2023-07-09T21:06:37.679 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-09T21:06:37.680 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} --verbose --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677 --name rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/orig.config.yaml 2023-07-09T21:06:37.722 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T21:06:37.821 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677 branch: wip-rishabh-2023Jul9 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} email: null first_in_suite: false job_id: '7331677' kernel: flavor: default kdb: true sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rishabh-2023Jul9 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 35b2d86cfd512f15ace2077050d20c8669933212 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 35b2d86cfd512f15ace2077050d20c8669933212 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul9 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 35b2d86cfd512f15ace2077050d20c8669933212 sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul9 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 35b2d86cfd512f15ace2077050d20c8669933212 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERKsNvOgLwrW0CMr6pA9qZNVRZX7CfRfVg1jgv2ijkdDXBkXubM9DoyudEAEhjwmuDGXfcvENuvjWzk3GW9qdE= smithi119.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgJr9Qx0DxQvngxPHLC6IpyukWKPiaqtFj+GfcqpF3VcO/XtZQuHPV/aCeu+oSMECMsqRmUOWvfYs/3btQqkG8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: b53f236c1077f1d295baafb9e0ca9a4b447019d7 timestamp: 2023-07-09_20:19:09 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-09T21:06:37.821 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa; will attempt to use it 2023-07-09T21:06:37.822 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa/tasks 2023-07-09T21:06:37.822 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-09T21:06:37.824 INFO:teuthology.task.internal:Checking packages... 2023-07-09T21:06:37.850 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '35b2d86cfd512f15ace2077050d20c8669933212' 2023-07-09T21:06:37.851 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-09T21:06:37.851 INFO:teuthology.packaging:ref: None 2023-07-09T21:06:37.851 INFO:teuthology.packaging:tag: None 2023-07-09T21:06:37.851 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul9 2023-07-09T21:06:37.852 INFO:teuthology.packaging:sha1: 35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:06:37.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rishabh-2023Jul9 2023-07-09T21:06:38.061 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:06:38.062 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-09T21:06:38.068 INFO:teuthology.task.internal:no buildpackages task found 2023-07-09T21:06:38.069 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-09T21:06:38.122 INFO:teuthology.task.internal:Saving configuration 2023-07-09T21:06:38.138 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-09T21:06:38.147 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T21:06:38.176 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:01:02.842369', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEMk/z6bqlbG7xTfwotDwKID+ATparrV4U5l/RWKwBr+'} 2023-07-09T21:06:38.200 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:01:02.840896', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL88O4F5FWKDZMYKiz90ehhfC6goDDdG8HugSgZKlmhH'} 2023-07-09T21:06:38.201 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-09T21:06:38.207 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-07-09T21:06:38.207 INFO:teuthology.task.internal:roles: ubuntu@smithi119.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-07-09T21:06:38.207 INFO:teuthology.run_tasks:Running task console_log... 2023-07-09T21:06:38.305 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9a81d90280>, signals=[15]) 2023-07-09T21:06:38.306 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-09T21:06:38.312 INFO:teuthology.task.internal:Opening connections... 2023-07-09T21:06:38.312 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:06:38.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:06:38.390 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:06:38.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:06:38.460 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-09T21:06:38.466 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-07-09T21:06:38.471 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-07-09T21:06:38.471 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-07-09T21:06:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-09T21:06:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="Ubuntu" 2023-07-09T21:06:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="22.04" 2023-07-09T21:06:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-09T21:06:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_CODENAME=jammy 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:ID=ubuntu 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE=debian 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-09T21:06:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:UBUNTU_CODENAME=jammy 2023-07-09T21:06:38.525 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-07-09T21:06:38.550 DEBUG:teuthology.orchestra.run.smithi119:> uname -m 2023-07-09T21:06:38.554 INFO:teuthology.orchestra.run.smithi119.stdout:x86_64 2023-07-09T21:06:38.554 DEBUG:teuthology.orchestra.run.smithi119:> cat /etc/os-release 2023-07-09T21:06:38.599 INFO:teuthology.orchestra.run.smithi119.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-07-09T21:06:38.600 INFO:teuthology.orchestra.run.smithi119.stdout:NAME="Ubuntu" 2023-07-09T21:06:38.600 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_ID="22.04" 2023-07-09T21:06:38.600 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-07-09T21:06:38.600 INFO:teuthology.orchestra.run.smithi119.stdout:VERSION_CODENAME=jammy 2023-07-09T21:06:38.600 INFO:teuthology.orchestra.run.smithi119.stdout:ID=ubuntu 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:ID_LIKE=debian 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:HOME_URL="https://www.ubuntu.com/" 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-07-09T21:06:38.601 INFO:teuthology.orchestra.run.smithi119.stdout:UBUNTU_CODENAME=jammy 2023-07-09T21:06:38.602 INFO:teuthology.lock.ops:Updating smithi119.front.sepia.ceph.com on lock server 2023-07-09T21:06:38.624 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-09T21:06:38.632 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-09T21:06:38.656 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-09T21:06:38.656 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-07-09T21:06:38.659 DEBUG:teuthology.orchestra.run.smithi119:> test '!' -e /home/ubuntu/cephtest 2023-07-09T21:06:38.663 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-09T21:06:38.680 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-09T21:06:38.681 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-07-09T21:06:38.705 DEBUG:teuthology.orchestra.run.smithi119:> test -z $(ls -A /var/lib/ceph) 2023-07-09T21:06:38.712 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-09T21:06:38.773 INFO:teuthology.run_tasks:Running task kernel... 2023-07-09T21:06:38.794 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'} 2023-07-09T21:06:38.795 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, timeout 300 2023-07-09T21:06:38.796 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T21:06:38.797 DEBUG:teuthology.orchestra.run.smithi119:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-09T21:06:38.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:06:38.803 DEBUG:teuthology.task.kernel:sha1 for mon.a is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:38.803 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T21:06:38.803 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-09T21:06:38.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:06:38.805 DEBUG:teuthology.task.kernel:sha1 for mon.b is 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:38.805 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "84139c18d56f518615369e8310ae4ecf07a36dcd"... 2023-07-09T21:06:38.806 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-07-09T21:06:38.851 INFO:teuthology.orchestra.run.smithi037.stdout:5.15.0-56-generic 2023-07-09T21:06:38.851 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:38.852 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T21:06:38.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:38.855 INFO:teuthology.orchestra.run.smithi119.stdout:5.15.0-56-generic 2023-07-09T21:06:38.855 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:38.855 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-09T21:06:38.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:06:39.006 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-07-09T21:06:39.007 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-09T21:06:39.019 INFO:teuthology.orchestra.run.smithi119.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-09T21:06:39.064 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-07-09T21:06:39.064 DEBUG:teuthology.orchestra.run.smithi037:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-07-09T21:06:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git config --global init.defaultBranch 2023-07-09T21:06:39.162 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-07-09T21:06:39.163 INFO:teuthology.orchestra.run.smithi119.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-09T21:06:39.163 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-09T21:06:39.163 INFO:teuthology.orchestra.run.smithi119.stderr:hint: 2023-07-09T21:06:39.163 INFO:teuthology.orchestra.run.smithi119.stderr:hint: git branch -m 2023-07-09T21:06:39.163 INFO:teuthology.orchestra.run.smithi119.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-09T21:06:39.165 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-09T21:06:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-07-09T21:06:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-07-09T21:06:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-07-09T21:06:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2023-07-09T21:06:39.206 INFO:teuthology.orchestra.run.smithi037.stderr:hint: git config --global init.defaultBranch 2023-07-09T21:06:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2023-07-09T21:06:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-07-09T21:06:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-07-09T21:06:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:hint: 2023-07-09T21:06:39.207 INFO:teuthology.orchestra.run.smithi037.stderr:hint: git branch -m 2023-07-09T21:06:39.208 INFO:teuthology.orchestra.run.smithi037.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-07-09T21:06:39.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-07-09T21:06:39.242 DEBUG:teuthology.orchestra.run.smithi119:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-09T21:06:39.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-07-09T21:06:39.296 DEBUG:teuthology.orchestra.run.smithi119:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-09T21:06:39.336 DEBUG:teuthology.orchestra.run.smithi037:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-07-09T21:07:47.791 INFO:teuthology.orchestra.run.smithi119.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-09T21:07:47.791 INFO:teuthology.orchestra.run.smithi119.stderr: * [new branch] main -> origin/main 2023-07-09T21:07:47.820 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190312 -> 20190312 2023-07-09T21:07:47.820 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190416 -> 20190416 2023-07-09T21:07:47.820 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190514 -> 20190514 2023-07-09T21:07:47.820 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190618 -> 20190618 2023-07-09T21:07:47.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190717 -> 20190717 2023-07-09T21:07:47.821 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190815 -> 20190815 2023-07-09T21:07:47.822 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20190923 -> 20190923 2023-07-09T21:07:47.822 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191022 -> 20191022 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20191215 -> 20191215 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200122 -> 20200122 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200316 -> 20200316 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200421 -> 20200421 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200519 -> 20200519 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200619 -> 20200619 2023-07-09T21:07:47.823 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200721 -> 20200721 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200817 -> 20200817 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20200918 -> 20200918 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201022 -> 20201022 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201118 -> 20201118 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20201218 -> 20201218 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210208 -> 20210208 2023-07-09T21:07:47.824 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210315 -> 20210315 2023-07-09T21:07:47.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210511 -> 20210511 2023-07-09T21:07:47.825 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210716 -> 20210716 2023-07-09T21:07:47.826 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210818 -> 20210818 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20210919 -> 20210919 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211027 -> 20211027 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20211216 -> 20211216 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220209 -> 20220209 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220310 -> 20220310 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220411 -> 20220411 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220509 -> 20220509 2023-07-09T21:07:47.827 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220610 -> 20220610 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220708 -> 20220708 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220815 -> 20220815 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20220913 -> 20220913 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221012 -> 20221012 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221109 -> 20221109 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20221214 -> 20221214 2023-07-09T21:07:47.828 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230117 -> 20230117 2023-07-09T21:07:47.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230210 -> 20230210 2023-07-09T21:07:47.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230310 -> 20230310 2023-07-09T21:07:47.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230404 -> 20230404 2023-07-09T21:07:47.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230515 -> 20230515 2023-07-09T21:07:47.829 INFO:teuthology.orchestra.run.smithi119.stderr: * [new tag] 20230625 -> 20230625 2023-07-09T21:07:50.902 INFO:teuthology.orchestra.run.smithi037.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-07-09T21:07:50.902 INFO:teuthology.orchestra.run.smithi037.stderr: * [new branch] main -> origin/main 2023-07-09T21:07:50.931 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190312 -> 20190312 2023-07-09T21:07:50.931 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190416 -> 20190416 2023-07-09T21:07:50.931 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190514 -> 20190514 2023-07-09T21:07:50.932 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190618 -> 20190618 2023-07-09T21:07:50.932 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190717 -> 20190717 2023-07-09T21:07:50.932 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190815 -> 20190815 2023-07-09T21:07:50.932 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20190923 -> 20190923 2023-07-09T21:07:50.934 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20191022 -> 20191022 2023-07-09T21:07:50.934 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20191215 -> 20191215 2023-07-09T21:07:50.934 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200122 -> 20200122 2023-07-09T21:07:50.934 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200316 -> 20200316 2023-07-09T21:07:50.934 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200421 -> 20200421 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200519 -> 20200519 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200619 -> 20200619 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200721 -> 20200721 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200817 -> 20200817 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20200918 -> 20200918 2023-07-09T21:07:50.935 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201022 -> 20201022 2023-07-09T21:07:50.936 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201118 -> 20201118 2023-07-09T21:07:50.936 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20201218 -> 20201218 2023-07-09T21:07:50.936 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210208 -> 20210208 2023-07-09T21:07:50.936 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210315 -> 20210315 2023-07-09T21:07:50.937 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210511 -> 20210511 2023-07-09T21:07:50.937 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210716 -> 20210716 2023-07-09T21:07:50.937 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210818 -> 20210818 2023-07-09T21:07:50.938 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20210919 -> 20210919 2023-07-09T21:07:50.941 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20211027 -> 20211027 2023-07-09T21:07:50.941 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20211216 -> 20211216 2023-07-09T21:07:50.941 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220209 -> 20220209 2023-07-09T21:07:50.942 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220310 -> 20220310 2023-07-09T21:07:50.942 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220411 -> 20220411 2023-07-09T21:07:50.942 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220509 -> 20220509 2023-07-09T21:07:50.942 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220610 -> 20220610 2023-07-09T21:07:50.943 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220708 -> 20220708 2023-07-09T21:07:50.943 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220815 -> 20220815 2023-07-09T21:07:50.943 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20220913 -> 20220913 2023-07-09T21:07:50.943 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221012 -> 20221012 2023-07-09T21:07:50.944 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221109 -> 20221109 2023-07-09T21:07:50.944 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20221214 -> 20221214 2023-07-09T21:07:50.944 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230117 -> 20230117 2023-07-09T21:07:50.944 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230210 -> 20230210 2023-07-09T21:07:50.945 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230310 -> 20230310 2023-07-09T21:07:50.945 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230404 -> 20230404 2023-07-09T21:07:50.945 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230515 -> 20230515 2023-07-09T21:07:50.945 INFO:teuthology.orchestra.run.smithi037.stderr: * [new tag] 20230625 -> 20230625 2023-07-09T21:07:51.109 INFO:teuthology.orchestra.run.smithi119.stderr:Updating files: 49% (1473/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1954/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 82% (2442/2977) Updating files: 82% (2443/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-09T21:07:51.113 INFO:teuthology.orchestra.run.smithi119.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-09T21:07:51.131 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on mon.b... 2023-07-09T21:07:51.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:07:51.277 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-09T21:07:51.277 DEBUG:teuthology.orchestra.run.smithi119:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-09T21:07:51.280 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-07-09T21:07:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09 21:07:53 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-09T21:07:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:FINISHED --2023-07-09 21:07:53-- 2023-07-09T21:07:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:Total wall clock time: 2.1s 2023-07-09T21:07:53.473 INFO:teuthology.orchestra.run.smithi119.stderr:Downloaded: 1 files, 37M in 1.9s (19.6 MB/s) 2023-07-09T21:07:53.476 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on mon.b... 2023-07-09T21:07:53.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo dpkg -i /tmp/linux-image.deb 2023-07-09T21:07:53.733 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-09T21:07:54.365 INFO:teuthology.orchestra.run.smithi037.stderr:Updating files: 47% (1420/2977) Updating files: 48% (1429/2977) Updating files: 49% (1459/2977) Updating files: 50% (1489/2977) Updating files: 51% (1519/2977) Updating files: 52% (1549/2977) Updating files: 53% (1578/2977) Updating files: 54% (1608/2977) Updating files: 55% (1638/2977) Updating files: 56% (1668/2977) Updating files: 57% (1697/2977) Updating files: 58% (1727/2977) Updating files: 59% (1757/2977) Updating files: 60% (1787/2977) Updating files: 61% (1816/2977) Updating files: 62% (1846/2977) Updating files: 63% (1876/2977) Updating files: 64% (1906/2977) Updating files: 65% (1936/2977) Updating files: 65% (1952/2977) Updating files: 66% (1965/2977) Updating files: 67% (1995/2977) Updating files: 68% (2025/2977) Updating files: 69% (2055/2977) Updating files: 70% (2084/2977) Updating files: 71% (2114/2977) Updating files: 72% (2144/2977) Updating files: 73% (2174/2977) Updating files: 74% (2203/2977) Updating files: 75% (2233/2977) Updating files: 76% (2263/2977) Updating files: 77% (2293/2977) Updating files: 78% (2323/2977) Updating files: 79% (2352/2977) Updating files: 80% (2382/2977) Updating files: 81% (2412/2977) Updating files: 81% (2429/2977) Updating files: 82% (2442/2977) Updating files: 83% (2471/2977) Updating files: 84% (2501/2977) Updating files: 85% (2531/2977) Updating files: 86% (2561/2977) Updating files: 87% (2590/2977) Updating files: 88% (2620/2977) Updating files: 89% (2650/2977) Updating files: 90% (2680/2977) Updating files: 91% (2710/2977) Updating files: 92% (2739/2977) Updating files: 93% (2769/2977) Updating files: 94% (2799/2977) Updating files: 95% (2829/2977) Updating files: 96% (2858/2977) Updating files: 97% (2888/2977) Updating files: 98% (2918/2977) Updating files: 99% (2948/2977) Updating files: 100% (2977/2977) Updating files: 100% (2977/2977), done. 2023-07-09T21:07:54.369 INFO:teuthology.orchestra.run.smithi037.stdout:HEAD is now at d3f66064 Partially revert "amdgpu: DMCUB updates for DCN 3.1.4 and 3.1.5" 2023-07-09T21:07:54.389 INFO:teuthology.task.kernel:Downloading kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on mon.a... 2023-07-09T21:07:54.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=84139c18d56f518615369e8310ae4ecf07a36dcd 2023-07-09T21:07:54.609 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ 2023-07-09T21:07:54.609 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/ --input-file=- 2023-07-09T21:07:54.612 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-07-09T21:07:55.739 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-09T21:07:55.744 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-09T21:07:55.851 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T21:07:56.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09 21:07:56 URL:https://3.chacra.ceph.com/r/kernel/testing/84139c18d56f518615369e8310ae4ecf07a36dcd/ubuntu/jammy/flavors/default/pool/main/l/linux-6.4.0-g84139c18d56f/linux-image-6.4.0-g84139c18d56f_6.4.0-g84139c18d56f-1_amd64.deb [38588998/38588998] -> "/tmp/linux-image.deb" [1] 2023-07-09T21:07:56.124 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2023-07-09 21:07:56-- 2023-07-09T21:07:56.125 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 1.5s 2023-07-09T21:07:56.125 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 37M in 1.4s (27.1 MB/s) 2023-07-09T21:07:56.127 INFO:teuthology.task.kernel:Installing kernel 84139c18d56f518615369e8310ae4ecf07a36dcd on mon.a... 2023-07-09T21:07:56.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo dpkg -i /tmp/linux-image.deb 2023-07-09T21:07:56.384 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package linux-image-6.4.0-g84139c18d56f. 2023-07-09T21:07:58.358 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-07-09T21:07:58.362 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-07-09T21:07:58.463 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T21:07:59.340 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T21:07:59.457 INFO:teuthology.orchestra.run.smithi119.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:01.733 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up linux-image-6.4.0-g84139c18d56f (6.4.0-g84139c18d56f-1) ... 2023-07-09T21:08:01.847 INFO:teuthology.orchestra.run.smithi037.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:18.655 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-07-09T21:08:18.672 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T21:08:18.685 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-07-09T21:08:18.988 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:19.006 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:19.323 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T21:08:19.331 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T21:08:19.390 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T21:08:19.396 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T21:08:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T21:08:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T21:08:19.538 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T21:08:19.596 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-07-09T21:08:19.783 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-deb -c /tmp/linux-image.deb 2023-07-09T21:08:19.791 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-09T21:08:19.792 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-09T21:08:19.792 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:08:19.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-09T21:08:19.803 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:19.823 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-09T21:08:19.824 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-09T21:08:19.824 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-09T21:08:19.824 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-09T21:08:19.824 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-09T21:08:19.825 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T21:08:19.826 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T21:08:19.827 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T21:08:19.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T21:08:19.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T21:08:19.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T21:08:19.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T21:08:19.828 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-09T21:08:19.829 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-09T21:08:19.830 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-09T21:08:19.830 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T21:08:19.850 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-09T21:08:19.851 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T21:08:19.852 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T21:08:19.853 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T21:08:19.854 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T21:08:19.855 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T21:08:19.856 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T21:08:19.857 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T21:08:19.858 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-09T21:08:19.859 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T21:08:19.860 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T21:08:19.861 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T21:08:19.862 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T21:08:19.863 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T21:08:19.864 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T21:08:19.865 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T21:08:19.866 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T21:08:19.867 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T21:08:19.868 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-09T21:08:19.869 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T21:08:19.870 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-09T21:08:19.871 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T21:08:19.872 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T21:08:19.873 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T21:08:19.874 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-09T21:08:19.875 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-09T21:08:19.876 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-09T21:08:19.876 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-09T21:08:19.876 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-09T21:08:19.876 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-09T21:08:19.876 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T21:08:19.877 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-09T21:08:19.878 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-09T21:08:19.879 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T21:08:19.880 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T21:08:19.881 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T21:08:19.882 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-09T21:08:19.883 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T21:08:19.884 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-09T21:08:19.885 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-09T21:08:19.886 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-09T21:08:19.887 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-09T21:08:19.888 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-09T21:08:19.889 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T21:08:19.890 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T21:08:19.891 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T21:08:19.892 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T21:08:19.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-09T21:08:19.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T21:08:19.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T21:08:19.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-09T21:08:19.893 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T21:08:19.894 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T21:08:19.895 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T21:08:19.896 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T21:08:19.897 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T21:08:19.898 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T21:08:19.899 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-09T21:08:19.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T21:08:19.900 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-09T21:08:19.900 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-09T21:08:19.943 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T21:08:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T21:08:19.945 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T21:08:19.946 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T21:08:19.947 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T21:08:19.948 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T21:08:19.949 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-09T21:08:19.950 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T21:08:19.951 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T21:08:19.952 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T21:08:19.953 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T21:08:19.954 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T21:08:19.955 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T21:08:19.956 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T21:08:19.957 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T21:08:19.958 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T21:08:19.959 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T21:08:19.960 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T21:08:19.961 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T21:08:19.962 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T21:08:19.963 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-09T21:08:19.964 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-09T21:08:19.965 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T21:08:19.966 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T21:08:19.967 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T21:08:19.968 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-09T21:08:19.969 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-09T21:08:19.970 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T21:08:19.971 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T21:08:19.972 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T21:08:19.973 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T21:08:19.974 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T21:08:19.975 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-09T21:08:19.976 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-09T21:08:19.977 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T21:08:19.978 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T21:08:19.979 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-09T21:08:19.980 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T21:08:19.981 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-09T21:08:19.982 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-09T21:08:19.983 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-09T21:08:19.984 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T21:08:19.985 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-09T21:08:19.986 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-09T21:08:19.987 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-09T21:08:19.988 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-09T21:08:19.989 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T21:08:19.990 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-09T21:08:19.991 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-09T21:08:19.992 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-09T21:08:19.993 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-09T21:08:19.994 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T21:08:19.995 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T21:08:19.996 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-09T21:08:19.997 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T21:08:19.998 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-09T21:08:19.999 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T21:08:20.000 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T21:08:20.001 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T21:08:20.002 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-09T21:08:20.003 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T21:08:20.004 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T21:08:20.005 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-09T21:08:20.006 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T21:08:20.007 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-09T21:08:20.008 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T21:08:20.009 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T21:08:20.010 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T21:08:20.011 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-09T21:08:20.012 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-09T21:08:20.013 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-09T21:08:20.014 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-09T21:08:20.015 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T21:08:20.016 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T21:08:20.017 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T21:08:20.018 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-09T21:08:20.019 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T21:08:20.020 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T21:08:20.021 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-09T21:08:20.022 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-09T21:08:20.023 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T21:08:20.024 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T21:08:20.025 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-09T21:08:20.026 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T21:08:20.027 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T21:08:20.028 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-09T21:08:20.029 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T21:08:20.030 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T21:08:20.031 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T21:08:20.032 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-09T21:08:20.033 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T21:08:20.034 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T21:08:20.035 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T21:08:20.036 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T21:08:20.037 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-09T21:08:20.038 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-09T21:08:20.039 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-09T21:08:20.040 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-09T21:08:20.041 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-09T21:08:20.041 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-09T21:08:20.041 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-09T21:08:20.041 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-09T21:08:20.041 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T21:08:20.042 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T21:08:20.043 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T21:08:20.044 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T21:08:20.045 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-09T21:08:20.046 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-09T21:08:20.047 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-09T21:08:20.048 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-09T21:08:20.049 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T21:08:20.050 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-09T21:08:20.051 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-09T21:08:20.052 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-09T21:08:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T21:08:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T21:08:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T21:08:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T21:08:20.053 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T21:08:20.054 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-09T21:08:20.055 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T21:08:20.056 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-09T21:08:20.057 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T21:08:20.057 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-09T21:08:20.057 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T21:08:20.057 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T21:08:20.057 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T21:08:20.058 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T21:08:20.059 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T21:08:20.059 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-09T21:08:20.059 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T21:08:20.059 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-09T21:08:20.059 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-09T21:08:20.060 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-09T21:08:20.060 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-09T21:08:20.060 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T21:08:20.061 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-09T21:08:20.061 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T21:08:20.061 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T21:08:20.061 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T21:08:20.062 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T21:08:20.062 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T21:08:20.062 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-09T21:08:20.062 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-09T21:08:20.063 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-09T21:08:20.064 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T21:08:20.064 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-09T21:08:20.064 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T21:08:20.064 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T21:08:20.065 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T21:08:20.066 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T21:08:20.067 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-09T21:08:20.068 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T21:08:20.068 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T21:08:20.068 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-09T21:08:20.068 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-09T21:08:20.068 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T21:08:20.069 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-09T21:08:20.070 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T21:08:20.136 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T21:08:20.136 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T21:08:20.136 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T21:08:20.137 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-09T21:08:20.138 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T21:08:20.139 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T21:08:20.140 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T21:08:20.141 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-09T21:08:20.142 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T21:08:20.143 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-09T21:08:20.144 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T21:08:20.145 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T21:08:20.146 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T21:08:20.147 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-09T21:08:20.148 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T21:08:20.149 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T21:08:20.150 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T21:08:20.151 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-09T21:08:20.152 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-09T21:08:20.153 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-09T21:08:20.154 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-09T21:08:20.155 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-09T21:08:20.156 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-09T21:08:20.157 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-09T21:08:20.158 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-09T21:08:20.159 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-09T21:08:20.160 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-09T21:08:20.161 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-09T21:08:20.162 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T21:08:20.163 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T21:08:20.164 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-09T21:08:20.165 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T21:08:20.166 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T21:08:20.167 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T21:08:20.168 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T21:08:20.169 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T21:08:20.170 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T21:08:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T21:08:20.172 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T21:08:20.173 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T21:08:20.174 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-09T21:08:20.175 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T21:08:20.176 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-09T21:08:20.177 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-09T21:08:20.178 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T21:08:20.179 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-09T21:08:20.180 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T21:08:20.181 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T21:08:20.182 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T21:08:20.183 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T21:08:20.184 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-09T21:08:20.185 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-09T21:08:20.186 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T21:08:20.187 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T21:08:20.188 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T21:08:20.189 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-09T21:08:20.190 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T21:08:20.191 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T21:08:20.192 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-09T21:08:20.193 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T21:08:20.194 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T21:08:20.195 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T21:08:20.196 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-09T21:08:20.197 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T21:08:20.198 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-09T21:08:20.199 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T21:08:20.200 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T21:08:20.201 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T21:08:20.202 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T21:08:20.203 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T21:08:20.204 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T21:08:20.205 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-09T21:08:20.206 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-09T21:08:20.207 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-09T21:08:20.208 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-09T21:08:20.209 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-09T21:08:20.210 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-09T21:08:20.211 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T21:08:20.212 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-09T21:08:20.213 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-09T21:08:20.214 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-09T21:08:20.215 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T21:08:20.216 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T21:08:20.217 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-09T21:08:20.218 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-09T21:08:20.219 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T21:08:20.220 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T21:08:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T21:08:20.222 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T21:08:20.223 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T21:08:20.224 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T21:08:20.225 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T21:08:20.226 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T21:08:20.227 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-09T21:08:20.228 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T21:08:20.229 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-09T21:08:20.230 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T21:08:20.231 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T21:08:20.232 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T21:08:20.233 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-09T21:08:20.234 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T21:08:20.235 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T21:08:20.236 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T21:08:20.237 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T21:08:20.238 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T21:08:20.239 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-09T21:08:20.240 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T21:08:20.241 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T21:08:20.242 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T21:08:20.243 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T21:08:20.244 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T21:08:20.245 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T21:08:20.246 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T21:08:20.247 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-09T21:08:20.248 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T21:08:20.249 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-09T21:08:20.250 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T21:08:20.251 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T21:08:20.252 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T21:08:20.253 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T21:08:20.254 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T21:08:20.255 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T21:08:20.256 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T21:08:20.257 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T21:08:20.258 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T21:08:20.259 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T21:08:20.260 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T21:08:20.261 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-09T21:08:20.262 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T21:08:20.263 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T21:08:20.264 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T21:08:20.265 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T21:08:20.266 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T21:08:20.267 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T21:08:20.268 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-09T21:08:20.269 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T21:08:20.270 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T21:08:20.271 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-09T21:08:20.272 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T21:08:20.273 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-09T21:08:20.274 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-09T21:08:20.275 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-09T21:08:20.275 INFO:teuthology.orchestra.run.smithi119.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-09T21:08:20.275 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-09T21:08:20.275 INFO:teuthology.orchestra.run.smithi119.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-09T21:08:20.276 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T21:08:20.276 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-09T21:08:20.276 DEBUG:teuthology.orchestra.run.smithi119:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-09T21:08:20.283 INFO:teuthology.orchestra.run.smithi119.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:20.284 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:20.284 INFO:teuthology.orchestra.run.smithi119.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:20.284 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-09T21:08:20.284 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-09T21:08:20.285 DEBUG:teuthology.orchestra.run.smithi119:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-09T21:08:20.328 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi119.front.sepia.ceph.com to complete... 2023-07-09T21:08:20.721 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub' 2023-07-09T21:08:20.721 INFO:teuthology.orchestra.run.smithi119.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T21:08:20.746 INFO:teuthology.orchestra.run.smithi119.stderr:Generating grub configuration file ... 2023-07-09T21:08:20.928 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:20.934 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2023-07-09T21:08:21.077 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T21:08:21.097 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-07-09T21:08:21.221 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T21:08:21.226 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T21:08:21.267 INFO:teuthology.orchestra.run.smithi119.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T21:08:21.272 INFO:teuthology.orchestra.run.smithi119.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T21:08:21.395 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T21:08:21.396 INFO:teuthology.orchestra.run.smithi119.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T21:08:21.396 INFO:teuthology.orchestra.run.smithi119.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T21:08:21.413 INFO:teuthology.orchestra.run.smithi119.stderr:done 2023-07-09T21:08:21.413 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:21.432 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:21.702 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T21:08:21.709 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T21:08:21.778 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T21:08:21.784 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T21:08:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T21:08:21.929 INFO:teuthology.orchestra.run.smithi037.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T21:08:21.930 INFO:teuthology.orchestra.run.smithi037.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T21:08:21.979 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-07-09T21:08:22.163 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-deb -c /tmp/linux-image.deb 2023-07-09T21:08:22.171 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./ 2023-07-09T21:08:22.172 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./boot/ 2023-07-09T21:08:22.172 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 4323582 2023-06-30 10:38 ./boot/System.map-6.4.0-g84139c18d56f 2023-07-09T21:08:22.184 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 167337 2023-06-30 10:38 ./boot/config-6.4.0-g84139c18d56f 2023-07-09T21:08:22.185 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11237632 2023-06-30 10:38 ./boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/ 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/ 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postinst.d/ 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/postrm.d/ 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/preinst.d/ 2023-07-09T21:08:22.204 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./etc/kernel/prerm.d/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/ 2023-07-09T21:08:22.205 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ 2023-07-09T21:08:22.206 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 490385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/aesni-intel.ko 2023-07-09T21:08:22.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-09T21:08:22.207 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 92385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 106729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 152241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-09T21:08:22.208 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-09T21:08:22.209 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/ 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/ 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/ 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/cpuid.ko 2023-07-09T21:08:22.210 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kernel/msr.ko 2023-07-09T21:08:22.211 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/ 2023-07-09T21:08:22.211 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 346513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-09T21:08:22.211 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 972233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-09T21:08:22.211 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2209953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/arch/x86/kvm/kvm.ko 2023-07-09T21:08:22.214 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ 2023-07-09T21:08:22.214 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/af_alg.ko 2023-07-09T21:08:22.214 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_hash.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/algif_skcipher.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ansi_cprng.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/anubis.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/arc4.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/ 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-07-09T21:08:22.215 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/ 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_memcpy.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_pq.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_tx.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/async_xor.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/async_tx/raid6test.ko 2023-07-09T21:08:22.216 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authenc.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/authencesn.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blake2b_generic.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_common.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/blowfish_generic.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/camellia_generic.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast5_generic.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast6_generic.ko 2023-07-09T21:08:22.217 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cast_common.ko 2023-07-09T21:08:22.218 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/ccm.ko 2023-07-09T21:08:22.218 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cmac.ko 2023-07-09T21:08:22.218 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crc32_generic.ko 2023-07-09T21:08:22.218 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cryptd.ko 2023-07-09T21:08:22.218 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_engine.ko 2023-07-09T21:08:22.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_simd.ko 2023-07-09T21:08:22.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/crypto_user.ko 2023-07-09T21:08:22.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/cts.ko 2023-07-09T21:08:22.223 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/des_generic.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/dh_generic.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/echainiv.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/essiv.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/fcrypt.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/khazad.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lrw.ko 2023-07-09T21:08:22.224 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/lz4hc.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/md4.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/michael_mic.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcbc.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/pcrypt.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/rmd160.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/seed.ko 2023-07-09T21:08:22.225 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/serpent_generic.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 149193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tcrypt.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/tea.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_common.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/twofish_generic.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/vmac.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/wp512.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xcbc.ko 2023-07-09T21:08:22.226 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xor.ko 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xts.ko 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/crypto/xxhash_generic.ko 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_extlog.ko 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-09T21:08:22.227 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/acpi_pad.ko 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/ 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/apei/einj.ko 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/ec_sys.ko 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/platform_profile.ko 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbs.ko 2023-07-09T21:08:22.228 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/sbshc.ko 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 98369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/acpi/video.ko 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/acard-ahci.ko 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 88625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci.ko 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/ahci_platform.ko 2023-07-09T21:08:22.229 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/libahci_platform.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_acpi.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ali.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_amd.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_artop.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atiixp.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_atp867x.ko 2023-07-09T21:08:22.230 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd640.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cmd64x.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_cypress.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_efar.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt366.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt37x.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-09T21:08:22.231 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it8213.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_it821x.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_jmicron.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_legacy.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_marvell.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_mpiix.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_netcell.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ninja32.ko 2023-07-09T21:08:22.232 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87410.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_ns87415.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_oldpiix.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_opti.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_optidma.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pcmcia.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-09T21:08:22.233 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_piccolo.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_radisys.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rdc.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_rz1000.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sch.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_serverworks.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sil680.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_sl82c105.ko 2023-07-09T21:08:22.234 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_triflex.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pata_via.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/pdc_adma.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_inic162x.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_mv.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_nv.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_promise.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_qstor.ko 2023-07-09T21:08:22.235 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sil24.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sis.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_svw.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_sx4.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_uli.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_via.ko 2023-07-09T21:08:22.236 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ata/sata_vsc.ko 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/auxdisplay/ks0108.ko 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/ 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/bcma/bcma.ko 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/ 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/ 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 113617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/aoe/aoe.ko 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/ 2023-07-09T21:08:22.237 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 968129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/drbd/drbd.ko 2023-07-09T21:08:22.238 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 173225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/floppy.ko 2023-07-09T21:08:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/ 2023-07-09T21:08:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-09T21:08:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/nbd.ko 2023-07-09T21:08:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/ 2023-07-09T21:08:22.260 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 110361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/null_blk/null_blk.ko 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/pktcdvd.ko 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 257529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/rbd.ko 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/ 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 98193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/ 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/block/zram/zram.ko 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ 2023-07-09T21:08:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/applicom.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hangcheck-timer.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/ 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/via-rng.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-09T21:08:22.262 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 147705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 139057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-09T21:08:22.263 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/lp.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/ 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/mwave/mwave.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/nvram.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/ppdev.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tlclk.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/ 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-09T21:08:22.264 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/ 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_class.ko 2023-07-09T21:08:22.265 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_core.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/ 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-palmas.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-si5351.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-twl6040.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/clk/clk-wm831x.ko 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/ 2023-07-09T21:08:22.266 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 231713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/ccp/ccp.ko 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/ 2023-07-09T21:08:22.267 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/ 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/ 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 396457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-aes.ko 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/padlock-sha.ko 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/ 2023-07-09T21:08:22.268 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/ 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dca/dca.ko 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/ 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ 2023-07-09T21:08:22.269 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/amd64_edac.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/e752x_edac.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/edac_mce_amd.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3000_edac.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i3200_edac.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5100_edac.ko 2023-07-09T21:08:22.270 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i5400_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7300_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i7core_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/i82975x_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/ie31200_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/sb_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/edac/x38_edac.ko 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/ 2023-07-09T21:08:22.271 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-gpio.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max14577.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max77693.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-max8997.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-palmas.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-rt8973a.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/extcon/extcon-sm5502.ko 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/ 2023-07-09T21:08:22.272 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/dmi-sysfs.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/ 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/efi/efi-pstore.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/ 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-adp5520.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-amd8111.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-arizona.ko 2023-07-09T21:08:22.273 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9052.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-da9055.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-dln2.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-f7188x.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-generic.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ich.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-kempld.ko 2023-07-09T21:08:22.274 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-lp3943.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max7300.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max730x.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-max732x.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pca953x.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-pcf857x.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-rdc321x.ko 2023-07-09T21:08:22.275 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-sch311x.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-tps65912.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl4030.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-twl6040.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-vx855.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm831x.ko 2023-07-09T21:08:22.276 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8350.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/gpio/gpio-wm8994.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/ 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-a4tech.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-apple.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-appleir.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-aureal.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-axff.ko 2023-07-09T21:08:22.277 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-belkin.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cherry.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-chicony.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cp2112.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-cypress.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-dr.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elecom.ko 2023-07-09T21:08:22.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-elo.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-emsff.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ezkey.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gaff.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-generic.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gt683r.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-gyration.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-09T21:08:22.279 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-holtekff.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-hyperv.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-icade.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kensington.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-keytouch.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-kye.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lcpower.ko 2023-07-09T21:08:22.280 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-led.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lenovo.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-lg-g15.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-logitech.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-magicmouse.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-microsoft.ko 2023-07-09T21:08:22.281 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-monterey.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-multitouch.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ntrig.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-ortek.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-penmount.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-petalynx.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-picolcd.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-pl.ko 2023-07-09T21:08:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-plantronics.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-primax.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-rmi.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-common.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-09T21:08:22.283 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-roccat.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-saitek.ko 2023-07-09T21:08:22.284 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-samsung.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sjoy.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sony.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-speedlink.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-steelseries.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-sunplus.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-09T21:08:22.285 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tivo.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-tmff.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-topseed.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-twinhan.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-uclogic.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-waltop.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 143585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-wiimote.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-xinmo.ko 2023-07-09T21:08:22.286 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zpff.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid-zydacron.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 261881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/hid.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/uhid.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/ 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 125425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbhid.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbkbd.ko 2023-07-09T21:08:22.287 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/usbhid/usbmouse.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 217401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hid/wacom.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/ 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_balloon.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_utils.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 292697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hv/hv_vmbus.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru.ko 2023-07-09T21:08:22.288 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/abituguru3.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7414.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ad7418.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adc128d818.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1025.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1026.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1029.ko 2023-07-09T21:08:22.289 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm1031.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adm9240.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ads7828.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7410.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7411.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7462.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7470.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7475.ko 2023-07-09T21:08:22.290 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/adt7x10.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/amc6821.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/applesmc.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asb100.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asc7621.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/atxp1.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/coretemp.ko 2023-07-09T21:08:22.291 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9052-hwmon.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/da9055-hwmon.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/dme1737.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds1621.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ds620.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc1403.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc2103.ko 2023-07-09T21:08:22.292 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/emc6w201.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71805f.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f71882fg.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/f75375s.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fam15h_power.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/fschmd.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g760a.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/g762.ko 2023-07-09T21:08:22.293 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl518sm.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/gl520sm.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hih6130.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5500_temp.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/i5k_amb.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmaem.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ibmpex.ko 2023-07-09T21:08:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina209.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ina2xx.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/it87.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/jc42.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k10temp.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/k8temp.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lineage-pem.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm63.ko 2023-07-09T21:08:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm73.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm75.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm77.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm78.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm80.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm83.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm85.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm87.ko 2023-07-09T21:08:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm90.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm92.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm93.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95234.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95241.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/lm95245.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc2945.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4151.ko 2023-07-09T21:08:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4215.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4222.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4245.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4260.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/ltc4261.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max16065.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1619.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max1668.ko 2023-07-09T21:08:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max197.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6639.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6650.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/max6697.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mc13783-adc.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/mcp3021.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6683.ko 2023-07-09T21:08:22.299 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775-core.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct6775.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/nct7802.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 82337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87360.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pc87427.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pcf8591.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-09T21:08:22.300 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 79465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-09T21:08:22.301 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/powr1220.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5627.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch5636.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht15.ko 2023-07-09T21:08:22.302 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sht21.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/shtc1.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/sis5595.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smm665.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47b397.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m1.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/smsc47m192.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/thmc50.ko 2023-07-09T21:08:22.303 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp102.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp103.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp401.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/tmp421.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via-cputemp.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/via686a.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt1211.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/vt8231.ko 2023-07-09T21:08:22.304 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627ehf.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83627hf.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83781d.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83791d.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83792d.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83793.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83795.ko 2023-07-09T21:08:22.305 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l785ts.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/w83l786ng.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/ 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/ 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-09T21:08:22.306 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/ 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-07-09T21:08:22.307 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-07-09T21:08:22.308 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-09T21:08:22.309 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-09T21:08:22.310 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-mux.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-smbus.ko 2023-07-09T21:08:22.311 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/i2c-stub.ko 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/ 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 264521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-09T21:08:22.312 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 849289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_core.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 320385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 271697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/ 2023-07-09T21:08:22.313 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 492561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-09T21:08:22.314 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/ 2023-07-09T21:08:22.314 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 419217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/ 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 738161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 296665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ 2023-07-09T21:08:22.337 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 153681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/ 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 169017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 263177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ 2023-07-09T21:08:22.338 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 111993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ 2023-07-09T21:08:22.339 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/evbug.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/ff-memless.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/gameport.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/lightning.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/gameport/ns558.ko 2023-07-09T21:08:22.340 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/joydev.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/ 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-09T21:08:22.341 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lkkbd.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8323.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/lm8333.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-07-09T21:08:22.342 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/newtonkbd.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt1070.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/qt2160.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/stowaway.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/sunkbd.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-07-09T21:08:22.343 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/keyboard/xtkbd.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/matrix-keymap.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/ 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/appletouch.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/bcm5974.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 123681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/cyapatp.ko 2023-07-09T21:08:22.344 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/gpio_mouse.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 334505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/psmouse.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/sermouse.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/ 2023-07-09T21:08:22.345 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/altera_ps2.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/arc_ps2.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ct82c710.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/parkbd.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/pcips2.ko 2023-07-09T21:08:22.346 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/ps2mult.ko 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serio_raw.ko 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/serio/serport.ko 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/input/sparse-keymap.ko 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/ 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/ 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/ 2023-07-09T21:08:22.347 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-88pm860x.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-adp5520.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-bd2802.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-blinkm.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da903x.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-da9052.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-gpio.ko 2023-07-09T21:08:22.348 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3530.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3533.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm355x.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lm3642.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp3944.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-lp8788.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-max8997.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-mc13783.ko 2023-07-09T21:08:22.349 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-menf21bmc.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca9532.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca955x.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-pca963x.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-ss4200.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-tca6507.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm831x-status.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/leds-wm8350.ko 2023-07-09T21:08:22.350 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-09T21:08:22.351 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/ 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/ 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 631833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/bcache/bcache.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bio-prison.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 86145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-bufio.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache-smq.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 154273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-cache.ko 2023-07-09T21:08:22.352 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-crypt.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-delay.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-era.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-flakey.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log-userspace.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-log.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-mirror.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-multipath.ko 2023-07-09T21:08:22.353 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-queue-length.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-raid.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-region-hash.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-round-robin.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-service-time.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-snapshot.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-switch.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 182185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-thin-pool.ko 2023-07-09T21:08:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-verity.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/dm-zero.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/faulty.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/linear.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/multipath.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/ 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 192841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid0.ko 2023-07-09T21:08:22.355 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 111465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid1.ko 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 157993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid10.ko 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 392889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/md/raid456.ko 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/ 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/ 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 174497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptbase.ko 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptctl.ko 2023-07-09T21:08:22.356 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptfc.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptlan.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 123305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptsas.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptscsih.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/message/fusion/mptspi.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm800.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm805.ko 2023-07-09T21:08:22.357 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/88pm80x.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona-i2c.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 121833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/arizona.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/bcm590xx.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/cros_ec_dev.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/dln2.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/janz-cmodio.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/kempld-core.ko 2023-07-09T21:08:22.358 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-core.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lp3943.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_ich.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/lpc_sch.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/max8907.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-core.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-07-09T21:08:22.359 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/menf21bmc.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-adc.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633-gpio.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/pcf50633.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/retu-mfd.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/si476x-core.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/sm501.ko 2023-07-09T21:08:22.360 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps65010.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/tps6507x.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/viperboard.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/vx855.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wl1273-core.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/mfd/wm8994.ko 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ 2023-07-09T21:08:22.361 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ad525x_dpot.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/ 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds9802als.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/apds990x.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/bh1770glc.ko 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/ 2023-07-09T21:08:22.362 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/c2port/core.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/ 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/cb710/cb710.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ds1682.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/dummy-irq.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/ 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/echo/echo.ko 2023-07-09T21:08:22.363 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/ 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/at24.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/eeprom/max6875.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/enclosure.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/ 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 152073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-07-09T21:08:22.364 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hmc6352.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/hpilo.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ics932s401.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29003.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/isl29020.ko 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/ 2023-07-09T21:08:22.365 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/ 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-me.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei-txe.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 304465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/mei/mei.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/phantom.ko 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/ 2023-07-09T21:08:22.366 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/ti-st/st_drv.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_7xx1.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tifm_core.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/tsl2550.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_balloon.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/ 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 180817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ 2023-07-09T21:08:22.367 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/ 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 487993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/bonding/bonding.ko 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/ 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/ 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-09T21:08:22.368 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/ 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 447289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/dummy.ko 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/eql.ko 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/ 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-09T21:08:22.369 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 130489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/ 2023-07-09T21:08:22.370 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/ 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/ 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/ 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/ 2023-07-09T21:08:22.371 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/ 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/ 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-09T21:08:22.372 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/ 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/ 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 176817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-09T21:08:22.373 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1422209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 127993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/ 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 312097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/ 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/ 2023-07-09T21:08:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 323601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/ 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 193433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 345929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-07-09T21:08:22.375 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1038969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 166113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/ 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/ 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 203537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-09T21:08:22.376 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/ 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/ 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 141161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-09T21:08:22.377 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/ 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/dnet.ko 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ec_bhf.ko 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/ 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/ 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 281033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-09T21:08:22.378 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ethoc.ko 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fealnx.ko 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/ 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 90465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/ 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 295713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-09T21:08:22.379 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/ 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 584001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/ 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 246321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/ 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 922401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/ 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 301689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-09T21:08:22.380 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/ 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 514641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/ 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 93593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 734081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 151865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-09T21:08:22.381 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 86921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/jme.ko 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/ 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/ 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 710481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-09T21:08:22.382 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 280513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1054153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-07-09T21:08:22.383 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 95665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/ 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-09T21:08:22.384 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/ 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 150905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/ 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 136785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/ 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/ 2023-07-09T21:08:22.385 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 227113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 671393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/ 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/ 2023-07-09T21:08:22.386 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 189817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/ 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/ 2023-07-09T21:08:22.387 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 893097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/ 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/ 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/ 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-09T21:08:22.388 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/ 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-07-09T21:08:22.389 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 480865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/ 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 166121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/ 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-09T21:08:22.390 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/ 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 86465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/ 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/ 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-09T21:08:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/ 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/ 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/defxx.ko 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/ 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 216913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/fddi/skfp/skfp.ko 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/geneve.ko 2023-07-09T21:08:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/ 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 234553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/ 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ifb.ko 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvlan.ko 2023-07-09T21:08:22.393 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/macvtap.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/ 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio/mdio-gpio.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mdio.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/mii.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/netconsole.ko 2023-07-09T21:08:22.394 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/nlmon.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/ 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/amd.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-09T21:08:22.395 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/bcm87xx.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/broadcom.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/cicada.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/davicom.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/et1011c.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/icplus.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/lxt.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/marvell.ko 2023-07-09T21:08:22.396 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/micrel.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/national.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 92249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/phylink.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/qsemi.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/realtek.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/smsc.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/ste10Xp.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/phy/vitesse.ko 2023-07-09T21:08:22.397 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/ 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/plip/plip.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_async.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-09T21:08:22.398 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppoe.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pppox.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/ppp/pptp.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sb1000.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/ 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/slip/slip.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/sungem_phy.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/tap.ko 2023-07-09T21:08:22.399 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/ 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_random.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/veth.ko 2023-07-09T21:08:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/ 2023-07-09T21:08:22.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-09T21:08:22.401 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/ 2023-07-09T21:08:22.401 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 290161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/vxlan/vxlan.ko 2023-07-09T21:08:22.435 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/ 2023-07-09T21:08:22.435 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 143801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-09T21:08:22.435 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ntb/ntb.ko 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/ 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/ 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 256953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme-core.ko 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/nvme/host/nvme.ko 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/ 2023-07-09T21:08:22.436 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 129129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_cs.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_pc.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/parport/parport_serial.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/ 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/ 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-07-09T21:08:22.437 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/pci-stub.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pci/xen-pcifront.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/ 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/i82092.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 143713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_core.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-07-09T21:08:22.438 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/pd6729.ko 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 112913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/ 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/ 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/ 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/ 2023-07-09T21:08:22.439 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/ 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/ 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/ 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec.ko 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-07-09T21:08:22.440 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/acerhdf.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-09T21:08:22.441 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 106393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-09T21:08:22.442 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/hdaps.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/ibm_rtl.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/ 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/intel_ips.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-09T21:08:22.443 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/platform/x86/wmi.ko 2023-07-09T21:08:22.444 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/ 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_battery.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/88pm860x_charger.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq2415x_charger.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24190_charger.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/bq24735-charger.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-07-09T21:08:22.445 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9030_battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/da9052-battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2760_battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2780_battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2781_battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/ds2782_battery.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/gpio-charger.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/isp1704_charger.ko 2023-07-09T21:08:22.446 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/lp8727_charger.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max14577_charger.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17040_battery.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max17042_battery.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8903_charger.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/max8925_power.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/pcf50633-charger.ko 2023-07-09T21:08:22.447 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/sbs-battery.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/test_power.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/tps65090-charger.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_backup.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm831x_power.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/power/supply/wm8350_power.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/ 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-09T21:08:22.448 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/ 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/ 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/clients/pps_parport.ko 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/pps/pps_core.ko 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ 2023-07-09T21:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ptp/ptp_kvm.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/ 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm80x.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-88pm860x.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9052.ko 2023-07-09T21:08:22.450 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9055.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-da9063.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-09T21:08:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-em3027.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-lp8788.ko 2023-07-09T21:08:22.452 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-m48t86.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max6900.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8907.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8925.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8997.ko 2023-07-09T21:08:22.453 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-max8998.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-palmas.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf50633.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-09T21:08:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rc5t583.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-09T21:08:22.455 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-s35390a.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps6586x.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-tps65910.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm831x.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-wm8350.ko 2023-07-09T21:08:22.456 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/rtc/rtc-x1205.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 77641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-9xxx.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-sas.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/3w-xxxx.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 135169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/BusLogic.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/a100u2w.ko 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/ 2023-07-09T21:08:22.457 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 272353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/advansys.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/ 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 356201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 295801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/ 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 189321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/am53c974.ko 2023-07-09T21:08:22.458 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/ 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 106569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/atp870u.ko 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/ 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 246897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/ 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1172185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bfa/bfa.ko 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/ 2023-07-09T21:08:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 237169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/ 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ch.ko 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/ 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 308889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/ 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-07-09T21:08:22.460 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 141873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dc395x.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/dmx3191d.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/ 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 212401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-09T21:08:22.461 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/esp_scsi.ko 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/ 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 155089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fdomain.ko 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/ 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 262073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/fnic/fnic.ko 2023-07-09T21:08:22.462 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 201793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hpsa.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hptiop.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/hv_storvsc.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/imm.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/initio.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 266521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ipr.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ips.ko 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/ 2023-07-09T21:08:22.463 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 317249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/isci/isci.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/ 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 308313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libfc/libfc.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 140225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/ 2023-07-09T21:08:22.464 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 213041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/libsas/libsas.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/ 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2193865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/ 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 310729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/megaraid.ko 2023-07-09T21:08:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/ 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 659577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/ 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/mvumi.ko 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/ 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-07-09T21:08:22.466 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/ 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 361433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 123489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/pmcraid.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ppa.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla1280.ko 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/ 2023-07-09T21:08:22.467 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1850945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/ 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 558865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/qlogicfas408.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/raid_class.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 238737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_debug.ko 2023-07-09T21:08:22.468 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 171865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 270161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/ses.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 115785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/st.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/stex.ko 2023-07-09T21:08:22.469 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/ 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 162121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/virtio_scsi.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/wd719x.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/scsi/xen-scsifront.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 127025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ssb/ssb.ko 2023-07-09T21:08:22.470 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/ 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/ 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 733905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/ 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_file.ko 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_iblock.ko 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 920793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_mod.ko 2023-07-09T21:08:22.471 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_pscsi.ko 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/target_core_user.ko 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/ 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/ 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/ 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/ 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-09T21:08:22.472 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-09T21:08:22.473 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ 2023-07-09T21:08:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/moxa.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/mxser.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 107545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_gsm.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/n_hdlc.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/nozomi.ko 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/ 2023-07-09T21:08:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/ 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/altera_uart.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/arc_uart.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-07-09T21:08:22.476 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/ 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/rp2.ko 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/serial/sc16is7xx.ko 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/tty/synclink_gt.ko 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/ 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 519393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-09T21:08:22.477 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/ 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 44033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_aec.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_cif.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_dmem_genirq.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_mf624.ko 2023-07-09T21:08:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_netx.ko 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pci_generic.ko 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/uio/uio_sercos3.ko 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/ 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/ 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/c67x00/c67x00.ko 2023-07-09T21:08:22.479 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 142529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/ 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-acm.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-09T21:08:22.480 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usblp.ko 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/class/usbtmc.ko 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/common/ulpi.ko 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/ 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/ 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-07-09T21:08:22.481 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 441593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/dwc3/dwc3.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/ 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/ 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_ether.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/u_serial.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-07-09T21:08:22.482 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 50985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 118017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-07-09T21:08:22.483 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 84193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/ 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-07-09T21:08:22.484 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-07-09T21:08:22.485 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 62153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 157009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/libcomposite.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/ 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/ 2023-07-09T21:08:22.486 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 157665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 69689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 76033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2272.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/net2280.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-07-09T21:08:22.487 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 146001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/bcma-hcd.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/isp116x-hcd.ko 2023-07-09T21:08:22.488 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/sl811_cs.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/ssb-hcd.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/ 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/mdc800.ko 2023-07-09T21:08:22.489 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/image/microtek.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/adutux.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/appledisplay.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/cytherm.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ehset.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi26.ko 2023-07-09T21:08:22.490 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/emi62.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ezusb.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/idmouse.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/iowarrior.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/ldusb.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/legousbtower.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/lvstest.ko 2023-07-09T21:08:22.491 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/ 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usb3503.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usblcd.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/usbtest.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/uss720.ko 2023-07-09T21:08:22.492 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/misc/yurex.ko 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/ 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/mon/usbmon.ko 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/ 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 295049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/musb/musb_hdrc.ko 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/ 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-generic.ko 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-07-09T21:08:22.493 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-isp1301.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/phy/phy-tahvo.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/aircable.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ark3116.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ch341.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 70097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cp210x.ko 2023-07-09T21:08:22.494 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cyberjack.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/empeg.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/f81232.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 174841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 136945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-09T21:08:22.495 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/io_ti.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 67769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipaq.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ipw.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ir-usb.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 57937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 107417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-09T21:08:22.496 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mct_u232.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/metro-usb.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7720.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 78113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mos7840.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/mxuport.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/navman.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/omninet.ko 2023-07-09T21:08:22.497 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/opticon.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 189337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/option.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/oti6858.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/pl2303.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcaux.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/qcserial.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/quatech2.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/safe_serial.ko 2023-07-09T21:08:22.498 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 51297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/sierra.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ssu100.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/symbolserial.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_debug.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-09T21:08:22.499 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 122913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/usbserial.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/visor.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/whiteheat.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/wishbone-serial.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/uas.ko 2023-07-09T21:08:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-karma.ko 2023-07-09T21:08:22.501 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 177153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/storage/usb-storage.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/ 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-09T21:08:22.502 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/ 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/ 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 145817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 97969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 75249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-09T21:08:22.503 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/ 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 96017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost.ko 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_net.ko 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/vhost/vhost_scsi.ko 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/ 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/ 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-07-09T21:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/aat2870_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp5520_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8860_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/adp8870_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/apple_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/as3711_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/bd6107.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da903x_bl.ko 2023-07-09T21:08:22.505 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/da9052_bl.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/gpio_backlight.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/kb3886_bl.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lcd.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3533_bl.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lm3639_bl.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/lv5207lp.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/max8925_bl.ko 2023-07-09T21:08:22.506 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pandora_bl.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/video/backlight/wm831x_bl.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/ 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2482.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/ds2490.ko 2023-07-09T21:08:22.507 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/matrox_w1.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/masters/w1-gpio.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/ 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-09T21:08:22.508 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/w1/wire.ko 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ 2023-07-09T21:08:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/acquirewdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/advantechwdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/cpu5wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9052_wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9055_wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/da9063_wdt.ko 2023-07-09T21:08:22.510 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/dw_wdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/eurotechwdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/hpwdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/i6300esb.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ib700wdt.ko 2023-07-09T21:08:22.511 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ibmasr.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/it87_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/kempld_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/machzwd.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/mena21_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-07-09T21:08:22.512 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/nv_tco.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pc87413_wdt.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/retu_wdt.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-07-09T21:08:22.513 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sc1200wdt.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/softdog.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-09T21:08:22.514 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/twl4030_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/via_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wafer5823wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wdt_pci.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm831x_wdt.ko 2023-07-09T21:08:22.515 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/wm8350_wdt.ko 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/watchdog/xen_wdt.ko 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/ 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-evtchn.ko 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntalloc.ko 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-gntdev.ko 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/ 2023-07-09T21:08:22.516 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 176353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-privcmd.ko 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 71321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xen-scsiback.ko 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/ 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/ 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 165513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/9p/9p.ko 2023-07-09T21:08:22.517 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/ 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/adfs/adfs.ko 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/ 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 162625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/affs/affs.ko 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/ 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 924297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/afs/kafs.ko 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/ 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 100761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/autofs/autofs4.ko 2023-07-09T21:08:22.518 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/ 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 64417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/befs/befs.ko 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/ 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/bfs/bfs.ko 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/binfmt_misc.ko 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/ 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 3447409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/btrfs/btrfs.ko 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/ 2023-07-09T21:08:22.519 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 300025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cachefiles/cachefiles.ko 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1308201 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ceph/ceph.ko 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/ 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/coda/coda.ko 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/ 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/configfs/configfs.ko 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/ 2023-07-09T21:08:22.520 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/cramfs/cramfs.ko 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/ 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 631425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/dlm/dlm.ko 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/ 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/efs/efs.ko 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/ 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1473049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/f2fs/f2fs.ko 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/ 2023-07-09T21:08:22.521 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fat/msdos.ko 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/ 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/freevxfs/freevxfs.ko 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/ 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 218713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fscache/fscache.ko 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/ 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/fuse/cuse.ko 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/ 2023-07-09T21:08:22.522 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1221129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/gfs2/gfs2.ko 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/ 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 141241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfs/hfs.ko 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/ 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 221561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hfsplus/hfsplus.ko 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/ 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 193585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/hpfs/hpfs.ko 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/ 2023-07-09T21:08:22.523 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 74393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/isofs/isofs.ko 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/ 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 420425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/jfs/jfs.ko 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/ 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 276953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/lockd/lockd.ko 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/ 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 87841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/minix/minix.ko 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/ 2023-07-09T21:08:22.524 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 128665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/netfs/netfs.ko 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/ 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/ 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/ 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/ 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-09T21:08:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1002089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfs.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv2.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 119289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv3.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2003425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs/nfsv4.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/ 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/grace.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfs_common/nfs_acl.ko 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/ 2023-07-09T21:08:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1407977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nfsd/nfsd.ko 2023-07-09T21:08:22.557 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/ 2023-07-09T21:08:22.557 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 589433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nilfs2/nilfs2.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/ 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-celtic.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-centeuro.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-croatian.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-cyrillic.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-gaelic.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-greek.ko 2023-07-09T21:08:22.558 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-iceland.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-inuit.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-roman.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-romanian.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/mac-turkish.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_ascii.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1250.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1251.ko 2023-07-09T21:08:22.559 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp1255.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp737.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp775.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp850.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp852.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp855.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp857.ko 2023-07-09T21:08:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp860.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp861.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp862.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp863.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp864.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp865.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp866.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp869.ko 2023-07-09T21:08:22.561 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp874.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 94137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp932.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 142673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp936.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 165745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp949.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 118121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_cp950.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_euc-jp.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-1.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-13.ko 2023-07-09T21:08:22.562 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-14.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-15.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-2.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-3.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-4.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-5.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-6.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-7.ko 2023-07-09T21:08:22.563 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_iso8859-9.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-r.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-ru.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_koi8-u.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/nls/nls_utf8.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 219081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ntfs/ntfs.ko 2023-07-09T21:08:22.564 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ 2023-07-09T21:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ 2023-07-09T21:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 241241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-09T21:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ 2023-07-09T21:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 439625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-09T21:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2511665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2.ko 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/ 2023-07-09T21:08:22.566 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 52577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/omfs/omfs.ko 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/ 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 320689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/overlayfs/overlay.ko 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/pstore/ramoops.ko 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/ 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx4/qnx4.ko 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/ 2023-07-09T21:08:22.567 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 46649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/qnx6/qnx6.ko 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/ 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_tree.ko 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v1.ko 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/quota/quota_v2.ko 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/ 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 530697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/reiserfs/reiserfs.ko 2023-07-09T21:08:22.568 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/ 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/romfs/romfs.ko 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/ 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/ 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 2622729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/client/cifs.ko 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/ 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_arc4.ko 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/smb/common/cifs_md4.ko 2023-07-09T21:08:22.569 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/ 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 131689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/squashfs/squashfs.ko 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/ 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 89657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/sysv/sysv.ko 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/ 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 248257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/udf/udf.ko 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 160857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/ufs/ufs.ko 2023-07-09T21:08:22.570 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/ 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 3854977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/fs/xfs/xfs.ko 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/ 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/ 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/locking/locktorture.ko 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/ 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/time/test_udelay.ko 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/kernel/torture.ko 2023-07-09T21:08:22.571 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc-itu-t.ko 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc7.ko 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crc8.ko 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/ 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libarc4.ko 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/crypto/libdes.ko 2023-07-09T21:08:22.572 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/interval_tree_test.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/libcrc32c.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lru_cache.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/ 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4_compress.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/lz4/lz4hc_compress.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/ 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/math/cordic.ko 2023-07-09T21:08:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/memory-notifier-error-inject.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/notifier-error-inject.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/percpu_test.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/pm-notifier-error-inject.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/ 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 142369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/raid6/raid6_pq.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/rbtree_test.ko 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/ 2023-07-09T21:08:22.574 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-kstrtox.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test-string_helpers.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 4760825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_bpf.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_firmware.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_module.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/test_user_copy.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_bm.ko 2023-07-09T21:08:22.575 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_fsm.ko 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/ts_kmp.ko 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/ 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/lib/xz/xz_dec_test.ko 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/ 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/mm/hwpoison-inject.ko 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ 2023-07-09T21:08:22.576 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/ 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54761 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/6lowpan.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_dest.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_fragment.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7049 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_hop.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 6985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_mobility.ko 2023-07-09T21:08:22.577 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_routing.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/6lowpan/nhc_udp.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/ 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/garp.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/mrp.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/p8022.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/psnap.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/802/stp.ko 2023-07-09T21:08:22.578 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/ 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 81017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/8021q/8021q.ko 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/ 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 191801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet.ko 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_fd.ko 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_rdma.ko 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/9p/9pnet_virtio.ko 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/ 2023-07-09T21:08:22.579 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 652553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/batman-adv/batman-adv.ko 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/ 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 63825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/br_netfilter.ko 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 769841 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/bridge.ko 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-09T21:08:22.580 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7585 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-09T21:08:22.581 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-09T21:08:22.582 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 55145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/ebtables.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/ 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1030233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ceph/libceph.ko 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/ 2023-07-09T21:08:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 124729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/core/pktgen.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/ 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 189745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8665 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_diag.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 56193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv4.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dccp/dccp_ipv6.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/ 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 380473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/dsa_core.ko 2023-07-09T21:08:22.584 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_brcm.ko 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_dsa.ko 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_none.ko 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/dsa/tag_trailer.ko 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/ 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 99825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/hsr/hsr.ko 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ 2023-07-09T21:08:22.585 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 45169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 245857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ah4.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/esp4.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/fou.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/gre.ko 2023-07-09T21:08:22.586 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47417 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/inet_diag.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 60305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_gre.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 58977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_tunnel.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 34369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ip_vti.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipcomp.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/ipip.ko 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ 2023-07-09T21:08:22.587 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8873 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40889 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ip_tables.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11177 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-09T21:08:22.588 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11305 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-09T21:08:22.589 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-09T21:08:22.590 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_bic.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_dctcp.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_diag.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_highspeed.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_htcp.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_hybla.ko 2023-07-09T21:08:22.591 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_illinois.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_lp.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_scalable.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_vegas.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_veno.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_westwood.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tcp_yeah.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/tunnel4.ko 2023-07-09T21:08:22.592 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_diag.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40513 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/udp_tunnel.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ah6.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/esp6.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/fou6.ko 2023-07-09T21:08:22.593 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_gre.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91481 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_tunnel.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ip6_vti.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/ipcomp6.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/mip6.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 41561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-09T21:08:22.594 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8913 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-09T21:08:22.595 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10937 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-09T21:08:22.596 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38361 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9569 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-09T21:08:22.597 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 73161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/sit.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/tunnel6.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/ 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 83065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/key/af_key.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/ 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 120753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_core.ko 2023-07-09T21:08:22.598 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_eth.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35241 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ip6.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_netlink.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 53153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/l2tp/l2tp_ppp.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/ 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/lapb/lapb.ko 2023-07-09T21:08:22.599 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/ 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22345 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc.ko 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 267209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/llc/llc2.ko 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/ 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 280401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mac802154/mac802154.ko 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/ 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/mpls/mpls_gso.ko 2023-07-09T21:08:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117977 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 102033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 103121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-09T21:08:22.601 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 104593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 105129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 111161 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 114329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 113153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-09T21:08:22.602 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 116217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 410337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-09T21:08:22.603 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9233 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7697 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-09T21:08:22.604 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conncount.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 397737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9929 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 117737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-09T21:08:22.605 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 108329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 65737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11009 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9641 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-09T21:08:22.606 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 86993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_log_syslog.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 91777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_irc.ko 2023-07-09T21:08:22.607 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_sip.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 584713 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nf_tables.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 42705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30561 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 39905 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_log.ko 2023-07-09T21:08:22.608 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22273 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 49673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_chain_nat.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_compat.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 40721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_ct.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10593 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fib.ko 2023-07-09T21:08:22.609 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13745 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14185 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_hash.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_limit.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_log.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_masq.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_nat.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_numgen.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_osf.ko 2023-07-09T21:08:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_queue.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14193 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_redir.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_reject_inet.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12737 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_socket.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_synproxy.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14849 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/nft_tproxy.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 85113 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/x_tables.ko 2023-07-09T21:08:22.611 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12097 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_AUDIT.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 18169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_CT.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10497 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_DSCP.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HL.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_HMARK.ko 2023-07-09T21:08:22.612 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 38857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14017 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LED.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11489 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_LOG.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NETMAP.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFLOG.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13289 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-09T21:08:22.613 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_RATEEST.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_SECMARK.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17369 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TEE.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TPROXY.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8321 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_TRACE.ko 2023-07-09T21:08:22.614 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_addrtype.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_bpf.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cgroup.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cluster.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_comment.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connbytes.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlabel.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connlimit.ko 2023-07-09T21:08:22.615 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13129 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_connmark.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12401 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_conntrack.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_cpu.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10969 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dccp.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_devgroup.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8801 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_dscp.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10657 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ecn.ko 2023-07-09T21:08:22.616 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_esp.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43393 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hashlimit.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_helper.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7865 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_hl.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipcomp.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_iprange.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11785 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_ipvs.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16041 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_l2tp.ko 2023-07-09T21:08:22.617 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_length.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10209 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_limit.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7545 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mac.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8577 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_mark.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11825 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_multiport.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13817 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nat.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_nfacct.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8297 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_osf.ko 2023-07-09T21:08:22.618 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_owner.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_physdev.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7633 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_pkttype.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_policy.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_quota.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_rateest.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_realm.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_recent.ko 2023-07-09T21:08:22.619 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13329 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_sctp.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 30089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_set.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_socket.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9505 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_state.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9473 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_statistic.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_string.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 8553 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpmss.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15777 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_tcpudp.ko 2023-07-09T21:08:22.620 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_time.ko 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9105 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netfilter/xt_u32.ko 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/ 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/netlink/netlink_diag.ko 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/ 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 12137 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/nsh/nsh.ko 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/ 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 378153 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/openvswitch.ko 2023-07-09T21:08:22.621 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10257 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-geneve.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9449 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-gre.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 11793 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/openvswitch/vport-vxlan.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/ 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/packet/af_packet_diag.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/ 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 110073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/phonet.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 54857 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/phonet/pn_pep.ko 2023-07-09T21:08:22.622 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/ 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 249033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds.ko 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 165081 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_rdma.ko 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66945 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rds/rds_tcp.ko 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/ 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 807465 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/rxrpc/rxrpc.ko 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/ 2023-07-09T21:08:22.623 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_csum.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23537 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_gact.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 25681 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_ipt.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_mirred.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 23425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_nat.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 43833 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_pedit.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31985 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_police.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_simple.ko 2023-07-09T21:08:22.624 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36353 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_skbedit.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/act_vlan.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26145 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_basic.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33673 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_bpf.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_cgroup.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31377 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_flow.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_fw.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 37953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_route.ko 2023-07-09T21:08:22.625 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 59217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/cls_u32.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7441 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_cmp.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 13457 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_ipset.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33337 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_meta.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_nbyte.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10625 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_text.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/em_u32.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21649 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_choke.ko 2023-07-09T21:08:22.626 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20961 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_codel.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33753 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_drr.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 33609 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31601 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_fq_codel.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 35433 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_gred.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 48409 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hfsc.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_hhf.ko 2023-07-09T21:08:22.627 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 66073 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_htb.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 16001 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_ingress.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 29809 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10313 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_mqprio_lib.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26065 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_multiq.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 36217 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_netem.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_pie.ko 2023-07-09T21:08:22.628 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10265 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_plug.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 24729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_prio.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 47617 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_qfq.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 32953 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_red.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 26881 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfb.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 31425 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_sfq.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 28897 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_tbf.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 27729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sched/sch_teql.ko 2023-07-09T21:08:22.629 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/ 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 929385 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp.ko 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 19033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sctp/sctp_diag.ko 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/ 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/ 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 328057 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 61769 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 1426529 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/sunrpc.ko 2023-07-09T21:08:22.630 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/ 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 681721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/ 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10025 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/diag.ko 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 855089 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/tipc/tipc.ko 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/ 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 15729 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/unix/unix_diag.ko 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/ 2023-07-09T21:08:22.631 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 80121 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68033 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 92689 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 10705 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 17521 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/ 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 125225 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/x25/x25.ko 2023-07-09T21:08:22.632 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/ 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 21281 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_algo.ko 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 20169 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 101993 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/net/xfrm/xfrm_user.ko 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/ 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/ 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 14921 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/kernel/virt/lib/irqbypass.ko 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 637389 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias 2023-07-09T21:08:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 623128 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.alias.bin 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 7605 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 22249 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.alias.bin 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 9788 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.bin 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 68530 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.builtin.modinfo 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 146380 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 232618 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.dep.bin 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 210 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.devname 2023-07-09T21:08:22.634 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 72721 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.order 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 879 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.softdep 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 251868 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 306661 2023-06-30 10:38 ./lib/modules/6.4.0-g84139c18d56f/modules.symbols.bin 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/ 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/ 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/ 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:drwxr-xr-x root/root 0 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/ 2023-07-09T21:08:22.635 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 170 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/changelog.Debian.gz 2023-07-09T21:08:22.636 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r-- root/root 691 2023-06-30 10:38 ./usr/share/doc/linux-image-6.4.0-g84139c18d56f/copyright 2023-07-09T21:08:22.636 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-g84139c18d56f 2023-07-09T21:08:22.637 INFO:teuthology.task.kernel:searching for kernel 6.4.0-g84139c18d56f 2023-07-09T21:08:22.637 DEBUG:teuthology.orchestra.run.smithi037:> egrep '(submenu|menuentry.*6.4.0-g84139c18d56f).*{' /boot/grub/grub.cfg 2023-07-09T21:08:22.644 INFO:teuthology.orchestra.run.smithi037.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:22.644 INFO:teuthology.orchestra.run.smithi037.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:22.645 INFO:teuthology.orchestra.run.smithi037.stdout: menuentry 'Ubuntu, with Linux 6.4.0-g84139c18d56f (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-g84139c18d56f-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-07-09T21:08:22.645 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-07-09T21:08:22.645 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-g84139c18d56f 2023-07-09T21:08:22.646 DEBUG:teuthology.orchestra.run.smithi037:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-07-09T21:08:22.688 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-07-09T21:08:23.082 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub' 2023-07-09T21:08:23.083 INFO:teuthology.orchestra.run.smithi037.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-07-09T21:08:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-07-09T21:08:23.316 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-6.4.0-g84139c18d56f 2023-07-09T21:08:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-6.4.0-g84139c18d56f 2023-07-09T21:08:23.563 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-07-09T21:08:23.569 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-07-09T21:08:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-07-09T21:08:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-07-09T21:08:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-07-09T21:08:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-07-09T21:08:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-07-09T21:08:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-07-09T21:08:52.573 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-09T21:08:52.573 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:08:52.574 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:08:54.896 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-09T21:08:54.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:08:54.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:09:10.896 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-09T21:09:13.456 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-09T21:09:19.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:09:19.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:09:22.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:09:22.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:09:22.960 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-09T21:09:34.972 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:09:34.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:09:40.848 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-09T21:09:52.860 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:09:52.861 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:09:53.392 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.119 2023-07-09T21:09:55.920 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-07-09T21:10:08.404 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:10:08.405 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:10:08.686 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-09T21:10:09.310 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:10:09.310 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.4.0-g84139c18d56f"... 2023-07-09T21:10:09.310 DEBUG:teuthology.orchestra.run.smithi119:> uname -r 2023-07-09T21:10:09.357 INFO:teuthology.orchestra.run.smithi119.stdout:6.4.0-g84139c18d56f 2023-07-09T21:10:09.358 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T21:10:09.358 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T21:10:09.358 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-09T21:10:10.359 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-09T21:10:10.360 DEBUG:teuthology.orchestra.run.smithi119:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-09T21:10:10.453 INFO:teuthology.orchestra.run.smithi119.stdout:ttyS1 2023-07-09T21:10:10.501 DEBUG:teuthology.parallel:result is None 2023-07-09T21:10:10.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:10:10.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:10:11.140 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-09T21:10:11.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:10:11.769 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.4.0-g84139c18d56f"... 2023-07-09T21:10:11.769 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-07-09T21:10:11.817 INFO:teuthology.orchestra.run.smithi037.stdout:6.4.0-g84139c18d56f 2023-07-09T21:10:11.817 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-g84139c18d56f vs 6.4.0-g84139c18d56f 2023-07-09T21:10:11.818 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-09T21:10:11.818 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-07-09T21:10:12.819 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-09T21:10:12.820 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-09T21:10:12.901 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2023-07-09T21:10:12.945 DEBUG:teuthology.parallel:result is None 2023-07-09T21:10:12.945 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-09T21:10:12.956 INFO:teuthology.task.internal:Creating test directory... 2023-07-09T21:10:12.957 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T21:10:12.960 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-09T21:10:12.970 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-09T21:10:12.987 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-09T21:10:13.020 INFO:teuthology.task.internal:Creating archive directory... 2023-07-09T21:10:13.021 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T21:10:13.025 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-09T21:10:13.118 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-09T21:10:13.127 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-09T21:10:13.127 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T21:10:13.131 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-09T21:10:13.152 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:10:13.161 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:10:13.168 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:10:13.176 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-09T21:10:13.178 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-09T21:10:13.192 INFO:teuthology.task.internal:Configuring sudo... 2023-07-09T21:10:13.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T21:10:13.217 DEBUG:teuthology.orchestra.run.smithi119:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-09T21:10:13.243 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-09T21:10:13.256 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-09T21:10:13.256 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T21:10:13.281 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-09T21:10:13.295 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:10:13.339 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:10:13.395 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:10:13.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T21:10:13.470 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-09T21:10:13.480 DEBUG:teuthology.orchestra.run.smithi119:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-09T21:10:13.535 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:10:13.535 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-09T21:10:13.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-07-09T21:10:13.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo service rsyslog restart 2023-07-09T21:10:13.780 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-09T21:10:13.788 INFO:teuthology.task.internal:Starting timer... 2023-07-09T21:10:13.788 INFO:teuthology.run_tasks:Running task pcp... 2023-07-09T21:10:13.815 INFO:teuthology.run_tasks:Running task selinux... 2023-07-09T21:10:13.848 DEBUG:teuthology.task.selinux:Excluding smithi037: OS 'ubuntu' does not support SELinux 2023-07-09T21:10:13.848 DEBUG:teuthology.task.selinux:Excluding smithi119: OS 'ubuntu' does not support SELinux 2023-07-09T21:10:13.849 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-09T21:10:13.849 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-07-09T21:10:13.849 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-09T21:10:13.850 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-09T21:10:13.881 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-09T21:10:13.887 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-09T21:10:14.021 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-09T21:10:14.042 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-09T21:10:14.044 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi119.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-09T21:18:40.006 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi119.front.sepia.ceph.com')] 2023-07-09T21:18:40.008 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:18:40.010 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:18:40.094 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-07-09T21:18:40.267 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-07-09T21:18:40.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:18:40.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi119.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-09T21:18:40.353 DEBUG:teuthology.orchestra.run.smithi119:> true 2023-07-09T21:18:40.495 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi119.front.sepia.ceph.com' 2023-07-09T21:18:40.495 INFO:teuthology.run_tasks:Running task clock... 2023-07-09T21:18:40.509 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-09T21:18:40.509 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T21:18:40.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:18:40.514 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-09T21:18:40.514 DEBUG:teuthology.orchestra.run.smithi119:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T21:18:40.552 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-09T21:18:40.552 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Command line: ntpd -gq 2023-07-09T21:18:40.552 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: ---------------------------------------------------- 2023-07-09T21:18:40.553 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: ntp-4 is maintained by Network Time Foundation, 2023-07-09T21:18:40.553 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-09T21:18:40.553 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: corporation. Support and training for ntp-4 are 2023-07-09T21:18:40.553 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: available at https://www.nwtime.org/support 2023-07-09T21:18:40.553 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: ---------------------------------------------------- 2023-07-09T21:18:40.554 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: proto: precision = 0.043 usec (-24) 2023-07-09T21:18:40.554 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: basedate set to 2022-02-04 2023-07-09T21:18:40.555 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: gps base set to 2022-02-06 (week 2196) 2023-07-09T21:18:40.555 INFO:teuthology.orchestra.run.smithi037.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T21:18:40.556 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T21:18:40.556 INFO:teuthology.orchestra.run.smithi037.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-09T21:18:40.558 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: restrict ::: KOD does nothing without LIMITED. 2023-07-09T21:18:40.558 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen and drop on 0 v6wildcard [::]:123 2023-07-09T21:18:40.558 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-09T21:18:40.558 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen normally on 2 lo 127.0.0.1:123 2023-07-09T21:18:40.559 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen normally on 3 ens1f0 172.21.15.37:123 2023-07-09T21:18:40.559 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen normally on 4 lo [::1]:123 2023-07-09T21:18:40.559 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe88:7794%4]:123 2023-07-09T21:18:40.559 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:40 ntpd[27324]: Listening on routing socket on fd #22 for interface updates 2023-07-09T21:18:40.574 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-07-09T21:18:40.574 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Command line: ntpd -gq 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: ---------------------------------------------------- 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: ntp-4 is maintained by Network Time Foundation, 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: corporation. Support and training for ntp-4 are 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: available at https://www.nwtime.org/support 2023-07-09T21:18:40.575 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: ---------------------------------------------------- 2023-07-09T21:18:40.576 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: proto: precision = 0.041 usec (-24) 2023-07-09T21:18:40.576 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: basedate set to 2022-02-04 2023-07-09T21:18:40.576 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: gps base set to 2022-02-06 (week 2196) 2023-07-09T21:18:40.577 INFO:teuthology.orchestra.run.smithi119.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T21:18:40.577 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-07-09T21:18:40.577 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: restrict ::: KOD does nothing without LIMITED. 2023-07-09T21:18:40.578 INFO:teuthology.orchestra.run.smithi119.stderr:restrict ::: KOD does nothing without LIMITED. 2023-07-09T21:18:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen and drop on 0 v6wildcard [::]:123 2023-07-09T21:18:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-07-09T21:18:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen normally on 2 lo 127.0.0.1:123 2023-07-09T21:18:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen normally on 3 enp3s0f1 172.21.15.119:123 2023-07-09T21:18:40.579 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen normally on 4 lo [::1]:123 2023-07-09T21:18:40.580 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5ef%5]:123 2023-07-09T21:18:40.580 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:40 ntpd[27398]: Listening on routing socket on fd #22 for interface updates 2023-07-09T21:18:41.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:41.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:41.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:41.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:41.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:41.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:41 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:42.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:42 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:42.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:42 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:42.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:42.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:42.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:42.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:42.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:42.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:42 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:43.552 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:43.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:43 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:43.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:43.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:43.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:43.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:43.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:43 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:44.552 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:44.552 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:44.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:44.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:44.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:44.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:44 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:44.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:44.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:44.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:44.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:44.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:44.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:44 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:45.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:45.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:45 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:45.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:45.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:45.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:45.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:45.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:45.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:45 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:46.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:46.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:46.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:46.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:46.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:46.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:46 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:46.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:46.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:46.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:46.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:46.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:46.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:46 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:47.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:47.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:47 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:47.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.575 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.576 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:47.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:47.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:47.577 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:47.578 INFO:teuthology.orchestra.run.smithi119.stdout: 9 Jul 21:18:47 ntpd[27398]: ntpd: time slew -0.000498 s 2023-07-09T21:18:47.578 INFO:teuthology.orchestra.run.smithi119.stdout:ntpd: time slew -0.000498s 2023-07-09T21:18:47.578 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-09T21:18:47.579 INFO:teuthology.orchestra.run.smithi119.stderr: 9 Jul 21:18:47 ntpd[27398]: can't open /var/log/ntpstats/loopstats.20230709: Permission denied 2023-07-09T21:18:47.699 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T21:18:47.699 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-07-09T21:18:47.699 INFO:teuthology.orchestra.run.smithi119.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:47.699 INFO:teuthology.orchestra.run.smithi119.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:47.700 INFO:teuthology.orchestra.run.smithi119.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:47.700 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:48.552 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:48.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:48.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:48.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:48.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:48.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:48 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:49.553 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-07-09T21:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: can't open /var/log/ntpstats/rawstats.20230709: Permission denied 2023-07-09T21:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-07-09T21:18:49.554 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: can't open /var/log/ntpstats/peerstats.20230709: Permission denied 2023-07-09T21:18:49.554 INFO:teuthology.orchestra.run.smithi037.stdout: 9 Jul 21:18:49 ntpd[27324]: ntpd: time slew +0.000098 s 2023-07-09T21:18:49.555 INFO:teuthology.orchestra.run.smithi037.stdout:ntpd: time slew +0.000098s 2023-07-09T21:18:49.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-07-09T21:18:49.555 INFO:teuthology.orchestra.run.smithi037.stderr: 9 Jul 21:18:49 ntpd[27324]: can't open /var/log/ntpstats/loopstats.20230709: Permission denied 2023-07-09T21:18:49.673 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T21:18:49.673 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2023-07-09T21:18:49.673 INFO:teuthology.orchestra.run.smithi037.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:49.674 INFO:teuthology.orchestra.run.smithi037.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:49.674 INFO:teuthology.orchestra.run.smithi037.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:49.674 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-07-09T21:18:49.675 INFO:teuthology.run_tasks:Running task install... 2023-07-09T21:18:49.686 DEBUG:teuthology.task.install:project ceph 2023-07-09T21:18:49.687 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}} 2023-07-09T21:18:49.687 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'} 2023-07-09T21:18:49.687 INFO:teuthology.task.install:Using flavor: default 2023-07-09T21:18:49.693 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-09T21:18:49.693 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-09T21:18:49.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-key list | grep Ceph 2023-07-09T21:18:49.695 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-key list | grep Ceph 2023-07-09T21:18:49.804 INFO:teuthology.orchestra.run.smithi119.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-09T21:18:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-07-09T21:18:49.857 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-09T21:18:49.858 INFO:teuthology.orchestra.run.smithi119.stdout:uid [ unknown] Ceph.com (release key) 2023-07-09T21:18:49.859 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-09T21:18:49.860 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-09T21:18:49.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:18:49.884 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-07-09T21:18:49.885 INFO:teuthology.orchestra.run.smithi037.stdout:uid [ unknown] Ceph.com (release key) 2023-07-09T21:18:49.894 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-07-09T21:18:49.894 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-07-09T21:18:49.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:18:50.001 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default/ 2023-07-09T21:18:50.002 INFO:teuthology.task.install.deb:Package version is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:18:50.038 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default/ 2023-07-09T21:18:50.038 INFO:teuthology.task.install.deb:Package version is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:18:50.294 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:18:50.294 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-09T21:18:50.314 DEBUG:teuthology.orchestra.run.smithi119:> sudo apt-get update 2023-07-09T21:18:50.331 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:18:50.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-07-09T21:18:50.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo apt-get update 2023-07-09T21:18:50.634 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-09T21:18:50.634 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-09T21:18:50.675 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-07-09T21:18:50.675 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-07-09T21:18:50.704 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-09T21:18:50.741 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy InRelease 2023-07-09T21:18:50.745 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-07-09T21:18:50.782 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy InRelease 2023-07-09T21:18:50.785 INFO:teuthology.orchestra.run.smithi119.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-09T21:18:50.810 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-09T21:18:50.825 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-07-09T21:18:50.826 INFO:teuthology.orchestra.run.smithi037.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-07-09T21:18:50.835 INFO:teuthology.orchestra.run.smithi119.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-09T21:18:50.847 INFO:teuthology.orchestra.run.smithi037.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy Release.gpg 2023-07-09T21:18:50.856 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-09T21:18:50.868 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-07-09T21:18:50.889 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2023-07-09T21:18:50.900 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,432 B] 2023-07-09T21:18:51.255 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 28.6 kB in 1s (39.8 kB/s) 2023-07-09T21:18:51.318 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 28.6 kB in 1s (38.8 kB/s) 2023-07-09T21:18:52.117 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-07-09T21:18:52.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4759-g35b2d86c-1jammy cephadm=18.0.0-4759-g35b2d86c-1jammy ceph-mds=18.0.0-4759-g35b2d86c-1jammy ceph-mgr=18.0.0-4759-g35b2d86c-1jammy ceph-common=18.0.0-4759-g35b2d86c-1jammy ceph-fuse=18.0.0-4759-g35b2d86c-1jammy ceph-test=18.0.0-4759-g35b2d86c-1jammy ceph-volume=18.0.0-4759-g35b2d86c-1jammy radosgw=18.0.0-4759-g35b2d86c-1jammy python3-rados=18.0.0-4759-g35b2d86c-1jammy python3-rgw=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy python3-rbd=18.0.0-4759-g35b2d86c-1jammy libcephfs2=18.0.0-4759-g35b2d86c-1jammy libcephfs-dev=18.0.0-4759-g35b2d86c-1jammy librados2=18.0.0-4759-g35b2d86c-1jammy librbd1=18.0.0-4759-g35b2d86c-1jammy rbd-fuse=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy cephfs-shell=18.0.0-4759-g35b2d86c-1jammy cephfs-top=18.0.0-4759-g35b2d86c-1jammy cephfs-mirror=18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:18:52.208 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-07-09T21:18:52.222 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-07-09T21:18:52.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4759-g35b2d86c-1jammy cephadm=18.0.0-4759-g35b2d86c-1jammy ceph-mds=18.0.0-4759-g35b2d86c-1jammy ceph-mgr=18.0.0-4759-g35b2d86c-1jammy ceph-common=18.0.0-4759-g35b2d86c-1jammy ceph-fuse=18.0.0-4759-g35b2d86c-1jammy ceph-test=18.0.0-4759-g35b2d86c-1jammy ceph-volume=18.0.0-4759-g35b2d86c-1jammy radosgw=18.0.0-4759-g35b2d86c-1jammy python3-rados=18.0.0-4759-g35b2d86c-1jammy python3-rgw=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy python3-rbd=18.0.0-4759-g35b2d86c-1jammy libcephfs2=18.0.0-4759-g35b2d86c-1jammy libcephfs-dev=18.0.0-4759-g35b2d86c-1jammy librados2=18.0.0-4759-g35b2d86c-1jammy librbd1=18.0.0-4759-g35b2d86c-1jammy rbd-fuse=18.0.0-4759-g35b2d86c-1jammy python3-cephfs=18.0.0-4759-g35b2d86c-1jammy cephfs-shell=18.0.0-4759-g35b2d86c-1jammy cephfs-top=18.0.0-4759-g35b2d86c-1jammy cephfs-mirror=18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:18:52.319 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-07-09T21:18:52.363 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-07-09T21:18:52.364 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-07-09T21:18:52.477 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-07-09T21:18:52.477 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-07-09T21:18:52.505 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T21:18:52.506 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T21:18:52.506 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T21:18:52.506 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T21:18:52.506 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-09T21:18:52.508 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T21:18:52.509 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-09T21:18:52.509 INFO:teuthology.orchestra.run.smithi119.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-09T21:18:52.509 INFO:teuthology.orchestra.run.smithi119.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-09T21:18:52.509 INFO:teuthology.orchestra.run.smithi119.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-09T21:18:52.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-09T21:18:52.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-09T21:18:52.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-09T21:18:52.510 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-09T21:18:52.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-09T21:18:52.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-09T21:18:52.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-09T21:18:52.511 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-09T21:18:52.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-09T21:18:52.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-09T21:18:52.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-09T21:18:52.512 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-09T21:18:52.513 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-09T21:18:52.513 INFO:teuthology.orchestra.run.smithi119.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-09T21:18:52.513 INFO:teuthology.orchestra.run.smithi119.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-09T21:18:52.513 INFO:teuthology.orchestra.run.smithi119.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-09T21:18:52.514 INFO:teuthology.orchestra.run.smithi119.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-09T21:18:52.515 INFO:teuthology.orchestra.run.smithi119.stdout: python3-watchdog 2023-07-09T21:18:52.515 INFO:teuthology.orchestra.run.smithi119.stdout:Recommended packages: 2023-07-09T21:18:52.515 INFO:teuthology.orchestra.run.smithi119.stdout: btrfs-tools 2023-07-09T21:18:52.624 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T21:18:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T21:18:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T21:18:52.624 INFO:teuthology.orchestra.run.smithi037.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T21:18:52.625 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T21:18:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T21:18:52.626 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T21:18:52.626 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2023-07-09T21:18:52.626 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-07-09T21:18:52.627 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-07-09T21:18:52.628 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-07-09T21:18:52.629 INFO:teuthology.orchestra.run.smithi037.stdout: qttranslations5-l10n socat xmlstarlet 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-07-09T21:18:52.630 INFO:teuthology.orchestra.run.smithi037.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-07-09T21:18:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-07-09T21:18:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: python3-watchdog 2023-07-09T21:18:52.631 INFO:teuthology.orchestra.run.smithi037.stdout:Recommended packages: 2023-07-09T21:18:52.631 INFO:teuthology.orchestra.run.smithi037.stdout: btrfs-tools 2023-07-09T21:18:52.646 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-07-09T21:18:52.647 INFO:teuthology.orchestra.run.smithi119.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-09T21:18:52.647 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-09T21:18:52.647 INFO:teuthology.orchestra.run.smithi119.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-09T21:18:52.648 INFO:teuthology.orchestra.run.smithi119.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-09T21:18:52.648 INFO:teuthology.orchestra.run.smithi119.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T21:18:52.648 INFO:teuthology.orchestra.run.smithi119.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-09T21:18:52.648 INFO:teuthology.orchestra.run.smithi119.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-09T21:18:52.650 INFO:teuthology.orchestra.run.smithi119.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-09T21:18:52.650 INFO:teuthology.orchestra.run.smithi119.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-09T21:18:52.650 INFO:teuthology.orchestra.run.smithi119.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-09T21:18:52.651 INFO:teuthology.orchestra.run.smithi119.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-09T21:18:52.651 INFO:teuthology.orchestra.run.smithi119.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-09T21:18:52.651 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-09T21:18:52.651 INFO:teuthology.orchestra.run.smithi119.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-09T21:18:52.652 INFO:teuthology.orchestra.run.smithi119.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-09T21:18:52.652 INFO:teuthology.orchestra.run.smithi119.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-09T21:18:52.652 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-09T21:18:52.653 INFO:teuthology.orchestra.run.smithi119.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-09T21:18:52.653 INFO:teuthology.orchestra.run.smithi119.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-09T21:18:52.653 INFO:teuthology.orchestra.run.smithi119.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-09T21:18:52.653 INFO:teuthology.orchestra.run.smithi119.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-09T21:18:52.654 INFO:teuthology.orchestra.run.smithi119.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-09T21:18:52.654 INFO:teuthology.orchestra.run.smithi119.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-09T21:18:52.654 INFO:teuthology.orchestra.run.smithi119.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-09T21:18:52.654 INFO:teuthology.orchestra.run.smithi119.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-09T21:18:52.655 INFO:teuthology.orchestra.run.smithi119.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-09T21:18:52.655 INFO:teuthology.orchestra.run.smithi119.stdout: socat xmlstarlet 2023-07-09T21:18:52.773 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2023-07-09T21:18:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-07-09T21:18:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-07-09T21:18:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-07-09T21:18:52.774 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-07-09T21:18:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-07-09T21:18:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-07-09T21:18:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-07-09T21:18:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-07-09T21:18:52.776 INFO:teuthology.orchestra.run.smithi037.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-07-09T21:18:52.777 INFO:teuthology.orchestra.run.smithi037.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-07-09T21:18:52.778 INFO:teuthology.orchestra.run.smithi037.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-07-09T21:18:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-07-09T21:18:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-07-09T21:18:52.779 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-07-09T21:18:52.780 INFO:teuthology.orchestra.run.smithi037.stdout: socat xmlstarlet 2023-07-09T21:18:52.795 INFO:teuthology.orchestra.run.smithi119.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-09T21:18:52.795 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 182 MB of archives. 2023-07-09T21:18:52.796 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 819 MB of additional disk space will be used. 2023-07-09T21:18:52.796 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4759-g35b2d86c-1jammy [3,433 kB] 2023-07-09T21:18:52.842 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-09T21:18:52.926 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-09T21:18:52.972 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-09T21:18:52.972 INFO:teuthology.orchestra.run.smithi037.stdout:0 upgraded, 115 newly installed, 0 to remove and 207 not upgraded. 2023-07-09T21:18:52.972 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 182 MB of archives. 2023-07-09T21:18:52.972 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 819 MB of additional disk space will be used. 2023-07-09T21:18:52.973 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-07-09T21:18:52.999 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4759-g35b2d86c-1jammy [3,094 kB] 2023-07-09T21:18:53.013 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-4759-g35b2d86c-1jammy [3,433 kB] 2023-07-09T21:18:53.054 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-07-09T21:18:53.094 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4759-g35b2d86c-1jammy [662 kB] 2023-07-09T21:18:53.100 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-07-09T21:18:53.118 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4759-g35b2d86c-1jammy [345 kB] 2023-07-09T21:18:53.130 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4759-g35b2d86c-1jammy [22.9 kB] 2023-07-09T21:18:53.130 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4759-g35b2d86c-1jammy [170 kB] 2023-07-09T21:18:53.136 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4759-g35b2d86c-1jammy [49.0 kB] 2023-07-09T21:18:53.138 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4759-g35b2d86c-1jammy [318 kB] 2023-07-09T21:18:53.148 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4759-g35b2d86c-1jammy [6,060 kB] 2023-07-09T21:18:53.167 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-09T21:18:53.211 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-09T21:18:53.286 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-09T21:18:53.295 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-07-09T21:18:53.297 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-09T21:18:53.339 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-07-09T21:18:53.343 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-09T21:18:53.360 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4759-g35b2d86c-1jammy [102 kB] 2023-07-09T21:18:53.363 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4759-g35b2d86c-1jammy [430 kB] 2023-07-09T21:18:53.379 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4759-g35b2d86c-1jammy [22.3 MB] 2023-07-09T21:18:53.414 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-07-09T21:18:53.425 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-07-09T21:18:53.471 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-07-09T21:18:53.509 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-09T21:18:53.517 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-09T21:18:53.544 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-09T21:18:53.637 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-07-09T21:18:53.646 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-07-09T21:18:53.672 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-07-09T21:18:53.716 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-09T21:18:53.844 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-07-09T21:18:53.910 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-09T21:18:54.038 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-07-09T21:18:54.166 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4759-g35b2d86c-1jammy [6,825 kB] 2023-07-09T21:18:54.274 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-09T21:18:54.282 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-09T21:18:54.283 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-09T21:18:54.295 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-09T21:18:54.296 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-09T21:18:54.298 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-09T21:18:54.300 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-09T21:18:54.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-09T21:18:54.303 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-09T21:18:54.402 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-07-09T21:18:54.410 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-07-09T21:18:54.411 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-07-09T21:18:54.412 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4759-g35b2d86c-1jammy [226 kB] 2023-07-09T21:18:54.418 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4759-g35b2d86c-1jammy [114 kB] 2023-07-09T21:18:54.427 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4759-g35b2d86c-1jammy [1,476 kB] 2023-07-09T21:18:54.427 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-07-09T21:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-07-09T21:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-07-09T21:18:54.428 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-07-09T21:18:54.430 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-07-09T21:18:54.431 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-07-09T21:18:54.468 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-09T21:18:54.477 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4759-g35b2d86c-1jammy [9,879 kB] 2023-07-09T21:18:54.596 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-07-09T21:18:54.604 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-4759-g35b2d86c-1jammy [3,094 kB] 2023-07-09T21:18:54.846 INFO:teuthology.orchestra.run.smithi119.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4759-g35b2d86c-1jammy [31.6 MB] 2023-07-09T21:18:54.899 INFO:teuthology.orchestra.run.smithi119.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-09T21:18:54.909 INFO:teuthology.orchestra.run.smithi119.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-09T21:18:54.914 INFO:teuthology.orchestra.run.smithi119.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-09T21:18:54.918 INFO:teuthology.orchestra.run.smithi119.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-09T21:18:54.936 INFO:teuthology.orchestra.run.smithi119.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-09T21:18:54.939 INFO:teuthology.orchestra.run.smithi119.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-09T21:18:54.941 INFO:teuthology.orchestra.run.smithi119.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-09T21:18:54.983 INFO:teuthology.orchestra.run.smithi119.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-09T21:18:54.997 INFO:teuthology.orchestra.run.smithi119.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-09T21:18:55.002 INFO:teuthology.orchestra.run.smithi119.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-09T21:18:55.027 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-07-09T21:18:55.037 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-07-09T21:18:55.043 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-07-09T21:18:55.046 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-07-09T21:18:55.065 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-07-09T21:18:55.068 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-07-09T21:18:55.070 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-07-09T21:18:55.114 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-07-09T21:18:55.126 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-07-09T21:18:55.130 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-07-09T21:18:55.255 INFO:teuthology.orchestra.run.smithi119.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-09T21:18:55.293 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-4759-g35b2d86c-1jammy [662 kB] 2023-07-09T21:18:55.338 INFO:teuthology.orchestra.run.smithi119.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-09T21:18:55.386 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-07-09T21:18:55.422 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-4759-g35b2d86c-1jammy [345 kB] 2023-07-09T21:18:55.427 INFO:teuthology.orchestra.run.smithi119.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-09T21:18:55.469 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-07-09T21:18:55.485 INFO:teuthology.orchestra.run.smithi119.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-09T21:18:55.488 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-4759-g35b2d86c-1jammy [22.9 kB] 2023-07-09T21:18:55.491 INFO:teuthology.orchestra.run.smithi037.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-4759-g35b2d86c-1jammy [170 kB] 2023-07-09T21:18:55.522 INFO:teuthology.orchestra.run.smithi037.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-4759-g35b2d86c-1jammy [49.0 kB] 2023-07-09T21:18:55.533 INFO:teuthology.orchestra.run.smithi037.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-4759-g35b2d86c-1jammy [318 kB] 2023-07-09T21:18:55.559 INFO:teuthology.orchestra.run.smithi037.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-07-09T21:18:55.588 INFO:teuthology.orchestra.run.smithi037.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-4759-g35b2d86c-1jammy [6,060 kB] 2023-07-09T21:18:55.603 INFO:teuthology.orchestra.run.smithi119.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-09T21:18:55.616 INFO:teuthology.orchestra.run.smithi037.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-07-09T21:18:55.689 INFO:teuthology.orchestra.run.smithi119.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-09T21:18:55.708 INFO:teuthology.orchestra.run.smithi119.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-09T21:18:55.737 INFO:teuthology.orchestra.run.smithi119.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-09T21:18:55.737 INFO:teuthology.orchestra.run.smithi037.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-07-09T21:18:55.748 INFO:teuthology.orchestra.run.smithi119.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-09T21:18:55.786 INFO:teuthology.orchestra.run.smithi119.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-09T21:18:55.794 INFO:teuthology.orchestra.run.smithi119.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-09T21:18:55.826 INFO:teuthology.orchestra.run.smithi037.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-07-09T21:18:55.844 INFO:teuthology.orchestra.run.smithi037.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-07-09T21:18:55.873 INFO:teuthology.orchestra.run.smithi037.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-07-09T21:18:55.885 INFO:teuthology.orchestra.run.smithi037.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-07-09T21:18:55.923 INFO:teuthology.orchestra.run.smithi037.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-07-09T21:18:55.932 INFO:teuthology.orchestra.run.smithi037.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-07-09T21:18:55.985 INFO:teuthology.orchestra.run.smithi119.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-09T21:18:56.118 INFO:teuthology.orchestra.run.smithi119.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4759-g35b2d86c-1jammy [3,600 B] 2023-07-09T21:18:56.118 INFO:teuthology.orchestra.run.smithi119.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [816 kB] 2023-07-09T21:18:56.123 INFO:teuthology.orchestra.run.smithi037.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-07-09T21:18:56.142 INFO:teuthology.orchestra.run.smithi119.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4759-g35b2d86c-1jammy [2,136 kB] 2023-07-09T21:18:56.234 INFO:teuthology.orchestra.run.smithi119.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4759-g35b2d86c-1jammy [218 kB] 2023-07-09T21:18:56.244 INFO:teuthology.orchestra.run.smithi119.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4759-g35b2d86c-1jammy [125 kB] 2023-07-09T21:18:56.249 INFO:teuthology.orchestra.run.smithi119.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4759-g35b2d86c-1jammy [1,842 kB] 2023-07-09T21:18:56.373 INFO:teuthology.orchestra.run.smithi119.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4759-g35b2d86c-1jammy [8,615 kB] 2023-07-09T21:18:56.488 INFO:teuthology.orchestra.run.smithi037.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-4759-g35b2d86c-1jammy [102 kB] 2023-07-09T21:18:56.492 INFO:teuthology.orchestra.run.smithi037.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-4759-g35b2d86c-1jammy [430 kB] 2023-07-09T21:18:56.558 INFO:teuthology.orchestra.run.smithi037.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-4759-g35b2d86c-1jammy [22.3 MB] 2023-07-09T21:18:56.705 INFO:teuthology.orchestra.run.smithi119.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4759-g35b2d86c-1jammy [3,730 B] 2023-07-09T21:18:56.705 INFO:teuthology.orchestra.run.smithi119.stdout:Get:72 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4759-g35b2d86c-1jammy [47.3 MB] 2023-07-09T21:18:56.795 INFO:teuthology.orchestra.run.smithi119.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-09T21:18:56.796 INFO:teuthology.orchestra.run.smithi119.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-09T21:18:56.797 INFO:teuthology.orchestra.run.smithi119.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-09T21:18:56.798 INFO:teuthology.orchestra.run.smithi119.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-09T21:18:56.799 INFO:teuthology.orchestra.run.smithi119.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-09T21:18:56.800 INFO:teuthology.orchestra.run.smithi119.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-09T21:18:56.824 INFO:teuthology.orchestra.run.smithi119.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-09T21:18:56.827 INFO:teuthology.orchestra.run.smithi119.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-09T21:18:56.827 INFO:teuthology.orchestra.run.smithi119.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-09T21:18:56.897 INFO:teuthology.orchestra.run.smithi119.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-09T21:18:56.932 INFO:teuthology.orchestra.run.smithi037.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-07-09T21:18:56.933 INFO:teuthology.orchestra.run.smithi037.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-07-09T21:18:56.935 INFO:teuthology.orchestra.run.smithi037.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-07-09T21:18:56.936 INFO:teuthology.orchestra.run.smithi037.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-07-09T21:18:56.936 INFO:teuthology.orchestra.run.smithi037.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-07-09T21:18:56.937 INFO:teuthology.orchestra.run.smithi037.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-07-09T21:18:56.960 INFO:teuthology.orchestra.run.smithi037.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-07-09T21:18:56.963 INFO:teuthology.orchestra.run.smithi037.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-07-09T21:18:56.963 INFO:teuthology.orchestra.run.smithi037.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-07-09T21:18:57.034 INFO:teuthology.orchestra.run.smithi037.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-07-09T21:18:57.061 INFO:teuthology.orchestra.run.smithi119.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-09T21:18:57.198 INFO:teuthology.orchestra.run.smithi037.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-07-09T21:18:57.318 INFO:teuthology.orchestra.run.smithi119.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-09T21:18:57.349 INFO:teuthology.orchestra.run.smithi119.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-09T21:18:57.376 INFO:teuthology.orchestra.run.smithi119.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-09T21:18:57.430 INFO:teuthology.orchestra.run.smithi119.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-09T21:18:57.449 INFO:teuthology.orchestra.run.smithi119.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-09T21:18:57.457 INFO:teuthology.orchestra.run.smithi037.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-07-09T21:18:57.475 INFO:teuthology.orchestra.run.smithi119.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-09T21:18:57.489 INFO:teuthology.orchestra.run.smithi037.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-07-09T21:18:57.516 INFO:teuthology.orchestra.run.smithi037.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-07-09T21:18:57.570 INFO:teuthology.orchestra.run.smithi037.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-07-09T21:18:57.588 INFO:teuthology.orchestra.run.smithi037.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-07-09T21:18:57.610 INFO:teuthology.orchestra.run.smithi119.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-09T21:18:57.615 INFO:teuthology.orchestra.run.smithi037.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-07-09T21:18:57.637 INFO:teuthology.orchestra.run.smithi119.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-09T21:18:57.745 INFO:teuthology.orchestra.run.smithi037.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-07-09T21:18:57.777 INFO:teuthology.orchestra.run.smithi037.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-07-09T21:18:57.797 INFO:teuthology.orchestra.run.smithi037.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-09T21:18:57.804 INFO:teuthology.orchestra.run.smithi037.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-09T21:18:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-07-09T21:18:57.829 INFO:teuthology.orchestra.run.smithi119.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-07-09T21:18:57.996 INFO:teuthology.orchestra.run.smithi119.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-09T21:18:58.009 INFO:teuthology.orchestra.run.smithi037.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-07-09T21:18:58.458 INFO:teuthology.orchestra.run.smithi119.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-09T21:18:58.463 INFO:teuthology.orchestra.run.smithi119.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-09T21:18:58.471 INFO:teuthology.orchestra.run.smithi037.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-07-09T21:18:58.476 INFO:teuthology.orchestra.run.smithi037.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-07-09T21:18:58.589 INFO:teuthology.orchestra.run.smithi119.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-09T21:18:58.603 INFO:teuthology.orchestra.run.smithi037.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-07-09T21:18:58.637 INFO:teuthology.orchestra.run.smithi119.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-09T21:18:58.637 INFO:teuthology.orchestra.run.smithi119.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-09T21:18:58.643 INFO:teuthology.orchestra.run.smithi119.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-09T21:18:58.645 INFO:teuthology.orchestra.run.smithi119.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-09T21:18:58.650 INFO:teuthology.orchestra.run.smithi037.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-07-09T21:18:58.651 INFO:teuthology.orchestra.run.smithi037.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-07-09T21:18:58.657 INFO:teuthology.orchestra.run.smithi037.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-07-09T21:18:58.658 INFO:teuthology.orchestra.run.smithi037.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-07-09T21:18:58.660 INFO:teuthology.orchestra.run.smithi119.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-09T21:18:58.668 INFO:teuthology.orchestra.run.smithi119.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-09T21:18:58.674 INFO:teuthology.orchestra.run.smithi037.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-07-09T21:18:58.681 INFO:teuthology.orchestra.run.smithi037.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-07-09T21:18:58.728 INFO:teuthology.orchestra.run.smithi119.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-09T21:18:58.742 INFO:teuthology.orchestra.run.smithi037.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-07-09T21:18:58.763 INFO:teuthology.orchestra.run.smithi119.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4759-g35b2d86c-1jammy [231 kB] 2023-07-09T21:18:58.765 INFO:teuthology.orchestra.run.smithi119.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4759-g35b2d86c-1jammy [217 kB] 2023-07-09T21:18:58.768 INFO:teuthology.orchestra.run.smithi119.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4759-g35b2d86c-1jammy [23.8 kB] 2023-07-09T21:18:58.768 INFO:teuthology.orchestra.run.smithi119.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4759-g35b2d86c-1jammy [13.2 kB] 2023-07-09T21:18:58.768 INFO:teuthology.orchestra.run.smithi119.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4759-g35b2d86c-1jammy [28.4 kB] 2023-07-09T21:18:58.769 INFO:teuthology.orchestra.run.smithi119.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4759-g35b2d86c-1jammy [12.0 MB] 2023-07-09T21:18:58.893 INFO:teuthology.orchestra.run.smithi119.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-09T21:18:58.906 INFO:teuthology.orchestra.run.smithi037.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-07-09T21:18:59.059 INFO:teuthology.orchestra.run.smithi119.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-09T21:18:59.072 INFO:teuthology.orchestra.run.smithi037.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-07-09T21:18:59.271 INFO:teuthology.orchestra.run.smithi119.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [82.1 kB] 2023-07-09T21:18:59.333 INFO:teuthology.orchestra.run.smithi119.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-09T21:18:59.349 INFO:teuthology.orchestra.run.smithi037.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-07-09T21:18:59.357 INFO:teuthology.orchestra.run.smithi119.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-09T21:18:59.373 INFO:teuthology.orchestra.run.smithi037.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-07-09T21:18:59.461 INFO:teuthology.orchestra.run.smithi037.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-4759-g35b2d86c-1jammy [6,825 kB] 2023-07-09T21:18:59.821 INFO:teuthology.orchestra.run.smithi037.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-4759-g35b2d86c-1jammy [226 kB] 2023-07-09T21:18:59.823 INFO:teuthology.orchestra.run.smithi037.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4759-g35b2d86c-1jammy [114 kB] 2023-07-09T21:18:59.829 INFO:teuthology.orchestra.run.smithi037.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-4759-g35b2d86c-1jammy [1,476 kB] 2023-07-09T21:18:59.908 INFO:teuthology.orchestra.run.smithi037.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-4759-g35b2d86c-1jammy [9,879 kB] 2023-07-09T21:19:00.166 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 182 MB in 7s (26.3 MB/s) 2023-07-09T21:19:00.295 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-09T21:19:00.366 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-09T21:19:00.368 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-09T21:19:00.411 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-09T21:19:00.435 INFO:teuthology.orchestra.run.smithi037.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-4759-g35b2d86c-1jammy [31.6 MB] 2023-07-09T21:19:00.714 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-09T21:19:00.726 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-09T21:19:00.764 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T21:19:01.066 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cmd2. 2023-07-09T21:19:01.080 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-09T21:19:01.117 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-09T21:19:01.419 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-09T21:19:01.432 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-09T21:19:01.511 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T21:19:01.822 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-09T21:19:01.836 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-09T21:19:01.881 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T21:19:02.057 INFO:teuthology.orchestra.run.smithi037.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-4759-g35b2d86c-1jammy [3,600 B] 2023-07-09T21:19:02.058 INFO:teuthology.orchestra.run.smithi037.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [816 kB] 2023-07-09T21:19:02.094 INFO:teuthology.orchestra.run.smithi037.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-4759-g35b2d86c-1jammy [2,136 kB] 2023-07-09T21:19:02.202 INFO:teuthology.orchestra.run.smithi037.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-4759-g35b2d86c-1jammy [218 kB] 2023-07-09T21:19:02.211 INFO:teuthology.orchestra.run.smithi037.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-4759-g35b2d86c-1jammy [125 kB] 2023-07-09T21:19:02.218 INFO:teuthology.orchestra.run.smithi037.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-4759-g35b2d86c-1jammy [1,842 kB] 2023-07-09T21:19:02.284 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-09T21:19:02.298 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-09T21:19:02.310 INFO:teuthology.orchestra.run.smithi037.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4759-g35b2d86c-1jammy [8,615 kB] 2023-07-09T21:19:02.351 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T21:19:02.696 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-09T21:19:02.709 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-09T21:19:02.762 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T21:19:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-4759-g35b2d86c-1jammy [3,730 B] 2023-07-09T21:19:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-4759-g35b2d86c-1jammy [47.3 MB] 2023-07-09T21:19:03.324 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-09T21:19:03.339 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:03.399 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:03.844 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-09T21:19:03.858 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:03.910 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:04.288 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-09T21:19:04.303 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:04.355 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:04.742 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-09T21:19:04.756 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-09T21:19:04.808 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T21:19:05.178 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librados2. 2023-07-09T21:19:05.192 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../011-librados2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:05.244 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:05.680 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librbd1. 2023-07-09T21:19:05.694 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../012-librbd1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:05.739 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:06.076 INFO:teuthology.orchestra.run.smithi037.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-4759-g35b2d86c-1jammy [231 kB] 2023-07-09T21:19:06.082 INFO:teuthology.orchestra.run.smithi037.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-4759-g35b2d86c-1jammy [217 kB] 2023-07-09T21:19:06.087 INFO:teuthology.orchestra.run.smithi037.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-4759-g35b2d86c-1jammy [23.8 kB] 2023-07-09T21:19:06.087 INFO:teuthology.orchestra.run.smithi037.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-4759-g35b2d86c-1jammy [13.2 kB] 2023-07-09T21:19:06.087 INFO:teuthology.orchestra.run.smithi037.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-4759-g35b2d86c-1jammy [28.4 kB] 2023-07-09T21:19:06.088 INFO:teuthology.orchestra.run.smithi037.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-4759-g35b2d86c-1jammy [12.0 MB] 2023-07-09T21:19:06.233 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs2. 2023-07-09T21:19:06.247 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:06.317 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:06.636 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rados. 2023-07-09T21:19:06.650 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:06.691 INFO:teuthology.orchestra.run.smithi037.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul9/35b2d86cfd512f15ace2077050d20c8669933212/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-4759-g35b2d86c-1jammy [82.1 kB] 2023-07-09T21:19:06.702 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:07.055 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-09T21:19:07.069 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:07.113 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:07.280 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 182 MB in 14s (13.1 MB/s) 2023-07-09T21:19:07.391 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cephfs. 2023-07-09T21:19:07.405 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:07.431 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyperclip. 2023-07-09T21:19:07.457 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:07.503 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132931 files and directories currently installed.) 2023-07-09T21:19:07.506 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-07-09T21:19:07.547 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-07-09T21:19:07.782 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-wcwidth. 2023-07-09T21:19:07.796 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-07-09T21:19:07.832 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T21:19:07.835 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-09T21:19:07.850 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:07.919 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:08.152 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cmd2. 2023-07-09T21:19:08.166 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-07-09T21:19:08.210 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-07-09T21:19:08.305 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-prettytable. 2023-07-09T21:19:08.319 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-09T21:19:08.372 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-09T21:19:08.658 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rbd. 2023-07-09T21:19:08.672 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:08.716 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:08.721 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libfmt8:amd64. 2023-07-09T21:19:08.736 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-07-09T21:19:08.805 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T21:19:09.091 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-07-09T21:19:09.106 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-07-09T21:19:09.119 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-09T21:19:09.133 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-09T21:19:09.150 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T21:19:09.194 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T21:19:09.486 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-07-09T21:19:09.501 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-07-09T21:19:09.545 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T21:19:09.580 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package librgw2. 2023-07-09T21:19:09.594 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../021-librgw2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:09.646 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:09.881 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-07-09T21:19:09.896 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-07-09T21:19:09.939 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T21:19:10.166 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rgw. 2023-07-09T21:19:10.179 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:10.224 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:10.360 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-07-09T21:19:10.375 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:10.426 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:10.611 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-09T21:19:10.625 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-09T21:19:10.677 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T21:19:10.821 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-07-09T21:19:10.836 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:10.879 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:11.046 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libradosstriper1. 2023-07-09T21:19:11.060 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:11.113 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:11.316 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-07-09T21:19:11.330 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-07-09T21:19:11.374 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:19:11.641 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-common. 2023-07-09T21:19:11.656 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:11.677 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-07-09T21:19:11.692 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-07-09T21:19:11.708 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:11.735 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T21:19:12.046 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librados2. 2023-07-09T21:19:12.061 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../011-librados2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:12.105 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:12.524 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librbd1. 2023-07-09T21:19:12.539 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../012-librbd1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:12.582 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:12.747 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-base. 2023-07-09T21:19:12.761 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:12.806 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:12.969 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs2. 2023-07-09T21:19:12.983 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:13.019 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:13.288 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rados. 2023-07-09T21:19:13.303 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../014-python3-rados_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:13.346 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:13.701 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-09T21:19:13.715 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-09T21:19:13.759 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-09T21:19:13.882 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-07-09T21:19:13.897 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:13.940 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:14.045 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cheroot. 2023-07-09T21:19:14.060 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-09T21:19:14.104 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T21:19:14.193 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cephfs. 2023-07-09T21:19:14.208 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:14.243 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:14.423 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-09T21:19:14.438 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-09T21:19:14.482 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-09T21:19:14.546 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-ceph-common. 2023-07-09T21:19:14.561 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:14.604 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:14.751 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-09T21:19:14.766 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-09T21:19:14.801 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-09T21:19:14.924 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-prettytable. 2023-07-09T21:19:14.938 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-07-09T21:19:14.982 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-07-09T21:19:15.079 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-09T21:19:15.093 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-09T21:19:15.137 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-09T21:19:15.218 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rbd. 2023-07-09T21:19:15.233 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:15.268 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:15.457 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempora. 2023-07-09T21:19:15.471 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-09T21:19:15.515 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-09T21:19:15.579 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-07-09T21:19:15.594 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-07-09T21:19:15.637 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T21:19:15.843 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-portend. 2023-07-09T21:19:15.857 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-09T21:19:15.893 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-09T21:19:15.957 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package librgw2. 2023-07-09T21:19:15.971 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../021-librgw2_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:16.015 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:16.138 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-09T21:19:16.152 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-09T21:19:16.195 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-09T21:19:16.493 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rgw. 2023-07-09T21:19:16.498 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-09T21:19:16.507 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:16.513 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-09T21:19:16.551 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:16.557 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-09T21:19:16.845 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liboath0:amd64. 2023-07-09T21:19:16.860 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-07-09T21:19:16.904 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T21:19:16.919 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-natsort. 2023-07-09T21:19:16.933 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-09T21:19:16.977 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-09T21:19:17.206 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libradosstriper1. 2023-07-09T21:19:17.221 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:17.265 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:17.288 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-logutils. 2023-07-09T21:19:17.303 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-09T21:19:17.347 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-09T21:19:17.616 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-09T21:19:17.630 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-09T21:19:17.666 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-09T21:19:17.718 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-common. 2023-07-09T21:19:17.733 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../025-ceph-common_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:17.776 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:17.969 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-mako. 2023-07-09T21:19:17.982 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-09T21:19:18.019 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T21:19:18.347 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-09T21:19:18.361 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-09T21:19:18.405 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-09T21:19:18.742 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-09T21:19:18.756 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-09T21:19:18.792 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-09T21:19:18.865 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-base. 2023-07-09T21:19:18.880 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../026-ceph-base_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:18.975 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:19.044 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webob. 2023-07-09T21:19:19.058 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-09T21:19:19.094 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-09T21:19:19.405 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-waitress. 2023-07-09T21:19:19.419 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-09T21:19:19.466 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T21:19:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-07-09T21:19:19.634 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-07-09T21:19:19.669 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-07-09T21:19:19.786 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-tempita. 2023-07-09T21:19:19.800 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-09T21:19:19.844 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T21:19:19.972 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cheroot. 2023-07-09T21:19:19.986 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-07-09T21:19:20.030 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T21:19:20.122 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-paste. 2023-07-09T21:19:20.136 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-09T21:19:20.171 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T21:19:20.342 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-07-09T21:19:20.357 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-07-09T21:19:20.409 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-07-09T21:19:20.500 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-09T21:19:20.513 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-09T21:19:20.558 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T21:19:20.720 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.text. 2023-07-09T21:19:20.735 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-07-09T21:19:20.778 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-07-09T21:19:20.844 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-09T21:19:20.858 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-09T21:19:20.894 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-09T21:19:21.064 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-07-09T21:19:21.079 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-07-09T21:19:21.114 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-07-09T21:19:21.172 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-webtest. 2023-07-09T21:19:21.186 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-09T21:19:21.231 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-09T21:19:21.434 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempora. 2023-07-09T21:19:21.447 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-07-09T21:19:21.492 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-07-09T21:19:21.516 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pecan. 2023-07-09T21:19:21.531 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-09T21:19:21.575 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T21:19:21.812 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-portend. 2023-07-09T21:19:21.826 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-07-09T21:19:21.870 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-07-09T21:19:21.963 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-certifi. 2023-07-09T21:19:21.978 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-09T21:19:22.021 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-09T21:19:22.148 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-07-09T21:19:22.163 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-07-09T21:19:22.198 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-07-09T21:19:22.324 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-idna. 2023-07-09T21:19:22.339 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-09T21:19:22.374 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-09T21:19:22.451 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cherrypy3. 2023-07-09T21:19:22.465 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-07-09T21:19:22.509 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-07-09T21:19:22.669 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-urllib3. 2023-07-09T21:19:22.684 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-09T21:19:22.727 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T21:19:22.862 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-natsort. 2023-07-09T21:19:22.877 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-07-09T21:19:22.921 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-07-09T21:19:23.064 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests. 2023-07-09T21:19:23.078 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-09T21:19:23.122 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T21:19:23.174 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-logutils. 2023-07-09T21:19:23.188 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-07-09T21:19:23.223 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-07-09T21:19:23.416 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-09T21:19:23.430 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-09T21:19:23.475 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T21:19:23.518 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-markupsafe. 2023-07-09T21:19:23.533 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-07-09T21:19:23.576 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-07-09T21:19:23.761 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-09T21:19:23.775 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:23.819 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:24.054 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-mako. 2023-07-09T21:19:24.069 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-07-09T21:19:24.113 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T21:19:24.141 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-09T21:19:24.154 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:24.190 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:24.441 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplegeneric. 2023-07-09T21:19:24.456 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-07-09T21:19:24.485 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-openssl. 2023-07-09T21:19:24.498 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-09T21:19:24.499 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-07-09T21:19:24.535 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-09T21:19:24.777 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-singledispatch. 2023-07-09T21:19:24.792 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-07-09T21:19:24.827 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-07-09T21:19:24.888 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr. 2023-07-09T21:19:24.901 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:24.946 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:25.130 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webob. 2023-07-09T21:19:25.145 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-07-09T21:19:25.188 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-07-09T21:19:25.291 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mon. 2023-07-09T21:19:25.305 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:25.341 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:25.507 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-waitress. 2023-07-09T21:19:25.522 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-07-09T21:19:26.103 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-osd. 2023-07-09T21:19:26.117 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:26.161 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:26.194 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T21:19:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-tempita. 2023-07-09T21:19:26.484 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-07-09T21:19:26.519 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T21:19:26.788 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-paste. 2023-07-09T21:19:26.804 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-07-09T21:19:26.847 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T21:19:27.158 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-07-09T21:19:27.173 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-07-09T21:19:27.208 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T21:19:27.356 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph. 2023-07-09T21:19:27.371 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../061-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:27.414 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:27.503 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastedeploy. 2023-07-09T21:19:27.518 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-07-09T21:19:27.561 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-07-09T21:19:27.675 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-fuse. 2023-07-09T21:19:27.690 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:27.725 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:27.864 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-webtest. 2023-07-09T21:19:27.879 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-07-09T21:19:27.922 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-07-09T21:19:28.120 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mds. 2023-07-09T21:19:28.134 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:28.178 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:28.200 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pecan. 2023-07-09T21:19:28.214 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-07-09T21:19:28.250 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T21:19:28.548 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephadm. 2023-07-09T21:19:28.562 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../064-cephadm_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:28.596 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-certifi. 2023-07-09T21:19:28.611 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-07-09T21:19:28.655 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-07-09T21:19:28.765 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:28.932 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-idna. 2023-07-09T21:19:28.948 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-07-09T21:19:28.982 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-idna (3.3-1) ... 2023-07-09T21:19:29.026 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-09T21:19:29.040 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-09T21:19:29.076 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-09T21:19:29.277 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-urllib3. 2023-07-09T21:19:29.292 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-07-09T21:19:29.344 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T21:19:29.371 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-09T21:19:29.385 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T21:19:29.421 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T21:19:29.672 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests. 2023-07-09T21:19:29.687 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-07-09T21:19:29.730 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T21:19:30.033 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-werkzeug. 2023-07-09T21:19:30.048 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-07-09T21:19:30.091 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T21:19:30.375 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-babel. 2023-07-09T21:19:30.389 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T21:19:30.403 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-07-09T21:19:30.418 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:30.434 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T21:19:30.461 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:30.754 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-jinja2. 2023-07-09T21:19:30.767 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-09T21:19:30.807 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-07-09T21:19:30.812 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-09T21:19:30.823 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:30.857 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:31.151 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-openssl. 2023-07-09T21:19:31.165 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-09T21:19:31.166 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-07-09T21:19:31.179 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:31.210 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-07-09T21:19:31.223 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:31.546 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr. 2023-07-09T21:19:31.560 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-09T21:19:31.561 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:31.574 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-09T21:19:31.604 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:31.618 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-09T21:19:31.888 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-09T21:19:31.903 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-09T21:19:31.938 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-09T21:19:31.966 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mon. 2023-07-09T21:19:31.981 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:32.016 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:32.224 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-routes. 2023-07-09T21:19:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-09T21:19:32.282 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T21:19:32.586 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-09T21:19:32.600 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:32.644 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:32.861 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-osd. 2023-07-09T21:19:32.877 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:32.919 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:33.039 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-09T21:19:33.053 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-09T21:19:33.097 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T21:19:33.576 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-joblib. 2023-07-09T21:19:33.590 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-09T21:19:33.634 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T21:19:34.038 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-09T21:19:34.053 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-09T21:19:34.096 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-09T21:19:34.356 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph. 2023-07-09T21:19:34.371 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../061-ceph_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:34.399 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-sklearn. 2023-07-09T21:19:34.414 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-09T21:19:34.414 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:34.457 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T21:19:34.692 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-fuse. 2023-07-09T21:19:34.707 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:34.744 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:35.095 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mds. 2023-07-09T21:19:35.111 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:35.133 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-09T21:19:35.146 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:35.153 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:35.191 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:35.556 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephadm. 2023-07-09T21:19:35.572 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../064-cephadm_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:35.615 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:35.876 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-asyncssh. 2023-07-09T21:19:35.892 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-07-09T21:19:35.926 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-07-09T21:19:36.094 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-cachetools. 2023-07-09T21:19:36.109 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-09T21:19:36.153 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-09T21:19:36.198 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-babel-localedata. 2023-07-09T21:19:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T21:19:36.247 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T21:19:36.455 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-09T21:19:36.470 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-09T21:19:36.513 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-09T21:19:36.842 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-09T21:19:36.857 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-09T21:19:36.892 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T21:19:37.161 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-babel. 2023-07-09T21:19:37.175 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-07-09T21:19:37.219 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T21:19:37.236 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-rsa. 2023-07-09T21:19:37.251 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-09T21:19:37.294 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-09T21:19:37.547 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-jinja2. 2023-07-09T21:19:37.562 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-07-09T21:19:37.606 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-07-09T21:19:37.683 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-google-auth. 2023-07-09T21:19:37.698 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-09T21:19:37.741 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-09T21:19:37.950 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-07-09T21:19:37.965 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:38.009 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:38.053 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-09T21:19:38.068 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-09T21:19:38.111 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T21:19:38.345 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-bcrypt. 2023-07-09T21:19:38.360 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-07-09T21:19:38.403 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-07-09T21:19:38.423 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-websocket. 2023-07-09T21:19:38.437 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-09T21:19:38.481 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-09T21:19:38.707 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-repoze.lru. 2023-07-09T21:19:38.722 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../071-python3-repoze.lru_0.7-2_all.deb ... 2023-07-09T21:19:38.765 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-07-09T21:19:38.784 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-09T21:19:38.799 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-09T21:19:38.842 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T21:19:39.043 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-routes. 2023-07-09T21:19:39.058 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../072-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-07-09T21:19:39.093 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T21:19:39.396 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-07-09T21:19:39.411 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../073-ceph-mgr-dashboard_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:39.445 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:39.514 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-09T21:19:39.528 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:39.573 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:39.825 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-09T21:19:39.839 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-09T21:19:39.874 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-07-09T21:19:39.875 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T21:19:39.889 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-07-09T21:19:39.933 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T21:19:40.229 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-09T21:19:40.242 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T21:19:40.287 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T21:19:40.403 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-joblib. 2023-07-09T21:19:40.418 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../075-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-07-09T21:19:40.461 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T21:19:40.539 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package jq. 2023-07-09T21:19:40.553 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T21:19:40.597 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-09T21:19:40.840 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-07-09T21:19:40.842 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package socat. 2023-07-09T21:19:40.854 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../076-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-07-09T21:19:40.856 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-09T21:19:40.889 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-07-09T21:19:40.891 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-09T21:19:41.142 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-sklearn. 2023-07-09T21:19:41.158 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../077-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-07-09T21:19:41.162 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package xmlstarlet. 2023-07-09T21:19:41.177 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-09T21:19:41.201 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T21:19:41.212 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-09T21:19:41.541 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-test. 2023-07-09T21:19:41.555 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:41.591 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-07-09T21:19:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../078-ceph-mgr-diskprediction-local_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:42.796 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-cachetools. 2023-07-09T21:19:42.811 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../079-python3-cachetools_5.0.0-1_all.deb ... 2023-07-09T21:19:42.845 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-07-09T21:19:43.140 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1. 2023-07-09T21:19:43.156 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../080-python3-pyasn1_0.4.8-1_all.deb ... 2023-07-09T21:19:43.199 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-07-09T21:19:43.295 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ceph-volume. 2023-07-09T21:19:43.310 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:43.353 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:43.510 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-07-09T21:19:43.525 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../081-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-07-09T21:19:43.568 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T21:19:43.766 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-09T21:19:43.780 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:43.824 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:43.863 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-rsa. 2023-07-09T21:19:43.878 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../082-python3-rsa_4.8-1_all.deb ... 2023-07-09T21:19:43.921 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-rsa (4.8-1) ... 2023-07-09T21:19:44.276 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-google-auth. 2023-07-09T21:19:44.286 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-colorama. 2023-07-09T21:19:44.292 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../083-python3-google-auth_1.5.1-3_all.deb ... 2023-07-09T21:19:44.301 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-09T21:19:44.326 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-07-09T21:19:44.336 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-09T21:19:44.597 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-shell. 2023-07-09T21:19:44.612 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:44.655 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:44.871 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-07-09T21:19:44.886 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../084-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-07-09T21:19:44.929 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T21:19:44.991 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package cephfs-top. 2023-07-09T21:19:45.006 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:45.050 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:45.249 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-websocket. 2023-07-09T21:19:45.264 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../085-python3-websocket_1.2.3-1_all.deb ... 2023-07-09T21:19:45.294 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-09T21:19:45.307 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-07-09T21:19:45.309 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:45.344 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:45.577 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-kubernetes. 2023-07-09T21:19:45.593 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../086-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-07-09T21:19:45.627 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T21:19:45.689 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package nvme-cli. 2023-07-09T21:19:45.704 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-09T21:19:45.739 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T21:19:46.019 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-09T21:19:46.033 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-09T21:19:46.068 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-09T21:19:46.324 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-07-09T21:19:46.338 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../087-ceph-mgr-k8sevents_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:46.383 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:46.488 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-09T21:19:46.502 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-09T21:19:46.538 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-09T21:19:46.685 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libonig5:amd64. 2023-07-09T21:19:46.699 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../088-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-07-09T21:19:46.743 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T21:19:46.774 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pastescript. 2023-07-09T21:19:46.788 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-09T21:19:46.837 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-09T21:19:47.021 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjq1:amd64. 2023-07-09T21:19:47.036 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../089-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T21:19:47.071 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T21:19:47.136 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pluggy. 2023-07-09T21:19:47.150 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-09T21:19:47.194 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-09T21:19:47.324 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package jq. 2023-07-09T21:19:47.340 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../090-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-07-09T21:19:47.382 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-07-09T21:19:47.506 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-psutil. 2023-07-09T21:19:47.519 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-09T21:19:47.564 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-09T21:19:47.635 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package socat. 2023-07-09T21:19:47.650 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../091-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-07-09T21:19:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-07-09T21:19:47.875 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-py. 2023-07-09T21:19:47.889 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-09T21:19:47.925 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-09T21:19:47.980 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package xmlstarlet. 2023-07-09T21:19:47.995 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../092-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-07-09T21:19:48.038 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-07-09T21:19:48.203 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pygments. 2023-07-09T21:19:48.217 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-09T21:19:48.262 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T21:19:48.384 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-test. 2023-07-09T21:19:48.398 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../093-ceph-test_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:48.442 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:48.749 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-09T21:19:48.763 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-09T21:19:48.807 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-09T21:19:49.110 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-toml. 2023-07-09T21:19:49.123 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-09T21:19:49.168 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-09T21:19:49.471 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-pytest. 2023-07-09T21:19:49.485 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-09T21:19:49.529 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T21:19:49.858 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package python3-simplejson. 2023-07-09T21:19:49.871 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-09T21:19:49.920 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-09T21:19:50.121 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ceph-volume. 2023-07-09T21:19:50.136 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../094-ceph-volume_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:50.171 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:50.185 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-09T21:19:50.199 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-09T21:19:50.243 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-09T21:19:50.559 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-mirror. 2023-07-09T21:19:50.574 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../095-cephfs-mirror_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:50.609 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:50.896 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-colorama. 2023-07-09T21:19:50.911 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../096-python3-colorama_0.4.4-1_all.deb ... 2023-07-09T21:19:50.939 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package radosgw. 2023-07-09T21:19:50.952 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../113-radosgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:50.953 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-07-09T21:19:50.989 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:51.215 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-shell. 2023-07-09T21:19:51.231 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../097-cephfs-shell_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:51.273 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:51.534 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package cephfs-top. 2023-07-09T21:19:51.550 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../098-cephfs-top_18.0.0-4759-g35b2d86c-1jammy_all.deb ... 2023-07-09T21:19:51.575 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package rbd-fuse. 2023-07-09T21:19:51.589 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:51.592 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:51.633 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:51.812 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libcephfs-dev. 2023-07-09T21:19:51.827 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../099-libcephfs-dev_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:51.861 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:51.909 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-09T21:19:52.189 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T21:19:52.232 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package nvme-cli. 2023-07-09T21:19:52.248 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../100-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-07-09T21:19:52.290 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T21:19:52.315 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T21:19:52.602 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-09T21:19:52.636 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-07-09T21:19:52.652 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../101-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-07-09T21:19:52.695 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-07-09T21:19:53.039 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-09T21:19:53.106 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-iniconfig. 2023-07-09T21:19:53.122 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../102-python3-iniconfig_1.1.1-2_all.deb ... 2023-07-09T21:19:53.173 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-07-09T21:19:53.484 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pastescript. 2023-07-09T21:19:53.500 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../103-python3-pastescript_2.0.2-4_all.deb ... 2023-07-09T21:19:53.533 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-07-09T21:19:53.685 INFO:teuthology.orchestra.run.smithi119.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-09T21:19:53.740 INFO:teuthology.orchestra.run.smithi119.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-09T21:19:53.783 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:53.837 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pluggy. 2023-07-09T21:19:53.853 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../104-python3-pluggy_0.13.0-7.1_all.deb ... 2023-07-09T21:19:53.886 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-07-09T21:19:54.198 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-psutil. 2023-07-09T21:19:54.214 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../105-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-07-09T21:19:54.248 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-07-09T21:19:54.353 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user cephadm....done 2023-07-09T21:19:54.514 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T21:19:54.593 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-py. 2023-07-09T21:19:54.609 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../106-python3-py_1.10.0-1_all.deb ... 2023-07-09T21:19:54.651 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-py (1.10.0-1) ... 2023-07-09T21:19:54.799 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-09T21:19:54.954 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pygments. 2023-07-09T21:19:54.970 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../107-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-07-09T21:19:55.012 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T21:19:55.059 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-09T21:19:55.184 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-09T21:19:55.444 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-09T21:19:55.483 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pyinotify. 2023-07-09T21:19:55.498 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../108-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-07-09T21:19:55.541 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-07-09T21:19:55.779 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T21:19:55.844 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-toml. 2023-07-09T21:19:55.859 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../109-python3-toml_0.10.2-1_all.deb ... 2023-07-09T21:19:55.888 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-09T21:19:55.902 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-07-09T21:19:56.163 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-pytest. 2023-07-09T21:19:56.179 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../110-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-07-09T21:19:56.198 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T21:19:56.213 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T21:19:56.550 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package python3-simplejson. 2023-07-09T21:19:56.566 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-07-09T21:19:56.567 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-09T21:19:56.608 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-07-09T21:19:56.834 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-09T21:19:56.877 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-07-09T21:19:56.893 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-07-09T21:19:56.935 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-07-09T21:19:57.094 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-09T21:19:57.356 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-09T21:19:57.615 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-09T21:19:57.664 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package radosgw. 2023-07-09T21:19:57.679 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../113-radosgw_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:57.731 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:57.891 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-09T21:19:58.151 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:58.267 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package rbd-fuse. 2023-07-09T21:19:58.282 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-4759-g35b2d86c-1jammy_amd64.deb ... 2023-07-09T21:19:58.317 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:19:58.410 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T21:19:58.519 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-09T21:19:58.610 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-07-09T21:19:58.795 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-09T21:19:58.889 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-07-09T21:19:59.024 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-07-09T21:19:59.046 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T21:19:59.181 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-09T21:19:59.293 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-07-09T21:19:59.540 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T21:19:59.666 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-09T21:19:59.716 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-07-09T21:19:59.934 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T21:20:00.202 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-09T21:20:00.338 INFO:teuthology.orchestra.run.smithi037.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-07-09T21:20:00.411 INFO:teuthology.orchestra.run.smithi037.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-07-09T21:20:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:00.494 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T21:20:01.045 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user cephadm....done 2023-07-09T21:20:01.207 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-07-09T21:20:01.213 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T21:20:01.466 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-07-09T21:20:01.481 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T21:20:01.607 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-09T21:20:01.709 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-07-09T21:20:01.750 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T21:20:01.810 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-07-09T21:20:02.061 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-07-09T21:20:02.067 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-09T21:20:02.329 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-07-09T21:20:02.455 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-py (1.10.0-1) ... 2023-07-09T21:20:02.469 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-09T21:20:02.711 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T21:20:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-07-09T21:20:03.105 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T21:20:03.142 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-07-09T21:20:03.414 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-09T21:20:03.451 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-07-09T21:20:03.727 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-07-09T21:20:03.732 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T21:20:04.012 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-07-09T21:20:04.092 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-09T21:20:04.271 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-07-09T21:20:04.343 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-09T21:20:04.444 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:04.547 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-07-09T21:20:04.737 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-idna (3.3-1) ... 2023-07-09T21:20:04.815 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-argparse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:05.075 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-07-09T21:20:05.079 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T21:20:05.184 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-07-09T21:20:05.443 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-07-09T21:20:05.703 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-07-09T21:20:05.829 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-07-09T21:20:06.213 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-07-09T21:20:06.319 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:06.339 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-07-09T21:20:06.428 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-09T21:20:06.665 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-07-09T21:20:06.687 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T21:20:06.814 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-09T21:20:06.940 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T21:20:06.941 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-07-09T21:20:07.234 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-07-09T21:20:07.249 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-09T21:20:07.517 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-09T21:20:07.793 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:07.911 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T21:20:07.945 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-07-09T21:20:08.037 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-09T21:20:08.221 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-07-09T21:20:08.346 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-07-09T21:20:08.347 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-09T21:20:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-07-09T21:20:08.606 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-09T21:20:08.799 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-07-09T21:20:08.874 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-09T21:20:09.141 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-09T21:20:09.192 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-07-09T21:20:09.401 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-09T21:20:09.435 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-07-09T21:20:09.661 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T21:20:09.786 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-09T21:20:09.836 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-07-09T21:20:10.071 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T21:20:10.146 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-07-09T21:20:10.197 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T21:20:10.472 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-07-09T21:20:10.490 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-09T21:20:10.800 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-09T21:20:10.832 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-07-09T21:20:11.083 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-07-09T21:20:11.100 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T21:20:11.184 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:11.485 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-idna (3.3-1) ... 2023-07-09T21:20:11.500 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-09T21:20:11.745 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T21:20:11.836 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-07-09T21:20:11.854 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T21:20:12.264 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-09T21:20:12.532 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-09T21:20:12.791 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:12.901 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-09T21:20:13.118 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:13.202 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T21:20:13.251 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-toml (0.10.2-1) ... 2023-07-09T21:20:13.495 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T21:20:13.528 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-07-09T21:20:13.654 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-07-09T21:20:13.762 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-09T21:20:13.780 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-07-09T21:20:13.914 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-09T21:20:14.097 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-07-09T21:20:14.190 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-09T21:20:14.374 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-07-09T21:20:14.466 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T21:20:14.617 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:14.718 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-07-09T21:20:14.844 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-07-09T21:20:15.050 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-09T21:20:15.162 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-07-09T21:20:15.429 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-07-09T21:20:15.435 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-09T21:20:15.706 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-07-09T21:20:15.728 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T21:20:15.965 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-07-09T21:20:16.064 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T21:20:16.215 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:16.216 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-07-09T21:20:16.341 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:16.501 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-07-09T21:20:16.527 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:16.618 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-07-09T21:20:16.628 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:16.729 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:16.855 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-09T21:20:16.911 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-07-09T21:20:17.037 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-07-09T21:20:17.148 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:17.275 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:17.338 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-07-09T21:20:17.400 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:17.611 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T21:20:17.611 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T21:20:17.647 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-07-09T21:20:17.915 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-07-09T21:20:18.319 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:18.333 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-07-09T21:20:18.420 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:18.546 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:18.585 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-07-09T21:20:18.672 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T21:20:18.711 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-07-09T21:20:19.121 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-07-09T21:20:19.397 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-portend (3.0.0-1) ... 2023-07-09T21:20:19.648 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-07-09T21:20:19.776 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-07-09T21:20:19.944 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.095 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.110 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-07-09T21:20:20.221 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.347 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.420 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-07-09T21:20:20.473 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.599 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:20.704 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-07-09T21:20:20.953 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rsa (4.8-1) ... 2023-07-09T21:20:21.119 INFO:teuthology.orchestra.run.smithi119.stdout:Adding group ceph....done 2023-07-09T21:20:21.306 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-07-09T21:20:21.495 INFO:teuthology.orchestra.run.smithi119.stdout:Adding system user ceph....done 2023-07-09T21:20:21.584 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-07-09T21:20:21.681 INFO:teuthology.orchestra.run.smithi119.stdout:Setting system user ceph properties....done 2023-07-09T21:20:21.695 INFO:teuthology.orchestra.run.smithi119.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-09T21:20:21.830 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-09T21:20:21.859 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-07-09T21:20:22.250 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-09T21:20:22.252 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-07-09T21:20:22.537 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-07-09T21:20:22.905 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-07-09T21:20:23.016 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.031 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librados2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.157 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librgw2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.224 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T21:20:23.225 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T21:20:23.352 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.461 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs2 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.587 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libradosstriper1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.713 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-07-09T21:20:23.860 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:23.977 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:24.007 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up librbd1 (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:24.132 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-modules-core (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:24.233 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T21:20:24.233 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T21:20:24.267 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:24.486 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T21:20:24.486 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-07-09T21:20:25.168 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libcephfs-dev (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:25.296 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:25.345 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rados (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:25.496 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-top (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-07-09T21:20:25.690 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-09T21:20:26.481 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:26.795 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T21:20:26.796 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T21:20:26.977 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rbd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.103 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up rbd-fuse (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.229 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-rgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.355 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up python3-cephfs (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.459 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.481 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-shell (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.607 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-common (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:27.662 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T21:20:27.663 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T21:20:28.144 INFO:teuthology.orchestra.run.smithi037.stdout:Adding group ceph....done 2023-07-09T21:20:28.377 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:28.495 INFO:teuthology.orchestra.run.smithi037.stdout:Adding system user ceph....done 2023-07-09T21:20:28.648 INFO:teuthology.orchestra.run.smithi037.stdout:Setting system user ceph properties....done 2023-07-09T21:20:28.664 INFO:teuthology.orchestra.run.smithi037.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-07-09T21:20:28.721 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T21:20:28.722 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T21:20:28.809 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-07-09T21:20:29.213 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-07-09T21:20:29.420 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:29.554 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:29.697 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:29.905 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T21:20:29.906 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T21:20:29.975 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up cephfs-mirror (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.191 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T21:20:30.191 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-07-09T21:20:30.582 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.716 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.817 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.860 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-test (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.952 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:30.961 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up radosgw (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:31.078 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T21:20:31.214 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T21:20:31.216 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-07-09T21:20:31.862 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T21:20:32.204 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-base (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:32.329 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T21:20:32.333 DEBUG:teuthology.orchestra.run.smithi119:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-09T21:20:32.408 INFO:teuthology.orchestra.run.smithi119.stdout:Reading package lists... 2023-07-09T21:20:32.544 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-07-09T21:20:32.564 INFO:teuthology.orchestra.run.smithi119.stdout:Building dependency tree... 2023-07-09T21:20:32.565 INFO:teuthology.orchestra.run.smithi119.stdout:Reading state information... 2023-07-09T21:20:32.706 INFO:teuthology.orchestra.run.smithi119.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-09T21:20:32.707 INFO:teuthology.orchestra.run.smithi119.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-09T21:20:32.707 INFO:teuthology.orchestra.run.smithi119.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-09T21:20:32.707 INFO:teuthology.orchestra.run.smithi119.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-09T21:20:32.707 INFO:teuthology.orchestra.run.smithi119.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-09T21:20:32.707 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T21:20:32.708 INFO:teuthology.orchestra.run.smithi119.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T21:20:32.708 INFO:teuthology.orchestra.run.smithi119.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T21:20:32.708 INFO:teuthology.orchestra.run.smithi119.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T21:20:32.708 INFO:teuthology.orchestra.run.smithi119.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T21:20:32.709 INFO:teuthology.orchestra.run.smithi119.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T21:20:32.709 INFO:teuthology.orchestra.run.smithi119.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout:The following additional packages will be installed: 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T21:20:32.710 INFO:teuthology.orchestra.run.smithi119.stdout:Suggested packages: 2023-07-09T21:20:32.711 INFO:teuthology.orchestra.run.smithi119.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-09T21:20:32.711 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-09T21:20:32.711 INFO:teuthology.orchestra.run.smithi119.stdout: libengine-pkcs11-openssl 2023-07-09T21:20:32.754 INFO:teuthology.orchestra.run.smithi119.stdout:The following NEW packages will be installed: 2023-07-09T21:20:32.755 INFO:teuthology.orchestra.run.smithi119.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-09T21:20:32.756 INFO:teuthology.orchestra.run.smithi119.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-09T21:20:32.756 INFO:teuthology.orchestra.run.smithi119.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-09T21:20:32.756 INFO:teuthology.orchestra.run.smithi119.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-09T21:20:32.756 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-09T21:20:32.757 INFO:teuthology.orchestra.run.smithi119.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-09T21:20:32.757 INFO:teuthology.orchestra.run.smithi119.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T21:20:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:The following packages will be upgraded: 2023-07-09T21:20:32.757 INFO:teuthology.orchestra.run.smithi119.stdout: libssl3 2023-07-09T21:20:32.812 INFO:teuthology.orchestra.run.smithi119.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-09T21:20:32.812 INFO:teuthology.orchestra.run.smithi119.stdout:Need to get 54.6 MB of archives. 2023-07-09T21:20:32.812 INFO:teuthology.orchestra.run.smithi119.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-09T21:20:32.812 INFO:teuthology.orchestra.run.smithi119.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-09T21:20:32.911 INFO:teuthology.orchestra.run.smithi119.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-09T21:20:32.969 INFO:teuthology.orchestra.run.smithi119.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-09T21:20:32.977 INFO:teuthology.orchestra.run.smithi119.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-09T21:20:32.977 INFO:teuthology.orchestra.run.smithi119.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-09T21:20:32.979 INFO:teuthology.orchestra.run.smithi119.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-09T21:20:32.980 INFO:teuthology.orchestra.run.smithi119.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-09T21:20:32.981 INFO:teuthology.orchestra.run.smithi119.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-09T21:20:32.982 INFO:teuthology.orchestra.run.smithi119.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-09T21:20:32.983 INFO:teuthology.orchestra.run.smithi119.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-09T21:20:33.020 INFO:teuthology.orchestra.run.smithi119.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-09T21:20:33.020 INFO:teuthology.orchestra.run.smithi119.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-09T21:20:33.069 INFO:teuthology.orchestra.run.smithi119.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-09T21:20:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mds (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:33.353 INFO:teuthology.orchestra.run.smithi119.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-09T21:20:33.355 INFO:teuthology.orchestra.run.smithi119.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-09T21:20:33.356 INFO:teuthology.orchestra.run.smithi119.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-09T21:20:33.358 INFO:teuthology.orchestra.run.smithi119.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-09T21:20:33.359 INFO:teuthology.orchestra.run.smithi119.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-09T21:20:33.363 INFO:teuthology.orchestra.run.smithi119.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-09T21:20:33.364 INFO:teuthology.orchestra.run.smithi119.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-09T21:20:33.372 INFO:teuthology.orchestra.run.smithi119.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-09T21:20:33.407 INFO:teuthology.orchestra.run.smithi119.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-09T21:20:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T21:20:33.468 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-07-09T21:20:33.562 INFO:teuthology.orchestra.run.smithi119.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-09T21:20:33.563 INFO:teuthology.orchestra.run.smithi119.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-09T21:20:33.573 INFO:teuthology.orchestra.run.smithi119.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-09T21:20:33.594 INFO:teuthology.orchestra.run.smithi119.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-09T21:20:33.598 INFO:teuthology.orchestra.run.smithi119.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-09T21:20:33.598 INFO:teuthology.orchestra.run.smithi119.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-09T21:20:33.599 INFO:teuthology.orchestra.run.smithi119.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-09T21:20:33.599 INFO:teuthology.orchestra.run.smithi119.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-09T21:20:33.612 INFO:teuthology.orchestra.run.smithi119.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-09T21:20:33.614 INFO:teuthology.orchestra.run.smithi119.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-09T21:20:33.794 INFO:teuthology.orchestra.run.smithi119.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-09T21:20:33.812 INFO:teuthology.orchestra.run.smithi119.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-09T21:20:33.813 INFO:teuthology.orchestra.run.smithi119.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-09T21:20:33.813 INFO:teuthology.orchestra.run.smithi119.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-09T21:20:33.831 INFO:teuthology.orchestra.run.smithi119.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-09T21:20:33.832 INFO:teuthology.orchestra.run.smithi119.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-09T21:20:33.929 INFO:teuthology.orchestra.run.smithi119.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-09T21:20:33.930 INFO:teuthology.orchestra.run.smithi119.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-09T21:20:34.232 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:34.301 INFO:teuthology.orchestra.run.smithi119.stdout:Preconfiguring packages ... 2023-07-09T21:20:34.456 INFO:teuthology.orchestra.run.smithi119.stdout:Fetched 54.6 MB in 1s (46.9 MB/s) 2023-07-09T21:20:34.466 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T21:20:34.467 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-07-09T21:20:34.593 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package flex. 2023-07-09T21:20:34.666 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139904 files and directories currently installed.) 2023-07-09T21:20:34.670 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:34.709 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-09T21:20:35.186 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-osd (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:35.253 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T21:20:35.558 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-09T21:20:35.609 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T21:20:35.609 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-07-09T21:20:35.938 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:20:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:36.412 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:36.492 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package bison. 2023-07-09T21:20:36.563 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mon (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:36.564 INFO:teuthology.orchestra.run.smithi119.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139977 files and directories currently installed.) 2023-07-09T21:20:36.567 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-09T21:20:36.619 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T21:20:36.782 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T21:20:36.782 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-07-09T21:20:36.995 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-09T21:20:37.009 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-09T21:20:37.045 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T21:20:37.374 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package dump. 2023-07-09T21:20:37.387 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-09T21:20:37.432 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking dump (0.4b47-3) ... 2023-07-09T21:20:37.481 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-cephadm (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:37.624 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:37.710 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package indent. 2023-07-09T21:20:37.724 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-09T21:20:37.768 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-09T21:20:37.775 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-mgr-dashboard (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:37.918 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ceph-volume (18.0.0-4759-g35b2d86c-1jammy) ... 2023-07-09T21:20:38.021 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-09T21:20:38.035 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-09T21:20:38.044 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T21:20:38.080 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T21:20:38.400 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-09T21:20:38.415 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-09T21:20:38.458 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T21:20:38.711 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T21:20:38.744 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-09T21:20:38.759 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-09T21:20:38.802 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T21:20:39.105 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-09T21:20:39.121 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:39.155 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T21:20:39.172 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T21:20:39.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-07-09T21:20:39.254 INFO:teuthology.orchestra.run.smithi037.stdout:Reading package lists... 2023-07-09T21:20:39.383 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-09T21:20:39.398 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:39.414 INFO:teuthology.orchestra.run.smithi037.stdout:Building dependency tree... 2023-07-09T21:20:39.415 INFO:teuthology.orchestra.run.smithi037.stdout:Reading state information... 2023-07-09T21:20:39.441 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T21:20:39.562 INFO:teuthology.orchestra.run.smithi037.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-07-09T21:20:39.562 INFO:teuthology.orchestra.run.smithi037.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-07-09T21:20:39.562 INFO:teuthology.orchestra.run.smithi037.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-07-09T21:20:39.562 INFO:teuthology.orchestra.run.smithi037.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages were automatically installed and are no longer required: 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-07-09T21:20:39.563 INFO:teuthology.orchestra.run.smithi037.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-07-09T21:20:39.564 INFO:teuthology.orchestra.run.smithi037.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout:Use 'sudo apt autoremove' to remove them. 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout:The following additional packages will be installed: 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-07-09T21:20:39.565 INFO:teuthology.orchestra.run.smithi037.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T21:20:39.566 INFO:teuthology.orchestra.run.smithi037.stdout:Suggested packages: 2023-07-09T21:20:39.566 INFO:teuthology.orchestra.run.smithi037.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-07-09T21:20:39.566 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-07-09T21:20:39.566 INFO:teuthology.orchestra.run.smithi037.stdout: libengine-pkcs11-openssl 2023-07-09T21:20:39.611 INFO:teuthology.orchestra.run.smithi037.stdout:The following NEW packages will be installed: 2023-07-09T21:20:39.612 INFO:teuthology.orchestra.run.smithi037.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-07-09T21:20:39.612 INFO:teuthology.orchestra.run.smithi037.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-07-09T21:20:39.613 INFO:teuthology.orchestra.run.smithi037.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-07-09T21:20:39.613 INFO:teuthology.orchestra.run.smithi037.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-07-09T21:20:39.613 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-07-09T21:20:39.613 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-07-09T21:20:39.613 INFO:teuthology.orchestra.run.smithi037.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-07-09T21:20:39.614 INFO:teuthology.orchestra.run.smithi037.stdout:The following packages will be upgraded: 2023-07-09T21:20:39.614 INFO:teuthology.orchestra.run.smithi037.stdout: libssl3 2023-07-09T21:20:39.669 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libjson-perl. 2023-07-09T21:20:39.684 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-09T21:20:39.719 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-09T21:20:39.797 INFO:teuthology.orchestra.run.smithi037.stdout:1 upgraded, 39 newly installed, 0 to remove and 206 not upgraded. 2023-07-09T21:20:39.798 INFO:teuthology.orchestra.run.smithi037.stdout:Need to get 54.6 MB of archives. 2023-07-09T21:20:39.798 INFO:teuthology.orchestra.run.smithi037.stdout:After this operation, 202 MB of additional disk space will be used. 2023-07-09T21:20:39.798 INFO:teuthology.orchestra.run.smithi037.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-07-09T21:20:40.014 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-09T21:20:40.029 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-09T21:20:40.072 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T21:20:40.276 INFO:teuthology.orchestra.run.smithi037.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-07-09T21:20:40.533 INFO:teuthology.orchestra.run.smithi037.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-07-09T21:20:40.568 INFO:teuthology.orchestra.run.smithi037.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-07-09T21:20:40.570 INFO:teuthology.orchestra.run.smithi037.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-07-09T21:20:40.575 INFO:teuthology.orchestra.run.smithi037.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-07-09T21:20:40.578 INFO:teuthology.orchestra.run.smithi037.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-07-09T21:20:40.579 INFO:teuthology.orchestra.run.smithi037.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-07-09T21:20:40.583 INFO:teuthology.orchestra.run.smithi037.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-07-09T21:20:40.585 INFO:teuthology.orchestra.run.smithi037.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-07-09T21:20:40.585 INFO:teuthology.orchestra.run.smithi037.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-07-09T21:20:40.750 INFO:teuthology.orchestra.run.smithi037.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-07-09T21:20:41.064 INFO:teuthology.orchestra.run.smithi037.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-07-09T21:20:41.475 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-09T21:20:41.491 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T21:20:41.534 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:20:41.811 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-09T21:20:41.827 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T21:20:41.870 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:20:42.133 INFO:teuthology.orchestra.run.smithi037.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-07-09T21:20:42.135 INFO:teuthology.orchestra.run.smithi037.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-07-09T21:20:42.135 INFO:teuthology.orchestra.run.smithi037.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-07-09T21:20:42.138 INFO:teuthology.orchestra.run.smithi037.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-07-09T21:20:42.139 INFO:teuthology.orchestra.run.smithi037.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-07-09T21:20:42.144 INFO:teuthology.orchestra.run.smithi037.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-07-09T21:20:42.162 INFO:teuthology.orchestra.run.smithi037.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-07-09T21:20:42.170 INFO:teuthology.orchestra.run.smithi037.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-07-09T21:20:42.170 INFO:teuthology.orchestra.run.smithi037.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-07-09T21:20:42.197 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-09T21:20:42.213 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T21:20:42.256 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:20:42.413 INFO:teuthology.orchestra.run.smithi037.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-07-09T21:20:42.496 INFO:teuthology.orchestra.run.smithi037.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-07-09T21:20:42.550 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-09T21:20:42.565 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-09T21:20:42.608 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T21:20:42.936 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-09T21:20:42.951 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T21:20:42.970 INFO:teuthology.orchestra.run.smithi037.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-07-09T21:20:42.994 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T21:20:43.098 INFO:teuthology.orchestra.run.smithi037.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-07-09T21:20:43.109 INFO:teuthology.orchestra.run.smithi037.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-07-09T21:20:43.110 INFO:teuthology.orchestra.run.smithi037.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-07-09T21:20:43.111 INFO:teuthology.orchestra.run.smithi037.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-07-09T21:20:43.113 INFO:teuthology.orchestra.run.smithi037.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-07-09T21:20:43.145 INFO:teuthology.orchestra.run.smithi037.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-07-09T21:20:43.149 INFO:teuthology.orchestra.run.smithi037.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-07-09T21:20:43.331 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-09T21:20:43.346 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:43.389 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:43.623 INFO:teuthology.orchestra.run.smithi037.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-07-09T21:20:43.725 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-09T21:20:43.741 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:43.784 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:20:43.786 INFO:teuthology.orchestra.run.smithi037.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-07-09T21:20:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-07-09T21:20:43.869 INFO:teuthology.orchestra.run.smithi037.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-07-09T21:20:43.950 INFO:teuthology.orchestra.run.smithi037.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-07-09T21:20:43.958 INFO:teuthology.orchestra.run.smithi037.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-07-09T21:20:44.061 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-09T21:20:44.076 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:44.119 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:20:44.363 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-09T21:20:44.379 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T21:20:44.420 INFO:teuthology.orchestra.run.smithi037.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-07-09T21:20:44.422 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:20:44.422 INFO:teuthology.orchestra.run.smithi037.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-07-09T21:20:44.829 INFO:teuthology.orchestra.run.smithi037.stdout:Preconfiguring packages ... 2023-07-09T21:20:44.917 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-09T21:20:44.932 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-09T21:20:44.974 INFO:teuthology.orchestra.run.smithi037.stdout:Fetched 54.6 MB in 5s (11.4 MB/s) 2023-07-09T21:20:44.975 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T21:20:45.086 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package flex. 2023-07-09T21:20:45.163 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139904 files and directories currently installed.) 2023-07-09T21:20:45.166 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:45.201 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking flex (2.6.4-8build2) ... 2023-07-09T21:20:45.320 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package modemmanager. 2023-07-09T21:20:45.335 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T21:20:45.369 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:20:45.746 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T21:20:45.924 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-07-09T21:20:46.306 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:20:46.435 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager. 2023-07-09T21:20:46.450 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T21:20:46.501 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-09T21:20:46.799 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package bison. 2023-07-09T21:20:46.875 INFO:teuthology.orchestra.run.smithi037.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139977 files and directories currently installed.) 2023-07-09T21:20:46.879 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-07-09T21:20:46.918 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T21:20:47.025 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package ppp. 2023-07-09T21:20:47.039 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-09T21:20:47.310 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-07-09T21:20:47.325 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-07-09T21:20:47.361 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T21:20:47.397 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T21:20:47.746 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package pptp-linux. 2023-07-09T21:20:47.756 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package dump. 2023-07-09T21:20:47.760 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-09T21:20:47.770 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-07-09T21:20:47.804 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-09T21:20:47.814 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking dump (0.4b47-3) ... 2023-07-09T21:20:48.049 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-09T21:20:48.062 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-09T21:20:48.084 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package indent. 2023-07-09T21:20:48.099 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-07-09T21:20:48.107 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-09T21:20:48.143 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking indent (2.2.12-1build2) ... 2023-07-09T21:20:48.362 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-07-09T21:20:48.377 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-07-09T21:20:48.410 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-09T21:20:48.412 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T21:20:48.424 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-09T21:20:48.477 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-common (238) ... 2023-07-09T21:20:48.732 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-07-09T21:20:48.748 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-07-09T21:20:48.774 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-09T21:20:48.788 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:48.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T21:20:48.832 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:49.043 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-07-09T21:20:49.059 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-07-09T21:20:49.101 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T21:20:49.438 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libfl2:amd64. 2023-07-09T21:20:49.454 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:49.479 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-common. 2023-07-09T21:20:49.493 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-09T21:20:49.496 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T21:20:49.554 INFO:teuthology.orchestra.run.smithi119.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-09T21:20:49.586 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-common (238) ... 2023-07-09T21:20:49.732 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-07-09T21:20:49.747 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-07-09T21:20:49.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T21:20:50.011 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-14. 2023-07-09T21:20:50.026 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:50.051 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libjson-perl. 2023-07-09T21:20:50.063 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:50.066 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-07-09T21:20:50.101 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-07-09T21:20:50.396 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libllvm14:amd64. 2023-07-09T21:20:50.411 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-07-09T21:20:50.446 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T21:20:51.250 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql. 2023-07-09T21:20:51.264 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-09T21:20:51.300 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql (14+238) ... 2023-07-09T21:20:51.527 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-client. 2023-07-09T21:20:51.541 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-09T21:20:51.585 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-client (14+238) ... 2023-07-09T21:20:51.732 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-07-09T21:20:51.747 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T21:20:51.790 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:20:51.829 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-09T21:20:51.843 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-09T21:20:51.887 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-09T21:20:52.051 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmbim-proxy. 2023-07-09T21:20:52.067 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-07-09T21:20:52.109 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:20:52.223 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl8.6. 2023-07-09T21:20:52.238 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-09T21:20:52.281 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T21:20:52.428 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-07-09T21:20:52.444 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T21:20:52.487 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:20:52.567 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package tcl. 2023-07-09T21:20:52.583 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-09T21:20:52.630 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-09T21:20:52.937 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package wpasupplicant. 2023-07-09T21:20:52.952 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-09T21:20:52.987 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T21:20:53.149 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libndp0:amd64. 2023-07-09T21:20:53.164 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-07-09T21:20:53.198 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T21:20:53.325 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-09T21:20:53.339 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-09T21:20:53.382 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-09T21:20:53.526 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libnm0:amd64. 2023-07-09T21:20:53.542 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T21:20:53.584 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T21:20:53.769 INFO:teuthology.orchestra.run.smithi119.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-09T21:20:53.784 INFO:teuthology.orchestra.run.smithi119.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-09T21:20:53.836 INFO:teuthology.orchestra.run.smithi119.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T21:20:53.887 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libpq5:amd64. 2023-07-09T21:20:53.903 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:53.946 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:54.135 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-common (238) ... 2023-07-09T21:20:54.273 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-07-09T21:20:54.289 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:54.331 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:20:54.350 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-09T21:20:54.468 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T21:20:54.569 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:54.651 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libqmi-proxy. 2023-07-09T21:20:54.666 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:54.695 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T21:20:54.709 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:20:54.821 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T21:20:54.945 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-07-09T21:20:54.946 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:54.960 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-07-09T21:20:54.995 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:20:55.490 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-07-09T21:20:55.505 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-07-09T21:20:55.548 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T21:20:55.884 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package modemmanager. 2023-07-09T21:20:55.900 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-07-09T21:20:55.943 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:20:55.953 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-09T21:20:56.053 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T21:20:56.430 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T21:20:56.430 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T21:20:56.540 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager. 2023-07-09T21:20:56.555 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-07-09T21:20:56.607 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-07-09T21:20:57.172 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package ppp. 2023-07-09T21:20:57.188 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-07-09T21:20:57.239 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T21:20:57.365 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:20:57.490 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-09T21:20:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T21:20:57.617 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T21:20:57.718 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T21:20:57.819 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T21:20:57.893 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package pptp-linux. 2023-07-09T21:20:57.907 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-07-09T21:20:57.936 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T21:20:57.995 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-07-09T21:20:58.298 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package network-manager-pptp. 2023-07-09T21:20:58.313 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-07-09T21:20:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-07-09T21:20:58.600 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T21:20:58.626 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client-common. 2023-07-09T21:20:58.642 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-07-09T21:20:58.685 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client-common (238) ... 2023-07-09T21:20:58.709 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up dump (0.4b47-3) ... 2023-07-09T21:20:58.805 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-09T21:20:58.869 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:20:58.988 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client-14. 2023-07-09T21:20:58.995 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T21:20:59.004 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:20:59.046 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:20:59.121 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-09T21:20:59.222 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-09T21:20:59.340 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T21:20:59.429 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-09T21:20:59.508 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-09T21:20:59.634 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T21:20:59.635 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-common. 2023-07-09T21:20:59.649 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-07-09T21:20:59.711 INFO:teuthology.orchestra.run.smithi037.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-07-09T21:20:59.750 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-common (238) ... 2023-07-09T21:20:59.811 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T21:20:59.937 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:21:00.088 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-09T21:21:00.217 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-14. 2023-07-09T21:21:00.230 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-client (14+238) ... 2023-07-09T21:21:00.232 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-07-09T21:21:00.286 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:21:00.340 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-09T21:21:00.953 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:00.953 INFO:teuthology.orchestra.run.smithi119.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-09T21:21:00.953 INFO:teuthology.orchestra.run.smithi119.stdout:which means they are currently configured by ifupdown: 2023-07-09T21:21:00.954 INFO:teuthology.orchestra.run.smithi119.stdout:- enp3s0f1 2023-07-09T21:21:00.954 INFO:teuthology.orchestra.run.smithi119.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-09T21:21:00.954 INFO:teuthology.orchestra.run.smithi119.stdout:remove their configuration from /etc/network/interfaces. 2023-07-09T21:21:00.954 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:01.085 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-09T21:21:01.345 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql. 2023-07-09T21:21:01.359 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-07-09T21:21:01.403 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql (14+238) ... 2023-07-09T21:21:01.522 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-09T21:21:01.638 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-client. 2023-07-09T21:21:01.652 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-07-09T21:21:01.688 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-client (14+238) ... 2023-07-09T21:21:01.923 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package postgresql-contrib. 2023-07-09T21:21:01.938 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-07-09T21:21:01.974 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-09T21:21:01.982 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking postgresql-contrib (14+238) ... 2023-07-09T21:21:02.301 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package tcl8.6. 2023-07-09T21:21:02.317 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-07-09T21:21:02.359 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T21:21:02.620 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package tcl. 2023-07-09T21:21:02.636 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-07-09T21:21:02.684 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-07-09T21:21:02.717 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:21:02.860 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T21:21:02.986 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-09T21:21:03.031 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package wpasupplicant. 2023-07-09T21:21:03.048 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-07-09T21:21:03.090 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T21:21:03.146 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-common (238) ... 2023-07-09T21:21:03.428 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-07-09T21:21:03.444 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-07-09T21:21:03.485 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-07-09T21:21:03.864 INFO:teuthology.orchestra.run.smithi037.stdout:Selecting previously unselected package usb-modeswitch. 2023-07-09T21:21:03.880 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-07-09T21:21:03.930 INFO:teuthology.orchestra.run.smithi037.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T21:21:04.053 INFO:teuthology.orchestra.run.smithi119.stdout:Adding user postgres to group ssl-cert 2023-07-09T21:21:04.207 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client-common (238) ... 2023-07-09T21:21:04.280 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:04.280 INFO:teuthology.orchestra.run.smithi119.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-09T21:21:04.419 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up flex (2.6.4-8build2) ... 2023-07-09T21:21:04.545 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-07-09T21:21:04.551 INFO:teuthology.orchestra.run.smithi119.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-09T21:21:04.551 INFO:teuthology.orchestra.run.smithi119.stdout:Removing obsolete dictionary files: 2023-07-09T21:21:04.671 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:21:04.797 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-07-09T21:21:04.923 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-07-09T21:21:05.041 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:21:05.317 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-09T21:21:05.805 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:21:06.051 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-07-09T21:21:06.147 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-07-09T21:21:06.210 INFO:teuthology.orchestra.run.smithi119.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-09T21:21:06.237 INFO:teuthology.orchestra.run.smithi119.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-09T21:21:06.294 INFO:teuthology.orchestra.run.smithi119.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-09T21:21:06.294 INFO:teuthology.orchestra.run.smithi119.stdout:This user must also own the server process. 2023-07-09T21:21:06.295 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:06.295 INFO:teuthology.orchestra.run.smithi119.stdout:The database cluster will be initialized with locale "en_US". 2023-07-09T21:21:06.295 INFO:teuthology.orchestra.run.smithi119.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-09T21:21:06.296 INFO:teuthology.orchestra.run.smithi119.stdout:The default text search configuration will be set to "english". 2023-07-09T21:21:06.296 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:06.296 INFO:teuthology.orchestra.run.smithi119.stdout:Data page checksums are disabled. 2023-07-09T21:21:06.296 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:06.297 INFO:teuthology.orchestra.run.smithi119.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-09T21:21:06.297 INFO:teuthology.orchestra.run.smithi119.stdout:creating subdirectories ... ok 2023-07-09T21:21:06.298 INFO:teuthology.orchestra.run.smithi119.stdout:selecting dynamic shared memory implementation ... posix 2023-07-09T21:21:06.318 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default max_connections ... 100 2023-07-09T21:21:06.351 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default shared_buffers ... 128MB 2023-07-09T21:21:06.365 INFO:teuthology.orchestra.run.smithi119.stdout:selecting default time zone ... Etc/UTC 2023-07-09T21:21:06.366 INFO:teuthology.orchestra.run.smithi119.stdout:creating configuration files ... ok 2023-07-09T21:21:06.525 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T21:21:06.526 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-07-09T21:21:06.540 INFO:teuthology.orchestra.run.smithi119.stdout:running bootstrap script ... ok 2023-07-09T21:21:07.183 INFO:teuthology.orchestra.run.smithi119.stdout:performing post-bootstrap initialization ... ok 2023-07-09T21:21:07.267 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-07-09T21:21:07.367 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-07-09T21:21:07.496 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-07-09T21:21:07.622 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-07-09T21:21:07.711 INFO:teuthology.orchestra.run.smithi119.stdout:syncing data to disk ... ok 2023-07-09T21:21:07.748 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-07-09T21:21:07.873 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-07-09T21:21:07.991 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-07-09T21:21:08.264 INFO:teuthology.orchestra.run.smithi119.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-09T21:21:08.638 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-07-09T21:21:08.789 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up dump (0.4b47-3) ... 2023-07-09T21:21:08.884 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-07-09T21:21:08.949 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:21:09.075 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-07-09T21:21:09.192 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up tcl (8.6.11+1build2) ... 2023-07-09T21:21:09.293 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libjson-perl (4.04000-1) ... 2023-07-09T21:21:09.419 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-07-09T21:21:09.509 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-07-09T21:21:09.579 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up indent (2.2.12-1build2) ... 2023-07-09T21:21:09.705 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-07-09T21:21:09.881 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-07-09T21:21:10.007 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:21:10.133 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-07-09T21:21:10.276 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-client (14+238) ... 2023-07-09T21:21:10.386 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-07-09T21:21:11.000 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:11.001 INFO:teuthology.orchestra.run.smithi037.stdout:The following network interfaces were found in /etc/network/interfaces 2023-07-09T21:21:11.001 INFO:teuthology.orchestra.run.smithi037.stdout:which means they are currently configured by ifupdown: 2023-07-09T21:21:11.002 INFO:teuthology.orchestra.run.smithi037.stdout:- ens1f0 2023-07-09T21:21:11.002 INFO:teuthology.orchestra.run.smithi037.stdout:If you want to manage those interfaces with NetworkManager instead 2023-07-09T21:21:11.002 INFO:teuthology.orchestra.run.smithi037.stdout:remove their configuration from /etc/network/interfaces. 2023-07-09T21:21:11.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:11.141 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-07-09T21:21:11.585 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-07-09T21:21:11.654 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:21:11.788 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-09T21:21:11.923 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up postgresql (14+238) ... 2023-07-09T21:21:12.004 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-07-09T21:21:12.049 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:21:12.175 INFO:teuthology.orchestra.run.smithi119.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:21:12.451 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T21:21:12.451 INFO:teuthology.orchestra.run.smithi119.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T21:21:12.788 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-07-09T21:21:12.922 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-07-09T21:21:13.057 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-07-09T21:21:13.183 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-common (238) ... 2023-07-09T21:21:13.277 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-09T21:21:13.596 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T21:21:13.731 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T21:21:14.318 INFO:teuthology.orchestra.run.smithi037.stdout:Adding user postgres to group ssl-cert 2023-07-09T21:21:14.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:14.583 INFO:teuthology.orchestra.run.smithi037.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-07-09T21:21:14.870 INFO:teuthology.orchestra.run.smithi037.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-07-09T21:21:14.870 INFO:teuthology.orchestra.run.smithi037.stdout:Removing obsolete dictionary files: 2023-07-09T21:21:15.092 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-09T21:21:15.200 INFO:teuthology.orchestra.run.smithi119.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-09T21:21:15.664 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-07-09T21:21:15.886 INFO:teuthology.orchestra.run.smithi119.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T21:21:15.890 DEBUG:teuthology.parallel:result is None 2023-07-09T21:21:16.175 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-07-09T21:21:16.533 INFO:teuthology.orchestra.run.smithi037.stdout:Creating new PostgreSQL cluster 14/main ... 2023-07-09T21:21:16.555 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-07-09T21:21:16.608 INFO:teuthology.orchestra.run.smithi037.stdout:The files belonging to this database system will be owned by user "postgres". 2023-07-09T21:21:16.608 INFO:teuthology.orchestra.run.smithi037.stdout:This user must also own the server process. 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout:The database cluster will be initialized with locale "en_US". 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout:The default text search configuration will be set to "english". 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout:Data page checksums are disabled. 2023-07-09T21:21:16.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-07-09T21:21:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:creating subdirectories ... ok 2023-07-09T21:21:16.610 INFO:teuthology.orchestra.run.smithi037.stdout:selecting dynamic shared memory implementation ... posix 2023-07-09T21:21:16.634 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default max_connections ... 100 2023-07-09T21:21:16.668 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default shared_buffers ... 128MB 2023-07-09T21:21:16.683 INFO:teuthology.orchestra.run.smithi037.stdout:selecting default time zone ... Etc/UTC 2023-07-09T21:21:16.683 INFO:teuthology.orchestra.run.smithi037.stdout:creating configuration files ... ok 2023-07-09T21:21:16.868 INFO:teuthology.orchestra.run.smithi037.stdout:running bootstrap script ... ok 2023-07-09T21:21:17.527 INFO:teuthology.orchestra.run.smithi037.stdout:performing post-bootstrap initialization ... ok 2023-07-09T21:21:18.090 INFO:teuthology.orchestra.run.smithi037.stdout:syncing data to disk ... ok 2023-07-09T21:21:18.632 INFO:teuthology.orchestra.run.smithi037.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-07-09T21:21:21.682 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:21:21.808 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql-contrib (14+238) ... 2023-07-09T21:21:21.934 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up postgresql (14+238) ... 2023-07-09T21:21:22.060 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-07-09T21:21:22.186 INFO:teuthology.orchestra.run.smithi037.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-07-09T21:21:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T21:21:22.454 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-07-09T21:21:23.255 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-07-09T21:21:23.557 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-07-09T21:21:23.708 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-07-09T21:21:25.485 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-07-09T21:21:25.586 INFO:teuthology.orchestra.run.smithi037.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-07-09T21:21:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-07-09T21:21:26.273 DEBUG:teuthology.parallel:result is None 2023-07-09T21:21:26.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:21:26.492 DEBUG:teuthology.orchestra.run.smithi037:> dpkg-query -W -f '${Version}' ceph 2023-07-09T21:21:26.515 INFO:teuthology.orchestra.run.smithi037.stdout:18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:21:26.515 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:21:26.516 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759-g35b2d86c-1jammy is installed. 2023-07-09T21:21:26.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=35b2d86cfd512f15ace2077050d20c8669933212 2023-07-09T21:21:26.740 DEBUG:teuthology.orchestra.run.smithi119:> dpkg-query -W -f '${Version}' ceph 2023-07-09T21:21:26.764 INFO:teuthology.orchestra.run.smithi119.stdout:18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:21:26.764 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4759-g35b2d86c-1jammy 2023-07-09T21:21:26.765 INFO:teuthology.task.install:The correct ceph version 18.0.0-4759-g35b2d86c-1jammy is installed. 2023-07-09T21:21:26.765 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-09T21:21:26.765 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:26.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T21:21:26.788 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:26.788 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-09T21:21:26.827 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-09T21:21:26.827 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:26.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T21:21:26.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T21:21:26.909 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:26.909 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/daemon-helper 2023-07-09T21:21:26.931 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-09T21:21:26.994 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-09T21:21:26.995 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:26.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T21:21:27.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T21:21:27.077 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:27.077 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-09T21:21:27.098 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-09T21:21:27.166 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-09T21:21:27.166 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:27.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T21:21:27.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T21:21:27.249 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:27.249 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/usr/bin/stdin-killer 2023-07-09T21:21:27.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-09T21:21:27.334 INFO:teuthology.run_tasks:Running task ceph... 2023-07-09T21:21:27.403 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-07-09T21:21:27.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-07-09T21:21:27.407 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 777 /var/log/ceph 2023-07-09T21:21:27.428 INFO:tasks.ceph:Disabling ceph logrotate... 2023-07-09T21:21:27.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T21:21:27.472 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/logrotate.d/ceph 2023-07-09T21:21:27.493 INFO:tasks.ceph:Creating extra log directories... 2023-07-09T21:21:27.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T21:21:27.536 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-07-09T21:21:27.564 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-07-09T21:21:27.565 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-07-09T21:21:27.565 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-07-09T21:21:27.565 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:27.565 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T21:21:27.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T21:21:27.702 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:27.702 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-07-09T21:21:27.711 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-07-09T21:21:27.810 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-07-09T21:21:27.810 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-07-09T21:21:27.811 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677', 'branch': 'wip-rishabh-2023Jul9', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule}', 'email': None, 'first_in_suite': False, 'job_id': '7331677', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Jul9'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Jul9', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Jul9', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_35b2d86cfd512f15ace2077050d20c8669933212/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '35b2d86cfd512f15ace2077050d20c8669933212', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERKsNvOgLwrW0CMr6pA9qZNVRZX7CfRfVg1jgv2ijkdDXBkXubM9DoyudEAEhjwmuDGXfcvENuvjWzk3GW9qdE=', 'smithi119.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgJr9Qx0DxQvngxPHLC6IpyukWKPiaqtFj+GfcqpF3VcO/XtZQuHPV/aCeu+oSMECMsqRmUOWvfYs/3btQqkG8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '84139c18d56f518615369e8310ae4ecf07a36dcd'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '35b2d86cfd512f15ace2077050d20c8669933212'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b53f236c1077f1d295baafb9e0ca9a4b447019d7', 'timestamp': '2023-07-09_20:19:09', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-07-09T21:21:27.811 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T21:21:27.815 DEBUG:teuthology.orchestra.run.smithi119:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-07-09T21:21:27.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T21:21:27.867 DEBUG:teuthology.orchestra.run.smithi119:> sudo install -d -m0777 -- /var/run/ceph 2023-07-09T21:21:27.888 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:27.889 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T21:21:27.941 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T21:21:27.941 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-07-09T21:21:27.997 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T21:21:27.997 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:27.997 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-07-09T21:21:27.998 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:27.998 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-09 21:15:06.357092354 +0000 2023-07-09T21:21:27.998 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-09 21:15:05.921096252 +0000 2023-07-09T21:21:27.998 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-09 21:15:05.921096252 +0000 2023-07-09T21:21:27.998 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-09 21:15:05.921096252 +0000 2023-07-09T21:21:27.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T21:21:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-09T21:21:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-09T21:21:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000381515 s, 1.3 MB/s 2023-07-09T21:21:28.063 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T21:21:28.115 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-07-09T21:21:28.169 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-09 21:15:07.273084167 +0000 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-09 21:15:06.633089887 +0000 2023-07-09T21:21:28.170 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-09 21:15:06.633089887 +0000 2023-07-09T21:21:28.171 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-09 21:15:06.633089887 +0000 2023-07-09T21:21:28.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T21:21:28.232 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-09T21:21:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-09T21:21:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000378491 s, 1.4 MB/s 2023-07-09T21:21:28.234 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T21:21:28.287 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-09 21:15:07.993077732 +0000 2023-07-09T21:21:28.342 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-09 21:15:07.549081701 +0000 2023-07-09T21:21:28.343 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-09 21:15:07.549081701 +0000 2023-07-09T21:21:28.343 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-09 21:15:07.549081701 +0000 2023-07-09T21:21:28.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T21:21:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-09T21:21:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-09T21:21:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000381279 s, 1.3 MB/s 2023-07-09T21:21:28.406 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T21:21:28.459 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-07-09T21:21:28.509 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T21:21:28.510 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:28.510 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-07-09T21:21:28.510 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:28.510 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-07-09 21:15:08.689071511 +0000 2023-07-09T21:21:28.510 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-07-09 21:15:08.273075229 +0000 2023-07-09T21:21:28.511 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-07-09 21:15:08.273075229 +0000 2023-07-09T21:21:28.511 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-07-09 21:15:08.273075229 +0000 2023-07-09T21:21:28.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T21:21:28.572 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-07-09T21:21:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-07-09T21:21:28.573 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000390098 s, 1.3 MB/s 2023-07-09T21:21:28.575 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T21:21:28.627 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:28.628 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:28.629 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/scratch_devs of=/dev/stdout 2023-07-09T21:21:28.638 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-09T21:21:28.639 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_1 2023-07-09T21:21:28.690 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-09T21:21:28.690 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-07-09T21:21:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:28.690 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-07-09 21:15:04.307228433 +0000 2023-07-09T21:21:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-07-09 21:15:03.903232042 +0000 2023-07-09T21:21:28.691 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-07-09 21:15:03.903232042 +0000 2023-07-09T21:21:28.691 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-07-09 21:15:03.903232042 +0000 2023-07-09T21:21:28.691 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-09T21:21:28.752 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-07-09T21:21:28.752 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-07-09T21:21:28.753 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000388212 s, 1.3 MB/s 2023-07-09T21:21:28.754 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-09T21:21:28.808 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_2 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-07-09 21:15:05.007222180 +0000 2023-07-09T21:21:28.858 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-07-09 21:15:04.591225895 +0000 2023-07-09T21:21:28.859 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-07-09 21:15:04.591225895 +0000 2023-07-09T21:21:28.859 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-07-09 21:15:04.591225895 +0000 2023-07-09T21:21:28.859 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-09T21:21:28.920 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-07-09T21:21:28.921 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-07-09T21:21:28.921 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000387586 s, 1.3 MB/s 2023-07-09T21:21:28.923 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-09T21:21:28.976 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_3 2023-07-09T21:21:29.030 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-09T21:21:29.030 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:29.030 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-07-09T21:21:29.030 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:29.030 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-07-09 21:15:05.707215927 +0000 2023-07-09T21:21:29.031 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-07-09 21:15:05.275219786 +0000 2023-07-09T21:21:29.031 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-07-09 21:15:05.275219786 +0000 2023-07-09T21:21:29.031 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-07-09 21:15:05.275219786 +0000 2023-07-09T21:21:29.031 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-09T21:21:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-07-09T21:21:29.093 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-07-09T21:21:29.094 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000387581 s, 1.3 MB/s 2023-07-09T21:21:29.095 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-09T21:21:29.148 DEBUG:teuthology.orchestra.run.smithi119:> stat /dev/vg_nvme/lv_4 2023-07-09T21:21:29.197 INFO:teuthology.orchestra.run.smithi119.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-09T21:21:29.198 INFO:teuthology.orchestra.run.smithi119.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-09T21:21:29.198 INFO:teuthology.orchestra.run.smithi119.stdout:Device: 5h/5d Inode: 955 Links: 1 2023-07-09T21:21:29.198 INFO:teuthology.orchestra.run.smithi119.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-09T21:21:29.198 INFO:teuthology.orchestra.run.smithi119.stdout:Access: 2023-07-09 21:15:06.375209961 +0000 2023-07-09T21:21:29.198 INFO:teuthology.orchestra.run.smithi119.stdout:Modify: 2023-07-09 21:15:05.959213677 +0000 2023-07-09T21:21:29.199 INFO:teuthology.orchestra.run.smithi119.stdout:Change: 2023-07-09 21:15:05.959213677 +0000 2023-07-09T21:21:29.199 INFO:teuthology.orchestra.run.smithi119.stdout: Birth: 2023-07-09 21:15:05.959213677 +0000 2023-07-09T21:21:29.199 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-09T21:21:29.264 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records in 2023-07-09T21:21:29.265 INFO:teuthology.orchestra.run.smithi119.stderr:1+0 records out 2023-07-09T21:21:29.265 INFO:teuthology.orchestra.run.smithi119.stderr:512 bytes copied, 0.000397975 s, 1.3 MB/s 2023-07-09T21:21:29.266 DEBUG:teuthology.orchestra.run.smithi119:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-09T21:21:29.323 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:29.323 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T21:21:29.324 INFO:tasks.ceph:Generating config... 2023-07-09T21:21:29.325 INFO:tasks.ceph:[client] client mount timeout = 600 2023-07-09T21:21:29.325 INFO:tasks.ceph:[client] debug client = 20 2023-07-09T21:21:29.325 INFO:tasks.ceph:[client] debug ms = 1 2023-07-09T21:21:29.326 INFO:tasks.ceph:[client] pid file = 2023-07-09T21:21:29.326 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-07-09T21:21:29.326 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-07-09T21:21:29.327 INFO:tasks.ceph:[mds] debug mds = 20 2023-07-09T21:21:29.327 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-07-09T21:21:29.327 INFO:tasks.ceph:[mds] debug ms = 1 2023-07-09T21:21:29.327 INFO:tasks.ceph:[mds] mds debug frag = True 2023-07-09T21:21:29.327 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-07-09T21:21:29.328 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-07-09T21:21:29.328 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-07-09T21:21:29.328 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-07-09T21:21:29.328 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-07-09T21:21:29.328 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mgr] debug client = 20 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mgr] debug ms = 1 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mon] debug mon = 20 2023-07-09T21:21:29.329 INFO:tasks.ceph:[mon] debug ms = 1 2023-07-09T21:21:29.330 INFO:tasks.ceph:[mon] debug paxos = 20 2023-07-09T21:21:29.330 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-07-09T21:21:29.330 INFO:tasks.ceph:[osd] bdev async discard = True 2023-07-09T21:21:29.330 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-07-09T21:21:29.330 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-07-09T21:21:29.331 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-07-09T21:21:29.331 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-07-09T21:21:29.331 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-07-09T21:21:29.331 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-07-09T21:21:29.331 INFO:tasks.ceph:[osd] debug ms = 1 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] debug osd = 20 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-07-09T21:21:29.332 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-07-09T21:21:29.333 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-07-09T21:21:29.333 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-07-09T21:21:29.333 INFO:tasks.ceph:Setting up mon.a... 2023-07-09T21:21:29.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-07-09T21:21:29.383 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-07-09T21:21:29.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-07-09T21:21:29.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:21:29.467 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.119'), ('mon.c', '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]')] 2023-07-09T21:21:29.468 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-07-09T21:21:29.469 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:29.469 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T21:21:29.520 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.119 --addv c '[v2:172.21.15.119:3301,v1:172.21.15.119:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:29.612 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:29.612 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-07-09T21:21:29.612974+0000 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-07-09T21:21:29.612974+0000 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-07-09T21:21:29.613 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-07-09T21:21:29.614 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-07-09T21:21:29.614 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] mon.b 2023-07-09T21:21:29.614 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] mon.c 2023-07-09T21:21:29.614 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-07-09T21:21:29.615 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-07-09T21:21:29.623 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 43b31e6b-703a-46c6-8fb1-0669649379d3... 2023-07-09T21:21:29.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T21:21:29.667 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T21:21:29.709 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-07-09T21:21:29.710 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-07-09T21:21:29.710 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T21:21:29.710 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-07-09T21:21:29.710 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.710 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-07-09T21:21:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T21:21:29.712 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-07-09T21:21:29.713 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.714 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-07-09T21:21:29.715 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T21:21:29.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.716 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-07-09T21:21:29.716 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-07-09T21:21:29.716 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.717 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-07-09T21:21:29.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.719 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-07-09T21:21:29.720 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-07-09T21:21:29.721 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-09T21:21:29.722 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug finisher = 20 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T21:21:29.723 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-07-09T21:21:29.724 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T21:21:29.725 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.726 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-07-09T21:21:29.727 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-09T21:21:29.728 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-07-09T21:21:29.729 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-09T21:21:29.730 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-09T21:21:29.731 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-09T21:21:29.731 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-07-09T21:21:29.731 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.732 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T21:21:29.733 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-07-09T21:21:29.734 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T21:21:29.735 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.736 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.37,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-07-09T21:21:29.737 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-07-09T21:21:29.738 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.739 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-07-09T21:21:29.740 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-07-09T21:21:29.741 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-07-09T21:21:29.742 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-07-09T21:21:29.743 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: debug finisher = 20 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-07-09T21:21:29.744 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-07-09T21:21:29.745 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T21:21:29.746 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-07-09T21:21:29.747 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-07-09T21:21:29.748 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-07-09T21:21:29.749 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-07-09T21:21:29.750 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-07-09T21:21:29.751 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-07-09T21:21:29.752 INFO:tasks.ceph:Creating admin key on mon.a... 2023-07-09T21:21:29.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-07-09T21:21:29.855 INFO:tasks.ceph:Copying monmap to all nodes... 2023-07-09T21:21:29.856 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:29.856 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-07-09T21:21:29.865 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:29.865 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-07-09T21:21:29.916 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:21:29.916 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:29.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T21:21:29.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:21:29.990 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:21:29.991 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:30.040 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:21:30.041 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:30.041 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd of=/etc/ceph/ceph.keyring 2023-07-09T21:21:30.041 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-07-09T21:21:30.077 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:21:30.077 DEBUG:teuthology.orchestra.run.smithi119:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:30.129 INFO:tasks.ceph:Setting up mon nodes... 2023-07-09T21:21:30.129 INFO:tasks.ceph:Setting up mgr nodes... 2023-07-09T21:21:30.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T21:21:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-07-09T21:21:30.192 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T21:21:30.252 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-07-09T21:21:30.273 INFO:tasks.ceph:Setting up mds nodes... 2023-07-09T21:21:30.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T21:21:30.331 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-07-09T21:21:30.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-07-09T21:21:30.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T21:21:30.458 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-07-09T21:21:30.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-07-09T21:21:30.484 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T21:21:30.543 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-07-09T21:21:30.547 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-07-09T21:21:30.569 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T21:21:30.669 INFO:teuthology.orchestra.run.smithi119.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-07-09T21:21:30.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-07-09T21:21:30.694 INFO:tasks.ceph_client:Setting up client nodes... 2023-07-09T21:21:30.694 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-09T21:21:30.740 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-07-09T21:21:30.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-07-09T21:21:30.844 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-07-09T21:21:30.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-07-09T21:21:30.905 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-07-09T21:21:30.922 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-07-09T21:21:31.011 INFO:teuthology.orchestra.run.smithi119.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-07-09T21:21:31.028 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-07-09T21:21:31.028 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi119.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-07-09T21:21:31.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-07-09T21:21:31.050 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:31.050 INFO:tasks.ceph:role: osd.0 2023-07-09T21:21:31.050 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:21:31.051 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:31.125 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:31.126 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:31.126 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:31.126 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:31.126 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:31.589 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-09T21:21:31.591 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-09T21:21:31.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-07-09T21:21:31.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-07-09T21:21:31.716 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:31.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:31.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-07-09T21:21:31.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:31.782 INFO:tasks.ceph:role: osd.1 2023-07-09T21:21:31.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:21:31.782 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T21:21:31.854 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:31.855 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:31.856 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:31.856 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:31.856 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:32.328 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-09T21:21:32.331 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-09T21:21:32.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-07-09T21:21:32.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-07-09T21:21:32.500 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:32.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:32.501 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-07-09T21:21:32.566 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:32.566 INFO:tasks.ceph:role: osd.2 2023-07-09T21:21:32.567 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:21:32.567 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T21:21:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:32.638 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:32.638 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:32.638 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:32.639 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:33.111 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-09T21:21:33.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-09T21:21:33.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-07-09T21:21:33.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-07-09T21:21:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:33.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:33.282 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-07-09T21:21:33.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:33.350 INFO:tasks.ceph:role: osd.3 2023-07-09T21:21:33.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:21:33.351 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T21:21:33.426 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:33.426 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:33.427 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:33.873 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-07-09T21:21:33.877 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-07-09T21:21:33.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-07-09T21:21:33.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-07-09T21:21:34.012 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:34.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:34.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:34.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.147+0000 7f2d985b2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-07-09T21:21:34.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.151+0000 7f2d985b2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-07-09T21:21:34.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.151+0000 7f2d985b2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:21:34.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.151+0000 7f2d985b2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:21:34.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.151+0000 7f2d985b2640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-07-09T21:21:34.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:34.155+0000 7f2d985b2640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-07-09T21:21:37.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-07-09T21:21:37.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:37.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.267+0000 7fef04fef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-07-09T21:21:37.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.267+0000 7fef04fef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-07-09T21:21:37.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.267+0000 7fef04fef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:21:37.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.267+0000 7fef04fef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:21:37.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.267+0000 7fef04fef640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-07-09T21:21:37.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:37.271+0000 7fef04fef640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-07-09T21:21:40.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-07-09T21:21:40.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.403+0000 7f3779680640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-07-09T21:21:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.403+0000 7f3779680640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-07-09T21:21:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.403+0000 7f3779680640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:21:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.403+0000 7f3779680640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:21:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.403+0000 7f3779680640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-07-09T21:21:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:40.407+0000 7f3779680640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-07-09T21:21:43.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-07-09T21:21:43.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:43.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-07-09T21:21:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-07-09T21:21:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:21:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:21:43.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-07-09T21:21:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:21:43.515+0000 7f692042b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-07-09T21:21:46.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-07-09T21:21:46.530 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-07-09T21:21:46.554 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:46.554 INFO:tasks.ceph:role: osd.4 2023-07-09T21:21:46.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:21:46.555 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-07-09T21:21:46.627 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:46.627 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:46.628 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:47.085 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-07-09T21:21:47.088 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-07-09T21:21:47.089 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-07-09T21:21:47.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-07-09T21:21:47.212 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:47.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:47.214 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-07-09T21:21:47.281 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:47.281 INFO:tasks.ceph:role: osd.5 2023-07-09T21:21:47.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:21:47.282 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-07-09T21:21:47.354 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:47.355 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:47.355 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:47.355 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:47.355 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:47.355 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:47.356 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:47.356 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:47.356 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:47.356 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:47.854 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-07-09T21:21:47.857 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-07-09T21:21:47.857 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-07-09T21:21:47.978 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-07-09T21:21:47.996 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:47.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:47.998 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-07-09T21:21:48.067 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:48.067 INFO:tasks.ceph:role: osd.6 2023-07-09T21:21:48.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:21:48.068 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-07-09T21:21:48.139 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:48.139 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:48.139 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:48.139 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:48.139 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:48.140 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:48.140 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:48.140 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:48.140 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:48.140 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:48.623 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-07-09T21:21:48.625 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-07-09T21:21:48.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-07-09T21:21:48.773 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-07-09T21:21:48.791 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:48.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:48.792 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-07-09T21:21:48.854 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-07-09T21:21:48.855 INFO:tasks.ceph:role: osd.7 2023-07-09T21:21:48.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:21:48.855 DEBUG:teuthology.orchestra.run.smithi119:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-07-09T21:21:48.926 INFO:teuthology.orchestra.run.smithi119.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-07-09T21:21:48.927 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 attr=2, projid32bit=1 2023-07-09T21:21:48.927 INFO:teuthology.orchestra.run.smithi119.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-07-09T21:21:48.927 INFO:teuthology.orchestra.run.smithi119.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-07-09T21:21:48.927 INFO:teuthology.orchestra.run.smithi119.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-07-09T21:21:48.927 INFO:teuthology.orchestra.run.smithi119.stdout: = sunit=0 swidth=0 blks 2023-07-09T21:21:48.928 INFO:teuthology.orchestra.run.smithi119.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-07-09T21:21:48.928 INFO:teuthology.orchestra.run.smithi119.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-07-09T21:21:48.928 INFO:teuthology.orchestra.run.smithi119.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-07-09T21:21:48.928 INFO:teuthology.orchestra.run.smithi119.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-07-09T21:21:49.376 INFO:teuthology.orchestra.run.smithi119.stdout:Discarding blocks...Done. 2023-07-09T21:21:49.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi119.front.sepia.ceph.com -o noatime 2023-07-09T21:21:49.379 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-07-09T21:21:49.484 DEBUG:teuthology.orchestra.run.smithi119:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-07-09T21:21:49.502 INFO:teuthology.orchestra.run.smithi119.stderr:sudo: /sbin/restorecon: command not found 2023-07-09T21:21:49.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:21:49.504 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:49.633 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.634+0000 7f9a29c5d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-07-09T21:21:49.638 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.638+0000 7f9a29c5d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-07-09T21:21:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.638+0000 7f9a29c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:21:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.638+0000 7f9a29c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:21:49.639 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.638+0000 7f9a29c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-07-09T21:21:49.642 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:49.642+0000 7f9a29c5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-07-09T21:21:52.632 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-07-09T21:21:52.654 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:52.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.750+0000 7f3c97d2d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-07-09T21:21:52.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.750+0000 7f3c97d2d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-07-09T21:21:52.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.750+0000 7f3c97d2d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:21:52.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.750+0000 7f3c97d2d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:21:52.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.750+0000 7f3c97d2d640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-07-09T21:21:52.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:52.754+0000 7f3c97d2d640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-07-09T21:21:55.737 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-07-09T21:21:55.758 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:55.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.854+0000 7fd10e680640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-07-09T21:21:55.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.854+0000 7fd10e680640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-07-09T21:21:55.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.854+0000 7fd10e680640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:21:55.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.854+0000 7fd10e680640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:21:55.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.854+0000 7fd10e680640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-07-09T21:21:55.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:55.858+0000 7fd10e680640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-07-09T21:21:57.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:21:57.817 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:21:58.851 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-07-09T21:21:58.872 DEBUG:teuthology.orchestra.run.smithi119:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:21:58.967 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.966+0000 7f8b75b4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-07-09T21:21:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.966+0000 7f8b75b4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-07-09T21:21:58.968 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.966+0000 7f8b75b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:21:58.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.966+0000 7f8b75b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:21:58.969 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.966+0000 7f8b75b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-07-09T21:21:58.970 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:21:58.970+0000 7f8b75b4a640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-07-09T21:22:01.955 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-07-09T21:22:01.976 INFO:tasks.ceph:Reading keys from all nodes... 2023-07-09T21:22:01.977 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:01.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-07-09T21:22:02.000 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-07-09T21:22:02.066 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-07-09T21:22:02.130 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-07-09T21:22:02.198 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-07-09T21:22:02.262 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-07-09T21:22:02.326 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.326 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-07-09T21:22:02.390 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.390 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-07-09T21:22:02.411 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-07-09T21:22:02.476 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.477 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-07-09T21:22:02.544 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-07-09T21:22:02.604 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-07-09T21:22:02.665 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.666 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-07-09T21:22:02.728 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.729 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-07-09T21:22:02.788 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.788 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-07-09T21:22:02.798 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:02.798 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-07-09T21:22:02.853 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.853 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-07-09T21:22:02.861 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:02.862 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-07-09T21:22:02.913 INFO:tasks.ceph:Adding keys to all mons... 2023-07-09T21:22:02.913 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T21:22:02.917 DEBUG:teuthology.orchestra.run.smithi119:> sudo tee -a /etc/ceph/ceph.keyring 2023-07-09T21:22:02.960 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-07-09T21:22:02.960 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg== 2023-07-09T21:22:02.960 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw== 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA== 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg== 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-07-09T21:22:02.961 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q== 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ== 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA== 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA== 2023-07-09T21:22:02.962 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w== 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA== 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ== 2023-07-09T21:22:02.963 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA== 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g== 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw== 2023-07-09T21:22:02.964 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw== 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg== 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-07-09T21:22:02.965 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q== 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.y] 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg== 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw== 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-07-09T21:22:02.975 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA== 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.0] 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg== 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.1] 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q== 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.2] 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ== 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.3] 2023-07-09T21:22:02.976 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA== 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr.x] 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA== 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w== 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA== 2023-07-09T21:22:02.977 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.4] 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ== 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.5] 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA== 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.6] 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g== 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout:[osd.7] 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw== 2023-07-09T21:22:02.978 INFO:teuthology.orchestra.run.smithi119.stdout:[client.0] 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout:[client.2] 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw== 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout:[client.1] 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg== 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout:[client.3] 2023-07-09T21:22:02.979 INFO:teuthology.orchestra.run.smithi119.stdout: key = AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q== 2023-07-09T21:22:02.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:22:03.016 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:22:03.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.147 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.209 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.266 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.323 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.382 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:22:03.440 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-07-09T21:22:03.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.499 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.560 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-07-09T21:22:03.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.621 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.682 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.739 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.798 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-07-09T21:22:03.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:03.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:03.915 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:03.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:03.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:03.981 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:04.039 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:04.043 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-07-09T21:22:04.100 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-07-09T21:22:04.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-07-09T21:22:04.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:22:04.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-07-09T21:22:04.258 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-07-09T21:22:04.279 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:22:04.391 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-07-09T21:22:04.411 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-07-09T21:22:04.471 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-07-09T21:22:04.583 DEBUG:teuthology.orchestra.run.smithi119:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-07-09T21:22:04.603 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:22:04.606 DEBUG:teuthology.orchestra.run.smithi119:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-07-09T21:22:04.652 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-07-09T21:22:04.652 INFO:tasks.ceph.mon.a:Restarting daemon 2023-07-09T21:22:04.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-07-09T21:22:04.658 INFO:tasks.ceph.mon.a:Started 2023-07-09T21:22:04.659 INFO:tasks.ceph.mon.b:Restarting daemon 2023-07-09T21:22:04.659 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-07-09T21:22:04.695 INFO:tasks.ceph.mon.b:Started 2023-07-09T21:22:04.695 INFO:tasks.ceph.mon.c:Restarting daemon 2023-07-09T21:22:04.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-07-09T21:22:04.699 INFO:tasks.ceph.mon.c:Started 2023-07-09T21:22:04.699 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-07-09T21:22:04.699 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-07-09T21:22:04.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-07-09T21:22:04.703 INFO:tasks.ceph.mgr.y:Started 2023-07-09T21:22:04.703 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-09T21:22:04.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-09T21:22:04.707 INFO:tasks.ceph.mgr.x:Started 2023-07-09T21:22:04.707 INFO:tasks.ceph:Setting crush tunables to default 2023-07-09T21:22:04.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-07-09T21:22:04.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.847+0000 7f3ef8093640 1 Processor -- start 2023-07-09T21:22:04.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.847+0000 7f3ef8093640 1 -- start start 2023-07-09T21:22:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef8093640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 0x7f3ef00cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef8093640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 0x7f3ef00cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef8093640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00b3bb0 con 0x7f3ef015f130 2023-07-09T21:22:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef8093640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00cccb0 con 0x7f3ef00d0360 2023-07-09T21:22:04.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef8093640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00d07a0 con 0x7f3ef00b76b0 2023-07-09T21:22:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef5e2f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ef015f130 0x7f3ef00b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50930/0 (socket says 172.21.15.37:50930) 2023-07-09T21:22:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef5e2f640 1 -- 172.21.15.37:0/159225656 learned_addr learned my addr 172.21.15.37:0/159225656 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:04.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 0x7f3ef00cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef562e640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 0x7f3ef00cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 msgr2=0x7f3ef00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 msgr2=0x7f3ef00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 0x7f3ef00cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef562e640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 msgr2=0x7f3ef00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef562e640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 msgr2=0x7f3ef00cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-07-09T21:22:04.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef562e640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 0x7f3ef00cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-09T21:22:04.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef562e640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 0x7f3ef00cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:22:04.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:04.851+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 0x7f3ef00cd140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:22:05.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1833751494 0 0) 0x7f3ef00b3bb0 con 0x7f3ef015f130 2023-07-09T21:22:05.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3edc003530 con 0x7f3ef015f130 2023-07-09T21:22:05.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1404670908 0 0) 0x7f3edc003530 con 0x7f3ef015f130 2023-07-09T21:22:05.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 msgr2=0x7f3ef00cfe20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:05.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.119:3300/0 conn(0x7f3ef00b76b0 0x7f3ef00cfe20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 msgr2=0x7f3ef00cd140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 --2- 172.21.15.37:0/159225656 >> v2:172.21.15.37:3300/0 conn(0x7f3ef00d0360 0x7f3ef00cd140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00b8100 con 0x7f3ef015f130 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3eec001680 con 0x7f3ef015f130 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 >> v1:172.21.15.37:6789/0 conn(0x7f3ef015f130 legacy=0x7f3ef00b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3edc003980 0x7f3edc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3edc0047d0 0x7f3edc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3edc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00cccb0 con 0x7f3edc005180 2023-07-09T21:22:05.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00d07a0 con 0x7f3edc003980 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3edc00c0e0 con 0x7f3edc0047d0 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3edc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef562e640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3edc0047d0 0x7f3edc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef5e2f640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3edc003980 0x7f3edc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3edc0047d0 msgr2=0x7f3edc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:05.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3edc0047d0 0x7f3edc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3edc003980 msgr2=0x7f3edc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:05.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3edc003980 0x7f3edc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc003530 con 0x7f3edc005180 2023-07-09T21:22:05.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.019+0000 7f3ef562e640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3edc0047d0 0x7f3edc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:05.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef6630640 1 -- 172.21.15.37:0/159225656 reap_dead start 2023-07-09T21:22:05.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef6630640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3edc00b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009fd0 tx=0x7f3ee801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d206a6e01d77a83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:05.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a5d20 con 0x7f3edc005180 2023-07-09T21:22:05.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee80ad440 con 0x7f3edc005180 2023-07-09T21:22:05.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef4e2d640 1 -- 172.21.15.37:0/159225656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee80a5ea0 con 0x7f3edc005180 2023-07-09T21:22:05.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 -- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 msgr2=0x7f3edc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3edc00b990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009fd0 tx=0x7f3ee801ce20 comp rx=0 tx=0).stop 2023-07-09T21:22:05.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 -- 172.21.15.37:0/159225656 shutdown_connections 2023-07-09T21:22:05.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 --2- 172.21.15.37:0/159225656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3edc00b990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 -- 172.21.15.37:0/159225656 >> 172.21.15.37:0/159225656 conn(0x7f3ef0072d20 msgr2=0x7f3ef00d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 -- 172.21.15.37:0/159225656 shutdown_connections 2023-07-09T21:22:05.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.023+0000 7f3ef8093640 1 -- 172.21.15.37:0/159225656 wait complete. 2023-07-09T21:22:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 Processor -- start 2023-07-09T21:22:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 -- start start 2023-07-09T21:22:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 0x7f3ef00c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ef00c74a0 0x7f3ef014dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef014dc40 con 0x7f3edc005180 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c6ad0 con 0x7f3ef00c74a0 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef8093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00c5ec0 con 0x7f3ef0150b50 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef5e2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef562e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 0x7f3ef00c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef5e2f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33132/0 (socket says 172.21.15.37:33132) 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef5e2f640 1 -- 172.21.15.37:0/3275172453 learned_addr learned my addr 172.21.15.37:0/3275172453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.027+0000 7f3ef6630640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ef00c74a0 0x7f3ef014dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 -- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 msgr2=0x7f3ef00c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 0x7f3ef00c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 -- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ef00c74a0 msgr2=0x7f3ef014dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ef00c74a0 0x7f3ef014dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 -- 172.21.15.37:0/3275172453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00c61a0 con 0x7f3edc005180 2023-07-09T21:22:05.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef562e640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 0x7f3ef00c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:05.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef5e2f640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3eec012540 tx=0x7f3eec012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec014810 con 0x7f3edc005180 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec014970 con 0x7f3edc005180 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec014d20 con 0x7f3edc005180 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef00c6480 con 0x7f3edc005180 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef014e400 con 0x7f3edc005180 2023-07-09T21:22:05.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3eec016440 con 0x7f3edc005180 2023-07-09T21:22:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3eec0203f0 con 0x7f3edc005180 2023-07-09T21:22:05.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.031+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef00668f0 con 0x7f3edc005180 2023-07-09T21:22:05.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.051+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3eec01c070 con 0x7f3edc005180 2023-07-09T21:22:05.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.123+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f3ef00b4110 con 0x7f3edc005180 2023-07-09T21:22:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ee67fc640 1 -- 172.21.15.37:0/3275172453 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3eec016880 con 0x7f3edc005180 2023-07-09T21:22:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-07-09T21:22:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 msgr2=0x7f3ef014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3eec012540 tx=0x7f3eec012a00 comp rx=0 tx=0).stop 2023-07-09T21:22:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 shutdown_connections 2023-07-09T21:22:05.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ef00c74a0 0x7f3ef014dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ef0150b50 0x7f3ef00c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 --2- 172.21.15.37:0/3275172453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3edc005180 0x7f3ef014d700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 >> 172.21.15.37:0/3275172453 conn(0x7f3ef0072d20 msgr2=0x7f3ef015e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 shutdown_connections 2023-07-09T21:22:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:05.127+0000 7f3ef8093640 1 -- 172.21.15.37:0/3275172453 wait complete. 2023-07-09T21:22:05.156 INFO:tasks.ceph:check_enable_crimson: False 2023-07-09T21:22:05.156 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-07-09T21:22:05.156 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:05.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-07-09T21:22:05.177 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:05.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-07-09T21:22:05.237 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:05.238+0000 7fcd04884180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:22:05.245 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:05.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-07-09T21:22:05.273 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:05.271+0000 7fedda775180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:22:05.295 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:22:05.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-07-09T21:22:05.356 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:05.357 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-07-09T21:22:05.377 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:05.378 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-07-09T21:22:05.444 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:05.444 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-07-09T21:22:05.506 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:22:05.506 DEBUG:teuthology.orchestra.run.smithi119:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-07-09T21:22:05.573 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new c0d9d184-1b6b-4124-a102-b0bb12334aa9 0 2023-07-09T21:22:05.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.750+0000 7f112247b640 1 Processor -- start 2023-07-09T21:22:05.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.750+0000 7f112247b640 1 -- start start 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f112247b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f111c0b7980 0x7f111c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f112247b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f111c0ceb80 0x7f111c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f112247b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c15bf80 con 0x7f111c0b3c20 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f112247b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0cd070 con 0x7f111c0ceb80 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f112247b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c0cfd70 con 0x7f111c0b7980 2023-07-09T21:22:05.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f111c0b7980 0x7f111c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f111c0b7980 0x7f111c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53794/0 (socket says 172.21.15.119:53794) 2023-07-09T21:22:05.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 -- 172.21.15.119:0/261184573 learned_addr learned my addr 172.21.15.119:0/261184573 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:05.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111b7fe640 1 --2- 172.21.15.119:0/261184573 >> v2:172.21.15.37:3300/0 conn(0x7f111c0ceb80 0x7f111c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.755 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 -- 172.21.15.119:0/261184573 >> v2:172.21.15.37:3300/0 conn(0x7f111c0ceb80 msgr2=0x7f111c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:05.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 --2- 172.21.15.119:0/261184573 >> v2:172.21.15.37:3300/0 conn(0x7f111c0ceb80 0x7f111c0cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 -- 172.21.15.119:0/261184573 >> v1:172.21.15.37:6789/0 conn(0x7f111c0b3c20 legacy=0x7f111c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.756 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.754+0000 7f111bfff640 1 -- 172.21.15.119:0/261184573 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c160570 con 0x7f111c0b7980 2023-07-09T21:22:05.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f111bfff640 1 --2- 172.21.15.119:0/261184573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b7980 0x7f111c160030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f111c069aa0 tx=0x7f110c01c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72a4315f28bba04c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:05.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f111affd640 1 -- 172.21.15.119:0/261184573 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0ab600 con 0x7f111c0b7980 2023-07-09T21:22:05.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f111affd640 1 -- 172.21.15.119:0/261184573 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c0a7050 con 0x7f111c0b7980 2023-07-09T21:22:05.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f111affd640 1 -- 172.21.15.119:0/261184573 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0ab980 con 0x7f111c0b7980 2023-07-09T21:22:05.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- 172.21.15.119:0/261184573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b7980 msgr2=0x7f111c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 --2- 172.21.15.119:0/261184573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b7980 0x7f111c160030 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f111c069aa0 tx=0x7f110c01c500 comp rx=0 tx=0).stop 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- 172.21.15.119:0/261184573 shutdown_connections 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 --2- 172.21.15.119:0/261184573 >> v2:172.21.15.37:3300/0 conn(0x7f111c0ceb80 0x7f111c0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 --2- 172.21.15.119:0/261184573 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b7980 0x7f111c160030 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- 172.21.15.119:0/261184573 >> 172.21.15.119:0/261184573 conn(0x7f111c073090 msgr2=0x7f111c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:05.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- 172.21.15.119:0/261184573 shutdown_connections 2023-07-09T21:22:05.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- 172.21.15.119:0/261184573 wait complete. 2023-07-09T21:22:05.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 Processor -- start 2023-07-09T21:22:05.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.758+0000 7f112247b640 1 -- start start 2023-07-09T21:22:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 0x7f111c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f111c0ceb80 0x7f111c0c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c15b6e0 con 0x7f111c0b7980 2023-07-09T21:22:05.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c1f5800 con 0x7f111c0b3c20 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c15b120 con 0x7f111c0ceb80 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53804/0 (socket says 172.21.15.119:53804) 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 -- 172.21.15.119:0/2046864847 learned_addr learned my addr 172.21.15.119:0/2046864847 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1120a18640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f111c0ceb80 0x7f111c0c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111b7fe640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 0x7f111c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:05.763 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 -- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f111c0ceb80 msgr2=0x7f111c0c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f111c0ceb80 0x7f111c0c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 -- 172.21.15.119:0/2046864847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 msgr2=0x7f111c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 0x7f111c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 -- 172.21.15.119:0/2046864847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c0094d0 con 0x7f111c0b3c20 2023-07-09T21:22:05.764 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111b7fe640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 0x7f111c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:05.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f111bfff640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f110c0ae040 tx=0x7f110c0192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:05.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0b37d0 con 0x7f111c0b3c20 2023-07-09T21:22:05.765 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c0b3930 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c15b400 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0b3ca0 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c0c7d80 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f110c0b2070 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f110c0b44f0 con 0x7f111c0b3c20 2023-07-09T21:22:05.766 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.762+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c0c7900 con 0x7f111c0b3c20 2023-07-09T21:22:05.780 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:05.778+0000 7fcd04884180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:22:05.785 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.786+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f111c0c7900 con 0x7f111c0b3c20 2023-07-09T21:22:05.833 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:05.831+0000 7fedda775180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:22:05.850 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.850+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c0d9d184-1b6b-4124-a102-b0bb12334aa9", "id": 0} v 0) v1 -- 0x7f111c0737d0 con 0x7f111c0b3c20 2023-07-09T21:22:05.856 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.854+0000 7f1118ff9640 1 -- 172.21.15.119:0/2046864847 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c0d9d184-1b6b-4124-a102-b0bb12334aa9", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f111c0737d0 con 0x7f111c0b3c20 2023-07-09T21:22:05.857 INFO:teuthology.orchestra.run.smithi119.stdout:0 2023-07-09T21:22:05.857 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 msgr2=0x7f111c1f52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f110c0ae040 tx=0x7f110c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 shutdown_connections 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f111c0ceb80 0x7f111c0c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f111c0b7980 0x7f111c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 --2- 172.21.15.119:0/2046864847 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f111c0b3c20 0x7f111c1f52c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 >> 172.21.15.119:0/2046864847 conn(0x7f111c073090 msgr2=0x7f111c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:05.858 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 shutdown_connections 2023-07-09T21:22:05.859 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:05.858+0000 7f112247b640 1 -- 172.21.15.119:0/2046864847 wait complete. 2023-07-09T21:22:05.876 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new f70dcc4b-43f8-40d2-971d-ce1b49ff373e 1 2023-07-09T21:22:05.974 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:05.974+0000 7fcd04884180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:22:06.012 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.010+0000 7f5510f00640 1 Processor -- start 2023-07-09T21:22:06.013 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.010+0000 7f5510f00640 1 -- start start 2023-07-09T21:22:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5510f00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5510f00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f550c0d0530 0x7f550c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5510f00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f550c0b3bb0 con 0x7f550c0b74e0 2023-07-09T21:22:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5510f00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550c0b7930 con 0x7f550c0d0530 2023-07-09T21:22:06.014 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5510f00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0cccb0 con 0x7f550c15f130 2023-07-09T21:22:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36868/0 (socket says 172.21.15.119:36868) 2023-07-09T21:22:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f5503fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f550c0b74e0 0x7f550c0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40608/0 (socket says 172.21.15.119:40608) 2023-07-09T21:22:06.015 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 -- 172.21.15.119:0/1309246707 learned_addr learned my addr 172.21.15.119:0/1309246707 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550ad9d640 1 --2- 172.21.15.119:0/1309246707 >> v2:172.21.15.37:3300/0 conn(0x7f550c0d0530 0x7f550c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 -- 172.21.15.119:0/1309246707 >> v2:172.21.15.37:3300/0 conn(0x7f550c0d0530 msgr2=0x7f550c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 --2- 172.21.15.119:0/1309246707 >> v2:172.21.15.37:3300/0 conn(0x7f550c0d0530 0x7f550c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 -- 172.21.15.119:0/1309246707 >> v1:172.21.15.119:6789/0 conn(0x7f550c0b74e0 legacy=0x7f550c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.016 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.014+0000 7f550a59c640 1 -- 172.21.15.119:0/1309246707 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0b8100 con 0x7f550c15f130 2023-07-09T21:22:06.017 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f550a59c640 1 --2- 172.21.15.119:0/1309246707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009870 tx=0x7f54fc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e097e72127326b0d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5509d9b640 1 -- 172.21.15.119:0/1309246707 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0ab680 con 0x7f550c15f130 2023-07-09T21:22:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5509d9b640 1 -- 172.21.15.119:0/1309246707 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc0ab7e0 con 0x7f550c15f130 2023-07-09T21:22:06.018 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5509d9b640 1 -- 172.21.15.119:0/1309246707 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0abb70 con 0x7f550c15f130 2023-07-09T21:22:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 -- 172.21.15.119:0/1309246707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 msgr2=0x7f550c0b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 --2- 172.21.15.119:0/1309246707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f54fc009870 tx=0x7f54fc01c480 comp rx=0 tx=0).stop 2023-07-09T21:22:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 -- 172.21.15.119:0/1309246707 shutdown_connections 2023-07-09T21:22:06.019 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 --2- 172.21.15.119:0/1309246707 >> v2:172.21.15.37:3300/0 conn(0x7f550c0d0530 0x7f550c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 --2- 172.21.15.119:0/1309246707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c15f130 0x7f550c0b6fa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 -- 172.21.15.119:0/1309246707 >> 172.21.15.119:0/1309246707 conn(0x7f550c072d20 msgr2=0x7f550c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 -- 172.21.15.119:0/1309246707 shutdown_connections 2023-07-09T21:22:06.020 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.018+0000 7f5510f00640 1 -- 172.21.15.119:0/1309246707 wait complete. 2023-07-09T21:22:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 Processor -- start 2023-07-09T21:22:06.022 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- start start 2023-07-09T21:22:06.025 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 0x7f550c1443b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c0d0530 0x7f550c15e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c15ec60 con 0x7f550c0b74e0 2023-07-09T21:22:06.026 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0cbbc0 con 0x7f550c15f130 2023-07-09T21:22:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550c0cbea0 con 0x7f550c0d0530 2023-07-09T21:22:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550ad9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53814/0 (socket says 172.21.15.119:53814) 2023-07-09T21:22:06.027 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550ad9d640 1 -- 172.21.15.119:0/2785386700 learned_addr learned my addr 172.21.15.119:0/2785386700 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5503fff640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c0d0530 0x7f550c15e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 0x7f550c1443b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.028 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 -- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c0d0530 msgr2=0x7f550c15e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c0d0530 0x7f550c15e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 -- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 msgr2=0x7f550c0b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 -- 172.21.15.119:0/2785386700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0094d0 con 0x7f550c0b74e0 2023-07-09T21:22:06.029 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550ad9d640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f550a59c640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 0x7f550c1443b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0ac000 tx=0x7f54fc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b5810 con 0x7f550c0b74e0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc0b5990 con 0x7f550c0b74e0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c0cc180 con 0x7f550c0b74e0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0b5d40 con 0x7f550c0b74e0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c15c3d0 con 0x7f550c0b74e0 2023-07-09T21:22:06.030 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.022+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f54fc0bf710 con 0x7f550c0b74e0 2023-07-09T21:22:06.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.026+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f54fc0c8830 con 0x7f550c0b74e0 2023-07-09T21:22:06.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.026+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c0668f0 con 0x7f550c0b74e0 2023-07-09T21:22:06.031 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.026+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f54fc0bfab0 con 0x7f550c0b74e0 2023-07-09T21:22:06.041 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.039+0000 7fedda775180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:22:06.093 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.094+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f70dcc4b-43f8-40d2-971d-ce1b49ff373e", "id": 1} v 0) v1 -- 0x7f550c15c5c0 con 0x7f550c0b74e0 2023-07-09T21:22:06.100 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.098+0000 7f5502ffd640 1 -- 172.21.15.119:0/2785386700 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f70dcc4b-43f8-40d2-971d-ce1b49ff373e", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f54fc0c89f0 con 0x7f550c0b74e0 2023-07-09T21:22:06.101 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 msgr2=0x7f550c1443b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 0x7f550c1443b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0ac000 tx=0x7f54fc019220 comp rx=0 tx=0).stop 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 shutdown_connections 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f550c15f130 0x7f550c0b5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f550c0d0530 0x7f550c15e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.102 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 --2- 172.21.15.119:0/2785386700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c0b74e0 0x7f550c1443b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 >> 172.21.15.119:0/2785386700 conn(0x7f550c072d20 msgr2=0x7f550c0d1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 shutdown_connections 2023-07-09T21:22:06.103 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.102+0000 7f5510f00640 1 -- 172.21.15.119:0/2785386700 wait complete. 2023-07-09T21:22:06.119 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 10ba599b-3a04-4405-81eb-75db70618a1d 2 2023-07-09T21:22:06.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 Processor -- start 2023-07-09T21:22:06.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 -- start start 2023-07-09T21:22:06.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19a415f130 0x7f19a40b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19a40d0530 0x7f19a40cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a40b3bb0 con 0x7f19a40b74e0 2023-07-09T21:22:06.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a40b7960 con 0x7f19a415f130 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.254+0000 7f19abe56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a40cccb0 con 0x7f19a40d0530 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19a40d0530 0x7f19a40cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19a40d0530 0x7f19a40cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53818/0 (socket says 172.21.15.119:53818) 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 -- 172.21.15.119:0/4110222589 learned_addr learned my addr 172.21.15.119:0/4110222589 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19a93f1640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f19a40b74e0 0x7f19a40cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40620/0 (socket says 172.21.15.119:40620) 2023-07-09T21:22:06.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19a9bf2640 1 --2- 172.21.15.119:0/4110222589 >> v2:172.21.15.37:3300/0 conn(0x7f19a415f130 0x7f19a40b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 -- 172.21.15.119:0/4110222589 >> v2:172.21.15.37:3300/0 conn(0x7f19a415f130 msgr2=0x7f19a40b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:06.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 --2- 172.21.15.119:0/4110222589 >> v2:172.21.15.37:3300/0 conn(0x7f19a415f130 0x7f19a40b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 -- 172.21.15.119:0/4110222589 >> v1:172.21.15.119:6789/0 conn(0x7f19a40b74e0 legacy=0x7f19a40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.259 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 -- 172.21.15.119:0/4110222589 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40b8100 con 0x7f19a40d0530 2023-07-09T21:22:06.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19aa3f3640 1 --2- 172.21.15.119:0/4110222589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a40d0530 0x7f19a40cd140 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19a40cfb70 tx=0x7f199c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6989b5e3fbb66b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.258+0000 7f19a8bf0640 1 -- 172.21.15.119:0/4110222589 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a57d0 con 0x7f19a40d0530 2023-07-09T21:22:06.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19a8bf0640 1 -- 172.21.15.119:0/4110222589 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0a5930 con 0x7f19a40d0530 2023-07-09T21:22:06.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19a8bf0640 1 -- 172.21.15.119:0/4110222589 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0a5cc0 con 0x7f19a40d0530 2023-07-09T21:22:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- 172.21.15.119:0/4110222589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a40d0530 msgr2=0x7f19a40cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- 172.21.15.119:0/4110222589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a40d0530 0x7f19a40cd140 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19a40cfb70 tx=0x7f199c01c910 comp rx=0 tx=0).stop 2023-07-09T21:22:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- 172.21.15.119:0/4110222589 shutdown_connections 2023-07-09T21:22:06.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- 172.21.15.119:0/4110222589 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a40d0530 0x7f19a40cd140 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- 172.21.15.119:0/4110222589 >> v2:172.21.15.37:3300/0 conn(0x7f19a415f130 0x7f19a40b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- 172.21.15.119:0/4110222589 >> 172.21.15.119:0/4110222589 conn(0x7f19a4072d20 msgr2=0x7f19a40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- 172.21.15.119:0/4110222589 shutdown_connections 2023-07-09T21:22:06.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- 172.21.15.119:0/4110222589 wait complete. 2023-07-09T21:22:06.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 Processor -- start 2023-07-09T21:22:06.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- start start 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 0x7f19a40c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 0x7f19a4152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4155610 con 0x7f19a40d0530 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4155860 con 0x7f19a415f130 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19abe56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4155b40 con 0x7f19a40b74e0 2023-07-09T21:22:06.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19aa3f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.262+0000 7f19a9bf2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 0x7f19a40c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53824/0 (socket says 172.21.15.119:53824) 2023-07-09T21:22:06.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 -- 172.21.15.119:0/1261399186 learned_addr learned my addr 172.21.15.119:0/1261399186 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19a93f1640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 0x7f19a4152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 -- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 msgr2=0x7f19a40c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 0x7f19a40c6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 -- 172.21.15.119:0/1261399186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 msgr2=0x7f19a4152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 0x7f19a4152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 -- 172.21.15.119:0/1261399186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009b30 con 0x7f19a415f130 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19a9bf2640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 0x7f19a40c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19a93f1640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 0x7f19a4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19aa3f3640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f199c019520 tx=0x7f199c0196b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0b8670 con 0x7f19a415f130 2023-07-09T21:22:06.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0b87f0 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0b8ba0 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a4155e20 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a40c6cd0 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f199c0c1400 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f199c0c1ad0 con 0x7f19a415f130 2023-07-09T21:22:06.269 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.266+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a40c6e60 con 0x7f19a415f130 2023-07-09T21:22:06.270 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.270+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f199c0bc020 con 0x7f19a415f130 2023-07-09T21:22:06.335 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.334+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "10ba599b-3a04-4405-81eb-75db70618a1d", "id": 2} v 0) v1 -- 0x7f19a41559a0 con 0x7f19a415f130 2023-07-09T21:22:06.343 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f199a7fc640 1 -- 172.21.15.119:0/1261399186 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "10ba599b-3a04-4405-81eb-75db70618a1d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f19a41559a0 con 0x7f19a415f130 2023-07-09T21:22:06.343 INFO:teuthology.orchestra.run.smithi119.stdout:2 2023-07-09T21:22:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 msgr2=0x7f19a4156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f199c019520 tx=0x7f199c0196b0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 shutdown_connections 2023-07-09T21:22:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19a415f130 0x7f19a4156620 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.344 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19a40d0530 0x7f19a4152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 --2- 172.21.15.119:0/1261399186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19a40b74e0 0x7f19a40c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 >> 172.21.15.119:0/1261399186 conn(0x7f19a4072d20 msgr2=0x7f19a415b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 shutdown_connections 2023-07-09T21:22:06.345 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.342+0000 7f19abe56640 1 -- 172.21.15.119:0/1261399186 wait complete. 2023-07-09T21:22:06.363 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 536df8a4-a8e1-4aff-b27a-31048529d14c 3 2023-07-09T21:22:06.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 Processor -- start 2023-07-09T21:22:06.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 -- start start 2023-07-09T21:22:06.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0ac15f130 0x7fe0ac0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 0x7fe0ac0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ac0b3bb0 con 0x7fe0ac0d0360 2023-07-09T21:22:06.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ac0b7930 con 0x7fe0ac15f130 2023-07-09T21:22:06.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.498+0000 7fe0b0834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac0d07e0 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 0x7fe0ac0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0aad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe0ac0d0360 0x7fe0ac0b50a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40630/0 (socket says 172.21.15.119:40630) 2023-07-09T21:22:06.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0aad9d640 1 -- 172.21.15.119:0/238908883 learned_addr learned my addr 172.21.15.119:0/238908883 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-07-09T21:22:06.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0aa59c640 1 --2- 172.21.15.119:0/238908883 >> v2:172.21.15.37:3300/0 conn(0x7fe0ac15f130 0x7fe0ac0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/238908883 >> v2:172.21.15.37:3300/0 conn(0x7fe0ac15f130 msgr2=0x7fe0ac0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 --2- 172.21.15.119:0/238908883 >> v2:172.21.15.37:3300/0 conn(0x7fe0ac15f130 0x7fe0ac0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a959a640 1 -- 172.21.15.119:0/238908883 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49018947 0 0) 0x7fe0ac0b3bb0 con 0x7fe0ac0d0360 2023-07-09T21:22:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/238908883 >> v1:172.21.15.119:6789/0 conn(0x7fe0ac0d0360 legacy=0x7fe0ac0b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.505 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/238908883 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac0cccb0 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a9d9b640 1 --2- 172.21.15.119:0/238908883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 0x7fe0ac0cfe20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00097c0 tx=0x7fe0a001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f43725cbd04c1d9c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a959a640 1 -- 172.21.15.119:0/238908883 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00ac630 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a959a640 1 -- 172.21.15.119:0/238908883 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a00ac790 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.507 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.502+0000 7fe0a959a640 1 -- 172.21.15.119:0/238908883 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a00acb20 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- 172.21.15.119:0/238908883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 msgr2=0x7fe0ac0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- 172.21.15.119:0/238908883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 0x7fe0ac0cfe20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00097c0 tx=0x7fe0a001c3d0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- 172.21.15.119:0/238908883 shutdown_connections 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- 172.21.15.119:0/238908883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac0b74e0 0x7fe0ac0cfe20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- 172.21.15.119:0/238908883 >> v2:172.21.15.37:3300/0 conn(0x7fe0ac15f130 0x7fe0ac0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.508 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- 172.21.15.119:0/238908883 >> 172.21.15.119:0/238908883 conn(0x7fe0ac072d20 msgr2=0x7fe0ac0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- 172.21.15.119:0/238908883 shutdown_connections 2023-07-09T21:22:06.509 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- 172.21.15.119:0/238908883 wait complete. 2023-07-09T21:22:06.510 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 Processor -- start 2023-07-09T21:22:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- start start 2023-07-09T21:22:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 0x7fe0ac0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.511 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 0x7fe0ac157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 0x7fe0ac0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15d930 con 0x7fe0ac0b74e0 2023-07-09T21:22:06.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15dc10 con 0x7fe0ac0d0360 2023-07-09T21:22:06.512 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.506+0000 7fe0b0834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ac15def0 con 0x7fe0ac15f130 2023-07-09T21:22:06.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0aad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 0x7fe0ac0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 0x7fe0ac157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0aad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 0x7fe0ac0ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36896/0 (socket says 172.21.15.119:36896) 2023-07-09T21:22:06.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0aad9d640 1 -- 172.21.15.119:0/3680835504 learned_addr learned my addr 172.21.15.119:0/3680835504 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.513 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0aa59c640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 0x7fe0ac0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 msgr2=0x7fe0ac0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 0x7fe0ac0ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/3680835504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 msgr2=0x7fe0ac0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 0x7fe0ac0c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.514 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 -- 172.21.15.119:0/3680835504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a0009420 con 0x7fe0ac0d0360 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0aa59c640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 0x7fe0ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0a9d9b640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 0x7fe0ac157730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00ac000 tx=0x7fe0a0019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0004220 con 0x7fe0ac0d0360 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a0004380 con 0x7fe0ac0d0360 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a0003820 con 0x7fe0ac0d0360 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ac15e1d0 con 0x7fe0ac0d0360 2023-07-09T21:22:06.515 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ac0c7a20 con 0x7fe0ac0d0360 2023-07-09T21:22:06.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe0a00b3040 con 0x7fe0ac0d0360 2023-07-09T21:22:06.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fe0a0003c80 con 0x7fe0ac0d0360 2023-07-09T21:22:06.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.510+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ac0668f0 con 0x7fe0ac0d0360 2023-07-09T21:22:06.516 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.514+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe0a00b1070 con 0x7fe0ac0d0360 2023-07-09T21:22:06.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.578+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "536df8a4-a8e1-4aff-b27a-31048529d14c", "id": 3} v 0) v1 -- 0x7fe0ac15e030 con 0x7fe0ac0d0360 2023-07-09T21:22:06.587 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe09affd640 1 -- 172.21.15.119:0/3680835504 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "536df8a4-a8e1-4aff-b27a-31048529d14c", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe0ac15e030 con 0x7fe0ac0d0360 2023-07-09T21:22:06.587 INFO:teuthology.orchestra.run.smithi119.stdout:3 2023-07-09T21:22:06.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 msgr2=0x7fe0ac157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.589 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 0x7fe0ac157730 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe0a00ac000 tx=0x7fe0a0019170 comp rx=0 tx=0).stop 2023-07-09T21:22:06.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 shutdown_connections 2023-07-09T21:22:06.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0ac15f130 0x7fe0ac0ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.590 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0ac0d0360 0x7fe0ac157730 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 --2- 172.21.15.119:0/3680835504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0ac0b74e0 0x7fe0ac0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 >> 172.21.15.119:0/3680835504 conn(0x7fe0ac072d20 msgr2=0x7fe0ac0b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 shutdown_connections 2023-07-09T21:22:06.591 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.586+0000 7fe0b0834640 1 -- 172.21.15.119:0/3680835504 wait complete. 2023-07-09T21:22:06.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8 4 2023-07-09T21:22:06.633 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:06.634+0000 7fcd04884180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:22:06.696 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:06.694+0000 7fcd04884180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:22:06.697 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.695+0000 7fedda775180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:22:06.741 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 Processor -- start 2023-07-09T21:22:06.742 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 -- start start 2023-07-09T21:22:06.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba240b7980 0x7fba24160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240ceb80 0x7fba240cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.743 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba2415bf80 con 0x7fba240b3c20 2023-07-09T21:22:06.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba240cd070 con 0x7fba240b7980 2023-07-09T21:22:06.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba289d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba240cfd70 con 0x7fba240ceb80 2023-07-09T21:22:06.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba240b7980 0x7fba24160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba240b7980 0x7fba24160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53842/0 (socket says 172.21.15.119:53842) 2023-07-09T21:22:06.744 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 -- 172.21.15.119:0/3049131508 learned_addr learned my addr 172.21.15.119:0/3049131508 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba22d9d640 1 --1- 172.21.15.119:0/3049131508 >> v1:172.21.15.119:6789/0 conn(0x7fba240b3c20 0x7fba240b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40644/0 (socket says 172.21.15.119:40644) 2023-07-09T21:22:06.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba21d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240ceb80 0x7fba240cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.745 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 -- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240ceb80 msgr2=0x7fba240cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:06.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 --2- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240ceb80 0x7fba240cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 -- 172.21.15.119:0/3049131508 >> v1:172.21.15.119:6789/0 conn(0x7fba240b3c20 legacy=0x7fba240b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.742+0000 7fba2259c640 1 -- 172.21.15.119:0/3049131508 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24160570 con 0x7fba240b7980 2023-07-09T21:22:06.746 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba2259c640 1 --2- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240b7980 0x7fba24160030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=985c87ace42f26d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba2159a640 1 -- 172.21.15.119:0/3049131508 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab600 con 0x7fba240b7980 2023-07-09T21:22:06.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba2159a640 1 -- 172.21.15.119:0/3049131508 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140a7050 con 0x7fba240b7980 2023-07-09T21:22:06.748 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba2159a640 1 -- 172.21.15.119:0/3049131508 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140ab980 con 0x7fba240b7980 2023-07-09T21:22:06.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 -- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240b7980 msgr2=0x7fba24160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.749 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 --2- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240b7980 0x7fba24160030 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba14009870 tx=0x7fba1401c3d0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.750 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 -- 172.21.15.119:0/3049131508 shutdown_connections 2023-07-09T21:22:06.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 --2- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240ceb80 0x7fba240cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 --2- 172.21.15.119:0/3049131508 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240b7980 0x7fba24160030 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 -- 172.21.15.119:0/3049131508 >> 172.21.15.119:0/3049131508 conn(0x7fba24073090 msgr2=0x7fba24069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.751 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 -- 172.21.15.119:0/3049131508 shutdown_connections 2023-07-09T21:22:06.752 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.746+0000 7fba289d5640 1 -- 172.21.15.119:0/3049131508 wait complete. 2023-07-09T21:22:06.753 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 Processor -- start 2023-07-09T21:22:06.754 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- start start 2023-07-09T21:22:06.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.757 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 0x7fba241f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240ceb80 0x7fba240d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2414cb10 con 0x7fba240b7980 2023-07-09T21:22:06.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba240c93f0 con 0x7fba240ceb80 2023-07-09T21:22:06.758 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba241f1bd0 con 0x7fba240b3c20 2023-07-09T21:22:06.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36908/0 (socket says 172.21.15.119:36908) 2023-07-09T21:22:06.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 -- 172.21.15.119:0/441756698 learned_addr learned my addr 172.21.15.119:0/441756698 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:06.759 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba22d9d640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240ceb80 0x7fba240d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba21d9b640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 0x7fba241f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 -- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240ceb80 msgr2=0x7fba240d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240ceb80 0x7fba240d1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 -- 172.21.15.119:0/441756698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 msgr2=0x7fba241f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 0x7fba241f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 -- 172.21.15.119:0/441756698 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094d0 con 0x7fba240b3c20 2023-07-09T21:22:06.760 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba21d9b640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 0x7fba241f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba2259c640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba140ae040 tx=0x7fba14019170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140b4850 con 0x7fba240b3c20 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba140b49d0 con 0x7fba240b3c20 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba241f1eb0 con 0x7fba240b3c20 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba140b4d80 con 0x7fba240b3c20 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.750+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2415ebc0 con 0x7fba240b3c20 2023-07-09T21:22:06.761 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.754+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba140b2070 con 0x7fba240b3c20 2023-07-09T21:22:06.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.754+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fba140bdc10 con 0x7fba240b3c20 2023-07-09T21:22:06.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.754+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba240c9250 con 0x7fba240b3c20 2023-07-09T21:22:06.762 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.754+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fba240c9250 con 0x7fba240b3c20 2023-07-09T21:22:06.762 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.759+0000 7fedda775180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:22:06.763 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:06.758+0000 7fcd04884180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:22:06.821 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.822+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8", "id": 4} v 0) v1 -- 0x7fba240737d0 con 0x7fba240b3c20 2023-07-09T21:22:06.826 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.823+0000 7fedda775180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:22:06.829 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba12ffd640 1 -- 172.21.15.119:0/441756698 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba240737d0 con 0x7fba240b3c20 2023-07-09T21:22:06.830 INFO:teuthology.orchestra.run.smithi119.stdout:4 2023-07-09T21:22:06.830 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 msgr2=0x7fba2414c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba140ae040 tx=0x7fba14019170 comp rx=0 tx=0).stop 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 shutdown_connections 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba240ceb80 0x7fba240d1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba240b7980 0x7fba241f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 --2- 172.21.15.119:0/441756698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba240b3c20 0x7fba2414c5d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 >> 172.21.15.119:0/441756698 conn(0x7fba24073090 msgr2=0x7fba2415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.831 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 shutdown_connections 2023-07-09T21:22:06.832 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.830+0000 7fba289d5640 1 -- 172.21.15.119:0/441756698 wait complete. 2023-07-09T21:22:06.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 08046945-b9c6-47b1-b26e-d147b5e82559 5 2023-07-09T21:22:06.851 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:06.850+0000 7fcd04884180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:22:06.913 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:06.914+0000 7fcd04884180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:22:06.918 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.915+0000 7fedda775180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:22:06.981 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:06.979+0000 7fedda775180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:22:06.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 Processor -- start 2023-07-09T21:22:06.987 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 -- start start 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcf80b76b0 0x7fbcf80cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80b3bb0 con 0x7fbcf80d0360 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80cccb0 con 0x7fbcf815f130 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcfd056640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80d07a0 con 0x7fbcf80b76b0 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcf6d9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbcf815f130 0x7fbcf80b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.119:40646/0 (socket says 172.21.15.119:40646) 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.986+0000 7fbcf6d9d640 1 -- 172.21.15.119:0/2690985609 learned_addr learned my addr 172.21.15.119:0/2690985609 (peer_addr_for_me v1:172.21.15.119:0/0) 2023-07-09T21:22:06.989 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf659c640 1 --2- 172.21.15.119:0/2690985609 >> v2:172.21.15.37:3300/0 conn(0x7fbcf80b76b0 0x7fbcf80cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:06.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf5d9b640 1 -- 172.21.15.119:0/2690985609 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728915976 0 0) 0x7fbcf80cccb0 con 0x7fbcf815f130 2023-07-09T21:22:06.990 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf5d9b640 1 -- 172.21.15.119:0/2690985609 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbce0003530 con 0x7fbcf815f130 2023-07-09T21:22:06.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf659c640 1 -- 172.21.15.119:0/2690985609 >> v1:172.21.15.119:6789/0 conn(0x7fbcf815f130 legacy=0x7fbcf80b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf659c640 1 -- 172.21.15.119:0/2690985609 >> v1:172.21.15.37:6789/0 conn(0x7fbcf80d0360 legacy=0x7fbcf80cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.991 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf659c640 1 -- 172.21.15.119:0/2690985609 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80b8100 con 0x7fbcf80b76b0 2023-07-09T21:22:06.992 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf659c640 1 --2- 172.21.15.119:0/2690985609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80cfe20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0097c0 tx=0x7fbcec01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e14e523634bc745 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf5d9b640 1 -- 172.21.15.119:0/2690985609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0ac620 con 0x7fbcf80b76b0 2023-07-09T21:22:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf5d9b640 1 -- 172.21.15.119:0/2690985609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0ac780 con 0x7fbcf80b76b0 2023-07-09T21:22:06.993 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.990+0000 7fbcf5d9b640 1 -- 172.21.15.119:0/2690985609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcec0acb10 con 0x7fbcf80b76b0 2023-07-09T21:22:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- 172.21.15.119:0/2690985609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 msgr2=0x7fbcf80cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 --2- 172.21.15.119:0/2690985609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80cfe20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0097c0 tx=0x7fbcec01c3c0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- 172.21.15.119:0/2690985609 shutdown_connections 2023-07-09T21:22:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 --2- 172.21.15.119:0/2690985609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80cfe20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:06.994 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- 172.21.15.119:0/2690985609 >> 172.21.15.119:0/2690985609 conn(0x7fbcf8072d20 msgr2=0x7fbcf80d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- 172.21.15.119:0/2690985609 shutdown_connections 2023-07-09T21:22:06.995 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- 172.21.15.119:0/2690985609 wait complete. 2023-07-09T21:22:06.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 Processor -- start 2023-07-09T21:22:06.996 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- start start 2023-07-09T21:22:06.998 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 0x7fbcf814cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 0x7fbcf80c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf814d4c0 con 0x7fbcf80b76b0 2023-07-09T21:22:06.999 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c8130 con 0x7fbcf815f130 2023-07-09T21:22:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.994+0000 7fbcfd056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf80c8410 con 0x7fbcf80d0360 2023-07-09T21:22:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 0x7fbcf80c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.000 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 0x7fbcf814cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.119:50722/0 (socket says 172.21.15.119:50722) 2023-07-09T21:22:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf6d9d640 1 -- 172.21.15.119:0/1190971858 learned_addr learned my addr 172.21.15.119:0/1190971858 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 -- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 msgr2=0x7fbcf814cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 0x7fbcf814cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.001 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 -- 172.21.15.119:0/1190971858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 msgr2=0x7fbcf80c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 -- 172.21.15.119:0/1190971858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec009420 con 0x7fbcf815f130 2023-07-09T21:22:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf659c640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 0x7fbcf814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:07.002 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf6d9d640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcf759e640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 0x7fbcf80c63f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c700 tx=0x7fbcf000cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0003b80 con 0x7fbcf815f130 2023-07-09T21:22:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0003ce0 con 0x7fbcf815f130 2023-07-09T21:22:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf80c86f0 con 0x7fbcf815f130 2023-07-09T21:22:07.003 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0005310 con 0x7fbcf815f130 2023-07-09T21:22:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf80c8cb0 con 0x7fbcf815f130 2023-07-09T21:22:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbcf000a640 con 0x7fbcf815f130 2023-07-09T21:22:07.004 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fbcf00124d0 con 0x7fbcf815f130 2023-07-09T21:22:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:06.998+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf80c8ea0 con 0x7fbcf815f130 2023-07-09T21:22:07.005 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.002+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fbcf000a8f0 con 0x7fbcf815f130 2023-07-09T21:22:07.007 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:07.006+0000 7fcd04884180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:22:07.075 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:07.071+0000 7fedda775180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:22:07.081 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:07.082+0000 7fcd04884180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:22:07.087 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.086+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08046945-b9c6-47b1-b26e-d147b5e82559", "id": 5} v 0) v1 -- 0x7fbcf80668f0 con 0x7fbcf815f130 2023-07-09T21:22:07.094 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcdf7fe640 1 -- 172.21.15.119:0/1190971858 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08046945-b9c6-47b1-b26e-d147b5e82559", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbcf000aa90 con 0x7fbcf815f130 2023-07-09T21:22:07.095 INFO:teuthology.orchestra.run.smithi119.stdout:5 2023-07-09T21:22:07.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 msgr2=0x7fbcf80c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 0x7fbcf80c63f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c700 tx=0x7fbcf000cbc0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 shutdown_connections 2023-07-09T21:22:07.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcf815f130 0x7fbcf80c63f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.096 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcf80d0360 0x7fbcf814cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 --2- 172.21.15.119:0/1190971858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcf80b76b0 0x7fbcf80c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 >> 172.21.15.119:0/1190971858 conn(0x7fbcf8072d20 msgr2=0x7fbcf80b6590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 shutdown_connections 2023-07-09T21:22:07.097 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.094+0000 7fbcfd056640 1 -- 172.21.15.119:0/1190971858 wait complete. 2023-07-09T21:22:07.114 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new 2366a411-8370-47c5-8e69-d265adf753aa 6 2023-07-09T21:22:07.138 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:07.135+0000 7fedda775180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:22:07.241 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:07.242+0000 7fcd04884180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:22:07.249 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 Processor -- start 2023-07-09T21:22:07.250 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 -- start start 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15bf80 con 0x7f477c0b7980 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0cd070 con 0x7f477c0d0780 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f47817fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0cfd70 con 0x7f477c0cf290 2023-07-09T21:22:07.251 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53876/0 (socket says 172.21.15.119:53876) 2023-07-09T21:22:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477b7fe640 1 -- 172.21.15.119:0/854331475 learned_addr learned my addr 172.21.15.119:0/854331475 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:07.252 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36916/0 (socket says 172.21.15.119:36916) 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 -- 172.21.15.119:0/854331475 >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 msgr2=0x7f477c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 --2- 172.21.15.119:0/854331475 >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 -- 172.21.15.119:0/854331475 >> v1:172.21.15.119:6789/0 conn(0x7f477c0b7980 legacy=0x7f477c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477a7fc640 1 -- 172.21.15.119:0/854331475 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c160570 con 0x7f477c0cf290 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f4779ffb640 1 -- 172.21.15.119:0/854331475 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857455836 0 0) 0x7f476c001120 con 0x7f477c0b7980 2023-07-09T21:22:07.253 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.250+0000 7f477b7fe640 1 --2- 172.21.15.119:0/854331475 >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:07.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f477a7fc640 1 --2- 172.21.15.119:0/854331475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47700097c0 tx=0x7f477001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f08c8f4475f5402e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.254 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f4779ffb640 1 -- 172.21.15.119:0/854331475 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700ab600 con 0x7f477c0cf290 2023-07-09T21:22:07.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f4779ffb640 1 -- 172.21.15.119:0/854331475 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47700a7050 con 0x7f477c0cf290 2023-07-09T21:22:07.255 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f4779ffb640 1 -- 172.21.15.119:0/854331475 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47700ab980 con 0x7f477c0cf290 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 -- 172.21.15.119:0/854331475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 msgr2=0x7f477c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 --2- 172.21.15.119:0/854331475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f47700097c0 tx=0x7f477001c480 comp rx=0 tx=0).stop 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 -- 172.21.15.119:0/854331475 shutdown_connections 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 --2- 172.21.15.119:0/854331475 >> v2:172.21.15.119:3300/0 conn(0x7f477c0d0780 0x7f477c0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 --2- 172.21.15.119:0/854331475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.256 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 -- 172.21.15.119:0/854331475 >> 172.21.15.119:0/854331475 conn(0x7f477c073090 msgr2=0x7f477c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 -- 172.21.15.119:0/854331475 shutdown_connections 2023-07-09T21:22:07.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.254+0000 7f47817fa640 1 -- 172.21.15.119:0/854331475 wait complete. 2023-07-09T21:22:07.257 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 Processor -- start 2023-07-09T21:22:07.258 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- start start 2023-07-09T21:22:07.260 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c155aa0 con 0x7f477c0d0780 2023-07-09T21:22:07.261 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c0b2b50 con 0x7f477c0b7980 2023-07-09T21:22:07.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c1522b0 con 0x7f477c0cf290 2023-07-09T21:22:07.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.262 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36928/0 (socket says 172.21.15.119:36928) 2023-07-09T21:22:07.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 -- 172.21.15.119:0/3448566224 learned_addr learned my addr 172.21.15.119:0/3448566224 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:07.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477b7fe640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 -- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 msgr2=0x7f477c151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.263 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 -- 172.21.15.119:0/3448566224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 msgr2=0x7f477c1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 -- 172.21.15.119:0/3448566224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009b30 con 0x7f477c0cf290 2023-07-09T21:22:07.264 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477b7fe640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:07.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f477a7fc640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f477001ab30 tx=0x7f4770019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770004220 con 0x7f477c0cf290 2023-07-09T21:22:07.265 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4770004380 con 0x7f477c0cf290 2023-07-09T21:22:07.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770003820 con 0x7f477c0cf290 2023-07-09T21:22:07.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770009420 con 0x7f477c0cf290 2023-07-09T21:22:07.266 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c152870 con 0x7f477c0cf290 2023-07-09T21:22:07.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47700b2040 con 0x7f477c0cf290 2023-07-09T21:22:07.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4770003980 con 0x7f477c0cf290 2023-07-09T21:22:07.267 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.258+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c0737d0 con 0x7f477c0cf290 2023-07-09T21:22:07.268 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.262+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f477c0737d0 con 0x7f477c0cf290 2023-07-09T21:22:07.299 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:07.295+0000 7fedda775180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:22:07.313 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:07.310+0000 7fcd04884180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:22:07.328 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.326+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2366a411-8370-47c5-8e69-d265adf753aa", "id": 6} v 0) v1 -- 0x7f477c152a30 con 0x7f477c0cf290 2023-07-09T21:22:07.336 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.334+0000 7f47637fe640 1 -- 172.21.15.119:0/3448566224 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2366a411-8370-47c5-8e69-d265adf753aa", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f477c160570 con 0x7f477c0cf290 2023-07-09T21:22:07.337 INFO:teuthology.orchestra.run.smithi119.stdout:6 2023-07-09T21:22:07.338 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 msgr2=0x7f477c0b2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f477001ab30 tx=0x7f4770019220 comp rx=0 tx=0).stop 2023-07-09T21:22:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 shutdown_connections 2023-07-09T21:22:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.339 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0cf290 0x7f477c0b2610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 --2- 172.21.15.119:0/3448566224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 >> 172.21.15.119:0/3448566224 conn(0x7f477c073090 msgr2=0x7f477c15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 shutdown_connections 2023-07-09T21:22:07.340 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.338+0000 7f47817fa640 1 -- 172.21.15.119:0/3448566224 wait complete. 2023-07-09T21:22:07.355 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --cluster ceph osd new dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26 7 2023-07-09T21:22:07.371 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:07.367+0000 7fedda775180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:22:07.490 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 Processor -- start 2023-07-09T21:22:07.491 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 -- start start 2023-07-09T21:22:07.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa6700b74e0 0x7fa6700cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.492 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6700b3bb0 con 0x7fa6700d0360 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6700b7930 con 0x7fa6700b74e0 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa678782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6700d07e0 con 0x7fa67015f130 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.119:36930/0 (socket says 172.21.15.119:36930) 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 -- 172.21.15.119:0/1487039042 learned_addr learned my addr 172.21.15.119:0/1487039042 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:07.493 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa675d1d640 1 --2- 172.21.15.119:0/1487039042 >> v2:172.21.15.37:3300/0 conn(0x7fa6700b74e0 0x7fa6700cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 -- 172.21.15.119:0/1487039042 >> v2:172.21.15.37:3300/0 conn(0x7fa6700b74e0 msgr2=0x7fa6700cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:07.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 --2- 172.21.15.119:0/1487039042 >> v2:172.21.15.37:3300/0 conn(0x7fa6700b74e0 0x7fa6700cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 -- 172.21.15.119:0/1487039042 >> v1:172.21.15.37:6789/0 conn(0x7fa6700d0360 legacy=0x7fa6700b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.494 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.490+0000 7fa67651e640 1 -- 172.21.15.119:0/1487039042 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6700cccb0 con 0x7fa67015f130 2023-07-09T21:22:07.495 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa67651e640 1 --2- 172.21.15.119:0/1487039042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b4e55163a6781e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa67551c640 1 -- 172.21.15.119:0/1487039042 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0aa5f0 con 0x7fa67015f130 2023-07-09T21:22:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa67551c640 1 -- 172.21.15.119:0/1487039042 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0aa750 con 0x7fa67015f130 2023-07-09T21:22:07.496 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa67551c640 1 -- 172.21.15.119:0/1487039042 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0aaae0 con 0x7fa67015f130 2023-07-09T21:22:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 -- 172.21.15.119:0/1487039042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 msgr2=0x7fa6700b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 --2- 172.21.15.119:0/1487039042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa66c009870 tx=0x7fa66c01c490 comp rx=0 tx=0).stop 2023-07-09T21:22:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 -- 172.21.15.119:0/1487039042 shutdown_connections 2023-07-09T21:22:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 --2- 172.21.15.119:0/1487039042 >> v2:172.21.15.37:3300/0 conn(0x7fa6700b74e0 0x7fa6700cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.497 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 --2- 172.21.15.119:0/1487039042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa67015f130 0x7fa6700b6fa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 -- 172.21.15.119:0/1487039042 >> 172.21.15.119:0/1487039042 conn(0x7fa670072d20 msgr2=0x7fa6700d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 -- 172.21.15.119:0/1487039042 shutdown_connections 2023-07-09T21:22:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.494+0000 7fa678782640 1 -- 172.21.15.119:0/1487039042 wait complete. 2023-07-09T21:22:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 Processor -- start 2023-07-09T21:22:07.498 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- start start 2023-07-09T21:22:07.499 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 0x7fa67015d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67015f130 0x7fa6700c5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015c740 con 0x7fa67015f130 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015c9e0 con 0x7fa6700b74e0 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa67015ccc0 con 0x7fa6700d0360 2023-07-09T21:22:07.500 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa675d1d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 0x7fa67015d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.119:53890/0 (socket says 172.21.15.119:53890) 2023-07-09T21:22:07.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 -- 172.21.15.119:0/2534433537 learned_addr learned my addr 172.21.15.119:0/2534433537 (peer_addr_for_me v2:172.21.15.119:0/0) 2023-07-09T21:22:07.501 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa676d1f640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67015f130 0x7fa6700c5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 -- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 msgr2=0x7fa67015d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 0x7fa67015d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.502 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 -- 172.21.15.119:0/2534433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67015f130 msgr2=0x7fa6700c5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67015f130 0x7fa6700c5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 -- 172.21.15.119:0/2534433537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0094d0 con 0x7fa6700b74e0 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa675d1d640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 0x7fa67015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa67651e640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ac040 tx=0x7fa66c019230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b4810 con 0x7fa6700b74e0 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66c0b4990 con 0x7fa6700b74e0 2023-07-09T21:22:07.503 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa67015cfa0 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66c0b4d40 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.498+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67014eca0 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.502+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa66c0be710 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.502+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa66c0a7070 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.502+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6700668f0 con 0x7fa6700b74e0 2023-07-09T21:22:07.504 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.502+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa66c0b3390 con 0x7fa6700b74e0 2023-07-09T21:22:07.568 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.566+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26", "id": 7} v 0) v1 -- 0x7fa6700b3440 con 0x7fa6700b74e0 2023-07-09T21:22:07.576 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.574+0000 7fa666ffd640 1 -- 172.21.15.119:0/2534433537 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa66c0be9c0 con 0x7fa6700b74e0 2023-07-09T21:22:07.577 INFO:teuthology.orchestra.run.smithi119.stdout:7 2023-07-09T21:22:07.577 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 msgr2=0x7fa67014e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0ac040 tx=0x7fa66c019230 comp rx=0 tx=0).stop 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 shutdown_connections 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa67015f130 0x7fa6700c5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6700d0360 0x7fa67015d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 --2- 172.21.15.119:0/2534433537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa6700b74e0 0x7fa67014e760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 >> 172.21.15.119:0/2534433537 conn(0x7fa670072d20 msgr2=0x7fa6700cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.578 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 shutdown_connections 2023-07-09T21:22:07.579 INFO:teuthology.orchestra.run.smithi119.stderr:2023-07-09T21:22:07.578+0000 7fa678782640 1 -- 172.21.15.119:0/2534433537 wait complete. 2023-07-09T21:22:07.595 INFO:tasks.ceph.osd.0:Restarting daemon 2023-07-09T21:22:07.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-07-09T21:22:07.599 INFO:tasks.ceph.osd.0:Started 2023-07-09T21:22:07.599 INFO:tasks.ceph.osd.1:Restarting daemon 2023-07-09T21:22:07.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-07-09T21:22:07.603 INFO:tasks.ceph.osd.1:Started 2023-07-09T21:22:07.603 INFO:tasks.ceph.osd.2:Restarting daemon 2023-07-09T21:22:07.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-07-09T21:22:07.608 INFO:tasks.ceph.osd.2:Started 2023-07-09T21:22:07.608 INFO:tasks.ceph.osd.3:Restarting daemon 2023-07-09T21:22:07.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-07-09T21:22:07.612 INFO:tasks.ceph.osd.3:Started 2023-07-09T21:22:07.613 INFO:tasks.ceph.osd.4:Restarting daemon 2023-07-09T21:22:07.613 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-07-09T21:22:07.618 INFO:tasks.ceph.osd.4:Started 2023-07-09T21:22:07.619 INFO:tasks.ceph.osd.5:Restarting daemon 2023-07-09T21:22:07.619 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-07-09T21:22:07.624 INFO:tasks.ceph.osd.5:Started 2023-07-09T21:22:07.624 INFO:tasks.ceph.osd.6:Restarting daemon 2023-07-09T21:22:07.625 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-07-09T21:22:07.629 INFO:tasks.ceph.osd.6:Started 2023-07-09T21:22:07.630 INFO:tasks.ceph.osd.7:Restarting daemon 2023-07-09T21:22:07.630 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-07-09T21:22:07.635 INFO:tasks.ceph.osd.7:Started 2023-07-09T21:22:07.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 Processor -- start 2023-07-09T21:22:07.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 -- start start 2023-07-09T21:22:07.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 0x7f744c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c06acb0 con 0x7f744c15ba60 2023-07-09T21:22:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744c0ccc90 con 0x7f744c0cf090 2023-07-09T21:22:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7450eca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0cfe20 con 0x7f744c0cc800 2023-07-09T21:22:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f744c15ba60 0x7f744c1600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51830/0 (socket says 172.21.15.37:51830) 2023-07-09T21:22:07.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744a59c640 1 -- 172.21.15.37:0/1737405658 learned_addr learned my addr 172.21.15.37:0/1737405658 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7449d9b640 1 --2- 172.21.15.37:0/1737405658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 0x7f744c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333928086 0 0) 0x7f744c06acb0 con 0x7f744c15ba60 2023-07-09T21:22:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7434003530 con 0x7f744c15ba60 2023-07-09T21:22:07.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718859798 0 0) 0x7f744c0ccc90 con 0x7f744c0cf090 2023-07-09T21:22:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c06acb0 con 0x7f744c0cf090 2023-07-09T21:22:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7449d9b640 1 -- 172.21.15.37:0/1737405658 >> v1:172.21.15.119:6789/0 conn(0x7f744c0cf090 legacy=0x7f744c0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7449d9b640 1 -- 172.21.15.37:0/1737405658 >> v1:172.21.15.37:6789/0 conn(0x7f744c15ba60 legacy=0x7f744c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.863+0000 7f7449d9b640 1 -- 172.21.15.37:0/1737405658 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0d0100 con 0x7f744c0cc800 2023-07-09T21:22:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7449d9b640 1 --2- 172.21.15.37:0/1737405658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 0x7f744c0ceb50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74400097f0 tx=0x7f744001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ab9f288e0dea0db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400aa610 con 0x7f744c0cc800 2023-07-09T21:22:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400a6040 con 0x7f744c0cc800 2023-07-09T21:22:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f744959a640 1 -- 172.21.15.37:0/1737405658 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400aa990 con 0x7f744c0cc800 2023-07-09T21:22:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 -- 172.21.15.37:0/1737405658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 msgr2=0x7f744c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 --2- 172.21.15.37:0/1737405658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 0x7f744c0ceb50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f74400097f0 tx=0x7f744001c490 comp rx=0 tx=0).stop 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 -- 172.21.15.37:0/1737405658 shutdown_connections 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 --2- 172.21.15.37:0/1737405658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c0cc800 0x7f744c0ceb50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 -- 172.21.15.37:0/1737405658 >> 172.21.15.37:0/1737405658 conn(0x7f744c073090 msgr2=0x7f744c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 -- 172.21.15.37:0/1737405658 shutdown_connections 2023-07-09T21:22:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.867+0000 7f7450eca640 1 -- 172.21.15.37:0/1737405658 wait complete. 2023-07-09T21:22:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 Processor -- start 2023-07-09T21:22:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- start start 2023-07-09T21:22:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 0x7f744c0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c15ba60 0x7f744c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:07.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c0c5440 con 0x7f744c0cc800 2023-07-09T21:22:07.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744c14d9d0 con 0x7f744c0cf090 2023-07-09T21:22:07.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f744c146fe0 con 0x7f744c15ba60 2023-07-09T21:22:07.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f744a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f744ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c15ba60 0x7f744c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 0x7f744c0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f744a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50104/0 (socket says 172.21.15.37:50104) 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f744a59c640 1 -- 172.21.15.37:0/994138428 learned_addr learned my addr 172.21.15.37:0/994138428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 -- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c15ba60 msgr2=0x7f744c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c15ba60 0x7f744c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 -- 172.21.15.37:0/994138428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 msgr2=0x7f744c0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 -- 172.21.15.37:0/994138428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7440009420 con 0x7f744c0cf090 2023-07-09T21:22:07.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f744a59c640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7449d9b640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 0x7f744c0c4f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74400ab000 tx=0x7f744001acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400be610 con 0x7f744c0cf090 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74400be7b0 con 0x7f744c0cf090 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74400beb60 con 0x7f744c0cf090 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744c14dc30 con 0x7f744c0cf090 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f744c147530 con 0x7f744c0cf090 2023-07-09T21:22:07.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f74400becc0 con 0x7f744c0cf090 2023-07-09T21:22:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.871+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f74400b3a60 con 0x7f744c0cf090 2023-07-09T21:22:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.875+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f744c0668f0 con 0x7f744c0cf090 2023-07-09T21:22:07.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.875+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f74400aae30 con 0x7f744c0cf090 2023-07-09T21:22:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f744c06a7f0 con 0x7f744c0cf090 2023-07-09T21:22:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f743affd640 1 -- 172.21.15.37:0/994138428 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f74400b3c70 con 0x7f744c0cf090 2023-07-09T21:22:07.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:07.939 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:07.570217+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 msgr2=0x7f744c0c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 0x7f744c0c4f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f74400ab000 tx=0x7f744001acd0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 shutdown_connections 2023-07-09T21:22:07.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f744c15ba60 0x7f744c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f744c0cf090 0x7f744c0c4f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 --2- 172.21.15.37:0/994138428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f744c0cc800 0x7f744c0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 >> 172.21.15.37:0/994138428 conn(0x7f744c073090 msgr2=0x7f744c15fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 shutdown_connections 2023-07-09T21:22:07.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:07.935+0000 7f7450eca640 1 -- 172.21.15.37:0/994138428 wait complete. 2023-07-09T21:22:07.953 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:22:07.953 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:22:07.953 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:22:07.961 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-07-09T21:22:07.962 INFO:tasks.ceph:Waiting for OSDs to come up 2023-07-09T21:22:08.000 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:22:08.000 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:22:08.000 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:22:08.043 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:08.042+0000 7fcd04884180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:22:08.049 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:08.047+0000 7fedda775180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:22:08.175 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:08.174+0000 7fcd04884180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:22:08.188 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:08.183+0000 7fedda775180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:22:08.310 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-07-09T21:22:08.310+0000 7fd15d872640 -1 Falling back to public interface 2023-07-09T21:22:08.314 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-09T21:22:08.311+0000 7fc48a88e640 -1 Falling back to public interface 2023-07-09T21:22:08.314 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-07-09T21:22:08.314+0000 7f4a4edfb640 -1 Falling back to public interface 2023-07-09T21:22:08.321 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-09T21:22:08.319+0000 7fefa1b7e640 -1 Falling back to public interface 2023-07-09T21:22:08.330 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-07-09T21:22:08.330+0000 7f10110c8640 -1 Falling back to public interface 2023-07-09T21:22:08.334 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-09T21:22:08.331+0000 7f70e9aa6640 -1 Falling back to public interface 2023-07-09T21:22:08.334 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-07-09T21:22:08.334+0000 7f36168f7640 -1 Falling back to public interface 2023-07-09T21:22:08.346 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-09T21:22:08.343+0000 7fc8db8d4640 -1 Falling back to public interface 2023-07-09T21:22:08.347 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:08.346+0000 7fcd04884180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:22:08.373 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:08.371+0000 7fedda775180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:22:08.420 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:08.417+0000 7fcd04884180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:22:08.449 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:08.447+0000 7fedda775180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:22:08.553 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:08.553+0000 7fcd04884180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:22:08.592 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:08.587+0000 7fedda775180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:22:08.767 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:08.900 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.895+0000 7f8a4d2ec640 1 Processor -- start 2023-07-09T21:22:08.900 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.895+0000 7f8a4d2ec640 1 -- start start 2023-07-09T21:22:08.901 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a4d2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 0x7f8a480b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:08.901 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a4d2ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480d0100 con 0x7f8a480b7940 2023-07-09T21:22:08.901 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a4d2ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a480b7d10 con 0x7f8a480d0590 2023-07-09T21:22:08.902 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a4d2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480ccec0 con 0x7f8a480b3be0 2023-07-09T21:22:08.902 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a46ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8a480b7940 0x7f8a480cc7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51842/0 (socket says 172.21.15.37:51842) 2023-07-09T21:22:08.902 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a46ffd640 1 -- 172.21.15.37:0/667117888 learned_addr learned my addr 172.21.15.37:0/667117888 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:08.902 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a3ffff640 1 --2- 172.21.15.37:0/667117888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 0x7f8a480b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3558223572 0 0) 0x7f8a480d0100 con 0x7f8a480b7940 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a34003530 con 0x7f8a480b7940 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2464326092 0 0) 0x7f8a480b7d10 con 0x7f8a480d0590 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a3ffff640 1 -- 172.21.15.37:0/667117888 >> v1:172.21.15.119:6789/0 conn(0x7f8a480d0590 legacy=0x7f8a480d09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a3ffff640 1 -- 172.21.15.37:0/667117888 >> v1:172.21.15.37:6789/0 conn(0x7f8a480b7940 legacy=0x7f8a480cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.903 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.899+0000 7f8a3ffff640 1 -- 172.21.15.37:0/667117888 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a480cfdd0 con 0x7f8a480b3be0 2023-07-09T21:22:08.905 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a3ffff640 1 --2- 172.21.15.37:0/667117888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 0x7f8a480b4050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a300097f0 tx=0x7f8a3001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4d70408cd6d946 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:08.905 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300ab600 con 0x7f8a480b3be0 2023-07-09T21:22:08.905 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a300a7050 con 0x7f8a480b3be0 2023-07-09T21:22:08.906 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a467fc640 1 -- 172.21.15.37:0/667117888 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300ab980 con 0x7f8a480b3be0 2023-07-09T21:22:08.906 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/667117888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 msgr2=0x7f8a480b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/667117888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 0x7f8a480b4050 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8a300097f0 tx=0x7f8a3001c430 comp rx=0 tx=0).stop 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/667117888 shutdown_connections 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/667117888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b3be0 0x7f8a480b4050 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/667117888 >> 172.21.15.37:0/667117888 conn(0x7f8a48073090 msgr2=0x7f8a48069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/667117888 shutdown_connections 2023-07-09T21:22:08.907 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/667117888 wait complete. 2023-07-09T21:22:08.908 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 Processor -- start 2023-07-09T21:22:08.908 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.903+0000 7f8a4d2ec640 1 -- start start 2023-07-09T21:22:08.909 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:08.909 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 0x7f8a4813ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:08.909 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a480d0590 0x7f8a480cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:08.909 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480c5d30 con 0x7f8a480d0590 2023-07-09T21:22:08.909 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a48152e40 con 0x7f8a480b3be0 2023-07-09T21:22:08.910 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480c5fa0 con 0x7f8a480b7940 2023-07-09T21:22:08.911 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:08.911 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 0x7f8a4813ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:08.911 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a46ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:57584/0 (socket says 172.21.15.37:57584) 2023-07-09T21:22:08.911 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a46ffd640 1 -- 172.21.15.37:0/1989178628 learned_addr learned my addr 172.21.15.37:0/1989178628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a477fe640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a480d0590 0x7f8a480cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 -- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 msgr2=0x7f8a48152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 -- 172.21.15.37:0/1989178628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a480d0590 msgr2=0x7f8a480cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a480d0590 0x7f8a480cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 -- 172.21.15.37:0/1989178628 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a30009420 con 0x7f8a480b7940 2023-07-09T21:22:08.912 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a46ffd640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3ffff640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 0x7f8a4813ff20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ab000 tx=0x7f8a300191d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004020 con 0x7f8a480b7940 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a30004180 con 0x7f8a480b7940 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004530 con 0x7f8a480b7940 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480c6280 con 0x7f8a480b7940 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a480c6840 con 0x7f8a480b7940 2023-07-09T21:22:08.913 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8a300b2040 con 0x7f8a480b7940 2023-07-09T21:22:08.914 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f8a300bc530 con 0x7f8a480b7940 2023-07-09T21:22:08.914 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.907+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480cd7a0 con 0x7f8a480b7940 2023-07-09T21:22:08.915 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.911+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f8a300c1060 con 0x7f8a480b7940 2023-07-09T21:22:08.975 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.971+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a480c60e0 con 0x7f8a480b7940 2023-07-09T21:22:08.976 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.971+0000 7f8a3f7fe640 1 -- 172.21.15.37:0/1989178628 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8a480c60e0 con 0x7f8a480b7940 2023-07-09T21:22:08.976 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-09T21:22:08.977 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:07.570217+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:08.977 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 msgr2=0x7f8a4813ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 0x7f8a4813ff20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ab000 tx=0x7f8a300191d0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 shutdown_connections 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a480d0590 0x7f8a480cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a480b7940 0x7f8a4813ff20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 --2- 172.21.15.37:0/1989178628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a480b3be0 0x7f8a48152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:08.978 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 >> 172.21.15.37:0/1989178628 conn(0x7f8a48073090 msgr2=0x7f8a480b67e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:08.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 shutdown_connections 2023-07-09T21:22:08.979 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:08.975+0000 7f8a4d2ec640 1 -- 172.21.15.37:0/1989178628 wait complete. 2023-07-09T21:22:08.995 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-09T21:22:09.228 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.225+0000 7fcd04884180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:22:09.291 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:09.287+0000 7fedda775180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:22:09.315 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.313+0000 7fcd04884180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:22:09.382 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:09.379+0000 7fedda775180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:22:09.503 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.501+0000 7fcd04884180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:22:09.580 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:09.575+0000 7fedda775180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:22:09.587 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.585+0000 7fcd04884180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:22:09.668 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:09.663+0000 7fedda775180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:22:09.866 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.865+0000 7fcd04884180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:22:09.934 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:09.933+0000 7fcd04884180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:22:09.967 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:09.963+0000 7fedda775180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:22:10.039 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:22:10.035+0000 7fedda775180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:22:10.958 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:10.957+0000 7fccac140640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-07-09T21:22:10.959 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:22:10.957+0000 7fccac140640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-09T21:22:12.149 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-09T21:22:12.147+0000 7fefa1b7e640 -1 osd.0 0 log_to_monitors true 2023-07-09T21:22:12.158 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-07-09T21:22:12.157+0000 7fd15d872640 -1 osd.6 0 log_to_monitors true 2023-07-09T21:22:12.266 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-09T21:22:12.263+0000 7f70e9aa6640 -1 osd.1 0 log_to_monitors true 2023-07-09T21:22:12.290 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-07-09T21:22:12.289+0000 7f4a4edfb640 -1 osd.4 0 log_to_monitors true 2023-07-09T21:22:12.311 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-07-09T21:22:12.309+0000 7f10110c8640 -1 osd.7 0 log_to_monitors true 2023-07-09T21:22:12.325 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-09T21:22:12.323+0000 7fc8db8d4640 -1 osd.3 0 log_to_monitors true 2023-07-09T21:22:12.333 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-09T21:22:12.331+0000 7fc48a88e640 -1 osd.2 0 log_to_monitors true 2023-07-09T21:22:12.366 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-07-09T21:22:12.365+0000 7f36168f7640 -1 osd.5 0 log_to_monitors true 2023-07-09T21:22:15.801 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:16.027 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.023+0000 7f7d86f11640 1 Processor -- start 2023-07-09T21:22:16.028 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.023+0000 7f7d86f11640 1 -- start start 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d86f11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d86f11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 0x7f7d800b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d86f11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d800d0100 con 0x7f7d800b3be0 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d86f11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d800b4590 con 0x7f7d800d15a0 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d86f11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800b7d10 con 0x7f7d800b7940 2023-07-09T21:22:16.031 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d7ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d800b3be0 0x7f7d8015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51854/0 (socket says 172.21.15.37:51854) 2023-07-09T21:22:16.032 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d7ffff640 1 -- 172.21.15.37:0/566778408 learned_addr learned my addr 172.21.15.37:0/566778408 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:16.032 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d84cad640 1 --2- 172.21.15.37:0/566778408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:16.034 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d854ae640 1 --2- 172.21.15.37:0/566778408 >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 0x7f7d800b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:16.034 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d84cad640 1 -- 172.21.15.37:0/566778408 >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 msgr2=0x7f7d800b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:16.035 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d84cad640 1 --2- 172.21.15.37:0/566778408 >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 0x7f7d800b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.035 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d84cad640 1 -- 172.21.15.37:0/566778408 >> v1:172.21.15.37:6789/0 conn(0x7f7d800b3be0 legacy=0x7f7d8015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:16.035 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d84cad640 1 -- 172.21.15.37:0/566778408 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d800cfdd0 con 0x7f7d800b7940 2023-07-09T21:22:16.035 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.027+0000 7f7d7f7fe640 1 -- 172.21.15.37:0/566778408 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 745236684 0 0) 0x7f7d800d0100 con 0x7f7d800b3be0 2023-07-09T21:22:16.036 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d854ae640 1 --2- 172.21.15.37:0/566778408 >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 0x7f7d800b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:16.038 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d84cad640 1 --2- 172.21.15.37:0/566778408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800cc7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d700097c0 tx=0x7f7d7001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a9ee5ba217d44c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:16.039 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d7f7fe640 1 -- 172.21.15.37:0/566778408 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700ab600 con 0x7f7d800b7940 2023-07-09T21:22:16.039 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d7f7fe640 1 -- 172.21.15.37:0/566778408 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d700a7050 con 0x7f7d800b7940 2023-07-09T21:22:16.040 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 -- 172.21.15.37:0/566778408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 msgr2=0x7f7d800cc7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 --2- 172.21.15.37:0/566778408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800cc7b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7d700097c0 tx=0x7f7d7001c3e0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 -- 172.21.15.37:0/566778408 shutdown_connections 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 --2- 172.21.15.37:0/566778408 >> v2:172.21.15.37:3300/0 conn(0x7f7d800d15a0 0x7f7d800b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 --2- 172.21.15.37:0/566778408 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800cc7b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.035+0000 7f7d86f11640 1 -- 172.21.15.37:0/566778408 >> 172.21.15.37:0/566778408 conn(0x7f7d80073090 msgr2=0x7f7d80069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:16.041 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.039+0000 7f7d86f11640 1 -- 172.21.15.37:0/566778408 shutdown_connections 2023-07-09T21:22:16.043 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.039+0000 7f7d86f11640 1 -- 172.21.15.37:0/566778408 wait complete. 2023-07-09T21:22:16.044 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.039+0000 7f7d86f11640 1 Processor -- start 2023-07-09T21:22:16.049 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.039+0000 7f7d86f11640 1 -- start start 2023-07-09T21:22:16.050 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.050 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.050 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:16.050 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50192/0 (socket says 172.21.15.37:50192) 2023-07-09T21:22:16.050 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 0x7f7d800c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 -- 172.21.15.37:0/121109641 learned_addr learned my addr 172.21.15.37:0/121109641 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800c5d30 con 0x7f7d800b3be0 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800ca160 con 0x7f7d800d15a0 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d800ca440 con 0x7f7d800b7940 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d854ae640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 0x7f7d800c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 -- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 msgr2=0x7f7d800c93f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800c93f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.051 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 -- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 msgr2=0x7f7d800c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 0x7f7d800c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d70009420 con 0x7f7d800b3be0 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d854ae640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 0x7f7d800c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d84cad640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d7001a010 tx=0x7f7d70019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700aa970 con 0x7f7d800b3be0 2023-07-09T21:22:16.052 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d700aaad0 con 0x7f7d800b3be0 2023-07-09T21:22:16.053 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d700aae60 con 0x7f7d800b3be0 2023-07-09T21:22:16.053 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.043+0000 7f7d86f11640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d800ca720 con 0x7f7d800b3be0 2023-07-09T21:22:16.053 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.047+0000 7f7d86f11640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d800caa00 con 0x7f7d800b3be0 2023-07-09T21:22:16.053 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.047+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f7d700b2040 con 0x7f7d800b3be0 2023-07-09T21:22:16.054 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.047+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d58005260 con 0x7f7d800b3be0 2023-07-09T21:22:16.054 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.051+0000 7f7d7d7fa640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 0x7f7d6c0686f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:16.059 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.055+0000 7f7d7ffff640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 0x7f7d6c0686f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:16.060 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.055+0000 7f7d7ffff640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 0x7f7d6c0686f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000f90 tx=0x7f7d78007d50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:16.061 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.059+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f7d70114870 con 0x7f7d800b3be0 2023-07-09T21:22:16.065 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.063+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d70144060 con 0x7f7d800b3be0 2023-07-09T21:22:16.350 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-07-09T21:22:16.349+0000 7fd158ff4640 -1 osd.6 0 waiting for initial osdmap 2023-07-09T21:22:16.356 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-07-09T21:22:16.353+0000 7f4a4a57d640 -1 osd.4 0 waiting for initial osdmap 2023-07-09T21:22:16.402 INFO:tasks.ceph.osd.4.smithi119.stderr:2023-07-09T21:22:16.401+0000 7f4a42bc2640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.403 INFO:tasks.ceph.osd.6.smithi119.stderr:2023-07-09T21:22:16.401+0000 7fd151639640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.411 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-07-09T21:22:16.409+0000 7f3612079640 -1 osd.5 0 waiting for initial osdmap 2023-07-09T21:22:16.414 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-07-09T21:22:16.413+0000 7f100c84a640 -1 osd.7 0 waiting for initial osdmap 2023-07-09T21:22:16.418 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.415+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d580057e0 con 0x7f7d800b3be0 2023-07-09T21:22:16.419 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.415+0000 7f7d7d7fa640 1 -- 172.21.15.37:0/121109641 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f7d7010cbf0 con 0x7f7d800b3be0 2023-07-09T21:22:16.422 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-09T21:22:16.423 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":12,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:13.957955+0000","last_up_change":"0.000000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:16.423 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 msgr2=0x7f7d6c0686f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:16.423 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 0x7f7d6c0686f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7d78000f90 tx=0x7f7d78007d50 comp rx=0 tx=0).stop 2023-07-09T21:22:16.424 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 msgr2=0x7f7d800c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:16.424 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7d7001a010 tx=0x7f7d70019180 comp rx=0 tx=0).stop 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 shutdown_connections 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.419+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d6c066240 0x7f7d6c0686f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d800d15a0 0x7f7d800c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d800b7940 0x7f7d800c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 --2- 172.21.15.37:0/121109641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d800b3be0 0x7f7d800c83b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:16.425 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 >> 172.21.15.37:0/121109641 conn(0x7f7d80073090 msgr2=0x7f7d8015a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:16.426 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 shutdown_connections 2023-07-09T21:22:16.426 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:16.423+0000 7f7d66ffd640 1 -- 172.21.15.37:0/121109641 wait complete. 2023-07-09T21:22:16.446 INFO:tasks.ceph.osd.5.smithi119.stderr:2023-07-09T21:22:16.445+0000 7f360a6be640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.454 INFO:tasks.ceph.osd.7.smithi119.stderr:2023-07-09T21:22:16.453+0000 7f1004e8f640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.456 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-07-09T21:22:16.560 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-09T21:22:16.555+0000 7fc8d7056640 -1 osd.3 0 waiting for initial osdmap 2023-07-09T21:22:16.560 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-09T21:22:16.555+0000 7fef9d300640 -1 osd.0 0 waiting for initial osdmap 2023-07-09T21:22:16.585 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-07-09T21:22:16.583+0000 7fef95945640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.589 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-07-09T21:22:16.587+0000 7fc8cf69b640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.593 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-09T21:22:16.591+0000 7f70e5228640 -1 osd.1 0 waiting for initial osdmap 2023-07-09T21:22:16.596 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-09T21:22:16.591+0000 7fc486012640 -1 osd.2 0 waiting for initial osdmap 2023-07-09T21:22:16.645 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-07-09T21:22:16.643+0000 7f70dd86d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:16.657 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-07-09T21:22:16.655+0000 7fc47e657640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-09T21:22:23.263 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:23.405 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.398+0000 7f01c7cec640 1 Processor -- start 2023-07-09T21:22:23.405 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 -- start start 2023-07-09T21:22:23.406 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f01c00b7940 0x7f01c00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.406 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c00b4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.406 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01c015f490 0x7f01c015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.406 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00b4590 con 0x7f01c015f490 2023-07-09T21:22:23.406 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00d0100 con 0x7f01c00b7940 2023-07-09T21:22:23.407 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c7cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00b7d10 con 0x7f01c00b3be0 2023-07-09T21:22:23.407 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01c015f490 0x7f01c015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01c015f490 0x7f01c015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50896/0 (socket says 172.21.15.37:50896) 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 -- 172.21.15.37:0/3568970318 learned_addr learned my addr 172.21.15.37:0/3568970318 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c5a88640 1 --2- 172.21.15.37:0/3568970318 >> v2:172.21.15.119:3300/0 conn(0x7f01c00b7940 0x7f01c00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c5287640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c00b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 -- 172.21.15.37:0/3568970318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 msgr2=0x7f01c00b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:23.408 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c00b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.409 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 -- 172.21.15.37:0/3568970318 >> v2:172.21.15.119:3300/0 conn(0x7f01c00b7940 msgr2=0x7f01c00cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:23.409 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 --2- 172.21.15.37:0/3568970318 >> v2:172.21.15.119:3300/0 conn(0x7f01c00b7940 0x7f01c00cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.409 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.402+0000 7f01c6289640 1 -- 172.21.15.37:0/3568970318 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00cfdd0 con 0x7f01c015f490 2023-07-09T21:22:23.409 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c6289640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c015f8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01c00cfbe0 tx=0x7f01b801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923e01be80d35e1e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.410 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c4a86640 1 -- 172.21.15.37:0/3568970318 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80a5790 con 0x7f01c015f490 2023-07-09T21:22:23.410 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c4a86640 1 -- 172.21.15.37:0/3568970318 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80a58f0 con 0x7f01c015f490 2023-07-09T21:22:23.410 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c4a86640 1 -- 172.21.15.37:0/3568970318 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80a5c80 con 0x7f01c015f490 2023-07-09T21:22:23.411 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- 172.21.15.37:0/3568970318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 msgr2=0x7f01c015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.411 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c015f8b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f01c00cfbe0 tx=0x7f01b801c910 comp rx=0 tx=0).stop 2023-07-09T21:22:23.411 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- 172.21.15.37:0/3568970318 shutdown_connections 2023-07-09T21:22:23.411 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c015f8b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.411 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3568970318 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c00b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.412 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3568970318 >> v2:172.21.15.119:3300/0 conn(0x7f01c00b7940 0x7f01c00cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.412 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- 172.21.15.37:0/3568970318 >> 172.21.15.37:0/3568970318 conn(0x7f01c0073090 msgr2=0x7f01c0069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:23.412 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- 172.21.15.37:0/3568970318 shutdown_connections 2023-07-09T21:22:23.412 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- 172.21.15.37:0/3568970318 wait complete. 2023-07-09T21:22:23.413 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 Processor -- start 2023-07-09T21:22:23.413 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.406+0000 7f01c7cec640 1 -- start start 2023-07-09T21:22:23.413 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c014d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.413 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c00b7940 0x7f01c0154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.414 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.414 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c0152cf0 con 0x7f01c015f490 2023-07-09T21:22:23.414 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c015bf90 con 0x7f01c00b7940 2023-07-09T21:22:23.414 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c015c7f0 con 0x7f01c00b3be0 2023-07-09T21:22:23.415 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.415 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50906/0 (socket says 172.21.15.37:50906) 2023-07-09T21:22:23.415 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 -- 172.21.15.37:0/3753077595 learned_addr learned my addr 172.21.15.37:0/3753077595 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c5287640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c00b7940 0x7f01c0154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c5a88640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c014d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 -- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 msgr2=0x7f01c014d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c014d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 -- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c00b7940 msgr2=0x7f01c0154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.416 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c00b7940 0x7f01c0154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 -- 172.21.15.37:0/3753077595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b8009b30 con 0x7f01c015f490 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c6289640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01b801afc0 tx=0x7f01b80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b8670 con 0x7f01c015f490 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b80b87d0 con 0x7f01c015f490 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b80b8b60 con 0x7f01c015f490 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c00cb5b0 con 0x7f01c015f490 2023-07-09T21:22:23.417 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c015c480 con 0x7f01c015f490 2023-07-09T21:22:23.418 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.410+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c00cd7a0 con 0x7f01c015f490 2023-07-09T21:22:23.418 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.414+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f01b80b8cc0 con 0x7f01c015f490 2023-07-09T21:22:23.418 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.414+0000 7f01b67fc640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 0x7f01a4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.418 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.414+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01b811eff0 con 0x7f01c015f490 2023-07-09T21:22:23.419 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.414+0000 7f01c5a88640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 0x7f01a4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.419 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.414+0000 7f01c5a88640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 0x7f01a4068760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0079c0 tx=0x7f01bc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.422 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.418+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01b80ecb20 con 0x7f01c015f490 2023-07-09T21:22:23.579 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.574+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01c015c980 con 0x7f01c015f490 2023-07-09T21:22:23.580 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.574+0000 7f01b67fc640 1 -- 172.21.15.37:0/3753077595 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12838 (secure 0 0 0) 0x7f01b80f0140 con 0x7f01c015f490 2023-07-09T21:22:23.580 INFO:teuthology.misc.health.smithi037.stdout: 2023-07-09T21:22:23.580 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":16,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:20.792587+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:23.582 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 msgr2=0x7f01a4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.582 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 0x7f01a4068760 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f01bc0079c0 tx=0x7f01bc008040 comp rx=0 tx=0).stop 2023-07-09T21:22:23.582 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 msgr2=0x7f01c0154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.582 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f01b801afc0 tx=0x7f01b80196b0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.582 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 shutdown_connections 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f01a40662b0 0x7f01a4068760 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01c015f490 0x7f01c0154590 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01c00b7940 0x7f01c0154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 --2- 172.21.15.37:0/3753077595 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01c00b3be0 0x7f01c014d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 >> 172.21.15.37:0/3753077595 conn(0x7f01c0073090 msgr2=0x7f01c0158680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 shutdown_connections 2023-07-09T21:22:23.583 INFO:teuthology.misc.health.smithi037.stderr:2023-07-09T21:22:23.578+0000 7f01c7cec640 1 -- 172.21.15.37:0/3753077595 wait complete. 2023-07-09T21:22:23.599 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-07-09T21:22:23.599 INFO:tasks.ceph:Creating RBD pool 2023-07-09T21:22:23.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2023-07-09T21:22:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.734+0000 7efd5feec640 1 Processor -- start 2023-07-09T21:22:23.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.734+0000 7efd5feec640 1 -- start start 2023-07-09T21:22:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b7980 0x7efd58160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd580ceb80 0x7efd580cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efd580b3c20 0x7efd580b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cd070 con 0x7efd580ceb80 2023-07-09T21:22:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd580cfd70 con 0x7efd580b3c20 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5feec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5815bf80 con 0x7efd580b7980 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd580ceb80 0x7efd580cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efd580ceb80 0x7efd580cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50910/0 (socket says 172.21.15.37:50910) 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 -- 172.21.15.37:0/3337626874 learned_addr learned my addr 172.21.15.37:0/3337626874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5e489640 1 --2- 172.21.15.37:0/3337626874 >> v2:172.21.15.119:3300/0 conn(0x7efd580b3c20 0x7efd580b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5dc88640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b7980 0x7efd58160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 -- 172.21.15.37:0/3337626874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b7980 msgr2=0x7efd58160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b7980 0x7efd58160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 -- 172.21.15.37:0/3337626874 >> v2:172.21.15.119:3300/0 conn(0x7efd580b3c20 msgr2=0x7efd580b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 --2- 172.21.15.37:0/3337626874 >> v2:172.21.15.119:3300/0 conn(0x7efd580b3c20 0x7efd580b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 -- 172.21.15.37:0/3337626874 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58160570 con 0x7efd580ceb80 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5d487640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580ceb80 0x7efd580cef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd5808ad30 tx=0x7efd4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06c658cf7504a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5cc86640 1 -- 172.21.15.37:0/3337626874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480ab600 con 0x7efd580ceb80 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5cc86640 1 -- 172.21.15.37:0/3337626874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480a7050 con 0x7efd580ceb80 2023-07-09T21:22:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.738+0000 7efd5cc86640 1 -- 172.21.15.37:0/3337626874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480ab980 con 0x7efd580ceb80 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- 172.21.15.37:0/3337626874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580ceb80 msgr2=0x7efd580cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580ceb80 0x7efd580cef90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efd5808ad30 tx=0x7efd4801c500 comp rx=0 tx=0).stop 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- 172.21.15.37:0/3337626874 shutdown_connections 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580ceb80 0x7efd580cef90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- 172.21.15.37:0/3337626874 >> v2:172.21.15.119:3300/0 conn(0x7efd580b3c20 0x7efd580b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- 172.21.15.37:0/3337626874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b7980 0x7efd58160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- 172.21.15.37:0/3337626874 >> 172.21.15.37:0/3337626874 conn(0x7efd58073090 msgr2=0x7efd58069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- 172.21.15.37:0/3337626874 shutdown_connections 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- 172.21.15.37:0/3337626874 wait complete. 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 Processor -- start 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- start start 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b3c20 0x7efd581598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd580ceb80 0x7efd5815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd58151070 con 0x7efd580b7980 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd580b7180 con 0x7efd580ceb80 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5feec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd580cc5b0 con 0x7efd580b3c20 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5d487640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5d487640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50924/0 (socket says 172.21.15.37:50924) 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5d487640 1 -- 172.21.15.37:0/2494284511 learned_addr learned my addr 172.21.15.37:0/2494284511 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5dc88640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b3c20 0x7efd581598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.742+0000 7efd5e489640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd580ceb80 0x7efd5815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 -- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b3c20 msgr2=0x7efd581598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b3c20 0x7efd581598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 -- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd580ceb80 msgr2=0x7efd5815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd580ceb80 0x7efd5815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 -- 172.21.15.37:0/2494284511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480094d0 con 0x7efd580b7980 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5d487640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd480ae040 tx=0x7efd480192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480b6620 con 0x7efd580b7980 2023-07-09T21:22:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd480b6780 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd580b6bc0 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd480b6b10 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd580cc1f0 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd581511b0 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd480b2040 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 0x7efd3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.746+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd4811dbd0 con 0x7efd580b7980 2023-07-09T21:22:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.750+0000 7efd5dc88640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 0x7efd3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.750+0000 7efd5dc88640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 0x7efd3c068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd580cbfb0 tx=0x7efd54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.750+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efd581511b0 con 0x7efd580b7980 2023-07-09T21:22:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:23.906+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7efd580737d0 con 0x7efd580b7980 2023-07-09T21:22:24.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.778+0000 7efd4e7fc640 1 -- 172.21.15.37:0/2494284511 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7efd580737d0 con 0x7efd580b7980 2023-07-09T21:22:24.786 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2023-07-09T21:22:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 msgr2=0x7efd3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 0x7efd3c068730 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd580cbfb0 tx=0x7efd54008040 comp rx=0 tx=0).stop 2023-07-09T21:22:24.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 msgr2=0x7efd581505a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7efd480ae040 tx=0x7efd480192a0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 shutdown_connections 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd3c066280 0x7efd3c068730 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd580ceb80 0x7efd5815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd580b7980 0x7efd581505a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 --2- 172.21.15.37:0/2494284511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd580b3c20 0x7efd581598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 >> 172.21.15.37:0/2494284511 conn(0x7efd58073090 msgr2=0x7efd5815f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 shutdown_connections 2023-07-09T21:22:24.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.782+0000 7efd5feec640 1 -- 172.21.15.37:0/2494284511 wait complete. 2023-07-09T21:22:24.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-07-09T21:22:24.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 Processor -- start 2023-07-09T21:22:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 -- start start 2023-07-09T21:22:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680c9090 con 0x7f7e680c4350 2023-07-09T21:22:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680c47f0 con 0x7f7e681585b0 2023-07-09T21:22:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.954+0000 7f7e6ea56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680cbf40 con 0x7f7e6806b970 2023-07-09T21:22:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50930/0 (socket says 172.21.15.37:50930) 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 -- 172.21.15.37:0/1615969581 learned_addr learned my addr 172.21.15.37:0/1615969581 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e677fe640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 -- 172.21.15.37:0/1615969581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 msgr2=0x7f7e680c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 -- 172.21.15.37:0/1615969581 >> v1:172.21.15.119:6789/0 conn(0x7f7e680c4350 legacy=0x7f7e6815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 -- 172.21.15.37:0/1615969581 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680c8a60 con 0x7f7e681585b0 2023-07-09T21:22:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e677fe640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e67fff640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806b430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e580098a0 tx=0x7f7e5801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b2c62157127c32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e66ffd640 1 -- 172.21.15.37:0/1615969581 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580aa650 con 0x7f7e681585b0 2023-07-09T21:22:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e66ffd640 1 -- 172.21.15.37:0/1615969581 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580aa7b0 con 0x7f7e681585b0 2023-07-09T21:22:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.958+0000 7f7e66ffd640 1 -- 172.21.15.37:0/1615969581 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580aab40 con 0x7f7e681585b0 2023-07-09T21:22:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- 172.21.15.37:0/1615969581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 msgr2=0x7f7e6806b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806b430 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7e580098a0 tx=0x7f7e5801c4f0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- 172.21.15.37:0/1615969581 shutdown_connections 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/1615969581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- 172.21.15.37:0/1615969581 >> 172.21.15.37:0/1615969581 conn(0x7f7e680cde40 msgr2=0x7f7e680ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- 172.21.15.37:0/1615969581 shutdown_connections 2023-07-09T21:22:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- 172.21.15.37:0/1615969581 wait complete. 2023-07-09T21:22:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 Processor -- start 2023-07-09T21:22:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- start start 2023-07-09T21:22:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e681585b0 0x7f7e681463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6815a1c0 con 0x7f7e680c4350 2023-07-09T21:22:24.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68144cf0 con 0x7f7e6806b970 2023-07-09T21:22:24.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6ea56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68144fd0 con 0x7f7e681585b0 2023-07-09T21:22:24.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:24.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50944/0 (socket says 172.21.15.37:50944) 2023-07-09T21:22:24.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 -- 172.21.15.37:0/2905168769 learned_addr learned my addr 172.21.15.37:0/2905168769 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:24.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e6cff3640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e681585b0 0x7f7e681463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:24.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 -- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e681585b0 msgr2=0x7f7e681463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e681585b0 0x7f7e681463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 -- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 msgr2=0x7f7e68159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:24.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.962+0000 7f7e677fe640 1 -- 172.21.15.37:0/2905168769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580094d0 con 0x7f7e680c4350 2023-07-09T21:22:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e677fe640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e810 tx=0x7f7e5c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00c8d0 con 0x7f7e680c4350 2023-07-09T21:22:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00ca30 con 0x7f7e680c4350 2023-07-09T21:22:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00cde0 con 0x7f7e680c4350 2023-07-09T21:22:24.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e681452b0 con 0x7f7e680c4350 2023-07-09T21:22:24.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68145870 con 0x7f7e680c4350 2023-07-09T21:22:24.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e68158180 con 0x7f7e680c4350 2023-07-09T21:22:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e5c013410 con 0x7f7e680c4350 2023-07-09T21:22:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 0x7f7e54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f7e5c083860 con 0x7f7e680c4350 2023-07-09T21:22:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.966+0000 7f7e67fff640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 0x7f7e54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.970+0000 7f7e67fff640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 0x7f7e54068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e58008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:24.970+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e5c051030 con 0x7f7e680c4350 2023-07-09T21:22:25.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.130+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e6804d7d0 con 0x7f7e680c4350 2023-07-09T21:22:25.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.778+0000 7f7e64ff9640 1 -- 172.21.15.37:0/2905168769 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7e5c054650 con 0x7f7e680c4350 2023-07-09T21:22:25.785 INFO:teuthology.orchestra.run.smithi037.stderr:enabled application 'rbd' on pool 'rbd' 2023-07-09T21:22:25.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 msgr2=0x7f7e54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 0x7f7e54068730 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e58008040 comp rx=0 tx=0).stop 2023-07-09T21:22:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 msgr2=0x7f7e68143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e810 tx=0x7f7e5c00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 shutdown_connections 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e54066280 0x7f7e54068730 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e681585b0 0x7f7e681463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e680c4350 0x7f7e68143fe0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 --2- 172.21.15.37:0/2905168769 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 >> 172.21.15.37:0/2905168769 conn(0x7f7e680cde40 msgr2=0x7f7e680ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 shutdown_connections 2023-07-09T21:22:25.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.782+0000 7f7e6ea56640 1 -- 172.21.15.37:0/2905168769 wait complete. 2023-07-09T21:22:25.811 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-07-09T21:22:25.811 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:22:25.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:22:25.816 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:22:25.816 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:22:25.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:22:25.821 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:22:25.821 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:22:25.821 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:22:25.825 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:22:25.825 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:22:25.825 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:22:25.828 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:22:25.829 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-07-09T21:22:25.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:25.919 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:22:25.920 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:22:25.933 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:22:25.935 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:22:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 Processor -- start 2023-07-09T21:22:25.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 -- start start 2023-07-09T21:22:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4d40b7ab0 0x7fb4d406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:25.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40b49f0 con 0x7fb4d40cef80 2023-07-09T21:22:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d40cc8a0 con 0x7fb4d40b4340 2023-07-09T21:22:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4db407640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40b7e80 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4d40b7ab0 0x7fb4d406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4d40b7ab0 0x7fb4d406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50992/0 (socket says 172.21.15.37:50992) 2023-07-09T21:22:25.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 -- 172.21.15.37:0/1520181837 learned_addr learned my addr 172.21.15.37:0/1520181837 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 -- 172.21.15.37:0/1520181837 >> v1:172.21.15.119:6789/0 conn(0x7fb4d40b4340 legacy=0x7fb4d40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 -- 172.21.15.37:0/1520181837 >> v1:172.21.15.37:6789/0 conn(0x7fb4d40cef80 legacy=0x7fb4d40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.978+0000 7fb4d91a3640 1 -- 172.21.15.37:0/1520181837 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40ccb80 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4d91a3640 1 --2- 172.21.15.37:0/1520181837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b7ab0 0x7fb4d406aa50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0492eb2e80fdac2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4cbfff640 1 -- 172.21.15.37:0/1520181837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00aa430 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4cbfff640 1 -- 172.21.15.37:0/1520181837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00aa590 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4cbfff640 1 -- 172.21.15.37:0/1520181837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00aa920 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 -- 172.21.15.37:0/1520181837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b7ab0 msgr2=0x7fb4d406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 --2- 172.21.15.37:0/1520181837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b7ab0 0x7fb4d406aa50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009870 tx=0x7fb4d001c4d0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 -- 172.21.15.37:0/1520181837 shutdown_connections 2023-07-09T21:22:25.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 --2- 172.21.15.37:0/1520181837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b7ab0 0x7fb4d406aa50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 -- 172.21.15.37:0/1520181837 >> 172.21.15.37:0/1520181837 conn(0x7fb4d4073090 msgr2=0x7fb4d4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 -- 172.21.15.37:0/1520181837 shutdown_connections 2023-07-09T21:22:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.982+0000 7fb4db407640 1 -- 172.21.15.37:0/1520181837 wait complete. 2023-07-09T21:22:25.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 Processor -- start 2023-07-09T21:22:25.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 -- start start 2023-07-09T21:22:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4d40b7ab0 0x7fb4d414f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4d40cef80 0x7fb4d40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c9ca0 con 0x7fb4d40b4340 2023-07-09T21:22:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c8b40 con 0x7fb4d40cef80 2023-07-09T21:22:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c93b0 con 0x7fb4d40b7ab0 2023-07-09T21:22:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51006/0 (socket says 172.21.15.37:51006) 2023-07-09T21:22:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 -- 172.21.15.37:0/2497411760 learned_addr learned my addr 172.21.15.37:0/2497411760 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:25.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d99a4640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4d40cef80 0x7fb4d40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d89a2640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4d40b7ab0 0x7fb4d414f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 -- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4d40b7ab0 msgr2=0x7fb4d414f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4d40b7ab0 0x7fb4d414f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 -- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4d40cef80 msgr2=0x7fb4d40c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4d40cef80 0x7fb4d40c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 -- 172.21.15.37:0/2497411760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00094d0 con 0x7fb4d40b4340 2023-07-09T21:22:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4d91a3640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00ac040 tx=0x7fb4d001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00b38c0 con 0x7fb4d40b4340 2023-07-09T21:22:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00b3a40 con 0x7fb4d40b4340 2023-07-09T21:22:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00b3df0 con 0x7fb4d40b4340 2023-07-09T21:22:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.986+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d40c9650 con 0x7fb4d40b4340 2023-07-09T21:22:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d414fb50 con 0x7fb4d40b4340 2023-07-09T21:22:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d404d7d0 con 0x7fb4d40b4340 2023-07-09T21:22:25.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb4d00c6440 con 0x7fb4d40b4340 2023-07-09T21:22:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4c9ffb640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 0x7fb4b8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb4d011e5e0 con 0x7fb4d40b4340 2023-07-09T21:22:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4d89a2640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 0x7fb4b8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.990+0000 7fb4d89a2640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 0x7fb4b8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4154b30 tx=0x7fb4c4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:25.994+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4d00ebe50 con 0x7fb4d40b4340 2023-07-09T21:22:26.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.150+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4d404d7d0 con 0x7fb4d40b4340 2023-07-09T21:22:26.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.150+0000 7fb4c9ffb640 1 -- 172.21.15.37:0/2497411760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fb4d00ef470 con 0x7fb4d40b4340 2023-07-09T21:22:26.156 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:26.156 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:25.780371+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 msgr2=0x7fb4b8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 0x7fb4b8068730 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4154b30 tx=0x7fb4c4009040 comp rx=0 tx=0).stop 2023-07-09T21:22:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 msgr2=0x7fb4d41506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00ac040 tx=0x7fb4d001ad10 comp rx=0 tx=0).stop 2023-07-09T21:22:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 shutdown_connections 2023-07-09T21:22:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb4b8066280 0x7fb4b8068730 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4d40cef80 0x7fb4d40c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4d40b7ab0 0x7fb4d414f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 --2- 172.21.15.37:0/2497411760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4d40b4340 0x7fb4d41506a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 >> 172.21.15.37:0/2497411760 conn(0x7fb4d4073090 msgr2=0x7fb4d40d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 shutdown_connections 2023-07-09T21:22:26.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.154+0000 7fb4db407640 1 -- 172.21.15.37:0/2497411760 wait complete. 2023-07-09T21:22:26.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:26.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 Processor -- start 2023-07-09T21:22:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 -- start start 2023-07-09T21:22:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b7980 0x7fe1fc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1fc0ceb80 0x7fe1fc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc15bf80 con 0x7fe1fc0b3c20 2023-07-09T21:22:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc0cd070 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe200dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0cfd70 con 0x7fe1fc0b7980 2023-07-09T21:22:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1fc0ceb80 0x7fe1fc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1fad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe1fc0b3c20 0x7fe1fc0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34252/0 (socket says 172.21.15.37:34252) 2023-07-09T21:22:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1fad9d640 1 -- 172.21.15.37:0/2384315854 learned_addr learned my addr 172.21.15.37:0/2384315854 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1fa59c640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b7980 0x7fe1fc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2384315854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b7980 msgr2=0x7fe1fc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f3fff640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b7980 0x7fe1fc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2384315854 >> v1:172.21.15.37:6789/0 conn(0x7fe1fc0b3c20 legacy=0x7fe1fc0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f9d9b640 1 -- 172.21.15.37:0/2384315854 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971980956 0 0) 0x7fe1f40014a0 con 0x7fe1fc0b3c20 2023-07-09T21:22:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.318+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2384315854 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc160570 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe1f3fff640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc0cef90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40097c0 tx=0x7fe1e401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93f0b5e4f0d7006 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe1f9d9b640 1 -- 172.21.15.37:0/2384315854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40ab600 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe1f9d9b640 1 -- 172.21.15.37:0/2384315854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e40a7050 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe1f9d9b640 1 -- 172.21.15.37:0/2384315854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40ab980 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 -- 172.21.15.37:0/2384315854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0ceb80 msgr2=0x7fe1fc0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc0cef90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40097c0 tx=0x7fe1e401c480 comp rx=0 tx=0).stop 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 -- 172.21.15.37:0/2384315854 shutdown_connections 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc0cef90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2384315854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b7980 0x7fe1fc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 -- 172.21.15.37:0/2384315854 >> 172.21.15.37:0/2384315854 conn(0x7fe1fc073090 msgr2=0x7fe1fc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 -- 172.21.15.37:0/2384315854 shutdown_connections 2023-07-09T21:22:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.322+0000 7fe200dfa640 1 -- 172.21.15.37:0/2384315854 wait complete. 2023-07-09T21:22:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 Processor -- start 2023-07-09T21:22:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- start start 2023-07-09T21:22:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 0x7fe1fc152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15bcf0 con 0x7fe1fc0b7980 2023-07-09T21:22:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15d320 con 0x7fe1fc0ceb80 2023-07-09T21:22:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15ba10 con 0x7fe1fc0b3c20 2023-07-09T21:22:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51022/0 (socket says 172.21.15.37:51022) 2023-07-09T21:22:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2847444427 learned_addr learned my addr 172.21.15.37:0/2847444427 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1fad9d640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1fa59c640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 0x7fe1fc152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 msgr2=0x7fe1fc152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 0x7fe1fc152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 msgr2=0x7fe1fc1534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc1534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 -- 172.21.15.37:0/2847444427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e4009420 con 0x7fe1fc0b7980 2023-07-09T21:22:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1fa59c640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 0x7fe1fc152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:26.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1fad9d640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:26.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f3fff640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1e401a0b0 tx=0x7fe1e4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40b4810 con 0x7fe1fc0b7980 2023-07-09T21:22:26.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e40b4990 con 0x7fe1fc0b7980 2023-07-09T21:22:26.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40b4d40 con 0x7fe1fc0b7980 2023-07-09T21:22:26.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc15ccd0 con 0x7fe1fc0b7980 2023-07-09T21:22:26.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.326+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc15b6e0 con 0x7fe1fc0b7980 2023-07-09T21:22:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc15cb30 con 0x7fe1fc0b7980 2023-07-09T21:22:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1e40b2040 con 0x7fe1fc0b7980 2023-07-09T21:22:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe1f2ffd640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 0x7fe1dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe1e411dc10 con 0x7fe1fc0b7980 2023-07-09T21:22:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe1fa59c640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 0x7fe1dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.330+0000 7fe1fa59c640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 0x7fe1dc068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009bb0 tx=0x7fe1ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.334+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1fc15cb30 con 0x7fe1fc0b7980 2023-07-09T21:22:26.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1fc160570 con 0x7fe1fc0b7980 2023-07-09T21:22:26.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe1f2ffd640 1 -- 172.21.15.37:0/2847444427 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1fc160570 con 0x7fe1fc0b7980 2023-07-09T21:22:26.495 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 msgr2=0x7fe1dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 0x7fe1dc068730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec009bb0 tx=0x7fe1ec008040 comp rx=0 tx=0).stop 2023-07-09T21:22:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 msgr2=0x7fe1fc152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe1e401a0b0 tx=0x7fe1e4019220 comp rx=0 tx=0).stop 2023-07-09T21:22:26.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 shutdown_connections 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe1dc066280 0x7fe1dc068730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1fc0ceb80 0x7fe1fc1534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1fc0b7980 0x7fe1fc152f60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 --2- 172.21.15.37:0/2847444427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1fc0b3c20 0x7fe1fc152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 >> 172.21.15.37:0/2847444427 conn(0x7fe1fc073090 msgr2=0x7fe1fc0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 shutdown_connections 2023-07-09T21:22:26.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.490+0000 7fe200dfa640 1 -- 172.21.15.37:0/2847444427 wait complete. 2023-07-09T21:22:26.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 Processor -- start 2023-07-09T21:22:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 -- start start 2023-07-09T21:22:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 0x7fe4d00b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00cbb00 con 0x7fe4d006cdd0 2023-07-09T21:22:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d00b1290 con 0x7fe4d00ad090 2023-07-09T21:22:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.654+0000 7fe4d687b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00b05a0 con 0x7fe4d00afc90 2023-07-09T21:22:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cf7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4d006cdd0 0x7fe4d006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34266/0 (socket says 172.21.15.37:34266) 2023-07-09T21:22:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cf7fe640 1 -- 172.21.15.37:0/414676794 learned_addr learned my addr 172.21.15.37:0/414676794 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cffff640 1 --2- 172.21.15.37:0/414676794 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 0x7fe4d00b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154537254 0 0) 0x7fe4c4001120 con 0x7fe4d006cdd0 2023-07-09T21:22:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b8003530 con 0x7fe4d006cdd0 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585358606 0 0) 0x7fe4d00b1290 con 0x7fe4d00ad090 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c4001120 con 0x7fe4d00ad090 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 967970001 0 0) 0x7fe4b8003530 con 0x7fe4d006cdd0 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cffff640 1 -- 172.21.15.37:0/414676794 >> v1:172.21.15.119:6789/0 conn(0x7fe4d00ad090 legacy=0x7fe4d00b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cffff640 1 -- 172.21.15.37:0/414676794 >> v1:172.21.15.37:6789/0 conn(0x7fe4d006cdd0 legacy=0x7fe4d006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cffff640 1 -- 172.21.15.37:0/414676794 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d006d340 con 0x7fe4d00afc90 2023-07-09T21:22:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.658+0000 7fe4cffff640 1 --2- 172.21.15.37:0/414676794 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 0x7fe4d00b0060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00097f0 tx=0x7fe4c001c290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64543aab9a60673b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4001810 con 0x7fe4d00afc90 2023-07-09T21:22:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00a7050 con 0x7fe4d00afc90 2023-07-09T21:22:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4ceffd640 1 -- 172.21.15.37:0/414676794 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00ab620 con 0x7fe4d00afc90 2023-07-09T21:22:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- 172.21.15.37:0/414676794 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 msgr2=0x7fe4d00b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 --2- 172.21.15.37:0/414676794 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 0x7fe4d00b0060 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00097f0 tx=0x7fe4c001c290 comp rx=0 tx=0).stop 2023-07-09T21:22:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- 172.21.15.37:0/414676794 shutdown_connections 2023-07-09T21:22:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 --2- 172.21.15.37:0/414676794 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00afc90 0x7fe4d00b0060 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- 172.21.15.37:0/414676794 >> 172.21.15.37:0/414676794 conn(0x7fe4d00694c0 msgr2=0x7fe4d00698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- 172.21.15.37:0/414676794 shutdown_connections 2023-07-09T21:22:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- 172.21.15.37:0/414676794 wait complete. 2023-07-09T21:22:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 Processor -- start 2023-07-09T21:22:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- start start 2023-07-09T21:22:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d006cdd0 0x7fe4d014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00ad090 0x7fe4d015ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d006beb0 con 0x7fe4d00afc90 2023-07-09T21:22:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d015b0a0 con 0x7fe4d00ad090 2023-07-09T21:22:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.662+0000 7fe4d687b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d015cf80 con 0x7fe4d006cdd0 2023-07-09T21:22:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4cf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00ad090 0x7fe4d015ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51036/0 (socket says 172.21.15.37:51036) 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 -- 172.21.15.37:0/69451998 learned_addr learned my addr 172.21.15.37:0/69451998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4cffff640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d006cdd0 0x7fe4d014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 -- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d006cdd0 msgr2=0x7fe4d014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d006cdd0 0x7fe4d014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 -- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00ad090 msgr2=0x7fe4d015ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00ad090 0x7fe4d015ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 -- 172.21.15.37:0/69451998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c0009420 con 0x7fe4d00afc90 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d4e18640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c730 tx=0x7fe4c800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003b80 con 0x7fe4d00afc90 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c8003ce0 con 0x7fe4d00afc90 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d015d260 con 0x7fe4d00afc90 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800aa90 con 0x7fe4d00afc90 2023-07-09T21:22:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d015d820 con 0x7fe4d00afc90 2023-07-09T21:22:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d015da40 con 0x7fe4d00afc90 2023-07-09T21:22:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4c800abf0 con 0x7fe4d00afc90 2023-07-09T21:22:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.666+0000 7fe4ccff9640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.670+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe4c8083770 con 0x7fe4d00afc90 2023-07-09T21:22:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.670+0000 7fe4cffff640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.670+0000 7fe4cffff640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 0x7fe4bc068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00ad000 tx=0x7fe4c0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.670+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4c8050f50 con 0x7fe4d00afc90 2023-07-09T21:22:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.826+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4d004d7d0 con 0x7fe4d00afc90 2023-07-09T21:22:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.826+0000 7fe4ccff9640 1 -- 172.21.15.37:0/69451998 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4c8054570 con 0x7fe4d00afc90 2023-07-09T21:22:26.832 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 msgr2=0x7fe4bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 0x7fe4bc068730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00ad000 tx=0x7fe4c0008040 comp rx=0 tx=0).stop 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 msgr2=0x7fe4d0155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800c730 tx=0x7fe4c800cbf0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 shutdown_connections 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe4bc066280 0x7fe4bc068730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00afc90 0x7fe4d0155bc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00ad090 0x7fe4d015ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 --2- 172.21.15.37:0/69451998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d006cdd0 0x7fe4d014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 >> 172.21.15.37:0/69451998 conn(0x7fe4d00694c0 msgr2=0x7fe4d006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 shutdown_connections 2023-07-09T21:22:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.830+0000 7fe4d687b640 1 -- 172.21.15.37:0/69451998 wait complete. 2023-07-09T21:22:26.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:22:27.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.994+0000 7ff73329e640 1 Processor -- start 2023-07-09T21:22:27.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 -- start start 2023-07-09T21:22:27.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff72c0b7ab0 0x7ff72c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff72c0b4170 0x7ff72c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c0b7e80 con 0x7ff72c0b4170 2023-07-09T21:22:27.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff72c0b4610 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73329e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0b49f0 con 0x7ff72c0cef80 2023-07-09T21:22:27.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff72c0b4170 0x7ff72c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff72c0b4170 0x7ff72c15f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51038/0 (socket says 172.21.15.37:51038) 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 -- 172.21.15.37:0/4119544581 learned_addr learned my addr 172.21.15.37:0/4119544581 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff730839640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73103a640 1 --2- 172.21.15.37:0/4119544581 >> v2:172.21.15.119:3300/0 conn(0x7ff72c0b7ab0 0x7ff72c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 -- 172.21.15.37:0/4119544581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 msgr2=0x7ff72c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 -- 172.21.15.37:0/4119544581 >> v2:172.21.15.119:3300/0 conn(0x7ff72c0b7ab0 msgr2=0x7ff72c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 --2- 172.21.15.37:0/4119544581 >> v2:172.21.15.119:3300/0 conn(0x7ff72c0b7ab0 0x7ff72c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:26.998+0000 7ff73183b640 1 -- 172.21.15.37:0/4119544581 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c0cc8a0 con 0x7ff72c0b4170 2023-07-09T21:22:27.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73183b640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b4170 0x7ff72c15f490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff72c06b360 tx=0x7ff72401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde3fae38d4d0879 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff723fff640 1 -- 172.21.15.37:0/4119544581 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240a5560 con 0x7ff72c0b4170 2023-07-09T21:22:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff723fff640 1 -- 172.21.15.37:0/4119544581 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7240a56c0 con 0x7ff72c0b4170 2023-07-09T21:22:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff723fff640 1 -- 172.21.15.37:0/4119544581 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240a5a50 con 0x7ff72c0b4170 2023-07-09T21:22:27.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- 172.21.15.37:0/4119544581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b4170 msgr2=0x7ff72c15f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b4170 0x7ff72c15f490 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff72c06b360 tx=0x7ff72401c6e0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- 172.21.15.37:0/4119544581 shutdown_connections 2023-07-09T21:22:27.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b4170 0x7ff72c15f490 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 --2- 172.21.15.37:0/4119544581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 --2- 172.21.15.37:0/4119544581 >> v2:172.21.15.119:3300/0 conn(0x7ff72c0b7ab0 0x7ff72c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- 172.21.15.37:0/4119544581 >> 172.21.15.37:0/4119544581 conn(0x7ff72c073090 msgr2=0x7ff72c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- 172.21.15.37:0/4119544581 shutdown_connections 2023-07-09T21:22:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- 172.21.15.37:0/4119544581 wait complete. 2023-07-09T21:22:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 Processor -- start 2023-07-09T21:22:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.002+0000 7ff73329e640 1 -- start start 2023-07-09T21:22:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff72c0b4170 0x7ff72c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0ca260 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cb190 con 0x7ff72c0b4170 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72c0cb470 con 0x7ff72c0cef80 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51052/0 (socket says 172.21.15.37:51052) 2023-07-09T21:22:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 -- 172.21.15.37:0/2960232303 learned_addr learned my addr 172.21.15.37:0/2960232303 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73103a640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff72c0b4170 0x7ff72c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73183b640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 -- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 msgr2=0x7ff72c156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 -- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff72c0b4170 msgr2=0x7ff72c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff72c0b4170 0x7ff72c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 -- 172.21.15.37:0/2960232303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724009b30 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73183b640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff730839640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e840 tx=0x7ff71c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c009510 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00ee90 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c00cb60 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72c0cb750 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72c0cbd10 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.006+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72c04d7d0 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.010+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff71c00ccc0 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.010+0000 7ff721ffb640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 0x7ff710068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.010+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff71c083980 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.010+0000 7ff73103a640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 0x7ff710068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.010+0000 7ff73103a640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 0x7ff710068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff728009b60 tx=0x7ff728009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.014+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff71c054c80 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff72c0ce810 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff721ffb640 1 -- 172.21.15.37:0/2960232303 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7ff71c021de0 con 0x7ff72c0b7ab0 2023-07-09T21:22:27.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:27.203 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-07-09T21:22:27.204 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 msgr2=0x7ff710068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 0x7ff710068730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff728009b60 tx=0x7ff728009190 comp rx=0 tx=0).stop 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 msgr2=0x7ff72c0c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00e840 tx=0x7ff71c00ec40 comp rx=0 tx=0).stop 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 shutdown_connections 2023-07-09T21:22:27.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff710066280 0x7ff710068730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff72c0cef80 0x7ff72c156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff72c0b7ab0 0x7ff72c0c9d20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 --2- 172.21.15.37:0/2960232303 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff72c0b4170 0x7ff72c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 >> 172.21.15.37:0/2960232303 conn(0x7ff72c073090 msgr2=0x7ff72c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 shutdown_connections 2023-07-09T21:22:27.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.198+0000 7ff73329e640 1 -- 172.21.15.37:0/2960232303 wait complete. 2023-07-09T21:22:27.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 Processor -- start 2023-07-09T21:22:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 -- start start 2023-07-09T21:22:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 0x7f00dc0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc06acb0 con 0x7f00dc15ba60 2023-07-09T21:22:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc0cf4d0 con 0x7f00dc0cc800 2023-07-09T21:22:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e466d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0ccc90 con 0x7f00dc0cf090 2023-07-09T21:22:27.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e1c08640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 0x7f00dc0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2c0a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2409640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f00dc15ba60 0x7f00dc1600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:52698/0 (socket says 172.21.15.37:52698) 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2409640 1 -- 172.21.15.37:0/2805668580 learned_addr learned my addr 172.21.15.37:0/2805668580 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2c0a640 1 -- 172.21.15.37:0/2805668580 >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 msgr2=0x7f00dc0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2c0a640 1 --2- 172.21.15.37:0/2805668580 >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 0x7f00dc0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2c0a640 1 -- 172.21.15.37:0/2805668580 >> v1:172.21.15.119:6789/0 conn(0x7f00dc15ba60 legacy=0x7f00dc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e1407640 1 -- 172.21.15.37:0/2805668580 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060777974 0 0) 0x7f00dc06acb0 con 0x7f00dc15ba60 2023-07-09T21:22:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e2c0a640 1 -- 172.21.15.37:0/2805668580 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0cfe20 con 0x7f00dc0cf090 2023-07-09T21:22:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.362+0000 7f00e1c08640 1 --2- 172.21.15.37:0/2805668580 >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 0x7f00dc0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e2c0a640 1 --2- 172.21.15.37:0/2805668580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0d0900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009d90 tx=0x7f00d401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be0a30b225e727c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e1407640 1 -- 172.21.15.37:0/2805668580 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40a59e0 con 0x7f00dc0cf090 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e1407640 1 -- 172.21.15.37:0/2805668580 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d40a5b40 con 0x7f00dc0cf090 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e1407640 1 -- 172.21.15.37:0/2805668580 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40ad440 con 0x7f00dc0cf090 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 -- 172.21.15.37:0/2805668580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 msgr2=0x7f00dc0d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 --2- 172.21.15.37:0/2805668580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0d0900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009d90 tx=0x7f00d401c920 comp rx=0 tx=0).stop 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 -- 172.21.15.37:0/2805668580 shutdown_connections 2023-07-09T21:22:27.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 --2- 172.21.15.37:0/2805668580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0d0900 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 --2- 172.21.15.37:0/2805668580 >> v2:172.21.15.119:3300/0 conn(0x7f00dc0cc800 0x7f00dc0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 -- 172.21.15.37:0/2805668580 >> 172.21.15.37:0/2805668580 conn(0x7f00dc073090 msgr2=0x7f00dc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 -- 172.21.15.37:0/2805668580 shutdown_connections 2023-07-09T21:22:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.366+0000 7f00e466d640 1 -- 172.21.15.37:0/2805668580 wait complete. 2023-07-09T21:22:27.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 Processor -- start 2023-07-09T21:22:27.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 -- start start 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00dc0cc800 0x7f00dc0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc14c150 con 0x7f00dc15ba60 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0b3e90 con 0x7f00dc0cc800 2023-07-09T21:22:27.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e466d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0b3280 con 0x7f00dc0cf090 2023-07-09T21:22:27.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48270/0 (socket says 172.21.15.37:48270) 2023-07-09T21:22:27.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 -- 172.21.15.37:0/111073898 learned_addr learned my addr 172.21.15.37:0/111073898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:27.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2409640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00dc0cc800 0x7f00dc0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e1c08640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 -- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 msgr2=0x7f00dc0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 -- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00dc0cc800 msgr2=0x7f00dc0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00dc0cc800 0x7f00dc0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 -- 172.21.15.37:0/111073898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00cc009420 con 0x7f00dc15ba60 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.370+0000 7f00e2c0a640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00d401a550 tx=0x7f00d40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40aed80 con 0x7f00dc15ba60 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d4009450 con 0x7f00dc15ba60 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40b7610 con 0x7f00dc15ba60 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d4009a70 con 0x7f00dc15ba60 2023-07-09T21:22:27.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc0b3840 con 0x7f00dc15ba60 2023-07-09T21:22:27.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc0b4040 con 0x7f00dc15ba60 2023-07-09T21:22:27.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00d40b4050 con 0x7f00dc15ba60 2023-07-09T21:22:27.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 0x7f00c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f00d411ea80 con 0x7f00dc15ba60 2023-07-09T21:22:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.374+0000 7f00e2409640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 0x7f00c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.378+0000 7f00e2409640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 0x7f00c0068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00d8007fd0 tx=0x7f00d8007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.378+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00dc0b4040 con 0x7f00dc15ba60 2023-07-09T21:22:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.534+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00dc0b4000 con 0x7f00dc15ba60 2023-07-09T21:22:27.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.534+0000 7f00d2ffd640 1 -- 172.21.15.37:0/111073898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14624 (secure 0 0 0) 0x7f00d40c6090 con 0x7f00dc15ba60 2023-07-09T21:22:27.540 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:27.541 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:26.789677+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 msgr2=0x7f00c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 0x7f00c0068760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00d8007fd0 tx=0x7f00d8007d60 comp rx=0 tx=0).stop 2023-07-09T21:22:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 msgr2=0x7f00dc14f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f00d401a550 tx=0x7f00d40196c0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 shutdown_connections 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f00c00662b0 0x7f00c0068760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00dc15ba60 0x7f00dc14f860 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00dc0cf090 0x7f00dc0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 --2- 172.21.15.37:0/111073898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00dc0cc800 0x7f00dc0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 >> 172.21.15.37:0/111073898 conn(0x7f00dc073090 msgr2=0x7f00dc0b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 shutdown_connections 2023-07-09T21:22:27.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.538+0000 7f00e466d640 1 -- 172.21.15.37:0/111073898 wait complete. 2023-07-09T21:22:27.561 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:27.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 Processor -- start 2023-07-09T21:22:27.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 -- start start 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e8c0b76b0 0x7f7e8c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e8c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8c0b3bb0 con 0x7f7e8c15f130 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e8c0cccb0 con 0x7f7e8c0b76b0 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e917e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0d07a0 con 0x7f7e8c0d0360 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e8c15f130 0x7f7e8c0b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41798/0 (socket says 172.21.15.37:41798) 2023-07-09T21:22:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8affd640 1 -- 172.21.15.37:0/3363680976 learned_addr learned my addr 172.21.15.37:0/3363680976 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407428067 0 0) 0x7f7e8c0b3bb0 con 0x7f7e8c15f130 2023-07-09T21:22:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e78003530 con 0x7f7e8c15f130 2023-07-09T21:22:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e83fff640 1 --2- 172.21.15.37:0/3363680976 >> v2:172.21.15.119:3300/0 conn(0x7f7e8c0b76b0 0x7f7e8c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e8c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 560567997 0 0) 0x7f7e78003530 con 0x7f7e8c15f130 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 msgr2=0x7f7e8c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e8c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 >> v2:172.21.15.119:3300/0 conn(0x7f7e8c0b76b0 msgr2=0x7f7e8c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 --2- 172.21.15.37:0/3363680976 >> v2:172.21.15.119:3300/0 conn(0x7f7e8c0b76b0 0x7f7e8c0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0b8100 con 0x7f7e8c15f130 2023-07-09T21:22:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7e7c0016a0 con 0x7f7e8c15f130 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 >> v1:172.21.15.37:6789/0 conn(0x7f7e8c15f130 legacy=0x7f7e8c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e78003980 0x7f7e78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.702+0000 7f7e8a7fc640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e78005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0cccb0 con 0x7f7e78004d10 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0d07a0 con 0x7f7e78003980 2023-07-09T21:22:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7800b990 con 0x7f7e8c0d0360 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e78005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e83fff640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8affd640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e78003980 0x7f7e78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 -- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 msgr2=0x7f7e780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c0d0360 0x7f7e780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 -- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e78003980 msgr2=0x7f7e78003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e78003980 0x7f7e78003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 -- 172.21.15.37:0/3363680976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e78003530 con 0x7f7e78004d10 2023-07-09T21:22:27.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e78005180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009fc0 tx=0x7f7e8401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b2a50bf819878a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840a5c70 con 0x7f7e78004d10 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8400f040 con 0x7f7e78004d10 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.706+0000 7f7e8a7fc640 1 -- 172.21.15.37:0/3363680976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e840ad440 con 0x7f7e78004d10 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- 172.21.15.37:0/3363680976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 msgr2=0x7f7e78005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 --2- 172.21.15.37:0/3363680976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e78005180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009fc0 tx=0x7f7e8401cc60 comp rx=0 tx=0).stop 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8b7fe640 1 -- 172.21.15.37:0/3363680976 reap_dead start 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- 172.21.15.37:0/3363680976 shutdown_connections 2023-07-09T21:22:27.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- 172.21.15.37:0/3363680976 >> 172.21.15.37:0/3363680976 conn(0x7f7e8c072d20 msgr2=0x7f7e8c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- 172.21.15.37:0/3363680976 shutdown_connections 2023-07-09T21:22:27.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- 172.21.15.37:0/3363680976 wait complete. 2023-07-09T21:22:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 Processor -- start 2023-07-09T21:22:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- start start 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c09ccf0 0x7f7e8c09d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 0x7f7e8c15d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c15d6d0 con 0x7f7e78004d10 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0c6b70 con 0x7f7e8c15cd20 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e917e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e8c0c7070 con 0x7f7e8c09ccf0 2023-07-09T21:22:27.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48288/0 (socket says 172.21.15.37:48288) 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 -- 172.21.15.37:0/1308596102 learned_addr learned my addr 172.21.15.37:0/1308596102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 0x7f7e8c15d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 -- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c09ccf0 msgr2=0x7f7e8c09d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c09ccf0 0x7f7e8c09d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 -- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 msgr2=0x7f7e8c15d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 0x7f7e8c15d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8affd640 1 -- 172.21.15.37:0/1308596102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e8c0c7350 con 0x7f7e78004d10 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.710+0000 7f7e8b7fe640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 0x7f7e8c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e8affd640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005870 tx=0x7f7e7c0126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c014750 con 0x7f7e78004d10 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0148d0 con 0x7f7e78004d10 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c014c80 con 0x7f7e78004d10 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e8c0c7630 con 0x7f7e78004d10 2023-07-09T21:22:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8c0b4120 con 0x7f7e78004d10 2023-07-09T21:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e8c0668f0 con 0x7f7e78004d10 2023-07-09T21:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e7c0153e0 con 0x7f7e78004d10 2023-07-09T21:22:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 0x7f7e6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7e7c086210 con 0x7f7e78004d10 2023-07-09T21:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.714+0000 7f7e83fff640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 0x7f7e6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.718+0000 7f7e83fff640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 0x7f7e6c068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e74006e90 tx=0x7f7e74006e00 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.718+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e7c053950 con 0x7f7e78004d10 2023-07-09T21:22:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e8c0cc680 con 0x7f7e78004d10 2023-07-09T21:22:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e837fe640 1 -- 172.21.15.37:0/1308596102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e7c01c0a0 con 0x7f7e78004d10 2023-07-09T21:22:27.879 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 msgr2=0x7f7e6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 0x7f7e6c068730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e74006e90 tx=0x7f7e74006e00 comp rx=0 tx=0).stop 2023-07-09T21:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 msgr2=0x7f7e8c0b3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c005870 tx=0x7f7e7c0126f0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 shutdown_connections 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e6c066280 0x7f7e6c068730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e8c15cd20 0x7f7e8c15d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e8c09ccf0 0x7f7e8c09d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 --2- 172.21.15.37:0/1308596102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e78004d10 0x7f7e8c0b3be0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 >> 172.21.15.37:0/1308596102 conn(0x7f7e8c072d20 msgr2=0x7f7e8c0d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 shutdown_connections 2023-07-09T21:22:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:27.874+0000 7f7e917e9640 1 -- 172.21.15.37:0/1308596102 wait complete. 2023-07-09T21:22:27.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:22:27.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:22:27.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.130+0000 7f634af82640 1 Processor -- start 2023-07-09T21:22:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.130+0000 7f634af82640 1 -- start start 2023-07-09T21:22:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634af82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634af82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f63440d0780 0x7f63440d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634af82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634415bf80 con 0x7f63440ceb80 2023-07-09T21:22:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634af82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440cd070 con 0x7f63440d0780 2023-07-09T21:22:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634af82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440cfd70 con 0x7f63440b7980 2023-07-09T21:22:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f6348d1e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634951f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f63440d0780 0x7f63440d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f6348d1e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:43740/0 (socket says 172.21.15.37:43740) 2023-07-09T21:22:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f6348d1e640 1 -- 172.21.15.37:0/2229219156 learned_addr learned my addr 172.21.15.37:0/2229219156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634951f640 1 -- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 msgr2=0x7f6344160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634951f640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634951f640 1 -- 172.21.15.37:0/2229219156 >> v1:172.21.15.37:6789/0 conn(0x7f63440ceb80 legacy=0x7f63440cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f634951f640 1 -- 172.21.15.37:0/2229219156 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344160570 con 0x7f63440d0780 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f63437fe640 1 -- 172.21.15.37:0/2229219156 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343525998 0 0) 0x7f6330001120 con 0x7f63440ceb80 2023-07-09T21:22:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.134+0000 7f6348d1e640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634951f640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f63440d0c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f633c009d90 tx=0x7f633c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b310257305d7711b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f63437fe640 1 -- 172.21.15.37:0/2229219156 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0a5810 con 0x7f63440d0780 2023-07-09T21:22:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f63437fe640 1 -- 172.21.15.37:0/2229219156 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0a5970 con 0x7f63440d0780 2023-07-09T21:22:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f63437fe640 1 -- 172.21.15.37:0/2229219156 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0a5d00 con 0x7f63440d0780 2023-07-09T21:22:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 msgr2=0x7f63440d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f63440d0c00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f633c009d90 tx=0x7f633c01c950 comp rx=0 tx=0).stop 2023-07-09T21:22:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- 172.21.15.37:0/2229219156 shutdown_connections 2023-07-09T21:22:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f63440d0c00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 --2- 172.21.15.37:0/2229219156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f6344160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- 172.21.15.37:0/2229219156 >> 172.21.15.37:0/2229219156 conn(0x7f6344073090 msgr2=0x7f6344069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- 172.21.15.37:0/2229219156 shutdown_connections 2023-07-09T21:22:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- 172.21.15.37:0/2229219156 wait complete. 2023-07-09T21:22:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 Processor -- start 2023-07-09T21:22:28.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.138+0000 7f634af82640 1 -- start start 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f63440b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f634414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634415ebf0 con 0x7f63440ceb80 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634415eed0 con 0x7f63440d0780 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63441598f0 con 0x7f63440b7980 2023-07-09T21:22:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48300/0 (socket says 172.21.15.37:48300) 2023-07-09T21:22:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 -- 172.21.15.37:0/2221025364 learned_addr learned my addr 172.21.15.37:0/2221025364 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634951f640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f634414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6348d1e640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f63440b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 -- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 msgr2=0x7f63440b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f63440b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 -- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 msgr2=0x7f634414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f634414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 -- 172.21.15.37:0/2221025364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63380094d0 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f6343fff640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f633000c750 tx=0x7f633000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330005270 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300053f0 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000a880 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c009a70 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6344159eb0 con 0x7f63440ceb80 2023-07-09T21:22:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634404d7d0 con 0x7f63440ceb80 2023-07-09T21:22:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.142+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f633000a9e0 con 0x7f63440ceb80 2023-07-09T21:22:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.146+0000 7f63417fa640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 0x7f6328068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.146+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6330082e10 con 0x7f63440ceb80 2023-07-09T21:22:28.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.146+0000 7f6348d1e640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 0x7f6328068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.146+0000 7f6348d1e640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 0x7f6328068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6338006cb0 tx=0x7f6338009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.150+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6330086030 con 0x7f63440ceb80 2023-07-09T21:22:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63440b1600 con 0x7f63440ceb80 2023-07-09T21:22:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f63417fa640 1 -- 172.21.15.37:0/2221025364 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6330017020 con 0x7f63440ceb80 2023-07-09T21:22:28.306 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 msgr2=0x7f6328068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 0x7f6328068730 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6338006cb0 tx=0x7f6338009240 comp rx=0 tx=0).stop 2023-07-09T21:22:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 msgr2=0x7f634415a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f633000c750 tx=0x7f633000cc10 comp rx=0 tx=0).stop 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 shutdown_connections 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6328066280 0x7f6328068730 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63440d0780 0x7f634414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63440ceb80 0x7f634415a3d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 --2- 172.21.15.37:0/2221025364 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63440b7980 0x7f63440b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 >> 172.21.15.37:0/2221025364 conn(0x7f6344073090 msgr2=0x7f634415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 shutdown_connections 2023-07-09T21:22:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.302+0000 7f634af82640 1 -- 172.21.15.37:0/2221025364 wait complete. 2023-07-09T21:22:28.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:22:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 Processor -- start 2023-07-09T21:22:28.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 -- start start 2023-07-09T21:22:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c5c0b7ab0 0x7f9c5c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0b49f0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5c0cc8a0 con 0x7f9c5c0cef80 2023-07-09T21:22:28.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c61d59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5c0b7e80 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9c5c0b4340 0x7f9c5c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41818/0 (socket says 172.21.15.37:41818) 2023-07-09T21:22:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5bfff640 1 -- 172.21.15.37:0/1384674017 learned_addr learned my addr 172.21.15.37:0/1384674017 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5b7fe640 1 --2- 172.21.15.37:0/1384674017 >> v2:172.21.15.119:3300/0 conn(0x7f9c5c0b7ab0 0x7f9c5c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180600625 0 0) 0x7f9c5c0b49f0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c48003530 con 0x7f9c5c0b4340 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079212977 0 0) 0x7f9c5c0cc8a0 con 0x7f9c5c0cef80 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c5c0b49f0 con 0x7f9c5c0cef80 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/1384674017 >> v1:172.21.15.119:6789/0 conn(0x7f9c5c0cef80 legacy=0x7f9c5c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/1384674017 >> v1:172.21.15.37:6789/0 conn(0x7f9c5c0b4340 legacy=0x7f9c5c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.466+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/1384674017 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c0ccb80 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c5b7fe640 1 --2- 172.21.15.37:0/1384674017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0b7ab0 0x7f9c5c06aa50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0097c0 tx=0x7f9c4c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84d94ee99a3629c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0ab650 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c0ab7b0 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c5affd640 1 -- 172.21.15.37:0/1384674017 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0abb40 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 -- 172.21.15.37:0/1384674017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0b7ab0 msgr2=0x7f9c5c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 --2- 172.21.15.37:0/1384674017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0b7ab0 0x7f9c5c06aa50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0097c0 tx=0x7f9c4c01c450 comp rx=0 tx=0).stop 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 -- 172.21.15.37:0/1384674017 shutdown_connections 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 --2- 172.21.15.37:0/1384674017 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0b7ab0 0x7f9c5c06aa50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 -- 172.21.15.37:0/1384674017 >> 172.21.15.37:0/1384674017 conn(0x7f9c5c073090 msgr2=0x7f9c5c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 -- 172.21.15.37:0/1384674017 shutdown_connections 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.470+0000 7f9c61d59640 1 -- 172.21.15.37:0/1384674017 wait complete. 2023-07-09T21:22:28.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 Processor -- start 2023-07-09T21:22:28.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- start start 2023-07-09T21:22:28.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c5c0b7ab0 0x7f9c5c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0cef80 0x7f9c5c14d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0cb870 con 0x7f9c5c0b4340 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c0c5ce0 con 0x7f9c5c0cef80 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5c15f220 con 0x7f9c5c0b7ab0 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48312/0 (socket says 172.21.15.37:48312) 2023-07-09T21:22:28.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/990287735 learned_addr learned my addr 172.21.15.37:0/990287735 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c5c0b7ab0 msgr2=0x7f9c5c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c5c0b7ab0 0x7f9c5c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0cef80 msgr2=0x7f9c5c14d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0cef80 0x7f9c5c14d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 -- 172.21.15.37:0/990287735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4c009420 con 0x7f9c5c0b4340 2023-07-09T21:22:28.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c5b7fe640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ad040 tx=0x7f9c4c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0bf610 con 0x7f9c5c0b4340 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c0bf7b0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0bfb60 con 0x7f9c5c0b4340 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c5c0c8100 con 0x7f9c5c0b4340 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.474+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c5c0c86c0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5c04d7d0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c4c0b5400 con 0x7f9c5c0b4340 2023-07-09T21:22:28.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c58ff9640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 0x7f9c3c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9c4c11e3f0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c53fff640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 0x7f9c3c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.478+0000 7f9c53fff640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 0x7f9c3c068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c440010f0 tx=0x7f9c44007960 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.482+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c4c0ebbc0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.638+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c5c0b6990 con 0x7f9c5c0b4340 2023-07-09T21:22:28.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.638+0000 7f9c58ff9640 1 -- 172.21.15.37:0/990287735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9c4c0ef1e0 con 0x7f9c5c0b4340 2023-07-09T21:22:28.644 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:28.644 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:22:28.644 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:22:28.644 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:22:28.644 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:22:28.645 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:22:28.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 msgr2=0x7f9c3c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 0x7f9c3c068730 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9c440010f0 tx=0x7f9c44007960 comp rx=0 tx=0).stop 2023-07-09T21:22:28.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 msgr2=0x7f9c5c0cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c0ad040 tx=0x7f9c4c01ac90 comp rx=0 tx=0).stop 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 shutdown_connections 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c3c066280 0x7f9c3c068730 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c5c0cef80 0x7f9c5c14d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c5c0b7ab0 0x7f9c5c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 --2- 172.21.15.37:0/990287735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c5c0b4340 0x7f9c5c0cb330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 >> 172.21.15.37:0/990287735 conn(0x7f9c5c073090 msgr2=0x7f9c5c0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 shutdown_connections 2023-07-09T21:22:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.642+0000 7f9c61d59640 1 -- 172.21.15.37:0/990287735 wait complete. 2023-07-09T21:22:28.664 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:22:28.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:22:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 Processor -- start 2023-07-09T21:22:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 -- start start 2023-07-09T21:22:28.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 0x7fc7f8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 0x7fc7f80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f815bf80 con 0x7fc7f80b3c20 2023-07-09T21:22:28.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f80cd070 con 0x7fc7f80b7980 2023-07-09T21:22:28.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7fd72c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cfd70 con 0x7fc7f80ceb80 2023-07-09T21:22:28.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7f77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7f80b3c20 0x7fc7f80b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41834/0 (socket says 172.21.15.37:41834) 2023-07-09T21:22:28.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7f77fe640 1 -- 172.21.15.37:0/604762158 learned_addr learned my addr 172.21.15.37:0/604762158 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/604762158 >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 0x7fc7f8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7effff640 1 --2- 172.21.15.37:0/604762158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 0x7fc7f80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7f67fc640 1 -- 172.21.15.37:0/604762158 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185709566 0 0) 0x7fc7f00014a0 con 0x7fc7f80b3c20 2023-07-09T21:22:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.806+0000 7fc7f67fc640 1 -- 172.21.15.37:0/604762158 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4003530 con 0x7fc7f80b3c20 2023-07-09T21:22:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7effff640 1 -- 172.21.15.37:0/604762158 >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 msgr2=0x7fc7f8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7effff640 1 --2- 172.21.15.37:0/604762158 >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 0x7fc7f8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7effff640 1 -- 172.21.15.37:0/604762158 >> v1:172.21.15.37:6789/0 conn(0x7fc7f80b3c20 legacy=0x7fc7f80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7effff640 1 -- 172.21.15.37:0/604762158 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8160570 con 0x7fc7f80ceb80 2023-07-09T21:22:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/604762158 >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 0x7fc7f8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7effff640 1 --2- 172.21.15.37:0/604762158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 0x7fc7f80cef90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00097c0 tx=0x7fc7e001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c82250ed695c23b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7f67fc640 1 -- 172.21.15.37:0/604762158 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00ab600 con 0x7fc7f80ceb80 2023-07-09T21:22:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7f67fc640 1 -- 172.21.15.37:0/604762158 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e00a7050 con 0x7fc7f80ceb80 2023-07-09T21:22:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7f67fc640 1 -- 172.21.15.37:0/604762158 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00ab980 con 0x7fc7f80ceb80 2023-07-09T21:22:28.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7fd72c640 1 -- 172.21.15.37:0/604762158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 msgr2=0x7fc7f80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.810+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/604762158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 0x7fc7f80cef90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00097c0 tx=0x7fc7e001c480 comp rx=0 tx=0).stop 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/604762158 shutdown_connections 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/604762158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80ceb80 0x7fc7f80cef90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/604762158 >> v2:172.21.15.119:3300/0 conn(0x7fc7f80b7980 0x7fc7f8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/604762158 >> 172.21.15.37:0/604762158 conn(0x7fc7f8073090 msgr2=0x7fc7f8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/604762158 shutdown_connections 2023-07-09T21:22:28.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/604762158 wait complete. 2023-07-09T21:22:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 Processor -- start 2023-07-09T21:22:28.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- start start 2023-07-09T21:22:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80b3c20 0x7fc7f81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f80ceb80 0x7fc7f80c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80c8840 con 0x7fc7f80b7980 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cb080 con 0x7fc7f80ceb80 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7fd72c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80ca7b0 con 0x7fc7f80b3c20 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48328/0 (socket says 172.21.15.37:48328) 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 -- 172.21.15.37:0/910714330 learned_addr learned my addr 172.21.15.37:0/910714330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7f77fe640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f80ceb80 0x7fc7f80c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80b3c20 0x7fc7f81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 -- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80b3c20 msgr2=0x7fc7f81530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80b3c20 0x7fc7f81530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 -- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f80ceb80 msgr2=0x7fc7f80c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:28.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f80ceb80 0x7fc7f80c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:28.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 -- 172.21.15.37:0/910714330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e8009420 con 0x7fc7f80b7980 2023-07-09T21:22:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.814+0000 7fc7effff640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7e001ab30 tx=0x7fc7e0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00b4810 con 0x7fc7f80b7980 2023-07-09T21:22:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e00b4990 con 0x7fc7f80b7980 2023-07-09T21:22:28.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00b4d40 con 0x7fc7f80b7980 2023-07-09T21:22:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e0009420 con 0x7fc7f80b7980 2023-07-09T21:22:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f80caa30 con 0x7fc7f80b7980 2023-07-09T21:22:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f80737d0 con 0x7fc7f80b7980 2023-07-09T21:22:28.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7e00b2040 con 0x7fc7f80b7980 2023-07-09T21:22:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 0x7fc7d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc7e011dc10 con 0x7fc7f80b7980 2023-07-09T21:22:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 0x7fc7d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:28.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.818+0000 7fc7f6ffd640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 0x7fc7d8068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7f81548c0 tx=0x7fc7e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:28.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.822+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7f80737d0 con 0x7fc7f80b7980 2023-07-09T21:22:28.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:28.978+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc7f8160570 con 0x7fc7f80b7980 2023-07-09T21:22:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.806+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/910714330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc7f8160570 con 0x7fc7f80b7980 2023-07-09T21:22:29.813 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:22:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 msgr2=0x7fc7d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.814+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 0x7fc7d8068760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc7f81548c0 tx=0x7fc7e8008040 comp rx=0 tx=0).stop 2023-07-09T21:22:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.814+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 msgr2=0x7fc7f80c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.814+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7e001ab30 tx=0x7fc7e0019220 comp rx=0 tx=0).stop 2023-07-09T21:22:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 shutdown_connections 2023-07-09T21:22:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc7d80662b0 0x7fc7d8068760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7f80ceb80 0x7fc7f80c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b7980 0x7fc7f80c7dc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 --2- 172.21.15.37:0/910714330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7f80b3c20 0x7fc7f81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 >> 172.21.15.37:0/910714330 conn(0x7fc7f8073090 msgr2=0x7fc7f8158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 shutdown_connections 2023-07-09T21:22:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.818+0000 7fc7fd72c640 1 -- 172.21.15.37:0/910714330 wait complete. 2023-07-09T21:22:29.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:22:29.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 Processor -- start 2023-07-09T21:22:29.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 -- start start 2023-07-09T21:22:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb720160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7200ceb80 0x7fb7200cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb72015bf80 con 0x7fb7200b3c20 2023-07-09T21:22:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7200cd070 con 0x7fb7200ceb80 2023-07-09T21:22:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb72871f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7200cfd70 con 0x7fb7200b7980 2023-07-09T21:22:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7200ceb80 0x7fb7200cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7200ceb80 0x7fb7200cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48332/0 (socket says 172.21.15.37:48332) 2023-07-09T21:22:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 -- 172.21.15.37:0/2403703418 learned_addr learned my addr 172.21.15.37:0/2403703418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb7264bb640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb720160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 -- 172.21.15.37:0/2403703418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 msgr2=0x7fb720160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb720160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 -- 172.21.15.37:0/2403703418 >> v1:172.21.15.37:6789/0 conn(0x7fb7200b3c20 legacy=0x7fb7200b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb725cba640 1 -- 172.21.15.37:0/2403703418 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb720160570 con 0x7fb7200ceb80 2023-07-09T21:22:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.994+0000 7fb7254b9640 1 -- 172.21.15.37:0/2403703418 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 491487325 0 0) 0x7fb7180014a0 con 0x7fb7200b3c20 2023-07-09T21:22:30.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb725cba640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200ceb80 0x7fb7200cef90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e883bc2e9fe531 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:30.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb7254b9640 1 -- 172.21.15.37:0/2403703418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100ab600 con 0x7fb7200ceb80 2023-07-09T21:22:30.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb7254b9640 1 -- 172.21.15.37:0/2403703418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7100a7050 con 0x7fb7200ceb80 2023-07-09T21:22:30.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb7254b9640 1 -- 172.21.15.37:0/2403703418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7100ab980 con 0x7fb7200ceb80 2023-07-09T21:22:30.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 -- 172.21.15.37:0/2403703418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200ceb80 msgr2=0x7fb7200cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200ceb80 0x7fb7200cef90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb710009870 tx=0x7fb71001c540 comp rx=0 tx=0).stop 2023-07-09T21:22:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 -- 172.21.15.37:0/2403703418 shutdown_connections 2023-07-09T21:22:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200ceb80 0x7fb7200cef90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 --2- 172.21.15.37:0/2403703418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb720160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 -- 172.21.15.37:0/2403703418 >> 172.21.15.37:0/2403703418 conn(0x7fb720073090 msgr2=0x7fb720069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:30.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 -- 172.21.15.37:0/2403703418 shutdown_connections 2023-07-09T21:22:30.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:29.998+0000 7fb72871f640 1 -- 172.21.15.37:0/2403703418 wait complete. 2023-07-09T21:22:30.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 Processor -- start 2023-07-09T21:22:30.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- start start 2023-07-09T21:22:30.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb72015e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 0x7fb72015e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb720159d70 con 0x7fb7200b3c20 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7201596d0 con 0x7fb7200ceb80 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb72015ec00 con 0x7fb7200b7980 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48342/0 (socket says 172.21.15.37:48342) 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 -- 172.21.15.37:0/2904206774 learned_addr learned my addr 172.21.15.37:0/2904206774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb725cba640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb72015e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb726cbc640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 0x7fb72015e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 -- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 msgr2=0x7fb72015e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb72015e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 -- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 msgr2=0x7fb72015e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 0x7fb72015e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 -- 172.21.15.37:0/2904206774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7100094d0 con 0x7fb7200b3c20 2023-07-09T21:22:30.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb726cbc640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 0x7fb72015e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb7264bb640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00e870 tx=0x7fb71c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c009510 con 0x7fb7200b3c20 2023-07-09T21:22:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71c00eec0 con 0x7fb7200b3c20 2023-07-09T21:22:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb72015eee0 con 0x7fb7200b3c20 2023-07-09T21:22:30.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb71c00cb40 con 0x7fb7200b3c20 2023-07-09T21:22:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.002+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7200c8230 con 0x7fb7200b3c20 2023-07-09T21:22:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.006+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb720159fe0 con 0x7fb7200b3c20 2023-07-09T21:22:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.006+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb71c00cca0 con 0x7fb7200b3c20 2023-07-09T21:22:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.006+0000 7fb716ffd640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 0x7fb704068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.006+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fb71c084320 con 0x7fb7200b3c20 2023-07-09T21:22:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.006+0000 7fb725cba640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 0x7fb704068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:30.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.010+0000 7fb725cba640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 0x7fb704068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb72008ad30 tx=0x7fb7100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.010+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb71c051aa0 con 0x7fb7200b3c20 2023-07-09T21:22:30.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.166+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb72004d7d0 con 0x7fb7200b3c20 2023-07-09T21:22:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.822+0000 7fb716ffd640 1 -- 172.21.15.37:0/2904206774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb71c0550c0 con 0x7fb7200b3c20 2023-07-09T21:22:30.830 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:22:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 msgr2=0x7fb704068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 0x7fb704068730 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb72008ad30 tx=0x7fb7100a6000 comp rx=0 tx=0).stop 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 msgr2=0x7fb7200c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb71c00e870 tx=0x7fb71c00ec70 comp rx=0 tx=0).stop 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 shutdown_connections 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb704066280 0x7fb704068730 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7200ceb80 0x7fb72015e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7200b7980 0x7fb72015e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 --2- 172.21.15.37:0/2904206774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7200b3c20 0x7fb7200c7cf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:30.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.830+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 >> 172.21.15.37:0/2904206774 conn(0x7fb720073090 msgr2=0x7fb720158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:30.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.838+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 shutdown_connections 2023-07-09T21:22:30.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:30.838+0000 7fb72871f640 1 -- 172.21.15.37:0/2904206774 wait complete. 2023-07-09T21:22:30.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:22:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.014+0000 7f4dc8848640 1 Processor -- start 2023-07-09T21:22:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.014+0000 7f4dc8848640 1 -- start start 2023-07-09T21:22:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc8848640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4dc4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc8848640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4dc40d0780 0x7f4dc40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc8848640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc415bf80 con 0x7f4dc40ceb80 2023-07-09T21:22:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc8848640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40cd070 con 0x7f4dc40d0780 2023-07-09T21:22:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc8848640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40cfd70 con 0x7f4dc40b7980 2023-07-09T21:22:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dbbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4dc40ceb80 0x7f4dc40cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41848/0 (socket says 172.21.15.37:41848) 2023-07-09T21:22:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dbbfff640 1 -- 172.21.15.37:0/1506491150 learned_addr learned my addr 172.21.15.37:0/1506491150 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4dc4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc2d9d640 1 --2- 172.21.15.37:0/1506491150 >> v2:172.21.15.119:3300/0 conn(0x7f4dc40d0780 0x7f4dc40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972161307 0 0) 0x7f4dac001120 con 0x7f4dc40ceb80 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db0003530 con 0x7f4dc40ceb80 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 39244576 0 0) 0x7f4db0003530 con 0x7f4dc40ceb80 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 msgr2=0x7f4dc4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4dc4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 >> v2:172.21.15.119:3300/0 conn(0x7f4dc40d0780 msgr2=0x7f4dc40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 --2- 172.21.15.37:0/1506491150 >> v2:172.21.15.119:3300/0 conn(0x7f4dc40d0780 0x7f4dc40d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc4160570 con 0x7f4dc40ceb80 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f4dac001810 con 0x7f4dc40ceb80 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 >> v1:172.21.15.37:6789/0 conn(0x7f4dc40ceb80 legacy=0x7f4dc40cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db0003980 0x7f4db0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4db00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4db0004d10 0x7f4db0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40cd070 con 0x7f4db0003980 2023-07-09T21:22:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40cfd70 con 0x7f4db0004d10 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db000b990 con 0x7f4dc40b7980 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db0003980 0x7f4db0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc2d9d640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4db0004d10 0x7f4db0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dbbfff640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4db00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 -- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 msgr2=0x7f4db00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4dc40b7980 0x7f4db00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 -- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4db0004d10 msgr2=0x7f4db0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4db0004d10 0x7f4db0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.018+0000 7f4dc259c640 1 -- 172.21.15.37:0/1506491150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db0003530 con 0x7f4db0003980 2023-07-09T21:22:31.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db0003980 0x7f4db0003d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ae0 tx=0x7f4db401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5cd9f20a5fe176 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a6430 con 0x7f4db0003980 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db40a6590 con 0x7f4db0003980 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc1d9b640 1 -- 172.21.15.37:0/1506491150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40a6940 con 0x7f4db0003980 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- 172.21.15.37:0/1506491150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db0003980 msgr2=0x7f4db0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1506491150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db0003980 0x7f4db0003d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4db4009ae0 tx=0x7f4db401c9f0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc2d9d640 1 -- 172.21.15.37:0/1506491150 reap_dead start 2023-07-09T21:22:31.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- 172.21.15.37:0/1506491150 shutdown_connections 2023-07-09T21:22:31.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- 172.21.15.37:0/1506491150 >> 172.21.15.37:0/1506491150 conn(0x7f4dc4073090 msgr2=0x7f4dc4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:31.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- 172.21.15.37:0/1506491150 shutdown_connections 2023-07-09T21:22:31.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- 172.21.15.37:0/1506491150 wait complete. 2023-07-09T21:22:31.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 Processor -- start 2023-07-09T21:22:31.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.022+0000 7f4dc8848640 1 -- start start 2023-07-09T21:22:31.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4db0003980 0x7f4dc40c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dc40b39d0 0x7f4dc40b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40a8f70 con 0x7f4dc40cbf10 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40c9cc0 con 0x7f4dc40b39d0 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc40ca430 con 0x7f4db0003980 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48352/0 (socket says 172.21.15.37:48352) 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 -- 172.21.15.37:0/1101444730 learned_addr learned my addr 172.21.15.37:0/1101444730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:31.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc2d9d640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dc40b39d0 0x7f4dc40b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4db0003980 0x7f4dc40c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 -- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4db0003980 msgr2=0x7f4dc40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4db0003980 0x7f4dc40c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 -- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dc40b39d0 msgr2=0x7f4dc40b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dc40b39d0 0x7f4dc40b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 -- 172.21.15.37:0/1101444730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40cc3a0 con 0x7f4dc40cbf10 2023-07-09T21:22:31.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbbfff640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0019b0 tx=0x7f4dac0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac007740 con 0x7f4dc40cbf10 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac00f940 con 0x7f4dc40cbf10 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc40c9700 con 0x7f4dc40cbf10 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00fcd0 con 0x7f4dc40cbf10 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc41f4280 con 0x7f4dc40cbf10 2023-07-09T21:22:31.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.026+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc40c9560 con 0x7f4dc40cbf10 2023-07-09T21:22:31.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.030+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dac01d460 con 0x7f4dc40cbf10 2023-07-09T21:22:31.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.030+0000 7f4dbaffd640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 0x7f4da4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:31.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.030+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4dac084120 con 0x7f4dc40cbf10 2023-07-09T21:22:31.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.030+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 0x7f4da4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:31.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.030+0000 7f4dc259c640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 0x7f4da4068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ad000 tx=0x7f4db40046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:31.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.034+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dac051820 con 0x7f4dc40cbf10 2023-07-09T21:22:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.218+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4dc40b36f0 con 0x7f4dc40cbf10 2023-07-09T21:22:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.822+0000 7f4dbaffd640 1 -- 172.21.15.37:0/1101444730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4dc40b36f0 con 0x7f4dc40cbf10 2023-07-09T21:22:31.830 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 3 and data pool 4 2023-07-09T21:22:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.830+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 msgr2=0x7f4da4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.830+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 0x7f4da4068730 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ad000 tx=0x7f4db40046d0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 msgr2=0x7f4dc41f3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0019b0 tx=0x7f4dac0074f0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 shutdown_connections 2023-07-09T21:22:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4da4066280 0x7f4da4068730 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4dc40b39d0 0x7f4dc40b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4dc40cbf10 0x7f4dc41f3d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 --2- 172.21.15.37:0/1101444730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4db0003980 0x7f4dc40c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:31.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 >> 172.21.15.37:0/1101444730 conn(0x7f4dc4073090 msgr2=0x7f4dc415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 shutdown_connections 2023-07-09T21:22:31.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:31.834+0000 7f4dc8848640 1 -- 172.21.15.37:0/1101444730 wait complete. 2023-07-09T21:22:31.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:32.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.014+0000 7f2b4ea48640 1 Processor -- start 2023-07-09T21:22:32.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.014+0000 7f2b4ea48640 1 -- start start 2023-07-09T21:22:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4ea48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b4815bbf0 0x7f2b480d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4ea48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b480cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4ea48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b480d1380 con 0x7f2b4806bc30 2023-07-09T21:22:32.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4ea48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b480b13e0 con 0x7f2b4815bbf0 2023-07-09T21:22:32.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4ea48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4802bbe0 con 0x7f2b480cf100 2023-07-09T21:22:32.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b4815bbf0 0x7f2b480d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b4815bbf0 0x7f2b480d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48366/0 (socket says 172.21.15.37:48366) 2023-07-09T21:22:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 -- 172.21.15.37:0/2736970445 learned_addr learned my addr 172.21.15.37:0/2736970445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4e247640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b480cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 -- 172.21.15.37:0/2736970445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 msgr2=0x7f2b480cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b480cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 -- 172.21.15.37:0/2736970445 >> v1:172.21.15.119:6789/0 conn(0x7f2b4806bc30 legacy=0x7f2b480ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.018+0000 7f2b4da46640 1 -- 172.21.15.37:0/2736970445 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b480b1100 con 0x7f2b4815bbf0 2023-07-09T21:22:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4da46640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480d1810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135aeb769ec60942 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ca44640 1 -- 172.21.15.37:0/2736970445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440a7070 con 0x7f2b4815bbf0 2023-07-09T21:22:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ca44640 1 -- 172.21.15.37:0/2736970445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b440ab430 con 0x7f2b4815bbf0 2023-07-09T21:22:32.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ca44640 1 -- 172.21.15.37:0/2736970445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b440ab7c0 con 0x7f2b4815bbf0 2023-07-09T21:22:32.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- 172.21.15.37:0/2736970445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 msgr2=0x7f2b480d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480d1810 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2b44009870 tx=0x7f2b4401c510 comp rx=0 tx=0).stop 2023-07-09T21:22:32.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- 172.21.15.37:0/2736970445 shutdown_connections 2023-07-09T21:22:32.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b480cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/2736970445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480d1810 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- 172.21.15.37:0/2736970445 >> 172.21.15.37:0/2736970445 conn(0x7f2b4802b640 msgr2=0x7f2b480d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:32.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- 172.21.15.37:0/2736970445 shutdown_connections 2023-07-09T21:22:32.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- 172.21.15.37:0/2736970445 wait complete. 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 Processor -- start 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.022+0000 7f2b4ea48640 1 -- start start 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 0x7f2b48154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b481515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480c68d0 con 0x7f2b4815bbf0 2023-07-09T21:22:32.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b48151b00 con 0x7f2b4806bc30 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b480cb670 con 0x7f2b480cf100 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4da46640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 0x7f2b48154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4d245640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b481515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48380/0 (socket says 172.21.15.37:48380) 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4da46640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 0x7f2b48154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:34274/0 (socket says 172.21.15.37:34274) 2023-07-09T21:22:32.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 -- 172.21.15.37:0/3004064495 learned_addr learned my addr 172.21.15.37:0/3004064495 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 -- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 msgr2=0x7f2b481515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b481515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 -- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 msgr2=0x7f2b48154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 0x7f2b48154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 -- 172.21.15.37:0/3004064495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440094d0 con 0x7f2b4815bbf0 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4d245640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b481515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4e247640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000efc0 tx=0x7f2b4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40014480 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b4000f040 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b40014820 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b480cb950 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b480cbf10 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4806b020 con 0x7f2b4815bbf0 2023-07-09T21:22:32.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.026+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2b40014980 con 0x7f2b4815bbf0 2023-07-09T21:22:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.030+0000 7f2b3e7fc640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 0x7f2b2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.030+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b40084b00 con 0x7f2b4815bbf0 2023-07-09T21:22:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.030+0000 7f2b4da46640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 0x7f2b2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.030+0000 7f2b4da46640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 0x7f2b2c068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b440af000 tx=0x7f2b44008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.034+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b40086e60 con 0x7f2b4815bbf0 2023-07-09T21:22:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.186+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b4804e020 con 0x7f2b4815bbf0 2023-07-09T21:22:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b3e7fc640 1 -- 172.21.15.37:0/3004064495 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18280 (secure 0 0 0) 0x7f2b40055a20 con 0x7f2b4815bbf0 2023-07-09T21:22:32.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:32.195 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:31.224558+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 msgr2=0x7f2b2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 0x7f2b2c068730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b440af000 tx=0x7f2b44008040 comp rx=0 tx=0).stop 2023-07-09T21:22:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 msgr2=0x7f2b480cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000efc0 tx=0x7f2b4000c490 comp rx=0 tx=0).stop 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 shutdown_connections 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2b2c066280 0x7f2b2c068730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b4815bbf0 0x7f2b480cdf90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b480cf100 0x7f2b481515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 --2- 172.21.15.37:0/3004064495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b4806bc30 0x7f2b48154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 >> 172.21.15.37:0/3004064495 conn(0x7f2b4802b640 msgr2=0x7f2b481593b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 shutdown_connections 2023-07-09T21:22:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.190+0000 7f2b4ea48640 1 -- 172.21.15.37:0/3004064495 wait complete. 2023-07-09T21:22:32.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 Processor -- start 2023-07-09T21:22:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 -- start start 2023-07-09T21:22:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 0x7f680406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 0x7f68040b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68040b49f0 con 0x7f68040b4170 2023-07-09T21:22:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68040b7e80 con 0x7f68040cef80 2023-07-09T21:22:32.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f680b9c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040b45f0 con 0x7f68040b7ab0 2023-07-09T21:22:32.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6808f60640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 0x7f68040b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6809761640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 0x7f680406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6808f60640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 0x7f68040b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:34286/0 (socket says 172.21.15.37:34286) 2023-07-09T21:22:32.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6808f60640 1 -- 172.21.15.37:0/3244984069 learned_addr learned my addr 172.21.15.37:0/3244984069 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6809761640 1 -- 172.21.15.37:0/3244984069 >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 msgr2=0x7f68040b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6809761640 1 --2- 172.21.15.37:0/3244984069 >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 0x7f68040b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6809761640 1 -- 172.21.15.37:0/3244984069 >> v1:172.21.15.119:6789/0 conn(0x7f68040b4170 legacy=0x7f680415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f6809761640 1 -- 172.21.15.37:0/3244984069 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68040cc8a0 con 0x7f68040b7ab0 2023-07-09T21:22:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.354+0000 7f67fbfff640 1 -- 172.21.15.37:0/3244984069 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779413091 0 0) 0x7f68040b49f0 con 0x7f68040b4170 2023-07-09T21:22:32.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f6809761640 1 --2- 172.21.15.37:0/3244984069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 0x7f680406aa50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68000097c0 tx=0x7f680001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97fe0a346eaa3820 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f67fbfff640 1 -- 172.21.15.37:0/3244984069 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000ab650 con 0x7f68040b7ab0 2023-07-09T21:22:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f67fbfff640 1 -- 172.21.15.37:0/3244984069 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000ab7b0 con 0x7f68040b7ab0 2023-07-09T21:22:32.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f67fbfff640 1 -- 172.21.15.37:0/3244984069 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000abb40 con 0x7f68040b7ab0 2023-07-09T21:22:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 -- 172.21.15.37:0/3244984069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 msgr2=0x7f680406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 --2- 172.21.15.37:0/3244984069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 0x7f680406aa50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68000097c0 tx=0x7f680001c450 comp rx=0 tx=0).stop 2023-07-09T21:22:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 -- 172.21.15.37:0/3244984069 shutdown_connections 2023-07-09T21:22:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 --2- 172.21.15.37:0/3244984069 >> v2:172.21.15.119:3300/0 conn(0x7f68040cef80 0x7f68040b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 --2- 172.21.15.37:0/3244984069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b7ab0 0x7f680406aa50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 -- 172.21.15.37:0/3244984069 >> 172.21.15.37:0/3244984069 conn(0x7f6804073090 msgr2=0x7f6804069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 -- 172.21.15.37:0/3244984069 shutdown_connections 2023-07-09T21:22:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.358+0000 7f680b9c5640 1 -- 172.21.15.37:0/3244984069 wait complete. 2023-07-09T21:22:32.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 Processor -- start 2023-07-09T21:22:32.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- start start 2023-07-09T21:22:32.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68040b7ab0 0x7f6804155570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 0x7f6804155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6804155ff0 con 0x7f68040cef80 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68040c75f0 con 0x7f68040b7ab0 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68040c78d0 con 0x7f68040b4170 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809f62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 0x7f6804155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:43838/0 (socket says 172.21.15.37:43838) 2023-07-09T21:22:32.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6808f60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68040b7ab0 0x7f6804155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 -- 172.21.15.37:0/4143896881 learned_addr learned my addr 172.21.15.37:0/4143896881 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 -- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68040b7ab0 msgr2=0x7f6804155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68040b7ab0 0x7f6804155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 -- 172.21.15.37:0/4143896881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 msgr2=0x7f6804155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 0x7f6804155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 -- 172.21.15.37:0/4143896881 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800009420 con 0x7f68040b4170 2023-07-09T21:22:32.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809f62640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 0x7f6804155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f6809761640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f68000ad040 tx=0x7f680001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000bf610 con 0x7f68040b4170 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68000bf770 con 0x7f68040b4170 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68000bfb20 con 0x7f68040b4170 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68040c7bb0 con 0x7f68040b4170 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68040c8170 con 0x7f68040b4170 2023-07-09T21:22:32.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.362+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680404d7d0 con 0x7f68040b4170 2023-07-09T21:22:32.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.366+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68000b5400 con 0x7f68040b4170 2023-07-09T21:22:32.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.366+0000 7f67f9ffb640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 0x7f67e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.366+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f680011f200 con 0x7f68040b4170 2023-07-09T21:22:32.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.366+0000 7f6808f60640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 0x7f67e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.366+0000 7f6808f60640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 0x7f67e8068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6804158220 tx=0x7f67f4009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.370+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68000ec8a0 con 0x7f68040b4170 2023-07-09T21:22:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.526+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68040b7130 con 0x7f68040b4170 2023-07-09T21:22:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.526+0000 7f67f9ffb640 1 -- 172.21.15.37:0/4143896881 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18280 (secure 0 0 0) 0x7f68000efec0 con 0x7f68040b4170 2023-07-09T21:22:32.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:32.532 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:31.224558+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 msgr2=0x7f67e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 0x7f67e8068760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6804158220 tx=0x7f67f4009240 comp rx=0 tx=0).stop 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 msgr2=0x7f6804157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f68000ad040 tx=0x7f680001ac90 comp rx=0 tx=0).stop 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 shutdown_connections 2023-07-09T21:22:32.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f67e80662b0 0x7f67e8068760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68040cef80 0x7f6804155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68040b7ab0 0x7f6804155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 --2- 172.21.15.37:0/4143896881 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68040b4170 0x7f6804157430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 >> 172.21.15.37:0/4143896881 conn(0x7f6804073090 msgr2=0x7f68040d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 shutdown_connections 2023-07-09T21:22:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.530+0000 7f680b9c5640 1 -- 172.21.15.37:0/4143896881 wait complete. 2023-07-09T21:22:32.554 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:22:32.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 Processor -- start 2023-07-09T21:22:32.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 -- start start 2023-07-09T21:22:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9fe80b7980 0x7f9fe8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fe80ceb80 0x7f9fe80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe815bf80 con 0x7f9fe80b3c20 2023-07-09T21:22:32.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80cd070 con 0x7f9fe80ceb80 2023-07-09T21:22:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.694+0000 7f9feca19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80cfd70 con 0x7f9fe80b7980 2023-07-09T21:22:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fe80ceb80 0x7f9fe80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9fe80ceb80 0x7f9fe80cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48398/0 (socket says 172.21.15.37:48398) 2023-07-09T21:22:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 -- 172.21.15.37:0/464637191 learned_addr learned my addr 172.21.15.37:0/464637191 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fe6d9d640 1 --1- 172.21.15.37:0/464637191 >> v1:172.21.15.37:6789/0 conn(0x7f9fe80b3c20 0x7f9fe80b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41858/0 (socket says 172.21.15.37:41858) 2023-07-09T21:22:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fe659c640 1 --2- 172.21.15.37:0/464637191 >> v2:172.21.15.119:3300/0 conn(0x7f9fe80b7980 0x7f9fe8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 -- 172.21.15.37:0/464637191 >> v2:172.21.15.119:3300/0 conn(0x7f9fe80b7980 msgr2=0x7f9fe8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 --2- 172.21.15.37:0/464637191 >> v2:172.21.15.119:3300/0 conn(0x7f9fe80b7980 0x7f9fe8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 -- 172.21.15.37:0/464637191 >> v1:172.21.15.37:6789/0 conn(0x7f9fe80b3c20 legacy=0x7f9fe80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 -- 172.21.15.37:0/464637191 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe8160570 con 0x7f9fe80ceb80 2023-07-09T21:22:32.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fdffff640 1 --2- 172.21.15.37:0/464637191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80ceb80 0x7f9fe80cefc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8069aa0 tx=0x7f9fd001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb238065c30ee23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fe5d9b640 1 -- 172.21.15.37:0/464637191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00ab600 con 0x7f9fe80ceb80 2023-07-09T21:22:32.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fe5d9b640 1 -- 172.21.15.37:0/464637191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00a7050 con 0x7f9fe80ceb80 2023-07-09T21:22:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.698+0000 7f9fe5d9b640 1 -- 172.21.15.37:0/464637191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00ab980 con 0x7f9fe80ceb80 2023-07-09T21:22:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- 172.21.15.37:0/464637191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80ceb80 msgr2=0x7f9fe80cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- 172.21.15.37:0/464637191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80ceb80 0x7f9fe80cefc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8069aa0 tx=0x7f9fd001c500 comp rx=0 tx=0).stop 2023-07-09T21:22:32.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- 172.21.15.37:0/464637191 shutdown_connections 2023-07-09T21:22:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- 172.21.15.37:0/464637191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80ceb80 0x7f9fe80cefc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- 172.21.15.37:0/464637191 >> v2:172.21.15.119:3300/0 conn(0x7f9fe80b7980 0x7f9fe8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- 172.21.15.37:0/464637191 >> 172.21.15.37:0/464637191 conn(0x7f9fe8073090 msgr2=0x7f9fe8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- 172.21.15.37:0/464637191 shutdown_connections 2023-07-09T21:22:32.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- 172.21.15.37:0/464637191 wait complete. 2023-07-09T21:22:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 Processor -- start 2023-07-09T21:22:32.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- start start 2023-07-09T21:22:32.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9fe80b3c20 0x7f9fe80c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 0x7f9fe815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8155490 con 0x7f9fe80b7980 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8157e40 con 0x7f9fe80ceb80 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9feca19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe8157880 con 0x7f9fe80b3c20 2023-07-09T21:22:32.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48404/0 (socket says 172.21.15.37:48404) 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 -- 172.21.15.37:0/1784291943 learned_addr learned my addr 172.21.15.37:0/1784291943 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 -- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9fe80b3c20 msgr2=0x7f9fe80c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9fe80b3c20 0x7f9fe80c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fe6d9d640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 0x7f9fe815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.702+0000 7f9fdffff640 1 -- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 msgr2=0x7f9fe815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdffff640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 0x7f9fe815d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdffff640 1 -- 172.21.15.37:0/1784291943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd00094d0 con 0x7f9fe80b7980 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fe6d9d640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 0x7f9fe815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdffff640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0019110 tx=0x7f9fd00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b3890 con 0x7f9fe80b7980 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd00b39f0 con 0x7f9fe80b7980 2023-07-09T21:22:32.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe8157b60 con 0x7f9fe80b7980 2023-07-09T21:22:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd00b3da0 con 0x7f9fe80b7980 2023-07-09T21:22:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe8157480 con 0x7f9fe80b7980 2023-07-09T21:22:32.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80cd600 con 0x7f9fe80b7980 2023-07-09T21:22:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fd00b2070 con 0x7f9fe80b7980 2023-07-09T21:22:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 0x7f9fc8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.706+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9fd011def0 con 0x7f9fe80b7980 2023-07-09T21:22:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.710+0000 7f9fe659c640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 0x7f9fc8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:32.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.710+0000 7f9fe659c640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 0x7f9fc8068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8166920 tx=0x7f9fd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:32.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.710+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fe80cd600 con 0x7f9fe80b7980 2023-07-09T21:22:32.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:32.898+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9fe8160570 con 0x7f9fe80b7980 2023-07-09T21:22:32.938 INFO:tasks.ceph.mds.d.smithi119.stderr:2023-07-09T21:22:32.936+0000 7f7694fa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:22:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.870+0000 7f9fdeffd640 1 -- 172.21.15.37:0/1784291943 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9fe8160570 con 0x7f9fe80b7980 2023-07-09T21:22:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 msgr2=0x7f9fc8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 0x7f9fc8068730 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8166920 tx=0x7f9fd8008040 comp rx=0 tx=0).stop 2023-07-09T21:22:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 msgr2=0x7f9fe81538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9fd0019110 tx=0x7f9fd00192a0 comp rx=0 tx=0).stop 2023-07-09T21:22:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 shutdown_connections 2023-07-09T21:22:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9fc8066280 0x7f9fc8068730 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9fe80ceb80 0x7f9fe815d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fe80b7980 0x7f9fe81538d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 --2- 172.21.15.37:0/1784291943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9fe80b3c20 0x7f9fe80c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 >> 172.21.15.37:0/1784291943 conn(0x7f9fe8073090 msgr2=0x7f9fe815b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 shutdown_connections 2023-07-09T21:22:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:33.874+0000 7f9feca19640 1 -- 172.21.15.37:0/1784291943 wait complete. 2023-07-09T21:22:33.901 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:22:33.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:22:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.046+0000 7fed597d2640 1 Processor -- start 2023-07-09T21:22:34.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.046+0000 7fed597d2640 1 -- start start 2023-07-09T21:22:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed597d2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:34.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed597d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415bf80 con 0x7fed540d0780 2023-07-09T21:22:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed597d2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed54160570 con 0x7fed540ceb80 2023-07-09T21:22:34.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed597d2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540cd070 con 0x7fed540b7980 2023-07-09T21:22:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed537fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed540d0780 0x7fed540d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41868/0 (socket says 172.21.15.37:41868) 2023-07-09T21:22:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed537fe640 1 -- 172.21.15.37:0/1098259448 learned_addr learned my addr 172.21.15.37:0/1098259448 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed52ffd640 1 --2- 172.21.15.37:0/1098259448 >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed527fc640 1 -- 172.21.15.37:0/1098259448 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247377978 0 0) 0x7fed4c0014a0 con 0x7fed540d0780 2023-07-09T21:22:34.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed527fc640 1 -- 172.21.15.37:0/1098259448 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed40003530 con 0x7fed540d0780 2023-07-09T21:22:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed52ffd640 1 -- 172.21.15.37:0/1098259448 >> v1:172.21.15.119:6789/0 conn(0x7fed540ceb80 legacy=0x7fed540cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed52ffd640 1 -- 172.21.15.37:0/1098259448 >> v1:172.21.15.37:6789/0 conn(0x7fed540d0780 legacy=0x7fed540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.050+0000 7fed52ffd640 1 -- 172.21.15.37:0/1098259448 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540d02f0 con 0x7fed540b7980 2023-07-09T21:22:34.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed52ffd640 1 --2- 172.21.15.37:0/1098259448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540b7980 0x7fed54160030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed440097c0 tx=0x7fed4401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48a7f8347491edcd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed527fc640 1 -- 172.21.15.37:0/1098259448 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440ab600 con 0x7fed540b7980 2023-07-09T21:22:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed527fc640 1 -- 172.21.15.37:0/1098259448 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440a7050 con 0x7fed540b7980 2023-07-09T21:22:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed527fc640 1 -- 172.21.15.37:0/1098259448 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440ab960 con 0x7fed540b7980 2023-07-09T21:22:34.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- 172.21.15.37:0/1098259448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540b7980 msgr2=0x7fed54160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 --2- 172.21.15.37:0/1098259448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540b7980 0x7fed54160030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fed440097c0 tx=0x7fed4401c480 comp rx=0 tx=0).stop 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- 172.21.15.37:0/1098259448 shutdown_connections 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 --2- 172.21.15.37:0/1098259448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- 172.21.15.37:0/1098259448 >> 172.21.15.37:0/1098259448 conn(0x7fed54073090 msgr2=0x7fed54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- 172.21.15.37:0/1098259448 shutdown_connections 2023-07-09T21:22:34.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- 172.21.15.37:0/1098259448 wait complete. 2023-07-09T21:22:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 Processor -- start 2023-07-09T21:22:34.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- start start 2023-07-09T21:22:34.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540ceb80 0x7fed54147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed541477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54156ca0 con 0x7fed540b7980 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed54147d10 con 0x7fed540ceb80 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.054+0000 7fed597d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed54156020 con 0x7fed540d0780 2023-07-09T21:22:34.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48416/0 (socket says 172.21.15.37:48416) 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 -- 172.21.15.37:0/1159655528 learned_addr learned my addr 172.21.15.37:0/1159655528 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed537fe640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed541477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed4bfff640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540ceb80 0x7fed54147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 -- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 msgr2=0x7fed541477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed541477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 -- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540ceb80 msgr2=0x7fed54147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540ceb80 0x7fed54147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 -- 172.21.15.37:0/1159655528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44009420 con 0x7fed540b7980 2023-07-09T21:22:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed52ffd640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed440097c0 tx=0x7fed44019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44003e60 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44006e20 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440ab600 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed54156300 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed541568c0 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5404d7d0 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.058+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed440b2040 con 0x7fed540b7980 2023-07-09T21:22:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.062+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 0x7fed34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.062+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed4411dde0 con 0x7fed540b7980 2023-07-09T21:22:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.062+0000 7fed4bfff640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 0x7fed34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.062+0000 7fed4bfff640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 0x7fed34068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed541f7f30 tx=0x7fed3c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.062+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed440eb1e0 con 0x7fed540b7980 2023-07-09T21:22:34.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.254+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed540c5a70 con 0x7fed540b7980 2023-07-09T21:22:34.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed4b7fe640 1 -- 172.21.15.37:0/1159655528 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed440b0070 con 0x7fed540b7980 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 msgr2=0x7fed34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 0x7fed34068730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fed541f7f30 tx=0x7fed3c009040 comp rx=0 tx=0).stop 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 msgr2=0x7fed5414cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fed440097c0 tx=0x7fed44019220 comp rx=0 tx=0).stop 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 shutdown_connections 2023-07-09T21:22:34.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed34066280 0x7fed34068730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed541477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540ceb80 0x7fed54147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 --2- 172.21.15.37:0/1159655528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540b7980 0x7fed5414cf90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 >> 172.21.15.37:0/1159655528 conn(0x7fed54073090 msgr2=0x7fed54154110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 shutdown_connections 2023-07-09T21:22:34.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:34.878+0000 7fed597d2640 1 -- 172.21.15.37:0/1159655528 wait complete. 2023-07-09T21:22:34.907 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:22:34.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:22:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 Processor -- start 2023-07-09T21:22:35.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 -- start start 2023-07-09T21:22:35.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c15ba60 0x7f8a3c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 0x7f8a3c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c06acb0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3c1605f0 con 0x7f8a3c0cf090 2023-07-09T21:22:35.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a422fc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0cf4d0 con 0x7f8a3c15ba60 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48426/0 (socket says 172.21.15.37:48426) 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 -- 172.21.15.37:0/3483986394 learned_addr learned my addr 172.21.15.37:0/3483986394 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a40899640 1 --2- 172.21.15.37:0/3483986394 >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 0x7f8a3c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3bfff640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c15ba60 0x7f8a3c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 -- 172.21.15.37:0/3483986394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c15ba60 msgr2=0x7f8a3c1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c15ba60 0x7f8a3c1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 -- 172.21.15.37:0/3483986394 >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 msgr2=0x7f8a3c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 --2- 172.21.15.37:0/3483986394 >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 0x7f8a3c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a3b7fe640 1 -- 172.21.15.37:0/3483986394 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3c0ccc90 con 0x7f8a3c0cc800 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.050+0000 7f8a40899640 1 --2- 172.21.15.37:0/3483986394 >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 0x7f8a3c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:35.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a3b7fe640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c073a50 tx=0x7f8a3001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ed2b1ea99fcbe7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a3affd640 1 -- 172.21.15.37:0/3483986394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300ab600 con 0x7f8a3c0cc800 2023-07-09T21:22:35.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a3affd640 1 -- 172.21.15.37:0/3483986394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a300a7050 con 0x7f8a3c0cc800 2023-07-09T21:22:35.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a3affd640 1 -- 172.21.15.37:0/3483986394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300ab980 con 0x7f8a3c0cc800 2023-07-09T21:22:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 -- 172.21.15.37:0/3483986394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 msgr2=0x7f8a3c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c073a50 tx=0x7f8a3001c210 comp rx=0 tx=0).stop 2023-07-09T21:22:35.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 -- 172.21.15.37:0/3483986394 shutdown_connections 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c0ceb50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 --2- 172.21.15.37:0/3483986394 >> v2:172.21.15.119:3300/0 conn(0x7f8a3c0cf090 0x7f8a3c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 --2- 172.21.15.37:0/3483986394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c15ba60 0x7f8a3c1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 -- 172.21.15.37:0/3483986394 >> 172.21.15.37:0/3483986394 conn(0x7f8a3c073090 msgr2=0x7f8a3c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 -- 172.21.15.37:0/3483986394 shutdown_connections 2023-07-09T21:22:35.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.054+0000 7f8a422fc640 1 -- 172.21.15.37:0/3483986394 wait complete. 2023-07-09T21:22:35.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 Processor -- start 2023-07-09T21:22:35.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- start start 2023-07-09T21:22:35.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c0cf090 0x7f8a3c156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a3c15ba60 0x7f8a3c0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c1552e0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c0b72e0 con 0x7f8a3c15ba60 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3c155580 con 0x7f8a3c0cf090 2023-07-09T21:22:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48430/0 (socket says 172.21.15.37:48430) 2023-07-09T21:22:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 -- 172.21.15.37:0/489304252 learned_addr learned my addr 172.21.15.37:0/489304252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 -- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c0cf090 msgr2=0x7f8a3c156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c0cf090 0x7f8a3c156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 -- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a3c15ba60 msgr2=0x7f8a3c0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a3c15ba60 0x7f8a3c0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 -- 172.21.15.37:0/489304252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300094d0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a3bfff640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d800 tx=0x7f8a2c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00b6c0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00b820 con 0x7f8a3c0cc800 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3c155860 con 0x7f8a3c0cc800 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00bb90 con 0x7f8a3c0cc800 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3c1572a0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.058+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3c0668f0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.062+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8a2c00bcf0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.062+0000 7f8a38ff9640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 0x7f8a28068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.062+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8a2c084310 con 0x7f8a3c0cc800 2023-07-09T21:22:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.062+0000 7f8a3b7fe640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 0x7f8a28068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.062+0000 7f8a3b7fe640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 0x7f8a28068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ad000 tx=0x7f8a30004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.066+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a2c055180 con 0x7f8a3c0cc800 2023-07-09T21:22:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.250+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a3c06a7f0 con 0x7f8a3c0cc800 2023-07-09T21:22:35.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.250+0000 7f8a38ff9640 1 -- 172.21.15.37:0/489304252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f8a2c054d10 con 0x7f8a3c0cc800 2023-07-09T21:22:35.257 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:35.257 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:22:35.257 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:22:35.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 msgr2=0x7f8a28068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 0x7f8a28068730 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a300ad000 tx=0x7f8a30004740 comp rx=0 tx=0).stop 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 msgr2=0x7f8a3c146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d800 tx=0x7f8a2c00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 shutdown_connections 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8a28066280 0x7f8a28068730 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a3c15ba60 0x7f8a3c0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a3c0cf090 0x7f8a3c156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 --2- 172.21.15.37:0/489304252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a3c0cc800 0x7f8a3c146ee0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 >> 172.21.15.37:0/489304252 conn(0x7f8a3c073090 msgr2=0x7f8a3c157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 shutdown_connections 2023-07-09T21:22:35.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.254+0000 7f8a422fc640 1 -- 172.21.15.37:0/489304252 wait complete. 2023-07-09T21:22:35.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 Processor -- start 2023-07-09T21:22:35.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 -- start start 2023-07-09T21:22:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e080af830 0x7f4e080afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc320 0x7f4e0806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 0x7f4e0806f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0806d370 con 0x7f4e080af830 2023-07-09T21:22:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e080cbe90 con 0x7f4e080cc770 2023-07-09T21:22:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.414+0000 7f4e0dd11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080b0140 con 0x7f4e080cc320 2023-07-09T21:22:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e080af830 0x7f4e080afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4e080af830 0x7f4e080afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48432/0 (socket says 172.21.15.37:48432) 2023-07-09T21:22:35.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 -- 172.21.15.37:0/1552365110 learned_addr learned my addr 172.21.15.37:0/1552365110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e06ffd640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc320 0x7f4e0806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e07fff640 1 --2- 172.21.15.37:0/1552365110 >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 0x7f4e0806f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 -- 172.21.15.37:0/1552365110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc320 msgr2=0x7f4e0806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc320 0x7f4e0806efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 -- 172.21.15.37:0/1552365110 >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 msgr2=0x7f4e0806f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:35.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1552365110 >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 0x7f4e0806f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 -- 172.21.15.37:0/1552365110 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08159bb0 con 0x7f4e080af830 2023-07-09T21:22:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e07fff640 1 --2- 172.21.15.37:0/1552365110 >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 0x7f4e0806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:35.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080af830 0x7f4e080afc00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e08071430 tx=0x7f4df801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846284fd2e8a3b78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e067fc640 1 -- 172.21.15.37:0/1552365110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80aa620 con 0x7f4e080af830 2023-07-09T21:22:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e067fc640 1 -- 172.21.15.37:0/1552365110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df80aa780 con 0x7f4e080af830 2023-07-09T21:22:35.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.418+0000 7f4e067fc640 1 -- 172.21.15.37:0/1552365110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df80aab10 con 0x7f4e080af830 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1552365110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080af830 msgr2=0x7f4e080afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080af830 0x7f4e080afc00 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4e08071430 tx=0x7f4df801c500 comp rx=0 tx=0).stop 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1552365110 shutdown_connections 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1552365110 >> v2:172.21.15.119:3300/0 conn(0x7f4e080cc770 0x7f4e0806f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc320 0x7f4e0806efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1552365110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080af830 0x7f4e080afc00 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1552365110 >> 172.21.15.37:0/1552365110 conn(0x7f4e080ca830 msgr2=0x7f4e080cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1552365110 shutdown_connections 2023-07-09T21:22:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1552365110 wait complete. 2023-07-09T21:22:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 Processor -- start 2023-07-09T21:22:35.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- start start 2023-07-09T21:22:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e080af830 0x7f4e080ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc770 0x7f4e0814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0814e4f0 con 0x7f4e080cc320 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080ae0f0 con 0x7f4e080af830 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e0dd11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080ae3d0 con 0x7f4e080cc770 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e06ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48442/0 (socket says 172.21.15.37:48442) 2023-07-09T21:22:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e06ffd640 1 -- 172.21.15.37:0/1277038850 learned_addr learned my addr 172.21.15.37:0/1277038850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e07fff640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc770 0x7f4e0814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.422+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e080af830 0x7f4e080ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 -- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc770 msgr2=0x7f4e0814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc770 0x7f4e0814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 -- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e080af830 msgr2=0x7f4e080ad7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e080af830 0x7f4e080ad7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 -- 172.21.15.37:0/1277038850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df80094d0 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e06ffd640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00d800 tx=0x7f4dfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc0096a0 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc009800 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e080ae6b0 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc009b70 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0814e010 con 0x7f4e080cc320 2023-07-09T21:22:35.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0806b550 con 0x7f4e080cc320 2023-07-09T21:22:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dfc009cd0 con 0x7f4e080cc320 2023-07-09T21:22:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 0x7f4df4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.426+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4dfc0843e0 con 0x7f4e080cc320 2023-07-09T21:22:35.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.430+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 0x7f4df4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.430+0000 7f4e077fe640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 0x7f4df4068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ae000 tx=0x7f4df80b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.430+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dfc051870 con 0x7f4e080cc320 2023-07-09T21:22:35.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.586+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e0814e630 con 0x7f4e080cc320 2023-07-09T21:22:35.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.586+0000 7f4deffff640 1 -- 172.21.15.37:0/1277038850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f4e0814e630 con 0x7f4e080cc320 2023-07-09T21:22:35.593 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:35.593 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:35.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 msgr2=0x7f4df4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 0x7f4df4068730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4df80ae000 tx=0x7f4df80b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 msgr2=0x7f4e0814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc00d800 tx=0x7f4dfc00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 shutdown_connections 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4df4066280 0x7f4df4068730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4e080cc770 0x7f4e0814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4e080cc320 0x7f4e0814ade0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 --2- 172.21.15.37:0/1277038850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4e080af830 0x7f4e080ad7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 >> 172.21.15.37:0/1277038850 conn(0x7f4e080ca830 msgr2=0x7f4e08155730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 shutdown_connections 2023-07-09T21:22:35.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.590+0000 7f4e0dd11640 1 -- 172.21.15.37:0/1277038850 wait complete. 2023-07-09T21:22:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:22:35.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:22:35.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 Processor -- start 2023-07-09T21:22:35.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 -- start start 2023-07-09T21:22:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c180b49f0 con 0x7f9c180b7ab0 2023-07-09T21:22:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c180b7e80 con 0x7f9c180cef80 2023-07-09T21:22:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.750+0000 7f9c1ffe2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c180cc8a0 con 0x7f9c180b4340 2023-07-09T21:22:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1e57f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1e57f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:34424/0 (socket says 172.21.15.37:34424) 2023-07-09T21:22:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:43918/0 (socket says 172.21.15.37:43918) 2023-07-09T21:22:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1e57f640 1 -- 172.21.15.37:0/1618409905 learned_addr learned my addr 172.21.15.37:0/1618409905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 -- 172.21.15.37:0/1618409905 >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 msgr2=0x7f9c180d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 --2- 172.21.15.37:0/1618409905 >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1cd7c640 1 -- 172.21.15.37:0/1618409905 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082353192 0 0) 0x7f9c180b49f0 con 0x7f9c180b7ab0 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 -- 172.21.15.37:0/1618409905 >> v1:172.21.15.119:6789/0 conn(0x7f9c180b7ab0 legacy=0x7f9c180b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 -- 172.21.15.37:0/1618409905 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180ccb80 con 0x7f9c180b4340 2023-07-09T21:22:35.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1e57f640 1 --2- 172.21.15.37:0/1618409905 >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:35.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.754+0000 7f9c1d57d640 1 --2- 172.21.15.37:0/1618409905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9c080097c0 tx=0x7f9c0801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed756242b53a346e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1cd7c640 1 -- 172.21.15.37:0/1618409905 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080ab650 con 0x7f9c180b4340 2023-07-09T21:22:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1cd7c640 1 -- 172.21.15.37:0/1618409905 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c080ab7b0 con 0x7f9c180b4340 2023-07-09T21:22:35.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1cd7c640 1 -- 172.21.15.37:0/1618409905 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c080abb40 con 0x7f9c180b4340 2023-07-09T21:22:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/1618409905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 msgr2=0x7f9c1806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/1618409905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9c080097c0 tx=0x7f9c0801c450 comp rx=0 tx=0).stop 2023-07-09T21:22:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/1618409905 shutdown_connections 2023-07-09T21:22:35.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/1618409905 >> v2:172.21.15.119:3300/0 conn(0x7f9c180cef80 0x7f9c180d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/1618409905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1806aa50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/1618409905 >> 172.21.15.37:0/1618409905 conn(0x7f9c18073090 msgr2=0x7f9c18069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/1618409905 shutdown_connections 2023-07-09T21:22:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/1618409905 wait complete. 2023-07-09T21:22:35.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 Processor -- start 2023-07-09T21:22:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- start start 2023-07-09T21:22:35.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 0x7f9c180b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1814c8f0 con 0x7f9c180cef80 2023-07-09T21:22:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c181553b0 con 0x7f9c180b7ab0 2023-07-09T21:22:35.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.758+0000 7f9c1ffe2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c18155690 con 0x7f9c180b4340 2023-07-09T21:22:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48444/0 (socket says 172.21.15.37:48444) 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 -- 172.21.15.37:0/284935883 learned_addr learned my addr 172.21.15.37:0/284935883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1dd7e640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1d57d640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 0x7f9c180b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 -- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 msgr2=0x7f9c1814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 -- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 msgr2=0x7f9c180b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 0x7f9c180b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 -- 172.21.15.37:0/284935883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009b30 con 0x7f9c180cef80 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1d57d640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 0x7f9c180b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1e57f640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ef90 tx=0x7f9c1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10018070 con 0x7f9c180cef80 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000f040 con 0x7f9c180cef80 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000ce20 con 0x7f9c180cef80 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c08009420 con 0x7f9c180cef80 2023-07-09T21:22:35.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c180c9560 con 0x7f9c180cef80 2023-07-09T21:22:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1804d7d0 con 0x7f9c180cef80 2023-07-09T21:22:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c10014480 con 0x7f9c180cef80 2023-07-09T21:22:35.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 0x7f9bfc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.762+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c10083f90 con 0x7f9c180cef80 2023-07-09T21:22:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.766+0000 7f9c1dd7e640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 0x7f9bfc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:35.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.766+0000 7f9c1dd7e640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 0x7f9bfc068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c14000f70 tx=0x7f9c14009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:35.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.766+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c10051370 con 0x7f9c180cef80 2023-07-09T21:22:35.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.918+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c180cf4d0 con 0x7f9bfc066280 2023-07-09T21:22:35.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.930+0000 7f9c0e7fc640 1 -- 172.21.15.37:0/284935883 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286738 (secure 0 0 0) 0x7f9c1400f820 con 0x7f9bfc066280 2023-07-09T21:22:35.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:35.938 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:22:35.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 msgr2=0x7f9bfc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 0x7f9bfc068730 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c14000f70 tx=0x7f9c14009040 comp rx=0 tx=0).stop 2023-07-09T21:22:35.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 msgr2=0x7f9c180b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ef90 tx=0x7f9c1000c490 comp rx=0 tx=0).stop 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 shutdown_connections 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9bfc066280 0x7f9bfc068730 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c180cef80 0x7f9c180b28c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c180b7ab0 0x7f9c180b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 --2- 172.21.15.37:0/284935883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c180b4340 0x7f9c1814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:35.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 >> 172.21.15.37:0/284935883 conn(0x7f9c18073090 msgr2=0x7f9c181588f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:35.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 shutdown_connections 2023-07-09T21:22:35.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:35.934+0000 7f9c1ffe2640 1 -- 172.21.15.37:0/284935883 wait complete. 2023-07-09T21:22:35.958 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-09T21:22:33.953669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222728,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751992,"statfs":{"total":773094113280,"available":772866039808,"internally_reserved":0,"allocated":3088384,"data_stored":1849028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.139775"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.851586+0000","last_change":"2023-07-09T21:22:31.846882+0000","last_active":"2023-07-09T21:22:31.851586+0000","last_peered":"2023-07-09T21:22:31.851586+0000","last_clean":"2023-07-09T21:22:31.851586+0000","last_became_active":"2023-07-09T21:22:31.846526+0000","last_became_peered":"2023-07-09T21:22:31.846526+0000","last_unstale":"2023-07-09T21:22:31.851586+0000","last_undegraded":"2023-07-09T21:22:31.851586+0000","last_fullsized":"2023-07-09T21:22:31.851586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:03.282921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831655+0000","last_change":"2023-07-09T21:22:31.865763+0000","last_active":"2023-07-09T21:22:32.831655+0000","last_peered":"2023-07-09T21:22:32.831655+0000","last_clean":"2023-07-09T21:22:32.831655+0000","last_became_active":"2023-07-09T21:22:31.865352+0000","last_became_peered":"2023-07-09T21:22:31.865352+0000","last_unstale":"2023-07-09T21:22:32.831655+0000","last_undegraded":"2023-07-09T21:22:32.831655+0000","last_fullsized":"2023-07-09T21:22:32.831655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832722+0000","last_change":"2023-07-09T21:22:31.852655+0000","last_active":"2023-07-09T21:22:32.832722+0000","last_peered":"2023-07-09T21:22:32.832722+0000","last_clean":"2023-07-09T21:22:32.832722+0000","last_became_active":"2023-07-09T21:22:31.852014+0000","last_became_peered":"2023-07-09T21:22:31.852014+0000","last_unstale":"2023-07-09T21:22:32.832722+0000","last_undegraded":"2023-07-09T21:22:32.832722+0000","last_fullsized":"2023-07-09T21:22:32.832722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830239+0000","last_change":"2023-07-09T21:22:31.851591+0000","last_active":"2023-07-09T21:22:32.830239+0000","last_peered":"2023-07-09T21:22:32.830239+0000","last_clean":"2023-07-09T21:22:32.830239+0000","last_became_active":"2023-07-09T21:22:31.851326+0000","last_became_peered":"2023-07-09T21:22:31.851326+0000","last_unstale":"2023-07-09T21:22:32.830239+0000","last_undegraded":"2023-07-09T21:22:32.830239+0000","last_fullsized":"2023-07-09T21:22:32.830239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:43.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857795+0000","last_change":"2023-07-09T21:22:31.845576+0000","last_active":"2023-07-09T21:22:31.857795+0000","last_peered":"2023-07-09T21:22:31.857795+0000","last_clean":"2023-07-09T21:22:31.857795+0000","last_became_active":"2023-07-09T21:22:31.844904+0000","last_became_peered":"2023-07-09T21:22:31.844904+0000","last_unstale":"2023-07-09T21:22:31.857795+0000","last_undegraded":"2023-07-09T21:22:31.857795+0000","last_fullsized":"2023-07-09T21:22:31.857795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831539+0000","last_change":"2023-07-09T21:22:31.853123+0000","last_active":"2023-07-09T21:22:32.831539+0000","last_peered":"2023-07-09T21:22:32.831539+0000","last_clean":"2023-07-09T21:22:32.831539+0000","last_became_active":"2023-07-09T21:22:31.852855+0000","last_became_peered":"2023-07-09T21:22:31.852855+0000","last_unstale":"2023-07-09T21:22:32.831539+0000","last_undegraded":"2023-07-09T21:22:32.831539+0000","last_fullsized":"2023-07-09T21:22:32.831539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.865696+0000","last_change":"2023-07-09T21:22:31.859422+0000","last_active":"2023-07-09T21:22:31.865696+0000","last_peered":"2023-07-09T21:22:31.865696+0000","last_clean":"2023-07-09T21:22:31.865696+0000","last_became_active":"2023-07-09T21:22:31.859125+0000","last_became_peered":"2023-07-09T21:22:31.859125+0000","last_unstale":"2023-07-09T21:22:31.865696+0000","last_undegraded":"2023-07-09T21:22:31.865696+0000","last_fullsized":"2023-07-09T21:22:31.865696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:01.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830707+0000","last_change":"2023-07-09T21:22:31.859849+0000","last_active":"2023-07-09T21:22:32.830707+0000","last_peered":"2023-07-09T21:22:32.830707+0000","last_clean":"2023-07-09T21:22:32.830707+0000","last_became_active":"2023-07-09T21:22:31.859115+0000","last_became_peered":"2023-07-09T21:22:31.859115+0000","last_unstale":"2023-07-09T21:22:32.830707+0000","last_undegraded":"2023-07-09T21:22:32.830707+0000","last_fullsized":"2023-07-09T21:22:32.830707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857772+0000","last_change":"2023-07-09T21:22:31.847329+0000","last_active":"2023-07-09T21:22:31.857772+0000","last_peered":"2023-07-09T21:22:31.857772+0000","last_clean":"2023-07-09T21:22:31.857772+0000","last_became_active":"2023-07-09T21:22:31.847067+0000","last_became_peered":"2023-07-09T21:22:31.847067+0000","last_unstale":"2023-07-09T21:22:31.857772+0000","last_undegraded":"2023-07-09T21:22:31.857772+0000","last_fullsized":"2023-07-09T21:22:31.857772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:26.099785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831808+0000","last_change":"2023-07-09T21:22:31.865305+0000","last_active":"2023-07-09T21:22:32.831808+0000","last_peered":"2023-07-09T21:22:32.831808+0000","last_clean":"2023-07-09T21:22:32.831808+0000","last_became_active":"2023-07-09T21:22:31.864992+0000","last_became_peered":"2023-07-09T21:22:31.864992+0000","last_unstale":"2023-07-09T21:22:32.831808+0000","last_undegraded":"2023-07-09T21:22:32.831808+0000","last_fullsized":"2023-07-09T21:22:32.831808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832758+0000","last_change":"2023-07-09T21:22:31.855739+0000","last_active":"2023-07-09T21:22:32.832758+0000","last_peered":"2023-07-09T21:22:32.832758+0000","last_clean":"2023-07-09T21:22:32.832758+0000","last_became_active":"2023-07-09T21:22:31.854569+0000","last_became_peered":"2023-07-09T21:22:31.854569+0000","last_unstale":"2023-07-09T21:22:32.832758+0000","last_undegraded":"2023-07-09T21:22:32.832758+0000","last_fullsized":"2023-07-09T21:22:32.832758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860788+0000","last_change":"2023-07-09T21:22:31.856905+0000","last_active":"2023-07-09T21:22:31.860788+0000","last_peered":"2023-07-09T21:22:31.860788+0000","last_clean":"2023-07-09T21:22:31.860788+0000","last_became_active":"2023-07-09T21:22:31.856417+0000","last_became_peered":"2023-07-09T21:22:31.856417+0000","last_unstale":"2023-07-09T21:22:31.860788+0000","last_undegraded":"2023-07-09T21:22:31.860788+0000","last_fullsized":"2023-07-09T21:22:31.860788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:56:51.977345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.851422+0000","last_change":"2023-07-09T21:22:31.845104+0000","last_active":"2023-07-09T21:22:31.851422+0000","last_peered":"2023-07-09T21:22:31.851422+0000","last_clean":"2023-07-09T21:22:31.851422+0000","last_became_active":"2023-07-09T21:22:31.844818+0000","last_became_peered":"2023-07-09T21:22:31.844818+0000","last_unstale":"2023-07-09T21:22:31.851422+0000","last_undegraded":"2023-07-09T21:22:31.851422+0000","last_fullsized":"2023-07-09T21:22:31.851422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:40.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831167+0000","last_change":"2023-07-09T21:22:31.866886+0000","last_active":"2023-07-09T21:22:32.831167+0000","last_peered":"2023-07-09T21:22:32.831167+0000","last_clean":"2023-07-09T21:22:32.831167+0000","last_became_active":"2023-07-09T21:22:31.866546+0000","last_became_peered":"2023-07-09T21:22:31.866546+0000","last_unstale":"2023-07-09T21:22:32.831167+0000","last_undegraded":"2023-07-09T21:22:32.831167+0000","last_fullsized":"2023-07-09T21:22:32.831167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861339+0000","last_change":"2023-07-09T21:22:31.858913+0000","last_active":"2023-07-09T21:22:31.861339+0000","last_peered":"2023-07-09T21:22:31.861339+0000","last_clean":"2023-07-09T21:22:31.861339+0000","last_became_active":"2023-07-09T21:22:31.858642+0000","last_became_peered":"2023-07-09T21:22:31.858642+0000","last_unstale":"2023-07-09T21:22:31.861339+0000","last_undegraded":"2023-07-09T21:22:31.861339+0000","last_fullsized":"2023-07-09T21:22:31.861339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.847866+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.847543+0000","last_became_peered":"2023-07-09T21:22:31.847543+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857750+0000","last_change":"2023-07-09T21:22:31.846826+0000","last_active":"2023-07-09T21:22:31.857750+0000","last_peered":"2023-07-09T21:22:31.857750+0000","last_clean":"2023-07-09T21:22:31.857750+0000","last_became_active":"2023-07-09T21:22:31.846429+0000","last_became_peered":"2023-07-09T21:22:31.846429+0000","last_unstale":"2023-07-09T21:22:31.857750+0000","last_undegraded":"2023-07-09T21:22:31.857750+0000","last_fullsized":"2023-07-09T21:22:31.857750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:03.282921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832648+0000","last_change":"2023-07-09T21:22:31.852252+0000","last_active":"2023-07-09T21:22:32.832648+0000","last_peered":"2023-07-09T21:22:32.832648+0000","last_clean":"2023-07-09T21:22:32.832648+0000","last_became_active":"2023-07-09T21:22:31.851797+0000","last_became_peered":"2023-07-09T21:22:31.851797+0000","last_unstale":"2023-07-09T21:22:32.832648+0000","last_undegraded":"2023-07-09T21:22:32.832648+0000","last_fullsized":"2023-07-09T21:22:32.832648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.852825+0000","last_change":"2023-07-09T21:22:31.848525+0000","last_active":"2023-07-09T21:22:31.852825+0000","last_peered":"2023-07-09T21:22:31.852825+0000","last_clean":"2023-07-09T21:22:31.852825+0000","last_became_active":"2023-07-09T21:22:31.847570+0000","last_became_peered":"2023-07-09T21:22:31.847570+0000","last_unstale":"2023-07-09T21:22:31.852825+0000","last_undegraded":"2023-07-09T21:22:31.852825+0000","last_fullsized":"2023-07-09T21:22:31.852825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:26.099785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832660+0000","last_change":"2023-07-09T21:22:31.855749+0000","last_active":"2023-07-09T21:22:32.832660+0000","last_peered":"2023-07-09T21:22:32.832660+0000","last_clean":"2023-07-09T21:22:32.832660+0000","last_became_active":"2023-07-09T21:22:31.855457+0000","last_became_peered":"2023-07-09T21:22:31.855457+0000","last_unstale":"2023-07-09T21:22:32.832660+0000","last_undegraded":"2023-07-09T21:22:32.832660+0000","last_fullsized":"2023-07-09T21:22:32.832660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.868232+0000","last_change":"2023-07-09T21:22:31.862987+0000","last_active":"2023-07-09T21:22:31.868232+0000","last_peered":"2023-07-09T21:22:31.868232+0000","last_clean":"2023-07-09T21:22:31.868232+0000","last_became_active":"2023-07-09T21:22:31.862706+0000","last_became_peered":"2023-07-09T21:22:31.862706+0000","last_unstale":"2023-07-09T21:22:31.868232+0000","last_undegraded":"2023-07-09T21:22:31.868232+0000","last_fullsized":"2023-07-09T21:22:31.868232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862114+0000","last_change":"2023-07-09T21:22:31.856986+0000","last_active":"2023-07-09T21:22:31.862114+0000","last_peered":"2023-07-09T21:22:31.862114+0000","last_clean":"2023-07-09T21:22:31.862114+0000","last_became_active":"2023-07-09T21:22:31.856738+0000","last_became_peered":"2023-07-09T21:22:31.856738+0000","last_unstale":"2023-07-09T21:22:31.862114+0000","last_undegraded":"2023-07-09T21:22:31.862114+0000","last_fullsized":"2023-07-09T21:22:31.862114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:56:51.977345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.858885+0000","last_change":"2023-07-09T21:22:31.848593+0000","last_active":"2023-07-09T21:22:31.858885+0000","last_peered":"2023-07-09T21:22:31.858885+0000","last_clean":"2023-07-09T21:22:31.858885+0000","last_became_active":"2023-07-09T21:22:31.848310+0000","last_became_peered":"2023-07-09T21:22:31.848310+0000","last_unstale":"2023-07-09T21:22:31.858885+0000","last_undegraded":"2023-07-09T21:22:31.858885+0000","last_fullsized":"2023-07-09T21:22:31.858885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.868213+0000","last_change":"2023-07-09T21:22:31.862953+0000","last_active":"2023-07-09T21:22:31.868213+0000","last_peered":"2023-07-09T21:22:31.868213+0000","last_clean":"2023-07-09T21:22:31.868213+0000","last_became_active":"2023-07-09T21:22:31.862334+0000","last_became_peered":"2023-07-09T21:22:31.862334+0000","last_unstale":"2023-07-09T21:22:31.868213+0000","last_undegraded":"2023-07-09T21:22:31.868213+0000","last_fullsized":"2023-07-09T21:22:31.868213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861166+0000","last_change":"2023-07-09T21:22:31.854043+0000","last_active":"2023-07-09T21:22:31.861166+0000","last_peered":"2023-07-09T21:22:31.861166+0000","last_clean":"2023-07-09T21:22:31.861166+0000","last_became_active":"2023-07-09T21:22:31.853765+0000","last_became_peered":"2023-07-09T21:22:31.853765+0000","last_unstale":"2023-07-09T21:22:31.861166+0000","last_undegraded":"2023-07-09T21:22:31.861166+0000","last_fullsized":"2023-07-09T21:22:31.861166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:46.073213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.852424+0000","last_change":"2023-07-09T21:22:31.843774+0000","last_active":"2023-07-09T21:22:31.852424+0000","last_peered":"2023-07-09T21:22:31.852424+0000","last_clean":"2023-07-09T21:22:31.852424+0000","last_became_active":"2023-07-09T21:22:31.843507+0000","last_became_peered":"2023-07-09T21:22:31.843507+0000","last_unstale":"2023-07-09T21:22:31.852424+0000","last_undegraded":"2023-07-09T21:22:31.852424+0000","last_fullsized":"2023-07-09T21:22:31.852424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831070+0000","last_change":"2023-07-09T21:22:31.865931+0000","last_active":"2023-07-09T21:22:32.831070+0000","last_peered":"2023-07-09T21:22:32.831070+0000","last_clean":"2023-07-09T21:22:32.831070+0000","last_became_active":"2023-07-09T21:22:31.865659+0000","last_became_peered":"2023-07-09T21:22:31.865659+0000","last_unstale":"2023-07-09T21:22:32.831070+0000","last_undegraded":"2023-07-09T21:22:32.831070+0000","last_fullsized":"2023-07-09T21:22:32.831070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862682+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:31.862682+0000","last_peered":"2023-07-09T21:22:31.862682+0000","last_clean":"2023-07-09T21:22:31.862682+0000","last_became_active":"2023-07-09T21:22:31.856284+0000","last_became_peered":"2023-07-09T21:22:31.856284+0000","last_unstale":"2023-07-09T21:22:31.862682+0000","last_undegraded":"2023-07-09T21:22:31.862682+0000","last_fullsized":"2023-07-09T21:22:31.862682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859332+0000","last_change":"2023-07-09T21:22:31.854071+0000","last_active":"2023-07-09T21:22:31.859332+0000","last_peered":"2023-07-09T21:22:31.859332+0000","last_clean":"2023-07-09T21:22:31.859332+0000","last_became_active":"2023-07-09T21:22:31.853768+0000","last_became_peered":"2023-07-09T21:22:31.853768+0000","last_unstale":"2023-07-09T21:22:31.859332+0000","last_undegraded":"2023-07-09T21:22:31.859332+0000","last_fullsized":"2023-07-09T21:22:31.859332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831876+0000","last_change":"2023-07-09T21:22:31.847820+0000","last_active":"2023-07-09T21:22:32.831876+0000","last_peered":"2023-07-09T21:22:32.831876+0000","last_clean":"2023-07-09T21:22:32.831876+0000","last_became_active":"2023-07-09T21:22:31.847484+0000","last_became_peered":"2023-07-09T21:22:31.847484+0000","last_unstale":"2023-07-09T21:22:32.831876+0000","last_undegraded":"2023-07-09T21:22:32.831876+0000","last_fullsized":"2023-07-09T21:22:32.831876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859449+0000","last_change":"2023-07-09T21:22:31.855297+0000","last_active":"2023-07-09T21:22:31.859449+0000","last_peered":"2023-07-09T21:22:31.859449+0000","last_clean":"2023-07-09T21:22:31.859449+0000","last_became_active":"2023-07-09T21:22:31.855025+0000","last_became_peered":"2023-07-09T21:22:31.855025+0000","last_unstale":"2023-07-09T21:22:31.859449+0000","last_undegraded":"2023-07-09T21:22:31.859449+0000","last_fullsized":"2023-07-09T21:22:31.859449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829783+0000","last_change":"2023-07-09T21:22:31.847753+0000","last_active":"2023-07-09T21:22:32.829783+0000","last_peered":"2023-07-09T21:22:32.829783+0000","last_clean":"2023-07-09T21:22:32.829783+0000","last_became_active":"2023-07-09T21:22:31.847425+0000","last_became_peered":"2023-07-09T21:22:31.847425+0000","last_unstale":"2023-07-09T21:22:32.829783+0000","last_undegraded":"2023-07-09T21:22:32.829783+0000","last_fullsized":"2023-07-09T21:22:32.829783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859371+0000","last_change":"2023-07-09T21:22:31.853654+0000","last_active":"2023-07-09T21:22:31.859371+0000","last_peered":"2023-07-09T21:22:31.859371+0000","last_clean":"2023-07-09T21:22:31.859371+0000","last_became_active":"2023-07-09T21:22:31.853302+0000","last_became_peered":"2023-07-09T21:22:31.853302+0000","last_unstale":"2023-07-09T21:22:31.859371+0000","last_undegraded":"2023-07-09T21:22:31.859371+0000","last_fullsized":"2023-07-09T21:22:31.859371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854727+0000","last_change":"2023-07-09T21:22:30.856062+0000","last_active":"2023-07-09T21:22:31.854727+0000","last_peered":"2023-07-09T21:22:31.854727+0000","last_clean":"2023-07-09T21:22:31.854727+0000","last_became_active":"2023-07-09T21:22:30.855739+0000","last_became_peered":"2023-07-09T21:22:30.855739+0000","last_unstale":"2023-07-09T21:22:31.854727+0000","last_undegraded":"2023-07-09T21:22:31.854727+0000","last_fullsized":"2023-07-09T21:22:31.854727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:56.259324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831637+0000","last_change":"2023-07-09T21:22:31.865421+0000","last_active":"2023-07-09T21:22:32.831637+0000","last_peered":"2023-07-09T21:22:32.831637+0000","last_clean":"2023-07-09T21:22:32.831637+0000","last_became_active":"2023-07-09T21:22:31.865018+0000","last_became_peered":"2023-07-09T21:22:31.865018+0000","last_unstale":"2023-07-09T21:22:32.831637+0000","last_undegraded":"2023-07-09T21:22:32.831637+0000","last_fullsized":"2023-07-09T21:22:32.831637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.840674+0000","last_change":"2023-07-09T21:22:30.844420+0000","last_active":"2023-07-09T21:22:31.840674+0000","last_peered":"2023-07-09T21:22:31.840674+0000","last_clean":"2023-07-09T21:22:31.840674+0000","last_became_active":"2023-07-09T21:22:30.843988+0000","last_became_peered":"2023-07-09T21:22:30.843988+0000","last_unstale":"2023-07-09T21:22:31.840674+0000","last_undegraded":"2023-07-09T21:22:31.840674+0000","last_fullsized":"2023-07-09T21:22:31.840674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859021+0000","last_change":"2023-07-09T21:22:31.845772+0000","last_active":"2023-07-09T21:22:31.859021+0000","last_peered":"2023-07-09T21:22:31.859021+0000","last_clean":"2023-07-09T21:22:31.859021+0000","last_became_active":"2023-07-09T21:22:31.845435+0000","last_became_peered":"2023-07-09T21:22:31.845435+0000","last_unstale":"2023-07-09T21:22:31.859021+0000","last_undegraded":"2023-07-09T21:22:31.859021+0000","last_fullsized":"2023-07-09T21:22:31.859021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843681+0000","last_change":"2023-07-09T21:22:30.858532+0000","last_active":"2023-07-09T21:22:31.843681+0000","last_peered":"2023-07-09T21:22:31.843681+0000","last_clean":"2023-07-09T21:22:31.843681+0000","last_became_active":"2023-07-09T21:22:30.858236+0000","last_became_peered":"2023-07-09T21:22:30.858236+0000","last_unstale":"2023-07-09T21:22:31.843681+0000","last_undegraded":"2023-07-09T21:22:31.843681+0000","last_fullsized":"2023-07-09T21:22:31.843681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:09.772460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859884+0000","last_change":"2023-07-09T21:22:31.854757+0000","last_active":"2023-07-09T21:22:31.859884+0000","last_peered":"2023-07-09T21:22:31.859884+0000","last_clean":"2023-07-09T21:22:31.859884+0000","last_became_active":"2023-07-09T21:22:31.854486+0000","last_became_peered":"2023-07-09T21:22:31.854486+0000","last_unstale":"2023-07-09T21:22:31.859884+0000","last_undegraded":"2023-07-09T21:22:31.859884+0000","last_fullsized":"2023-07-09T21:22:31.859884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:41.397827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829862+0000","last_change":"2023-07-09T21:22:30.847752+0000","last_active":"2023-07-09T21:22:32.829862+0000","last_peered":"2023-07-09T21:22:32.829862+0000","last_clean":"2023-07-09T21:22:32.829862+0000","last_became_active":"2023-07-09T21:22:30.847443+0000","last_became_peered":"2023-07-09T21:22:30.847443+0000","last_unstale":"2023-07-09T21:22:32.829862+0000","last_undegraded":"2023-07-09T21:22:32.829862+0000","last_fullsized":"2023-07-09T21:22:32.829862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854387+0000","last_change":"2023-07-09T21:22:30.858567+0000","last_active":"2023-07-09T21:22:31.854387+0000","last_peered":"2023-07-09T21:22:31.854387+0000","last_clean":"2023-07-09T21:22:31.854387+0000","last_became_active":"2023-07-09T21:22:30.858292+0000","last_became_peered":"2023-07-09T21:22:30.858292+0000","last_unstale":"2023-07-09T21:22:31.854387+0000","last_undegraded":"2023-07-09T21:22:31.854387+0000","last_fullsized":"2023-07-09T21:22:31.854387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830934+0000","last_change":"2023-07-09T21:22:31.860174+0000","last_active":"2023-07-09T21:22:32.830934+0000","last_peered":"2023-07-09T21:22:32.830934+0000","last_clean":"2023-07-09T21:22:32.830934+0000","last_became_active":"2023-07-09T21:22:31.859534+0000","last_became_peered":"2023-07-09T21:22:31.859534+0000","last_unstale":"2023-07-09T21:22:32.830934+0000","last_undegraded":"2023-07-09T21:22:32.830934+0000","last_fullsized":"2023-07-09T21:22:32.830934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854315+0000","last_change":"2023-07-09T21:22:30.859109+0000","last_active":"2023-07-09T21:22:31.854315+0000","last_peered":"2023-07-09T21:22:31.854315+0000","last_clean":"2023-07-09T21:22:31.854315+0000","last_became_active":"2023-07-09T21:22:30.858847+0000","last_became_peered":"2023-07-09T21:22:30.858847+0000","last_unstale":"2023-07-09T21:22:31.854315+0000","last_undegraded":"2023-07-09T21:22:31.854315+0000","last_fullsized":"2023-07-09T21:22:31.854315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:56.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.853909+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.853620+0000","last_became_peered":"2023-07-09T21:22:31.853620+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.870329+0000","last_change":"2023-07-09T21:22:30.843222+0000","last_active":"2023-07-09T21:22:31.870329+0000","last_peered":"2023-07-09T21:22:31.870329+0000","last_clean":"2023-07-09T21:22:31.870329+0000","last_became_active":"2023-07-09T21:22:30.842674+0000","last_became_peered":"2023-07-09T21:22:30.842674+0000","last_unstale":"2023-07-09T21:22:31.870329+0000","last_undegraded":"2023-07-09T21:22:31.870329+0000","last_fullsized":"2023-07-09T21:22:31.870329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:01.551080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829829+0000","last_change":"2023-07-09T21:22:31.862216+0000","last_active":"2023-07-09T21:22:32.829829+0000","last_peered":"2023-07-09T21:22:32.829829+0000","last_clean":"2023-07-09T21:22:32.829829+0000","last_became_active":"2023-07-09T21:22:31.861894+0000","last_became_peered":"2023-07-09T21:22:31.861894+0000","last_unstale":"2023-07-09T21:22:32.829829+0000","last_undegraded":"2023-07-09T21:22:32.829829+0000","last_fullsized":"2023-07-09T21:22:32.829829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831409+0000","last_change":"2023-07-09T21:22:30.851190+0000","last_active":"2023-07-09T21:22:32.831409+0000","last_peered":"2023-07-09T21:22:32.831409+0000","last_clean":"2023-07-09T21:22:32.831409+0000","last_became_active":"2023-07-09T21:22:30.850854+0000","last_became_peered":"2023-07-09T21:22:30.850854+0000","last_unstale":"2023-07-09T21:22:32.831409+0000","last_undegraded":"2023-07-09T21:22:32.831409+0000","last_fullsized":"2023-07-09T21:22:32.831409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861917+0000","last_change":"2023-07-09T21:22:31.851686+0000","last_active":"2023-07-09T21:22:31.861917+0000","last_peered":"2023-07-09T21:22:31.861917+0000","last_clean":"2023-07-09T21:22:31.861917+0000","last_became_active":"2023-07-09T21:22:31.851409+0000","last_became_peered":"2023-07-09T21:22:31.851409+0000","last_unstale":"2023-07-09T21:22:31.861917+0000","last_undegraded":"2023-07-09T21:22:31.861917+0000","last_fullsized":"2023-07-09T21:22:31.861917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860377+0000","last_change":"2023-07-09T21:22:30.850817+0000","last_active":"2023-07-09T21:22:31.860377+0000","last_peered":"2023-07-09T21:22:31.860377+0000","last_clean":"2023-07-09T21:22:31.860377+0000","last_became_active":"2023-07-09T21:22:30.850487+0000","last_became_peered":"2023-07-09T21:22:30.850487+0000","last_unstale":"2023-07-09T21:22:31.860377+0000","last_undegraded":"2023-07-09T21:22:31.860377+0000","last_fullsized":"2023-07-09T21:22:31.860377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:24.803685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832857+0000","last_change":"2023-07-09T21:22:31.856467+0000","last_active":"2023-07-09T21:22:32.832857+0000","last_peered":"2023-07-09T21:22:32.832857+0000","last_clean":"2023-07-09T21:22:32.832857+0000","last_became_active":"2023-07-09T21:22:31.855212+0000","last_became_peered":"2023-07-09T21:22:31.855212+0000","last_unstale":"2023-07-09T21:22:32.832857+0000","last_undegraded":"2023-07-09T21:22:32.832857+0000","last_fullsized":"2023-07-09T21:22:32.832857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:55.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830026+0000","last_change":"2023-07-09T21:22:30.857694+0000","last_active":"2023-07-09T21:22:32.830026+0000","last_peered":"2023-07-09T21:22:32.830026+0000","last_clean":"2023-07-09T21:22:32.830026+0000","last_became_active":"2023-07-09T21:22:30.857229+0000","last_became_peered":"2023-07-09T21:22:30.857229+0000","last_unstale":"2023-07-09T21:22:32.830026+0000","last_undegraded":"2023-07-09T21:22:32.830026+0000","last_fullsized":"2023-07-09T21:22:32.830026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832851+0000","last_change":"2023-07-09T21:22:31.850987+0000","last_active":"2023-07-09T21:22:32.832851+0000","last_peered":"2023-07-09T21:22:32.832851+0000","last_clean":"2023-07-09T21:22:32.832851+0000","last_became_active":"2023-07-09T21:22:31.850653+0000","last_became_peered":"2023-07-09T21:22:31.850653+0000","last_unstale":"2023-07-09T21:22:32.832851+0000","last_undegraded":"2023-07-09T21:22:32.832851+0000","last_fullsized":"2023-07-09T21:22:32.832851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832117+0000","last_change":"2023-07-09T21:22:30.856178+0000","last_active":"2023-07-09T21:22:32.832117+0000","last_peered":"2023-07-09T21:22:32.832117+0000","last_clean":"2023-07-09T21:22:32.832117+0000","last_became_active":"2023-07-09T21:22:30.855740+0000","last_became_peered":"2023-07-09T21:22:30.855740+0000","last_unstale":"2023-07-09T21:22:32.832117+0000","last_undegraded":"2023-07-09T21:22:32.832117+0000","last_fullsized":"2023-07-09T21:22:32.832117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832756+0000","last_change":"2023-07-09T21:22:31.852075+0000","last_active":"2023-07-09T21:22:32.832756+0000","last_peered":"2023-07-09T21:22:32.832756+0000","last_clean":"2023-07-09T21:22:32.832756+0000","last_became_active":"2023-07-09T21:22:31.851518+0000","last_became_peered":"2023-07-09T21:22:31.851518+0000","last_unstale":"2023-07-09T21:22:32.832756+0000","last_undegraded":"2023-07-09T21:22:32.832756+0000","last_fullsized":"2023-07-09T21:22:32.832756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837350+0000","last_change":"2023-07-09T21:22:30.850674+0000","last_active":"2023-07-09T21:22:31.837350+0000","last_peered":"2023-07-09T21:22:31.837350+0000","last_clean":"2023-07-09T21:22:31.837350+0000","last_became_active":"2023-07-09T21:22:30.847971+0000","last_became_peered":"2023-07-09T21:22:30.847971+0000","last_unstale":"2023-07-09T21:22:31.837350+0000","last_undegraded":"2023-07-09T21:22:31.837350+0000","last_fullsized":"2023-07-09T21:22:31.837350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:54.688518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.865663+0000","last_change":"2023-07-09T21:22:31.861069+0000","last_active":"2023-07-09T21:22:31.865663+0000","last_peered":"2023-07-09T21:22:31.865663+0000","last_clean":"2023-07-09T21:22:31.865663+0000","last_became_active":"2023-07-09T21:22:31.860705+0000","last_became_peered":"2023-07-09T21:22:31.860705+0000","last_unstale":"2023-07-09T21:22:31.865663+0000","last_undegraded":"2023-07-09T21:22:31.865663+0000","last_fullsized":"2023-07-09T21:22:31.865663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843794+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:22:31.843794+0000","last_peered":"2023-07-09T21:22:31.843794+0000","last_clean":"2023-07-09T21:22:31.843794+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:22:31.843794+0000","last_undegraded":"2023-07-09T21:22:31.843794+0000","last_fullsized":"2023-07-09T21:22:31.843794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:57.150016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831034+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:22:32.831034+0000","last_peered":"2023-07-09T21:22:32.831034+0000","last_clean":"2023-07-09T21:22:32.831034+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:22:32.831034+0000","last_undegraded":"2023-07-09T21:22:32.831034+0000","last_fullsized":"2023-07-09T21:22:32.831034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:03.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837228+0000","last_change":"2023-07-09T21:22:30.843989+0000","last_active":"2023-07-09T21:22:31.837228+0000","last_peered":"2023-07-09T21:22:31.837228+0000","last_clean":"2023-07-09T21:22:31.837228+0000","last_became_active":"2023-07-09T21:22:30.843612+0000","last_became_peered":"2023-07-09T21:22:30.843612+0000","last_unstale":"2023-07-09T21:22:31.837228+0000","last_undegraded":"2023-07-09T21:22:31.837228+0000","last_fullsized":"2023-07-09T21:22:31.837228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830346+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:32.830346+0000","last_peered":"2023-07-09T21:22:32.830346+0000","last_clean":"2023-07-09T21:22:32.830346+0000","last_became_active":"2023-07-09T21:22:31.855516+0000","last_became_peered":"2023-07-09T21:22:31.855516+0000","last_unstale":"2023-07-09T21:22:32.830346+0000","last_undegraded":"2023-07-09T21:22:32.830346+0000","last_fullsized":"2023-07-09T21:22:32.830346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:55.695138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.842355+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:22:31.842355+0000","last_peered":"2023-07-09T21:22:31.842355+0000","last_clean":"2023-07-09T21:22:31.842355+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:22:31.842355+0000","last_undegraded":"2023-07-09T21:22:31.842355+0000","last_fullsized":"2023-07-09T21:22:31.842355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.836569+0000","last_change":"2023-07-09T21:22:30.857285+0000","last_active":"2023-07-09T21:22:31.836569+0000","last_peered":"2023-07-09T21:22:31.836569+0000","last_clean":"2023-07-09T21:22:31.836569+0000","last_became_active":"2023-07-09T21:22:30.856950+0000","last_became_peered":"2023-07-09T21:22:30.856950+0000","last_unstale":"2023-07-09T21:22:31.836569+0000","last_undegraded":"2023-07-09T21:22:31.836569+0000","last_fullsized":"2023-07-09T21:22:31.836569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:09.046232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862874+0000","last_change":"2023-07-09T21:22:31.858719+0000","last_active":"2023-07-09T21:22:31.862874+0000","last_peered":"2023-07-09T21:22:31.862874+0000","last_clean":"2023-07-09T21:22:31.862874+0000","last_became_active":"2023-07-09T21:22:31.858412+0000","last_became_peered":"2023-07-09T21:22:31.858412+0000","last_unstale":"2023-07-09T21:22:31.862874+0000","last_undegraded":"2023-07-09T21:22:31.862874+0000","last_fullsized":"2023-07-09T21:22:31.862874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.827523+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:22:31.827523+0000","last_peered":"2023-07-09T21:22:31.827523+0000","last_clean":"2023-07-09T21:22:31.827523+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:22:31.827523+0000","last_undegraded":"2023-07-09T21:22:31.827523+0000","last_fullsized":"2023-07-09T21:22:31.827523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:29.533132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.848367+0000","last_change":"2023-07-09T21:22:30.843863+0000","last_active":"2023-07-09T21:22:31.848367+0000","last_peered":"2023-07-09T21:22:31.848367+0000","last_clean":"2023-07-09T21:22:31.848367+0000","last_became_active":"2023-07-09T21:22:30.843523+0000","last_became_peered":"2023-07-09T21:22:30.843523+0000","last_unstale":"2023-07-09T21:22:31.848367+0000","last_undegraded":"2023-07-09T21:22:31.848367+0000","last_fullsized":"2023-07-09T21:22:31.848367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.873982+0000","last_change":"2023-07-09T21:22:31.869166+0000","last_active":"2023-07-09T21:22:31.873982+0000","last_peered":"2023-07-09T21:22:31.873982+0000","last_clean":"2023-07-09T21:22:31.873982+0000","last_became_active":"2023-07-09T21:22:31.868832+0000","last_became_peered":"2023-07-09T21:22:31.868832+0000","last_unstale":"2023-07-09T21:22:31.873982+0000","last_undegraded":"2023-07-09T21:22:31.873982+0000","last_fullsized":"2023-07-09T21:22:31.873982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831237+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:22:32.831237+0000","last_peered":"2023-07-09T21:22:32.831237+0000","last_clean":"2023-07-09T21:22:32.831237+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:22:32.831237+0000","last_undegraded":"2023-07-09T21:22:32.831237+0000","last_fullsized":"2023-07-09T21:22:32.831237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:09.500561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832498+0000","last_change":"2023-07-09T21:22:30.855389+0000","last_active":"2023-07-09T21:22:32.832498+0000","last_peered":"2023-07-09T21:22:32.832498+0000","last_clean":"2023-07-09T21:22:32.832498+0000","last_became_active":"2023-07-09T21:22:30.855134+0000","last_became_peered":"2023-07-09T21:22:30.855134+0000","last_unstale":"2023-07-09T21:22:32.832498+0000","last_undegraded":"2023-07-09T21:22:32.832498+0000","last_fullsized":"2023-07-09T21:22:32.832498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860843+0000","last_change":"2023-07-09T21:22:31.852120+0000","last_active":"2023-07-09T21:22:31.860843+0000","last_peered":"2023-07-09T21:22:31.860843+0000","last_clean":"2023-07-09T21:22:31.860843+0000","last_became_active":"2023-07-09T21:22:31.851781+0000","last_became_peered":"2023-07-09T21:22:31.851781+0000","last_unstale":"2023-07-09T21:22:31.860843+0000","last_undegraded":"2023-07-09T21:22:31.860843+0000","last_fullsized":"2023-07-09T21:22:31.860843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831933+0000","last_change":"2023-07-09T21:22:30.851147+0000","last_active":"2023-07-09T21:22:32.831933+0000","last_peered":"2023-07-09T21:22:32.831933+0000","last_clean":"2023-07-09T21:22:32.831933+0000","last_became_active":"2023-07-09T21:22:30.850732+0000","last_became_peered":"2023-07-09T21:22:30.850732+0000","last_unstale":"2023-07-09T21:22:32.831933+0000","last_undegraded":"2023-07-09T21:22:32.831933+0000","last_fullsized":"2023-07-09T21:22:32.831933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850090+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:22:31.850090+0000","last_peered":"2023-07-09T21:22:31.850090+0000","last_clean":"2023-07-09T21:22:31.850090+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:22:31.850090+0000","last_undegraded":"2023-07-09T21:22:31.850090+0000","last_fullsized":"2023-07-09T21:22:31.850090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:49.657215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.871441+0000","last_change":"2023-07-09T21:22:31.866350+0000","last_active":"2023-07-09T21:22:31.871441+0000","last_peered":"2023-07-09T21:22:31.871441+0000","last_clean":"2023-07-09T21:22:31.871441+0000","last_became_active":"2023-07-09T21:22:31.866065+0000","last_became_peered":"2023-07-09T21:22:31.866065+0000","last_unstale":"2023-07-09T21:22:31.871441+0000","last_undegraded":"2023-07-09T21:22:31.871441+0000","last_fullsized":"2023-07-09T21:22:31.871441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.849999+0000","last_change":"2023-07-09T21:22:30.847415+0000","last_active":"2023-07-09T21:22:31.849999+0000","last_peered":"2023-07-09T21:22:31.849999+0000","last_clean":"2023-07-09T21:22:31.849999+0000","last_became_active":"2023-07-09T21:22:30.847083+0000","last_became_peered":"2023-07-09T21:22:30.847083+0000","last_unstale":"2023-07-09T21:22:31.849999+0000","last_undegraded":"2023-07-09T21:22:31.849999+0000","last_fullsized":"2023-07-09T21:22:31.849999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843504+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:22:31.843504+0000","last_peered":"2023-07-09T21:22:31.843504+0000","last_clean":"2023-07-09T21:22:31.843504+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:22:31.843504+0000","last_undegraded":"2023-07-09T21:22:31.843504+0000","last_fullsized":"2023-07-09T21:22:31.843504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.029984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.873897+0000","last_change":"2023-07-09T21:22:31.869857+0000","last_active":"2023-07-09T21:22:31.873897+0000","last_peered":"2023-07-09T21:22:31.873897+0000","last_clean":"2023-07-09T21:22:31.873897+0000","last_became_active":"2023-07-09T21:22:31.869492+0000","last_became_peered":"2023-07-09T21:22:31.869492+0000","last_unstale":"2023-07-09T21:22:31.873897+0000","last_undegraded":"2023-07-09T21:22:31.873897+0000","last_fullsized":"2023-07-09T21:22:31.873897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859835+0000","last_change":"2023-07-09T21:22:30.837573+0000","last_active":"2023-07-09T21:22:31.859835+0000","last_peered":"2023-07-09T21:22:31.859835+0000","last_clean":"2023-07-09T21:22:31.859835+0000","last_became_active":"2023-07-09T21:22:30.837216+0000","last_became_peered":"2023-07-09T21:22:30.837216+0000","last_unstale":"2023-07-09T21:22:31.859835+0000","last_undegraded":"2023-07-09T21:22:31.859835+0000","last_fullsized":"2023-07-09T21:22:31.859835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:00.316799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850339+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:22:31.850339+0000","last_peered":"2023-07-09T21:22:31.850339+0000","last_clean":"2023-07-09T21:22:31.850339+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:22:31.850339+0000","last_undegraded":"2023-07-09T21:22:31.850339+0000","last_fullsized":"2023-07-09T21:22:31.850339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:19.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859441+0000","last_change":"2023-07-09T21:22:31.853429+0000","last_active":"2023-07-09T21:22:31.859441+0000","last_peered":"2023-07-09T21:22:31.859441+0000","last_clean":"2023-07-09T21:22:31.859441+0000","last_became_active":"2023-07-09T21:22:31.853117+0000","last_became_peered":"2023-07-09T21:22:31.853117+0000","last_unstale":"2023-07-09T21:22:31.859441+0000","last_undegraded":"2023-07-09T21:22:31.859441+0000","last_fullsized":"2023-07-09T21:22:31.859441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.842804+0000","last_change":"2023-07-09T21:22:30.848294+0000","last_active":"2023-07-09T21:22:31.842804+0000","last_peered":"2023-07-09T21:22:31.842804+0000","last_clean":"2023-07-09T21:22:31.842804+0000","last_became_active":"2023-07-09T21:22:30.847977+0000","last_became_peered":"2023-07-09T21:22:30.847977+0000","last_unstale":"2023-07-09T21:22:31.842804+0000","last_undegraded":"2023-07-09T21:22:31.842804+0000","last_fullsized":"2023-07-09T21:22:31.842804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830462+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:22:32.830462+0000","last_peered":"2023-07-09T21:22:32.830462+0000","last_clean":"2023-07-09T21:22:32.830462+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:22:32.830462+0000","last_undegraded":"2023-07-09T21:22:32.830462+0000","last_fullsized":"2023-07-09T21:22:32.830462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.865948+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.865590+0000","last_became_peered":"2023-07-09T21:22:31.865590+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832513+0000","last_change":"2023-07-09T21:22:31.852986+0000","last_active":"2023-07-09T21:22:32.832513+0000","last_peered":"2023-07-09T21:22:32.832513+0000","last_clean":"2023-07-09T21:22:32.832513+0000","last_became_active":"2023-07-09T21:22:31.852672+0000","last_became_peered":"2023-07-09T21:22:31.852672+0000","last_unstale":"2023-07-09T21:22:32.832513+0000","last_undegraded":"2023-07-09T21:22:32.832513+0000","last_fullsized":"2023-07-09T21:22:32.832513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832985+0000","last_change":"2023-07-09T21:22:30.857328+0000","last_active":"2023-07-09T21:22:32.832985+0000","last_peered":"2023-07-09T21:22:32.832985+0000","last_clean":"2023-07-09T21:22:32.832985+0000","last_became_active":"2023-07-09T21:22:30.857074+0000","last_became_peered":"2023-07-09T21:22:30.857074+0000","last_unstale":"2023-07-09T21:22:32.832985+0000","last_undegraded":"2023-07-09T21:22:32.832985+0000","last_fullsized":"2023-07-09T21:22:32.832985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:35.836977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.856463+0000","last_change":"2023-07-09T21:22:31.849713+0000","last_active":"2023-07-09T21:22:31.856463+0000","last_peered":"2023-07-09T21:22:31.856463+0000","last_clean":"2023-07-09T21:22:31.856463+0000","last_became_active":"2023-07-09T21:22:31.849438+0000","last_became_peered":"2023-07-09T21:22:31.849438+0000","last_unstale":"2023-07-09T21:22:31.856463+0000","last_undegraded":"2023-07-09T21:22:31.856463+0000","last_fullsized":"2023-07-09T21:22:31.856463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862485+0000","last_change":"2023-07-09T21:22:30.850957+0000","last_active":"2023-07-09T21:22:31.862485+0000","last_peered":"2023-07-09T21:22:31.862485+0000","last_clean":"2023-07-09T21:22:31.862485+0000","last_became_active":"2023-07-09T21:22:30.850675+0000","last_became_peered":"2023-07-09T21:22:30.850675+0000","last_unstale":"2023-07-09T21:22:31.862485+0000","last_undegraded":"2023-07-09T21:22:31.862485+0000","last_fullsized":"2023-07-09T21:22:31.862485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:53.047005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832318+0000","last_change":"2023-07-09T21:22:30.843875+0000","last_active":"2023-07-09T21:22:32.832318+0000","last_peered":"2023-07-09T21:22:32.832318+0000","last_clean":"2023-07-09T21:22:32.832318+0000","last_became_active":"2023-07-09T21:22:30.843484+0000","last_became_peered":"2023-07-09T21:22:30.843484+0000","last_unstale":"2023-07-09T21:22:32.832318+0000","last_undegraded":"2023-07-09T21:22:32.832318+0000","last_fullsized":"2023-07-09T21:22:32.832318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859111+0000","last_change":"2023-07-09T21:22:31.853270+0000","last_active":"2023-07-09T21:22:31.859111+0000","last_peered":"2023-07-09T21:22:31.859111+0000","last_clean":"2023-07-09T21:22:31.859111+0000","last_became_active":"2023-07-09T21:22:31.852994+0000","last_became_peered":"2023-07-09T21:22:31.852994+0000","last_unstale":"2023-07-09T21:22:31.859111+0000","last_undegraded":"2023-07-09T21:22:31.859111+0000","last_fullsized":"2023-07-09T21:22:31.859111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.836917+0000","last_change":"2023-07-09T21:22:30.845979+0000","last_active":"2023-07-09T21:22:31.836917+0000","last_peered":"2023-07-09T21:22:31.836917+0000","last_clean":"2023-07-09T21:22:31.836917+0000","last_became_active":"2023-07-09T21:22:30.844569+0000","last_became_peered":"2023-07-09T21:22:30.844569+0000","last_unstale":"2023-07-09T21:22:31.836917+0000","last_undegraded":"2023-07-09T21:22:31.836917+0000","last_fullsized":"2023-07-09T21:22:31.836917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:15.644653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859420+0000","last_change":"2023-07-09T21:22:31.850051+0000","last_active":"2023-07-09T21:22:31.859420+0000","last_peered":"2023-07-09T21:22:31.859420+0000","last_clean":"2023-07-09T21:22:31.859420+0000","last_became_active":"2023-07-09T21:22:31.849776+0000","last_became_peered":"2023-07-09T21:22:31.849776+0000","last_unstale":"2023-07-09T21:22:31.859420+0000","last_undegraded":"2023-07-09T21:22:31.859420+0000","last_fullsized":"2023-07-09T21:22:31.859420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830414+0000","last_change":"2023-07-09T21:22:31.870733+0000","last_active":"2023-07-09T21:22:32.830414+0000","last_peered":"2023-07-09T21:22:32.830414+0000","last_clean":"2023-07-09T21:22:32.830414+0000","last_became_active":"2023-07-09T21:22:31.870386+0000","last_became_peered":"2023-07-09T21:22:31.870386+0000","last_unstale":"2023-07-09T21:22:32.830414+0000","last_undegraded":"2023-07-09T21:22:32.830414+0000","last_fullsized":"2023-07-09T21:22:32.830414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837191+0000","last_change":"2023-07-09T21:22:30.843731+0000","last_active":"2023-07-09T21:22:31.837191+0000","last_peered":"2023-07-09T21:22:31.837191+0000","last_clean":"2023-07-09T21:22:31.837191+0000","last_became_active":"2023-07-09T21:22:30.839924+0000","last_became_peered":"2023-07-09T21:22:30.839924+0000","last_unstale":"2023-07-09T21:22:31.837191+0000","last_undegraded":"2023-07-09T21:22:31.837191+0000","last_fullsized":"2023-07-09T21:22:31.837191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862018+0000","last_change":"2023-07-09T21:22:31.853288+0000","last_active":"2023-07-09T21:22:31.862018+0000","last_peered":"2023-07-09T21:22:31.862018+0000","last_clean":"2023-07-09T21:22:31.862018+0000","last_became_active":"2023-07-09T21:22:31.852965+0000","last_became_peered":"2023-07-09T21:22:31.852965+0000","last_unstale":"2023-07-09T21:22:31.862018+0000","last_undegraded":"2023-07-09T21:22:31.862018+0000","last_fullsized":"2023-07-09T21:22:31.862018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.848452+0000","last_change":"2023-07-09T21:22:30.849317+0000","last_active":"2023-07-09T21:22:31.848452+0000","last_peered":"2023-07-09T21:22:31.848452+0000","last_clean":"2023-07-09T21:22:31.848452+0000","last_became_active":"2023-07-09T21:22:30.849028+0000","last_became_peered":"2023-07-09T21:22:30.849028+0000","last_unstale":"2023-07-09T21:22:31.848452+0000","last_undegraded":"2023-07-09T21:22:31.848452+0000","last_fullsized":"2023-07-09T21:22:31.848452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859401+0000","last_change":"2023-07-09T21:22:31.853961+0000","last_active":"2023-07-09T21:22:31.859401+0000","last_peered":"2023-07-09T21:22:31.859401+0000","last_clean":"2023-07-09T21:22:31.859401+0000","last_became_active":"2023-07-09T21:22:31.853341+0000","last_became_peered":"2023-07-09T21:22:31.853341+0000","last_unstale":"2023-07-09T21:22:31.859401+0000","last_undegraded":"2023-07-09T21:22:31.859401+0000","last_fullsized":"2023-07-09T21:22:31.859401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831983+0000","last_change":"2023-07-09T21:22:30.856671+0000","last_active":"2023-07-09T21:22:32.831983+0000","last_peered":"2023-07-09T21:22:32.831983+0000","last_clean":"2023-07-09T21:22:32.831983+0000","last_became_active":"2023-07-09T21:22:30.856408+0000","last_became_peered":"2023-07-09T21:22:30.856408+0000","last_unstale":"2023-07-09T21:22:32.831983+0000","last_undegraded":"2023-07-09T21:22:32.831983+0000","last_fullsized":"2023-07-09T21:22:32.831983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860768+0000","last_change":"2023-07-09T21:22:31.856724+0000","last_active":"2023-07-09T21:22:31.860768+0000","last_peered":"2023-07-09T21:22:31.860768+0000","last_clean":"2023-07-09T21:22:31.860768+0000","last_became_active":"2023-07-09T21:22:31.855887+0000","last_became_peered":"2023-07-09T21:22:31.855887+0000","last_unstale":"2023-07-09T21:22:31.860768+0000","last_undegraded":"2023-07-09T21:22:31.860768+0000","last_fullsized":"2023-07-09T21:22:31.860768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.856248+0000","last_change":"2023-07-09T21:22:30.856613+0000","last_active":"2023-07-09T21:22:31.856248+0000","last_peered":"2023-07-09T21:22:31.856248+0000","last_clean":"2023-07-09T21:22:31.856248+0000","last_became_active":"2023-07-09T21:22:30.856381+0000","last_became_peered":"2023-07-09T21:22:30.856381+0000","last_unstale":"2023-07-09T21:22:31.856248+0000","last_undegraded":"2023-07-09T21:22:31.856248+0000","last_fullsized":"2023-07-09T21:22:31.856248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831645+0000","last_change":"2023-07-09T21:22:31.853264+0000","last_active":"2023-07-09T21:22:32.831645+0000","last_peered":"2023-07-09T21:22:32.831645+0000","last_clean":"2023-07-09T21:22:32.831645+0000","last_became_active":"2023-07-09T21:22:31.852950+0000","last_became_peered":"2023-07-09T21:22:31.852950+0000","last_unstale":"2023-07-09T21:22:32.831645+0000","last_undegraded":"2023-07-09T21:22:32.831645+0000","last_fullsized":"2023-07-09T21:22:32.831645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831443+0000","last_change":"2023-07-09T21:22:30.858476+0000","last_active":"2023-07-09T21:22:32.831443+0000","last_peered":"2023-07-09T21:22:32.831443+0000","last_clean":"2023-07-09T21:22:32.831443+0000","last_became_active":"2023-07-09T21:22:30.858135+0000","last_became_peered":"2023-07-09T21:22:30.858135+0000","last_unstale":"2023-07-09T21:22:32.831443+0000","last_undegraded":"2023-07-09T21:22:32.831443+0000","last_fullsized":"2023-07-09T21:22:32.831443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831673+0000","last_change":"2023-07-09T21:22:31.847803+0000","last_active":"2023-07-09T21:22:32.831673+0000","last_peered":"2023-07-09T21:22:32.831673+0000","last_clean":"2023-07-09T21:22:32.831673+0000","last_became_active":"2023-07-09T21:22:31.847509+0000","last_became_peered":"2023-07-09T21:22:31.847509+0000","last_unstale":"2023-07-09T21:22:32.831673+0000","last_undegraded":"2023-07-09T21:22:32.831673+0000","last_fullsized":"2023-07-09T21:22:32.831673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831760+0000","last_change":"2023-07-09T21:22:30.858399+0000","last_active":"2023-07-09T21:22:32.831760+0000","last_peered":"2023-07-09T21:22:32.831760+0000","last_clean":"2023-07-09T21:22:32.831760+0000","last_became_active":"2023-07-09T21:22:30.858113+0000","last_became_peered":"2023-07-09T21:22:30.858113+0000","last_unstale":"2023-07-09T21:22:32.831760+0000","last_undegraded":"2023-07-09T21:22:32.831760+0000","last_fullsized":"2023-07-09T21:22:32.831760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:18.521756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.858908+0000","last_change":"2023-07-09T21:22:31.850287+0000","last_active":"2023-07-09T21:22:31.858908+0000","last_peered":"2023-07-09T21:22:31.858908+0000","last_clean":"2023-07-09T21:22:31.858908+0000","last_became_active":"2023-07-09T21:22:31.849962+0000","last_became_peered":"2023-07-09T21:22:31.849962+0000","last_unstale":"2023-07-09T21:22:31.858908+0000","last_undegraded":"2023-07-09T21:22:31.858908+0000","last_fullsized":"2023-07-09T21:22:31.858908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:46.073213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850593+0000","last_change":"2023-07-09T21:22:30.834480+0000","last_active":"2023-07-09T21:22:31.850593+0000","last_peered":"2023-07-09T21:22:31.850593+0000","last_clean":"2023-07-09T21:22:31.850593+0000","last_became_active":"2023-07-09T21:22:30.834184+0000","last_became_peered":"2023-07-09T21:22:30.834184+0000","last_unstale":"2023-07-09T21:22:31.850593+0000","last_undegraded":"2023-07-09T21:22:31.850593+0000","last_fullsized":"2023-07-09T21:22:31.850593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:31.964272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.851493+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.851203+0000","last_became_peered":"2023-07-09T21:22:31.851203+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.870403+0000","last_change":"2023-07-09T21:22:30.846855+0000","last_active":"2023-07-09T21:22:31.870403+0000","last_peered":"2023-07-09T21:22:31.870403+0000","last_clean":"2023-07-09T21:22:31.870403+0000","last_became_active":"2023-07-09T21:22:30.846556+0000","last_became_peered":"2023-07-09T21:22:30.846556+0000","last_unstale":"2023-07-09T21:22:31.870403+0000","last_undegraded":"2023-07-09T21:22:31.870403+0000","last_fullsized":"2023-07-09T21:22:31.870403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:45.066594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":83598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:22:35.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:22:36.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 Processor -- start 2023-07-09T21:22:36.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 -- start start 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f104015ba20 0x7f10400cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f104006c330 0x7f10400ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f104015bdf0 con 0x7f10400b1a30 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104006b650 con 0x7f104015ba20 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1046dfa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400b2720 con 0x7f104006c330 2023-07-09T21:22:36.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.138+0000 7f1044b96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f104015ba20 0x7f10400cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f104015ba20 0x7f10400cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48456/0 (socket says 172.21.15.37:48456) 2023-07-09T21:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1045397640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f10400b1a30 0x7f10400b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41882/0 (socket says 172.21.15.37:41882) 2023-07-09T21:22:36.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 -- 172.21.15.37:0/3908879376 learned_addr learned my addr 172.21.15.37:0/3908879376 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f103ffff640 1 --2- 172.21.15.37:0/3908879376 >> v2:172.21.15.119:3300/0 conn(0x7f104006c330 0x7f10400ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 -- 172.21.15.37:0/3908879376 >> v2:172.21.15.119:3300/0 conn(0x7f104006c330 msgr2=0x7f10400ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 --2- 172.21.15.37:0/3908879376 >> v2:172.21.15.119:3300/0 conn(0x7f104006c330 0x7f10400ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f103f7fe640 1 -- 172.21.15.37:0/3908879376 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182459758 0 0) 0x7f104015bdf0 con 0x7f10400b1a30 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 -- 172.21.15.37:0/3908879376 >> v1:172.21.15.37:6789/0 conn(0x7f10400b1a30 legacy=0x7f10400b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 -- 172.21.15.37:0/3908879376 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104006b850 con 0x7f104015ba20 2023-07-09T21:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f1044b96640 1 --2- 172.21.15.37:0/3908879376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104015ba20 0x7f10400cc9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f104006f9a0 tx=0x7f103401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4b528561005051f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f103f7fe640 1 -- 172.21.15.37:0/3908879376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340ac630 con 0x7f104015ba20 2023-07-09T21:22:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f103f7fe640 1 -- 172.21.15.37:0/3908879376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10340ac790 con 0x7f104015ba20 2023-07-09T21:22:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.142+0000 7f103f7fe640 1 -- 172.21.15.37:0/3908879376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340acb20 con 0x7f104015ba20 2023-07-09T21:22:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- 172.21.15.37:0/3908879376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104015ba20 msgr2=0x7f10400cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- 172.21.15.37:0/3908879376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104015ba20 0x7f10400cc9c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f104006f9a0 tx=0x7f103401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- 172.21.15.37:0/3908879376 shutdown_connections 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- 172.21.15.37:0/3908879376 >> v2:172.21.15.119:3300/0 conn(0x7f104006c330 0x7f10400ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- 172.21.15.37:0/3908879376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104015ba20 0x7f10400cc9c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- 172.21.15.37:0/3908879376 >> 172.21.15.37:0/3908879376 conn(0x7f1040072400 msgr2=0x7f1040072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- 172.21.15.37:0/3908879376 shutdown_connections 2023-07-09T21:22:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- 172.21.15.37:0/3908879376 wait complete. 2023-07-09T21:22:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 Processor -- start 2023-07-09T21:22:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- start start 2023-07-09T21:22:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 0x7f104014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f104015ba20 0x7f104014a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104015d120 con 0x7f104006c330 2023-07-09T21:22:36.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104015ce40 con 0x7f10400b1a30 2023-07-09T21:22:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1046dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b39e0 con 0x7f104015ba20 2023-07-09T21:22:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48462/0 (socket says 172.21.15.37:48462) 2023-07-09T21:22:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 -- 172.21.15.37:0/2173987662 learned_addr learned my addr 172.21.15.37:0/2173987662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f103ffff640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 0x7f104014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1045397640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f104015ba20 0x7f104014a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 -- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f104015ba20 msgr2=0x7f104014a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f104015ba20 0x7f104014a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 -- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 msgr2=0x7f104014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 0x7f104014a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f1044b96640 1 -- 172.21.15.37:0/2173987662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340094d0 con 0x7f104006c330 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.146+0000 7f103ffff640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 0x7f104014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f1044b96640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10340190e0 tx=0x7f103401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034004230 con 0x7f104006c330 2023-07-09T21:22:36.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1034004390 con 0x7f104006c330 2023-07-09T21:22:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1034003820 con 0x7f104006c330 2023-07-09T21:22:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10400b3cc0 con 0x7f104006c330 2023-07-09T21:22:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104015e0d0 con 0x7f104006c330 2023-07-09T21:22:36.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104015e2c0 con 0x7f104006c330 2023-07-09T21:22:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f10340b3050 con 0x7f104006c330 2023-07-09T21:22:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 0x7f1024068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f103411dfc0 con 0x7f104006c330 2023-07-09T21:22:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.150+0000 7f103ffff640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 0x7f1024068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.154+0000 7f103ffff640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 0x7f1024068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f104014b670 tx=0x7f102c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.154+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f104015e2c0 con 0x7f104006c330 2023-07-09T21:22:36.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.306+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10400b3860 con 0x7f1024066280 2023-07-09T21:22:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.314+0000 7f103d7fa640 1 -- 172.21.15.37:0/2173987662 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286738 (secure 0 0 0) 0x7f102c007710 con 0x7f1024066280 2023-07-09T21:22:36.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:22:36.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 msgr2=0x7f1024068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 0x7f1024068730 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f104014b670 tx=0x7f102c008040 comp rx=0 tx=0).stop 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 msgr2=0x7f104015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f10340190e0 tx=0x7f103401ad10 comp rx=0 tx=0).stop 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 shutdown_connections 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1024066280 0x7f1024068730 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f104015ba20 0x7f104014a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10400b1a30 0x7f104014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 --2- 172.21.15.37:0/2173987662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f104006c330 0x7f104015db90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 >> 172.21.15.37:0/2173987662 conn(0x7f1040072400 msgr2=0x7f10400ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 shutdown_connections 2023-07-09T21:22:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.318+0000 7f1046dfa640 1 -- 172.21.15.37:0/2173987662 wait complete. 2023-07-09T21:22:36.341 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:22:35.954551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222728,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751992,"statfs":{"total":773094113280,"available":772866039808,"internally_reserved":0,"allocated":3088384,"data_stored":1849028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001865"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.851586+0000","last_change":"2023-07-09T21:22:31.846882+0000","last_active":"2023-07-09T21:22:31.851586+0000","last_peered":"2023-07-09T21:22:31.851586+0000","last_clean":"2023-07-09T21:22:31.851586+0000","last_became_active":"2023-07-09T21:22:31.846526+0000","last_became_peered":"2023-07-09T21:22:31.846526+0000","last_unstale":"2023-07-09T21:22:31.851586+0000","last_undegraded":"2023-07-09T21:22:31.851586+0000","last_fullsized":"2023-07-09T21:22:31.851586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:03.282921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831655+0000","last_change":"2023-07-09T21:22:31.865763+0000","last_active":"2023-07-09T21:22:32.831655+0000","last_peered":"2023-07-09T21:22:32.831655+0000","last_clean":"2023-07-09T21:22:32.831655+0000","last_became_active":"2023-07-09T21:22:31.865352+0000","last_became_peered":"2023-07-09T21:22:31.865352+0000","last_unstale":"2023-07-09T21:22:32.831655+0000","last_undegraded":"2023-07-09T21:22:32.831655+0000","last_fullsized":"2023-07-09T21:22:32.831655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832722+0000","last_change":"2023-07-09T21:22:31.852655+0000","last_active":"2023-07-09T21:22:32.832722+0000","last_peered":"2023-07-09T21:22:32.832722+0000","last_clean":"2023-07-09T21:22:32.832722+0000","last_became_active":"2023-07-09T21:22:31.852014+0000","last_became_peered":"2023-07-09T21:22:31.852014+0000","last_unstale":"2023-07-09T21:22:32.832722+0000","last_undegraded":"2023-07-09T21:22:32.832722+0000","last_fullsized":"2023-07-09T21:22:32.832722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830239+0000","last_change":"2023-07-09T21:22:31.851591+0000","last_active":"2023-07-09T21:22:32.830239+0000","last_peered":"2023-07-09T21:22:32.830239+0000","last_clean":"2023-07-09T21:22:32.830239+0000","last_became_active":"2023-07-09T21:22:31.851326+0000","last_became_peered":"2023-07-09T21:22:31.851326+0000","last_unstale":"2023-07-09T21:22:32.830239+0000","last_undegraded":"2023-07-09T21:22:32.830239+0000","last_fullsized":"2023-07-09T21:22:32.830239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:43.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857795+0000","last_change":"2023-07-09T21:22:31.845576+0000","last_active":"2023-07-09T21:22:31.857795+0000","last_peered":"2023-07-09T21:22:31.857795+0000","last_clean":"2023-07-09T21:22:31.857795+0000","last_became_active":"2023-07-09T21:22:31.844904+0000","last_became_peered":"2023-07-09T21:22:31.844904+0000","last_unstale":"2023-07-09T21:22:31.857795+0000","last_undegraded":"2023-07-09T21:22:31.857795+0000","last_fullsized":"2023-07-09T21:22:31.857795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831539+0000","last_change":"2023-07-09T21:22:31.853123+0000","last_active":"2023-07-09T21:22:32.831539+0000","last_peered":"2023-07-09T21:22:32.831539+0000","last_clean":"2023-07-09T21:22:32.831539+0000","last_became_active":"2023-07-09T21:22:31.852855+0000","last_became_peered":"2023-07-09T21:22:31.852855+0000","last_unstale":"2023-07-09T21:22:32.831539+0000","last_undegraded":"2023-07-09T21:22:32.831539+0000","last_fullsized":"2023-07-09T21:22:32.831539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.865696+0000","last_change":"2023-07-09T21:22:31.859422+0000","last_active":"2023-07-09T21:22:31.865696+0000","last_peered":"2023-07-09T21:22:31.865696+0000","last_clean":"2023-07-09T21:22:31.865696+0000","last_became_active":"2023-07-09T21:22:31.859125+0000","last_became_peered":"2023-07-09T21:22:31.859125+0000","last_unstale":"2023-07-09T21:22:31.865696+0000","last_undegraded":"2023-07-09T21:22:31.865696+0000","last_fullsized":"2023-07-09T21:22:31.865696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:01.323418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830707+0000","last_change":"2023-07-09T21:22:31.859849+0000","last_active":"2023-07-09T21:22:32.830707+0000","last_peered":"2023-07-09T21:22:32.830707+0000","last_clean":"2023-07-09T21:22:32.830707+0000","last_became_active":"2023-07-09T21:22:31.859115+0000","last_became_peered":"2023-07-09T21:22:31.859115+0000","last_unstale":"2023-07-09T21:22:32.830707+0000","last_undegraded":"2023-07-09T21:22:32.830707+0000","last_fullsized":"2023-07-09T21:22:32.830707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857772+0000","last_change":"2023-07-09T21:22:31.847329+0000","last_active":"2023-07-09T21:22:31.857772+0000","last_peered":"2023-07-09T21:22:31.857772+0000","last_clean":"2023-07-09T21:22:31.857772+0000","last_became_active":"2023-07-09T21:22:31.847067+0000","last_became_peered":"2023-07-09T21:22:31.847067+0000","last_unstale":"2023-07-09T21:22:31.857772+0000","last_undegraded":"2023-07-09T21:22:31.857772+0000","last_fullsized":"2023-07-09T21:22:31.857772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:26.099785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831808+0000","last_change":"2023-07-09T21:22:31.865305+0000","last_active":"2023-07-09T21:22:32.831808+0000","last_peered":"2023-07-09T21:22:32.831808+0000","last_clean":"2023-07-09T21:22:32.831808+0000","last_became_active":"2023-07-09T21:22:31.864992+0000","last_became_peered":"2023-07-09T21:22:31.864992+0000","last_unstale":"2023-07-09T21:22:32.831808+0000","last_undegraded":"2023-07-09T21:22:32.831808+0000","last_fullsized":"2023-07-09T21:22:32.831808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832758+0000","last_change":"2023-07-09T21:22:31.855739+0000","last_active":"2023-07-09T21:22:32.832758+0000","last_peered":"2023-07-09T21:22:32.832758+0000","last_clean":"2023-07-09T21:22:32.832758+0000","last_became_active":"2023-07-09T21:22:31.854569+0000","last_became_peered":"2023-07-09T21:22:31.854569+0000","last_unstale":"2023-07-09T21:22:32.832758+0000","last_undegraded":"2023-07-09T21:22:32.832758+0000","last_fullsized":"2023-07-09T21:22:32.832758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860788+0000","last_change":"2023-07-09T21:22:31.856905+0000","last_active":"2023-07-09T21:22:31.860788+0000","last_peered":"2023-07-09T21:22:31.860788+0000","last_clean":"2023-07-09T21:22:31.860788+0000","last_became_active":"2023-07-09T21:22:31.856417+0000","last_became_peered":"2023-07-09T21:22:31.856417+0000","last_unstale":"2023-07-09T21:22:31.860788+0000","last_undegraded":"2023-07-09T21:22:31.860788+0000","last_fullsized":"2023-07-09T21:22:31.860788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:56:51.977345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.851422+0000","last_change":"2023-07-09T21:22:31.845104+0000","last_active":"2023-07-09T21:22:31.851422+0000","last_peered":"2023-07-09T21:22:31.851422+0000","last_clean":"2023-07-09T21:22:31.851422+0000","last_became_active":"2023-07-09T21:22:31.844818+0000","last_became_peered":"2023-07-09T21:22:31.844818+0000","last_unstale":"2023-07-09T21:22:31.851422+0000","last_undegraded":"2023-07-09T21:22:31.851422+0000","last_fullsized":"2023-07-09T21:22:31.851422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:40.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831167+0000","last_change":"2023-07-09T21:22:31.866886+0000","last_active":"2023-07-09T21:22:32.831167+0000","last_peered":"2023-07-09T21:22:32.831167+0000","last_clean":"2023-07-09T21:22:32.831167+0000","last_became_active":"2023-07-09T21:22:31.866546+0000","last_became_peered":"2023-07-09T21:22:31.866546+0000","last_unstale":"2023-07-09T21:22:32.831167+0000","last_undegraded":"2023-07-09T21:22:32.831167+0000","last_fullsized":"2023-07-09T21:22:32.831167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861339+0000","last_change":"2023-07-09T21:22:31.858913+0000","last_active":"2023-07-09T21:22:31.861339+0000","last_peered":"2023-07-09T21:22:31.861339+0000","last_clean":"2023-07-09T21:22:31.861339+0000","last_became_active":"2023-07-09T21:22:31.858642+0000","last_became_peered":"2023-07-09T21:22:31.858642+0000","last_unstale":"2023-07-09T21:22:31.861339+0000","last_undegraded":"2023-07-09T21:22:31.861339+0000","last_fullsized":"2023-07-09T21:22:31.861339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.847866+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.847543+0000","last_became_peered":"2023-07-09T21:22:31.847543+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.857750+0000","last_change":"2023-07-09T21:22:31.846826+0000","last_active":"2023-07-09T21:22:31.857750+0000","last_peered":"2023-07-09T21:22:31.857750+0000","last_clean":"2023-07-09T21:22:31.857750+0000","last_became_active":"2023-07-09T21:22:31.846429+0000","last_became_peered":"2023-07-09T21:22:31.846429+0000","last_unstale":"2023-07-09T21:22:31.857750+0000","last_undegraded":"2023-07-09T21:22:31.857750+0000","last_fullsized":"2023-07-09T21:22:31.857750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:03.282921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832648+0000","last_change":"2023-07-09T21:22:31.852252+0000","last_active":"2023-07-09T21:22:32.832648+0000","last_peered":"2023-07-09T21:22:32.832648+0000","last_clean":"2023-07-09T21:22:32.832648+0000","last_became_active":"2023-07-09T21:22:31.851797+0000","last_became_peered":"2023-07-09T21:22:31.851797+0000","last_unstale":"2023-07-09T21:22:32.832648+0000","last_undegraded":"2023-07-09T21:22:32.832648+0000","last_fullsized":"2023-07-09T21:22:32.832648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.852825+0000","last_change":"2023-07-09T21:22:31.848525+0000","last_active":"2023-07-09T21:22:31.852825+0000","last_peered":"2023-07-09T21:22:31.852825+0000","last_clean":"2023-07-09T21:22:31.852825+0000","last_became_active":"2023-07-09T21:22:31.847570+0000","last_became_peered":"2023-07-09T21:22:31.847570+0000","last_unstale":"2023-07-09T21:22:31.852825+0000","last_undegraded":"2023-07-09T21:22:31.852825+0000","last_fullsized":"2023-07-09T21:22:31.852825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:26.099785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832660+0000","last_change":"2023-07-09T21:22:31.855749+0000","last_active":"2023-07-09T21:22:32.832660+0000","last_peered":"2023-07-09T21:22:32.832660+0000","last_clean":"2023-07-09T21:22:32.832660+0000","last_became_active":"2023-07-09T21:22:31.855457+0000","last_became_peered":"2023-07-09T21:22:31.855457+0000","last_unstale":"2023-07-09T21:22:32.832660+0000","last_undegraded":"2023-07-09T21:22:32.832660+0000","last_fullsized":"2023-07-09T21:22:32.832660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.868232+0000","last_change":"2023-07-09T21:22:31.862987+0000","last_active":"2023-07-09T21:22:31.868232+0000","last_peered":"2023-07-09T21:22:31.868232+0000","last_clean":"2023-07-09T21:22:31.868232+0000","last_became_active":"2023-07-09T21:22:31.862706+0000","last_became_peered":"2023-07-09T21:22:31.862706+0000","last_unstale":"2023-07-09T21:22:31.868232+0000","last_undegraded":"2023-07-09T21:22:31.868232+0000","last_fullsized":"2023-07-09T21:22:31.868232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862114+0000","last_change":"2023-07-09T21:22:31.856986+0000","last_active":"2023-07-09T21:22:31.862114+0000","last_peered":"2023-07-09T21:22:31.862114+0000","last_clean":"2023-07-09T21:22:31.862114+0000","last_became_active":"2023-07-09T21:22:31.856738+0000","last_became_peered":"2023-07-09T21:22:31.856738+0000","last_unstale":"2023-07-09T21:22:31.862114+0000","last_undegraded":"2023-07-09T21:22:31.862114+0000","last_fullsized":"2023-07-09T21:22:31.862114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:56:51.977345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.858885+0000","last_change":"2023-07-09T21:22:31.848593+0000","last_active":"2023-07-09T21:22:31.858885+0000","last_peered":"2023-07-09T21:22:31.858885+0000","last_clean":"2023-07-09T21:22:31.858885+0000","last_became_active":"2023-07-09T21:22:31.848310+0000","last_became_peered":"2023-07-09T21:22:31.848310+0000","last_unstale":"2023-07-09T21:22:31.858885+0000","last_undegraded":"2023-07-09T21:22:31.858885+0000","last_fullsized":"2023-07-09T21:22:31.858885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.868213+0000","last_change":"2023-07-09T21:22:31.862953+0000","last_active":"2023-07-09T21:22:31.868213+0000","last_peered":"2023-07-09T21:22:31.868213+0000","last_clean":"2023-07-09T21:22:31.868213+0000","last_became_active":"2023-07-09T21:22:31.862334+0000","last_became_peered":"2023-07-09T21:22:31.862334+0000","last_unstale":"2023-07-09T21:22:31.868213+0000","last_undegraded":"2023-07-09T21:22:31.868213+0000","last_fullsized":"2023-07-09T21:22:31.868213+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861166+0000","last_change":"2023-07-09T21:22:31.854043+0000","last_active":"2023-07-09T21:22:31.861166+0000","last_peered":"2023-07-09T21:22:31.861166+0000","last_clean":"2023-07-09T21:22:31.861166+0000","last_became_active":"2023-07-09T21:22:31.853765+0000","last_became_peered":"2023-07-09T21:22:31.853765+0000","last_unstale":"2023-07-09T21:22:31.861166+0000","last_undegraded":"2023-07-09T21:22:31.861166+0000","last_fullsized":"2023-07-09T21:22:31.861166+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:46.073213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.852424+0000","last_change":"2023-07-09T21:22:31.843774+0000","last_active":"2023-07-09T21:22:31.852424+0000","last_peered":"2023-07-09T21:22:31.852424+0000","last_clean":"2023-07-09T21:22:31.852424+0000","last_became_active":"2023-07-09T21:22:31.843507+0000","last_became_peered":"2023-07-09T21:22:31.843507+0000","last_unstale":"2023-07-09T21:22:31.852424+0000","last_undegraded":"2023-07-09T21:22:31.852424+0000","last_fullsized":"2023-07-09T21:22:31.852424+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831070+0000","last_change":"2023-07-09T21:22:31.865931+0000","last_active":"2023-07-09T21:22:32.831070+0000","last_peered":"2023-07-09T21:22:32.831070+0000","last_clean":"2023-07-09T21:22:32.831070+0000","last_became_active":"2023-07-09T21:22:31.865659+0000","last_became_peered":"2023-07-09T21:22:31.865659+0000","last_unstale":"2023-07-09T21:22:32.831070+0000","last_undegraded":"2023-07-09T21:22:32.831070+0000","last_fullsized":"2023-07-09T21:22:32.831070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862682+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:31.862682+0000","last_peered":"2023-07-09T21:22:31.862682+0000","last_clean":"2023-07-09T21:22:31.862682+0000","last_became_active":"2023-07-09T21:22:31.856284+0000","last_became_peered":"2023-07-09T21:22:31.856284+0000","last_unstale":"2023-07-09T21:22:31.862682+0000","last_undegraded":"2023-07-09T21:22:31.862682+0000","last_fullsized":"2023-07-09T21:22:31.862682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859332+0000","last_change":"2023-07-09T21:22:31.854071+0000","last_active":"2023-07-09T21:22:31.859332+0000","last_peered":"2023-07-09T21:22:31.859332+0000","last_clean":"2023-07-09T21:22:31.859332+0000","last_became_active":"2023-07-09T21:22:31.853768+0000","last_became_peered":"2023-07-09T21:22:31.853768+0000","last_unstale":"2023-07-09T21:22:31.859332+0000","last_undegraded":"2023-07-09T21:22:31.859332+0000","last_fullsized":"2023-07-09T21:22:31.859332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831876+0000","last_change":"2023-07-09T21:22:31.847820+0000","last_active":"2023-07-09T21:22:32.831876+0000","last_peered":"2023-07-09T21:22:32.831876+0000","last_clean":"2023-07-09T21:22:32.831876+0000","last_became_active":"2023-07-09T21:22:31.847484+0000","last_became_peered":"2023-07-09T21:22:31.847484+0000","last_unstale":"2023-07-09T21:22:32.831876+0000","last_undegraded":"2023-07-09T21:22:32.831876+0000","last_fullsized":"2023-07-09T21:22:32.831876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859449+0000","last_change":"2023-07-09T21:22:31.855297+0000","last_active":"2023-07-09T21:22:31.859449+0000","last_peered":"2023-07-09T21:22:31.859449+0000","last_clean":"2023-07-09T21:22:31.859449+0000","last_became_active":"2023-07-09T21:22:31.855025+0000","last_became_peered":"2023-07-09T21:22:31.855025+0000","last_unstale":"2023-07-09T21:22:31.859449+0000","last_undegraded":"2023-07-09T21:22:31.859449+0000","last_fullsized":"2023-07-09T21:22:31.859449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829783+0000","last_change":"2023-07-09T21:22:31.847753+0000","last_active":"2023-07-09T21:22:32.829783+0000","last_peered":"2023-07-09T21:22:32.829783+0000","last_clean":"2023-07-09T21:22:32.829783+0000","last_became_active":"2023-07-09T21:22:31.847425+0000","last_became_peered":"2023-07-09T21:22:31.847425+0000","last_unstale":"2023-07-09T21:22:32.829783+0000","last_undegraded":"2023-07-09T21:22:32.829783+0000","last_fullsized":"2023-07-09T21:22:32.829783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859371+0000","last_change":"2023-07-09T21:22:31.853654+0000","last_active":"2023-07-09T21:22:31.859371+0000","last_peered":"2023-07-09T21:22:31.859371+0000","last_clean":"2023-07-09T21:22:31.859371+0000","last_became_active":"2023-07-09T21:22:31.853302+0000","last_became_peered":"2023-07-09T21:22:31.853302+0000","last_unstale":"2023-07-09T21:22:31.859371+0000","last_undegraded":"2023-07-09T21:22:31.859371+0000","last_fullsized":"2023-07-09T21:22:31.859371+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854727+0000","last_change":"2023-07-09T21:22:30.856062+0000","last_active":"2023-07-09T21:22:31.854727+0000","last_peered":"2023-07-09T21:22:31.854727+0000","last_clean":"2023-07-09T21:22:31.854727+0000","last_became_active":"2023-07-09T21:22:30.855739+0000","last_became_peered":"2023-07-09T21:22:30.855739+0000","last_unstale":"2023-07-09T21:22:31.854727+0000","last_undegraded":"2023-07-09T21:22:31.854727+0000","last_fullsized":"2023-07-09T21:22:31.854727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:56.259324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831637+0000","last_change":"2023-07-09T21:22:31.865421+0000","last_active":"2023-07-09T21:22:32.831637+0000","last_peered":"2023-07-09T21:22:32.831637+0000","last_clean":"2023-07-09T21:22:32.831637+0000","last_became_active":"2023-07-09T21:22:31.865018+0000","last_became_peered":"2023-07-09T21:22:31.865018+0000","last_unstale":"2023-07-09T21:22:32.831637+0000","last_undegraded":"2023-07-09T21:22:32.831637+0000","last_fullsized":"2023-07-09T21:22:32.831637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.840674+0000","last_change":"2023-07-09T21:22:30.844420+0000","last_active":"2023-07-09T21:22:31.840674+0000","last_peered":"2023-07-09T21:22:31.840674+0000","last_clean":"2023-07-09T21:22:31.840674+0000","last_became_active":"2023-07-09T21:22:30.843988+0000","last_became_peered":"2023-07-09T21:22:30.843988+0000","last_unstale":"2023-07-09T21:22:31.840674+0000","last_undegraded":"2023-07-09T21:22:31.840674+0000","last_fullsized":"2023-07-09T21:22:31.840674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859021+0000","last_change":"2023-07-09T21:22:31.845772+0000","last_active":"2023-07-09T21:22:31.859021+0000","last_peered":"2023-07-09T21:22:31.859021+0000","last_clean":"2023-07-09T21:22:31.859021+0000","last_became_active":"2023-07-09T21:22:31.845435+0000","last_became_peered":"2023-07-09T21:22:31.845435+0000","last_unstale":"2023-07-09T21:22:31.859021+0000","last_undegraded":"2023-07-09T21:22:31.859021+0000","last_fullsized":"2023-07-09T21:22:31.859021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843681+0000","last_change":"2023-07-09T21:22:30.858532+0000","last_active":"2023-07-09T21:22:31.843681+0000","last_peered":"2023-07-09T21:22:31.843681+0000","last_clean":"2023-07-09T21:22:31.843681+0000","last_became_active":"2023-07-09T21:22:30.858236+0000","last_became_peered":"2023-07-09T21:22:30.858236+0000","last_unstale":"2023-07-09T21:22:31.843681+0000","last_undegraded":"2023-07-09T21:22:31.843681+0000","last_fullsized":"2023-07-09T21:22:31.843681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:09.772460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859884+0000","last_change":"2023-07-09T21:22:31.854757+0000","last_active":"2023-07-09T21:22:31.859884+0000","last_peered":"2023-07-09T21:22:31.859884+0000","last_clean":"2023-07-09T21:22:31.859884+0000","last_became_active":"2023-07-09T21:22:31.854486+0000","last_became_peered":"2023-07-09T21:22:31.854486+0000","last_unstale":"2023-07-09T21:22:31.859884+0000","last_undegraded":"2023-07-09T21:22:31.859884+0000","last_fullsized":"2023-07-09T21:22:31.859884+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:41.397827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829862+0000","last_change":"2023-07-09T21:22:30.847752+0000","last_active":"2023-07-09T21:22:32.829862+0000","last_peered":"2023-07-09T21:22:32.829862+0000","last_clean":"2023-07-09T21:22:32.829862+0000","last_became_active":"2023-07-09T21:22:30.847443+0000","last_became_peered":"2023-07-09T21:22:30.847443+0000","last_unstale":"2023-07-09T21:22:32.829862+0000","last_undegraded":"2023-07-09T21:22:32.829862+0000","last_fullsized":"2023-07-09T21:22:32.829862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854387+0000","last_change":"2023-07-09T21:22:30.858567+0000","last_active":"2023-07-09T21:22:31.854387+0000","last_peered":"2023-07-09T21:22:31.854387+0000","last_clean":"2023-07-09T21:22:31.854387+0000","last_became_active":"2023-07-09T21:22:30.858292+0000","last_became_peered":"2023-07-09T21:22:30.858292+0000","last_unstale":"2023-07-09T21:22:31.854387+0000","last_undegraded":"2023-07-09T21:22:31.854387+0000","last_fullsized":"2023-07-09T21:22:31.854387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830934+0000","last_change":"2023-07-09T21:22:31.860174+0000","last_active":"2023-07-09T21:22:32.830934+0000","last_peered":"2023-07-09T21:22:32.830934+0000","last_clean":"2023-07-09T21:22:32.830934+0000","last_became_active":"2023-07-09T21:22:31.859534+0000","last_became_peered":"2023-07-09T21:22:31.859534+0000","last_unstale":"2023-07-09T21:22:32.830934+0000","last_undegraded":"2023-07-09T21:22:32.830934+0000","last_fullsized":"2023-07-09T21:22:32.830934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.854315+0000","last_change":"2023-07-09T21:22:30.859109+0000","last_active":"2023-07-09T21:22:31.854315+0000","last_peered":"2023-07-09T21:22:31.854315+0000","last_clean":"2023-07-09T21:22:31.854315+0000","last_became_active":"2023-07-09T21:22:30.858847+0000","last_became_peered":"2023-07-09T21:22:30.858847+0000","last_unstale":"2023-07-09T21:22:31.854315+0000","last_undegraded":"2023-07-09T21:22:31.854315+0000","last_fullsized":"2023-07-09T21:22:31.854315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:56.855251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.853909+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.853620+0000","last_became_peered":"2023-07-09T21:22:31.853620+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.870329+0000","last_change":"2023-07-09T21:22:30.843222+0000","last_active":"2023-07-09T21:22:31.870329+0000","last_peered":"2023-07-09T21:22:31.870329+0000","last_clean":"2023-07-09T21:22:31.870329+0000","last_became_active":"2023-07-09T21:22:30.842674+0000","last_became_peered":"2023-07-09T21:22:30.842674+0000","last_unstale":"2023-07-09T21:22:31.870329+0000","last_undegraded":"2023-07-09T21:22:31.870329+0000","last_fullsized":"2023-07-09T21:22:31.870329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:01.551080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829829+0000","last_change":"2023-07-09T21:22:31.862216+0000","last_active":"2023-07-09T21:22:32.829829+0000","last_peered":"2023-07-09T21:22:32.829829+0000","last_clean":"2023-07-09T21:22:32.829829+0000","last_became_active":"2023-07-09T21:22:31.861894+0000","last_became_peered":"2023-07-09T21:22:31.861894+0000","last_unstale":"2023-07-09T21:22:32.829829+0000","last_undegraded":"2023-07-09T21:22:32.829829+0000","last_fullsized":"2023-07-09T21:22:32.829829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831409+0000","last_change":"2023-07-09T21:22:30.851190+0000","last_active":"2023-07-09T21:22:32.831409+0000","last_peered":"2023-07-09T21:22:32.831409+0000","last_clean":"2023-07-09T21:22:32.831409+0000","last_became_active":"2023-07-09T21:22:30.850854+0000","last_became_peered":"2023-07-09T21:22:30.850854+0000","last_unstale":"2023-07-09T21:22:32.831409+0000","last_undegraded":"2023-07-09T21:22:32.831409+0000","last_fullsized":"2023-07-09T21:22:32.831409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.861917+0000","last_change":"2023-07-09T21:22:31.851686+0000","last_active":"2023-07-09T21:22:31.861917+0000","last_peered":"2023-07-09T21:22:31.861917+0000","last_clean":"2023-07-09T21:22:31.861917+0000","last_became_active":"2023-07-09T21:22:31.851409+0000","last_became_peered":"2023-07-09T21:22:31.851409+0000","last_unstale":"2023-07-09T21:22:31.861917+0000","last_undegraded":"2023-07-09T21:22:31.861917+0000","last_fullsized":"2023-07-09T21:22:31.861917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860377+0000","last_change":"2023-07-09T21:22:30.850817+0000","last_active":"2023-07-09T21:22:31.860377+0000","last_peered":"2023-07-09T21:22:31.860377+0000","last_clean":"2023-07-09T21:22:31.860377+0000","last_became_active":"2023-07-09T21:22:30.850487+0000","last_became_peered":"2023-07-09T21:22:30.850487+0000","last_unstale":"2023-07-09T21:22:31.860377+0000","last_undegraded":"2023-07-09T21:22:31.860377+0000","last_fullsized":"2023-07-09T21:22:31.860377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:24.803685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832857+0000","last_change":"2023-07-09T21:22:31.856467+0000","last_active":"2023-07-09T21:22:32.832857+0000","last_peered":"2023-07-09T21:22:32.832857+0000","last_clean":"2023-07-09T21:22:32.832857+0000","last_became_active":"2023-07-09T21:22:31.855212+0000","last_became_peered":"2023-07-09T21:22:31.855212+0000","last_unstale":"2023-07-09T21:22:32.832857+0000","last_undegraded":"2023-07-09T21:22:32.832857+0000","last_fullsized":"2023-07-09T21:22:32.832857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:55.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830026+0000","last_change":"2023-07-09T21:22:30.857694+0000","last_active":"2023-07-09T21:22:32.830026+0000","last_peered":"2023-07-09T21:22:32.830026+0000","last_clean":"2023-07-09T21:22:32.830026+0000","last_became_active":"2023-07-09T21:22:30.857229+0000","last_became_peered":"2023-07-09T21:22:30.857229+0000","last_unstale":"2023-07-09T21:22:32.830026+0000","last_undegraded":"2023-07-09T21:22:32.830026+0000","last_fullsized":"2023-07-09T21:22:32.830026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832851+0000","last_change":"2023-07-09T21:22:31.850987+0000","last_active":"2023-07-09T21:22:32.832851+0000","last_peered":"2023-07-09T21:22:32.832851+0000","last_clean":"2023-07-09T21:22:32.832851+0000","last_became_active":"2023-07-09T21:22:31.850653+0000","last_became_peered":"2023-07-09T21:22:31.850653+0000","last_unstale":"2023-07-09T21:22:32.832851+0000","last_undegraded":"2023-07-09T21:22:32.832851+0000","last_fullsized":"2023-07-09T21:22:32.832851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832117+0000","last_change":"2023-07-09T21:22:30.856178+0000","last_active":"2023-07-09T21:22:32.832117+0000","last_peered":"2023-07-09T21:22:32.832117+0000","last_clean":"2023-07-09T21:22:32.832117+0000","last_became_active":"2023-07-09T21:22:30.855740+0000","last_became_peered":"2023-07-09T21:22:30.855740+0000","last_unstale":"2023-07-09T21:22:32.832117+0000","last_undegraded":"2023-07-09T21:22:32.832117+0000","last_fullsized":"2023-07-09T21:22:32.832117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832756+0000","last_change":"2023-07-09T21:22:31.852075+0000","last_active":"2023-07-09T21:22:32.832756+0000","last_peered":"2023-07-09T21:22:32.832756+0000","last_clean":"2023-07-09T21:22:32.832756+0000","last_became_active":"2023-07-09T21:22:31.851518+0000","last_became_peered":"2023-07-09T21:22:31.851518+0000","last_unstale":"2023-07-09T21:22:32.832756+0000","last_undegraded":"2023-07-09T21:22:32.832756+0000","last_fullsized":"2023-07-09T21:22:32.832756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837350+0000","last_change":"2023-07-09T21:22:30.850674+0000","last_active":"2023-07-09T21:22:31.837350+0000","last_peered":"2023-07-09T21:22:31.837350+0000","last_clean":"2023-07-09T21:22:31.837350+0000","last_became_active":"2023-07-09T21:22:30.847971+0000","last_became_peered":"2023-07-09T21:22:30.847971+0000","last_unstale":"2023-07-09T21:22:31.837350+0000","last_undegraded":"2023-07-09T21:22:31.837350+0000","last_fullsized":"2023-07-09T21:22:31.837350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:54.688518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.865663+0000","last_change":"2023-07-09T21:22:31.861069+0000","last_active":"2023-07-09T21:22:31.865663+0000","last_peered":"2023-07-09T21:22:31.865663+0000","last_clean":"2023-07-09T21:22:31.865663+0000","last_became_active":"2023-07-09T21:22:31.860705+0000","last_became_peered":"2023-07-09T21:22:31.860705+0000","last_unstale":"2023-07-09T21:22:31.865663+0000","last_undegraded":"2023-07-09T21:22:31.865663+0000","last_fullsized":"2023-07-09T21:22:31.865663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":173,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843794+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:22:31.843794+0000","last_peered":"2023-07-09T21:22:31.843794+0000","last_clean":"2023-07-09T21:22:31.843794+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:22:31.843794+0000","last_undegraded":"2023-07-09T21:22:31.843794+0000","last_fullsized":"2023-07-09T21:22:31.843794+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:57.150016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831034+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:22:32.831034+0000","last_peered":"2023-07-09T21:22:32.831034+0000","last_clean":"2023-07-09T21:22:32.831034+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:22:32.831034+0000","last_undegraded":"2023-07-09T21:22:32.831034+0000","last_fullsized":"2023-07-09T21:22:32.831034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:03.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837228+0000","last_change":"2023-07-09T21:22:30.843989+0000","last_active":"2023-07-09T21:22:31.837228+0000","last_peered":"2023-07-09T21:22:31.837228+0000","last_clean":"2023-07-09T21:22:31.837228+0000","last_became_active":"2023-07-09T21:22:30.843612+0000","last_became_peered":"2023-07-09T21:22:30.843612+0000","last_unstale":"2023-07-09T21:22:31.837228+0000","last_undegraded":"2023-07-09T21:22:31.837228+0000","last_fullsized":"2023-07-09T21:22:31.837228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830346+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:32.830346+0000","last_peered":"2023-07-09T21:22:32.830346+0000","last_clean":"2023-07-09T21:22:32.830346+0000","last_became_active":"2023-07-09T21:22:31.855516+0000","last_became_peered":"2023-07-09T21:22:31.855516+0000","last_unstale":"2023-07-09T21:22:32.830346+0000","last_undegraded":"2023-07-09T21:22:32.830346+0000","last_fullsized":"2023-07-09T21:22:32.830346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:55.695138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.842355+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:22:31.842355+0000","last_peered":"2023-07-09T21:22:31.842355+0000","last_clean":"2023-07-09T21:22:31.842355+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:22:31.842355+0000","last_undegraded":"2023-07-09T21:22:31.842355+0000","last_fullsized":"2023-07-09T21:22:31.842355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.836569+0000","last_change":"2023-07-09T21:22:30.857285+0000","last_active":"2023-07-09T21:22:31.836569+0000","last_peered":"2023-07-09T21:22:31.836569+0000","last_clean":"2023-07-09T21:22:31.836569+0000","last_became_active":"2023-07-09T21:22:30.856950+0000","last_became_peered":"2023-07-09T21:22:30.856950+0000","last_unstale":"2023-07-09T21:22:31.836569+0000","last_undegraded":"2023-07-09T21:22:31.836569+0000","last_fullsized":"2023-07-09T21:22:31.836569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:09.046232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862874+0000","last_change":"2023-07-09T21:22:31.858719+0000","last_active":"2023-07-09T21:22:31.862874+0000","last_peered":"2023-07-09T21:22:31.862874+0000","last_clean":"2023-07-09T21:22:31.862874+0000","last_became_active":"2023-07-09T21:22:31.858412+0000","last_became_peered":"2023-07-09T21:22:31.858412+0000","last_unstale":"2023-07-09T21:22:31.862874+0000","last_undegraded":"2023-07-09T21:22:31.862874+0000","last_fullsized":"2023-07-09T21:22:31.862874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.827523+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:22:31.827523+0000","last_peered":"2023-07-09T21:22:31.827523+0000","last_clean":"2023-07-09T21:22:31.827523+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:22:31.827523+0000","last_undegraded":"2023-07-09T21:22:31.827523+0000","last_fullsized":"2023-07-09T21:22:31.827523+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:29.533132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.848367+0000","last_change":"2023-07-09T21:22:30.843863+0000","last_active":"2023-07-09T21:22:31.848367+0000","last_peered":"2023-07-09T21:22:31.848367+0000","last_clean":"2023-07-09T21:22:31.848367+0000","last_became_active":"2023-07-09T21:22:30.843523+0000","last_became_peered":"2023-07-09T21:22:30.843523+0000","last_unstale":"2023-07-09T21:22:31.848367+0000","last_undegraded":"2023-07-09T21:22:31.848367+0000","last_fullsized":"2023-07-09T21:22:31.848367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.873982+0000","last_change":"2023-07-09T21:22:31.869166+0000","last_active":"2023-07-09T21:22:31.873982+0000","last_peered":"2023-07-09T21:22:31.873982+0000","last_clean":"2023-07-09T21:22:31.873982+0000","last_became_active":"2023-07-09T21:22:31.868832+0000","last_became_peered":"2023-07-09T21:22:31.868832+0000","last_unstale":"2023-07-09T21:22:31.873982+0000","last_undegraded":"2023-07-09T21:22:31.873982+0000","last_fullsized":"2023-07-09T21:22:31.873982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831237+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:22:32.831237+0000","last_peered":"2023-07-09T21:22:32.831237+0000","last_clean":"2023-07-09T21:22:32.831237+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:22:32.831237+0000","last_undegraded":"2023-07-09T21:22:32.831237+0000","last_fullsized":"2023-07-09T21:22:32.831237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:09.500561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832498+0000","last_change":"2023-07-09T21:22:30.855389+0000","last_active":"2023-07-09T21:22:32.832498+0000","last_peered":"2023-07-09T21:22:32.832498+0000","last_clean":"2023-07-09T21:22:32.832498+0000","last_became_active":"2023-07-09T21:22:30.855134+0000","last_became_peered":"2023-07-09T21:22:30.855134+0000","last_unstale":"2023-07-09T21:22:32.832498+0000","last_undegraded":"2023-07-09T21:22:32.832498+0000","last_fullsized":"2023-07-09T21:22:32.832498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860843+0000","last_change":"2023-07-09T21:22:31.852120+0000","last_active":"2023-07-09T21:22:31.860843+0000","last_peered":"2023-07-09T21:22:31.860843+0000","last_clean":"2023-07-09T21:22:31.860843+0000","last_became_active":"2023-07-09T21:22:31.851781+0000","last_became_peered":"2023-07-09T21:22:31.851781+0000","last_unstale":"2023-07-09T21:22:31.860843+0000","last_undegraded":"2023-07-09T21:22:31.860843+0000","last_fullsized":"2023-07-09T21:22:31.860843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831933+0000","last_change":"2023-07-09T21:22:30.851147+0000","last_active":"2023-07-09T21:22:32.831933+0000","last_peered":"2023-07-09T21:22:32.831933+0000","last_clean":"2023-07-09T21:22:32.831933+0000","last_became_active":"2023-07-09T21:22:30.850732+0000","last_became_peered":"2023-07-09T21:22:30.850732+0000","last_unstale":"2023-07-09T21:22:32.831933+0000","last_undegraded":"2023-07-09T21:22:32.831933+0000","last_fullsized":"2023-07-09T21:22:32.831933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850090+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:22:31.850090+0000","last_peered":"2023-07-09T21:22:31.850090+0000","last_clean":"2023-07-09T21:22:31.850090+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:22:31.850090+0000","last_undegraded":"2023-07-09T21:22:31.850090+0000","last_fullsized":"2023-07-09T21:22:31.850090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:49.657215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.871441+0000","last_change":"2023-07-09T21:22:31.866350+0000","last_active":"2023-07-09T21:22:31.871441+0000","last_peered":"2023-07-09T21:22:31.871441+0000","last_clean":"2023-07-09T21:22:31.871441+0000","last_became_active":"2023-07-09T21:22:31.866065+0000","last_became_peered":"2023-07-09T21:22:31.866065+0000","last_unstale":"2023-07-09T21:22:31.871441+0000","last_undegraded":"2023-07-09T21:22:31.871441+0000","last_fullsized":"2023-07-09T21:22:31.871441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.849999+0000","last_change":"2023-07-09T21:22:30.847415+0000","last_active":"2023-07-09T21:22:31.849999+0000","last_peered":"2023-07-09T21:22:31.849999+0000","last_clean":"2023-07-09T21:22:31.849999+0000","last_became_active":"2023-07-09T21:22:30.847083+0000","last_became_peered":"2023-07-09T21:22:30.847083+0000","last_unstale":"2023-07-09T21:22:31.849999+0000","last_undegraded":"2023-07-09T21:22:31.849999+0000","last_fullsized":"2023-07-09T21:22:31.849999+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.843504+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:22:31.843504+0000","last_peered":"2023-07-09T21:22:31.843504+0000","last_clean":"2023-07-09T21:22:31.843504+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:22:31.843504+0000","last_undegraded":"2023-07-09T21:22:31.843504+0000","last_fullsized":"2023-07-09T21:22:31.843504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.029984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.873897+0000","last_change":"2023-07-09T21:22:31.869857+0000","last_active":"2023-07-09T21:22:31.873897+0000","last_peered":"2023-07-09T21:22:31.873897+0000","last_clean":"2023-07-09T21:22:31.873897+0000","last_became_active":"2023-07-09T21:22:31.869492+0000","last_became_peered":"2023-07-09T21:22:31.869492+0000","last_unstale":"2023-07-09T21:22:31.873897+0000","last_undegraded":"2023-07-09T21:22:31.873897+0000","last_fullsized":"2023-07-09T21:22:31.873897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:23:06.352921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859835+0000","last_change":"2023-07-09T21:22:30.837573+0000","last_active":"2023-07-09T21:22:31.859835+0000","last_peered":"2023-07-09T21:22:31.859835+0000","last_clean":"2023-07-09T21:22:31.859835+0000","last_became_active":"2023-07-09T21:22:30.837216+0000","last_became_peered":"2023-07-09T21:22:30.837216+0000","last_unstale":"2023-07-09T21:22:31.859835+0000","last_undegraded":"2023-07-09T21:22:31.859835+0000","last_fullsized":"2023-07-09T21:22:31.859835+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:00.316799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850339+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:22:31.850339+0000","last_peered":"2023-07-09T21:22:31.850339+0000","last_clean":"2023-07-09T21:22:31.850339+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:22:31.850339+0000","last_undegraded":"2023-07-09T21:22:31.850339+0000","last_fullsized":"2023-07-09T21:22:31.850339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:19.772382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859441+0000","last_change":"2023-07-09T21:22:31.853429+0000","last_active":"2023-07-09T21:22:31.859441+0000","last_peered":"2023-07-09T21:22:31.859441+0000","last_clean":"2023-07-09T21:22:31.859441+0000","last_became_active":"2023-07-09T21:22:31.853117+0000","last_became_peered":"2023-07-09T21:22:31.853117+0000","last_unstale":"2023-07-09T21:22:31.859441+0000","last_undegraded":"2023-07-09T21:22:31.859441+0000","last_fullsized":"2023-07-09T21:22:31.859441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:41.566985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.842804+0000","last_change":"2023-07-09T21:22:30.848294+0000","last_active":"2023-07-09T21:22:31.842804+0000","last_peered":"2023-07-09T21:22:31.842804+0000","last_clean":"2023-07-09T21:22:31.842804+0000","last_became_active":"2023-07-09T21:22:30.847977+0000","last_became_peered":"2023-07-09T21:22:30.847977+0000","last_unstale":"2023-07-09T21:22:31.842804+0000","last_undegraded":"2023-07-09T21:22:31.842804+0000","last_fullsized":"2023-07-09T21:22:31.842804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:42.550440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830462+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:22:32.830462+0000","last_peered":"2023-07-09T21:22:32.830462+0000","last_clean":"2023-07-09T21:22:32.830462+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:22:32.830462+0000","last_undegraded":"2023-07-09T21:22:32.830462+0000","last_fullsized":"2023-07-09T21:22:32.830462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.865948+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.865590+0000","last_became_peered":"2023-07-09T21:22:31.865590+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832513+0000","last_change":"2023-07-09T21:22:31.852986+0000","last_active":"2023-07-09T21:22:32.832513+0000","last_peered":"2023-07-09T21:22:32.832513+0000","last_clean":"2023-07-09T21:22:32.832513+0000","last_became_active":"2023-07-09T21:22:31.852672+0000","last_became_peered":"2023-07-09T21:22:31.852672+0000","last_unstale":"2023-07-09T21:22:32.832513+0000","last_undegraded":"2023-07-09T21:22:32.832513+0000","last_fullsized":"2023-07-09T21:22:32.832513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832985+0000","last_change":"2023-07-09T21:22:30.857328+0000","last_active":"2023-07-09T21:22:32.832985+0000","last_peered":"2023-07-09T21:22:32.832985+0000","last_clean":"2023-07-09T21:22:32.832985+0000","last_became_active":"2023-07-09T21:22:30.857074+0000","last_became_peered":"2023-07-09T21:22:30.857074+0000","last_unstale":"2023-07-09T21:22:32.832985+0000","last_undegraded":"2023-07-09T21:22:32.832985+0000","last_fullsized":"2023-07-09T21:22:32.832985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:35.836977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.856463+0000","last_change":"2023-07-09T21:22:31.849713+0000","last_active":"2023-07-09T21:22:31.856463+0000","last_peered":"2023-07-09T21:22:31.856463+0000","last_clean":"2023-07-09T21:22:31.856463+0000","last_became_active":"2023-07-09T21:22:31.849438+0000","last_became_peered":"2023-07-09T21:22:31.849438+0000","last_unstale":"2023-07-09T21:22:31.856463+0000","last_undegraded":"2023-07-09T21:22:31.856463+0000","last_fullsized":"2023-07-09T21:22:31.856463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862485+0000","last_change":"2023-07-09T21:22:30.850957+0000","last_active":"2023-07-09T21:22:31.862485+0000","last_peered":"2023-07-09T21:22:31.862485+0000","last_clean":"2023-07-09T21:22:31.862485+0000","last_became_active":"2023-07-09T21:22:30.850675+0000","last_became_peered":"2023-07-09T21:22:30.850675+0000","last_unstale":"2023-07-09T21:22:31.862485+0000","last_undegraded":"2023-07-09T21:22:31.862485+0000","last_fullsized":"2023-07-09T21:22:31.862485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:53.047005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832318+0000","last_change":"2023-07-09T21:22:30.843875+0000","last_active":"2023-07-09T21:22:32.832318+0000","last_peered":"2023-07-09T21:22:32.832318+0000","last_clean":"2023-07-09T21:22:32.832318+0000","last_became_active":"2023-07-09T21:22:30.843484+0000","last_became_peered":"2023-07-09T21:22:30.843484+0000","last_unstale":"2023-07-09T21:22:32.832318+0000","last_undegraded":"2023-07-09T21:22:32.832318+0000","last_fullsized":"2023-07-09T21:22:32.832318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859111+0000","last_change":"2023-07-09T21:22:31.853270+0000","last_active":"2023-07-09T21:22:31.859111+0000","last_peered":"2023-07-09T21:22:31.859111+0000","last_clean":"2023-07-09T21:22:31.859111+0000","last_became_active":"2023-07-09T21:22:31.852994+0000","last_became_peered":"2023-07-09T21:22:31.852994+0000","last_unstale":"2023-07-09T21:22:31.859111+0000","last_undegraded":"2023-07-09T21:22:31.859111+0000","last_fullsized":"2023-07-09T21:22:31.859111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.836917+0000","last_change":"2023-07-09T21:22:30.845979+0000","last_active":"2023-07-09T21:22:31.836917+0000","last_peered":"2023-07-09T21:22:31.836917+0000","last_clean":"2023-07-09T21:22:31.836917+0000","last_became_active":"2023-07-09T21:22:30.844569+0000","last_became_peered":"2023-07-09T21:22:30.844569+0000","last_unstale":"2023-07-09T21:22:31.836917+0000","last_undegraded":"2023-07-09T21:22:31.836917+0000","last_fullsized":"2023-07-09T21:22:31.836917+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:15.644653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859420+0000","last_change":"2023-07-09T21:22:31.850051+0000","last_active":"2023-07-09T21:22:31.859420+0000","last_peered":"2023-07-09T21:22:31.859420+0000","last_clean":"2023-07-09T21:22:31.859420+0000","last_became_active":"2023-07-09T21:22:31.849776+0000","last_became_peered":"2023-07-09T21:22:31.849776+0000","last_unstale":"2023-07-09T21:22:31.859420+0000","last_undegraded":"2023-07-09T21:22:31.859420+0000","last_fullsized":"2023-07-09T21:22:31.859420+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830414+0000","last_change":"2023-07-09T21:22:31.870733+0000","last_active":"2023-07-09T21:22:32.830414+0000","last_peered":"2023-07-09T21:22:32.830414+0000","last_clean":"2023-07-09T21:22:32.830414+0000","last_became_active":"2023-07-09T21:22:31.870386+0000","last_became_peered":"2023-07-09T21:22:31.870386+0000","last_unstale":"2023-07-09T21:22:32.830414+0000","last_undegraded":"2023-07-09T21:22:32.830414+0000","last_fullsized":"2023-07-09T21:22:32.830414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.837191+0000","last_change":"2023-07-09T21:22:30.843731+0000","last_active":"2023-07-09T21:22:31.837191+0000","last_peered":"2023-07-09T21:22:31.837191+0000","last_clean":"2023-07-09T21:22:31.837191+0000","last_became_active":"2023-07-09T21:22:30.839924+0000","last_became_peered":"2023-07-09T21:22:30.839924+0000","last_unstale":"2023-07-09T21:22:31.837191+0000","last_undegraded":"2023-07-09T21:22:31.837191+0000","last_fullsized":"2023-07-09T21:22:31.837191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.862018+0000","last_change":"2023-07-09T21:22:31.853288+0000","last_active":"2023-07-09T21:22:31.862018+0000","last_peered":"2023-07-09T21:22:31.862018+0000","last_clean":"2023-07-09T21:22:31.862018+0000","last_became_active":"2023-07-09T21:22:31.852965+0000","last_became_peered":"2023-07-09T21:22:31.852965+0000","last_unstale":"2023-07-09T21:22:31.862018+0000","last_undegraded":"2023-07-09T21:22:31.862018+0000","last_fullsized":"2023-07-09T21:22:31.862018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:43.268296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.848452+0000","last_change":"2023-07-09T21:22:30.849317+0000","last_active":"2023-07-09T21:22:31.848452+0000","last_peered":"2023-07-09T21:22:31.848452+0000","last_clean":"2023-07-09T21:22:31.848452+0000","last_became_active":"2023-07-09T21:22:30.849028+0000","last_became_peered":"2023-07-09T21:22:30.849028+0000","last_unstale":"2023-07-09T21:22:31.848452+0000","last_undegraded":"2023-07-09T21:22:31.848452+0000","last_fullsized":"2023-07-09T21:22:31.848452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.859401+0000","last_change":"2023-07-09T21:22:31.853961+0000","last_active":"2023-07-09T21:22:31.859401+0000","last_peered":"2023-07-09T21:22:31.859401+0000","last_clean":"2023-07-09T21:22:31.859401+0000","last_became_active":"2023-07-09T21:22:31.853341+0000","last_became_peered":"2023-07-09T21:22:31.853341+0000","last_unstale":"2023-07-09T21:22:31.859401+0000","last_undegraded":"2023-07-09T21:22:31.859401+0000","last_fullsized":"2023-07-09T21:22:31.859401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831983+0000","last_change":"2023-07-09T21:22:30.856671+0000","last_active":"2023-07-09T21:22:32.831983+0000","last_peered":"2023-07-09T21:22:32.831983+0000","last_clean":"2023-07-09T21:22:32.831983+0000","last_became_active":"2023-07-09T21:22:30.856408+0000","last_became_peered":"2023-07-09T21:22:30.856408+0000","last_unstale":"2023-07-09T21:22:32.831983+0000","last_undegraded":"2023-07-09T21:22:32.831983+0000","last_fullsized":"2023-07-09T21:22:32.831983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.860768+0000","last_change":"2023-07-09T21:22:31.856724+0000","last_active":"2023-07-09T21:22:31.860768+0000","last_peered":"2023-07-09T21:22:31.860768+0000","last_clean":"2023-07-09T21:22:31.860768+0000","last_became_active":"2023-07-09T21:22:31.855887+0000","last_became_peered":"2023-07-09T21:22:31.855887+0000","last_unstale":"2023-07-09T21:22:31.860768+0000","last_undegraded":"2023-07-09T21:22:31.860768+0000","last_fullsized":"2023-07-09T21:22:31.860768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.106954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.856248+0000","last_change":"2023-07-09T21:22:30.856613+0000","last_active":"2023-07-09T21:22:31.856248+0000","last_peered":"2023-07-09T21:22:31.856248+0000","last_clean":"2023-07-09T21:22:31.856248+0000","last_became_active":"2023-07-09T21:22:30.856381+0000","last_became_peered":"2023-07-09T21:22:30.856381+0000","last_unstale":"2023-07-09T21:22:31.856248+0000","last_undegraded":"2023-07-09T21:22:31.856248+0000","last_fullsized":"2023-07-09T21:22:31.856248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831645+0000","last_change":"2023-07-09T21:22:31.853264+0000","last_active":"2023-07-09T21:22:32.831645+0000","last_peered":"2023-07-09T21:22:32.831645+0000","last_clean":"2023-07-09T21:22:32.831645+0000","last_became_active":"2023-07-09T21:22:31.852950+0000","last_became_peered":"2023-07-09T21:22:31.852950+0000","last_unstale":"2023-07-09T21:22:32.831645+0000","last_undegraded":"2023-07-09T21:22:32.831645+0000","last_fullsized":"2023-07-09T21:22:32.831645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831443+0000","last_change":"2023-07-09T21:22:30.858476+0000","last_active":"2023-07-09T21:22:32.831443+0000","last_peered":"2023-07-09T21:22:32.831443+0000","last_clean":"2023-07-09T21:22:32.831443+0000","last_became_active":"2023-07-09T21:22:30.858135+0000","last_became_peered":"2023-07-09T21:22:30.858135+0000","last_unstale":"2023-07-09T21:22:32.831443+0000","last_undegraded":"2023-07-09T21:22:32.831443+0000","last_fullsized":"2023-07-09T21:22:32.831443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831673+0000","last_change":"2023-07-09T21:22:31.847803+0000","last_active":"2023-07-09T21:22:32.831673+0000","last_peered":"2023-07-09T21:22:32.831673+0000","last_clean":"2023-07-09T21:22:32.831673+0000","last_became_active":"2023-07-09T21:22:31.847509+0000","last_became_peered":"2023-07-09T21:22:31.847509+0000","last_unstale":"2023-07-09T21:22:32.831673+0000","last_undegraded":"2023-07-09T21:22:32.831673+0000","last_fullsized":"2023-07-09T21:22:32.831673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831760+0000","last_change":"2023-07-09T21:22:30.858399+0000","last_active":"2023-07-09T21:22:32.831760+0000","last_peered":"2023-07-09T21:22:32.831760+0000","last_clean":"2023-07-09T21:22:32.831760+0000","last_became_active":"2023-07-09T21:22:30.858113+0000","last_became_peered":"2023-07-09T21:22:30.858113+0000","last_unstale":"2023-07-09T21:22:32.831760+0000","last_undegraded":"2023-07-09T21:22:32.831760+0000","last_fullsized":"2023-07-09T21:22:32.831760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:18.521756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.858908+0000","last_change":"2023-07-09T21:22:31.850287+0000","last_active":"2023-07-09T21:22:31.858908+0000","last_peered":"2023-07-09T21:22:31.858908+0000","last_clean":"2023-07-09T21:22:31.858908+0000","last_became_active":"2023-07-09T21:22:31.849962+0000","last_became_peered":"2023-07-09T21:22:31.849962+0000","last_unstale":"2023-07-09T21:22:31.858908+0000","last_undegraded":"2023-07-09T21:22:31.858908+0000","last_fullsized":"2023-07-09T21:22:31.858908+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:46.073213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.850593+0000","last_change":"2023-07-09T21:22:30.834480+0000","last_active":"2023-07-09T21:22:31.850593+0000","last_peered":"2023-07-09T21:22:31.850593+0000","last_clean":"2023-07-09T21:22:31.850593+0000","last_became_active":"2023-07-09T21:22:30.834184+0000","last_became_peered":"2023-07-09T21:22:30.834184+0000","last_unstale":"2023-07-09T21:22:31.850593+0000","last_undegraded":"2023-07-09T21:22:31.850593+0000","last_fullsized":"2023-07-09T21:22:31.850593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:31.964272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.851493+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.851203+0000","last_became_peered":"2023-07-09T21:22:31.851203+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-07-09T21:22:31.870403+0000","last_change":"2023-07-09T21:22:30.846855+0000","last_active":"2023-07-09T21:22:31.870403+0000","last_peered":"2023-07-09T21:22:31.870403+0000","last_clean":"2023-07-09T21:22:31.870403+0000","last_became_active":"2023-07-09T21:22:30.846556+0000","last_became_peered":"2023-07-09T21:22:30.846556+0000","last_unstale":"2023-07-09T21:22:31.870403+0000","last_undegraded":"2023-07-09T21:22:31.870403+0000","last_fullsized":"2023-07-09T21:22:31.870403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:45.066594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":675094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27184,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":237568,"data_stored":83598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":84566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":233472,"data_stored":83036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27176,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":229376,"data_stored":82946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":673896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:22:36.347 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:22:36.347 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-09T21:22:36.347 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-07-09T21:22:36.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-09T21:22:36.348 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-07-09T21:22:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 Processor -- start 2023-07-09T21:22:36.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 -- start start 2023-07-09T21:22:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5340b4340 0x7ff53406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5340cef80 0x7ff5340d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5340b49f0 con 0x7ff5340b7ab0 2023-07-09T21:22:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340b7e80 con 0x7ff5340b4340 2023-07-09T21:22:36.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff53a456640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5340cc8a0 con 0x7ff5340cef80 2023-07-09T21:22:36.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5340b4340 0x7ff53406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5340b4340 0x7ff53406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48474/0 (socket says 172.21.15.37:48474) 2023-07-09T21:22:36.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 -- 172.21.15.37:0/3630828334 learned_addr learned my addr 172.21.15.37:0/3630828334 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5389f3640 1 --2- 172.21.15.37:0/3630828334 >> v2:172.21.15.119:3300/0 conn(0x7ff5340cef80 0x7ff5340d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 -- 172.21.15.37:0/3630828334 >> v2:172.21.15.119:3300/0 conn(0x7ff5340cef80 msgr2=0x7ff5340d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 --2- 172.21.15.37:0/3630828334 >> v2:172.21.15.119:3300/0 conn(0x7ff5340cef80 0x7ff5340d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 -- 172.21.15.37:0/3630828334 >> v1:172.21.15.119:6789/0 conn(0x7ff5340b7ab0 legacy=0x7ff5340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.522+0000 7ff5337fe640 1 -- 172.21.15.37:0/3630828334 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5340ccb80 con 0x7ff5340b4340 2023-07-09T21:22:36.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff5337fe640 1 --2- 172.21.15.37:0/3630828334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53406aa50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff53408b5b0 tx=0x7ff52801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb865981f4b2824 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff532ffd640 1 -- 172.21.15.37:0/3630828334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280aa5f0 con 0x7ff5340b4340 2023-07-09T21:22:36.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff532ffd640 1 -- 172.21.15.37:0/3630828334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5280aa750 con 0x7ff5340b4340 2023-07-09T21:22:36.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff532ffd640 1 -- 172.21.15.37:0/3630828334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280aaae0 con 0x7ff5340b4340 2023-07-09T21:22:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 -- 172.21.15.37:0/3630828334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 msgr2=0x7ff53406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 --2- 172.21.15.37:0/3630828334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53406aa50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff53408b5b0 tx=0x7ff52801c490 comp rx=0 tx=0).stop 2023-07-09T21:22:36.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 -- 172.21.15.37:0/3630828334 shutdown_connections 2023-07-09T21:22:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 --2- 172.21.15.37:0/3630828334 >> v2:172.21.15.119:3300/0 conn(0x7ff5340cef80 0x7ff5340d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 --2- 172.21.15.37:0/3630828334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53406aa50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 -- 172.21.15.37:0/3630828334 >> 172.21.15.37:0/3630828334 conn(0x7ff534073090 msgr2=0x7ff534069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 -- 172.21.15.37:0/3630828334 shutdown_connections 2023-07-09T21:22:36.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.526+0000 7ff53a456640 1 -- 172.21.15.37:0/3630828334 wait complete. 2023-07-09T21:22:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 Processor -- start 2023-07-09T21:22:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- start start 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5340b7ab0 0x7ff53414eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 0x7ff53414f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53414e880 con 0x7ff5340b4340 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53414df20 con 0x7ff5340b7ab0 2023-07-09T21:22:36.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5340b34c0 con 0x7ff5340cef80 2023-07-09T21:22:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48476/0 (socket says 172.21.15.37:48476) 2023-07-09T21:22:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 -- 172.21.15.37:0/267371230 learned_addr learned my addr 172.21.15.37:0/267371230 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff5337fe640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5340b7ab0 0x7ff53414eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff5389f3640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 0x7ff53414f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 -- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 msgr2=0x7ff53414f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 0x7ff53414f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 -- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5340b7ab0 msgr2=0x7ff53414eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5340b7ab0 0x7ff53414eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 -- 172.21.15.37:0/267371230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5280094d0 con 0x7ff5340b4340 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff5389f3640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 0x7ff53414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff533fff640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c450 tx=0x7ff52400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524012830 con 0x7ff5340b4340 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5240129b0 con 0x7ff5340b4340 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53414e1c0 con 0x7ff5340b4340 2023-07-09T21:22:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524012d60 con 0x7ff5340b4340 2023-07-09T21:22:36.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53414f720 con 0x7ff5340b4340 2023-07-09T21:22:36.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.530+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53404d7d0 con 0x7ff5340b4340 2023-07-09T21:22:36.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.534+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff52401c460 con 0x7ff5340b4340 2023-07-09T21:22:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.534+0000 7ff530ff9640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.534+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff524083bb0 con 0x7ff5340b4340 2023-07-09T21:22:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.534+0000 7ff5337fe640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.534+0000 7ff5337fe640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 0x7ff520068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff5280ae000 tx=0x7ff5280b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.538+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff524050f90 con 0x7ff5340b4340 2023-07-09T21:22:36.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.726+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff5340b0ed0 con 0x7ff5340b4340 2023-07-09T21:22:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.726+0000 7ff530ff9640 1 -- 172.21.15.37:0/267371230 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164249 (secure 0 0 0) 0x7ff5240545b0 con 0x7ff5340b4340 2023-07-09T21:22:36.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 msgr2=0x7ff520068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 0x7ff520068760 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff5280ae000 tx=0x7ff5280b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 msgr2=0x7ff53414d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c450 tx=0x7ff52400c910 comp rx=0 tx=0).stop 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 shutdown_connections 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff5200662b0 0x7ff520068760 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5340cef80 0x7ff53414f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5340b7ab0 0x7ff53414eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 --2- 172.21.15.37:0/267371230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5340b4340 0x7ff53414d660 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 >> 172.21.15.37:0/267371230 conn(0x7ff534073090 msgr2=0x7ff5340b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 shutdown_connections 2023-07-09T21:22:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.730+0000 7ff53a456640 1 -- 172.21.15.37:0/267371230 wait complete. 2023-07-09T21:22:36.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":1139343796},{"type":"v1","addr":"172.21.15.119:6833","nonce":1139343796}]},"active_addr":"172.21.15.119:6833/1139343796","active_change":"2023-07-09T21:22:09.937315+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2798932044}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":4267916423}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3050580235}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1387781828}]}]} 2023-07-09T21:22:36.759 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-07-09T21:22:36.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-07-09T21:22:36.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 Processor -- start 2023-07-09T21:22:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 -- start start 2023-07-09T21:22:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06480b7ab0 0x7f064806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 0x7f06480b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480b49f0 con 0x7f06480b4170 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480b7e80 con 0x7f06480b7ab0 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064e2ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480b4610 con 0x7f06480cef80 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06480b7ab0 0x7f064806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06480b7ab0 0x7f064806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48488/0 (socket says 172.21.15.37:48488) 2023-07-09T21:22:36.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 -- 172.21.15.37:0/3101973280 learned_addr learned my addr 172.21.15.37:0/3101973280 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f064c889640 1 --1- 172.21.15.37:0/3101973280 >> v1:172.21.15.37:6789/0 conn(0x7f06480b4170 0x7f064815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41892/0 (socket says 172.21.15.37:41892) 2023-07-09T21:22:36.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 -- 172.21.15.37:0/3101973280 >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 msgr2=0x7f06480b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f06477fe640 1 --2- 172.21.15.37:0/3101973280 >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 0x7f06480b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 --2- 172.21.15.37:0/3101973280 >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 0x7f06480b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 -- 172.21.15.37:0/3101973280 >> v1:172.21.15.37:6789/0 conn(0x7f06480b4170 legacy=0x7f064815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0647fff640 1 -- 172.21.15.37:0/3101973280 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480cc8a0 con 0x7f06480b7ab0 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f06477fe640 1 --2- 172.21.15.37:0/3101973280 >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 0x7f06480b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:36.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.898+0000 7f0646ffd640 1 -- 172.21.15.37:0/3101973280 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258765181 0 0) 0x7f06480b49f0 con 0x7f06480b4170 2023-07-09T21:22:36.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f0647fff640 1 --2- 172.21.15.37:0/3101973280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480b7ab0 0x7f064806aa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06480b4d10 tx=0x7f063801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758ea70d7ab9f33b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f0646ffd640 1 -- 172.21.15.37:0/3101973280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380aa430 con 0x7f06480b7ab0 2023-07-09T21:22:36.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f0646ffd640 1 -- 172.21.15.37:0/3101973280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380aa590 con 0x7f06480b7ab0 2023-07-09T21:22:36.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f0646ffd640 1 -- 172.21.15.37:0/3101973280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380aa920 con 0x7f06480b7ab0 2023-07-09T21:22:36.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 -- 172.21.15.37:0/3101973280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480b7ab0 msgr2=0x7f064806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 --2- 172.21.15.37:0/3101973280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480b7ab0 0x7f064806aa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f06480b4d10 tx=0x7f063801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 -- 172.21.15.37:0/3101973280 shutdown_connections 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 --2- 172.21.15.37:0/3101973280 >> v2:172.21.15.119:3300/0 conn(0x7f06480cef80 0x7f06480b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 --2- 172.21.15.37:0/3101973280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480b7ab0 0x7f064806aa50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 -- 172.21.15.37:0/3101973280 >> 172.21.15.37:0/3101973280 conn(0x7f0648073090 msgr2=0x7f0648069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 -- 172.21.15.37:0/3101973280 shutdown_connections 2023-07-09T21:22:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.902+0000 7f064e2ec640 1 -- 172.21.15.37:0/3101973280 wait complete. 2023-07-09T21:22:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 Processor -- start 2023-07-09T21:22:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- start start 2023-07-09T21:22:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06480b4170 0x7f06480caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06480b7ab0 0x7f06480b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06480cbf10 con 0x7f06480cef80 2023-07-09T21:22:36.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06480cb300 con 0x7f06480b4170 2023-07-09T21:22:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06480cb5e0 con 0x7f06480b7ab0 2023-07-09T21:22:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48494/0 (socket says 172.21.15.37:48494) 2023-07-09T21:22:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 -- 172.21.15.37:0/2944418019 learned_addr learned my addr 172.21.15.37:0/2944418019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f06477fe640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06480b7ab0 0x7f06480b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f0647fff640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06480b4170 0x7f06480caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 -- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06480b7ab0 msgr2=0x7f06480b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06480b7ab0 0x7f06480b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 -- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06480b4170 msgr2=0x7f06480caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06480b4170 0x7f06480caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 -- 172.21.15.37:0/2944418019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380094d0 con 0x7f06480cef80 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064c889640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0640001570 tx=0x7f064000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000a640 con 0x7f06480cef80 2023-07-09T21:22:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064000a7c0 con 0x7f06480cef80 2023-07-09T21:22:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064000ab70 con 0x7f06480cef80 2023-07-09T21:22:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06480cb8c0 con 0x7f06480cef80 2023-07-09T21:22:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.906+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06480cafa0 con 0x7f06480cef80 2023-07-09T21:22:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06480cc0c0 con 0x7f06480cef80 2023-07-09T21:22:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f064000acd0 con 0x7f06480cef80 2023-07-09T21:22:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f0644ff9640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 0x7f0634068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f06400831c0 con 0x7f06480cef80 2023-07-09T21:22:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f0647fff640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 0x7f0634068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.910+0000 7f0647fff640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 0x7f0634068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06380ae000 tx=0x7f06380b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:36.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:36.914+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06480cc0c0 con 0x7f06480cef80 2023-07-09T21:22:37.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.070+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06480cc0c0 con 0x7f06480cef80 2023-07-09T21:22:37.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f0644ff9640 1 -- 172.21.15.37:0/2944418019 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f06480cc0c0 con 0x7f06480cef80 2023-07-09T21:22:37.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:37.078 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 msgr2=0x7f0634068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 0x7f0634068730 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f06380ae000 tx=0x7f06380b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 msgr2=0x7f06480b2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0640001570 tx=0x7f064000cca0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 shutdown_connections 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0634066280 0x7f0634068730 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06480cef80 0x7f06480b2150 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06480b7ab0 0x7f06480b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 --2- 172.21.15.37:0/2944418019 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06480b4170 0x7f06480caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 >> 172.21.15.37:0/2944418019 conn(0x7f0648073090 msgr2=0x7f06480b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 shutdown_connections 2023-07-09T21:22:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.074+0000 7f064e2ec640 1 -- 172.21.15.37:0/2944418019 wait complete. 2023-07-09T21:22:37.100 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-07-09T21:22:37.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:37.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 Processor -- start 2023-07-09T21:22:37.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 -- start start 2023-07-09T21:22:37.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0bc00b7ab0 0x7f0bc006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bc00b4340 0x7f0bc00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc00b49f0 con 0x7f0bc00cef80 2023-07-09T21:22:37.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00b7e80 con 0x7f0bc00b4340 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bc567b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bc00cc8a0 con 0x7f0bc00b7ab0 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bc00b4340 0x7f0bc00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bc00b4340 0x7f0bc00d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48498/0 (socket says 172.21.15.37:48498) 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 -- 172.21.15.37:0/2290505330 learned_addr learned my addr 172.21.15.37:0/2290505330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbeffd640 1 --2- 172.21.15.37:0/2290505330 >> v2:172.21.15.119:3300/0 conn(0x7f0bc00b7ab0 0x7f0bc006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 -- 172.21.15.37:0/2290505330 >> v2:172.21.15.119:3300/0 conn(0x7f0bc00b7ab0 msgr2=0x7f0bc006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 --2- 172.21.15.37:0/2290505330 >> v2:172.21.15.119:3300/0 conn(0x7f0bc00b7ab0 0x7f0bc006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 -- 172.21.15.37:0/2290505330 >> v1:172.21.15.119:6789/0 conn(0x7f0bc00cef80 legacy=0x7f0bc00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.238+0000 7f0bbf7fe640 1 -- 172.21.15.37:0/2290505330 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc00ccb80 con 0x7f0bc00b4340 2023-07-09T21:22:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bbf7fe640 1 --2- 172.21.15.37:0/2290505330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00d02a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006b360 tx=0x7f0bb801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9742b519dbf70e37 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bbe7fc640 1 -- 172.21.15.37:0/2290505330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80a5860 con 0x7f0bc00b4340 2023-07-09T21:22:37.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bbe7fc640 1 -- 172.21.15.37:0/2290505330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb80a59c0 con 0x7f0bc00b4340 2023-07-09T21:22:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bbe7fc640 1 -- 172.21.15.37:0/2290505330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb80a5d50 con 0x7f0bc00b4340 2023-07-09T21:22:37.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 -- 172.21.15.37:0/2290505330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 msgr2=0x7f0bc00d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 --2- 172.21.15.37:0/2290505330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00d02a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0bc006b360 tx=0x7f0bb801c9a0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 -- 172.21.15.37:0/2290505330 shutdown_connections 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 --2- 172.21.15.37:0/2290505330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00d02a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 --2- 172.21.15.37:0/2290505330 >> v2:172.21.15.119:3300/0 conn(0x7f0bc00b7ab0 0x7f0bc006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 -- 172.21.15.37:0/2290505330 >> 172.21.15.37:0/2290505330 conn(0x7f0bc0073090 msgr2=0x7f0bc0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 -- 172.21.15.37:0/2290505330 shutdown_connections 2023-07-09T21:22:37.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.242+0000 7f0bc567b640 1 -- 172.21.15.37:0/2290505330 wait complete. 2023-07-09T21:22:37.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 Processor -- start 2023-07-09T21:22:37.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- start start 2023-07-09T21:22:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bc00b7ab0 0x7f0bc00c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bc00cef80 0x7f0bc00cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc0150df0 con 0x7f0bc00b4340 2023-07-09T21:22:37.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01569f0 con 0x7f0bc00b7ab0 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc01501e0 con 0x7f0bc00cef80 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48500/0 (socket says 172.21.15.37:48500) 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 -- 172.21.15.37:0/1846858466 learned_addr learned my addr 172.21.15.37:0/1846858466 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bb7fff640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bc00b7ab0 0x7f0bc00c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbf7fe640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bc00cef80 0x7f0bc00cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 -- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bc00cef80 msgr2=0x7f0bc00cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bc00cef80 0x7f0bc00cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 -- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bc00b7ab0 msgr2=0x7f0bc00c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bc00b7ab0 0x7f0bc00c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 -- 172.21.15.37:0/1846858466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb8009b30 con 0x7f0bc00b4340 2023-07-09T21:22:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bbeffd640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000e9b0 tx=0x7f0bb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb00096b0 con 0x7f0bc00b4340 2023-07-09T21:22:37.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb000c9a0 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb000cd30 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc01504c0 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.246+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0150a80 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc004d7d0 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bb0013470 con 0x7f0bc00b4340 2023-07-09T21:22:37.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bb77fe640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 0x7f0ba0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bb0083f90 con 0x7f0bc00b4340 2023-07-09T21:22:37.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bb7fff640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 0x7f0ba0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.250+0000 7f0bb7fff640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 0x7f0ba0068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00c84e0 tx=0x7f0ba8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.254+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bb0051420 con 0x7f0bc00b4340 2023-07-09T21:22:37.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.414+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bc006a830 con 0x7f0bc00b4340 2023-07-09T21:22:37.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.414+0000 7f0bb77fe640 1 -- 172.21.15.37:0/1846858466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f0bb0017090 con 0x7f0bc00b4340 2023-07-09T21:22:37.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:37.420 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 msgr2=0x7f0ba0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 0x7f0ba0068730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00c84e0 tx=0x7f0ba8009040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 msgr2=0x7f0bc00c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000e9b0 tx=0x7f0bb000ee70 comp rx=0 tx=0).stop 2023-07-09T21:22:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 shutdown_connections 2023-07-09T21:22:37.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0ba0066280 0x7f0ba0068730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bc00cef80 0x7f0bc00cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bc00b7ab0 0x7f0bc00c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 --2- 172.21.15.37:0/1846858466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bc00b4340 0x7f0bc00c9280 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 >> 172.21.15.37:0/1846858466 conn(0x7f0bc0073090 msgr2=0x7f0bc00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 shutdown_connections 2023-07-09T21:22:37.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.418+0000 7f0bc567b640 1 -- 172.21.15.37:0/1846858466 wait complete. 2023-07-09T21:22:37.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-07-09T21:22:37.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-07-09T21:22:37.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-07-09T21:22:37.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-07-09T21:22:37.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-07-09T21:22:37.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-07-09T21:22:37.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-07-09T21:22:37.444 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-07-09T21:22:37.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 Processor -- start 2023-07-09T21:22:37.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 -- start start 2023-07-09T21:22:37.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60581579d0 0x7f60580c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f60580c9eb0 0x7f60580c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605815b340 con 0x7f60580694c0 2023-07-09T21:22:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605815b620 con 0x7f60581579d0 2023-07-09T21:22:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f605d69e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605815b900 con 0x7f60580c9eb0 2023-07-09T21:22:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f60567fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60581579d0 0x7f60580c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f60567fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f60581579d0 0x7f60580c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34102/0 (socket says 172.21.15.37:34102) 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f60567fc640 1 -- 172.21.15.37:0/4156230297 learned_addr learned my addr 172.21.15.37:0/4156230297 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f60577fe640 1 --2- 172.21.15.37:0/4156230297 >> v2:172.21.15.119:3300/0 conn(0x7f60580c9eb0 0x7f60580c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.682+0000 7f60567fc640 1 -- 172.21.15.37:0/4156230297 >> v2:172.21.15.119:3300/0 conn(0x7f60580c9eb0 msgr2=0x7f60580c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7f60567fc640 1 --2- 172.21.15.37:0/4156230297 >> v2:172.21.15.119:3300/0 conn(0x7f60580c9eb0 0x7f60580c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7f60567fc640 1 -- 172.21.15.37:0/4156230297 >> v1:172.21.15.37:6789/0 conn(0x7f60580694c0 legacy=0x7f6058069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7f60567fc640 1 -- 172.21.15.37:0/4156230297 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605815bbe0 con 0x7f60581579d0 2023-07-09T21:22:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7efd46676640 1 Processor -- start 2023-07-09T21:22:37.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7efd46676640 1 -- start start 2023-07-09T21:22:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f60567fc640 1 --2- 172.21.15.37:0/4156230297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f60580c9970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60580c8340 tx=0x7f605001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e382a413a037a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f6055ffb640 1 -- 172.21.15.37:0/4156230297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500a5a40 con 0x7f60581579d0 2023-07-09T21:22:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f6055ffb640 1 -- 172.21.15.37:0/4156230297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60500a5ba0 con 0x7f60581579d0 2023-07-09T21:22:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f6055ffb640 1 -- 172.21.15.37:0/4156230297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500ad3f0 con 0x7f60581579d0 2023-07-09T21:22:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd46676640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efd400c97b0 0x7efd400af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd46676640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400afef0 0x7efd400cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd46676640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd400ca4c0 con 0x7efd4015ff20 2023-07-09T21:22:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd46676640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd401602f0 con 0x7efd400c97b0 2023-07-09T21:22:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd46676640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c9c20 con 0x7efd400afef0 2023-07-09T21:22:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 -- 172.21.15.37:0/4156230297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 msgr2=0x7f60580c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 --2- 172.21.15.37:0/4156230297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f60580c9970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f60580c8340 tx=0x7f605001cc10 comp rx=0 tx=0).stop 2023-07-09T21:22:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd45674640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efd4015ff20 0x7efd4006ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57020/0 (socket says 172.21.15.37:57020) 2023-07-09T21:22:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd45674640 1 -- 172.21.15.37:0/3664301074 learned_addr learned my addr 172.21.15.37:0/3664301074 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:37.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd44e73640 1 --2- 172.21.15.37:0/3664301074 >> v2:172.21.15.119:3300/0 conn(0x7efd400c97b0 0x7efd400af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 -- 172.21.15.37:0/4156230297 shutdown_connections 2023-07-09T21:22:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 --2- 172.21.15.37:0/4156230297 >> v2:172.21.15.119:3300/0 conn(0x7f60580c9eb0 0x7f60580c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 --2- 172.21.15.37:0/4156230297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f60580c9970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 -- 172.21.15.37:0/4156230297 >> 172.21.15.37:0/4156230297 conn(0x7f60580ca6c0 msgr2=0x7f60580caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd45e75640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400afef0 0x7efd400cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 -- 172.21.15.37:0/4156230297 shutdown_connections 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7f605d69e640 1 -- 172.21.15.37:0/4156230297 wait complete. 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.686+0000 7fbad5a56640 1 Processor -- start 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 -- start start 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 0x7fbad00708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 0x7fbad006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad006f3b0 con 0x7fbad0164580 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad0163680 con 0x7fbad0069bd0 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbad5a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0070f20 con 0x7fbad01632b0 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbacf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 0x7fbad006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbacf7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 0x7fbad006ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50128/0 (socket says 172.21.15.37:50128) 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbacf7fe640 1 -- 172.21.15.37:0/1673898289 learned_addr learned my addr 172.21.15.37:0/1673898289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbaceffd640 1 --2- 172.21.15.37:0/1673898289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 0x7fbad00708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbaceffd640 1 -- 172.21.15.37:0/1673898289 >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 msgr2=0x7fbad006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbaceffd640 1 --2- 172.21.15.37:0/1673898289 >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 0x7fbad006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7fbaceffd640 1 -- 172.21.15.37:0/1673898289 >> v1:172.21.15.37:6789/0 conn(0x7fbad0164580 legacy=0x7fbad00694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.694+0000 7fbaceffd640 1 -- 172.21.15.37:0/1673898289 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad0163aa0 con 0x7fbad01632b0 2023-07-09T21:22:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.694+0000 7f605d69e640 1 Processor -- start 2023-07-09T21:22:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.694+0000 7f605d69e640 1 -- start start 2023-07-09T21:22:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd44e73640 1 -- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400afef0 msgr2=0x7efd400cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd44e73640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400afef0 0x7efd400cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd44e73640 1 -- 172.21.15.37:0/3664301074 >> v1:172.21.15.37:6789/0 conn(0x7efd4015ff20 legacy=0x7efd4006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.690+0000 7efd44e73640 1 -- 172.21.15.37:0/3664301074 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd400c9f00 con 0x7efd400c97b0 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580694c0 0x7f6058157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 0x7f605814d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f6056ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580694c0 0x7f6058157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 0x7f605814d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 0x7f605814d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49664/0 (socket says 172.21.15.37:49664) 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f6056ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580694c0 0x7f6058157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50146/0 (socket says 172.21.15.37:50146) 2023-07-09T21:22:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f605814d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbaceffd640 1 --2- 172.21.15.37:0/1673898289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 0x7fbad00708f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbac00097c0 tx=0x7fbac001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ab83b603fa55185 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f605814d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60580af420 con 0x7f60581579d0 2023-07-09T21:22:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f605814d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34114/0 (socket says 172.21.15.37:34114) 2023-07-09T21:22:37.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058158380 con 0x7f60580694c0 2023-07-09T21:22:37.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60577fe640 1 -- 172.21.15.37:0/3514574037 learned_addr learned my addr 172.21.15.37:0/3514574037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f605d69e640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6058158660 con 0x7f60580c9eb0 2023-07-09T21:22:37.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd44e73640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd400c97b0 0x7efd400af9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097c0 tx=0x7efd3c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c4ba16be1795915 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbacdffb640 1 -- 172.21.15.37:0/1673898289 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00ac640 con 0x7fbad01632b0 2023-07-09T21:22:37.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbacdffb640 1 -- 172.21.15.37:0/1673898289 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac00ac7a0 con 0x7fbad01632b0 2023-07-09T21:22:37.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbacdffb640 1 -- 172.21.15.37:0/1673898289 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac00acb30 con 0x7fbad01632b0 2023-07-09T21:22:37.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd37fff640 1 -- 172.21.15.37:0/3664301074 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0ad660 con 0x7efd400c97b0 2023-07-09T21:22:37.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd37fff640 1 -- 172.21.15.37:0/3664301074 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c0ad7c0 con 0x7efd400c97b0 2023-07-09T21:22:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 -- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580694c0 msgr2=0x7f6058157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60580694c0 0x7f6058157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 -- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 msgr2=0x7f605814d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60581579d0 0x7f605814d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500096b0 con 0x7f60580c9eb0 2023-07-09T21:22:37.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f09568ca640 1 Processor -- start 2023-07-09T21:22:37.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 -- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd400c97b0 msgr2=0x7efd400af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 -- 172.21.15.37:0/1673898289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 msgr2=0x7fbad00708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 --2- 172.21.15.37:0/1673898289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 0x7fbad00708f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbac00097c0 tx=0x7fbac001c440 comp rx=0 tx=0).stop 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 -- 172.21.15.37:0/1673898289 shutdown_connections 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 --2- 172.21.15.37:0/1673898289 >> v2:172.21.15.119:3300/0 conn(0x7fbad0069bd0 0x7fbad006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 --2- 172.21.15.37:0/1673898289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad01632b0 0x7fbad00708f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 -- 172.21.15.37:0/1673898289 >> 172.21.15.37:0/1673898289 conn(0x7fbad00ca6c0 msgr2=0x7fbad00caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 -- 172.21.15.37:0/1673898289 shutdown_connections 2023-07-09T21:22:37.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd37fff640 1 -- 172.21.15.37:0/3664301074 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0ad660 con 0x7efd400c97b0 2023-07-09T21:22:37.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7fbad5a56640 1 -- 172.21.15.37:0/1673898289 wait complete. 2023-07-09T21:22:37.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd400c97b0 0x7efd400af9b0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0097c0 tx=0x7efd3c01c450 comp rx=0 tx=0).stop 2023-07-09T21:22:37.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 -- 172.21.15.37:0/3664301074 shutdown_connections 2023-07-09T21:22:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400afef0 0x7efd400cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 --2- 172.21.15.37:0/3664301074 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd400c97b0 0x7efd400af9b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 -- 172.21.15.37:0/3664301074 >> 172.21.15.37:0/3664301074 conn(0x7efd400ce8a0 msgr2=0x7efd400ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f09568ca640 1 -- start start 2023-07-09T21:22:37.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7f60567fc640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 0x7f605814d450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60500ab000 tx=0x7f60500199b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.698+0000 7efd46676640 1 -- 172.21.15.37:0/3664301074 shutdown_connections 2023-07-09T21:22:37.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 Processor -- start 2023-07-09T21:22:37.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500a5a40 con 0x7f60580c9eb0 2023-07-09T21:22:37.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f605d69e640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058158940 con 0x7f60580c9eb0 2023-07-09T21:22:37.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f605d69e640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6058158f00 con 0x7f60580c9eb0 2023-07-09T21:22:37.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60500b8440 con 0x7f60580c9eb0 2023-07-09T21:22:37.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60500adea0 con 0x7f60580c9eb0 2023-07-09T21:22:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09568ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f095015ff20 0x7f095006ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09568ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09500cd070 0x7f09500cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09568ca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cda10 con 0x7f09500c97b0 2023-07-09T21:22:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09568ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09501602f0 con 0x7f095015ff20 2023-07-09T21:22:37.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09568ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09500ca4c0 con 0x7f09500cd070 2023-07-09T21:22:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 -- start start 2023-07-09T21:22:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f605d69e640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6038000fd0 con 0x7f60580c9eb0 2023-07-09T21:22:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09550c7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09500c97b0 0x7f09500af9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57032/0 (socket says 172.21.15.37:57032) 2023-07-09T21:22:37.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09550c7640 1 -- 172.21.15.37:0/173109327 learned_addr learned my addr 172.21.15.37:0/173109327 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:37.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7efd46676640 1 -- 172.21.15.37:0/3664301074 wait complete. 2023-07-09T21:22:37.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7efd46676640 1 Processor -- start 2023-07-09T21:22:37.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7fbad5a56640 1 Processor -- start 2023-07-09T21:22:37.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7fbad5a56640 1 -- start start 2023-07-09T21:22:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7f09560c9640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09500cd070 0x7f09500cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb0406efe0 0x7ffb041636f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb0406f3b0 0x7ffb040cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb04163cd0 con 0x7ffb040cefd0 2023-07-09T21:22:37.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb040b1ba0 con 0x7ffb0406f3b0 2023-07-09T21:22:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0c5ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb04163fb0 con 0x7ffb0406efe0 2023-07-09T21:22:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7efd46676640 1 -- start start 2023-07-09T21:22:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb0a348640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb0406efe0 0x7ffb041636f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb09b47640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb0406f3b0 0x7ffb040cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb09b47640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb0406f3b0 0x7ffb040cea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50150/0 (socket says 172.21.15.37:50150) 2023-07-09T21:22:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.702+0000 7ffb09b47640 1 -- 172.21.15.37:0/2292217152 learned_addr learned my addr 172.21.15.37:0/2292217152 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad0069bd0 0x7fbad0144080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbad01632b0 0x7fbad0145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 0x7fbad0149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad0140940 con 0x7fbad0069bd0 2023-07-09T21:22:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c1750 con 0x7fbad01632b0 2023-07-09T21:22:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad00c1a30 con 0x7fbad0164580 2023-07-09T21:22:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 0x7fbad0149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164427373 0 0) 0x7f09500cda10 con 0x7f09500c97b0 2023-07-09T21:22:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 0x7fbad0149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49692/0 (socket says 172.21.15.37:49692) 2023-07-09T21:22:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 -- 172.21.15.37:0/4172310384 learned_addr learned my addr 172.21.15.37:0/4172310384 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbace7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbad01632b0 0x7fbad0145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7ffb09b47640 1 -- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb0406efe0 msgr2=0x7ffb041636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7ffb09b47640 1 --2- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb0406efe0 0x7ffb041636f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7ffb09b47640 1 -- 172.21.15.37:0/2292217152 >> v1:172.21.15.37:6789/0 conn(0x7ffb040cefd0 legacy=0x7ffb0406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7ffb09b47640 1 -- 172.21.15.37:0/2292217152 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04164290 con 0x7ffb0406f3b0 2023-07-09T21:22:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbaceffd640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad0069bd0 0x7fbad0144080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f093c003530 con 0x7f09500c97b0 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09558c8640 1 --2- 172.21.15.37:0/173109327 >> v2:172.21.15.119:3300/0 conn(0x7f095015ff20 0x7f095006ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1154733805 0 0) 0x7f093c003530 con 0x7f09500c97b0 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09500cd070 msgr2=0x7f09500cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09500cd070 0x7f09500cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 >> v2:172.21.15.119:3300/0 conn(0x7f095015ff20 msgr2=0x7f095006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 --2- 172.21.15.37:0/173109327 >> v2:172.21.15.119:3300/0 conn(0x7f095015ff20 0x7f095006ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500c9c20 con 0x7f09500c97b0 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 -- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbad01632b0 msgr2=0x7fbad0145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbad01632b0 0x7fbad0145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 -- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad0069bd0 msgr2=0x7fbad0144080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad0069bd0 0x7fbad0144080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009420 con 0x7fbad0164580 2023-07-09T21:22:37.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbaceffd640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbad0069bd0 0x7fbad0144080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f60500b87f0 con 0x7f60580c9eb0 2023-07-09T21:22:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6044066350 0x7f6044068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f605011f9d0 con 0x7f60580c9eb0 2023-07-09T21:22:37.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7f604406ec00 0x7f6044071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f6056ffd640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6044066350 0x7f6044068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f60440716c0 con 0x7f604406ec00 2023-07-09T21:22:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f605011fd80 con 0x7f60580c9eb0 2023-07-09T21:22:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f094c001680 con 0x7f09500c97b0 2023-07-09T21:22:37.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 >> v1:172.21.15.37:6789/0 conn(0x7f09500c97b0 legacy=0x7f09500af9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbacf7fe640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 0x7fbad0149360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbac800efc0 tx=0x7fbac800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f60577fe640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7f604406ec00 0x7f6044071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093c003a00 0x7f093c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f093c0043a0 0x7f093c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f6056ffd640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6044066350 0x7f6044068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6048000f70 tx=0x7f6048009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac800cd20 con 0x7fbad0164580 2023-07-09T21:22:37.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac800f040 con 0x7fbad0164580 2023-07-09T21:22:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09550c7640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f093c0043a0 0x7f093c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac8003be0 con 0x7fbad0164580 2023-07-09T21:22:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad00c1d10 con 0x7fbad0164580 2023-07-09T21:22:37.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7fbad5a56640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad00c22d0 con 0x7fbad0164580 2023-07-09T21:22:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f093c005070 0x7f093c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09501602f0 con 0x7f093c0043a0 2023-07-09T21:22:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500ca4c0 con 0x7f093c005070 2023-07-09T21:22:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c00c000 con 0x7f093c003a00 2023-07-09T21:22:37.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.706+0000 7f60577fe640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7f604406ec00 0x7f6044071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09558c8640 1 --2- 172.21.15.37:0/173109327 >> v2:172.21.15.119:3300/0 conn(0x7f095015ff20 0x7f095006ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fbad5a56640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbad004e020 con 0x7fbad0164580 2023-07-09T21:22:37.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== osd.0 v2:172.21.15.37:6808/3872612948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f60440716c0 con 0x7f604406ec00 2023-07-09T21:22:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fb96ab59640 1 Processor -- start 2023-07-09T21:22:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fd9c652c640 1 Processor -- start 2023-07-09T21:22:37.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fb66e9b7640 1 Processor -- start 2023-07-09T21:22:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7ffb09b47640 1 --2- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406f3b0 0x7ffb040cea90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009870 tx=0x7ffaf401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef2b7d6c63c48e54 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fb96ab59640 1 -- start start 2023-07-09T21:22:37.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fb66e9b7640 1 -- start start 2023-07-09T21:22:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7efd46676640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd400afef0 0x7efd40158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7ffb09346640 1 -- 172.21.15.37:0/2292217152 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40ab680 con 0x7ffb0406f3b0 2023-07-09T21:22:37.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbac8003d40 con 0x7fbad0164580 2023-07-09T21:22:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7fd9c652c640 1 -- start start 2023-07-09T21:22:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7ffb09346640 1 -- 172.21.15.37:0/2292217152 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40ab7e0 con 0x7ffb0406f3b0 2023-07-09T21:22:37.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09550c7640 1 -- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093c003a00 msgr2=0x7f093c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09550c7640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f093c003a00 0x7f093c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09550c7640 1 -- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f093c005070 msgr2=0x7f093c00b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09550c7640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f093c005070 0x7f093c00b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.710+0000 7f09550c7640 1 -- 172.21.15.37:0/173109327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c003530 con 0x7f093c0043a0 2023-07-09T21:22:37.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9c652c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9c652c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd9c00b4e20 0x7fd9c00b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9c652c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c00d1dc0 con 0x7fd9c00b3a50 2023-07-09T21:22:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9c652c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c00cc9e0 con 0x7fd9c00b4e20 2023-07-09T21:22:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9c652c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c00d1770 con 0x7fd9c006a840 2023-07-09T21:22:37.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e9b7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6680724e0 0x7fb66815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e9b7640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb668159cf0 0x7fb6680b1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e9b7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680cc200 con 0x7fb668159920 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e9b7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66815afb0 con 0x7fb6680724e0 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e9b7640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6680cc4e0 con 0x7fb668159cf0 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbab7fff640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbabc066350 0x7fbabc068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbac8084370 con 0x7fbad0164580 2023-07-09T21:22:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb668159920 0x7fb6680cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51142/0 (socket says 172.21.15.37:51142) 2023-07-09T21:22:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3292674720 learned_addr learned my addr 172.21.15.37:0/3292674720 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:37.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e1b6640 1 --2- 172.21.15.37:0/3292674720 >> v2:172.21.15.119:3300/0 conn(0x7fb668159cf0 0x7fb6680b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb96ab59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9640b47a0 0x7fb9640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb96ab59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cef80 con 0x7fb9640b4140 2023-07-09T21:22:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb96ab59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9640cf260 con 0x7fb9640b7a60 2023-07-09T21:22:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940969415 0 0) 0x7fb6680cc200 con 0x7fb668159920 2023-07-09T21:22:37.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb654003530 con 0x7fb668159920 2023-07-09T21:22:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbab7fff640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7fbabc06ec00 0x7fbabc071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbabc0716c0 con 0x7fbabc06ec00 2023-07-09T21:22:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbac8086990 con 0x7fbad0164580 2023-07-09T21:22:37.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbaceffd640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbabc066350 0x7fbabc068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49710/0 (socket says 172.21.15.37:49710) 2023-07-09T21:22:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 -- 172.21.15.37:0/4249639750 learned_addr learned my addr 172.21.15.37:0/4249639750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbace7fc640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7fbabc06ec00 0x7fbabc071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb963fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9640b47a0 0x7fb9640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb9688f5640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb9640b7a60 0x7fb9640cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51150/0 (socket says 172.21.15.37:51150) 2023-07-09T21:22:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb9688f5640 1 -- 172.21.15.37:0/3742302201 learned_addr learned my addr 172.21.15.37:0/3742302201 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:37.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3007645320 0 0) 0x7fb654003530 con 0x7fb668159920 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 >> v2:172.21.15.119:3300/0 conn(0x7fb668159cf0 msgr2=0x7fb6680b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 --2- 172.21.15.37:0/3292674720 >> v2:172.21.15.119:3300/0 conn(0x7fb668159cf0 0x7fb6680b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 >> v2:172.21.15.37:3300/0 conn(0x7fb6680724e0 msgr2=0x7fb66815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 --2- 172.21.15.37:0/3292674720 >> v2:172.21.15.37:3300/0 conn(0x7fb6680724e0 0x7fb66815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66815a270 con 0x7fb668159920 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fb664001680 con 0x7fb668159920 2023-07-09T21:22:37.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 >> v1:172.21.15.119:6789/0 conn(0x7fb668159920 legacy=0x7fb6680cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 0x7fb654003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6540047d0 0x7fb654004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540052a0 0x7fb65400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66815afb0 con 0x7fb6540047d0 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680cc4e0 con 0x7fb654003980 2023-07-09T21:22:37.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb65400c1e0 con 0x7fb6540052a0 2023-07-09T21:22:37.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640ccee0 con 0x7fb9640b47a0 2023-07-09T21:22:37.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 0x7fb654003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd46676640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400c97b0 0x7efd40158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd46676640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd4015ff20 0x7efd400b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd46676640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c5030 con 0x7efd400afef0 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd46676640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c5310 con 0x7efd4015ff20 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd46676640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd400c55f0 con 0x7efd400c97b0 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd45674640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd400afef0 0x7efd40158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd45674640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd400afef0 0x7efd40158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34144/0 (socket says 172.21.15.37:34144) 2023-07-09T21:22:37.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd45674640 1 -- 172.21.15.37:0/751917857 learned_addr learned my addr 172.21.15.37:0/751917857 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400c97b0 0x7efd40158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd45e75640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd4015ff20 0x7efd400b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 -- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd4015ff20 msgr2=0x7efd400b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efd4015ff20 0x7efd400b0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 -- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd400afef0 msgr2=0x7efd40158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efd400afef0 0x7efd40158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c009420 con 0x7efd400c97b0 2023-07-09T21:22:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406f3b0 msgr2=0x7ffb040cea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb09346640 1 -- 172.21.15.37:0/2292217152 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40ab680 con 0x7ffb0406f3b0 2023-07-09T21:22:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406f3b0 0x7ffb040cea90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009870 tx=0x7ffaf401c4a0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2292217152 shutdown_connections 2023-07-09T21:22:37.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406f3b0 0x7ffb040cea90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2292217152 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb0406efe0 0x7ffb041636f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2292217152 >> 172.21.15.37:0/2292217152 conn(0x7ffb0406dde0 msgr2=0x7ffb040cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7efd44e73640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400c97b0 0x7efd40158580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ac000 tx=0x7efd3c0191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540052a0 msgr2=0x7fb65400b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540052a0 0x7fb65400b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3292674720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6540047d0 msgr2=0x7fb654004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6540047d0 0x7fb654004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3292674720 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb654003530 con 0x7fb654003980 2023-07-09T21:22:37.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fb66e1b6640 1 -- 172.21.15.37:0/3292674720 reap_dead start 2023-07-09T21:22:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0ba070 con 0x7efd400c97b0 2023-07-09T21:22:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c0ad930 con 0x7efd400c97b0 2023-07-09T21:22:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0adcc0 con 0x7efd400c97b0 2023-07-09T21:22:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9beffd640 1 -- 172.21.15.37:0/4249639750 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112754078 0 0) 0x7fd9c00d1dc0 con 0x7fd9c00b3a50 2023-07-09T21:22:37.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9beffd640 1 -- 172.21.15.37:0/4249639750 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9a8003530 con 0x7fd9c00b3a50 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 -- 172.21.15.37:0/4249639750 >> v2:172.21.15.37:3300/0 conn(0x7fd9c00b4e20 msgr2=0x7fd9c00b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 --2- 172.21.15.37:0/4249639750 >> v2:172.21.15.37:3300/0 conn(0x7fd9c00b4e20 0x7fd9c00b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 -- 172.21.15.37:0/4249639750 >> v1:172.21.15.119:6789/0 conn(0x7fd9c00b3a50 legacy=0x7fd9c00b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fd9bf7fe640 1 -- 172.21.15.37:0/4249639750 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c00d1a50 con 0x7fd9c006a840 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400c58d0 con 0x7efd400c97b0 2023-07-09T21:22:37.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd400c4c50 con 0x7efd400c97b0 2023-07-09T21:22:37.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7f09550c7640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f093c0043a0 0x7f093c004870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f094c004f90 tx=0x7f094c01f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8b3c8cde3f1d8c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7efd237fe640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd1c000fd0 con 0x7efd400c97b0 2023-07-09T21:22:37.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb9637fe640 1 -- 172.21.15.37:0/3742302201 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671623943 0 0) 0x7fb9640cef80 con 0x7fb9640b4140 2023-07-09T21:22:37.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb9637fe640 1 -- 172.21.15.37:0/3742302201 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb954003530 con 0x7fb9640b4140 2023-07-09T21:22:37.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb963fff640 1 -- 172.21.15.37:0/3742302201 >> v1:172.21.15.119:6789/0 conn(0x7fb9640b7a60 legacy=0x7fb9640cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb963fff640 1 -- 172.21.15.37:0/3742302201 >> v1:172.21.15.37:6789/0 conn(0x7fb9640b4140 legacy=0x7fb9640d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb963fff640 1 -- 172.21.15.37:0/3742302201 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640cf540 con 0x7fb9640b47a0 2023-07-09T21:22:37.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0058e0 con 0x7f093c0043a0 2023-07-09T21:22:37.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c005a60 con 0x7f093c0043a0 2023-07-09T21:22:37.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7f09548c6640 1 -- 172.21.15.37:0/173109327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c005e10 con 0x7f093c0043a0 2023-07-09T21:22:37.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.714+0000 7fbace7fc640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7fbabc06ec00 0x7fbabc071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== osd.2 v2:172.21.15.37:6800/836778419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fbabc0716c0 con 0x7fbabc06ec00 2023-07-09T21:22:37.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fbaceffd640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbabc066350 0x7fbabc068800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac00ae000 tx=0x7fbac0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fd9bf7fe640 1 --2- 172.21.15.37:0/4249639750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e50 tx=0x7fd9b801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f4bfef74f9722b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 -- 172.21.15.37:0/173109327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f093c0043a0 msgr2=0x7f093c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 --2- 172.21.15.37:0/173109327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f093c0043a0 0x7f093c004870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f094c004f90 tx=0x7f094c01f8f0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09560c9640 1 -- 172.21.15.37:0/173109327 reap_dead start 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 -- 172.21.15.37:0/173109327 shutdown_connections 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 -- 172.21.15.37:0/173109327 >> 172.21.15.37:0/173109327 conn(0x7f09500ce8a0 msgr2=0x7f09500ca690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 -- 172.21.15.37:0/173109327 shutdown_connections 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efd3c0b4040 con 0x7efd400c97b0 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd24066350 0x7efd24068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efd3c11db60 con 0x7efd400c97b0 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7efd2406ec00 0x7efd24071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd240716c0 con 0x7efd2406ec00 2023-07-09T21:22:37.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd3c11df10 con 0x7efd400c97b0 2023-07-09T21:22:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2292217152 shutdown_connections 2023-07-09T21:22:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2292217152 wait complete. 2023-07-09T21:22:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7ffb0c5ac640 1 Processor -- start 2023-07-09T21:22:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7ffb0c5ac640 1 -- start start 2023-07-09T21:22:37.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7efd45674640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd24066350 0x7efd24068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 0x7fb654003d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c240 tx=0x7fb66401cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffdbbb5a6667503e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.718+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640a59c0 con 0x7fb654003980 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6640a5b40 con 0x7fb654003980 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66c9b3640 1 -- 172.21.15.37:0/3292674720 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6640058e0 con 0x7fb654003980 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 msgr2=0x7fb654003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 0x7fb654003d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb66400c240 tx=0x7fb66401cc30 comp rx=0 tx=0).stop 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3292674720 shutdown_connections 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 --2- 172.21.15.37:0/3292674720 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb654003980 0x7fb654003d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3292674720 >> 172.21.15.37:0/3292674720 conn(0x7fb66806dd90 msgr2=0x7fb6680cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3292674720 shutdown_connections 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3292674720 wait complete. 2023-07-09T21:22:37.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.722+0000 7f09568ca640 1 -- 172.21.15.37:0/173109327 wait complete. 2023-07-09T21:22:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 0x7ffb04143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7efd45674640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd24066350 0x7efd24068800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd38005c10 tx=0x7efd38009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cefd0 0x7ffb0413f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7efd45e75640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7efd2406ec00 0x7efd24071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb040b3c60 0x7ffb040af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0413f890 con 0x7ffb040cefd0 2023-07-09T21:22:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb04088d10 con 0x7ffb0406efe0 2023-07-09T21:22:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0413fb10 con 0x7ffb040b3c60 2023-07-09T21:22:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 Processor -- start 2023-07-09T21:22:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7f09568ca640 1 Processor -- start 2023-07-09T21:22:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 0x7ffb04143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 0x7ffb04143430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50206/0 (socket says 172.21.15.37:50206) 2023-07-09T21:22:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 -- 172.21.15.37:0/2409236636 learned_addr learned my addr 172.21.15.37:0/2409236636 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 -- start start 2023-07-09T21:22:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0ab49640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb040b3c60 0x7ffb040af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb09b47640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cefd0 0x7ffb0413f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 -- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb040b3c60 msgr2=0x7ffb040af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb040b3c60 0x7ffb040af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 -- 172.21.15.37:0/2409236636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cefd0 msgr2=0x7ffb0413f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb040cefd0 0x7ffb0413f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40094d0 con 0x7ffb0406efe0 2023-07-09T21:22:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7efd45e75640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7efd2406ec00 0x7efd24071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0a348640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 0x7ffb04143430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e930 tx=0x7ffb0000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb963fff640 1 --2- 172.21.15.37:0/3742302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b47a0 0x7fb9640b3c00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9500097c0 tx=0x7fb95001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9869e96dc1132bae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654003980 0x7fb6680c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6680c8000 0x7fb6680c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6680cde90 0x7fb6680ce300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c9580 con 0x7fb654003980 2023-07-09T21:22:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680ce840 con 0x7fb6680c8000 2023-07-09T21:22:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e9b7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c90f0 con 0x7fb6680cde90 2023-07-09T21:22:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7f09568ca640 1 -- start start 2023-07-09T21:22:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e1b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6680cde90 0x7fb6680ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e1b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6680cde90 0x7fb6680ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49732/0 (socket says 172.21.15.37:49732) 2023-07-09T21:22:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66e1b6640 1 -- 172.21.15.37:0/3482739495 learned_addr learned my addr 172.21.15.37:0/3482739495 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654003980 0x7fb6680c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb00009690 con 0x7ffb0406efe0 2023-07-09T21:22:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0000ca00 con 0x7ffb0406efe0 2023-07-09T21:22:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0000cd70 con 0x7ffb0406efe0 2023-07-09T21:22:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== osd.1 v2:172.21.15.37:6816/3133493931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efd240716c0 con 0x7efd2406ec00 2023-07-09T21:22:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0413fdf0 con 0x7ffb0406efe0 2023-07-09T21:22:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6680cde90 msgr2=0x7fb6680ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6680cde90 0x7fb6680ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6680c8000 msgr2=0x7fb6680c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb66d1b4640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6680c8000 0x7fb6680c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb040b4100 con 0x7ffb0406efe0 2023-07-09T21:22:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb9637fe640 1 -- 172.21.15.37:0/3742302201 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500ab600 con 0x7fb9640b47a0 2023-07-09T21:22:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb9637fe640 1 -- 172.21.15.37:0/3742302201 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9500a7050 con 0x7fb9640b47a0 2023-07-09T21:22:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fb9637fe640 1 -- 172.21.15.37:0/3742302201 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500ab980 con 0x7fb9640b47a0 2023-07-09T21:22:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6680c8000 0x7fb6680c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66d9b5640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680c84e0 con 0x7fb654003980 2023-07-09T21:22:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66d1b4640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6680c8000 0x7fb6680c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b47a0 msgr2=0x7fb9640b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb96ab59640 1 --2- 172.21.15.37:0/3742302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b47a0 0x7fb9640b3c00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9500097c0 tx=0x7fb95001c480 comp rx=0 tx=0).stop 2023-07-09T21:22:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 shutdown_connections 2023-07-09T21:22:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb96ab59640 1 --2- 172.21.15.37:0/3742302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b47a0 0x7fb9640b3c00 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb9500097c0 tx=0x7fb95001c480 comp rx=0 tx=0).stop 2023-07-09T21:22:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 >> 172.21.15.37:0/3742302201 conn(0x7fb964073050 msgr2=0x7fb964069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66d9b5640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654003980 0x7fb6680c9bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c1b0 tx=0x7fb654005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f095014b490 0x7f09501f95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 0x7f095006b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09500c16b0 0x7f09500c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09500b0af0 con 0x7f095014b490 2023-07-09T21:22:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095006b7b0 con 0x7f09500c16b0 2023-07-09T21:22:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09501f9b00 con 0x7f095006ae00 2023-07-09T21:22:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffaf8ff9640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb040b4350 con 0x7ffb0406efe0 2023-07-09T21:22:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09558c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f095014b490 0x7f09501f95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 0x7f095006b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 0x7f095006b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49748/0 (socket says 172.21.15.37:49748) 2023-07-09T21:22:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 -- 172.21.15.37:0/529885467 learned_addr learned my addr 172.21.15.37:0/529885467 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09558c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f095014b490 0x7f09501f95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34200/0 (socket says 172.21.15.37:34200) 2023-07-09T21:22:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664004c00 con 0x7fb654003980 2023-07-09T21:22:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb664004d60 con 0x7fb654003980 2023-07-09T21:22:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb664007310 con 0x7fb654003980 2023-07-09T21:22:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb00013470 con 0x7ffb0406efe0 2023-07-09T21:22:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6680c87c0 con 0x7fb654003980 2023-07-09T21:22:37.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6680c8d80 con 0x7fb654003980 2023-07-09T21:22:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 -- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09500c16b0 msgr2=0x7f09500c1b50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:22:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09500c16b0 0x7f09500c1b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 -- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f095014b490 msgr2=0x7f09501f95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f095014b490 0x7f09501f95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f095014dd30 con 0x7f095006ae00 2023-07-09T21:22:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffafaffd640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffae80662d0 0x7ffae8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09550c7640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 0x7f095006b270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f094c0264c0 tx=0x7f093c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb66806c5e0 con 0x7fb654003980 2023-07-09T21:22:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c001d00 con 0x7f095006ae00 2023-07-09T21:22:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c0013c0 con 0x7f095006ae00 2023-07-09T21:22:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c008110 con 0x7f095006ae00 2023-07-09T21:22:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095014e010 con 0x7f095006ae00 2023-07-09T21:22:37.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095014e5d0 con 0x7f095006ae00 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb00083fa0 con 0x7ffb0406efe0 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffb09b47640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffae80662d0 0x7ffae8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7ffafaffd640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7ffae806eb00 0x7ffae8070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffae80715c0 con 0x7ffae806eb00 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb000514c0 con 0x7ffb0406efe0 2023-07-09T21:22:37.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffb0ab49640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7ffae806eb00 0x7ffae8070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09500ca1e0 con 0x7f095006ae00 2023-07-09T21:22:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffb0ab49640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7ffae806eb00 0x7ffae8070f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffb09b47640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffae80662d0 0x7ffae8068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40af000 tx=0x7ffaf4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb664007470 con 0x7fb654003980 2023-07-09T21:22:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== osd.4 v2:172.21.15.119:6808/1723829532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffae80715c0 con 0x7ffae806eb00 2023-07-09T21:22:37.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb64c066300 0x7fb64c0687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6640b4030 con 0x7fb654003980 2023-07-09T21:22:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7fb64c06ebb0 0x7fb64c070fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb64c071670 con 0x7fb64c06ebb0 2023-07-09T21:22:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb66411f940 con 0x7fb654003980 2023-07-09T21:22:37.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9beffd640 1 -- 172.21.15.37:0/4249639750 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80a5780 con 0x7fd9c006a840 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9beffd640 1 -- 172.21.15.37:0/4249639750 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b80a58e0 con 0x7fd9c006a840 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 -- 172.21.15.37:0/4249639750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 msgr2=0x7fd9c00d05b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9beffd640 1 -- 172.21.15.37:0/4249639750 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b80a5780 con 0x7fd9c006a840 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 --2- 172.21.15.37:0/4249639750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e50 tx=0x7fd9b801c8e0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 -- 172.21.15.37:0/4249639750 shutdown_connections 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 --2- 172.21.15.37:0/4249639750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c006a840 0x7fd9c00d05b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 --2- 172.21.15.37:0/4249639750 >> v2:172.21.15.37:3300/0 conn(0x7fd9c00b4e20 0x7fd9c00b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 -- 172.21.15.37:0/4249639750 >> 172.21.15.37:0/4249639750 conn(0x7fd9c00d2bf0 msgr2=0x7fd9c0069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 -- 172.21.15.37:0/4249639750 shutdown_connections 2023-07-09T21:22:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.726+0000 7fd9c652c640 1 -- 172.21.15.37:0/4249639750 wait complete. 2023-07-09T21:22:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f094c008270 con 0x7f095006ae00 2023-07-09T21:22:37.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 Processor -- start 2023-07-09T21:22:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 -- start start 2023-07-09T21:22:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 0x7fd9c015e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 shutdown_connections 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c00b3a50 0x7fd9c015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c00b4e20 0x7fd9c0155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 0x7fd9c015e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9bffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 0x7fd9c015e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50248/0 (socket says 172.21.15.37:50248) 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c00b3a50 0x7fd9c015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9bf7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c00b3a50 0x7fd9c015bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49760/0 (socket says 172.21.15.37:49760) 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9bffff640 1 -- 172.21.15.37:0/172154438 learned_addr learned my addr 172.21.15.37:0/172154438 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0148510 con 0x7fd9c00b4e20 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c015e910 con 0x7fd9c006a840 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c015c300 con 0x7fd9c00b3a50 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.730+0000 7fd9c4ac9640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c00b4e20 0x7fd9c0155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 -- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c00b3a50 msgr2=0x7fd9c015bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd9c00b3a50 0x7fd9c015bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 -- 172.21.15.37:0/172154438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c00b4e20 msgr2=0x7fd9c0155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c00b4e20 0x7fd9c0155450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009b30 con 0x7fd9c006a840 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bffff640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 0x7fd9c015e3d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0050530 tx=0x7fd9b00509f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.734+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0005280 con 0x7fd9c006a840 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b00053e0 con 0x7fd9c006a840 2023-07-09T21:22:37.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0003820 con 0x7fd9c006a840 2023-07-09T21:22:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb66e1b6640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7fb64c06ebb0 0x7fb64c070fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb66d1b4640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb64c066300 0x7fb64c0687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0934066280 0x7f0934068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb66e1b6640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7fb64c06ebb0 0x7fb64c070fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f094c121470 con 0x7f095006ae00 2023-07-09T21:22:37.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb66d1b4640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb64c066300 0x7fb64c0687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6680c6a70 tx=0x7fb658008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb96ab59640 1 -- 172.21.15.37:0/3742302201 wait complete. 2023-07-09T21:22:37.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f093406eb30 0x7f0934070f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09340715f0 con 0x7f093406eb30 2023-07-09T21:22:37.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f094c121820 con 0x7f095006ae00 2023-07-09T21:22:37.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09558c8640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0934066280 0x7f0934068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c015c5e0 con 0x7fd9c006a840 2023-07-09T21:22:37.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09560c9640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f093406eb30 0x7f0934070f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== osd.7 v2:172.21.15.119:6816/904929402 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb64c071670 con 0x7fb64c06ebb0 2023-07-09T21:22:37.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09558c8640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0934066280 0x7f0934068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0940006b20 tx=0x7f0940008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb96ab59640 1 Processor -- start 2023-07-09T21:22:37.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c015cba0 con 0x7fd9c006a840 2023-07-09T21:22:37.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7f09560c9640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f093406eb30 0x7f0934070f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9c00d0af0 con 0x7fd9c006a840 2023-07-09T21:22:37.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== osd.3 v2:172.21.15.37:6824/1042910606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f09340715f0 con 0x7f093406eb30 2023-07-09T21:22:37.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.738+0000 7fb96ab59640 1 -- start start 2023-07-09T21:22:37.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b4140 0x7fb96414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 0x7fb964154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964153630 0x7fb96414fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb9688f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b4140 0x7fb96414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb9688f5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b4140 0x7fb96414f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50252/0 (socket says 172.21.15.37:50252) 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 0x7fb964154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 0x7fb964154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49768/0 (socket says 172.21.15.37:49768) 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb9688f5640 1 -- 172.21.15.37:0/104259778 learned_addr learned my addr 172.21.15.37:0/104259778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96415e4b0 con 0x7fb964153630 2023-07-09T21:22:37.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb9690f6640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964153630 0x7fb96414fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb964153ac0 con 0x7fb9640b4140 2023-07-09T21:22:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb964153da0 con 0x7fb9640b7a60 2023-07-09T21:22:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9b0003980 con 0x7fd9c006a840 2023-07-09T21:22:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd9ac066280 0x7fd9ac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd9b00c6fd0 con 0x7fd9c006a840 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7fd9ac06eab0 0x7fd9ac070ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9ac071570 con 0x7fd9ac06eab0 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9b00c9670 con 0x7fd9c006a840 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 -- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b4140 msgr2=0x7fb96414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9640b4140 0x7fb96414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 -- 172.21.15.37:0/104259778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964153630 msgr2=0x7fb96414fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb964153630 0x7fb96414fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.742+0000 7fb963fff640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb950009420 con 0x7fb9640b7a60 2023-07-09T21:22:37.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb963fff640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 0x7fb964154b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ab000 tx=0x7fb950019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fd9c4ac9640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7fd9ac06eab0 0x7fd9ac070ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fd9bf7fe640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd9ac066280 0x7fd9ac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500b4840 con 0x7fb9640b7a60 2023-07-09T21:22:37.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9500b49e0 con 0x7fb9640b7a60 2023-07-09T21:22:37.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9500b4d90 con 0x7fb9640b7a60 2023-07-09T21:22:37.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb964154080 con 0x7fb9640b7a60 2023-07-09T21:22:37.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb964154640 con 0x7fb9640b7a60 2023-07-09T21:22:37.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fd9c4ac9640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7fd9ac06eab0 0x7fd9ac070ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fd9bf7fe640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd9ac066280 0x7fd9ac068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ae000 tx=0x7fd9b80a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fbad5a56640 1 -- 172.21.15.37:0/4172310384 --> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbad00c9c80 con 0x7fbabc06ec00 2023-07-09T21:22:37.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb96404d7d0 con 0x7fb9640b7a60 2023-07-09T21:22:37.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fbab7fff640 1 -- 172.21.15.37:0/4172310384 <== osd.2 v2:172.21.15.37:6800/836778419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbad00c9c80 con 0x7fbabc06ec00 2023-07-09T21:22:37.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.746+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== osd.5 v2:172.21.15.119:6821/2030521603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd9ac071570 con 0x7fd9ac06eab0 2023-07-09T21:22:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7fbabc06ec00 msgr2=0x7fbabc071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7fbabc06ec00 0x7fbabc071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbabc066350 msgr2=0x7fbabc068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbabc066350 0x7fbabc068800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbac00ae000 tx=0x7fbac0008040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 msgr2=0x7fbad0149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 --2- 172.21.15.37:0/4172310384 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbad0164580 0x7fbad0149360 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbac800efc0 tx=0x7fbac800c490 comp rx=0 tx=0).stop 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbacf7fe640 1 -- 172.21.15.37:0/4172310384 reap_dead start 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 shutdown_connections 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 >> 172.21.15.37:0/4172310384 conn(0x7fbad00ca6c0 msgr2=0x7fbad01586f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9500b2040 con 0x7fb9640b7a60 2023-07-09T21:22:37.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 shutdown_connections 2023-07-09T21:22:37.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fbab5ffb640 1 -- 172.21.15.37:0/4172310384 wait complete. 2023-07-09T21:22:37.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9480662d0 0x7fb948068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb95011e920 con 0x7fb9640b7a60 2023-07-09T21:22:37.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fb94806eb80 0x7fb948070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:37.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb948071640 con 0x7fb94806eb80 2023-07-09T21:22:37.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb95011ec90 con 0x7fb9640b7a60 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9688f5640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9480662d0 0x7fb948068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.750+0000 7fb9690f6640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fb94806eb80 0x7fb948070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.754+0000 7fb9690f6640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fb94806eb80 0x7fb948070f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.754+0000 7fb9688f5640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9480662d0 0x7fb948068780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb958007fd0 tx=0x7fb958009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.754+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== osd.6 v2:172.21.15.119:6800/1695629895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb948071640 con 0x7fb94806eb80 2023-07-09T21:22:37.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd237fe640 1 -- 172.21.15.37:0/751917857 --> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd1c002cc0 con 0x7efd2406ec00 2023-07-09T21:22:37.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd35ffb640 1 -- 172.21.15.37:0/751917857 <== osd.1 v2:172.21.15.37:6816/3133493931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd1c002cc0 con 0x7efd2406ec00 2023-07-09T21:22:37.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7efd2406ec00 msgr2=0x7efd24071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7efd2406ec00 0x7efd24071010 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd24066350 msgr2=0x7efd24068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7efd24066350 0x7efd24068800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd38005c10 tx=0x7efd38009040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400c97b0 msgr2=0x7efd40158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 --2- 172.21.15.37:0/751917857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efd400c97b0 0x7efd40158580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efd3c0ac000 tx=0x7efd3c0191f0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd45e75640 1 -- 172.21.15.37:0/751917857 reap_dead start 2023-07-09T21:22:37.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 shutdown_connections 2023-07-09T21:22:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 >> 172.21.15.37:0/751917857 conn(0x7efd400ce8a0 msgr2=0x7efd40069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 shutdown_connections 2023-07-09T21:22:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.758+0000 7efd46676640 1 -- 172.21.15.37:0/751917857 wait complete. 2023-07-09T21:22:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f605d69e640 1 -- 172.21.15.37:0/3514574037 --> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6038002cc0 con 0x7f604406ec00 2023-07-09T21:22:37.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603f7fe640 1 -- 172.21.15.37:0/3514574037 <== osd.0 v2:172.21.15.37:6808/3872612948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6038002cc0 con 0x7f604406ec00 2023-07-09T21:22:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7ffaf8ff9640 1 -- 172.21.15.37:0/2409236636 --> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ffb04088b90 con 0x7ffae806eb00 2023-07-09T21:22:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7f604406ec00 msgr2=0x7f6044071010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7f604406ec00 0x7f6044071010 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6044066350 msgr2=0x7f6044068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6044066350 0x7f6044068800 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6048000f70 tx=0x7f6048009040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 msgr2=0x7f605814d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 --2- 172.21.15.37:0/3514574037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60580c9eb0 0x7f605814d450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f60500ab000 tx=0x7f60500199b0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f60577fe640 1 -- 172.21.15.37:0/3514574037 reap_dead start 2023-07-09T21:22:37.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7ffafaffd640 1 -- 172.21.15.37:0/2409236636 <== osd.4 v2:172.21.15.119:6808/1723829532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ffafc001e80 con 0x7ffae806eb00 2023-07-09T21:22:37.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 shutdown_connections 2023-07-09T21:22:37.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 >> 172.21.15.37:0/3514574037 conn(0x7f60580ca6c0 msgr2=0x7f6058156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 shutdown_connections 2023-07-09T21:22:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7ffae806eb00 msgr2=0x7ffae8070f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.766+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7ffae806eb00 0x7ffae8070f10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7f603d7fa640 1 -- 172.21.15.37:0/3514574037 wait complete. 2023-07-09T21:22:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffae80662d0 msgr2=0x7ffae8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffae80662d0 0x7ffae8068780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40af000 tx=0x7ffaf4009040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 msgr2=0x7ffb04143430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 --2- 172.21.15.37:0/2409236636 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb0406efe0 0x7ffb04143430 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb0000e930 tx=0x7ffb0000edf0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0ab49640 1 -- 172.21.15.37:0/2409236636 reap_dead start 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 shutdown_connections 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 >> 172.21.15.37:0/2409236636 conn(0x7ffb0406dde0 msgr2=0x7ffb0406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 shutdown_connections 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7ffb0c5ac640 1 -- 172.21.15.37:0/2409236636 wait complete. 2023-07-09T21:22:37.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 --> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09500c9f00 con 0x7f093406eb30 2023-07-09T21:22:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.770+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 --> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb66804e020 con 0x7fb64c06ebb0 2023-07-09T21:22:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09467fc640 1 -- 172.21.15.37:0/529885467 <== osd.3 v2:172.21.15.37:6824/1042910606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f094800f040 con 0x7f093406eb30 2023-07-09T21:22:37.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb65e7fc640 1 -- 172.21.15.37:0/3482739495 <== osd.7 v2:172.21.15.119:6816/904929402 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb66804e020 con 0x7fb64c06ebb0 2023-07-09T21:22:37.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f093406eb30 msgr2=0x7f0934070f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f093406eb30 0x7f0934070f40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0934066280 msgr2=0x7f0934068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0934066280 0x7f0934068730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0940006b20 tx=0x7f0940008040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 msgr2=0x7f095006b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 --2- 172.21.15.37:0/529885467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f095006ae00 0x7f095006b270 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f094c0264c0 tx=0x7f093c005800 comp rx=0 tx=0).stop 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09560c9640 1 -- 172.21.15.37:0/529885467 reap_dead start 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 shutdown_connections 2023-07-09T21:22:37.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 >> 172.21.15.37:0/529885467 conn(0x7f09500ce8a0 msgr2=0x7f0950070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7fb64c06ebb0 msgr2=0x7fb64c070fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7fb64c06ebb0 0x7fb64c070fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 shutdown_connections 2023-07-09T21:22:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7f09568ca640 1 -- 172.21.15.37:0/529885467 wait complete. 2023-07-09T21:22:37.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb64c066300 msgr2=0x7fb64c0687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb64c066300 0x7fb64c0687b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb6680c6a70 tx=0x7fb658008040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654003980 msgr2=0x7fb6680c9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 --2- 172.21.15.37:0/3482739495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654003980 0x7fb6680c9bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c1b0 tx=0x7fb654005800 comp rx=0 tx=0).stop 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e1b6640 1 -- 172.21.15.37:0/3482739495 reap_dead start 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 shutdown_connections 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 >> 172.21.15.37:0/3482739495 conn(0x7fb66806dd90 msgr2=0x7fb66815b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 shutdown_connections 2023-07-09T21:22:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fb66e9b7640 1 -- 172.21.15.37:0/3482739495 wait complete. 2023-07-09T21:22:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.774+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 --> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd9c015cdc0 con 0x7fd9ac06eab0 2023-07-09T21:22:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9bcff9640 1 -- 172.21.15.37:0/172154438 <== osd.5 v2:172.21.15.119:6821/2030521603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd9c015cdc0 con 0x7fd9ac06eab0 2023-07-09T21:22:37.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7fd9ac06eab0 msgr2=0x7fd9ac070ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7fd9ac06eab0 0x7fd9ac070ec0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd9ac066280 msgr2=0x7fd9ac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd9ac066280 0x7fd9ac068730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd9b80ae000 tx=0x7fd9b80a7070 comp rx=0 tx=0).stop 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 msgr2=0x7fd9c015e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 --2- 172.21.15.37:0/172154438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd9c006a840 0x7fd9c015e3d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0050530 tx=0x7fd9b00509f0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c4ac9640 1 -- 172.21.15.37:0/172154438 reap_dead start 2023-07-09T21:22:37.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 shutdown_connections 2023-07-09T21:22:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 >> 172.21.15.37:0/172154438 conn(0x7fd9c00d2bf0 msgr2=0x7fd9c00b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 shutdown_connections 2023-07-09T21:22:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fd9c652c640 1 -- 172.21.15.37:0/172154438 wait complete. 2023-07-09T21:22:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.778+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 --> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb9640b1520 con 0x7fb94806eb80 2023-07-09T21:22:37.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb9617fa640 1 -- 172.21.15.37:0/104259778 <== osd.6 v2:172.21.15.119:6800/1695629895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb9640b1520 con 0x7fb94806eb80 2023-07-09T21:22:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fb94806eb80 msgr2=0x7fb948070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fb94806eb80 0x7fb948070f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:37.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9480662d0 msgr2=0x7fb948068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9480662d0 0x7fb948068780 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb958007fd0 tx=0x7fb958009040 comp rx=0 tx=0).stop 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 msgr2=0x7fb964154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 --2- 172.21.15.37:0/104259778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9640b7a60 0x7fb964154b60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ab000 tx=0x7fb950019220 comp rx=0 tx=0).stop 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb9690f6640 1 -- 172.21.15.37:0/104259778 reap_dead start 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 shutdown_connections 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 >> 172.21.15.37:0/104259778 conn(0x7fb964073050 msgr2=0x7fb9640b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 shutdown_connections 2023-07-09T21:22:37.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:37.782+0000 7fb96ab59640 1 -- 172.21.15.37:0/104259778 wait complete. 2023-07-09T21:22:37.835 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:37.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T21:22:37.836 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:37.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T21:22:37.837 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:37.838 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T21:22:37.838 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:37.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T21:22:37.840 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:37.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T21:22:37.841 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:37.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T21:22:37.842 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-07-09T21:22:37.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T21:22:37.843 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:37.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T21:22:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.114+0000 7f6bd0d9f640 1 Processor -- start 2023-07-09T21:22:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.114+0000 7f6bd0d9f640 1 -- start start 2023-07-09T21:22:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bd0d9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bcc158500 0x7f6bcc15c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bd0d9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc15ced0 con 0x7f6bcc06b970 2023-07-09T21:22:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bd0d9f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bcc1588d0 con 0x7f6bcc0694c0 2023-07-09T21:22:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bd0d9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bcc06b610 con 0x7f6bcc158500 2023-07-09T21:22:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bca59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bcc158500 0x7f6bcc15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bcad9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f6bcc0694c0 0x7f6bcc06ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51158/0 (socket says 172.21.15.37:51158) 2023-07-09T21:22:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bcad9d640 1 -- 172.21.15.37:0/555121684 learned_addr learned my addr 172.21.15.37:0/555121684 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bca59c640 1 -- 172.21.15.37:0/555121684 >> v1:172.21.15.119:6789/0 conn(0x7f6bcc0694c0 legacy=0x7f6bcc06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bca59c640 1 -- 172.21.15.37:0/555121684 >> v1:172.21.15.37:6789/0 conn(0x7f6bcc06b970 legacy=0x7f6bcc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.118+0000 7f6bca59c640 1 -- 172.21.15.37:0/555121684 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bcc06b050 con 0x7f6bcc158500 2023-07-09T21:22:38.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bca59c640 1 --2- 172.21.15.37:0/555121684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc158500 0x7f6bcc15c990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097c0 tx=0x7f6bc001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a243e13723e0f288 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bc959a640 1 -- 172.21.15.37:0/555121684 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab600 con 0x7f6bcc158500 2023-07-09T21:22:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bc959a640 1 -- 172.21.15.37:0/555121684 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a7050 con 0x7f6bcc158500 2023-07-09T21:22:38.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bc959a640 1 -- 172.21.15.37:0/555121684 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00ab980 con 0x7f6bcc158500 2023-07-09T21:22:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/555121684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc158500 msgr2=0x7f6bcc15c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 --2- 172.21.15.37:0/555121684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc158500 0x7f6bcc15c990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00097c0 tx=0x7f6bc001c480 comp rx=0 tx=0).stop 2023-07-09T21:22:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/555121684 shutdown_connections 2023-07-09T21:22:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 --2- 172.21.15.37:0/555121684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc158500 0x7f6bcc15c990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/555121684 >> 172.21.15.37:0/555121684 conn(0x7f6bcc0ca6c0 msgr2=0x7f6bcc0caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/555121684 shutdown_connections 2023-07-09T21:22:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/555121684 wait complete. 2023-07-09T21:22:38.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.126+0000 7fb02aa56640 1 Processor -- start 2023-07-09T21:22:38.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 -- start start 2023-07-09T21:22:38.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bd0d9f640 1 Processor -- start 2023-07-09T21:22:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb01c053fc0 0x7fb01c0545c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c036590 0x7fb01c0369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c050cc0 con 0x7fb01c0e2630 2023-07-09T21:22:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c053cc0 con 0x7fb01c053fc0 2023-07-09T21:22:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb02aa56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c050ef0 con 0x7fb01c036590 2023-07-09T21:22:38.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb023fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb01c0e2630 0x7fb01c04f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57050/0 (socket says 172.21.15.37:57050) 2023-07-09T21:22:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb023fff640 1 -- 172.21.15.37:0/1636666498 learned_addr learned my addr 172.21.15.37:0/1636666498 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb0237fe640 1 --2- 172.21.15.37:0/1636666498 >> v2:172.21.15.119:3300/0 conn(0x7fb01c053fc0 0x7fb01c0545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bd0d9f640 1 -- start start 2023-07-09T21:22:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bd0d9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bd0d9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 0x7f6bcc0c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb022ffd640 1 -- 172.21.15.37:0/1636666498 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402380149 0 0) 0x7fb01c050cc0 con 0x7fb01c0e2630 2023-07-09T21:22:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb022ffd640 1 -- 172.21.15.37:0/1636666498 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb014003530 con 0x7fb01c0e2630 2023-07-09T21:22:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7fb0237fe640 1 -- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c036590 msgr2=0x7fb01c0369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bca59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bc9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 0x7f6bcc0c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.130+0000 7f6bca59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49776/0 (socket says 172.21.15.37:49776) 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bc9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 0x7f6bcc0c0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34228/0 (socket says 172.21.15.37:34228) 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc145100 0x7f6bcc157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bc9d9b640 1 -- 172.21.15.37:0/3499224651 learned_addr learned my addr 172.21.15.37:0/3499224651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc159030 con 0x7f6bcc158500 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc145b90 con 0x7f6bcc145100 2023-07-09T21:22:38.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bcc13dfb0 con 0x7f6bcc0694c0 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bcad9d640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc145100 0x7f6bcc157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 -- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc145100 msgr2=0x7f6bcc157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc145100 0x7f6bcc157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 -- 172.21.15.37:0/3499224651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 msgr2=0x7f6bcc0c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 0x7f6bcc0c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc0009420 con 0x7f6bcc0694c0 2023-07-09T21:22:38.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bca59c640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ab000 tx=0x7f6bc001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00b7650 con 0x7f6bcc0694c0 2023-07-09T21:22:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00b77f0 con 0x7f6bcc0694c0 2023-07-09T21:22:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00b7ba0 con 0x7f6bcc0694c0 2023-07-09T21:22:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bcc1455d0 con 0x7f6bcc0694c0 2023-07-09T21:22:38.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bcc13e250 con 0x7f6bcc0694c0 2023-07-09T21:22:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7fb0237fe640 1 --2- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c036590 0x7fb01c0369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7fb0237fe640 1 -- 172.21.15.37:0/1636666498 >> v1:172.21.15.37:6789/0 conn(0x7fb01c0e2630 legacy=0x7fb01c04f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.134+0000 7fb0237fe640 1 -- 172.21.15.37:0/1636666498 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c036f30 con 0x7fb01c053fc0 2023-07-09T21:22:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 Processor -- start 2023-07-09T21:22:38.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bcc04e020 con 0x7f6bcc0694c0 2023-07-09T21:22:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 -- start start 2023-07-09T21:22:38.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb0237fe640 1 --2- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c053fc0 0x7fb01c0545c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097c0 tx=0x7fb01001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467ca5b128d2c710 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7f4ba4434640 1 Processor -- start 2023-07-09T21:22:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb022ffd640 1 -- 172.21.15.37:0/1636666498 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100ac640 con 0x7fb01c053fc0 2023-07-09T21:22:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb022ffd640 1 -- 172.21.15.37:0/1636666498 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0100ac7a0 con 0x7fb01c053fc0 2023-07-09T21:22:38.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb022ffd640 1 -- 172.21.15.37:0/1636666498 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100acb30 con 0x7fb01c053fc0 2023-07-09T21:22:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7f4ba4434640 1 -- start start 2023-07-09T21:22:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 -- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c053fc0 msgr2=0x7fb01c0545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c053fc0 0x7fb01c0545c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb0100097c0 tx=0x7fb01001c3e0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 -- 172.21.15.37:0/1636666498 shutdown_connections 2023-07-09T21:22:38.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c036590 0x7fb01c0369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1636666498 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c053fc0 0x7fb01c0545c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 -- 172.21.15.37:0/1636666498 >> 172.21.15.37:0/1636666498 conn(0x7fb01c051590 msgr2=0x7fb01c051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3540b3a50 0x7fc35406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540d1dc0 con 0x7fc3540b3e20 2023-07-09T21:22:38.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3540cc9e0 con 0x7fc3540b4e20 2023-07-09T21:22:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc35b8d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc35406ad80 con 0x7fc3540b3a50 2023-07-09T21:22:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 -- 172.21.15.37:0/1636666498 shutdown_connections 2023-07-09T21:22:38.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc359e75640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc3540b4e20 0x7fc3540b5260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51164/0 (socket says 172.21.15.37:51164) 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fc359e75640 1 -- 172.21.15.37:0/3877861050 learned_addr learned my addr 172.21.15.37:0/3877861050 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc359674640 1 --2- 172.21.15.37:0/3877861050 >> v2:172.21.15.119:3300/0 conn(0x7fc3540b3a50 0x7fc35406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011537322 0 0) 0x7fc3540cc9e0 con 0x7fc3540b4e20 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bc00b7d00 con 0x7f6bcc0694c0 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f6bbaffd640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 0x7f6bac068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6bc011ee40 con 0x7f6bcc0694c0 2023-07-09T21:22:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.138+0000 7fb02aa56640 1 -- 172.21.15.37:0/1636666498 wait complete. 2023-07-09T21:22:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f6bc9d9b640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 0x7f6bac068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc340003530 con 0x7fc3540b4e20 2023-07-09T21:22:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 856810697 0 0) 0x7fc3540d1dc0 con 0x7fc3540b3e20 2023-07-09T21:22:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3540cc9e0 con 0x7fc3540b3e20 2023-07-09T21:22:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fb02aa56640 1 Processor -- start 2023-07-09T21:22:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fb02aa56640 1 -- start start 2023-07-09T21:22:38.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c036590 0x7fb01c0d3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c053fc0 0x7fb01c048990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0d3dd0 con 0x7fb01c0e2630 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c048ed0 con 0x7fb01c036590 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb02aa56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c03a550 con 0x7fb01c053fc0 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34242/0 (socket says 172.21.15.37:34242) 2023-07-09T21:22:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 -- 172.21.15.37:0/1372188600 learned_addr learned my addr 172.21.15.37:0/1372188600 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb023fff640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c036590 0x7fb01c0d3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f6bc9d9b640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 0x7f6bac068800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0018d0 tx=0x7f6bbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bc00ec330 con 0x7f6bcc0694c0 2023-07-09T21:22:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba4434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba4434640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c15b620 con 0x7f4b9c0c83b0 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba4434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c15b900 con 0x7f4b9c0cb1d0 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba4434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c15bbe0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba21d0640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f4b9c0cb1d0 0x7f4b9c0694c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51166/0 (socket says 172.21.15.37:51166) 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba21d0640 1 -- 172.21.15.37:0/2477952501 learned_addr learned my addr 172.21.15.37:0/2477952501 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba19cf640 1 --2- 172.21.15.37:0/2477952501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba11ce640 1 -- 172.21.15.37:0/2477952501 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833131303 0 0) 0x7f4b9c15b900 con 0x7f4b9c0cb1d0 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba11ce640 1 -- 172.21.15.37:0/2477952501 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b88003450 con 0x7f4b9c0cb1d0 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba19cf640 1 -- 172.21.15.37:0/2477952501 >> v1:172.21.15.119:6789/0 conn(0x7f4b9c0cb1d0 legacy=0x7f4b9c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba19cf640 1 -- 172.21.15.37:0/2477952501 >> v1:172.21.15.37:6789/0 conn(0x7f4b9c0c83b0 legacy=0x7f4b9c0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7f4ba19cf640 1 -- 172.21.15.37:0/2477952501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c15bec0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc359674640 1 -- 172.21.15.37:0/3877861050 >> v1:172.21.15.119:6789/0 conn(0x7fc3540b4e20 legacy=0x7fc3540b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc359674640 1 -- 172.21.15.37:0/3877861050 >> v1:172.21.15.37:6789/0 conn(0x7fc3540b3e20 legacy=0x7fc3540d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.142+0000 7fc359674640 1 -- 172.21.15.37:0/3877861050 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3540d1770 con 0x7fc3540b3a50 2023-07-09T21:22:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 -- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c053fc0 msgr2=0x7fb01c048990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:22:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c053fc0 0x7fb01c048990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 -- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c036590 msgr2=0x7fb01c0d3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c036590 0x7fb01c0d3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 -- 172.21.15.37:0/1372188600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009420 con 0x7fb01c0e2630 2023-07-09T21:22:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb028ff3640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb024067e70 tx=0x7fb024066870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fc359674640 1 --2- 172.21.15.37:0/3877861050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097c0 tx=0x7fc34801c3d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28e1754f30340311 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fbb613f4640 1 Processor -- start 2023-07-09T21:22:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fbb613f4640 1 -- start start 2023-07-09T21:22:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02406ac20 con 0x7fb01c0e2630 2023-07-09T21:22:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02406ad80 con 0x7fb01c0e2630 2023-07-09T21:22:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0240713c0 con 0x7fb01c0e2630 2023-07-09T21:22:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480ac630 con 0x7fc3540b3a50 2023-07-09T21:22:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480ac790 con 0x7fc3540b3a50 2023-07-09T21:22:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7fc347fff640 1 -- 172.21.15.37:0/3877861050 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480acb20 con 0x7fc3540b3a50 2023-07-09T21:22:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0d3fc0 con 0x7fb01c0e2630 2023-07-09T21:22:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- 172.21.15.37:0/3877861050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 msgr2=0x7fc35406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 --2- 172.21.15.37:0/3877861050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35406a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc3480097c0 tx=0x7fc34801c3d0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- 172.21.15.37:0/3877861050 shutdown_connections 2023-07-09T21:22:38.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 --2- 172.21.15.37:0/3877861050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35406a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- 172.21.15.37:0/3877861050 >> 172.21.15.37:0/3877861050 conn(0x7fc3540d2bf0 msgr2=0x7fc354069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb613f4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb5c0c0b20 0x7fbb5c0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb613f4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0cd8e0 con 0x7fbb5c0ccfd0 2023-07-09T21:22:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb613f4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c06b820 con 0x7fbb5c0cb7d0 2023-07-09T21:22:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb613f4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c06c0c0 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0d4580 con 0x7fb01c0e2630 2023-07-09T21:22:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f4ba19cf640 1 --2- 172.21.15.37:0/2477952501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c157770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0097f0 tx=0x7f4b8c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4678f551c480ecf1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- 172.21.15.37:0/3877861050 shutdown_connections 2023-07-09T21:22:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- 172.21.15.37:0/3877861050 wait complete. 2023-07-09T21:22:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb5c0ccfd0 0x7fbb5c164360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57078/0 (socket says 172.21.15.37:57078) 2023-07-09T21:22:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5bfff640 1 -- 172.21.15.37:0/3131157082 learned_addr learned my addr 172.21.15.37:0/3131157082 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 Processor -- start 2023-07-09T21:22:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f4ba11ce640 1 -- 172.21.15.37:0/2477952501 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0ac630 con 0x7f4b9c069bd0 2023-07-09T21:22:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f4ba11ce640 1 -- 172.21.15.37:0/2477952501 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b8c0ac790 con 0x7f4b9c069bd0 2023-07-09T21:22:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f4ba11ce640 1 -- 172.21.15.37:0/2477952501 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0acb20 con 0x7f4b9c069bd0 2023-07-09T21:22:38.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5b7fe640 1 --2- 172.21.15.37:0/3131157082 >> v2:172.21.15.37:3300/0 conn(0x7fbb5c0c0b20 0x7fbb5c0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 -- start start 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4bd40cd880 0x7f4bd406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd41583a0 con 0x7f4bd40b3070 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd40cdc50 con 0x7f4bd40cd880 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd987b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd4158680 con 0x7f4bd4157ea0 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49822/0 (socket says 172.21.15.37:49822) 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 -- 172.21.15.37:0/4116670543 learned_addr learned my addr 172.21.15.37:0/4116670543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd2ffd640 1 --2- 172.21.15.37:0/4116670543 >> v2:172.21.15.119:3300/0 conn(0x7f4bd40cd880 0x7f4bd406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 -- 172.21.15.37:0/4116670543 >> v2:172.21.15.119:3300/0 conn(0x7f4bd40cd880 msgr2=0x7f4bd406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/4116670543 >> v2:172.21.15.119:3300/0 conn(0x7f4bd40cd880 0x7f4bd406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 -- 172.21.15.37:0/4116670543 >> v1:172.21.15.37:6789/0 conn(0x7f4bd40b3070 legacy=0x7f4bd40cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.146+0000 7f4bd27fc640 1 -- 172.21.15.37:0/4116670543 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd4158960 con 0x7f4bd4157ea0 2023-07-09T21:22:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb024071520 con 0x7fb01c0e2630 2023-07-09T21:22:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fb020ff9640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 0x7fb008068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fb023fff640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 0x7fb008068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0240d1290 con 0x7fb01c0e2630 2023-07-09T21:22:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fb023fff640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 0x7fb008068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0180011f0 tx=0x7fb018007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 -- 172.21.15.37:0/2477952501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 msgr2=0x7f4b9c157770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 --2- 172.21.15.37:0/2477952501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c157770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0097f0 tx=0x7f4b8c01c4c0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 -- 172.21.15.37:0/2477952501 shutdown_connections 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 --2- 172.21.15.37:0/2477952501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c157770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 -- 172.21.15.37:0/2477952501 >> 172.21.15.37:0/2477952501 conn(0x7f4b9c0ca6c0 msgr2=0x7f4b9c0caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 -- 172.21.15.37:0/2477952501 shutdown_connections 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 -- 172.21.15.37:0/2477952501 wait complete. 2023-07-09T21:22:38.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4ba4434640 1 Processor -- start 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 -- start start 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 Processor -- start 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fc35b8d8640 1 -- start start 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3540b3e20 0x7fc354200d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50330/0 (socket says 172.21.15.37:50330) 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 -- 172.21.15.37:0/890380907 learned_addr learned my addr 172.21.15.37:0/890380907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 0x7fc3540c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc354201da0 con 0x7fc3540b3e20 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3542012a0 con 0x7fc3540b3a50 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc35b8d8640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc354201500 con 0x7fc3540b4e20 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359e75640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 0x7fc3540c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 -- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 msgr2=0x7fc3540c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 0x7fc3540c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 -- 172.21.15.37:0/890380907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3540b3e20 msgr2=0x7fc354200d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3540b3e20 0x7fc354200d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359674640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc348009420 con 0x7fc3540b3a50 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fc359e75640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 0x7fc3540c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:38.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc359674640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc34801a000 tx=0x7fc348019170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/4116670543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009870 tx=0x7f4bc801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e519f6ff02e99fd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd1ffb640 1 -- 172.21.15.37:0/4116670543 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80aa620 con 0x7f4bd4157ea0 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd1ffb640 1 -- 172.21.15.37:0/4116670543 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc80aa780 con 0x7f4bd4157ea0 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 -- 172.21.15.37:0/4116670543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 msgr2=0x7f4bd40b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd1ffb640 1 -- 172.21.15.37:0/4116670543 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80aa620 con 0x7f4bd4157ea0 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 --2- 172.21.15.37:0/4116670543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8009870 tx=0x7f4bc801c500 comp rx=0 tx=0).stop 2023-07-09T21:22:38.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 -- 172.21.15.37:0/4116670543 shutdown_connections 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 --2- 172.21.15.37:0/4116670543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd4157ea0 0x7f4bd40b2b30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 --2- 172.21.15.37:0/4116670543 >> v2:172.21.15.119:3300/0 conn(0x7f4bd40cd880 0x7f4bd406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f4bd987b640 1 -- 172.21.15.37:0/4116670543 >> 172.21.15.37:0/4116670543 conn(0x7f4bd40694c0 msgr2=0x7f4bd40698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4bd987b640 1 -- 172.21.15.37:0/4116670543 shutdown_connections 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5b7fe640 1 -- 172.21.15.37:0/3131157082 >> v1:172.21.15.119:6789/0 conn(0x7fbb5c0cb7d0 legacy=0x7fbb5c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5b7fe640 1 -- 172.21.15.37:0/3131157082 >> v1:172.21.15.37:6789/0 conn(0x7fbb5c0ccfd0 legacy=0x7fbb5c164360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fbb5b7fe640 1 -- 172.21.15.37:0/3131157082 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c06bb00 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fdcccc56640 1 Processor -- start 2023-07-09T21:22:38.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7fdcccc56640 1 -- start start 2023-07-09T21:22:38.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcccc56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcc815ae70 0x7fdcc806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcccc56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80cc770 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcccc56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc80cb810 con 0x7fdcc8069bd0 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcccc56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc80cbaf0 con 0x7fdcc815ae70 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc5d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdcc80cd1c0 0x7fdcc80694c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57084/0 (socket says 172.21.15.37:57084) 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc5d9b640 1 -- 172.21.15.37:0/865186456 learned_addr learned my addr 172.21.15.37:0/865186456 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc659c640 1 --2- 172.21.15.37:0/865186456 >> v2:172.21.15.119:3300/0 conn(0x7fdcc815ae70 0x7fdcc806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790215296 0 0) 0x7fdcc80cc770 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcb0003530 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3687456700 0 0) 0x7fdcb0003530 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 >> v2:172.21.15.119:3300/0 conn(0x7fdcc815ae70 msgr2=0x7fdcc806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 --2- 172.21.15.37:0/865186456 >> v2:172.21.15.119:3300/0 conn(0x7fdcc815ae70 0x7fdcc806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 >> v1:172.21.15.119:6789/0 conn(0x7fdcc8069bd0 legacy=0x7fdcc815b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80cbdd0 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fdcbc001680 con 0x7fdcc80cd1c0 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 >> v1:172.21.15.37:6789/0 conn(0x7fdcc80cd1c0 legacy=0x7fdcc80694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0003980 0x7fdcb0003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00047d0 0x7fdcb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 0x7fdcb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc80cbaf0 con 0x7fdcb0003980 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00104a0 con 0x7fdcb0005180 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0010660 con 0x7fdcb00047d0 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 0x7fdcb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc5d9b640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00047d0 0x7fdcb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f102ee56640 1 Processor -- start 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.150+0000 7f102ee56640 1 -- start start 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102ee56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f10280d04f0 0x7f10280afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102ee56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10280b3840 0x7f10280b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102ee56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10280af7b0 con 0x7f102815f320 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102ee56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10280cf640 con 0x7f10280d04f0 2023-07-09T21:22:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102ee56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10280b2c00 con 0x7f10280b3840 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10280b3840 0x7f10280b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f10280b3840 0x7f10280b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50342/0 (socket says 172.21.15.37:50342) 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 -- 172.21.15.37:0/16732633 learned_addr learned my addr 172.21.15.37:0/16732633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 -- 172.21.15.37:0/16732633 >> v2:172.21.15.37:3300/0 conn(0x7f10280d04f0 msgr2=0x7f10280afc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 --2- 172.21.15.37:0/16732633 >> v2:172.21.15.37:3300/0 conn(0x7f10280d04f0 0x7f10280afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 -- 172.21.15.37:0/16732633 >> v1:172.21.15.37:6789/0 conn(0x7f102815f320 legacy=0x7f10280cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.154+0000 7f102d3f3640 1 -- 172.21.15.37:0/16732633 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10280aee80 con 0x7f10280b3840 2023-07-09T21:22:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 -- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00047d0 msgr2=0x7fdcb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00047d0 0x7fdcb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 -- 172.21.15.37:0/865186456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0003980 msgr2=0x7fdcb0003d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b5600 con 0x7fc3540b3a50 2023-07-09T21:22:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c005350 con 0x7fb01c0e2630 2023-07-09T21:22:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc35b8d8640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3540b43f0 con 0x7fc3540b3a50 2023-07-09T21:22:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc35b8d8640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc354201ac0 con 0x7fc3540b3a50 2023-07-09T21:22:38.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9c0c83b0 0x7f4b9c1f8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0cb1d0 0x7f4b9c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c1a10 con 0x7f4b9c0c83b0 2023-07-09T21:22:38.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c4670 con 0x7f4b9c0cb1d0 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba4434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c3bc0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49842/0 (socket says 172.21.15.37:49842) 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 -- 172.21.15.37:0/1267949193 learned_addr learned my addr 172.21.15.37:0/1267949193 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba29d1640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0cb1d0 0x7f4b9c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3480b5780 con 0x7fc3540b3a50 2023-07-09T21:22:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480b5b30 con 0x7fc3540b3a50 2023-07-09T21:22:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba19cf640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9c0c83b0 0x7f4b9c1f8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4bd987b640 1 -- 172.21.15.37:0/4116670543 wait complete. 2023-07-09T21:22:38.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4bd987b640 1 Processor -- start 2023-07-09T21:22:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 -- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0cb1d0 msgr2=0x7f4b9c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0cb1d0 0x7f4b9c0c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 -- 172.21.15.37:0/1267949193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9c0c83b0 msgr2=0x7f4b9c1f8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9c0c83b0 0x7f4b9c1f8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4ba21d0640 1 -- 172.21.15.37:0/1267949193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c009420 con 0x7f4b9c069bd0 2023-07-09T21:22:38.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0003980 0x7fdcb0003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fdcc6d9d640 1 -- 172.21.15.37:0/865186456 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc80cbdd0 con 0x7fdcb0005180 2023-07-09T21:22:38.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35404e020 con 0x7fc3540b3a50 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4ba21d0640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c420 tx=0x7f4b9800c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98005cf0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98005e50 con 0x7f4b9c069bd0 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980072d0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c0c3dd0 con 0x7f4b9c069bd0 2023-07-09T21:22:38.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c0c4390 con 0x7f4b9c069bd0 2023-07-09T21:22:38.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fbb5b7fe640 1 --2- 172.21.15.37:0/3131157082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c0cd3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009740 tx=0x7fbb5001c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbaee6b540b565e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.158+0000 7f4bd987b640 1 -- start start 2023-07-09T21:22:38.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 0x7f4bd4144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f102d3f3640 1 --2- 172.21.15.37:0/16732633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280b3840 0x7f10280b0180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f102808b6b0 tx=0x7f102001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd580054c3b36e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc3480b3040 con 0x7fc3540b3a50 2023-07-09T21:22:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcc6d9d640 1 -- 172.21.15.37:0/865186456 reap_dead start 2023-07-09T21:22:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 0x7f4bd414b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcc6d9d640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 0x7fdcb000b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0007fd0 tx=0x7fdcc001c620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce92591c19ea7a79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 0x7f4bd4144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 0x7f4bd4144930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50364/0 (socket says 172.21.15.37:50364) 2023-07-09T21:22:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd2ffd640 1 -- 172.21.15.37:0/1508948377 learned_addr learned my addr 172.21.15.37:0/1508948377 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 0x7f4bd414b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00a7070 con 0x7fdcb0005180 2023-07-09T21:22:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc00ab430 con 0x7fdcb0005180 2023-07-09T21:22:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcc559a640 1 -- 172.21.15.37:0/865186456 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc00ab7c0 con 0x7fdcb0005180 2023-07-09T21:22:38.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4b98007430 con 0x7f4b9c069bd0 2023-07-09T21:22:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd4157ea0 0x7f4bd4156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fc345ffb640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 0x7fc338068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc34811dc50 con 0x7fc3540b3a50 2023-07-09T21:22:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd414d320 con 0x7f4bd4157ea0 2023-07-09T21:22:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd37fe640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd4157ea0 0x7f4bd4156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd415a0d0 con 0x7f4bd40b3070 2023-07-09T21:22:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd4144e70 con 0x7f4bd40cd880 2023-07-09T21:22:38.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c04e020 con 0x7f4b9c069bd0 2023-07-09T21:22:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f10277fe640 1 -- 172.21.15.37:0/16732633 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200a5590 con 0x7f10280b3840 2023-07-09T21:22:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fc358e73640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 0x7fc338068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7f10277fe640 1 -- 172.21.15.37:0/16732633 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10200a56f0 con 0x7f10280b3840 2023-07-09T21:22:38.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.162+0000 7fdcccc56640 1 -- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 msgr2=0x7fdcb000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 0x7fdcb000b990 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0007fd0 tx=0x7fdcc001c620 comp rx=0 tx=0).stop 2023-07-09T21:22:38.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4b92ffd640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 0x7f4b80068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f10277fe640 1 -- 172.21.15.37:0/16732633 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200a5a80 con 0x7f10280b3840 2023-07-09T21:22:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 -- 172.21.15.37:0/865186456 shutdown_connections 2023-07-09T21:22:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 --2- 172.21.15.37:0/865186456 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb0005180 0x7fdcb000b990 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 -- 172.21.15.37:0/865186456 >> 172.21.15.37:0/865186456 conn(0x7fdcc80ca6c0 msgr2=0x7fdcc80caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4b98083260 con 0x7f4b9c069bd0 2023-07-09T21:22:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 -- 172.21.15.37:0/865186456 shutdown_connections 2023-07-09T21:22:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fc358e73640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 0x7fc338068780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc350007fd0 tx=0x7fc350007960 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4ba19cf640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 0x7f4b80068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 -- 172.21.15.37:0/16732633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280b3840 msgr2=0x7f10280b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 --2- 172.21.15.37:0/16732633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280b3840 0x7f10280b0180 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f102808b6b0 tx=0x7f102001c860 comp rx=0 tx=0).stop 2023-07-09T21:22:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 -- 172.21.15.37:0/16732633 shutdown_connections 2023-07-09T21:22:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 --2- 172.21.15.37:0/16732633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f10280b3840 0x7f10280b0180 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 --2- 172.21.15.37:0/16732633 >> v2:172.21.15.37:3300/0 conn(0x7f10280d04f0 0x7f10280afc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 -- 172.21.15.37:0/16732633 >> 172.21.15.37:0/16732633 conn(0x7f1028072d20 msgr2=0x7f10280d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 -- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 msgr2=0x7f4bd4144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 0x7f4bd4144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 -- 172.21.15.37:0/1508948377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd4157ea0 msgr2=0x7f4bd4156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd4157ea0 0x7f4bd4156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc80094d0 con 0x7f4bd40cd880 2023-07-09T21:22:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4bd27fc640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 0x7f4bd414b570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bd41587c0 tx=0x7f4bc80192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 -- 172.21.15.37:0/16732633 shutdown_connections 2023-07-09T21:22:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 -- 172.21.15.37:0/865186456 wait complete. 2023-07-09T21:22:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f102ee56640 1 -- 172.21.15.37:0/16732633 wait complete. 2023-07-09T21:22:38.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7f4ba19cf640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 0x7f4b80068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0ae000 tx=0x7f4b8c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 Processor -- start 2023-07-09T21:22:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fbb5affd640 1 -- 172.21.15.37:0/3131157082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500ab600 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fbb5affd640 1 -- 172.21.15.37:0/3131157082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500a7050 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fbb5affd640 1 -- 172.21.15.37:0/3131157082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500ab980 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0240c9610 con 0x7fb01c0e2630 2023-07-09T21:22:38.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.166+0000 7fdcccc56640 1 -- start start 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- 172.21.15.37:0/3131157082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 msgr2=0x7fbb5c0cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 --2- 172.21.15.37:0/3131157082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c0cd3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009740 tx=0x7fbb5001c2b0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- 172.21.15.37:0/3131157082 shutdown_connections 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 --2- 172.21.15.37:0/3131157082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c0cd3a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- 172.21.15.37:0/3131157082 >> 172.21.15.37:0/3131157082 conn(0x7fbb5c0af710 msgr2=0x7fbb5c0afb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 Processor -- start 2023-07-09T21:22:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- 172.21.15.37:0/3131157082 shutdown_connections 2023-07-09T21:22:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0005180 0x7fdcc8151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 0x7fdcc81f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81488b0 con 0x7fdcb0005180 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81510a0 con 0x7fdcc80c1820 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc81482f0 con 0x7fdcc80c1c70 2023-07-09T21:22:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- 172.21.15.37:0/3131157082 wait complete. 2023-07-09T21:22:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 -- start start 2023-07-09T21:22:38.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3480eb160 con 0x7fc3540b3a50 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0005180 0x7fdcc8151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50368/0 (socket says 172.21.15.37:50368) 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 -- 172.21.15.37:0/3208820942 learned_addr learned my addr 172.21.15.37:0/3208820942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc6d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 0x7fdcc81f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 -- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 msgr2=0x7fdcc81f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 0x7fdcc81f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 -- 172.21.15.37:0/3208820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0005180 msgr2=0x7fdcc8151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0005180 0x7fdcc8151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 -- 172.21.15.37:0/3208820942 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc81485d0 con 0x7fdcc80c1820 2023-07-09T21:22:38.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b98050770 con 0x7f4b9c069bd0 2023-07-09T21:22:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc6d9d640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 0x7fdcc81f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcc5d9b640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007340 tx=0x7fdcbc007800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 Processor -- start 2023-07-09T21:22:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00f9c0 con 0x7fdcc80c1820 2023-07-09T21:22:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00fb20 con 0x7fdcc80c1820 2023-07-09T21:22:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00fe90 con 0x7fdcc80c1820 2023-07-09T21:22:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc8150d30 con 0x7fdcc80c1820 2023-07-09T21:22:38.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fbb613f4640 1 -- start start 2023-07-09T21:22:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc80c22b0 con 0x7fdcc80c1820 2023-07-09T21:22:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10280d04f0 0x7f102815dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1028150680 0x7f10280c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c73e0 con 0x7f10280d04f0 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10280c5e50 con 0x7f1028150680 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f102ee56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102815e2e0 con 0x7f102815f320 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f1027fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f1027fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49866/0 (socket says 172.21.15.37:49866) 2023-07-09T21:22:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.170+0000 7f1027fff640 1 -- 172.21.15.37:0/3707130290 learned_addr learned my addr 172.21.15.37:0/3707130290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 -- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1028150680 msgr2=0x7f10280c8130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1028150680 0x7f10280c8130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 -- 172.21.15.37:0/3707130290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10280d04f0 msgr2=0x7f102815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10280d04f0 0x7f102815dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 -- 172.21.15.37:0/3707130290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1020009b30 con 0x7f102815f320 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f1027fff640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f101c00b480 tx=0x7f101c00b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8004510 con 0x7f4bd40cd880 2023-07-09T21:22:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc80aa8f0 con 0x7f4bd40cd880 2023-07-09T21:22:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80aaca0 con 0x7f4bd40cd880 2023-07-09T21:22:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c010870 con 0x7f102815f320 2023-07-09T21:22:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0109d0 con 0x7f102815f320 2023-07-09T21:22:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c010d80 con 0x7f102815f320 2023-07-09T21:22:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd4159df0 con 0x7f4bd40cd880 2023-07-09T21:22:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd414d830 con 0x7f4bd40cd880 2023-07-09T21:22:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc806cda0 con 0x7fdcc80c1820 2023-07-09T21:22:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb5bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34330/0 (socket says 172.21.15.37:34330) 2023-07-09T21:22:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb5bfff640 1 -- 172.21.15.37:0/545972260 learned_addr learned my addr 172.21.15.37:0/545972260 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb5c0cb7d0 0x7fbb5c0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10280c7650 con 0x7f102815f320 2023-07-09T21:22:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10280c7c10 con 0x7f102815f320 2023-07-09T21:22:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10280c7e30 con 0x7f102815f320 2023-07-09T21:22:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb5c0ccfd0 0x7fbb5c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c1434f0 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c42c0 con 0x7fbb5c0ccfd0 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0c45a0 con 0x7fbb5c0cb7d0 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fbb5b7fe640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb5c0cb7d0 0x7fbb5c0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb60bf3640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb5c0ccfd0 0x7fbb5c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdcbc01e3b0 con 0x7fdcc80c1820 2023-07-09T21:22:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fdcb6ffd640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 0x7fdca8068830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdcbc0839e0 con 0x7fdcc80c1820 2023-07-09T21:22:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 -- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb5c0cb7d0 msgr2=0x7fbb5c0c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb5c0cb7d0 0x7fbb5c0c9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 -- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb5c0ccfd0 msgr2=0x7fbb5c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb5c0ccfd0 0x7fbb5c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb50009420 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fdcc659c640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 0x7fdca8068830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb5bfff640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400cbc0 tx=0x7fbb5400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fdcc659c640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 0x7fdca8068830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009ae0 tx=0x7fdcb80094c0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f101c019450 con 0x7f102815f320 2023-07-09T21:22:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400aca0 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5400ae00 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54012600 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c0c4880 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4bc8003620 con 0x7f4bd40cd880 2023-07-09T21:22:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7f4bbbfff640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 0x7f4bc0068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4bc811dca0 con 0x7f4bd40cd880 2023-07-09T21:22:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.174+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd404d7d0 con 0x7f4bd40cd880 2023-07-09T21:22:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c0c36f0 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.178+0000 7f10257fa640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 0x7f1014068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7f4bd2ffd640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 0x7f4bc0068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f101c084790 con 0x7f102815f320 2023-07-09T21:22:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7f4bd2ffd640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 0x7f4bc0068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009c00 tx=0x7f4bc4006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c06eb50 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdcbc050ef0 con 0x7fdcc80c1820 2023-07-09T21:22:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb54007070 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.186+0000 7fbb58ff9640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 0x7fbb48068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.186+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbb54083c40 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7f102cbf2640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 0x7f1014068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.182+0000 7f102cbf2640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 0x7f1014068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1018007fd0 tx=0x7f10180079a0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.186+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f101c051c80 con 0x7f102815f320 2023-07-09T21:22:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.186+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4bc80eb2d0 con 0x7f4bd40cd880 2023-07-09T21:22:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.186+0000 7fbb5b7fe640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 0x7fbb48068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.190+0000 7fbb5b7fe640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 0x7fbb48068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ad000 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.194+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb54051150 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.474+0000 7f6bd0d9f640 1 -- 172.21.15.37:0/3499224651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f6bcc0cac10 con 0x7f6bcc0694c0 2023-07-09T21:22:38.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.474+0000 7f6bbaffd640 1 -- 172.21.15.37:0/3499224651 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bc00b0090 con 0x7f6bcc0694c0 2023-07-09T21:22:38.483 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:38.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 msgr2=0x7f6bac068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 0x7f6bac068800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0018d0 tx=0x7f6bbc009040 comp rx=0 tx=0).stop 2023-07-09T21:22:38.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 msgr2=0x7f6bcc158af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bc00ab000 tx=0x7f6bc001acc0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 shutdown_connections 2023-07-09T21:22:38.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6bac066350 0x7f6bac068800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bcc145100 0x7f6bcc157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bcc158500 0x7f6bcc0c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 --2- 172.21.15.37:0/3499224651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bcc0694c0 0x7f6bcc158af0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 >> 172.21.15.37:0/3499224651 conn(0x7f6bcc0ca6c0 msgr2=0x7f6bcc0ae800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 shutdown_connections 2023-07-09T21:22:38.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.478+0000 7f6bb8ff9640 1 -- 172.21.15.37:0/3499224651 wait complete. 2023-07-09T21:22:38.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.498+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4b9c0c1770 con 0x7f4b9c069bd0 2023-07-09T21:22:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.498+0000 7f4b92ffd640 1 -- 172.21.15.37:0/1267949193 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b98053d90 con 0x7f4b9c069bd0 2023-07-09T21:22:38.502 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-07-09T21:22:38.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.498+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb01c051bb0 con 0x7fb01c0e2630 2023-07-09T21:22:38.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.498+0000 7fb020ff9640 1 -- 172.21.15.37:0/1372188600 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb0240ccc30 con 0x7fb01c0e2630 2023-07-09T21:22:38.503 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.498+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 msgr2=0x7f4b80068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 0x7f4b80068800 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0ae000 tx=0x7f4b8c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:22:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 msgr2=0x7f4b9c1484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c420 tx=0x7f4b9800c8e0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 shutdown_connections 2023-07-09T21:22:38.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4b80066350 0x7f4b80068800 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b9c0cb1d0 0x7f4b9c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b9c0c83b0 0x7f4b9c1f8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 --2- 172.21.15.37:0/1267949193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b9c069bd0 0x7f4b9c1484c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 >> 172.21.15.37:0/1267949193 conn(0x7f4b9c0ca6c0 msgr2=0x7f4b9c0c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 shutdown_connections 2023-07-09T21:22:38.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.502+0000 7f4ba4434640 1 -- 172.21.15.37:0/1267949193 wait complete. 2023-07-09T21:22:38.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc35402bb00 con 0x7fc3540b3a50 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 msgr2=0x7fb008068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 0x7fb008068780 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb0180011f0 tx=0x7fb018007d40 comp rx=0 tx=0).stop 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 msgr2=0x7fb01c04a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb024067e70 tx=0x7fb024066870 comp rx=0 tx=0).stop 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 shutdown_connections 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0080662d0 0x7fb008068780 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c0e2630 0x7fb01c04a3c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c053fc0 0x7fb01c048990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 --2- 172.21.15.37:0/1372188600 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c036590 0x7fb01c0d3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 >> 172.21.15.37:0/1372188600 conn(0x7fb01c051590 msgr2=0x7fb01c034830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.506+0000 7fc345ffb640 1 -- 172.21.15.37:0/890380907 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc3480b1020 con 0x7fc3540b3a50 2023-07-09T21:22:38.515 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 shutdown_connections 2023-07-09T21:22:38.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fb02aa56640 1 -- 172.21.15.37:0/1372188600 wait complete. 2023-07-09T21:22:38.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-07-09T21:22:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 msgr2=0x7fc338068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 0x7fc338068780 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc350007fd0 tx=0x7fc350007960 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 msgr2=0x7fc35414c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc34801a000 tx=0x7fc348019170 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 shutdown_connections 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc3380662d0 0x7fc338068780 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3540b4e20 0x7fc3540c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3540b3e20 0x7fc354200d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 --2- 172.21.15.37:0/890380907 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3540b3a50 0x7fc35414c090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.510+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 >> 172.21.15.37:0/890380907 conn(0x7fc3540d2bf0 msgr2=0x7fc3540b5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.514+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 shutdown_connections 2023-07-09T21:22:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.514+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4bd404d7d0 con 0x7f4bd40cd880 2023-07-09T21:22:38.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.514+0000 7fc33f7fe640 1 -- 172.21.15.37:0/890380907 wait complete. 2023-07-09T21:22:38.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.514+0000 7f4bbbfff640 1 -- 172.21.15.37:0/1508948377 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4bc80ee8f0 con 0x7f4bd40cd880 2023-07-09T21:22:38.520 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.514+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 msgr2=0x7f4bc0068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 0x7f4bc0068800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009c00 tx=0x7f4bc4006f90 comp rx=0 tx=0).stop 2023-07-09T21:22:38.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 msgr2=0x7f4bd414b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 0x7f4bd414b570 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4bd41587c0 tx=0x7f4bc80192a0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f10280c90f0 con 0x7f102815f320 2023-07-09T21:22:38.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 shutdown_connections 2023-07-09T21:22:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4bc0066350 0x7f4bc0068800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4bd4157ea0 0x7f4bd4156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4bd40cd880 0x7f4bd414b570 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdcc8150b90 con 0x7fdcc80c1820 2023-07-09T21:22:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 --2- 172.21.15.37:0/1508948377 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4bd40b3070 0x7f4bd4144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 >> 172.21.15.37:0/1508948377 conn(0x7f4bd40694c0 msgr2=0x7f4bd414e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f10257fa640 1 -- 172.21.15.37:0/3707130290 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f101c0552a0 con 0x7f102815f320 2023-07-09T21:22:38.524 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-07-09T21:22:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 shutdown_connections 2023-07-09T21:22:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f4bd987b640 1 -- 172.21.15.37:0/1508948377 wait complete. 2023-07-09T21:22:38.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7fdcb6ffd640 1 -- 172.21.15.37:0/3208820942 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdcc8150b90 con 0x7fdcc80c1820 2023-07-09T21:22:38.526 INFO:teuthology.orchestra.run.smithi037.stdout:55834574852 2023-07-09T21:22:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 msgr2=0x7f1014068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 0x7f1014068800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1018007fd0 tx=0x7f10180079a0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 msgr2=0x7f10280c5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.518+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f101c00b480 tx=0x7f101c00b940 comp rx=0 tx=0).stop 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 shutdown_connections 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1014066350 0x7f1014068800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1028150680 0x7f10280c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f102815f320 0x7f10280c5910 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 --2- 172.21.15.37:0/3707130290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f10280d04f0 0x7f102815dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 >> 172.21.15.37:0/3707130290 conn(0x7f1028072d20 msgr2=0x7f102806b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 shutdown_connections 2023-07-09T21:22:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 msgr2=0x7fdca8068830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 0x7fdca8068830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8009ae0 tx=0x7fdcb80094c0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 msgr2=0x7fdcc814ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007340 tx=0x7fdcbc007800 comp rx=0 tx=0).stop 2023-07-09T21:22:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 shutdown_connections 2023-07-09T21:22:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7f102ee56640 1 -- 172.21.15.37:0/3707130290 wait complete. 2023-07-09T21:22:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdca8066380 0x7fdca8068830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcc80c1c70 0x7fdcc81f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcc80c1820 0x7fdcc814ca50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 --2- 172.21.15.37:0/3208820942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb0005180 0x7fdcc8151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 >> 172.21.15.37:0/3208820942 conn(0x7fdcc80ca6c0 msgr2=0x7fdcc80694c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 shutdown_connections 2023-07-09T21:22:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.522+0000 7fdcccc56640 1 -- 172.21.15.37:0/3208820942 wait complete. 2023-07-09T21:22:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.526+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbb5c0c4ac0 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.526+0000 7fbb58ff9640 1 -- 172.21.15.37:0/545972260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb54054770 con 0x7fbb5c0c0b20 2023-07-09T21:22:38.532 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.530+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 msgr2=0x7fbb48068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.530+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 0x7fbb48068800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ad000 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2023-07-09T21:22:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.530+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 msgr2=0x7fbb5c15a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.530+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400cbc0 tx=0x7fbb5400a060 comp rx=0 tx=0).stop 2023-07-09T21:22:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 shutdown_connections 2023-07-09T21:22:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb48066350 0x7fbb48068800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb5c0ccfd0 0x7fbb5c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb5c0cb7d0 0x7fbb5c0c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 --2- 172.21.15.37:0/545972260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb5c0c0b20 0x7fbb5c15a2e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 >> 172.21.15.37:0/545972260 conn(0x7fbb5c0af710 msgr2=0x7fbb5c160450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 shutdown_connections 2023-07-09T21:22:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:38.534+0000 7fbb613f4640 1 -- 172.21.15.37:0/545972260 wait complete. 2023-07-09T21:22:38.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2023-07-09T21:22:38.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-07-09T21:22:38.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-07-09T21:22:38.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.0 2023-07-09T21:22:38.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-07-09T21:22:38.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.4 2023-07-09T21:22:38.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-07-09T21:22:39.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-07-09T21:22:39.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-07-09T21:22:39.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-07-09T21:22:39.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-07-09T21:22:39.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-07-09T21:22:39.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-07-09T21:22:39.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-07-09T21:22:39.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-07-09T21:22:39.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.710+0000 7f275e3ac640 1 Processor -- start 2023-07-09T21:22:39.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.710+0000 7f275e3ac640 1 -- start start 2023-07-09T21:22:39.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275e3ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27581579d0 0x7f27580c9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275e3ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 0x7f27580c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275e3ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275815b340 con 0x7f27580694c0 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275e3ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275815b620 con 0x7f27581579d0 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275e3ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275815b900 con 0x7f27580c9eb0 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27581579d0 0x7f27580c9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27581579d0 0x7f27580c9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34340/0 (socket says 172.21.15.37:34340) 2023-07-09T21:22:39.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 -- 172.21.15.37:0/2690157719 learned_addr learned my addr 172.21.15.37:0/2690157719 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275c949640 1 --2- 172.21.15.37:0/2690157719 >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 0x7f27580c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 -- 172.21.15.37:0/2690157719 >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 msgr2=0x7f27580c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 --2- 172.21.15.37:0/2690157719 >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 0x7f27580c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 -- 172.21.15.37:0/2690157719 >> v1:172.21.15.37:6789/0 conn(0x7f27580694c0 legacy=0x7f2758069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f27577fe640 1 -- 172.21.15.37:0/2690157719 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275815bbe0 con 0x7f27581579d0 2023-07-09T21:22:39.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.714+0000 7f275c949640 1 --2- 172.21.15.37:0/2690157719 >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 0x7f27580c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:39.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.718+0000 7f27577fe640 1 --2- 172.21.15.37:0/2690157719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27581579d0 0x7f27580c9970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27580c8340 tx=0x7f275001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7421c646dcd351 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f2756ffd640 1 -- 172.21.15.37:0/2690157719 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500a5b80 con 0x7f27581579d0 2023-07-09T21:22:39.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f2756ffd640 1 -- 172.21.15.37:0/2690157719 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500a5ce0 con 0x7f27581579d0 2023-07-09T21:22:39.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 -- 172.21.15.37:0/2690157719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27581579d0 msgr2=0x7f27580c9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 --2- 172.21.15.37:0/2690157719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27581579d0 0x7f27580c9970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27580c8340 tx=0x7f275001cb90 comp rx=0 tx=0).stop 2023-07-09T21:22:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 -- 172.21.15.37:0/2690157719 shutdown_connections 2023-07-09T21:22:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 --2- 172.21.15.37:0/2690157719 >> v2:172.21.15.119:3300/0 conn(0x7f27580c9eb0 0x7f27580c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 --2- 172.21.15.37:0/2690157719 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27581579d0 0x7f27580c9970 secure :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27580c8340 tx=0x7f275001cb90 comp rx=0 tx=0).stop 2023-07-09T21:22:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 -- 172.21.15.37:0/2690157719 >> 172.21.15.37:0/2690157719 conn(0x7f27580ca6c0 msgr2=0x7f27580caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 -- 172.21.15.37:0/2690157719 shutdown_connections 2023-07-09T21:22:39.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.722+0000 7f275e3ac640 1 -- 172.21.15.37:0/2690157719 wait complete. 2023-07-09T21:22:39.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.726+0000 7f275e3ac640 1 Processor -- start 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.726+0000 7f275e3ac640 1 -- start start 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 0x7f27580c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27580c9eb0 0x7f27581f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c1770 con 0x7f27580c9eb0 2023-07-09T21:22:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c1a50 con 0x7f27580694c0 2023-07-09T21:22:39.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580c5560 con 0x7f27580c4d10 2023-07-09T21:22:39.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f2757fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 0x7f27580c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49878/0 (socket says 172.21.15.37:49878) 2023-07-09T21:22:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 -- 172.21.15.37:0/1045435256 learned_addr learned my addr 172.21.15.37:0/1045435256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f27577fe640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27580c9eb0 0x7f27581f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 -- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 msgr2=0x7f27580c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 0x7f27580c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 -- 172.21.15.37:0/1045435256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27580c9eb0 msgr2=0x7f27581f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27580c9eb0 0x7f27581f6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 -- 172.21.15.37:0/1045435256 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275000c660 con 0x7f27580c4d10 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f2757fff640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 0x7f27580c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275c949640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f274800c7f0 tx=0x7f274800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748007820 con 0x7f27580c4d10 2023-07-09T21:22:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580c5840 con 0x7f27580c4d10 2023-07-09T21:22:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.730+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580c5190 con 0x7f27580c4d10 2023-07-09T21:22:39.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27480079a0 con 0x7f27580c4d10 2023-07-09T21:22:39.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2748007d50 con 0x7f27580c4d10 2023-07-09T21:22:39.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804e020 con 0x7f27580c4d10 2023-07-09T21:22:39.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27480113f0 con 0x7f27580c4d10 2023-07-09T21:22:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f2754ff9640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 0x7f27400688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.734+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2748084110 con 0x7f27580c4d10 2023-07-09T21:22:39.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.738+0000 7f2757fff640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 0x7f27400688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.738+0000 7f2757fff640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 0x7f27400688a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f274c0017e0 tx=0x7f274c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.742+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27480515a0 con 0x7f27580c4d10 2023-07-09T21:22:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 Processor -- start 2023-07-09T21:22:39.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 -- start start 2023-07-09T21:22:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 0x7f6d68157770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6d680c9970 0x7f6d680c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6815b620 con 0x7f6d680cb1d0 2023-07-09T21:22:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6815b900 con 0x7f6d68069bd0 2023-07-09T21:22:39.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.782+0000 7f6d6f2ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6815bbe0 con 0x7f6d680c9970 2023-07-09T21:22:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6c887640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 0x7f6d68157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6c887640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 0x7f6d68157770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34362/0 (socket says 172.21.15.37:34362) 2023-07-09T21:22:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6c887640 1 -- 172.21.15.37:0/1967035539 learned_addr learned my addr 172.21.15.37:0/1967035539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6d889640 1 --2- 172.21.15.37:0/1967035539 >> v2:172.21.15.119:3300/0 conn(0x7f6d680c9970 0x7f6d680c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6d889640 1 -- 172.21.15.37:0/1967035539 >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 msgr2=0x7f6d68157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6d889640 1 --2- 172.21.15.37:0/1967035539 >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 0x7f6d68157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6d889640 1 -- 172.21.15.37:0/1967035539 >> v1:172.21.15.37:6789/0 conn(0x7f6d680cb1d0 legacy=0x7f6d680694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f6d6d889640 1 -- 172.21.15.37:0/1967035539 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6815bec0 con 0x7f6d680c9970 2023-07-09T21:22:39.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f2bca174640 1 Processor -- start 2023-07-09T21:22:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f2bca174640 1 -- start start 2023-07-09T21:22:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.786+0000 7f2bca174640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2bc4069bd0 0x7f2bc41641d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bca174640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc4163d40 con 0x7f2bc406d5a0 2023-07-09T21:22:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bca174640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40c1190 con 0x7f2bc40c0c20 2023-07-09T21:22:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d6d889640 1 --2- 172.21.15.37:0/1967035539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d680c9970 0x7f6d680c9db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c8340 tx=0x7f6d5801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51d56df1def5f87e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d5ffff640 1 -- 172.21.15.37:0/1967035539 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580ab600 con 0x7f6d680c9970 2023-07-09T21:22:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d5ffff640 1 -- 172.21.15.37:0/1967035539 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580a7050 con 0x7f6d680c9970 2023-07-09T21:22:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d5ffff640 1 -- 172.21.15.37:0/1967035539 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d580ab980 con 0x7f6d680c9970 2023-07-09T21:22:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/1967035539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d680c9970 msgr2=0x7f6d680c9db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/1967035539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d680c9970 0x7f6d680c9db0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6d680c8340 tx=0x7f6d5801c420 comp rx=0 tx=0).stop 2023-07-09T21:22:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bca174640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc406f230 con 0x7f2bc4069bd0 2023-07-09T21:22:39.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2bc406d5a0 0x7f2bc40c9ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57130/0 (socket says 172.21.15.37:57130) 2023-07-09T21:22:39.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc37fe640 1 -- 172.21.15.37:0/610620053 learned_addr learned my addr 172.21.15.37:0/610620053 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:39.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc3fff640 1 --2- 172.21.15.37:0/610620053 >> v2:172.21.15.119:3300/0 conn(0x7f2bc4069bd0 0x7f2bc41641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/1967035539 shutdown_connections 2023-07-09T21:22:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/1967035539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d680c9970 0x7f6d680c9db0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/1967035539 >> v2:172.21.15.37:3300/0 conn(0x7f6d68069bd0 0x7f6d68157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/1967035539 >> 172.21.15.37:0/1967035539 conn(0x7f6d680ca6c0 msgr2=0x7f6d680caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/1967035539 shutdown_connections 2023-07-09T21:22:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc3fff640 1 -- 172.21.15.37:0/610620053 >> v1:172.21.15.119:6789/0 conn(0x7f2bc40c0c20 legacy=0x7f2bc40694c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc3fff640 1 -- 172.21.15.37:0/610620053 >> v1:172.21.15.37:6789/0 conn(0x7f2bc406d5a0 legacy=0x7f2bc40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.790+0000 7f2bc3fff640 1 -- 172.21.15.37:0/610620053 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40c1470 con 0x7f2bc4069bd0 2023-07-09T21:22:39.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f2bc3fff640 1 --2- 172.21.15.37:0/610620053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc4069bd0 0x7f2bc41641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009d90 tx=0x7f2bbc01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467d5b0e85d60c98 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/1967035539 wait complete. 2023-07-09T21:22:39.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.794+0000 7f888f93a640 1 Processor -- start 2023-07-09T21:22:39.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888f93a640 1 -- start start 2023-07-09T21:22:39.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bc27fc640 1 -- 172.21.15.37:0/610620053 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0a59a0 con 0x7f2bc4069bd0 2023-07-09T21:22:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bc27fc640 1 -- 172.21.15.37:0/610620053 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0a5b00 con 0x7f2bc4069bd0 2023-07-09T21:22:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bc27fc640 1 -- 172.21.15.37:0/610620053 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0a5e90 con 0x7f2bc4069bd0 2023-07-09T21:22:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f6d6f2ec640 1 Processor -- start 2023-07-09T21:22:39.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f6d6f2ec640 1 -- start start 2023-07-09T21:22:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888f93a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88800e1db0 0x7f88800e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 -- 172.21.15.37:0/610620053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc4069bd0 msgr2=0x7f2bc41641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 --2- 172.21.15.37:0/610620053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc4069bd0 0x7f2bc41641d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc009d90 tx=0x7f2bbc01c8e0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 -- 172.21.15.37:0/610620053 shutdown_connections 2023-07-09T21:22:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 --2- 172.21.15.37:0/610620053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc4069bd0 0x7f2bc41641d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 -- 172.21.15.37:0/610620053 >> 172.21.15.37:0/610620053 conn(0x7f2bc40ca6c0 msgr2=0x7f2bc40caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 -- 172.21.15.37:0/610620053 shutdown_connections 2023-07-09T21:22:39.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f6d6f2ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888d6d6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88800e1db0 0x7f88800e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888d6d6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88800e1db0 0x7f88800e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2023-07-09T21:22:39.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888d6d6640 1 -- 172.21.15.37:0/1930731641 learned_addr learned my addr 172.21.15.37:0/1930731641 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f888f93a640 1 --2- 172.21.15.37:0/1930731641 >> v2:172.21.15.119:3300/0 conn(0x7f88800520a0 0x7f8880036590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d680c9970 0x7f6d680cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8880033af0 con 0x7f88800526e0 2023-07-09T21:22:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88800e29b0 con 0x7f88800e1db0 2023-07-09T21:22:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8880033810 con 0x7f88800520a0 2023-07-09T21:22:39.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 0x7f6d68154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6806d1d0 con 0x7f6d680cb1d0 2023-07-09T21:22:39.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d680c6800 con 0x7f6d68069bd0 2023-07-09T21:22:39.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50440/0 (socket says 172.21.15.37:50440) 2023-07-09T21:22:39.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d68156ae0 con 0x7f6d680c9970 2023-07-09T21:22:39.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 -- 172.21.15.37:0/2738506780 learned_addr learned my addr 172.21.15.37:0/2738506780 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6c887640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d680c9970 0x7f6d680cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d889640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 0x7f6d68154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 -- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d680c9970 msgr2=0x7f6d680cba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d680c9970 0x7f6d680cba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 -- 172.21.15.37:0/2738506780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 msgr2=0x7f6d68154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 0x7f6d68154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 -- 172.21.15.37:0/2738506780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58009420 con 0x7f6d68069bd0 2023-07-09T21:22:39.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d889640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 0x7f6d68154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:39.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.798+0000 7f2bca174640 1 -- 172.21.15.37:0/610620053 wait complete. 2023-07-09T21:22:39.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f2bca174640 1 Processor -- start 2023-07-09T21:22:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6d088640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b3e0 tx=0x7f6d6400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011830 con 0x7f6d68069bd0 2023-07-09T21:22:39.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d640119b0 con 0x7f6d68069bd0 2023-07-09T21:22:39.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f2bca174640 1 -- start start 2023-07-09T21:22:39.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64011d60 con 0x7f6d68069bd0 2023-07-09T21:22:39.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d68156dc0 con 0x7f6d68069bd0 2023-07-09T21:22:39.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d680c5210 con 0x7f6d68069bd0 2023-07-09T21:22:39.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 0x7f2bc414c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bc40c0c20 0x7f2bc40aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4148da0 con 0x7f2bc40c0c20 2023-07-09T21:22:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc414abf0 con 0x7f2bc406d5a0 2023-07-09T21:22:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4148120 con 0x7f2bc4069bd0 2023-07-09T21:22:39.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50456/0 (socket says 172.21.15.37:50456) 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 -- 172.21.15.37:0/2762825826 learned_addr learned my addr 172.21.15.37:0/2762825826 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc3fff640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bc40c0c20 0x7f2bc40aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc37fe640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 0x7f2bc414c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 -- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 msgr2=0x7f2bc414c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 0x7f2bc414c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 -- 172.21.15.37:0/2762825826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bc40c0c20 msgr2=0x7f2bc40aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bc40c0c20 0x7f2bc40aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 -- 172.21.15.37:0/2762825826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc009a70 con 0x7f2bc406d5a0 2023-07-09T21:22:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc37fe640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 0x7f2bc414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888d6d6640 1 -- 172.21.15.37:0/1930731641 >> v2:172.21.15.119:3300/0 conn(0x7f88800520a0 msgr2=0x7f8880036590 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-09T21:22:39.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888d6d6640 1 --2- 172.21.15.37:0/1930731641 >> v2:172.21.15.119:3300/0 conn(0x7f88800520a0 0x7f8880036590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888d6d6640 1 -- 172.21.15.37:0/1930731641 >> v1:172.21.15.37:6789/0 conn(0x7f88800526e0 legacy=0x7f8880052bf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:39.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.802+0000 7f888d6d6640 1 -- 172.21.15.37:0/1930731641 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88800e22f0 con 0x7f88800e1db0 2023-07-09T21:22:39.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bc2ffd640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800b3f0 tx=0x7f2bb800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d680c69c0 con 0x7f6d68069bd0 2023-07-09T21:22:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8011830 con 0x7f2bc406d5a0 2023-07-09T21:22:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bb80119b0 con 0x7f2bc406d5a0 2023-07-09T21:22:39.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bb8011d60 con 0x7f2bc406d5a0 2023-07-09T21:22:39.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc4148400 con 0x7f2bc406d5a0 2023-07-09T21:22:39.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc41489c0 con 0x7f2bc406d5a0 2023-07-09T21:22:39.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f888d6d6640 1 --2- 172.21.15.37:0/1930731641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800e1db0 0x7f88800e2dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f88800076a0 tx=0x7f887801d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f52462ecfb27ad19 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f887ffff640 1 -- 172.21.15.37:0/1930731641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878007ad0 con 0x7f88800e1db0 2023-07-09T21:22:39.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f887ffff640 1 -- 172.21.15.37:0/1930731641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878007c30 con 0x7f88800e1db0 2023-07-09T21:22:39.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f887ffff640 1 -- 172.21.15.37:0/1930731641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878007ad0 con 0x7f88800e1db0 2023-07-09T21:22:39.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4148ee0 con 0x7f2bc406d5a0 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800e1db0 msgr2=0x7f88800e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 --2- 172.21.15.37:0/1930731641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800e1db0 0x7f88800e2dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f88800076a0 tx=0x7f887801d420 comp rx=0 tx=0).stop 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 shutdown_connections 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 --2- 172.21.15.37:0/1930731641 >> v2:172.21.15.119:3300/0 conn(0x7f88800520a0 0x7f8880036590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 --2- 172.21.15.37:0/1930731641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800e1db0 0x7f88800e2dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 >> 172.21.15.37:0/1930731641 conn(0x7f8880051590 msgr2=0x7f8880051990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 shutdown_connections 2023-07-09T21:22:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.806+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d6401a400 con 0x7f6d68069bd0 2023-07-09T21:22:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f6d5dffb640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 0x7f6d4c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d64083dc0 con 0x7f6d68069bd0 2023-07-09T21:22:39.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f6d6c887640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 0x7f6d4c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f888f93a640 1 -- 172.21.15.37:0/1930731641 wait complete. 2023-07-09T21:22:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.810+0000 7f6d6c887640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 0x7f6d4c068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d680b2be0 tx=0x7f6d6000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888f93a640 1 Processor -- start 2023-07-09T21:22:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888f93a640 1 -- start start 2023-07-09T21:22:39.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d680c69c0 con 0x7f6d68069bd0 2023-07-09T21:22:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888f93a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888d6d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888d6d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34392/0 (socket says 172.21.15.37:34392) 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888d6d6640 1 -- 172.21.15.37:0/1274668659 learned_addr learned my addr 172.21.15.37:0/1274668659 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88800526e0 0x7f88800db980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800e1db0 0x7f888017f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888ced5640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88800526e0 0x7f88800db980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88800d7ee0 con 0x7f88800520a0 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888ded7640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800e1db0 0x7f888017f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88800dbec0 con 0x7f88800e1db0 2023-07-09T21:22:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888004c1d0 con 0x7f88800526e0 2023-07-09T21:22:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.814+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2bb801a400 con 0x7f2bc406d5a0 2023-07-09T21:22:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f2babfff640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 0x7f2bb0068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2bb8084350 con 0x7f2bc406d5a0 2023-07-09T21:22:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2bb8051840 con 0x7f2bc406d5a0 2023-07-09T21:22:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 -- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88800526e0 msgr2=0x7f88800db980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88800526e0 0x7f88800db980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 -- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800e1db0 msgr2=0x7f888017f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800e1db0 0x7f888017f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887800d040 con 0x7f88800520a0 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f888d6d6640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8878000c10 tx=0x7f887801a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88780bb070 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.818+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878009720 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.822+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878007ad0 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.822+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888004c4b0 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.826+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f88780b3420 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.826+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88800d9d90 con 0x7f88800520a0 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.826+0000 7f887dffb640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 0x7f886c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.826+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f887811d130 con 0x7f88800520a0 2023-07-09T21:22:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.830+0000 7f888ced5640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 0x7f886c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.830+0000 7f2bc37fe640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 0x7f2bb0068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.830+0000 7f2bc37fe640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 0x7f2bb0068800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005890 tx=0x7f2bb4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.830+0000 7f888ced5640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 0x7f886c068780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f888004add0 tx=0x7f8884009060 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.830+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88800d9f80 con 0x7f88800520a0 2023-07-09T21:22:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.838+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8878122060 con 0x7f88800520a0 2023-07-09T21:22:39.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 Processor -- start 2023-07-09T21:22:39.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 -- start start 2023-07-09T21:22:39.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f900c0ca1b0 0x7f900c0694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f900c069a00 0x7f900c0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f900c069e60 con 0x7f900c06cb10 2023-07-09T21:22:39.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c0cc400 con 0x7f900c0ca1b0 2023-07-09T21:22:39.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.874+0000 7f90120d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f900c15f380 con 0x7f900c069a00 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f900c0ca1b0 0x7f900c0694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f900c069a00 0x7f900c0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f900c069a00 0x7f900c0c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50472/0 (socket says 172.21.15.37:50472) 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 -- 172.21.15.37:0/1838560863 learned_addr learned my addr 172.21.15.37:0/1838560863 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 -- 172.21.15.37:0/1838560863 >> v2:172.21.15.37:3300/0 conn(0x7f900c0ca1b0 msgr2=0x7f900c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 --2- 172.21.15.37:0/1838560863 >> v2:172.21.15.37:3300/0 conn(0x7f900c0ca1b0 0x7f900c0694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 -- 172.21.15.37:0/1838560863 >> v1:172.21.15.119:6789/0 conn(0x7f900c06cb10 legacy=0x7f900c0c9aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:39.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7f900bfff640 1 -- 172.21.15.37:0/1838560863 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f900c15bc90 con 0x7f900c069a00 2023-07-09T21:22:39.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f900bfff640 1 --2- 172.21.15.37:0/1838560863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c069a00 0x7f900c0c86a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ad230 tx=0x7f900401c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5501625b47bc9ebe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f900a7fc640 1 -- 172.21.15.37:0/1838560863 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040a5790 con 0x7f900c069a00 2023-07-09T21:22:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f900a7fc640 1 -- 172.21.15.37:0/1838560863 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90040a58f0 con 0x7f900c069a00 2023-07-09T21:22:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f900a7fc640 1 -- 172.21.15.37:0/1838560863 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040a5c80 con 0x7f900c069a00 2023-07-09T21:22:39.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7fb65a700640 1 Processor -- start 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.878+0000 7fb65a700640 1 -- start start 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb65a700640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb654070db0 0x7fb6540c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb65a700640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6540ca2d0 0x7fb6540694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb65a700640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb65416bff0 con 0x7fb6540cb810 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb65a700640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb654071180 con 0x7fb654070db0 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb65a700640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540cbc80 con 0x7fb6540ca2d0 2023-07-09T21:22:39.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6540ca2d0 0x7fb6540694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6540ca2d0 0x7fb6540694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50474/0 (socket says 172.21.15.37:50474) 2023-07-09T21:22:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 -- 172.21.15.37:0/1742578971 learned_addr learned my addr 172.21.15.37:0/1742578971 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 -- 172.21.15.37:0/1838560863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c069a00 msgr2=0x7f900c0c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 --2- 172.21.15.37:0/1838560863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c069a00 0x7f900c0c86a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f900c0ad230 tx=0x7f900401c8d0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb653fff640 1 --2- 172.21.15.37:0/1742578971 >> v2:172.21.15.37:3300/0 conn(0x7fb654070db0 0x7fb6540c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 -- 172.21.15.37:0/1742578971 >> v2:172.21.15.37:3300/0 conn(0x7fb654070db0 msgr2=0x7fb6540c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 --2- 172.21.15.37:0/1742578971 >> v2:172.21.15.37:3300/0 conn(0x7fb654070db0 0x7fb6540c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 -- 172.21.15.37:0/1742578971 >> v1:172.21.15.119:6789/0 conn(0x7fb6540cb810 legacy=0x7fb6541689d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:22:39.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 -- 172.21.15.37:0/1838560863 shutdown_connections 2023-07-09T21:22:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 --2- 172.21.15.37:0/1838560863 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c069a00 0x7f900c0c86a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 --2- 172.21.15.37:0/1838560863 >> v2:172.21.15.37:3300/0 conn(0x7f900c0ca1b0 0x7f900c0694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 -- 172.21.15.37:0/1838560863 >> 172.21.15.37:0/1838560863 conn(0x7f900c0ca6c0 msgr2=0x7f900c0caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 -- 172.21.15.37:0/1838560863 shutdown_connections 2023-07-09T21:22:39.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7f90120d8640 1 -- 172.21.15.37:0/1838560863 wait complete. 2023-07-09T21:22:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.882+0000 7fb658c9d640 1 -- 172.21.15.37:0/1742578971 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540cbf60 con 0x7fb6540ca2d0 2023-07-09T21:22:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 Processor -- start 2023-07-09T21:22:39.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 -- start start 2023-07-09T21:22:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7f90120d8640 1 Processor -- start 2023-07-09T21:22:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7f90120d8640 1 -- start start 2023-07-09T21:22:39.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 0x7fc7a80c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7a80c9fe0 0x7fc7a80694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7a815f380 con 0x7fc7a8069a00 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7a80cc400 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.886+0000 7fc7b039f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a80ca450 con 0x7fc7a806cb10 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ae13b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 0x7fc7a80c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ae13b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 0x7fc7a80c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49902/0 (socket says 172.21.15.37:49902) 2023-07-09T21:22:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ae13b640 1 -- 172.21.15.37:0/1607244123 learned_addr learned my addr 172.21.15.37:0/1607244123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb658c9d640 1 --2- 172.21.15.37:0/1742578971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540694c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6540cb7a0 tx=0x7fb644024cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d42452dde90f626 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ad93a640 1 --2- 172.21.15.37:0/1607244123 >> v2:172.21.15.37:3300/0 conn(0x7fc7a80c9fe0 0x7fc7a80694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb652ffd640 1 -- 172.21.15.37:0/1742578971 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440adca0 con 0x7fb6540ca2d0 2023-07-09T21:22:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb652ffd640 1 -- 172.21.15.37:0/1742578971 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6440ade00 con 0x7fb6540ca2d0 2023-07-09T21:22:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb652ffd640 1 -- 172.21.15.37:0/1742578971 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440b5610 con 0x7fb6540ca2d0 2023-07-09T21:22:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 -- 172.21.15.37:0/1742578971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 msgr2=0x7fb6540694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 --2- 172.21.15.37:0/1742578971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540694c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb6540cb7a0 tx=0x7fb644024cc0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 0x7f900c152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f900c06cb10 0x7f900c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 -- 172.21.15.37:0/1742578971 shutdown_connections 2023-07-09T21:22:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 --2- 172.21.15.37:0/1742578971 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540694c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 --2- 172.21.15.37:0/1742578971 >> v2:172.21.15.37:3300/0 conn(0x7fb654070db0 0x7fb6540c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 -- 172.21.15.37:0/1742578971 >> 172.21.15.37:0/1742578971 conn(0x7fb6540ca6c0 msgr2=0x7fb6540caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f900b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 0x7f900c152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 -- 172.21.15.37:0/1742578971 shutdown_connections 2023-07-09T21:22:39.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fb65a700640 1 -- 172.21.15.37:0/1742578971 wait complete. 2023-07-09T21:22:39.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f900b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 0x7f900c152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49904/0 (socket says 172.21.15.37:49904) 2023-07-09T21:22:39.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f900b7fe640 1 -- 172.21.15.37:0/4237105694 learned_addr learned my addr 172.21.15.37:0/4237105694 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 0x7f900c0b2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c153c80 con 0x7f900c06cb10 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f900bfff640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 0x7f900c0b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f900c1542f0 con 0x7f900c0ca1b0 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f900c153070 con 0x7f900c069a00 2023-07-09T21:22:39.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ad93a640 1 -- 172.21.15.37:0/1607244123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 msgr2=0x7fc7a80c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ad93a640 1 --2- 172.21.15.37:0/1607244123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 0x7fc7a80c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ad93a640 1 -- 172.21.15.37:0/1607244123 >> v1:172.21.15.119:6789/0 conn(0x7fc7a8069a00 legacy=0x7fc7a80ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.890+0000 7fc7ad93a640 1 -- 172.21.15.37:0/1607244123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7a815bc90 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 -- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 msgr2=0x7f900c152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 0x7f900c152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 -- 172.21.15.37:0/4237105694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f900c06cb10 msgr2=0x7f900c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f900c06cb10 0x7f900c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9004009b30 con 0x7f900c0ca1b0 2023-07-09T21:22:39.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb65a700640 1 Processor -- start 2023-07-09T21:22:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb9f1448640 1 Processor -- start 2023-07-09T21:22:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f900bfff640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 0x7f900c0b2310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90040ab000 tx=0x7f9004019670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb65a700640 1 -- start start 2023-07-09T21:22:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040b8670 con 0x7f900c0ca1b0 2023-07-09T21:22:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90040b87d0 con 0x7f900c0ca1b0 2023-07-09T21:22:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90040b8b80 con 0x7f900c0ca1b0 2023-07-09T21:22:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f900c153350 con 0x7f900c0ca1b0 2023-07-09T21:22:39.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f900c153910 con 0x7f900c0ca1b0 2023-07-09T21:22:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fc7ad93a640 1 --2- 172.21.15.37:0/1607244123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a80c9fe0 0x7fc7a80694c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7980097c0 tx=0x7fc79801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3cf50be50423c52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb9f1448640 1 -- start start 2023-07-09T21:22:39.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb65a700640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 0x7fb6540c0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fc7ad139640 1 -- 172.21.15.37:0/1607244123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7980ab600 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fb9f1448640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9e404a450 0x7fb9e4056750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9f1448640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e4008110 con 0x7fb9e4007c90 2023-07-09T21:22:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9f1448640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40e7cb0 con 0x7fb9e40388e0 2023-07-09T21:22:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9f1448640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40e7f90 con 0x7fb9e404a450 2023-07-09T21:22:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eaffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb9e40388e0 0x7fb9e4038cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51226/0 (socket says 172.21.15.37:51226) 2023-07-09T21:22:39.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eaffd640 1 -- 172.21.15.37:0/3050362816 learned_addr learned my addr 172.21.15.37:0/3050362816 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 0x7fb6540c1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.894+0000 7fc7ad139640 1 -- 172.21.15.37:0/1607244123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7980a7050 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 -- 172.21.15.37:0/1607244123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a80c9fe0 msgr2=0x7fc7a80694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb6537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50494/0 (socket says 172.21.15.37:50494) 2023-07-09T21:22:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c1310 con 0x7fb654070db0 2023-07-09T21:22:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c2150 con 0x7fb6540ca2d0 2023-07-09T21:22:39.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c2430 con 0x7fb6540cb810 2023-07-09T21:22:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840401488 0 0) 0x7fb9e40e7cb0 con 0x7fb9e40388e0 2023-07-09T21:22:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9d4003530 con 0x7fb9e40388e0 2023-07-09T21:22:39.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7ad139640 1 -- 172.21.15.37:0/1607244123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7980ab600 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb653fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 0x7fb6540c0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb6537fe640 1 -- 172.21.15.37:0/642339275 learned_addr learned my addr 172.21.15.37:0/642339275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb653fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 0x7fb6540c0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34434/0 (socket says 172.21.15.37:34434) 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 0x7fb6540c1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 -- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 msgr2=0x7fb6540b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 -- 172.21.15.37:0/642339275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 msgr2=0x7fb6540c0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 0x7fb6540c0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 -- 172.21.15.37:0/642339275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb644008550 con 0x7fb6540cb810 2023-07-09T21:22:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb6537fe640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/3050362816 >> v2:172.21.15.37:3300/0 conn(0x7fb9e404a450 0x7fb9e4056750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.1 v1:172.21.15.119:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958718128 0 0) 0x7fb9d4003530 con 0x7fb9e40388e0 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 >> v2:172.21.15.37:3300/0 conn(0x7fb9e404a450 msgr2=0x7fb9e4056750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 --2- 172.21.15.37:0/3050362816 >> v2:172.21.15.37:3300/0 conn(0x7fb9e404a450 0x7fb9e4056750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 >> v1:172.21.15.37:6789/0 conn(0x7fb9e4007c90 legacy=0x7fb9e40eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 --> v1:172.21.15.119:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4054bf0 con 0x7fb9e40388e0 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.1 v1:172.21.15.119:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fb9ec04e020 con 0x7fb9e40388e0 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 >> v1:172.21.15.119:6789/0 conn(0x7fb9e40388e0 legacy=0x7fb9e4038cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d4003980 0x7fb9d4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d40043a0 0x7fb9d4004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 0x7fb9d400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40e7f90 con 0x7fb9d4003980 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400c060 con 0x7fb9d40043a0 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d400c220 con 0x7fb9d4005110 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 0x7fb9d400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d40043a0 0x7fb9d4004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eaffd640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d4003980 0x7fb9d4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1607244123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a80c9fe0 0x7fc7a80694c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc7980097c0 tx=0x7fc79801c480 comp rx=0 tx=0).stop 2023-07-09T21:22:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb658c9d640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 0x7fb6540c1770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6440b3000 tx=0x7fb644021a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f90040b8ce0 con 0x7f900c0ca1b0 2023-07-09T21:22:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440b5ce0 con 0x7fb6540cb810 2023-07-09T21:22:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6440b5e80 con 0x7fb6540cb810 2023-07-09T21:22:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440c06b0 con 0x7fb6540cb810 2023-07-09T21:22:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 -- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d40043a0 msgr2=0x7fb9d4004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d40043a0 0x7fb9d4004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 -- 172.21.15.37:0/3050362816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d4003980 msgr2=0x7fb9d4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d4003980 0x7fb9d4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9eb7fe640 1 -- 172.21.15.37:0/3050362816 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d4003530 con 0x7fb9d4005110 2023-07-09T21:22:39.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d40043a0 0x7fb9d4004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 -- 172.21.15.37:0/1607244123 shutdown_connections 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1607244123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a80c9fe0 0x7fc7a80694c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1607244123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a806cb10 0x7fc7a80c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 -- 172.21.15.37:0/1607244123 >> 172.21.15.37:0/1607244123 conn(0x7fc7a80ca6c0 msgr2=0x7fc7a80caac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 -- 172.21.15.37:0/1607244123 shutdown_connections 2023-07-09T21:22:39.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fc7b039f640 1 -- 172.21.15.37:0/1607244123 wait complete. 2023-07-09T21:22:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 -- 172.21.15.37:0/642339275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540c5fc0 con 0x7fb6540cb810 2023-07-09T21:22:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.898+0000 7fb65a700640 1 -- 172.21.15.37:0/642339275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540b1050 con 0x7fb6540cb810 2023-07-09T21:22:39.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c005260 con 0x7fb6540cb810 2023-07-09T21:22:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7b039f640 1 Processor -- start 2023-07-09T21:22:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7b039f640 1 -- start start 2023-07-09T21:22:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7b039f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 0x7fc7a81500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7b039f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a806cb10 0x7fc7a8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7f8ff3fff640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 0x7f8ff8068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f900411f260 con 0x7f900c0ca1b0 2023-07-09T21:22:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec005260 con 0x7f900c0ca1b0 2023-07-09T21:22:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7ae13b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 0x7fc7a81500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fc7ae13b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 0x7fc7a81500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50514/0 (socket says 172.21.15.37:50514) 2023-07-09T21:22:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7f900b7fe640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 0x7f8ff8068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae13b640 1 -- 172.21.15.37:0/1775999265 learned_addr learned my addr 172.21.15.37:0/1775999265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 0x7fc7a814e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8150730 con 0x7fc7a806cb10 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8150a10 con 0x7fc7a8069a00 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 0x7fc7a814e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.902+0000 7fb9eb7fe640 1 -- 172.21.15.37:0/3050362816 reap_dead start 2023-07-09T21:22:39.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb9eb7fe640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 0x7fb9d400b990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc003db0 tx=0x7fb9dc01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183b0f58b9ed553c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6440c0810 con 0x7fb6540cb810 2023-07-09T21:22:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7a8150cf0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7f900b7fe640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 0x7f8ff8068780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9000009a50 tx=0x7f9000009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ad93a640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a806cb10 0x7fc7a8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 -- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 msgr2=0x7fc7a81500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 0x7fc7a81500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 -- 172.21.15.37:0/1775999265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a806cb10 msgr2=0x7fc7a8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a806cb10 0x7fc7a8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc798009420 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb650ff9640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 0x7fb6400687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb644127990 con 0x7fb6540cb810 2023-07-09T21:22:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7ae93c640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 0x7fc7a814e710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c390 tx=0x7fc7a400c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb653fff640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 0x7fb6400687b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0ab640 con 0x7fb9d4005110 2023-07-09T21:22:39.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc0a7050 con 0x7fb9d4005110 2023-07-09T21:22:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40052d0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7a8150fd0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.906+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7a8154670 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4005430 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90040ec6c0 con 0x7f900c0ca1b0 2023-07-09T21:22:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6440f4e80 con 0x7fb6540cb810 2023-07-09T21:22:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb653fff640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 0x7fb6400687b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00b1e0 tx=0x7fb64c00d040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 -- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 msgr2=0x7fb9d400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9e9ffb640 1 -- 172.21.15.37:0/3050362816 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc0ab640 con 0x7fb9d4005110 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 0x7fb9d400b990 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc003db0 tx=0x7fb9dc01c300 comp rx=0 tx=0).stop 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 -- 172.21.15.37:0/3050362816 shutdown_connections 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 --2- 172.21.15.37:0/3050362816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9d4005110 0x7fb9d400b990 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 -- 172.21.15.37:0/3050362816 >> 172.21.15.37:0/3050362816 conn(0x7fb9e400d000 msgr2=0x7fb9e40538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 -- 172.21.15.37:0/3050362816 shutdown_connections 2023-07-09T21:22:39.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fb9f1448640 1 -- 172.21.15.37:0/3050362816 wait complete. 2023-07-09T21:22:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4003840 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc790005260 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 Processor -- start 2023-07-09T21:22:39.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.910+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7a40039a0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 -- start start 2023-07-09T21:22:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fc79effd640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 0x7fc78c068800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc7a40831b0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e404e940 0x7fb9e40e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9e404f880 0x7fb9e40501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9eaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9eaffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50528/0 (socket says 172.21.15.37:50528) 2023-07-09T21:22:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9eaffd640 1 -- 172.21.15.37:0/2948511308 learned_addr learned my addr 172.21.15.37:0/2948511308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:39.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fc7ae13b640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 0x7fc78c068800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9eb7fe640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9e404f880 0x7fb9e40501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e404e940 0x7fb9e40e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40e6920 con 0x7fb9e404e940 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40521d0 con 0x7fb9d4005110 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e404f400 con 0x7fb9e404f880 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 -- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9e404f880 msgr2=0x7fb9e40501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9e404f880 0x7fb9e40501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 -- 172.21.15.37:0/2948511308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e404e940 msgr2=0x7fb9e40e63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e404e940 0x7fb9e40e63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:39.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e4052770 con 0x7fb9d4005110 2023-07-09T21:22:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.914+0000 7fc7ae13b640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 0x7fc78c068800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00114a0 tx=0x7fc7a000b040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9eaffd640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec071fe0 tx=0x7fb9ec0737e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec06a9a0 con 0x7fb9d4005110 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec06ab00 con 0x7fb9d4005110 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec06ae90 con 0x7fb9d4005110 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e404ee40 con 0x7fb9d4005110 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4052400 con 0x7fb9d4005110 2023-07-09T21:22:39.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.918+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc7a40506c0 con 0x7fc7a80c9fe0 2023-07-09T21:22:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.922+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9ec0711d0 con 0x7fb9d4005110 2023-07-09T21:22:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.922+0000 7fb9d37fe640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 0x7fb9d8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.922+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9ec0fcf20 con 0x7fb9d4005110 2023-07-09T21:22:39.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.922+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 0x7fb9d8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:39.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.922+0000 7fb9ea7fc640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 0x7fb9d8068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9e418b430 tx=0x7fb9e0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:39.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.942+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e400ae30 con 0x7fb9d4005110 2023-07-09T21:22:39.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:39.946+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9ec0cde40 con 0x7fb9d4005110 2023-07-09T21:22:40.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.058+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f27580c1b90 con 0x7f27580c4d10 2023-07-09T21:22:40.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.058+0000 7f2754ff9640 1 -- 172.21.15.37:0/1045435256 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2748054bc0 con 0x7f27580c4d10 2023-07-09T21:22:40.067 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 msgr2=0x7f27400688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 0x7f27400688a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f274c0017e0 tx=0x7f274c009040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 msgr2=0x7f275806c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f274800c7f0 tx=0x7f274800ccb0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 shutdown_connections 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27400663f0 0x7f27400688a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27580c4d10 0x7f275806c430 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27580c9eb0 0x7f27581f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 --2- 172.21.15.37:0/1045435256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27580694c0 0x7f27580c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 >> 172.21.15.37:0/1045435256 conn(0x7f27580ca6c0 msgr2=0x7f27580cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 shutdown_connections 2023-07-09T21:22:40.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.062+0000 7f275e3ac640 1 -- 172.21.15.37:0/1045435256 wait complete. 2023-07-09T21:22:40.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-07-09T21:22:40.101 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.122+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2bc404e020 con 0x7f2bc406d5a0 2023-07-09T21:22:40.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.122+0000 7f2babfff640 1 -- 172.21.15.37:0/2762825826 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2bb8054e60 con 0x7f2bc406d5a0 2023-07-09T21:22:40.128 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:40.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 msgr2=0x7f2bb0068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 0x7f2bb0068800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005890 tx=0x7f2bb4009040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 msgr2=0x7f2bc40ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bb800b3f0 tx=0x7f2bb800b8b0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 shutdown_connections 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2bb0066350 0x7f2bb0068800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2bc40c0c20 0x7f2bc40aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2bc406d5a0 0x7f2bc40ae900 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 --2- 172.21.15.37:0/2762825826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2bc4069bd0 0x7f2bc414c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 >> 172.21.15.37:0/2762825826 conn(0x7f2bc40ca6c0 msgr2=0x7f2bc40c9110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 shutdown_connections 2023-07-09T21:22:40.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.126+0000 7f2bca174640 1 -- 172.21.15.37:0/2762825826 wait complete. 2023-07-09T21:22:40.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-07-09T21:22:40.152 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.154+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6d6804e020 con 0x7f6d68069bd0 2023-07-09T21:22:40.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.154+0000 7f6d5dffb640 1 -- 172.21.15.37:0/2738506780 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6d64015020 con 0x7f6d68069bd0 2023-07-09T21:22:40.158 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 msgr2=0x7f6d4c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 0x7f6d4c068800 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6d680b2be0 tx=0x7f6d6000b040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 msgr2=0x7f6d6806cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6d6400b3e0 tx=0x7f6d6400b8a0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 shutdown_connections 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d4c066350 0x7f6d4c068800 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d680cb1d0 0x7f6d68154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d680c9970 0x7f6d680cba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 --2- 172.21.15.37:0/2738506780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d68069bd0 0x7f6d6806cc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 >> 172.21.15.37:0/2738506780 conn(0x7f6d680ca6c0 msgr2=0x7f6d680caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 shutdown_connections 2023-07-09T21:22:40.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.158+0000 7f6d6f2ec640 1 -- 172.21.15.37:0/2738506780 wait complete. 2023-07-09T21:22:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.166+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8880005350 con 0x7f88800520a0 2023-07-09T21:22:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f887dffb640 1 -- 172.21.15.37:0/1274668659 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88780ea760 con 0x7f88800520a0 2023-07-09T21:22:40.173 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 msgr2=0x7f886c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 0x7f886c068780 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f888004add0 tx=0x7f8884009060 comp rx=0 tx=0).stop 2023-07-09T21:22:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 msgr2=0x7f888004bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8878000c10 tx=0x7f887801a1c0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 shutdown_connections 2023-07-09T21:22:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f886c0662d0 0x7f886c068780 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88800e1db0 0x7f888017f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88800526e0 0x7f88800db980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 --2- 172.21.15.37:0/1274668659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88800520a0 0x7f888004bbe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 >> 172.21.15.37:0/1274668659 conn(0x7f8880051590 msgr2=0x7f888004ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 shutdown_connections 2023-07-09T21:22:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.170+0000 7f888f93a640 1 -- 172.21.15.37:0/1274668659 wait complete. 2023-07-09T21:22:40.193 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2023-07-09T21:22:40.193 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.207 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-07-09T21:22:40.207 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc790005510 con 0x7fc7a80c9fe0 2023-07-09T21:22:40.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc79effd640 1 -- 172.21.15.37:0/1775999265 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7a4053ce0 con 0x7fc7a80c9fe0 2023-07-09T21:22:40.222 INFO:teuthology.orchestra.run.smithi037.stdout:55834574854 2023-07-09T21:22:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 msgr2=0x7fc78c068800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 0x7fc78c068800 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00114a0 tx=0x7fc7a000b040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 msgr2=0x7fc7a814e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 0x7fc7a814e710 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc7a400c390 tx=0x7fc7a400c850 comp rx=0 tx=0).stop 2023-07-09T21:22:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 shutdown_connections 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc78c066350 0x7fc78c068800 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7a80c9fe0 0x7fc7a814e710 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7a806cb10 0x7fc7a8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 --2- 172.21.15.37:0/1775999265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7a8069a00 0x7fc7a81500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 >> 172.21.15.37:0/1775999265 conn(0x7fc7a80ca6c0 msgr2=0x7fc7a80ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 shutdown_connections 2023-07-09T21:22:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.218+0000 7fc7b039f640 1 -- 172.21.15.37:0/1775999265 wait complete. 2023-07-09T21:22:40.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.234+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb9e4005920 con 0x7fb9d4005110 2023-07-09T21:22:40.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9d37fe640 1 -- 172.21.15.37:0/2948511308 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb9ec0cd9d0 con 0x7fb9d4005110 2023-07-09T21:22:40.241 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:40.244 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-07-09T21:22:40.244 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 msgr2=0x7fb9d8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 0x7fb9d8068760 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9e418b430 tx=0x7fb9e0008040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 msgr2=0x7fb9e404bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec071fe0 tx=0x7fb9ec0737e0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 shutdown_connections 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9d80662b0 0x7fb9d8068760 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9e404f880 0x7fb9e40501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9e404e940 0x7fb9e40e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 --2- 172.21.15.37:0/2948511308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9d4005110 0x7fb9e404bad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 >> 172.21.15.37:0/2948511308 conn(0x7fb9e400d000 msgr2=0x7fb9e4037c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 shutdown_connections 2023-07-09T21:22:40.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.238+0000 7fb9f1448640 1 -- 172.21.15.37:0/2948511308 wait complete. 2023-07-09T21:22:40.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.242+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb62c0057e0 con 0x7fb6540cb810 2023-07-09T21:22:40.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.242+0000 7fb650ff9640 1 -- 172.21.15.37:0/642339275 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6440f84a0 con 0x7fb6540cb810 2023-07-09T21:22:40.248 INFO:teuthology.orchestra.run.smithi037.stdout:55834574855 2023-07-09T21:22:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 msgr2=0x7fb6400687b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 0x7fb6400687b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb64c00b1e0 tx=0x7fb64c00d040 comp rx=0 tx=0).stop 2023-07-09T21:22:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 msgr2=0x7fb6540c1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 0x7fb6540c1770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6440b3000 tx=0x7fb644021a60 comp rx=0 tx=0).stop 2023-07-09T21:22:40.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 shutdown_connections 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb640066300 0x7fb6400687b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6540cb810 0x7fb6540c1770 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6540ca2d0 0x7fb6540b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 --2- 172.21.15.37:0/642339275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb654070db0 0x7fb6540c0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 >> 172.21.15.37:0/642339275 conn(0x7fb6540ca6c0 msgr2=0x7fb654089540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 shutdown_connections 2023-07-09T21:22:40.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7fb63a7fc640 1 -- 172.21.15.37:0/642339275 wait complete. 2023-07-09T21:22:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f8fec005510 con 0x7f900c0ca1b0 2023-07-09T21:22:40.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.246+0000 7f8ff3fff640 1 -- 172.21.15.37:0/4237105694 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90040bc020 con 0x7f900c0ca1b0 2023-07-09T21:22:40.253 INFO:teuthology.orchestra.run.smithi037.stdout:55834574853 2023-07-09T21:22:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 msgr2=0x7f8ff8068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 0x7f8ff8068780 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9000009a50 tx=0x7f9000009190 comp rx=0 tx=0).stop 2023-07-09T21:22:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 msgr2=0x7f900c0b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 0x7f900c0b2310 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f90040ab000 tx=0x7f9004019670 comp rx=0 tx=0).stop 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 shutdown_connections 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8ff80662d0 0x7f8ff8068780 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f900c0ca1b0 0x7f900c0b2310 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f900c06cb10 0x7f900c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 --2- 172.21.15.37:0/4237105694 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f900c069a00 0x7f900c152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 >> 172.21.15.37:0/4237105694 conn(0x7f900c0ca6c0 msgr2=0x7f900c15b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 shutdown_connections 2023-07-09T21:22:40.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.250+0000 7f90120d8640 1 -- 172.21.15.37:0/4237105694 wait complete. 2023-07-09T21:22:40.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.4 2023-07-09T21:22:40.268 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.275 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-07-09T21:22:40.275 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-07-09T21:22:40.277 DEBUG:teuthology.parallel:result is None 2023-07-09T21:22:40.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T21:22:40.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:22:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 Processor -- start 2023-07-09T21:22:40.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 -- start start 2023-07-09T21:22:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a1c0b7ab0 0x7f7a1c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0b49f0 con 0x7f7a1c0b4170 2023-07-09T21:22:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b7e80 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a24737640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0b4610 con 0x7f7a1c0cef80 2023-07-09T21:22:40.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a22cd4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7a1c0b4170 0x7f7a1c15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57150/0 (socket says 172.21.15.37:57150) 2023-07-09T21:22:40.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a22cd4640 1 -- 172.21.15.37:0/581925690 learned_addr learned my addr 172.21.15.37:0/581925690 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:40.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/581925690 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a224d3640 1 --2- 172.21.15.37:0/581925690 >> v2:172.21.15.119:3300/0 conn(0x7f7a1c0b7ab0 0x7f7a1c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a214d1640 1 -- 172.21.15.37:0/581925690 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1079459614 0 0) 0x7f7a1c0b49f0 con 0x7f7a1c0b4170 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a214d1640 1 -- 172.21.15.37:0/581925690 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a08003530 con 0x7f7a1c0b4170 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a21cd2640 1 -- 172.21.15.37:0/581925690 >> v2:172.21.15.119:3300/0 conn(0x7f7a1c0b7ab0 msgr2=0x7f7a1c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/581925690 >> v2:172.21.15.119:3300/0 conn(0x7f7a1c0b7ab0 0x7f7a1c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a21cd2640 1 -- 172.21.15.37:0/581925690 >> v1:172.21.15.37:6789/0 conn(0x7f7a1c0b4170 legacy=0x7f7a1c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.458+0000 7f7a21cd2640 1 -- 172.21.15.37:0/581925690 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0cc8a0 con 0x7f7a1c0cef80 2023-07-09T21:22:40.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/581925690 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c0b3c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0097c0 tx=0x7f7a0c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c3ff9b6e74c953 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a214d1640 1 -- 172.21.15.37:0/581925690 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0ab650 con 0x7f7a1c0cef80 2023-07-09T21:22:40.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a214d1640 1 -- 172.21.15.37:0/581925690 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0ab7b0 con 0x7f7a1c0cef80 2023-07-09T21:22:40.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a214d1640 1 -- 172.21.15.37:0/581925690 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0abb40 con 0x7f7a1c0cef80 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 -- 172.21.15.37:0/581925690 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 msgr2=0x7f7a1c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 --2- 172.21.15.37:0/581925690 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c0b3c30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0097c0 tx=0x7f7a0c01c450 comp rx=0 tx=0).stop 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 -- 172.21.15.37:0/581925690 shutdown_connections 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 --2- 172.21.15.37:0/581925690 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c0b3c30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 --2- 172.21.15.37:0/581925690 >> v2:172.21.15.119:3300/0 conn(0x7f7a1c0b7ab0 0x7f7a1c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 -- 172.21.15.37:0/581925690 >> 172.21.15.37:0/581925690 conn(0x7f7a1c073090 msgr2=0x7f7a1c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 -- 172.21.15.37:0/581925690 shutdown_connections 2023-07-09T21:22:40.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.462+0000 7f7a24737640 1 -- 172.21.15.37:0/581925690 wait complete. 2023-07-09T21:22:40.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 Processor -- start 2023-07-09T21:22:40.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- start start 2023-07-09T21:22:40.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a1c0b4170 0x7f7a1c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c6d30 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c72f0 con 0x7f7a1c0b4170 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0ca6e0 con 0x7f7a1c0cef80 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34496/0 (socket says 172.21.15.37:34496) 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 -- 172.21.15.37:0/3385796175 learned_addr learned my addr 172.21.15.37:0/3385796175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a224d3640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a1c0b4170 0x7f7a1c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a22cd4640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 -- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 msgr2=0x7f7a1c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 -- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a1c0b4170 msgr2=0x7f7a1c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a1c0b4170 0x7f7a1c0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 -- 172.21.15.37:0/3385796175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009420 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a21cd2640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ab00 tx=0x7f7a0c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0abdf0 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0bf450 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0ca9c0 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0bf7e0 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.466+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0cb0c0 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c0c7480 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a0c0bf940 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a12ffd640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a0c11e600 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a224d3640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.470+0000 7f7a224d3640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 0x7f7a00068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009b60 tx=0x7f7a18009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.474+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a0c0eb9e0 con 0x7f7a1c0b7ab0 2023-07-09T21:22:40.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.626+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a1c0cf4d0 con 0x7f7a00066280 2023-07-09T21:22:40.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.634+0000 7f7a12ffd640 1 -- 172.21.15.37:0/3385796175 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286619 (secure 0 0 0) 0x7f7a18011ac0 con 0x7f7a00066280 2023-07-09T21:22:40.641 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:40.642 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:22:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 msgr2=0x7f7a00068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 0x7f7a00068730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7a18009b60 tx=0x7f7a18009190 comp rx=0 tx=0).stop 2023-07-09T21:22:40.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 msgr2=0x7f7a1c0c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c01ab00 tx=0x7f7a0c0191f0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 shutdown_connections 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7a00066280 0x7f7a00068730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a1c0cef80 0x7f7a1c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a1c0b7ab0 0x7f7a1c0c9c90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 --2- 172.21.15.37:0/3385796175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7a1c0b4170 0x7f7a1c0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 >> 172.21.15.37:0/3385796175 conn(0x7f7a1c073090 msgr2=0x7f7a1c158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 shutdown_connections 2023-07-09T21:22:40.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.638+0000 7f7a24737640 1 -- 172.21.15.37:0/3385796175 wait complete. 2023-07-09T21:22:40.661 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:22:39.955699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222824,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751896,"statfs":{"total":773094113280,"available":772865941504,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.129536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242306+0000","last_change":"2023-07-09T21:22:31.846882+0000","last_active":"2023-07-09T21:22:33.242306+0000","last_peered":"2023-07-09T21:22:33.242306+0000","last_clean":"2023-07-09T21:22:33.242306+0000","last_became_active":"2023-07-09T21:22:31.846526+0000","last_became_peered":"2023-07-09T21:22:31.846526+0000","last_unstale":"2023-07-09T21:22:33.242306+0000","last_undegraded":"2023-07-09T21:22:33.242306+0000","last_fullsized":"2023-07-09T21:22:33.242306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831655+0000","last_change":"2023-07-09T21:22:31.865763+0000","last_active":"2023-07-09T21:22:32.831655+0000","last_peered":"2023-07-09T21:22:32.831655+0000","last_clean":"2023-07-09T21:22:32.831655+0000","last_became_active":"2023-07-09T21:22:31.865352+0000","last_became_peered":"2023-07-09T21:22:31.865352+0000","last_unstale":"2023-07-09T21:22:32.831655+0000","last_undegraded":"2023-07-09T21:22:32.831655+0000","last_fullsized":"2023-07-09T21:22:32.831655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832722+0000","last_change":"2023-07-09T21:22:31.852655+0000","last_active":"2023-07-09T21:22:32.832722+0000","last_peered":"2023-07-09T21:22:32.832722+0000","last_clean":"2023-07-09T21:22:32.832722+0000","last_became_active":"2023-07-09T21:22:31.852014+0000","last_became_peered":"2023-07-09T21:22:31.852014+0000","last_unstale":"2023-07-09T21:22:32.832722+0000","last_undegraded":"2023-07-09T21:22:32.832722+0000","last_fullsized":"2023-07-09T21:22:32.832722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830239+0000","last_change":"2023-07-09T21:22:31.851591+0000","last_active":"2023-07-09T21:22:32.830239+0000","last_peered":"2023-07-09T21:22:32.830239+0000","last_clean":"2023-07-09T21:22:32.830239+0000","last_became_active":"2023-07-09T21:22:31.851326+0000","last_became_peered":"2023-07-09T21:22:31.851326+0000","last_unstale":"2023-07-09T21:22:32.830239+0000","last_undegraded":"2023-07-09T21:22:32.830239+0000","last_fullsized":"2023-07-09T21:22:32.830239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:43.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158817+0000","last_change":"2023-07-09T21:22:31.845576+0000","last_active":"2023-07-09T21:22:33.158817+0000","last_peered":"2023-07-09T21:22:33.158817+0000","last_clean":"2023-07-09T21:22:33.158817+0000","last_became_active":"2023-07-09T21:22:31.844904+0000","last_became_peered":"2023-07-09T21:22:31.844904+0000","last_unstale":"2023-07-09T21:22:33.158817+0000","last_undegraded":"2023-07-09T21:22:33.158817+0000","last_fullsized":"2023-07-09T21:22:33.158817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831539+0000","last_change":"2023-07-09T21:22:31.853123+0000","last_active":"2023-07-09T21:22:32.831539+0000","last_peered":"2023-07-09T21:22:32.831539+0000","last_clean":"2023-07-09T21:22:32.831539+0000","last_became_active":"2023-07-09T21:22:31.852855+0000","last_became_peered":"2023-07-09T21:22:31.852855+0000","last_unstale":"2023-07-09T21:22:32.831539+0000","last_undegraded":"2023-07-09T21:22:32.831539+0000","last_fullsized":"2023-07-09T21:22:32.831539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222888+0000","last_change":"2023-07-09T21:22:31.859422+0000","last_active":"2023-07-09T21:22:34.222888+0000","last_peered":"2023-07-09T21:22:34.222888+0000","last_clean":"2023-07-09T21:22:34.222888+0000","last_became_active":"2023-07-09T21:22:31.859125+0000","last_became_peered":"2023-07-09T21:22:31.859125+0000","last_unstale":"2023-07-09T21:22:34.222888+0000","last_undegraded":"2023-07-09T21:22:34.222888+0000","last_fullsized":"2023-07-09T21:22:34.222888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830707+0000","last_change":"2023-07-09T21:22:31.859849+0000","last_active":"2023-07-09T21:22:32.830707+0000","last_peered":"2023-07-09T21:22:32.830707+0000","last_clean":"2023-07-09T21:22:32.830707+0000","last_became_active":"2023-07-09T21:22:31.859115+0000","last_became_peered":"2023-07-09T21:22:31.859115+0000","last_unstale":"2023-07-09T21:22:32.830707+0000","last_undegraded":"2023-07-09T21:22:32.830707+0000","last_fullsized":"2023-07-09T21:22:32.830707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158936+0000","last_change":"2023-07-09T21:22:31.847329+0000","last_active":"2023-07-09T21:22:33.158936+0000","last_peered":"2023-07-09T21:22:33.158936+0000","last_clean":"2023-07-09T21:22:33.158936+0000","last_became_active":"2023-07-09T21:22:31.847067+0000","last_became_peered":"2023-07-09T21:22:31.847067+0000","last_unstale":"2023-07-09T21:22:33.158936+0000","last_undegraded":"2023-07-09T21:22:33.158936+0000","last_fullsized":"2023-07-09T21:22:33.158936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:09.592064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831808+0000","last_change":"2023-07-09T21:22:31.865305+0000","last_active":"2023-07-09T21:22:32.831808+0000","last_peered":"2023-07-09T21:22:32.831808+0000","last_clean":"2023-07-09T21:22:32.831808+0000","last_became_active":"2023-07-09T21:22:31.864992+0000","last_became_peered":"2023-07-09T21:22:31.864992+0000","last_unstale":"2023-07-09T21:22:32.831808+0000","last_undegraded":"2023-07-09T21:22:32.831808+0000","last_fullsized":"2023-07-09T21:22:32.831808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832758+0000","last_change":"2023-07-09T21:22:31.855739+0000","last_active":"2023-07-09T21:22:32.832758+0000","last_peered":"2023-07-09T21:22:32.832758+0000","last_clean":"2023-07-09T21:22:32.832758+0000","last_became_active":"2023-07-09T21:22:31.854569+0000","last_became_peered":"2023-07-09T21:22:31.854569+0000","last_unstale":"2023-07-09T21:22:32.832758+0000","last_undegraded":"2023-07-09T21:22:32.832758+0000","last_fullsized":"2023-07-09T21:22:32.832758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242393+0000","last_change":"2023-07-09T21:22:31.856905+0000","last_active":"2023-07-09T21:22:33.242393+0000","last_peered":"2023-07-09T21:22:33.242393+0000","last_clean":"2023-07-09T21:22:33.242393+0000","last_became_active":"2023-07-09T21:22:31.856417+0000","last_became_peered":"2023-07-09T21:22:31.856417+0000","last_unstale":"2023-07-09T21:22:33.242393+0000","last_undegraded":"2023-07-09T21:22:33.242393+0000","last_fullsized":"2023-07-09T21:22:33.242393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:41.397827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242279+0000","last_change":"2023-07-09T21:22:31.845104+0000","last_active":"2023-07-09T21:22:33.242279+0000","last_peered":"2023-07-09T21:22:33.242279+0000","last_clean":"2023-07-09T21:22:33.242279+0000","last_became_active":"2023-07-09T21:22:31.844818+0000","last_became_peered":"2023-07-09T21:22:31.844818+0000","last_unstale":"2023-07-09T21:22:33.242279+0000","last_undegraded":"2023-07-09T21:22:33.242279+0000","last_fullsized":"2023-07-09T21:22:33.242279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831167+0000","last_change":"2023-07-09T21:22:31.866886+0000","last_active":"2023-07-09T21:22:32.831167+0000","last_peered":"2023-07-09T21:22:32.831167+0000","last_clean":"2023-07-09T21:22:32.831167+0000","last_became_active":"2023-07-09T21:22:31.866546+0000","last_became_peered":"2023-07-09T21:22:31.866546+0000","last_unstale":"2023-07-09T21:22:32.831167+0000","last_undegraded":"2023-07-09T21:22:32.831167+0000","last_fullsized":"2023-07-09T21:22:32.831167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223021+0000","last_change":"2023-07-09T21:22:31.858913+0000","last_active":"2023-07-09T21:22:34.223021+0000","last_peered":"2023-07-09T21:22:34.223021+0000","last_clean":"2023-07-09T21:22:34.223021+0000","last_became_active":"2023-07-09T21:22:31.858642+0000","last_became_peered":"2023-07-09T21:22:31.858642+0000","last_unstale":"2023-07-09T21:22:34.223021+0000","last_undegraded":"2023-07-09T21:22:34.223021+0000","last_fullsized":"2023-07-09T21:22:34.223021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.847866+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.847543+0000","last_became_peered":"2023-07-09T21:22:31.847543+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158975+0000","last_change":"2023-07-09T21:22:31.846826+0000","last_active":"2023-07-09T21:22:33.158975+0000","last_peered":"2023-07-09T21:22:33.158975+0000","last_clean":"2023-07-09T21:22:33.158975+0000","last_became_active":"2023-07-09T21:22:31.846429+0000","last_became_peered":"2023-07-09T21:22:31.846429+0000","last_unstale":"2023-07-09T21:22:33.158975+0000","last_undegraded":"2023-07-09T21:22:33.158975+0000","last_fullsized":"2023-07-09T21:22:33.158975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832648+0000","last_change":"2023-07-09T21:22:31.852252+0000","last_active":"2023-07-09T21:22:32.832648+0000","last_peered":"2023-07-09T21:22:32.832648+0000","last_clean":"2023-07-09T21:22:32.832648+0000","last_became_active":"2023-07-09T21:22:31.851797+0000","last_became_peered":"2023-07-09T21:22:31.851797+0000","last_unstale":"2023-07-09T21:22:32.832648+0000","last_undegraded":"2023-07-09T21:22:32.832648+0000","last_fullsized":"2023-07-09T21:22:32.832648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242388+0000","last_change":"2023-07-09T21:22:31.848525+0000","last_active":"2023-07-09T21:22:33.242388+0000","last_peered":"2023-07-09T21:22:33.242388+0000","last_clean":"2023-07-09T21:22:33.242388+0000","last_became_active":"2023-07-09T21:22:31.847570+0000","last_became_peered":"2023-07-09T21:22:31.847570+0000","last_unstale":"2023-07-09T21:22:33.242388+0000","last_undegraded":"2023-07-09T21:22:33.242388+0000","last_fullsized":"2023-07-09T21:22:33.242388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832660+0000","last_change":"2023-07-09T21:22:31.855749+0000","last_active":"2023-07-09T21:22:32.832660+0000","last_peered":"2023-07-09T21:22:32.832660+0000","last_clean":"2023-07-09T21:22:32.832660+0000","last_became_active":"2023-07-09T21:22:31.855457+0000","last_became_peered":"2023-07-09T21:22:31.855457+0000","last_unstale":"2023-07-09T21:22:32.832660+0000","last_undegraded":"2023-07-09T21:22:32.832660+0000","last_fullsized":"2023-07-09T21:22:32.832660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223176+0000","last_change":"2023-07-09T21:22:31.862987+0000","last_active":"2023-07-09T21:22:34.223176+0000","last_peered":"2023-07-09T21:22:34.223176+0000","last_clean":"2023-07-09T21:22:34.223176+0000","last_became_active":"2023-07-09T21:22:31.862706+0000","last_became_peered":"2023-07-09T21:22:31.862706+0000","last_unstale":"2023-07-09T21:22:34.223176+0000","last_undegraded":"2023-07-09T21:22:34.223176+0000","last_fullsized":"2023-07-09T21:22:34.223176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:36.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158583+0000","last_change":"2023-07-09T21:22:31.856986+0000","last_active":"2023-07-09T21:22:33.158583+0000","last_peered":"2023-07-09T21:22:33.158583+0000","last_clean":"2023-07-09T21:22:33.158583+0000","last_became_active":"2023-07-09T21:22:31.856738+0000","last_became_peered":"2023-07-09T21:22:31.856738+0000","last_unstale":"2023-07-09T21:22:33.158583+0000","last_undegraded":"2023-07-09T21:22:33.158583+0000","last_fullsized":"2023-07-09T21:22:33.158583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475659+0000","last_change":"2023-07-09T21:22:31.848593+0000","last_active":"2023-07-09T21:22:34.475659+0000","last_peered":"2023-07-09T21:22:34.475659+0000","last_clean":"2023-07-09T21:22:34.475659+0000","last_became_active":"2023-07-09T21:22:31.848310+0000","last_became_peered":"2023-07-09T21:22:31.848310+0000","last_unstale":"2023-07-09T21:22:34.475659+0000","last_undegraded":"2023-07-09T21:22:34.475659+0000","last_fullsized":"2023-07-09T21:22:34.475659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223082+0000","last_change":"2023-07-09T21:22:31.862953+0000","last_active":"2023-07-09T21:22:34.223082+0000","last_peered":"2023-07-09T21:22:34.223082+0000","last_clean":"2023-07-09T21:22:34.223082+0000","last_became_active":"2023-07-09T21:22:31.862334+0000","last_became_peered":"2023-07-09T21:22:31.862334+0000","last_unstale":"2023-07-09T21:22:34.223082+0000","last_undegraded":"2023-07-09T21:22:34.223082+0000","last_fullsized":"2023-07-09T21:22:34.223082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374698+0000","last_change":"2023-07-09T21:22:31.854043+0000","last_active":"2023-07-09T21:22:33.374698+0000","last_peered":"2023-07-09T21:22:33.374698+0000","last_clean":"2023-07-09T21:22:33.374698+0000","last_became_active":"2023-07-09T21:22:31.853765+0000","last_became_peered":"2023-07-09T21:22:31.853765+0000","last_unstale":"2023-07-09T21:22:33.374698+0000","last_undegraded":"2023-07-09T21:22:33.374698+0000","last_fullsized":"2023-07-09T21:22:33.374698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374889+0000","last_change":"2023-07-09T21:22:31.843774+0000","last_active":"2023-07-09T21:22:33.374889+0000","last_peered":"2023-07-09T21:22:33.374889+0000","last_clean":"2023-07-09T21:22:33.374889+0000","last_became_active":"2023-07-09T21:22:31.843507+0000","last_became_peered":"2023-07-09T21:22:31.843507+0000","last_unstale":"2023-07-09T21:22:33.374889+0000","last_undegraded":"2023-07-09T21:22:33.374889+0000","last_fullsized":"2023-07-09T21:22:33.374889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831070+0000","last_change":"2023-07-09T21:22:31.865931+0000","last_active":"2023-07-09T21:22:32.831070+0000","last_peered":"2023-07-09T21:22:32.831070+0000","last_clean":"2023-07-09T21:22:32.831070+0000","last_became_active":"2023-07-09T21:22:31.865659+0000","last_became_peered":"2023-07-09T21:22:31.865659+0000","last_unstale":"2023-07-09T21:22:32.831070+0000","last_undegraded":"2023-07-09T21:22:32.831070+0000","last_fullsized":"2023-07-09T21:22:32.831070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375072+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:33.375072+0000","last_peered":"2023-07-09T21:22:33.375072+0000","last_clean":"2023-07-09T21:22:33.375072+0000","last_became_active":"2023-07-09T21:22:31.856284+0000","last_became_peered":"2023-07-09T21:22:31.856284+0000","last_unstale":"2023-07-09T21:22:33.375072+0000","last_undegraded":"2023-07-09T21:22:33.375072+0000","last_fullsized":"2023-07-09T21:22:33.375072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476240+0000","last_change":"2023-07-09T21:22:31.854071+0000","last_active":"2023-07-09T21:22:34.476240+0000","last_peered":"2023-07-09T21:22:34.476240+0000","last_clean":"2023-07-09T21:22:34.476240+0000","last_became_active":"2023-07-09T21:22:31.853768+0000","last_became_peered":"2023-07-09T21:22:31.853768+0000","last_unstale":"2023-07-09T21:22:34.476240+0000","last_undegraded":"2023-07-09T21:22:34.476240+0000","last_fullsized":"2023-07-09T21:22:34.476240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831876+0000","last_change":"2023-07-09T21:22:31.847820+0000","last_active":"2023-07-09T21:22:32.831876+0000","last_peered":"2023-07-09T21:22:32.831876+0000","last_clean":"2023-07-09T21:22:32.831876+0000","last_became_active":"2023-07-09T21:22:31.847484+0000","last_became_peered":"2023-07-09T21:22:31.847484+0000","last_unstale":"2023-07-09T21:22:32.831876+0000","last_undegraded":"2023-07-09T21:22:32.831876+0000","last_fullsized":"2023-07-09T21:22:32.831876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475764+0000","last_change":"2023-07-09T21:22:31.855297+0000","last_active":"2023-07-09T21:22:34.475764+0000","last_peered":"2023-07-09T21:22:34.475764+0000","last_clean":"2023-07-09T21:22:34.475764+0000","last_became_active":"2023-07-09T21:22:31.855025+0000","last_became_peered":"2023-07-09T21:22:31.855025+0000","last_unstale":"2023-07-09T21:22:34.475764+0000","last_undegraded":"2023-07-09T21:22:34.475764+0000","last_fullsized":"2023-07-09T21:22:34.475764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829783+0000","last_change":"2023-07-09T21:22:31.847753+0000","last_active":"2023-07-09T21:22:32.829783+0000","last_peered":"2023-07-09T21:22:32.829783+0000","last_clean":"2023-07-09T21:22:32.829783+0000","last_became_active":"2023-07-09T21:22:31.847425+0000","last_became_peered":"2023-07-09T21:22:31.847425+0000","last_unstale":"2023-07-09T21:22:32.829783+0000","last_undegraded":"2023-07-09T21:22:32.829783+0000","last_fullsized":"2023-07-09T21:22:32.829783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475982+0000","last_change":"2023-07-09T21:22:31.853654+0000","last_active":"2023-07-09T21:22:34.475982+0000","last_peered":"2023-07-09T21:22:34.475982+0000","last_clean":"2023-07-09T21:22:34.475982+0000","last_became_active":"2023-07-09T21:22:31.853302+0000","last_became_peered":"2023-07-09T21:22:31.853302+0000","last_unstale":"2023-07-09T21:22:34.475982+0000","last_undegraded":"2023-07-09T21:22:34.475982+0000","last_fullsized":"2023-07-09T21:22:34.475982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:15.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223313+0000","last_change":"2023-07-09T21:22:30.856062+0000","last_active":"2023-07-09T21:22:34.223313+0000","last_peered":"2023-07-09T21:22:34.223313+0000","last_clean":"2023-07-09T21:22:34.223313+0000","last_became_active":"2023-07-09T21:22:30.855739+0000","last_became_peered":"2023-07-09T21:22:30.855739+0000","last_unstale":"2023-07-09T21:22:34.223313+0000","last_undegraded":"2023-07-09T21:22:34.223313+0000","last_fullsized":"2023-07-09T21:22:34.223313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:53.171536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831637+0000","last_change":"2023-07-09T21:22:31.865421+0000","last_active":"2023-07-09T21:22:32.831637+0000","last_peered":"2023-07-09T21:22:32.831637+0000","last_clean":"2023-07-09T21:22:32.831637+0000","last_became_active":"2023-07-09T21:22:31.865018+0000","last_became_peered":"2023-07-09T21:22:31.865018+0000","last_unstale":"2023-07-09T21:22:32.831637+0000","last_undegraded":"2023-07-09T21:22:32.831637+0000","last_fullsized":"2023-07-09T21:22:32.831637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158617+0000","last_change":"2023-07-09T21:22:30.844420+0000","last_active":"2023-07-09T21:22:33.158617+0000","last_peered":"2023-07-09T21:22:33.158617+0000","last_clean":"2023-07-09T21:22:33.158617+0000","last_became_active":"2023-07-09T21:22:30.843988+0000","last_became_peered":"2023-07-09T21:22:30.843988+0000","last_unstale":"2023-07-09T21:22:33.158617+0000","last_undegraded":"2023-07-09T21:22:33.158617+0000","last_fullsized":"2023-07-09T21:22:33.158617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:27.561323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158970+0000","last_change":"2023-07-09T21:22:31.845772+0000","last_active":"2023-07-09T21:22:33.158970+0000","last_peered":"2023-07-09T21:22:33.158970+0000","last_clean":"2023-07-09T21:22:33.158970+0000","last_became_active":"2023-07-09T21:22:31.845435+0000","last_became_peered":"2023-07-09T21:22:31.845435+0000","last_unstale":"2023-07-09T21:22:33.158970+0000","last_undegraded":"2023-07-09T21:22:33.158970+0000","last_fullsized":"2023-07-09T21:22:33.158970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223093+0000","last_change":"2023-07-09T21:22:30.858532+0000","last_active":"2023-07-09T21:22:34.223093+0000","last_peered":"2023-07-09T21:22:34.223093+0000","last_clean":"2023-07-09T21:22:34.223093+0000","last_became_active":"2023-07-09T21:22:30.858236+0000","last_became_peered":"2023-07-09T21:22:30.858236+0000","last_unstale":"2023-07-09T21:22:34.223093+0000","last_undegraded":"2023-07-09T21:22:34.223093+0000","last_fullsized":"2023-07-09T21:22:34.223093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476256+0000","last_change":"2023-07-09T21:22:31.854757+0000","last_active":"2023-07-09T21:22:34.476256+0000","last_peered":"2023-07-09T21:22:34.476256+0000","last_clean":"2023-07-09T21:22:34.476256+0000","last_became_active":"2023-07-09T21:22:31.854486+0000","last_became_peered":"2023-07-09T21:22:31.854486+0000","last_unstale":"2023-07-09T21:22:34.476256+0000","last_undegraded":"2023-07-09T21:22:34.476256+0000","last_fullsized":"2023-07-09T21:22:34.476256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829862+0000","last_change":"2023-07-09T21:22:30.847752+0000","last_active":"2023-07-09T21:22:32.829862+0000","last_peered":"2023-07-09T21:22:32.829862+0000","last_clean":"2023-07-09T21:22:32.829862+0000","last_became_active":"2023-07-09T21:22:30.847443+0000","last_became_peered":"2023-07-09T21:22:30.847443+0000","last_unstale":"2023-07-09T21:22:32.829862+0000","last_undegraded":"2023-07-09T21:22:32.829862+0000","last_fullsized":"2023-07-09T21:22:32.829862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223446+0000","last_change":"2023-07-09T21:22:30.858567+0000","last_active":"2023-07-09T21:22:34.223446+0000","last_peered":"2023-07-09T21:22:34.223446+0000","last_clean":"2023-07-09T21:22:34.223446+0000","last_became_active":"2023-07-09T21:22:30.858292+0000","last_became_peered":"2023-07-09T21:22:30.858292+0000","last_unstale":"2023-07-09T21:22:34.223446+0000","last_undegraded":"2023-07-09T21:22:34.223446+0000","last_fullsized":"2023-07-09T21:22:34.223446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:21.676598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830934+0000","last_change":"2023-07-09T21:22:31.860174+0000","last_active":"2023-07-09T21:22:32.830934+0000","last_peered":"2023-07-09T21:22:32.830934+0000","last_clean":"2023-07-09T21:22:32.830934+0000","last_became_active":"2023-07-09T21:22:31.859534+0000","last_became_peered":"2023-07-09T21:22:31.859534+0000","last_unstale":"2023-07-09T21:22:32.830934+0000","last_undegraded":"2023-07-09T21:22:32.830934+0000","last_fullsized":"2023-07-09T21:22:32.830934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223257+0000","last_change":"2023-07-09T21:22:30.859109+0000","last_active":"2023-07-09T21:22:34.223257+0000","last_peered":"2023-07-09T21:22:34.223257+0000","last_clean":"2023-07-09T21:22:34.223257+0000","last_became_active":"2023-07-09T21:22:30.858847+0000","last_became_peered":"2023-07-09T21:22:30.858847+0000","last_unstale":"2023-07-09T21:22:34.223257+0000","last_undegraded":"2023-07-09T21:22:34.223257+0000","last_fullsized":"2023-07-09T21:22:34.223257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:09:31.012287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.853909+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.853620+0000","last_became_peered":"2023-07-09T21:22:31.853620+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223459+0000","last_change":"2023-07-09T21:22:30.843222+0000","last_active":"2023-07-09T21:22:34.223459+0000","last_peered":"2023-07-09T21:22:34.223459+0000","last_clean":"2023-07-09T21:22:34.223459+0000","last_became_active":"2023-07-09T21:22:30.842674+0000","last_became_peered":"2023-07-09T21:22:30.842674+0000","last_unstale":"2023-07-09T21:22:34.223459+0000","last_undegraded":"2023-07-09T21:22:34.223459+0000","last_fullsized":"2023-07-09T21:22:34.223459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:11.095047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829829+0000","last_change":"2023-07-09T21:22:31.862216+0000","last_active":"2023-07-09T21:22:32.829829+0000","last_peered":"2023-07-09T21:22:32.829829+0000","last_clean":"2023-07-09T21:22:32.829829+0000","last_became_active":"2023-07-09T21:22:31.861894+0000","last_became_peered":"2023-07-09T21:22:31.861894+0000","last_unstale":"2023-07-09T21:22:32.829829+0000","last_undegraded":"2023-07-09T21:22:32.829829+0000","last_fullsized":"2023-07-09T21:22:32.829829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831409+0000","last_change":"2023-07-09T21:22:30.851190+0000","last_active":"2023-07-09T21:22:32.831409+0000","last_peered":"2023-07-09T21:22:32.831409+0000","last_clean":"2023-07-09T21:22:32.831409+0000","last_became_active":"2023-07-09T21:22:30.850854+0000","last_became_peered":"2023-07-09T21:22:30.850854+0000","last_unstale":"2023-07-09T21:22:32.831409+0000","last_undegraded":"2023-07-09T21:22:32.831409+0000","last_fullsized":"2023-07-09T21:22:32.831409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158620+0000","last_change":"2023-07-09T21:22:31.851686+0000","last_active":"2023-07-09T21:22:33.158620+0000","last_peered":"2023-07-09T21:22:33.158620+0000","last_clean":"2023-07-09T21:22:33.158620+0000","last_became_active":"2023-07-09T21:22:31.851409+0000","last_became_peered":"2023-07-09T21:22:31.851409+0000","last_unstale":"2023-07-09T21:22:33.158620+0000","last_undegraded":"2023-07-09T21:22:33.158620+0000","last_fullsized":"2023-07-09T21:22:33.158620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476330+0000","last_change":"2023-07-09T21:22:30.850817+0000","last_active":"2023-07-09T21:22:34.476330+0000","last_peered":"2023-07-09T21:22:34.476330+0000","last_clean":"2023-07-09T21:22:34.476330+0000","last_became_active":"2023-07-09T21:22:30.850487+0000","last_became_peered":"2023-07-09T21:22:30.850487+0000","last_unstale":"2023-07-09T21:22:34.476330+0000","last_undegraded":"2023-07-09T21:22:34.476330+0000","last_fullsized":"2023-07-09T21:22:34.476330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832857+0000","last_change":"2023-07-09T21:22:31.856467+0000","last_active":"2023-07-09T21:22:32.832857+0000","last_peered":"2023-07-09T21:22:32.832857+0000","last_clean":"2023-07-09T21:22:32.832857+0000","last_became_active":"2023-07-09T21:22:31.855212+0000","last_became_peered":"2023-07-09T21:22:31.855212+0000","last_unstale":"2023-07-09T21:22:32.832857+0000","last_undegraded":"2023-07-09T21:22:32.832857+0000","last_fullsized":"2023-07-09T21:22:32.832857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:55.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830026+0000","last_change":"2023-07-09T21:22:30.857694+0000","last_active":"2023-07-09T21:22:32.830026+0000","last_peered":"2023-07-09T21:22:32.830026+0000","last_clean":"2023-07-09T21:22:32.830026+0000","last_became_active":"2023-07-09T21:22:30.857229+0000","last_became_peered":"2023-07-09T21:22:30.857229+0000","last_unstale":"2023-07-09T21:22:32.830026+0000","last_undegraded":"2023-07-09T21:22:32.830026+0000","last_fullsized":"2023-07-09T21:22:32.830026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832851+0000","last_change":"2023-07-09T21:22:31.850987+0000","last_active":"2023-07-09T21:22:32.832851+0000","last_peered":"2023-07-09T21:22:32.832851+0000","last_clean":"2023-07-09T21:22:32.832851+0000","last_became_active":"2023-07-09T21:22:31.850653+0000","last_became_peered":"2023-07-09T21:22:31.850653+0000","last_unstale":"2023-07-09T21:22:32.832851+0000","last_undegraded":"2023-07-09T21:22:32.832851+0000","last_fullsized":"2023-07-09T21:22:32.832851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832117+0000","last_change":"2023-07-09T21:22:30.856178+0000","last_active":"2023-07-09T21:22:32.832117+0000","last_peered":"2023-07-09T21:22:32.832117+0000","last_clean":"2023-07-09T21:22:32.832117+0000","last_became_active":"2023-07-09T21:22:30.855740+0000","last_became_peered":"2023-07-09T21:22:30.855740+0000","last_unstale":"2023-07-09T21:22:32.832117+0000","last_undegraded":"2023-07-09T21:22:32.832117+0000","last_fullsized":"2023-07-09T21:22:32.832117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832756+0000","last_change":"2023-07-09T21:22:31.852075+0000","last_active":"2023-07-09T21:22:32.832756+0000","last_peered":"2023-07-09T21:22:32.832756+0000","last_clean":"2023-07-09T21:22:32.832756+0000","last_became_active":"2023-07-09T21:22:31.851518+0000","last_became_peered":"2023-07-09T21:22:31.851518+0000","last_unstale":"2023-07-09T21:22:32.832756+0000","last_undegraded":"2023-07-09T21:22:32.832756+0000","last_fullsized":"2023-07-09T21:22:32.832756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476033+0000","last_change":"2023-07-09T21:22:30.850674+0000","last_active":"2023-07-09T21:22:34.476033+0000","last_peered":"2023-07-09T21:22:34.476033+0000","last_clean":"2023-07-09T21:22:34.476033+0000","last_became_active":"2023-07-09T21:22:30.847971+0000","last_became_peered":"2023-07-09T21:22:30.847971+0000","last_unstale":"2023-07-09T21:22:34.476033+0000","last_undegraded":"2023-07-09T21:22:34.476033+0000","last_fullsized":"2023-07-09T21:22:34.476033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374907+0000","last_change":"2023-07-09T21:22:31.861069+0000","last_active":"2023-07-09T21:22:33.374907+0000","last_peered":"2023-07-09T21:22:33.374907+0000","last_clean":"2023-07-09T21:22:33.374907+0000","last_became_active":"2023-07-09T21:22:31.860705+0000","last_became_peered":"2023-07-09T21:22:31.860705+0000","last_unstale":"2023-07-09T21:22:33.374907+0000","last_undegraded":"2023-07-09T21:22:33.374907+0000","last_fullsized":"2023-07-09T21:22:33.374907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:15.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223479+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:22:34.223479+0000","last_peered":"2023-07-09T21:22:34.223479+0000","last_clean":"2023-07-09T21:22:34.223479+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:22:34.223479+0000","last_undegraded":"2023-07-09T21:22:34.223479+0000","last_fullsized":"2023-07-09T21:22:34.223479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:26.027091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831034+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:22:32.831034+0000","last_peered":"2023-07-09T21:22:32.831034+0000","last_clean":"2023-07-09T21:22:32.831034+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:22:32.831034+0000","last_undegraded":"2023-07-09T21:22:32.831034+0000","last_fullsized":"2023-07-09T21:22:32.831034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:03.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475817+0000","last_change":"2023-07-09T21:22:30.843989+0000","last_active":"2023-07-09T21:22:34.475817+0000","last_peered":"2023-07-09T21:22:34.475817+0000","last_clean":"2023-07-09T21:22:34.475817+0000","last_became_active":"2023-07-09T21:22:30.843612+0000","last_became_peered":"2023-07-09T21:22:30.843612+0000","last_unstale":"2023-07-09T21:22:34.475817+0000","last_undegraded":"2023-07-09T21:22:34.475817+0000","last_fullsized":"2023-07-09T21:22:34.475817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:11.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830346+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:32.830346+0000","last_peered":"2023-07-09T21:22:32.830346+0000","last_clean":"2023-07-09T21:22:32.830346+0000","last_became_active":"2023-07-09T21:22:31.855516+0000","last_became_peered":"2023-07-09T21:22:31.855516+0000","last_unstale":"2023-07-09T21:22:32.830346+0000","last_undegraded":"2023-07-09T21:22:32.830346+0000","last_fullsized":"2023-07-09T21:22:32.830346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:55.695138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222704+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:22:34.222704+0000","last_peered":"2023-07-09T21:22:34.222704+0000","last_clean":"2023-07-09T21:22:34.222704+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:22:34.222704+0000","last_undegraded":"2023-07-09T21:22:34.222704+0000","last_fullsized":"2023-07-09T21:22:34.222704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:34.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158518+0000","last_change":"2023-07-09T21:22:30.857285+0000","last_active":"2023-07-09T21:22:33.158518+0000","last_peered":"2023-07-09T21:22:33.158518+0000","last_clean":"2023-07-09T21:22:33.158518+0000","last_became_active":"2023-07-09T21:22:30.856950+0000","last_became_peered":"2023-07-09T21:22:30.856950+0000","last_unstale":"2023-07-09T21:22:33.158518+0000","last_undegraded":"2023-07-09T21:22:33.158518+0000","last_fullsized":"2023-07-09T21:22:33.158518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:00.316799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158880+0000","last_change":"2023-07-09T21:22:31.858719+0000","last_active":"2023-07-09T21:22:33.158880+0000","last_peered":"2023-07-09T21:22:33.158880+0000","last_clean":"2023-07-09T21:22:33.158880+0000","last_became_active":"2023-07-09T21:22:31.858412+0000","last_became_peered":"2023-07-09T21:22:31.858412+0000","last_unstale":"2023-07-09T21:22:33.158880+0000","last_undegraded":"2023-07-09T21:22:33.158880+0000","last_fullsized":"2023-07-09T21:22:33.158880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242243+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:22:33.242243+0000","last_peered":"2023-07-09T21:22:33.242243+0000","last_clean":"2023-07-09T21:22:33.242243+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:22:33.242243+0000","last_undegraded":"2023-07-09T21:22:33.242243+0000","last_fullsized":"2023-07-09T21:22:33.242243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:40.035291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374698+0000","last_change":"2023-07-09T21:22:30.843863+0000","last_active":"2023-07-09T21:22:33.374698+0000","last_peered":"2023-07-09T21:22:33.374698+0000","last_clean":"2023-07-09T21:22:33.374698+0000","last_became_active":"2023-07-09T21:22:30.843523+0000","last_became_peered":"2023-07-09T21:22:30.843523+0000","last_unstale":"2023-07-09T21:22:33.374698+0000","last_undegraded":"2023-07-09T21:22:33.374698+0000","last_fullsized":"2023-07-09T21:22:33.374698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:27.561323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374907+0000","last_change":"2023-07-09T21:22:31.869166+0000","last_active":"2023-07-09T21:22:33.374907+0000","last_peered":"2023-07-09T21:22:33.374907+0000","last_clean":"2023-07-09T21:22:33.374907+0000","last_became_active":"2023-07-09T21:22:31.868832+0000","last_became_peered":"2023-07-09T21:22:31.868832+0000","last_unstale":"2023-07-09T21:22:33.374907+0000","last_undegraded":"2023-07-09T21:22:33.374907+0000","last_fullsized":"2023-07-09T21:22:33.374907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831237+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:22:32.831237+0000","last_peered":"2023-07-09T21:22:32.831237+0000","last_clean":"2023-07-09T21:22:32.831237+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:22:32.831237+0000","last_undegraded":"2023-07-09T21:22:32.831237+0000","last_fullsized":"2023-07-09T21:22:32.831237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:09.500561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832498+0000","last_change":"2023-07-09T21:22:30.855389+0000","last_active":"2023-07-09T21:22:32.832498+0000","last_peered":"2023-07-09T21:22:32.832498+0000","last_clean":"2023-07-09T21:22:32.832498+0000","last_became_active":"2023-07-09T21:22:30.855134+0000","last_became_peered":"2023-07-09T21:22:30.855134+0000","last_unstale":"2023-07-09T21:22:32.832498+0000","last_undegraded":"2023-07-09T21:22:32.832498+0000","last_fullsized":"2023-07-09T21:22:32.832498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374712+0000","last_change":"2023-07-09T21:22:31.852120+0000","last_active":"2023-07-09T21:22:33.374712+0000","last_peered":"2023-07-09T21:22:33.374712+0000","last_clean":"2023-07-09T21:22:33.374712+0000","last_became_active":"2023-07-09T21:22:31.851781+0000","last_became_peered":"2023-07-09T21:22:31.851781+0000","last_unstale":"2023-07-09T21:22:33.374712+0000","last_undegraded":"2023-07-09T21:22:33.374712+0000","last_fullsized":"2023-07-09T21:22:33.374712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831933+0000","last_change":"2023-07-09T21:22:30.851147+0000","last_active":"2023-07-09T21:22:32.831933+0000","last_peered":"2023-07-09T21:22:32.831933+0000","last_clean":"2023-07-09T21:22:32.831933+0000","last_became_active":"2023-07-09T21:22:30.850732+0000","last_became_peered":"2023-07-09T21:22:30.850732+0000","last_unstale":"2023-07-09T21:22:32.831933+0000","last_undegraded":"2023-07-09T21:22:32.831933+0000","last_fullsized":"2023-07-09T21:22:32.831933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375059+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:22:33.375059+0000","last_peered":"2023-07-09T21:22:33.375059+0000","last_clean":"2023-07-09T21:22:33.375059+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:22:33.375059+0000","last_undegraded":"2023-07-09T21:22:33.375059+0000","last_fullsized":"2023-07-09T21:22:33.375059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:04.788716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375040+0000","last_change":"2023-07-09T21:22:31.866350+0000","last_active":"2023-07-09T21:22:33.375040+0000","last_peered":"2023-07-09T21:22:33.375040+0000","last_clean":"2023-07-09T21:22:33.375040+0000","last_became_active":"2023-07-09T21:22:31.866065+0000","last_became_peered":"2023-07-09T21:22:31.866065+0000","last_unstale":"2023-07-09T21:22:33.375040+0000","last_undegraded":"2023-07-09T21:22:33.375040+0000","last_fullsized":"2023-07-09T21:22:33.375040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374740+0000","last_change":"2023-07-09T21:22:30.847415+0000","last_active":"2023-07-09T21:22:33.374740+0000","last_peered":"2023-07-09T21:22:33.374740+0000","last_clean":"2023-07-09T21:22:33.374740+0000","last_became_active":"2023-07-09T21:22:30.847083+0000","last_became_peered":"2023-07-09T21:22:30.847083+0000","last_unstale":"2023-07-09T21:22:33.374740+0000","last_undegraded":"2023-07-09T21:22:33.374740+0000","last_fullsized":"2023-07-09T21:22:33.374740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:01.551080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222667+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:22:34.222667+0000","last_peered":"2023-07-09T21:22:34.222667+0000","last_clean":"2023-07-09T21:22:34.222667+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:22:34.222667+0000","last_undegraded":"2023-07-09T21:22:34.222667+0000","last_fullsized":"2023-07-09T21:22:34.222667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:04.788716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158686+0000","last_change":"2023-07-09T21:22:31.869857+0000","last_active":"2023-07-09T21:22:33.158686+0000","last_peered":"2023-07-09T21:22:33.158686+0000","last_clean":"2023-07-09T21:22:33.158686+0000","last_became_active":"2023-07-09T21:22:31.869492+0000","last_became_peered":"2023-07-09T21:22:31.869492+0000","last_unstale":"2023-07-09T21:22:33.158686+0000","last_undegraded":"2023-07-09T21:22:33.158686+0000","last_fullsized":"2023-07-09T21:22:33.158686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476270+0000","last_change":"2023-07-09T21:22:30.837573+0000","last_active":"2023-07-09T21:22:34.476270+0000","last_peered":"2023-07-09T21:22:34.476270+0000","last_clean":"2023-07-09T21:22:34.476270+0000","last_became_active":"2023-07-09T21:22:30.837216+0000","last_became_peered":"2023-07-09T21:22:30.837216+0000","last_unstale":"2023-07-09T21:22:34.476270+0000","last_undegraded":"2023-07-09T21:22:34.476270+0000","last_fullsized":"2023-07-09T21:22:34.476270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:20.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374895+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:22:33.374895+0000","last_peered":"2023-07-09T21:22:33.374895+0000","last_clean":"2023-07-09T21:22:33.374895+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:22:33.374895+0000","last_undegraded":"2023-07-09T21:22:33.374895+0000","last_fullsized":"2023-07-09T21:22:33.374895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.029984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475750+0000","last_change":"2023-07-09T21:22:31.853429+0000","last_active":"2023-07-09T21:22:34.475750+0000","last_peered":"2023-07-09T21:22:34.475750+0000","last_clean":"2023-07-09T21:22:34.475750+0000","last_became_active":"2023-07-09T21:22:31.853117+0000","last_became_peered":"2023-07-09T21:22:31.853117+0000","last_unstale":"2023-07-09T21:22:34.475750+0000","last_undegraded":"2023-07-09T21:22:34.475750+0000","last_fullsized":"2023-07-09T21:22:34.475750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159009+0000","last_change":"2023-07-09T21:22:30.848294+0000","last_active":"2023-07-09T21:22:33.159009+0000","last_peered":"2023-07-09T21:22:33.159009+0000","last_clean":"2023-07-09T21:22:33.159009+0000","last_became_active":"2023-07-09T21:22:30.847977+0000","last_became_peered":"2023-07-09T21:22:30.847977+0000","last_unstale":"2023-07-09T21:22:33.159009+0000","last_undegraded":"2023-07-09T21:22:33.159009+0000","last_fullsized":"2023-07-09T21:22:33.159009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830462+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:22:32.830462+0000","last_peered":"2023-07-09T21:22:32.830462+0000","last_clean":"2023-07-09T21:22:32.830462+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:22:32.830462+0000","last_undegraded":"2023-07-09T21:22:32.830462+0000","last_fullsized":"2023-07-09T21:22:32.830462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.865948+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.865590+0000","last_became_peered":"2023-07-09T21:22:31.865590+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832513+0000","last_change":"2023-07-09T21:22:31.852986+0000","last_active":"2023-07-09T21:22:32.832513+0000","last_peered":"2023-07-09T21:22:32.832513+0000","last_clean":"2023-07-09T21:22:32.832513+0000","last_became_active":"2023-07-09T21:22:31.852672+0000","last_became_peered":"2023-07-09T21:22:31.852672+0000","last_unstale":"2023-07-09T21:22:32.832513+0000","last_undegraded":"2023-07-09T21:22:32.832513+0000","last_fullsized":"2023-07-09T21:22:32.832513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832985+0000","last_change":"2023-07-09T21:22:30.857328+0000","last_active":"2023-07-09T21:22:32.832985+0000","last_peered":"2023-07-09T21:22:32.832985+0000","last_clean":"2023-07-09T21:22:32.832985+0000","last_became_active":"2023-07-09T21:22:30.857074+0000","last_became_peered":"2023-07-09T21:22:30.857074+0000","last_unstale":"2023-07-09T21:22:32.832985+0000","last_undegraded":"2023-07-09T21:22:32.832985+0000","last_fullsized":"2023-07-09T21:22:32.832985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:35.836977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374900+0000","last_change":"2023-07-09T21:22:31.849713+0000","last_active":"2023-07-09T21:22:33.374900+0000","last_peered":"2023-07-09T21:22:33.374900+0000","last_clean":"2023-07-09T21:22:33.374900+0000","last_became_active":"2023-07-09T21:22:31.849438+0000","last_became_peered":"2023-07-09T21:22:31.849438+0000","last_unstale":"2023-07-09T21:22:33.374900+0000","last_undegraded":"2023-07-09T21:22:33.374900+0000","last_fullsized":"2023-07-09T21:22:33.374900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:09.592064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223452+0000","last_change":"2023-07-09T21:22:30.850957+0000","last_active":"2023-07-09T21:22:34.223452+0000","last_peered":"2023-07-09T21:22:34.223452+0000","last_clean":"2023-07-09T21:22:34.223452+0000","last_became_active":"2023-07-09T21:22:30.850675+0000","last_became_peered":"2023-07-09T21:22:30.850675+0000","last_unstale":"2023-07-09T21:22:34.223452+0000","last_undegraded":"2023-07-09T21:22:34.223452+0000","last_fullsized":"2023-07-09T21:22:34.223452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:03.757733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832318+0000","last_change":"2023-07-09T21:22:30.843875+0000","last_active":"2023-07-09T21:22:32.832318+0000","last_peered":"2023-07-09T21:22:32.832318+0000","last_clean":"2023-07-09T21:22:32.832318+0000","last_became_active":"2023-07-09T21:22:30.843484+0000","last_became_peered":"2023-07-09T21:22:30.843484+0000","last_unstale":"2023-07-09T21:22:32.832318+0000","last_undegraded":"2023-07-09T21:22:32.832318+0000","last_fullsized":"2023-07-09T21:22:32.832318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475827+0000","last_change":"2023-07-09T21:22:31.853270+0000","last_active":"2023-07-09T21:22:34.475827+0000","last_peered":"2023-07-09T21:22:34.475827+0000","last_clean":"2023-07-09T21:22:34.475827+0000","last_became_active":"2023-07-09T21:22:31.852994+0000","last_became_peered":"2023-07-09T21:22:31.852994+0000","last_unstale":"2023-07-09T21:22:34.475827+0000","last_undegraded":"2023-07-09T21:22:34.475827+0000","last_fullsized":"2023-07-09T21:22:34.475827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159089+0000","last_change":"2023-07-09T21:22:30.845979+0000","last_active":"2023-07-09T21:22:33.159089+0000","last_peered":"2023-07-09T21:22:33.159089+0000","last_clean":"2023-07-09T21:22:33.159089+0000","last_became_active":"2023-07-09T21:22:30.844569+0000","last_became_peered":"2023-07-09T21:22:30.844569+0000","last_unstale":"2023-07-09T21:22:33.159089+0000","last_undegraded":"2023-07-09T21:22:33.159089+0000","last_fullsized":"2023-07-09T21:22:33.159089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:09.820019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475665+0000","last_change":"2023-07-09T21:22:31.850051+0000","last_active":"2023-07-09T21:22:34.475665+0000","last_peered":"2023-07-09T21:22:34.475665+0000","last_clean":"2023-07-09T21:22:34.475665+0000","last_became_active":"2023-07-09T21:22:31.849776+0000","last_became_peered":"2023-07-09T21:22:31.849776+0000","last_unstale":"2023-07-09T21:22:34.475665+0000","last_undegraded":"2023-07-09T21:22:34.475665+0000","last_fullsized":"2023-07-09T21:22:34.475665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830414+0000","last_change":"2023-07-09T21:22:31.870733+0000","last_active":"2023-07-09T21:22:32.830414+0000","last_peered":"2023-07-09T21:22:32.830414+0000","last_clean":"2023-07-09T21:22:32.830414+0000","last_became_active":"2023-07-09T21:22:31.870386+0000","last_became_peered":"2023-07-09T21:22:31.870386+0000","last_unstale":"2023-07-09T21:22:32.830414+0000","last_undegraded":"2023-07-09T21:22:32.830414+0000","last_fullsized":"2023-07-09T21:22:32.830414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475894+0000","last_change":"2023-07-09T21:22:30.843731+0000","last_active":"2023-07-09T21:22:34.475894+0000","last_peered":"2023-07-09T21:22:34.475894+0000","last_clean":"2023-07-09T21:22:34.475894+0000","last_became_active":"2023-07-09T21:22:30.839924+0000","last_became_peered":"2023-07-09T21:22:30.839924+0000","last_unstale":"2023-07-09T21:22:34.475894+0000","last_undegraded":"2023-07-09T21:22:34.475894+0000","last_fullsized":"2023-07-09T21:22:34.475894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158814+0000","last_change":"2023-07-09T21:22:31.853288+0000","last_active":"2023-07-09T21:22:33.158814+0000","last_peered":"2023-07-09T21:22:33.158814+0000","last_clean":"2023-07-09T21:22:33.158814+0000","last_became_active":"2023-07-09T21:22:31.852965+0000","last_became_peered":"2023-07-09T21:22:31.852965+0000","last_unstale":"2023-07-09T21:22:33.158814+0000","last_undegraded":"2023-07-09T21:22:33.158814+0000","last_fullsized":"2023-07-09T21:22:33.158814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374795+0000","last_change":"2023-07-09T21:22:30.849317+0000","last_active":"2023-07-09T21:22:33.374795+0000","last_peered":"2023-07-09T21:22:33.374795+0000","last_clean":"2023-07-09T21:22:33.374795+0000","last_became_active":"2023-07-09T21:22:30.849028+0000","last_became_peered":"2023-07-09T21:22:30.849028+0000","last_unstale":"2023-07-09T21:22:33.374795+0000","last_undegraded":"2023-07-09T21:22:33.374795+0000","last_fullsized":"2023-07-09T21:22:33.374795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:56.259324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476054+0000","last_change":"2023-07-09T21:22:31.853961+0000","last_active":"2023-07-09T21:22:34.476054+0000","last_peered":"2023-07-09T21:22:34.476054+0000","last_clean":"2023-07-09T21:22:34.476054+0000","last_became_active":"2023-07-09T21:22:31.853341+0000","last_became_peered":"2023-07-09T21:22:31.853341+0000","last_unstale":"2023-07-09T21:22:34.476054+0000","last_undegraded":"2023-07-09T21:22:34.476054+0000","last_fullsized":"2023-07-09T21:22:34.476054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831983+0000","last_change":"2023-07-09T21:22:30.856671+0000","last_active":"2023-07-09T21:22:32.831983+0000","last_peered":"2023-07-09T21:22:32.831983+0000","last_clean":"2023-07-09T21:22:32.831983+0000","last_became_active":"2023-07-09T21:22:30.856408+0000","last_became_peered":"2023-07-09T21:22:30.856408+0000","last_unstale":"2023-07-09T21:22:32.831983+0000","last_undegraded":"2023-07-09T21:22:32.831983+0000","last_fullsized":"2023-07-09T21:22:32.831983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242345+0000","last_change":"2023-07-09T21:22:31.856724+0000","last_active":"2023-07-09T21:22:33.242345+0000","last_peered":"2023-07-09T21:22:33.242345+0000","last_clean":"2023-07-09T21:22:33.242345+0000","last_became_active":"2023-07-09T21:22:31.855887+0000","last_became_peered":"2023-07-09T21:22:31.855887+0000","last_unstale":"2023-07-09T21:22:33.242345+0000","last_undegraded":"2023-07-09T21:22:33.242345+0000","last_fullsized":"2023-07-09T21:22:33.242345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158837+0000","last_change":"2023-07-09T21:22:30.856613+0000","last_active":"2023-07-09T21:22:33.158837+0000","last_peered":"2023-07-09T21:22:33.158837+0000","last_clean":"2023-07-09T21:22:33.158837+0000","last_became_active":"2023-07-09T21:22:30.856381+0000","last_became_peered":"2023-07-09T21:22:30.856381+0000","last_unstale":"2023-07-09T21:22:33.158837+0000","last_undegraded":"2023-07-09T21:22:33.158837+0000","last_fullsized":"2023-07-09T21:22:33.158837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:11.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831645+0000","last_change":"2023-07-09T21:22:31.853264+0000","last_active":"2023-07-09T21:22:32.831645+0000","last_peered":"2023-07-09T21:22:32.831645+0000","last_clean":"2023-07-09T21:22:32.831645+0000","last_became_active":"2023-07-09T21:22:31.852950+0000","last_became_peered":"2023-07-09T21:22:31.852950+0000","last_unstale":"2023-07-09T21:22:32.831645+0000","last_undegraded":"2023-07-09T21:22:32.831645+0000","last_fullsized":"2023-07-09T21:22:32.831645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831443+0000","last_change":"2023-07-09T21:22:30.858476+0000","last_active":"2023-07-09T21:22:32.831443+0000","last_peered":"2023-07-09T21:22:32.831443+0000","last_clean":"2023-07-09T21:22:32.831443+0000","last_became_active":"2023-07-09T21:22:30.858135+0000","last_became_peered":"2023-07-09T21:22:30.858135+0000","last_unstale":"2023-07-09T21:22:32.831443+0000","last_undegraded":"2023-07-09T21:22:32.831443+0000","last_fullsized":"2023-07-09T21:22:32.831443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831673+0000","last_change":"2023-07-09T21:22:31.847803+0000","last_active":"2023-07-09T21:22:32.831673+0000","last_peered":"2023-07-09T21:22:32.831673+0000","last_clean":"2023-07-09T21:22:32.831673+0000","last_became_active":"2023-07-09T21:22:31.847509+0000","last_became_peered":"2023-07-09T21:22:31.847509+0000","last_unstale":"2023-07-09T21:22:32.831673+0000","last_undegraded":"2023-07-09T21:22:32.831673+0000","last_fullsized":"2023-07-09T21:22:32.831673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831760+0000","last_change":"2023-07-09T21:22:30.858399+0000","last_active":"2023-07-09T21:22:32.831760+0000","last_peered":"2023-07-09T21:22:32.831760+0000","last_clean":"2023-07-09T21:22:32.831760+0000","last_became_active":"2023-07-09T21:22:30.858113+0000","last_became_peered":"2023-07-09T21:22:30.858113+0000","last_unstale":"2023-07-09T21:22:32.831760+0000","last_undegraded":"2023-07-09T21:22:32.831760+0000","last_fullsized":"2023-07-09T21:22:32.831760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:18.521756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475940+0000","last_change":"2023-07-09T21:22:31.850287+0000","last_active":"2023-07-09T21:22:34.475940+0000","last_peered":"2023-07-09T21:22:34.475940+0000","last_clean":"2023-07-09T21:22:34.475940+0000","last_became_active":"2023-07-09T21:22:31.849962+0000","last_became_peered":"2023-07-09T21:22:31.849962+0000","last_unstale":"2023-07-09T21:22:34.475940+0000","last_undegraded":"2023-07-09T21:22:34.475940+0000","last_fullsized":"2023-07-09T21:22:34.475940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476090+0000","last_change":"2023-07-09T21:22:30.834480+0000","last_active":"2023-07-09T21:22:34.476090+0000","last_peered":"2023-07-09T21:22:34.476090+0000","last_clean":"2023-07-09T21:22:34.476090+0000","last_became_active":"2023-07-09T21:22:30.834184+0000","last_became_peered":"2023-07-09T21:22:30.834184+0000","last_unstale":"2023-07-09T21:22:34.476090+0000","last_undegraded":"2023-07-09T21:22:34.476090+0000","last_fullsized":"2023-07-09T21:22:34.476090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:09.820019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.851493+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.851203+0000","last_became_peered":"2023-07-09T21:22:31.851203+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159022+0000","last_change":"2023-07-09T21:22:30.846855+0000","last_active":"2023-07-09T21:22:33.159022+0000","last_peered":"2023-07-09T21:22:33.159022+0000","last_clean":"2023-07-09T21:22:33.159022+0000","last_became_active":"2023-07-09T21:22:30.846556+0000","last_became_peered":"2023-07-09T21:22:30.846556+0000","last_unstale":"2023-07-09T21:22:33.159022+0000","last_undegraded":"2023-07-09T21:22:33.159022+0000","last_fullsized":"2023-07-09T21:22:33.159022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:22:40.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:22:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 Processor -- start 2023-07-09T21:22:40.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 -- start start 2023-07-09T21:22:40.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 0x7f09641600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096406acb0 con 0x7f09640cf260 2023-07-09T21:22:40.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09641605f0 con 0x7f09640cc800 2023-07-09T21:22:40.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096bc18640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09640ccc90 con 0x7f096415ba60 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096a1b5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09640cf260 0x7f09640d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57162/0 (socket says 172.21.15.37:57162) 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f096a1b5640 1 -- 172.21.15.37:0/2047587 learned_addr learned my addr 172.21.15.37:0/2047587 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09699b4640 1 --2- 172.21.15.37:0/2047587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 0x7f09641600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487142402 0 0) 0x7f096406acb0 con 0x7f09640cf260 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0950003530 con 0x7f09640cf260 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074443678 0 0) 0x7f09641605f0 con 0x7f09640cc800 2023-07-09T21:22:40.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f096406acb0 con 0x7f09640cc800 2023-07-09T21:22:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09699b4640 1 -- 172.21.15.37:0/2047587 >> v1:172.21.15.119:6789/0 conn(0x7f09640cc800 legacy=0x7f09640ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09699b4640 1 -- 172.21.15.37:0/2047587 >> v1:172.21.15.37:6789/0 conn(0x7f09640cf260 legacy=0x7f09640d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.846+0000 7f09699b4640 1 -- 172.21.15.37:0/2047587 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09640cfe20 con 0x7f096415ba60 2023-07-09T21:22:40.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f09699b4640 1 --2- 172.21.15.37:0/2047587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 0x7f09641600b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f09600097f0 tx=0x7f096001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e4810ab015eafeb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600aa5f0 con 0x7f096415ba60 2023-07-09T21:22:40.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09600aa750 con 0x7f096415ba60 2023-07-09T21:22:40.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f09689b2640 1 -- 172.21.15.37:0/2047587 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09600aaae0 con 0x7f096415ba60 2023-07-09T21:22:40.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 -- 172.21.15.37:0/2047587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 msgr2=0x7f09641600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 --2- 172.21.15.37:0/2047587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 0x7f09641600b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f09600097f0 tx=0x7f096001c490 comp rx=0 tx=0).stop 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 -- 172.21.15.37:0/2047587 shutdown_connections 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 --2- 172.21.15.37:0/2047587 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f096415ba60 0x7f09641600b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 -- 172.21.15.37:0/2047587 >> 172.21.15.37:0/2047587 conn(0x7f0964073090 msgr2=0x7f0964069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 -- 172.21.15.37:0/2047587 shutdown_connections 2023-07-09T21:22:40.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.850+0000 7f096bc18640 1 -- 172.21.15.37:0/2047587 wait complete. 2023-07-09T21:22:40.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 Processor -- start 2023-07-09T21:22:40.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- start start 2023-07-09T21:22:40.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09640cc800 0x7f09640b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 0x7f096414d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09640b7640 con 0x7f09640cf260 2023-07-09T21:22:40.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0964148660 con 0x7f096415ba60 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09641475c0 con 0x7f09640cc800 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34498/0 (socket says 172.21.15.37:34498) 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 -- 172.21.15.37:0/2022239609 learned_addr learned my addr 172.21.15.37:0/2022239609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 -- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09640cc800 msgr2=0x7f09640b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09640cc800 0x7f09640b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 -- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 msgr2=0x7f096414d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096a1b5640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 0x7f096414d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 0x7f096414d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 -- 172.21.15.37:0/2022239609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009420 con 0x7f09640cf260 2023-07-09T21:22:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096a1b5640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 0x7f096414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:40.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f09691b3640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f095400c430 tx=0x7f095400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09540052d0 con 0x7f09640cf260 2023-07-09T21:22:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0954005450 con 0x7f09640cf260 2023-07-09T21:22:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0954003840 con 0x7f09640cf260 2023-07-09T21:22:40.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09641478a0 con 0x7f09640cf260 2023-07-09T21:22:40.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.854+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0964147e60 con 0x7f09640cf260 2023-07-09T21:22:40.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09640668f0 con 0x7f09640cf260 2023-07-09T21:22:40.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f09540039a0 con 0x7f09640cf260 2023-07-09T21:22:40.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f095a7fc640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 0x7f0948068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:40.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0954083400 con 0x7f09640cf260 2023-07-09T21:22:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f09699b4640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 0x7f0948068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:40.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.858+0000 7f09699b4640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 0x7f0948068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09600ae000 tx=0x7f0960008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:40.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:40.862+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09540507e0 con 0x7f09640cf260 2023-07-09T21:22:41.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.014+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09640ccf70 con 0x7f0948066280 2023-07-09T21:22:41.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f095a7fc640 1 -- 172.21.15.37:0/2022239609 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286619 (secure 0 0 0) 0x7f09600aa5b0 con 0x7f0948066280 2023-07-09T21:22:41.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:41.029 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:22:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 msgr2=0x7f0948068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 0x7f0948068730 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f09600ae000 tx=0x7f0960008040 comp rx=0 tx=0).stop 2023-07-09T21:22:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 msgr2=0x7f09640b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f095400c430 tx=0x7f095400c8f0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 shutdown_connections 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0948066280 0x7f0948068730 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f096415ba60 0x7f096414d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09640cf260 0x7f09640b7100 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 --2- 172.21.15.37:0/2022239609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09640cc800 0x7f09640b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 >> 172.21.15.37:0/2022239609 conn(0x7f0964073090 msgr2=0x7f09640c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 shutdown_connections 2023-07-09T21:22:41.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.022+0000 7f096bc18640 1 -- 172.21.15.37:0/2022239609 wait complete. 2023-07-09T21:22:41.048 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:22:39.955699+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222824,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751896,"statfs":{"total":773094113280,"available":772865941504,"internally_reserved":0,"allocated":3186688,"data_stored":1902252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.129536"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242306+0000","last_change":"2023-07-09T21:22:31.846882+0000","last_active":"2023-07-09T21:22:33.242306+0000","last_peered":"2023-07-09T21:22:33.242306+0000","last_clean":"2023-07-09T21:22:33.242306+0000","last_became_active":"2023-07-09T21:22:31.846526+0000","last_became_peered":"2023-07-09T21:22:31.846526+0000","last_unstale":"2023-07-09T21:22:33.242306+0000","last_undegraded":"2023-07-09T21:22:33.242306+0000","last_fullsized":"2023-07-09T21:22:33.242306+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:29:29.920119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831655+0000","last_change":"2023-07-09T21:22:31.865763+0000","last_active":"2023-07-09T21:22:32.831655+0000","last_peered":"2023-07-09T21:22:32.831655+0000","last_clean":"2023-07-09T21:22:32.831655+0000","last_became_active":"2023-07-09T21:22:31.865352+0000","last_became_peered":"2023-07-09T21:22:31.865352+0000","last_unstale":"2023-07-09T21:22:32.831655+0000","last_undegraded":"2023-07-09T21:22:32.831655+0000","last_fullsized":"2023-07-09T21:22:32.831655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832722+0000","last_change":"2023-07-09T21:22:31.852655+0000","last_active":"2023-07-09T21:22:32.832722+0000","last_peered":"2023-07-09T21:22:32.832722+0000","last_clean":"2023-07-09T21:22:32.832722+0000","last_became_active":"2023-07-09T21:22:31.852014+0000","last_became_peered":"2023-07-09T21:22:31.852014+0000","last_unstale":"2023-07-09T21:22:32.832722+0000","last_undegraded":"2023-07-09T21:22:32.832722+0000","last_fullsized":"2023-07-09T21:22:32.832722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830239+0000","last_change":"2023-07-09T21:22:31.851591+0000","last_active":"2023-07-09T21:22:32.830239+0000","last_peered":"2023-07-09T21:22:32.830239+0000","last_clean":"2023-07-09T21:22:32.830239+0000","last_became_active":"2023-07-09T21:22:31.851326+0000","last_became_peered":"2023-07-09T21:22:31.851326+0000","last_unstale":"2023-07-09T21:22:32.830239+0000","last_undegraded":"2023-07-09T21:22:32.830239+0000","last_fullsized":"2023-07-09T21:22:32.830239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:43.557059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158817+0000","last_change":"2023-07-09T21:22:31.845576+0000","last_active":"2023-07-09T21:22:33.158817+0000","last_peered":"2023-07-09T21:22:33.158817+0000","last_clean":"2023-07-09T21:22:33.158817+0000","last_became_active":"2023-07-09T21:22:31.844904+0000","last_became_peered":"2023-07-09T21:22:31.844904+0000","last_unstale":"2023-07-09T21:22:33.158817+0000","last_undegraded":"2023-07-09T21:22:33.158817+0000","last_fullsized":"2023-07-09T21:22:33.158817+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831539+0000","last_change":"2023-07-09T21:22:31.853123+0000","last_active":"2023-07-09T21:22:32.831539+0000","last_peered":"2023-07-09T21:22:32.831539+0000","last_clean":"2023-07-09T21:22:32.831539+0000","last_became_active":"2023-07-09T21:22:31.852855+0000","last_became_peered":"2023-07-09T21:22:31.852855+0000","last_unstale":"2023-07-09T21:22:32.831539+0000","last_undegraded":"2023-07-09T21:22:32.831539+0000","last_fullsized":"2023-07-09T21:22:32.831539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222888+0000","last_change":"2023-07-09T21:22:31.859422+0000","last_active":"2023-07-09T21:22:34.222888+0000","last_peered":"2023-07-09T21:22:34.222888+0000","last_clean":"2023-07-09T21:22:34.222888+0000","last_became_active":"2023-07-09T21:22:31.859125+0000","last_became_peered":"2023-07-09T21:22:31.859125+0000","last_unstale":"2023-07-09T21:22:34.222888+0000","last_undegraded":"2023-07-09T21:22:34.222888+0000","last_fullsized":"2023-07-09T21:22:34.222888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830707+0000","last_change":"2023-07-09T21:22:31.859849+0000","last_active":"2023-07-09T21:22:32.830707+0000","last_peered":"2023-07-09T21:22:32.830707+0000","last_clean":"2023-07-09T21:22:32.830707+0000","last_became_active":"2023-07-09T21:22:31.859115+0000","last_became_peered":"2023-07-09T21:22:31.859115+0000","last_unstale":"2023-07-09T21:22:32.830707+0000","last_undegraded":"2023-07-09T21:22:32.830707+0000","last_fullsized":"2023-07-09T21:22:32.830707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158936+0000","last_change":"2023-07-09T21:22:31.847329+0000","last_active":"2023-07-09T21:22:33.158936+0000","last_peered":"2023-07-09T21:22:33.158936+0000","last_clean":"2023-07-09T21:22:33.158936+0000","last_became_active":"2023-07-09T21:22:31.847067+0000","last_became_peered":"2023-07-09T21:22:31.847067+0000","last_unstale":"2023-07-09T21:22:33.158936+0000","last_undegraded":"2023-07-09T21:22:33.158936+0000","last_fullsized":"2023-07-09T21:22:33.158936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:09.592064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831808+0000","last_change":"2023-07-09T21:22:31.865305+0000","last_active":"2023-07-09T21:22:32.831808+0000","last_peered":"2023-07-09T21:22:32.831808+0000","last_clean":"2023-07-09T21:22:32.831808+0000","last_became_active":"2023-07-09T21:22:31.864992+0000","last_became_peered":"2023-07-09T21:22:31.864992+0000","last_unstale":"2023-07-09T21:22:32.831808+0000","last_undegraded":"2023-07-09T21:22:32.831808+0000","last_fullsized":"2023-07-09T21:22:32.831808+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832758+0000","last_change":"2023-07-09T21:22:31.855739+0000","last_active":"2023-07-09T21:22:32.832758+0000","last_peered":"2023-07-09T21:22:32.832758+0000","last_clean":"2023-07-09T21:22:32.832758+0000","last_became_active":"2023-07-09T21:22:31.854569+0000","last_became_peered":"2023-07-09T21:22:31.854569+0000","last_unstale":"2023-07-09T21:22:32.832758+0000","last_undegraded":"2023-07-09T21:22:32.832758+0000","last_fullsized":"2023-07-09T21:22:32.832758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242393+0000","last_change":"2023-07-09T21:22:31.856905+0000","last_active":"2023-07-09T21:22:33.242393+0000","last_peered":"2023-07-09T21:22:33.242393+0000","last_clean":"2023-07-09T21:22:33.242393+0000","last_became_active":"2023-07-09T21:22:31.856417+0000","last_became_peered":"2023-07-09T21:22:31.856417+0000","last_unstale":"2023-07-09T21:22:33.242393+0000","last_undegraded":"2023-07-09T21:22:33.242393+0000","last_fullsized":"2023-07-09T21:22:33.242393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:41.397827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242279+0000","last_change":"2023-07-09T21:22:31.845104+0000","last_active":"2023-07-09T21:22:33.242279+0000","last_peered":"2023-07-09T21:22:33.242279+0000","last_clean":"2023-07-09T21:22:33.242279+0000","last_became_active":"2023-07-09T21:22:31.844818+0000","last_became_peered":"2023-07-09T21:22:31.844818+0000","last_unstale":"2023-07-09T21:22:33.242279+0000","last_undegraded":"2023-07-09T21:22:33.242279+0000","last_fullsized":"2023-07-09T21:22:33.242279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:10.052851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831167+0000","last_change":"2023-07-09T21:22:31.866886+0000","last_active":"2023-07-09T21:22:32.831167+0000","last_peered":"2023-07-09T21:22:32.831167+0000","last_clean":"2023-07-09T21:22:32.831167+0000","last_became_active":"2023-07-09T21:22:31.866546+0000","last_became_peered":"2023-07-09T21:22:31.866546+0000","last_unstale":"2023-07-09T21:22:32.831167+0000","last_undegraded":"2023-07-09T21:22:32.831167+0000","last_fullsized":"2023-07-09T21:22:32.831167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223021+0000","last_change":"2023-07-09T21:22:31.858913+0000","last_active":"2023-07-09T21:22:34.223021+0000","last_peered":"2023-07-09T21:22:34.223021+0000","last_clean":"2023-07-09T21:22:34.223021+0000","last_became_active":"2023-07-09T21:22:31.858642+0000","last_became_peered":"2023-07-09T21:22:31.858642+0000","last_unstale":"2023-07-09T21:22:34.223021+0000","last_undegraded":"2023-07-09T21:22:34.223021+0000","last_fullsized":"2023-07-09T21:22:34.223021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:21.581993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.847866+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.847543+0000","last_became_peered":"2023-07-09T21:22:31.847543+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158975+0000","last_change":"2023-07-09T21:22:31.846826+0000","last_active":"2023-07-09T21:22:33.158975+0000","last_peered":"2023-07-09T21:22:33.158975+0000","last_clean":"2023-07-09T21:22:33.158975+0000","last_became_active":"2023-07-09T21:22:31.846429+0000","last_became_peered":"2023-07-09T21:22:31.846429+0000","last_unstale":"2023-07-09T21:22:33.158975+0000","last_undegraded":"2023-07-09T21:22:33.158975+0000","last_fullsized":"2023-07-09T21:22:33.158975+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832648+0000","last_change":"2023-07-09T21:22:31.852252+0000","last_active":"2023-07-09T21:22:32.832648+0000","last_peered":"2023-07-09T21:22:32.832648+0000","last_clean":"2023-07-09T21:22:32.832648+0000","last_became_active":"2023-07-09T21:22:31.851797+0000","last_became_peered":"2023-07-09T21:22:31.851797+0000","last_unstale":"2023-07-09T21:22:32.832648+0000","last_undegraded":"2023-07-09T21:22:32.832648+0000","last_fullsized":"2023-07-09T21:22:32.832648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242388+0000","last_change":"2023-07-09T21:22:31.848525+0000","last_active":"2023-07-09T21:22:33.242388+0000","last_peered":"2023-07-09T21:22:33.242388+0000","last_clean":"2023-07-09T21:22:33.242388+0000","last_became_active":"2023-07-09T21:22:31.847570+0000","last_became_peered":"2023-07-09T21:22:31.847570+0000","last_unstale":"2023-07-09T21:22:33.242388+0000","last_undegraded":"2023-07-09T21:22:33.242388+0000","last_fullsized":"2023-07-09T21:22:33.242388+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832660+0000","last_change":"2023-07-09T21:22:31.855749+0000","last_active":"2023-07-09T21:22:32.832660+0000","last_peered":"2023-07-09T21:22:32.832660+0000","last_clean":"2023-07-09T21:22:32.832660+0000","last_became_active":"2023-07-09T21:22:31.855457+0000","last_became_peered":"2023-07-09T21:22:31.855457+0000","last_unstale":"2023-07-09T21:22:32.832660+0000","last_undegraded":"2023-07-09T21:22:32.832660+0000","last_fullsized":"2023-07-09T21:22:32.832660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223176+0000","last_change":"2023-07-09T21:22:31.862987+0000","last_active":"2023-07-09T21:22:34.223176+0000","last_peered":"2023-07-09T21:22:34.223176+0000","last_clean":"2023-07-09T21:22:34.223176+0000","last_became_active":"2023-07-09T21:22:31.862706+0000","last_became_peered":"2023-07-09T21:22:31.862706+0000","last_unstale":"2023-07-09T21:22:34.223176+0000","last_undegraded":"2023-07-09T21:22:34.223176+0000","last_fullsized":"2023-07-09T21:22:34.223176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:36.843596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158583+0000","last_change":"2023-07-09T21:22:31.856986+0000","last_active":"2023-07-09T21:22:33.158583+0000","last_peered":"2023-07-09T21:22:33.158583+0000","last_clean":"2023-07-09T21:22:33.158583+0000","last_became_active":"2023-07-09T21:22:31.856738+0000","last_became_peered":"2023-07-09T21:22:31.856738+0000","last_unstale":"2023-07-09T21:22:33.158583+0000","last_undegraded":"2023-07-09T21:22:33.158583+0000","last_fullsized":"2023-07-09T21:22:33.158583+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475659+0000","last_change":"2023-07-09T21:22:31.848593+0000","last_active":"2023-07-09T21:22:34.475659+0000","last_peered":"2023-07-09T21:22:34.475659+0000","last_clean":"2023-07-09T21:22:34.475659+0000","last_became_active":"2023-07-09T21:22:31.848310+0000","last_became_peered":"2023-07-09T21:22:31.848310+0000","last_unstale":"2023-07-09T21:22:34.475659+0000","last_undegraded":"2023-07-09T21:22:34.475659+0000","last_fullsized":"2023-07-09T21:22:34.475659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223082+0000","last_change":"2023-07-09T21:22:31.862953+0000","last_active":"2023-07-09T21:22:34.223082+0000","last_peered":"2023-07-09T21:22:34.223082+0000","last_clean":"2023-07-09T21:22:34.223082+0000","last_became_active":"2023-07-09T21:22:31.862334+0000","last_became_peered":"2023-07-09T21:22:31.862334+0000","last_unstale":"2023-07-09T21:22:34.223082+0000","last_undegraded":"2023-07-09T21:22:34.223082+0000","last_fullsized":"2023-07-09T21:22:34.223082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374698+0000","last_change":"2023-07-09T21:22:31.854043+0000","last_active":"2023-07-09T21:22:33.374698+0000","last_peered":"2023-07-09T21:22:33.374698+0000","last_clean":"2023-07-09T21:22:33.374698+0000","last_became_active":"2023-07-09T21:22:31.853765+0000","last_became_peered":"2023-07-09T21:22:31.853765+0000","last_unstale":"2023-07-09T21:22:33.374698+0000","last_undegraded":"2023-07-09T21:22:33.374698+0000","last_fullsized":"2023-07-09T21:22:33.374698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374889+0000","last_change":"2023-07-09T21:22:31.843774+0000","last_active":"2023-07-09T21:22:33.374889+0000","last_peered":"2023-07-09T21:22:33.374889+0000","last_clean":"2023-07-09T21:22:33.374889+0000","last_became_active":"2023-07-09T21:22:31.843507+0000","last_became_peered":"2023-07-09T21:22:31.843507+0000","last_unstale":"2023-07-09T21:22:33.374889+0000","last_undegraded":"2023-07-09T21:22:33.374889+0000","last_fullsized":"2023-07-09T21:22:33.374889+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831070+0000","last_change":"2023-07-09T21:22:31.865931+0000","last_active":"2023-07-09T21:22:32.831070+0000","last_peered":"2023-07-09T21:22:32.831070+0000","last_clean":"2023-07-09T21:22:32.831070+0000","last_became_active":"2023-07-09T21:22:31.865659+0000","last_became_peered":"2023-07-09T21:22:31.865659+0000","last_unstale":"2023-07-09T21:22:32.831070+0000","last_undegraded":"2023-07-09T21:22:32.831070+0000","last_fullsized":"2023-07-09T21:22:32.831070+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375072+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:33.375072+0000","last_peered":"2023-07-09T21:22:33.375072+0000","last_clean":"2023-07-09T21:22:33.375072+0000","last_became_active":"2023-07-09T21:22:31.856284+0000","last_became_peered":"2023-07-09T21:22:31.856284+0000","last_unstale":"2023-07-09T21:22:33.375072+0000","last_undegraded":"2023-07-09T21:22:33.375072+0000","last_fullsized":"2023-07-09T21:22:33.375072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476240+0000","last_change":"2023-07-09T21:22:31.854071+0000","last_active":"2023-07-09T21:22:34.476240+0000","last_peered":"2023-07-09T21:22:34.476240+0000","last_clean":"2023-07-09T21:22:34.476240+0000","last_became_active":"2023-07-09T21:22:31.853768+0000","last_became_peered":"2023-07-09T21:22:31.853768+0000","last_unstale":"2023-07-09T21:22:34.476240+0000","last_undegraded":"2023-07-09T21:22:34.476240+0000","last_fullsized":"2023-07-09T21:22:34.476240+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:40.321020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831876+0000","last_change":"2023-07-09T21:22:31.847820+0000","last_active":"2023-07-09T21:22:32.831876+0000","last_peered":"2023-07-09T21:22:32.831876+0000","last_clean":"2023-07-09T21:22:32.831876+0000","last_became_active":"2023-07-09T21:22:31.847484+0000","last_became_peered":"2023-07-09T21:22:31.847484+0000","last_unstale":"2023-07-09T21:22:32.831876+0000","last_undegraded":"2023-07-09T21:22:32.831876+0000","last_fullsized":"2023-07-09T21:22:32.831876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475764+0000","last_change":"2023-07-09T21:22:31.855297+0000","last_active":"2023-07-09T21:22:34.475764+0000","last_peered":"2023-07-09T21:22:34.475764+0000","last_clean":"2023-07-09T21:22:34.475764+0000","last_became_active":"2023-07-09T21:22:31.855025+0000","last_became_peered":"2023-07-09T21:22:31.855025+0000","last_unstale":"2023-07-09T21:22:34.475764+0000","last_undegraded":"2023-07-09T21:22:34.475764+0000","last_fullsized":"2023-07-09T21:22:34.475764+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829783+0000","last_change":"2023-07-09T21:22:31.847753+0000","last_active":"2023-07-09T21:22:32.829783+0000","last_peered":"2023-07-09T21:22:32.829783+0000","last_clean":"2023-07-09T21:22:32.829783+0000","last_became_active":"2023-07-09T21:22:31.847425+0000","last_became_peered":"2023-07-09T21:22:31.847425+0000","last_unstale":"2023-07-09T21:22:32.829783+0000","last_undegraded":"2023-07-09T21:22:32.829783+0000","last_fullsized":"2023-07-09T21:22:32.829783+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475982+0000","last_change":"2023-07-09T21:22:31.853654+0000","last_active":"2023-07-09T21:22:34.475982+0000","last_peered":"2023-07-09T21:22:34.475982+0000","last_clean":"2023-07-09T21:22:34.475982+0000","last_became_active":"2023-07-09T21:22:31.853302+0000","last_became_peered":"2023-07-09T21:22:31.853302+0000","last_unstale":"2023-07-09T21:22:34.475982+0000","last_undegraded":"2023-07-09T21:22:34.475982+0000","last_fullsized":"2023-07-09T21:22:34.475982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:15.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223313+0000","last_change":"2023-07-09T21:22:30.856062+0000","last_active":"2023-07-09T21:22:34.223313+0000","last_peered":"2023-07-09T21:22:34.223313+0000","last_clean":"2023-07-09T21:22:34.223313+0000","last_became_active":"2023-07-09T21:22:30.855739+0000","last_became_peered":"2023-07-09T21:22:30.855739+0000","last_unstale":"2023-07-09T21:22:34.223313+0000","last_undegraded":"2023-07-09T21:22:34.223313+0000","last_fullsized":"2023-07-09T21:22:34.223313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:53.171536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831637+0000","last_change":"2023-07-09T21:22:31.865421+0000","last_active":"2023-07-09T21:22:32.831637+0000","last_peered":"2023-07-09T21:22:32.831637+0000","last_clean":"2023-07-09T21:22:32.831637+0000","last_became_active":"2023-07-09T21:22:31.865018+0000","last_became_peered":"2023-07-09T21:22:31.865018+0000","last_unstale":"2023-07-09T21:22:32.831637+0000","last_undegraded":"2023-07-09T21:22:32.831637+0000","last_fullsized":"2023-07-09T21:22:32.831637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:10.826638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158617+0000","last_change":"2023-07-09T21:22:30.844420+0000","last_active":"2023-07-09T21:22:33.158617+0000","last_peered":"2023-07-09T21:22:33.158617+0000","last_clean":"2023-07-09T21:22:33.158617+0000","last_became_active":"2023-07-09T21:22:30.843988+0000","last_became_peered":"2023-07-09T21:22:30.843988+0000","last_unstale":"2023-07-09T21:22:33.158617+0000","last_undegraded":"2023-07-09T21:22:33.158617+0000","last_fullsized":"2023-07-09T21:22:33.158617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:27.561323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158970+0000","last_change":"2023-07-09T21:22:31.845772+0000","last_active":"2023-07-09T21:22:33.158970+0000","last_peered":"2023-07-09T21:22:33.158970+0000","last_clean":"2023-07-09T21:22:33.158970+0000","last_became_active":"2023-07-09T21:22:31.845435+0000","last_became_peered":"2023-07-09T21:22:31.845435+0000","last_unstale":"2023-07-09T21:22:33.158970+0000","last_undegraded":"2023-07-09T21:22:33.158970+0000","last_fullsized":"2023-07-09T21:22:33.158970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223093+0000","last_change":"2023-07-09T21:22:30.858532+0000","last_active":"2023-07-09T21:22:34.223093+0000","last_peered":"2023-07-09T21:22:34.223093+0000","last_clean":"2023-07-09T21:22:34.223093+0000","last_became_active":"2023-07-09T21:22:30.858236+0000","last_became_peered":"2023-07-09T21:22:30.858236+0000","last_unstale":"2023-07-09T21:22:34.223093+0000","last_undegraded":"2023-07-09T21:22:34.223093+0000","last_fullsized":"2023-07-09T21:22:34.223093+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476256+0000","last_change":"2023-07-09T21:22:31.854757+0000","last_active":"2023-07-09T21:22:34.476256+0000","last_peered":"2023-07-09T21:22:34.476256+0000","last_clean":"2023-07-09T21:22:34.476256+0000","last_became_active":"2023-07-09T21:22:31.854486+0000","last_became_peered":"2023-07-09T21:22:31.854486+0000","last_unstale":"2023-07-09T21:22:34.476256+0000","last_undegraded":"2023-07-09T21:22:34.476256+0000","last_fullsized":"2023-07-09T21:22:34.476256+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829862+0000","last_change":"2023-07-09T21:22:30.847752+0000","last_active":"2023-07-09T21:22:32.829862+0000","last_peered":"2023-07-09T21:22:32.829862+0000","last_clean":"2023-07-09T21:22:32.829862+0000","last_became_active":"2023-07-09T21:22:30.847443+0000","last_became_peered":"2023-07-09T21:22:30.847443+0000","last_unstale":"2023-07-09T21:22:32.829862+0000","last_undegraded":"2023-07-09T21:22:32.829862+0000","last_fullsized":"2023-07-09T21:22:32.829862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:40.391208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223446+0000","last_change":"2023-07-09T21:22:30.858567+0000","last_active":"2023-07-09T21:22:34.223446+0000","last_peered":"2023-07-09T21:22:34.223446+0000","last_clean":"2023-07-09T21:22:34.223446+0000","last_became_active":"2023-07-09T21:22:30.858292+0000","last_became_peered":"2023-07-09T21:22:30.858292+0000","last_unstale":"2023-07-09T21:22:34.223446+0000","last_undegraded":"2023-07-09T21:22:34.223446+0000","last_fullsized":"2023-07-09T21:22:34.223446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:21.676598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830934+0000","last_change":"2023-07-09T21:22:31.860174+0000","last_active":"2023-07-09T21:22:32.830934+0000","last_peered":"2023-07-09T21:22:32.830934+0000","last_clean":"2023-07-09T21:22:32.830934+0000","last_became_active":"2023-07-09T21:22:31.859534+0000","last_became_peered":"2023-07-09T21:22:31.859534+0000","last_unstale":"2023-07-09T21:22:32.830934+0000","last_undegraded":"2023-07-09T21:22:32.830934+0000","last_fullsized":"2023-07-09T21:22:32.830934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223257+0000","last_change":"2023-07-09T21:22:30.859109+0000","last_active":"2023-07-09T21:22:34.223257+0000","last_peered":"2023-07-09T21:22:34.223257+0000","last_clean":"2023-07-09T21:22:34.223257+0000","last_became_active":"2023-07-09T21:22:30.858847+0000","last_became_peered":"2023-07-09T21:22:30.858847+0000","last_unstale":"2023-07-09T21:22:34.223257+0000","last_undegraded":"2023-07-09T21:22:34.223257+0000","last_fullsized":"2023-07-09T21:22:34.223257+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:09:31.012287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831088+0000","last_change":"2023-07-09T21:22:31.853909+0000","last_active":"2023-07-09T21:22:32.831088+0000","last_peered":"2023-07-09T21:22:32.831088+0000","last_clean":"2023-07-09T21:22:32.831088+0000","last_became_active":"2023-07-09T21:22:31.853620+0000","last_became_peered":"2023-07-09T21:22:31.853620+0000","last_unstale":"2023-07-09T21:22:32.831088+0000","last_undegraded":"2023-07-09T21:22:32.831088+0000","last_fullsized":"2023-07-09T21:22:32.831088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:50:27.889021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223459+0000","last_change":"2023-07-09T21:22:30.843222+0000","last_active":"2023-07-09T21:22:34.223459+0000","last_peered":"2023-07-09T21:22:34.223459+0000","last_clean":"2023-07-09T21:22:34.223459+0000","last_became_active":"2023-07-09T21:22:30.842674+0000","last_became_peered":"2023-07-09T21:22:30.842674+0000","last_unstale":"2023-07-09T21:22:34.223459+0000","last_undegraded":"2023-07-09T21:22:34.223459+0000","last_fullsized":"2023-07-09T21:22:34.223459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:32:11.095047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.829829+0000","last_change":"2023-07-09T21:22:31.862216+0000","last_active":"2023-07-09T21:22:32.829829+0000","last_peered":"2023-07-09T21:22:32.829829+0000","last_clean":"2023-07-09T21:22:32.829829+0000","last_became_active":"2023-07-09T21:22:31.861894+0000","last_became_peered":"2023-07-09T21:22:31.861894+0000","last_unstale":"2023-07-09T21:22:32.829829+0000","last_undegraded":"2023-07-09T21:22:32.829829+0000","last_fullsized":"2023-07-09T21:22:32.829829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:10.894410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831409+0000","last_change":"2023-07-09T21:22:30.851190+0000","last_active":"2023-07-09T21:22:32.831409+0000","last_peered":"2023-07-09T21:22:32.831409+0000","last_clean":"2023-07-09T21:22:32.831409+0000","last_became_active":"2023-07-09T21:22:30.850854+0000","last_became_peered":"2023-07-09T21:22:30.850854+0000","last_unstale":"2023-07-09T21:22:32.831409+0000","last_undegraded":"2023-07-09T21:22:32.831409+0000","last_fullsized":"2023-07-09T21:22:32.831409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158620+0000","last_change":"2023-07-09T21:22:31.851686+0000","last_active":"2023-07-09T21:22:33.158620+0000","last_peered":"2023-07-09T21:22:33.158620+0000","last_clean":"2023-07-09T21:22:33.158620+0000","last_became_active":"2023-07-09T21:22:31.851409+0000","last_became_peered":"2023-07-09T21:22:31.851409+0000","last_unstale":"2023-07-09T21:22:33.158620+0000","last_undegraded":"2023-07-09T21:22:33.158620+0000","last_fullsized":"2023-07-09T21:22:33.158620+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:54.053624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476330+0000","last_change":"2023-07-09T21:22:30.850817+0000","last_active":"2023-07-09T21:22:34.476330+0000","last_peered":"2023-07-09T21:22:34.476330+0000","last_clean":"2023-07-09T21:22:34.476330+0000","last_became_active":"2023-07-09T21:22:30.850487+0000","last_became_peered":"2023-07-09T21:22:30.850487+0000","last_unstale":"2023-07-09T21:22:34.476330+0000","last_undegraded":"2023-07-09T21:22:34.476330+0000","last_fullsized":"2023-07-09T21:22:34.476330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832857+0000","last_change":"2023-07-09T21:22:31.856467+0000","last_active":"2023-07-09T21:22:32.832857+0000","last_peered":"2023-07-09T21:22:32.832857+0000","last_clean":"2023-07-09T21:22:32.832857+0000","last_became_active":"2023-07-09T21:22:31.855212+0000","last_became_peered":"2023-07-09T21:22:31.855212+0000","last_unstale":"2023-07-09T21:22:32.832857+0000","last_undegraded":"2023-07-09T21:22:32.832857+0000","last_fullsized":"2023-07-09T21:22:32.832857+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:55.069666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830026+0000","last_change":"2023-07-09T21:22:30.857694+0000","last_active":"2023-07-09T21:22:32.830026+0000","last_peered":"2023-07-09T21:22:32.830026+0000","last_clean":"2023-07-09T21:22:32.830026+0000","last_became_active":"2023-07-09T21:22:30.857229+0000","last_became_peered":"2023-07-09T21:22:30.857229+0000","last_unstale":"2023-07-09T21:22:32.830026+0000","last_undegraded":"2023-07-09T21:22:32.830026+0000","last_fullsized":"2023-07-09T21:22:32.830026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:45.590932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832851+0000","last_change":"2023-07-09T21:22:31.850987+0000","last_active":"2023-07-09T21:22:32.832851+0000","last_peered":"2023-07-09T21:22:32.832851+0000","last_clean":"2023-07-09T21:22:32.832851+0000","last_became_active":"2023-07-09T21:22:31.850653+0000","last_became_peered":"2023-07-09T21:22:31.850653+0000","last_unstale":"2023-07-09T21:22:32.832851+0000","last_undegraded":"2023-07-09T21:22:32.832851+0000","last_fullsized":"2023-07-09T21:22:32.832851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:52.777686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832117+0000","last_change":"2023-07-09T21:22:30.856178+0000","last_active":"2023-07-09T21:22:32.832117+0000","last_peered":"2023-07-09T21:22:32.832117+0000","last_clean":"2023-07-09T21:22:32.832117+0000","last_became_active":"2023-07-09T21:22:30.855740+0000","last_became_peered":"2023-07-09T21:22:30.855740+0000","last_unstale":"2023-07-09T21:22:32.832117+0000","last_undegraded":"2023-07-09T21:22:32.832117+0000","last_fullsized":"2023-07-09T21:22:32.832117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:04.755161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832756+0000","last_change":"2023-07-09T21:22:31.852075+0000","last_active":"2023-07-09T21:22:32.832756+0000","last_peered":"2023-07-09T21:22:32.832756+0000","last_clean":"2023-07-09T21:22:32.832756+0000","last_became_active":"2023-07-09T21:22:31.851518+0000","last_became_peered":"2023-07-09T21:22:31.851518+0000","last_unstale":"2023-07-09T21:22:32.832756+0000","last_undegraded":"2023-07-09T21:22:32.832756+0000","last_fullsized":"2023-07-09T21:22:32.832756+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:19.528375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476033+0000","last_change":"2023-07-09T21:22:30.850674+0000","last_active":"2023-07-09T21:22:34.476033+0000","last_peered":"2023-07-09T21:22:34.476033+0000","last_clean":"2023-07-09T21:22:34.476033+0000","last_became_active":"2023-07-09T21:22:30.847971+0000","last_became_peered":"2023-07-09T21:22:30.847971+0000","last_unstale":"2023-07-09T21:22:34.476033+0000","last_undegraded":"2023-07-09T21:22:34.476033+0000","last_fullsized":"2023-07-09T21:22:34.476033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:18.148685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374907+0000","last_change":"2023-07-09T21:22:31.861069+0000","last_active":"2023-07-09T21:22:33.374907+0000","last_peered":"2023-07-09T21:22:33.374907+0000","last_clean":"2023-07-09T21:22:33.374907+0000","last_became_active":"2023-07-09T21:22:31.860705+0000","last_became_peered":"2023-07-09T21:22:31.860705+0000","last_unstale":"2023-07-09T21:22:33.374907+0000","last_undegraded":"2023-07-09T21:22:33.374907+0000","last_fullsized":"2023-07-09T21:22:33.374907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:15.538483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":175,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223479+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:22:34.223479+0000","last_peered":"2023-07-09T21:22:34.223479+0000","last_clean":"2023-07-09T21:22:34.223479+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:22:34.223479+0000","last_undegraded":"2023-07-09T21:22:34.223479+0000","last_fullsized":"2023-07-09T21:22:34.223479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:26.027091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831034+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:22:32.831034+0000","last_peered":"2023-07-09T21:22:32.831034+0000","last_clean":"2023-07-09T21:22:32.831034+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:22:32.831034+0000","last_undegraded":"2023-07-09T21:22:32.831034+0000","last_fullsized":"2023-07-09T21:22:32.831034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:03.554142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475817+0000","last_change":"2023-07-09T21:22:30.843989+0000","last_active":"2023-07-09T21:22:34.475817+0000","last_peered":"2023-07-09T21:22:34.475817+0000","last_clean":"2023-07-09T21:22:34.475817+0000","last_became_active":"2023-07-09T21:22:30.843612+0000","last_became_peered":"2023-07-09T21:22:30.843612+0000","last_unstale":"2023-07-09T21:22:34.475817+0000","last_undegraded":"2023-07-09T21:22:34.475817+0000","last_fullsized":"2023-07-09T21:22:34.475817+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:11.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830346+0000","last_change":"2023-07-09T21:22:31.856560+0000","last_active":"2023-07-09T21:22:32.830346+0000","last_peered":"2023-07-09T21:22:32.830346+0000","last_clean":"2023-07-09T21:22:32.830346+0000","last_became_active":"2023-07-09T21:22:31.855516+0000","last_became_peered":"2023-07-09T21:22:31.855516+0000","last_unstale":"2023-07-09T21:22:32.830346+0000","last_undegraded":"2023-07-09T21:22:32.830346+0000","last_fullsized":"2023-07-09T21:22:32.830346+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:55.695138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222704+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:22:34.222704+0000","last_peered":"2023-07-09T21:22:34.222704+0000","last_clean":"2023-07-09T21:22:34.222704+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:22:34.222704+0000","last_undegraded":"2023-07-09T21:22:34.222704+0000","last_fullsized":"2023-07-09T21:22:34.222704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:34.283098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158518+0000","last_change":"2023-07-09T21:22:30.857285+0000","last_active":"2023-07-09T21:22:33.158518+0000","last_peered":"2023-07-09T21:22:33.158518+0000","last_clean":"2023-07-09T21:22:33.158518+0000","last_became_active":"2023-07-09T21:22:30.856950+0000","last_became_peered":"2023-07-09T21:22:30.856950+0000","last_unstale":"2023-07-09T21:22:33.158518+0000","last_undegraded":"2023-07-09T21:22:33.158518+0000","last_fullsized":"2023-07-09T21:22:33.158518+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:00.316799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158880+0000","last_change":"2023-07-09T21:22:31.858719+0000","last_active":"2023-07-09T21:22:33.158880+0000","last_peered":"2023-07-09T21:22:33.158880+0000","last_clean":"2023-07-09T21:22:33.158880+0000","last_became_active":"2023-07-09T21:22:31.858412+0000","last_became_peered":"2023-07-09T21:22:31.858412+0000","last_unstale":"2023-07-09T21:22:33.158880+0000","last_undegraded":"2023-07-09T21:22:33.158880+0000","last_fullsized":"2023-07-09T21:22:33.158880+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242243+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:22:33.242243+0000","last_peered":"2023-07-09T21:22:33.242243+0000","last_clean":"2023-07-09T21:22:33.242243+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:22:33.242243+0000","last_undegraded":"2023-07-09T21:22:33.242243+0000","last_fullsized":"2023-07-09T21:22:33.242243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:40.035291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374698+0000","last_change":"2023-07-09T21:22:30.843863+0000","last_active":"2023-07-09T21:22:33.374698+0000","last_peered":"2023-07-09T21:22:33.374698+0000","last_clean":"2023-07-09T21:22:33.374698+0000","last_became_active":"2023-07-09T21:22:30.843523+0000","last_became_peered":"2023-07-09T21:22:30.843523+0000","last_unstale":"2023-07-09T21:22:33.374698+0000","last_undegraded":"2023-07-09T21:22:33.374698+0000","last_fullsized":"2023-07-09T21:22:33.374698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:27.561323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374907+0000","last_change":"2023-07-09T21:22:31.869166+0000","last_active":"2023-07-09T21:22:33.374907+0000","last_peered":"2023-07-09T21:22:33.374907+0000","last_clean":"2023-07-09T21:22:33.374907+0000","last_became_active":"2023-07-09T21:22:31.868832+0000","last_became_peered":"2023-07-09T21:22:31.868832+0000","last_unstale":"2023-07-09T21:22:33.374907+0000","last_undegraded":"2023-07-09T21:22:33.374907+0000","last_fullsized":"2023-07-09T21:22:33.374907+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831237+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:22:32.831237+0000","last_peered":"2023-07-09T21:22:32.831237+0000","last_clean":"2023-07-09T21:22:32.831237+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:22:32.831237+0000","last_undegraded":"2023-07-09T21:22:32.831237+0000","last_fullsized":"2023-07-09T21:22:32.831237+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:09.500561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832498+0000","last_change":"2023-07-09T21:22:30.855389+0000","last_active":"2023-07-09T21:22:32.832498+0000","last_peered":"2023-07-09T21:22:32.832498+0000","last_clean":"2023-07-09T21:22:32.832498+0000","last_became_active":"2023-07-09T21:22:30.855134+0000","last_became_peered":"2023-07-09T21:22:30.855134+0000","last_unstale":"2023-07-09T21:22:32.832498+0000","last_undegraded":"2023-07-09T21:22:32.832498+0000","last_fullsized":"2023-07-09T21:22:32.832498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374712+0000","last_change":"2023-07-09T21:22:31.852120+0000","last_active":"2023-07-09T21:22:33.374712+0000","last_peered":"2023-07-09T21:22:33.374712+0000","last_clean":"2023-07-09T21:22:33.374712+0000","last_became_active":"2023-07-09T21:22:31.851781+0000","last_became_peered":"2023-07-09T21:22:31.851781+0000","last_unstale":"2023-07-09T21:22:33.374712+0000","last_undegraded":"2023-07-09T21:22:33.374712+0000","last_fullsized":"2023-07-09T21:22:33.374712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831933+0000","last_change":"2023-07-09T21:22:30.851147+0000","last_active":"2023-07-09T21:22:32.831933+0000","last_peered":"2023-07-09T21:22:32.831933+0000","last_clean":"2023-07-09T21:22:32.831933+0000","last_became_active":"2023-07-09T21:22:30.850732+0000","last_became_peered":"2023-07-09T21:22:30.850732+0000","last_unstale":"2023-07-09T21:22:32.831933+0000","last_undegraded":"2023-07-09T21:22:32.831933+0000","last_fullsized":"2023-07-09T21:22:32.831933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:51.771067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375059+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:22:33.375059+0000","last_peered":"2023-07-09T21:22:33.375059+0000","last_clean":"2023-07-09T21:22:33.375059+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:22:33.375059+0000","last_undegraded":"2023-07-09T21:22:33.375059+0000","last_fullsized":"2023-07-09T21:22:33.375059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:04.788716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.375040+0000","last_change":"2023-07-09T21:22:31.866350+0000","last_active":"2023-07-09T21:22:33.375040+0000","last_peered":"2023-07-09T21:22:33.375040+0000","last_clean":"2023-07-09T21:22:33.375040+0000","last_became_active":"2023-07-09T21:22:31.866065+0000","last_became_peered":"2023-07-09T21:22:31.866065+0000","last_unstale":"2023-07-09T21:22:33.375040+0000","last_undegraded":"2023-07-09T21:22:33.375040+0000","last_fullsized":"2023-07-09T21:22:33.375040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374740+0000","last_change":"2023-07-09T21:22:30.847415+0000","last_active":"2023-07-09T21:22:33.374740+0000","last_peered":"2023-07-09T21:22:33.374740+0000","last_clean":"2023-07-09T21:22:33.374740+0000","last_became_active":"2023-07-09T21:22:30.847083+0000","last_became_peered":"2023-07-09T21:22:30.847083+0000","last_unstale":"2023-07-09T21:22:33.374740+0000","last_undegraded":"2023-07-09T21:22:33.374740+0000","last_fullsized":"2023-07-09T21:22:33.374740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:01.551080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.222667+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:22:34.222667+0000","last_peered":"2023-07-09T21:22:34.222667+0000","last_clean":"2023-07-09T21:22:34.222667+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:22:34.222667+0000","last_undegraded":"2023-07-09T21:22:34.222667+0000","last_fullsized":"2023-07-09T21:22:34.222667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:04.788716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158686+0000","last_change":"2023-07-09T21:22:31.869857+0000","last_active":"2023-07-09T21:22:33.158686+0000","last_peered":"2023-07-09T21:22:33.158686+0000","last_clean":"2023-07-09T21:22:33.158686+0000","last_became_active":"2023-07-09T21:22:31.869492+0000","last_became_peered":"2023-07-09T21:22:31.869492+0000","last_unstale":"2023-07-09T21:22:33.158686+0000","last_undegraded":"2023-07-09T21:22:33.158686+0000","last_fullsized":"2023-07-09T21:22:33.158686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476270+0000","last_change":"2023-07-09T21:22:30.837573+0000","last_active":"2023-07-09T21:22:34.476270+0000","last_peered":"2023-07-09T21:22:34.476270+0000","last_clean":"2023-07-09T21:22:34.476270+0000","last_became_active":"2023-07-09T21:22:30.837216+0000","last_became_peered":"2023-07-09T21:22:30.837216+0000","last_unstale":"2023-07-09T21:22:34.476270+0000","last_undegraded":"2023-07-09T21:22:34.476270+0000","last_fullsized":"2023-07-09T21:22:34.476270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:20.575374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374895+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:22:33.374895+0000","last_peered":"2023-07-09T21:22:33.374895+0000","last_clean":"2023-07-09T21:22:33.374895+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:22:33.374895+0000","last_undegraded":"2023-07-09T21:22:33.374895+0000","last_fullsized":"2023-07-09T21:22:33.374895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.029984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475750+0000","last_change":"2023-07-09T21:22:31.853429+0000","last_active":"2023-07-09T21:22:34.475750+0000","last_peered":"2023-07-09T21:22:34.475750+0000","last_clean":"2023-07-09T21:22:34.475750+0000","last_became_active":"2023-07-09T21:22:31.853117+0000","last_became_peered":"2023-07-09T21:22:31.853117+0000","last_unstale":"2023-07-09T21:22:34.475750+0000","last_undegraded":"2023-07-09T21:22:34.475750+0000","last_fullsized":"2023-07-09T21:22:34.475750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:06:02.557699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"23'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159009+0000","last_change":"2023-07-09T21:22:30.848294+0000","last_active":"2023-07-09T21:22:33.159009+0000","last_peered":"2023-07-09T21:22:33.159009+0000","last_clean":"2023-07-09T21:22:33.159009+0000","last_became_active":"2023-07-09T21:22:30.847977+0000","last_became_peered":"2023-07-09T21:22:30.847977+0000","last_unstale":"2023-07-09T21:22:33.159009+0000","last_undegraded":"2023-07-09T21:22:33.159009+0000","last_fullsized":"2023-07-09T21:22:33.159009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:14.531864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830462+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:22:32.830462+0000","last_peered":"2023-07-09T21:22:32.830462+0000","last_clean":"2023-07-09T21:22:32.830462+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:22:32.830462+0000","last_undegraded":"2023-07-09T21:22:32.830462+0000","last_fullsized":"2023-07-09T21:22:32.830462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:21:26.932969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.865948+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.865590+0000","last_became_peered":"2023-07-09T21:22:31.865590+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:28.567942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832513+0000","last_change":"2023-07-09T21:22:31.852986+0000","last_active":"2023-07-09T21:22:32.832513+0000","last_peered":"2023-07-09T21:22:32.832513+0000","last_clean":"2023-07-09T21:22:32.832513+0000","last_became_active":"2023-07-09T21:22:31.852672+0000","last_became_peered":"2023-07-09T21:22:31.852672+0000","last_unstale":"2023-07-09T21:22:32.832513+0000","last_undegraded":"2023-07-09T21:22:32.832513+0000","last_fullsized":"2023-07-09T21:22:32.832513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:19.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832985+0000","last_change":"2023-07-09T21:22:30.857328+0000","last_active":"2023-07-09T21:22:32.832985+0000","last_peered":"2023-07-09T21:22:32.832985+0000","last_clean":"2023-07-09T21:22:32.832985+0000","last_became_active":"2023-07-09T21:22:30.857074+0000","last_became_peered":"2023-07-09T21:22:30.857074+0000","last_unstale":"2023-07-09T21:22:32.832985+0000","last_undegraded":"2023-07-09T21:22:32.832985+0000","last_fullsized":"2023-07-09T21:22:32.832985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:35.836977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374900+0000","last_change":"2023-07-09T21:22:31.849713+0000","last_active":"2023-07-09T21:22:33.374900+0000","last_peered":"2023-07-09T21:22:33.374900+0000","last_clean":"2023-07-09T21:22:33.374900+0000","last_became_active":"2023-07-09T21:22:31.849438+0000","last_became_peered":"2023-07-09T21:22:31.849438+0000","last_unstale":"2023-07-09T21:22:33.374900+0000","last_undegraded":"2023-07-09T21:22:33.374900+0000","last_fullsized":"2023-07-09T21:22:33.374900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:09.592064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.223452+0000","last_change":"2023-07-09T21:22:30.850957+0000","last_active":"2023-07-09T21:22:34.223452+0000","last_peered":"2023-07-09T21:22:34.223452+0000","last_clean":"2023-07-09T21:22:34.223452+0000","last_became_active":"2023-07-09T21:22:30.850675+0000","last_became_peered":"2023-07-09T21:22:30.850675+0000","last_unstale":"2023-07-09T21:22:34.223452+0000","last_undegraded":"2023-07-09T21:22:34.223452+0000","last_fullsized":"2023-07-09T21:22:34.223452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:03.757733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.832318+0000","last_change":"2023-07-09T21:22:30.843875+0000","last_active":"2023-07-09T21:22:32.832318+0000","last_peered":"2023-07-09T21:22:32.832318+0000","last_clean":"2023-07-09T21:22:32.832318+0000","last_became_active":"2023-07-09T21:22:30.843484+0000","last_became_peered":"2023-07-09T21:22:30.843484+0000","last_unstale":"2023-07-09T21:22:32.832318+0000","last_undegraded":"2023-07-09T21:22:32.832318+0000","last_fullsized":"2023-07-09T21:22:32.832318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:54.063047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475827+0000","last_change":"2023-07-09T21:22:31.853270+0000","last_active":"2023-07-09T21:22:34.475827+0000","last_peered":"2023-07-09T21:22:34.475827+0000","last_clean":"2023-07-09T21:22:34.475827+0000","last_became_active":"2023-07-09T21:22:31.852994+0000","last_became_peered":"2023-07-09T21:22:31.852994+0000","last_unstale":"2023-07-09T21:22:34.475827+0000","last_undegraded":"2023-07-09T21:22:34.475827+0000","last_fullsized":"2023-07-09T21:22:34.475827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:10.779080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159089+0000","last_change":"2023-07-09T21:22:30.845979+0000","last_active":"2023-07-09T21:22:33.159089+0000","last_peered":"2023-07-09T21:22:33.159089+0000","last_clean":"2023-07-09T21:22:33.159089+0000","last_became_active":"2023-07-09T21:22:30.844569+0000","last_became_peered":"2023-07-09T21:22:30.844569+0000","last_unstale":"2023-07-09T21:22:33.159089+0000","last_undegraded":"2023-07-09T21:22:33.159089+0000","last_fullsized":"2023-07-09T21:22:33.159089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:09.820019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475665+0000","last_change":"2023-07-09T21:22:31.850051+0000","last_active":"2023-07-09T21:22:34.475665+0000","last_peered":"2023-07-09T21:22:34.475665+0000","last_clean":"2023-07-09T21:22:34.475665+0000","last_became_active":"2023-07-09T21:22:31.849776+0000","last_became_peered":"2023-07-09T21:22:31.849776+0000","last_unstale":"2023-07-09T21:22:34.475665+0000","last_undegraded":"2023-07-09T21:22:34.475665+0000","last_fullsized":"2023-07-09T21:22:34.475665+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.830414+0000","last_change":"2023-07-09T21:22:31.870733+0000","last_active":"2023-07-09T21:22:32.830414+0000","last_peered":"2023-07-09T21:22:32.830414+0000","last_clean":"2023-07-09T21:22:32.830414+0000","last_became_active":"2023-07-09T21:22:31.870386+0000","last_became_peered":"2023-07-09T21:22:31.870386+0000","last_unstale":"2023-07-09T21:22:32.830414+0000","last_undegraded":"2023-07-09T21:22:32.830414+0000","last_fullsized":"2023-07-09T21:22:32.830414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:25.810304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475894+0000","last_change":"2023-07-09T21:22:30.843731+0000","last_active":"2023-07-09T21:22:34.475894+0000","last_peered":"2023-07-09T21:22:34.475894+0000","last_clean":"2023-07-09T21:22:34.475894+0000","last_became_active":"2023-07-09T21:22:30.839924+0000","last_became_peered":"2023-07-09T21:22:30.839924+0000","last_unstale":"2023-07-09T21:22:34.475894+0000","last_undegraded":"2023-07-09T21:22:34.475894+0000","last_fullsized":"2023-07-09T21:22:34.475894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158814+0000","last_change":"2023-07-09T21:22:31.853288+0000","last_active":"2023-07-09T21:22:33.158814+0000","last_peered":"2023-07-09T21:22:33.158814+0000","last_clean":"2023-07-09T21:22:33.158814+0000","last_became_active":"2023-07-09T21:22:31.852965+0000","last_became_peered":"2023-07-09T21:22:31.852965+0000","last_unstale":"2023-07-09T21:22:33.158814+0000","last_undegraded":"2023-07-09T21:22:33.158814+0000","last_fullsized":"2023-07-09T21:22:33.158814+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.374795+0000","last_change":"2023-07-09T21:22:30.849317+0000","last_active":"2023-07-09T21:22:33.374795+0000","last_peered":"2023-07-09T21:22:33.374795+0000","last_clean":"2023-07-09T21:22:33.374795+0000","last_became_active":"2023-07-09T21:22:30.849028+0000","last_became_peered":"2023-07-09T21:22:30.849028+0000","last_unstale":"2023-07-09T21:22:33.374795+0000","last_undegraded":"2023-07-09T21:22:33.374795+0000","last_fullsized":"2023-07-09T21:22:33.374795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:56.259324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476054+0000","last_change":"2023-07-09T21:22:31.853961+0000","last_active":"2023-07-09T21:22:34.476054+0000","last_peered":"2023-07-09T21:22:34.476054+0000","last_clean":"2023-07-09T21:22:34.476054+0000","last_became_active":"2023-07-09T21:22:31.853341+0000","last_became_peered":"2023-07-09T21:22:31.853341+0000","last_unstale":"2023-07-09T21:22:34.476054+0000","last_undegraded":"2023-07-09T21:22:34.476054+0000","last_fullsized":"2023-07-09T21:22:34.476054+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:38.233071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831983+0000","last_change":"2023-07-09T21:22:30.856671+0000","last_active":"2023-07-09T21:22:32.831983+0000","last_peered":"2023-07-09T21:22:32.831983+0000","last_clean":"2023-07-09T21:22:32.831983+0000","last_became_active":"2023-07-09T21:22:30.856408+0000","last_became_peered":"2023-07-09T21:22:30.856408+0000","last_unstale":"2023-07-09T21:22:32.831983+0000","last_undegraded":"2023-07-09T21:22:32.831983+0000","last_fullsized":"2023-07-09T21:22:32.831983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:24:08.585445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.242345+0000","last_change":"2023-07-09T21:22:31.856724+0000","last_active":"2023-07-09T21:22:33.242345+0000","last_peered":"2023-07-09T21:22:33.242345+0000","last_clean":"2023-07-09T21:22:33.242345+0000","last_became_active":"2023-07-09T21:22:31.855887+0000","last_became_peered":"2023-07-09T21:22:31.855887+0000","last_unstale":"2023-07-09T21:22:33.242345+0000","last_undegraded":"2023-07-09T21:22:33.242345+0000","last_fullsized":"2023-07-09T21:22:33.242345+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:16.651272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.158837+0000","last_change":"2023-07-09T21:22:30.856613+0000","last_active":"2023-07-09T21:22:33.158837+0000","last_peered":"2023-07-09T21:22:33.158837+0000","last_clean":"2023-07-09T21:22:33.158837+0000","last_became_active":"2023-07-09T21:22:30.856381+0000","last_became_peered":"2023-07-09T21:22:30.856381+0000","last_unstale":"2023-07-09T21:22:33.158837+0000","last_undegraded":"2023-07-09T21:22:33.158837+0000","last_fullsized":"2023-07-09T21:22:33.158837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:11.061287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831645+0000","last_change":"2023-07-09T21:22:31.853264+0000","last_active":"2023-07-09T21:22:32.831645+0000","last_peered":"2023-07-09T21:22:32.831645+0000","last_clean":"2023-07-09T21:22:32.831645+0000","last_became_active":"2023-07-09T21:22:31.852950+0000","last_became_peered":"2023-07-09T21:22:31.852950+0000","last_unstale":"2023-07-09T21:22:32.831645+0000","last_undegraded":"2023-07-09T21:22:32.831645+0000","last_fullsized":"2023-07-09T21:22:32.831645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:57.265943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831443+0000","last_change":"2023-07-09T21:22:30.858476+0000","last_active":"2023-07-09T21:22:32.831443+0000","last_peered":"2023-07-09T21:22:32.831443+0000","last_clean":"2023-07-09T21:22:32.831443+0000","last_became_active":"2023-07-09T21:22:30.858135+0000","last_became_peered":"2023-07-09T21:22:30.858135+0000","last_unstale":"2023-07-09T21:22:32.831443+0000","last_undegraded":"2023-07-09T21:22:32.831443+0000","last_fullsized":"2023-07-09T21:22:32.831443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831673+0000","last_change":"2023-07-09T21:22:31.847803+0000","last_active":"2023-07-09T21:22:32.831673+0000","last_peered":"2023-07-09T21:22:32.831673+0000","last_clean":"2023-07-09T21:22:32.831673+0000","last_became_active":"2023-07-09T21:22:31.847509+0000","last_became_peered":"2023-07-09T21:22:31.847509+0000","last_unstale":"2023-07-09T21:22:32.831673+0000","last_undegraded":"2023-07-09T21:22:32.831673+0000","last_fullsized":"2023-07-09T21:22:32.831673+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:12.067906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831760+0000","last_change":"2023-07-09T21:22:30.858399+0000","last_active":"2023-07-09T21:22:32.831760+0000","last_peered":"2023-07-09T21:22:32.831760+0000","last_clean":"2023-07-09T21:22:32.831760+0000","last_became_active":"2023-07-09T21:22:30.858113+0000","last_became_peered":"2023-07-09T21:22:30.858113+0000","last_unstale":"2023-07-09T21:22:32.831760+0000","last_undegraded":"2023-07-09T21:22:32.831760+0000","last_fullsized":"2023-07-09T21:22:32.831760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:18.521756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.475940+0000","last_change":"2023-07-09T21:22:31.850287+0000","last_active":"2023-07-09T21:22:34.475940+0000","last_peered":"2023-07-09T21:22:34.475940+0000","last_clean":"2023-07-09T21:22:34.475940+0000","last_became_active":"2023-07-09T21:22:31.849962+0000","last_became_peered":"2023-07-09T21:22:31.849962+0000","last_unstale":"2023-07-09T21:22:34.475940+0000","last_undegraded":"2023-07-09T21:22:34.475940+0000","last_fullsized":"2023-07-09T21:22:34.475940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:05.761780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:34.476090+0000","last_change":"2023-07-09T21:22:30.834480+0000","last_active":"2023-07-09T21:22:34.476090+0000","last_peered":"2023-07-09T21:22:34.476090+0000","last_clean":"2023-07-09T21:22:34.476090+0000","last_became_active":"2023-07-09T21:22:30.834184+0000","last_became_peered":"2023-07-09T21:22:30.834184+0000","last_unstale":"2023-07-09T21:22:34.476090+0000","last_undegraded":"2023-07-09T21:22:34.476090+0000","last_fullsized":"2023-07-09T21:22:34.476090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:09.820019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:32.831247+0000","last_change":"2023-07-09T21:22:31.851493+0000","last_active":"2023-07-09T21:22:32.831247+0000","last_peered":"2023-07-09T21:22:32.831247+0000","last_clean":"2023-07-09T21:22:32.831247+0000","last_became_active":"2023-07-09T21:22:31.851203+0000","last_became_peered":"2023-07-09T21:22:31.851203+0000","last_unstale":"2023-07-09T21:22:32.831247+0000","last_undegraded":"2023-07-09T21:22:32.831247+0000","last_fullsized":"2023-07-09T21:22:32.831247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:30.811630+0000","last_clean_scrub_stamp":"2023-07-09T21:22:30.811630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:57.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-07-09T21:22:33.159022+0000","last_change":"2023-07-09T21:22:30.846855+0000","last_active":"2023-07-09T21:22:33.159022+0000","last_peered":"2023-07-09T21:22:33.159022+0000","last_clean":"2023-07-09T21:22:33.159022+0000","last_became_active":"2023-07-09T21:22:30.846556+0000","last_became_peered":"2023-07-09T21:22:30.846556+0000","last_unstale":"2023-07-09T21:22:33.159022+0000","last_undegraded":"2023-07-09T21:22:33.159022+0000","last_fullsized":"2023-07-09T21:22:33.159022+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:29.805011+0000","last_clean_scrub_stamp":"2023-07-09T21:22:29.805011+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:37.226451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":864256,"data_stored":681747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":249856,"data_stored":90251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":91219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27188,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344652,"statfs":{"total":96636764160,"available":96608923648,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31868,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339972,"statfs":{"total":96636764160,"available":96604131328,"internally_reserved":0,"allocated":839680,"data_stored":680549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:22:41.054 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T21:22:41.055 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-09T21:22:41.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-07-09T21:22:41.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-07-09T21:22:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 Processor -- start 2023-07-09T21:22:41.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 -- start start 2023-07-09T21:22:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 0x7f24f406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 0x7f24f40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24f40b4170 0x7f24f415f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40b7e80 con 0x7f24f40b4170 2023-07-09T21:22:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40b4610 con 0x7f24f40b7ab0 2023-07-09T21:22:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fc693640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40b49f0 con 0x7f24f40cef80 2023-07-09T21:22:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24f40b4170 0x7f24f415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24f40b4170 0x7f24f415f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34514/0 (socket says 172.21.15.37:34514) 2023-07-09T21:22:41.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 -- 172.21.15.37:0/2368724425 learned_addr learned my addr 172.21.15.37:0/2368724425 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 -- 172.21.15.37:0/2368724425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 msgr2=0x7f24f40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fa42f640 1 --2- 172.21.15.37:0/2368724425 >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 0x7f24f406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24f9c2e640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 0x7f24f40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 0x7f24f40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 -- 172.21.15.37:0/2368724425 >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 msgr2=0x7f24f406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 --2- 172.21.15.37:0/2368724425 >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 0x7f24f406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fac30640 1 -- 172.21.15.37:0/2368724425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40cc8a0 con 0x7f24f40b4170 2023-07-09T21:22:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24fa42f640 1 --2- 172.21.15.37:0/2368724425 >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 0x7f24f406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.226+0000 7f24f9c2e640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 0x7f24f40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:41.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fac30640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40b4170 0x7f24f415f490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f24f406b360 tx=0x7f24ec01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b257b1706ff97a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24f942d640 1 -- 172.21.15.37:0/2368724425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0a5560 con 0x7f24f40b4170 2023-07-09T21:22:41.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24f942d640 1 -- 172.21.15.37:0/2368724425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec0a56c0 con 0x7f24f40b4170 2023-07-09T21:22:41.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24f942d640 1 -- 172.21.15.37:0/2368724425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0a5a50 con 0x7f24f40b4170 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 -- 172.21.15.37:0/2368724425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40b4170 msgr2=0x7f24f415f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40b4170 0x7f24f415f490 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f24f406b360 tx=0x7f24ec01c6e0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 -- 172.21.15.37:0/2368724425 shutdown_connections 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40b4170 0x7f24f415f490 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 --2- 172.21.15.37:0/2368724425 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40cef80 0x7f24f40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 --2- 172.21.15.37:0/2368724425 >> v2:172.21.15.119:3300/0 conn(0x7f24f40b7ab0 0x7f24f406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 -- 172.21.15.37:0/2368724425 >> 172.21.15.37:0/2368724425 conn(0x7f24f4073090 msgr2=0x7f24f4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 -- 172.21.15.37:0/2368724425 shutdown_connections 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.230+0000 7f24fc693640 1 -- 172.21.15.37:0/2368724425 wait complete. 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 Processor -- start 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- start start 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f40b4170 0x7f24f41453e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40b7ab0 0x7f24f4159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4146380 con 0x7f24f40cef80 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f41599e0 con 0x7f24f40b4170 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f4145dc0 con 0x7f24f40b7ab0 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34522/0 (socket says 172.21.15.37:34522) 2023-07-09T21:22:41.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 -- 172.21.15.37:0/3934531874 learned_addr learned my addr 172.21.15.37:0/3934531874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fa42f640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f40b4170 0x7f24f41453e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24f9c2e640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40b7ab0 0x7f24f4159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 -- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40b7ab0 msgr2=0x7f24f4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40b7ab0 0x7f24f4159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 -- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f40b4170 msgr2=0x7f24f41453e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f40b4170 0x7f24f41453e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 -- 172.21.15.37:0/3934531874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ec009b30 con 0x7f24f40cef80 2023-07-09T21:22:41.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fac30640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24ec01ad90 tx=0x7f24ec019480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0b8670 con 0x7f24f40cef80 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24ec0b87d0 con 0x7f24f40cef80 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f41460a0 con 0x7f24f40cef80 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24ec0b8b40 con 0x7f24f40cef80 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f4158b10 con 0x7f24f40cef80 2023-07-09T21:22:41.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.234+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f4159460 con 0x7f24f40cef80 2023-07-09T21:22:41.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.238+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f24ec0b8ca0 con 0x7f24f40cef80 2023-07-09T21:22:41.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.238+0000 7f24eaffd640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 0x7f24d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.238+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f24ec11f210 con 0x7f24f40cef80 2023-07-09T21:22:41.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.238+0000 7f24fa42f640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 0x7f24d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.238+0000 7f24fa42f640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 0x7f24d8068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24f40c5c50 tx=0x7f24f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.242+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24f4159460 con 0x7f24f40cef80 2023-07-09T21:22:41.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f24f4159460 con 0x7f24f40cef80 2023-07-09T21:22:41.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24eaffd640 1 -- 172.21.15.37:0/3934531874 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f24f4159460 con 0x7f24f40cef80 2023-07-09T21:22:41.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:41.434 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 msgr2=0x7f24d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 0x7f24d8068730 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f24f40c5c50 tx=0x7f24f0008040 comp rx=0 tx=0).stop 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 msgr2=0x7f24f40b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f24ec01ad90 tx=0x7f24ec019480 comp rx=0 tx=0).stop 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 shutdown_connections 2023-07-09T21:22:41.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f24d8066280 0x7f24d8068730 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24f40cef80 0x7f24f40b2e30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24f40b7ab0 0x7f24f4159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 --2- 172.21.15.37:0/3934531874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24f40b4170 0x7f24f41453e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 >> 172.21.15.37:0/3934531874 conn(0x7f24f4073090 msgr2=0x7f24f40d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 shutdown_connections 2023-07-09T21:22:41.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.430+0000 7f24fc693640 1 -- 172.21.15.37:0/3934531874 wait complete. 2023-07-09T21:22:41.455 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-07-09T21:22:41.455 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:41.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.590+0000 7f3cb7f82640 1 Processor -- start 2023-07-09T21:22:41.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.590+0000 7f3cb7f82640 1 -- start start 2023-07-09T21:22:41.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb7f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3cb006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb7f82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3cb00cef80 0x7f3cb00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb7f82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb00b49f0 con 0x7f3cb00b4170 2023-07-09T21:22:41.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb7f82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb00b7e80 con 0x7f3cb00cef80 2023-07-09T21:22:41.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb7f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00b45f0 con 0x7f3cb00b7ab0 2023-07-09T21:22:41.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb651f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3cb00b4170 0x7f3cb015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57168/0 (socket says 172.21.15.37:57168) 2023-07-09T21:22:41.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb651f640 1 -- 172.21.15.37:0/1917785897 learned_addr learned my addr 172.21.15.37:0/1917785897 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:41.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3cb006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb551d640 1 --2- 172.21.15.37:0/1917785897 >> v2:172.21.15.119:3300/0 conn(0x7f3cb00cef80 0x7f3cb00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106227561 0 0) 0x7f3cb00b49f0 con 0x7f3cb00b4170 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c9c003530 con 0x7f3cb00b4170 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3539466813 0 0) 0x7f3c9c003530 con 0x7f3cb00b4170 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 msgr2=0x7f3cb006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3cb006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 >> v2:172.21.15.119:3300/0 conn(0x7f3cb00cef80 msgr2=0x7f3cb00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 --2- 172.21.15.37:0/1917785897 >> v2:172.21.15.119:3300/0 conn(0x7f3cb00cef80 0x7f3cb00b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb00cc8a0 con 0x7f3cb00b4170 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3ca8001a00 con 0x7f3cb00b4170 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 >> v1:172.21.15.37:6789/0 conn(0x7f3cb00b4170 legacy=0x7f3cb015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c003980 0x7f3c9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3c9c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c9c004d10 0x7f3c9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00b45f0 con 0x7f3c9c003980 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c00b990 con 0x7f3c9c004d10 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c9c00bad0 con 0x7f3cb00b7ab0 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c003980 0x7f3c9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb651f640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c9c004d10 0x7f3c9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb551d640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3c9c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 -- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 msgr2=0x7f3c9c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cb00b7ab0 0x7f3c9c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 -- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c9c004d10 msgr2=0x7f3c9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:41.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c9c004d10 0x7f3c9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.594+0000 7f3cb5d1e640 1 -- 172.21.15.37:0/1917785897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c003530 con 0x7f3c9c003980 2023-07-09T21:22:41.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c003980 0x7f3c9c003d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009ae0 tx=0x7f3cac01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f26264c66a295fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a55f0 con 0x7f3c9c003980 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac0a5750 con 0x7f3c9c003980 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb4d1c640 1 -- 172.21.15.37:0/1917785897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0a5b00 con 0x7f3c9c003980 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1917785897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c003980 msgr2=0x7f3c9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1917785897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c9c003980 0x7f3c9c003d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3cac009ae0 tx=0x7f3cac01c9c0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb651f640 1 -- 172.21.15.37:0/1917785897 reap_dead start 2023-07-09T21:22:41.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1917785897 shutdown_connections 2023-07-09T21:22:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1917785897 >> 172.21.15.37:0/1917785897 conn(0x7f3cb0073090 msgr2=0x7f3cb0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1917785897 shutdown_connections 2023-07-09T21:22:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.598+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1917785897 wait complete. 2023-07-09T21:22:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 Processor -- start 2023-07-09T21:22:41.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- start start 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c9c003980 0x7f3cb0154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cb00b21b0 0x7f3cb00b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb00b2b60 con 0x7f3cb01553f0 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb01648b0 con 0x7f3cb00b21b0 2023-07-09T21:22:41.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb0164b90 con 0x7f3c9c003980 2023-07-09T21:22:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34536/0 (socket says 172.21.15.37:34536) 2023-07-09T21:22:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 -- 172.21.15.37:0/1491228103 learned_addr learned my addr 172.21.15.37:0/1491228103 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb651f640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cb00b21b0 0x7f3cb00b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c9c003980 0x7f3cb0154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 -- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c9c003980 msgr2=0x7f3cb0154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c9c003980 0x7f3cb0154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 -- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cb00b21b0 msgr2=0x7f3cb00b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cb00b21b0 0x7f3cb00b2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 -- 172.21.15.37:0/1491228103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0164e70 con 0x7f3cb01553f0 2023-07-09T21:22:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb551d640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0011660 tx=0x7f3ca0011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0015870 con 0x7f3cb01553f0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca00159d0 con 0x7f3cb01553f0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca0015d40 con 0x7f3cb01553f0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb0165150 con 0x7f3cb01553f0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb0157080 con 0x7f3cb01553f0 2023-07-09T21:22:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.602+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb0165670 con 0x7f3cb01553f0 2023-07-09T21:22:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.606+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3ca000f480 con 0x7f3cb01553f0 2023-07-09T21:22:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.606+0000 7f3ca67fc640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 0x7f3c94068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.606+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3ca0083ff0 con 0x7f3cb01553f0 2023-07-09T21:22:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.606+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 0x7f3c94068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.606+0000 7f3cb5d1e640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 0x7f3c94068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0af000 tx=0x7f3cac0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.610+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cb0165670 con 0x7f3cb01553f0 2023-07-09T21:22:41.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.762+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cb0165670 con 0x7f3cb01553f0 2023-07-09T21:22:41.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3ca67fc640 1 -- 172.21.15.37:0/1491228103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f3cb0165670 con 0x7f3cb01553f0 2023-07-09T21:22:41.771 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:41.771 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:41.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 msgr2=0x7f3c94068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 0x7f3c94068760 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0af000 tx=0x7f3cac0046d0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 msgr2=0x7f3cb00c61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ca0011660 tx=0x7f3ca0011a60 comp rx=0 tx=0).stop 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 shutdown_connections 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3c940662b0 0x7f3c94068760 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cb00b21b0 0x7f3cb00b2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb01553f0 0x7f3cb00c61b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 --2- 172.21.15.37:0/1491228103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c9c003980 0x7f3cb0154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 >> 172.21.15.37:0/1491228103 conn(0x7f3cb0073090 msgr2=0x7f3cb00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 shutdown_connections 2023-07-09T21:22:41.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.766+0000 7f3cb7f82640 1 -- 172.21.15.37:0/1491228103 wait complete. 2023-07-09T21:22:41.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:41.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 Processor -- start 2023-07-09T21:22:41.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 -- start start 2023-07-09T21:22:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 0x7f7db006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db00c9090 con 0x7f7db006b970 2023-07-09T21:22:41.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7db00c8a60 con 0x7f7db00c4520 2023-07-09T21:22:41.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7db5cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db00cbf40 con 0x7f7db01585b0 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daeffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7db006b970 0x7f7db00c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57170/0 (socket says 172.21.15.37:57170) 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daeffd640 1 -- 172.21.15.37:0/2618106241 learned_addr learned my addr 172.21.15.37:0/2618106241 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daf7fe640 1 --2- 172.21.15.37:0/2618106241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 0x7f7db006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066886090 0 0) 0x7f7db00c9090 con 0x7f7db006b970 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d98003530 con 0x7f7db006b970 2023-07-09T21:22:41.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256696775 0 0) 0x7f7db00c8a60 con 0x7f7db00c4520 2023-07-09T21:22:41.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daf7fe640 1 -- 172.21.15.37:0/2618106241 >> v1:172.21.15.119:6789/0 conn(0x7f7db00c4520 legacy=0x7f7db015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daf7fe640 1 -- 172.21.15.37:0/2618106241 >> v1:172.21.15.37:6789/0 conn(0x7f7db006b970 legacy=0x7f7db00c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.934+0000 7f7daf7fe640 1 -- 172.21.15.37:0/2618106241 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db015ce10 con 0x7f7db01585b0 2023-07-09T21:22:41.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7daf7fe640 1 --2- 172.21.15.37:0/2618106241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 0x7f7db006b430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7da00097f0 tx=0x7f7da001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d3410ce35a6f736 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00aa610 con 0x7f7db01585b0 2023-07-09T21:22:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da00a6040 con 0x7f7db01585b0 2023-07-09T21:22:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7dae7fc640 1 -- 172.21.15.37:0/2618106241 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da00aa990 con 0x7f7db01585b0 2023-07-09T21:22:41.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 -- 172.21.15.37:0/2618106241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 msgr2=0x7f7db006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 --2- 172.21.15.37:0/2618106241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 0x7f7db006b430 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7da00097f0 tx=0x7f7da001c490 comp rx=0 tx=0).stop 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 -- 172.21.15.37:0/2618106241 shutdown_connections 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 --2- 172.21.15.37:0/2618106241 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db01585b0 0x7f7db006b430 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 -- 172.21.15.37:0/2618106241 >> 172.21.15.37:0/2618106241 conn(0x7f7db00cde40 msgr2=0x7f7db00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 -- 172.21.15.37:0/2618106241 shutdown_connections 2023-07-09T21:22:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.938+0000 7f7db5cec640 1 -- 172.21.15.37:0/2618106241 wait complete. 2023-07-09T21:22:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 Processor -- start 2023-07-09T21:22:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- start start 2023-07-09T21:22:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 0x7f7db006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db00c4520 0x7f7db00700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db01595b0 con 0x7f7db01585b0 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0159890 con 0x7f7db006b970 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7db0159b70 con 0x7f7db00c4520 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daf7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 0x7f7db006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daeffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db00c4520 0x7f7db00700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34544/0 (socket says 172.21.15.37:34544) 2023-07-09T21:22:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 -- 172.21.15.37:0/3087120441 learned_addr learned my addr 172.21.15.37:0/3087120441 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 -- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db00c4520 msgr2=0x7f7db00700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db00c4520 0x7f7db00700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 -- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 msgr2=0x7f7db006fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 0x7f7db006fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 -- 172.21.15.37:0/3087120441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da0009420 con 0x7f7db01585b0 2023-07-09T21:22:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daf7fe640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 0x7f7db006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7daffff640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c770 tx=0x7f7da800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da8003db0 con 0x7f7db01585b0 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da800ce80 con 0x7f7db01585b0 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7db0159e50 con 0x7f7db01585b0 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da80052b0 con 0x7f7db01585b0 2023-07-09T21:22:41.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.942+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7db0142430 con 0x7f7db01585b0 2023-07-09T21:22:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7db004d7d0 con 0x7f7db01585b0 2023-07-09T21:22:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7da8005410 con 0x7f7db01585b0 2023-07-09T21:22:41.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7d97fff640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 0x7f7d9c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7da8083520 con 0x7f7db01585b0 2023-07-09T21:22:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7daf7fe640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 0x7f7d9c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:41.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.946+0000 7f7daf7fe640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 0x7f7d9c068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7da00ae000 tx=0x7f7da00b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:41.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:41.950+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7da8050a40 con 0x7f7db01585b0 2023-07-09T21:22:42.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7db015a300 con 0x7f7db01585b0 2023-07-09T21:22:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7d97fff640 1 -- 172.21.15.37:0/3087120441 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7da8054060 con 0x7f7db01585b0 2023-07-09T21:22:42.114 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 msgr2=0x7f7d9c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 0x7f7d9c068730 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7da00ae000 tx=0x7f7da00b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 msgr2=0x7f7db015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7da800c770 tx=0x7f7da800cc30 comp rx=0 tx=0).stop 2023-07-09T21:22:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 shutdown_connections 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7d9c066280 0x7f7d9c068730 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7db01585b0 0x7f7db015aa60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7db00c4520 0x7f7db00700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 --2- 172.21.15.37:0/3087120441 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7db006b970 0x7f7db006fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 >> 172.21.15.37:0/3087120441 conn(0x7f7db00cde40 msgr2=0x7f7db00ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 shutdown_connections 2023-07-09T21:22:42.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.110+0000 7f7db5cec640 1 -- 172.21.15.37:0/3087120441 wait complete. 2023-07-09T21:22:42.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 Processor -- start 2023-07-09T21:22:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 -- start start 2023-07-09T21:22:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d140d0780 0x7f0d140d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1415bf80 con 0x7f0d140b7980 2023-07-09T21:22:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d140cd070 con 0x7f0d140d0780 2023-07-09T21:22:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d1ad74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d140cfd70 con 0x7f0d140cf290 2023-07-09T21:22:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d18b10640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0d140b7980 0x7f0d140ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57182/0 (socket says 172.21.15.37:57182) 2023-07-09T21:22:42.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d18b10640 1 -- 172.21.15.37:0/3844817536 learned_addr learned my addr 172.21.15.37:0/3844817536 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d13fff640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.274+0000 7f0d19311640 1 --2- 172.21.15.37:0/3844817536 >> v2:172.21.15.119:3300/0 conn(0x7f0d140d0780 0x7f0d140d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d137fe640 1 -- 172.21.15.37:0/3844817536 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680159735 0 0) 0x7f0d08001120 con 0x7f0d140b7980 2023-07-09T21:22:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d137fe640 1 -- 172.21.15.37:0/3844817536 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d04003530 con 0x7f0d140b7980 2023-07-09T21:22:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d19311640 1 -- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 msgr2=0x7f0d14160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d19311640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d19311640 1 -- 172.21.15.37:0/3844817536 >> v1:172.21.15.37:6789/0 conn(0x7f0d140b7980 legacy=0x7f0d140ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d19311640 1 -- 172.21.15.37:0/3844817536 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d14160570 con 0x7f0d140d0780 2023-07-09T21:22:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d19311640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140d0780 0x7f0d140d0c00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009d90 tx=0x7f0d0c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=549f6f658c18813d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d137fe640 1 -- 172.21.15.37:0/3844817536 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0a5810 con 0x7f0d140d0780 2023-07-09T21:22:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d137fe640 1 -- 172.21.15.37:0/3844817536 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0a5970 con 0x7f0d140d0780 2023-07-09T21:22:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d137fe640 1 -- 172.21.15.37:0/3844817536 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0a5d00 con 0x7f0d140d0780 2023-07-09T21:22:42.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d1ad74640 1 -- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140d0780 msgr2=0x7f0d140d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.278+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140d0780 0x7f0d140d0c00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c009d90 tx=0x7f0d0c01c950 comp rx=0 tx=0).stop 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- 172.21.15.37:0/3844817536 shutdown_connections 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140d0780 0x7f0d140d0c00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/3844817536 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- 172.21.15.37:0/3844817536 >> 172.21.15.37:0/3844817536 conn(0x7f0d14073090 msgr2=0x7f0d14069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- 172.21.15.37:0/3844817536 shutdown_connections 2023-07-09T21:22:42.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- 172.21.15.37:0/3844817536 wait complete. 2023-07-09T21:22:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 Processor -- start 2023-07-09T21:22:42.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- start start 2023-07-09T21:22:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140b7980 0x7f0d14151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d141526c0 con 0x7f0d140d0780 2023-07-09T21:22:42.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14152150 con 0x7f0d140b7980 2023-07-09T21:22:42.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d1ad74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d14150ba0 con 0x7f0d140cf290 2023-07-09T21:22:42.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34556/0 (socket says 172.21.15.37:34556) 2023-07-09T21:22:42.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 -- 172.21.15.37:0/1462245469 learned_addr learned my addr 172.21.15.37:0/1462245469 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:42.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d13fff640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d18b10640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140b7980 0x7f0d14151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 -- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 msgr2=0x7f0d14150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 -- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140b7980 msgr2=0x7f0d14151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140b7980 0x7f0d14151c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.282+0000 7f0d19311640 1 -- 172.21.15.37:0/1462245469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0c009a70 con 0x7f0d140d0780 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d19311640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0b0040 tx=0x7f0d0c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0b9860 con 0x7f0d140d0780 2023-07-09T21:22:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0c0b99c0 con 0x7f0d140d0780 2023-07-09T21:22:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0c0b9d50 con 0x7f0d140d0780 2023-07-09T21:22:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d14150e50 con 0x7f0d140d0780 2023-07-09T21:22:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d14151410 con 0x7f0d140d0780 2023-07-09T21:22:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1404d7d0 con 0x7f0d140d0780 2023-07-09T21:22:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0d0c0c4460 con 0x7f0d140d0780 2023-07-09T21:22:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 0x7f0cf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0d0c11ee60 con 0x7f0d140d0780 2023-07-09T21:22:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.286+0000 7f0d18b10640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 0x7f0cf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.290+0000 7f0d18b10640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 0x7f0cf8068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d08001280 tx=0x7f0d08007bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.290+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d0c0ec410 con 0x7f0d140d0780 2023-07-09T21:22:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.442+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0d14160570 con 0x7f0d140d0780 2023-07-09T21:22:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d117fa640 1 -- 172.21.15.37:0/1462245469 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0d14160570 con 0x7f0d140d0780 2023-07-09T21:22:42.450 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 msgr2=0x7f0cf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 0x7f0cf8068730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0d08001280 tx=0x7f0d08007bc0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 msgr2=0x7f0d140b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c0b0040 tx=0x7f0d0c0196f0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 shutdown_connections 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cf8066280 0x7f0cf8068730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d140d0780 0x7f0d140b4520 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d140cf290 0x7f0d14150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 --2- 172.21.15.37:0/1462245469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d140b7980 0x7f0d14151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 >> 172.21.15.37:0/1462245469 conn(0x7f0d14073090 msgr2=0x7f0d140ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 shutdown_connections 2023-07-09T21:22:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.446+0000 7f0d1ad74640 1 -- 172.21.15.37:0/1462245469 wait complete. 2023-07-09T21:22:42.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:22:42.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 Processor -- start 2023-07-09T21:22:42.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 -- start start 2023-07-09T21:22:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28700b7980 0x7f2870160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287015bf80 con 0x7f28700ceb80 2023-07-09T21:22:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2870160570 con 0x7f28700d0780 2023-07-09T21:22:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.610+0000 7f2877c0b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28700cd070 con 0x7f28700b7980 2023-07-09T21:22:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28759a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28700b7980 0x7f2870160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28751a6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28700ceb80 0x7f28700cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57188/0 (socket says 172.21.15.37:57188) 2023-07-09T21:22:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28751a6640 1 -- 172.21.15.37:0/2844769402 learned_addr learned my addr 172.21.15.37:0/2844769402 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28759a7640 1 -- 172.21.15.37:0/2844769402 >> v1:172.21.15.119:6789/0 conn(0x7f28700d0780 legacy=0x7f28700d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28759a7640 1 -- 172.21.15.37:0/2844769402 >> v1:172.21.15.37:6789/0 conn(0x7f28700ceb80 legacy=0x7f28700cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28759a7640 1 -- 172.21.15.37:0/2844769402 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28700d02f0 con 0x7f28700b7980 2023-07-09T21:22:42.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28759a7640 1 --2- 172.21.15.37:0/2844769402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870160030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097c0 tx=0x7f286c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f936e62021a4f8aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28749a5640 1 -- 172.21.15.37:0/2844769402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0ab600 con 0x7f28700b7980 2023-07-09T21:22:42.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28749a5640 1 -- 172.21.15.37:0/2844769402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c0a7050 con 0x7f28700b7980 2023-07-09T21:22:42.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.614+0000 7f28749a5640 1 -- 172.21.15.37:0/2844769402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0ab980 con 0x7f28700b7980 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- 172.21.15.37:0/2844769402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 msgr2=0x7f2870160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 --2- 172.21.15.37:0/2844769402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870160030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097c0 tx=0x7f286c01c440 comp rx=0 tx=0).stop 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- 172.21.15.37:0/2844769402 shutdown_connections 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 --2- 172.21.15.37:0/2844769402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870160030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- 172.21.15.37:0/2844769402 >> 172.21.15.37:0/2844769402 conn(0x7f2870073090 msgr2=0x7f2870069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- 172.21.15.37:0/2844769402 shutdown_connections 2023-07-09T21:22:42.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- 172.21.15.37:0/2844769402 wait complete. 2023-07-09T21:22:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 Processor -- start 2023-07-09T21:22:42.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- start start 2023-07-09T21:22:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28700ceb80 0x7f28700b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28700d0780 0x7f2870151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287014bea0 con 0x7f28700b7980 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870153820 con 0x7f28700d0780 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f2877c0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2870153b00 con 0x7f28700ceb80 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34566/0 (socket says 172.21.15.37:34566) 2023-07-09T21:22:42.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 -- 172.21.15.37:0/3129943859 learned_addr learned my addr 172.21.15.37:0/3129943859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28751a6640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28700ceb80 0x7f28700b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28761a8640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28700d0780 0x7f2870151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 -- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28700ceb80 msgr2=0x7f28700b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28700ceb80 0x7f28700b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 -- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28700d0780 msgr2=0x7f2870151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28700d0780 0x7f2870151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.618+0000 7f28759a7640 1 -- 172.21.15.37:0/3129943859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009420 con 0x7f28700b7980 2023-07-09T21:22:42.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28759a7640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f286c019050 tx=0x7f286c01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0b7860 con 0x7f28700b7980 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c0abe90 con 0x7f28700b7980 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c0b7c20 con 0x7f28700b7980 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2870153de0 con 0x7f28700b7980 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28701543a0 con 0x7f28700b7980 2023-07-09T21:22:42.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287014fee0 con 0x7f28700b7980 2023-07-09T21:22:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f286c0c2460 con 0x7f28700b7980 2023-07-09T21:22:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 0x7f2854068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f286c11e7c0 con 0x7f28700b7980 2023-07-09T21:22:42.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.622+0000 7f28751a6640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 0x7f2854068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.626+0000 7f28751a6640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 0x7f2854068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28701f7d20 tx=0x7f2860009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.626+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f286c0ebc40 con 0x7f28700b7980 2023-07-09T21:22:42.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.778+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28700737d0 con 0x7f28700b7980 2023-07-09T21:22:42.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.778+0000 7f28667fc640 1 -- 172.21.15.37:0/3129943859 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28700737d0 con 0x7f28700b7980 2023-07-09T21:22:42.784 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:22:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 msgr2=0x7f2854068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 0x7f2854068730 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f28701f7d20 tx=0x7f2860009040 comp rx=0 tx=0).stop 2023-07-09T21:22:42.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 msgr2=0x7f2870154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f286c019050 tx=0x7f286c01ac80 comp rx=0 tx=0).stop 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 shutdown_connections 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2854066280 0x7f2854068730 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28700d0780 0x7f2870151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28700ceb80 0x7f28700b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 --2- 172.21.15.37:0/3129943859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28700b7980 0x7f2870154b40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 >> 172.21.15.37:0/3129943859 conn(0x7f2870073090 msgr2=0x7f28701576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 shutdown_connections 2023-07-09T21:22:42.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.782+0000 7f2877c0b640 1 -- 172.21.15.37:0/3129943859 wait complete. 2023-07-09T21:22:42.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:22:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 Processor -- start 2023-07-09T21:22:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 -- start start 2023-07-09T21:22:42.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 0x7fd2b0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00ceb80 0x7fd2b00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2b015bf80 con 0x7fd2b00b3c20 2023-07-09T21:22:42.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00cd070 con 0x7fd2b00ceb80 2023-07-09T21:22:42.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b7019640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00cfd70 con 0x7fd2b00b7980 2023-07-09T21:22:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00ceb80 0x7fd2b00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00ceb80 0x7fd2b00cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34572/0 (socket says 172.21.15.37:34572) 2023-07-09T21:22:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 -- 172.21.15.37:0/514078167 learned_addr learned my addr 172.21.15.37:0/514078167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:42.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b4db5640 1 --2- 172.21.15.37:0/514078167 >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 0x7fd2b0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 -- 172.21.15.37:0/514078167 >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 msgr2=0x7fd2b0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:42.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 --2- 172.21.15.37:0/514078167 >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 0x7fd2b0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 -- 172.21.15.37:0/514078167 >> v1:172.21.15.119:6789/0 conn(0x7fd2b00b3c20 legacy=0x7fd2b00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2a7fff640 1 -- 172.21.15.37:0/514078167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b0160570 con 0x7fd2b00ceb80 2023-07-09T21:22:42.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.946+0000 7fd2b4db5640 1 --2- 172.21.15.37:0/514078167 >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 0x7fd2b0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2a7fff640 1 --2- 172.21.15.37:0/514078167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00cefc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0069aa0 tx=0x7fd2a001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2140b120375738a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2a77fe640 1 -- 172.21.15.37:0/514078167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00ab600 con 0x7fd2b00ceb80 2023-07-09T21:22:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2a77fe640 1 -- 172.21.15.37:0/514078167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00a7050 con 0x7fd2b00ceb80 2023-07-09T21:22:42.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2a77fe640 1 -- 172.21.15.37:0/514078167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a00ab980 con 0x7fd2b00ceb80 2023-07-09T21:22:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 -- 172.21.15.37:0/514078167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ceb80 msgr2=0x7fd2b00cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 --2- 172.21.15.37:0/514078167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00cefc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0069aa0 tx=0x7fd2a001c500 comp rx=0 tx=0).stop 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 -- 172.21.15.37:0/514078167 shutdown_connections 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 --2- 172.21.15.37:0/514078167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00cefc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 --2- 172.21.15.37:0/514078167 >> v2:172.21.15.119:3300/0 conn(0x7fd2b00b7980 0x7fd2b0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 -- 172.21.15.37:0/514078167 >> 172.21.15.37:0/514078167 conn(0x7fd2b0073090 msgr2=0x7fd2b0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 -- 172.21.15.37:0/514078167 shutdown_connections 2023-07-09T21:22:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.950+0000 7fd2b7019640 1 -- 172.21.15.37:0/514078167 wait complete. 2023-07-09T21:22:42.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 Processor -- start 2023-07-09T21:22:42.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- start start 2023-07-09T21:22:42.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2b00b7980 0x7fd2b0152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0154500 con 0x7fd2b00b3c20 2023-07-09T21:22:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0152c40 con 0x7fd2b00ceb80 2023-07-09T21:22:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b0152f20 con 0x7fd2b00b7980 2023-07-09T21:22:42.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34580/0 (socket says 172.21.15.37:34580) 2023-07-09T21:22:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 -- 172.21.15.37:0/925549542 learned_addr learned my addr 172.21.15.37:0/925549542 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:42.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2a7fff640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2b00b7980 0x7fd2b0152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b55b6640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 -- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2b00b7980 msgr2=0x7fd2b0152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2b00b7980 0x7fd2b0152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 -- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b00ceb80 msgr2=0x7fd2b00c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 -- 172.21.15.37:0/925549542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a00094d0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b4db5640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e810 tx=0x7fd2ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00c8d0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac00ca30 con 0x7fd2b00b3c20 2023-07-09T21:22:42.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00cde0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b0153200 con 0x7fd2b00b3c20 2023-07-09T21:22:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b01537c0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.954+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b004d7d0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.958+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd2ac013410 con 0x7fd2b00b3c20 2023-07-09T21:22:42.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.958+0000 7fd2a57fa640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:42.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.958+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd2ac083af0 con 0x7fd2b00b3c20 2023-07-09T21:22:42.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.958+0000 7fd2a7fff640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:42.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.958+0000 7fd2a7fff640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 0x7fd29c068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00ad000 tx=0x7fd2a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:42.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:42.962+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2ac051010 con 0x7fd2b00b3c20 2023-07-09T21:22:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.114+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd2b00cff50 con 0x7fd2b00b3c20 2023-07-09T21:22:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.114+0000 7fd2a57fa640 1 -- 172.21.15.37:0/925549542 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2ac054630 con 0x7fd2b00b3c20 2023-07-09T21:22:43.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:22:43.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 msgr2=0x7fd29c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 0x7fd29c068730 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00ad000 tx=0x7fd2a0008040 comp rx=0 tx=0).stop 2023-07-09T21:22:43.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 msgr2=0x7fd2b0153fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00e810 tx=0x7fd2ac00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 shutdown_connections 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd29c066280 0x7fd29c068730 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2b00ceb80 0x7fd2b00c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2b00b7980 0x7fd2b0152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 --2- 172.21.15.37:0/925549542 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00b3c20 0x7fd2b0153fc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 >> 172.21.15.37:0/925549542 conn(0x7fd2b0073090 msgr2=0x7fd2b00b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 shutdown_connections 2023-07-09T21:22:43.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.118+0000 7fd2b7019640 1 -- 172.21.15.37:0/925549542 wait complete. 2023-07-09T21:22:43.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:22:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 Processor -- start 2023-07-09T21:22:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 -- start start 2023-07-09T21:22:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40b7ab0 0x7fe0f406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0f40b4340 0x7fe0f40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f40b49f0 con 0x7fe0f40cef80 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f40b7e80 con 0x7fe0f40b4340 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0faffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40cc8a0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0f40b4340 0x7fe0f40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0f40b4340 0x7fe0f40d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34594/0 (socket says 172.21.15.37:34594) 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0f40cef80 0x7fe0f40b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57202/0 (socket says 172.21.15.37:57202) 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 -- 172.21.15.37:0/2817314663 learned_addr learned my addr 172.21.15.37:0/2817314663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f8d96640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40b7ab0 0x7fe0f406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 -- 172.21.15.37:0/2817314663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40b7ab0 msgr2=0x7fe0f406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40b7ab0 0x7fe0f406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 -- 172.21.15.37:0/2817314663 >> v1:172.21.15.37:6789/0 conn(0x7fe0f40cef80 legacy=0x7fe0f40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f9597640 1 -- 172.21.15.37:0/2817314663 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40ccb80 con 0x7fe0f40b4340 2023-07-09T21:22:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.278+0000 7fe0f37fe640 1 -- 172.21.15.37:0/2817314663 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410983389 0 0) 0x7fe0f40b49f0 con 0x7fe0f40cef80 2023-07-09T21:22:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0f9597640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b4340 0x7fe0f40d02a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e50 tx=0x7fe0ec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912b860e3c308c25 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0f37fe640 1 -- 172.21.15.37:0/2817314663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0a58a0 con 0x7fe0f40b4340 2023-07-09T21:22:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0f37fe640 1 -- 172.21.15.37:0/2817314663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec0a5a00 con 0x7fe0f40b4340 2023-07-09T21:22:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0f37fe640 1 -- 172.21.15.37:0/2817314663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0a5d90 con 0x7fe0f40b4340 2023-07-09T21:22:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 -- 172.21.15.37:0/2817314663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b4340 msgr2=0x7fe0f40d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b4340 0x7fe0f40d02a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009e50 tx=0x7fe0ec01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 -- 172.21.15.37:0/2817314663 shutdown_connections 2023-07-09T21:22:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b4340 0x7fe0f40d02a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2817314663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40b7ab0 0x7fe0f406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 -- 172.21.15.37:0/2817314663 >> 172.21.15.37:0/2817314663 conn(0x7fe0f4073090 msgr2=0x7fe0f4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 -- 172.21.15.37:0/2817314663 shutdown_connections 2023-07-09T21:22:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.282+0000 7fe0faffa640 1 -- 172.21.15.37:0/2817314663 wait complete. 2023-07-09T21:22:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 Processor -- start 2023-07-09T21:22:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- start start 2023-07-09T21:22:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0f40b4340 0x7fe0f40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40cef80 0x7fe0f40c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4155880 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4154a10 con 0x7fe0f40b4340 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4154c70 con 0x7fe0f40cef80 2023-07-09T21:22:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34598/0 (socket says 172.21.15.37:34598) 2023-07-09T21:22:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 -- 172.21.15.37:0/2993786537 learned_addr learned my addr 172.21.15.37:0/2993786537 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f8d96640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0f40b4340 0x7fe0f40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f9597640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40cef80 0x7fe0f40c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 -- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40cef80 msgr2=0x7fe0f40c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40cef80 0x7fe0f40c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 -- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0f40b4340 msgr2=0x7fe0f40cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0f40b4340 0x7fe0f40cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 -- 172.21.15.37:0/2993786537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec009b30 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f3fff640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c480 tx=0x7fe0e000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e00074e0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e0007660 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0004a30 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f4154f50 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f4155510 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.286+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f41559f0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.290+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe0e0004b90 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.290+0000 7fe0f17fa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.290+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe0e0082eb0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.290+0000 7fe0f8d96640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.290+0000 7fe0f8d96640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 0x7fe0d8068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009b60 tx=0x7fe0e8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.294+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0e00503d0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.478+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f404d7d0 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.478+0000 7fe0f17fa640 1 -- 172.21.15.37:0/2993786537 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7fe0e0018020 con 0x7fe0f40b7ab0 2023-07-09T21:22:43.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:43.485 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:22:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:22:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 msgr2=0x7fe0d8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 0x7fe0d8068730 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009b60 tx=0x7fe0e8009190 comp rx=0 tx=0).stop 2023-07-09T21:22:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 msgr2=0x7fe0f41544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000c480 tx=0x7fe0e000c940 comp rx=0 tx=0).stop 2023-07-09T21:22:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 shutdown_connections 2023-07-09T21:22:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0d8066280 0x7fe0d8068730 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0f40cef80 0x7fe0f40c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0f40b7ab0 0x7fe0f41544d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 --2- 172.21.15.37:0/2993786537 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0f40b4340 0x7fe0f40cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 >> 172.21.15.37:0/2993786537 conn(0x7fe0f4073090 msgr2=0x7fe0f40b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 shutdown_connections 2023-07-09T21:22:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.482+0000 7fe0faffa640 1 -- 172.21.15.37:0/2993786537 wait complete. 2023-07-09T21:22:43.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 Processor -- start 2023-07-09T21:22:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 -- start start 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 0x7f6d9006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d900b49f0 con 0x7f6d900b7ab0 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d900cc8a0 con 0x7f6d900b4340 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d94fdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900b7e80 con 0x7f6d900cef80 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d8e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d900b7ab0 0x7f6d900b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57206/0 (socket says 172.21.15.37:57206) 2023-07-09T21:22:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.642+0000 7f6d8e59c640 1 -- 172.21.15.37:0/1159682735 learned_addr learned my addr 172.21.15.37:0/1159682735 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8ed9d640 1 --2- 172.21.15.37:0/1159682735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 0x7f6d9006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975484195 0 0) 0x7f6d900b49f0 con 0x7f6d900b7ab0 2023-07-09T21:22:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d7c003530 con 0x7f6d900b7ab0 2023-07-09T21:22:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8ed9d640 1 -- 172.21.15.37:0/1159682735 >> v1:172.21.15.119:6789/0 conn(0x7f6d900b4340 legacy=0x7f6d900d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8ed9d640 1 -- 172.21.15.37:0/1159682735 >> v1:172.21.15.37:6789/0 conn(0x7f6d900b7ab0 legacy=0x7f6d900b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504870926 0 0) 0x7f6d900cc8a0 con 0x7f6d900b4340 2023-07-09T21:22:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8ed9d640 1 -- 172.21.15.37:0/1159682735 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900ccb80 con 0x7f6d900cef80 2023-07-09T21:22:43.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.646+0000 7f6d8ed9d640 1 --2- 172.21.15.37:0/1159682735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 0x7f6d9006aa50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009dc0 tx=0x7f6d8801c780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62db763a60f18869 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80001600 con 0x7f6d900cef80 2023-07-09T21:22:43.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d880a5600 con 0x7f6d900cef80 2023-07-09T21:22:43.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8dd9b640 1 -- 172.21.15.37:0/1159682735 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880a5990 con 0x7f6d900cef80 2023-07-09T21:22:43.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- 172.21.15.37:0/1159682735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 msgr2=0x7f6d9006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/1159682735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 0x7f6d9006aa50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009dc0 tx=0x7f6d8801c780 comp rx=0 tx=0).stop 2023-07-09T21:22:43.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- 172.21.15.37:0/1159682735 shutdown_connections 2023-07-09T21:22:43.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/1159682735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900cef80 0x7f6d9006aa50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- 172.21.15.37:0/1159682735 >> 172.21.15.37:0/1159682735 conn(0x7f6d90073090 msgr2=0x7f6d90069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- 172.21.15.37:0/1159682735 shutdown_connections 2023-07-09T21:22:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- 172.21.15.37:0/1159682735 wait complete. 2023-07-09T21:22:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 Processor -- start 2023-07-09T21:22:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- start start 2023-07-09T21:22:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900b7ab0 0x7f6d900c66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d900cef80 0x7f6d900ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c7040 con 0x7f6d900b4340 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c7320 con 0x7f6d900cef80 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d94fdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c7600 con 0x7f6d900b7ab0 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34614/0 (socket says 172.21.15.37:34614) 2023-07-09T21:22:43.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.650+0000 7f6d8e59c640 1 -- 172.21.15.37:0/2769421764 learned_addr learned my addr 172.21.15.37:0/2769421764 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8ed9d640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d900cef80 0x7f6d900ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d87fff640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900b7ab0 0x7f6d900c66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 -- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900b7ab0 msgr2=0x7f6d900c66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900b7ab0 0x7f6d900c66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 -- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d900cef80 msgr2=0x7f6d900ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d900cef80 0x7f6d900ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 -- 172.21.15.37:0/2769421764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d88009a70 con 0x7f6d900b4340 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d8e59c640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c730 tx=0x7f6d8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800074e0 con 0x7f6d900b4340 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d80007660 con 0x7f6d900b4340 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80004a30 con 0x7f6d900b4340 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d900c78e0 con 0x7f6d900b4340 2023-07-09T21:22:43.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d900c6be0 con 0x7f6d900b4340 2023-07-09T21:22:43.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9004d7d0 con 0x7f6d900b4340 2023-07-09T21:22:43.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d80004c50 con 0x7f6d900b4340 2023-07-09T21:22:43.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 0x7f6d70068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.654+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6d800833d0 con 0x7f6d900b4340 2023-07-09T21:22:43.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.658+0000 7f6d87fff640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 0x7f6d70068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.658+0000 7f6d87fff640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 0x7f6d70068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d78007b30 tx=0x7f6d78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:43.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.658+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d80050720 con 0x7f6d900b4340 2023-07-09T21:22:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.818+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d9006a830 con 0x7f6d900b4340 2023-07-09T21:22:43.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d86ffd640 1 -- 172.21.15.37:0/2769421764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f6d80018020 con 0x7f6d900b4340 2023-07-09T21:22:43.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:43.827 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:43.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 msgr2=0x7f6d70068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 0x7f6d70068730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d78007b30 tx=0x7f6d78009040 comp rx=0 tx=0).stop 2023-07-09T21:22:43.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 msgr2=0x7f6d901f6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f6d8000c730 tx=0x7f6d8000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 shutdown_connections 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6d70066280 0x7f6d70068730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d900cef80 0x7f6d900ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d900b7ab0 0x7f6d900c66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 --2- 172.21.15.37:0/2769421764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d900b4340 0x7f6d901f6bb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 >> 172.21.15.37:0/2769421764 conn(0x7f6d90073090 msgr2=0x7f6d901565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 shutdown_connections 2023-07-09T21:22:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.822+0000 7f6d94fdb640 1 -- 172.21.15.37:0/2769421764 wait complete. 2023-07-09T21:22:43.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:43.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:43.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 Processor -- start 2023-07-09T21:22:43.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 -- start start 2023-07-09T21:22:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f645c159990 0x7f645c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f645c0c99e0 0x7f645c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c0c4c90 con 0x7f645c1595c0 2023-07-09T21:22:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0ca730 con 0x7f645c159990 2023-07-09T21:22:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6460b3a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c0ca170 con 0x7f645c0c99e0 2023-07-09T21:22:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6453fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f645c159990 0x7f645c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6453fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f645c159990 0x7f645c0c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34624/0 (socket says 172.21.15.37:34624) 2023-07-09T21:22:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.990+0000 7f6453fff640 1 -- 172.21.15.37:0/3873383526 learned_addr learned my addr 172.21.15.37:0/3873383526 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f645ad9d640 1 --2- 172.21.15.37:0/3873383526 >> v2:172.21.15.119:3300/0 conn(0x7f645c0c99e0 0x7f645c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6453fff640 1 -- 172.21.15.37:0/3873383526 >> v2:172.21.15.119:3300/0 conn(0x7f645c0c99e0 msgr2=0x7f645c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6453fff640 1 --2- 172.21.15.37:0/3873383526 >> v2:172.21.15.119:3300/0 conn(0x7f645c0c99e0 0x7f645c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6453fff640 1 -- 172.21.15.37:0/3873383526 >> v1:172.21.15.37:6789/0 conn(0x7f645c1595c0 legacy=0x7f645c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6453fff640 1 -- 172.21.15.37:0/3873383526 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0ca450 con 0x7f645c159990 2023-07-09T21:22:43.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6459d9b640 1 -- 172.21.15.37:0/3873383526 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884637156 0 0) 0x7f644c001120 con 0x7f645c1595c0 2023-07-09T21:22:44.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6453fff640 1 --2- 172.21.15.37:0/3873383526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c159990 0x7f645c0c4750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f645c0cebf0 tx=0x7f644401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fa9aac7196fe6b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6459d9b640 1 -- 172.21.15.37:0/3873383526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ac640 con 0x7f645c159990 2023-07-09T21:22:44.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6459d9b640 1 -- 172.21.15.37:0/3873383526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440ac7a0 con 0x7f645c159990 2023-07-09T21:22:44.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.994+0000 7f6459d9b640 1 -- 172.21.15.37:0/3873383526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440acb30 con 0x7f645c159990 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- 172.21.15.37:0/3873383526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c159990 msgr2=0x7f645c0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- 172.21.15.37:0/3873383526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c159990 0x7f645c0c4750 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f645c0cebf0 tx=0x7f644401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- 172.21.15.37:0/3873383526 shutdown_connections 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- 172.21.15.37:0/3873383526 >> v2:172.21.15.119:3300/0 conn(0x7f645c0c99e0 0x7f645c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- 172.21.15.37:0/3873383526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c159990 0x7f645c0c4750 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- 172.21.15.37:0/3873383526 >> 172.21.15.37:0/3873383526 conn(0x7f645c0cde40 msgr2=0x7f645c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- 172.21.15.37:0/3873383526 shutdown_connections 2023-07-09T21:22:44.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- 172.21.15.37:0/3873383526 wait complete. 2023-07-09T21:22:44.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 Processor -- start 2023-07-09T21:22:44.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- start start 2023-07-09T21:22:44.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 0x7f645c0b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 0x7f645c13b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0c4e80 con 0x7f645c1595c0 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c151d40 con 0x7f645c0c99e0 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6460b3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0b3350 con 0x7f645c159990 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34640/0 (socket says 172.21.15.37:34640) 2023-07-09T21:22:44.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 -- 172.21.15.37:0/411501435 learned_addr learned my addr 172.21.15.37:0/411501435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f645a59c640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 0x7f645c0b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f645ad9d640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 0x7f645c13b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 -- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 msgr2=0x7f645c13b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 0x7f645c13b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 -- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 msgr2=0x7f645c0b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 0x7f645c0b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f6453fff640 1 -- 172.21.15.37:0/411501435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440094d0 con 0x7f645c1595c0 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f645a59c640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 0x7f645c0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:43.998+0000 7f645ad9d640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 0x7f645c13b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:44.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6453fff640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64440190e0 tx=0x7f6444019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444004230 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6444004390 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444003820 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c0b3630 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c0b3bf0 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c0c4ff0 con 0x7f645c1595c0 2023-07-09T21:22:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6444003980 con 0x7f645c1595c0 2023-07-09T21:22:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 0x7f643c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f644411ea30 con 0x7f645c1595c0 2023-07-09T21:22:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.002+0000 7f645a59c640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 0x7f643c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.006+0000 7f645a59c640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 0x7f643c068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f644c001380 tx=0x7f644c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.006+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64440ebea0 con 0x7f645c1595c0 2023-07-09T21:22:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f645c04d7d0 con 0x7f645c1595c0 2023-07-09T21:22:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6452ffd640 1 -- 172.21.15.37:0/411501435 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f64440b10a0 con 0x7f645c1595c0 2023-07-09T21:22:44.167 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 msgr2=0x7f643c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 0x7f643c068730 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f644c001380 tx=0x7f644c009040 comp rx=0 tx=0).stop 2023-07-09T21:22:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 msgr2=0x7f645c151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f64440190e0 tx=0x7f6444019270 comp rx=0 tx=0).stop 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 shutdown_connections 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f643c066280 0x7f643c068730 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f645c159990 0x7f645c13b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f645c1595c0 0x7f645c151800 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 --2- 172.21.15.37:0/411501435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f645c0c99e0 0x7f645c0b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 >> 172.21.15.37:0/411501435 conn(0x7f645c0cde40 msgr2=0x7f645c156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 shutdown_connections 2023-07-09T21:22:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.162+0000 7f6460b3a640 1 -- 172.21.15.37:0/411501435 wait complete. 2023-07-09T21:22:44.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:44.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 Processor -- start 2023-07-09T21:22:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 -- start start 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700b7980 0x7fea70160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea700ceb80 0x7fea700cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea7015bf80 con 0x7fea700b3c20 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea700cd070 con 0x7fea700ceb80 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea77056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea700cfd70 con 0x7fea700b7980 2023-07-09T21:22:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea700ceb80 0x7fea700cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fea700ceb80 0x7fea700cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34648/0 (socket says 172.21.15.37:34648) 2023-07-09T21:22:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 -- 172.21.15.37:0/2913676237 learned_addr learned my addr 172.21.15.37:0/2913676237 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea74df2640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700b7980 0x7fea70160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 -- 172.21.15.37:0/2913676237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700b7980 msgr2=0x7fea70160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700b7980 0x7fea70160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 -- 172.21.15.37:0/2913676237 >> v1:172.21.15.119:6789/0 conn(0x7fea700b3c20 legacy=0x7fea700b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.330+0000 7fea6ffff640 1 -- 172.21.15.37:0/2913676237 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea70160570 con 0x7fea700ceb80 2023-07-09T21:22:44.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700ceb80 0x7fea700cef90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009870 tx=0x7fea5c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc40d15a15e0a1f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea6f7fe640 1 -- 172.21.15.37:0/2913676237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0ab600 con 0x7fea700ceb80 2023-07-09T21:22:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea6f7fe640 1 -- 172.21.15.37:0/2913676237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c0a7050 con 0x7fea700ceb80 2023-07-09T21:22:44.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea6f7fe640 1 -- 172.21.15.37:0/2913676237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c0ab980 con 0x7fea700ceb80 2023-07-09T21:22:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 -- 172.21.15.37:0/2913676237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700ceb80 msgr2=0x7fea700cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700ceb80 0x7fea700cef90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009870 tx=0x7fea5c01c540 comp rx=0 tx=0).stop 2023-07-09T21:22:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 -- 172.21.15.37:0/2913676237 shutdown_connections 2023-07-09T21:22:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700ceb80 0x7fea700cef90 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 --2- 172.21.15.37:0/2913676237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700b7980 0x7fea70160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 -- 172.21.15.37:0/2913676237 >> 172.21.15.37:0/2913676237 conn(0x7fea70073090 msgr2=0x7fea70069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 -- 172.21.15.37:0/2913676237 shutdown_connections 2023-07-09T21:22:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.334+0000 7fea77056640 1 -- 172.21.15.37:0/2913676237 wait complete. 2023-07-09T21:22:44.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 Processor -- start 2023-07-09T21:22:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- start start 2023-07-09T21:22:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 0x7fea7015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700ceb80 0x7fea700b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015efe0 con 0x7fea700b3c20 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015c250 con 0x7fea700b7980 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7015c530 con 0x7fea700ceb80 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34658/0 (socket says 172.21.15.37:34658) 2023-07-09T21:22:44.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 -- 172.21.15.37:0/2832931120 learned_addr learned my addr 172.21.15.37:0/2832931120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:44.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 0x7fea7015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea755f3640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700ceb80 0x7fea700b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 -- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700ceb80 msgr2=0x7fea700b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700ceb80 0x7fea700b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 -- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 msgr2=0x7fea7015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 0x7fea7015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 -- 172.21.15.37:0/2832931120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0094d0 con 0x7fea700b3c20 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 0x7fea7015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea74df2640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea6400e930 tx=0x7fea6400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea64009690 con 0x7fea700b3c20 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea6400ca00 con 0x7fea700b3c20 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea6400cd70 con 0x7fea700b3c20 2023-07-09T21:22:44.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea7015c810 con 0x7fea700b3c20 2023-07-09T21:22:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.338+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea700d1df0 con 0x7fea700b3c20 2023-07-09T21:22:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea7004d7d0 con 0x7fea700b3c20 2023-07-09T21:22:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fea64013470 con 0x7fea700b3c20 2023-07-09T21:22:44.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea6d7fa640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 0x7fea54068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fea64084000 con 0x7fea700b3c20 2023-07-09T21:22:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 0x7fea54068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.342+0000 7fea6ffff640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 0x7fea54068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea7008ad30 tx=0x7fea5c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.346+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea64051530 con 0x7fea700b3c20 2023-07-09T21:22:44.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.502+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fea700b1600 con 0x7fea700b3c20 2023-07-09T21:22:44.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.502+0000 7fea6d7fa640 1 -- 172.21.15.37:0/2832931120 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fea64054b50 con 0x7fea700b3c20 2023-07-09T21:22:44.509 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 msgr2=0x7fea54068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 0x7fea54068730 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fea7008ad30 tx=0x7fea5c0a6000 comp rx=0 tx=0).stop 2023-07-09T21:22:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 msgr2=0x7fea70154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fea6400e930 tx=0x7fea6400edf0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 shutdown_connections 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fea54066280 0x7fea54068730 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea700ceb80 0x7fea700b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea700b7980 0x7fea7015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 --2- 172.21.15.37:0/2832931120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea700b3c20 0x7fea70154470 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 >> 172.21.15.37:0/2832931120 conn(0x7fea70073090 msgr2=0x7fea700b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 shutdown_connections 2023-07-09T21:22:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.506+0000 7fea77056640 1 -- 172.21.15.37:0/2832931120 wait complete. 2023-07-09T21:22:44.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:22:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 Processor -- start 2023-07-09T21:22:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 -- start start 2023-07-09T21:22:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a40cf290 0x7f06a4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 0x7f06a40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a415bf80 con 0x7f06a40b7980 2023-07-09T21:22:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a40cd070 con 0x7f06a40cf290 2023-07-09T21:22:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a9f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a40cfd70 con 0x7f06a40d0780 2023-07-09T21:22:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a40cf290 0x7f06a4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06a40cf290 0x7f06a4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34672/0 (socket says 172.21.15.37:34672) 2023-07-09T21:22:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 -- 172.21.15.37:0/231868335 learned_addr learned my addr 172.21.15.37:0/231868335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a37fe640 1 --1- 172.21.15.37:0/231868335 >> v1:172.21.15.37:6789/0 conn(0x7f06a40b7980 0x7f06a40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57210/0 (socket says 172.21.15.37:57210) 2023-07-09T21:22:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a3fff640 1 --2- 172.21.15.37:0/231868335 >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 0x7f06a40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 -- 172.21.15.37:0/231868335 >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 msgr2=0x7f06a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 --2- 172.21.15.37:0/231868335 >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 0x7f06a40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 -- 172.21.15.37:0/231868335 >> v1:172.21.15.37:6789/0 conn(0x7f06a40b7980 legacy=0x7f06a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a2ffd640 1 -- 172.21.15.37:0/231868335 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4160570 con 0x7f06a40cf290 2023-07-09T21:22:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.670+0000 7f06a3fff640 1 --2- 172.21.15.37:0/231868335 >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 0x7f06a40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a2ffd640 1 --2- 172.21.15.37:0/231868335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40cf290 0x7f06a4160030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f06a40b1240 tx=0x7f069801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3b71560830224c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a27fc640 1 -- 172.21.15.37:0/231868335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980ab600 con 0x7f06a40cf290 2023-07-09T21:22:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a27fc640 1 -- 172.21.15.37:0/231868335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06980a7050 con 0x7f06a40cf290 2023-07-09T21:22:44.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a27fc640 1 -- 172.21.15.37:0/231868335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06980ab980 con 0x7f06a40cf290 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 -- 172.21.15.37:0/231868335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40cf290 msgr2=0x7f06a4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 --2- 172.21.15.37:0/231868335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40cf290 0x7f06a4160030 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f06a40b1240 tx=0x7f069801c500 comp rx=0 tx=0).stop 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 -- 172.21.15.37:0/231868335 shutdown_connections 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 --2- 172.21.15.37:0/231868335 >> v2:172.21.15.119:3300/0 conn(0x7f06a40d0780 0x7f06a40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 --2- 172.21.15.37:0/231868335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40cf290 0x7f06a4160030 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 -- 172.21.15.37:0/231868335 >> 172.21.15.37:0/231868335 conn(0x7f06a4073090 msgr2=0x7f06a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 -- 172.21.15.37:0/231868335 shutdown_connections 2023-07-09T21:22:44.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.674+0000 7f06a9f40640 1 -- 172.21.15.37:0/231868335 wait complete. 2023-07-09T21:22:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 Processor -- start 2023-07-09T21:22:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- start start 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06a40b7980 0x7f06a40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06a40cf290 0x7f06a414f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a4154310 con 0x7f06a40d0780 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41545f0 con 0x7f06a40b7980 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a41548d0 con 0x7f06a40cf290 2023-07-09T21:22:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34678/0 (socket says 172.21.15.37:34678) 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 -- 172.21.15.37:0/850460195 learned_addr learned my addr 172.21.15.37:0/850460195 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a37fe640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06a40b7980 0x7f06a40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a2ffd640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06a40cf290 0x7f06a414f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 -- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06a40cf290 msgr2=0x7f06a414f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06a40cf290 0x7f06a414f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 -- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06a40b7980 msgr2=0x7f06a40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06a40b7980 0x7f06a40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 -- 172.21.15.37:0/850460195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06980094d0 con 0x7f06a40d0780 2023-07-09T21:22:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a3fff640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f069c00cd50 tx=0x7f069c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00f680 con 0x7f06a40d0780 2023-07-09T21:22:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069c00f800 con 0x7f06a40d0780 2023-07-09T21:22:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c00fbb0 con 0x7f06a40d0780 2023-07-09T21:22:44.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a4152fb0 con 0x7f06a40d0780 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.678+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a414fa10 con 0x7f06a40d0780 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a41534d0 con 0x7f06a40d0780 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f069c00b040 con 0x7f06a40d0780 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f068bfff640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 0x7f0690068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f069c084840 con 0x7f06a40d0780 2023-07-09T21:22:44.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f06a37fe640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 0x7f0690068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.682+0000 7f06a37fe640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 0x7f0690068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0694000f70 tx=0x7f0694007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:44.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.686+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06a41534d0 con 0x7f06a40d0780 2023-07-09T21:22:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.842+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06a41534d0 con 0x7f06a40d0780 2023-07-09T21:22:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f068bfff640 1 -- 172.21.15.37:0/850460195 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06a41534d0 con 0x7f06a40d0780 2023-07-09T21:22:44.850 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:22:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 msgr2=0x7f0690068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 0x7f0690068730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0694000f70 tx=0x7f0694007c90 comp rx=0 tx=0).stop 2023-07-09T21:22:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 msgr2=0x7f06a41537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f069c00cd50 tx=0x7f069c00a650 comp rx=0 tx=0).stop 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 shutdown_connections 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0690066280 0x7f0690068730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06a40d0780 0x7f06a41537b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06a40cf290 0x7f06a414f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 --2- 172.21.15.37:0/850460195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06a40b7980 0x7f06a40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 >> 172.21.15.37:0/850460195 conn(0x7f06a4073090 msgr2=0x7f06a415fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 shutdown_connections 2023-07-09T21:22:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:44.846+0000 7f06a9f40640 1 -- 172.21.15.37:0/850460195 wait complete. 2023-07-09T21:22:44.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:22:45.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 Processor -- start 2023-07-09T21:22:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 -- start start 2023-07-09T21:22:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2200b7980 0x7ff220160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 0x7ff2200cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff2200b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200cd070 con 0x7ff2200b7980 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2200cfd70 con 0x7ff2200ceb80 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.010+0000 7ff224974640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff22015bf80 con 0x7ff2200b3c20 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2200b7980 0x7ff220160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2200b7980 0x7ff220160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34692/0 (socket says 172.21.15.37:34692) 2023-07-09T21:22:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 -- 172.21.15.37:0/37902087 learned_addr learned my addr 172.21.15.37:0/37902087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21ed9d640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff2200b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21dd9b640 1 --2- 172.21.15.37:0/37902087 >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 0x7ff2200cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 -- 172.21.15.37:0/37902087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 msgr2=0x7ff2200b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff2200b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 -- 172.21.15.37:0/37902087 >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 msgr2=0x7ff2200cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 --2- 172.21.15.37:0/37902087 >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 0x7ff2200cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 -- 172.21.15.37:0/37902087 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff220160570 con 0x7ff2200b7980 2023-07-09T21:22:45.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21ed9d640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff2200b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:45.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21dd9b640 1 --2- 172.21.15.37:0/37902087 >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 0x7ff2200cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21e59c640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff220160030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b4cd0 tx=0x7ff21001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee0b012870f5f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21d59a640 1 -- 172.21.15.37:0/37902087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100ab600 con 0x7ff2200b7980 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21d59a640 1 -- 172.21.15.37:0/37902087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2100a7050 con 0x7ff2200b7980 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.014+0000 7ff21d59a640 1 -- 172.21.15.37:0/37902087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2100ab980 con 0x7ff2200b7980 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- 172.21.15.37:0/37902087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 msgr2=0x7ff220160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff220160030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff2200b4cd0 tx=0x7ff21001c500 comp rx=0 tx=0).stop 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- 172.21.15.37:0/37902087 shutdown_connections 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff2200b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- 172.21.15.37:0/37902087 >> v2:172.21.15.119:3300/0 conn(0x7ff2200ceb80 0x7ff2200cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- 172.21.15.37:0/37902087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff220160030 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- 172.21.15.37:0/37902087 >> 172.21.15.37:0/37902087 conn(0x7ff220073090 msgr2=0x7ff220069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- 172.21.15.37:0/37902087 shutdown_connections 2023-07-09T21:22:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- 172.21.15.37:0/37902087 wait complete. 2023-07-09T21:22:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 Processor -- start 2023-07-09T21:22:45.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- start start 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff220149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 0x7ff22014a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2201562c0 con 0x7ff2200b7980 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c8a00 con 0x7ff2200ceb80 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff224974640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2200c5d70 con 0x7ff2200b3c20 2023-07-09T21:22:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34696/0 (socket says 172.21.15.37:34696) 2023-07-09T21:22:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 -- 172.21.15.37:0/3992282240 learned_addr learned my addr 172.21.15.37:0/3992282240 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21ed9d640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 0x7ff22014a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21e59c640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff220149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 -- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 msgr2=0x7ff220149d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff220149d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 -- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 msgr2=0x7ff22014a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 0x7ff22014a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21dd9b640 1 -- 172.21.15.37:0/3992282240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100094d0 con 0x7ff2200b7980 2023-07-09T21:22:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21ed9d640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 0x7ff22014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.018+0000 7ff21e59c640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff220149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff21dd9b640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff21400e810 tx=0x7ff21400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400c8d0 con 0x7ff2200b7980 2023-07-09T21:22:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400ca30 con 0x7ff2200b7980 2023-07-09T21:22:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400cde0 con 0x7ff2200b7980 2023-07-09T21:22:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2200c6050 con 0x7ff2200b7980 2023-07-09T21:22:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff220153870 con 0x7ff2200b7980 2023-07-09T21:22:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff22004d7d0 con 0x7ff2200b7980 2023-07-09T21:22:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff214013410 con 0x7ff2200b7980 2023-07-09T21:22:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff214083b80 con 0x7ff2200b7980 2023-07-09T21:22:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.022+0000 7ff21e59c640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.026+0000 7ff21e59c640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 0x7ff200068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2100ad000 tx=0x7ff210008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.026+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff214050f60 con 0x7ff2200b7980 2023-07-09T21:22:45.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff22006a800 con 0x7ff2200b7980 2023-07-09T21:22:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff20effd640 1 -- 172.21.15.37:0/3992282240 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff214054580 con 0x7ff2200b7980 2023-07-09T21:22:45.187 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:22:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 msgr2=0x7ff200068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 0x7ff200068730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2100ad000 tx=0x7ff210008040 comp rx=0 tx=0).stop 2023-07-09T21:22:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 msgr2=0x7ff22014b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff21400e810 tx=0x7ff21400ecd0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 shutdown_connections 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff200066280 0x7ff200068730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2200ceb80 0x7ff22014a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2200b7980 0x7ff22014b3a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 --2- 172.21.15.37:0/3992282240 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2200b3c20 0x7ff220149d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 >> 172.21.15.37:0/3992282240 conn(0x7ff220073090 msgr2=0x7ff2200b5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 shutdown_connections 2023-07-09T21:22:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.182+0000 7ff224974640 1 -- 172.21.15.37:0/3992282240 wait complete. 2023-07-09T21:22:45.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:22:45.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 Processor -- start 2023-07-09T21:22:45.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 -- start start 2023-07-09T21:22:45.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 0x7f57680d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f576806bc30 0x7f57680ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57680d1380 con 0x7f57680b1650 2023-07-09T21:22:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680b13e0 con 0x7f576806bc30 2023-07-09T21:22:45.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576802bbe0 con 0x7f576815bbf0 2023-07-09T21:22:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f576806bc30 0x7f57680ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f576806bc30 0x7f57680ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34702/0 (socket says 172.21.15.37:34702) 2023-07-09T21:22:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 -- 172.21.15.37:0/3472860472 learned_addr learned my addr 172.21.15.37:0/3472860472 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576659c640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 0x7f57680d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 -- 172.21.15.37:0/3472860472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 msgr2=0x7f57680d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:45.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 0x7f57680d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 -- 172.21.15.37:0/3472860472 >> v1:172.21.15.119:6789/0 conn(0x7f57680b1650 legacy=0x7f57680cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f575ffff640 1 -- 172.21.15.37:0/3472860472 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680b1100 con 0x7f576806bc30 2023-07-09T21:22:45.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.346+0000 7f576659c640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 0x7f57680d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:45.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f575ffff640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f57680ce9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57500098a0 tx=0x7f575001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a5f91b3a74d666 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f5765d9b640 1 -- 172.21.15.37:0/3472860472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500ab600 con 0x7f576806bc30 2023-07-09T21:22:45.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f5765d9b640 1 -- 172.21.15.37:0/3472860472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57500ab760 con 0x7f576806bc30 2023-07-09T21:22:45.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f5765d9b640 1 -- 172.21.15.37:0/3472860472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500abaf0 con 0x7f576806bc30 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 -- 172.21.15.37:0/3472860472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 msgr2=0x7f57680ce9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f57680ce9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f57500098a0 tx=0x7f575001c4f0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 -- 172.21.15.37:0/3472860472 shutdown_connections 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f57680ce9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 --2- 172.21.15.37:0/3472860472 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f576815bbf0 0x7f57680d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 -- 172.21.15.37:0/3472860472 >> 172.21.15.37:0/3472860472 conn(0x7f576802b640 msgr2=0x7f57680d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 -- 172.21.15.37:0/3472860472 shutdown_connections 2023-07-09T21:22:45.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 -- 172.21.15.37:0/3472860472 wait complete. 2023-07-09T21:22:45.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.350+0000 7f576759e640 1 Processor -- start 2023-07-09T21:22:45.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- start start 2023-07-09T21:22:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57680b1650 0x7f57680b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 0x7f57680cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576814fc20 con 0x7f576806bc30 2023-07-09T21:22:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576814fe20 con 0x7f576815bbf0 2023-07-09T21:22:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680c8d70 con 0x7f57680b1650 2023-07-09T21:22:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34712/0 (socket says 172.21.15.37:34712) 2023-07-09T21:22:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 -- 172.21.15.37:0/704164080 learned_addr learned my addr 172.21.15.37:0/704164080 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f575ffff640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57680b1650 0x7f57680b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f5766d9d640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 0x7f57680cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 -- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57680b1650 msgr2=0x7f57680b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57680b1650 0x7f57680b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 -- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 msgr2=0x7f57680cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 0x7f57680cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 -- 172.21.15.37:0/704164080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500094d0 con 0x7f576806bc30 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f5766d9d640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 0x7f57680cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576659c640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f575800e840 tx=0x7f575800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800c8d0 con 0x7f576806bc30 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575800ca30 con 0x7f576806bc30 2023-07-09T21:22:45.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575800cdc0 con 0x7f576806bc30 2023-07-09T21:22:45.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57680b71d0 con 0x7f576806bc30 2023-07-09T21:22:45.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57680b7770 con 0x7f576806bc30 2023-07-09T21:22:45.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.354+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576806b020 con 0x7f576806bc30 2023-07-09T21:22:45.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.358+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5758013410 con 0x7f576806bc30 2023-07-09T21:22:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.358+0000 7f575effd640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.358+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5758083a60 con 0x7f576806bc30 2023-07-09T21:22:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.358+0000 7f575ffff640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.358+0000 7f575ffff640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57500af000 tx=0x7f57500b6040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.362+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5758050f90 con 0x7f576806bc30 2023-07-09T21:22:45.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.546+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f576804e020 con 0x7f576806bc30 2023-07-09T21:22:45.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.546+0000 7f575effd640 1 -- 172.21.15.37:0/704164080 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f5758009480 con 0x7f576806bc30 2023-07-09T21:22:45.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:45.552 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:22:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:22:45.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 msgr2=0x7f5748068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 0x7f5748068730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f57500af000 tx=0x7f57500b6040 comp rx=0 tx=0).stop 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 msgr2=0x7f576814f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f575800e840 tx=0x7f575800ed00 comp rx=0 tx=0).stop 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 shutdown_connections 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5748066280 0x7f5748068730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f576815bbf0 0x7f57680cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57680b1650 0x7f57680b6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 --2- 172.21.15.37:0/704164080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f576806bc30 0x7f576814f6e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 >> 172.21.15.37:0/704164080 conn(0x7f576802b640 msgr2=0x7f5768159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 shutdown_connections 2023-07-09T21:22:45.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.550+0000 7f576759e640 1 -- 172.21.15.37:0/704164080 wait complete. 2023-07-09T21:22:45.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 Processor -- start 2023-07-09T21:22:45.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 -- start start 2023-07-09T21:22:45.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52840b7ab0 0x7f528406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52840d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52840b49f0 con 0x7f52840cef80 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52840b7e80 con 0x7f52840b7ab0 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f528a6d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840cc8a0 con 0x7f52840b4340 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f5283fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52840b7ab0 0x7f528406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f5288c75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52840d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f5283fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52840b7ab0 0x7f528406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50744/0 (socket says 172.21.15.37:50744) 2023-07-09T21:22:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f5283fff640 1 -- 172.21.15.37:0/2006409271 learned_addr learned my addr 172.21.15.37:0/2006409271 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.710+0000 7f52837fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f52840cef80 0x7f52840b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51296/0 (socket says 172.21.15.37:51296) 2023-07-09T21:22:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5283fff640 1 -- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 msgr2=0x7f52840d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:45.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5283fff640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52840d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5283fff640 1 -- 172.21.15.37:0/2006409271 >> v1:172.21.15.119:6789/0 conn(0x7f52840cef80 legacy=0x7f52840b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5283fff640 1 -- 172.21.15.37:0/2006409271 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52840ccb80 con 0x7f52840b7ab0 2023-07-09T21:22:45.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5288c75640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52840d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5283fff640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840b7ab0 0x7f528406aa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5274009870 tx=0x7f527401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=852db0fce0c8b2a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5282ffd640 1 -- 172.21.15.37:0/2006409271 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740aa670 con 0x7f52840b7ab0 2023-07-09T21:22:45.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5282ffd640 1 -- 172.21.15.37:0/2006409271 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52740aa7d0 con 0x7f52840b7ab0 2023-07-09T21:22:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f5282ffd640 1 -- 172.21.15.37:0/2006409271 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52740aab60 con 0x7f52840b7ab0 2023-07-09T21:22:45.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 -- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840b7ab0 msgr2=0x7f528406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840b7ab0 0x7f528406aa50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5274009870 tx=0x7f527401c510 comp rx=0 tx=0).stop 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 -- 172.21.15.37:0/2006409271 shutdown_connections 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52840d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2006409271 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840b7ab0 0x7f528406aa50 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.714+0000 7f528a6d8640 1 -- 172.21.15.37:0/2006409271 >> 172.21.15.37:0/2006409271 conn(0x7f5284073090 msgr2=0x7f5284069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- 172.21.15.37:0/2006409271 shutdown_connections 2023-07-09T21:22:45.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- 172.21.15.37:0/2006409271 wait complete. 2023-07-09T21:22:45.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 Processor -- start 2023-07-09T21:22:45.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- start start 2023-07-09T21:22:45.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52841517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 0x7f52840c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840c6960 con 0x7f52840b7ab0 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52840b6440 con 0x7f52840cef80 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f528a6d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52840b6720 con 0x7f52840b4340 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34722/0 (socket says 172.21.15.37:34722) 2023-07-09T21:22:45.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 -- 172.21.15.37:0/2083258973 learned_addr learned my addr 172.21.15.37:0/2083258973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:45.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f5283fff640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52841517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 -- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 msgr2=0x7f52841517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f5288c75640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 0x7f52840c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52841517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 -- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 msgr2=0x7f52840c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 0x7f52840c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f52837fe640 1 -- 172.21.15.37:0/2083258973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527c009a70 con 0x7f52840b7ab0 2023-07-09T21:22:45.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f5283fff640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52841517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.718+0000 7f5288c75640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 0x7f52840c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f52837fe640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f527800c430 tx=0x7f527800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52780074e0 con 0x7f52840b7ab0 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278007640 con 0x7f52840b7ab0 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278004a10 con 0x7f52840b7ab0 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52740094d0 con 0x7f52840b7ab0 2023-07-09T21:22:45.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52840c6440 con 0x7f52840b7ab0 2023-07-09T21:22:45.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f528404d7d0 con 0x7f52840b7ab0 2023-07-09T21:22:45.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5278004b70 con 0x7f52840b7ab0 2023-07-09T21:22:45.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 0x7f5270068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:45.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f52780837f0 con 0x7f52840b7ab0 2023-07-09T21:22:45.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.722+0000 7f5283fff640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 0x7f5270068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:45.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.726+0000 7f5283fff640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 0x7f5270068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae000 tx=0x7f5274008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:45.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.726+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5278050bd0 con 0x7f52840b7ab0 2023-07-09T21:22:45.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.882+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52840c6df0 con 0x7f52840b7ab0 2023-07-09T21:22:45.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.882+0000 7f5280ff9640 1 -- 172.21.15.37:0/2083258973 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f52780541f0 con 0x7f52840b7ab0 2023-07-09T21:22:45.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:45.889 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 msgr2=0x7f5270068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 0x7f5270068730 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f52740ae000 tx=0x7f5274008040 comp rx=0 tx=0).stop 2023-07-09T21:22:45.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 msgr2=0x7f52840b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f527800c430 tx=0x7f527800c8f0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 shutdown_connections 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5270066280 0x7f5270068730 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52840cef80 0x7f52840c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52840b7ab0 0x7f52840b59f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 --2- 172.21.15.37:0/2083258973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52840b4340 0x7f52841517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:45.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 >> 172.21.15.37:0/2083258973 conn(0x7f5284073090 msgr2=0x7f52840d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 shutdown_connections 2023-07-09T21:22:45.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:45.886+0000 7f528a6d8640 1 -- 172.21.15.37:0/2083258973 wait complete. 2023-07-09T21:22:45.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:22:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.046+0000 7f734a537640 1 Processor -- start 2023-07-09T21:22:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.046+0000 7f734a537640 1 -- start start 2023-07-09T21:22:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f734a537640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73440b4340 0x7f734406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f734a537640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 0x7f73440d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f734a537640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73440b49f0 con 0x7f73440b7ab0 2023-07-09T21:22:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f734a537640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440b7e80 con 0x7f73440b4340 2023-07-09T21:22:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f734a537640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73440cc8a0 con 0x7f73440cef80 2023-07-09T21:22:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f73437fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73440b4340 0x7f734406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f7343fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73440b7ab0 0x7f73440b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57222/0 (socket says 172.21.15.37:57222) 2023-07-09T21:22:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f7343fff640 1 -- 172.21.15.37:0/1483021976 learned_addr learned my addr 172.21.15.37:0/1483021976 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f7348ad4640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 0x7f73440d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f73437fe640 1 -- 172.21.15.37:0/1483021976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 msgr2=0x7f73440d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f73437fe640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 0x7f73440d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f73437fe640 1 -- 172.21.15.37:0/1483021976 >> v1:172.21.15.37:6789/0 conn(0x7f73440b7ab0 legacy=0x7f73440b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f73437fe640 1 -- 172.21.15.37:0/1483021976 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440ccb80 con 0x7f73440b4340 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f7348ad4640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 0x7f73440d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.050+0000 7f7342ffd640 1 -- 172.21.15.37:0/1483021976 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566294355 0 0) 0x7f73440b49f0 con 0x7f73440b7ab0 2023-07-09T21:22:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f73437fe640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f734406aa50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73380097c0 tx=0x7f733801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d4ab3c8519949cf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f7342ffd640 1 -- 172.21.15.37:0/1483021976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73380ab650 con 0x7f73440b4340 2023-07-09T21:22:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f7342ffd640 1 -- 172.21.15.37:0/1483021976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73380ab7b0 con 0x7f73440b4340 2023-07-09T21:22:46.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f7342ffd640 1 -- 172.21.15.37:0/1483021976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73380abb40 con 0x7f73440b4340 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- 172.21.15.37:0/1483021976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 msgr2=0x7f734406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f734406aa50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f73380097c0 tx=0x7f733801c450 comp rx=0 tx=0).stop 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- 172.21.15.37:0/1483021976 shutdown_connections 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440cef80 0x7f73440d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 --2- 172.21.15.37:0/1483021976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f734406aa50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- 172.21.15.37:0/1483021976 >> 172.21.15.37:0/1483021976 conn(0x7f7344073090 msgr2=0x7f7344069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- 172.21.15.37:0/1483021976 shutdown_connections 2023-07-09T21:22:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- 172.21.15.37:0/1483021976 wait complete. 2023-07-09T21:22:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 Processor -- start 2023-07-09T21:22:46.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.054+0000 7f734a537640 1 -- start start 2023-07-09T21:22:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440b7ab0 0x7f7344152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73440cef80 0x7f734414f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73440c6010 con 0x7f73440b4340 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73440b2740 con 0x7f73440cef80 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73440b2a20 con 0x7f73440b7ab0 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34732/0 (socket says 172.21.15.37:34732) 2023-07-09T21:22:46.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 -- 172.21.15.37:0/3096116545 learned_addr learned my addr 172.21.15.37:0/3096116545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 -- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440b7ab0 msgr2=0x7f7344152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440b7ab0 0x7f7344152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 -- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73440cef80 msgr2=0x7f734414f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73440cef80 0x7f734414f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 -- 172.21.15.37:0/3096116545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009420 con 0x7f73440b4340 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7343fff640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73340011f0 tx=0x7f733400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340074e0 con 0x7f73440b4340 2023-07-09T21:22:46.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334007640 con 0x7f73440b4340 2023-07-09T21:22:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73440b2d00 con 0x7f73440b4340 2023-07-09T21:22:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334004a10 con 0x7f73440b4340 2023-07-09T21:22:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73440c9280 con 0x7f73440b4340 2023-07-09T21:22:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734404d7d0 con 0x7f73440b4340 2023-07-09T21:22:46.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.058+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7334004b70 con 0x7f73440b4340 2023-07-09T21:22:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.062+0000 7f7340ff9640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 0x7f7330068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.062+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7334083290 con 0x7f73440b4340 2023-07-09T21:22:46.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.062+0000 7f73437fe640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 0x7f7330068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.062+0000 7f73437fe640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 0x7f7330068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73380af000 tx=0x7f7338008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.066+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7334050700 con 0x7f73440b4340 2023-07-09T21:22:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.250+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73440ce8b0 con 0x7f73440b4340 2023-07-09T21:22:46.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f7340ff9640 1 -- 172.21.15.37:0/3096116545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f7334053d20 con 0x7f73440b4340 2023-07-09T21:22:46.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:46.261 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 msgr2=0x7f7330068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 0x7f7330068760 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f73380af000 tx=0x7f7338008040 comp rx=0 tx=0).stop 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 msgr2=0x7f73440b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f73340011f0 tx=0x7f733400c9b0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 shutdown_connections 2023-07-09T21:22:46.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f73300662b0 0x7f7330068760 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73440cef80 0x7f734414f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73440b7ab0 0x7f7344152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 --2- 172.21.15.37:0/3096116545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73440b4340 0x7f73440b3a90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 >> 172.21.15.37:0/3096116545 conn(0x7f7344073090 msgr2=0x7f7344069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 shutdown_connections 2023-07-09T21:22:46.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.254+0000 7f734a537640 1 -- 172.21.15.37:0/3096116545 wait complete. 2023-07-09T21:22:46.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:22:31.224845+0000', 'modified': '2023-07-09T21:22:34.874942+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6836/3858793656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 3858793656}, {'type': 'v1', 'addr': '172.21.15.119:6836', 'nonce': 3858793656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:22:46.681 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:22:46.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-07-09T21:22:46.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 Processor -- start 2023-07-09T21:22:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 -- start start 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41380b4310 0x7f41381668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380cef80 con 0x7f41380b47a0 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41380cf260 con 0x7f41380b7a60 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413f818640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41380ccee0 con 0x7f41380b4310 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413cdb3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41380b47a0 0x7f41380b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57230/0 (socket says 172.21.15.37:57230) 2023-07-09T21:22:46.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413cdb3640 1 -- 172.21.15.37:0/637268589 learned_addr learned my addr 172.21.15.37:0/637268589 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:46.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.822+0000 7f413ddb5640 1 --2- 172.21.15.37:0/637268589 >> v2:172.21.15.37:3300/0 conn(0x7f41380b4310 0x7f41381668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877526822 0 0) 0x7f41380cef80 con 0x7f41380b47a0 2023-07-09T21:22:46.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4124003530 con 0x7f41380b47a0 2023-07-09T21:22:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1858569503 0 0) 0x7f41380cf260 con 0x7f41380b7a60 2023-07-09T21:22:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f413ddb5640 1 -- 172.21.15.37:0/637268589 >> v1:172.21.15.119:6789/0 conn(0x7f41380b7a60 legacy=0x7f41380cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f413ddb5640 1 -- 172.21.15.37:0/637268589 >> v1:172.21.15.37:6789/0 conn(0x7f41380b47a0 legacy=0x7f41380b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f413ddb5640 1 -- 172.21.15.37:0/637268589 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41380cf540 con 0x7f41380b4310 2023-07-09T21:22:46.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f413ddb5640 1 --2- 172.21.15.37:0/637268589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b4310 0x7f41381668c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4130009d90 tx=0x7f413001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed8af770c70b697 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300a5900 con 0x7f41380b4310 2023-07-09T21:22:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41300a5a60 con 0x7f41380b4310 2023-07-09T21:22:46.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.826+0000 7f412ffff640 1 -- 172.21.15.37:0/637268589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300a5df0 con 0x7f41380b4310 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- 172.21.15.37:0/637268589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b4310 msgr2=0x7f41381668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 --2- 172.21.15.37:0/637268589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b4310 0x7f41381668c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4130009d90 tx=0x7f413001c950 comp rx=0 tx=0).stop 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- 172.21.15.37:0/637268589 shutdown_connections 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 --2- 172.21.15.37:0/637268589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b4310 0x7f41381668c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- 172.21.15.37:0/637268589 >> 172.21.15.37:0/637268589 conn(0x7f4138073050 msgr2=0x7f4138069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- 172.21.15.37:0/637268589 shutdown_connections 2023-07-09T21:22:46.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- 172.21.15.37:0/637268589 wait complete. 2023-07-09T21:22:46.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 Processor -- start 2023-07-09T21:22:46.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- start start 2023-07-09T21:22:46.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 0x7f41380cbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 0x7f41381550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f413815ac30 con 0x7f41380b7a60 2023-07-09T21:22:46.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380cc0f0 con 0x7f41380b4310 2023-07-09T21:22:46.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413f818640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413815a300 con 0x7f41380b47a0 2023-07-09T21:22:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34756/0 (socket says 172.21.15.37:34756) 2023-07-09T21:22:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 -- 172.21.15.37:0/2109875369 learned_addr learned my addr 172.21.15.37:0/2109875369 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413d5b4640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 0x7f41380cbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413cdb3640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 0x7f41381550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 -- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 msgr2=0x7f41381550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 0x7f41381550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 -- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 msgr2=0x7f41380cbae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 0x7f41380cbae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413ddb5640 1 -- 172.21.15.37:0/2109875369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4130009a70 con 0x7f41380b7a60 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413d5b4640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 0x7f41380cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:46.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.830+0000 7f413cdb3640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 0x7f41381550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f413ddb5640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f41300b0040 tx=0x7f41300196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 -- 172.21.15.37:0/2109875369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130003ba0 con 0x7f41380b7a60 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 -- 172.21.15.37:0/2109875369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4130003d00 con 0x7f41380b7a60 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f413815a5e0 con 0x7f41380b7a60 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 -- 172.21.15.37:0/2109875369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4130004260 con 0x7f41380b7a60 2023-07-09T21:22:46.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138154490 con 0x7f41380b7a60 2023-07-09T21:22:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 -- 172.21.15.37:0/2109875369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41300b4050 con 0x7f41380b7a60 2023-07-09T21:22:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 0x7f411c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.834+0000 7f412dffb640 1 -- 172.21.15.37:0/2109875369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f413011ea00 con 0x7f41380b7a60 2023-07-09T21:22:46.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 Processor -- start 2023-07-09T21:22:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- start start 2023-07-09T21:22:46.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413d5b4640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 0x7f411c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d868cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413d5b4640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 0x7f411c068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4134000f70 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d868d110 0x5583d8642a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d8509f80 con 0x5583d8642f90 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d8443c60 con 0x5583d868c800 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583d8497700 con 0x5583d868d110 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413d5b4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d868cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34772/0 (socket says 172.21.15.37:34772) 2023-07-09T21:22:46.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 -- 172.21.15.37:0/3426677619 learned_addr learned my addr 172.21.15.37:0/3426677619 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413cdb3640 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d868d110 0x5583d8642a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 -- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d868d110 msgr2=0x5583d8642a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d868d110 0x5583d8642a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 -- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 msgr2=0x5583d868cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d868cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 -- 172.21.15.37:0/3426677619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583d818c890 con 0x5583d8642f90 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f413ddb5640 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f41300efb40 tx=0x7f41300f3c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b2a411179aeb95 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4122ffd640 1 -- 172.21.15.37:0/3426677619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300edf50 con 0x5583d8642f90 2023-07-09T21:22:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4122ffd640 1 -- 172.21.15.37:0/3426677619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41300ec2c0 con 0x5583d8642f90 2023-07-09T21:22:46.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4122ffd640 1 -- 172.21.15.37:0/3426677619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300aceb0 con 0x5583d8642f90 2023-07-09T21:22:46.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- 172.21.15.37:0/3426677619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 msgr2=0x5583d8643360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f41300efb40 tx=0x7f41300f3c30 comp rx=0 tx=0).stop 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- 172.21.15.37:0/3426677619 shutdown_connections 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d8642f90 0x5583d8643360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d868d110 0x5583d8642a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 --2- 172.21.15.37:0/3426677619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d868cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- 172.21.15.37:0/3426677619 >> 172.21.15.37:0/3426677619 conn(0x5583d8505a70 msgr2=0x5583d8641330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- 172.21.15.37:0/3426677619 shutdown_connections 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- 172.21.15.37:0/3426677619 wait complete. 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 -- start start 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.838+0000 7f4142b8b000 1 Processor -- start 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d864ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d864e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868d110 0x5583d864e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d84907a0 con 0x5583d868d110 2023-07-09T21:22:46.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d844cf00 con 0x5583d868c800 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583d844cba0 con 0x5583d8642f90 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 10 client.0 _ll_register_callbacks cb 0x5583d862e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d864e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413ddb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868d110 0x5583d864e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d864ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d864e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50804/0 (socket says 172.21.15.37:50804) 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413cdb3640 1 -- 172.21.15.37:0/62114849 learned_addr learned my addr 172.21.15.37:0/62114849 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 -- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 msgr2=0x5583d864e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d864e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 -- 172.21.15.37:0/62114849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868d110 msgr2=0x5583d864e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868d110 0x5583d864e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 -- 172.21.15.37:0/62114849 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138154490 con 0x5583d8642f90 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413d5b4640 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d864ddf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41340011f0 tx=0x7f4134001090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=156c546720817266 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3301/0 2023-07-09T21:22:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134003d90 con 0x5583d8642f90 2023-07-09T21:22:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mon.2 v2:172.21.15.119:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4134022c00 con 0x5583d8642f90 2023-07-09T21:22:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583d848f0f0 con 0x5583d8642f90 2023-07-09T21:22:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4134022020 con 0x5583d8642f90 2023-07-09T21:22:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 10 client.4526 fetch_fsmap learned FSMap version 8 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5583d8455130 con 0x5583d8642f90 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mon.2 v2:172.21.15.119:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4134022180 con 0x5583d8642f90 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mon.2 v2:172.21.15.119:3301/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4134020070 con 0x5583d8642f90 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 10 client.4526 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 10 client.4526 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 20 client.4526 populate_metadata read hostname 'smithi037' 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d869b870 0x5583d869dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 4 client.4526 mds_command: new command op to 4299 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 --> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583d848f0f0 con 0x5583d869b870 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.842+0000 7f413cdb3640 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d869b870 0x5583d869dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f413cdb3640 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d869b870 0x5583d869dc50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5da50a2e05ebe1f3 server_cookie=cefdc22eafbb51c0 in_seq=0 out_seq=0 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4117fff640 10 client.4526 ms_handle_connect on v2:172.21.15.119:6834/3858793656 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4117fff640 1 -- 172.21.15.37:0/62114849 <== mds.0 v2:172.21.15.119:6834/3858793656 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5583d848f0f0 con 0x5583d869b870 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4117fff640 10 client.4526 handle_command_reply: tid=0 2023-07-09T21:22:46.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 client.4526 shutdown 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 msgr2=0x5583d864ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d864ddf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f41340011f0 tx=0x7f4134001090 comp rx=0 tx=0).stop 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 shutdown_connections 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868d110 0x5583d864e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d869b870 0x5583d869dc50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868c800 0x5583d864e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 --2- 172.21.15.37:0/62114849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d864ddf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4117fff640 0 client.4526 ms_handle_reset on v2:172.21.15.119:6834/3858793656 2023-07-09T21:22:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 >> 172.21.15.37:0/62114849 conn(0x5583d8505a70 msgr2=0x5583d8641a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 shutdown_connections 2023-07-09T21:22:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 1 -- 172.21.15.37:0/62114849 wait complete. 2023-07-09T21:22:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.846+0000 7f4142b8b000 20 client.4526 trim_cache size 0 max 16384 2023-07-09T21:22:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 Processor -- start 2023-07-09T21:22:46.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 -- start start 2023-07-09T21:22:46.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d869f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d86877d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d814d940 con 0x5583d868c800 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d8645d60 con 0x5583d868d110 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583d848dba0 con 0x5583d8642f90 2023-07-09T21:22:46.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34796/0 (socket says 172.21.15.37:34796) 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 -- 172.21.15.37:0/4253156206 learned_addr learned my addr 172.21.15.37:0/4253156206 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413d5b4640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d869f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413ddb5640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d86877d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 -- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 msgr2=0x5583d869f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d869f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 -- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 msgr2=0x5583d86877d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d86877d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413cdb3640 1 -- 172.21.15.37:0/4253156206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583d843b3c0 con 0x5583d868c800 2023-07-09T21:22:46.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.862+0000 7f413d5b4640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d869f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413cdb3640 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41280078d0 tx=0x7f4128009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53df38037863dcf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f41237fe640 1 -- 172.21.15.37:0/4253156206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412801c390 con 0x5583d868c800 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f41237fe640 1 -- 172.21.15.37:0/4253156206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412801c040 con 0x5583d868c800 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f41237fe640 1 -- 172.21.15.37:0/4253156206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412801c530 con 0x5583d868c800 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- 172.21.15.37:0/4253156206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 msgr2=0x5583d869f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f41280078d0 tx=0x7f4128009040 comp rx=0 tx=0).stop 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- 172.21.15.37:0/4253156206 shutdown_connections 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d86877d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d869f8b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- 172.21.15.37:0/4253156206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d869f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- 172.21.15.37:0/4253156206 >> 172.21.15.37:0/4253156206 conn(0x5583d8505a70 msgr2=0x5583d869dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- 172.21.15.37:0/4253156206 shutdown_connections 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- 172.21.15.37:0/4253156206 wait complete. 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- start start 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 Processor -- start 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d868a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d845c760 con 0x5583d868c800 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583d848aaa0 con 0x5583d868d110 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583d84947a0 con 0x5583d8642f90 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f4142b8b000 10 client.0 _ll_register_callbacks cb 0x5583d860f4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:50286/0 (socket says 172.21.15.37:50286) 2023-07-09T21:22:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 -- 172.21.15.37:0/768828839 learned_addr learned my addr 172.21.15.37:0/768828839 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413cdb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34808/0 (socket says 172.21.15.37:34808) 2023-07-09T21:22:46.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413ddb5640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d868a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 -- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 msgr2=0x5583d868a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d868a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 -- 172.21.15.37:0/768828839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 msgr2=0x5583d86ea630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413d5b4640 1 -- 172.21.15.37:0/768828839 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412800f040 con 0x5583d8642f90 2023-07-09T21:22:46.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.866+0000 7f413cdb3640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413d5b4640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4134009010 tx=0x7f4134013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5bb2b172f2af76e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 10 client.0 ms_handle_connect on v2:172.21.15.119:3301/0 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134022340 con 0x5583d8642f90 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mon.2 v2:172.21.15.119:3301/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4134003d90 con 0x5583d8642f90 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583d84496f0 con 0x5583d8642f90 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41340039d0 con 0x5583d8642f90 2023-07-09T21:22:46.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 10 client.4532 fetch_fsmap learned FSMap version 8 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5583d818ccc0 con 0x5583d8642f90 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mon.2 v2:172.21.15.119:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583d84496f0 con 0x5583d8642f90 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mon.2 v2:172.21.15.119:3301/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4134013420 con 0x5583d8642f90 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 10 client.4532 fetch_fsmap finished waiting for FSMap version 8 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 10 client.4532 resolve_mds: resolved name 'd' to daemon mds.d 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 20 client.4532 populate_metadata read hostname 'smithi037' 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d86f0fc0 0x5583d86f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:46.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 4 client.4532 mds_command: new command op to 4299 tid=0[{"prefix": "status"}] 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 --> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5583d8457e40 con 0x5583d86f0fc0 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413cdb3640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d86f0fc0 0x5583d86f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413cdb3640 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d86f0fc0 0x5583d86f33a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eae6dac888b39a8b server_cookie=32cc0f9d9afad36e in_seq=0 out_seq=0 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 10 client.4532 ms_handle_connect on v2:172.21.15.119:6834/3858793656 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 1 -- 172.21.15.37:0/768828839 <== mds.0 v2:172.21.15.119:6834/3858793656 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x5583d8457e40 con 0x5583d86f0fc0 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 10 client.4532 handle_command_reply: tid=0 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 client.4532 shutdown 2023-07-09T21:22:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 msgr2=0x5583d86ea0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4134009010 tx=0x7f4134013000 comp rx=0 tx=0).stop 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 shutdown_connections 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:6834/3858793656,v1:172.21.15.119:6836/3858793656] conn(0x5583d86f0fc0 0x5583d86f33a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5583d868d110 0x5583d868a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583d868c800 0x5583d86ea630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 --2- 172.21.15.37:0/768828839 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5583d8642f90 0x5583d86ea0f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 >> 172.21.15.37:0/768828839 conn(0x5583d8505a70 msgr2=0x5583d869e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4117fff640 0 client.4532 ms_handle_reset on v2:172.21.15.119:6834/3858793656 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 shutdown_connections 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 1 -- 172.21.15.37:0/768828839 wait complete. 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f4142b8b000 20 client.4532 trim_cache size 0 max 16384 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:22:46.883 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4299, 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 15.052020266, 2023-07-09T21:22:46.884 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2023-07-09T21:22:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 23, 2023-07-09T21:22:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 23, 2023-07-09T21:22:46.885 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 20.938282976 2023-07-09T21:22:46.885 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 msgr2=0x7f411c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 0x7f411c068730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4134000f70 tx=0x7f4134009040 comp rx=0 tx=0).stop 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 msgr2=0x7f41381f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f41300b0040 tx=0x7f41300196f0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 shutdown_connections 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f411c066280 0x7f411c068730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41380b7a60 0x7f41381f7b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41380b47a0 0x7f41381550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 --2- 172.21.15.37:0/2109875369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41380b4310 0x7f41380cbae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:46.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.870+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 >> 172.21.15.37:0/2109875369 conn(0x7f4138073050 msgr2=0x7f41380b6650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:46.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.874+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 shutdown_connections 2023-07-09T21:22:46.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:46.874+0000 7f413f818640 1 -- 172.21.15.37:0/2109875369 wait complete. 2023-07-09T21:22:46.895 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-09T21:22:46.924 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-09T21:22:46.925 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-07-09T21:22:46.925 INFO:tasks.ceph_fuse:client.0 config is {} 2023-07-09T21:22:46.925 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:22:46.926 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:46.926 INFO:tasks.ceph_fuse:client.2 config is {} 2023-07-09T21:22:46.926 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:22:46.927 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:46.927 INFO:tasks.ceph_fuse:client.1 config is {} 2023-07-09T21:22:46.927 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:22:46.927 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:46.927 INFO:tasks.ceph_fuse:client.3 config is {} 2023-07-09T21:22:46.927 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-09T21:22:46.928 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:46.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:46.928 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-07-09T21:22:46.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:46.938 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-07-09T21:22:47.005 INFO:teuthology.orchestra.run.smithi119.stderr:Cannot find device "ceph-brx" 2023-07-09T21:22:47.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:22:47.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.008 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:22:47.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-09T21:22:47.088 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-07-09T21:22:47.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:22:47.090 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-09T21:22:47.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:22:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 Processor -- start 2023-07-09T21:22:47.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 -- start start 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27e00b7ab0 0x7f27e006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e00b49f0 con 0x7f27e00cef80 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e00b7e80 con 0x7f27e00b7ab0 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e63d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00cc8a0 con 0x7f27e00b4340 2023-07-09T21:22:47.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27e00b7ab0 0x7f27e006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27e00b7ab0 0x7f27e006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34812/0 (socket says 172.21.15.37:34812) 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 -- 172.21.15.37:0/1211375578 learned_addr learned my addr 172.21.15.37:0/1211375578 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27df7fe640 1 --1- 172.21.15.37:0/1211375578 >> v1:172.21.15.37:6789/0 conn(0x7f27e00cef80 0x7f27e00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57240/0 (socket says 172.21.15.37:57240) 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27e4972640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 -- 172.21.15.37:0/1211375578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 msgr2=0x7f27e00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 -- 172.21.15.37:0/1211375578 >> v1:172.21.15.37:6789/0 conn(0x7f27e00cef80 legacy=0x7f27e00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.270+0000 7f27dffff640 1 -- 172.21.15.37:0/1211375578 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00ccb80 con 0x7f27e00b7ab0 2023-07-09T21:22:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27dffff640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e006aa50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009870 tx=0x7f27d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3753e8a7ee84c84 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27deffd640 1 -- 172.21.15.37:0/1211375578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00aa670 con 0x7f27e00b7ab0 2023-07-09T21:22:47.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27deffd640 1 -- 172.21.15.37:0/1211375578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d00aa7d0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27deffd640 1 -- 172.21.15.37:0/1211375578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d00aab60 con 0x7f27e00b7ab0 2023-07-09T21:22:47.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 -- 172.21.15.37:0/1211375578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 msgr2=0x7f27e006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e006aa50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27d0009870 tx=0x7f27d001c510 comp rx=0 tx=0).stop 2023-07-09T21:22:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 -- 172.21.15.37:0/1211375578 shutdown_connections 2023-07-09T21:22:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 --2- 172.21.15.37:0/1211375578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e006aa50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 -- 172.21.15.37:0/1211375578 >> 172.21.15.37:0/1211375578 conn(0x7f27e0073090 msgr2=0x7f27e0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 -- 172.21.15.37:0/1211375578 shutdown_connections 2023-07-09T21:22:47.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.274+0000 7f27e63d5640 1 -- 172.21.15.37:0/1211375578 wait complete. 2023-07-09T21:22:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 Processor -- start 2023-07-09T21:22:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- start start 2023-07-09T21:22:47.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27e00cef80 0x7f27e00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00c8350 con 0x7f27e00b7ab0 2023-07-09T21:22:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00c8630 con 0x7f27e00cef80 2023-07-09T21:22:47.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e00b51a0 con 0x7f27e00b4340 2023-07-09T21:22:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34824/0 (socket says 172.21.15.37:34824) 2023-07-09T21:22:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 -- 172.21.15.37:0/768437053 learned_addr learned my addr 172.21.15.37:0/768437053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:47.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27dffff640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e4972640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27e00cef80 0x7f27e00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 -- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 msgr2=0x7f27e014d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e014d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 -- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27e00cef80 msgr2=0x7f27e00b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27e00cef80 0x7f27e00b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 -- 172.21.15.37:0/768437053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00094d0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27dffff640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:47.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27df7fe640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c430 tx=0x7f27d400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:47.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d40074e0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4007640 con 0x7f27e00b7ab0 2023-07-09T21:22:47.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e00b5480 con 0x7f27e00b7ab0 2023-07-09T21:22:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4004a10 con 0x7f27e00b7ab0 2023-07-09T21:22:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.278+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e00c7f90 con 0x7f27e00b7ab0 2023-07-09T21:22:47.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.282+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e00b56c0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.282+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27d4004b70 con 0x7f27e00b7ab0 2023-07-09T21:22:47.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.282+0000 7f27dcff9640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 0x7f27cc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.282+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f27d40835a0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.282+0000 7f27dffff640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 0x7f27cc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.286+0000 7f27dffff640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 0x7f27cc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27d00ae000 tx=0x7f27d00b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:47.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.286+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27e00b56c0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27e00b4fe0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27dcff9640 1 -- 172.21.15.37:0/768437053 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27d4050ac0 con 0x7f27e00b7ab0 2023-07-09T21:22:47.491 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:22:47.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 msgr2=0x7f27cc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 0x7f27cc068760 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27d00ae000 tx=0x7f27d00b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:47.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 msgr2=0x7f27e00c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:47.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f27d400c430 tx=0x7f27d400c8f0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 shutdown_connections 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f27cc0662b0 0x7f27cc068760 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27e00cef80 0x7f27e00b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27e00b7ab0 0x7f27e00c7a50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 --2- 172.21.15.37:0/768437053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27e00b4340 0x7f27e014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 >> 172.21.15.37:0/768437053 conn(0x7f27e0073090 msgr2=0x7f27e00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:47.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 shutdown_connections 2023-07-09T21:22:47.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:47.486+0000 7f27e63d5640 1 -- 172.21.15.37:0/768437053 wait complete. 2023-07-09T21:22:47.511 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:22:47.512 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:22:47.512 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:22:47.512 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:22:47.513 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:47.513 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:22:47.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:22:47.514 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:22:47.514 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:22:47.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.515 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:22:47.525 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:47.526 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:47.526 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:47.527 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:22:47.528 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42436sec preferred_lft 42436sec 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:22:47.529 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:47.530 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:22:47.530 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:47.530 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T21:22:47.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:47.531 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:47.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-07-09T21:22:47.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-07-09T21:22:47.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-07-09T21:22:47.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T21:22:47.532 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:47.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.641 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:22:47.661 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:22:47.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.663 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:22:47.728 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:22:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:22:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:22:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:22:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:22:47.729 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:22:47.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.730 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:47.730 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:47.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:22:47.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:22:47.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:22:47.731 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:47.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.822 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:22:47.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.833 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-09T21:22:47.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.882 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:47.882 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:47.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:22:47.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-07-09T21:22:47.883 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:47.967 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-07-09T21:22:47.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:47.968 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:47.969 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:47.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-07-09T21:22:47.970 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T21:22:47.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-07-09T21:22:47.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-07-09T21:22:47.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-07-09T21:22:47.972 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:48.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:48.142 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:48.142 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:48.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:22:48.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T21:22:48.144 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:48.187 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:22:48.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:48.188 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:48.237 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:22:48.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:48.238 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:48.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:22:48.358 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:48.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:48.424 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:48.425 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:48.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:48.427 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:22:48.477 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:22:48.477 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:22:48.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:22:48.547 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:48.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:48.614 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:48.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:48.615 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:22:48.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:22:48.622+0000 7eff0feef580 -1 init, newargv = 0x55ccf990b670 newargc=15 2023-07-09T21:22:48.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[44950]: starting ceph client 2023-07-09T21:22:48.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[44950]: starting fuse 2023-07-09T21:22:49.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:22:49.764 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:49.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:49.829 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:49.831 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:49.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:49.832 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:22:49.885 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:22:49.886 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:22:49.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:22:49.886 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:22:49.887 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:22:49.887 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:22:49.887 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:22:49.887 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:49.887 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:22:49.888 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:22:49.888 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:22:49.888 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:22:49.888 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:49.889 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:22:49.889 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:22:49.889 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:22:49.889 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:22:49.889 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:49.890 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:22:49.890 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:22:49.890 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:22:49.890 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:22:49.891 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:22:49.891 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:22:49.891 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:22:49.891 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:22:49.891 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:49.892 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:22:49.892 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:22:50.020 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.44950.asok 2023-07-09T21:22:50.205 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44950.asok 2023-07-09T21:22:50.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44950.asok status 2023-07-09T21:22:50.382 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:22:50.383 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "44950", 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4716, 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:22:50.384 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4716 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:22:50.385 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 47139902 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 47139902 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:50.386 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4716 192.168.0.1:0/47139902", 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/47139902", 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 8, 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 23, 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:22:50.387 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:22:50.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:22:50.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.534+0000 7f3497e9c640 1 Processor -- start 2023-07-09T21:22:50.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.534+0000 7f3497e9c640 1 -- start start 2023-07-09T21:22:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3497e9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34900b7ab0 0x7f349006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3497e9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b4340 0x7f34900d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3497e9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900b49f0 con 0x7f34900cef80 2023-07-09T21:22:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3497e9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900b7e80 con 0x7f34900b7ab0 2023-07-09T21:22:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3497e9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900cc8a0 con 0x7f34900b4340 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34900b7ab0 0x7f349006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34900b7ab0 0x7f349006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60726/0 (socket says 172.21.15.37:60726) 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 -- 172.21.15.37:0/2668552858 learned_addr learned my addr 172.21.15.37:0/2668552858 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3496439640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b4340 0x7f34900d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 -- 172.21.15.37:0/2668552858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b4340 msgr2=0x7f34900d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b4340 0x7f34900d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 -- 172.21.15.37:0/2668552858 >> v1:172.21.15.37:6789/0 conn(0x7f34900cef80 legacy=0x7f34900b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3495c38640 1 -- 172.21.15.37:0/2668552858 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900ccb80 con 0x7f34900b7ab0 2023-07-09T21:22:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.538+0000 7f3494c36640 1 -- 172.21.15.37:0/2668552858 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672293271 0 0) 0x7f34900b49f0 con 0x7f34900cef80 2023-07-09T21:22:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3495c38640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900b7ab0 0x7f349006aa50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24a10a1f7ebbb47a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3494c36640 1 -- 172.21.15.37:0/2668552858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c0aa670 con 0x7f34900b7ab0 2023-07-09T21:22:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3494c36640 1 -- 172.21.15.37:0/2668552858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c0aa7d0 con 0x7f34900b7ab0 2023-07-09T21:22:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3494c36640 1 -- 172.21.15.37:0/2668552858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c0aab60 con 0x7f34900b7ab0 2023-07-09T21:22:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- 172.21.15.37:0/2668552858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900b7ab0 msgr2=0x7f349006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900b7ab0 0x7f349006aa50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f348c009870 tx=0x7f348c01c510 comp rx=0 tx=0).stop 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- 172.21.15.37:0/2668552858 shutdown_connections 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b4340 0x7f34900d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- 172.21.15.37:0/2668552858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900b7ab0 0x7f349006aa50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- 172.21.15.37:0/2668552858 >> 172.21.15.37:0/2668552858 conn(0x7f3490073090 msgr2=0x7f3490069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- 172.21.15.37:0/2668552858 shutdown_connections 2023-07-09T21:22:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- 172.21.15.37:0/2668552858 wait complete. 2023-07-09T21:22:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 Processor -- start 2023-07-09T21:22:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- start start 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b7ab0 0x7f34900b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900c80e0 con 0x7f34900cef80 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34900b3630 con 0x7f34900b4340 2023-07-09T21:22:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.542+0000 7f3497e9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900c82d0 con 0x7f34900b7ab0 2023-07-09T21:22:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3495c38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60738/0 (socket says 172.21.15.37:60738) 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3495c38640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:57650/0 (socket says 172.21.15.37:57650) 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 -- 172.21.15.37:0/114890678 learned_addr learned my addr 172.21.15.37:0/114890678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3495437640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b7ab0 0x7f34900b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 -- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b7ab0 msgr2=0x7f34900b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b7ab0 0x7f34900b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 -- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 msgr2=0x7f34900c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 -- 172.21.15.37:0/114890678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c0094d0 con 0x7f34900cef80 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3495c38640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3496439640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3488007e30 tx=0x7f348800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488014620 con 0x7f34900cef80 2023-07-09T21:22:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800ee90 con 0x7f34900cef80 2023-07-09T21:22:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34900c85b0 con 0x7f34900cef80 2023-07-09T21:22:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34880149c0 con 0x7f34900cef80 2023-07-09T21:22:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900b5da0 con 0x7f34900cef80 2023-07-09T21:22:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349004d7d0 con 0x7f34900cef80 2023-07-09T21:22:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.546+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3488014b20 con 0x7f34900cef80 2023-07-09T21:22:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.550+0000 7f34867fc640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 0x7f3474068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.550+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34880845c0 con 0x7f34900cef80 2023-07-09T21:22:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.550+0000 7f3495c38640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 0x7f3474068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.550+0000 7f3495c38640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 0x7f3474068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f348c0ae000 tx=0x7f348c0b5040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.554+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3488051a60 con 0x7f34900cef80 2023-07-09T21:22:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.742+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f349006a830 con 0x7f34900cef80 2023-07-09T21:22:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.742+0000 7f34867fc640 1 -- 172.21.15.37:0/114890678 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3488055080 con 0x7f34900cef80 2023-07-09T21:22:50.753 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:22:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 msgr2=0x7f3474068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 0x7f3474068760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f348c0ae000 tx=0x7f348c0b5040 comp rx=0 tx=0).stop 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 msgr2=0x7f349014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3488007e30 tx=0x7f348800e4b0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 shutdown_connections 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f34740662b0 0x7f3474068760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34900cef80 0x7f349014f110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34900b7ab0 0x7f34900b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 --2- 172.21.15.37:0/114890678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34900b4340 0x7f34900c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:50.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 >> 172.21.15.37:0/114890678 conn(0x7f3490073090 msgr2=0x7f34900b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:50.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 shutdown_connections 2023-07-09T21:22:50.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:50.746+0000 7f3497e9c640 1 -- 172.21.15.37:0/114890678 wait complete. 2023-07-09T21:22:50.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:22:50.770 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:22:50.770 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:22:50.771 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-07-09T21:22:50.771 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:50.771 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:22:50.772 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:22:50.772 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:22:50.773 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-07-09T21:22:50.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.773 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:22:50.783 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:50.783 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:50.784 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:22:50.785 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42432sec preferred_lft 42432sec 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:22:50.786 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:22:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.788 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:22:50.788 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:22:50.788 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:22:50.788 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:50.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.789 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:22:50.844 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:22:50.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.846 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:22:50.898 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:22:50.898 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:22:50.898 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:22:50.898 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:22:50.898 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:22:50.899 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:22:50.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.899 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:50.899 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:50.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:22:50.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:22:50.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:22:50.900 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:50.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:50.993 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:22:51.002 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:22:51.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.004 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-07-09T21:22:51.053 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-07-09T21:22:51.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.054 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:51.054 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:51.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:22:51.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-07-09T21:22:51.055 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:51.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T21:22:51.202 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.202 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:06:d1:16:f0:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7c06:d1ff:fe16:f0a7/64 scope link 2023-07-09T21:22:51.203 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.266 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:06:d1:16:f0:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:22:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:22:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7c06:d1ff:fe16:f0a7/64 scope link 2023-07-09T21:22:51.267 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:51.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-07-09T21:22:51.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.269 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:51.269 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:51.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-07-09T21:22:51.269 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T21:22:51.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-07-09T21:22:51.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-07-09T21:22:51.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-07-09T21:22:51.270 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:51.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.410 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:22:51.410 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:22:51.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-07-09T21:22:51.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T21:22:51.411 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:22:51.453 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-07-09T21:22:51.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:51.453 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:51.509 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-07-09T21:22:51.509 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:51.510 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:51.560 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:22:51.622 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:51.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:51.688 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:51.689 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:51.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.690 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:22:51.745 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:22:51.745 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-07-09T21:22:51.745 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-07-09T21:22:51.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:22:51.818 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:51.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:51.880 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:51.882 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:51.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:51.883 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:22:51.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:2023-07-09T21:22:51.890+0000 7fe3e0648580 -1 init, newargv = 0x55afcc1f0f70 newargc=15 2023-07-09T21:22:51.895 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[45089]: starting ceph client 2023-07-09T21:22:51.903 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi037.stderr:ceph-fuse[45089]: starting fuse 2023-07-09T21:22:51.904 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:22:51.904 INFO:teuthology.orchestra.run.smithi037.stdout:43 2023-07-09T21:22:51.904 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-07-09T21:22:51.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:22:51.905 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:22:51.905 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:22:51.905 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:22:51.905 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:22:51.906 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:51.906 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:22:51.906 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-07-09T21:22:51.906 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:22:51.906 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-07-09T21:22:51.907 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:51.907 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:22:51.907 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:22:51.907 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:22:51.908 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:22:51.908 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:51.908 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:22:51.909 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:22:51.909 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:22:51.909 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:22:51.909 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:22:51.909 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:22:51.910 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:22:51.910 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:22:51.910 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:22:51.910 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.2")) 2023-07-09T21:22:51.910 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:22:52.027 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.2.45089.asok 2023-07-09T21:22:52.210 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45089.asok 2023-07-09T21:22:52.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:52.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45089.asok status 2023-07-09T21:22:52.387 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:22:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:22:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:22:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:22:52.387 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "2", 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "45089", 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:22:52.388 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4734, 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4734 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:22:52.389 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 698149822 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.2:0", 2023-07-09T21:22:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 698149822 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4734 192.168.0.2:0/698149822", 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.2:0/698149822", 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 8, 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 23, 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:22:52.391 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:22:52.392 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:22:52.392 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:22:52.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:22:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.538+0000 7f4432dd5640 1 Processor -- start 2023-07-09T21:22:52.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.538+0000 7f4432dd5640 1 -- start start 2023-07-09T21:22:52.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4432dd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4432dd5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 0x7f442c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4432dd5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c0b49f0 con 0x7f442c0cef80 2023-07-09T21:22:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4432dd5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c0b7e80 con 0x7f442c0b4340 2023-07-09T21:22:52.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4432dd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0cc8a0 con 0x7f442c0b7ab0 2023-07-09T21:22:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4431372640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 0x7f442c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4430b71640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f442bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f442c0cef80 0x7f442c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:55072/0 (socket says 172.21.15.37:55072) 2023-07-09T21:22:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f442bfff640 1 -- 172.21.15.37:0/2716143502 learned_addr learned my addr 172.21.15.37:0/2716143502 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:52.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4430b71640 1 -- 172.21.15.37:0/2716143502 >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 msgr2=0x7f442c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4430b71640 1 --2- 172.21.15.37:0/2716143502 >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 0x7f442c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4430b71640 1 -- 172.21.15.37:0/2716143502 >> v1:172.21.15.119:6789/0 conn(0x7f442c0cef80 legacy=0x7f442c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f442b7fe640 1 -- 172.21.15.37:0/2716143502 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3911520545 0 0) 0x7f442c0b49f0 con 0x7f442c0cef80 2023-07-09T21:22:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4430b71640 1 -- 172.21.15.37:0/2716143502 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0ccb80 con 0x7f442c0b7ab0 2023-07-09T21:22:52.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.542+0000 7f4431372640 1 --2- 172.21.15.37:0/2716143502 >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 0x7f442c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:52.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4430b71640 1 --2- 172.21.15.37:0/2716143502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c06aa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44200097c0 tx=0x7f442001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51f63d51b28fc8ba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:52.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f442b7fe640 1 -- 172.21.15.37:0/2716143502 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200ab650 con 0x7f442c0b7ab0 2023-07-09T21:22:52.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f442b7fe640 1 -- 172.21.15.37:0/2716143502 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44200ab7b0 con 0x7f442c0b7ab0 2023-07-09T21:22:52.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f442b7fe640 1 -- 172.21.15.37:0/2716143502 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44200abb40 con 0x7f442c0b7ab0 2023-07-09T21:22:52.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- 172.21.15.37:0/2716143502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 msgr2=0x7f442c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 --2- 172.21.15.37:0/2716143502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c06aa50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f44200097c0 tx=0x7f442001c450 comp rx=0 tx=0).stop 2023-07-09T21:22:52.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- 172.21.15.37:0/2716143502 shutdown_connections 2023-07-09T21:22:52.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 --2- 172.21.15.37:0/2716143502 >> v2:172.21.15.119:3300/0 conn(0x7f442c0b4340 0x7f442c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 --2- 172.21.15.37:0/2716143502 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c06aa50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- 172.21.15.37:0/2716143502 >> 172.21.15.37:0/2716143502 conn(0x7f442c073090 msgr2=0x7f442c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- 172.21.15.37:0/2716143502 shutdown_connections 2023-07-09T21:22:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- 172.21.15.37:0/2716143502 wait complete. 2023-07-09T21:22:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 Processor -- start 2023-07-09T21:22:52.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.546+0000 7f4432dd5640 1 -- start start 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0b4340 0x7f442c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c15de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0cb770 con 0x7f442c0cef80 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c15cdc0 con 0x7f442c0b4340 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c15d0a0 con 0x7f442c0b7ab0 2023-07-09T21:22:52.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60740/0 (socket says 172.21.15.37:60740) 2023-07-09T21:22:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 -- 172.21.15.37:0/3484455526 learned_addr learned my addr 172.21.15.37:0/3484455526 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4430b71640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0b4340 0x7f442c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f442bfff640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c15de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 -- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 msgr2=0x7f442c15de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c15de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 -- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0b4340 msgr2=0x7f442c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0b4340 0x7f442c15c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 -- 172.21.15.37:0/3484455526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4424009a70 con 0x7f442c0cef80 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4431372640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f442400efc0 tx=0x7f4424009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424009d70 con 0x7f442c0cef80 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442400f040 con 0x7f442c0cef80 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240039a0 con 0x7f442c0cef80 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4420009420 con 0x7f442c0cef80 2023-07-09T21:22:52.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c15d660 con 0x7f442c0cef80 2023-07-09T21:22:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c04d7d0 con 0x7f442c0cef80 2023-07-09T21:22:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.550+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f44240144a0 con 0x7f442c0cef80 2023-07-09T21:22:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.554+0000 7f44297fa640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 0x7f4410068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:52.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.554+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44240848e0 con 0x7f442c0cef80 2023-07-09T21:22:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.554+0000 7f4430b71640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 0x7f4410068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.554+0000 7f4430b71640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 0x7f4410068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44200af000 tx=0x7f44200a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.558+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4424055800 con 0x7f442c0cef80 2023-07-09T21:22:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.746+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f442c0c5860 con 0x7f442c0cef80 2023-07-09T21:22:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.746+0000 7f44297fa640 1 -- 172.21.15.37:0/3484455526 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4424018060 con 0x7f442c0cef80 2023-07-09T21:22:52.752 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:22:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 msgr2=0x7f4410068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 0x7f4410068730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f44200af000 tx=0x7f44200a7000 comp rx=0 tx=0).stop 2023-07-09T21:22:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 msgr2=0x7f442c0cac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f442400efc0 tx=0x7f4424009f90 comp rx=0 tx=0).stop 2023-07-09T21:22:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 shutdown_connections 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4410066280 0x7f4410068730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f442c0cef80 0x7f442c0cac90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f442c0b7ab0 0x7f442c15de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 --2- 172.21.15.37:0/3484455526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f442c0b4340 0x7f442c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 >> 172.21.15.37:0/3484455526 conn(0x7f442c073090 msgr2=0x7f442c0c7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 shutdown_connections 2023-07-09T21:22:52.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:52.750+0000 7f4432dd5640 1 -- 172.21.15.37:0/3484455526 wait complete. 2023-07-09T21:22:52.773 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:22:52.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:22:52.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-07-09T21:22:52.773 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-07-09T21:22:52.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:52.774 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:22:52.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:22:52.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:22:52.774 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:22:52.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:52.775 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-07-09T21:22:52.784 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:52.785 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:52.786 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42429sec preferred_lft 42429sec 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:9e:69:14:cf brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:52.787 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:22:52.788 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:52.788 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-09T21:22:52.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:52.789 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:52.789 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:52.789 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add name ceph-brx type bridge 2023-07-09T21:22:52.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr flush dev ceph-brx 2023-07-09T21:22:52.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set ceph-brx up 2023-07-09T21:22:52.790 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-09T21:22:52.790 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:52.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:52.908 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:22:52.928 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-07-09T21:22:52.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:52.930 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-07-09T21:22:52.999 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:53.000 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:53.001 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:53.001 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:22:53.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.001 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:53.002 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:53.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:22:53.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:22:53.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:22:53.002 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:53.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.095 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-07-09T21:22:53.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.105 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-07-09T21:22:53.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.154 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:53.155 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:53.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:22:53.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-07-09T21:22:53.155 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:53.238 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-07-09T21:22:53.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.239 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:53.239 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:53.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-07-09T21:22:53.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-09T21:22:53.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-07-09T21:22:53.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-07-09T21:22:53.240 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-07-09T21:22:53.241 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:53.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.399 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:53.399 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:53.399 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.0 up 2023-07-09T21:22:53.400 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.0 master ceph-brx 2023-07-09T21:22:53.400 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:53.442 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-07-09T21:22:53.442 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:53.443 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:53.498 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-07-09T21:22:53.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:53.498 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:53.549 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-07-09T21:22:53.610 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:53.611 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:53.672 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:53.674 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:53.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.675 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-07-09T21:22:53.725 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:22:53.726 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-07-09T21:22:53.772 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-07-09T21:22:53.793 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:53.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:53.852 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:53.854 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:53.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:53.855 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-07-09T21:22:53.874 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:2023-07-09T21:22:53.871+0000 7ff703da4580 -1 init, newargv = 0x55ddf43da1c0 newargc=15 2023-07-09T21:22:53.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[43450]: starting ceph client 2023-07-09T21:22:53.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi119.stderr:ceph-fuse[43450]: starting fuse 2023-07-09T21:22:53.884 INFO:teuthology.orchestra.run.smithi119.stdout:42 2023-07-09T21:22:53.884 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:22:53.885 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:22:53.885 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-07-09T21:22:53.885 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-07-09T21:22:53.885 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-07-09T21:22:53.886 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-07-09T21:22:53.886 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:53.886 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-07-09T21:22:53.886 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-07-09T21:22:53.886 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-07-09T21:22:53.887 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-07-09T21:22:53.887 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:53.887 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-07-09T21:22:53.887 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-07-09T21:22:53.888 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-07-09T21:22:53.888 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-07-09T21:22:53.888 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:53.888 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-07-09T21:22:53.888 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:22:53.889 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:22:53.889 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:22:53.889 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-07-09T21:22:53.889 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-07-09T21:22:53.890 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-07-09T21:22:53.890 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:22:53.890 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:53.890 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.1")) 2023-07-09T21:22:53.891 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-07-09T21:22:54.009 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.1.43450.asok 2023-07-09T21:22:54.193 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43450.asok 2023-07-09T21:22:54.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.193 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43450.asok status 2023-07-09T21:22:54.365 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-07-09T21:22:54.365 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-07-09T21:22:54.365 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:22:54.365 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:22:54.365 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "1", 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "43450", 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-07-09T21:22:54.366 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4565, 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4565 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-07-09T21:22:54.367 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3954495575 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 3954495575 2023-07-09T21:22:54.368 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4565 192.168.0.1:0/3954495575", 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.1:0/3954495575", 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 23, 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:22:54.369 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-07-09T21:22:54.370 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-07-09T21:22:54.370 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-07-09T21:22:54.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:22:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.526+0000 7f200cd40640 1 Processor -- start 2023-07-09T21:22:54.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 -- start start 2023-07-09T21:22:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2008158670 0x7f20080ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 0x7f20080af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200806efc0 con 0x7f200806caa0 2023-07-09T21:22:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200806d390 con 0x7f2008158670 2023-07-09T21:22:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200cd40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200806f4f0 con 0x7f200806b120 2023-07-09T21:22:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f2006d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f200806caa0 0x7f20080cca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39514/0 (socket says 172.21.15.37:39514) 2023-07-09T21:22:54.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f2006d9d640 1 -- 172.21.15.37:0/118096484 learned_addr learned my addr 172.21.15.37:0/118096484 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:54.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f1ffffff640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 0x7f20080af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200659c640 1 --2- 172.21.15.37:0/118096484 >> v2:172.21.15.119:3300/0 conn(0x7f2008158670 0x7f20080ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f2005d9b640 1 -- 172.21.15.37:0/118096484 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437255246 0 0) 0x7f200806efc0 con 0x7f200806caa0 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f2005d9b640 1 -- 172.21.15.37:0/118096484 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ff4003530 con 0x7f200806caa0 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200659c640 1 -- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 msgr2=0x7f20080af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200659c640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 0x7f20080af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200659c640 1 -- 172.21.15.37:0/118096484 >> v1:172.21.15.37:6789/0 conn(0x7f200806caa0 legacy=0x7f20080cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f200659c640 1 -- 172.21.15.37:0/118096484 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200806fe90 con 0x7f2008158670 2023-07-09T21:22:54.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.530+0000 7f1ffffff640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 0x7f20080af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:54.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200659c640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2008158670 0x7f20080ca2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097f0 tx=0x7f1ff801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7345cd480a70029 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:54.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f2005d9b640 1 -- 172.21.15.37:0/118096484 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80ab600 con 0x7f2008158670 2023-07-09T21:22:54.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f2005d9b640 1 -- 172.21.15.37:0/118096484 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff80a7050 con 0x7f2008158670 2023-07-09T21:22:54.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f2005d9b640 1 -- 172.21.15.37:0/118096484 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80ab980 con 0x7f2008158670 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 -- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2008158670 msgr2=0x7f20080ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2008158670 0x7f20080ca2f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097f0 tx=0x7f1ff801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 -- 172.21.15.37:0/118096484 shutdown_connections 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f200806b120 0x7f20080af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 --2- 172.21.15.37:0/118096484 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2008158670 0x7f20080ca2f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 -- 172.21.15.37:0/118096484 >> 172.21.15.37:0/118096484 conn(0x7f20080ca830 msgr2=0x7f20080cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:54.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 -- 172.21.15.37:0/118096484 shutdown_connections 2023-07-09T21:22:54.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.534+0000 7f200cd40640 1 -- 172.21.15.37:0/118096484 wait complete. 2023-07-09T21:22:54.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 Processor -- start 2023-07-09T21:22:54.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- start start 2023-07-09T21:22:54.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2008158670 0x7f20080ade60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b3a70 con 0x7f200806caa0 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b1ad0 con 0x7f200806b120 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b0be0 con 0x7f2008158670 2023-07-09T21:22:54.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f2006d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2008158670 0x7f20080ade60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:57702/0 (socket says 172.21.15.37:57702) 2023-07-09T21:22:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 -- 172.21.15.37:0/3336509554 learned_addr learned my addr 172.21.15.37:0/3336509554 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:54.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60750/0 (socket says 172.21.15.37:60750) 2023-07-09T21:22:54.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 -- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2008158670 msgr2=0x7f20080ade60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2008158670 0x7f20080ade60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 -- 172.21.15.37:0/3336509554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 msgr2=0x7f2008147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 -- 172.21.15.37:0/3336509554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff0009420 con 0x7f200806b120 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffffff640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200659c640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8019ff0 tx=0x7f1ff801ac00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8006e20 con 0x7f200806b120 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff80b7450 con 0x7f200806b120 2023-07-09T21:22:54.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80b77e0 con 0x7f200806b120 2023-07-09T21:22:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff8009420 con 0x7f200806b120 2023-07-09T21:22:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080b11a0 con 0x7f200806b120 2023-07-09T21:22:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.538+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200804d7d0 con 0x7f200806b120 2023-07-09T21:22:54.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.542+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ff80b7940 con 0x7f200806b120 2023-07-09T21:22:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.542+0000 7f1ffeffd640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 0x7f1fe8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.542+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ff811e320 con 0x7f200806b120 2023-07-09T21:22:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.542+0000 7f1ffffff640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 0x7f1fe8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:54.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.542+0000 7f1ffffff640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 0x7f1fe8068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f200814ef90 tx=0x7f1ff0009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:54.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.546+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ff80eb8d0 con 0x7f200806b120 2023-07-09T21:22:54.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f20080c8660 con 0x7f200806b120 2023-07-09T21:22:54.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f1ffeffd640 1 -- 172.21.15.37:0/3336509554 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1ff80eeef0 con 0x7f200806b120 2023-07-09T21:22:54.738 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 msgr2=0x7f1fe8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 0x7f1fe8068760 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f200814ef90 tx=0x7f1ff0009190 comp rx=0 tx=0).stop 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 msgr2=0x7f20080b3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8019ff0 tx=0x7f1ff801ac00 comp rx=0 tx=0).stop 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 shutdown_connections 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1fe80662b0 0x7f1fe8068760 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2008158670 0x7f20080ade60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200806caa0 0x7f2008147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 --2- 172.21.15.37:0/3336509554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f200806b120 0x7f20080b3530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 >> 172.21.15.37:0/3336509554 conn(0x7f20080ca830 msgr2=0x7f20080af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 shutdown_connections 2023-07-09T21:22:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:54.734+0000 7f200cd40640 1 -- 172.21.15.37:0/3336509554 wait complete. 2023-07-09T21:22:54.759 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:22:54.759 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:22:54.759 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi119.front.sepia.ceph.com 2023-07-09T21:22:54.759 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-07-09T21:22:54.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:54.760 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:22:54.760 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:22:54.760 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:22:54.760 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-07-09T21:22:54.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.761 DEBUG:teuthology.orchestra.run.smithi119:> ip addr 2023-07-09T21:22:54.770 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.770 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:62 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f0 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:d8:da:63 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout: altname enp7s0f1 2023-07-09T21:22:54.771 INFO:teuthology.orchestra.run.smithi119.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ee brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0c:c4:7a:8f:d5:ef brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.21.15.119/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft 42427sec preferred_lft 42427sec 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::ec4:7aff:fe8f:d5ef/64 scope link 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.772 INFO:teuthology.orchestra.run.smithi119.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 02:42:9e:69:14:cf brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.773 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-07-09T21:22:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.774 INFO:teuthology.orchestra.run.smithi119.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:22:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T21:22:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:22:54.774 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:54.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.775 DEBUG:teuthology.orchestra.run.smithi119:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:22:54.841 INFO:teuthology.orchestra.run.smithi119.stdout:1 2023-07-09T21:22:54.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.843 DEBUG:teuthology.orchestra.run.smithi119:> route 2023-07-09T21:22:54.896 INFO:teuthology.orchestra.run.smithi119.stdout:Kernel IP routing table 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-09T21:22:54.897 INFO:teuthology.orchestra.run.smithi119.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:54.898 INFO:teuthology.orchestra.run.smithi119.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:54.898 INFO:teuthology.orchestra.run.smithi119.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-07-09T21:22:54.898 INFO:teuthology.orchestra.run.smithi119.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:22:54.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.899 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:54.899 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:54.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-09T21:22:54.899 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-09T21:22:54.900 DEBUG:teuthology.orchestra.run.smithi119:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-09T21:22:54.900 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:54.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:54.989 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-07-09T21:22:54.998 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T21:22:55.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.000 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list-id 2023-07-09T21:22:55.050 INFO:teuthology.orchestra.run.smithi119.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-07-09T21:22:55.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.051 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:55.051 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:55.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T21:22:55.052 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-07-09T21:22:55.052 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:55.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.134 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T21:22:55.198 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.199 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:55.200 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 9e:aa:cb:69:98:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:22:55.200 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:22:55.200 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.200 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::9caa:cbff:fe69:9823/64 scope link 2023-07-09T21:22:55.200 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.201 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-07-09T21:22:55.266 INFO:teuthology.orchestra.run.smithi119.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:22:55.266 INFO:teuthology.orchestra.run.smithi119.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 ::1/128 scope host 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: link/ether 9e:aa:cb:69:98:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-07-09T21:22:55.267 INFO:teuthology.orchestra.run.smithi119.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-07-09T21:22:55.268 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.268 INFO:teuthology.orchestra.run.smithi119.stdout: inet6 fe80::9caa:cbff:fe69:9823/64 scope link 2023-07-09T21:22:55.268 INFO:teuthology.orchestra.run.smithi119.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:22:55.269 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-07-09T21:22:55.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.269 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:55.270 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:55.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-07-09T21:22:55.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-07-09T21:22:55.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-07-09T21:22:55.270 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-07-09T21:22:55.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-07-09T21:22:55.271 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:55.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.408 DEBUG:teuthology.orchestra.run.smithi119:> (cd / && exec bash -c ' 2023-07-09T21:22:55.409 DEBUG:teuthology.orchestra.run.smithi119:> set -e 2023-07-09T21:22:55.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set brx.1 up 2023-07-09T21:22:55.409 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link set dev brx.1 master ceph-brx 2023-07-09T21:22:55.409 DEBUG:teuthology.orchestra.run.smithi119:> ') 2023-07-09T21:22:55.450 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-07-09T21:22:55.450 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:55.451 DEBUG:teuthology.orchestra.run.smithi119:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:55.503 INFO:teuthology.orchestra.run.smithi119.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-07-09T21:22:55.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:22:55.503 DEBUG:teuthology.orchestra.run.smithi119:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:55.557 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-07-09T21:22:55.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:55.624 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:55.684 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:55.686 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:55.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.687 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-07-09T21:22:55.737 INFO:teuthology.orchestra.run.smithi119.stdout:42 2023-07-09T21:22:55.738 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-07-09T21:22:55.738 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-07-09T21:22:55.780 DEBUG:teuthology.orchestra.run.smithi119:> sudo modprobe fuse 2023-07-09T21:22:55.801 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:22:55.802 DEBUG:teuthology.orchestra.run.smithi119:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:22:55.863 INFO:teuthology.orchestra.run.smithi119.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:22:55.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:22:55.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:55.866 DEBUG:teuthology.orchestra.run.smithi119:> ls /sys/fs/fuse/connections 2023-07-09T21:22:55.880 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:2023-07-09T21:22:55.879+0000 7f716ea45580 -1 init, newargv = 0x55663cc54830 newargc=15 2023-07-09T21:22:55.881 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[43557]: starting ceph client 2023-07-09T21:22:55.886 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi119.stderr:ceph-fuse[43557]: starting fuse 2023-07-09T21:22:55.889 INFO:teuthology.orchestra.run.smithi119.stdout:42 2023-07-09T21:22:55.889 INFO:teuthology.orchestra.run.smithi119.stdout:43 2023-07-09T21:22:55.890 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2023-07-09T21:22:55.890 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:22:55.890 DEBUG:teuthology.orchestra.run.smithi119:> import glob 2023-07-09T21:22:55.890 DEBUG:teuthology.orchestra.run.smithi119:> import re 2023-07-09T21:22:55.891 DEBUG:teuthology.orchestra.run.smithi119:> import os 2023-07-09T21:22:55.891 DEBUG:teuthology.orchestra.run.smithi119:> import subprocess 2023-07-09T21:22:55.891 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:55.891 DEBUG:teuthology.orchestra.run.smithi119:> def _find_admin_socket(client_name): 2023-07-09T21:22:55.892 DEBUG:teuthology.orchestra.run.smithi119:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-07-09T21:22:55.892 DEBUG:teuthology.orchestra.run.smithi119:> files = glob.glob(asok_path) 2023-07-09T21:22:55.892 DEBUG:teuthology.orchestra.run.smithi119:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-07-09T21:22:55.892 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:55.893 DEBUG:teuthology.orchestra.run.smithi119:> # Given a non-glob path, it better be there 2023-07-09T21:22:55.893 DEBUG:teuthology.orchestra.run.smithi119:> if "*" not in asok_path: 2023-07-09T21:22:55.893 DEBUG:teuthology.orchestra.run.smithi119:> assert(len(files) == 1) 2023-07-09T21:22:55.893 DEBUG:teuthology.orchestra.run.smithi119:> return files[0] 2023-07-09T21:22:55.893 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:55.894 DEBUG:teuthology.orchestra.run.smithi119:> for f in files: 2023-07-09T21:22:55.894 DEBUG:teuthology.orchestra.run.smithi119:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:22:55.894 DEBUG:teuthology.orchestra.run.smithi119:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:22:55.895 DEBUG:teuthology.orchestra.run.smithi119:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:22:55.895 DEBUG:teuthology.orchestra.run.smithi119:> contents = proc_f.read() 2023-07-09T21:22:55.895 DEBUG:teuthology.orchestra.run.smithi119:> if mountpoint in contents: 2023-07-09T21:22:55.895 DEBUG:teuthology.orchestra.run.smithi119:> return f 2023-07-09T21:22:55.895 DEBUG:teuthology.orchestra.run.smithi119:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:22:55.896 DEBUG:teuthology.orchestra.run.smithi119:> 2023-07-09T21:22:55.896 DEBUG:teuthology.orchestra.run.smithi119:> print(_find_admin_socket("client.3")) 2023-07-09T21:22:55.896 DEBUG:teuthology.orchestra.run.smithi119:> ' 2023-07-09T21:22:56.010 INFO:teuthology.orchestra.run.smithi119.stdout:/var/run/ceph/ceph-client.3.43557.asok 2023-07-09T21:22:56.194 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43557.asok 2023-07-09T21:22:56.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.195 DEBUG:teuthology.orchestra.run.smithi119:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43557.asok status 2023-07-09T21:22:56.365 INFO:teuthology.orchestra.run.smithi119.stdout:{ 2023-07-09T21:22:56.365 INFO:teuthology.orchestra.run.smithi119.stdout: "metadata": { 2023-07-09T21:22:56.366 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:22:56.366 INFO:teuthology.orchestra.run.smithi119.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:22:56.366 INFO:teuthology.orchestra.run.smithi119.stdout: "entity_id": "3", 2023-07-09T21:22:56.366 INFO:teuthology.orchestra.run.smithi119.stdout: "hostname": "smithi119", 2023-07-09T21:22:56.366 INFO:teuthology.orchestra.run.smithi119.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-07-09T21:22:56.367 INFO:teuthology.orchestra.run.smithi119.stdout: "pid": "43557", 2023-07-09T21:22:56.367 INFO:teuthology.orchestra.run.smithi119.stdout: "root": "/" 2023-07-09T21:22:56.367 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:56.367 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_count": 0, 2023-07-09T21:22:56.368 INFO:teuthology.orchestra.run.smithi119.stdout: "dentry_pinned_count": 0, 2023-07-09T21:22:56.368 INFO:teuthology.orchestra.run.smithi119.stdout: "id": 4675, 2023-07-09T21:22:56.368 INFO:teuthology.orchestra.run.smithi119.stdout: "inst": { 2023-07-09T21:22:56.369 INFO:teuthology.orchestra.run.smithi119.stdout: "name": { 2023-07-09T21:22:56.369 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "client", 2023-07-09T21:22:56.369 INFO:teuthology.orchestra.run.smithi119.stdout: "num": 4675 2023-07-09T21:22:56.369 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:56.370 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-07-09T21:22:56.370 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-07-09T21:22:56.370 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-07-09T21:22:56.371 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2227302547 2023-07-09T21:22:56.371 INFO:teuthology.orchestra.run.smithi119.stdout: } 2023-07-09T21:22:56.371 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:56.371 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": { 2023-07-09T21:22:56.372 INFO:teuthology.orchestra.run.smithi119.stdout: "type": "v1", 2023-07-09T21:22:56.372 INFO:teuthology.orchestra.run.smithi119.stdout: "addr": "192.168.0.2:0", 2023-07-09T21:22:56.372 INFO:teuthology.orchestra.run.smithi119.stdout: "nonce": 2227302547 2023-07-09T21:22:56.373 INFO:teuthology.orchestra.run.smithi119.stdout: }, 2023-07-09T21:22:56.373 INFO:teuthology.orchestra.run.smithi119.stdout: "inst_str": "client.4675 192.168.0.2:0/2227302547", 2023-07-09T21:22:56.373 INFO:teuthology.orchestra.run.smithi119.stdout: "addr_str": "192.168.0.2:0/2227302547", 2023-07-09T21:22:56.373 INFO:teuthology.orchestra.run.smithi119.stdout: "inode_count": 1, 2023-07-09T21:22:56.374 INFO:teuthology.orchestra.run.smithi119.stdout: "mds_epoch": 8, 2023-07-09T21:22:56.374 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch": 23, 2023-07-09T21:22:56.374 INFO:teuthology.orchestra.run.smithi119.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:22:56.374 INFO:teuthology.orchestra.run.smithi119.stdout: "blocklisted": false, 2023-07-09T21:22:56.374 INFO:teuthology.orchestra.run.smithi119.stdout: "fs_name": "cephfs" 2023-07-09T21:22:56.375 INFO:teuthology.orchestra.run.smithi119.stdout:} 2023-07-09T21:22:56.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.381 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:22:56.381 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:56.392 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:22:56.392 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:56.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.393 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:22:56.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.459 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:22:56.459 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:56.510 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:22:56.511 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:56.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-07-09T21:22:56.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.579 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-07-09T21:22:56.579 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:56.588 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-07-09T21:22:56.588 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:56.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.589 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-07-09T21:22:56.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.650 DEBUG:teuthology.orchestra.run.smithi119:> stat --file-system '--printf=%T 2023-07-09T21:22:56.650 DEBUG:teuthology.orchestra.run.smithi119:> ' -- /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:56.702 INFO:teuthology.orchestra.run.smithi119.stdout:fuseblk 2023-07-09T21:22:56.702 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:56.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:22:56.703 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-07-09T21:22:56.766 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-07-09T21:22:56.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 Processor -- start 2023-07-09T21:22:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 -- start start 2023-07-09T21:22:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7ab0 0x7f8c9406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940cef80 0x7f8c940b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c940b49f0 con 0x7f8c940b4170 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940b7e80 con 0x7f8c940cef80 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c9aeec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940b45f0 con 0x7f8c940b7ab0 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.938+0000 7f8c93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940cef80 0x7f8c940b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940cef80 0x7f8c940b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60764/0 (socket says 172.21.15.37:60764) 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 -- 172.21.15.37:0/3635152879 learned_addr learned my addr 172.21.15.37:0/3635152879 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c98c88640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7ab0 0x7f8c9406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 -- 172.21.15.37:0/3635152879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7ab0 msgr2=0x7f8c9406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7ab0 0x7f8c9406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 -- 172.21.15.37:0/3635152879 >> v1:172.21.15.119:6789/0 conn(0x7f8c940b4170 legacy=0x7f8c9415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 -- 172.21.15.37:0/3635152879 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940cc8a0 con 0x7f8c940cef80 2023-07-09T21:22:56.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c93fff640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940cef80 0x7f8c940b3c30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009870 tx=0x7f8c8001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143f8c05df05e228 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:56.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c937fe640 1 -- 172.21.15.37:0/3635152879 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800aa670 con 0x7f8c940cef80 2023-07-09T21:22:56.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c937fe640 1 -- 172.21.15.37:0/3635152879 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c800aa7d0 con 0x7f8c940cef80 2023-07-09T21:22:56.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.942+0000 7f8c937fe640 1 -- 172.21.15.37:0/3635152879 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800aab60 con 0x7f8c940cef80 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- 172.21.15.37:0/3635152879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940cef80 msgr2=0x7f8c940b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940cef80 0x7f8c940b3c30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009870 tx=0x7f8c8001c510 comp rx=0 tx=0).stop 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- 172.21.15.37:0/3635152879 shutdown_connections 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940cef80 0x7f8c940b3c30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/3635152879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7ab0 0x7f8c9406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- 172.21.15.37:0/3635152879 >> 172.21.15.37:0/3635152879 conn(0x7f8c94073090 msgr2=0x7f8c94069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- 172.21.15.37:0/3635152879 shutdown_connections 2023-07-09T21:22:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- 172.21.15.37:0/3635152879 wait complete. 2023-07-09T21:22:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 Processor -- start 2023-07-09T21:22:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- start start 2023-07-09T21:22:56.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b4170 0x7f8c940c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940cef80 0x7f8c9414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940c6330 con 0x7f8c940b7ab0 2023-07-09T21:22:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94149870 con 0x7f8c940b4170 2023-07-09T21:22:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c9aeec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c94157fb0 con 0x7f8c940cef80 2023-07-09T21:22:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c93fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60768/0 (socket says 172.21.15.37:60768) 2023-07-09T21:22:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c93fff640 1 -- 172.21.15.37:0/2547673224 learned_addr learned my addr 172.21.15.37:0/2547673224 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c98c88640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b4170 0x7f8c940c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.946+0000 7f8c99489640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940cef80 0x7f8c9414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 -- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940cef80 msgr2=0x7f8c9414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940cef80 0x7f8c9414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 -- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b4170 msgr2=0x7f8c940c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b4170 0x7f8c940c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 -- 172.21.15.37:0/2547673224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c800094d0 con 0x7f8c940b7ab0 2023-07-09T21:22:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c93fff640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001a140 tx=0x7f8c8001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800b3800 con 0x7f8c940b7ab0 2023-07-09T21:22:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c800b3960 con 0x7f8c940b7ab0 2023-07-09T21:22:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800b3d10 con 0x7f8c940b7ab0 2023-07-09T21:22:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c94158290 con 0x7f8c940b7ab0 2023-07-09T21:22:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c940c5fc0 con 0x7f8c940b7ab0 2023-07-09T21:22:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c940c64a0 con 0x7f8c940b7ab0 2023-07-09T21:22:56.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8c800b2380 con 0x7f8c940b7ab0 2023-07-09T21:22:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 0x7f8c78068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c8011e660 con 0x7f8c940b7ab0 2023-07-09T21:22:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.950+0000 7f8c98c88640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 0x7f8c78068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.954+0000 7f8c98c88640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 0x7f8c78068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c88007a60 tx=0x7f8c88008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:56.954+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c800ebb80 con 0x7f8c940b7ab0 2023-07-09T21:22:57.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c9404d7d0 con 0x7f8c940b7ab0 2023-07-09T21:22:57.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c917fa640 1 -- 172.21.15.37:0/2547673224 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f8c800ef1a0 con 0x7f8c940b7ab0 2023-07-09T21:22:57.119 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:57.119 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:57.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 msgr2=0x7f8c78068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 0x7f8c78068730 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8c88007a60 tx=0x7f8c88008040 comp rx=0 tx=0).stop 2023-07-09T21:22:57.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 msgr2=0x7f8c94147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8c8001a140 tx=0x7f8c8001ad50 comp rx=0 tx=0).stop 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 shutdown_connections 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8c78066280 0x7f8c78068730 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940cef80 0x7f8c9414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b7ab0 0x7f8c94147720 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 --2- 172.21.15.37:0/2547673224 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b4170 0x7f8c940c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 >> 172.21.15.37:0/2547673224 conn(0x7f8c94073090 msgr2=0x7f8c940b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 shutdown_connections 2023-07-09T21:22:57.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.114+0000 7f8c9aeec640 1 -- 172.21.15.37:0/2547673224 wait complete. 2023-07-09T21:22:57.140 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:57.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 Processor -- start 2023-07-09T21:22:57.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 -- start start 2023-07-09T21:22:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9fc0b7980 0x7fb9fc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0ceb80 0x7fb9fc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc15bf80 con 0x7fb9fc0b3c20 2023-07-09T21:22:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0cd070 con 0x7fb9fc0b7980 2023-07-09T21:22:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fba0219f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0cfd70 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb9fc0b7980 0x7fb9fc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9fc0b3c20 0x7fb9fc0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39518/0 (socket says 172.21.15.37:39518) 2023-07-09T21:22:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fbfff640 1 -- 172.21.15.37:0/4174420442 learned_addr learned my addr 172.21.15.37:0/4174420442 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:57.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9faffd640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0ceb80 0x7fb9fc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/4174420442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0ceb80 msgr2=0x7fb9fc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0ceb80 0x7fb9fc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/4174420442 >> v1:172.21.15.37:6789/0 conn(0x7fb9fc0b3c20 legacy=0x7fb9fc0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/4174420442 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc160570 con 0x7fb9fc0b7980 2023-07-09T21:22:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.282+0000 7fb9fa7fc640 1 -- 172.21.15.37:0/4174420442 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633888635 0 0) 0x7fb9f40014a0 con 0x7fb9fc0b3c20 2023-07-09T21:22:57.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc160030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e54f01bfb736be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fb9fa7fc640 1 -- 172.21.15.37:0/4174420442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ab600 con 0x7fb9fc0b7980 2023-07-09T21:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fb9fa7fc640 1 -- 172.21.15.37:0/4174420442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0a7050 con 0x7fb9fc0b7980 2023-07-09T21:22:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fb9fa7fc640 1 -- 172.21.15.37:0/4174420442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ab980 con 0x7fb9fc0b7980 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 -- 172.21.15.37:0/4174420442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0b7980 msgr2=0x7fb9fc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc160030 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0097c0 tx=0x7fb9ec01c480 comp rx=0 tx=0).stop 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 -- 172.21.15.37:0/4174420442 shutdown_connections 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0ceb80 0x7fb9fc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 --2- 172.21.15.37:0/4174420442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc160030 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 -- 172.21.15.37:0/4174420442 >> 172.21.15.37:0/4174420442 conn(0x7fb9fc073090 msgr2=0x7fb9fc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 -- 172.21.15.37:0/4174420442 shutdown_connections 2023-07-09T21:22:57.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.286+0000 7fba0219f640 1 -- 172.21.15.37:0/4174420442 wait complete. 2023-07-09T21:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 Processor -- start 2023-07-09T21:22:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- start start 2023-07-09T21:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 0x7fb9fc15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc153850 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc153aa0 con 0x7fb9fc0b7980 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc153d80 con 0x7fb9fc0b3c20 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60782/0 (socket says 172.21.15.37:60782) 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 -- 172.21.15.37:0/337048795 learned_addr learned my addr 172.21.15.37:0/337048795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9faffd640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 0x7fb9fc15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 -- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 msgr2=0x7fb9fc15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 0x7fb9fc15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 -- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 msgr2=0x7fb9fc154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 -- 172.21.15.37:0/337048795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec009420 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9faffd640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 0x7fb9fc15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c780 tx=0x7fb9f400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400ce90 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f400a640 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f400a9d0 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc154060 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.290+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0ca8c0 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9fc04d7d0 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9f400ab30 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fb9e3fff640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 0x7fb9e8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9f40831b0 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 0x7fb9e8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.294+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 0x7fb9e8068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0ad000 tx=0x7fb9ec008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.298+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9f4050590 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.454+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9fc15bf60 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.454+0000 7fb9e3fff640 1 -- 172.21.15.37:0/337048795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb9f4053bb0 con 0x7fb9fc0ceb80 2023-07-09T21:22:57.461 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 msgr2=0x7fb9e8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 0x7fb9e8068730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0ad000 tx=0x7fb9ec008040 comp rx=0 tx=0).stop 2023-07-09T21:22:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 msgr2=0x7fb9fc15e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400c780 tx=0x7fb9f400cc40 comp rx=0 tx=0).stop 2023-07-09T21:22:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 shutdown_connections 2023-07-09T21:22:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9e8066280 0x7fb9e8068730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9fc0ceb80 0x7fb9fc15e550 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9fc0b7980 0x7fb9fc154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 --2- 172.21.15.37:0/337048795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9fc0b3c20 0x7fb9fc15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 >> 172.21.15.37:0/337048795 conn(0x7fb9fc073090 msgr2=0x7fb9fc0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 shutdown_connections 2023-07-09T21:22:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.458+0000 7fba0219f640 1 -- 172.21.15.37:0/337048795 wait complete. 2023-07-09T21:22:57.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 Processor -- start 2023-07-09T21:22:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 -- start start 2023-07-09T21:22:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f49080cf290 0x7f4908160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490815bf80 con 0x7f49080d0780 2023-07-09T21:22:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908160570 con 0x7f49080b7980 2023-07-09T21:22:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490fc93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080cd070 con 0x7f49080cf290 2023-07-09T21:22:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490e230640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f49080d0780 0x7f49080d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53190/0 (socket says 172.21.15.37:53190) 2023-07-09T21:22:57.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490e230640 1 -- 172.21.15.37:0/1961163616 learned_addr learned my addr 172.21.15.37:0/1961163616 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490d22e640 1 --2- 172.21.15.37:0/1961163616 >> v2:172.21.15.119:3300/0 conn(0x7f49080cf290 0x7f4908160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671614253 0 0) 0x7f49000014a0 con 0x7f49080d0780 2023-07-09T21:22:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f4003530 con 0x7f49080d0780 2023-07-09T21:22:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020114808 0 0) 0x7f4904001120 con 0x7f49080b7980 2023-07-09T21:22:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49000014a0 con 0x7f49080b7980 2023-07-09T21:22:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490d22e640 1 -- 172.21.15.37:0/1961163616 >> v1:172.21.15.119:6789/0 conn(0x7f49080b7980 legacy=0x7f49080ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490d22e640 1 -- 172.21.15.37:0/1961163616 >> v1:172.21.15.37:6789/0 conn(0x7f49080d0780 legacy=0x7f49080d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.622+0000 7f490d22e640 1 -- 172.21.15.37:0/1961163616 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080d02f0 con 0x7f49080cf290 2023-07-09T21:22:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490d22e640 1 --2- 172.21.15.37:0/1961163616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080cf290 0x7f4908160030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48f80097c0 tx=0x7f48f801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16740955de520d8b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80ab600 con 0x7f49080cf290 2023-07-09T21:22:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f80a7050 con 0x7f49080cf290 2023-07-09T21:22:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490ca2d640 1 -- 172.21.15.37:0/1961163616 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80ab960 con 0x7f49080cf290 2023-07-09T21:22:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490fc93640 1 -- 172.21.15.37:0/1961163616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080cf290 msgr2=0x7f4908160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490fc93640 1 --2- 172.21.15.37:0/1961163616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080cf290 0x7f4908160030 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48f80097c0 tx=0x7f48f801c480 comp rx=0 tx=0).stop 2023-07-09T21:22:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490fc93640 1 -- 172.21.15.37:0/1961163616 shutdown_connections 2023-07-09T21:22:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490fc93640 1 --2- 172.21.15.37:0/1961163616 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080cf290 0x7f4908160030 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.626+0000 7f490fc93640 1 -- 172.21.15.37:0/1961163616 >> 172.21.15.37:0/1961163616 conn(0x7f4908073090 msgr2=0x7f4908069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- 172.21.15.37:0/1961163616 shutdown_connections 2023-07-09T21:22:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- 172.21.15.37:0/1961163616 wait complete. 2023-07-09T21:22:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 Processor -- start 2023-07-09T21:22:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- start start 2023-07-09T21:22:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 0x7f490813d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 0x7f49080b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49080b3ad0 con 0x7f49080cf290 2023-07-09T21:22:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490813dbc0 con 0x7f49080b7980 2023-07-09T21:22:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490fc93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490814f230 con 0x7f49080d0780 2023-07-09T21:22:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60616/0 (socket says 172.21.15.37:60616) 2023-07-09T21:22:57.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 -- 172.21.15.37:0/1311632742 learned_addr learned my addr 172.21.15.37:0/1311632742 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490e230640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 0x7f49080b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490da2f640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 0x7f490813d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 -- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 msgr2=0x7f49080b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 0x7f49080b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 -- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 msgr2=0x7f490813d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 0x7f490813d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 -- 172.21.15.37:0/1311632742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f8009420 con 0x7f49080cf290 2023-07-09T21:22:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490e230640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 0x7f49080b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:57.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490da2f640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 0x7f490813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f490d22e640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48f8019090 tx=0x7f48f8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.630+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80b4810 con 0x7f49080cf290 2023-07-09T21:22:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f80b4970 con 0x7f49080cf290 2023-07-09T21:22:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80b4d00 con 0x7f49080cf290 2023-07-09T21:22:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49080c8670 con 0x7f49080cf290 2023-07-09T21:22:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49080b36f0 con 0x7f49080cf290 2023-07-09T21:22:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490804d7d0 con 0x7f49080cf290 2023-07-09T21:22:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48f80b2040 con 0x7f49080cf290 2023-07-09T21:22:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f48fe7fc640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 0x7f48ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.634+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f48f811e270 con 0x7f49080cf290 2023-07-09T21:22:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.638+0000 7f490da2f640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 0x7f48ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.638+0000 7f490da2f640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 0x7f48ec068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4904001380 tx=0x7f4904009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.638+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48f80eb6e0 con 0x7f49080cf290 2023-07-09T21:22:57.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49080b1600 con 0x7f49080cf290 2023-07-09T21:22:57.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f48fe7fc640 1 -- 172.21.15.37:0/1311632742 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f48f80b4e60 con 0x7f49080cf290 2023-07-09T21:22:57.802 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:57.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 msgr2=0x7f48ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 0x7f48ec068730 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4904001380 tx=0x7f4904009040 comp rx=0 tx=0).stop 2023-07-09T21:22:57.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 msgr2=0x7f490814ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48f8019090 tx=0x7f48f8019220 comp rx=0 tx=0).stop 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 shutdown_connections 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f48ec066280 0x7f48ec068730 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49080d0780 0x7f49080b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49080cf290 0x7f490814ecf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 --2- 172.21.15.37:0/1311632742 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49080b7980 0x7f490813d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 >> 172.21.15.37:0/1311632742 conn(0x7f4908073090 msgr2=0x7f490815cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 shutdown_connections 2023-07-09T21:22:57.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.798+0000 7f490fc93640 1 -- 172.21.15.37:0/1311632742 wait complete. 2023-07-09T21:22:57.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:22:57.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:22:57.954 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.962+0000 7f4a35e48640 1 Processor -- start 2023-07-09T21:22:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.962+0000 7f4a35e48640 1 -- start start 2023-07-09T21:22:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a35e48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a300b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a35e48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a300d0530 0x7f4a300cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a35e48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300b3bb0 con 0x7f4a300b74e0 2023-07-09T21:22:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a35e48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300b7930 con 0x7f4a300d0530 2023-07-09T21:22:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a35e48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cccb0 con 0x7f4a3015f130 2023-07-09T21:22:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a300b74e0 0x7f4a300cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53196/0 (socket says 172.21.15.37:53196) 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2effd640 1 -- 172.21.15.37:0/895447660 learned_addr learned my addr 172.21.15.37:0/895447660 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4a300d0530 0x7f4a300cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2f7fe640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a300b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2ffff640 1 -- 172.21.15.37:0/895447660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 msgr2=0x7f4a300b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2ffff640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a300b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2ffff640 1 -- 172.21.15.37:0/895447660 >> v1:172.21.15.37:6789/0 conn(0x7f4a300b74e0 legacy=0x7f4a300cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.966+0000 7f4a2ffff640 1 -- 172.21.15.37:0/895447660 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300b8100 con 0x7f4a300d0530 2023-07-09T21:22:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a2ffff640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cd140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009d90 tx=0x7f4a2801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6cc60aeaccb644 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a2e7fc640 1 -- 172.21.15.37:0/895447660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280a5950 con 0x7f4a300d0530 2023-07-09T21:22:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a2e7fc640 1 -- 172.21.15.37:0/895447660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a280a5ab0 con 0x7f4a300d0530 2023-07-09T21:22:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a2e7fc640 1 -- 172.21.15.37:0/895447660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280a5e40 con 0x7f4a300d0530 2023-07-09T21:22:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- 172.21.15.37:0/895447660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 msgr2=0x7f4a300cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cd140 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4a28009d90 tx=0x7f4a2801c890 comp rx=0 tx=0).stop 2023-07-09T21:22:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- 172.21.15.37:0/895447660 shutdown_connections 2023-07-09T21:22:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cd140 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 --2- 172.21.15.37:0/895447660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a300b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- 172.21.15.37:0/895447660 >> 172.21.15.37:0/895447660 conn(0x7f4a30072d20 msgr2=0x7f4a300d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- 172.21.15.37:0/895447660 shutdown_connections 2023-07-09T21:22:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- 172.21.15.37:0/895447660 wait complete. 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 Processor -- start 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.970+0000 7f4a35e48640 1 -- start start 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 0x7f4a30159e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a3015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cc590 con 0x7f4a300d0530 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cb4f0 con 0x7f4a300b74e0 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300cb7d0 con 0x7f4a3015f130 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60626/0 (socket says 172.21.15.37:60626) 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 -- 172.21.15.37:0/2705487217 learned_addr learned my addr 172.21.15.37:0/2705487217 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2ffff640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a3015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2f7fe640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 0x7f4a30159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 -- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 msgr2=0x7f4a3015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a3015b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 -- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 msgr2=0x7f4a30159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 0x7f4a30159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 -- 172.21.15.37:0/2705487217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a28009a70 con 0x7f4a300d0530 2023-07-09T21:22:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2f7fe640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 0x7f4a30159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a2effd640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c400 tx=0x7f4a2400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24005cf0 con 0x7f4a300d0530 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a24005e50 con 0x7f4a300d0530 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a240072d0 con 0x7f4a300d0530 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300cbab0 con 0x7f4a300d0530 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300cc070 con 0x7f4a300d0530 2023-07-09T21:22:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.974+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300668f0 con 0x7f4a300d0530 2023-07-09T21:22:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.978+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a24007430 con 0x7f4a300d0530 2023-07-09T21:22:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.978+0000 7f4a17fff640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 0x7f4a1c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.978+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4a240831b0 con 0x7f4a300d0530 2023-07-09T21:22:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.978+0000 7f4a2f7fe640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 0x7f4a1c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.978+0000 7f4a2f7fe640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 0x7f4a1c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009bb0 tx=0x7f4a20008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:57.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:57.982+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a240506d0 con 0x7f4a300d0530 2023-07-09T21:22:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4a300b6f80 con 0x7f4a300d0530 2023-07-09T21:22:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a17fff640 1 -- 172.21.15.37:0/2705487217 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4a24053cf0 con 0x7f4a300d0530 2023-07-09T21:22:58.139 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:22:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 msgr2=0x7f4a1c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 0x7f4a1c068730 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009bb0 tx=0x7f4a20008040 comp rx=0 tx=0).stop 2023-07-09T21:22:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 msgr2=0x7f4a300cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4a2400c400 tx=0x7f4a2400c8c0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 shutdown_connections 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4a1c066280 0x7f4a1c068730 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a3015f130 0x7f4a3015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a300d0530 0x7f4a300cac10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 --2- 172.21.15.37:0/2705487217 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a300b74e0 0x7f4a30159e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.134+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 >> 172.21.15.37:0/2705487217 conn(0x7f4a30072d20 msgr2=0x7f4a300cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.138+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 shutdown_connections 2023-07-09T21:22:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.138+0000 7f4a35e48640 1 -- 172.21.15.37:0/2705487217 wait complete. 2023-07-09T21:22:58.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:22:58.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.298+0000 7fcd80d00640 1 Processor -- start 2023-07-09T21:22:58.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.298+0000 7fcd80d00640 1 -- start start 2023-07-09T21:22:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd80d00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7c0b7980 0x7fcd7c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd80d00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 0x7fcd7c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd80d00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c15bf80 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd80d00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c0cd070 con 0x7fcd7c0b7980 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd80d00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0cfd70 con 0x7fcd7c0ceb80 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7c0b7980 0x7fcd7c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd7c0b7980 0x7fcd7c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60636/0 (socket says 172.21.15.37:60636) 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 -- 172.21.15.37:0/148687570 learned_addr learned my addr 172.21.15.37:0/148687570 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd79d9b640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 0x7fcd7c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 -- 172.21.15.37:0/148687570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 msgr2=0x7fcd7c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 0x7fcd7c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 -- 172.21.15.37:0/148687570 >> v1:172.21.15.119:6789/0 conn(0x7fcd7c0b3c20 legacy=0x7fcd7c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd7a59c640 1 -- 172.21.15.37:0/148687570 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c160570 con 0x7fcd7c0b7980 2023-07-09T21:22:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.302+0000 7fcd79d9b640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 0x7fcd7c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:58.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd7a59c640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b7980 0x7fcd7c160030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178516c1e71e33db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd7959a640 1 -- 172.21.15.37:0/148687570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0ab600 con 0x7fcd7c0b7980 2023-07-09T21:22:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd7959a640 1 -- 172.21.15.37:0/148687570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0a7050 con 0x7fcd7c0b7980 2023-07-09T21:22:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd7959a640 1 -- 172.21.15.37:0/148687570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0ab980 con 0x7fcd7c0b7980 2023-07-09T21:22:58.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- 172.21.15.37:0/148687570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b7980 msgr2=0x7fcd7c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b7980 0x7fcd7c160030 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c009870 tx=0x7fcd6c01c500 comp rx=0 tx=0).stop 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- 172.21.15.37:0/148687570 shutdown_connections 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0ceb80 0x7fcd7c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 --2- 172.21.15.37:0/148687570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b7980 0x7fcd7c160030 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- 172.21.15.37:0/148687570 >> 172.21.15.37:0/148687570 conn(0x7fcd7c073090 msgr2=0x7fcd7c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- 172.21.15.37:0/148687570 shutdown_connections 2023-07-09T21:22:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- 172.21.15.37:0/148687570 wait complete. 2023-07-09T21:22:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 Processor -- start 2023-07-09T21:22:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.306+0000 7fcd80d00640 1 -- start start 2023-07-09T21:22:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0b7980 0x7fcd7c151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c0ceb80 0x7fcd7c1f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c151c60 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c153150 con 0x7fcd7c0ceb80 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c152b90 con 0x7fcd7c0b7980 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60638/0 (socket says 172.21.15.37:60638) 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 -- 172.21.15.37:0/2668446739 learned_addr learned my addr 172.21.15.37:0/2668446739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd79d9b640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0b7980 0x7fcd7c151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7ad9d640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c0ceb80 0x7fcd7c1f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 -- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0b7980 msgr2=0x7fcd7c151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0b7980 0x7fcd7c151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 -- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c0ceb80 msgr2=0x7fcd7c1f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c0ceb80 0x7fcd7c1f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 -- 172.21.15.37:0/2668446739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0094d0 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd7a59c640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c01abb0 tx=0x7fcd6c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0b37d0 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6c0b3930 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6c0b3ce0 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c152e70 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c15a790 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c04d7d0 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.310+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcd6c0b2070 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.314+0000 7fcd6affd640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 0x7fcd5c068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.314+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd6c11de20 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.314+0000 7fcd79d9b640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 0x7fcd5c068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.314+0000 7fcd79d9b640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 0x7fcd5c068700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0ceb20 tx=0x7fcd70008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.318+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd6c0eb290 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd7c160570 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd6affd640 1 -- 172.21.15.37:0/2668446739 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd7c160570 con 0x7fcd7c0b3c20 2023-07-09T21:22:58.474 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 msgr2=0x7fcd5c068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 0x7fcd5c068700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c0ceb20 tx=0x7fcd70008040 comp rx=0 tx=0).stop 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 msgr2=0x7fcd7c1511e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c01abb0 tx=0x7fcd6c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 shutdown_connections 2023-07-09T21:22:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fcd5c066250 0x7fcd5c068700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd7c0ceb80 0x7fcd7c1f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd7c0b7980 0x7fcd7c151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 --2- 172.21.15.37:0/2668446739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd7c0b3c20 0x7fcd7c1511e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 >> 172.21.15.37:0/2668446739 conn(0x7fcd7c073090 msgr2=0x7fcd7c1550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 shutdown_connections 2023-07-09T21:22:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.470+0000 7fcd80d00640 1 -- 172.21.15.37:0/2668446739 wait complete. 2023-07-09T21:22:58.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 Processor -- start 2023-07-09T21:22:58.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 -- start start 2023-07-09T21:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1440b4340 0x7fb14406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440b49f0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1440b7e80 con 0x7fb1440b4340 2023-07-09T21:22:58.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb148834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440cc8a0 con 0x7fb1440cef80 2023-07-09T21:22:58.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb13bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1440b4340 0x7fb14406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb14259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1440b7ab0 0x7fb1440b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53202/0 (socket says 172.21.15.37:53202) 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb14259c640 1 -- 172.21.15.37:0/223091362 learned_addr learned my addr 172.21.15.37:0/223091362 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb142d9d640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb13bfff640 1 -- 172.21.15.37:0/223091362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 msgr2=0x7fb1440d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb13bfff640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb141d9b640 1 -- 172.21.15.37:0/223091362 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523051637 0 0) 0x7fb1440b49f0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb13bfff640 1 -- 172.21.15.37:0/223091362 >> v1:172.21.15.37:6789/0 conn(0x7fb1440b7ab0 legacy=0x7fb1440b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb13bfff640 1 -- 172.21.15.37:0/223091362 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440ccb80 con 0x7fb1440b4340 2023-07-09T21:22:58.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.634+0000 7fb142d9d640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:22:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb13bfff640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b4340 0x7fb14406aa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097c0 tx=0x7fb12c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b423794c3bce9f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb141d9b640 1 -- 172.21.15.37:0/223091362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0ab650 con 0x7fb1440b4340 2023-07-09T21:22:58.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb141d9b640 1 -- 172.21.15.37:0/223091362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0ab7b0 con 0x7fb1440b4340 2023-07-09T21:22:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb141d9b640 1 -- 172.21.15.37:0/223091362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0abb40 con 0x7fb1440b4340 2023-07-09T21:22:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 -- 172.21.15.37:0/223091362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b4340 msgr2=0x7fb14406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b4340 0x7fb14406aa50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0097c0 tx=0x7fb12c01c450 comp rx=0 tx=0).stop 2023-07-09T21:22:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 -- 172.21.15.37:0/223091362 shutdown_connections 2023-07-09T21:22:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 --2- 172.21.15.37:0/223091362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b4340 0x7fb14406aa50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 -- 172.21.15.37:0/223091362 >> 172.21.15.37:0/223091362 conn(0x7fb144073090 msgr2=0x7fb144069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 -- 172.21.15.37:0/223091362 shutdown_connections 2023-07-09T21:22:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.638+0000 7fb148834640 1 -- 172.21.15.37:0/223091362 wait complete. 2023-07-09T21:22:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 Processor -- start 2023-07-09T21:22:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- start start 2023-07-09T21:22:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 0x7fb14414f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c7410 con 0x7fb1440b7ab0 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c7660 con 0x7fb1440b4340 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1440c7940 con 0x7fb1440cef80 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60648/0 (socket says 172.21.15.37:60648) 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 -- 172.21.15.37:0/1374539010 learned_addr learned my addr 172.21.15.37:0/1374539010 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:58.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb14259c640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 0x7fb14414f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb142d9d640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 -- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 msgr2=0x7fb1440c6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440c6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 -- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 msgr2=0x7fb14414f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 0x7fb14414f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 -- 172.21.15.37:0/1374539010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c009420 con 0x7fb1440b7ab0 2023-07-09T21:22:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb14259c640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 0x7fb14414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13bfff640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ad040 tx=0x7fb12c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0b5810 con 0x7fb1440b7ab0 2023-07-09T21:22:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c0b5990 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c0b5d40 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1440c7c20 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1440c81e0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.642+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14404d7d0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.646+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb12c0c93f0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.646+0000 7fb13affd640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 0x7fb124068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.646+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb12c11efa0 con 0x7fb1440b7ab0 2023-07-09T21:22:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.646+0000 7fb14259c640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 0x7fb124068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.646+0000 7fb14259c640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 0x7fb124068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb134007fd0 tx=0x7fb134007c20 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.650+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb12c0ec530 con 0x7fb1440b7ab0 2023-07-09T21:22:58.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb14406a830 con 0x7fb1440b7ab0 2023-07-09T21:22:58.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb13affd640 1 -- 172.21.15.37:0/1374539010 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fb12c0c4090 con 0x7fb1440b7ab0 2023-07-09T21:22:58.811 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:22:58.811 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:22:58.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 msgr2=0x7fb124068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 0x7fb124068730 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb134007fd0 tx=0x7fb134007c20 comp rx=0 tx=0).stop 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 msgr2=0x7fb1440c66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0ad040 tx=0x7fb12c01ac90 comp rx=0 tx=0).stop 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 shutdown_connections 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb124066280 0x7fb124068730 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1440cef80 0x7fb1440c6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1440b7ab0 0x7fb1440c66f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 --2- 172.21.15.37:0/1374539010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1440b4340 0x7fb14414f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 >> 172.21.15.37:0/1374539010 conn(0x7fb144073090 msgr2=0x7fb1440b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 shutdown_connections 2023-07-09T21:22:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.806+0000 7fb148834640 1 -- 172.21.15.37:0/1374539010 wait complete. 2023-07-09T21:22:58.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:22:58.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:22:58.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.974+0000 7f26e09ba640 1 Processor -- start 2023-07-09T21:22:58.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.974+0000 7f26e09ba640 1 -- start start 2023-07-09T21:22:58.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26e09ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26e09ba640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f26dc0ceb80 0x7f26dc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26e09ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26dc15bf80 con 0x7f26dc0b3c20 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26e09ba640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26dc0cd070 con 0x7f26dc0ceb80 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26e09ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cfd70 con 0x7f26dc0b7980 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26dad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f26dc0b3c20 0x7f26dc0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53212/0 (socket says 172.21.15.37:53212) 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26dad9d640 1 -- 172.21.15.37:0/3720661101 learned_addr learned my addr 172.21.15.37:0/3720661101 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d3fff640 1 --2- 172.21.15.37:0/3720661101 >> v2:172.21.15.119:3300/0 conn(0x7f26dc0ceb80 0x7f26dc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542927202 0 0) 0x7f26d40014a0 con 0x7f26dc0b3c20 2023-07-09T21:22:58.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26c8003530 con 0x7f26dc0b3c20 2023-07-09T21:22:58.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809472278 0 0) 0x7f26c8003530 con 0x7f26dc0b3c20 2023-07-09T21:22:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 msgr2=0x7f26dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 >> v2:172.21.15.119:3300/0 conn(0x7f26dc0ceb80 msgr2=0x7f26dc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 --2- 172.21.15.37:0/3720661101 >> v2:172.21.15.119:3300/0 conn(0x7f26dc0ceb80 0x7f26dc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc160570 con 0x7f26dc0b3c20 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f26d4001b90 con 0x7f26dc0b3c20 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 >> v1:172.21.15.37:6789/0 conn(0x7f26dc0b3c20 legacy=0x7f26dc0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26c8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c8003f00 0x7f26c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26c8004d10 0x7f26c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cd070 con 0x7f26c8003f00 2023-07-09T21:22:58.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cfd70 con 0x7f26c8004d10 2023-07-09T21:22:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26c800b990 con 0x7f26dc0b7980 2023-07-09T21:22:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d3fff640 1 --2- 172.21.15.37:0/3720661101 >> v2:172.21.15.119:3300/0 conn(0x7f26dc0ceb80 0x7f26dc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:22:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26c8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26dad9d640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26c8004d10 0x7f26c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26d3fff640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c8003f00 0x7f26c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 -- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26c8004d10 msgr2=0x7f26c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26c8004d10 0x7f26c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 -- 172.21.15.37:0/3720661101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c8003f00 msgr2=0x7f26c80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26c8003f00 0x7f26c80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.978+0000 7f26da59c640 1 -- 172.21.15.37:0/3720661101 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c8003530 con 0x7f26dc0b7980 2023-07-09T21:22:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26da59c640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26c8003980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009ae0 tx=0x7f26cc01ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d75393a002c9f3a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0a5570 con 0x7f26dc0b7980 2023-07-09T21:22:58.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0a56d0 con 0x7f26dc0b7980 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26d9d9b640 1 -- 172.21.15.37:0/3720661101 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0a5a80 con 0x7f26dc0b7980 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 -- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 msgr2=0x7f26c8003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 --2- 172.21.15.37:0/3720661101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26c8003980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009ae0 tx=0x7f26cc01ca90 comp rx=0 tx=0).stop 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26dad9d640 1 -- 172.21.15.37:0/3720661101 reap_dead start 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 -- 172.21.15.37:0/3720661101 shutdown_connections 2023-07-09T21:22:58.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 -- 172.21.15.37:0/3720661101 >> 172.21.15.37:0/3720661101 conn(0x7f26dc073090 msgr2=0x7f26dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 -- 172.21.15.37:0/3720661101 shutdown_connections 2023-07-09T21:22:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.982+0000 7f26e09ba640 1 -- 172.21.15.37:0/3720661101 wait complete. 2023-07-09T21:22:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 Processor -- start 2023-07-09T21:22:58.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- start start 2023-07-09T21:22:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc1f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc0ca370 0x7f26dc1f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0cae80 con 0x7f26dc1f1f80 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0d1150 con 0x7f26dc0ca370 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26dc0caba0 con 0x7f26dc0b7980 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60662/0 (socket says 172.21.15.37:60662) 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 -- 172.21.15.37:0/1000727663 learned_addr learned my addr 172.21.15.37:0/1000727663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26d3fff640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc0ca370 0x7f26dc1f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26da59c640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc1f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 -- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 msgr2=0x7f26dc1f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc1f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 -- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc0ca370 msgr2=0x7f26dc1f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc0ca370 0x7f26dc1f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 -- 172.21.15.37:0/1000727663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc0d0b00 con 0x7f26dc1f1f80 2023-07-09T21:22:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26dad9d640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b1240 tx=0x7f26d4007c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d401b070 con 0x7f26dc1f1f80 2023-07-09T21:22:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d40125a0 con 0x7f26dc1f1f80 2023-07-09T21:22:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26dc0d0de0 con 0x7f26dc1f1f80 2023-07-09T21:22:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4012930 con 0x7f26dc1f1f80 2023-07-09T21:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.986+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26dc156c90 con 0x7f26dc1f1f80 2023-07-09T21:22:58.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26dc0cf450 con 0x7f26dc1f1f80 2023-07-09T21:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f26d4012a90 con 0x7f26dc1f1f80 2023-07-09T21:22:58.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26d2ffd640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 0x7f26bc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f26d4086c70 con 0x7f26dc1f1f80 2023-07-09T21:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26da59c640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 0x7f26bc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.990+0000 7f26da59c640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 0x7f26bc068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0af000 tx=0x7f26cc0046d0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:58.994+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f26d4054190 con 0x7f26dc1f1f80 2023-07-09T21:22:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f26dc15bf80 con 0x7f26dc1f1f80 2023-07-09T21:22:59.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26d2ffd640 1 -- 172.21.15.37:0/1000727663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f26dc15bf80 con 0x7f26dc1f1f80 2023-07-09T21:22:59.155 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:22:59.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 msgr2=0x7f26bc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 0x7f26bc068760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f26cc0af000 tx=0x7f26cc0046d0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 msgr2=0x7f26dc156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26dc0b1240 tx=0x7f26d4007c10 comp rx=0 tx=0).stop 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 shutdown_connections 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f26bc0662b0 0x7f26bc068760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f26dc1f1f80 0x7f26dc156750 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f26dc0ca370 0x7f26dc1f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 --2- 172.21.15.37:0/1000727663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f26dc0b7980 0x7f26dc1f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 >> 172.21.15.37:0/1000727663 conn(0x7f26dc073090 msgr2=0x7f26dc15f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 shutdown_connections 2023-07-09T21:22:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.150+0000 7f26e09ba640 1 -- 172.21.15.37:0/1000727663 wait complete. 2023-07-09T21:22:59.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:22:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.314+0000 7fb716fac640 1 Processor -- start 2023-07-09T21:22:59.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 -- start start 2023-07-09T21:22:59.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b7980 0x7fb710160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7100ceb80 0x7fb7100cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7100b3c20 0x7fb7100b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100cd070 con 0x7fb7100b3c20 2023-07-09T21:22:59.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7100cfd70 con 0x7fb7100ceb80 2023-07-09T21:22:59.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb716fac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71015bf80 con 0x7fb7100b7980 2023-07-09T21:22:59.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7100b3c20 0x7fb7100b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7100b3c20 0x7fb7100b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60676/0 (socket says 172.21.15.37:60676) 2023-07-09T21:22:59.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 -- 172.21.15.37:0/3421258177 learned_addr learned my addr 172.21.15.37:0/3421258177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:59.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb714d48640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b7980 0x7fb710160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb70ffff640 1 --2- 172.21.15.37:0/3421258177 >> v2:172.21.15.119:3300/0 conn(0x7fb7100ceb80 0x7fb7100cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 -- 172.21.15.37:0/3421258177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b7980 msgr2=0x7fb710160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b7980 0x7fb710160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 -- 172.21.15.37:0/3421258177 >> v2:172.21.15.119:3300/0 conn(0x7fb7100ceb80 msgr2=0x7fb7100cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 --2- 172.21.15.37:0/3421258177 >> v2:172.21.15.119:3300/0 conn(0x7fb7100ceb80 0x7fb7100cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.318+0000 7fb715549640 1 -- 172.21.15.37:0/3421258177 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb710160570 con 0x7fb7100b3c20 2023-07-09T21:22:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb715549640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b3c20 0x7fb7100b4080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b4ca0 tx=0x7fb70801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b7b800ec450ebc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb70f7fe640 1 -- 172.21.15.37:0/3421258177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080a5650 con 0x7fb7100b3c20 2023-07-09T21:22:59.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb70f7fe640 1 -- 172.21.15.37:0/3421258177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080a57b0 con 0x7fb7100b3c20 2023-07-09T21:22:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb70f7fe640 1 -- 172.21.15.37:0/3421258177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7080a5b40 con 0x7fb7100b3c20 2023-07-09T21:22:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- 172.21.15.37:0/3421258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b3c20 msgr2=0x7fb7100b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b3c20 0x7fb7100b4080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b4ca0 tx=0x7fb70801c9d0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- 172.21.15.37:0/3421258177 shutdown_connections 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b3c20 0x7fb7100b4080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 --2- 172.21.15.37:0/3421258177 >> v2:172.21.15.119:3300/0 conn(0x7fb7100ceb80 0x7fb7100cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 --2- 172.21.15.37:0/3421258177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b7980 0x7fb710160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- 172.21.15.37:0/3421258177 >> 172.21.15.37:0/3421258177 conn(0x7fb710073090 msgr2=0x7fb710069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- 172.21.15.37:0/3421258177 shutdown_connections 2023-07-09T21:22:59.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- 172.21.15.37:0/3421258177 wait complete. 2023-07-09T21:22:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 Processor -- start 2023-07-09T21:22:59.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.322+0000 7fb716fac640 1 -- start start 2023-07-09T21:22:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 0x7fb710152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7100ceb80 0x7fb7100b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710152cd0 con 0x7fb7100b7980 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb710156f40 con 0x7fb7100ceb80 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71015c790 con 0x7fb7100b3c20 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60684/0 (socket says 172.21.15.37:60684) 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 -- 172.21.15.37:0/1740314708 learned_addr learned my addr 172.21.15.37:0/1740314708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb715549640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7100ceb80 0x7fb7100b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb714d48640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 0x7fb710152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 -- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 msgr2=0x7fb710152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 0x7fb710152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 -- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7100ceb80 msgr2=0x7fb7100b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7100ceb80 0x7fb7100b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 -- 172.21.15.37:0/1740314708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009b30 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb714d48640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 0x7fb710152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70ffff640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d800 tx=0x7fb6fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00b6c0 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6fc00b820 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc00bb90 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7101565a0 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb710156b60 con 0x7fb7100b7980 2023-07-09T21:22:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7101571b0 con 0x7fb7100b7980 2023-07-09T21:22:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.326+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb6fc00bcf0 con 0x7fb7100b7980 2023-07-09T21:22:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.330+0000 7fb70d7fa640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 0x7fb6f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.330+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb6fc0841b0 con 0x7fb7100b7980 2023-07-09T21:22:59.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.330+0000 7fb714d48640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 0x7fb6f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.330+0000 7fb714d48640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 0x7fb6f4068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb70400b9f0 tx=0x7fb704008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.334+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6fc0550b0 con 0x7fb7100b7980 2023-07-09T21:22:59.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb71004d7d0 con 0x7fb7100b7980 2023-07-09T21:22:59.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb70d7fa640 1 -- 172.21.15.37:0/1740314708 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6fc054c40 con 0x7fb7100b7980 2023-07-09T21:22:59.495 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:22:59.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 msgr2=0x7fb6f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 0x7fb6f4068730 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb70400b9f0 tx=0x7fb704008040 comp rx=0 tx=0).stop 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 msgr2=0x7fb71014b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00d800 tx=0x7fb6fc00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 shutdown_connections 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb6f4066280 0x7fb6f4068730 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7100ceb80 0x7fb7100b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100b7980 0x7fb71014b490 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 --2- 172.21.15.37:0/1740314708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7100b3c20 0x7fb710152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 >> 172.21.15.37:0/1740314708 conn(0x7fb710073090 msgr2=0x7fb7100b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 shutdown_connections 2023-07-09T21:22:59.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.490+0000 7fb716fac640 1 -- 172.21.15.37:0/1740314708 wait complete. 2023-07-09T21:22:59.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:22:59.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.654+0000 7ff4b9c56640 1 Processor -- start 2023-07-09T21:22:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.654+0000 7ff4b9c56640 1 -- start start 2023-07-09T21:22:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b9c56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4b40b7980 0x7ff4b4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b9c56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b415bf80 con 0x7ff4b40d0780 2023-07-09T21:22:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b9c56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b4160570 con 0x7ff4b40ceb80 2023-07-09T21:22:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b9c56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b40cd070 con 0x7ff4b40b7980 2023-07-09T21:22:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4b40b7980 0x7ff4b4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4b40d0780 0x7ff4b40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53228/0 (socket says 172.21.15.37:53228) 2023-07-09T21:22:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b3fff640 1 -- 172.21.15.37:0/3375337020 learned_addr learned my addr 172.21.15.37:0/3375337020 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:22:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b37fe640 1 -- 172.21.15.37:0/3375337020 >> v1:172.21.15.119:6789/0 conn(0x7ff4b40ceb80 legacy=0x7ff4b40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b37fe640 1 -- 172.21.15.37:0/3375337020 >> v1:172.21.15.37:6789/0 conn(0x7ff4b40d0780 legacy=0x7ff4b40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b37fe640 1 -- 172.21.15.37:0/3375337020 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40d02f0 con 0x7ff4b40b7980 2023-07-09T21:22:59.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.658+0000 7ff4b27fc640 1 -- 172.21.15.37:0/3375337020 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252574661 0 0) 0x7ff4ac0014a0 con 0x7ff4b40d0780 2023-07-09T21:22:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b37fe640 1 --2- 172.21.15.37:0/3375337020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b4160030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097c0 tx=0x7ff4a401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1099990f66014e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b27fc640 1 -- 172.21.15.37:0/3375337020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40ab600 con 0x7ff4b40b7980 2023-07-09T21:22:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b27fc640 1 -- 172.21.15.37:0/3375337020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40a7050 con 0x7ff4b40b7980 2023-07-09T21:22:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b27fc640 1 -- 172.21.15.37:0/3375337020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40ab980 con 0x7ff4b40b7980 2023-07-09T21:22:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- 172.21.15.37:0/3375337020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 msgr2=0x7ff4b4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/3375337020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b4160030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff4a40097c0 tx=0x7ff4a401c480 comp rx=0 tx=0).stop 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- 172.21.15.37:0/3375337020 shutdown_connections 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/3375337020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b4160030 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- 172.21.15.37:0/3375337020 >> 172.21.15.37:0/3375337020 conn(0x7ff4b4073090 msgr2=0x7ff4b4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- 172.21.15.37:0/3375337020 shutdown_connections 2023-07-09T21:22:59.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- 172.21.15.37:0/3375337020 wait complete. 2023-07-09T21:22:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 Processor -- start 2023-07-09T21:22:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.662+0000 7ff4b9c56640 1 -- start start 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4b40ceb80 0x7ff4b414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4b40d0780 0x7ff4b414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414fa60 con 0x7ff4b40b7980 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41508d0 con 0x7ff4b40ceb80 2023-07-09T21:22:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414fc50 con 0x7ff4b40d0780 2023-07-09T21:22:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60704/0 (socket says 172.21.15.37:60704) 2023-07-09T21:22:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 -- 172.21.15.37:0/2533694588 learned_addr learned my addr 172.21.15.37:0/2533694588 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:22:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b2ffd640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4b40ceb80 0x7ff4b414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b3fff640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4b40d0780 0x7ff4b414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 -- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4b40d0780 msgr2=0x7ff4b414e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4b40d0780 0x7ff4b414e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 -- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4b40ceb80 msgr2=0x7ff4b414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4b40ceb80 0x7ff4b414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 -- 172.21.15.37:0/2533694588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4009420 con 0x7ff4b40b7980 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b37fe640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4019090 tx=0x7ff4a4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40b4820 con 0x7ff4b40b7980 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40abe90 con 0x7ff4b40b7980 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a40b4be0 con 0x7ff4b40b7980 2023-07-09T21:22:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b414ff30 con 0x7ff4b40b7980 2023-07-09T21:22:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b41504f0 con 0x7ff4b40b7980 2023-07-09T21:22:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b404d7d0 con 0x7ff4b40b7980 2023-07-09T21:22:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.666+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4a40b2040 con 0x7ff4b40b7980 2023-07-09T21:22:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.670+0000 7ff49bfff640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 0x7ff4a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:22:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.670+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff4a411e140 con 0x7ff4b40b7980 2023-07-09T21:22:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.670+0000 7ff4b2ffd640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 0x7ff4a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:22:59.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.670+0000 7ff4b2ffd640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 0x7ff4a0068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4167930 tx=0x7ff4a8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:22:59.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.674+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff4a40eb5b0 con 0x7ff4b40b7980 2023-07-09T21:22:59.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.830+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4b40ce460 con 0x7ff4b40b7980 2023-07-09T21:22:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.830+0000 7ff49bfff640 1 -- 172.21.15.37:0/2533694588 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4a40b4d40 con 0x7ff4b40b7980 2023-07-09T21:22:59.837 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:22:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 msgr2=0x7ff4a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 0x7ff4a0068730 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4167930 tx=0x7ff4a8009040 comp rx=0 tx=0).stop 2023-07-09T21:22:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 msgr2=0x7ff4b40c5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:22:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4019090 tx=0x7ff4a4019220 comp rx=0 tx=0).stop 2023-07-09T21:22:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 shutdown_connections 2023-07-09T21:22:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff4a0066280 0x7ff4a0068730 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4b40d0780 0x7ff4b414e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff4b40ceb80 0x7ff4b414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 --2- 172.21.15.37:0/2533694588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4b40b7980 0x7ff4b40c5280 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:22:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 >> 172.21.15.37:0/2533694588 conn(0x7ff4b4073090 msgr2=0x7ff4b4154110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:22:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 shutdown_connections 2023-07-09T21:22:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:22:59.834+0000 7ff4b9c56640 1 -- 172.21.15.37:0/2533694588 wait complete. 2023-07-09T21:22:59.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 Processor -- start 2023-07-09T21:23:00.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 -- start start 2023-07-09T21:23:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34600b7980 0x7f3460160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34600d0780 0x7f34600d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346015bf80 con 0x7f34600ceb80 2023-07-09T21:23:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600cd070 con 0x7f34600b7980 2023-07-09T21:23:00.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f346647b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600cfd70 con 0x7f34600d0780 2023-07-09T21:23:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34600b7980 0x7f3460160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f34600b7980 0x7f3460160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60706/0 (socket says 172.21.15.37:60706) 2023-07-09T21:23:00.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 -- 172.21.15.37:0/114268086 learned_addr learned my addr 172.21.15.37:0/114268086 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f3464a18640 1 --2- 172.21.15.37:0/114268086 >> v2:172.21.15.119:3300/0 conn(0x7f34600d0780 0x7f34600d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 -- 172.21.15.37:0/114268086 >> v2:172.21.15.119:3300/0 conn(0x7f34600d0780 msgr2=0x7f34600d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 --2- 172.21.15.37:0/114268086 >> v2:172.21.15.119:3300/0 conn(0x7f34600d0780 0x7f34600d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 -- 172.21.15.37:0/114268086 >> v1:172.21.15.119:6789/0 conn(0x7f34600ceb80 legacy=0x7f34600cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.002+0000 7f345ffff640 1 -- 172.21.15.37:0/114268086 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460160570 con 0x7f34600b7980 2023-07-09T21:23:00.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f345ffff640 1 --2- 172.21.15.37:0/114268086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f3460160030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34600b1240 tx=0x7f345001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade36699213eb2c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f345f7fe640 1 -- 172.21.15.37:0/114268086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500ab600 con 0x7f34600b7980 2023-07-09T21:23:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f345f7fe640 1 -- 172.21.15.37:0/114268086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500a7050 con 0x7f34600b7980 2023-07-09T21:23:00.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f345f7fe640 1 -- 172.21.15.37:0/114268086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500ab980 con 0x7f34600b7980 2023-07-09T21:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 -- 172.21.15.37:0/114268086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 msgr2=0x7f3460160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 --2- 172.21.15.37:0/114268086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f3460160030 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f34600b1240 tx=0x7f345001c4c0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 -- 172.21.15.37:0/114268086 shutdown_connections 2023-07-09T21:23:00.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 --2- 172.21.15.37:0/114268086 >> v2:172.21.15.119:3300/0 conn(0x7f34600d0780 0x7f34600d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 --2- 172.21.15.37:0/114268086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f3460160030 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 -- 172.21.15.37:0/114268086 >> 172.21.15.37:0/114268086 conn(0x7f3460073090 msgr2=0x7f3460069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 -- 172.21.15.37:0/114268086 shutdown_connections 2023-07-09T21:23:00.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.006+0000 7f346647b640 1 -- 172.21.15.37:0/114268086 wait complete. 2023-07-09T21:23:00.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 Processor -- start 2023-07-09T21:23:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- start start 2023-07-09T21:23:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34600ceb80 0x7f3460150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 0x7f34600b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600caab0 con 0x7f34600b7980 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600b1fa0 con 0x7f34600ceb80 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600b2280 con 0x7f34600d0780 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60712/0 (socket says 172.21.15.37:60712) 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 -- 172.21.15.37:0/375646000 learned_addr learned my addr 172.21.15.37:0/375646000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:00.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f3457fff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34600ceb80 0x7f3460150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f3464a18640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 0x7f34600b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 -- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 msgr2=0x7f34600b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 0x7f34600b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 -- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34600ceb80 msgr2=0x7f3460150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34600ceb80 0x7f3460150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 -- 172.21.15.37:0/375646000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34500094d0 con 0x7f34600b7980 2023-07-09T21:23:00.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f3464a18640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 0x7f34600b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345ffff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f345001a0f0 tx=0x7f3450019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500b37d0 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34500b3930 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34500b3ca0 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34600b2560 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600b2b20 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.010+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346004d7d0 con 0x7f34600b7980 2023-07-09T21:23:00.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.014+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f34500b2070 con 0x7f34600b7980 2023-07-09T21:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.014+0000 7f345d7fa640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 0x7f3440068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.014+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f345011de50 con 0x7f34600b7980 2023-07-09T21:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.014+0000 7f3457fff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 0x7f3440068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.014+0000 7f3457fff640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 0x7f3440068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34600b13d0 tx=0x7f3448009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.018+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34500eb230 con 0x7f34600b7980 2023-07-09T21:23:00.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.174+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3460160570 con 0x7f34600b7980 2023-07-09T21:23:00.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.174+0000 7f345d7fa640 1 -- 172.21.15.37:0/375646000 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3460160570 con 0x7f34600b7980 2023-07-09T21:23:00.181 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 msgr2=0x7f3440068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 0x7f3440068730 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f34600b13d0 tx=0x7f3448009040 comp rx=0 tx=0).stop 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 msgr2=0x7f34600ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f345001a0f0 tx=0x7f3450019260 comp rx=0 tx=0).stop 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 shutdown_connections 2023-07-09T21:23:00.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3440066280 0x7f3440068730 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34600d0780 0x7f34600b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34600ceb80 0x7f3460150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 --2- 172.21.15.37:0/375646000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34600b7980 0x7f34600ca570 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 >> 172.21.15.37:0/375646000 conn(0x7f3460073090 msgr2=0x7f34600cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 shutdown_connections 2023-07-09T21:23:00.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.178+0000 7f346647b640 1 -- 172.21.15.37:0/375646000 wait complete. 2023-07-09T21:23:00.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:00.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.338+0000 7fab581ad640 1 Processor -- start 2023-07-09T21:23:00.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.338+0000 7fab581ad640 1 -- start start 2023-07-09T21:23:00.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab581ad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500b4340 0x7fab5006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab581ad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500b49f0 con 0x7fab500cef80 2023-07-09T21:23:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab581ad640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500cc8a0 con 0x7fab500b7ab0 2023-07-09T21:23:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab581ad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500b7e80 con 0x7fab500b4340 2023-07-09T21:23:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab500cef80 0x7fab500d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53240/0 (socket says 172.21.15.37:53240) 2023-07-09T21:23:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 -- 172.21.15.37:0/1722088787 learned_addr learned my addr 172.21.15.37:0/1722088787 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab55748640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500b4340 0x7fab5006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792696123 0 0) 0x7fab500b49f0 con 0x7fab500cef80 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c003530 con 0x7fab500cef80 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2655012824 0 0) 0x7fab3c003530 con 0x7fab500cef80 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500b4340 msgr2=0x7fab5006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500b4340 0x7fab5006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 >> v1:172.21.15.119:6789/0 conn(0x7fab500b7ab0 legacy=0x7fab500b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500ccb80 con 0x7fab500cef80 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fab48001a00 con 0x7fab500cef80 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 >> v1:172.21.15.37:6789/0 conn(0x7fab500cef80 legacy=0x7fab500d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab3c0039b0 0x7fab3c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004300 0x7fab3c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab3c004fd0 0x7fab3c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c00bed0 con 0x7fab3c004fd0 2023-07-09T21:23:00.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c00c010 con 0x7fab3c004300 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c00c1d0 con 0x7fab3c0039b0 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab3c004fd0 0x7fab3c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab55748640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004300 0x7fab3c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab55f49640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab3c0039b0 0x7fab3c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 -- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab3c0039b0 msgr2=0x7fab3c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab3c0039b0 0x7fab3c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 -- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004300 msgr2=0x7fab3c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004300 0x7fab3c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.342+0000 7fab5674a640 1 -- 172.21.15.37:0/1722088787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c003530 con 0x7fab3c004fd0 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab5674a640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab3c004fd0 0x7fab3c00b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a7a0 tx=0x7fab4801f9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddeedd69e25cb2c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab480aa610 con 0x7fab3c004fd0 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480aa790 con 0x7fab3c004fd0 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab54f47640 1 -- 172.21.15.37:0/1722088787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab480aab80 con 0x7fab3c004fd0 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- 172.21.15.37:0/1722088787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab3c004fd0 msgr2=0x7fab3c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 --2- 172.21.15.37:0/1722088787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab3c004fd0 0x7fab3c00b990 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a7a0 tx=0x7fab4801f9e0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab5674a640 1 -- 172.21.15.37:0/1722088787 reap_dead start 2023-07-09T21:23:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- 172.21.15.37:0/1722088787 shutdown_connections 2023-07-09T21:23:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- 172.21.15.37:0/1722088787 >> 172.21.15.37:0/1722088787 conn(0x7fab50073090 msgr2=0x7fab50069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- 172.21.15.37:0/1722088787 shutdown_connections 2023-07-09T21:23:00.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- 172.21.15.37:0/1722088787 wait complete. 2023-07-09T21:23:00.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 Processor -- start 2023-07-09T21:23:00.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.346+0000 7fab581ad640 1 -- start start 2023-07-09T21:23:00.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004fd0 0x7fab50150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500c93a0 0x7fab500cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500cc230 con 0x7fab500cbdc0 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c77e0 con 0x7fab3c004fd0 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c7ac0 con 0x7fab500c93a0 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60722/0 (socket says 172.21.15.37:60722) 2023-07-09T21:23:00.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 -- 172.21.15.37:0/2511959278 learned_addr learned my addr 172.21.15.37:0/2511959278 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:00.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab55748640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500c93a0 0x7fab500cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab55f49640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004fd0 0x7fab50150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 -- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500c93a0 msgr2=0x7fab500cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500c93a0 0x7fab500cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 -- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004fd0 msgr2=0x7fab50150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004fd0 0x7fab50150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 -- 172.21.15.37:0/2511959278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab500c7da0 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab5674a640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a7a0 tx=0x7fab3c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab480ba070 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab480aa410 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48004b70 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500c8080 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab50151240 con 0x7fab500cbdc0 2023-07-09T21:23:00.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500c85a0 con 0x7fab500cbdc0 2023-07-09T21:23:00.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.350+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab48004cd0 con 0x7fab500cbdc0 2023-07-09T21:23:00.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.354+0000 7fab467fc640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.354+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab48121310 con 0x7fab500cbdc0 2023-07-09T21:23:00.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.354+0000 7fab55f49640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.354+0000 7fab55f49640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 0x7fab34068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab4c000c10 tx=0x7fab4c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.358+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab500c85a0 con 0x7fab500cbdc0 2023-07-09T21:23:00.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.510+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab500c85a0 con 0x7fab500cbdc0 2023-07-09T21:23:00.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.510+0000 7fab467fc640 1 -- 172.21.15.37:0/2511959278 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fab500c85a0 con 0x7fab500cbdc0 2023-07-09T21:23:00.517 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:00.517 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 msgr2=0x7fab34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 0x7fab34068760 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab4c000c10 tx=0x7fab4c009040 comp rx=0 tx=0).stop 2023-07-09T21:23:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 msgr2=0x7fab50156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fab4800a7a0 tx=0x7fab3c005800 comp rx=0 tx=0).stop 2023-07-09T21:23:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 shutdown_connections 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fab340662b0 0x7fab34068760 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab500cbdc0 0x7fab50156020 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab500c93a0 0x7fab500cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 --2- 172.21.15.37:0/2511959278 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab3c004fd0 0x7fab50150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 >> 172.21.15.37:0/2511959278 conn(0x7fab50073090 msgr2=0x7fab500b26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 shutdown_connections 2023-07-09T21:23:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.514+0000 7fab581ad640 1 -- 172.21.15.37:0/2511959278 wait complete. 2023-07-09T21:23:00.539 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:00.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.678+0000 7ff1b3218640 1 Processor -- start 2023-07-09T21:23:00.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.678+0000 7ff1b3218640 1 -- start start 2023-07-09T21:23:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b3218640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1ac0b7980 0x7ff1ac160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b3218640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac15bf80 con 0x7ff1ac0d0780 2023-07-09T21:23:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b3218640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac160570 con 0x7ff1ac0ceb80 2023-07-09T21:23:00.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b3218640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac0cd070 con 0x7ff1ac0b7980 2023-07-09T21:23:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b0fb4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff1ac0b7980 0x7ff1ac160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b17b5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff1ac0d0780 0x7ff1ac0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53242/0 (socket says 172.21.15.37:53242) 2023-07-09T21:23:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b17b5640 1 -- 172.21.15.37:0/735949557 learned_addr learned my addr 172.21.15.37:0/735949557 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:00.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b0fb4640 1 -- 172.21.15.37:0/735949557 >> v1:172.21.15.119:6789/0 conn(0x7ff1ac0ceb80 legacy=0x7ff1ac0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b0fb4640 1 -- 172.21.15.37:0/735949557 >> v1:172.21.15.37:6789/0 conn(0x7ff1ac0d0780 legacy=0x7ff1ac0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1b0fb4640 1 -- 172.21.15.37:0/735949557 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0d02f0 con 0x7ff1ac0b7980 2023-07-09T21:23:00.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.682+0000 7ff1ab7fe640 1 -- 172.21.15.37:0/735949557 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074808329 0 0) 0x7ff1a40014a0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b0fb4640 1 --2- 172.21.15.37:0/735949557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0b7980 0x7ff1ac160030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097c0 tx=0x7ff1a001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d4599cf93e9d05 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1ab7fe640 1 -- 172.21.15.37:0/735949557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00ab600 con 0x7ff1ac0b7980 2023-07-09T21:23:00.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1ab7fe640 1 -- 172.21.15.37:0/735949557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a00a7050 con 0x7ff1ac0b7980 2023-07-09T21:23:00.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1ab7fe640 1 -- 172.21.15.37:0/735949557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a00ab980 con 0x7ff1ac0b7980 2023-07-09T21:23:00.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- 172.21.15.37:0/735949557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0b7980 msgr2=0x7ff1ac160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 --2- 172.21.15.37:0/735949557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0b7980 0x7ff1ac160030 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00097c0 tx=0x7ff1a001c440 comp rx=0 tx=0).stop 2023-07-09T21:23:00.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- 172.21.15.37:0/735949557 shutdown_connections 2023-07-09T21:23:00.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 --2- 172.21.15.37:0/735949557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0b7980 0x7ff1ac160030 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- 172.21.15.37:0/735949557 >> 172.21.15.37:0/735949557 conn(0x7ff1ac073090 msgr2=0x7ff1ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- 172.21.15.37:0/735949557 shutdown_connections 2023-07-09T21:23:00.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- 172.21.15.37:0/735949557 wait complete. 2023-07-09T21:23:00.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 Processor -- start 2023-07-09T21:23:00.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.686+0000 7ff1b3218640 1 -- start start 2023-07-09T21:23:00.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1ac0b7980 0x7ff1ac156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac0ceb80 0x7ff1ac0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b4120 con 0x7ff1ac0d0780 2023-07-09T21:23:00.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac14e4b0 con 0x7ff1ac0ceb80 2023-07-09T21:23:00.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b3e40 con 0x7ff1ac0b7980 2023-07-09T21:23:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60742/0 (socket says 172.21.15.37:60742) 2023-07-09T21:23:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 -- 172.21.15.37:0/3393504674 learned_addr learned my addr 172.21.15.37:0/3393504674 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:00.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b0fb4640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1ac0b7980 0x7ff1ac156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1abfff640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac0ceb80 0x7ff1ac0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 -- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1ac0b7980 msgr2=0x7ff1ac156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1ac0b7980 0x7ff1ac156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 -- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac0ceb80 msgr2=0x7ff1ac0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac0ceb80 0x7ff1ac0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 -- 172.21.15.37:0/3393504674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a0009420 con 0x7ff1ac0d0780 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b17b5640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7b0 tx=0x7ff1a400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400a640 con 0x7ff1ac0d0780 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a400a7c0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1a400ab70 con 0x7ff1ac0d0780 2023-07-09T21:23:00.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac14e850 con 0x7ff1ac0d0780 2023-07-09T21:23:00.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac14ee10 con 0x7ff1ac0d0780 2023-07-09T21:23:00.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac14e6b0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.690+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff1a400acd0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.694+0000 7ff1a97fa640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:00.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.694+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff1a4082ef0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.694+0000 7ff1b0fb4640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:00.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.694+0000 7ff1b0fb4640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 0x7ff190068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ad000 tx=0x7ff1a00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:00.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.698+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff1ac14e6b0 con 0x7ff1ac0d0780 2023-07-09T21:23:00.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1ac15bf80 con 0x7ff1ac0d0780 2023-07-09T21:23:00.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1a97fa640 1 -- 172.21.15.37:0/3393504674 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff1ac15bf80 con 0x7ff1ac0d0780 2023-07-09T21:23:00.859 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 msgr2=0x7ff190068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 0x7ff190068730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00ad000 tx=0x7ff1a00a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 msgr2=0x7ff1ac14df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c7b0 tx=0x7ff1a400cc70 comp rx=0 tx=0).stop 2023-07-09T21:23:00.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 shutdown_connections 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff190066280 0x7ff190068730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff1ac0d0780 0x7ff1ac14df70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff1ac0ceb80 0x7ff1ac0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 --2- 172.21.15.37:0/3393504674 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff1ac0b7980 0x7ff1ac156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 >> 172.21.15.37:0/3393504674 conn(0x7ff1ac073090 msgr2=0x7ff1ac1576b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 shutdown_connections 2023-07-09T21:23:00.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:00.854+0000 7ff1b3218640 1 -- 172.21.15.37:0/3393504674 wait complete. 2023-07-09T21:23:00.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:01.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.018+0000 7fe9785c5640 1 Processor -- start 2023-07-09T21:23:01.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.018+0000 7fe9785c5640 1 -- start start 2023-07-09T21:23:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe9785c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe9700ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe9785c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe97015bf60 con 0x7fe97015f610 2023-07-09T21:23:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe9785c5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9701600d0 con 0x7fe97006c0d0 2023-07-09T21:23:01.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe9785c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700cc530 con 0x7fe97015bb90 2023-07-09T21:23:01.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe97015f610 0x7fe97006b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53254/0 (socket says 172.21.15.37:53254) 2023-07-09T21:23:01.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 -- 172.21.15.37:0/2169548795 learned_addr learned my addr 172.21.15.37:0/2169548795 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:01.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407241889 0 0) 0x7fe97015bf60 con 0x7fe97015f610 2023-07-09T21:23:01.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe95c003530 con 0x7fe97015f610 2023-07-09T21:23:01.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe976361640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe9700ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2046162587 0 0) 0x7fe95c003530 con 0x7fe97015f610 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 msgr2=0x7fe9700ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe9700ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 >> v1:172.21.15.119:6789/0 conn(0x7fe97006c0d0 legacy=0x7fe97006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9701603b0 con 0x7fe97015f610 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe960001680 con 0x7fe97015f610 2023-07-09T21:23:01.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 >> v1:172.21.15.37:6789/0 conn(0x7fe97015f610 legacy=0x7fe97006b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe95c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c003ef0 0x7fe95c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95c004d10 0x7fe95c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700cc530 con 0x7fe95c003ef0 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00b9c0 con 0x7fe95c004d10 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c00bb80 con 0x7fe97015bb90 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c003ef0 0x7fe95c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe976361640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe95c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe976b62640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95c004d10 0x7fe95c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 -- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 msgr2=0x7fe95c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe97015bb90 0x7fe95c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 -- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95c004d10 msgr2=0x7fe95c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe95c004d10 0x7fe95c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.022+0000 7fe975b60640 1 -- 172.21.15.37:0/2169548795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c003530 con 0x7fe95c003ef0 2023-07-09T21:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe975b60640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c003ef0 0x7fe95c0047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c210 tx=0x7fe96001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895db4b2a890f23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe960005ae0 con 0x7fe95c003ef0 2023-07-09T21:23:01.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe960005c60 con 0x7fe95c003ef0 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe97535f640 1 -- 172.21.15.37:0/2169548795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9600a5a40 con 0x7fe95c003ef0 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 -- 172.21.15.37:0/2169548795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c003ef0 msgr2=0x7fe95c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 --2- 172.21.15.37:0/2169548795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95c003ef0 0x7fe95c0047d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe96000c210 tx=0x7fe96001cc10 comp rx=0 tx=0).stop 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe976b62640 1 -- 172.21.15.37:0/2169548795 reap_dead start 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 -- 172.21.15.37:0/2169548795 shutdown_connections 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 -- 172.21.15.37:0/2169548795 >> 172.21.15.37:0/2169548795 conn(0x7fe97006d230 msgr2=0x7fe97006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 -- 172.21.15.37:0/2169548795 shutdown_connections 2023-07-09T21:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.026+0000 7fe9785c5640 1 -- 172.21.15.37:0/2169548795 wait complete. 2023-07-09T21:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 Processor -- start 2023-07-09T21:23:01.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- start start 2023-07-09T21:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe95c003ef0 0x7fe97014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9700c4e50 0x7fe9700c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c8270 con 0x7fe9700c9850 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c8550 con 0x7fe9700c4e50 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700c8830 con 0x7fe95c003ef0 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60766/0 (socket says 172.21.15.37:60766) 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 -- 172.21.15.37:0/4288535868 learned_addr learned my addr 172.21.15.37:0/4288535868 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:01.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe975b60640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9700c4e50 0x7fe9700c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976361640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe95c003ef0 0x7fe97014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 -- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe95c003ef0 msgr2=0x7fe97014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe95c003ef0 0x7fe97014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 -- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9700c4e50 msgr2=0x7fe9700c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9700c4e50 0x7fe9700c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 -- 172.21.15.37:0/4288535868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700c8b10 con 0x7fe9700c9850 2023-07-09T21:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe976b62640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe97015f570 tx=0x7fe96800e690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96800ec50 con 0x7fe9700c9850 2023-07-09T21:23:01.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96800edb0 con 0x7fe9700c9850 2023-07-09T21:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe968003bc0 con 0x7fe9700c9850 2023-07-09T21:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9700c8df0 con 0x7fe9700c9850 2023-07-09T21:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe970150aa0 con 0x7fe9700c9850 2023-07-09T21:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.030+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97004d7d0 con 0x7fe9700c9850 2023-07-09T21:23:01.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.034+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe968003d20 con 0x7fe9700c9850 2023-07-09T21:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.034+0000 7fe966ffd640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.034+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe968082e10 con 0x7fe9700c9850 2023-07-09T21:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.034+0000 7fe976361640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.034+0000 7fe976361640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 0x7fe954068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009be0 tx=0x7fe96c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.038+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe968086030 con 0x7fe9700c9850 2023-07-09T21:23:01.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe97006eb20 con 0x7fe9700c9850 2023-07-09T21:23:01.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe966ffd640 1 -- 172.21.15.37:0/4288535868 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe968019020 con 0x7fe9700c9850 2023-07-09T21:23:01.198 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:01.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 msgr2=0x7fe954068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 0x7fe954068730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009be0 tx=0x7fe96c009190 comp rx=0 tx=0).stop 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 msgr2=0x7fe970154bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe97015f570 tx=0x7fe96800e690 comp rx=0 tx=0).stop 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 shutdown_connections 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe954066280 0x7fe954068730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9700c9850 0x7fe970154bf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9700c4e50 0x7fe9700c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 --2- 172.21.15.37:0/4288535868 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe95c003ef0 0x7fe97014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 >> 172.21.15.37:0/4288535868 conn(0x7fe97006d230 msgr2=0x7fe97015b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 shutdown_connections 2023-07-09T21:23:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.194+0000 7fe9785c5640 1 -- 172.21.15.37:0/4288535868 wait complete. 2023-07-09T21:23:01.218 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.358+0000 7f0cd918f640 1 Processor -- start 2023-07-09T21:23:01.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.358+0000 7f0cd918f640 1 -- start start 2023-07-09T21:23:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.358+0000 7f0cd918f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40cf290 0x7f0cd4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.358+0000 7f0cd918f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cd40d0780 0x7f0cd40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.358+0000 7f0cd918f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd415bf80 con 0x7f0cd40b7980 2023-07-09T21:23:01.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd918f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd40cd070 con 0x7f0cd40d0780 2023-07-09T21:23:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd918f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd40cfd70 con 0x7f0cd40cf290 2023-07-09T21:23:01.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cd40d0780 0x7f0cd40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cd40d0780 0x7f0cd40d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60776/0 (socket says 172.21.15.37:60776) 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 -- 172.21.15.37:0/1203180791 learned_addr learned my addr 172.21.15.37:0/1203180791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0ccbfff640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40cf290 0x7f0cd4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 -- 172.21.15.37:0/1203180791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40cf290 msgr2=0x7f0cd4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40cf290 0x7f0cd4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 -- 172.21.15.37:0/1203180791 >> v1:172.21.15.119:6789/0 conn(0x7f0cd40b7980 legacy=0x7f0cd40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 -- 172.21.15.37:0/1203180791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd4160570 con 0x7f0cd40d0780 2023-07-09T21:23:01.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd359e640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40d0780 0x7f0cd40d0c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009e50 tx=0x7f0ccc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e96d94708cac633 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd259c640 1 -- 172.21.15.37:0/1203180791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0a56e0 con 0x7f0cd40d0780 2023-07-09T21:23:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd259c640 1 -- 172.21.15.37:0/1203180791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ccc0a5840 con 0x7f0cd40d0780 2023-07-09T21:23:01.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.362+0000 7f0cd259c640 1 -- 172.21.15.37:0/1203180791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ccc0a5bd0 con 0x7f0cd40d0780 2023-07-09T21:23:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- 172.21.15.37:0/1203180791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40d0780 msgr2=0x7f0cd40d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40d0780 0x7f0cd40d0c00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ccc009e50 tx=0x7f0ccc01ca10 comp rx=0 tx=0).stop 2023-07-09T21:23:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- 172.21.15.37:0/1203180791 shutdown_connections 2023-07-09T21:23:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40cf290 0x7f0cd4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- 172.21.15.37:0/1203180791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40d0780 0x7f0cd40d0c00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- 172.21.15.37:0/1203180791 >> 172.21.15.37:0/1203180791 conn(0x7f0cd4073090 msgr2=0x7f0cd4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- 172.21.15.37:0/1203180791 shutdown_connections 2023-07-09T21:23:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- 172.21.15.37:0/1203180791 wait complete. 2023-07-09T21:23:01.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 Processor -- start 2023-07-09T21:23:01.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- start start 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 0x7f0cd4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40d0780 0x7f0cd415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4152140 con 0x7f0cd40cf290 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd415a3d0 con 0x7f0cd40b7980 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd918f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd415a6b0 con 0x7f0cd40d0780 2023-07-09T21:23:01.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0ccbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60790/0 (socket says 172.21.15.37:60790) 2023-07-09T21:23:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0ccbfff640 1 -- 172.21.15.37:0/4194449341 learned_addr learned my addr 172.21.15.37:0/4194449341 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd359e640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40d0780 0x7f0cd415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0cd2d9d640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 0x7f0cd4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.366+0000 7f0ccbfff640 1 -- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40d0780 msgr2=0x7f0cd415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccbfff640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40d0780 0x7f0cd415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccbfff640 1 -- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 msgr2=0x7f0cd4151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccbfff640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 0x7f0cd4151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccbfff640 1 -- 172.21.15.37:0/4194449341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc009b30 con 0x7f0cd40cf290 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0cd2d9d640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 0x7f0cd4151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccbfff640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00d5f0 tx=0x7f0cbc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0125f0 con 0x7f0cd40cf290 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc012750 con 0x7f0cd40cf290 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc012ae0 con 0x7f0cd40cf290 2023-07-09T21:23:01.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd415a990 con 0x7f0cd40cf290 2023-07-09T21:23:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd415af50 con 0x7f0cd40cf290 2023-07-09T21:23:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd415b110 con 0x7f0cd40cf290 2023-07-09T21:23:01.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0cbc012c40 con 0x7f0cd40cf290 2023-07-09T21:23:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 0x7f0cb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0cbc084120 con 0x7f0cd40cf290 2023-07-09T21:23:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.370+0000 7f0cd2d9d640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 0x7f0cb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.374+0000 7f0cd2d9d640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 0x7f0cb4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0cd415f0d0 tx=0x7f0cc4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.374+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cbc051630 con 0x7f0cd40cf290 2023-07-09T21:23:01.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cd404d7d0 con 0x7f0cd40cf290 2023-07-09T21:23:01.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0ccb7fe640 1 -- 172.21.15.37:0/4194449341 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0cbc054c50 con 0x7f0cd40cf290 2023-07-09T21:23:01.535 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:01.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 msgr2=0x7f0cb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 0x7f0cb4068730 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0cd415f0d0 tx=0x7f0cc4009040 comp rx=0 tx=0).stop 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 msgr2=0x7f0cd40b2e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc00d5f0 tx=0x7f0cbc00dab0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 shutdown_connections 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0cb4066280 0x7f0cb4068730 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cd40d0780 0x7f0cd415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cd40cf290 0x7f0cd40b2e00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 --2- 172.21.15.37:0/4194449341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cd40b7980 0x7f0cd4151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 >> 172.21.15.37:0/4194449341 conn(0x7f0cd4073090 msgr2=0x7f0cd41586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 shutdown_connections 2023-07-09T21:23:01.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.530+0000 7f0cd918f640 1 -- 172.21.15.37:0/4194449341 wait complete. 2023-07-09T21:23:01.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:01.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.694+0000 7f1af76aa640 1 Processor -- start 2023-07-09T21:23:01.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.694+0000 7f1af76aa640 1 -- start start 2023-07-09T21:23:01.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af76aa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1af00cf290 0x7f1af0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af76aa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00d0780 0x7f1af00d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af76aa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1af015bf80 con 0x7f1af00b7980 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af76aa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1af00cd070 con 0x7f1af00cf290 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af76aa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00cfd70 con 0x7f1af00d0780 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1af00cf290 0x7f1af0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1af00cf290 0x7f1af0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60804/0 (socket says 172.21.15.37:60804) 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 -- 172.21.15.37:0/253596791 learned_addr learned my addr 172.21.15.37:0/253596791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:01.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af5c47640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00d0780 0x7f1af00d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 -- 172.21.15.37:0/253596791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00d0780 msgr2=0x7f1af00d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00d0780 0x7f1af00d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 -- 172.21.15.37:0/253596791 >> v1:172.21.15.119:6789/0 conn(0x7f1af00b7980 legacy=0x7f1af00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.698+0000 7f1af4c45640 1 -- 172.21.15.37:0/253596791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af0160570 con 0x7f1af00cf290 2023-07-09T21:23:01.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af4c45640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00cf290 0x7f1af0160030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57b9c1eb6a2cbe7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1ae7fff640 1 -- 172.21.15.37:0/253596791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab600 con 0x7f1af00cf290 2023-07-09T21:23:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1ae7fff640 1 -- 172.21.15.37:0/253596791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00a7050 con 0x7f1af00cf290 2023-07-09T21:23:01.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1ae7fff640 1 -- 172.21.15.37:0/253596791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00ab980 con 0x7f1af00cf290 2023-07-09T21:23:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- 172.21.15.37:0/253596791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00cf290 msgr2=0x7f1af0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00cf290 0x7f1af0160030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0009870 tx=0x7f1ae001c540 comp rx=0 tx=0).stop 2023-07-09T21:23:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- 172.21.15.37:0/253596791 shutdown_connections 2023-07-09T21:23:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00d0780 0x7f1af00d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 --2- 172.21.15.37:0/253596791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00cf290 0x7f1af0160030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- 172.21.15.37:0/253596791 >> 172.21.15.37:0/253596791 conn(0x7f1af0073090 msgr2=0x7f1af0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- 172.21.15.37:0/253596791 shutdown_connections 2023-07-09T21:23:01.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- 172.21.15.37:0/253596791 wait complete. 2023-07-09T21:23:01.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 Processor -- start 2023-07-09T21:23:01.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.702+0000 7f1af76aa640 1 -- start start 2023-07-09T21:23:01.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af00b7980 0x7f1af01549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00cf290 0x7f1af00c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00c9e10 con 0x7f1af00d0780 2023-07-09T21:23:01.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00c7990 con 0x7f1af00b7980 2023-07-09T21:23:01.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af00c74a0 con 0x7f1af00cf290 2023-07-09T21:23:01.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60820/0 (socket says 172.21.15.37:60820) 2023-07-09T21:23:01.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 -- 172.21.15.37:0/2562280633 learned_addr learned my addr 172.21.15.37:0/2562280633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:01.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af4c45640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00cf290 0x7f1af00c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5446640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af00b7980 0x7f1af01549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 -- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00cf290 msgr2=0x7f1af00c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00cf290 0x7f1af00c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 -- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af00b7980 msgr2=0x7f1af01549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af00b7980 0x7f1af01549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 -- 172.21.15.37:0/2562280633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00094d0 con 0x7f1af00d0780 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af5c47640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8007e60 tx=0x7f1ae800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8014420 con 0x7f1af00d0780 2023-07-09T21:23:01.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae80145a0 con 0x7f1af00d0780 2023-07-09T21:23:01.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8014950 con 0x7f1af00d0780 2023-07-09T21:23:01.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af00ca060 con 0x7f1af00d0780 2023-07-09T21:23:01.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1af00ca620 con 0x7f1af00d0780 2023-07-09T21:23:01.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1af00c7b50 con 0x7f1af00d0780 2023-07-09T21:23:01.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.706+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ae8014ab0 con 0x7f1af00d0780 2023-07-09T21:23:01.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.710+0000 7f1ae5ffb640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 0x7f1ad4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:01.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.710+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ae8084550 con 0x7f1af00d0780 2023-07-09T21:23:01.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.710+0000 7f1af5446640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 0x7f1ad4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:01.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.710+0000 7f1af5446640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 0x7f1ad4068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1aec001810 tx=0x7f1aec009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:01.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.714+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ae8055470 con 0x7f1af00d0780 2023-07-09T21:23:01.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.866+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1af004d7d0 con 0x7f1af00d0780 2023-07-09T21:23:01.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.866+0000 7f1ae5ffb640 1 -- 172.21.15.37:0/2562280633 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ae8055000 con 0x7f1af00d0780 2023-07-09T21:23:01.872 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:01.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 msgr2=0x7f1ad4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 0x7f1ad4068730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1aec001810 tx=0x7f1aec009040 comp rx=0 tx=0).stop 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 msgr2=0x7f1af015a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8007e60 tx=0x7f1ae800e4b0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 shutdown_connections 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1ad4066280 0x7f1ad4068730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1af00d0780 0x7f1af015a280 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1af00cf290 0x7f1af00c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 --2- 172.21.15.37:0/2562280633 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1af00b7980 0x7f1af01549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:01.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 >> 172.21.15.37:0/2562280633 conn(0x7f1af0073090 msgr2=0x7f1af015dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:01.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 shutdown_connections 2023-07-09T21:23:01.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:01.870+0000 7f1af76aa640 1 -- 172.21.15.37:0/2562280633 wait complete. 2023-07-09T21:23:01.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:02.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 Processor -- start 2023-07-09T21:23:02.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 -- start start 2023-07-09T21:23:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ffc15ba60 0x7f7ffc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ffc0cc800 0x7f7ffc0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc06acb0 con 0x7f7ffc0cf090 2023-07-09T21:23:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc1605f0 con 0x7f7ffc0cc800 2023-07-09T21:23:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f8003337640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ffc0ccc90 con 0x7f7ffc15ba60 2023-07-09T21:23:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80018d4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ffc0cf090 0x7f7ffc0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53256/0 (socket says 172.21.15.37:53256) 2023-07-09T21:23:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80018d4640 1 -- 172.21.15.37:0/1256760775 learned_addr learned my addr 172.21.15.37:0/1256760775 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80008d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ffc0cc800 0x7f7ffc0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80010d3640 1 --2- 172.21.15.37:0/1256760775 >> v2:172.21.15.119:3300/0 conn(0x7f7ffc15ba60 0x7f7ffc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80008d2640 1 -- 172.21.15.37:0/1256760775 >> v2:172.21.15.119:3300/0 conn(0x7f7ffc15ba60 msgr2=0x7f7ffc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80008d2640 1 --2- 172.21.15.37:0/1256760775 >> v2:172.21.15.119:3300/0 conn(0x7f7ffc15ba60 0x7f7ffc1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80008d2640 1 -- 172.21.15.37:0/1256760775 >> v1:172.21.15.37:6789/0 conn(0x7f7ffc0cf090 legacy=0x7f7ffc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.030+0000 7f80008d2640 1 -- 172.21.15.37:0/1256760775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc0cfe20 con 0x7f7ffc0cc800 2023-07-09T21:23:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.034+0000 7f80008d2640 1 --2- 172.21.15.37:0/1256760775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0ceb50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc08b0d0 tx=0x7f7fec01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3bab6bcff89561 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f7ff3fff640 1 -- 172.21.15.37:0/1256760775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0a7070 con 0x7f7ffc0cc800 2023-07-09T21:23:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f7ff3fff640 1 -- 172.21.15.37:0/1256760775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0ab430 con 0x7f7ffc0cc800 2023-07-09T21:23:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f7ff3fff640 1 -- 172.21.15.37:0/1256760775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0ab7c0 con 0x7f7ffc0cc800 2023-07-09T21:23:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 -- 172.21.15.37:0/1256760775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cc800 msgr2=0x7f7ffc0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 --2- 172.21.15.37:0/1256760775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0ceb50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc08b0d0 tx=0x7f7fec01c430 comp rx=0 tx=0).stop 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 -- 172.21.15.37:0/1256760775 shutdown_connections 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 --2- 172.21.15.37:0/1256760775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0ceb50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 --2- 172.21.15.37:0/1256760775 >> v2:172.21.15.119:3300/0 conn(0x7f7ffc15ba60 0x7f7ffc1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 -- 172.21.15.37:0/1256760775 >> 172.21.15.37:0/1256760775 conn(0x7f7ffc073090 msgr2=0x7f7ffc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 -- 172.21.15.37:0/1256760775 shutdown_connections 2023-07-09T21:23:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.038+0000 7f8003337640 1 -- 172.21.15.37:0/1256760775 wait complete. 2023-07-09T21:23:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 Processor -- start 2023-07-09T21:23:02.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- start start 2023-07-09T21:23:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ffc15ba60 0x7f7ffc150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0caa30 con 0x7f7ffc0cf090 2023-07-09T21:23:02.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc0cb390 con 0x7f7ffc0cc800 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc15df30 con 0x7f7ffc15ba60 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60840/0 (socket says 172.21.15.37:60840) 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 -- 172.21.15.37:0/2156036730 learned_addr learned my addr 172.21.15.37:0/2156036730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80010d3640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80018d4640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ffc15ba60 0x7f7ffc150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 -- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ffc15ba60 msgr2=0x7f7ffc150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ffc15ba60 0x7f7ffc150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 -- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ffc0cc800 msgr2=0x7f7ffc0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 -- 172.21.15.37:0/2156036730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009420 con 0x7f7ffc0cf090 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f80008d2640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7fec019040 tx=0x7f7fec01ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0b5610 con 0x7f7ffc0cf090 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec0b5790 con 0x7f7ffc0cf090 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec0b5b40 con 0x7f7ffc0cf090 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc0ca370 con 0x7f7ffc0cf090 2023-07-09T21:23:02.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc15e210 con 0x7f7ffc0cf090 2023-07-09T21:23:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.042+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0cab70 con 0x7f7ffc0cf090 2023-07-09T21:23:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.046+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7fec0b5ca0 con 0x7f7ffc0cf090 2023-07-09T21:23:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.046+0000 7f7ff1ffb640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 0x7f7fe0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.046+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7fec11e980 con 0x7f7ffc0cf090 2023-07-09T21:23:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.046+0000 7f80010d3640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 0x7f7fe0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.046+0000 7f80010d3640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 0x7f7fe0068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009ac0 tx=0x7f7ff8009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.050+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7ffc0cab70 con 0x7f7ffc0cf090 2023-07-09T21:23:02.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ffc0cab70 con 0x7f7ffc0cf090 2023-07-09T21:23:02.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f7ff1ffb640 1 -- 172.21.15.37:0/2156036730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f7ffc0cab70 con 0x7f7ffc0cf090 2023-07-09T21:23:02.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:02.211 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 msgr2=0x7f7fe0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 0x7f7fe0068730 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009ac0 tx=0x7f7ff8009190 comp rx=0 tx=0).stop 2023-07-09T21:23:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 msgr2=0x7f7ffc150a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7fec019040 tx=0x7f7fec01ac70 comp rx=0 tx=0).stop 2023-07-09T21:23:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 shutdown_connections 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7fe0066280 0x7f7fe0068730 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ffc15ba60 0x7f7ffc150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ffc0cf090 0x7f7ffc150a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 --2- 172.21.15.37:0/2156036730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ffc0cc800 0x7f7ffc0cae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 >> 172.21.15.37:0/2156036730 conn(0x7f7ffc073090 msgr2=0x7f7ffc154240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 shutdown_connections 2023-07-09T21:23:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.206+0000 7f8003337640 1 -- 172.21.15.37:0/2156036730 wait complete. 2023-07-09T21:23:02.232 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:02.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 Processor -- start 2023-07-09T21:23:02.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 -- start start 2023-07-09T21:23:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6d80cf290 0x7fd6d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d815bf80 con 0x7fd6d80b7980 2023-07-09T21:23:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d8160570 con 0x7fd6d80d0780 2023-07-09T21:23:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6df419640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d80cd070 con 0x7fd6d80cf290 2023-07-09T21:23:02.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6dd1b5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd6d80b7980 0x7fd6d80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53264/0 (socket says 172.21.15.37:53264) 2023-07-09T21:23:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6dd1b5640 1 -- 172.21.15.37:0/187283145 learned_addr learned my addr 172.21.15.37:0/187283145 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.374+0000 7fd6dc9b4640 1 --2- 172.21.15.37:0/187283145 >> v2:172.21.15.37:3300/0 conn(0x7fd6d80cf290 0x7fd6d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6cffff640 1 -- 172.21.15.37:0/187283145 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935872166 0 0) 0x7fd6d4001120 con 0x7fd6d80b7980 2023-07-09T21:23:02.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6cffff640 1 -- 172.21.15.37:0/187283145 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003530 con 0x7fd6d80b7980 2023-07-09T21:23:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/187283145 >> v1:172.21.15.119:6789/0 conn(0x7fd6d80d0780 legacy=0x7fd6d80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/187283145 >> v1:172.21.15.37:6789/0 conn(0x7fd6d80b7980 legacy=0x7fd6d80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/187283145 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d80d02f0 con 0x7fd6d80cf290 2023-07-09T21:23:02.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6dc9b4640 1 --2- 172.21.15.37:0/187283145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d8160030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097c0 tx=0x7fd6c801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dec1cb378fe5fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6cffff640 1 -- 172.21.15.37:0/187283145 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ab600 con 0x7fd6d80cf290 2023-07-09T21:23:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6cffff640 1 -- 172.21.15.37:0/187283145 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80a7050 con 0x7fd6d80cf290 2023-07-09T21:23:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6cffff640 1 -- 172.21.15.37:0/187283145 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80ab960 con 0x7fd6d80cf290 2023-07-09T21:23:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6df419640 1 -- 172.21.15.37:0/187283145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 msgr2=0x7fd6d8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6df419640 1 --2- 172.21.15.37:0/187283145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d8160030 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097c0 tx=0x7fd6c801c440 comp rx=0 tx=0).stop 2023-07-09T21:23:02.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6df419640 1 -- 172.21.15.37:0/187283145 shutdown_connections 2023-07-09T21:23:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6df419640 1 --2- 172.21.15.37:0/187283145 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d8160030 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.378+0000 7fd6df419640 1 -- 172.21.15.37:0/187283145 >> 172.21.15.37:0/187283145 conn(0x7fd6d8073090 msgr2=0x7fd6d8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- 172.21.15.37:0/187283145 shutdown_connections 2023-07-09T21:23:02.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- 172.21.15.37:0/187283145 wait complete. 2023-07-09T21:23:02.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 Processor -- start 2023-07-09T21:23:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- start start 2023-07-09T21:23:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d80b7980 0x7fd6d80c6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d80d0780 0x7fd6d80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c7260 con 0x7fd6d80cf290 2023-07-09T21:23:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80b4a70 con 0x7fd6d80d0780 2023-07-09T21:23:02.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d80c7450 con 0x7fd6d80b7980 2023-07-09T21:23:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60862/0 (socket says 172.21.15.37:60862) 2023-07-09T21:23:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/781294937 learned_addr learned my addr 172.21.15.37:0/781294937 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dd1b5640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d80b7980 0x7fd6d80c6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dd9b6640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d80d0780 0x7fd6d80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d80b7980 msgr2=0x7fd6d80c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d80b7980 0x7fd6d80c6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d80d0780 msgr2=0x7fd6d80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d80d0780 0x7fd6d80cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 -- 172.21.15.37:0/781294937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009420 con 0x7fd6d80cf290 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6dc9b4640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8019050 tx=0x7fd6c80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80b4600 con 0x7fd6d80cf290 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c80b4760 con 0x7fd6d80cf290 2023-07-09T21:23:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80b4af0 con 0x7fd6d80cf290 2023-07-09T21:23:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.382+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d80c7730 con 0x7fd6d80cf290 2023-07-09T21:23:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d80c7cf0 con 0x7fd6d80cf290 2023-07-09T21:23:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d80737d0 con 0x7fd6d80cf290 2023-07-09T21:23:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd6c80b2040 con 0x7fd6d80cf290 2023-07-09T21:23:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6cdffb640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 0x7fd6bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd6c811dc80 con 0x7fd6d80cf290 2023-07-09T21:23:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.386+0000 7fd6dd1b5640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 0x7fd6bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.390+0000 7fd6dd1b5640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 0x7fd6bc068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005890 tx=0x7fd6d4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.390+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6d80737d0 con 0x7fd6d80cf290 2023-07-09T21:23:02.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6d8160570 con 0x7fd6d80cf290 2023-07-09T21:23:02.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6cdffb640 1 -- 172.21.15.37:0/781294937 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6d8160570 con 0x7fd6d80cf290 2023-07-09T21:23:02.551 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:02.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 msgr2=0x7fd6bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 0x7fd6bc068730 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4005890 tx=0x7fd6d4009040 comp rx=0 tx=0).stop 2023-07-09T21:23:02.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 msgr2=0x7fd6d80b4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8019050 tx=0x7fd6c80191e0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 shutdown_connections 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6bc066280 0x7fd6bc068730 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.546+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6d80d0780 0x7fd6d80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.550+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6d80cf290 0x7fd6d80b4530 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.550+0000 7fd6df419640 1 --2- 172.21.15.37:0/781294937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6d80b7980 0x7fd6d80c6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.550+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 >> 172.21.15.37:0/781294937 conn(0x7fd6d8073090 msgr2=0x7fd6d80ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.550+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 shutdown_connections 2023-07-09T21:23:02.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.550+0000 7fd6df419640 1 -- 172.21.15.37:0/781294937 wait complete. 2023-07-09T21:23:02.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:02.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 Processor -- start 2023-07-09T21:23:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 -- start start 2023-07-09T21:23:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 0x7f940c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 0x7f940c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c15bf80 con 0x7f940c0b7980 2023-07-09T21:23:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c0cd070 con 0x7f940c0cf290 2023-07-09T21:23:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9411834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0cfd70 con 0x7f940c0d0780 2023-07-09T21:23:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f940c0b7980 0x7f940c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53274/0 (socket says 172.21.15.37:53274) 2023-07-09T21:23:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940affd640 1 -- 172.21.15.37:0/112372398 learned_addr learned my addr 172.21.15.37:0/112372398 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9403fff640 1 --2- 172.21.15.37:0/112372398 >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 0x7f940c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940b7fe640 1 --2- 172.21.15.37:0/112372398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 0x7f940c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940a7fc640 1 -- 172.21.15.37:0/112372398 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295538211 0 0) 0x7f93fc001120 con 0x7f940c0b7980 2023-07-09T21:23:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940a7fc640 1 -- 172.21.15.37:0/112372398 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f8003530 con 0x7f940c0b7980 2023-07-09T21:23:02.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940b7fe640 1 -- 172.21.15.37:0/112372398 >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 msgr2=0x7f940c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940b7fe640 1 --2- 172.21.15.37:0/112372398 >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 0x7f940c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940b7fe640 1 -- 172.21.15.37:0/112372398 >> v1:172.21.15.37:6789/0 conn(0x7f940c0b7980 legacy=0x7f940c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f940b7fe640 1 -- 172.21.15.37:0/112372398 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c160570 con 0x7f940c0d0780 2023-07-09T21:23:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.714+0000 7f9403fff640 1 --2- 172.21.15.37:0/112372398 >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 0x7f940c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f940b7fe640 1 --2- 172.21.15.37:0/112372398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 0x7f940c0d0bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9404009d90 tx=0x7f940401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9425bf18a3b52a16 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f940a7fc640 1 -- 172.21.15.37:0/112372398 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040a5810 con 0x7f940c0d0780 2023-07-09T21:23:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f940a7fc640 1 -- 172.21.15.37:0/112372398 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94040a5970 con 0x7f940c0d0780 2023-07-09T21:23:02.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f940a7fc640 1 -- 172.21.15.37:0/112372398 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94040a5ce0 con 0x7f940c0d0780 2023-07-09T21:23:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 -- 172.21.15.37:0/112372398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 msgr2=0x7f940c0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 --2- 172.21.15.37:0/112372398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 0x7f940c0d0bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9404009d90 tx=0x7f940401c950 comp rx=0 tx=0).stop 2023-07-09T21:23:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 -- 172.21.15.37:0/112372398 shutdown_connections 2023-07-09T21:23:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 --2- 172.21.15.37:0/112372398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0d0780 0x7f940c0d0bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 --2- 172.21.15.37:0/112372398 >> v2:172.21.15.119:3300/0 conn(0x7f940c0cf290 0x7f940c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 -- 172.21.15.37:0/112372398 >> 172.21.15.37:0/112372398 conn(0x7f940c073090 msgr2=0x7f940c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 -- 172.21.15.37:0/112372398 shutdown_connections 2023-07-09T21:23:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.718+0000 7f9411834640 1 -- 172.21.15.37:0/112372398 wait complete. 2023-07-09T21:23:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 Processor -- start 2023-07-09T21:23:02.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- start start 2023-07-09T21:23:02.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 0x7f940c0b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 0x7f940c15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c13f700 con 0x7f940c0cf290 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c141c90 con 0x7f940c0d0780 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c141f50 con 0x7f940c0b7980 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60870/0 (socket says 172.21.15.37:60870) 2023-07-09T21:23:02.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 -- 172.21.15.37:0/2665055527 learned_addr learned my addr 172.21.15.37:0/2665055527 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f940b7fe640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 0x7f940c15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f940affd640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 0x7f940c0b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 -- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 msgr2=0x7f940c0b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 0x7f940c0b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 -- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 msgr2=0x7f940c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 0x7f940c15dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 -- 172.21.15.37:0/2665055527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f4009420 con 0x7f940c0cf290 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f940affd640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 0x7f940c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f940b7fe640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 0x7f940c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9403fff640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9d0 tx=0x7f93f400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f400ca60 con 0x7f940c0cf290 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f400cbc0 con 0x7f940c0cf290 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9404009a70 con 0x7f940c0cf290 2023-07-09T21:23:02.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f4013470 con 0x7f940c0cf290 2023-07-09T21:23:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c142510 con 0x7f940c0cf290 2023-07-09T21:23:02.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.722+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c04d7d0 con 0x7f940c0cf290 2023-07-09T21:23:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.726+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93f40135d0 con 0x7f940c0cf290 2023-07-09T21:23:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.726+0000 7f9408ff9640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.726+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f93f4083d70 con 0x7f940c0cf290 2023-07-09T21:23:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.726+0000 7f940affd640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:02.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.726+0000 7f940affd640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 0x7f93ec068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f93fc007fd0 tx=0x7f93fc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:02.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.730+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93f4054be0 con 0x7f940c0cf290 2023-07-09T21:23:02.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f940c0b1600 con 0x7f940c0cf290 2023-07-09T21:23:02.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9408ff9640 1 -- 172.21.15.37:0/2665055527 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f93f4054770 con 0x7f940c0cf290 2023-07-09T21:23:02.891 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:02.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 msgr2=0x7f93ec068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 0x7f93ec068730 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f93fc007fd0 tx=0x7f93fc009040 comp rx=0 tx=0).stop 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 msgr2=0x7f940c141750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f93f400e9d0 tx=0x7f93f400ee90 comp rx=0 tx=0).stop 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 shutdown_connections 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f93ec066280 0x7f93ec068730 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f940c0d0780 0x7f940c15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f940c0cf290 0x7f940c141750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 --2- 172.21.15.37:0/2665055527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f940c0b7980 0x7f940c0b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 >> 172.21.15.37:0/2665055527 conn(0x7f940c073090 msgr2=0x7f940c0ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 shutdown_connections 2023-07-09T21:23:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:02.886+0000 7f9411834640 1 -- 172.21.15.37:0/2665055527 wait complete. 2023-07-09T21:23:02.912 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.050+0000 7fddbe0ec640 1 Processor -- start 2023-07-09T21:23:03.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddbe0ec640 1 -- start start 2023-07-09T21:23:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddbe0ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fddb80cf290 0x7fddb8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddbe0ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb815bf80 con 0x7fddb80d0780 2023-07-09T21:23:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddbe0ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb8160570 con 0x7fddb80b7980 2023-07-09T21:23:03.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddbe0ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80cd070 con 0x7fddb80cf290 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fddb80cf290 0x7fddb8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fddb80cf290 0x7fddb8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60872/0 (socket says 172.21.15.37:60872) 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 -- 172.21.15.37:0/1715150234 learned_addr learned my addr 172.21.15.37:0/1715150234 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 -- 172.21.15.37:0/1715150234 >> v1:172.21.15.119:6789/0 conn(0x7fddb80b7980 legacy=0x7fddb80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 -- 172.21.15.37:0/1715150234 >> v1:172.21.15.37:6789/0 conn(0x7fddb80d0780 legacy=0x7fddb80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb6ffd640 1 -- 172.21.15.37:0/1715150234 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb80d02f0 con 0x7fddb80cf290 2023-07-09T21:23:03.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.054+0000 7fddb67fc640 1 -- 172.21.15.37:0/1715150234 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265298006 0 0) 0x7fddb00014a0 con 0x7fddb80d0780 2023-07-09T21:23:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddb6ffd640 1 --2- 172.21.15.37:0/1715150234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80cf290 0x7fddb8160030 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fddac009870 tx=0x7fddac01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9829067efa314555 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddb67fc640 1 -- 172.21.15.37:0/1715150234 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0ab600 con 0x7fddb80cf290 2023-07-09T21:23:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddb67fc640 1 -- 172.21.15.37:0/1715150234 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac0a7050 con 0x7fddb80cf290 2023-07-09T21:23:03.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddb67fc640 1 -- 172.21.15.37:0/1715150234 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0ab980 con 0x7fddb80cf290 2023-07-09T21:23:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- 172.21.15.37:0/1715150234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80cf290 msgr2=0x7fddb8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/1715150234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80cf290 0x7fddb8160030 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fddac009870 tx=0x7fddac01c540 comp rx=0 tx=0).stop 2023-07-09T21:23:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- 172.21.15.37:0/1715150234 shutdown_connections 2023-07-09T21:23:03.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/1715150234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80cf290 0x7fddb8160030 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- 172.21.15.37:0/1715150234 >> 172.21.15.37:0/1715150234 conn(0x7fddb8073090 msgr2=0x7fddb8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- 172.21.15.37:0/1715150234 shutdown_connections 2023-07-09T21:23:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- 172.21.15.37:0/1715150234 wait complete. 2023-07-09T21:23:03.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 Processor -- start 2023-07-09T21:23:03.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.058+0000 7fddbe0ec640 1 -- start start 2023-07-09T21:23:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 0x7fddb8146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb80cf290 0x7fddb814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80c6400 con 0x7fddb80d0780 2023-07-09T21:23:03.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb814bed0 con 0x7fddb80b7980 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb8147190 con 0x7fddb80cf290 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60888/0 (socket says 172.21.15.37:60888) 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 -- 172.21.15.37:0/3690262046 learned_addr learned my addr 172.21.15.37:0/3690262046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb6ffd640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb80cf290 0x7fddb814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb77fe640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 0x7fddb8146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 -- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb80cf290 msgr2=0x7fddb814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb80cf290 0x7fddb814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 -- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 msgr2=0x7fddb8146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 0x7fddb8146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 -- 172.21.15.37:0/3690262046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac0094d0 con 0x7fddb80d0780 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb77fe640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 0x7fddb8146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddb7fff640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c780 tx=0x7fddb000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003db0 con 0x7fddb80d0780 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb000ce30 con 0x7fddb80d0780 2023-07-09T21:23:03.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80c8930 con 0x7fddb80d0780 2023-07-09T21:23:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb00052b0 con 0x7fddb80d0780 2023-07-09T21:23:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb814c400 con 0x7fddb80d0780 2023-07-09T21:23:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.062+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb804d7d0 con 0x7fddb80d0780 2023-07-09T21:23:03.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.066+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fddb0005410 con 0x7fddb80d0780 2023-07-09T21:23:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.066+0000 7fdd9ffff640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 0x7fdda4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.066+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fddb0083930 con 0x7fddb80d0780 2023-07-09T21:23:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.066+0000 7fddb77fe640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 0x7fdda4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.066+0000 7fddb77fe640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 0x7fdda4068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddb8147db0 tx=0x7fdda8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.070+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddb0050d10 con 0x7fddb80d0780 2023-07-09T21:23:03.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fddb815bf80 con 0x7fddb80d0780 2023-07-09T21:23:03.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fdd9ffff640 1 -- 172.21.15.37:0/3690262046 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fddb815bf80 con 0x7fddb80d0780 2023-07-09T21:23:03.226 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 msgr2=0x7fdda4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 0x7fdda4068730 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fddb8147db0 tx=0x7fdda8009040 comp rx=0 tx=0).stop 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 msgr2=0x7fddb8157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fddb000c780 tx=0x7fddb000cc40 comp rx=0 tx=0).stop 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 shutdown_connections 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fdda4066280 0x7fdda4068730 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddb80d0780 0x7fddb8157c30 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fddb80cf290 0x7fddb814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 --2- 172.21.15.37:0/3690262046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddb80b7980 0x7fddb8146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 >> 172.21.15.37:0/3690262046 conn(0x7fddb8073090 msgr2=0x7fddb815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 shutdown_connections 2023-07-09T21:23:03.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.222+0000 7fddbe0ec640 1 -- 172.21.15.37:0/3690262046 wait complete. 2023-07-09T21:23:03.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:03.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.386+0000 7fa53cc5b640 1 Processor -- start 2023-07-09T21:23:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa53cc5b640 1 -- start start 2023-07-09T21:23:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa53cc5b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5380b41e0 0x7fa5380ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa53cc5b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53815bf00 con 0x7fa5380b11a0 2023-07-09T21:23:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa53cc5b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53815f6e0 con 0x7fa53815bb30 2023-07-09T21:23:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa53cc5b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5380ce970 con 0x7fa5380b41e0 2023-07-09T21:23:03.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa52ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5380b41e0 0x7fa5380ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa537fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa5380b11a0 0x7fa5380cfcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53300/0 (socket says 172.21.15.37:53300) 2023-07-09T21:23:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa537fff640 1 -- 172.21.15.37:0/2089893751 learned_addr learned my addr 172.21.15.37:0/2089893751 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa52ffff640 1 -- 172.21.15.37:0/2089893751 >> v1:172.21.15.119:6789/0 conn(0x7fa53815bb30 legacy=0x7fa5380b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa52ffff640 1 -- 172.21.15.37:0/2089893751 >> v1:172.21.15.37:6789/0 conn(0x7fa5380b11a0 legacy=0x7fa5380cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.390+0000 7fa52ffff640 1 -- 172.21.15.37:0/2089893751 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53815f9c0 con 0x7fa5380b41e0 2023-07-09T21:23:03.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa52ffff640 1 --2- 172.21.15.37:0/2089893751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa5380ce430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5200097c0 tx=0x7fa52001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819247a2cef32cec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa536ffd640 1 -- 172.21.15.37:0/2089893751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200ab600 con 0x7fa5380b41e0 2023-07-09T21:23:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa536ffd640 1 -- 172.21.15.37:0/2089893751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5200a7050 con 0x7fa5380b41e0 2023-07-09T21:23:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa536ffd640 1 -- 172.21.15.37:0/2089893751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200ab980 con 0x7fa5380b41e0 2023-07-09T21:23:03.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- 172.21.15.37:0/2089893751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 msgr2=0x7fa5380ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/2089893751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa5380ce430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa5200097c0 tx=0x7fa52001c310 comp rx=0 tx=0).stop 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- 172.21.15.37:0/2089893751 shutdown_connections 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/2089893751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa5380ce430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- 172.21.15.37:0/2089893751 >> 172.21.15.37:0/2089893751 conn(0x7fa53806aac0 msgr2=0x7fa5380cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- 172.21.15.37:0/2089893751 shutdown_connections 2023-07-09T21:23:03.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- 172.21.15.37:0/2089893751 wait complete. 2023-07-09T21:23:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 Processor -- start 2023-07-09T21:23:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.394+0000 7fa53cc5b640 1 -- start start 2023-07-09T21:23:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 0x7fa5380b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa53815bb30 0x7fa5380d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380b7d30 con 0x7fa5380b41e0 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53815e500 con 0x7fa5380b11a0 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5380c8980 con 0x7fa53815bb30 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60906/0 (socket says 172.21.15.37:60906) 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 -- 172.21.15.37:0/1168466499 learned_addr learned my addr 172.21.15.37:0/1168466499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa5377fe640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 0x7fa5380b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa537fff640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa53815bb30 0x7fa5380d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 -- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa53815bb30 msgr2=0x7fa5380d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa53815bb30 0x7fa5380d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 -- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 msgr2=0x7fa5380b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 0x7fa5380b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 -- 172.21.15.37:0/1168466499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520009420 con 0x7fa5380b41e0 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa5377fe640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 0x7fa5380b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa52ffff640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa520018f20 tx=0x7fa5200190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200aa8b0 con 0x7fa5380b41e0 2023-07-09T21:23:03.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5200aaa30 con 0x7fa5380b41e0 2023-07-09T21:23:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5380b7a50 con 0x7fa5380b41e0 2023-07-09T21:23:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5200aade0 con 0x7fa5380b41e0 2023-07-09T21:23:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53815e190 con 0x7fa5380b41e0 2023-07-09T21:23:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.398+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53815dcf0 con 0x7fa5380b41e0 2023-07-09T21:23:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.402+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa5200b2040 con 0x7fa5380b41e0 2023-07-09T21:23:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.402+0000 7fa534ff9640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 0x7fa518068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.402+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa52011e200 con 0x7fa5380b41e0 2023-07-09T21:23:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.402+0000 7fa5377fe640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 0x7fa518068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.402+0000 7fa5377fe640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 0x7fa518068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa53815a3b0 tx=0x7fa528009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.406+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5200eb5e0 con 0x7fa5380b41e0 2023-07-09T21:23:03.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa53804e020 con 0x7fa5380b41e0 2023-07-09T21:23:03.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa534ff9640 1 -- 172.21.15.37:0/1168466499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa5200eec00 con 0x7fa5380b41e0 2023-07-09T21:23:03.563 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:03.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 msgr2=0x7fa518068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 0x7fa518068730 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa53815a3b0 tx=0x7fa528009040 comp rx=0 tx=0).stop 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 msgr2=0x7fa53815e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa520018f20 tx=0x7fa5200190b0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 shutdown_connections 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa518066280 0x7fa518068730 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa53815bb30 0x7fa5380d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5380b41e0 0x7fa53815e990 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 --2- 172.21.15.37:0/1168466499 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5380b11a0 0x7fa5380b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 >> 172.21.15.37:0/1168466499 conn(0x7fa53806aac0 msgr2=0x7fa538155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:03.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 shutdown_connections 2023-07-09T21:23:03.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.558+0000 7fa53cc5b640 1 -- 172.21.15.37:0/1168466499 wait complete. 2023-07-09T21:23:03.597 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2023-07-09T21:23:03.598 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:23:03.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-09T21:23:03.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 Processor -- start 2023-07-09T21:23:03.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 -- start start 2023-07-09T21:23:03.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f880b4340 0x7f6f8806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6f880cef80 0x7f6f880d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f880b49f0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880b7e80 con 0x7f6f880b4340 2023-07-09T21:23:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f8d511640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f880cc8a0 con 0x7f6f880cef80 2023-07-09T21:23:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f86ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f880b7ab0 0x7f6f880b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53306/0 (socket says 172.21.15.37:53306) 2023-07-09T21:23:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f86ffd640 1 -- 172.21.15.37:0/2556741617 learned_addr learned my addr 172.21.15.37:0/2556741617 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/2556741617 >> v2:172.21.15.37:3300/0 conn(0x7f6f880b4340 0x7f6f8806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f877fe640 1 --2- 172.21.15.37:0/2556741617 >> v2:172.21.15.119:3300/0 conn(0x7f6f880cef80 0x7f6f880d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f867fc640 1 -- 172.21.15.37:0/2556741617 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011794236 0 0) 0x7f6f880b49f0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f867fc640 1 -- 172.21.15.37:0/2556741617 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f74003530 con 0x7f6f880b7ab0 2023-07-09T21:23:03.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f7ffff640 1 -- 172.21.15.37:0/2556741617 >> v2:172.21.15.119:3300/0 conn(0x7f6f880cef80 msgr2=0x7f6f880d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:03.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/2556741617 >> v2:172.21.15.119:3300/0 conn(0x7f6f880cef80 0x7f6f880d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f7ffff640 1 -- 172.21.15.37:0/2556741617 >> v1:172.21.15.37:6789/0 conn(0x7f6f880b7ab0 legacy=0x7f6f880b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.738+0000 7f6f7ffff640 1 -- 172.21.15.37:0/2556741617 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f880ccb80 con 0x7f6f880b4340 2023-07-09T21:23:03.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/2556741617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b4340 0x7f6f8806aa50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6f8808b5b0 tx=0x7f6f7001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1dad402e3c29c16 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f867fc640 1 -- 172.21.15.37:0/2556741617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700a7070 con 0x7f6f880b4340 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f867fc640 1 -- 172.21.15.37:0/2556741617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700ab430 con 0x7f6f880b4340 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f867fc640 1 -- 172.21.15.37:0/2556741617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700ab7c0 con 0x7f6f880b4340 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 -- 172.21.15.37:0/2556741617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b4340 msgr2=0x7f6f8806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 --2- 172.21.15.37:0/2556741617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b4340 0x7f6f8806aa50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6f8808b5b0 tx=0x7f6f7001c430 comp rx=0 tx=0).stop 2023-07-09T21:23:03.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 -- 172.21.15.37:0/2556741617 shutdown_connections 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 --2- 172.21.15.37:0/2556741617 >> v2:172.21.15.119:3300/0 conn(0x7f6f880cef80 0x7f6f880d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 --2- 172.21.15.37:0/2556741617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b4340 0x7f6f8806aa50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 -- 172.21.15.37:0/2556741617 >> 172.21.15.37:0/2556741617 conn(0x7f6f88073090 msgr2=0x7f6f88069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 -- 172.21.15.37:0/2556741617 shutdown_connections 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.742+0000 7f6f8d511640 1 -- 172.21.15.37:0/2556741617 wait complete. 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 Processor -- start 2023-07-09T21:23:03.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- start start 2023-07-09T21:23:03.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f880b4340 0x7f6f88152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 0x7f6f880c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f88152b80 con 0x7f6f880b7ab0 2023-07-09T21:23:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880ca950 con 0x7f6f880cef80 2023-07-09T21:23:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f880c9d40 con 0x7f6f880b4340 2023-07-09T21:23:03.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60922/0 (socket says 172.21.15.37:60922) 2023-07-09T21:23:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 -- 172.21.15.37:0/4281004336 learned_addr learned my addr 172.21.15.37:0/4281004336 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f877fe640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 0x7f6f880c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f86ffd640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f880b4340 0x7f6f88152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 -- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f880b4340 msgr2=0x7f6f88152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f880b4340 0x7f6f88152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 -- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 msgr2=0x7f6f880c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 0x7f6f880c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 -- 172.21.15.37:0/4281004336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70009420 con 0x7f6f880b7ab0 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f877fe640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 0x7f6f880c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7ffff640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f70019040 tx=0x7f6f7001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700bf610 con 0x7f6f880b7ab0 2023-07-09T21:23:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700bf790 con 0x7f6f880b7ab0 2023-07-09T21:23:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700bfb40 con 0x7f6f880b7ab0 2023-07-09T21:23:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f880ca020 con 0x7f6f880b7ab0 2023-07-09T21:23:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f880ca5e0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.746+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f880caac0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.750+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f700bfca0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.750+0000 7f6f7f7fe640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 0x7f6f68068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.750+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f7011e3d0 con 0x7f6f880b7ab0 2023-07-09T21:23:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.750+0000 7f6f86ffd640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 0x7f6f68068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.750+0000 7f6f86ffd640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 0x7f6f68068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f780011f0 tx=0x7f6f78009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.754+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f700eb860 con 0x7f6f880b7ab0 2023-07-09T21:23:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:03.966+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f6f8804d7d0 con 0x7f6f880b7ab0 2023-07-09T21:23:04.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.042+0000 7f6f7f7fe640 1 -- 172.21.15.37:0/4281004336 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6f700eee80 con 0x7f6f880b7ab0 2023-07-09T21:23:04.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 msgr2=0x7f6f68068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 0x7f6f68068730 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f780011f0 tx=0x7f6f78009040 comp rx=0 tx=0).stop 2023-07-09T21:23:04.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 msgr2=0x7f6f880c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6f70019040 tx=0x7f6f7001ac70 comp rx=0 tx=0).stop 2023-07-09T21:23:04.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 shutdown_connections 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f68066280 0x7f6f68068730 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f880cef80 0x7f6f880c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f880b7ab0 0x7f6f880c9280 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 --2- 172.21.15.37:0/4281004336 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f880b4340 0x7f6f88152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 >> 172.21.15.37:0/4281004336 conn(0x7f6f88073090 msgr2=0x7f6f88069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 shutdown_connections 2023-07-09T21:23:04.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.046+0000 7f6f8d511640 1 -- 172.21.15.37:0/4281004336 wait complete. 2023-07-09T21:23:04.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:23:04.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 Processor -- start 2023-07-09T21:23:04.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 -- start start 2023-07-09T21:23:04.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faf540b7980 0x7faf54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5415bf80 con 0x7faf540d0780 2023-07-09T21:23:04.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf54160570 con 0x7faf540ceb80 2023-07-09T21:23:04.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf59b74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540cd070 con 0x7faf540b7980 2023-07-09T21:23:04.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf53fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf540d0780 0x7faf540d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53318/0 (socket says 172.21.15.37:53318) 2023-07-09T21:23:04.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf53fff640 1 -- 172.21.15.37:0/4161138570 learned_addr learned my addr 172.21.15.37:0/4161138570 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf537fe640 1 --2- 172.21.15.37:0/4161138570 >> v2:172.21.15.119:3300/0 conn(0x7faf540b7980 0x7faf54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2816251178 0 0) 0x7faf4c0014a0 con 0x7faf540d0780 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf3c003530 con 0x7faf540d0780 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20574759 0 0) 0x7faf48001120 con 0x7faf540ceb80 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf4c0014a0 con 0x7faf540ceb80 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf537fe640 1 -- 172.21.15.37:0/4161138570 >> v1:172.21.15.119:6789/0 conn(0x7faf540ceb80 legacy=0x7faf540cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640194189 0 0) 0x7faf3c003530 con 0x7faf540d0780 2023-07-09T21:23:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf537fe640 1 -- 172.21.15.37:0/4161138570 >> v1:172.21.15.37:6789/0 conn(0x7faf540d0780 legacy=0x7faf540d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.210+0000 7faf537fe640 1 -- 172.21.15.37:0/4161138570 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540d02f0 con 0x7faf540b7980 2023-07-09T21:23:04.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf537fe640 1 --2- 172.21.15.37:0/4161138570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540b7980 0x7faf54160030 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faf440097c0 tx=0x7faf4401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57f6a6122448d9ad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c001b90 con 0x7faf540b7980 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf440a7050 con 0x7faf540b7980 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf527fc640 1 -- 172.21.15.37:0/4161138570 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440ab620 con 0x7faf540b7980 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 -- 172.21.15.37:0/4161138570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540b7980 msgr2=0x7faf54160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 --2- 172.21.15.37:0/4161138570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540b7980 0x7faf54160030 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faf440097c0 tx=0x7faf4401c3a0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 -- 172.21.15.37:0/4161138570 shutdown_connections 2023-07-09T21:23:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 --2- 172.21.15.37:0/4161138570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540b7980 0x7faf54160030 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 -- 172.21.15.37:0/4161138570 >> 172.21.15.37:0/4161138570 conn(0x7faf54073090 msgr2=0x7faf54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 -- 172.21.15.37:0/4161138570 shutdown_connections 2023-07-09T21:23:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.214+0000 7faf59b74640 1 -- 172.21.15.37:0/4161138570 wait complete. 2023-07-09T21:23:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 Processor -- start 2023-07-09T21:23:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 -- start start 2023-07-09T21:23:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf540b7980 0x7faf541481d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 0x7faf5414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5414de70 con 0x7faf540d0780 2023-07-09T21:23:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf54148710 con 0x7faf540ceb80 2023-07-09T21:23:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf59b74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5414d1f0 con 0x7faf540b7980 2023-07-09T21:23:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60930/0 (socket says 172.21.15.37:60930) 2023-07-09T21:23:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 -- 172.21.15.37:0/3326344780 learned_addr learned my addr 172.21.15.37:0/3326344780 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf537fe640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf540b7980 0x7faf541481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf52ffd640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 0x7faf5414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 -- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf540b7980 msgr2=0x7faf541481d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf540b7980 0x7faf541481d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 -- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 msgr2=0x7faf5414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 0x7faf5414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 -- 172.21.15.37:0/3326344780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf44009420 con 0x7faf540d0780 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf52ffd640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 0x7faf5414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.218+0000 7faf53fff640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf4c002150 tx=0x7faf4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c012400 con 0x7faf540d0780 2023-07-09T21:23:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c012560 con 0x7faf540d0780 2023-07-09T21:23:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0128f0 con 0x7faf540d0780 2023-07-09T21:23:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5414d4d0 con 0x7faf540d0780 2023-07-09T21:23:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5414da90 con 0x7faf540d0780 2023-07-09T21:23:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5404d7d0 con 0x7faf540d0780 2023-07-09T21:23:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf4c012a50 con 0x7faf540d0780 2023-07-09T21:23:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 0x7faf40068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faf4c0843a0 con 0x7faf540d0780 2023-07-09T21:23:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.222+0000 7faf537fe640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 0x7faf40068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.226+0000 7faf537fe640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 0x7faf40068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad000 tx=0x7faf440a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.226+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf4c0518b0 con 0x7faf540d0780 2023-07-09T21:23:04.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.382+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7faf5415bf80 con 0x7faf540d0780 2023-07-09T21:23:04.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf3bfff640 1 -- 172.21.15.37:0/3326344780 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf5415bf80 con 0x7faf540d0780 2023-07-09T21:23:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 msgr2=0x7faf40068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 0x7faf40068760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7faf440ad000 tx=0x7faf440a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 msgr2=0x7faf54156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf4c002150 tx=0x7faf4c00a430 comp rx=0 tx=0).stop 2023-07-09T21:23:04.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 shutdown_connections 2023-07-09T21:23:04.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7faf400662b0 0x7faf40068760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf540d0780 0x7faf54156da0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf540ceb80 0x7faf5414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 --2- 172.21.15.37:0/3326344780 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf540b7980 0x7faf541481d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 >> 172.21.15.37:0/3326344780 conn(0x7faf54073090 msgr2=0x7faf5415c960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:04.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 shutdown_connections 2023-07-09T21:23:04.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.386+0000 7faf59b74640 1 -- 172.21.15.37:0/3326344780 wait complete. 2023-07-09T21:23:04.412 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:23:04.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:23:04.476 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:23:04.537 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:23:04.538 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:04.538 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:04.547 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:04.547 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:04.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:04.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 Processor -- start 2023-07-09T21:23:04.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 -- start start 2023-07-09T21:23:04.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f432c0b7ab0 0x7f432c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0cef80 0x7f432c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f432c0b4170 0x7f432c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0b7e80 con 0x7f432c0b4170 2023-07-09T21:23:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f432c0b4610 con 0x7f432c0b7ab0 2023-07-09T21:23:04.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f43321c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c0b49f0 con 0x7f432c0cef80 2023-07-09T21:23:04.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f432c0b4170 0x7f432c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f432c0b4170 0x7f432c15f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60938/0 (socket says 172.21.15.37:60938) 2023-07-09T21:23:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 -- 172.21.15.37:0/2095598160 learned_addr learned my addr 172.21.15.37:0/2095598160 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:04.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432b7fe640 1 --2- 172.21.15.37:0/2095598160 >> v2:172.21.15.119:3300/0 conn(0x7f432c0b7ab0 0x7f432c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432affd640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0cef80 0x7f432c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 -- 172.21.15.37:0/2095598160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0cef80 msgr2=0x7f432c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0cef80 0x7f432c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 -- 172.21.15.37:0/2095598160 >> v2:172.21.15.119:3300/0 conn(0x7f432c0b7ab0 msgr2=0x7f432c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 --2- 172.21.15.37:0/2095598160 >> v2:172.21.15.119:3300/0 conn(0x7f432c0b7ab0 0x7f432c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.778+0000 7f432bfff640 1 -- 172.21.15.37:0/2095598160 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f432c0cc8a0 con 0x7f432c0b4170 2023-07-09T21:23:04.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f432bfff640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b4170 0x7f432c15f490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f432c06b360 tx=0x7f432401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68cf308051b738c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f432a7fc640 1 -- 172.21.15.37:0/2095598160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240a5560 con 0x7f432c0b4170 2023-07-09T21:23:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f432a7fc640 1 -- 172.21.15.37:0/2095598160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43240a56c0 con 0x7f432c0b4170 2023-07-09T21:23:04.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f432a7fc640 1 -- 172.21.15.37:0/2095598160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43240a5a50 con 0x7f432c0b4170 2023-07-09T21:23:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 -- 172.21.15.37:0/2095598160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b4170 msgr2=0x7f432c15f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b4170 0x7f432c15f490 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f432c06b360 tx=0x7f432401c6e0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 -- 172.21.15.37:0/2095598160 shutdown_connections 2023-07-09T21:23:04.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b4170 0x7f432c15f490 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 --2- 172.21.15.37:0/2095598160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0cef80 0x7f432c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 --2- 172.21.15.37:0/2095598160 >> v2:172.21.15.119:3300/0 conn(0x7f432c0b7ab0 0x7f432c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 -- 172.21.15.37:0/2095598160 >> 172.21.15.37:0/2095598160 conn(0x7f432c073090 msgr2=0x7f432c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:04.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 -- 172.21.15.37:0/2095598160 shutdown_connections 2023-07-09T21:23:04.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.782+0000 7f43321c5640 1 -- 172.21.15.37:0/2095598160 wait complete. 2023-07-09T21:23:04.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 Processor -- start 2023-07-09T21:23:04.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- start start 2023-07-09T21:23:04.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0b4170 0x7f432c1f8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 0x7f432c0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1f8ca0 con 0x7f432c0b7ab0 2023-07-09T21:23:04.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c15b120 con 0x7f432c0cef80 2023-07-09T21:23:04.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f432c15ae40 con 0x7f432c0b4170 2023-07-09T21:23:04.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60948/0 (socket says 172.21.15.37:60948) 2023-07-09T21:23:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 -- 172.21.15.37:0/1264613471 learned_addr learned my addr 172.21.15.37:0/1264613471 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432b7fe640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0b4170 0x7f432c1f8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432bfff640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 0x7f432c0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 -- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0b4170 msgr2=0x7f432c1f8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0b4170 0x7f432c1f8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 -- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 msgr2=0x7f432c0b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 0x7f432c0b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 -- 172.21.15.37:0/1264613471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4324009b30 con 0x7f432c0b7ab0 2023-07-09T21:23:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432bfff640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 0x7f432c0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f432affd640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f432000e840 tx=0x7f432000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320009510 con 0x7f432c0b7ab0 2023-07-09T21:23:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f432000ee90 con 0x7f432c0b7ab0 2023-07-09T21:23:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000cb60 con 0x7f432c0b7ab0 2023-07-09T21:23:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c0cae50 con 0x7f432c0b7ab0 2023-07-09T21:23:04.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.786+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c0cb410 con 0x7f432c0b7ab0 2023-07-09T21:23:04.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f432c04d7d0 con 0x7f432c0b7ab0 2023-07-09T21:23:04.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f432000ccc0 con 0x7f432c0b7ab0 2023-07-09T21:23:04.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f4313fff640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 0x7f4318068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:04.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4320083df0 con 0x7f432c0b7ab0 2023-07-09T21:23:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f432b7fe640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 0x7f4318068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.790+0000 7f432b7fe640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 0x7f4318068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f431c009b60 tx=0x7f431c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:04.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.794+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4320054c90 con 0x7f432c0b7ab0 2023-07-09T21:23:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.954+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f432c0c5a60 con 0x7f432c0b7ab0 2023-07-09T21:23:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.954+0000 7f4313fff640 1 -- 172.21.15.37:0/1264613471 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f4320054820 con 0x7f432c0b7ab0 2023-07-09T21:23:04.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:04.960 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 msgr2=0x7f4318068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 0x7f4318068730 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f431c009b60 tx=0x7f431c009190 comp rx=0 tx=0).stop 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 msgr2=0x7f432c15a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f432000e840 tx=0x7f432000ec40 comp rx=0 tx=0).stop 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 shutdown_connections 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4318066280 0x7f4318068730 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f432c0cef80 0x7f432c0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f432c0b7ab0 0x7f432c15a540 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 --2- 172.21.15.37:0/1264613471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f432c0b4170 0x7f432c1f8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 >> 172.21.15.37:0/1264613471 conn(0x7f432c073090 msgr2=0x7f432c0b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 shutdown_connections 2023-07-09T21:23:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:04.958+0000 7f43321c5640 1 -- 172.21.15.37:0/1264613471 wait complete. 2023-07-09T21:23:04.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:04.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 Processor -- start 2023-07-09T21:23:05.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 -- start start 2023-07-09T21:23:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2de80b7980 0x7f2de8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de815bf80 con 0x7f2de80ceb80 2023-07-09T21:23:05.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8160570 con 0x7f2de80d0780 2023-07-09T21:23:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.122+0000 7f2deefac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de80cd070 con 0x7f2de80b7980 2023-07-09T21:23:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2de80ceb80 0x7f2de80cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53334/0 (socket says 172.21.15.37:53334) 2023-07-09T21:23:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 -- 172.21.15.37:0/2998355048 learned_addr learned my addr 172.21.15.37:0/2998355048 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:05.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2decd48640 1 --2- 172.21.15.37:0/2998355048 >> v2:172.21.15.119:3300/0 conn(0x7f2de80b7980 0x7f2de8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160276953 0 0) 0x7f2dd4001120 con 0x7f2de80ceb80 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8003530 con 0x7f2de80ceb80 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413853990 0 0) 0x7f2de00014a0 con 0x7f2de80d0780 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd4001120 con 0x7f2de80d0780 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 978330555 0 0) 0x7f2dd8003530 con 0x7f2de80ceb80 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 >> v2:172.21.15.119:3300/0 conn(0x7f2de80b7980 msgr2=0x7f2de8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 --2- 172.21.15.37:0/2998355048 >> v2:172.21.15.119:3300/0 conn(0x7f2de80b7980 0x7f2de8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 >> v1:172.21.15.119:6789/0 conn(0x7f2de80d0780 legacy=0x7f2de80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80d02f0 con 0x7f2de80ceb80 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2dd4001810 con 0x7f2de80ceb80 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 >> v1:172.21.15.37:6789/0 conn(0x7f2de80ceb80 legacy=0x7f2de80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd8003b10 0x7f2dd8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 0x7f2dd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dd8005180 0x7f2dd800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80cd070 con 0x7f2dd80047d0 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800bfe0 con 0x7f2dd8005180 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800c1a0 con 0x7f2dd8003b10 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 0x7f2dd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2decd48640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd8003b10 0x7f2dd8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2ded549640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dd8005180 0x7f2dd800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 -- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd8003b10 msgr2=0x7f2dd8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd8003b10 0x7f2dd8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 -- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dd8005180 msgr2=0x7f2dd800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2dd8005180 0x7f2dd800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2ded549640 1 -- 172.21.15.37:0/2998355048 reap_dead start 2023-07-09T21:23:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.126+0000 7f2de7fff640 1 -- 172.21.15.37:0/2998355048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8003530 con 0x7f2dd80047d0 2023-07-09T21:23:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2de7fff640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 0x7f2dd8004c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4007fd0 tx=0x7f2dd401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e165a52d2aeb7f58 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40058e0 con 0x7f2dd80047d0 2023-07-09T21:23:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de0002100 con 0x7f2dd80047d0 2023-07-09T21:23:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2de77fe640 1 -- 172.21.15.37:0/2998355048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4005ce0 con 0x7f2dd80047d0 2023-07-09T21:23:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 msgr2=0x7f2dd8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 0x7f2dd8004c40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4007fd0 tx=0x7f2dd401cba0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- 172.21.15.37:0/2998355048 shutdown_connections 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 --2- 172.21.15.37:0/2998355048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2dd80047d0 0x7f2dd8004c40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- 172.21.15.37:0/2998355048 >> 172.21.15.37:0/2998355048 conn(0x7f2de8073090 msgr2=0x7f2de8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- 172.21.15.37:0/2998355048 shutdown_connections 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- 172.21.15.37:0/2998355048 wait complete. 2023-07-09T21:23:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 Processor -- start 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.130+0000 7f2deefac640 1 -- start start 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd80047d0 0x7f2de80c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2de815cbc0 0x7f2de81e6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80c54a0 con 0x7f2de81e7e80 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81e6de0 con 0x7f2de815cbc0 2023-07-09T21:23:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de81e70c0 con 0x7f2dd80047d0 2023-07-09T21:23:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60966/0 (socket says 172.21.15.37:60966) 2023-07-09T21:23:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 -- 172.21.15.37:0/1691112835 learned_addr learned my addr 172.21.15.37:0/1691112835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2decd48640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd80047d0 0x7f2de80c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2de7fff640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2de815cbc0 0x7f2de81e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 -- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd80047d0 msgr2=0x7f2de80c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd80047d0 0x7f2de80c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 -- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2de815cbc0 msgr2=0x7f2de81e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2de815cbc0 0x7f2de81e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 -- 172.21.15.37:0/1691112835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de81e73a0 con 0x7f2de81e7e80 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2ded549640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b1010 tx=0x7f2de0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0014570 con 0x7f2de81e7e80 2023-07-09T21:23:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de00146d0 con 0x7f2de81e7e80 2023-07-09T21:23:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de81e7680 con 0x7f2de81e7e80 2023-07-09T21:23:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de0014a80 con 0x7f2de81e7e80 2023-07-09T21:23:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de81e69b0 con 0x7f2de81e7e80 2023-07-09T21:23:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de804d7d0 con 0x7f2de81e7e80 2023-07-09T21:23:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.134+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2de0014be0 con 0x7f2de81e7e80 2023-07-09T21:23:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.138+0000 7f2de57fa640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 0x7f2dcc068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.138+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2de00860e0 con 0x7f2de81e7e80 2023-07-09T21:23:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.138+0000 7f2decd48640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 0x7f2dcc068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.138+0000 7f2decd48640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 0x7f2dcc068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de804f110 tx=0x7f2ddc009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.142+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2de0053570 con 0x7f2de81e7e80 2023-07-09T21:23:05.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.294+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2de8160570 con 0x7f2de81e7e80 2023-07-09T21:23:05.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2de57fa640 1 -- 172.21.15.37:0/1691112835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2de8160570 con 0x7f2de81e7e80 2023-07-09T21:23:05.302 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:05.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 msgr2=0x7f2dcc068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 0x7f2dcc068760 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2de804f110 tx=0x7f2ddc009190 comp rx=0 tx=0).stop 2023-07-09T21:23:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 msgr2=0x7f2de815e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b1010 tx=0x7f2de0011b00 comp rx=0 tx=0).stop 2023-07-09T21:23:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 shutdown_connections 2023-07-09T21:23:05.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2dcc0662b0 0x7f2dcc068760 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2de81e7e80 0x7f2de815e380 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2de815cbc0 0x7f2de81e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 --2- 172.21.15.37:0/1691112835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2dd80047d0 0x7f2de80c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 >> 172.21.15.37:0/1691112835 conn(0x7f2de8073090 msgr2=0x7f2de80d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 shutdown_connections 2023-07-09T21:23:05.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.298+0000 7f2deefac640 1 -- 172.21.15.37:0/1691112835 wait complete. 2023-07-09T21:23:05.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:05.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.462+0000 7f7e6eb11640 1 Processor -- start 2023-07-09T21:23:05.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.462+0000 7f7e6eb11640 1 -- start start 2023-07-09T21:23:05.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6eb11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6eb11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6eb11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e680c9090 con 0x7f7e680c4350 2023-07-09T21:23:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6eb11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e680c47f0 con 0x7f7e681585b0 2023-07-09T21:23:05.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6eb11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e680cbf40 con 0x7f7e6806b970 2023-07-09T21:23:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6c8ad640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56894/0 (socket says 172.21.15.37:56894) 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e6d0ae640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f7e680c4350 0x7f7e6815c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:48956/0 (socket says 172.21.15.37:48956) 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 -- 172.21.15.37:0/3106321349 learned_addr learned my addr 172.21.15.37:0/3106321349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 -- 172.21.15.37:0/3106321349 >> v2:172.21.15.119:3300/0 conn(0x7f7e681585b0 msgr2=0x7f7e6806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 --2- 172.21.15.37:0/3106321349 >> v2:172.21.15.119:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 -- 172.21.15.37:0/3106321349 >> v1:172.21.15.119:6789/0 conn(0x7f7e680c4350 legacy=0x7f7e6815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e677fe640 1 -- 172.21.15.37:0/3106321349 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783913351 0 0) 0x7f7e680c9090 con 0x7f7e680c4350 2023-07-09T21:23:05.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.466+0000 7f7e67fff640 1 -- 172.21.15.37:0/3106321349 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680c8a60 con 0x7f7e6806b970 2023-07-09T21:23:05.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e67fff640 1 --2- 172.21.15.37:0/3106321349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400bb10 tx=0x7f7e5401ebe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6813f9ee4ed895b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e677fe640 1 -- 172.21.15.37:0/3106321349 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540a7cb0 con 0x7f7e6806b970 2023-07-09T21:23:05.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e677fe640 1 -- 172.21.15.37:0/3106321349 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e540a7e10 con 0x7f7e6806b970 2023-07-09T21:23:05.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e677fe640 1 -- 172.21.15.37:0/3106321349 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e540af660 con 0x7f7e6806b970 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3106321349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 msgr2=0x7f7e680c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3106321349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400bb10 tx=0x7f7e5401ebe0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3106321349 shutdown_connections 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3106321349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e6806b970 0x7f7e680c3e10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3106321349 >> v2:172.21.15.119:3300/0 conn(0x7f7e681585b0 0x7f7e6806b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3106321349 >> 172.21.15.37:0/3106321349 conn(0x7f7e680cde40 msgr2=0x7f7e680ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3106321349 shutdown_connections 2023-07-09T21:23:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3106321349 wait complete. 2023-07-09T21:23:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 Processor -- start 2023-07-09T21:23:05.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.470+0000 7f7e6eb11640 1 -- start start 2023-07-09T21:23:05.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680c4350 0x7f7e68149ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68158c80 con 0x7f7e681585b0 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68159f70 con 0x7f7e6806b970 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e68158ed0 con 0x7f7e680c4350 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6d0ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:53948/0 (socket says 172.21.15.37:53948) 2023-07-09T21:23:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 -- 172.21.15.37:0/3618920957 learned_addr learned my addr 172.21.15.37:0/3618920957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:05.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e67fff640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680c4350 0x7f7e68149ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 -- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680c4350 msgr2=0x7f7e68149ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680c4350 0x7f7e68149ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 -- 172.21.15.37:0/3618920957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 msgr2=0x7f7e6806bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 -- 172.21.15.37:0/3618920957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5400b770 con 0x7f7e6806b970 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6d0ae640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6c8ad640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e930 tx=0x7f7e5c00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c009690 con 0x7f7e6806b970 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c00ca00 con 0x7f7e6806b970 2023-07-09T21:23:05.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5c00cd70 con 0x7f7e6806b970 2023-07-09T21:23:05.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e681591b0 con 0x7f7e6806b970 2023-07-09T21:23:05.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e68159770 con 0x7f7e6806b970 2023-07-09T21:23:05.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.474+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e680cc230 con 0x7f7e6806b970 2023-07-09T21:23:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.478+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e5c013470 con 0x7f7e6806b970 2023-07-09T21:23:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.478+0000 7f7e657fa640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.478+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7e5c083fe0 con 0x7f7e6806b970 2023-07-09T21:23:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.478+0000 7f7e67fff640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.478+0000 7f7e67fff640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 0x7f7e4c068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400bb10 tx=0x7f7e54008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.482+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e5c051530 con 0x7f7e6806b970 2023-07-09T21:23:05.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.638+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e6804d7d0 con 0x7f7e6806b970 2023-07-09T21:23:05.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e657fa640 1 -- 172.21.15.37:0/3618920957 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e5c0170a0 con 0x7f7e6806b970 2023-07-09T21:23:05.645 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 msgr2=0x7f7e4c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 0x7f7e4c068730 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7e5400bb10 tx=0x7f7e54008040 comp rx=0 tx=0).stop 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 msgr2=0x7f7e68146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c00e930 tx=0x7f7e5c00edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 shutdown_connections 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7e4c066280 0x7f7e4c068730 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e681585b0 0x7f7e6806bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e680c4350 0x7f7e68149ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 --2- 172.21.15.37:0/3618920957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e6806b970 0x7f7e68146740 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 >> 172.21.15.37:0/3618920957 conn(0x7f7e680cde40 msgr2=0x7f7e680aca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 shutdown_connections 2023-07-09T21:23:05.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.642+0000 7f7e6eb11640 1 -- 172.21.15.37:0/3618920957 wait complete. 2023-07-09T21:23:05.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.806+0000 7f884bc5c640 1 Processor -- start 2023-07-09T21:23:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.806+0000 7f884bc5c640 1 -- start start 2023-07-09T21:23:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884bc5c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88440b7980 0x7f8844160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884bc5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440d0780 0x7f88440d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884bc5c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884415bf80 con 0x7f88440ceb80 2023-07-09T21:23:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884bc5c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88440cd070 con 0x7f88440b7980 2023-07-09T21:23:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884bc5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440cfd70 con 0x7f88440d0780 2023-07-09T21:23:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88440b7980 0x7f8844160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f88440b7980 0x7f8844160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60976/0 (socket says 172.21.15.37:60976) 2023-07-09T21:23:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 -- 172.21.15.37:0/14765230 learned_addr learned my addr 172.21.15.37:0/14765230 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f884a1f9640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440d0780 0x7f88440d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 -- 172.21.15.37:0/14765230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440d0780 msgr2=0x7f88440d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440d0780 0x7f88440d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 -- 172.21.15.37:0/14765230 >> v1:172.21.15.119:6789/0 conn(0x7f88440ceb80 legacy=0x7f88440cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.810+0000 7f88499f8640 1 -- 172.21.15.37:0/14765230 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844160570 con 0x7f88440b7980 2023-07-09T21:23:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f88499f8640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440b7980 0x7f8844160030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f884001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d01a5feba8706e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f88489f6640 1 -- 172.21.15.37:0/14765230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400ab600 con 0x7f88440b7980 2023-07-09T21:23:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f88489f6640 1 -- 172.21.15.37:0/14765230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400a7050 con 0x7f88440b7980 2023-07-09T21:23:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f88489f6640 1 -- 172.21.15.37:0/14765230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400ab980 con 0x7f88440b7980 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- 172.21.15.37:0/14765230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440b7980 msgr2=0x7f8844160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440b7980 0x7f8844160030 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f884001c500 comp rx=0 tx=0).stop 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- 172.21.15.37:0/14765230 shutdown_connections 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440d0780 0x7f88440d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 --2- 172.21.15.37:0/14765230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440b7980 0x7f8844160030 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- 172.21.15.37:0/14765230 >> 172.21.15.37:0/14765230 conn(0x7f8844073090 msgr2=0x7f8844069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- 172.21.15.37:0/14765230 shutdown_connections 2023-07-09T21:23:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- 172.21.15.37:0/14765230 wait complete. 2023-07-09T21:23:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 Processor -- start 2023-07-09T21:23:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.814+0000 7f884bc5c640 1 -- start start 2023-07-09T21:23:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 0x7f884415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88440d0780 0x7f8844159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8844154110 con 0x7f88440ceb80 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88441472a0 con 0x7f88440d0780 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8844147580 con 0x7f88440b7980 2023-07-09T21:23:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88499f8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 0x7f884415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88499f8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 0x7f884415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56936/0 (socket says 172.21.15.37:56936) 2023-07-09T21:23:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60982/0 (socket says 172.21.15.37:60982) 2023-07-09T21:23:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88499f8640 1 -- 172.21.15.37:0/1702867046 learned_addr learned my addr 172.21.15.37:0/1702867046 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884a1f9640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88440d0780 0x7f8844159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 -- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 msgr2=0x7f884415ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 0x7f884415ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 -- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88440d0780 msgr2=0x7f8844159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88440d0780 0x7f8844159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 -- 172.21.15.37:0/1702867046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400094d0 con 0x7f88440ceb80 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f88491f7640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f883400c3e0 tx=0x7f883400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011790 con 0x7f88440ceb80 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88340118f0 con 0x7f88440ceb80 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8834011ce0 con 0x7f88440ceb80 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8844147860 con 0x7f88440ceb80 2023-07-09T21:23:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884415b380 con 0x7f88440ceb80 2023-07-09T21:23:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884404d7d0 con 0x7f88440ceb80 2023-07-09T21:23:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.818+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f883401c460 con 0x7f88440ceb80 2023-07-09T21:23:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.822+0000 7f883a7fc640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 0x7f8828068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:05.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.822+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8834083b60 con 0x7f88440ceb80 2023-07-09T21:23:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.822+0000 7f88499f8640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 0x7f8828068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.822+0000 7f88499f8640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 0x7f8828068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f8840008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:05.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.826+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8834050ff0 con 0x7f88440ceb80 2023-07-09T21:23:05.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.978+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f884406a800 con 0x7f88440ceb80 2023-07-09T21:23:05.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.978+0000 7f883a7fc640 1 -- 172.21.15.37:0/1702867046 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8834054610 con 0x7f88440ceb80 2023-07-09T21:23:05.985 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 msgr2=0x7f8828068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 0x7f8828068730 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f8840008040 comp rx=0 tx=0).stop 2023-07-09T21:23:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 msgr2=0x7f88441563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f883400c3e0 tx=0x7f883400c8a0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 shutdown_connections 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f8828066280 0x7f8828068730 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88440d0780 0x7f8844159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88440ceb80 0x7f88441563e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 --2- 172.21.15.37:0/1702867046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88440b7980 0x7f884415ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 >> 172.21.15.37:0/1702867046 conn(0x7f8844073090 msgr2=0x7f884415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 shutdown_connections 2023-07-09T21:23:05.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:05.982+0000 7f884bc5c640 1 -- 172.21.15.37:0/1702867046 wait complete. 2023-07-09T21:23:06.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 Processor -- start 2023-07-09T21:23:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 -- start start 2023-07-09T21:23:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f900b7980 0x7f0f90160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 0x7f0f900d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9015bf80 con 0x7f0f900ceb80 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cd070 con 0x7f0f900b7980 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.146+0000 7f0f96b2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cfd70 con 0x7f0f900d0780 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f900b7980 0x7f0f90160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0f900ceb80 0x7f0f900cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53336/0 (socket says 172.21.15.37:53336) 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f900b7980 0x7f0f90160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60986/0 (socket says 172.21.15.37:60986) 2023-07-09T21:23:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8ffff640 1 -- 172.21.15.37:0/132082081 learned_addr learned my addr 172.21.15.37:0/132082081 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f950c9640 1 --2- 172.21.15.37:0/132082081 >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 0x7f0f900d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 -- 172.21.15.37:0/132082081 >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 msgr2=0x7f0f900d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 --2- 172.21.15.37:0/132082081 >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 0x7f0f900d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 -- 172.21.15.37:0/132082081 >> v1:172.21.15.37:6789/0 conn(0x7f0f900ceb80 legacy=0x7f0f900cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 -- 172.21.15.37:0/132082081 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f90160570 con 0x7f0f900b7980 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8f7fe640 1 -- 172.21.15.37:0/132082081 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851454925 0 0) 0x7f0f7c001120 con 0x7f0f900ceb80 2023-07-09T21:23:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f950c9640 1 --2- 172.21.15.37:0/132082081 >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 0x7f0f900d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f948c8640 1 --2- 172.21.15.37:0/132082081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f90160030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b1240 tx=0x7f0f8401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6283852647289c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8f7fe640 1 -- 172.21.15.37:0/132082081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840ab600 con 0x7f0f900b7980 2023-07-09T21:23:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8f7fe640 1 -- 172.21.15.37:0/132082081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f840a7050 con 0x7f0f900b7980 2023-07-09T21:23:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.150+0000 7f0f8f7fe640 1 -- 172.21.15.37:0/132082081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840ab980 con 0x7f0f900b7980 2023-07-09T21:23:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- 172.21.15.37:0/132082081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 msgr2=0x7f0f90160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/132082081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f90160030 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b1240 tx=0x7f0f8401c460 comp rx=0 tx=0).stop 2023-07-09T21:23:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- 172.21.15.37:0/132082081 shutdown_connections 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/132082081 >> v2:172.21.15.119:3300/0 conn(0x7f0f900d0780 0x7f0f900d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/132082081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f90160030 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- 172.21.15.37:0/132082081 >> 172.21.15.37:0/132082081 conn(0x7f0f90073090 msgr2=0x7f0f90069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- 172.21.15.37:0/132082081 shutdown_connections 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- 172.21.15.37:0/132082081 wait complete. 2023-07-09T21:23:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 Processor -- start 2023-07-09T21:23:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- start start 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f900ceb80 0x7f0f901575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 0x7f0f90157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c9380 con 0x7f0f900b7980 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9015a0b0 con 0x7f0f900ceb80 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f96b2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f90151780 con 0x7f0f900d0780 2023-07-09T21:23:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f948c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f948c8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60988/0 (socket says 172.21.15.37:60988) 2023-07-09T21:23:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f948c8640 1 -- 172.21.15.37:0/1748357193 learned_addr learned my addr 172.21.15.37:0/1748357193 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f8ffff640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f900ceb80 0x7f0f901575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.154+0000 7f0f950c9640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 0x7f0f90157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 -- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 msgr2=0x7f0f90157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 0x7f0f90157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 -- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f900ceb80 msgr2=0x7f0f901575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f900ceb80 0x7f0f901575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 -- 172.21.15.37:0/1748357193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84009420 con 0x7f0f900b7980 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f950c9640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 0x7f0f90157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f948c8640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f84019070 tx=0x7f0f84019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84004230 con 0x7f0f900b7980 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84004390 con 0x7f0f900b7980 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84003820 con 0x7f0f900b7980 2023-07-09T21:23:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f90151a60 con 0x7f0f900b7980 2023-07-09T21:23:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f90152020 con 0x7f0f900b7980 2023-07-09T21:23:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9004d7d0 con 0x7f0f900b7980 2023-07-09T21:23:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f840b2040 con 0x7f0f900b7980 2023-07-09T21:23:06.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 0x7f0f74068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f8411d0c0 con 0x7f0f900b7980 2023-07-09T21:23:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.158+0000 7f0f8ffff640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 0x7f0f74068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.162+0000 7f0f8ffff640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 0x7f0f74068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b5710 tx=0x7f0f7c007ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.162+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f840ea550 con 0x7f0f900b7980 2023-07-09T21:23:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f90160570 con 0x7f0f900b7980 2023-07-09T21:23:06.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f8d7fa640 1 -- 172.21.15.37:0/1748357193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f840bc020 con 0x7f0f900b7980 2023-07-09T21:23:06.323 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 msgr2=0x7f0f74068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 0x7f0f74068730 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f900b5710 tx=0x7f0f7c007ba0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 msgr2=0x7f0f901499c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f84019070 tx=0x7f0f84019200 comp rx=0 tx=0).stop 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 shutdown_connections 2023-07-09T21:23:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0f74066280 0x7f0f74068730 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f900d0780 0x7f0f90157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f900ceb80 0x7f0f901575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 --2- 172.21.15.37:0/1748357193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f900b7980 0x7f0f901499c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 >> 172.21.15.37:0/1748357193 conn(0x7f0f90073090 msgr2=0x7f0f9015dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 shutdown_connections 2023-07-09T21:23:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.318+0000 7f0f96b2c640 1 -- 172.21.15.37:0/1748357193 wait complete. 2023-07-09T21:23:06.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.482+0000 7f2f3149c640 1 Processor -- start 2023-07-09T21:23:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.482+0000 7f2f3149c640 1 -- start start 2023-07-09T21:23:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f3149c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2f2c06b740 0x7f2f2c158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f3149c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0b2760 con 0x7f2f2c0707c0 2023-07-09T21:23:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f3149c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c06f010 con 0x7f2f2c157c60 2023-07-09T21:23:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f3149c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c06f2f0 con 0x7f2f2c06b740 2023-07-09T21:23:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f23fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f2c0707c0 0x7f2f2c06b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53344/0 (socket says 172.21.15.37:53344) 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f23fff640 1 -- 172.21.15.37:0/3498051054 learned_addr learned my addr 172.21.15.37:0/3498051054 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2b7fe640 1 --2- 172.21.15.37:0/3498051054 >> v2:172.21.15.119:3300/0 conn(0x7f2f2c06b740 0x7f2f2c158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89478162 0 0) 0x7f2f2c0b2760 con 0x7f2f2c0707c0 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f18004640 con 0x7f2f2c0707c0 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380573305 0 0) 0x7f2f2c06f010 con 0x7f2f2c157c60 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f2c0b2760 con 0x7f2f2c157c60 2023-07-09T21:23:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3498051054 >> v1:172.21.15.119:6789/0 conn(0x7f2f2c157c60 legacy=0x7f2f2c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3498051054 >> v1:172.21.15.37:6789/0 conn(0x7f2f2c0707c0 legacy=0x7f2f2c06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.486+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3498051054 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c06f5d0 con 0x7f2f2c06b740 2023-07-09T21:23:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f2b7fe640 1 --2- 172.21.15.37:0/3498051054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c158030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2401c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edd9889f91cee2b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a58c0 con 0x7f2f2c06b740 2023-07-09T21:23:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240a5a20 con 0x7f2f2c06b740 2023-07-09T21:23:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f2a7fc640 1 -- 172.21.15.37:0/3498051054 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240a5db0 con 0x7f2f2c06b740 2023-07-09T21:23:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- 172.21.15.37:0/3498051054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 msgr2=0x7f2f2c158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3498051054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c158030 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f24009d90 tx=0x7f2f2401c800 comp rx=0 tx=0).stop 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- 172.21.15.37:0/3498051054 shutdown_connections 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3498051054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c158030 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- 172.21.15.37:0/3498051054 >> 172.21.15.37:0/3498051054 conn(0x7f2f2c0694c0 msgr2=0x7f2f2c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- 172.21.15.37:0/3498051054 shutdown_connections 2023-07-09T21:23:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- 172.21.15.37:0/3498051054 wait complete. 2023-07-09T21:23:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 Processor -- start 2023-07-09T21:23:06.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.490+0000 7f2f3149c640 1 -- start start 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c1f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 0x7f2f2c1f93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1f9930 con 0x7f2f2c157c60 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1454f0 con 0x7f2f2c06b740 2023-07-09T21:23:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c144190 con 0x7f2f2c0707c0 2023-07-09T21:23:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32772/0 (socket says 172.21.15.37:32772) 2023-07-09T21:23:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3056101856 learned_addr learned my addr 172.21.15.37:0/3056101856 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f23fff640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 0x7f2f2c1f93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2affd640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c1f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 msgr2=0x7f2f2c1f93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 0x7f2f2c1f93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 msgr2=0x7f2f2c1f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c1f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 -- 172.21.15.37:0/3056101856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f24009a70 con 0x7f2f2c157c60 2023-07-09T21:23:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f23fff640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 0x7f2f2c1f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2affd640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f2b7fe640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2f2401a430 tx=0x7f2f240195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240b9650 con 0x7f2f2c157c60 2023-07-09T21:23:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f240b97b0 con 0x7f2f2c157c60 2023-07-09T21:23:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f240b9b20 con 0x7f2f2c157c60 2023-07-09T21:23:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c144450 con 0x7f2f2c157c60 2023-07-09T21:23:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c144a10 con 0x7f2f2c157c60 2023-07-09T21:23:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.494+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c04d7d0 con 0x7f2f2c157c60 2023-07-09T21:23:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.498+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f240b9c80 con 0x7f2f2c157c60 2023-07-09T21:23:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.498+0000 7f2f237fe640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 0x7f2f0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.498+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f2411efe0 con 0x7f2f2c157c60 2023-07-09T21:23:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.498+0000 7f2f2affd640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 0x7f2f0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.498+0000 7f2f2affd640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 0x7f2f0c068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c001240 tx=0x7f2f1c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.502+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f240ec490 con 0x7f2f2c157c60 2023-07-09T21:23:06.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.666+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2f2c151aa0 con 0x7f2f2c157c60 2023-07-09T21:23:06.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.666+0000 7f2f237fe640 1 -- 172.21.15.37:0/3056101856 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2f240efab0 con 0x7f2f2c157c60 2023-07-09T21:23:06.672 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 msgr2=0x7f2f0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 0x7f2f0c068730 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c001240 tx=0x7f2f1c009040 comp rx=0 tx=0).stop 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 msgr2=0x7f2f2c143c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2f2401a430 tx=0x7f2f240195a0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 shutdown_connections 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f0c066280 0x7f2f0c068730 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f2c157c60 0x7f2f2c143c50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f2c0707c0 0x7f2f2c1f93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 --2- 172.21.15.37:0/3056101856 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f2c06b740 0x7f2f2c1f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 >> 172.21.15.37:0/3056101856 conn(0x7f2f2c0694c0 msgr2=0x7f2f2c14a890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 shutdown_connections 2023-07-09T21:23:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.670+0000 7f2f3149c640 1 -- 172.21.15.37:0/3056101856 wait complete. 2023-07-09T21:23:06.693 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:06.694 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:06.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:06.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 Processor -- start 2023-07-09T21:23:06.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 -- start start 2023-07-09T21:23:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 0x7f098c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f098c0b4340 0x7f098c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c0b49f0 con 0x7f098c0cef80 2023-07-09T21:23:06.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c0b7e80 con 0x7f098c0b4340 2023-07-09T21:23:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f099287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0cc8a0 con 0x7f098c0b7ab0 2023-07-09T21:23:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0983fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f098c0cef80 0x7f098c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53348/0 (socket says 172.21.15.37:53348) 2023-07-09T21:23:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0983fff640 1 -- 172.21.15.37:0/2855487167 learned_addr learned my addr 172.21.15.37:0/2855487167 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:06.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0990e18640 1 --2- 172.21.15.37:0/2855487167 >> v2:172.21.15.37:3300/0 conn(0x7f098c0b4340 0x7f098c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f098bfff640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 0x7f098c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0990e18640 1 -- 172.21.15.37:0/2855487167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 msgr2=0x7f098c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0990e18640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 0x7f098c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0990e18640 1 -- 172.21.15.37:0/2855487167 >> v1:172.21.15.37:6789/0 conn(0x7f098c0cef80 legacy=0x7f098c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f0990e18640 1 -- 172.21.15.37:0/2855487167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0ccb80 con 0x7f098c0b4340 2023-07-09T21:23:06.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f098b7fe640 1 -- 172.21.15.37:0/2855487167 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373493742 0 0) 0x7f098c0b49f0 con 0x7f098c0cef80 2023-07-09T21:23:06.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.882+0000 7f098bfff640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 0x7f098c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:06.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f0990e18640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b4340 0x7f098c0d02a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0984009d90 tx=0x7f098401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477a14e721fd8fb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f098b7fe640 1 -- 172.21.15.37:0/2855487167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840a59e0 con 0x7f098c0b4340 2023-07-09T21:23:06.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f098b7fe640 1 -- 172.21.15.37:0/2855487167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09840a5b40 con 0x7f098c0b4340 2023-07-09T21:23:06.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f098b7fe640 1 -- 172.21.15.37:0/2855487167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840ad440 con 0x7f098c0b4340 2023-07-09T21:23:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 -- 172.21.15.37:0/2855487167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b4340 msgr2=0x7f098c0d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b4340 0x7f098c0d02a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0984009d90 tx=0x7f098401c920 comp rx=0 tx=0).stop 2023-07-09T21:23:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 -- 172.21.15.37:0/2855487167 shutdown_connections 2023-07-09T21:23:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b4340 0x7f098c0d02a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 --2- 172.21.15.37:0/2855487167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0b7ab0 0x7f098c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 -- 172.21.15.37:0/2855487167 >> 172.21.15.37:0/2855487167 conn(0x7f098c073090 msgr2=0x7f098c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 -- 172.21.15.37:0/2855487167 shutdown_connections 2023-07-09T21:23:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.886+0000 7f099287b640 1 -- 172.21.15.37:0/2855487167 wait complete. 2023-07-09T21:23:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 Processor -- start 2023-07-09T21:23:06.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- start start 2023-07-09T21:23:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f098c0b4340 0x7f098c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 0x7f098c0d2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1f74e0 con 0x7f098c0b7ab0 2023-07-09T21:23:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0c9530 con 0x7f098c0b4340 2023-07-09T21:23:06.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c1f76f0 con 0x7f098c0cef80 2023-07-09T21:23:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32790/0 (socket says 172.21.15.37:32790) 2023-07-09T21:23:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 -- 172.21.15.37:0/2767600543 learned_addr learned my addr 172.21.15.37:0/2767600543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0990e18640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 0x7f098c0d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f098bfff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f098c0b4340 0x7f098c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 -- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 msgr2=0x7f098c0d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 0x7f098c0d2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 -- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f098c0b4340 msgr2=0x7f098c14faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f098c0b4340 0x7f098c14faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 -- 172.21.15.37:0/2767600543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009a70 con 0x7f098c0b7ab0 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0990e18640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 0x7f098c0d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f0983fff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f097400c480 tx=0x7f097400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740074e0 con 0x7f098c0b7ab0 2023-07-09T21:23:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974007660 con 0x7f098c0b7ab0 2023-07-09T21:23:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974004a30 con 0x7f098c0b7ab0 2023-07-09T21:23:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c1f79d0 con 0x7f098c0b7ab0 2023-07-09T21:23:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.890+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c1f7f90 con 0x7f098c0b7ab0 2023-07-09T21:23:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c04d7d0 con 0x7f098c0b7ab0 2023-07-09T21:23:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0974004b90 con 0x7f098c0b7ab0 2023-07-09T21:23:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f09897fa640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 0x7f096c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0974082f60 con 0x7f098c0b7ab0 2023-07-09T21:23:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f098bfff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 0x7f096c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.894+0000 7f098bfff640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 0x7f096c068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f097c00a9a0 tx=0x7f097c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:06.898+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0974053e60 con 0x7f098c0b7ab0 2023-07-09T21:23:07.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.058+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f098c158c40 con 0x7f098c0b7ab0 2023-07-09T21:23:07.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.058+0000 7f09897fa640 1 -- 172.21.15.37:0/2767600543 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f0974018020 con 0x7f098c0b7ab0 2023-07-09T21:23:07.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:07.064 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 msgr2=0x7f096c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 0x7f096c068730 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f097c00a9a0 tx=0x7f097c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 msgr2=0x7f098c146350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f097400c480 tx=0x7f097400c940 comp rx=0 tx=0).stop 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 shutdown_connections 2023-07-09T21:23:07.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f096c066280 0x7f096c068730 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f098c0cef80 0x7f098c0d2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f098c0b7ab0 0x7f098c146350 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 --2- 172.21.15.37:0/2767600543 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f098c0b4340 0x7f098c14faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 >> 172.21.15.37:0/2767600543 conn(0x7f098c073090 msgr2=0x7f098c0b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 shutdown_connections 2023-07-09T21:23:07.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.062+0000 7f099287b640 1 -- 172.21.15.37:0/2767600543 wait complete. 2023-07-09T21:23:07.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:07.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:07.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 Processor -- start 2023-07-09T21:23:07.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 -- start start 2023-07-09T21:23:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f04540cf290 0x7f0454160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f045415bf80 con 0x7f04540b7980 2023-07-09T21:23:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04540cd070 con 0x7f04540cf290 2023-07-09T21:23:07.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045bed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540cfd70 con 0x7f04540d0780 2023-07-09T21:23:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.226+0000 7f045a475640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56986/0 (socket says 172.21.15.37:56986) 2023-07-09T21:23:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 -- 172.21.15.37:0/3561719924 learned_addr learned my addr 172.21.15.37:0/3561719924 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:07.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f0459473640 1 --2- 172.21.15.37:0/3561719924 >> v2:172.21.15.119:3300/0 conn(0x7f04540cf290 0x7f0454160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 -- 172.21.15.37:0/3561719924 >> v2:172.21.15.119:3300/0 conn(0x7f04540cf290 msgr2=0x7f0454160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 --2- 172.21.15.37:0/3561719924 >> v2:172.21.15.119:3300/0 conn(0x7f04540cf290 0x7f0454160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 -- 172.21.15.37:0/3561719924 >> v1:172.21.15.119:6789/0 conn(0x7f04540b7980 legacy=0x7f04540ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 -- 172.21.15.37:0/3561719924 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0454160570 con 0x7f04540d0780 2023-07-09T21:23:07.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f045a475640 1 --2- 172.21.15.37:0/3561719924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f044c009e50 tx=0x7f044c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa96348e2c671b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f0458c72640 1 -- 172.21.15.37:0/3561719924 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0a56e0 con 0x7f04540d0780 2023-07-09T21:23:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f0458c72640 1 -- 172.21.15.37:0/3561719924 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044c0a5840 con 0x7f04540d0780 2023-07-09T21:23:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.230+0000 7f0458c72640 1 -- 172.21.15.37:0/3561719924 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044c0a5bd0 con 0x7f04540d0780 2023-07-09T21:23:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- 172.21.15.37:0/3561719924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 msgr2=0x7f04540d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- 172.21.15.37:0/3561719924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f044c009e50 tx=0x7f044c01ca10 comp rx=0 tx=0).stop 2023-07-09T21:23:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- 172.21.15.37:0/3561719924 shutdown_connections 2023-07-09T21:23:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- 172.21.15.37:0/3561719924 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540d0bc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- 172.21.15.37:0/3561719924 >> v2:172.21.15.119:3300/0 conn(0x7f04540cf290 0x7f0454160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- 172.21.15.37:0/3561719924 >> 172.21.15.37:0/3561719924 conn(0x7f0454073090 msgr2=0x7f0454069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- 172.21.15.37:0/3561719924 shutdown_connections 2023-07-09T21:23:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- 172.21.15.37:0/3561719924 wait complete. 2023-07-09T21:23:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 Processor -- start 2023-07-09T21:23:07.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- start start 2023-07-09T21:23:07.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04540b7980 0x7f045415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04540b3c80 con 0x7f04540cf290 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045415a670 con 0x7f04540b7980 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045bed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04540c61f0 con 0x7f04540d0780 2023-07-09T21:23:07.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32804/0 (socket says 172.21.15.37:32804) 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 -- 172.21.15.37:0/3168984280 learned_addr learned my addr 172.21.15.37:0/3168984280 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045a475640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459c74640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04540b7980 0x7f045415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 -- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 msgr2=0x7f04540b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 -- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04540b7980 msgr2=0x7f045415cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04540b7980 0x7f045415cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 -- 172.21.15.37:0/3168984280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c009b30 con 0x7f04540cf290 2023-07-09T21:23:07.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f045a475640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.234+0000 7f0459473640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f044400e930 tx=0x7f044400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0444009690 con 0x7f04540cf290 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044400ca00 con 0x7f04540cf290 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044400cdb0 con 0x7f04540cf290 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f045415d1e0 con 0x7f04540cf290 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f045415a300 con 0x7f04540cf290 2023-07-09T21:23:07.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045415a820 con 0x7f04540cf290 2023-07-09T21:23:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0444013470 con 0x7f04540cf290 2023-07-09T21:23:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0444083f40 con 0x7f04540cf290 2023-07-09T21:23:07.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.238+0000 7f0459c74640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.242+0000 7f0459c74640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0454153ab0 tx=0x7f0450009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.242+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f045415a820 con 0x7f04540cf290 2023-07-09T21:23:07.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f045415a820 con 0x7f04540cf290 2023-07-09T21:23:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f044a7fc640 1 -- 172.21.15.37:0/3168984280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f045415a820 con 0x7f04540cf290 2023-07-09T21:23:07.402 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:07.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 msgr2=0x7f0438068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 0x7f0438068730 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0454153ab0 tx=0x7f0450009040 comp rx=0 tx=0).stop 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 msgr2=0x7f04540c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f044400e930 tx=0x7f044400edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 shutdown_connections 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0438066280 0x7f0438068730 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04540d0780 0x7f04540b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04540cf290 0x7f04540c5cb0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 --2- 172.21.15.37:0/3168984280 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04540b7980 0x7f045415cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 >> 172.21.15.37:0/3168984280 conn(0x7f0454073090 msgr2=0x7f0454155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 shutdown_connections 2023-07-09T21:23:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.398+0000 7f045bed8640 1 -- 172.21.15.37:0/3168984280 wait complete. 2023-07-09T21:23:07.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.562+0000 7fd710a56640 1 Processor -- start 2023-07-09T21:23:07.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.562+0000 7fd710a56640 1 -- start start 2023-07-09T21:23:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd710a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd70c159990 0x7fd70c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd710a56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd70c0c99e0 0x7fd70c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd710a56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70c0c4c90 con 0x7fd70c1595c0 2023-07-09T21:23:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd710a56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0ca730 con 0x7fd70c0c99e0 2023-07-09T21:23:07.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd710a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70c0ca170 con 0x7fd70c159990 2023-07-09T21:23:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd70c0c99e0 0x7fd70c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd70c1595c0 0x7fd70c15dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46866/0 (socket says 172.21.15.37:46866) 2023-07-09T21:23:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd70c0c99e0 0x7fd70c0cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37918/0 (socket says 172.21.15.37:37918) 2023-07-09T21:23:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70a59c640 1 -- 172.21.15.37:0/3712144532 learned_addr learned my addr 172.21.15.37:0/3712144532 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd703fff640 1 --2- 172.21.15.37:0/3712144532 >> v2:172.21.15.119:3300/0 conn(0x7fd70c159990 0x7fd70c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 -- 172.21.15.37:0/3712144532 >> v2:172.21.15.119:3300/0 conn(0x7fd70c159990 msgr2=0x7fd70c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 --2- 172.21.15.37:0/3712144532 >> v2:172.21.15.119:3300/0 conn(0x7fd70c159990 0x7fd70c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 -- 172.21.15.37:0/3712144532 >> v1:172.21.15.37:6789/0 conn(0x7fd70c1595c0 legacy=0x7fd70c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.566+0000 7fd70ad9d640 1 -- 172.21.15.37:0/3712144532 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0ca450 con 0x7fd70c0c99e0 2023-07-09T21:23:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd70ad9d640 1 --2- 172.21.15.37:0/3712144532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0cd300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06e8c0 tx=0x7fd70401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284747349e0b1f4a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd709d9b640 1 -- 172.21.15.37:0/3712144532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040a58b0 con 0x7fd70c0c99e0 2023-07-09T21:23:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd709d9b640 1 -- 172.21.15.37:0/3712144532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7040a5a10 con 0x7fd70c0c99e0 2023-07-09T21:23:07.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd709d9b640 1 -- 172.21.15.37:0/3712144532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040a5da0 con 0x7fd70c0c99e0 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- 172.21.15.37:0/3712144532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c0c99e0 msgr2=0x7fd70c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 --2- 172.21.15.37:0/3712144532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0cd300 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd70c06e8c0 tx=0x7fd70401c8e0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- 172.21.15.37:0/3712144532 shutdown_connections 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 --2- 172.21.15.37:0/3712144532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0cd300 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 --2- 172.21.15.37:0/3712144532 >> v2:172.21.15.119:3300/0 conn(0x7fd70c159990 0x7fd70c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- 172.21.15.37:0/3712144532 >> 172.21.15.37:0/3712144532 conn(0x7fd70c0cde40 msgr2=0x7fd70c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- 172.21.15.37:0/3712144532 shutdown_connections 2023-07-09T21:23:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- 172.21.15.37:0/3712144532 wait complete. 2023-07-09T21:23:07.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 Processor -- start 2023-07-09T21:23:07.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.569+0000 7fd710a56640 1 -- start start 2023-07-09T21:23:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd70c1595c0 0x7fd70c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0b1610 con 0x7fd70c159990 2023-07-09T21:23:07.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c1f81a0 con 0x7fd70c0c99e0 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c0c5f00 con 0x7fd70c1595c0 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37920/0 (socket says 172.21.15.37:37920) 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 -- 172.21.15.37:0/4014881466 learned_addr learned my addr 172.21.15.37:0/4014881466 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd703fff640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd70c1595c0 0x7fd70c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70a59c640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 -- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd70c1595c0 msgr2=0x7fd70c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd70c1595c0 0x7fd70c0c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 -- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd70c0c99e0 msgr2=0x7fd70c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 -- 172.21.15.37:0/4014881466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009a70 con 0x7fd70c159990 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd70ad9d640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7040b0040 tx=0x7fd704019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040b9860 con 0x7fd70c159990 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7040b99c0 con 0x7fd70c159990 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040b9d70 con 0x7fd70c159990 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c157760 con 0x7fd70c159990 2023-07-09T21:23:07.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c0b1b40 con 0x7fd70c159990 2023-07-09T21:23:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c04d7d0 con 0x7fd70c159990 2023-07-09T21:23:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.573+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7040ad440 con 0x7fd70c159990 2023-07-09T21:23:07.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.577+0000 7fd702ffd640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 0x7fd6ec068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.577+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd70411ef90 con 0x7fd70c159990 2023-07-09T21:23:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.577+0000 7fd70a59c640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 0x7fd6ec068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.577+0000 7fd70a59c640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 0x7fd6ec068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005890 tx=0x7fd6fc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.581+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7040ec5d0 con 0x7fd70c159990 2023-07-09T21:23:07.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd70c0c7c50 con 0x7fd70c159990 2023-07-09T21:23:07.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd702ffd640 1 -- 172.21.15.37:0/4014881466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd7040efbf0 con 0x7fd70c159990 2023-07-09T21:23:07.739 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 msgr2=0x7fd6ec068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 0x7fd6ec068760 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005890 tx=0x7fd6fc009040 comp rx=0 tx=0).stop 2023-07-09T21:23:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 msgr2=0x7fd70c15c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd7040b0040 tx=0x7fd704019680 comp rx=0 tx=0).stop 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 shutdown_connections 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd6ec0662b0 0x7fd6ec068760 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd70c159990 0x7fd70c15c1c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd70c1595c0 0x7fd70c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 --2- 172.21.15.37:0/4014881466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd70c0c99e0 0x7fd70c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 >> 172.21.15.37:0/4014881466 conn(0x7fd70c0cde40 msgr2=0x7fd70c163c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 shutdown_connections 2023-07-09T21:23:07.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.733+0000 7fd710a56640 1 -- 172.21.15.37:0/4014881466 wait complete. 2023-07-09T21:23:07.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 Processor -- start 2023-07-09T21:23:07.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 -- start start 2023-07-09T21:23:07.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 0x7f595c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f595c0c99e0 0x7f595c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f595c0c4c90 con 0x7f595c1595c0 2023-07-09T21:23:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0ca730 con 0x7f595c0c99e0 2023-07-09T21:23:07.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f5964419640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595c0ca170 con 0x7f595c159990 2023-07-09T21:23:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f595c0c99e0 0x7f595c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f595c0c99e0 0x7f595c0cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37934/0 (socket says 172.21.15.37:37934) 2023-07-09T21:23:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 -- 172.21.15.37:0/3279046020 learned_addr learned my addr 172.21.15.37:0/3279046020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:07.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59619b4640 1 --2- 172.21.15.37:0/3279046020 >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 0x7f595c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 -- 172.21.15.37:0/3279046020 >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 msgr2=0x7f595c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 --2- 172.21.15.37:0/3279046020 >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 0x7f595c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 -- 172.21.15.37:0/3279046020 >> v1:172.21.15.119:6789/0 conn(0x7f595c1595c0 legacy=0x7f595c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59629b6640 1 -- 172.21.15.37:0/3279046020 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f595c0ca450 con 0x7f595c0c99e0 2023-07-09T21:23:07.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.901+0000 7f59619b4640 1 --2- 172.21.15.37:0/3279046020 >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 0x7f595c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f59629b6640 1 --2- 172.21.15.37:0/3279046020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c0c99e0 0x7f595c0cd300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f595c06e8c0 tx=0x7f595401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7925a5454a898 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f59611b3640 1 -- 172.21.15.37:0/3279046020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540a5770 con 0x7f595c0c99e0 2023-07-09T21:23:07.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f59611b3640 1 -- 172.21.15.37:0/3279046020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540a58d0 con 0x7f595c0c99e0 2023-07-09T21:23:07.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f59611b3640 1 -- 172.21.15.37:0/3279046020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540a5c60 con 0x7f595c0c99e0 2023-07-09T21:23:07.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 -- 172.21.15.37:0/3279046020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c0c99e0 msgr2=0x7f595c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 --2- 172.21.15.37:0/3279046020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c0c99e0 0x7f595c0cd300 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f595c06e8c0 tx=0x7f595401c9a0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 -- 172.21.15.37:0/3279046020 shutdown_connections 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 --2- 172.21.15.37:0/3279046020 >> v2:172.21.15.119:3300/0 conn(0x7f595c159990 0x7f595c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 --2- 172.21.15.37:0/3279046020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c0c99e0 0x7f595c0cd300 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 -- 172.21.15.37:0/3279046020 >> 172.21.15.37:0/3279046020 conn(0x7f595c0cde40 msgr2=0x7f595c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 -- 172.21.15.37:0/3279046020 shutdown_connections 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.905+0000 7f5964419640 1 -- 172.21.15.37:0/3279046020 wait complete. 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 Processor -- start 2023-07-09T21:23:07.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- start start 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 0x7f595c151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 0x7f595c1587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c7730 con 0x7f595c159990 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0b1bc0 con 0x7f595c0c99e0 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f595c0c6b20 con 0x7f595c1595c0 2023-07-09T21:23:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37942/0 (socket says 172.21.15.37:37942) 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 -- 172.21.15.37:0/788507693 learned_addr learned my addr 172.21.15.37:0/788507693 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59621b5640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 0x7f595c151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59619b4640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 0x7f595c1587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 -- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 msgr2=0x7f595c1587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 0x7f595c1587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 -- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 msgr2=0x7f595c151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 0x7f595c151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 -- 172.21.15.37:0/788507693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009b30 con 0x7f595c159990 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59619b4640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 0x7f595c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59621b5640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 0x7f595c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f59629b6640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59540af040 tx=0x7f5954019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540b8670 con 0x7f595c159990 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540b87d0 con 0x7f595c159990 2023-07-09T21:23:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f595c0c6e00 con 0x7f595c159990 2023-07-09T21:23:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540b8b60 con 0x7f595c159990 2023-07-09T21:23:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f595c0c73c0 con 0x7f595c159990 2023-07-09T21:23:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.909+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595c156970 con 0x7f595c159990 2023-07-09T21:23:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.913+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f59540b8cc0 con 0x7f595c159990 2023-07-09T21:23:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.913+0000 7f5952ffd640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 0x7f5940068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.913+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f595411f460 con 0x7f595c159990 2023-07-09T21:23:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.913+0000 7f59621b5640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 0x7f5940068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.913+0000 7f59621b5640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 0x7f5940068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5958000f70 tx=0x7f5958009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:07.917+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f595c156970 con 0x7f595c159990 2023-07-09T21:23:08.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.073+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f595c156970 con 0x7f595c159990 2023-07-09T21:23:08.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.073+0000 7f5952ffd640 1 -- 172.21.15.37:0/788507693 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f595c156970 con 0x7f595c159990 2023-07-09T21:23:08.080 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 msgr2=0x7f5940068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 0x7f5940068730 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5958000f70 tx=0x7f5958009040 comp rx=0 tx=0).stop 2023-07-09T21:23:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 msgr2=0x7f595c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f59540af040 tx=0x7f5954019740 comp rx=0 tx=0).stop 2023-07-09T21:23:08.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 shutdown_connections 2023-07-09T21:23:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5940066280 0x7f5940068730 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f595c159990 0x7f595c0b0d90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f595c1595c0 0x7f595c1587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 --2- 172.21.15.37:0/788507693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f595c0c99e0 0x7f595c151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 >> 172.21.15.37:0/788507693 conn(0x7f595c0cde40 msgr2=0x7f595c1522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:08.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 shutdown_connections 2023-07-09T21:23:08.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.077+0000 7f5964419640 1 -- 172.21.15.37:0/788507693 wait complete. 2023-07-09T21:23:08.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:08.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 Processor -- start 2023-07-09T21:23:08.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 -- start start 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38a40b7980 0x7f38a4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a415bf80 con 0x7f38a40d0780 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a4160570 con 0x7f38a40ceb80 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38ac09c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a40cd070 con 0x7f38a40b7980 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38a9e38640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38a40b7980 0x7f38a4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38aa639640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f38a40d0780 0x7f38a40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46872/0 (socket says 172.21.15.37:46872) 2023-07-09T21:23:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38aa639640 1 -- 172.21.15.37:0/126032091 learned_addr learned my addr 172.21.15.37:0/126032091 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:08.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38a9e38640 1 -- 172.21.15.37:0/126032091 >> v1:172.21.15.119:6789/0 conn(0x7f38a40ceb80 legacy=0x7f38a40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38a9e38640 1 -- 172.21.15.37:0/126032091 >> v1:172.21.15.37:6789/0 conn(0x7f38a40d0780 legacy=0x7f38a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38a9e38640 1 -- 172.21.15.37:0/126032091 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a40d02f0 con 0x7f38a40b7980 2023-07-09T21:23:08.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.241+0000 7f38a8e36640 1 -- 172.21.15.37:0/126032091 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 793346806 0 0) 0x7f389c0014a0 con 0x7f38a40d0780 2023-07-09T21:23:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38a9e38640 1 --2- 172.21.15.37:0/126032091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40b7980 0x7f38a4160030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097c0 tx=0x7f38a001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=897fff2b3e951c03 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38a8e36640 1 -- 172.21.15.37:0/126032091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00ab600 con 0x7f38a40b7980 2023-07-09T21:23:08.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38a8e36640 1 -- 172.21.15.37:0/126032091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a00a7050 con 0x7f38a40b7980 2023-07-09T21:23:08.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38a8e36640 1 -- 172.21.15.37:0/126032091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a00ab980 con 0x7f38a40b7980 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 -- 172.21.15.37:0/126032091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40b7980 msgr2=0x7f38a4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 --2- 172.21.15.37:0/126032091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40b7980 0x7f38a4160030 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f38a00097c0 tx=0x7f38a001c480 comp rx=0 tx=0).stop 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 -- 172.21.15.37:0/126032091 shutdown_connections 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 --2- 172.21.15.37:0/126032091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40b7980 0x7f38a4160030 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 -- 172.21.15.37:0/126032091 >> 172.21.15.37:0/126032091 conn(0x7f38a4073090 msgr2=0x7f38a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:08.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 -- 172.21.15.37:0/126032091 shutdown_connections 2023-07-09T21:23:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.245+0000 7f38ac09c640 1 -- 172.21.15.37:0/126032091 wait complete. 2023-07-09T21:23:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 Processor -- start 2023-07-09T21:23:08.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- start start 2023-07-09T21:23:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 0x7f38a40b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 0x7f38a41533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40b3260 con 0x7f38a40ceb80 2023-07-09T21:23:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40c7fe0 con 0x7f38a40d0780 2023-07-09T21:23:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a40c82b0 con 0x7f38a40b7980 2023-07-09T21:23:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37964/0 (socket says 172.21.15.37:37964) 2023-07-09T21:23:08.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 -- 172.21.15.37:0/4041166183 learned_addr learned my addr 172.21.15.37:0/4041166183 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38aa639640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 0x7f38a41533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9e38640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 0x7f38a40b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 -- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 msgr2=0x7f38a40b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 0x7f38a40b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 -- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 msgr2=0x7f38a41533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 0x7f38a41533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 -- 172.21.15.37:0/4041166183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a0009420 con 0x7f38a40ceb80 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38aa639640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 0x7f38a41533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:08.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9e38640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 0x7f38a40b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38a9637640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f389400c500 tx=0x7f389400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894005220 con 0x7f38a40ceb80 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3894005380 con 0x7f38a40ceb80 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3894007270 con 0x7f38a40ceb80 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a40c8590 con 0x7f38a40ceb80 2023-07-09T21:23:08.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.249+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a40b2b10 con 0x7f38a40ceb80 2023-07-09T21:23:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a40b3410 con 0x7f38a40ceb80 2023-07-09T21:23:08.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38940073d0 con 0x7f38a40ceb80 2023-07-09T21:23:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f389a7fc640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 0x7f3888068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f38940834d0 con 0x7f38a40ceb80 2023-07-09T21:23:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f38a9e38640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 0x7f3888068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.253+0000 7f38a9e38640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 0x7f3888068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38a00ad000 tx=0x7f38a00a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.257+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38a40b3410 con 0x7f38a40ceb80 2023-07-09T21:23:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.409+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38a4160570 con 0x7f38a40ceb80 2023-07-09T21:23:08.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.409+0000 7f389a7fc640 1 -- 172.21.15.37:0/4041166183 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38a4160570 con 0x7f38a40ceb80 2023-07-09T21:23:08.418 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:08.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 msgr2=0x7f3888068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 0x7f3888068760 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f38a00ad000 tx=0x7f38a00a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 msgr2=0x7f38a40c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f389400c500 tx=0x7f389400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 shutdown_connections 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f38880662b0 0x7f3888068760 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38a40d0780 0x7f38a41533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38a40ceb80 0x7f38a40c7aa0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 --2- 172.21.15.37:0/4041166183 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38a40b7980 0x7f38a40b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 >> 172.21.15.37:0/4041166183 conn(0x7f38a4073090 msgr2=0x7f38a40d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 shutdown_connections 2023-07-09T21:23:08.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.413+0000 7f38ac09c640 1 -- 172.21.15.37:0/4041166183 wait complete. 2023-07-09T21:23:08.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:08.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.577+0000 7fe0a2140640 1 Processor -- start 2023-07-09T21:23:08.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.577+0000 7fe0a2140640 1 -- start start 2023-07-09T21:23:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 0x7fe09c070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c06b810 0x7fe09c06bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c1566f0 con 0x7fe09c06b810 2023-07-09T21:23:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c06c1f0 con 0x7fe09c070120 2023-07-09T21:23:08.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe0a2140640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1592f0 con 0x7fe09c156320 2023-07-09T21:23:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c06b810 0x7fe09c06bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe09c06b810 0x7fe09c06bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37976/0 (socket says 172.21.15.37:37976) 2023-07-09T21:23:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 -- 172.21.15.37:0/285650335 learned_addr learned my addr 172.21.15.37:0/285650335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09affd640 1 --2- 172.21.15.37:0/285650335 >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 0x7fe09c070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09b7fe640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 -- 172.21.15.37:0/285650335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 msgr2=0x7fe09c159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 -- 172.21.15.37:0/285650335 >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 msgr2=0x7fe09c070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 --2- 172.21.15.37:0/285650335 >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 0x7fe09c070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09bfff640 1 -- 172.21.15.37:0/285650335 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c070b50 con 0x7fe09c06b810 2023-07-09T21:23:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.581+0000 7fe09affd640 1 --2- 172.21.15.37:0/285650335 >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 0x7fe09c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe09bfff640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06b810 0x7fe09c06bcb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe09c071240 tx=0x7fe09401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9d6f70a18b21bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe09a7fc640 1 -- 172.21.15.37:0/285650335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940a5820 con 0x7fe09c06b810 2023-07-09T21:23:08.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe09a7fc640 1 -- 172.21.15.37:0/285650335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0940a5980 con 0x7fe09c06b810 2023-07-09T21:23:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe09a7fc640 1 -- 172.21.15.37:0/285650335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940a5d10 con 0x7fe09c06b810 2023-07-09T21:23:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- 172.21.15.37:0/285650335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06b810 msgr2=0x7fe09c06bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06b810 0x7fe09c06bcb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe09c071240 tx=0x7fe09401c9a0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- 172.21.15.37:0/285650335 shutdown_connections 2023-07-09T21:23:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c06b810 0x7fe09c06bcb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 --2- 172.21.15.37:0/285650335 >> v2:172.21.15.119:3300/0 conn(0x7fe09c070120 0x7fe09c070550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 --2- 172.21.15.37:0/285650335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- 172.21.15.37:0/285650335 >> 172.21.15.37:0/285650335 conn(0x7fe09c0694c0 msgr2=0x7fe09c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- 172.21.15.37:0/285650335 shutdown_connections 2023-07-09T21:23:08.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- 172.21.15.37:0/285650335 wait complete. 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 Processor -- start 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.585+0000 7fe0a2140640 1 -- start start 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe09c06b810 0x7fe09c149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0a88d0 con 0x7fe09c070120 2023-07-09T21:23:08.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c149ec0 con 0x7fe09c06b810 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c14ec90 con 0x7fe09c156320 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37990/0 (socket says 172.21.15.37:37990) 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 -- 172.21.15.37:0/3987320840 learned_addr learned my addr 172.21.15.37:0/3987320840 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09b7fe640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe09c06b810 0x7fe09c149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09bfff640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 -- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 msgr2=0x7fe09c14e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c14e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 -- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe09c06b810 msgr2=0x7fe09c149980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe09c06b810 0x7fe09c149980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 -- 172.21.15.37:0/3987320840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009b30 con 0x7fe09c070120 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe09affd640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e840 tx=0x7fe09000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090004030 con 0x7fe09c070120 2023-07-09T21:23:08.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe090004190 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c14ef70 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe090004520 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c14f530 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c0a8a10 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.589+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe09000c6d0 con 0x7fe09c070120 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.593+0000 7fe083fff640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 0x7fe088068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:08.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.593+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe090083810 con 0x7fe09c070120 2023-07-09T21:23:08.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.593+0000 7fe09b7fe640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 0x7fe088068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:08.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.593+0000 7fe09b7fe640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 0x7fe088068760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe09c158420 tx=0x7fe08c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:08.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.597+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe09c0a8a10 con 0x7fe09c070120 2023-07-09T21:23:08.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.761+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe09c0a8a10 con 0x7fe09c070120 2023-07-09T21:23:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.761+0000 7fe083fff640 1 -- 172.21.15.37:0/3987320840 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe09c0a8a10 con 0x7fe09c070120 2023-07-09T21:23:08.768 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:08.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 msgr2=0x7fe088068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 0x7fe088068760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe09c158420 tx=0x7fe08c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:08.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 msgr2=0x7fe09c14e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:08.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe09000e840 tx=0x7fe09000ed00 comp rx=0 tx=0).stop 2023-07-09T21:23:08.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 shutdown_connections 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe0880662b0 0x7fe088068760 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe09c156320 0x7fe09c14e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe09c070120 0x7fe09c14e140 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 --2- 172.21.15.37:0/3987320840 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe09c06b810 0x7fe09c149980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 >> 172.21.15.37:0/3987320840 conn(0x7fe09c0694c0 msgr2=0x7fe09c156900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 shutdown_connections 2023-07-09T21:23:08.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:08.765+0000 7fe0a2140640 1 -- 172.21.15.37:0/3987320840 wait complete. 2023-07-09T21:23:08.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:23:08.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:08.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:08.824 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:08.824 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:23:08.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:08.825 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:23:08.882 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:08.882 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:08.893 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:08.894 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:08.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:09.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 Processor -- start 2023-07-09T21:23:09.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 -- start start 2023-07-09T21:23:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f986c0b4340 0x7f986c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f986c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9870b96640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f986c0b7ab0 0x7f986c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46876/0 (socket says 172.21.15.37:46876) 2023-07-09T21:23:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9870b96640 1 -- 172.21.15.37:0/1440624867 learned_addr learned my addr 172.21.15.37:0/1440624867 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:09.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986c0b49f0 con 0x7f986c0b7ab0 2023-07-09T21:23:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f986c0b7e80 con 0x7f986c0b4340 2023-07-09T21:23:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0cc8a0 con 0x7f986c0cef80 2023-07-09T21:23:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 674006052 0 0) 0x7f986c0b49f0 con 0x7f986c0b7ab0 2023-07-09T21:23:09.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f985c003530 con 0x7f986c0b7ab0 2023-07-09T21:23:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986bfff640 1 --2- 172.21.15.37:0/1440624867 >> v2:172.21.15.119:3300/0 conn(0x7f986c0b4340 0x7f986c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f986c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2430247662 0 0) 0x7f985c003530 con 0x7f986c0b7ab0 2023-07-09T21:23:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 msgr2=0x7f986c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f986c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 >> v2:172.21.15.119:3300/0 conn(0x7f986c0b4340 msgr2=0x7f986c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:09.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 --2- 172.21.15.37:0/1440624867 >> v2:172.21.15.119:3300/0 conn(0x7f986c0b4340 0x7f986c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c0ccb80 con 0x7f986c0b7ab0 2023-07-09T21:23:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f9860001680 con 0x7f986c0b7ab0 2023-07-09T21:23:09.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 >> v1:172.21.15.37:6789/0 conn(0x7f986c0b7ab0 legacy=0x7f986c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c003980 0x7f985c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f985c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f985c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c0cc8a0 con 0x7f985c004d10 2023-07-09T21:23:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c00ba40 con 0x7f985c003980 2023-07-09T21:23:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c00bbb0 con 0x7f986c0cef80 2023-07-09T21:23:09.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f985c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9870b96640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c003980 0x7f985c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f986bfff640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f985c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 -- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 msgr2=0x7f985c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:09.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cef80 0x7f985c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 -- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c003980 msgr2=0x7f985c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:09.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f985c003980 0x7f985c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.085+0000 7f9871397640 1 -- 172.21.15.37:0/1440624867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c003530 con 0x7f985c004d10 2023-07-09T21:23:09.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9871397640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f985c005180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9864007330 tx=0x7f986401ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7acdbd6cc7694eb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640a5d00 con 0x7f985c004d10 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98640a5e60 con 0x7f985c004d10 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f986b7fe640 1 -- 172.21.15.37:0/1440624867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98640ad660 con 0x7f985c004d10 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 msgr2=0x7f985c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 --2- 172.21.15.37:0/1440624867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f985c005180 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9864007330 tx=0x7f986401ce00 comp rx=0 tx=0).stop 2023-07-09T21:23:09.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9871397640 1 -- 172.21.15.37:0/1440624867 reap_dead start 2023-07-09T21:23:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 shutdown_connections 2023-07-09T21:23:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 >> 172.21.15.37:0/1440624867 conn(0x7f986c073090 msgr2=0x7f986c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 shutdown_connections 2023-07-09T21:23:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.089+0000 7f9872dfa640 1 -- 172.21.15.37:0/1440624867 wait complete. 2023-07-09T21:23:09.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 Processor -- start 2023-07-09T21:23:09.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- start start 2023-07-09T21:23:09.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 0x7f986c159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 0x7f986c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15b570 con 0x7f985c004d10 2023-07-09T21:23:09.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15b7e0 con 0x7f986c15c5a0 2023-07-09T21:23:09.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986c15bac0 con 0x7f986c0cb700 2023-07-09T21:23:09.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38004/0 (socket says 172.21.15.37:38004) 2023-07-09T21:23:09.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 -- 172.21.15.37:0/457923797 learned_addr learned my addr 172.21.15.37:0/457923797 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:09.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f986bfff640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 0x7f986c159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 -- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 msgr2=0x7f986c159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9871397640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 0x7f986c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 0x7f986c159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 -- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 msgr2=0x7f986c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 0x7f986c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 -- 172.21.15.37:0/457923797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986c15bda0 con 0x7f985c004d10 2023-07-09T21:23:09.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f986bfff640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 0x7f986c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:09.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9871397640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 0x7f986c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:09.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9870b96640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9860007310 tx=0x7f98600077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986000f9c0 con 0x7f985c004d10 2023-07-09T21:23:09.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986000fb40 con 0x7f985c004d10 2023-07-09T21:23:09.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600133f0 con 0x7f985c004d10 2023-07-09T21:23:09.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986c15c080 con 0x7f985c004d10 2023-07-09T21:23:09.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.093+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986c15ca10 con 0x7f985c004d10 2023-07-09T21:23:09.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986c04d7d0 con 0x7f985c004d10 2023-07-09T21:23:09.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9860013550 con 0x7f985c004d10 2023-07-09T21:23:09.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f98697fa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 0x7f9850068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9860083fe0 con 0x7f985c004d10 2023-07-09T21:23:09.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f986bfff640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 0x7f9850068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.097+0000 7f986bfff640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 0x7f9850068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f986c0cb670 tx=0x7f9858008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.101+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98600513c0 con 0x7f985c004d10 2023-07-09T21:23:09.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.257+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f986c0cbe70 con 0x7f985c004d10 2023-07-09T21:23:09.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.257+0000 7f98697fa640 1 -- 172.21.15.37:0/457923797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f98600549e0 con 0x7f985c004d10 2023-07-09T21:23:09.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:09.264 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:22:32.822581+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:09.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 msgr2=0x7f9850068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 0x7f9850068760 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f986c0cb670 tx=0x7f9858008040 comp rx=0 tx=0).stop 2023-07-09T21:23:09.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 msgr2=0x7f986c15f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9860007310 tx=0x7f98600077d0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 shutdown_connections 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98500662b0 0x7f9850068760 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f986c15c5a0 0x7f986c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986c0cb700 0x7f986c159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 --2- 172.21.15.37:0/457923797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f985c004d10 0x7f986c15f9a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 >> 172.21.15.37:0/457923797 conn(0x7f986c073090 msgr2=0x7f986c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 shutdown_connections 2023-07-09T21:23:09.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.261+0000 7f9872dfa640 1 -- 172.21.15.37:0/457923797 wait complete. 2023-07-09T21:23:09.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:09.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 Processor -- start 2023-07-09T21:23:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 -- start start 2023-07-09T21:23:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55f80b7980 0x7f55f8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f815bf80 con 0x7f55f80d0780 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f8160570 con 0x7f55f80ceb80 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55fd339640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f80cd070 con 0x7f55f80b7980 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55f80b7980 0x7f55f8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55f80b7980 0x7f55f8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38006/0 (socket says 172.21.15.37:38006) 2023-07-09T21:23:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 -- 172.21.15.37:0/1586547606 learned_addr learned my addr 172.21.15.37:0/1586547606 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f55f80d0780 0x7f55f80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46878/0 (socket says 172.21.15.37:46878) 2023-07-09T21:23:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 -- 172.21.15.37:0/1586547606 >> v1:172.21.15.119:6789/0 conn(0x7f55f80ceb80 legacy=0x7f55f80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 -- 172.21.15.37:0/1586547606 >> v1:172.21.15.37:6789/0 conn(0x7f55f80d0780 legacy=0x7f55f80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.425+0000 7f55f6ffd640 1 -- 172.21.15.37:0/1586547606 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f80d02f0 con 0x7f55f80b7980 2023-07-09T21:23:09.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55f6ffd640 1 --2- 172.21.15.37:0/1586547606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f8160030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009870 tx=0x7f55e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2909a82dcdda930b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55f67fc640 1 -- 172.21.15.37:0/1586547606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80ab600 con 0x7f55f80b7980 2023-07-09T21:23:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55f67fc640 1 -- 172.21.15.37:0/1586547606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e80a7050 con 0x7f55f80b7980 2023-07-09T21:23:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55f67fc640 1 -- 172.21.15.37:0/1586547606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80ab980 con 0x7f55f80b7980 2023-07-09T21:23:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 -- 172.21.15.37:0/1586547606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 msgr2=0x7f55f8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 --2- 172.21.15.37:0/1586547606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f8160030 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f55e8009870 tx=0x7f55e801c540 comp rx=0 tx=0).stop 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 -- 172.21.15.37:0/1586547606 shutdown_connections 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 --2- 172.21.15.37:0/1586547606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f8160030 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 -- 172.21.15.37:0/1586547606 >> 172.21.15.37:0/1586547606 conn(0x7f55f8073090 msgr2=0x7f55f8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 -- 172.21.15.37:0/1586547606 shutdown_connections 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.429+0000 7f55fd339640 1 -- 172.21.15.37:0/1586547606 wait complete. 2023-07-09T21:23:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 Processor -- start 2023-07-09T21:23:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- start start 2023-07-09T21:23:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 0x7f55f8150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f80d0780 0x7f55f8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f80c5750 con 0x7f55f80b7980 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8151de0 con 0x7f55f80d0780 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f8152030 con 0x7f55f80ceb80 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38016/0 (socket says 172.21.15.37:38016) 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 -- 172.21.15.37:0/3217312735 learned_addr learned my addr 172.21.15.37:0/3217312735 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f77fe640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f80d0780 0x7f55f8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55effff640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 0x7f55f8150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 -- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 msgr2=0x7f55f8150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 0x7f55f8150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 -- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f80d0780 msgr2=0x7f55f8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f80d0780 0x7f55f8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 -- 172.21.15.37:0/3217312735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e80094d0 con 0x7f55f80b7980 2023-07-09T21:23:09.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55effff640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 0x7f55f8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:09.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55f6ffd640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55e8019150 tx=0x7f55e80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80b4420 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e80b4580 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e80b48f0 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f8152310 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.433+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f81528d0 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f804d7d0 con 0x7f55f80b7980 2023-07-09T21:23:09.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f55e80b2070 con 0x7f55f80b7980 2023-07-09T21:23:09.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55ef7fe640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 0x7f55d8068700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55e811d1e0 con 0x7f55f80b7980 2023-07-09T21:23:09.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55effff640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 0x7f55d8068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.437+0000 7f55effff640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 0x7f55d8068700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f55f81f8290 tx=0x7f55e0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.441+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f55e80ea760 con 0x7f55f80b7980 2023-07-09T21:23:09.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.593+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55f80b1600 con 0x7f55f80b7980 2023-07-09T21:23:09.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55ef7fe640 1 -- 172.21.15.37:0/3217312735 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55e80edd80 con 0x7f55f80b7980 2023-07-09T21:23:09.602 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:09.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 msgr2=0x7f55d8068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 0x7f55d8068700 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f55f81f8290 tx=0x7f55e0009040 comp rx=0 tx=0).stop 2023-07-09T21:23:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 msgr2=0x7f55f80c5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55e8019150 tx=0x7f55e80192e0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 shutdown_connections 2023-07-09T21:23:09.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f55d8066250 0x7f55d8068700 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f55f80d0780 0x7f55f8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f55f80ceb80 0x7f55f8150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 --2- 172.21.15.37:0/3217312735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f55f80b7980 0x7f55f80c5210 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 >> 172.21.15.37:0/3217312735 conn(0x7f55f8073090 msgr2=0x7f55f815c750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 shutdown_connections 2023-07-09T21:23:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.597+0000 7f55fd339640 1 -- 172.21.15.37:0/3217312735 wait complete. 2023-07-09T21:23:09.623 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.761+0000 7fc78f3ac640 1 Processor -- start 2023-07-09T21:23:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.761+0000 7fc78f3ac640 1 -- start start 2023-07-09T21:23:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.761+0000 7fc78f3ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7880cf290 0x7fc788160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.761+0000 7fc78f3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7880d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78f3ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78815bf80 con 0x7fc7880b7980 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78f3ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7880cd070 con 0x7fc7880cf290 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78f3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7880cfd70 con 0x7fc7880d0780 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7880cf290 0x7fc788160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7880cf290 0x7fc788160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38026/0 (socket says 172.21.15.37:38026) 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 -- 172.21.15.37:0/2004234134 learned_addr learned my addr 172.21.15.37:0/2004234134 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78d949640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7880d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 -- 172.21.15.37:0/2004234134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 msgr2=0x7fc7880d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:09.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7880d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 -- 172.21.15.37:0/2004234134 >> v1:172.21.15.119:6789/0 conn(0x7fc7880b7980 legacy=0x7fc7880ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 -- 172.21.15.37:0/2004234134 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc788160570 con 0x7fc7880cf290 2023-07-09T21:23:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc78c947640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880cf290 0x7fc788160030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc778009870 tx=0x7fc77801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571169831407e8c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc77ffff640 1 -- 172.21.15.37:0/2004234134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780ab600 con 0x7fc7880cf290 2023-07-09T21:23:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc77ffff640 1 -- 172.21.15.37:0/2004234134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7780a7050 con 0x7fc7880cf290 2023-07-09T21:23:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.765+0000 7fc77ffff640 1 -- 172.21.15.37:0/2004234134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7780ab980 con 0x7fc7880cf290 2023-07-09T21:23:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- 172.21.15.37:0/2004234134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880cf290 msgr2=0x7fc788160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880cf290 0x7fc788160030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc778009870 tx=0x7fc77801c540 comp rx=0 tx=0).stop 2023-07-09T21:23:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- 172.21.15.37:0/2004234134 shutdown_connections 2023-07-09T21:23:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7880d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/2004234134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880cf290 0x7fc788160030 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- 172.21.15.37:0/2004234134 >> 172.21.15.37:0/2004234134 conn(0x7fc788073090 msgr2=0x7fc788069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- 172.21.15.37:0/2004234134 shutdown_connections 2023-07-09T21:23:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- 172.21.15.37:0/2004234134 wait complete. 2023-07-09T21:23:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 Processor -- start 2023-07-09T21:23:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- start start 2023-07-09T21:23:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7880cf290 0x7fc788152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7881599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815b3c0 con 0x7fc7880b7980 2023-07-09T21:23:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815a740 con 0x7fc7880cf290 2023-07-09T21:23:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78f3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78815aa20 con 0x7fc7880d0780 2023-07-09T21:23:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38036/0 (socket says 172.21.15.37:38036) 2023-07-09T21:23:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 -- 172.21.15.37:0/4288264774 learned_addr learned my addr 172.21.15.37:0/4288264774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78c947640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7880cf290 0x7fc788152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d949640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7881599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 -- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 msgr2=0x7fc7881599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7881599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 -- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7880cf290 msgr2=0x7fc788152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7880cf290 0x7fc788152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.769+0000 7fc78d148640 1 -- 172.21.15.37:0/4288264774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7780094d0 con 0x7fc7880b7980 2023-07-09T21:23:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc78d148640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c500 tx=0x7fc78400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784005220 con 0x7fc7880b7980 2023-07-09T21:23:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc784005380 con 0x7fc7880b7980 2023-07-09T21:23:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784007270 con 0x7fc7880b7980 2023-07-09T21:23:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc78815ad00 con 0x7fc7880b7980 2023-07-09T21:23:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc788152940 con 0x7fc7880b7980 2023-07-09T21:23:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78804d7d0 con 0x7fc7880b7980 2023-07-09T21:23:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc7840073d0 con 0x7fc7880b7980 2023-07-09T21:23:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.773+0000 7fc77dffb640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 0x7fc76c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.777+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc784082ec0 con 0x7fc7880b7980 2023-07-09T21:23:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.777+0000 7fc78c947640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 0x7fc76c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.777+0000 7fc78c947640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 0x7fc76c068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc788069aa0 tx=0x7fc778008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:09.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.777+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc784050360 con 0x7fc7880b7980 2023-07-09T21:23:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc78815bf80 con 0x7fc7880b7980 2023-07-09T21:23:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc77dffb640 1 -- 172.21.15.37:0/4288264774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc78815bf80 con 0x7fc7880b7980 2023-07-09T21:23:09.943 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 msgr2=0x7fc76c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 0x7fc76c068730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc788069aa0 tx=0x7fc778008040 comp rx=0 tx=0).stop 2023-07-09T21:23:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 msgr2=0x7fc78815b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc78400c500 tx=0x7fc78400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 shutdown_connections 2023-07-09T21:23:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc76c066280 0x7fc76c068730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc7880d0780 0x7fc7881599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc7880cf290 0x7fc788152400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 --2- 172.21.15.37:0/4288264774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7880b7980 0x7fc78815b7e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 >> 172.21.15.37:0/4288264774 conn(0x7fc788073090 msgr2=0x7fc78815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:09.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 shutdown_connections 2023-07-09T21:23:09.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:09.937+0000 7fc78f3ac640 1 -- 172.21.15.37:0/4288264774 wait complete. 2023-07-09T21:23:09.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 Processor -- start 2023-07-09T21:23:10.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 -- start start 2023-07-09T21:23:10.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe1880b7980 0x7fe188160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe1880cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18815bf80 con 0x7fe1880b3c20 2023-07-09T21:23:10.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1880cd070 con 0x7fe1880b7980 2023-07-09T21:23:10.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18f056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1880cfd70 con 0x7fe1880ceb80 2023-07-09T21:23:10.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18d5f3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe1880b3c20 0x7fe1880b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46892/0 (socket says 172.21.15.37:46892) 2023-07-09T21:23:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18d5f3640 1 -- 172.21.15.37:0/2039424833 learned_addr learned my addr 172.21.15.37:0/2039424833 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/2039424833 >> v2:172.21.15.119:3300/0 conn(0x7fe1880b7980 0x7fe188160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.105+0000 7fe187fff640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe1880cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe1877fe640 1 -- 172.21.15.37:0/2039424833 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470046098 0 0) 0x7fe1800014a0 con 0x7fe1880b3c20 2023-07-09T21:23:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe1877fe640 1 -- 172.21.15.37:0/2039424833 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003530 con 0x7fe1880b3c20 2023-07-09T21:23:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe18cdf2640 1 -- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 msgr2=0x7fe1880cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe1880cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe18cdf2640 1 -- 172.21.15.37:0/2039424833 >> v1:172.21.15.37:6789/0 conn(0x7fe1880b3c20 legacy=0x7fe1880b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe18cdf2640 1 -- 172.21.15.37:0/2039424833 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe188160570 con 0x7fe1880b7980 2023-07-09T21:23:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b7980 0x7fe188160030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097c0 tx=0x7fe17c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=378905d32b99718 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe1877fe640 1 -- 172.21.15.37:0/2039424833 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0ab600 con 0x7fe1880b7980 2023-07-09T21:23:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe1877fe640 1 -- 172.21.15.37:0/2039424833 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c0a7050 con 0x7fe1880b7980 2023-07-09T21:23:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.109+0000 7fe1877fe640 1 -- 172.21.15.37:0/2039424833 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c0ab980 con 0x7fe1880b7980 2023-07-09T21:23:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b7980 msgr2=0x7fe188160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b7980 0x7fe188160030 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097c0 tx=0x7fe17c01c480 comp rx=0 tx=0).stop 2023-07-09T21:23:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- 172.21.15.37:0/2039424833 shutdown_connections 2023-07-09T21:23:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe1880cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- 172.21.15.37:0/2039424833 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b7980 0x7fe188160030 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- 172.21.15.37:0/2039424833 >> 172.21.15.37:0/2039424833 conn(0x7fe188073090 msgr2=0x7fe188069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- 172.21.15.37:0/2039424833 shutdown_connections 2023-07-09T21:23:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- 172.21.15.37:0/2039424833 wait complete. 2023-07-09T21:23:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 Processor -- start 2023-07-09T21:23:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- start start 2023-07-09T21:23:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 0x7fe188153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe188151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1881f6500 con 0x7fe1880b7980 2023-07-09T21:23:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18815b0b0 con 0x7fe1880b3c20 2023-07-09T21:23:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18f056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe188151d60 con 0x7fe1880ceb80 2023-07-09T21:23:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38050/0 (socket says 172.21.15.37:38050) 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 -- 172.21.15.37:0/1117349033 learned_addr learned my addr 172.21.15.37:0/1117349033 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 0x7fe188153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 -- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 msgr2=0x7fe188151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe188151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 -- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 msgr2=0x7fe188153420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 0x7fe188153420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.113+0000 7fe187fff640 1 -- 172.21.15.37:0/1117349033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c009420 con 0x7fe1880b7980 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 0x7fe188153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe187fff640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe17400e930 tx=0x7fe17400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe174009690 con 0x7fe1880b7980 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17400ca00 con 0x7fe1880b7980 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17400cd70 con 0x7fe1880b7980 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18815a810 con 0x7fe1880b7980 2023-07-09T21:23:10.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18815add0 con 0x7fe1880b7980 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18804d7d0 con 0x7fe1880b7980 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe174013470 con 0x7fe1880b7980 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 0x7fe16c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe174083fe0 con 0x7fe1880b7980 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.117+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 0x7fe16c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.121+0000 7fe18cdf2640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 0x7fe16c068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ad000 tx=0x7fe17c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.121+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe174051510 con 0x7fe1880b7980 2023-07-09T21:23:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.277+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe18815bc40 con 0x7fe1880b7980 2023-07-09T21:23:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.277+0000 7fe1857fa640 1 -- 172.21.15.37:0/1117349033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe174054b30 con 0x7fe1880b7980 2023-07-09T21:23:10.285 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:10.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 msgr2=0x7fe16c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 0x7fe16c068730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0ad000 tx=0x7fe17c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 msgr2=0x7fe18815b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe17400e930 tx=0x7fe17400edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 shutdown_connections 2023-07-09T21:23:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe16c066280 0x7fe16c068730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1880ceb80 0x7fe188151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1880b7980 0x7fe18815b6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 --2- 172.21.15.37:0/1117349033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1880b3c20 0x7fe188153420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 >> 172.21.15.37:0/1117349033 conn(0x7fe188073090 msgr2=0x7fe1880b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 shutdown_connections 2023-07-09T21:23:10.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.281+0000 7fe18f056640 1 -- 172.21.15.37:0/1117349033 wait complete. 2023-07-09T21:23:10.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:10.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 Processor -- start 2023-07-09T21:23:10.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 -- start start 2023-07-09T21:23:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0b7980 0x7f0bcc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bcc0d0780 0x7f0bcc0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bcc15bf80 con 0x7f0bcc0ceb80 2023-07-09T21:23:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bcc0cd070 con 0x7f0bcc0d0780 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bd1159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc0cfd70 con 0x7f0bcc0b7980 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcb59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bcc0d0780 0x7f0bcc0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bc3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0bcc0ceb80 0x7f0bcc0cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46904/0 (socket says 172.21.15.37:46904) 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bc3fff640 1 -- 172.21.15.37:0/677411501 learned_addr learned my addr 172.21.15.37:0/677411501 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcad9d640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0b7980 0x7f0bcc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcb59e640 1 -- 172.21.15.37:0/677411501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0b7980 msgr2=0x7f0bcc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcb59e640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0b7980 0x7f0bcc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcb59e640 1 -- 172.21.15.37:0/677411501 >> v1:172.21.15.37:6789/0 conn(0x7f0bcc0ceb80 legacy=0x7f0bcc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bca59c640 1 -- 172.21.15.37:0/677411501 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539278765 0 0) 0x7f0bb4001120 con 0x7f0bcc0ceb80 2023-07-09T21:23:10.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.445+0000 7f0bcb59e640 1 -- 172.21.15.37:0/677411501 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc160570 con 0x7f0bcc0d0780 2023-07-09T21:23:10.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bcb59e640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc0d0c00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c73f9b2f24e1bc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bca59c640 1 -- 172.21.15.37:0/677411501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5810 con 0x7f0bcc0d0780 2023-07-09T21:23:10.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bca59c640 1 -- 172.21.15.37:0/677411501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc40a5970 con 0x7f0bcc0d0780 2023-07-09T21:23:10.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bca59c640 1 -- 172.21.15.37:0/677411501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40a5d00 con 0x7f0bcc0d0780 2023-07-09T21:23:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 -- 172.21.15.37:0/677411501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0d0780 msgr2=0x7f0bcc0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc0d0c00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d90 tx=0x7f0bc401c950 comp rx=0 tx=0).stop 2023-07-09T21:23:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 -- 172.21.15.37:0/677411501 shutdown_connections 2023-07-09T21:23:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc0d0c00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 --2- 172.21.15.37:0/677411501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0b7980 0x7f0bcc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 -- 172.21.15.37:0/677411501 >> 172.21.15.37:0/677411501 conn(0x7f0bcc073090 msgr2=0x7f0bcc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 -- 172.21.15.37:0/677411501 shutdown_connections 2023-07-09T21:23:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.449+0000 7f0bd1159640 1 -- 172.21.15.37:0/677411501 wait complete. 2023-07-09T21:23:10.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 Processor -- start 2023-07-09T21:23:10.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- start start 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0ceb80 0x7f0bcc15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc15ebf0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc15eed0 con 0x7f0bcc0d0780 2023-07-09T21:23:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bcc1598f0 con 0x7f0bcc0ceb80 2023-07-09T21:23:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38060/0 (socket says 172.21.15.37:38060) 2023-07-09T21:23:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 -- 172.21.15.37:0/3161619860 learned_addr learned my addr 172.21.15.37:0/3161619860 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 -- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0ceb80 msgr2=0x7f0bcc15a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0ceb80 0x7f0bcc15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 -- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0d0780 msgr2=0x7f0bcc14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 -- 172.21.15.37:0/3161619860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc4009a70 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bcad9d640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00e930 tx=0x7f0bbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc00ca00 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc00cb60 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc013470 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bcc159bd0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.453+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bcc0b2cc0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bcc04d7d0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0bbc0135d0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bc37fe640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 0x7f0bac068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0bbc0840c0 con 0x7f0bcc0b7980 2023-07-09T21:23:10.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bc3fff640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 0x7f0bac068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.457+0000 7f0bc3fff640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 0x7f0bac068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc151340 tx=0x7f0bb4001320 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.461+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bbc051560 con 0x7f0bcc0b7980 2023-07-09T21:23:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.613+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bcc0b1600 con 0x7f0bcc0b7980 2023-07-09T21:23:10.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.613+0000 7f0bc37fe640 1 -- 172.21.15.37:0/3161619860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bbc054b80 con 0x7f0bcc0b7980 2023-07-09T21:23:10.624 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 msgr2=0x7f0bac068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 0x7f0bac068730 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc151340 tx=0x7f0bb4001320 comp rx=0 tx=0).stop 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 msgr2=0x7f0bcc0b2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc00e930 tx=0x7f0bbc00edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 shutdown_connections 2023-07-09T21:23:10.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0bac066280 0x7f0bac068730 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bcc0d0780 0x7f0bcc14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bcc0ceb80 0x7f0bcc15a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 --2- 172.21.15.37:0/3161619860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bcc0b7980 0x7f0bcc0b2780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 >> 172.21.15.37:0/3161619860 conn(0x7f0bcc073090 msgr2=0x7f0bcc15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 shutdown_connections 2023-07-09T21:23:10.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.617+0000 7f0bd1159640 1 -- 172.21.15.37:0/3161619860 wait complete. 2023-07-09T21:23:10.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.777+0000 7f4c72fac640 1 Processor -- start 2023-07-09T21:23:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 -- start start 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4c6c0b4140 0x7f4c6c15f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c0b45b0 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c6c0cef80 con 0x7f4c6c0b4140 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c72fac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c0cf260 con 0x7f4c6c0b47a0 2023-07-09T21:23:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38068/0 (socket says 172.21.15.37:38068) 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 -- 172.21.15.37:0/316817896 learned_addr learned my addr 172.21.15.37:0/316817896 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c6bfff640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c71549640 1 --2- 172.21.15.37:0/316817896 >> v2:172.21.15.119:3300/0 conn(0x7f4c6c0b4140 0x7f4c6c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 -- 172.21.15.37:0/316817896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 msgr2=0x7f4c6c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 -- 172.21.15.37:0/316817896 >> v2:172.21.15.119:3300/0 conn(0x7f4c6c0b4140 msgr2=0x7f4c6c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 --2- 172.21.15.37:0/316817896 >> v2:172.21.15.119:3300/0 conn(0x7f4c6c0b4140 0x7f4c6c15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.781+0000 7f4c70d48640 1 -- 172.21.15.37:0/316817896 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c0cf540 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c70d48640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0cd5c0 tx=0x7f4c6001c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e3188549332842 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c6b7fe640 1 -- 172.21.15.37:0/316817896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600ab600 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c6b7fe640 1 -- 172.21.15.37:0/316817896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c600a7050 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c6b7fe640 1 -- 172.21.15.37:0/316817896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c600ab980 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- 172.21.15.37:0/316817896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 msgr2=0x7f4c6c0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0cd5c0 tx=0x7f4c6001c240 comp rx=0 tx=0).stop 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- 172.21.15.37:0/316817896 shutdown_connections 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 --2- 172.21.15.37:0/316817896 >> v2:172.21.15.119:3300/0 conn(0x7f4c6c0b4140 0x7f4c6c15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 --2- 172.21.15.37:0/316817896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c0cc7d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- 172.21.15.37:0/316817896 >> 172.21.15.37:0/316817896 conn(0x7f4c6c073050 msgr2=0x7f4c6c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- 172.21.15.37:0/316817896 shutdown_connections 2023-07-09T21:23:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- 172.21.15.37:0/316817896 wait complete. 2023-07-09T21:23:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 Processor -- start 2023-07-09T21:23:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.785+0000 7f4c72fac640 1 -- start start 2023-07-09T21:23:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c6c0b4140 0x7f4c6c155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c153330 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c154ea0 con 0x7f4c6c0b4140 2023-07-09T21:23:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6c155180 con 0x7f4c6c0b47a0 2023-07-09T21:23:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38076/0 (socket says 172.21.15.37:38076) 2023-07-09T21:23:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 -- 172.21.15.37:0/1464344846 learned_addr learned my addr 172.21.15.37:0/1464344846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c6bfff640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c70d48640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c6c0b4140 0x7f4c6c155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 -- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 msgr2=0x7f4c6c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 -- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c6c0b4140 msgr2=0x7f4c6c155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c6c0b4140 0x7f4c6c155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 -- 172.21.15.37:0/1464344846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600094d0 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c71549640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c64007e30 tx=0x7f4c6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64014420 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c64014580 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6c155460 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c64014930 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c155a20 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6c0cdaa0 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.789+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4c64014a90 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.793+0000 7f4c697fa640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 0x7f4c50068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.793+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4c64084540 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.793+0000 7f4c70d48640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 0x7f4c50068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.793+0000 7f4c70d48640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 0x7f4c50068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c600ad000 tx=0x7f4c600a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:10.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.797+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c640554f0 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c6c04d7d0 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c697fa640 1 -- 172.21.15.37:0/1464344846 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c64009960 con 0x7f4c6c0b7a60 2023-07-09T21:23:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 msgr2=0x7f4c50068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 0x7f4c50068730 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4c600ad000 tx=0x7f4c600a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 msgr2=0x7f4c6c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4c64007e30 tx=0x7f4c6400e4b0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 shutdown_connections 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4c50066280 0x7f4c50068730 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c6c0b7a60 0x7f4c6c15d370 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c6c0b47a0 0x7f4c6c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 --2- 172.21.15.37:0/1464344846 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c6c0b4140 0x7f4c6c155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 >> 172.21.15.37:0/1464344846 conn(0x7f4c6c073050 msgr2=0x7f4c6c0d09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 shutdown_connections 2023-07-09T21:23:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:10.969+0000 7f4c72fac640 1 -- 172.21.15.37:0/1464344846 wait complete. 2023-07-09T21:23:10.995 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:10.996 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:11.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 Processor -- start 2023-07-09T21:23:11.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 -- start start 2023-07-09T21:23:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3c0c158670 0x7f3c0c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3c0c15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c0c06efc0 con 0x7f3c0c06b120 2023-07-09T21:23:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c0c06d390 con 0x7f3c0c158670 2023-07-09T21:23:11.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.141+0000 7f3c12bd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c06f4f0 con 0x7f3c0c0aff40 2023-07-09T21:23:11.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c0c06b120 0x7f3c0c0af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46910/0 (socket says 172.21.15.37:46910) 2023-07-09T21:23:11.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0bfff640 1 -- 172.21.15.37:0/2941358739 learned_addr learned my addr 172.21.15.37:0/2941358739 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:11.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1096e640 1 --2- 172.21.15.37:0/2941358739 >> v2:172.21.15.119:3300/0 conn(0x7f3c0c158670 0x7f3c0c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3c0c15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163266867 0 0) 0x7f3c0c06efc0 con 0x7f3c0c06b120 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bfc003530 con 0x7f3c0c06b120 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1313256501 0 0) 0x7f3bfc003530 con 0x7f3c0c06b120 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 msgr2=0x7f3c0c15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3c0c15c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 >> v2:172.21.15.119:3300/0 conn(0x7f3c0c158670 msgr2=0x7f3c0c0ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 --2- 172.21.15.37:0/2941358739 >> v2:172.21.15.119:3300/0 conn(0x7f3c0c158670 0x7f3c0c0ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c06fe90 con 0x7f3c0c06b120 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3bf8001680 con 0x7f3c0c06b120 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 >> v1:172.21.15.37:6789/0 conn(0x7f3c0c06b120 legacy=0x7f3c0c0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3bfc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bfc003f00 0x7f3bfc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3bfc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c06d390 con 0x7f3bfc004d10 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c06f4f0 con 0x7f3bfc003f00 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc00b9c0 con 0x7f3c0c0aff40 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3bfc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1096e640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3bfc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bfc003f00 0x7f3bfc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 -- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 msgr2=0x7f3bfc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0aff40 0x7f3bfc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 -- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bfc003f00 msgr2=0x7f3bfc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bfc003f00 0x7f3bfc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c1116f640 1 -- 172.21.15.37:0/2941358739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc003530 con 0x7f3bfc004d10 2023-07-09T21:23:11.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.145+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3bfc003f00 0x7f3bfc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3bfc005180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009f90 tx=0x7f3c0401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d754ac10128959fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040a5b20 con 0x7f3bfc004d10 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400f040 con 0x7f3bfc004d10 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c0b7fe640 1 -- 172.21.15.37:0/2941358739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040ad440 con 0x7f3bfc004d10 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2941358739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 msgr2=0x7f3bfc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2941358739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3bfc005180 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009f90 tx=0x7f3c0401cbc0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c1116f640 1 -- 172.21.15.37:0/2941358739 reap_dead start 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2941358739 shutdown_connections 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2941358739 >> 172.21.15.37:0/2941358739 conn(0x7f3c0c0ca830 msgr2=0x7f3c0c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:11.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2941358739 shutdown_connections 2023-07-09T21:23:11.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2941358739 wait complete. 2023-07-09T21:23:11.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 Processor -- start 2023-07-09T21:23:11.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.149+0000 7f3c12bd2640 1 -- start start 2023-07-09T21:23:11.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 0x7f3c0c14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c144160 0x7f3c0c1445d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0c2de0 con 0x7f3bfc004d10 2023-07-09T21:23:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c14d840 con 0x7f3c0c144160 2023-07-09T21:23:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c0b33b0 con 0x7f3c0c0b15f0 2023-07-09T21:23:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38084/0 (socket says 172.21.15.37:38084) 2023-07-09T21:23:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 -- 172.21.15.37:0/2351058945 learned_addr learned my addr 172.21.15.37:0/2351058945 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1116f640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c144160 0x7f3c0c1445d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 0x7f3c0c14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 -- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 msgr2=0x7f3c0c14cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 0x7f3c0c14cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 -- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c144160 msgr2=0x7f3c0c1445d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c144160 0x7f3c0c1445d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 -- 172.21.15.37:0/2351058945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0c0b3670 con 0x7f3bfc004d10 2023-07-09T21:23:11.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 0x7f3c0c14cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:11.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c1096e640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c00011ad0 tx=0x7f3c00011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0000fbb0 con 0x7f3bfc004d10 2023-07-09T21:23:11.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0000fd10 con 0x7f3bfc004d10 2023-07-09T21:23:11.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c0b3950 con 0x7f3bfc004d10 2023-07-09T21:23:11.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c00014680 con 0x7f3bfc004d10 2023-07-09T21:23:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c0c2a00 con 0x7f3bfc004d10 2023-07-09T21:23:11.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c04d7d0 con 0x7f3bfc004d10 2023-07-09T21:23:11.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.153+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3c000147e0 con 0x7f3bfc004d10 2023-07-09T21:23:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.157+0000 7f3c097fa640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 0x7f3bf0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.157+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3c000846e0 con 0x7f3bfc004d10 2023-07-09T21:23:11.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.157+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 0x7f3bf0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.157+0000 7f3c0bfff640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 0x7f3bf0068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c9040 tx=0x7f3bf8001590 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.157+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c00051a90 con 0x7f3bfc004d10 2023-07-09T21:23:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.313+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c0c0c3050 con 0x7f3bfc004d10 2023-07-09T21:23:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c097fa640 1 -- 172.21.15.37:0/2351058945 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f3c000550b0 con 0x7f3bfc004d10 2023-07-09T21:23:11.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:11.322 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:10.804072+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 msgr2=0x7f3bf0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 0x7f3bf0068730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c0c9040 tx=0x7f3bf8001590 comp rx=0 tx=0).stop 2023-07-09T21:23:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 msgr2=0x7f3c0c0b2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f3c00011ad0 tx=0x7f3c00011f90 comp rx=0 tx=0).stop 2023-07-09T21:23:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 shutdown_connections 2023-07-09T21:23:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bf0066280 0x7f3bf0068730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c0c144160 0x7f3c0c1445d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c0c0b15f0 0x7f3c0c14cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 --2- 172.21.15.37:0/2351058945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3bfc004d10 0x7f3c0c0b2e70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 >> 172.21.15.37:0/2351058945 conn(0x7f3c0c0ca830 msgr2=0x7f3c0c0c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 shutdown_connections 2023-07-09T21:23:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.317+0000 7f3c12bd2640 1 -- 172.21.15.37:0/2351058945 wait complete. 2023-07-09T21:23:11.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:11.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.481+0000 7fedad27b640 1 Processor -- start 2023-07-09T21:23:11.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.481+0000 7fedad27b640 1 -- start start 2023-07-09T21:23:11.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fedad27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7feda80d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fedad27b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda815bf80 con 0x7feda80cf290 2023-07-09T21:23:11.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fedad27b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda80d02f0 con 0x7feda80b7980 2023-07-09T21:23:11.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fedad27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda80cd070 con 0x7feda8160030 2023-07-09T21:23:11.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feda80cf290 0x7feda80d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46916/0 (socket says 172.21.15.37:46916) 2023-07-09T21:23:11.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 -- 172.21.15.37:0/3205008727 learned_addr learned my addr 172.21.15.37:0/3205008727 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:11.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda77fe640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7feda80d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210047136 0 0) 0x7fed90001120 con 0x7feda80cf290 2023-07-09T21:23:11.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed94003530 con 0x7feda80cf290 2023-07-09T21:23:11.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566748221 0 0) 0x7feda80d02f0 con 0x7feda80b7980 2023-07-09T21:23:11.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed90001120 con 0x7feda80b7980 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1625931670 0 0) 0x7fed94003530 con 0x7feda80cf290 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 msgr2=0x7feda80d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7feda80d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 >> v1:172.21.15.119:6789/0 conn(0x7feda80b7980 legacy=0x7feda80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80cc7f0 con 0x7feda80cf290 2023-07-09T21:23:11.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fed90001810 con 0x7feda80cf290 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 >> v1:172.21.15.37:6789/0 conn(0x7feda80cf290 legacy=0x7feda80d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed94003b40 0x7fed94003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed940047d0 0x7fed94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7fed94005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80cd070 con 0x7fed940047d0 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400ba40 con 0x7fed94003b40 2023-07-09T21:23:11.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400bbb0 con 0x7feda8160030 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed940047d0 0x7fed94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda6ffd640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed94003b40 0x7fed94003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7feda77fe640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7fed94005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 -- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 msgr2=0x7fed94005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8160030 0x7fed94005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 -- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed94003b40 msgr2=0x7fed94003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed94003b40 0x7fed94003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.485+0000 7fed9ffff640 1 -- 172.21.15.37:0/3205008727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed94003530 con 0x7fed940047d0 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fed9ffff640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed940047d0 0x7fed94004c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feda80cf6b0 tx=0x7fed9001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ac8ec95ef41e91 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900058e0 con 0x7fed940047d0 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90005a60 con 0x7fed940047d0 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7feda67fc640 1 -- 172.21.15.37:0/3205008727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90005e10 con 0x7fed940047d0 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 -- 172.21.15.37:0/3205008727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed940047d0 msgr2=0x7fed94004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 --2- 172.21.15.37:0/3205008727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed940047d0 0x7fed94004c40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7feda80cf6b0 tx=0x7fed9001cb80 comp rx=0 tx=0).stop 2023-07-09T21:23:11.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7feda77fe640 1 -- 172.21.15.37:0/3205008727 reap_dead start 2023-07-09T21:23:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 -- 172.21.15.37:0/3205008727 shutdown_connections 2023-07-09T21:23:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 -- 172.21.15.37:0/3205008727 >> 172.21.15.37:0/3205008727 conn(0x7feda8073090 msgr2=0x7feda8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 -- 172.21.15.37:0/3205008727 shutdown_connections 2023-07-09T21:23:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.489+0000 7fedad27b640 1 -- 172.21.15.37:0/3205008727 wait complete. 2023-07-09T21:23:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 Processor -- start 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- start start 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 0x7feda80c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8150a30 0x7feda80ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80cae30 con 0x7feda81f1b10 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda80cbcf0 con 0x7fed940047d0 2023-07-09T21:23:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda8150ea0 con 0x7feda8150a30 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38098/0 (socket says 172.21.15.37:38098) 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 -- 172.21.15.37:0/1006414910 learned_addr learned my addr 172.21.15.37:0/1006414910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fed9ffff640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8150a30 0x7feda80ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda6ffd640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 0x7feda80c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 -- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8150a30 msgr2=0x7feda80ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8150a30 0x7feda80ca8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 -- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 msgr2=0x7feda80c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 0x7feda80c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 -- 172.21.15.37:0/1006414910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda80c9850 con 0x7feda81f1b10 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda6ffd640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 0x7feda80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7feda77fe640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feda80cd370 tx=0x7feda0011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda000e040 con 0x7feda81f1b10 2023-07-09T21:23:11.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda000f040 con 0x7feda81f1b10 2023-07-09T21:23:11.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0015b60 con 0x7feda81f1b10 2023-07-09T21:23:11.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda80c9b30 con 0x7feda81f1b10 2023-07-09T21:23:11.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.493+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda80ca0f0 con 0x7feda81f1b10 2023-07-09T21:23:11.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda804d7d0 con 0x7feda81f1b10 2023-07-09T21:23:11.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feda0015cc0 con 0x7feda81f1b10 2023-07-09T21:23:11.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 0x7fed88068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6120+0+0 (secure 0 0 0) 0x7feda0083ba0 con 0x7feda81f1b10 2023-07-09T21:23:11.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7feda6ffd640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 0x7fed88068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.497+0000 7feda6ffd640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 0x7fed88068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed98005630 tx=0x7fed98009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.501+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feda0050fd0 con 0x7feda81f1b10 2023-07-09T21:23:11.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.653+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feda806a800 con 0x7feda81f1b10 2023-07-09T21:23:11.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1006414910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7feda00545f0 con 0x7feda81f1b10 2023-07-09T21:23:11.662 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:11.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 msgr2=0x7fed88068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 0x7fed88068760 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fed98005630 tx=0x7fed98009040 comp rx=0 tx=0).stop 2023-07-09T21:23:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 msgr2=0x7feda8159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feda80cd370 tx=0x7feda0011d40 comp rx=0 tx=0).stop 2023-07-09T21:23:11.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 shutdown_connections 2023-07-09T21:23:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fed880662b0 0x7fed88068760 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda81f1b10 0x7feda8159000 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda8150a30 0x7feda80ca8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 --2- 172.21.15.37:0/1006414910 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed940047d0 0x7feda80c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 >> 172.21.15.37:0/1006414910 conn(0x7feda8073090 msgr2=0x7feda81e5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 shutdown_connections 2023-07-09T21:23:11.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.657+0000 7fedad27b640 1 -- 172.21.15.37:0/1006414910 wait complete. 2023-07-09T21:23:11.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.821+0000 7f1195b3d640 1 Processor -- start 2023-07-09T21:23:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 -- start start 2023-07-09T21:23:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11900cfb40 0x7f11900cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b0540 0x7f11900cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900d0450 con 0x7f11900b1420 2023-07-09T21:23:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900ce640 con 0x7f11900cfb40 2023-07-09T21:23:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1195b3d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900ce080 con 0x7f11900b0540 2023-07-09T21:23:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1194b3b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11900cfb40 0x7f11900cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f118ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11900b1420 0x7f11900cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46920/0 (socket says 172.21.15.37:46920) 2023-07-09T21:23:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f118ffff640 1 -- 172.21.15.37:0/501675236 learned_addr learned my addr 172.21.15.37:0/501675236 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f119533c640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b0540 0x7f11900cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f118f7fe640 1 -- 172.21.15.37:0/501675236 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634122246 0 0) 0x7f11900d0450 con 0x7f11900b1420 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f118f7fe640 1 -- 172.21.15.37:0/501675236 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1180003530 con 0x7f11900b1420 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1194b3b640 1 -- 172.21.15.37:0/501675236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b0540 msgr2=0x7f11900cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1194b3b640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b0540 0x7f11900cccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1194b3b640 1 -- 172.21.15.37:0/501675236 >> v1:172.21.15.37:6789/0 conn(0x7f11900b1420 legacy=0x7f11900cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.825+0000 7f1194b3b640 1 -- 172.21.15.37:0/501675236 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900ce360 con 0x7f11900cfb40 2023-07-09T21:23:11.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1194b3b640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900cfb40 0x7f11900cff10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11840097c0 tx=0x7f118401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a12f57edd1ca8c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f118f7fe640 1 -- 172.21.15.37:0/501675236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840ab650 con 0x7f11900cfb40 2023-07-09T21:23:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f118f7fe640 1 -- 172.21.15.37:0/501675236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11840ab7b0 con 0x7f11900cfb40 2023-07-09T21:23:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f118f7fe640 1 -- 172.21.15.37:0/501675236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840abb20 con 0x7f11900cfb40 2023-07-09T21:23:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- 172.21.15.37:0/501675236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900cfb40 msgr2=0x7f11900cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900cfb40 0x7f11900cff10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f11840097c0 tx=0x7f118401c450 comp rx=0 tx=0).stop 2023-07-09T21:23:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- 172.21.15.37:0/501675236 shutdown_connections 2023-07-09T21:23:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b0540 0x7f11900cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 --2- 172.21.15.37:0/501675236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900cfb40 0x7f11900cff10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- 172.21.15.37:0/501675236 >> 172.21.15.37:0/501675236 conn(0x7f1190072d20 msgr2=0x7f11900d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- 172.21.15.37:0/501675236 shutdown_connections 2023-07-09T21:23:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- 172.21.15.37:0/501675236 wait complete. 2023-07-09T21:23:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 Processor -- start 2023-07-09T21:23:11.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.829+0000 7f1195b3d640 1 -- start start 2023-07-09T21:23:11.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b1420 0x7f11900c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11900cfb40 0x7f11900b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11900c80c0 con 0x7f11900b0540 2023-07-09T21:23:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190155600 con 0x7f11900cfb40 2023-07-09T21:23:11.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900c74b0 con 0x7f11900b1420 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38108/0 (socket says 172.21.15.37:38108) 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 -- 172.21.15.37:0/1672881414 learned_addr learned my addr 172.21.15.37:0/1672881414 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f118ffff640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b1420 0x7f11900c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f119533c640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11900cfb40 0x7f11900b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 -- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b1420 msgr2=0x7f11900c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b1420 0x7f11900c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 -- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11900cfb40 msgr2=0x7f11900b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:11.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11900cfb40 0x7f11900b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:11.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 -- 172.21.15.37:0/1672881414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1184009420 con 0x7f11900b0540 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1194b3b640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11840ad040 tx=0x7f118401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840bf610 con 0x7f11900b0540 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11840bf770 con 0x7f11900b0540 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11840bfae0 con 0x7f11900b0540 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11900c7790 con 0x7f11900b0540 2023-07-09T21:23:11.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11900c7d50 con 0x7f11900b0540 2023-07-09T21:23:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.833+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119004e020 con 0x7f11900b0540 2023-07-09T21:23:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.837+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11840bfc40 con 0x7f11900b0540 2023-07-09T21:23:11.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.837+0000 7f118d7fa640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:11.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.837+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f118411e840 con 0x7f11900b0540 2023-07-09T21:23:11.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.837+0000 7f118ffff640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:11.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.837+0000 7f118ffff640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 0x7f1174068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119006a350 tx=0x7f117c009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:11.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.841+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11840ebbf0 con 0x7f11900b0540 2023-07-09T21:23:12.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:11.997+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f119006b070 con 0x7f11900b0540 2023-07-09T21:23:12.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f118d7fa640 1 -- 172.21.15.37:0/1672881414 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f11840ef210 con 0x7f11900b0540 2023-07-09T21:23:12.006 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:12.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 msgr2=0x7f1174068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 0x7f1174068730 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f119006a350 tx=0x7f117c009040 comp rx=0 tx=0).stop 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 msgr2=0x7f11901550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11840ad040 tx=0x7f118401ac90 comp rx=0 tx=0).stop 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 shutdown_connections 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1174066280 0x7f1174068730 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11900cfb40 0x7f11900b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11900b1420 0x7f11900c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 --2- 172.21.15.37:0/1672881414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900b0540 0x7f11901550c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 >> 172.21.15.37:0/1672881414 conn(0x7f1190072d20 msgr2=0x7f119006b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 shutdown_connections 2023-07-09T21:23:12.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.001+0000 7f1195b3d640 1 -- 172.21.15.37:0/1672881414 wait complete. 2023-07-09T21:23:12.027 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:12.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 Processor -- start 2023-07-09T21:23:12.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 -- start start 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9aa80cf290 0x7f9aa8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa815bf80 con 0x7f9aa80d0780 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9aa8160570 con 0x7f9aa80b7980 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aaf91f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9aa80cd070 con 0x7f9aa80cf290 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aadebc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9aa80d0780 0x7f9aa80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46928/0 (socket says 172.21.15.37:46928) 2023-07-09T21:23:12.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.169+0000 7f9aadebc640 1 -- 172.21.15.37:0/2541572861 learned_addr learned my addr 172.21.15.37:0/2541572861 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9aaceba640 1 --2- 172.21.15.37:0/2541572861 >> v2:172.21.15.119:3300/0 conn(0x7f9aa80cf290 0x7f9aa8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227551284 0 0) 0x7f9aa00014a0 con 0x7f9aa80d0780 2023-07-09T21:23:12.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a94003530 con 0x7f9aa80d0780 2023-07-09T21:23:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061194193 0 0) 0x7f9aa4001120 con 0x7f9aa80b7980 2023-07-09T21:23:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aa00014a0 con 0x7f9aa80b7980 2023-07-09T21:23:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9aaceba640 1 -- 172.21.15.37:0/2541572861 >> v1:172.21.15.119:6789/0 conn(0x7f9aa80b7980 legacy=0x7f9aa80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9aaceba640 1 -- 172.21.15.37:0/2541572861 >> v1:172.21.15.37:6789/0 conn(0x7f9aa80d0780 legacy=0x7f9aa80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.173+0000 7f9aaceba640 1 -- 172.21.15.37:0/2541572861 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa80d02f0 con 0x7f9aa80cf290 2023-07-09T21:23:12.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaceba640 1 --2- 172.21.15.37:0/2541572861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80cf290 0x7f9aa8160030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097c0 tx=0x7f9a9801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67dc3dc7b948a4f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980ab600 con 0x7f9aa80cf290 2023-07-09T21:23:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a980a7050 con 0x7f9aa80cf290 2023-07-09T21:23:12.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9a9ffff640 1 -- 172.21.15.37:0/2541572861 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a980ab980 con 0x7f9aa80cf290 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- 172.21.15.37:0/2541572861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80cf290 msgr2=0x7f9aa8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/2541572861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80cf290 0x7f9aa8160030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a980097c0 tx=0x7f9a9801c480 comp rx=0 tx=0).stop 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- 172.21.15.37:0/2541572861 shutdown_connections 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/2541572861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80cf290 0x7f9aa8160030 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- 172.21.15.37:0/2541572861 >> 172.21.15.37:0/2541572861 conn(0x7f9aa8073090 msgr2=0x7f9aa8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- 172.21.15.37:0/2541572861 shutdown_connections 2023-07-09T21:23:12.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- 172.21.15.37:0/2541572861 wait complete. 2023-07-09T21:23:12.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 Processor -- start 2023-07-09T21:23:12.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.177+0000 7f9aaf91f640 1 -- start start 2023-07-09T21:23:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9aa80cf290 0x7f9aa814e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80d0780 0x7f9aa814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa814c2b0 con 0x7f9aa80b7980 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa8153710 con 0x7f9aa80d0780 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9aa81539f0 con 0x7f9aa80cf290 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaceba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9aa80cf290 0x7f9aa814e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38114/0 (socket says 172.21.15.37:38114) 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 -- 172.21.15.37:0/14703308 learned_addr learned my addr 172.21.15.37:0/14703308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:12.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aadebc640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80d0780 0x7f9aa814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 -- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9aa80cf290 msgr2=0x7f9aa814e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9aa80cf290 0x7f9aa814e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 -- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80d0780 msgr2=0x7f9aa814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80d0780 0x7f9aa814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 -- 172.21.15.37:0/14703308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a98009420 con 0x7f9aa80b7980 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aad6bb640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c700 tx=0x7f9aa400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa40052d0 con 0x7f9aa80b7980 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aa4005450 con 0x7f9aa80b7980 2023-07-09T21:23:12.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa400a860 con 0x7f9aa80b7980 2023-07-09T21:23:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9aa8153cd0 con 0x7f9aa80b7980 2023-07-09T21:23:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa8147a30 con 0x7f9aa80b7980 2023-07-09T21:23:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.181+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9aa808b2b0 con 0x7f9aa80b7980 2023-07-09T21:23:12.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.185+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9aa400a9c0 con 0x7f9aa80b7980 2023-07-09T21:23:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.185+0000 7f9a9dffb640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 0x7f9a8c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.185+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9aa4083650 con 0x7f9aa80b7980 2023-07-09T21:23:12.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.185+0000 7f9aaceba640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 0x7f9a8c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.185+0000 7f9aaceba640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 0x7f9a8c068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a98008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.189+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9aa4050b30 con 0x7f9aa80b7980 2023-07-09T21:23:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.341+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9aa8160570 con 0x7f9aa80b7980 2023-07-09T21:23:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9a9dffb640 1 -- 172.21.15.37:0/14703308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9aa8160570 con 0x7f9aa80b7980 2023-07-09T21:23:12.350 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 msgr2=0x7f9a8c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 0x7f9a8c068760 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9a980ad000 tx=0x7f9a98008040 comp rx=0 tx=0).stop 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 msgr2=0x7f9aa81474f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9aa400c700 tx=0x7f9aa400cbc0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 shutdown_connections 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9a8c0662b0 0x7f9a8c068760 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9aa80d0780 0x7f9aa814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9aa80cf290 0x7f9aa814e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 --2- 172.21.15.37:0/14703308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9aa80b7980 0x7f9aa81474f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 >> 172.21.15.37:0/14703308 conn(0x7f9aa8073090 msgr2=0x7f9aa815c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 shutdown_connections 2023-07-09T21:23:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.345+0000 7f9aaf91f640 1 -- 172.21.15.37:0/14703308 wait complete. 2023-07-09T21:23:12.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:12.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 Processor -- start 2023-07-09T21:23:12.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 -- start start 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d0c0cf500 0x7f3d0c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c15e090 0x7f3d0c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0b5f40 con 0x7f3d0c15cec0 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cfc50 con 0x7f3d0c0cf500 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.509+0000 7f3d13782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c15d290 con 0x7f3d0c15e090 2023-07-09T21:23:12.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d0c0cf500 0x7f3d0c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3d0c0cf500 0x7f3d0c0cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38124/0 (socket says 172.21.15.37:38124) 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 -- 172.21.15.37:0/2923601909 learned_addr learned my addr 172.21.15.37:0/2923601909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d11d1f640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c15e090 0x7f3d0c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 -- 172.21.15.37:0/2923601909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c15e090 msgr2=0x7f3d0c0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c15e090 0x7f3d0c0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 -- 172.21.15.37:0/2923601909 >> v1:172.21.15.119:6789/0 conn(0x7f3d0c15cec0 legacy=0x7f3d0c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 -- 172.21.15.37:0/2923601909 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0b28f0 con 0x7f3d0c0cf500 2023-07-09T21:23:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d10d1d640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c0cf500 0x7f3d0c0cb720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009870 tx=0x7f3cfc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b3d563382ef5b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d03fff640 1 -- 172.21.15.37:0/2923601909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0ab600 con 0x7f3d0c0cf500 2023-07-09T21:23:12.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d03fff640 1 -- 172.21.15.37:0/2923601909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cfc0a7050 con 0x7f3d0c0cf500 2023-07-09T21:23:12.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.513+0000 7f3d03fff640 1 -- 172.21.15.37:0/2923601909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cfc0ab980 con 0x7f3d0c0cf500 2023-07-09T21:23:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- 172.21.15.37:0/2923601909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c0cf500 msgr2=0x7f3d0c0cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c0cf500 0x7f3d0c0cb720 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009870 tx=0x7f3cfc01c4b0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- 172.21.15.37:0/2923601909 shutdown_connections 2023-07-09T21:23:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c15e090 0x7f3d0c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- 172.21.15.37:0/2923601909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c0cf500 0x7f3d0c0cb720 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- 172.21.15.37:0/2923601909 >> 172.21.15.37:0/2923601909 conn(0x7f3d0c06d230 msgr2=0x7f3d0c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- 172.21.15.37:0/2923601909 shutdown_connections 2023-07-09T21:23:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- 172.21.15.37:0/2923601909 wait complete. 2023-07-09T21:23:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 Processor -- start 2023-07-09T21:23:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- start start 2023-07-09T21:23:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c0cf500 0x7f3d0c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c15cec0 0x7f3d0c153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c153bc0 con 0x7f3d0c15e090 2023-07-09T21:23:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c0af780 con 0x7f3d0c15cec0 2023-07-09T21:23:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d13782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c153dd0 con 0x7f3d0c0cf500 2023-07-09T21:23:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38136/0 (socket says 172.21.15.37:38136) 2023-07-09T21:23:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 -- 172.21.15.37:0/709258146 learned_addr learned my addr 172.21.15.37:0/709258146 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d1151e640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c0cf500 0x7f3d0c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d10d1d640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c15cec0 0x7f3d0c153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 -- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c0cf500 msgr2=0x7f3d0c0b4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c0cf500 0x7f3d0c0b4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 -- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c15cec0 msgr2=0x7f3d0c153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c15cec0 0x7f3d0c153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.517+0000 7f3d11d1f640 1 -- 172.21.15.37:0/709258146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cfc0094d0 con 0x7f3d0c15e090 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d11d1f640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400efc0 tx=0x7f3d0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d04009ba0 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0400f040 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d040146c0 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c0b3ac0 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c0b4080 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c0af910 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3d04014820 con 0x7f3d0c15e090 2023-07-09T21:23:12.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 0x7f3cf0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3d040846b0 con 0x7f3d0c15e090 2023-07-09T21:23:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.521+0000 7f3d1151e640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 0x7f3cf0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.525+0000 7f3d1151e640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 0x7f3cf0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d08007fd0 tx=0x7f3d08009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.525+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3d04051c30 con 0x7f3d0c15e090 2023-07-09T21:23:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d0c04d7d0 con 0x7f3d0c15e090 2023-07-09T21:23:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d01ffb640 1 -- 172.21.15.37:0/709258146 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d04082e60 con 0x7f3d0c15e090 2023-07-09T21:23:12.686 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 msgr2=0x7f3cf0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 0x7f3cf0068730 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3d08007fd0 tx=0x7f3d08009040 comp rx=0 tx=0).stop 2023-07-09T21:23:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 msgr2=0x7f3d0c1631f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d0400efc0 tx=0x7f3d0400c490 comp rx=0 tx=0).stop 2023-07-09T21:23:12.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 shutdown_connections 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3cf0066280 0x7f3cf0068730 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d0c15e090 0x7f3d0c1631f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3d0c15cec0 0x7f3d0c153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 --2- 172.21.15.37:0/709258146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3d0c0cf500 0x7f3d0c0b4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 >> 172.21.15.37:0/709258146 conn(0x7f3d0c06d230 msgr2=0x7f3d0c0cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 shutdown_connections 2023-07-09T21:23:12.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.681+0000 7f3d13782640 1 -- 172.21.15.37:0/709258146 wait complete. 2023-07-09T21:23:12.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 Processor -- start 2023-07-09T21:23:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 -- start start 2023-07-09T21:23:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 0x7fc6800cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6800b47a0 0x7fc6800b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6800cef80 con 0x7fc6800b4140 2023-07-09T21:23:12.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6800b45b0 con 0x7fc6800b47a0 2023-07-09T21:23:12.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc686fd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6800cf260 con 0x7fc6800b7a60 2023-07-09T21:23:12.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc684d6e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 0x7fc6800cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc677fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6800b47a0 0x7fc6800b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc68556f640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc6800b4140 0x7fc68015f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:46632/0 (socket says 172.21.15.37:46632) 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc68556f640 1 -- 172.21.15.37:0/398638007 learned_addr learned my addr 172.21.15.37:0/398638007 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc684d6e640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 0x7fc6800cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:48136/0 (socket says 172.21.15.37:48136) 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc677fff640 1 -- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 msgr2=0x7fc6800cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc677fff640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 0x7fc6800cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.845+0000 7fc677fff640 1 -- 172.21.15.37:0/398638007 >> v1:172.21.15.119:6789/0 conn(0x7fc6800b4140 legacy=0x7fc68015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc677fff640 1 -- 172.21.15.37:0/398638007 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6800cf540 con 0x7fc6800b47a0 2023-07-09T21:23:12.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc6777fe640 1 -- 172.21.15.37:0/398638007 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731404398 0 0) 0x7fc6800cef80 con 0x7fc6800b4140 2023-07-09T21:23:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc677fff640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b47a0 0x7fc6800b3c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6700097c0 tx=0x7fc67001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7729d8c5dc07bdb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc6777fe640 1 -- 172.21.15.37:0/398638007 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6700ab600 con 0x7fc6800b47a0 2023-07-09T21:23:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc6777fe640 1 -- 172.21.15.37:0/398638007 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6700a7050 con 0x7fc6800b47a0 2023-07-09T21:23:12.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc6777fe640 1 -- 172.21.15.37:0/398638007 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6700ab980 con 0x7fc6800b47a0 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc686fd2640 1 -- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b47a0 msgr2=0x7fc6800b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.849+0000 7fc686fd2640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b47a0 0x7fc6800b3c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc6700097c0 tx=0x7fc67001c480 comp rx=0 tx=0).stop 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- 172.21.15.37:0/398638007 shutdown_connections 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b47a0 0x7fc6800b3c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 --2- 172.21.15.37:0/398638007 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b7a60 0x7fc6800cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- 172.21.15.37:0/398638007 >> 172.21.15.37:0/398638007 conn(0x7fc680073050 msgr2=0x7fc680069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:12.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- 172.21.15.37:0/398638007 shutdown_connections 2023-07-09T21:23:12.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- 172.21.15.37:0/398638007 wait complete. 2023-07-09T21:23:12.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 Processor -- start 2023-07-09T21:23:12.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- start start 2023-07-09T21:23:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b4140 0x7fc6801539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b47a0 0x7fc68015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68015dfb0 con 0x7fc6800b7a60 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc680153ef0 con 0x7fc6800b4140 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc686fd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68015d3a0 con 0x7fc6800b47a0 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38146/0 (socket says 172.21.15.37:38146) 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 -- 172.21.15.37:0/300532620 learned_addr learned my addr 172.21.15.37:0/300532620 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:12.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc684d6e640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b4140 0x7fc6801539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc677fff640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b47a0 0x7fc68015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 -- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b47a0 msgr2=0x7fc68015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b47a0 0x7fc68015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 -- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b4140 msgr2=0x7fc6801539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b4140 0x7fc6801539b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.853+0000 7fc68556f640 1 -- 172.21.15.37:0/300532620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc670009420 con 0x7fc6800b7a60 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc68556f640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c780 tx=0x7fc67800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800ce90 con 0x7fc6800b7a60 2023-07-09T21:23:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67800a640 con 0x7fc6800b7a60 2023-07-09T21:23:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68015d680 con 0x7fc6800b7a60 2023-07-09T21:23:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67800a9d0 con 0x7fc6800b7a60 2023-07-09T21:23:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68015dc40 con 0x7fc6800b7a60 2023-07-09T21:23:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6800cdaa0 con 0x7fc6800b7a60 2023-07-09T21:23:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc67800ab30 con 0x7fc6800b7a60 2023-07-09T21:23:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 0x7fc66c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.857+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc678083580 con 0x7fc6800b7a60 2023-07-09T21:23:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.861+0000 7fc684d6e640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 0x7fc66c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.861+0000 7fc684d6e640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 0x7fc66c068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009b60 tx=0x7fc67c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:12.861+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6780509d0 con 0x7fc6800b7a60 2023-07-09T21:23:13.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.029+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc68004d7d0 con 0x7fc6800b7a60 2023-07-09T21:23:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.029+0000 7fc6757fa640 1 -- 172.21.15.37:0/300532620 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc678053ff0 con 0x7fc6800b7a60 2023-07-09T21:23:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 msgr2=0x7fc66c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 0x7fc66c068730 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009b60 tx=0x7fc67c009190 comp rx=0 tx=0).stop 2023-07-09T21:23:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 msgr2=0x7fc6800b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c780 tx=0x7fc67800cc40 comp rx=0 tx=0).stop 2023-07-09T21:23:13.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 shutdown_connections 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc66c066280 0x7fc66c068730 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6800b7a60 0x7fc6800b60f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6800b47a0 0x7fc68015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 --2- 172.21.15.37:0/300532620 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc6800b4140 0x7fc6801539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 >> 172.21.15.37:0/300532620 conn(0x7fc680073050 msgr2=0x7fc6800c8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 shutdown_connections 2023-07-09T21:23:13.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.033+0000 7fc686fd2640 1 -- 172.21.15.37:0/300532620 wait complete. 2023-07-09T21:23:13.058 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-07-09T21:23:13.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:13.059 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-07-09T21:23:13.096 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:13.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:23:13.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:13.097 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:23:13.169 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:13.170 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:13.178 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:13.179 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:13.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:13.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 Processor -- start 2023-07-09T21:23:13.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 -- start start 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f036406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03640cef80 0x7f03640d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03640b49f0 con 0x7f03640b7ab0 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03640b7e80 con 0x7f03640cef80 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f036b29c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640cc8a0 con 0x7f03640b4340 2023-07-09T21:23:13.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0369038640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f03640b7ab0 0x7f03640b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46932/0 (socket says 172.21.15.37:46932) 2023-07-09T21:23:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0369038640 1 -- 172.21.15.37:0/232003563 learned_addr learned my addr 172.21.15.37:0/232003563 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0368837640 1 --2- 172.21.15.37:0/232003563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f036406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0369839640 1 --2- 172.21.15.37:0/232003563 >> v2:172.21.15.119:3300/0 conn(0x7f03640cef80 0x7f03640d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f035bfff640 1 -- 172.21.15.37:0/232003563 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35589852 0 0) 0x7f03640b49f0 con 0x7f03640b7ab0 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f035bfff640 1 -- 172.21.15.37:0/232003563 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0350003530 con 0x7f03640b7ab0 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0368837640 1 -- 172.21.15.37:0/232003563 >> v2:172.21.15.119:3300/0 conn(0x7f03640cef80 msgr2=0x7f03640d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0368837640 1 --2- 172.21.15.37:0/232003563 >> v2:172.21.15.119:3300/0 conn(0x7f03640cef80 0x7f03640d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0368837640 1 -- 172.21.15.37:0/232003563 >> v1:172.21.15.37:6789/0 conn(0x7f03640b7ab0 legacy=0x7f03640b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.409+0000 7f0368837640 1 -- 172.21.15.37:0/232003563 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03640ccb80 con 0x7f03640b4340 2023-07-09T21:23:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f0368837640 1 --2- 172.21.15.37:0/232003563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f036406aa50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03540097c0 tx=0x7f035401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1a863e7e5d98f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f035bfff640 1 -- 172.21.15.37:0/232003563 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540ab650 con 0x7f03640b4340 2023-07-09T21:23:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f035bfff640 1 -- 172.21.15.37:0/232003563 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03540ab7b0 con 0x7f03640b4340 2023-07-09T21:23:13.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f035bfff640 1 -- 172.21.15.37:0/232003563 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540abb40 con 0x7f03640b4340 2023-07-09T21:23:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 -- 172.21.15.37:0/232003563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 msgr2=0x7f036406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 --2- 172.21.15.37:0/232003563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f036406aa50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03540097c0 tx=0x7f035401c450 comp rx=0 tx=0).stop 2023-07-09T21:23:13.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 -- 172.21.15.37:0/232003563 shutdown_connections 2023-07-09T21:23:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 --2- 172.21.15.37:0/232003563 >> v2:172.21.15.119:3300/0 conn(0x7f03640cef80 0x7f03640d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 --2- 172.21.15.37:0/232003563 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f036406aa50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 -- 172.21.15.37:0/232003563 >> 172.21.15.37:0/232003563 conn(0x7f0364073090 msgr2=0x7f0364069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 -- 172.21.15.37:0/232003563 shutdown_connections 2023-07-09T21:23:13.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.413+0000 7f036b29c640 1 -- 172.21.15.37:0/232003563 wait complete. 2023-07-09T21:23:13.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 Processor -- start 2023-07-09T21:23:13.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 -- start start 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f0364156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 0x7f03640c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640cc040 con 0x7f03640b7ab0 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03640c7120 con 0x7f03640cef80 2023-07-09T21:23:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03640c6510 con 0x7f03640b4340 2023-07-09T21:23:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38156/0 (socket says 172.21.15.37:38156) 2023-07-09T21:23:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 -- 172.21.15.37:0/318131461 learned_addr learned my addr 172.21.15.37:0/318131461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0369038640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f0364156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0369839640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 0x7f03640c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 -- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 msgr2=0x7f0364156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f0364156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 -- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 msgr2=0x7f03640c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 0x7f03640c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 -- 172.21.15.37:0/318131461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0354009420 con 0x7f03640b7ab0 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0369839640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 0x7f03640c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0368837640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f03540ad040 tx=0x7f035401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540bf610 con 0x7f03640b7ab0 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03540bf7b0 con 0x7f03640b7ab0 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540bfb60 con 0x7f03640b7ab0 2023-07-09T21:23:13.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.417+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03640c67f0 con 0x7f03640b7ab0 2023-07-09T21:23:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03640c6db0 con 0x7f03640b7ab0 2023-07-09T21:23:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f036404d7d0 con 0x7f03640b7ab0 2023-07-09T21:23:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03540b5400 con 0x7f03640b7ab0 2023-07-09T21:23:13.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f0359ffb640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 0x7f0348068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f035411e7a0 con 0x7f03640b7ab0 2023-07-09T21:23:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.421+0000 7f0369038640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 0x7f0348068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.425+0000 7f0369038640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 0x7f0348068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03600011f0 tx=0x7f0360007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.425+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03540ebdb0 con 0x7f03640b7ab0 2023-07-09T21:23:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.581+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f036406a830 con 0x7f03640b7ab0 2023-07-09T21:23:13.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.581+0000 7f0359ffb640 1 -- 172.21.15.37:0/318131461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f03540ef3d0 con 0x7f03640b7ab0 2023-07-09T21:23:13.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:13.588 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 msgr2=0x7f0348068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 0x7f0348068730 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f03600011f0 tx=0x7f0360007d40 comp rx=0 tx=0).stop 2023-07-09T21:23:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 msgr2=0x7f03640cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f03540ad040 tx=0x7f035401ac90 comp rx=0 tx=0).stop 2023-07-09T21:23:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 shutdown_connections 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0348066280 0x7f0348068730 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03640cef80 0x7f03640c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03640b7ab0 0x7f03640cbb00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 --2- 172.21.15.37:0/318131461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03640b4340 0x7f0364156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 >> 172.21.15.37:0/318131461 conn(0x7f0364073090 msgr2=0x7f0364069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 shutdown_connections 2023-07-09T21:23:13.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.585+0000 7f036b29c640 1 -- 172.21.15.37:0/318131461 wait complete. 2023-07-09T21:23:13.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:13.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 Processor -- start 2023-07-09T21:23:13.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 -- start start 2023-07-09T21:23:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14300b7980 0x7f1430160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14300ceb80 0x7f14300cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143015bf80 con 0x7f14300b3c20 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300cd070 con 0x7f14300ceb80 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1434974640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14300cfd70 con 0x7f14300b7980 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1427fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14300ceb80 0x7f14300cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f142ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14300b3c20 0x7f14300b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46942/0 (socket says 172.21.15.37:46942) 2023-07-09T21:23:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f142ed9d640 1 -- 172.21.15.37:0/3178318393 learned_addr learned my addr 172.21.15.37:0/3178318393 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f142e59c640 1 --2- 172.21.15.37:0/3178318393 >> v2:172.21.15.119:3300/0 conn(0x7f14300b7980 0x7f1430160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1427fff640 1 -- 172.21.15.37:0/3178318393 >> v2:172.21.15.119:3300/0 conn(0x7f14300b7980 msgr2=0x7f1430160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1427fff640 1 --2- 172.21.15.37:0/3178318393 >> v2:172.21.15.119:3300/0 conn(0x7f14300b7980 0x7f1430160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1427fff640 1 -- 172.21.15.37:0/3178318393 >> v1:172.21.15.37:6789/0 conn(0x7f14300b3c20 legacy=0x7f14300b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f1427fff640 1 -- 172.21.15.37:0/3178318393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1430160570 con 0x7f14300ceb80 2023-07-09T21:23:13.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.749+0000 7f142dd9b640 1 -- 172.21.15.37:0/3178318393 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584151480 0 0) 0x7f14280014a0 con 0x7f14300b3c20 2023-07-09T21:23:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1427fff640 1 --2- 172.21.15.37:0/3178318393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300ceb80 0x7f14300cefc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1430069aa0 tx=0x7f141801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2771c1379cc1ec4d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f142dd9b640 1 -- 172.21.15.37:0/3178318393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180ab600 con 0x7f14300ceb80 2023-07-09T21:23:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f142dd9b640 1 -- 172.21.15.37:0/3178318393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180a7050 con 0x7f14300ceb80 2023-07-09T21:23:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f142dd9b640 1 -- 172.21.15.37:0/3178318393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180ab980 con 0x7f14300ceb80 2023-07-09T21:23:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 -- 172.21.15.37:0/3178318393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300ceb80 msgr2=0x7f14300cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 --2- 172.21.15.37:0/3178318393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300ceb80 0x7f14300cefc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1430069aa0 tx=0x7f141801c460 comp rx=0 tx=0).stop 2023-07-09T21:23:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 -- 172.21.15.37:0/3178318393 shutdown_connections 2023-07-09T21:23:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 --2- 172.21.15.37:0/3178318393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300ceb80 0x7f14300cefc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 --2- 172.21.15.37:0/3178318393 >> v2:172.21.15.119:3300/0 conn(0x7f14300b7980 0x7f1430160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 -- 172.21.15.37:0/3178318393 >> 172.21.15.37:0/3178318393 conn(0x7f1430073090 msgr2=0x7f1430069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 -- 172.21.15.37:0/3178318393 shutdown_connections 2023-07-09T21:23:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.753+0000 7f1434974640 1 -- 172.21.15.37:0/3178318393 wait complete. 2023-07-09T21:23:13.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 Processor -- start 2023-07-09T21:23:13.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 -- start start 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14300b3c20 0x7f1430141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14300ceb80 0x7f14300cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1430141cd0 con 0x7f14300b7980 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14300cab10 con 0x7f14300b3c20 2023-07-09T21:23:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14300cadf0 con 0x7f14300ceb80 2023-07-09T21:23:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38170/0 (socket says 172.21.15.37:38170) 2023-07-09T21:23:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 -- 172.21.15.37:0/770396776 learned_addr learned my addr 172.21.15.37:0/770396776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f142e59c640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14300b3c20 0x7f1430141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f142ed9d640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14300ceb80 0x7f14300cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 -- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14300ceb80 msgr2=0x7f14300cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14300ceb80 0x7f14300cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 -- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14300b3c20 msgr2=0x7f1430141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14300b3c20 0x7f1430141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 -- 172.21.15.37:0/770396776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1418009420 con 0x7f14300b7980 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1427fff640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f14180ae040 tx=0x7f1418019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180b4840 con 0x7f14300b7980 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14180b49c0 con 0x7f14300b7980 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14180b4d70 con 0x7f14300b7980 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.757+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14300cb0d0 con 0x7f14300b7980 2023-07-09T21:23:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14300cb690 con 0x7f14300b7980 2023-07-09T21:23:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14300cd600 con 0x7f14300b7980 2023-07-09T21:23:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f14180b2040 con 0x7f14300b7980 2023-07-09T21:23:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f1426ffd640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 0x7f1410068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:13.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f141811ddd0 con 0x7f14300b7980 2023-07-09T21:23:13.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f142e59c640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 0x7f1410068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:13.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.761+0000 7f142e59c640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 0x7f1410068760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1420007a60 tx=0x7f1420008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:13.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.765+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14300cd600 con 0x7f14300b7980 2023-07-09T21:23:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1430160570 con 0x7f14300b7980 2023-07-09T21:23:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1426ffd640 1 -- 172.21.15.37:0/770396776 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1430160570 con 0x7f14300b7980 2023-07-09T21:23:13.931 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 msgr2=0x7f1410068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 0x7f1410068760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1420007a60 tx=0x7f1420008040 comp rx=0 tx=0).stop 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 msgr2=0x7f1430153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f14180ae040 tx=0x7f1418019200 comp rx=0 tx=0).stop 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 shutdown_connections 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14100662b0 0x7f1410068760 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14300ceb80 0x7f14300cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14300b7980 0x7f1430153ac0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 --2- 172.21.15.37:0/770396776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14300b3c20 0x7f1430141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 >> 172.21.15.37:0/770396776 conn(0x7f1430073090 msgr2=0x7f14300b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 shutdown_connections 2023-07-09T21:23:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:13.925+0000 7f1434974640 1 -- 172.21.15.37:0/770396776 wait complete. 2023-07-09T21:23:13.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 Processor -- start 2023-07-09T21:23:14.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 -- start start 2023-07-09T21:23:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84400cf290 0x7f8440160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844015bf80 con 0x7f84400b7980 2023-07-09T21:23:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8440160570 con 0x7f84400d0780 2023-07-09T21:23:14.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.093+0000 7f8444dd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84400cd070 con 0x7f84400cf290 2023-07-09T21:23:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84400b7980 0x7f84400ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46950/0 (socket says 172.21.15.37:46950) 2023-07-09T21:23:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843e59c640 1 -- 172.21.15.37:0/2627731753 learned_addr learned my addr 172.21.15.37:0/2627731753 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 --2- 172.21.15.37:0/2627731753 >> v2:172.21.15.119:3300/0 conn(0x7f84400cf290 0x7f8440160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012392399 0 0) 0x7f8430001120 con 0x7f84400b7980 2023-07-09T21:23:14.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c003530 con 0x7f84400b7980 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1214446697 0 0) 0x7f842c003530 con 0x7f84400b7980 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 >> v2:172.21.15.119:3300/0 conn(0x7f84400cf290 msgr2=0x7f8440160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 --2- 172.21.15.37:0/2627731753 >> v2:172.21.15.119:3300/0 conn(0x7f84400cf290 0x7f8440160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 >> v1:172.21.15.119:6789/0 conn(0x7f84400d0780 legacy=0x7f84400d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400d02f0 con 0x7f84400b7980 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f8430001810 con 0x7f84400b7980 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 >> v1:172.21.15.37:6789/0 conn(0x7f84400b7980 legacy=0x7f84400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c003980 0x7f842c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 0x7f842c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c005030 0x7f842c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400cd070 con 0x7f842c004370 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c00bf80 con 0x7f842c003980 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c00c140 con 0x7f842c005030 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 0x7f842c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843e59c640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c003980 0x7f842c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843ed9d640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c005030 0x7f842c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 -- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c005030 msgr2=0x7f842c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c005030 0x7f842c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 -- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c003980 msgr2=0x7f842c003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c003980 0x7f842c003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f8437fff640 1 -- 172.21.15.37:0/2627731753 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c003530 con 0x7f842c004370 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843ed9d640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c005030 0x7f842c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.097+0000 7f843ed9d640 1 -- 172.21.15.37:0/2627731753 reap_dead start 2023-07-09T21:23:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8437fff640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 0x7f842c004830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8428009ab0 tx=0x7f842801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641a7efd7ea61cb4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280a5620 con 0x7f842c004370 2023-07-09T21:23:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84280a5780 con 0x7f842c004370 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f843dd9b640 1 -- 172.21.15.37:0/2627731753 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84280a5b30 con 0x7f842c004370 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 msgr2=0x7f842c004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 0x7f842c004830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8428009ab0 tx=0x7f842801ca30 comp rx=0 tx=0).stop 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- 172.21.15.37:0/2627731753 shutdown_connections 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 --2- 172.21.15.37:0/2627731753 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c004370 0x7f842c004830 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- 172.21.15.37:0/2627731753 >> 172.21.15.37:0/2627731753 conn(0x7f8440073090 msgr2=0x7f8440069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- 172.21.15.37:0/2627731753 shutdown_connections 2023-07-09T21:23:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- 172.21.15.37:0/2627731753 wait complete. 2023-07-09T21:23:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 Processor -- start 2023-07-09T21:23:14.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.101+0000 7f8444dd2640 1 -- start start 2023-07-09T21:23:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c004370 0x7f84400c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 0x7f844014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400b3e90 con 0x7f84400b34b0 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400c6060 con 0x7f842c004370 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844015eed0 con 0x7f844015e6f0 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38190/0 (socket says 172.21.15.37:38190) 2023-07-09T21:23:14.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 -- 172.21.15.37:0/669223018 learned_addr learned my addr 172.21.15.37:0/669223018 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8437fff640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 0x7f844014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843e59c640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c004370 0x7f84400c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 -- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 msgr2=0x7f844014fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 0x7f844014fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 -- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c004370 msgr2=0x7f84400c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c004370 0x7f84400c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 -- 172.21.15.37:0/669223018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400c9270 con 0x7f84400b34b0 2023-07-09T21:23:14.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8437fff640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 0x7f844014fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:14.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f843ed9d640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f844008ad30 tx=0x7f8438011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380136e0 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438013840 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400c9550 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438013bd0 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400c9b10 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84400c9d30 con 0x7f84400b34b0 2023-07-09T21:23:14.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.105+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8438013d30 con 0x7f84400b34b0 2023-07-09T21:23:14.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.109+0000 7f8436ffd640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 0x7f8420068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.109+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f8438086070 con 0x7f84400b34b0 2023-07-09T21:23:14.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.109+0000 7f843e59c640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 0x7f8420068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.109+0000 7f843e59c640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 0x7f8420068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84400c5e30 tx=0x7f8430009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.113+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8438056f30 con 0x7f84400b34b0 2023-07-09T21:23:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f844004d7d0 con 0x7f84400b34b0 2023-07-09T21:23:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8436ffd640 1 -- 172.21.15.37:0/669223018 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f843801c070 con 0x7f84400b34b0 2023-07-09T21:23:14.275 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 msgr2=0x7f8420068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 0x7f8420068760 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84400c5e30 tx=0x7f8430009040 comp rx=0 tx=0).stop 2023-07-09T21:23:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 msgr2=0x7f84400b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f844008ad30 tx=0x7f8438011bc0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 shutdown_connections 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f84200662b0 0x7f8420068760 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84400b34b0 0x7f84400b3950 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f844015e6f0 0x7f844014fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 --2- 172.21.15.37:0/669223018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c004370 0x7f84400c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 >> 172.21.15.37:0/669223018 conn(0x7f8440073090 msgr2=0x7f84400ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 shutdown_connections 2023-07-09T21:23:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.269+0000 7f8444dd2640 1 -- 172.21.15.37:0/669223018 wait complete. 2023-07-09T21:23:14.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.433+0000 7fbb5c47b640 1 Processor -- start 2023-07-09T21:23:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.433+0000 7fbb5c47b640 1 -- start start 2023-07-09T21:23:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5c47b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb540b7980 0x7fbb54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5c47b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb540ceb80 0x7fbb540cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5c47b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5415bf80 con 0x7fbb540b3c20 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5c47b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540cd070 con 0x7fbb540b7980 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5c47b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb540cfd70 con 0x7fbb540ceb80 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb540b7980 0x7fbb54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb540b7980 0x7fbb54160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38194/0 (socket says 172.21.15.37:38194) 2023-07-09T21:23:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 -- 172.21.15.37:0/1079600279 learned_addr learned my addr 172.21.15.37:0/1079600279 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5aa18640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbb540b3c20 0x7fbb540b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46954/0 (socket says 172.21.15.37:46954) 2023-07-09T21:23:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb59a16640 1 --2- 172.21.15.37:0/1079600279 >> v2:172.21.15.119:3300/0 conn(0x7fbb540ceb80 0x7fbb540cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 -- 172.21.15.37:0/1079600279 >> v2:172.21.15.119:3300/0 conn(0x7fbb540ceb80 msgr2=0x7fbb540cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 --2- 172.21.15.37:0/1079600279 >> v2:172.21.15.119:3300/0 conn(0x7fbb540ceb80 0x7fbb540cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 -- 172.21.15.37:0/1079600279 >> v1:172.21.15.37:6789/0 conn(0x7fbb540b3c20 legacy=0x7fbb540b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.437+0000 7fbb5a217640 1 -- 172.21.15.37:0/1079600279 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb54160570 con 0x7fbb540b7980 2023-07-09T21:23:14.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5a217640 1 --2- 172.21.15.37:0/1079600279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54160030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b4cd0 tx=0x7fbb5001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437b4e4d1ab75513 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb59215640 1 -- 172.21.15.37:0/1079600279 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500ab600 con 0x7fbb540b7980 2023-07-09T21:23:14.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb59215640 1 -- 172.21.15.37:0/1079600279 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb500a7050 con 0x7fbb540b7980 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb59215640 1 -- 172.21.15.37:0/1079600279 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb500ab980 con 0x7fbb540b7980 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- 172.21.15.37:0/1079600279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 msgr2=0x7fbb54160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/1079600279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54160030 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fbb540b4cd0 tx=0x7fbb5001c500 comp rx=0 tx=0).stop 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- 172.21.15.37:0/1079600279 shutdown_connections 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/1079600279 >> v2:172.21.15.119:3300/0 conn(0x7fbb540ceb80 0x7fbb540cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/1079600279 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54160030 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- 172.21.15.37:0/1079600279 >> 172.21.15.37:0/1079600279 conn(0x7fbb54073090 msgr2=0x7fbb54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- 172.21.15.37:0/1079600279 shutdown_connections 2023-07-09T21:23:14.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- 172.21.15.37:0/1079600279 wait complete. 2023-07-09T21:23:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 Processor -- start 2023-07-09T21:23:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.441+0000 7fbb5c47b640 1 -- start start 2023-07-09T21:23:14.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 0x7fbb5414d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb540ceb80 0x7fbb5414ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb541530f0 con 0x7fbb540b7980 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54153a50 con 0x7fbb540b3c20 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54152470 con 0x7fbb540ceb80 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38208/0 (socket says 172.21.15.37:38208) 2023-07-09T21:23:14.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 -- 172.21.15.37:0/2409499919 learned_addr learned my addr 172.21.15.37:0/2409499919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 -- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb540ceb80 msgr2=0x7fbb5414ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb540ceb80 0x7fbb5414ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 -- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 msgr2=0x7fbb5414d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5a217640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 0x7fbb5414d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 0x7fbb5414d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 -- 172.21.15.37:0/2409499919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb500094d0 con 0x7fbb540b7980 2023-07-09T21:23:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5a217640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 0x7fbb5414d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb59a16640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400e870 tx=0x7fbb4400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44009510 con 0x7fbb540b7980 2023-07-09T21:23:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400eec0 con 0x7fbb540b7980 2023-07-09T21:23:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400cb40 con 0x7fbb540b7980 2023-07-09T21:23:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb54152750 con 0x7fbb540b7980 2023-07-09T21:23:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb54152d10 con 0x7fbb540b7980 2023-07-09T21:23:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54153230 con 0x7fbb540b7980 2023-07-09T21:23:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.445+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbb4400cca0 con 0x7fbb540b7980 2023-07-09T21:23:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.449+0000 7fbb4affd640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 0x7fbb38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.449+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbb44083f60 con 0x7fbb540b7980 2023-07-09T21:23:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.449+0000 7fbb5a217640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 0x7fbb38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.449+0000 7fbb5a217640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 0x7fbb38068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ad000 tx=0x7fbb50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.453+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb54153230 con 0x7fbb540b7980 2023-07-09T21:23:14.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.605+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb54153230 con 0x7fbb540b7980 2023-07-09T21:23:14.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.605+0000 7fbb4affd640 1 -- 172.21.15.37:0/2409499919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb44021020 con 0x7fbb540b7980 2023-07-09T21:23:14.614 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 msgr2=0x7fbb38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 0x7fbb38068730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbb500ad000 tx=0x7fbb50008040 comp rx=0 tx=0).stop 2023-07-09T21:23:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 msgr2=0x7fbb54153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400e870 tx=0x7fbb4400ec70 comp rx=0 tx=0).stop 2023-07-09T21:23:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 shutdown_connections 2023-07-09T21:23:14.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbb38066280 0x7fbb38068730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb540ceb80 0x7fbb5414ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb540b7980 0x7fbb54153510 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 --2- 172.21.15.37:0/2409499919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb540b3c20 0x7fbb5414d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 >> 172.21.15.37:0/2409499919 conn(0x7fbb54073090 msgr2=0x7fbb540b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 shutdown_connections 2023-07-09T21:23:14.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.609+0000 7fbb5c47b640 1 -- 172.21.15.37:0/2409499919 wait complete. 2023-07-09T21:23:14.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 Processor -- start 2023-07-09T21:23:14.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 -- start start 2023-07-09T21:23:14.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06415bf80 con 0x7fe0640b7980 2023-07-09T21:23:14.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe064160570 con 0x7fe0640d0780 2023-07-09T21:23:14.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe06a12c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640cd070 con 0x7fe0640cf290 2023-07-09T21:23:14.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0637fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0640b7980 0x7fe0640ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46964/0 (socket says 172.21.15.37:46964) 2023-07-09T21:23:14.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0637fe640 1 -- 172.21.15.37:0/2692333107 learned_addr learned my addr 172.21.15.37:0/2692333107 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:14.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe062ffd640 1 --2- 172.21.15.37:0/2692333107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693388540 0 0) 0x7fe054001120 con 0x7fe0640b7980 2023-07-09T21:23:14.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe04c003530 con 0x7fe0640b7980 2023-07-09T21:23:14.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539515587 0 0) 0x7fe05c0014a0 con 0x7fe0640d0780 2023-07-09T21:23:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe054001120 con 0x7fe0640d0780 2023-07-09T21:23:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe062ffd640 1 -- 172.21.15.37:0/2692333107 >> v1:172.21.15.119:6789/0 conn(0x7fe0640d0780 legacy=0x7fe0640d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe062ffd640 1 -- 172.21.15.37:0/2692333107 >> v1:172.21.15.37:6789/0 conn(0x7fe0640b7980 legacy=0x7fe0640ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.773+0000 7fe062ffd640 1 -- 172.21.15.37:0/2692333107 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640d02f0 con 0x7fe0640cf290 2023-07-09T21:23:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe062ffd640 1 --2- 172.21.15.37:0/2692333107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097f0 tx=0x7fe05801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=447cea903824ca79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580ab600 con 0x7fe0640cf290 2023-07-09T21:23:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0580a7050 con 0x7fe0640cf290 2023-07-09T21:23:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe0627fc640 1 -- 172.21.15.37:0/2692333107 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0580ab980 con 0x7fe0640cf290 2023-07-09T21:23:14.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 -- 172.21.15.37:0/2692333107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 msgr2=0x7fe064160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 --2- 172.21.15.37:0/2692333107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe0580097f0 tx=0x7fe05801c4c0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 -- 172.21.15.37:0/2692333107 shutdown_connections 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 --2- 172.21.15.37:0/2692333107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 -- 172.21.15.37:0/2692333107 >> 172.21.15.37:0/2692333107 conn(0x7fe064073090 msgr2=0x7fe064069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 -- 172.21.15.37:0/2692333107 shutdown_connections 2023-07-09T21:23:14.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.777+0000 7fe06a12c640 1 -- 172.21.15.37:0/2692333107 wait complete. 2023-07-09T21:23:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 Processor -- start 2023-07-09T21:23:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- start start 2023-07-09T21:23:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640b7980 0x7fe064151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe064152e60 con 0x7fe0640d0780 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0641532f0 con 0x7fe0640b7980 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe064151f70 con 0x7fe0640cf290 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38220/0 (socket says 172.21.15.37:38220) 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 -- 172.21.15.37:0/986621261 learned_addr learned my addr 172.21.15.37:0/986621261 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:14.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe062ffd640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe0637fe640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640b7980 0x7fe064151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 -- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 msgr2=0x7fe064153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 -- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640b7980 msgr2=0x7fe064151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640b7980 0x7fe064151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 -- 172.21.15.37:0/986621261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe058009420 con 0x7fe0640d0780 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe063fff640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c790 tx=0x7fe05c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00cea0 con 0x7fe0640d0780 2023-07-09T21:23:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c003ba0 con 0x7fe0640d0780 2023-07-09T21:23:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe064152250 con 0x7fe0640d0780 2023-07-09T21:23:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00a850 con 0x7fe0640d0780 2023-07-09T21:23:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.781+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe064152810 con 0x7fe0640d0780 2023-07-09T21:23:14.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe064152fd0 con 0x7fe0640d0780 2023-07-09T21:23:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe05c00a9b0 con 0x7fe0640d0780 2023-07-09T21:23:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe04bfff640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe05c0838b0 con 0x7fe0640d0780 2023-07-09T21:23:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe0637fe640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:14.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.785+0000 7fe0637fe640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 0x7fe050068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe054007fd0 tx=0x7fe054007d60 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.789+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe05c050e30 con 0x7fe0640d0780 2023-07-09T21:23:14.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.945+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe064160570 con 0x7fe0640d0780 2023-07-09T21:23:14.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.945+0000 7fe04bfff640 1 -- 172.21.15.37:0/986621261 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe064160570 con 0x7fe0640d0780 2023-07-09T21:23:14.952 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 msgr2=0x7fe050068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 0x7fe050068730 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe054007fd0 tx=0x7fe054007d60 comp rx=0 tx=0).stop 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 msgr2=0x7fe064150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c790 tx=0x7fe05c00cc50 comp rx=0 tx=0).stop 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 shutdown_connections 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe050066280 0x7fe050068730 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640d0780 0x7fe064150240 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 --2- 172.21.15.37:0/986621261 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640b7980 0x7fe064151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:14.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 >> 172.21.15.37:0/986621261 conn(0x7fe064073090 msgr2=0x7fe06415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:14.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 shutdown_connections 2023-07-09T21:23:14.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:14.949+0000 7fe06a12c640 1 -- 172.21.15.37:0/986621261 wait complete. 2023-07-09T21:23:14.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:15.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.109+0000 7f9a1fc34640 1 Processor -- start 2023-07-09T21:23:15.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 -- start start 2023-07-09T21:23:15.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9a180b7a60 0x7f9a180cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a180b47a0 0x7f9a180b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b4140 0x7f9a1815f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180b45b0 con 0x7f9a180b47a0 2023-07-09T21:23:15.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a180cef80 con 0x7f9a180b7a60 2023-07-09T21:23:15.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1fc34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a180cf260 con 0x7f9a180b4140 2023-07-09T21:23:15.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a180b47a0 0x7f9a180b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9a180b47a0 0x7f9a180b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38228/0 (socket says 172.21.15.37:38228) 2023-07-09T21:23:15.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 -- 172.21.15.37:0/3269217496 learned_addr learned my addr 172.21.15.37:0/3269217496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:15.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1e1d1640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b4140 0x7f9a1815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d9d0640 1 --2- 172.21.15.37:0/3269217496 >> v2:172.21.15.119:3300/0 conn(0x7f9a180b7a60 0x7f9a180cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 -- 172.21.15.37:0/3269217496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b4140 msgr2=0x7f9a1815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b4140 0x7f9a1815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 -- 172.21.15.37:0/3269217496 >> v2:172.21.15.119:3300/0 conn(0x7f9a180b7a60 msgr2=0x7f9a180cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/3269217496 >> v2:172.21.15.119:3300/0 conn(0x7f9a180b7a60 0x7f9a180cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.113+0000 7f9a1d1cf640 1 -- 172.21.15.37:0/3269217496 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a180cf540 con 0x7f9a180b47a0 2023-07-09T21:23:15.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b47a0 0x7f9a180b3c00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a180cde60 tx=0x7f9a0801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b2849e03773fc60 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1c9ce640 1 -- 172.21.15.37:0/3269217496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080ab600 con 0x7f9a180b47a0 2023-07-09T21:23:15.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1c9ce640 1 -- 172.21.15.37:0/3269217496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a080a7050 con 0x7f9a180b47a0 2023-07-09T21:23:15.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1c9ce640 1 -- 172.21.15.37:0/3269217496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a080ab980 con 0x7f9a180b47a0 2023-07-09T21:23:15.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- 172.21.15.37:0/3269217496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b47a0 msgr2=0x7f9a180b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b47a0 0x7f9a180b3c00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a180cde60 tx=0x7f9a0801c240 comp rx=0 tx=0).stop 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- 172.21.15.37:0/3269217496 shutdown_connections 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b47a0 0x7f9a180b3c00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/3269217496 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b4140 0x7f9a1815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/3269217496 >> v2:172.21.15.119:3300/0 conn(0x7f9a180b7a60 0x7f9a180cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- 172.21.15.37:0/3269217496 >> 172.21.15.37:0/3269217496 conn(0x7f9a18073050 msgr2=0x7f9a18069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:15.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- 172.21.15.37:0/3269217496 shutdown_connections 2023-07-09T21:23:15.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- 172.21.15.37:0/3269217496 wait complete. 2023-07-09T21:23:15.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 Processor -- start 2023-07-09T21:23:15.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.117+0000 7f9a1fc34640 1 -- start start 2023-07-09T21:23:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b47a0 0x7f9a181553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a180b7a60 0x7f9a1815ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1815d340 con 0x7f9a180b4140 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1815d620 con 0x7f9a180b7a60 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1815d900 con 0x7f9a180b47a0 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38236/0 (socket says 172.21.15.37:38236) 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 -- 172.21.15.37:0/1389091117 learned_addr learned my addr 172.21.15.37:0/1389091117 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b47a0 0x7f9a181553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1e1d1640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a180b7a60 0x7f9a1815ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 -- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b47a0 msgr2=0x7f9a181553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b47a0 0x7f9a181553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 -- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a180b7a60 msgr2=0x7f9a1815ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a180b7a60 0x7f9a1815ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 -- 172.21.15.37:0/1389091117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080094d0 con 0x7f9a180b4140 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1d9d0640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e870 tx=0x7f9a1400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a14009510 con 0x7f9a180b4140 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1400eec0 con 0x7f9a180b4140 2023-07-09T21:23:15.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1400cb40 con 0x7f9a180b4140 2023-07-09T21:23:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a1815dbe0 con 0x7f9a180b4140 2023-07-09T21:23:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a181558f0 con 0x7f9a180b4140 2023-07-09T21:23:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.121+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a180cdaa0 con 0x7f9a180b4140 2023-07-09T21:23:15.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.125+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a1400cca0 con 0x7f9a180b4140 2023-07-09T21:23:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.125+0000 7f9a0e7fc640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 0x7f99fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.125+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9a14083e10 con 0x7f9a180b4140 2023-07-09T21:23:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.125+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 0x7f99fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.125+0000 7f9a1d1cf640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 0x7f99fc068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a080ad000 tx=0x7f9a08008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.129+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a14051300 con 0x7f9a180b4140 2023-07-09T21:23:15.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a1815d480 con 0x7f9a180b4140 2023-07-09T21:23:15.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a0e7fc640 1 -- 172.21.15.37:0/1389091117 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a1815d480 con 0x7f9a180b4140 2023-07-09T21:23:15.300 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:15.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 msgr2=0x7f99fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 0x7f99fc068730 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9a080ad000 tx=0x7f9a08008040 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 msgr2=0x7f9a18153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400e870 tx=0x7f9a1400ec70 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 shutdown_connections 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f99fc066280 0x7f99fc068730 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9a180b7a60 0x7f9a1815ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9a180b47a0 0x7f9a181553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 --2- 172.21.15.37:0/1389091117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a180b4140 0x7f9a18153a70 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.293+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 >> 172.21.15.37:0/1389091117 conn(0x7f9a18073050 msgr2=0x7f9a180650b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.297+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 shutdown_connections 2023-07-09T21:23:15.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.297+0000 7f9a1fc34640 1 -- 172.21.15.37:0/1389091117 wait complete. 2023-07-09T21:23:15.320 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:23:15.321 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:15.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 Processor -- start 2023-07-09T21:23:15.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 -- start start 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f144406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14440cef80 0x7f14440d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14440b49f0 con 0x7f14440b7ab0 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14440b7e80 con 0x7f14440cef80 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144c582640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440cc8a0 con 0x7f14440b4340 2023-07-09T21:23:15.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144a31e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14440b7ab0 0x7f14440b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46970/0 (socket says 172.21.15.37:46970) 2023-07-09T21:23:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144a31e640 1 -- 172.21.15.37:0/4157116745 learned_addr learned my addr 172.21.15.37:0/4157116745 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144ab1f640 1 --2- 172.21.15.37:0/4157116745 >> v2:172.21.15.37:3300/0 conn(0x7f14440cef80 0x7f14440d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f1449b1d640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f144406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144931c640 1 -- 172.21.15.37:0/4157116745 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 37006869 0 0) 0x7f14440b49f0 con 0x7f14440b7ab0 2023-07-09T21:23:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144931c640 1 -- 172.21.15.37:0/4157116745 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1430003530 con 0x7f14440b7ab0 2023-07-09T21:23:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144ab1f640 1 -- 172.21.15.37:0/4157116745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 msgr2=0x7f144406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144ab1f640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f144406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144ab1f640 1 -- 172.21.15.37:0/4157116745 >> v1:172.21.15.37:6789/0 conn(0x7f14440b7ab0 legacy=0x7f14440b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.513+0000 7f144ab1f640 1 -- 172.21.15.37:0/4157116745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14440ccb80 con 0x7f14440cef80 2023-07-09T21:23:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144ab1f640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440d02a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ef5198e9eee5437 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144931c640 1 -- 172.21.15.37:0/4157116745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c0a59e0 con 0x7f14440cef80 2023-07-09T21:23:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144931c640 1 -- 172.21.15.37:0/4157116745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c0a5b40 con 0x7f14440cef80 2023-07-09T21:23:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144931c640 1 -- 172.21.15.37:0/4157116745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c0ad440 con 0x7f14440cef80 2023-07-09T21:23:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 -- 172.21.15.37:0/4157116745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 msgr2=0x7f14440d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440d02a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c01c920 comp rx=0 tx=0).stop 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 -- 172.21.15.37:0/4157116745 shutdown_connections 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440d02a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 --2- 172.21.15.37:0/4157116745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f144406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 -- 172.21.15.37:0/4157116745 >> 172.21.15.37:0/4157116745 conn(0x7f1444073090 msgr2=0x7f1444069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 -- 172.21.15.37:0/4157116745 shutdown_connections 2023-07-09T21:23:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.517+0000 7f144c582640 1 -- 172.21.15.37:0/4157116745 wait complete. 2023-07-09T21:23:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 Processor -- start 2023-07-09T21:23:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- start start 2023-07-09T21:23:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f1444147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 0x7f14440b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444156310 con 0x7f14440cef80 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1444147a60 con 0x7f14440b7ab0 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1444155720 con 0x7f14440b4340 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38262/0 (socket says 172.21.15.37:38262) 2023-07-09T21:23:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 -- 172.21.15.37:0/1042971601 learned_addr learned my addr 172.21.15.37:0/1042971601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 -- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 msgr2=0x7f1444147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f1444147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 -- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 msgr2=0x7f14440b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f1449b1d640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 0x7f14440b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 0x7f14440b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 -- 172.21.15.37:0/1042971601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c009a70 con 0x7f14440cef80 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f1449b1d640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 0x7f14440b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144ab1f640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c004240 con 0x7f14440cef80 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c0043a0 con 0x7f14440cef80 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c004730 con 0x7f14440cef80 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1444155970 con 0x7f14440cef80 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.521+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1444155f30 con 0x7f14440cef80 2023-07-09T21:23:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1444156450 con 0x7f14440cef80 2023-07-09T21:23:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f143c0ad440 con 0x7f14440cef80 2023-07-09T21:23:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f143affd640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 0x7f1428068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f143c11f350 con 0x7f14440cef80 2023-07-09T21:23:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f144a31e640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 0x7f1428068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.525+0000 7f144a31e640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 0x7f1428068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f1440007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.529+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1444156450 con 0x7f14440cef80 2023-07-09T21:23:15.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.685+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1444156450 con 0x7f14440cef80 2023-07-09T21:23:15.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.685+0000 7f143affd640 1 -- 172.21.15.37:0/1042971601 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f1444156450 con 0x7f14440cef80 2023-07-09T21:23:15.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:15.692 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 msgr2=0x7f1428068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 0x7f1428068730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1440007fd0 tx=0x7f1440007940 comp rx=0 tx=0).stop 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 msgr2=0x7f14440b39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f143c009d90 tx=0x7f143c0196c0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 shutdown_connections 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1428066280 0x7f1428068730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14440cef80 0x7f14440b39c0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14440b7ab0 0x7f14440b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 --2- 172.21.15.37:0/1042971601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14440b4340 0x7f1444147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 >> 172.21.15.37:0/1042971601 conn(0x7f1444073090 msgr2=0x7f144415b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 shutdown_connections 2023-07-09T21:23:15.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.689+0000 7f144c582640 1 -- 172.21.15.37:0/1042971601 wait complete. 2023-07-09T21:23:15.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:15.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:15.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 Processor -- start 2023-07-09T21:23:15.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 -- start start 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4e8160030 0x7fa4e80d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e815bf80 con 0x7fa4e80b7980 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80d02f0 con 0x7fa4e80cf290 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4ee018640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e80cd070 con 0x7fa4e8160030 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4e80b7980 0x7fa4e80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46980/0 (socket says 172.21.15.37:46980) 2023-07-09T21:23:15.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e77fe640 1 -- 172.21.15.37:0/3843490962 learned_addr learned my addr 172.21.15.37:0/3843490962 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:15.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e7fff640 1 --2- 172.21.15.37:0/3843490962 >> v2:172.21.15.119:3300/0 conn(0x7fa4e8160030 0x7fa4e80d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023034538 0 0) 0x7fa4d8001120 con 0x7fa4e80b7980 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d0003530 con 0x7fa4e80b7980 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1769105822 0 0) 0x7fa4d0003530 con 0x7fa4e80b7980 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 >> v2:172.21.15.119:3300/0 conn(0x7fa4e8160030 msgr2=0x7fa4e80d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 --2- 172.21.15.37:0/3843490962 >> v2:172.21.15.119:3300/0 conn(0x7fa4e8160030 0x7fa4e80d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 >> v1:172.21.15.119:6789/0 conn(0x7fa4e80cf290 legacy=0x7fa4e80d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80cc7f0 con 0x7fa4e80b7980 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fa4d8001810 con 0x7fa4e80b7980 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 >> v1:172.21.15.37:6789/0 conn(0x7fa4e80b7980 legacy=0x7fa4e80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4d0003980 0x7fa4d0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 0x7fa4d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d0005180 0x7fa4d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80cd070 con 0x7fa4d00047d0 2023-07-09T21:23:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d000bfe0 con 0x7fa4d0005180 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.853+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d000c1a0 con 0x7fa4d0003980 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 0x7fa4d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e77fe640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4d0003980 0x7fa4d0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e7fff640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d0005180 0x7fa4d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4d0003980 msgr2=0x7fa4d0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4d0003980 0x7fa4d0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d0005180 msgr2=0x7fa4d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d0005180 0x7fa4d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/3843490962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d0003530 con 0x7fa4d00047d0 2023-07-09T21:23:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e7fff640 1 -- 172.21.15.37:0/3843490962 reap_dead start 2023-07-09T21:23:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 0x7fa4d0004c40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80cf6b0 tx=0x7fa4dc01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58f3237421c428 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0a8810 con 0x7fa4d00047d0 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0a8970 con 0x7fa4d00047d0 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.857+0000 7fa4e67fc640 1 -- 172.21.15.37:0/3843490962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0a8d60 con 0x7fa4d00047d0 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 msgr2=0x7fa4d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 0x7fa4d0004c40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80cf6b0 tx=0x7fa4dc01ebf0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- 172.21.15.37:0/3843490962 shutdown_connections 2023-07-09T21:23:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 --2- 172.21.15.37:0/3843490962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4d00047d0 0x7fa4d0004c40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- 172.21.15.37:0/3843490962 >> 172.21.15.37:0/3843490962 conn(0x7fa4e8073090 msgr2=0x7fa4e8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- 172.21.15.37:0/3843490962 shutdown_connections 2023-07-09T21:23:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- 172.21.15.37:0/3843490962 wait complete. 2023-07-09T21:23:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 Processor -- start 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- start start 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d00047d0 0x7fa4e8153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4e80ca060 0x7fa4e80b4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80b4a00 con 0x7fa4e80b4580 2023-07-09T21:23:15.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80c9bd0 con 0x7fa4d00047d0 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4ee018640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80c9310 con 0x7fa4e80ca060 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38292/0 (socket says 172.21.15.37:38292) 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 -- 172.21.15.37:0/872889730 learned_addr learned my addr 172.21.15.37:0/872889730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e77fe640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d00047d0 0x7fa4e8153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4e80ca060 0x7fa4e80b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 -- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4e80ca060 msgr2=0x7fa4e80b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4e80ca060 0x7fa4e80b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 -- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d00047d0 msgr2=0x7fa4e8153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d00047d0 0x7fa4e8153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.861+0000 7fa4e7fff640 1 -- 172.21.15.37:0/872889730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80c9580 con 0x7fa4e80b4580 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4e7fff640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0011bf0 tx=0x7fa4e0011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e000e040 con 0x7fa4e80b4580 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e000f040 con 0x7fa4e80b4580 2023-07-09T21:23:15.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0015a80 con 0x7fa4e80b4580 2023-07-09T21:23:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e80c9860 con 0x7fa4e80b4580 2023-07-09T21:23:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e81f22f0 con 0x7fa4e80b4580 2023-07-09T21:23:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e80c9d60 con 0x7fa4e80b4580 2023-07-09T21:23:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4e0015be0 con 0x7fa4e80b4580 2023-07-09T21:23:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.865+0000 7fa4cffff640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 0x7fa4d4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.869+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa4e00840a0 con 0x7fa4e80b4580 2023-07-09T21:23:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.869+0000 7fa4e77fe640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 0x7fa4d4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.869+0000 7fa4e77fe640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 0x7fa4d4068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001060 tx=0x7fa4d8000ff0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:15.869+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4e0051580 con 0x7fa4e80b4580 2023-07-09T21:23:16.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.025+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa4e804d7d0 con 0x7fa4e80b4580 2023-07-09T21:23:16.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.025+0000 7fa4cffff640 1 -- 172.21.15.37:0/872889730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa4e0054ba0 con 0x7fa4e80b4580 2023-07-09T21:23:16.033 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:16.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 msgr2=0x7fa4d4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 0x7fa4d4068760 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001060 tx=0x7fa4d8000ff0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 msgr2=0x7fa4e81f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0011bf0 tx=0x7fa4e0011ce0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 shutdown_connections 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4d40662b0 0x7fa4d4068760 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e80b4580 0x7fa4e81f15c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4e80ca060 0x7fa4e80b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 --2- 172.21.15.37:0/872889730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4d00047d0 0x7fa4e8153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 >> 172.21.15.37:0/872889730 conn(0x7fa4e8073090 msgr2=0x7fa4e80d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 shutdown_connections 2023-07-09T21:23:16.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.029+0000 7fa4ee018640 1 -- 172.21.15.37:0/872889730 wait complete. 2023-07-09T21:23:16.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:16.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.193+0000 7fa65a09c640 1 Processor -- start 2023-07-09T21:23:16.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.193+0000 7fa65a09c640 1 -- start start 2023-07-09T21:23:16.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa65a09c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa654160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa65a09c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65415bf80 con 0x7fa6540b7980 2023-07-09T21:23:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa65a09c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa654160570 con 0x7fa6540d0780 2023-07-09T21:23:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa65a09c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540cd070 con 0x7fa6540cf290 2023-07-09T21:23:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa6540b7980 0x7fa6540ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46992/0 (socket says 172.21.15.37:46992) 2023-07-09T21:23:16.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 -- 172.21.15.37:0/1301580795 learned_addr learned my addr 172.21.15.37:0/1301580795 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:16.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa652ffd640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa654160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130295042 0 0) 0x7fa644001120 con 0x7fa6540b7980 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa63c003530 con 0x7fa6540b7980 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1805296197 0 0) 0x7fa63c003530 con 0x7fa6540b7980 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 msgr2=0x7fa654160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa654160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 >> v1:172.21.15.119:6789/0 conn(0x7fa6540d0780 legacy=0x7fa6540d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6540d02f0 con 0x7fa6540b7980 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fa644001810 con 0x7fa6540b7980 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 >> v1:172.21.15.37:6789/0 conn(0x7fa6540b7980 legacy=0x7fa6540ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0039b0 0x7fa63c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa63c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c004d10 0x7fa63c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540cd070 con 0x7fa63c0039b0 2023-07-09T21:23:16.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c00b990 con 0x7fa63c004d10 2023-07-09T21:23:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c00bb50 con 0x7fa6540cf290 2023-07-09T21:23:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0039b0 0x7fa63c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa653fff640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c004d10 0x7fa63c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa652ffd640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa63c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 -- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 msgr2=0x7fa63c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540cf290 0x7fa63c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 -- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c004d10 msgr2=0x7fa63c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c004d10 0x7fa63c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa6537fe640 1 -- 172.21.15.37:0/1301580795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63c003530 con 0x7fa63c0039b0 2023-07-09T21:23:16.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.197+0000 7fa653fff640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c004d10 0x7fa63c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0039b0 0x7fa63c003d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c1c0 tx=0x7fa64401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=231532c17d1a57b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644005ae0 con 0x7fa63c0039b0 2023-07-09T21:23:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa644005c40 con 0x7fa63c0039b0 2023-07-09T21:23:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa6527fc640 1 -- 172.21.15.37:0/1301580795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa644007070 con 0x7fa63c0039b0 2023-07-09T21:23:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 -- 172.21.15.37:0/1301580795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0039b0 msgr2=0x7fa63c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1301580795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa63c0039b0 0x7fa63c003d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa64400c1c0 tx=0x7fa64401cc40 comp rx=0 tx=0).stop 2023-07-09T21:23:16.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa653fff640 1 -- 172.21.15.37:0/1301580795 reap_dead start 2023-07-09T21:23:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 -- 172.21.15.37:0/1301580795 shutdown_connections 2023-07-09T21:23:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 -- 172.21.15.37:0/1301580795 >> 172.21.15.37:0/1301580795 conn(0x7fa654073090 msgr2=0x7fa654069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 -- 172.21.15.37:0/1301580795 shutdown_connections 2023-07-09T21:23:16.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 -- 172.21.15.37:0/1301580795 wait complete. 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.201+0000 7fa65a09c640 1 Processor -- start 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- start start 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 0x7fa65414e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540c9270 0x7fa65415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 0x7fa654154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65415efb0 con 0x7fa65414dcc0 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6540c96e0 con 0x7fa63c0039b0 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65415ed30 con 0x7fa6540c9270 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 0x7fa654154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa6537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 0x7fa65414e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa6537fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 0x7fa65414e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41922/0 (socket says 172.21.15.37:41922) 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa6537fe640 1 -- 172.21.15.37:0/1507590490 learned_addr learned my addr 172.21.15.37:0/1507590490 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:16.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa652ffd640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540c9270 0x7fa65415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 -- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540c9270 msgr2=0x7fa65415e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540c9270 0x7fa65415e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 -- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 msgr2=0x7fa65414e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 0x7fa65414e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 -- 172.21.15.37:0/1507590490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654153e10 con 0x7fa65414dcc0 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa653fff640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 0x7fa654154bd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa65408ad50 tx=0x7fa64c00e790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c00ecf0 con 0x7fa65414dcc0 2023-07-09T21:23:16.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c00ee50 con 0x7fa65414dcc0 2023-07-09T21:23:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6541540f0 con 0x7fa65414dcc0 2023-07-09T21:23:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64c003bc0 con 0x7fa65414dcc0 2023-07-09T21:23:16.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6541546b0 con 0x7fa65414dcc0 2023-07-09T21:23:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.205+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6541548a0 con 0x7fa65414dcc0 2023-07-09T21:23:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.209+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa64c003d20 con 0x7fa65414dcc0 2023-07-09T21:23:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.209+0000 7fa63bfff640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 0x7fa640068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.209+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa64c082cf0 con 0x7fa65414dcc0 2023-07-09T21:23:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.209+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 0x7fa640068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.209+0000 7fa6537fe640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 0x7fa640068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6540c8840 tx=0x7fa6440a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.213+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa64c0501d0 con 0x7fa65414dcc0 2023-07-09T21:23:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.365+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa65404d7d0 con 0x7fa65414dcc0 2023-07-09T21:23:16.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.365+0000 7fa63bfff640 1 -- 172.21.15.37:0/1507590490 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa64c0537f0 con 0x7fa65414dcc0 2023-07-09T21:23:16.373 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:16.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 msgr2=0x7fa640068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 0x7fa640068730 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa6540c8840 tx=0x7fa6440a7070 comp rx=0 tx=0).stop 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 msgr2=0x7fa654154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 0x7fa654154bd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa65408ad50 tx=0x7fa64c00e790 comp rx=0 tx=0).stop 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 shutdown_connections 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa640066280 0x7fa640068730 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65414dcc0 0x7fa654154bd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa6540c9270 0x7fa65415e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 --2- 172.21.15.37:0/1507590490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa63c0039b0 0x7fa65414e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 >> 172.21.15.37:0/1507590490 conn(0x7fa654073090 msgr2=0x7fa65415f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 shutdown_connections 2023-07-09T21:23:16.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.369+0000 7fa65a09c640 1 -- 172.21.15.37:0/1507590490 wait complete. 2023-07-09T21:23:16.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 Processor -- start 2023-07-09T21:23:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 -- start start 2023-07-09T21:23:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54040c47c0 0x7f5404160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040cbcd0 con 0x7f54040b0390 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040ca050 con 0x7f54040c42b0 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f540b834640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54040ca6d0 con 0x7f54040c47c0 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f5409dd1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54040c47c0 0x7f5404160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f54095d0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54040b0390 0x7f54040cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47004/0 (socket says 172.21.15.37:47004) 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f5409dd1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54040c47c0 0x7f5404160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38322/0 (socket says 172.21.15.37:38322) 2023-07-09T21:23:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f54095d0640 1 -- 172.21.15.37:0/557592553 learned_addr learned my addr 172.21.15.37:0/557592553 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f5409dd1640 1 -- 172.21.15.37:0/557592553 >> v1:172.21.15.119:6789/0 conn(0x7f54040c42b0 legacy=0x7f5404163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f5409dd1640 1 -- 172.21.15.37:0/557592553 >> v1:172.21.15.37:6789/0 conn(0x7f54040b0390 legacy=0x7f54040cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f5409dd1640 1 -- 172.21.15.37:0/557592553 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540406cb80 con 0x7f54040c47c0 2023-07-09T21:23:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.533+0000 7f53fbfff640 1 -- 172.21.15.37:0/557592553 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341079204 0 0) 0x7f5400001120 con 0x7f54040b0390 2023-07-09T21:23:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f5409dd1640 1 --2- 172.21.15.37:0/557592553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c47c0 0x7f5404160410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfffa1630f7e0785 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f53fbfff640 1 -- 172.21.15.37:0/557592553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0a5890 con 0x7f54040c47c0 2023-07-09T21:23:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f53fbfff640 1 -- 172.21.15.37:0/557592553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc0a59f0 con 0x7f54040c47c0 2023-07-09T21:23:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f53fbfff640 1 -- 172.21.15.37:0/557592553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc0a5d80 con 0x7f54040c47c0 2023-07-09T21:23:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 -- 172.21.15.37:0/557592553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c47c0 msgr2=0x7f5404160410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 --2- 172.21.15.37:0/557592553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c47c0 0x7f5404160410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f53fc009d90 tx=0x7f53fc01c8c0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 -- 172.21.15.37:0/557592553 shutdown_connections 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 --2- 172.21.15.37:0/557592553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c47c0 0x7f5404160410 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 -- 172.21.15.37:0/557592553 >> 172.21.15.37:0/557592553 conn(0x7f54040cde40 msgr2=0x7f54040ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 -- 172.21.15.37:0/557592553 shutdown_connections 2023-07-09T21:23:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.537+0000 7f540b834640 1 -- 172.21.15.37:0/557592553 wait complete. 2023-07-09T21:23:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 Processor -- start 2023-07-09T21:23:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- start start 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54040b0390 0x7f54040c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54040c47c0 0x7f54040b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041580b0 con 0x7f54040c42b0 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040b38a0 con 0x7f54040c47c0 2023-07-09T21:23:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54041579f0 con 0x7f54040b0390 2023-07-09T21:23:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38326/0 (socket says 172.21.15.37:38326) 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 -- 172.21.15.37:0/1298512988 learned_addr learned my addr 172.21.15.37:0/1298512988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f54095d0640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54040b0390 0x7f54040c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5409dd1640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54040c47c0 0x7f54040b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 -- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54040b0390 msgr2=0x7f54040c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54040b0390 0x7f54040c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 -- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54040c47c0 msgr2=0x7f54040b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54040c47c0 0x7f54040b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 -- 172.21.15.37:0/1298512988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53fc009a70 con 0x7f54040c42b0 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f5408dcf640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c400 tx=0x7f53f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40052d0 con 0x7f54040c42b0 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4005430 con 0x7f54040c42b0 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4003840 con 0x7f54040c42b0 2023-07-09T21:23:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5404157cd0 con 0x7f54040c42b0 2023-07-09T21:23:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.541+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54040c8760 con 0x7f54040c42b0 2023-07-09T21:23:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54040ad870 con 0x7f54040c42b0 2023-07-09T21:23:16.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f53f40039a0 con 0x7f54040c42b0 2023-07-09T21:23:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f53f9ffb640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 0x7f53e8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f53f4083280 con 0x7f54040c42b0 2023-07-09T21:23:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f54095d0640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 0x7f53e8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.545+0000 7f54095d0640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 0x7f53e8068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5400007e00 tx=0x7f5400007d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.549+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f53f4050760 con 0x7f54040c42b0 2023-07-09T21:23:16.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.701+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f54041581f0 con 0x7f54040c42b0 2023-07-09T21:23:16.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.701+0000 7f53f9ffb640 1 -- 172.21.15.37:0/1298512988 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54041581f0 con 0x7f54040c42b0 2023-07-09T21:23:16.708 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 msgr2=0x7f53e8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 0x7f53e8068760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5400007e00 tx=0x7f5400007d90 comp rx=0 tx=0).stop 2023-07-09T21:23:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 msgr2=0x7f54040b2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f53f400c400 tx=0x7f53f400c8c0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 shutdown_connections 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f53e80662b0 0x7f53e8068760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54040c47c0 0x7f54040b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54040c42b0 0x7f54040b2b30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 --2- 172.21.15.37:0/1298512988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54040b0390 0x7f54040c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 >> 172.21.15.37:0/1298512988 conn(0x7f54040cde40 msgr2=0x7f54040c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 shutdown_connections 2023-07-09T21:23:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.705+0000 7f540b834640 1 -- 172.21.15.37:0/1298512988 wait complete. 2023-07-09T21:23:16.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:16.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 Processor -- start 2023-07-09T21:23:16.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 -- start start 2023-07-09T21:23:16.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4d2c0b7980 0x7f4d2c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0cd070 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d2c0cfd70 con 0x7f4d2c0b7980 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d3165c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15bf80 con 0x7f4d2c0ceb80 2023-07-09T21:23:16.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38340/0 (socket says 172.21.15.37:38340) 2023-07-09T21:23:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 -- 172.21.15.37:0/2286148570 learned_addr learned my addr 172.21.15.37:0/2286148570 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2affd640 1 --2- 172.21.15.37:0/2286148570 >> v2:172.21.15.119:3300/0 conn(0x7f4d2c0b7980 0x7f4d2c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d23fff640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 -- 172.21.15.37:0/2286148570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 msgr2=0x7f4d2c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 -- 172.21.15.37:0/2286148570 >> v2:172.21.15.119:3300/0 conn(0x7f4d2c0b7980 msgr2=0x7f4d2c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 --2- 172.21.15.37:0/2286148570 >> v2:172.21.15.119:3300/0 conn(0x7f4d2c0b7980 0x7f4d2c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d2b7fe640 1 -- 172.21.15.37:0/2286148570 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c160570 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.869+0000 7f4d23fff640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:16.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d2b7fe640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c069aa0 tx=0x7f4d2401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c08683887c4c0e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d2a7fc640 1 -- 172.21.15.37:0/2286148570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240a5650 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d2a7fc640 1 -- 172.21.15.37:0/2286148570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d240a57b0 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d2a7fc640 1 -- 172.21.15.37:0/2286148570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d240a5b40 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 -- 172.21.15.37:0/2286148570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 msgr2=0x7f4d2c0b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c069aa0 tx=0x7f4d2401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 -- 172.21.15.37:0/2286148570 shutdown_connections 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c0b4080 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 --2- 172.21.15.37:0/2286148570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 --2- 172.21.15.37:0/2286148570 >> v2:172.21.15.119:3300/0 conn(0x7f4d2c0b7980 0x7f4d2c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 -- 172.21.15.37:0/2286148570 >> 172.21.15.37:0/2286148570 conn(0x7f4d2c073090 msgr2=0x7f4d2c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 -- 172.21.15.37:0/2286148570 shutdown_connections 2023-07-09T21:23:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.873+0000 7f4d3165c640 1 -- 172.21.15.37:0/2286148570 wait complete. 2023-07-09T21:23:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 Processor -- start 2023-07-09T21:23:16.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- start start 2023-07-09T21:23:16.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d2c0b7980 0x7f4d2c15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15c3b0 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c15d020 con 0x7f4d2c0b7980 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2c159d20 con 0x7f4d2c0ceb80 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38348/0 (socket says 172.21.15.37:38348) 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 -- 172.21.15.37:0/3288500170 learned_addr learned my addr 172.21.15.37:0/3288500170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d23fff640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d2c0b7980 0x7f4d2c15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2b7fe640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 -- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 msgr2=0x7f4d2c15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 -- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d2c0b7980 msgr2=0x7f4d2c15e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:16.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d2c0b7980 0x7f4d2c15e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:16.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 -- 172.21.15.37:0/3288500170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24009b30 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d2affd640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e8a0 tx=0x7f4d1c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c009510 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1c00c940 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c00ccb0 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c15eff0 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.877+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d2c0cc2f0 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d2c0cff60 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4d1c013470 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d237fe640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 0x7f4d0c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f4d1c083e50 con 0x7f4d2c0b3c20 2023-07-09T21:23:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d23fff640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 0x7f4d0c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.881+0000 7f4d23fff640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 0x7f4d0c068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c1539d0 tx=0x7f4d14008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:16.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:16.885+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d2c0cff60 con 0x7f4d2c0b3c20 2023-07-09T21:23:17.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.041+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4d2c0cff60 con 0x7f4d2c0b3c20 2023-07-09T21:23:17.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d237fe640 1 -- 172.21.15.37:0/3288500170 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4d2c0cff60 con 0x7f4d2c0b3c20 2023-07-09T21:23:17.050 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:17.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 msgr2=0x7f4d0c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 0x7f4d0c068730 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c1539d0 tx=0x7f4d14008040 comp rx=0 tx=0).stop 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 msgr2=0x7f4d2c15cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c00e8a0 tx=0x7f4d1c00eca0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 shutdown_connections 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4d0c066280 0x7f4d0c068730 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d2c0ceb80 0x7f4d2c15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d2c0b7980 0x7f4d2c15e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 --2- 172.21.15.37:0/3288500170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d2c0b3c20 0x7f4d2c15cae0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 >> 172.21.15.37:0/3288500170 conn(0x7f4d2c073090 msgr2=0x7f4d2c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:17.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 shutdown_connections 2023-07-09T21:23:17.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.045+0000 7f4d3165c640 1 -- 172.21.15.37:0/3288500170 wait complete. 2023-07-09T21:23:17.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 Processor -- start 2023-07-09T21:23:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 -- start start 2023-07-09T21:23:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f8c06bf20 0x7f9f8c0cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c1592f0 con 0x7f9f8c159780 2023-07-09T21:23:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c159bb0 con 0x7f9f8c156320 2023-07-09T21:23:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.209+0000 7f9f91311640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c1566f0 con 0x7f9f8c06bf20 2023-07-09T21:23:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f83fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9f8c159780 0x7f9f8c06b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47008/0 (socket says 172.21.15.37:47008) 2023-07-09T21:23:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f83fff640 1 -- 172.21.15.37:0/4051241445 learned_addr learned my addr 172.21.15.37:0/4051241445 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/4051241445 >> v2:172.21.15.119:3300/0 conn(0x7f9f8c06bf20 0x7f9f8c0cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114757694 0 0) 0x7f9f8c1592f0 con 0x7f9f8c159780 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f78005740 con 0x7f9f8c159780 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8b7fe640 1 -- 172.21.15.37:0/4051241445 >> v1:172.21.15.119:6789/0 conn(0x7f9f8c156320 legacy=0x7f9f8c070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786926233 0 0) 0x7f9f8c159bb0 con 0x7f9f8c156320 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8b7fe640 1 -- 172.21.15.37:0/4051241445 >> v1:172.21.15.37:6789/0 conn(0x7f9f8c159780 legacy=0x7f9f8c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8b7fe640 1 -- 172.21.15.37:0/4051241445 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c070b50 con 0x7f9f8c06bf20 2023-07-09T21:23:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.213+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/4051241445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c0cd620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868d1b3999baa0ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c0ce370 con 0x7f9f8c06bf20 2023-07-09T21:23:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840a59e0 con 0x7f9f8c06bf20 2023-07-09T21:23:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/4051241445 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840a5d70 con 0x7f9f8c06bf20 2023-07-09T21:23:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- 172.21.15.37:0/4051241445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06bf20 msgr2=0x7f9f8c0cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 --2- 172.21.15.37:0/4051241445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c0cd620 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8401c920 comp rx=0 tx=0).stop 2023-07-09T21:23:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- 172.21.15.37:0/4051241445 shutdown_connections 2023-07-09T21:23:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 --2- 172.21.15.37:0/4051241445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c0cd620 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- 172.21.15.37:0/4051241445 >> 172.21.15.37:0/4051241445 conn(0x7f9f8c0694c0 msgr2=0x7f9f8c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- 172.21.15.37:0/4051241445 shutdown_connections 2023-07-09T21:23:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- 172.21.15.37:0/4051241445 wait complete. 2023-07-09T21:23:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 Processor -- start 2023-07-09T21:23:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- start start 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c156320 0x7f9f8c14cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c159780 0x7f9f8c0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c14ca30 con 0x7f9f8c06bf20 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cb640 con 0x7f9f8c159780 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f91311640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cb920 con 0x7f9f8c156320 2023-07-09T21:23:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38358/0 (socket says 172.21.15.37:38358) 2023-07-09T21:23:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.217+0000 7f9f8affd640 1 -- 172.21.15.37:0/1031214344 learned_addr learned my addr 172.21.15.37:0/1031214344 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f83fff640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c156320 0x7f9f8c14cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c159780 0x7f9f8c0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 -- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c156320 msgr2=0x7f9f8c14cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c156320 0x7f9f8c14cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 -- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c159780 msgr2=0x7f9f8c0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c159780 0x7f9f8c0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 -- 172.21.15.37:0/1031214344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009a70 con 0x7f9f8c06bf20 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c550 tx=0x7f9f7c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c005500 con 0x7f9f8c06bf20 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f7c003650 con 0x7f9f8c06bf20 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f8c14c6c0 con 0x7f9f8c06bf20 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c003a00 con 0x7f9f8c06bf20 2023-07-09T21:23:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c144120 con 0x7f9f8c06bf20 2023-07-09T21:23:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f8c14c520 con 0x7f9f8c06bf20 2023-07-09T21:23:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f7c003b60 con 0x7f9f8c06bf20 2023-07-09T21:23:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 0x7f9f6c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.221+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9f7c083360 con 0x7f9f8c06bf20 2023-07-09T21:23:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.225+0000 7f9f83fff640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 0x7f9f6c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.225+0000 7f9f83fff640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 0x7f9f6c068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c149e60 tx=0x7f9f74009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.225+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f8c14c520 con 0x7f9f8c06bf20 2023-07-09T21:23:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.393+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f8c14c520 con 0x7f9f8c06bf20 2023-07-09T21:23:17.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f837fe640 1 -- 172.21.15.37:0/1031214344 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f8c14c520 con 0x7f9f8c06bf20 2023-07-09T21:23:17.402 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 msgr2=0x7f9f6c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 0x7f9f6c068730 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c149e60 tx=0x7f9f74009040 comp rx=0 tx=0).stop 2023-07-09T21:23:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 msgr2=0x7f9f8c138d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c00c550 tx=0x7f9f7c00ca10 comp rx=0 tx=0).stop 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 shutdown_connections 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9f6c066280 0x7f9f6c068730 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c159780 0x7f9f8c0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c156320 0x7f9f8c14cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 --2- 172.21.15.37:0/1031214344 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c06bf20 0x7f9f8c138d30 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 >> 172.21.15.37:0/1031214344 conn(0x7f9f8c0694c0 msgr2=0x7f9f8c069890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:17.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 shutdown_connections 2023-07-09T21:23:17.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.397+0000 7f9f91311640 1 -- 172.21.15.37:0/1031214344 wait complete. 2023-07-09T21:23:17.422 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:23:17.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:17.423 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-07-09T21:23:17.444 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:17.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:23:17.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:17.445 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:23:17.494 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:17.494 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:17.504 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:17.504 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:17.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:17.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.689+0000 7fc66905c640 1 Processor -- start 2023-07-09T21:23:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.689+0000 7fc66905c640 1 -- start start 2023-07-09T21:23:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66905c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc6640cc320 0x7fc66406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66905c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640cbe90 con 0x7fc6640cc770 2023-07-09T21:23:17.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66905c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc664159bb0 con 0x7fc6640af830 2023-07-09T21:23:17.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66905c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66406d370 con 0x7fc6640cc320 2023-07-09T21:23:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc6640cc770 0x7fc66406c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58004/0 (socket says 172.21.15.37:58004) 2023-07-09T21:23:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 -- 172.21.15.37:0/256168343 learned_addr learned my addr 172.21.15.37:0/256168343 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:17.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66259c640 1 --2- 172.21.15.37:0/256168343 >> v2:172.21.15.119:3300/0 conn(0x7fc6640cc320 0x7fc66406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162401599 0 0) 0x7fc6640cbe90 con 0x7fc6640cc770 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc64c003530 con 0x7fc6640cc770 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3995384368 0 0) 0x7fc64c003530 con 0x7fc6640cc770 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 >> v2:172.21.15.119:3300/0 conn(0x7fc6640cc320 msgr2=0x7fc66406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 --2- 172.21.15.37:0/256168343 >> v2:172.21.15.119:3300/0 conn(0x7fc6640cc320 0x7fc66406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 >> v1:172.21.15.119:6789/0 conn(0x7fc6640af830 legacy=0x7fc6640afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640b38b0 con 0x7fc6640cc770 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fc65c001a50 con 0x7fc6640cc770 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 >> v1:172.21.15.37:6789/0 conn(0x7fc6640cc770 legacy=0x7fc66406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc64c003980 0x7fc64c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc64c0047d0 0x7fc64c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc64c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66406d370 con 0x7fc64c005180 2023-07-09T21:23:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c010410 con 0x7fc64c0047d0 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0105d0 con 0x7fc64c003980 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc64c00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66259c640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc64c0047d0 0x7fc64c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc662d9d640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc64c003980 0x7fc64c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 -- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc64c003980 msgr2=0x7fc64c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc64c003980 0x7fc64c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 -- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc64c0047d0 msgr2=0x7fc64c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc64c0047d0 0x7fc64c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc66359e640 1 -- 172.21.15.37:0/256168343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c003530 con 0x7fc64c005180 2023-07-09T21:23:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.693+0000 7fc662d9d640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc64c003980 0x7fc64c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66359e640 1 -- 172.21.15.37:0/256168343 reap_dead start 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66359e640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc64c00fda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00a7d0 tx=0x7fc65c01d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd9e603f5b35b23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0ac620 con 0x7fc64c005180 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c0a8070 con 0x7fc64c005180 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc661d9b640 1 -- 172.21.15.37:0/256168343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0ac9e0 con 0x7fc64c005180 2023-07-09T21:23:17.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 msgr2=0x7fc64c00fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc64c00fda0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00a7d0 tx=0x7fc65c01d2e0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- 172.21.15.37:0/256168343 shutdown_connections 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 --2- 172.21.15.37:0/256168343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc64c00fda0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- 172.21.15.37:0/256168343 >> 172.21.15.37:0/256168343 conn(0x7fc6640ca830 msgr2=0x7fc6640cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- 172.21.15.37:0/256168343 shutdown_connections 2023-07-09T21:23:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- 172.21.15.37:0/256168343 wait complete. 2023-07-09T21:23:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 Processor -- start 2023-07-09T21:23:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.697+0000 7fc66905c640 1 -- start start 2023-07-09T21:23:17.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6640ae320 0x7fc66414bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66406ef80 0x7fc66406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66406f930 con 0x7fc64c005180 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641f1270 con 0x7fc66406ef80 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c16a0 con 0x7fc6640ae320 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38844/0 (socket says 172.21.15.37:38844) 2023-07-09T21:23:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 -- 172.21.15.37:0/463769654 learned_addr learned my addr 172.21.15.37:0/463769654 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66259c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6640ae320 0x7fc66414bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66359e640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66406ef80 0x7fc66406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 -- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6640ae320 msgr2=0x7fc66414bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6640ae320 0x7fc66414bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 -- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66406ef80 msgr2=0x7fc66406f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66406ef80 0x7fc66406f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 -- 172.21.15.37:0/463769654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6640c2500 con 0x7fc64c005180 2023-07-09T21:23:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc662d9d640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e4b0 tx=0x7fc65400e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540052e0 con 0x7fc64c005180 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc654005440 con 0x7fc64c005180 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66414d5f0 con 0x7fc64c005180 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc654003820 con 0x7fc64c005180 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6640c1bd0 con 0x7fc64c005180 2023-07-09T21:23:17.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.701+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640cebc0 con 0x7fc64c005180 2023-07-09T21:23:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.705+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc654003980 con 0x7fc64c005180 2023-07-09T21:23:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.705+0000 7fc64b7fe640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.705+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc654083350 con 0x7fc64c005180 2023-07-09T21:23:17.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.705+0000 7fc66259c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:17.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.705+0000 7fc66259c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 0x7fc650068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc664155d30 tx=0x7fc658009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:17.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.709+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6540508d0 con 0x7fc64c005180 2023-07-09T21:23:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.861+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc66404d7d0 con 0x7fc64c005180 2023-07-09T21:23:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc64b7fe640 1 -- 172.21.15.37:0/463769654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fc654053ef0 con 0x7fc64c005180 2023-07-09T21:23:17.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:17.870 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 msgr2=0x7fc650068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 0x7fc650068730 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc664155d30 tx=0x7fc658009190 comp rx=0 tx=0).stop 2023-07-09T21:23:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 msgr2=0x7fc6641f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc65400e4b0 tx=0x7fc65400e8b0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 shutdown_connections 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc650066280 0x7fc650068730 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc66406ef80 0x7fc66406f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc6640ae320 0x7fc66414bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 --2- 172.21.15.37:0/463769654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc64c005180 0x7fc6641f0d30 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 >> 172.21.15.37:0/463769654 conn(0x7fc6640ca830 msgr2=0x7fc66406fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 shutdown_connections 2023-07-09T21:23:17.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:17.865+0000 7fc66905c640 1 -- 172.21.15.37:0/463769654 wait complete. 2023-07-09T21:23:17.891 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:17.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 Processor -- start 2023-07-09T21:23:18.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 -- start start 2023-07-09T21:23:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee040b5e40 0x7fee040cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 0x7fee040ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee040d04e0 con 0x7fee040b3430 2023-07-09T21:23:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee040b7e90 con 0x7fee040b5e40 2023-07-09T21:23:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee0994a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0415bde0 con 0x7fee040d0080 2023-07-09T21:23:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee040b5e40 0x7fee040cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee040b5e40 0x7fee040cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38856/0 (socket says 172.21.15.37:38856) 2023-07-09T21:23:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 -- 172.21.15.37:0/1929506913 learned_addr learned my addr 172.21.15.37:0/1929506913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee08948640 1 --1- 172.21.15.37:0/1929506913 >> v1:172.21.15.37:6789/0 conn(0x7fee040b3430 0x7fee040b6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58012/0 (socket says 172.21.15.37:58012) 2023-07-09T21:23:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee09149640 1 --2- 172.21.15.37:0/1929506913 >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 0x7fee040ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 -- 172.21.15.37:0/1929506913 >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 msgr2=0x7fee040ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 --2- 172.21.15.37:0/1929506913 >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 0x7fee040ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 -- 172.21.15.37:0/1929506913 >> v1:172.21.15.37:6789/0 conn(0x7fee040b3430 legacy=0x7fee040b6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee03fff640 1 -- 172.21.15.37:0/1929506913 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040cc780 con 0x7fee040b5e40 2023-07-09T21:23:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.033+0000 7fee09149640 1 --2- 172.21.15.37:0/1929506913 >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 0x7fee040ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee03fff640 1 --2- 172.21.15.37:0/1929506913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040b5e40 0x7fee040cfb40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee0408b3e0 tx=0x7fedf001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4681f762e35e479 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee037fe640 1 -- 172.21.15.37:0/1929506913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00ab5f0 con 0x7fee040b5e40 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee037fe640 1 -- 172.21.15.37:0/1929506913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00ab750 con 0x7fee040b5e40 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee037fe640 1 -- 172.21.15.37:0/1929506913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00abae0 con 0x7fee040b5e40 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 -- 172.21.15.37:0/1929506913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040b5e40 msgr2=0x7fee040cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 --2- 172.21.15.37:0/1929506913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040b5e40 0x7fee040cfb40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fee0408b3e0 tx=0x7fedf001c500 comp rx=0 tx=0).stop 2023-07-09T21:23:18.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 -- 172.21.15.37:0/1929506913 shutdown_connections 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 --2- 172.21.15.37:0/1929506913 >> v2:172.21.15.119:3300/0 conn(0x7fee040d0080 0x7fee040ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 --2- 172.21.15.37:0/1929506913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040b5e40 0x7fee040cfb40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 -- 172.21.15.37:0/1929506913 >> 172.21.15.37:0/1929506913 conn(0x7fee04072d20 msgr2=0x7fee040d1f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 -- 172.21.15.37:0/1929506913 shutdown_connections 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.037+0000 7fee0994a640 1 -- 172.21.15.37:0/1929506913 wait complete. 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 Processor -- start 2023-07-09T21:23:18.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- start start 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee040b3430 0x7fee040c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee040b5e40 0x7fee040ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c68f0 con 0x7fee040d0080 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c7770 con 0x7fee040b3430 2023-07-09T21:23:18.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040c7a50 con 0x7fee040b5e40 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38860/0 (socket says 172.21.15.37:38860) 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 -- 172.21.15.37:0/876373014 learned_addr learned my addr 172.21.15.37:0/876373014 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee08948640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee040b3430 0x7fee040c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee03fff640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee040b5e40 0x7fee040ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 -- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee040b5e40 msgr2=0x7fee040ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee040b5e40 0x7fee040ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 -- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee040b3430 msgr2=0x7fee040c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee040b3430 0x7fee040c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 -- 172.21.15.37:0/876373014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00094d0 con 0x7fee040d0080 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee09149640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00cd50 tx=0x7fedfc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00f680 con 0x7fee040d0080 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc00f800 con 0x7fee040d0080 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc00fbb0 con 0x7fee040d0080 2023-07-09T21:23:18.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee040c7d30 con 0x7fee040d0080 2023-07-09T21:23:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.041+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040cad30 con 0x7fee040d0080 2023-07-09T21:23:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee040c63e0 con 0x7fee040d0080 2023-07-09T21:23:18.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedfc00b040 con 0x7fee040d0080 2023-07-09T21:23:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee017fa640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 0x7fede8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fedfc0846b0 con 0x7fee040d0080 2023-07-09T21:23:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee08948640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 0x7fede8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.045+0000 7fee08948640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 0x7fede8068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000f70 tx=0x7fedf8007e50 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.049+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee040c63e0 con 0x7fee040d0080 2023-07-09T21:23:18.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.205+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee040c63e0 con 0x7fee040d0080 2023-07-09T21:23:18.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.205+0000 7fee017fa640 1 -- 172.21.15.37:0/876373014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fee040c63e0 con 0x7fee040d0080 2023-07-09T21:23:18.212 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:18.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.205+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 msgr2=0x7fede8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 0x7fede8068730 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fedf8000f70 tx=0x7fedf8007e50 comp rx=0 tx=0).stop 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 msgr2=0x7fee040c6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00cd50 tx=0x7fedfc00a650 comp rx=0 tx=0).stop 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 shutdown_connections 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fede8066280 0x7fede8068730 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee040d0080 0x7fee040c6d80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee040b5e40 0x7fee040ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 --2- 172.21.15.37:0/876373014 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee040b3430 0x7fee040c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 >> 172.21.15.37:0/876373014 conn(0x7fee04072d20 msgr2=0x7fee0406a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 shutdown_connections 2023-07-09T21:23:18.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.209+0000 7fee0994a640 1 -- 172.21.15.37:0/876373014 wait complete. 2023-07-09T21:23:18.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:18.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 Processor -- start 2023-07-09T21:23:18.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 -- start start 2023-07-09T21:23:18.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf840c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840c47a0 con 0x7fbf841585b0 2023-07-09T21:23:18.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf840c9090 con 0x7fbf8415c200 2023-07-09T21:23:18.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf8bccb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840cbf40 con 0x7fbf840c3e10 2023-07-09T21:23:18.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf89a67640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbf841585b0 0x7fbf8406b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58022/0 (socket says 172.21.15.37:58022) 2023-07-09T21:23:18.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf89a67640 1 -- 172.21.15.37:0/3641867118 learned_addr learned my addr 172.21.15.37:0/3641867118 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:18.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf89266640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf840c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3941831064 0 0) 0x7fbf80001120 con 0x7fbf841585b0 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf70003530 con 0x7fbf841585b0 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224093514 0 0) 0x7fbf840c9090 con 0x7fbf8415c200 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf80001120 con 0x7fbf8415c200 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2097816873 0 0) 0x7fbf70003530 con 0x7fbf841585b0 2023-07-09T21:23:18.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 msgr2=0x7fbf840c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf840c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.373+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 >> v1:172.21.15.119:6789/0 conn(0x7fbf8415c200 legacy=0x7fbf840c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf840c8a60 con 0x7fbf841585b0 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fbf80001810 con 0x7fbf841585b0 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 >> v1:172.21.15.37:6789/0 conn(0x7fbf841585b0 legacy=0x7fbf8406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf70003b40 0x7fbf70003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70004d10 0x7fbf70005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf840cbf40 con 0x7fbf70003b40 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000dc50 con 0x7fbf70004d10 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7000de10 con 0x7fbf840c3e10 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf70003b40 0x7fbf70003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf8a268640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70004d10 0x7fbf70005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89266640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 -- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 msgr2=0x7fbf700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf840c3e10 0x7fbf700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 -- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70004d10 msgr2=0x7fbf70005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70004d10 0x7fbf70005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 -- 172.21.15.37:0/3641867118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf70003530 con 0x7fbf70003b40 2023-07-09T21:23:18.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf70003b40 0x7fbf70003f30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007f80 tx=0x7fbf8001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c889cc5a7b6abfda server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80005ae0 con 0x7fbf70003b40 2023-07-09T21:23:18.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf80005c40 con 0x7fbf70003b40 2023-07-09T21:23:18.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.377+0000 7fbf88a65640 1 -- 172.21.15.37:0/3641867118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf80007070 con 0x7fbf70003b40 2023-07-09T21:23:18.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3641867118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf70003b40 msgr2=0x7fbf70003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3641867118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf70003b40 0x7fbf70003f30 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007f80 tx=0x7fbf8001cae0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8a268640 1 -- 172.21.15.37:0/3641867118 reap_dead start 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3641867118 shutdown_connections 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3641867118 >> 172.21.15.37:0/3641867118 conn(0x7fbf840cde40 msgr2=0x7fbf840ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3641867118 shutdown_connections 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3641867118 wait complete. 2023-07-09T21:23:18.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 Processor -- start 2023-07-09T21:23:18.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- start start 2023-07-09T21:23:18.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70003b40 0x7fbf840b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf84147670 0x7fbf840b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84070f20 con 0x7fbf8406ff80 2023-07-09T21:23:18.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84070960 con 0x7fbf70003b40 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8bccb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84070c40 con 0x7fbf84147670 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8a268640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8a268640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38868/0 (socket says 172.21.15.37:38868) 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf8a268640 1 -- 172.21.15.37:0/3476000545 learned_addr learned my addr 172.21.15.37:0/3476000545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70003b40 0x7fbf840b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.381+0000 7fbf89266640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf84147670 0x7fbf840b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 -- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf84147670 msgr2=0x7fbf840b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf84147670 0x7fbf840b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 -- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70003b40 msgr2=0x7fbf840b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70003b40 0x7fbf840b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 -- 172.21.15.37:0/3476000545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf841460f0 con 0x7fbf8406ff80 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8a268640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf8406b1b0 tx=0x7fbf7c00e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c00ed90 con 0x7fbf8406ff80 2023-07-09T21:23:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7c003980 con 0x7fbf8406ff80 2023-07-09T21:23:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf841463d0 con 0x7fbf8406ff80 2023-07-09T21:23:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7c003d30 con 0x7fbf8406ff80 2023-07-09T21:23:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf840b12d0 con 0x7fbf8406ff80 2023-07-09T21:23:18.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf841465c0 con 0x7fbf8406ff80 2023-07-09T21:23:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf7c005070 con 0x7fbf8406ff80 2023-07-09T21:23:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 0x7fbf68068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.385+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fbf7c082f40 con 0x7fbf8406ff80 2023-07-09T21:23:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.389+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 0x7fbf68068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.389+0000 7fbf89a67640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 0x7fbf68068760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007f80 tx=0x7fbf800a7070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.389+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf7c050420 con 0x7fbf8406ff80 2023-07-09T21:23:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.545+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbf8404d7d0 con 0x7fbf8406ff80 2023-07-09T21:23:18.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.545+0000 7fbf7a7fc640 1 -- 172.21.15.37:0/3476000545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbf7c019070 con 0x7fbf8406ff80 2023-07-09T21:23:18.553 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:18.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 msgr2=0x7fbf68068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 0x7fbf68068760 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbf80007f80 tx=0x7fbf800a7070 comp rx=0 tx=0).stop 2023-07-09T21:23:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 msgr2=0x7fbf84153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbf8406b1b0 tx=0x7fbf7c00e750 comp rx=0 tx=0).stop 2023-07-09T21:23:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 shutdown_connections 2023-07-09T21:23:18.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf680662b0 0x7fbf68068760 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf8406ff80 0x7fbf84153190 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf84147670 0x7fbf840b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 --2- 172.21.15.37:0/3476000545 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf70003b40 0x7fbf840b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 >> 172.21.15.37:0/3476000545 conn(0x7fbf840cde40 msgr2=0x7fbf8406c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 shutdown_connections 2023-07-09T21:23:18.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.549+0000 7fbf8bccb640 1 -- 172.21.15.37:0/3476000545 wait complete. 2023-07-09T21:23:18.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:18.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 Processor -- start 2023-07-09T21:23:18.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 -- start start 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70980b7980 0x7f7098160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f70980cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70980b3c20 0x7f70980b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980cd070 con 0x7f70980b7980 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70980cfd70 con 0x7f70980b3c20 2023-07-09T21:23:18.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709e4ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709815bf80 con 0x7f70980ceb80 2023-07-09T21:23:18.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70980b7980 0x7f7098160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70980b7980 0x7f7098160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38882/0 (socket says 172.21.15.37:38882) 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 -- 172.21.15.37:0/3329224485 learned_addr learned my addr 172.21.15.37:0/3329224485 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f709ca89640 1 --2- 172.21.15.37:0/3329224485 >> v2:172.21.15.119:3300/0 conn(0x7f70980b3c20 0x7f70980b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f70977fe640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f70980cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 -- 172.21.15.37:0/3329224485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 msgr2=0x7f70980cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f70980cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 -- 172.21.15.37:0/3329224485 >> v2:172.21.15.119:3300/0 conn(0x7f70980b3c20 msgr2=0x7f70980b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:18.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 --2- 172.21.15.37:0/3329224485 >> v2:172.21.15.119:3300/0 conn(0x7f70980b3c20 0x7f70980b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.713+0000 7f7097fff640 1 -- 172.21.15.37:0/3329224485 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098160570 con 0x7f70980b7980 2023-07-09T21:23:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f7097fff640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b7980 0x7f7098160030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f709808ad30 tx=0x7f708801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb3c898ab9e5443 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f7096ffd640 1 -- 172.21.15.37:0/3329224485 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880ab600 con 0x7f70980b7980 2023-07-09T21:23:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f7096ffd640 1 -- 172.21.15.37:0/3329224485 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70880a7050 con 0x7f70980b7980 2023-07-09T21:23:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f7096ffd640 1 -- 172.21.15.37:0/3329224485 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880ab980 con 0x7f70980b7980 2023-07-09T21:23:18.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 -- 172.21.15.37:0/3329224485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b7980 msgr2=0x7f7098160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b7980 0x7f7098160030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f709808ad30 tx=0x7f708801c500 comp rx=0 tx=0).stop 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 -- 172.21.15.37:0/3329224485 shutdown_connections 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 --2- 172.21.15.37:0/3329224485 >> v2:172.21.15.119:3300/0 conn(0x7f70980b3c20 0x7f70980b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f70980cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 --2- 172.21.15.37:0/3329224485 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b7980 0x7f7098160030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 -- 172.21.15.37:0/3329224485 >> 172.21.15.37:0/3329224485 conn(0x7f7098073090 msgr2=0x7f7098069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 -- 172.21.15.37:0/3329224485 shutdown_connections 2023-07-09T21:23:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.717+0000 7f709e4ec640 1 -- 172.21.15.37:0/3329224485 wait complete. 2023-07-09T21:23:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 Processor -- start 2023-07-09T21:23:18.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- start start 2023-07-09T21:23:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70980b7980 0x7f70980d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f709814f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7098154960 con 0x7f70980b3c20 2023-07-09T21:23:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709815a1e0 con 0x7f70980b7980 2023-07-09T21:23:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7098154680 con 0x7f70980ceb80 2023-07-09T21:23:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38892/0 (socket says 172.21.15.37:38892) 2023-07-09T21:23:18.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 -- 172.21.15.37:0/2821661948 learned_addr learned my addr 172.21.15.37:0/2821661948 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 -- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 msgr2=0x7f709814f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f709814f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 -- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70980b7980 msgr2=0x7f70980d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70980b7980 0x7f70980d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 -- 172.21.15.37:0/2821661948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880094d0 con 0x7f70980b3c20 2023-07-09T21:23:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7097fff640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70880ae040 tx=0x7f70880192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880b3890 con 0x7f70980b3c20 2023-07-09T21:23:18.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70880b39f0 con 0x7f70980b3c20 2023-07-09T21:23:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70880b3da0 con 0x7f70980b3c20 2023-07-09T21:23:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7098159b90 con 0x7f70980b3c20 2023-07-09T21:23:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.721+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709815ae80 con 0x7f70980b3c20 2023-07-09T21:23:18.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709815b070 con 0x7f70980b3c20 2023-07-09T21:23:18.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70880b2070 con 0x7f70980b3c20 2023-07-09T21:23:18.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f7094ff9640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 0x7f7084068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:18.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f708811e0a0 con 0x7f70980b3c20 2023-07-09T21:23:18.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f70977fe640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 0x7f7084068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:18.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.725+0000 7f70977fe640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 0x7f7084068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70981f7bb0 tx=0x7f708c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:18.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.729+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f709815b070 con 0x7f70980b3c20 2023-07-09T21:23:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.881+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70981599f0 con 0x7f70980b3c20 2023-07-09T21:23:18.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.881+0000 7f7094ff9640 1 -- 172.21.15.37:0/2821661948 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70981599f0 con 0x7f70980b3c20 2023-07-09T21:23:18.889 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:18.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 msgr2=0x7f7084068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 0x7f7084068730 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f70981f7bb0 tx=0x7f708c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 msgr2=0x7f7098151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f70880ae040 tx=0x7f70880192a0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 shutdown_connections 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7084066280 0x7f7084068730 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70980ceb80 0x7f709814f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70980b7980 0x7f70980d11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 --2- 172.21.15.37:0/2821661948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70980b3c20 0x7f7098151470 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 >> 172.21.15.37:0/2821661948 conn(0x7f7098073090 msgr2=0x7f70980b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 shutdown_connections 2023-07-09T21:23:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:18.885+0000 7f709e4ec640 1 -- 172.21.15.37:0/2821661948 wait complete. 2023-07-09T21:23:18.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:19.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.049+0000 7fe1963fa640 1 Processor -- start 2023-07-09T21:23:19.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.049+0000 7fe1963fa640 1 -- start start 2023-07-09T21:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe1963fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1900b7980 0x7fe190160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe1963fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe1900d0780 0x7fe1900d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe1963fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19015bf80 con 0x7fe1900ceb80 2023-07-09T21:23:19.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe1963fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900cd070 con 0x7fe1900b7980 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe1963fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900cfd70 con 0x7fe1900d0780 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1900b7980 0x7fe190160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1900b7980 0x7fe190160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38904/0 (socket says 172.21.15.37:38904) 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 -- 172.21.15.37:0/625229749 learned_addr learned my addr 172.21.15.37:0/625229749 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18f7fe640 1 --1- 172.21.15.37:0/625229749 >> v1:172.21.15.37:6789/0 conn(0x7fe1900ceb80 0x7fe1900cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58038/0 (socket says 172.21.15.37:58038) 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe194997640 1 --2- 172.21.15.37:0/625229749 >> v2:172.21.15.119:3300/0 conn(0x7fe1900d0780 0x7fe1900d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 -- 172.21.15.37:0/625229749 >> v2:172.21.15.119:3300/0 conn(0x7fe1900d0780 msgr2=0x7fe1900d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:19.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 --2- 172.21.15.37:0/625229749 >> v2:172.21.15.119:3300/0 conn(0x7fe1900d0780 0x7fe1900d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 -- 172.21.15.37:0/625229749 >> v1:172.21.15.37:6789/0 conn(0x7fe1900ceb80 legacy=0x7fe1900cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.053+0000 7fe18ffff640 1 -- 172.21.15.37:0/625229749 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190160570 con 0x7fe1900b7980 2023-07-09T21:23:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe18ffff640 1 --2- 172.21.15.37:0/625229749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe190160030 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b1240 tx=0x7fe18001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4aef7a1234dada7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe18effd640 1 -- 172.21.15.37:0/625229749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800ab600 con 0x7fe1900b7980 2023-07-09T21:23:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe18effd640 1 -- 172.21.15.37:0/625229749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800a7050 con 0x7fe1900b7980 2023-07-09T21:23:19.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe18effd640 1 -- 172.21.15.37:0/625229749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800ab980 con 0x7fe1900b7980 2023-07-09T21:23:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- 172.21.15.37:0/625229749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 msgr2=0x7fe190160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 --2- 172.21.15.37:0/625229749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe190160030 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b1240 tx=0x7fe18001c500 comp rx=0 tx=0).stop 2023-07-09T21:23:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- 172.21.15.37:0/625229749 shutdown_connections 2023-07-09T21:23:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 --2- 172.21.15.37:0/625229749 >> v2:172.21.15.119:3300/0 conn(0x7fe1900d0780 0x7fe1900d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 --2- 172.21.15.37:0/625229749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe190160030 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- 172.21.15.37:0/625229749 >> 172.21.15.37:0/625229749 conn(0x7fe190073090 msgr2=0x7fe190069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- 172.21.15.37:0/625229749 shutdown_connections 2023-07-09T21:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- 172.21.15.37:0/625229749 wait complete. 2023-07-09T21:23:19.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 Processor -- start 2023-07-09T21:23:19.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.057+0000 7fe1963fa640 1 -- start start 2023-07-09T21:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1900ceb80 0x7fe190148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1900d0780 0x7fe1901487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190149bb0 con 0x7fe1900b7980 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe190148680 con 0x7fe1900ceb80 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe190149030 con 0x7fe1900d0780 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38916/0 (socket says 172.21.15.37:38916) 2023-07-09T21:23:19.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 -- 172.21.15.37:0/2969994650 learned_addr learned my addr 172.21.15.37:0/2969994650 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18f7fe640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1900ceb80 0x7fe190148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe194997640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1900d0780 0x7fe1901487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 -- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1900d0780 msgr2=0x7fe1901487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1900d0780 0x7fe1901487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 -- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1900ceb80 msgr2=0x7fe190148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1900ceb80 0x7fe190148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 -- 172.21.15.37:0/2969994650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1800094d0 con 0x7fe1900b7980 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18ffff640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe180019110 tx=0x7fe1800192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800b37d0 con 0x7fe1900b7980 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800b3930 con 0x7fe1900b7980 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190149310 con 0x7fe1900b7980 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800b3ca0 con 0x7fe1900b7980 2023-07-09T21:23:19.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1901498d0 con 0x7fe1900b7980 2023-07-09T21:23:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.061+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19004d7d0 con 0x7fe1900b7980 2023-07-09T21:23:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.065+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1800b2070 con 0x7fe1900b7980 2023-07-09T21:23:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.065+0000 7fe18cff9640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 0x7fe17c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.065+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fe18011ded0 con 0x7fe1900b7980 2023-07-09T21:23:19.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.065+0000 7fe18f7fe640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 0x7fe17c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.065+0000 7fe18f7fe640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 0x7fe17c068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe19015a3c0 tx=0x7fe184007c90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.069+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1800eb310 con 0x7fe1900b7980 2023-07-09T21:23:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe190160570 con 0x7fe1900b7980 2023-07-09T21:23:19.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe18cff9640 1 -- 172.21.15.37:0/2969994650 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe190160570 con 0x7fe1900b7980 2023-07-09T21:23:19.232 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:19.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 msgr2=0x7fe17c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 0x7fe17c068730 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe19015a3c0 tx=0x7fe184007c90 comp rx=0 tx=0).stop 2023-07-09T21:23:19.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 msgr2=0x7fe1900b6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe180019110 tx=0x7fe1800192a0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 shutdown_connections 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe17c066280 0x7fe17c068730 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1900d0780 0x7fe1901487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1900ceb80 0x7fe190148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 --2- 172.21.15.37:0/2969994650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1900b7980 0x7fe1900b6cb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.225+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 >> 172.21.15.37:0/2969994650 conn(0x7fe190073090 msgr2=0x7fe190158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.229+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 shutdown_connections 2023-07-09T21:23:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.229+0000 7fe1963fa640 1 -- 172.21.15.37:0/2969994650 wait complete. 2023-07-09T21:23:19.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.389+0000 7fedcd12c640 1 Processor -- start 2023-07-09T21:23:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.389+0000 7fedcd12c640 1 -- start start 2023-07-09T21:23:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedcd12c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fedc80b7a60 0x7fedc80cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedcd12c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80cef80 con 0x7fedc80b4310 2023-07-09T21:23:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedcd12c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc80cf260 con 0x7fedc80b47a0 2023-07-09T21:23:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedcd12c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc80cf540 con 0x7fedc80b7a60 2023-07-09T21:23:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc759e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fedc80b4310 0x7fedc80d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58048/0 (socket says 172.21.15.37:58048) 2023-07-09T21:23:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc759e640 1 -- 172.21.15.37:0/3525464899 learned_addr learned my addr 172.21.15.37:0/3525464899 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc6d9d640 1 --2- 172.21.15.37:0/3525464899 >> v2:172.21.15.119:3300/0 conn(0x7fedc80b7a60 0x7fedc80cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc5d9b640 1 -- 172.21.15.37:0/3525464899 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531753588 0 0) 0x7fedc80cef80 con 0x7fedc80b4310 2023-07-09T21:23:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc5d9b640 1 -- 172.21.15.37:0/3525464899 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0003530 con 0x7fedc80b4310 2023-07-09T21:23:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3525464899 >> v1:172.21.15.119:6789/0 conn(0x7fedc80b47a0 legacy=0x7fedc80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3525464899 >> v1:172.21.15.37:6789/0 conn(0x7fedc80b4310 legacy=0x7fedc80d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.393+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3525464899 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc80cfdf0 con 0x7fedc80b7a60 2023-07-09T21:23:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedc6d9d640 1 --2- 172.21.15.37:0/3525464899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc80cc7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedb80097c0 tx=0x7fedb801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df1bf16c4aa1c435 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedc5d9b640 1 -- 172.21.15.37:0/3525464899 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80ab600 con 0x7fedc80b7a60 2023-07-09T21:23:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedc5d9b640 1 -- 172.21.15.37:0/3525464899 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb80a7050 con 0x7fedc80b7a60 2023-07-09T21:23:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedc5d9b640 1 -- 172.21.15.37:0/3525464899 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80ab980 con 0x7fedc80b7a60 2023-07-09T21:23:19.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- 172.21.15.37:0/3525464899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 msgr2=0x7fedc80cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3525464899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc80cc7d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fedb80097c0 tx=0x7fedb801c480 comp rx=0 tx=0).stop 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- 172.21.15.37:0/3525464899 shutdown_connections 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3525464899 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc80cc7d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- 172.21.15.37:0/3525464899 >> 172.21.15.37:0/3525464899 conn(0x7fedc8073050 msgr2=0x7fedc8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- 172.21.15.37:0/3525464899 shutdown_connections 2023-07-09T21:23:19.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- 172.21.15.37:0/3525464899 wait complete. 2023-07-09T21:23:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 Processor -- start 2023-07-09T21:23:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.397+0000 7fedcd12c640 1 -- start start 2023-07-09T21:23:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedc80b47a0 0x7fedc8154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc8154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c8460 con 0x7fedc80b4310 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c7890 con 0x7fedc80b7a60 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc80c7b30 con 0x7fedc80b47a0 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38930/0 (socket says 172.21.15.37:38930) 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3508142861 learned_addr learned my addr 172.21.15.37:0/3508142861 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc659c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedc80b47a0 0x7fedc8154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc759e640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc8154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedc80b47a0 msgr2=0x7fedc8154930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedc80b47a0 0x7fedc8154930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 msgr2=0x7fedc8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc8154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 -- 172.21.15.37:0/3508142861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb8009420 con 0x7fedc80b4310 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedc6d9d640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fedb80ae040 tx=0x7fedb801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80b7450 con 0x7fedc80b4310 2023-07-09T21:23:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb80b75b0 con 0x7fedc80b4310 2023-07-09T21:23:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc80c7e10 con 0x7fedc80b4310 2023-07-09T21:23:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb80b7960 con 0x7fedc80b4310 2023-07-09T21:23:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc815d500 con 0x7fedc80b4310 2023-07-09T21:23:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc80cdaa0 con 0x7fedc80b4310 2023-07-09T21:23:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.401+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fedb80b7ac0 con 0x7fedc80b4310 2023-07-09T21:23:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.405+0000 7fedaf7fe640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 0x7fedb4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.405+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fedb811e740 con 0x7fedc80b4310 2023-07-09T21:23:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.405+0000 7fedc659c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 0x7fedb4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.405+0000 7fedc659c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 0x7fedb4068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedc80cc9f0 tx=0x7fedbc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.409+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedb80eba60 con 0x7fedc80b4310 2023-07-09T21:23:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fedc804d7d0 con 0x7fedc80b4310 2023-07-09T21:23:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedaf7fe640 1 -- 172.21.15.37:0/3508142861 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fedb80ef080 con 0x7fedc80b4310 2023-07-09T21:23:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 msgr2=0x7fedb4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 0x7fedb4068730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fedc80cc9f0 tx=0x7fedbc009040 comp rx=0 tx=0).stop 2023-07-09T21:23:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 msgr2=0x7fedc80cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fedb80ae040 tx=0x7fedb801acc0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 shutdown_connections 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fedb4066280 0x7fedb4068730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedc80b7a60 0x7fedc8154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedc80b47a0 0x7fedc8154930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 --2- 172.21.15.37:0/3508142861 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedc80b4310 0x7fedc80cb940 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.573+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 >> 172.21.15.37:0/3508142861 conn(0x7fedc8073050 msgr2=0x7fedc815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.577+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 shutdown_connections 2023-07-09T21:23:19.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.577+0000 7fedcd12c640 1 -- 172.21.15.37:0/3508142861 wait complete. 2023-07-09T21:23:19.600 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:23:19.601 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:23:19.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 Processor -- start 2023-07-09T21:23:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 -- start start 2023-07-09T21:23:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc23c0b7ab0 0x7fc23c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0b49f0 con 0x7fc23c0b4340 2023-07-09T21:23:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc23c0cc8a0 con 0x7fc23c0cef80 2023-07-09T21:23:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc241219640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23c0b7e80 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23b59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc23c0b4340 0x7fc23c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58056/0 (socket says 172.21.15.37:58056) 2023-07-09T21:23:19.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23b59e640 1 -- 172.21.15.37:0/3706649463 learned_addr learned my addr 172.21.15.37:0/3706649463 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:19.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23ad9d640 1 --2- 172.21.15.37:0/3706649463 >> v2:172.21.15.119:3300/0 conn(0x7fc23c0b7ab0 0x7fc23c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244314696 0 0) 0x7fc23c0b49f0 con 0x7fc23c0b4340 2023-07-09T21:23:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc228003530 con 0x7fc23c0b4340 2023-07-09T21:23:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2099014675 0 0) 0x7fc23c0cc8a0 con 0x7fc23c0cef80 2023-07-09T21:23:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c0b49f0 con 0x7fc23c0cef80 2023-07-09T21:23:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3583513680 0 0) 0x7fc228003530 con 0x7fc23c0b4340 2023-07-09T21:23:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23ad9d640 1 -- 172.21.15.37:0/3706649463 >> v1:172.21.15.119:6789/0 conn(0x7fc23c0cef80 legacy=0x7fc23c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23ad9d640 1 -- 172.21.15.37:0/3706649463 >> v1:172.21.15.37:6789/0 conn(0x7fc23c0b4340 legacy=0x7fc23c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.749+0000 7fc23ad9d640 1 -- 172.21.15.37:0/3706649463 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c0ccb80 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc23ad9d640 1 --2- 172.21.15.37:0/3706649463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c06aa50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097c0 tx=0x7fc22c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d63e5251d23d3bc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234001a00 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c0a7050 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc23a59c640 1 -- 172.21.15.37:0/3706649463 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0ab620 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 -- 172.21.15.37:0/3706649463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0b7ab0 msgr2=0x7fc23c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 --2- 172.21.15.37:0/3706649463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c06aa50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0097c0 tx=0x7fc22c01c370 comp rx=0 tx=0).stop 2023-07-09T21:23:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 -- 172.21.15.37:0/3706649463 shutdown_connections 2023-07-09T21:23:19.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 --2- 172.21.15.37:0/3706649463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c06aa50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 -- 172.21.15.37:0/3706649463 >> 172.21.15.37:0/3706649463 conn(0x7fc23c073090 msgr2=0x7fc23c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 -- 172.21.15.37:0/3706649463 shutdown_connections 2023-07-09T21:23:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.753+0000 7fc241219640 1 -- 172.21.15.37:0/3706649463 wait complete. 2023-07-09T21:23:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 Processor -- start 2023-07-09T21:23:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- start start 2023-07-09T21:23:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc23c0b4340 0x7fc23c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cef80 0x7fc23c0cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c9bb0 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0c9e90 con 0x7fc23c0cef80 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c0ca170 con 0x7fc23c0b4340 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38934/0 (socket says 172.21.15.37:38934) 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 -- 172.21.15.37:0/3194051057 learned_addr learned my addr 172.21.15.37:0/3194051057 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc23ad9d640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc23c0b4340 0x7fc23c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc23b59e640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cef80 0x7fc23c0cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 -- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc23c0b4340 msgr2=0x7fc23c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc23c0b4340 0x7fc23c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 -- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cef80 msgr2=0x7fc23c0cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cef80 0x7fc23c0cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 -- 172.21.15.37:0/3194051057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c009420 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc233fff640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c500 tx=0x7fc22400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2240052d0 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc224005430 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc224012870 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc23c0ca450 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.757+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc23c0c97c0 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23c04d7d0 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc2240129d0 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc2337fe640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 0x7fc21c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc224083900 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc23ad9d640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 0x7fc21c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:19.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.761+0000 7fc23ad9d640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 0x7fc21c068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0ad000 tx=0x7fc22c0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:19.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.765+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc224050d60 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.929+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc23c0ca900 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.929+0000 7fc2337fe640 1 -- 172.21.15.37:0/3194051057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fc224054380 con 0x7fc23c0b7ab0 2023-07-09T21:23:19.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:19.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 msgr2=0x7fc21c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 0x7fc21c068760 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc22c0ad000 tx=0x7fc22c0a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 msgr2=0x7fc23c0c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc22400c500 tx=0x7fc22400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 shutdown_connections 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc21c0662b0 0x7fc21c068760 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc23c0cef80 0x7fc23c0cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc23c0b7ab0 0x7fc23c0c7de0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 --2- 172.21.15.37:0/3194051057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc23c0b4340 0x7fc23c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 >> 172.21.15.37:0/3194051057 conn(0x7fc23c073090 msgr2=0x7fc23c0d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 shutdown_connections 2023-07-09T21:23:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:19.933+0000 7fc241219640 1 -- 172.21.15.37:0/3194051057 wait complete. 2023-07-09T21:23:19.957 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:19.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:20.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.097+0000 7f3befc7b640 1 Processor -- start 2023-07-09T21:23:20.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.097+0000 7f3befc7b640 1 -- start start 2023-07-09T21:23:20.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3befc7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3be80b7980 0x7f3be8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3befc7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80ceb80 0x7f3be80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3befc7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3be815bf80 con 0x7f3be80b3c20 2023-07-09T21:23:20.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3befc7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3be80cd070 con 0x7f3be80b7980 2023-07-09T21:23:20.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3befc7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be80cfd70 con 0x7f3be80ceb80 2023-07-09T21:23:20.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3be80b7980 0x7f3be8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3be80b7980 0x7f3be8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38938/0 (socket says 172.21.15.37:38938) 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 -- 172.21.15.37:0/2982656422 learned_addr learned my addr 172.21.15.37:0/2982656422 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3bed216640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80ceb80 0x7f3be80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 -- 172.21.15.37:0/2982656422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80ceb80 msgr2=0x7f3be80cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80ceb80 0x7f3be80cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 -- 172.21.15.37:0/2982656422 >> v1:172.21.15.37:6789/0 conn(0x7f3be80b3c20 legacy=0x7f3be80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.101+0000 7f3beda17640 1 -- 172.21.15.37:0/2982656422 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8160570 con 0x7f3be80b7980 2023-07-09T21:23:20.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3beda17640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b7980 0x7f3be8160030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009870 tx=0x7f3be401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2000434e628502ab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3beca15640 1 -- 172.21.15.37:0/2982656422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40ab600 con 0x7f3be80b7980 2023-07-09T21:23:20.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3beca15640 1 -- 172.21.15.37:0/2982656422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be40a7050 con 0x7f3be80b7980 2023-07-09T21:23:20.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3beca15640 1 -- 172.21.15.37:0/2982656422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40ab980 con 0x7f3be80b7980 2023-07-09T21:23:20.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- 172.21.15.37:0/2982656422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b7980 msgr2=0x7f3be8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b7980 0x7f3be8160030 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3be4009870 tx=0x7f3be401c540 comp rx=0 tx=0).stop 2023-07-09T21:23:20.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- 172.21.15.37:0/2982656422 shutdown_connections 2023-07-09T21:23:20.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80ceb80 0x7f3be80cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 --2- 172.21.15.37:0/2982656422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b7980 0x7f3be8160030 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- 172.21.15.37:0/2982656422 >> 172.21.15.37:0/2982656422 conn(0x7f3be8073090 msgr2=0x7f3be8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- 172.21.15.37:0/2982656422 shutdown_connections 2023-07-09T21:23:20.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- 172.21.15.37:0/2982656422 wait complete. 2023-07-09T21:23:20.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 Processor -- start 2023-07-09T21:23:20.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.105+0000 7f3befc7b640 1 -- start start 2023-07-09T21:23:20.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80b7980 0x7f3be8154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 0x7f3be80c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be815c120 con 0x7f3be80b3c20 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3be815c400 con 0x7f3be80ceb80 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3be815c6e0 con 0x7f3be80b7980 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38948/0 (socket says 172.21.15.37:38948) 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 -- 172.21.15.37:0/3072483139 learned_addr learned my addr 172.21.15.37:0/3072483139 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:20.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bed216640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80b7980 0x7f3be8154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bee218640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 0x7f3be80c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 -- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80b7980 msgr2=0x7f3be8154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80b7980 0x7f3be8154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 -- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 msgr2=0x7f3be80c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 0x7f3be80c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 -- 172.21.15.37:0/3072483139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be40094d0 con 0x7f3be80b3c20 2023-07-09T21:23:20.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bee218640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 0x7f3be80c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:20.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3beda17640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3be401abf0 tx=0x7f3be40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40b35d0 con 0x7f3be80b3c20 2023-07-09T21:23:20.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be40b3730 con 0x7f3be80b3c20 2023-07-09T21:23:20.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3be815c9c0 con 0x7f3be80b3c20 2023-07-09T21:23:20.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40b3ae0 con 0x7f3be80b3c20 2023-07-09T21:23:20.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be80c9e00 con 0x7f3be80b3c20 2023-07-09T21:23:20.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3be804d7d0 con 0x7f3be80b3c20 2023-07-09T21:23:20.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.109+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3be40b2070 con 0x7f3be80b3c20 2023-07-09T21:23:20.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.113+0000 7f3bde7fc640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.113+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f3be411dde0 con 0x7f3be80b3c20 2023-07-09T21:23:20.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.113+0000 7f3bed216640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.113+0000 7f3bed216640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 0x7f3bcc068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3be80ce7d0 tx=0x7f3bd8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.117+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3be40eb180 con 0x7f3be80b3c20 2023-07-09T21:23:20.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.269+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3be8160570 con 0x7f3be80b3c20 2023-07-09T21:23:20.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.269+0000 7f3bde7fc640 1 -- 172.21.15.37:0/3072483139 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3be8160570 con 0x7f3be80b3c20 2023-07-09T21:23:20.277 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:20.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 msgr2=0x7f3bcc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 0x7f3bcc068730 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3be80ce7d0 tx=0x7f3bd8008040 comp rx=0 tx=0).stop 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 msgr2=0x7f3be815b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3be401abf0 tx=0x7f3be40192e0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 shutdown_connections 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3bcc066280 0x7f3bcc068730 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3be80ceb80 0x7f3be80c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3be80b7980 0x7f3be8154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 --2- 172.21.15.37:0/3072483139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3be80b3c20 0x7f3be815b770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 >> 172.21.15.37:0/3072483139 conn(0x7f3be8073090 msgr2=0x7f3be80b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 shutdown_connections 2023-07-09T21:23:20.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.273+0000 7f3befc7b640 1 -- 172.21.15.37:0/3072483139 wait complete. 2023-07-09T21:23:20.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 Processor -- start 2023-07-09T21:23:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 -- start start 2023-07-09T21:23:20.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61d00ceb80 0x7f61d00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61d00b3c20 0x7f61d00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00cd070 con 0x7f61d00ceb80 2023-07-09T21:23:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61d00cfd70 con 0x7f61d00b3c20 2023-07-09T21:23:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61d5dc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d015bf80 con 0x7f61d00b7980 2023-07-09T21:23:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61d00ceb80 0x7f61d00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61d00ceb80 0x7f61d00cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38964/0 (socket says 172.21.15.37:38964) 2023-07-09T21:23:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 -- 172.21.15.37:0/1487316137 learned_addr learned my addr 172.21.15.37:0/1487316137 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61cffff640 1 --2- 172.21.15.37:0/1487316137 >> v2:172.21.15.119:3300/0 conn(0x7f61d00b3c20 0x7f61d00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61cf7fe640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 -- 172.21.15.37:0/1487316137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 msgr2=0x7f61d0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 -- 172.21.15.37:0/1487316137 >> v2:172.21.15.119:3300/0 conn(0x7f61d00b3c20 msgr2=0x7f61d00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 --2- 172.21.15.37:0/1487316137 >> v2:172.21.15.119:3300/0 conn(0x7f61d00b3c20 0x7f61d00b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.437+0000 7f61ceffd640 1 -- 172.21.15.37:0/1487316137 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d0160570 con 0x7f61d00ceb80 2023-07-09T21:23:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61ceffd640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00ceb80 0x7f61d00cef90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61d008ad30 tx=0x7f61c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef8cd9aa523dc5b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61ce7fc640 1 -- 172.21.15.37:0/1487316137 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ab600 con 0x7f61d00ceb80 2023-07-09T21:23:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61ce7fc640 1 -- 172.21.15.37:0/1487316137 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c40a7050 con 0x7f61d00ceb80 2023-07-09T21:23:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61ce7fc640 1 -- 172.21.15.37:0/1487316137 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c40ab980 con 0x7f61d00ceb80 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 -- 172.21.15.37:0/1487316137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00ceb80 msgr2=0x7f61d00cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00ceb80 0x7f61d00cef90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f61d008ad30 tx=0x7f61c401c500 comp rx=0 tx=0).stop 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 -- 172.21.15.37:0/1487316137 shutdown_connections 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00ceb80 0x7f61d00cef90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/1487316137 >> v2:172.21.15.119:3300/0 conn(0x7f61d00b3c20 0x7f61d00b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/1487316137 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 -- 172.21.15.37:0/1487316137 >> 172.21.15.37:0/1487316137 conn(0x7f61d0073090 msgr2=0x7f61d0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 -- 172.21.15.37:0/1487316137 shutdown_connections 2023-07-09T21:23:20.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.441+0000 7f61d5dc5640 1 -- 172.21.15.37:0/1487316137 wait complete. 2023-07-09T21:23:20.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 Processor -- start 2023-07-09T21:23:20.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- start start 2023-07-09T21:23:20.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d01505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61d00ceb80 0x7f61d015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0151070 con 0x7f61d00b3c20 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00b7180 con 0x7f61d00ceb80 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d00cc5b0 con 0x7f61d00b7980 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38968/0 (socket says 172.21.15.37:38968) 2023-07-09T21:23:20.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 -- 172.21.15.37:0/794837916 learned_addr learned my addr 172.21.15.37:0/794837916 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:20.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cffff640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61d00ceb80 0x7f61d015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61ceffd640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d01505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 -- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 msgr2=0x7f61d01505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d01505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 -- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61d00ceb80 msgr2=0x7f61d015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61d00ceb80 0x7f61d015e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 -- 172.21.15.37:0/794837916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61c40094d0 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61cf7fe640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61c000d800 tx=0x7f61c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000b6c0 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c000b820 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c000bb90 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d00b6bc0 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.445+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d00cc1f0 con 0x7f61d00b3c20 2023-07-09T21:23:20.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d004d7d0 con 0x7f61d00b3c20 2023-07-09T21:23:20.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61c000bcf0 con 0x7f61d00b3c20 2023-07-09T21:23:20.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61b7fff640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 0x7f61bc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f61c0084180 con 0x7f61d00b3c20 2023-07-09T21:23:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61ceffd640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 0x7f61bc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.449+0000 7f61ceffd640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 0x7f61bc068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ad000 tx=0x7f61c40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.453+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61c0055070 con 0x7f61d00b3c20 2023-07-09T21:23:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.609+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f61d00b1600 con 0x7f61d00b3c20 2023-07-09T21:23:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.609+0000 7f61b7fff640 1 -- 172.21.15.37:0/794837916 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f61c0054c00 con 0x7f61d00b3c20 2023-07-09T21:23:20.616 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 msgr2=0x7f61bc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 0x7f61bc068730 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f61c40ad000 tx=0x7f61c40a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 msgr2=0x7f61d01598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61c000d800 tx=0x7f61c000dcc0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 shutdown_connections 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f61bc066280 0x7f61bc068730 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61d00ceb80 0x7f61d015e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61d00b7980 0x7f61d01505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 --2- 172.21.15.37:0/794837916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61d00b3c20 0x7f61d01598f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 >> 172.21.15.37:0/794837916 conn(0x7f61d0073090 msgr2=0x7f61d015f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 shutdown_connections 2023-07-09T21:23:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.613+0000 7f61d5dc5640 1 -- 172.21.15.37:0/794837916 wait complete. 2023-07-09T21:23:20.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 Processor -- start 2023-07-09T21:23:20.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 -- start start 2023-07-09T21:23:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 0x7fc13406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 0x7fc1340c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1340c9090 con 0x7fc1340c4350 2023-07-09T21:23:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1340c47f0 con 0x7fc13406b970 2023-07-09T21:23:20.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc13ae19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340cbf40 con 0x7fc1341585b0 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc1393b6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc1340c4350 0x7fc13415c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58082/0 (socket says 172.21.15.37:58082) 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc1393b6640 1 -- 172.21.15.37:0/2722145429 learned_addr learned my addr 172.21.15.37:0/2722145429 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc133fff640 1 --2- 172.21.15.37:0/2722145429 >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 0x7fc1340c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc138bb5640 1 --2- 172.21.15.37:0/2722145429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 0x7fc13406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.777+0000 7fc1337fe640 1 -- 172.21.15.37:0/2722145429 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686826845 0 0) 0x7fc1340c9090 con 0x7fc1340c4350 2023-07-09T21:23:20.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc1337fe640 1 -- 172.21.15.37:0/2722145429 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc124003530 con 0x7fc1340c4350 2023-07-09T21:23:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc138bb5640 1 -- 172.21.15.37:0/2722145429 >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 msgr2=0x7fc1340c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc138bb5640 1 --2- 172.21.15.37:0/2722145429 >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 0x7fc1340c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc138bb5640 1 -- 172.21.15.37:0/2722145429 >> v1:172.21.15.37:6789/0 conn(0x7fc1340c4350 legacy=0x7fc13415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc138bb5640 1 -- 172.21.15.37:0/2722145429 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1340c8a60 con 0x7fc1341585b0 2023-07-09T21:23:20.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc133fff640 1 --2- 172.21.15.37:0/2722145429 >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 0x7fc1340c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:20.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc138bb5640 1 --2- 172.21.15.37:0/2722145429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 0x7fc13406b430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ade1a610bb4f8e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc1337fe640 1 -- 172.21.15.37:0/2722145429 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280ab650 con 0x7fc1341585b0 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc1337fe640 1 -- 172.21.15.37:0/2722145429 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1280ab7b0 con 0x7fc1341585b0 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.781+0000 7fc1337fe640 1 -- 172.21.15.37:0/2722145429 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280abb40 con 0x7fc1341585b0 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- 172.21.15.37:0/2722145429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 msgr2=0x7fc13406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- 172.21.15.37:0/2722145429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 0x7fc13406b430 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1280097c0 tx=0x7fc12801c450 comp rx=0 tx=0).stop 2023-07-09T21:23:20.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- 172.21.15.37:0/2722145429 shutdown_connections 2023-07-09T21:23:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- 172.21.15.37:0/2722145429 >> v2:172.21.15.119:3300/0 conn(0x7fc13406b970 0x7fc1340c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- 172.21.15.37:0/2722145429 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1341585b0 0x7fc13406b430 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- 172.21.15.37:0/2722145429 >> 172.21.15.37:0/2722145429 conn(0x7fc1340cde40 msgr2=0x7fc1340ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- 172.21.15.37:0/2722145429 shutdown_connections 2023-07-09T21:23:20.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- 172.21.15.37:0/2722145429 wait complete. 2023-07-09T21:23:20.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 Processor -- start 2023-07-09T21:23:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- start start 2023-07-09T21:23:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1340c4350 0x7fc1340afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 0x7fc1340affb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340c6f30 con 0x7fc13406b970 2023-07-09T21:23:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1340c7790 con 0x7fc1341585b0 2023-07-09T21:23:20.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc13ae19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc134144f00 con 0x7fc1340c4350 2023-07-09T21:23:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38972/0 (socket says 172.21.15.37:38972) 2023-07-09T21:23:20.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 -- 172.21.15.37:0/1448404663 learned_addr learned my addr 172.21.15.37:0/1448404663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc133fff640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1340c4350 0x7fc1340afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc1393b6640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 0x7fc1340affb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 -- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1340c4350 msgr2=0x7fc1340afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1340c4350 0x7fc1340afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 -- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 msgr2=0x7fc1340affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 0x7fc1340affb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc138bb5640 1 -- 172.21.15.37:0/1448404663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc120009420 con 0x7fc13406b970 2023-07-09T21:23:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.785+0000 7fc1393b6640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 0x7fc1340affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc138bb5640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc12801a080 tx=0x7fc1280191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280abd30 con 0x7fc13406b970 2023-07-09T21:23:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1280abe90 con 0x7fc13406b970 2023-07-09T21:23:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1280bf650 con 0x7fc13406b970 2023-07-09T21:23:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc128009420 con 0x7fc13406b970 2023-07-09T21:23:20.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1340c7140 con 0x7fc13406b970 2023-07-09T21:23:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13404d7d0 con 0x7fc13406b970 2023-07-09T21:23:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc1280b43f0 con 0x7fc13406b970 2023-07-09T21:23:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 0x7fc118068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:20.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fc12811e310 con 0x7fc13406b970 2023-07-09T21:23:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.789+0000 7fc133fff640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 0x7fc118068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.793+0000 7fc133fff640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 0x7fc118068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1340b3fc0 tx=0x7fc120008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.793+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc1280eb6b0 con 0x7fc13406b970 2023-07-09T21:23:20.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.949+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc13406b210 con 0x7fc13406b970 2023-07-09T21:23:20.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.949+0000 7fc1317fa640 1 -- 172.21.15.37:0/1448404663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc1280eecd0 con 0x7fc13406b970 2023-07-09T21:23:20.957 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:20.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 msgr2=0x7fc118068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 0x7fc118068760 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc1340b3fc0 tx=0x7fc120008040 comp rx=0 tx=0).stop 2023-07-09T21:23:20.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 msgr2=0x7fc1341449c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:20.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc12801a080 tx=0x7fc1280191f0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 shutdown_connections 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc1180662b0 0x7fc118068760 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc1341585b0 0x7fc1340affb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc1340c4350 0x7fc1340afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 --2- 172.21.15.37:0/1448404663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc13406b970 0x7fc1341449c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 >> 172.21.15.37:0/1448404663 conn(0x7fc1340cde40 msgr2=0x7fc134152190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 shutdown_connections 2023-07-09T21:23:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:20.953+0000 7fc13ae19640 1 -- 172.21.15.37:0/1448404663 wait complete. 2023-07-09T21:23:20.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.117+0000 7f91c887b640 1 Processor -- start 2023-07-09T21:23:21.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.117+0000 7f91c887b640 1 -- start start 2023-07-09T21:23:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c887b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40cf290 0x7f91c4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c887b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91c40d0780 0x7f91c40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c887b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91c415bf80 con 0x7f91c40b7980 2023-07-09T21:23:21.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c887b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91c40cd070 con 0x7f91c40d0780 2023-07-09T21:23:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c887b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40cfd70 con 0x7f91c40cf290 2023-07-09T21:23:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f91c40b7980 0x7f91c40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58086/0 (socket says 172.21.15.37:58086) 2023-07-09T21:23:21.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c259c640 1 -- 172.21.15.37:0/1540526194 learned_addr learned my addr 172.21.15.37:0/1540526194 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91bbfff640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40cf290 0x7f91c4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c2d9d640 1 --2- 172.21.15.37:0/1540526194 >> v2:172.21.15.119:3300/0 conn(0x7f91c40d0780 0x7f91c40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189113627 0 0) 0x7f91b4001120 con 0x7f91c40b7980 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b0003530 con 0x7f91c40b7980 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c2d9d640 1 -- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40cf290 msgr2=0x7f91c4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:21.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c2d9d640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40cf290 0x7f91c4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 376871496 0 0) 0x7f91b0003530 con 0x7f91c40b7980 2023-07-09T21:23:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c2d9d640 1 -- 172.21.15.37:0/1540526194 >> v1:172.21.15.37:6789/0 conn(0x7f91c40b7980 legacy=0x7f91c40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.121+0000 7f91c2d9d640 1 -- 172.21.15.37:0/1540526194 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4160570 con 0x7f91c40d0780 2023-07-09T21:23:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c2d9d640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c40d0c00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009d90 tx=0x7f91bc01c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98ce6356488062ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91b4001810 con 0x7f91c40d0780 2023-07-09T21:23:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc0a6480 con 0x7f91c40d0780 2023-07-09T21:23:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c1d9b640 1 -- 172.21.15.37:0/1540526194 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0a6810 con 0x7f91c40d0780 2023-07-09T21:23:21.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 msgr2=0x7f91c40d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c40d0c00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009d90 tx=0x7f91bc01c870 comp rx=0 tx=0).stop 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- 172.21.15.37:0/1540526194 shutdown_connections 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c40d0c00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 --2- 172.21.15.37:0/1540526194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40cf290 0x7f91c4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- 172.21.15.37:0/1540526194 >> 172.21.15.37:0/1540526194 conn(0x7f91c4073090 msgr2=0x7f91c4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- 172.21.15.37:0/1540526194 shutdown_connections 2023-07-09T21:23:21.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- 172.21.15.37:0/1540526194 wait complete. 2023-07-09T21:23:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 Processor -- start 2023-07-09T21:23:21.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.125+0000 7f91c887b640 1 -- start start 2023-07-09T21:23:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40b7980 0x7f91c40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b3d70 con 0x7f91c40cf290 2023-07-09T21:23:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b2790 con 0x7f91c40d0780 2023-07-09T21:23:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b2a70 con 0x7f91c40b7980 2023-07-09T21:23:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38984/0 (socket says 172.21.15.37:38984) 2023-07-09T21:23:21.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 -- 172.21.15.37:0/3936720717 learned_addr learned my addr 172.21.15.37:0/3936720717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:21.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c2d9d640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c259c640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40b7980 0x7f91c40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 -- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40b7980 msgr2=0x7f91c40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40b7980 0x7f91c40b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 -- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 msgr2=0x7f91c415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 -- 172.21.15.37:0/3936720717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc009a70 con 0x7f91c40cf290 2023-07-09T21:23:21.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91bbfff640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e930 tx=0x7f91ac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac009690 con 0x7f91c40cf290 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91ac00ca00 con 0x7f91c40cf290 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91c40b2d50 con 0x7f91c40cf290 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91ac00cd70 con 0x7f91c40cf290 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c40b3310 con 0x7f91c40cf290 2023-07-09T21:23:21.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.129+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c404d7d0 con 0x7f91c40cf290 2023-07-09T21:23:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.133+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f91ac013470 con 0x7f91c40cf290 2023-07-09T21:23:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.133+0000 7f91baffd640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 0x7f91a4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.133+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f91ac083fe0 con 0x7f91c40cf290 2023-07-09T21:23:21.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.133+0000 7f91c259c640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 0x7f91a4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.133+0000 7f91c259c640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 0x7f91a4068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f91b40015a0 tx=0x7f91b4001530 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.137+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91ac051520 con 0x7f91c40cf290 2023-07-09T21:23:21.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.289+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91c40b1600 con 0x7f91c40cf290 2023-07-09T21:23:21.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91baffd640 1 -- 172.21.15.37:0/3936720717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91ac054b40 con 0x7f91c40cf290 2023-07-09T21:23:21.298 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 msgr2=0x7f91a4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 0x7f91a4068730 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f91b40015a0 tx=0x7f91b4001530 comp rx=0 tx=0).stop 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 msgr2=0x7f91c4152e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f91ac00e930 tx=0x7f91ac00edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 shutdown_connections 2023-07-09T21:23:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f91a4066280 0x7f91a4068730 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91c40d0780 0x7f91c415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91c40cf290 0x7f91c4152e10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 --2- 172.21.15.37:0/3936720717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91c40b7980 0x7f91c40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 >> 172.21.15.37:0/3936720717 conn(0x7f91c4073090 msgr2=0x7f91c4155120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 shutdown_connections 2023-07-09T21:23:21.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.293+0000 7f91c887b640 1 -- 172.21.15.37:0/3936720717 wait complete. 2023-07-09T21:23:21.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:23:21.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 Processor -- start 2023-07-09T21:23:21.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 -- start start 2023-07-09T21:23:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa89806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa898070bb0 0x7fa89806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89806d290 con 0x7fa89806ce40 2023-07-09T21:23:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa898070000 con 0x7fa898070bb0 2023-07-09T21:23:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.457+0000 7fa89f27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89806afa0 con 0x7fa898159830 2023-07-09T21:23:21.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa898070bb0 0x7fa89806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89d017640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa89806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89d818640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa89806ce40 0x7fa89815d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:37700/0 (socket says 172.21.15.37:37700) 2023-07-09T21:23:21.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89d818640 1 -- 172.21.15.37:0/2923865128 learned_addr learned my addr 172.21.15.37:0/2923865128 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 -- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 msgr2=0x7fa89806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 --2- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa89806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 -- 172.21.15.37:0/2923865128 >> v1:172.21.15.119:6789/0 conn(0x7fa89806ce40 legacy=0x7fa89815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa88ffff640 1 -- 172.21.15.37:0/2923865128 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828354983 0 0) 0x7fa8900014a0 con 0x7fa89806ce40 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 -- 172.21.15.37:0/2923865128 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89806b280 con 0x7fa898070bb0 2023-07-09T21:23:21.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa89c816640 1 --2- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa89806c900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8880097c0 tx=0x7fa88801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9badd738f598db6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa88ffff640 1 -- 172.21.15.37:0/2923865128 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880ab600 con 0x7fa898070bb0 2023-07-09T21:23:21.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa88ffff640 1 -- 172.21.15.37:0/2923865128 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880a7050 con 0x7fa898070bb0 2023-07-09T21:23:21.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.461+0000 7fa88ffff640 1 -- 172.21.15.37:0/2923865128 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8880ab980 con 0x7fa898070bb0 2023-07-09T21:23:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 msgr2=0x7fa89806c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa89806c900 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8880097c0 tx=0x7fa88801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- 172.21.15.37:0/2923865128 shutdown_connections 2023-07-09T21:23:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa89806c900 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- 172.21.15.37:0/2923865128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa89806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- 172.21.15.37:0/2923865128 >> 172.21.15.37:0/2923865128 conn(0x7fa8980694c0 msgr2=0x7fa8980698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- 172.21.15.37:0/2923865128 shutdown_connections 2023-07-09T21:23:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- 172.21.15.37:0/2923865128 wait complete. 2023-07-09T21:23:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 Processor -- start 2023-07-09T21:23:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- start start 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa898152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa898152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8981f8190 con 0x7fa89806ce40 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa898152560 con 0x7fa898070bb0 2023-07-09T21:23:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89f27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa898151690 con 0x7fa898159830 2023-07-09T21:23:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89d017640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89d017640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38988/0 (socket says 172.21.15.37:38988) 2023-07-09T21:23:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.465+0000 7fa89d017640 1 -- 172.21.15.37:0/3786405020 learned_addr learned my addr 172.21.15.37:0/3786405020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d818640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa898152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89c816640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa898152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 -- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 msgr2=0x7fa898152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa898152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 -- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 msgr2=0x7fa898152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa898152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 -- 172.21.15.37:0/3786405020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009420 con 0x7fa89806ce40 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d818640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa898152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89c816640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa898152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89d017640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa89400e960 tx=0x7fa89400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa894009690 con 0x7fa89806ce40 2023-07-09T21:23:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89400ca00 con 0x7fa89806ce40 2023-07-09T21:23:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89400cd90 con 0x7fa89806ce40 2023-07-09T21:23:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa898150b10 con 0x7fa89806ce40 2023-07-09T21:23:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8981510d0 con 0x7fa89806ce40 2023-07-09T21:23:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa898154900 con 0x7fa89806ce40 2023-07-09T21:23:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa894013470 con 0x7fa89806ce40 2023-07-09T21:23:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 0x7fa87c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.469+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa8940843f0 con 0x7fa89806ce40 2023-07-09T21:23:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.473+0000 7fa89c816640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 0x7fa87c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.473+0000 7fa89c816640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 0x7fa87c068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ad000 tx=0x7fa8880a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.473+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa898154900 con 0x7fa89806ce40 2023-07-09T21:23:21.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.637+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa898154900 con 0x7fa89806ce40 2023-07-09T21:23:21.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.637+0000 7fa88dffb640 1 -- 172.21.15.37:0/3786405020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa898154900 con 0x7fa89806ce40 2023-07-09T21:23:21.646 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-07-09T21:23:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 msgr2=0x7fa87c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 0x7fa87c068730 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa8880ad000 tx=0x7fa8880a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 msgr2=0x7fa8981f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fa89400e960 tx=0x7fa89400ee20 comp rx=0 tx=0).stop 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 shutdown_connections 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa87c066280 0x7fa87c068730 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa898159830 0x7fa898152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa898070bb0 0x7fa898152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 --2- 172.21.15.37:0/3786405020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89806ce40 0x7fa8981f7c50 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 >> 172.21.15.37:0/3786405020 conn(0x7fa8980694c0 msgr2=0x7fa8980abce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 shutdown_connections 2023-07-09T21:23:21.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.641+0000 7fa89f27b640 1 -- 172.21.15.37:0/3786405020 wait complete. 2023-07-09T21:23:21.667 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi119.front.sepia.ceph.com... 2023-07-09T21:23:21.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:21.668 DEBUG:teuthology.orchestra.run.smithi119:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-07-09T21:23:21.693 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:21.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:23:21.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:21.696 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:23:21.748 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:23:21.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:21.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 Processor -- start 2023-07-09T21:23:21.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 -- start start 2023-07-09T21:23:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69500b7ab0 0x7f695006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500cef80 0x7f69500b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69500b49f0 con 0x7f69500b4170 2023-07-09T21:23:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69500b7e80 con 0x7f69500b7ab0 2023-07-09T21:23:21.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f69571d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500b4610 con 0x7f69500cef80 2023-07-09T21:23:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69500b7ab0 0x7f695006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69500b7ab0 0x7f695006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38996/0 (socket says 172.21.15.37:38996) 2023-07-09T21:23:21.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 -- 172.21.15.37:0/1720092294 learned_addr learned my addr 172.21.15.37:0/1720092294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6947fff640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500cef80 0x7f69500b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 -- 172.21.15.37:0/1720092294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500cef80 msgr2=0x7f69500b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500cef80 0x7f69500b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 -- 172.21.15.37:0/1720092294 >> v1:172.21.15.119:6789/0 conn(0x7f69500b4170 legacy=0x7f695015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.885+0000 7f6954f6e640 1 -- 172.21.15.37:0/1720092294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500cc8a0 con 0x7f69500b7ab0 2023-07-09T21:23:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f6954f6e640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b7ab0 0x7f695006aa50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd29ca50509f201e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69477fe640 1 -- 172.21.15.37:0/1720092294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0aa670 con 0x7f69500b7ab0 2023-07-09T21:23:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69477fe640 1 -- 172.21.15.37:0/1720092294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0aa7d0 con 0x7f69500b7ab0 2023-07-09T21:23:21.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69477fe640 1 -- 172.21.15.37:0/1720092294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0aab60 con 0x7f69500b7ab0 2023-07-09T21:23:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 -- 172.21.15.37:0/1720092294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b7ab0 msgr2=0x7f695006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b7ab0 0x7f695006aa50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c01c510 comp rx=0 tx=0).stop 2023-07-09T21:23:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 -- 172.21.15.37:0/1720092294 shutdown_connections 2023-07-09T21:23:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500cef80 0x7f69500b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 --2- 172.21.15.37:0/1720092294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b7ab0 0x7f695006aa50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 -- 172.21.15.37:0/1720092294 >> 172.21.15.37:0/1720092294 conn(0x7f6950073090 msgr2=0x7f6950069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 -- 172.21.15.37:0/1720092294 shutdown_connections 2023-07-09T21:23:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.889+0000 7f69571d2640 1 -- 172.21.15.37:0/1720092294 wait complete. 2023-07-09T21:23:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 Processor -- start 2023-07-09T21:23:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- start start 2023-07-09T21:23:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500b7ab0 0x7f69500c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 0x7f6950151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69501518b0 con 0x7f69500b4170 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c6bb0 con 0x7f69500cef80 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c68d0 con 0x7f69500b7ab0 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39004/0 (socket says 172.21.15.37:39004) 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 -- 172.21.15.37:0/1554405715 learned_addr learned my addr 172.21.15.37:0/1554405715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6947fff640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500b7ab0 0x7f69500c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f695576f640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 0x7f6950151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 -- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500b7ab0 msgr2=0x7f69500c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500b7ab0 0x7f69500c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 -- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 msgr2=0x7f6950151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 0x7f6950151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 -- 172.21.15.37:0/1554405715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0094d0 con 0x7f69500b4170 2023-07-09T21:23:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f695576f640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 0x7f6950151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f6954f6e640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f694c01abc0 tx=0x7f694c01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0b3800 con 0x7f69500b4170 2023-07-09T21:23:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0b3980 con 0x7f69500b4170 2023-07-09T21:23:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6950151260 con 0x7f69500b4170 2023-07-09T21:23:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c0b3d30 con 0x7f69500b4170 2023-07-09T21:23:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.893+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6950150df0 con 0x7f69500b4170 2023-07-09T21:23:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.897+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69501510c0 con 0x7f69500b4170 2023-07-09T21:23:21.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.897+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f694c0c6390 con 0x7f69500b4170 2023-07-09T21:23:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.897+0000 7f69457fa640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.897+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f694c11e8f0 con 0x7f69500b4170 2023-07-09T21:23:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.897+0000 7f6947fff640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.901+0000 7f6947fff640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 0x7f693c068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69501f7d70 tx=0x7f6940008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:21.901+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f69501510c0 con 0x7f69500b4170 2023-07-09T21:23:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.089+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69501510c0 con 0x7f69500b4170 2023-07-09T21:23:22.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.089+0000 7f69457fa640 1 -- 172.21.15.37:0/1554405715 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f69501510c0 con 0x7f69500b4170 2023-07-09T21:23:22.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:22.096 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:23:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:23:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 msgr2=0x7f693c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 0x7f693c068730 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f69501f7d70 tx=0x7f6940008040 comp rx=0 tx=0).stop 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 msgr2=0x7f69501508b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f694c01abc0 tx=0x7f694c01ad50 comp rx=0 tx=0).stop 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 shutdown_connections 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f693c066280 0x7f693c068730 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f69500cef80 0x7f6950151d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f69500b7ab0 0x7f69500c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 --2- 172.21.15.37:0/1554405715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69500b4170 0x7f69501508b0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 >> 172.21.15.37:0/1554405715 conn(0x7f6950073090 msgr2=0x7f69500b5070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 shutdown_connections 2023-07-09T21:23:22.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.093+0000 7f69571d2640 1 -- 172.21.15.37:0/1554405715 wait complete. 2023-07-09T21:23:22.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:22.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 Processor -- start 2023-07-09T21:23:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 -- start start 2023-07-09T21:23:22.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07100b4340 0x7f071006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100b49f0 con 0x7f07100b7ab0 2023-07-09T21:23:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07100cc8a0 con 0x7f07100cef80 2023-07-09T21:23:22.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0718740640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07100b7e80 con 0x7f07100b4340 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f07164dc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07100b7ab0 0x7f07100b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58092/0 (socket says 172.21.15.37:58092) 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f07164dc640 1 -- 172.21.15.37:0/3271037171 learned_addr learned my addr 172.21.15.37:0/3271037171 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.253+0000 7f0715cdb640 1 --2- 172.21.15.37:0/3271037171 >> v2:172.21.15.37:3300/0 conn(0x7f07100b4340 0x7f071006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0715cdb640 1 -- 172.21.15.37:0/3271037171 >> v1:172.21.15.119:6789/0 conn(0x7f07100cef80 legacy=0x7f07100d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0715cdb640 1 -- 172.21.15.37:0/3271037171 >> v1:172.21.15.37:6789/0 conn(0x7f07100b7ab0 legacy=0x7f07100b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0715cdb640 1 -- 172.21.15.37:0/3271037171 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07100ccb80 con 0x7f07100b4340 2023-07-09T21:23:22.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f07154da640 1 -- 172.21.15.37:0/3271037171 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3636587146 0 0) 0x7f07100b49f0 con 0x7f07100b7ab0 2023-07-09T21:23:22.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0715cdb640 1 --2- 172.21.15.37:0/3271037171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f071006aa50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07000097c0 tx=0x7f070001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debdd70987edbbdc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f07154da640 1 -- 172.21.15.37:0/3271037171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000ab650 con 0x7f07100b4340 2023-07-09T21:23:22.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f07154da640 1 -- 172.21.15.37:0/3271037171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07000ab7b0 con 0x7f07100b4340 2023-07-09T21:23:22.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f07154da640 1 -- 172.21.15.37:0/3271037171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07000abb40 con 0x7f07100b4340 2023-07-09T21:23:22.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0718740640 1 -- 172.21.15.37:0/3271037171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 msgr2=0x7f071006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.257+0000 7f0718740640 1 --2- 172.21.15.37:0/3271037171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f071006aa50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f07000097c0 tx=0x7f070001c450 comp rx=0 tx=0).stop 2023-07-09T21:23:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- 172.21.15.37:0/3271037171 shutdown_connections 2023-07-09T21:23:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 --2- 172.21.15.37:0/3271037171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f071006aa50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- 172.21.15.37:0/3271037171 >> 172.21.15.37:0/3271037171 conn(0x7f0710073090 msgr2=0x7f0710069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- 172.21.15.37:0/3271037171 shutdown_connections 2023-07-09T21:23:22.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- 172.21.15.37:0/3271037171 wait complete. 2023-07-09T21:23:22.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 Processor -- start 2023-07-09T21:23:22.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- start start 2023-07-09T21:23:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 0x7f07100b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 0x7f07100c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07100c8320 con 0x7f07100b4340 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0710154da0 con 0x7f07100cef80 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0718740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071014fec0 con 0x7f07100b7ab0 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39028/0 (socket says 172.21.15.37:39028) 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 -- 172.21.15.37:0/2515358698 learned_addr learned my addr 172.21.15.37:0/2515358698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0716cdd640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 0x7f07100c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0715cdb640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 0x7f07100b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 -- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 msgr2=0x7f07100b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 0x7f07100b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 -- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 msgr2=0x7f07100c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 0x7f07100c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 -- 172.21.15.37:0/2515358698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700009420 con 0x7f07100b4340 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0716cdd640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 0x7f07100c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0715cdb640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 0x7f07100b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f07164dc640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c4d0 tx=0x7f070c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.261+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c0074e0 con 0x7f07100b4340 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c007640 con 0x7f07100b4340 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07100c7d60 con 0x7f07100b4340 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c004a30 con 0x7f07100b4340 2023-07-09T21:23:22.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0710154a30 con 0x7f07100b4340 2023-07-09T21:23:22.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0710154890 con 0x7f07100b4340 2023-07-09T21:23:22.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f070c004b90 con 0x7f07100b4340 2023-07-09T21:23:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0706ffd640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 0x7f06f4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f070c083320 con 0x7f07100b4340 2023-07-09T21:23:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.265+0000 7f0715cdb640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 0x7f06f4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.269+0000 7f0715cdb640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 0x7f06f4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07000af000 tx=0x7f0700008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.269+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0710154890 con 0x7f07100b4340 2023-07-09T21:23:22.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.425+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0710154890 con 0x7f07100b4340 2023-07-09T21:23:22.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.425+0000 7f0706ffd640 1 -- 172.21.15.37:0/2515358698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f0710154890 con 0x7f07100b4340 2023-07-09T21:23:22.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:22.432 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 msgr2=0x7f06f4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 0x7f06f4068730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f07000af000 tx=0x7f0700008040 comp rx=0 tx=0).stop 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 msgr2=0x7f0710146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f070c00c4d0 tx=0x7f070c00c990 comp rx=0 tx=0).stop 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 shutdown_connections 2023-07-09T21:23:22.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f06f4066280 0x7f06f4068730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07100cef80 0x7f07100c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07100b7ab0 0x7f07100b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 --2- 172.21.15.37:0/2515358698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07100b4340 0x7f0710146c60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 >> 172.21.15.37:0/2515358698 conn(0x7f0710073090 msgr2=0x7f0710069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 shutdown_connections 2023-07-09T21:23:22.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.429+0000 7f0718740640 1 -- 172.21.15.37:0/2515358698 wait complete. 2023-07-09T21:23:22.453 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:22:29.025615+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:22:30.216661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:22.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 Processor -- start 2023-07-09T21:23:22.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 -- start start 2023-07-09T21:23:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 0x7f5cd8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 0x7f5cd80d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd815bf80 con 0x7f5cd80b7980 2023-07-09T21:23:22.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd80cd070 con 0x7f5cd80d0780 2023-07-09T21:23:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cdda48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd80cfd70 con 0x7f5cd80cf290 2023-07-09T21:23:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cd80b7980 0x7f5cd80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58106/0 (socket says 172.21.15.37:58106) 2023-07-09T21:23:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd6ffd640 1 -- 172.21.15.37:0/3959928895 learned_addr learned my addr 172.21.15.37:0/3959928895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:22.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd67fc640 1 --2- 172.21.15.37:0/3959928895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 0x7f5cd8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd77fe640 1 --2- 172.21.15.37:0/3959928895 >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 0x7f5cd80d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd5ffb640 1 -- 172.21.15.37:0/3959928895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629224984 0 0) 0x7f5cc8001120 con 0x7f5cd80b7980 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd5ffb640 1 -- 172.21.15.37:0/3959928895 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc0003530 con 0x7f5cd80b7980 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd67fc640 1 -- 172.21.15.37:0/3959928895 >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 msgr2=0x7f5cd80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd67fc640 1 --2- 172.21.15.37:0/3959928895 >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 0x7f5cd80d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd67fc640 1 -- 172.21.15.37:0/3959928895 >> v1:172.21.15.37:6789/0 conn(0x7f5cd80b7980 legacy=0x7f5cd80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd67fc640 1 -- 172.21.15.37:0/3959928895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd8160570 con 0x7f5cd80cf290 2023-07-09T21:23:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.593+0000 7f5cd77fe640 1 --2- 172.21.15.37:0/3959928895 >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 0x7f5cd80d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:22.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cd67fc640 1 --2- 172.21.15.37:0/3959928895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 0x7f5cd8160030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097c0 tx=0x7f5ccc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9162bd3b8d9a6dc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cd5ffb640 1 -- 172.21.15.37:0/3959928895 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0ab600 con 0x7f5cd80cf290 2023-07-09T21:23:22.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cd5ffb640 1 -- 172.21.15.37:0/3959928895 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0a7050 con 0x7f5cd80cf290 2023-07-09T21:23:22.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cd5ffb640 1 -- 172.21.15.37:0/3959928895 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0ab980 con 0x7f5cd80cf290 2023-07-09T21:23:22.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 -- 172.21.15.37:0/3959928895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 msgr2=0x7f5cd8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 --2- 172.21.15.37:0/3959928895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 0x7f5cd8160030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0097c0 tx=0x7f5ccc01c480 comp rx=0 tx=0).stop 2023-07-09T21:23:22.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 -- 172.21.15.37:0/3959928895 shutdown_connections 2023-07-09T21:23:22.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 --2- 172.21.15.37:0/3959928895 >> v2:172.21.15.119:3300/0 conn(0x7f5cd80d0780 0x7f5cd80d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 --2- 172.21.15.37:0/3959928895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80cf290 0x7f5cd8160030 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 -- 172.21.15.37:0/3959928895 >> 172.21.15.37:0/3959928895 conn(0x7f5cd8073090 msgr2=0x7f5cd8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 -- 172.21.15.37:0/3959928895 shutdown_connections 2023-07-09T21:23:22.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.597+0000 7f5cdda48640 1 -- 172.21.15.37:0/3959928895 wait complete. 2023-07-09T21:23:22.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 Processor -- start 2023-07-09T21:23:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- start start 2023-07-09T21:23:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 0x7f5cd81551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd80cf290 0x7f5cd80c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8152730 con 0x7f5cd80d0780 2023-07-09T21:23:22.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8152b50 con 0x7f5cd80cf290 2023-07-09T21:23:22.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd81556f0 con 0x7f5cd80b7980 2023-07-09T21:23:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd6ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 0x7f5cd81551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39044/0 (socket says 172.21.15.37:39044) 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 -- 172.21.15.37:0/1044131786 learned_addr learned my addr 172.21.15.37:0/1044131786 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd67fc640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd80cf290 0x7f5cd80c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 -- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 msgr2=0x7f5cd81551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 0x7f5cd81551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 -- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd80cf290 msgr2=0x7f5cd80c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd80cf290 0x7f5cd80c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 -- 172.21.15.37:0/1044131786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0009a70 con 0x7f5cd80d0780 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd6ffd640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 0x7f5cd81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cd77fe640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000efc0 tx=0x7f5cd0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0009d70 con 0x7f5cd80d0780 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd000f040 con 0x7f5cd80d0780 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00039a0 con 0x7f5cd80d0780 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc009420 con 0x7f5cd80d0780 2023-07-09T21:23:22.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.601+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd8151ab0 con 0x7f5cd80d0780 2023-07-09T21:23:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd8152870 con 0x7f5cd80d0780 2023-07-09T21:23:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5cd00144a0 con 0x7f5cd80d0780 2023-07-09T21:23:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cbffff640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f5cd00848d0 con 0x7f5cd80d0780 2023-07-09T21:23:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cd6ffd640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.605+0000 7f5cd6ffd640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 0x7f5cc4068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8007fd0 tx=0x7f5cc8007bc0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.609+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cd8152870 con 0x7f5cd80d0780 2023-07-09T21:23:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cd8152870 con 0x7f5cd80d0780 2023-07-09T21:23:22.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cbffff640 1 -- 172.21.15.37:0/1044131786 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5cd8152870 con 0x7f5cd80d0780 2023-07-09T21:23:22.770 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 msgr2=0x7f5cc4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 0x7f5cc4068730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8007fd0 tx=0x7f5cc8007bc0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 msgr2=0x7f5cd81542c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000efc0 tx=0x7f5cd0009f90 comp rx=0 tx=0).stop 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 shutdown_connections 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f5cc4066280 0x7f5cc4068730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd80d0780 0x7f5cd81542c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd80cf290 0x7f5cd80c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 --2- 172.21.15.37:0/1044131786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd80b7980 0x7f5cd81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 >> 172.21.15.37:0/1044131786 conn(0x7f5cd8073090 msgr2=0x7f5cd815cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 shutdown_connections 2023-07-09T21:23:22.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.765+0000 7f5cdda48640 1 -- 172.21.15.37:0/1044131786 wait complete. 2023-07-09T21:23:22.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.929+0000 7f12409e8640 1 Processor -- start 2023-07-09T21:23:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.929+0000 7f12409e8640 1 -- start start 2023-07-09T21:23:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f123c0cfb40 0x7f123c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 0x7f123c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0b0ed0 0x7f123c0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0ce640 con 0x7f123c0cfb40 2023-07-09T21:23:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0d0450 con 0x7f123c0b1420 2023-07-09T21:23:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f12409e8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0ce080 con 0x7f123c0b0ed0 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f123c0cfb40 0x7f123c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f123c0cfb40 0x7f123c0cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39060/0 (socket says 172.21.15.37:39060) 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 -- 172.21.15.37:0/77650955 learned_addr learned my addr 172.21.15.37:0/77650955 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123b59e640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0b0ed0 0x7f123c0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f1233fff640 1 --2- 172.21.15.37:0/77650955 >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 0x7f123c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 -- 172.21.15.37:0/77650955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0b0ed0 msgr2=0x7f123c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0b0ed0 0x7f123c0ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 -- 172.21.15.37:0/77650955 >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 msgr2=0x7f123c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 --2- 172.21.15.37:0/77650955 >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 0x7f123c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f123ad9d640 1 -- 172.21.15.37:0/77650955 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0ce360 con 0x7f123c0cfb40 2023-07-09T21:23:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.933+0000 7f1233fff640 1 --2- 172.21.15.37:0/77650955 >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 0x7f123c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f123ad9d640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0cfb40 0x7f123c0cff10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f123c0716f0 tx=0x7f122c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c8eda85db3ad45 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f123a59c640 1 -- 172.21.15.37:0/77650955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0ac600 con 0x7f123c0cfb40 2023-07-09T21:23:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f123a59c640 1 -- 172.21.15.37:0/77650955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0a8050 con 0x7f123c0cfb40 2023-07-09T21:23:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f123a59c640 1 -- 172.21.15.37:0/77650955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0ac980 con 0x7f123c0cfb40 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- 172.21.15.37:0/77650955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0cfb40 msgr2=0x7f123c0cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0cfb40 0x7f123c0cff10 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f123c0716f0 tx=0x7f122c01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- 172.21.15.37:0/77650955 shutdown_connections 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0b0ed0 0x7f123c0ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 --2- 172.21.15.37:0/77650955 >> v2:172.21.15.119:3300/0 conn(0x7f123c0b1420 0x7f123c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 --2- 172.21.15.37:0/77650955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0cfb40 0x7f123c0cff10 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- 172.21.15.37:0/77650955 >> 172.21.15.37:0/77650955 conn(0x7f123c072d20 msgr2=0x7f123c0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- 172.21.15.37:0/77650955 shutdown_connections 2023-07-09T21:23:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- 172.21.15.37:0/77650955 wait complete. 2023-07-09T21:23:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 Processor -- start 2023-07-09T21:23:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.937+0000 7f12409e8640 1 -- start start 2023-07-09T21:23:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 0x7f123c0b6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 0x7f123c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b7aa0 con 0x7f123c0b1420 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b2e20 con 0x7f123c0b0ed0 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c0b3100 con 0x7f123c0cfb40 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39074/0 (socket says 172.21.15.37:39074) 2023-07-09T21:23:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 -- 172.21.15.37:0/200790622 learned_addr learned my addr 172.21.15.37:0/200790622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f123ad9d640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 0x7f123c0b6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f123b59e640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 0x7f123c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 -- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 msgr2=0x7f123c0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 0x7f123c0b3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 -- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 msgr2=0x7f123c0b6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 0x7f123c0b6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 -- 172.21.15.37:0/200790622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c0094d0 con 0x7f123c0b1420 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f123ad9d640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 0x7f123c0b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f123b59e640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 0x7f123c0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f1233fff640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f122400d800 tx=0x7f122400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12240096c0 con 0x7f123c0b1420 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1224009820 con 0x7f123c0b1420 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1224009bd0 con 0x7f123c0b1420 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0b33e0 con 0x7f123c0b1420 2023-07-09T21:23:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c0b39a0 con 0x7f123c0b1420 2023-07-09T21:23:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c0b3b60 con 0x7f123c0b1420 2023-07-09T21:23:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.941+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1224009d30 con 0x7f123c0b1420 2023-07-09T21:23:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.945+0000 7f12337fe640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 0x7f121c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.945+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f1224084460 con 0x7f123c0b1420 2023-07-09T21:23:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.945+0000 7f123ad9d640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 0x7f121c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.945+0000 7f123ad9d640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 0x7f121c068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f122c0ae000 tx=0x7f122c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:22.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:22.949+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1224051890 con 0x7f123c0b1420 2023-07-09T21:23:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.101+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f123c04e020 con 0x7f123c0b1420 2023-07-09T21:23:23.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.101+0000 7f12337fe640 1 -- 172.21.15.37:0/200790622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1224054eb0 con 0x7f123c0b1420 2023-07-09T21:23:23.109 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:23.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 msgr2=0x7f121c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 0x7f121c068760 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f122c0ae000 tx=0x7f122c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 msgr2=0x7f123c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f122400d800 tx=0x7f122400dcc0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 shutdown_connections 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f121c0662b0 0x7f121c068760 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f123c0cfb40 0x7f123c0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f123c0b1420 0x7f123c0c9040 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 --2- 172.21.15.37:0/200790622 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f123c0b0ed0 0x7f123c0b6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 >> 172.21.15.37:0/200790622 conn(0x7f123c072d20 msgr2=0x7f123c15e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 shutdown_connections 2023-07-09T21:23:23.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.105+0000 7f12409e8640 1 -- 172.21.15.37:0/200790622 wait complete. 2023-07-09T21:23:23.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:23:23.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.269+0000 7f6d1c7d5640 1 Processor -- start 2023-07-09T21:23:23.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.269+0000 7f6d1c7d5640 1 -- start start 2023-07-09T21:23:23.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1c7d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d140c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1c7d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6d140c99e0 0x7f6d140cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1c7d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d140c4c90 con 0x7f6d141595c0 2023-07-09T21:23:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1c7d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140ca730 con 0x7f6d140c99e0 2023-07-09T21:23:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1c7d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140ca170 con 0x7f6d14159990 2023-07-09T21:23:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1a571640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d141595c0 0x7f6d1415dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58114/0 (socket says 172.21.15.37:58114) 2023-07-09T21:23:23.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1a571640 1 -- 172.21.15.37:0/3071634688 learned_addr learned my addr 172.21.15.37:0/3071634688 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d19d70640 1 --2- 172.21.15.37:0/3071634688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d140c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1ad72640 1 --2- 172.21.15.37:0/3071634688 >> v2:172.21.15.119:3300/0 conn(0x7f6d140c99e0 0x7f6d140cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1956f640 1 -- 172.21.15.37:0/3071634688 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662136611 0 0) 0x7f6d10001120 con 0x7f6d141595c0 2023-07-09T21:23:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d1956f640 1 -- 172.21.15.37:0/3071634688 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d00003530 con 0x7f6d141595c0 2023-07-09T21:23:23.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d19d70640 1 -- 172.21.15.37:0/3071634688 >> v2:172.21.15.119:3300/0 conn(0x7f6d140c99e0 msgr2=0x7f6d140cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d19d70640 1 --2- 172.21.15.37:0/3071634688 >> v2:172.21.15.119:3300/0 conn(0x7f6d140c99e0 0x7f6d140cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d19d70640 1 -- 172.21.15.37:0/3071634688 >> v1:172.21.15.37:6789/0 conn(0x7f6d141595c0 legacy=0x7f6d1415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.273+0000 7f6d19d70640 1 -- 172.21.15.37:0/3071634688 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d140ca450 con 0x7f6d14159990 2023-07-09T21:23:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d19d70640 1 --2- 172.21.15.37:0/3071634688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d140c4750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097c0 tx=0x7f6d0401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e465f6fc32e4715 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1956f640 1 -- 172.21.15.37:0/3071634688 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040ad660 con 0x7f6d14159990 2023-07-09T21:23:23.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1956f640 1 -- 172.21.15.37:0/3071634688 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040ad7c0 con 0x7f6d14159990 2023-07-09T21:23:23.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1956f640 1 -- 172.21.15.37:0/3071634688 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040adb50 con 0x7f6d14159990 2023-07-09T21:23:23.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/3071634688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 msgr2=0x7f6d140c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/3071634688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d140c4750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6d040097c0 tx=0x7f6d0401c450 comp rx=0 tx=0).stop 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/3071634688 shutdown_connections 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/3071634688 >> v2:172.21.15.119:3300/0 conn(0x7f6d140c99e0 0x7f6d140cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/3071634688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d140c4750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/3071634688 >> 172.21.15.37:0/3071634688 conn(0x7f6d140cde40 msgr2=0x7f6d140ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/3071634688 shutdown_connections 2023-07-09T21:23:23.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/3071634688 wait complete. 2023-07-09T21:23:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 Processor -- start 2023-07-09T21:23:23.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- start start 2023-07-09T21:23:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 0x7f6d140b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d14154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140b3ea0 con 0x7f6d141595c0 2023-07-09T21:23:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14153be0 con 0x7f6d140c99e0 2023-07-09T21:23:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.277+0000 7f6d1c7d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d140b2200 con 0x7f6d14159990 2023-07-09T21:23:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39082/0 (socket says 172.21.15.37:39082) 2023-07-09T21:23:23.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 -- 172.21.15.37:0/1723233463 learned_addr learned my addr 172.21.15.37:0/1723233463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1ad72640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d14154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1a571640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 0x7f6d140b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 -- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 msgr2=0x7f6d14154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d14154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 -- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 msgr2=0x7f6d140b3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 0x7f6d140b3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 -- 172.21.15.37:0/1723233463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04009420 con 0x7f6d141595c0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1a571640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 0x7f6d140b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d19d70640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d040b0040 tx=0x7f6d040191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040b6610 con 0x7f6d141595c0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040b6790 con 0x7f6d141595c0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040b6b40 con 0x7f6d141595c0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d14153dd0 con 0x7f6d141595c0 2023-07-09T21:23:23.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d14154390 con 0x7f6d141595c0 2023-07-09T21:23:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1404d7d0 con 0x7f6d141595c0 2023-07-09T21:23:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.281+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6d040b4040 con 0x7f6d141595c0 2023-07-09T21:23:23.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.285+0000 7f6d0affd640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 0x7f6cf8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.285+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f6d0411dff0 con 0x7f6d141595c0 2023-07-09T21:23:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.285+0000 7f6d1a571640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 0x7f6cf8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.285+0000 7f6d1a571640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 0x7f6cf8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001280 tx=0x7f6d10009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.285+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d040eb510 con 0x7f6d141595c0 2023-07-09T21:23:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d1415c6f0 con 0x7f6d141595c0 2023-07-09T21:23:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d0affd640 1 -- 172.21.15.37:0/1723233463 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6d040c4020 con 0x7f6d141595c0 2023-07-09T21:23:23.446 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:23:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 msgr2=0x7f6cf8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 0x7f6cf8068730 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6d10001280 tx=0x7f6d10009040 comp rx=0 tx=0).stop 2023-07-09T21:23:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 msgr2=0x7f6d1414f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6d040b0040 tx=0x7f6d040191f0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 shutdown_connections 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6cf8066280 0x7f6cf8068730 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d14159990 0x7f6d14154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d141595c0 0x7f6d1414f8e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 --2- 172.21.15.37:0/1723233463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d140c99e0 0x7f6d140b3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 >> 172.21.15.37:0/1723233463 conn(0x7f6d140cde40 msgr2=0x7f6d14158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 shutdown_connections 2023-07-09T21:23:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.441+0000 7f6d1c7d5640 1 -- 172.21.15.37:0/1723233463 wait complete. 2023-07-09T21:23:23.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:23:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.605+0000 7fa0e378f640 1 Processor -- start 2023-07-09T21:23:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e378f640 1 -- start start 2023-07-09T21:23:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e378f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0dc160030 0x7fa0dc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e378f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc15bf80 con 0x7fa0dc0cf290 2023-07-09T21:23:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e378f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0d02f0 con 0x7fa0dc0b7980 2023-07-09T21:23:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e378f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cd070 con 0x7fa0dc160030 2023-07-09T21:23:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e0d2a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0dc0cf290 0x7fa0dc0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58128/0 (socket says 172.21.15.37:58128) 2023-07-09T21:23:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e0d2a640 1 -- 172.21.15.37:0/3995493607 learned_addr learned my addr 172.21.15.37:0/3995493607 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e1d2c640 1 --2- 172.21.15.37:0/3995493607 >> v2:172.21.15.119:3300/0 conn(0x7fa0dc160030 0x7fa0dc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769501177 0 0) 0x7fa0cc001120 con 0x7fa0dc0cf290 2023-07-09T21:23:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c8003530 con 0x7fa0dc0cf290 2023-07-09T21:23:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3229435569 0 0) 0x7fa0c8003530 con 0x7fa0dc0cf290 2023-07-09T21:23:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e1d2c640 1 -- 172.21.15.37:0/3995493607 >> v1:172.21.15.119:6789/0 conn(0x7fa0dc0b7980 legacy=0x7fa0dc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e1d2c640 1 -- 172.21.15.37:0/3995493607 >> v1:172.21.15.37:6789/0 conn(0x7fa0dc0cf290 legacy=0x7fa0dc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.609+0000 7fa0e1d2c640 1 -- 172.21.15.37:0/3995493607 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0cc7f0 con 0x7fa0dc160030 2023-07-09T21:23:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e1d2c640 1 --2- 172.21.15.37:0/3995493607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc160030 0x7fa0dc0d0e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d401c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb1033573d2c2e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc001810 con 0x7fa0dc160030 2023-07-09T21:23:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d40a64c0 con 0x7fa0dc160030 2023-07-09T21:23:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0d3fff640 1 -- 172.21.15.37:0/3995493607 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d40a6850 con 0x7fa0dc160030 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- 172.21.15.37:0/3995493607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc160030 msgr2=0x7fa0dc0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 --2- 172.21.15.37:0/3995493607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc160030 0x7fa0dc0d0e90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009d90 tx=0x7fa0d401c870 comp rx=0 tx=0).stop 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- 172.21.15.37:0/3995493607 shutdown_connections 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 --2- 172.21.15.37:0/3995493607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc160030 0x7fa0dc0d0e90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- 172.21.15.37:0/3995493607 >> 172.21.15.37:0/3995493607 conn(0x7fa0dc073090 msgr2=0x7fa0dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- 172.21.15.37:0/3995493607 shutdown_connections 2023-07-09T21:23:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- 172.21.15.37:0/3995493607 wait complete. 2023-07-09T21:23:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 Processor -- start 2023-07-09T21:23:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.613+0000 7fa0e378f640 1 -- start start 2023-07-09T21:23:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc0b7980 0x7fa0dc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc160030 0x7fa0dc0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0c7e60 con 0x7fa0dc0cf290 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc148ee0 con 0x7fa0dc0b7980 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc156290 con 0x7fa0dc160030 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39088/0 (socket says 172.21.15.37:39088) 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 -- 172.21.15.37:0/4226901509 learned_addr learned my addr 172.21.15.37:0/4226901509 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e152b640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc0b7980 0x7fa0dc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e1d2c640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc160030 0x7fa0dc0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 -- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc160030 msgr2=0x7fa0dc0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc160030 0x7fa0dc0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 -- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc0b7980 msgr2=0x7fa0dc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc0b7980 0x7fa0dc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 -- 172.21.15.37:0/4226901509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d4009a70 con 0x7fa0dc0cf290 2023-07-09T21:23:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e0d2a640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c750 tx=0x7fa0cc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc005af0 con 0x7fa0dc0cf290 2023-07-09T21:23:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0cc005c50 con 0x7fa0dc0cf290 2023-07-09T21:23:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc007070 con 0x7fa0dc0cf290 2023-07-09T21:23:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc156570 con 0x7fa0dc0cf290 2023-07-09T21:23:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc156b30 con 0x7fa0dc0cf290 2023-07-09T21:23:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.617+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc04d7d0 con 0x7fa0dc0cf290 2023-07-09T21:23:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.621+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0cc0071d0 con 0x7fa0dc0cf290 2023-07-09T21:23:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.621+0000 7fa0d1ffb640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 0x7fa0c0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.621+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fa0cc0832b0 con 0x7fa0dc0cf290 2023-07-09T21:23:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.621+0000 7fa0e152b640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 0x7fa0c0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.621+0000 7fa0e152b640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 0x7fa0c0068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007fd0 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.625+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0cc050790 con 0x7fa0dc0cf290 2023-07-09T21:23:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.777+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0dc15bf80 con 0x7fa0dc0cf290 2023-07-09T21:23:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.777+0000 7fa0d1ffb640 1 -- 172.21.15.37:0/4226901509 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0dc15bf80 con 0x7fa0dc0cf290 2023-07-09T21:23:23.784 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:23:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 msgr2=0x7fa0c0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 0x7fa0c0068760 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8007fd0 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2023-07-09T21:23:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 msgr2=0x7fa0dc1558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c750 tx=0x7fa0cc00cc10 comp rx=0 tx=0).stop 2023-07-09T21:23:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 shutdown_connections 2023-07-09T21:23:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa0c00662b0 0x7fa0c0068760 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc160030 0x7fa0dc0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc0cf290 0x7fa0dc1558b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 --2- 172.21.15.37:0/4226901509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc0b7980 0x7fa0dc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 >> 172.21.15.37:0/4226901509 conn(0x7fa0dc073090 msgr2=0x7fa0dc0b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 shutdown_connections 2023-07-09T21:23:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.781+0000 7fa0e378f640 1 -- 172.21.15.37:0/4226901509 wait complete. 2023-07-09T21:23:23.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.941+0000 7f7667c0b640 1 Processor -- start 2023-07-09T21:23:23.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.941+0000 7f7667c0b640 1 -- start start 2023-07-09T21:23:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.941+0000 7f7667c0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.941+0000 7f7667c0b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 0x7f76600caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f7667c0b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76600708b0 con 0x7f76601598b0 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f7667c0b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7660070b90 con 0x7f766006cff0 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f7667c0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7660070e70 con 0x7f76601594e0 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76661a8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 0x7f76600caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:60246/0 (socket says 172.21.15.37:60246) 2023-07-09T21:23:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 -- 172.21.15.37:0/4272958651 learned_addr learned my addr 172.21.15.37:0/4272958651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 -- 172.21.15.37:0/4272958651 >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 msgr2=0x7f76600caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 --2- 172.21.15.37:0/4272958651 >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 0x7f76600caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 -- 172.21.15.37:0/4272958651 >> v1:172.21.15.119:6789/0 conn(0x7f76601598b0 legacy=0x7f766006c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 -- 172.21.15.37:0/4272958651 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7660071150 con 0x7f76601594e0 2023-07-09T21:23:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76661a8640 1 --2- 172.21.15.37:0/4272958651 >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 0x7f76600caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76659a7640 1 --2- 172.21.15.37:0/4272958651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f765c009870 tx=0x7f765c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cab63d07da0f804 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.945+0000 7f76649a5640 1 -- 172.21.15.37:0/4272958651 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0ac640 con 0x7f76601594e0 2023-07-09T21:23:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76649a5640 1 -- 172.21.15.37:0/4272958651 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0ac7a0 con 0x7f76601594e0 2023-07-09T21:23:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76649a5640 1 -- 172.21.15.37:0/4272958651 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0acb30 con 0x7f76601594e0 2023-07-09T21:23:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- 172.21.15.37:0/4272958651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 msgr2=0x7f766006ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4272958651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f765c009870 tx=0x7f765c01c4b0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- 172.21.15.37:0/4272958651 shutdown_connections 2023-07-09T21:23:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4272958651 >> v2:172.21.15.37:3300/0 conn(0x7f766006cff0 0x7f76600caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4272958651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601594e0 0x7f766006ffd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- 172.21.15.37:0/4272958651 >> 172.21.15.37:0/4272958651 conn(0x7f766006a5d0 msgr2=0x7f766006a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- 172.21.15.37:0/4272958651 shutdown_connections 2023-07-09T21:23:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- 172.21.15.37:0/4272958651 wait complete. 2023-07-09T21:23:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 Processor -- start 2023-07-09T21:23:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- start start 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 0x7f76600ced60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601598b0 0x7f76600cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600cf7e0 con 0x7f766006cff0 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76600c5160 con 0x7f76601594e0 2023-07-09T21:23:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f7667c0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766015a840 con 0x7f76601598b0 2023-07-09T21:23:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76659a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76659a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39114/0 (socket says 172.21.15.37:39114) 2023-07-09T21:23:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76659a7640 1 -- 172.21.15.37:0/4087200395 learned_addr learned my addr 172.21.15.37:0/4087200395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76661a8640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601598b0 0x7f76600cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.949+0000 7f76651a6640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 0x7f76600ced60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 -- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601598b0 msgr2=0x7f76600cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601598b0 0x7f76600cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 -- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 msgr2=0x7f76600ced60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 0x7f76600ced60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 -- 172.21.15.37:0/4087200395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7658009a70 con 0x7f766006cff0 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76651a6640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 0x7f76600ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76659a7640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af040 tx=0x7f765c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0b7620 con 0x7f766006cff0 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c0b77a0 con 0x7f766006cff0 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c0b7b50 con 0x7f766006cff0 2023-07-09T21:23:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c0094d0 con 0x7f766006cff0 2023-07-09T21:23:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f766015ae00 con 0x7f766006cff0 2023-07-09T21:23:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766004d7d0 con 0x7f766006cff0 2023-07-09T21:23:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f765c0b3040 con 0x7f766006cff0 2023-07-09T21:23:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.953+0000 7f76567fc640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 0x7f7644068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.957+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f765c11e300 con 0x7f766006cff0 2023-07-09T21:23:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.957+0000 7f76651a6640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 0x7f7644068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.957+0000 7f76651a6640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 0x7f7644068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76600ae610 tx=0x7f7650009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:23.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:23.957+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f765c0eb730 con 0x7f766006cff0 2023-07-09T21:23:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76600b0eb0 con 0x7f766006cff0 2023-07-09T21:23:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f76567fc640 1 -- 172.21.15.37:0/4087200395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f765c0eed50 con 0x7f766006cff0 2023-07-09T21:23:24.156 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:24.156 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:23:24.156 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:23:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 msgr2=0x7f7644068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 0x7f7644068730 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f76600ae610 tx=0x7f7650009040 comp rx=0 tx=0).stop 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 msgr2=0x7f7660143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f765c0af040 tx=0x7f765c01acf0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 shutdown_connections 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.149+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7644066280 0x7f7644068730 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76601598b0 0x7f76600cf2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76601594e0 0x7f76600ced60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 --2- 172.21.15.37:0/4087200395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f766006cff0 0x7f7660143150 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 >> 172.21.15.37:0/4087200395 conn(0x7f766006a5d0 msgr2=0x7f76600af8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 shutdown_connections 2023-07-09T21:23:24.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.153+0000 7f7667c0b640 1 -- 172.21.15.37:0/4087200395 wait complete. 2023-07-09T21:23:24.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 Processor -- start 2023-07-09T21:23:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 -- start start 2023-07-09T21:23:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f959c0b7ab0 0x7f959c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f959c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959c0b49f0 con 0x7f959c0cef80 2023-07-09T21:23:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959c0b7e80 con 0x7f959c0b7ab0 2023-07-09T21:23:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f95a17ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0cc8a0 con 0x7f959c0b4340 2023-07-09T21:23:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f9593fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f959c0cef80 0x7f959c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58134/0 (socket says 172.21.15.37:58134) 2023-07-09T21:23:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f9593fff640 1 -- 172.21.15.37:0/608562397 learned_addr learned my addr 172.21.15.37:0/608562397 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f959c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959affd640 1 --2- 172.21.15.37:0/608562397 >> v2:172.21.15.119:3300/0 conn(0x7f959c0b7ab0 0x7f959c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714219608 0 0) 0x7f959c0b49f0 con 0x7f959c0cef80 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9588003530 con 0x7f959c0cef80 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 360532552 0 0) 0x7f9588003530 con 0x7f959c0cef80 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 msgr2=0x7f959c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f959c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 >> v2:172.21.15.119:3300/0 conn(0x7f959c0b7ab0 msgr2=0x7f959c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 --2- 172.21.15.37:0/608562397 >> v2:172.21.15.119:3300/0 conn(0x7f959c0b7ab0 0x7f959c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0ccb80 con 0x7f959c0cef80 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f9584001680 con 0x7f959c0cef80 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 >> v1:172.21.15.37:6789/0 conn(0x7f959c0cef80 legacy=0x7f959c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f9588003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588003f00 0x7f95880047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588004d10 0x7f9588005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0cc8a0 con 0x7f9588004d10 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958800b990 con 0x7f9588003f00 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958800bad0 con 0x7f959c0b4340 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588004d10 0x7f9588005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959affd640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f9588003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f9593fff640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588003f00 0x7f95880047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 -- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 msgr2=0x7f9588003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b4340 0x7f9588003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 -- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588003f00 msgr2=0x7f95880047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588003f00 0x7f95880047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.313+0000 7f959b7fe640 1 -- 172.21.15.37:0/608562397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9588003530 con 0x7f9588004d10 2023-07-09T21:23:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f959b7fe640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588004d10 0x7f9588005180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9594009f90 tx=0x7f959401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ccc190ec3f8803 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940a5c30 con 0x7f9588004d10 2023-07-09T21:23:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959400f040 con 0x7f9588004d10 2023-07-09T21:23:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f959a7fc640 1 -- 172.21.15.37:0/608562397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940ad440 con 0x7f9588004d10 2023-07-09T21:23:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 -- 172.21.15.37:0/608562397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588004d10 msgr2=0x7f9588005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 --2- 172.21.15.37:0/608562397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9588004d10 0x7f9588005180 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9594009f90 tx=0x7f959401cc20 comp rx=0 tx=0).stop 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f959b7fe640 1 -- 172.21.15.37:0/608562397 reap_dead start 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 -- 172.21.15.37:0/608562397 shutdown_connections 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 -- 172.21.15.37:0/608562397 >> 172.21.15.37:0/608562397 conn(0x7f959c073090 msgr2=0x7f959c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 -- 172.21.15.37:0/608562397 shutdown_connections 2023-07-09T21:23:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.317+0000 7f95a17ba640 1 -- 172.21.15.37:0/608562397 wait complete. 2023-07-09T21:23:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 Processor -- start 2023-07-09T21:23:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- start start 2023-07-09T21:23:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588004d10 0x7f959c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b6830 0x7f959c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0cae40 con 0x7f959c0c99c0 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0c76a0 con 0x7f9588004d10 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959c0c7980 con 0x7f959c0b6830 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39126/0 (socket says 172.21.15.37:39126) 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 -- 172.21.15.37:0/677195033 learned_addr learned my addr 172.21.15.37:0/677195033 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f9593fff640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b6830 0x7f959c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959affd640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588004d10 0x7f959c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 -- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b6830 msgr2=0x7f959c0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b6830 0x7f959c0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 -- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588004d10 msgr2=0x7f959c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588004d10 0x7f959c0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 -- 172.21.15.37:0/677195033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959c0c7c60 con 0x7f959c0c99c0 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f959b7fe640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95940b0040 tx=0x7f9594009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940ae890 con 0x7f959c0c99c0 2023-07-09T21:23:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95940ae9f0 con 0x7f959c0c99c0 2023-07-09T21:23:24.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95940aed80 con 0x7f959c0c99c0 2023-07-09T21:23:24.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959c0c7f40 con 0x7f959c0c99c0 2023-07-09T21:23:24.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.321+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959c0c72e0 con 0x7f959c0c99c0 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959c04d7d0 con 0x7f959c0c99c0 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95940b4040 con 0x7f959c0c99c0 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f95937fe640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 0x7f957c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f959411e8e0 con 0x7f959c0c99c0 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f959affd640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 0x7f957c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.325+0000 7f959affd640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 0x7f957c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f958c009c60 tx=0x7f958c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.329+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95940ebdc0 con 0x7f959c0c99c0 2023-07-09T21:23:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f959c0c83f0 con 0x7f959c0c99c0 2023-07-09T21:23:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95937fe640 1 -- 172.21.15.37:0/677195033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7f95940b2070 con 0x7f959c0c99c0 2023-07-09T21:23:24.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:24.491 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 msgr2=0x7f957c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 0x7f957c068730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f958c009c60 tx=0x7f958c009190 comp rx=0 tx=0).stop 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 msgr2=0x7f959c145eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95940b0040 tx=0x7f9594009750 comp rx=0 tx=0).stop 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 shutdown_connections 2023-07-09T21:23:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f957c066280 0x7f957c068730 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f959c0c99c0 0x7f959c145eb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f959c0b6830 0x7f959c0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 --2- 172.21.15.37:0/677195033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9588004d10 0x7f959c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 >> 172.21.15.37:0/677195033 conn(0x7f959c073090 msgr2=0x7f959c0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 shutdown_connections 2023-07-09T21:23:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.485+0000 7f95a17ba640 1 -- 172.21.15.37:0/677195033 wait complete. 2023-07-09T21:23:24.512 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:23:24.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:24.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 Processor -- start 2023-07-09T21:23:24.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 -- start start 2023-07-09T21:23:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee540b7ab0 0x7fee5406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee540cef80 0x7fee540b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee540b49f0 con 0x7fee540b4170 2023-07-09T21:23:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540b7e80 con 0x7fee540b7ab0 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee5a140640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee540b4610 con 0x7fee540cef80 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee540b7ab0 0x7fee5406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee540b7ab0 0x7fee5406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39130/0 (socket says 172.21.15.37:39130) 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 -- 172.21.15.37:0/2972681717 learned_addr learned my addr 172.21.15.37:0/2972681717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee53fff640 1 --1- 172.21.15.37:0/2972681717 >> v1:172.21.15.37:6789/0 conn(0x7fee540b4170 0x7fee5415f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58150/0 (socket says 172.21.15.37:58150) 2023-07-09T21:23:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee52ffd640 1 --2- 172.21.15.37:0/2972681717 >> v2:172.21.15.119:3300/0 conn(0x7fee540cef80 0x7fee540b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 -- 172.21.15.37:0/2972681717 >> v2:172.21.15.119:3300/0 conn(0x7fee540cef80 msgr2=0x7fee540b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 --2- 172.21.15.37:0/2972681717 >> v2:172.21.15.119:3300/0 conn(0x7fee540cef80 0x7fee540b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 -- 172.21.15.37:0/2972681717 >> v1:172.21.15.37:6789/0 conn(0x7fee540b4170 legacy=0x7fee5415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.649+0000 7fee537fe640 1 -- 172.21.15.37:0/2972681717 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540cc8a0 con 0x7fee540b7ab0 2023-07-09T21:23:24.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee537fe640 1 --2- 172.21.15.37:0/2972681717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540b7ab0 0x7fee5406aa50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee540b4d10 tx=0x7fee4401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b61459bf0cfa6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee527fc640 1 -- 172.21.15.37:0/2972681717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440aa430 con 0x7fee540b7ab0 2023-07-09T21:23:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee527fc640 1 -- 172.21.15.37:0/2972681717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee440aa590 con 0x7fee540b7ab0 2023-07-09T21:23:24.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee527fc640 1 -- 172.21.15.37:0/2972681717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee440aa920 con 0x7fee540b7ab0 2023-07-09T21:23:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 -- 172.21.15.37:0/2972681717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540b7ab0 msgr2=0x7fee5406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 --2- 172.21.15.37:0/2972681717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540b7ab0 0x7fee5406aa50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fee540b4d10 tx=0x7fee4401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 -- 172.21.15.37:0/2972681717 shutdown_connections 2023-07-09T21:23:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 --2- 172.21.15.37:0/2972681717 >> v2:172.21.15.119:3300/0 conn(0x7fee540cef80 0x7fee540b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 --2- 172.21.15.37:0/2972681717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540b7ab0 0x7fee5406aa50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 -- 172.21.15.37:0/2972681717 >> 172.21.15.37:0/2972681717 conn(0x7fee54073090 msgr2=0x7fee54069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 -- 172.21.15.37:0/2972681717 shutdown_connections 2023-07-09T21:23:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.653+0000 7fee5a140640 1 -- 172.21.15.37:0/2972681717 wait complete. 2023-07-09T21:23:24.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 Processor -- start 2023-07-09T21:23:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- start start 2023-07-09T21:23:24.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 0x7fee541535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee540b7ab0 0x7fee540c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c5d80 con 0x7fee540cef80 2023-07-09T21:23:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee5415b450 con 0x7fee540b4170 2023-07-09T21:23:24.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee540c6020 con 0x7fee540b7ab0 2023-07-09T21:23:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39132/0 (socket says 172.21.15.37:39132) 2023-07-09T21:23:24.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 -- 172.21.15.37:0/1148148483 learned_addr learned my addr 172.21.15.37:0/1148148483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee537fe640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 0x7fee541535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee52ffd640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee540b7ab0 0x7fee540c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 -- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee540b7ab0 msgr2=0x7fee540c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee540b7ab0 0x7fee540c6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 -- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 msgr2=0x7fee541535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 0x7fee541535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 -- 172.21.15.37:0/1148148483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440094d0 con 0x7fee540cef80 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee537fe640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 0x7fee541535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee53fff640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c700 tx=0x7fee4c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00ce10 con 0x7fee540cef80 2023-07-09T21:23:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4c00a640 con 0x7fee540cef80 2023-07-09T21:23:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4c00a9b0 con 0x7fee540cef80 2023-07-09T21:23:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee540c6300 con 0x7fee540cef80 2023-07-09T21:23:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.657+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee54153b20 con 0x7fee540cef80 2023-07-09T21:23:24.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee540c6520 con 0x7fee540cef80 2023-07-09T21:23:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee4c00ab10 con 0x7fee540cef80 2023-07-09T21:23:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee3bfff640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 0x7fee40068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fee4c083560 con 0x7fee540cef80 2023-07-09T21:23:24.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee537fe640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 0x7fee40068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:24.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.661+0000 7fee537fe640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 0x7fee40068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fee440ae000 tx=0x7fee440a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:24.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.665+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee4c0509b0 con 0x7fee540cef80 2023-07-09T21:23:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee5404d7d0 con 0x7fee540cef80 2023-07-09T21:23:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee3bfff640 1 -- 172.21.15.37:0/1148148483 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7fee4c053fd0 con 0x7fee540cef80 2023-07-09T21:23:24.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:24.859 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:23:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:23:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 msgr2=0x7fee40068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 0x7fee40068730 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fee440ae000 tx=0x7fee440a7000 comp rx=0 tx=0).stop 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 msgr2=0x7fee540c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fee4c00c700 tx=0x7fee4c00cbc0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 shutdown_connections 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fee40066280 0x7fee40068730 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee540cef80 0x7fee540c6d60 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee540b7ab0 0x7fee540c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 --2- 172.21.15.37:0/1148148483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee540b4170 0x7fee541535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 >> 172.21.15.37:0/1148148483 conn(0x7fee54073090 msgr2=0x7fee540ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 shutdown_connections 2023-07-09T21:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:24.853+0000 7fee5a140640 1 -- 172.21.15.37:0/1148148483 wait complete. 2023-07-09T21:23:24.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 Processor -- start 2023-07-09T21:23:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 -- start start 2023-07-09T21:23:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98c80b7ab0 0x7f98c806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80b49f0 con 0x7f98c80cef80 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c80cc8a0 con 0x7f98c80b4340 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98ce256640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c80b7e80 con 0x7f98c80b7ab0 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98c80b7ab0 0x7f98c806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c6ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f98c80cef80 0x7f98c80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58166/0 (socket says 172.21.15.37:58166) 2023-07-09T21:23:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c6ffd640 1 -- 172.21.15.37:0/1568292236 learned_addr learned my addr 172.21.15.37:0/1568292236 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c77fe640 1 -- 172.21.15.37:0/1568292236 >> v1:172.21.15.119:6789/0 conn(0x7f98c80b4340 legacy=0x7f98c80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c77fe640 1 -- 172.21.15.37:0/1568292236 >> v1:172.21.15.37:6789/0 conn(0x7f98c80cef80 legacy=0x7f98c80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c77fe640 1 -- 172.21.15.37:0/1568292236 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c80ccb80 con 0x7f98c80b7ab0 2023-07-09T21:23:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.017+0000 7f98c67fc640 1 -- 172.21.15.37:0/1568292236 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021499987 0 0) 0x7f98c80b49f0 con 0x7f98c80cef80 2023-07-09T21:23:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98c77fe640 1 --2- 172.21.15.37:0/1568292236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c806aa50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f98b80097c0 tx=0x7f98b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841b621b33207fdb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98c67fc640 1 -- 172.21.15.37:0/1568292236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80ab610 con 0x7f98c80b7ab0 2023-07-09T21:23:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98c67fc640 1 -- 172.21.15.37:0/1568292236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98b80ab770 con 0x7f98c80b7ab0 2023-07-09T21:23:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98c67fc640 1 -- 172.21.15.37:0/1568292236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b80abb00 con 0x7f98c80b7ab0 2023-07-09T21:23:25.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 -- 172.21.15.37:0/1568292236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 msgr2=0x7f98c806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 --2- 172.21.15.37:0/1568292236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c806aa50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f98b80097c0 tx=0x7f98b801c410 comp rx=0 tx=0).stop 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 -- 172.21.15.37:0/1568292236 shutdown_connections 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 --2- 172.21.15.37:0/1568292236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c806aa50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 -- 172.21.15.37:0/1568292236 >> 172.21.15.37:0/1568292236 conn(0x7f98c8073090 msgr2=0x7f98c8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 -- 172.21.15.37:0/1568292236 shutdown_connections 2023-07-09T21:23:25.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.021+0000 7f98ce256640 1 -- 172.21.15.37:0/1568292236 wait complete. 2023-07-09T21:23:25.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 Processor -- start 2023-07-09T21:23:25.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- start start 2023-07-09T21:23:25.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c80b4340 0x7f98c81f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c80cef80 0x7f98c8153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80ca1e0 con 0x7f98c80b7ab0 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80ca4c0 con 0x7f98c80cef80 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c80ca7a0 con 0x7f98c80b4340 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39156/0 (socket says 172.21.15.37:39156) 2023-07-09T21:23:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 -- 172.21.15.37:0/3699461205 learned_addr learned my addr 172.21.15.37:0/3699461205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:25.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c77fe640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c80b4340 0x7f98c81f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c7fff640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c80cef80 0x7f98c8153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 -- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c80b4340 msgr2=0x7f98c81f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c80b4340 0x7f98c81f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 -- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c80cef80 msgr2=0x7f98c8153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c80cef80 0x7f98c8153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 -- 172.21.15.37:0/3699461205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b8009420 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98c6ffd640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00c4b0 tx=0x7f98bc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc0074e0 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98bc007660 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98bc004a30 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c80caa80 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.025+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c80d2d60 con 0x7f98c80b7ab0 2023-07-09T21:23:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c80d0750 con 0x7f98c80b7ab0 2023-07-09T21:23:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f98bc004b90 con 0x7f98c80b7ab0 2023-07-09T21:23:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98affff640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 0x7f98b4068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f98bc082f90 con 0x7f98c80b7ab0 2023-07-09T21:23:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98c77fe640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 0x7f98b4068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.029+0000 7f98c77fe640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 0x7f98b4068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98b80af000 tx=0x7f98b80a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.033+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98bc050480 con 0x7f98c80b7ab0 2023-07-09T21:23:25.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.221+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98c804d7d0 con 0x7f98c80b7ab0 2023-07-09T21:23:25.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.221+0000 7f98affff640 1 -- 172.21.15.37:0/3699461205 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4671 (secure 0 0 0) 0x7f98bc018020 con 0x7f98c80b7ab0 2023-07-09T21:23:25.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:25.262 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4262,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/4089743685","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":4089743685},{"type":"v1","addr":"172.21.15.119:6837","nonce":4089743685}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/4161222432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":4161222432},{"type":"v1","addr":"172.21.15.37:6835","nonce":4161222432}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/3678044078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3678044078},{"type":"v1","addr":"172.21.15.37:6834","nonce":3678044078}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:22:31.224845+0000","modified":"2023-07-09T21:22:34.874942+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/3858793656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3858793656},{"type":"v1","addr":"172.21.15.119:6836","nonce":3858793656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-09T21:23:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-07-09T21:23:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 msgr2=0x7f98b4068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 0x7f98b4068760 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f98b80af000 tx=0x7f98b80a7000 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 msgr2=0x7f98c80d2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00c4b0 tx=0x7f98bc00c970 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 shutdown_connections 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f98b40662b0 0x7f98b4068760 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98c80cef80 0x7f98c8153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98c80b7ab0 0x7f98c80d2820 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 --2- 172.21.15.37:0/3699461205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98c80b4340 0x7f98c81f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 >> 172.21.15.37:0/3699461205 conn(0x7f98c8073090 msgr2=0x7f98c80b6ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 shutdown_connections 2023-07-09T21:23:25.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.225+0000 7f98ce256640 1 -- 172.21.15.37:0/3699461205 wait complete. 2023-07-09T21:23:25.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 Processor -- start 2023-07-09T21:23:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 -- start start 2023-07-09T21:23:25.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb9bc0cef80 0x7fb9bc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc0b49f0 con 0x7fb9bc0b4340 2023-07-09T21:23:25.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9bc0cc8a0 con 0x7fb9bc0b7ab0 2023-07-09T21:23:25.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9c300b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9bc0b7e80 con 0x7fb9bc0cef80 2023-07-09T21:23:25.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9bbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9bc0b4340 0x7fb9bc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58172/0 (socket says 172.21.15.37:58172) 2023-07-09T21:23:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.405+0000 7fb9bbfff640 1 -- 172.21.15.37:0/97119526 learned_addr learned my addr 172.21.15.37:0/97119526 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9c15a8640 1 --2- 172.21.15.37:0/97119526 >> v2:172.21.15.119:3300/0 conn(0x7fb9bc0cef80 0x7fb9bc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9bb7fe640 1 -- 172.21.15.37:0/97119526 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802942090 0 0) 0x7fb9bc0b49f0 con 0x7fb9bc0b4340 2023-07-09T21:23:25.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9bb7fe640 1 -- 172.21.15.37:0/97119526 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9ac003530 con 0x7fb9bc0b4340 2023-07-09T21:23:25.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9c15a8640 1 -- 172.21.15.37:0/97119526 >> v1:172.21.15.119:6789/0 conn(0x7fb9bc0b7ab0 legacy=0x7fb9bc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9c15a8640 1 -- 172.21.15.37:0/97119526 >> v1:172.21.15.37:6789/0 conn(0x7fb9bc0b4340 legacy=0x7fb9bc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9c15a8640 1 -- 172.21.15.37:0/97119526 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9bc0ccb80 con 0x7fb9bc0cef80 2023-07-09T21:23:25.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9c15a8640 1 --2- 172.21.15.37:0/97119526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc06aa50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009d90 tx=0x7fb9b401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16a505e87dba0796 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9bb7fe640 1 -- 172.21.15.37:0/97119526 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40a59e0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9bb7fe640 1 -- 172.21.15.37:0/97119526 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b40a5b40 con 0x7fb9bc0cef80 2023-07-09T21:23:25.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.409+0000 7fb9bb7fe640 1 -- 172.21.15.37:0/97119526 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40ad440 con 0x7fb9bc0cef80 2023-07-09T21:23:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- 172.21.15.37:0/97119526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0cef80 msgr2=0x7fb9bc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 --2- 172.21.15.37:0/97119526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc06aa50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009d90 tx=0x7fb9b401c920 comp rx=0 tx=0).stop 2023-07-09T21:23:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- 172.21.15.37:0/97119526 shutdown_connections 2023-07-09T21:23:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 --2- 172.21.15.37:0/97119526 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc06aa50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- 172.21.15.37:0/97119526 >> 172.21.15.37:0/97119526 conn(0x7fb9bc073090 msgr2=0x7fb9bc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- 172.21.15.37:0/97119526 shutdown_connections 2023-07-09T21:23:25.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- 172.21.15.37:0/97119526 wait complete. 2023-07-09T21:23:25.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 Processor -- start 2023-07-09T21:23:25.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- start start 2023-07-09T21:23:25.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 0x7fb9bc0c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9bc0b7ab0 0x7fb9bc0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0c64a0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0c6220 con 0x7fb9bc0b4340 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c300b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9bc0ca550 con 0x7fb9bc0b7ab0 2023-07-09T21:23:25.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c15a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c15a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39158/0 (socket says 172.21.15.37:39158) 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c15a8640 1 -- 172.21.15.37:0/2627335142 learned_addr learned my addr 172.21.15.37:0/2627335142 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9bbfff640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9bc0b7ab0 0x7fb9bc0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.413+0000 7fb9c0da7640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 0x7fb9bc0c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 -- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9bc0b7ab0 msgr2=0x7fb9bc0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9bc0b7ab0 0x7fb9bc0c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 -- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 msgr2=0x7fb9bc0c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 0x7fb9bc0c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 -- 172.21.15.37:0/2627335142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b4009a70 con 0x7fb9bc0cef80 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c0da7640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 0x7fb9bc0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c15a8640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40b0040 tx=0x7fb9b40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40add90 con 0x7fb9bc0cef80 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4009450 con 0x7fb9bc0cef80 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40b9690 con 0x7fb9bc0cef80 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9bc0ca830 con 0x7fb9bc0cef80 2023-07-09T21:23:25.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9bc0cadf0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9bc0cafe0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9b40b97f0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 0x7fb9a0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7fb9b411f3e0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.417+0000 7fb9c0da7640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 0x7fb9a0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.421+0000 7fb9c0da7640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 0x7fb9a0068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000f70 tx=0x7fb9b0009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.421+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9b40ec930 con 0x7fb9bc0cef80 2023-07-09T21:23:25.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.577+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9bc04d7d0 con 0x7fb9bc0cef80 2023-07-09T21:23:25.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9b97fa640 1 -- 172.21.15.37:0/2627335142 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18363 (secure 0 0 0) 0x7fb9b40eff50 con 0x7fb9bc0cef80 2023-07-09T21:23:25.586 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:25.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:11.809219+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:22:29.025615+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-07-09T21:22:30.216661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.23","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:25.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 msgr2=0x7fb9a0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 0x7fb9a0068730 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb9b0000f70 tx=0x7fb9b0009040 comp rx=0 tx=0).stop 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 msgr2=0x7fb9bc14c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb9b40b0040 tx=0x7fb9b40196c0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 shutdown_connections 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb9a0066280 0x7fb9a0068730 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9bc0cef80 0x7fb9bc14c2b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb9bc0b7ab0 0x7fb9bc0c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 --2- 172.21.15.37:0/2627335142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb9bc0b4340 0x7fb9bc0c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 >> 172.21.15.37:0/2627335142 conn(0x7fb9bc073090 msgr2=0x7fb9bc0d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 shutdown_connections 2023-07-09T21:23:25.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.581+0000 7fb9c300b640 1 -- 172.21.15.37:0/2627335142 wait complete. 2023-07-09T21:23:25.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:23:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 Processor -- start 2023-07-09T21:23:25.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 -- start start 2023-07-09T21:23:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e580b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9e580b4140 0x7f9e580d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e580cef80 con 0x7f9e580b7a60 2023-07-09T21:23:25.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580ccee0 con 0x7f9e580b4140 2023-07-09T21:23:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5c911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b45b0 con 0x7f9e580b47a0 2023-07-09T21:23:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e580b7a60 0x7f9e580cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58174/0 (socket says 172.21.15.37:58174) 2023-07-09T21:23:25.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5659c640 1 -- 172.21.15.37:0/60859272 learned_addr learned my addr 172.21.15.37:0/60859272 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:25.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466834816 0 0) 0x7f9e580cef80 con 0x7f9e580b7a60 2023-07-09T21:23:25.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e44003530 con 0x7f9e580b7a60 2023-07-09T21:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e4ffff640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e580b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/60859272 >> v2:172.21.15.119:3300/0 conn(0x7f9e580b4140 0x7f9e580d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2774783196 0 0) 0x7f9e44003530 con 0x7f9e580b7a60 2023-07-09T21:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 msgr2=0x7f9e580b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e580b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 >> v2:172.21.15.119:3300/0 conn(0x7f9e580b4140 msgr2=0x7f9e580d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 --2- 172.21.15.37:0/60859272 >> v2:172.21.15.119:3300/0 conn(0x7f9e580b4140 0x7f9e580d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580cf260 con 0x7f9e580b7a60 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f9e48001680 con 0x7f9e580b7a60 2023-07-09T21:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 >> v1:172.21.15.37:6789/0 conn(0x7f9e580b7a60 legacy=0x7f9e580cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e44003f00 0x7f9e440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e44004d10 0x7f9e44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580b45b0 con 0x7f9e44004d10 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4400b990 con 0x7f9e44003f00 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4400bad0 con 0x7f9e580b47a0 2023-07-09T21:23:25.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e44004d10 0x7f9e44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e4ffff640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e44003f00 0x7f9e440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e5659c640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 -- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 msgr2=0x7f9e44003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e580b47a0 0x7f9e44003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 -- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e44003f00 msgr2=0x7f9e440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e44003f00 0x7f9e440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.749+0000 7f9e56d9d640 1 -- 172.21.15.37:0/60859272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44003530 con 0x7f9e44004d10 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e44004d10 0x7f9e44005180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009f90 tx=0x7f9e5001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5138bf718494573 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500a5c70 con 0x7f9e44004d10 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5000f040 con 0x7f9e44004d10 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e55d9b640 1 -- 172.21.15.37:0/60859272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500ad640 con 0x7f9e44004d10 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 -- 172.21.15.37:0/60859272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e44004d10 msgr2=0x7f9e44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 --2- 172.21.15.37:0/60859272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e44004d10 0x7f9e44005180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009f90 tx=0x7f9e5001cc60 comp rx=0 tx=0).stop 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e56d9d640 1 -- 172.21.15.37:0/60859272 reap_dead start 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 -- 172.21.15.37:0/60859272 shutdown_connections 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 -- 172.21.15.37:0/60859272 >> 172.21.15.37:0/60859272 conn(0x7f9e58073050 msgr2=0x7f9e58069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 -- 172.21.15.37:0/60859272 shutdown_connections 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.753+0000 7f9e5c911640 1 -- 172.21.15.37:0/60859272 wait complete. 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 Processor -- start 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- start start 2023-07-09T21:23:25.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 0x7f9e580b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e580a8f30 0x7f9e580a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580a98e0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58158c10 con 0x7f9e580a8f30 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5815e370 con 0x7f9e44004d10 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39170/0 (socket says 172.21.15.37:39170) 2023-07-09T21:23:25.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 -- 172.21.15.37:0/584248577 learned_addr learned my addr 172.21.15.37:0/584248577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e4ffff640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e580a8f30 0x7f9e580a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5659c640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 0x7f9e580b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 -- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 msgr2=0x7f9e580b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 0x7f9e580b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 -- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e580a8f30 msgr2=0x7f9e580a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e580a8f30 0x7f9e580a93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 -- 172.21.15.37:0/584248577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e581f0c80 con 0x7f9e5815d9c0 2023-07-09T21:23:25.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5659c640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 0x7f9e580b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:25.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e56d9d640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e50002240 tx=0x7f9e50009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500ae890 con 0x7f9e5815d9c0 2023-07-09T21:23:25.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e500ae9f0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5815e5a0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e500aed80 con 0x7f9e5815d9c0 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.757+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e580ca3b0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e580cdaa0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9e500b4040 con 0x7f9e5815d9c0 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e4effd640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 0x7f9e38068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:25.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6120+0+0 (secure 0 0 0) 0x7f9e5011e5d0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e5659c640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 0x7f9e38068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:25.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.761+0000 7f9e5659c640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 0x7f9e38068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9e48007da0 tx=0x7f9e48009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:25.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.765+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e500ebab0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.949+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9e5804d7d0 con 0x7f9e5815d9c0 2023-07-09T21:23:25.958 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:23:25.953+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:23:25.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e4effd640 1 -- 172.21.15.37:0/584248577 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9e500b2090 con 0x7f9e5815d9c0 2023-07-09T21:23:25.963 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:23:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 msgr2=0x7f9e38068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 0x7f9e38068760 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9e48007da0 tx=0x7f9e48009040 comp rx=0 tx=0).stop 2023-07-09T21:23:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 msgr2=0x7f9e5815de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:25.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9e50002240 tx=0x7f9e50009750 comp rx=0 tx=0).stop 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 shutdown_connections 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9e380662b0 0x7f9e38068760 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e5815d9c0 0x7f9e5815de30 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e580a8f30 0x7f9e580a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 --2- 172.21.15.37:0/584248577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e44004d10 0x7f9e580b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 >> 172.21.15.37:0/584248577 conn(0x7f9e58073050 msgr2=0x7f9e580b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:25.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 shutdown_connections 2023-07-09T21:23:25.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:25.957+0000 7f9e5c911640 1 -- 172.21.15.37:0/584248577 wait complete. 2023-07-09T21:23:25.972 INFO:tasks.ceph.mds.d.smithi119.stderr: -3118> 2023-07-09T21:22:32.936+0000 7f7694fa4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:23:25.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:23:26.022 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:23:26.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.121+0000 7f3b58ed8640 1 Processor -- start 2023-07-09T21:23:26.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.121+0000 7f3b58ed8640 1 -- start start 2023-07-09T21:23:26.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 0x7f3b54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b540ceb80 0x7f3b540cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b540b3c20 0x7f3b540b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540cd070 con 0x7f3b540ceb80 2023-07-09T21:23:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b540cfd70 con 0x7f3b540b3c20 2023-07-09T21:23:26.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b58ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5415bf80 con 0x7f3b540b7980 2023-07-09T21:23:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b540ceb80 0x7f3b540cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b5259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 0x7f3b54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b540ceb80 0x7f3b540cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39174/0 (socket says 172.21.15.37:39174) 2023-07-09T21:23:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3341126089 learned_addr learned my addr 172.21.15.37:0/3341126089 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:26.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b5259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 0x7f3b54160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:60342/0 (socket says 172.21.15.37:60342) 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b52d9d640 1 --2- 172.21.15.37:0/3341126089 >> v2:172.21.15.119:3300/0 conn(0x7f3b540b3c20 0x7f3b540b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3341126089 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 msgr2=0x7f3b54160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3341126089 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 0x7f3b54160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3341126089 >> v2:172.21.15.119:3300/0 conn(0x7f3b540b3c20 msgr2=0x7f3b540b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3341126089 >> v2:172.21.15.119:3300/0 conn(0x7f3b540b3c20 0x7f3b540b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.125+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3341126089 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b54160570 con 0x7f3b540ceb80 2023-07-09T21:23:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3341126089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540ceb80 0x7f3b540cef90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b5408ad30 tx=0x7f3b4801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b159128dd88271 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b5159a640 1 -- 172.21.15.37:0/3341126089 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480ab600 con 0x7f3b540ceb80 2023-07-09T21:23:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b5159a640 1 -- 172.21.15.37:0/3341126089 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480a7050 con 0x7f3b540ceb80 2023-07-09T21:23:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b5159a640 1 -- 172.21.15.37:0/3341126089 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480ab980 con 0x7f3b540ceb80 2023-07-09T21:23:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3341126089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540ceb80 msgr2=0x7f3b540cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3341126089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540ceb80 0x7f3b540cef90 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3b5408ad30 tx=0x7f3b4801c500 comp rx=0 tx=0).stop 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3341126089 shutdown_connections 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3341126089 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540ceb80 0x7f3b540cef90 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3341126089 >> v2:172.21.15.119:3300/0 conn(0x7f3b540b3c20 0x7f3b540b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3341126089 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b7980 0x7f3b54160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3341126089 >> 172.21.15.37:0/3341126089 conn(0x7f3b54073090 msgr2=0x7f3b54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3341126089 shutdown_connections 2023-07-09T21:23:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3341126089 wait complete. 2023-07-09T21:23:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.129+0000 7f3b58ed8640 1 Processor -- start 2023-07-09T21:23:26.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- start start 2023-07-09T21:23:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b540ceb80 0x7f3b54150680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540b71f0 con 0x7f3b540b7980 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b540cc600 con 0x7f3b540ceb80 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b54150bc0 con 0x7f3b540b3c20 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b5259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39182/0 (socket says 172.21.15.37:39182) 2023-07-09T21:23:26.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3091183158 learned_addr learned my addr 172.21.15.37:0/3091183158 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b52d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b540ceb80 0x7f3b54150680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b5259c640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:60356/0 (socket says 172.21.15.37:60356) 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 msgr2=0x7f3b541522f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b540ceb80 msgr2=0x7f3b54150680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b540ceb80 0x7f3b54150680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 -- 172.21.15.37:0/3091183158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b480094d0 con 0x7f3b540b7980 2023-07-09T21:23:26.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b5259c640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b51d9b640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b480ae040 tx=0x7f3b480192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480bc070 con 0x7f3b540b7980 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480b6420 con 0x7f3b540b7980 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b54152a90 con 0x7f3b540b7980 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480b67d0 con 0x7f3b540b7980 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b540b6c30 con 0x7f3b540b7980 2023-07-09T21:23:26.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.133+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b540737d0 con 0x7f3b540b7980 2023-07-09T21:23:26.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.137+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b480b2040 con 0x7f3b540b7980 2023-07-09T21:23:26.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.137+0000 7f3b42ffd640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 0x7f3b34068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:26.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.137+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f3b4811d8f0 con 0x7f3b540b7980 2023-07-09T21:23:26.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.137+0000 7f3b5259c640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 0x7f3b34068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:26.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.137+0000 7f3b5259c640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 0x7f3b34068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b540c8a80 tx=0x7f3b44009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:26.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.141+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b540737d0 con 0x7f3b540b7980 2023-07-09T21:23:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.329+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3b54160570 con 0x7f3b540b7980 2023-07-09T21:23:26.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.961+0000 7f3b42ffd640 1 -- 172.21.15.37:0/3091183158 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b54160570 con 0x7f3b540b7980 2023-07-09T21:23:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 msgr2=0x7f3b34068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:26.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 0x7f3b34068730 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3b540c8a80 tx=0x7f3b44009190 comp rx=0 tx=0).stop 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 msgr2=0x7f3b5415cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b480ae040 tx=0x7f3b480192a0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 shutdown_connections 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3b34066280 0x7f3b34068730 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b540ceb80 0x7f3b54150680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b540b7980 0x7f3b5415cb30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 --2- 172.21.15.37:0/3091183158 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b540b3c20 0x7f3b541522f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:26.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 >> 172.21.15.37:0/3091183158 conn(0x7f3b54073090 msgr2=0x7f3b5415f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:26.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 shutdown_connections 2023-07-09T21:23:26.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:26.965+0000 7f3b58ed8640 1 -- 172.21.15.37:0/3091183158 wait complete. 2023-07-09T21:23:26.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:23:27.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 Processor -- start 2023-07-09T21:23:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 -- start start 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3020160030 0x7f30200d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302015bf80 con 0x7f30200cf290 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200d02f0 con 0x7f30200b7980 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3024d11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30200cd070 con 0x7f3020160030 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3017fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f30200cf290 0x7f30200d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58188/0 (socket says 172.21.15.37:58188) 2023-07-09T21:23:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f3017fff640 1 -- 172.21.15.37:0/1006634803 learned_addr learned my addr 172.21.15.37:0/1006634803 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301ed9d640 1 --2- 172.21.15.37:0/1006634803 >> v2:172.21.15.119:3300/0 conn(0x7f3020160030 0x7f30200d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521651798 0 0) 0x7f3008001120 con 0x7f30200cf290 2023-07-09T21:23:27.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f300c003530 con 0x7f30200cf290 2023-07-09T21:23:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234619649 0 0) 0x7f30200d02f0 con 0x7f30200b7980 2023-07-09T21:23:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3008001120 con 0x7f30200b7980 2023-07-09T21:23:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301ed9d640 1 -- 172.21.15.37:0/1006634803 >> v1:172.21.15.119:6789/0 conn(0x7f30200b7980 legacy=0x7f30200ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301ed9d640 1 -- 172.21.15.37:0/1006634803 >> v1:172.21.15.37:6789/0 conn(0x7f30200cf290 legacy=0x7f30200d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.137+0000 7f301ed9d640 1 -- 172.21.15.37:0/1006634803 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200cc7f0 con 0x7f3020160030 2023-07-09T21:23:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f301ed9d640 1 --2- 172.21.15.37:0/1006634803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3020160030 0x7f30200d0e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3018009d90 tx=0x7f301801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35fdaa52697c2e07 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:27.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30180a5810 con 0x7f3020160030 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30180a5970 con 0x7f3020160030 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f301dd9b640 1 -- 172.21.15.37:0/1006634803 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30180a5d00 con 0x7f3020160030 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 -- 172.21.15.37:0/1006634803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3020160030 msgr2=0x7f30200d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/1006634803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3020160030 0x7f30200d0e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f3018009d90 tx=0x7f301801c950 comp rx=0 tx=0).stop 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 -- 172.21.15.37:0/1006634803 shutdown_connections 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/1006634803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3020160030 0x7f30200d0e90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:27.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 -- 172.21.15.37:0/1006634803 >> 172.21.15.37:0/1006634803 conn(0x7f3020073090 msgr2=0x7f3020069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 -- 172.21.15.37:0/1006634803 shutdown_connections 2023-07-09T21:23:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.141+0000 7f3024d11640 1 -- 172.21.15.37:0/1006634803 wait complete. 2023-07-09T21:23:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 Processor -- start 2023-07-09T21:23:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- start start 2023-07-09T21:23:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30200cf290 0x7f302014e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:27.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3020160030 0x7f30200c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3020149080 con 0x7f30200b7980 2023-07-09T21:23:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30200c4a40 con 0x7f30200cf290 2023-07-09T21:23:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30200c4710 con 0x7f3020160030 2023-07-09T21:23:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39192/0 (socket says 172.21.15.37:39192) 2023-07-09T21:23:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 -- 172.21.15.37:0/3931354544 learned_addr learned my addr 172.21.15.37:0/3931354544 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3017fff640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30200cf290 0x7f302014e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301ed9d640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3020160030 0x7f30200c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 -- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3020160030 msgr2=0x7f30200c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3020160030 0x7f30200c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 -- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30200cf290 msgr2=0x7f302014e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30200cf290 0x7f302014e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 -- 172.21.15.37:0/3931354544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009a70 con 0x7f30200b7980 2023-07-09T21:23:27.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f301e59c640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f301000c490 tx=0x7f301000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30100052d0 con 0x7f30200b7980 2023-07-09T21:23:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3010005430 con 0x7f30200b7980 2023-07-09T21:23:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3010003840 con 0x7f30200b7980 2023-07-09T21:23:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30200c3b00 con 0x7f30200b7980 2023-07-09T21:23:27.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30200c40c0 con 0x7f30200b7980 2023-07-09T21:23:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.145+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302004d7d0 con 0x7f30200b7980 2023-07-09T21:23:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.149+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f30100039a0 con 0x7f30200b7980 2023-07-09T21:23:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.149+0000 7f3016ffd640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 0x7f3000068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.149+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6206+0+0 (secure 0 0 0) 0x7f30100834f0 con 0x7f30200b7980 2023-07-09T21:23:27.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.149+0000 7f3017fff640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 0x7f3000068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.149+0000 7f3017fff640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 0x7f3000068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f30201678c0 tx=0x7f3008009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.153+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3010050840 con 0x7f30200b7980 2023-07-09T21:23:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:27.305+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f302015c120 con 0x7f30200b7980 2023-07-09T21:23:27.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:23:28.002 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:23:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.137+0000 7f3016ffd640 1 -- 172.21.15.37:0/3931354544 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v27) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3010053e60 con 0x7f30200b7980 2023-07-09T21:23:28.143 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:23:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 msgr2=0x7f3000068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 0x7f3000068730 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f30201678c0 tx=0x7f3008009040 comp rx=0 tx=0).stop 2023-07-09T21:23:28.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 msgr2=0x7f30200c32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f301000c490 tx=0x7f301000c950 comp rx=0 tx=0).stop 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 shutdown_connections 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3000066280 0x7f3000068730 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3020160030 0x7f30200c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30200cf290 0x7f302014e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 --2- 172.21.15.37:0/3931354544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30200b7980 0x7f30200c32b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 >> 172.21.15.37:0/3931354544 conn(0x7f3020073090 msgr2=0x7f30200b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 shutdown_connections 2023-07-09T21:23:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.141+0000 7f3024d11640 1 -- 172.21.15.37:0/3931354544 wait complete. 2023-07-09T21:23:28.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:23:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 Processor -- start 2023-07-09T21:23:28.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 -- start start 2023-07-09T21:23:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbf540b7980 0x7fbf54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 0x7fbf540cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5415bf80 con 0x7fbf540b3c20 2023-07-09T21:23:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf540cd070 con 0x7fbf540b7980 2023-07-09T21:23:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf58b11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540cfd70 con 0x7fbf540ceb80 2023-07-09T21:23:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf52d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbf540b3c20 0x7fbf540b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46930/0 (socket says 172.21.15.37:46930) 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf52d9d640 1 -- 172.21.15.37:0/3900856461 learned_addr learned my addr 172.21.15.37:0/3900856461 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf4bfff640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 0x7fbf540cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf5259c640 1 --2- 172.21.15.37:0/3900856461 >> v2:172.21.15.119:3300/0 conn(0x7fbf540b7980 0x7fbf54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf51d9b640 1 -- 172.21.15.37:0/3900856461 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545868004 0 0) 0x7fbf4c0014a0 con 0x7fbf540b3c20 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.317+0000 7fbf51d9b640 1 -- 172.21.15.37:0/3900856461 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf40003530 con 0x7fbf540b3c20 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf5259c640 1 -- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 msgr2=0x7fbf540cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf5259c640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 0x7fbf540cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf5259c640 1 -- 172.21.15.37:0/3900856461 >> v1:172.21.15.37:6789/0 conn(0x7fbf540b3c20 legacy=0x7fbf540b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf5259c640 1 -- 172.21.15.37:0/3900856461 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54160570 con 0x7fbf540b7980 2023-07-09T21:23:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf4bfff640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 0x7fbf540cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:28.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf5259c640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540b7980 0x7fbf54160030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097c0 tx=0x7fbf4401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93fa6191e67db15 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf51d9b640 1 -- 172.21.15.37:0/3900856461 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440ab600 con 0x7fbf540b7980 2023-07-09T21:23:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf51d9b640 1 -- 172.21.15.37:0/3900856461 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf440a7050 con 0x7fbf540b7980 2023-07-09T21:23:28.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf51d9b640 1 -- 172.21.15.37:0/3900856461 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440ab960 con 0x7fbf540b7980 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf58b11640 1 -- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540b7980 msgr2=0x7fbf54160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.321+0000 7fbf58b11640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540b7980 0x7fbf54160030 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbf440097c0 tx=0x7fbf4401c480 comp rx=0 tx=0).stop 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- 172.21.15.37:0/3900856461 shutdown_connections 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540ceb80 0x7fbf540cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 --2- 172.21.15.37:0/3900856461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540b7980 0x7fbf54160030 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- 172.21.15.37:0/3900856461 >> 172.21.15.37:0/3900856461 conn(0x7fbf54073090 msgr2=0x7fbf54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- 172.21.15.37:0/3900856461 shutdown_connections 2023-07-09T21:23:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- 172.21.15.37:0/3900856461 wait complete. 2023-07-09T21:23:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 Processor -- start 2023-07-09T21:23:28.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- start start 2023-07-09T21:23:28.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540b7980 0x7fbf540ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540ceb80 0x7fbf54155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540ca440 con 0x7fbf540b3c20 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c9830 con 0x7fbf540ceb80 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf58b11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c9b10 con 0x7fbf540b7980 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42432/0 (socket says 172.21.15.37:42432) 2023-07-09T21:23:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 -- 172.21.15.37:0/1634760786 learned_addr learned my addr 172.21.15.37:0/1634760786 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf52d9d640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540ceb80 0x7fbf54155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf4bfff640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540b7980 0x7fbf540ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 -- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540b7980 msgr2=0x7fbf540ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540b7980 0x7fbf540ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 -- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540ceb80 msgr2=0x7fbf54155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540ceb80 0x7fbf54155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.325+0000 7fbf5259c640 1 -- 172.21.15.37:0/1634760786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf3c009420 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf5259c640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbf4401a0b0 tx=0x7fbf44019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440ba070 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44006e20 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440b4600 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf44009420 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf540ca0d0 con 0x7fbf540b3c20 2023-07-09T21:23:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf540737d0 con 0x7fbf540b3c20 2023-07-09T21:23:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf440b2040 con 0x7fbf540b3c20 2023-07-09T21:23:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.329+0000 7fbf4affd640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 0x7fbf34068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.333+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5768+0+0 (secure 0 0 0) 0x7fbf4411d300 con 0x7fbf540b3c20 2023-07-09T21:23:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.333+0000 7fbf4bfff640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 0x7fbf34068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:28.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.333+0000 7fbf4bfff640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 0x7fbf34068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf5415efa0 tx=0x7fbf3c009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.337+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf540737d0 con 0x7fbf540b3c20 2023-07-09T21:23:28.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:28.493+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbf54160570 con 0x7fbf540b3c20 2023-07-09T21:23:29.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.145+0000 7fbf4affd640 1 -- 172.21.15.37:0/1634760786 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v28) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbf54160570 con 0x7fbf540b3c20 2023-07-09T21:23:29.150 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:23:29.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.145+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 msgr2=0x7fbf34068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.145+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 0x7fbf34068760 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbf5415efa0 tx=0x7fbf3c009190 comp rx=0 tx=0).stop 2023-07-09T21:23:29.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.145+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 msgr2=0x7fbf54153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.145+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbf4401a0b0 tx=0x7fbf44019220 comp rx=0 tx=0).stop 2023-07-09T21:23:29.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 shutdown_connections 2023-07-09T21:23:29.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf340662b0 0x7fbf34068760 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf540ceb80 0x7fbf54155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf540b7980 0x7fbf540ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 --2- 172.21.15.37:0/1634760786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf540b3c20 0x7fbf54153360 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 >> 172.21.15.37:0/1634760786 conn(0x7fbf54073090 msgr2=0x7fbf540b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:29.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 shutdown_connections 2023-07-09T21:23:29.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.149+0000 7fbf58b11640 1 -- 172.21.15.37:0/1634760786 wait complete. 2023-07-09T21:23:29.180 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:23:29.181 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:23:29.181 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:23:29.181 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:29.181 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:23:29.182 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:23:29.182 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:23:29.182 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:29.182 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:23:29.183 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:23:29.183 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:23:29.183 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:29.183 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:23:29.183 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:23:29.184 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:23:29.184 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:23:29.197 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:23:29.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:23:29.199 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:23:29.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:23:29.202 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:23:29.202 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:23:29.204 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:23:29.204 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:23:29.244 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:23:29.245 DEBUG:teuthology.parallel:result is None 2023-07-09T21:23:29.246 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:23:29.246 DEBUG:teuthology.parallel:result is None 2023-07-09T21:23:29.249 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:23:29.250 DEBUG:teuthology.parallel:result is None 2023-07-09T21:23:29.252 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:23:29.252 DEBUG:teuthology.parallel:result is None 2023-07-09T21:23:29.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:23:29.334 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:23:29.335 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:23:29.335 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:23:29.337 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:23:29.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 Processor -- start 2023-07-09T21:23:29.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 -- start start 2023-07-09T21:23:29.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35e80b2110 0x7f35e815b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:29.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806b280 con 0x7f35e80ca5d0 2023-07-09T21:23:29.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e806a670 con 0x7f35e815b5c0 2023-07-09T21:23:29.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35ecdad640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e806a950 con 0x7f35e80b2110 2023-07-09T21:23:29.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e5d9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f35e80b2110 0x7f35e815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:29.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f35e80ca5d0 0x7f35e806b710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46958/0 (socket says 172.21.15.37:46958) 2023-07-09T21:23:29.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e6d9d640 1 -- 172.21.15.37:0/1429217001 learned_addr learned my addr 172.21.15.37:0/1429217001 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:29.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e5d9b640 1 -- 172.21.15.37:0/1429217001 >> v1:172.21.15.119:6789/0 conn(0x7f35e815b5c0 legacy=0x7f35e80b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e5d9b640 1 -- 172.21.15.37:0/1429217001 >> v1:172.21.15.37:6789/0 conn(0x7f35e80ca5d0 legacy=0x7f35e806b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e5d9b640 1 -- 172.21.15.37:0/1429217001 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e806ac30 con 0x7f35e80b2110 2023-07-09T21:23:29.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.397+0000 7f35e559a640 1 -- 172.21.15.37:0/1429217001 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346441232 0 0) 0x7f35e806b280 con 0x7f35e80ca5d0 2023-07-09T21:23:29.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35e5d9b640 1 --2- 172.21.15.37:0/1429217001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80b2110 0x7f35e815b990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097c0 tx=0x7f35dc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b562a22fe797b67 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:29.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35e559a640 1 -- 172.21.15.37:0/1429217001 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ab600 con 0x7f35e80b2110 2023-07-09T21:23:29.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35e559a640 1 -- 172.21.15.37:0/1429217001 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35dc0a7050 con 0x7f35e80b2110 2023-07-09T21:23:29.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35e559a640 1 -- 172.21.15.37:0/1429217001 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0ab980 con 0x7f35e80b2110 2023-07-09T21:23:29.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 -- 172.21.15.37:0/1429217001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80b2110 msgr2=0x7f35e815b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 --2- 172.21.15.37:0/1429217001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80b2110 0x7f35e815b990 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0097c0 tx=0x7f35dc01c3c0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 -- 172.21.15.37:0/1429217001 shutdown_connections 2023-07-09T21:23:29.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 --2- 172.21.15.37:0/1429217001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80b2110 0x7f35e815b990 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 -- 172.21.15.37:0/1429217001 >> 172.21.15.37:0/1429217001 conn(0x7f35e80d0c10 msgr2=0x7f35e8072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:29.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 -- 172.21.15.37:0/1429217001 shutdown_connections 2023-07-09T21:23:29.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.401+0000 7f35ecdad640 1 -- 172.21.15.37:0/1429217001 wait complete. 2023-07-09T21:23:29.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 Processor -- start 2023-07-09T21:23:29.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- start start 2023-07-09T21:23:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80ca5d0 0x7f35e814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35e815b5c0 0x7f35e80b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e815c370 con 0x7f35e80b2110 2023-07-09T21:23:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e814fce0 con 0x7f35e80ca5d0 2023-07-09T21:23:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e80b5640 con 0x7f35e815b5c0 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e5d9b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80ca5d0 0x7f35e814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42466/0 (socket says 172.21.15.37:42466) 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 -- 172.21.15.37:0/462923572 learned_addr learned my addr 172.21.15.37:0/462923572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e6d9d640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35e815b5c0 0x7f35e80b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:29.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 -- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35e815b5c0 msgr2=0x7f35e80b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35e815b5c0 0x7f35e80b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 -- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80ca5d0 msgr2=0x7f35e814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:29.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80ca5d0 0x7f35e814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:29.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 -- 172.21.15.37:0/462923572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc009420 con 0x7f35e80b2110 2023-07-09T21:23:29.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35e659c640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c3c0 tx=0x7f35d800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:29.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d80052d0 con 0x7f35e80b2110 2023-07-09T21:23:29.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d8005430 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8003840 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e80b5920 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e815bf90 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.405+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e815c4b0 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.409+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35d80039a0 con 0x7f35e80b2110 2023-07-09T21:23:29.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.409+0000 7f35d6ffd640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 0x7f35c8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:29.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.409+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5296+0+0 (secure 0 0 0) 0x7f35d8082e70 con 0x7f35e80b2110 2023-07-09T21:23:29.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.409+0000 7f35e5d9b640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 0x7f35c8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:29.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.409+0000 7f35e5d9b640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 0x7f35c8068760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0ad000 tx=0x7f35dc0a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:29.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.413+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35e815c4b0 con 0x7f35e80b2110 2023-07-09T21:23:29.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:29.577+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f35e815c4b0 con 0x7f35e80b2110 2023-07-09T21:23:30.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35d6ffd640 1 -- 172.21.15.37:0/462923572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f35e815c4b0 con 0x7f35e80b2110 2023-07-09T21:23:30.834 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:23:30.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 msgr2=0x7f35c8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 0x7f35c8068760 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0ad000 tx=0x7f35dc0a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 msgr2=0x7f35e815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f35d800c3c0 tx=0x7f35d800c880 comp rx=0 tx=0).stop 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 shutdown_connections 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f35c80662b0 0x7f35c8068760 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:30.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f35e815b5c0 0x7f35e80b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35e80ca5d0 0x7f35e814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 --2- 172.21.15.37:0/462923572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35e80b2110 0x7f35e815dd50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 >> 172.21.15.37:0/462923572 conn(0x7f35e80d0c10 msgr2=0x7f35e806f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 shutdown_connections 2023-07-09T21:23:30.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:30.829+0000 7f35ecdad640 1 -- 172.21.15.37:0/462923572 wait complete. 2023-07-09T21:23:30.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:23:31.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.005+0000 7f363b219640 1 Processor -- start 2023-07-09T21:23:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.005+0000 7f363b219640 1 -- start start 2023-07-09T21:23:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f363b219640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f36340b7ab0 0x7f363406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f363b219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f363b219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36340b49f0 con 0x7f36340b4170 2023-07-09T21:23:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f363b219640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36340b7e80 con 0x7f36340b7ab0 2023-07-09T21:23:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f363b219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36340b4610 con 0x7f36340cef80 2023-07-09T21:23:31.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3638fb5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f36340b7ab0 0x7f363406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:47904/0 (socket says 172.21.15.37:47904) 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f36397b6640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f36340b4170 0x7f363415f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:47364/0 (socket says 172.21.15.37:47364) 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 -- 172.21.15.37:0/527050019 learned_addr learned my addr 172.21.15.37:0/527050019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 -- 172.21.15.37:0/527050019 >> v2:172.21.15.119:3300/0 conn(0x7f36340b7ab0 msgr2=0x7f363406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 --2- 172.21.15.37:0/527050019 >> v2:172.21.15.119:3300/0 conn(0x7f36340b7ab0 0x7f363406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 -- 172.21.15.37:0/527050019 >> v1:172.21.15.119:6789/0 conn(0x7f36340b4170 legacy=0x7f363415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f3633fff640 1 -- 172.21.15.37:0/527050019 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36340cc8a0 con 0x7f36340cef80 2023-07-09T21:23:31.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.009+0000 7f36337fe640 1 -- 172.21.15.37:0/527050019 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2819692744 0 0) 0x7f36340b49f0 con 0x7f36340b4170 2023-07-09T21:23:31.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f3633fff640 1 --2- 172.21.15.37:0/527050019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3620009870 tx=0x7f362001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6066f7c30e8e127f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f36337fe640 1 -- 172.21.15.37:0/527050019 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200aa670 con 0x7f36340cef80 2023-07-09T21:23:31.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f36337fe640 1 -- 172.21.15.37:0/527050019 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200aa7d0 con 0x7f36340cef80 2023-07-09T21:23:31.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f36337fe640 1 -- 172.21.15.37:0/527050019 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200aab60 con 0x7f36340cef80 2023-07-09T21:23:31.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- 172.21.15.37:0/527050019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 msgr2=0x7f36340b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- 172.21.15.37:0/527050019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3620009870 tx=0x7f362001c510 comp rx=0 tx=0).stop 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- 172.21.15.37:0/527050019 shutdown_connections 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- 172.21.15.37:0/527050019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340cef80 0x7f36340b3c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- 172.21.15.37:0/527050019 >> v2:172.21.15.119:3300/0 conn(0x7f36340b7ab0 0x7f363406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- 172.21.15.37:0/527050019 >> 172.21.15.37:0/527050019 conn(0x7f3634073090 msgr2=0x7f3634069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:31.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- 172.21.15.37:0/527050019 shutdown_connections 2023-07-09T21:23:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- 172.21.15.37:0/527050019 wait complete. 2023-07-09T21:23:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 Processor -- start 2023-07-09T21:23:31.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- start start 2023-07-09T21:23:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340b7ab0 0x7f36340c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36340cef80 0x7f36341584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363414f270 con 0x7f36340b4170 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363415d490 con 0x7f36340cef80 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.013+0000 7f363b219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f363415d770 con 0x7f36340b7ab0 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42468/0 (socket says 172.21.15.37:42468) 2023-07-09T21:23:31.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 -- 172.21.15.37:0/3476658957 learned_addr learned my addr 172.21.15.37:0/3476658957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3633fff640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340b7ab0 0x7f36340c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f36397b6640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36340cef80 0x7f36341584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 -- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340b7ab0 msgr2=0x7f36340c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340b7ab0 0x7f36340c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 -- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36340cef80 msgr2=0x7f36341584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36340cef80 0x7f36341584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 -- 172.21.15.37:0/3476658957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200094d0 con 0x7f36340b4170 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f3638fb5640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f362800e930 tx=0x7f362800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628009690 con 0x7f36340b4170 2023-07-09T21:23:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f362800ca00 con 0x7f36340b4170 2023-07-09T21:23:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363415da50 con 0x7f36340b4170 2023-07-09T21:23:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800cd70 con 0x7f36340b4170 2023-07-09T21:23:31.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363415e010 con 0x7f36340b4170 2023-07-09T21:23:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363415e1d0 con 0x7f36340b4170 2023-07-09T21:23:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.017+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3628013470 con 0x7f36340b4170 2023-07-09T21:23:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.021+0000 7f36317fa640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 0x7f3618068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.021+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3628083c90 con 0x7f36340b4170 2023-07-09T21:23:31.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.021+0000 7f3633fff640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 0x7f3618068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.021+0000 7f3633fff640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 0x7f3618068760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36200ae000 tx=0x7f36200a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.021+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3628051400 con 0x7f36340b4170 2023-07-09T21:23:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.229+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f363404d7d0 con 0x7f36340b4170 2023-07-09T21:23:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f36317fa640 1 -- 172.21.15.37:0/3476658957 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3628054a20 con 0x7f36340b4170 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:23:31.238 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.239 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.240 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:23:31.241 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.242 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.243 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.245 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.246 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.247 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.248 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:23:31.249 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:23:31.250 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.251 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.252 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:23:31.253 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:23:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.255 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:23:31.256 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.257 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:23:31.258 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkFzgRABAAUMig45pASWma6RuQtp0T6w==", 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.259 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-07-09T21:23:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.260 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-07-09T21:23:31.261 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkU0gRABAA5WChWh/qh9LcJV6ORTuNjg==", 2023-07-09T21:23:31.261 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.261 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkSVcRABAAXhKBOB6VzBKnEY6/KHE7XA==", 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-07-09T21:23:31.262 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkL2cRABAANXDl/mZDfI2Diekb5zpRzg==", 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.263 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkVnARABAA+7wN4EWj8r4WYOrDnmmmKw==", 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.264 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD9JKtkFHsRABAAa2uPhxHotK0GG1YXFSvV0A==", 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.265 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.266 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:23:31.267 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.268 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:31.268 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:23:31.268 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:23:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 msgr2=0x7f3618068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 0x7f3618068760 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f36200ae000 tx=0x7f36200a7000 comp rx=0 tx=0).stop 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 msgr2=0x7f363414ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f362800e930 tx=0x7f362800edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 shutdown_connections 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f36180662b0 0x7f3618068760 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36340cef80 0x7f36341584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36340b7ab0 0x7f36340c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 --2- 172.21.15.37:0/3476658957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36340b4170 0x7f363414ed30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 >> 172.21.15.37:0/3476658957 conn(0x7f3634073090 msgr2=0x7f363415b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 shutdown_connections 2023-07-09T21:23:31.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.233+0000 7f363b219640 1 -- 172.21.15.37:0/3476658957 wait complete. 2023-07-09T21:23:31.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-07-09T21:23:31.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 Processor -- start 2023-07-09T21:23:31.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 -- start start 2023-07-09T21:23:31.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c06cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc46c06ae00 0x7fc46c15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc46c0b2ae0 con 0x7fc46c0b2400 2023-07-09T21:23:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc46c0b32f0 con 0x7fc46c06ae00 2023-07-09T21:23:31.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc47372c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c06d1e0 con 0x7fc46c06c8d0 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc471cc9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc46c06ae00 0x7fc46c15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc4714c8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c06cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc470cc7640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fc46c0b2400 0x7fc46c06f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:47378/0 (socket says 172.21.15.37:47378) 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc470cc7640 1 -- 172.21.15.37:0/3096582714 learned_addr learned my addr 172.21.15.37:0/3096582714 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc471cc9640 1 -- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 msgr2=0x7fc46c06cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc471cc9640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c06cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc471cc9640 1 -- 172.21.15.37:0/3096582714 >> v1:172.21.15.119:6789/0 conn(0x7fc46c0b2400 legacy=0x7fc46c06f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc471cc9640 1 -- 172.21.15.37:0/3096582714 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c070d20 con 0x7fc46c06ae00 2023-07-09T21:23:31.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc4714c8640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:31.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.409+0000 7fc463fff640 1 -- 172.21.15.37:0/3096582714 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2547372030 0 0) 0x7fc46c0b2ae0 con 0x7fc46c0b2400 2023-07-09T21:23:31.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc471cc9640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15ff00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc464009d90 tx=0x7fc46401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=803c680ffab8520f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc463fff640 1 -- 172.21.15.37:0/3096582714 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640a59e0 con 0x7fc46c06ae00 2023-07-09T21:23:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc463fff640 1 -- 172.21.15.37:0/3096582714 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4640a5b40 con 0x7fc46c06ae00 2023-07-09T21:23:31.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc463fff640 1 -- 172.21.15.37:0/3096582714 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640ad440 con 0x7fc46c06ae00 2023-07-09T21:23:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 -- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 msgr2=0x7fc46c15ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15ff00 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc464009d90 tx=0x7fc46401c920 comp rx=0 tx=0).stop 2023-07-09T21:23:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 -- 172.21.15.37:0/3096582714 shutdown_connections 2023-07-09T21:23:31.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15ff00 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 --2- 172.21.15.37:0/3096582714 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c06cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 -- 172.21.15.37:0/3096582714 >> 172.21.15.37:0/3096582714 conn(0x7fc46c0694c0 msgr2=0x7fc46c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 -- 172.21.15.37:0/3096582714 shutdown_connections 2023-07-09T21:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.413+0000 7fc47372c640 1 -- 172.21.15.37:0/3096582714 wait complete. 2023-07-09T21:23:31.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 Processor -- start 2023-07-09T21:23:31.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- start start 2023-07-09T21:23:31.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c14f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c15b4a0 con 0x7fc46c0b2400 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c15e880 con 0x7fc46c06ae00 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c15d2a0 con 0x7fc46c06c8d0 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42482/0 (socket says 172.21.15.37:42482) 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 -- 172.21.15.37:0/485020516 learned_addr learned my addr 172.21.15.37:0/485020516 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc4714c8640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc470cc7640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c14f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 -- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 msgr2=0x7fc46c14f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c14f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 -- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 msgr2=0x7fc46c15e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 -- 172.21.15.37:0/485020516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4680093b0 con 0x7fc46c0b2400 2023-07-09T21:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc471cc9640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b0040 tx=0x7fc4640196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640add90 con 0x7fc46c0b2400 2023-07-09T21:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc464009450 con 0x7fc46c0b2400 2023-07-09T21:23:31.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc464009a70 con 0x7fc46c0b2400 2023-07-09T21:23:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4640b7650 con 0x7fc46c0b2400 2023-07-09T21:23:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.417+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c15d860 con 0x7fc46c0b2400 2023-07-09T21:23:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c04d7d0 con 0x7fc46c0b2400 2023-07-09T21:23:31.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc4640b4050 con 0x7fc46c0b2400 2023-07-09T21:23:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc461ffb640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc46411e710 con 0x7fc46c0b2400 2023-07-09T21:23:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc4714c8640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.421+0000 7fc4714c8640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 0x7fc450068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc468009cd0 tx=0x7fc468006f90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.425+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4640ebef0 con 0x7fc46c0b2400 2023-07-09T21:23:31.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.633+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc46c0ad7e0 con 0x7fc46c0b2400 2023-07-09T21:23:31.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc461ffb640 1 -- 172.21.15.37:0/485020516 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc4640ef510 con 0x7fc46c0b2400 2023-07-09T21:23:31.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 msgr2=0x7fc450068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 0x7fc450068760 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc468009cd0 tx=0x7fc468006f90 comp rx=0 tx=0).stop 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 msgr2=0x7fc46c161950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fc4640b0040 tx=0x7fc4640196c0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 shutdown_connections 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fc4500662b0 0x7fc450068760 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc46c0b2400 0x7fc46c161950 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc46c06c8d0 0x7fc46c14f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 --2- 172.21.15.37:0/485020516 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc46c06ae00 0x7fc46c15e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 >> 172.21.15.37:0/485020516 conn(0x7fc46c0694c0 msgr2=0x7fc46c162ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 shutdown_connections 2023-07-09T21:23:31.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.641+0000 7fc47372c640 1 -- 172.21.15.37:0/485020516 wait complete. 2023-07-09T21:23:31.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-07-09T21:23:31.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 Processor -- start 2023-07-09T21:23:31.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 -- start start 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd780156320 0x7fd780159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd780070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7801592f0 con 0x7fd780070120 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7801566f0 con 0x7fd780156320 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd786511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd780070b50 con 0x7fd78006bf20 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd77f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd780070120 0x7fd78006b810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46964/0 (socket says 172.21.15.37:46964) 2023-07-09T21:23:31.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd77f7fe640 1 -- 172.21.15.37:0/2303099954 learned_addr learned my addr 172.21.15.37:0/2303099954 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd784aae640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd780070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.805+0000 7fd77ffff640 1 --2- 172.21.15.37:0/2303099954 >> v2:172.21.15.119:3300/0 conn(0x7fd780156320 0x7fd780159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178380008 0 0) 0x7fd7801592f0 con 0x7fd780070120 2023-07-09T21:23:31.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd768003530 con 0x7fd780070120 2023-07-09T21:23:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3461289377 0 0) 0x7fd768003530 con 0x7fd780070120 2023-07-09T21:23:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 msgr2=0x7fd780070550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd780070550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 >> v2:172.21.15.119:3300/0 conn(0x7fd780156320 msgr2=0x7fd780159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 --2- 172.21.15.37:0/2303099954 >> v2:172.21.15.119:3300/0 conn(0x7fd780156320 0x7fd780159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780070e30 con 0x7fd780070120 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fd774001680 con 0x7fd780070120 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 >> v1:172.21.15.37:6789/0 conn(0x7fd780070120 legacy=0x7fd78006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd768003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd768004d10 0x7fd768005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7801566f0 con 0x7fd768003f00 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780070b50 con 0x7fd768004d10 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76800b990 con 0x7fd78006bf20 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77ffff640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd768003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd784aae640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd768004d10 0x7fd768005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 -- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 msgr2=0x7fd768003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006bf20 0x7fd768003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 -- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd768004d10 msgr2=0x7fd768005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd768004d10 0x7fd768005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 -- 172.21.15.37:0/2303099954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd768003530 con 0x7fd768003f00 2023-07-09T21:23:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.809+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7680047d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c210 tx=0x7fd77401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5baa46aea6cdb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774005ae0 con 0x7fd768003f00 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7740ab070 con 0x7fd768003f00 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77effd640 1 -- 172.21.15.37:0/2303099954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774007070 con 0x7fd768003f00 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- 172.21.15.37:0/2303099954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 msgr2=0x7fd7680047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 --2- 172.21.15.37:0/2303099954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7680047d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd77400c210 tx=0x7fd77401f3b0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd784aae640 1 -- 172.21.15.37:0/2303099954 reap_dead start 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- 172.21.15.37:0/2303099954 shutdown_connections 2023-07-09T21:23:31.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- 172.21.15.37:0/2303099954 >> 172.21.15.37:0/2303099954 conn(0x7fd7800694c0 msgr2=0x7fd7800698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- 172.21.15.37:0/2303099954 shutdown_connections 2023-07-09T21:23:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- 172.21.15.37:0/2303099954 wait complete. 2023-07-09T21:23:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 Processor -- start 2023-07-09T21:23:31.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- start start 2023-07-09T21:23:31.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006b4c0 0x7fd78014b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd78014b780 0x7fd7801450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78006b0a0 con 0x7fd768003f00 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78014ca70 con 0x7fd78014b780 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd786511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800cbc30 con 0x7fd78006b4c0 2023-07-09T21:23:31.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42496/0 (socket says 172.21.15.37:42496) 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.813+0000 7fd77ffff640 1 -- 172.21.15.37:0/501400889 learned_addr learned my addr 172.21.15.37:0/501400889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006b4c0 0x7fd78014b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd784aae640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd78014b780 0x7fd7801450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 -- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006b4c0 msgr2=0x7fd78014b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006b4c0 0x7fd78014b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 -- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd78014b780 msgr2=0x7fd7801450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd78014b780 0x7fd7801450f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 -- 172.21.15.37:0/501400889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800cbf10 con 0x7fd768003f00 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77ffff640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd7700119d0 tx=0x7fd770011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77000fb50 con 0x7fd768003f00 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77000fcb0 con 0x7fd768003f00 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd770014440 con 0x7fd768003f00 2023-07-09T21:23:31.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7800cc1f0 con 0x7fd768003f00 2023-07-09T21:23:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800ce300 con 0x7fd768003f00 2023-07-09T21:23:31.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7800b16c0 con 0x7fd768003f00 2023-07-09T21:23:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd7700145a0 con 0x7fd768003f00 2023-07-09T21:23:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 0x7fd76c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.817+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd770084310 con 0x7fd768003f00 2023-07-09T21:23:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.821+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 0x7fd76c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:31.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.821+0000 7fd77f7fe640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 0x7fd76c068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7740ae000 tx=0x7fd774001a10 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:31.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:31.821+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd770051a40 con 0x7fd768003f00 2023-07-09T21:23:32.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.029+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd7800cc6a0 con 0x7fd768003f00 2023-07-09T21:23:32.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd77cff9640 1 -- 172.21.15.37:0/501400889 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd770055060 con 0x7fd768003f00 2023-07-09T21:23:32.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 msgr2=0x7fd76c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 0x7fd76c068760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd7740ae000 tx=0x7fd774001a10 comp rx=0 tx=0).stop 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 msgr2=0x7fd7800cddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd7700119d0 tx=0x7fd770011e90 comp rx=0 tx=0).stop 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 shutdown_connections 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd76c0662b0 0x7fd76c068760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd78014b780 0x7fd7801450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd78006b4c0 0x7fd78014b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 --2- 172.21.15.37:0/501400889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd768003f00 0x7fd7800cddc0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 >> 172.21.15.37:0/501400889 conn(0x7fd7800694c0 msgr2=0x7fd78014d560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 shutdown_connections 2023-07-09T21:23:32.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.037+0000 7fd786511640 1 -- 172.21.15.37:0/501400889 wait complete. 2023-07-09T21:23:32.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-07-09T21:23:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 Processor -- start 2023-07-09T21:23:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 -- start start 2023-07-09T21:23:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c073060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c072bd0 con 0x7f196c0b1830 2023-07-09T21:23:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c15c050 con 0x7f196c15fe80 2023-07-09T21:23:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f197303a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c160430 con 0x7f196c15bc80 2023-07-09T21:23:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1971837640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f196c0b1830 0x7f196c15f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46982/0 (socket says 172.21.15.37:46982) 2023-07-09T21:23:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1971837640 1 -- 172.21.15.37:0/893497521 learned_addr learned my addr 172.21.15.37:0/893497521 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1972038640 1 --2- 172.21.15.37:0/893497521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1971036640 1 -- 172.21.15.37:0/893497521 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10167489 0 0) 0x7f196c072bd0 con 0x7f196c0b1830 2023-07-09T21:23:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1971036640 1 -- 172.21.15.37:0/893497521 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1958003530 con 0x7f196c0b1830 2023-07-09T21:23:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1972038640 1 -- 172.21.15.37:0/893497521 >> v1:172.21.15.119:6789/0 conn(0x7f196c15fe80 legacy=0x7f196c0ca400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1972038640 1 -- 172.21.15.37:0/893497521 >> v1:172.21.15.37:6789/0 conn(0x7f196c0b1830 legacy=0x7f196c15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.201+0000 7f1972038640 1 -- 172.21.15.37:0/893497521 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c072580 con 0x7f196c15bc80 2023-07-09T21:23:32.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f1972038640 1 --2- 172.21.15.37:0/893497521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c073060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19680097f0 tx=0x7f196c0cb320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=126b6ba84b24acc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f1971036640 1 -- 172.21.15.37:0/893497521 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680ab650 con 0x7f196c15bc80 2023-07-09T21:23:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f1971036640 1 -- 172.21.15.37:0/893497521 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19680ab7b0 con 0x7f196c15bc80 2023-07-09T21:23:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f1971036640 1 -- 172.21.15.37:0/893497521 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19680abb40 con 0x7f196c15bc80 2023-07-09T21:23:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 -- 172.21.15.37:0/893497521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 msgr2=0x7f196c073060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 --2- 172.21.15.37:0/893497521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c073060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f19680097f0 tx=0x7f196c0cb320 comp rx=0 tx=0).stop 2023-07-09T21:23:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 -- 172.21.15.37:0/893497521 shutdown_connections 2023-07-09T21:23:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 --2- 172.21.15.37:0/893497521 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c073060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 -- 172.21.15.37:0/893497521 >> 172.21.15.37:0/893497521 conn(0x7f196c06dda0 msgr2=0x7f196c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.205+0000 7f197303a640 1 -- 172.21.15.37:0/893497521 shutdown_connections 2023-07-09T21:23:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 -- 172.21.15.37:0/893497521 wait complete. 2023-07-09T21:23:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 Processor -- start 2023-07-09T21:23:32.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 -- start start 2023-07-09T21:23:32.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c0b1830 0x7f196c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15e610 con 0x7f196c15fe80 2023-07-09T21:23:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15ea00 con 0x7f196c0b1830 2023-07-09T21:23:32.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f197303a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15ece0 con 0x7f196c15bc80 2023-07-09T21:23:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972038640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c0b1830 0x7f196c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1971837640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42510/0 (socket says 172.21.15.37:42510) 2023-07-09T21:23:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 -- 172.21.15.37:0/1411313285 learned_addr learned my addr 172.21.15.37:0/1411313285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 -- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 msgr2=0x7f196c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 -- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c0b1830 msgr2=0x7f196c15e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c0b1830 0x7f196c15e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 -- 172.21.15.37:0/1411313285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1968009420 con 0x7f196c15fe80 2023-07-09T21:23:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1972839640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f196400c770 tx=0x7f196400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.209+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964003b80 con 0x7f196c15fe80 2023-07-09T21:23:32.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964003ce0 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196400aa90 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c15efc0 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c153630 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c04e020 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f196400abf0 con 0x7f196c15fe80 2023-07-09T21:23:32.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1962ffd640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 0x7f1950068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f19640837a0 con 0x7f196c15fe80 2023-07-09T21:23:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.213+0000 7f1972038640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 0x7f1950068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.217+0000 7f1972038640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 0x7f1950068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f19680af000 tx=0x7f1968004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.217+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1964050f80 con 0x7f196c15fe80 2023-07-09T21:23:32.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.425+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f196c0b5d30 con 0x7f196c15fe80 2023-07-09T21:23:32.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.429+0000 7f1962ffd640 1 -- 172.21.15.37:0/1411313285 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f19640545a0 con 0x7f196c15fe80 2023-07-09T21:23:32.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 msgr2=0x7f1950068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 0x7f1950068730 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f19680af000 tx=0x7f1968004740 comp rx=0 tx=0).stop 2023-07-09T21:23:32.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 msgr2=0x7f196c0b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f196400c770 tx=0x7f196400cc30 comp rx=0 tx=0).stop 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 shutdown_connections 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1950066280 0x7f1950068730 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c15fe80 0x7f196c0b4300 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c15bc80 0x7f196c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 --2- 172.21.15.37:0/1411313285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c0b1830 0x7f196c15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 >> 172.21.15.37:0/1411313285 conn(0x7f196c06dda0 msgr2=0x7f196c0cbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 shutdown_connections 2023-07-09T21:23:32.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.433+0000 7f197303a640 1 -- 172.21.15.37:0/1411313285 wait complete. 2023-07-09T21:23:32.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-07-09T21:23:32.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 Processor -- start 2023-07-09T21:23:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 -- start start 2023-07-09T21:23:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2e80ce9c0 0x7ff2e80b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80d1a60 0x7ff2e80cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 0x7ff2e80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80ce300 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e80ce5a0 con 0x7ff2e80ced90 2023-07-09T21:23:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ef03a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80d0730 con 0x7ff2e80d1a60 2023-07-09T21:23:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2e80ce9c0 0x7ff2e80b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2e80ce9c0 0x7ff2e80b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42512/0 (socket says 172.21.15.37:42512) 2023-07-09T21:23:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 -- 172.21.15.37:0/3678898246 learned_addr learned my addr 172.21.15.37:0/3678898246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ed837640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80d1a60 0x7ff2e80cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee839640 1 --2- 172.21.15.37:0/3678898246 >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 0x7ff2e80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 -- 172.21.15.37:0/3678898246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80d1a60 msgr2=0x7ff2e80cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80d1a60 0x7ff2e80cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 -- 172.21.15.37:0/3678898246 >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 msgr2=0x7ff2e80b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 --2- 172.21.15.37:0/3678898246 >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 0x7ff2e80b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee038640 1 -- 172.21.15.37:0/3678898246 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e80d0a10 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.601+0000 7ff2ee839640 1 --2- 172.21.15.37:0/3678898246 >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 0x7ff2e80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ee038640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e80b1400 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80b1390 tx=0x7ff2e401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340a7d99e94ed532 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ed036640 1 -- 172.21.15.37:0/3678898246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40ab600 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ed036640 1 -- 172.21.15.37:0/3678898246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e40a7050 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ed036640 1 -- 172.21.15.37:0/3678898246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e40ab980 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 -- 172.21.15.37:0/3678898246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80ce9c0 msgr2=0x7ff2e80b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e80b1400 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff2e80b1390 tx=0x7ff2e401c320 comp rx=0 tx=0).stop 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 -- 172.21.15.37:0/3678898246 shutdown_connections 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/3678898246 >> v2:172.21.15.119:3300/0 conn(0x7ff2e80ced90 0x7ff2e80b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80d1a60 0x7ff2e80cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/3678898246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e80b1400 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 -- 172.21.15.37:0/3678898246 >> 172.21.15.37:0/3678898246 conn(0x7ff2e80d1fb0 msgr2=0x7ff2e80d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 -- 172.21.15.37:0/3678898246 shutdown_connections 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.605+0000 7ff2ef03a640 1 -- 172.21.15.37:0/3678898246 wait complete. 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 Processor -- start 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 -- start start 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 0x7ff2e80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e80ca2d0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8152e40 con 0x7ff2e80ce9c0 2023-07-09T21:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ef03a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e8153040 con 0x7ff2e80ced90 2023-07-09T21:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42524/0 (socket says 172.21.15.37:42524) 2023-07-09T21:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 -- 172.21.15.37:0/482661220 learned_addr learned my addr 172.21.15.37:0/482661220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee038640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ed837640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 0x7ff2e80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 -- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 msgr2=0x7ff2e80cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 0x7ff2e80cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 -- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2e80ce9c0 msgr2=0x7ff2e814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ee839640 1 -- 172.21.15.37:0/482661220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e40094d0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.609+0000 7ff2ed837640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 0x7ff2e80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2ee839640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fa0 tx=0x7ff2e000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0003ba0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e000f040 con 0x7ff2e80d1a60 2023-07-09T21:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0004030 con 0x7ff2e80d1a60 2023-07-09T21:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e8153320 con 0x7ff2e80d1a60 2023-07-09T21:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e8153bc0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e8153de0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2e0004190 con 0x7ff2e80d1a60 2023-07-09T21:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 0x7ff2cc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff2e0083d00 con 0x7ff2e80d1a60 2023-07-09T21:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.613+0000 7ff2ee038640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 0x7ff2cc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:32.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.617+0000 7ff2ee038640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 0x7ff2cc068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40ad000 tx=0x7ff2e4004740 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:32.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.617+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2e0051570 con 0x7ff2e80d1a60 2023-07-09T21:23:32.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.825+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff2e804e020 con 0x7ff2e80d1a60 2023-07-09T21:23:32.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2deffd640 1 -- 172.21.15.37:0/482661220 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff2e001a0a0 con 0x7ff2e80d1a60 2023-07-09T21:23:32.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 msgr2=0x7ff2cc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 0x7ff2cc068730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40ad000 tx=0x7ff2e4004740 comp rx=0 tx=0).stop 2023-07-09T21:23:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 msgr2=0x7ff2e80c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:32.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009fa0 tx=0x7ff2e000d560 comp rx=0 tx=0).stop 2023-07-09T21:23:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 shutdown_connections 2023-07-09T21:23:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff2cc066280 0x7ff2cc068730 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2e80d1a60 0x7ff2e80c9710 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2e80ced90 0x7ff2e80cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 --2- 172.21.15.37:0/482661220 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2e80ce9c0 0x7ff2e814cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:32.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 >> 172.21.15.37:0/482661220 conn(0x7ff2e80d1fb0 msgr2=0x7ff2e81548e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 shutdown_connections 2023-07-09T21:23:32.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.833+0000 7ff2ef03a640 1 -- 172.21.15.37:0/482661220 wait complete. 2023-07-09T21:23:32.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-07-09T21:23:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 Processor -- start 2023-07-09T21:23:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 -- start start 2023-07-09T21:23:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4c40b7a60 0x7fa4c40cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b47a0 0x7fa4c40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40cef80 con 0x7fa4c40b4140 2023-07-09T21:23:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c40b45b0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4ca959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40cf260 con 0x7fa4c40b47a0 2023-07-09T21:23:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c8ef6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4c40b4140 0x7fa4c415f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46996/0 (socket says 172.21.15.37:46996) 2023-07-09T21:23:33.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c8ef6640 1 -- 172.21.15.37:0/1788720848 learned_addr learned my addr 172.21.15.37:0/1788720848 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c37fe640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b47a0 0x7fa4c40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/1788720848 >> v2:172.21.15.119:3300/0 conn(0x7fa4c40b7a60 0x7fa4c40cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/1788720848 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408747151 0 0) 0x7fa4c40cef80 con 0x7fa4c40b4140 2023-07-09T21:23:33.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/1788720848 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac003530 con 0x7fa4c40b4140 2023-07-09T21:23:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c3fff640 1 -- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b47a0 msgr2=0x7fa4c40b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b47a0 0x7fa4c40b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c3fff640 1 -- 172.21.15.37:0/1788720848 >> v1:172.21.15.37:6789/0 conn(0x7fa4c40b4140 legacy=0x7fa4c415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:32.997+0000 7fa4c3fff640 1 -- 172.21.15.37:0/1788720848 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40cf540 con 0x7fa4c40b7a60 2023-07-09T21:23:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40cc7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40097c0 tx=0x7fa4b401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d5f988468e7319 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/1788720848 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40ab600 con 0x7fa4c40b7a60 2023-07-09T21:23:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/1788720848 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4b40a7050 con 0x7fa4c40b7a60 2023-07-09T21:23:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4c2ffd640 1 -- 172.21.15.37:0/1788720848 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4b40ab980 con 0x7fa4c40b7a60 2023-07-09T21:23:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 -- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b7a60 msgr2=0x7fa4c40cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40cc7d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40097c0 tx=0x7fa4b401c480 comp rx=0 tx=0).stop 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 -- 172.21.15.37:0/1788720848 shutdown_connections 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b47a0 0x7fa4c40b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 --2- 172.21.15.37:0/1788720848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40cc7d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 -- 172.21.15.37:0/1788720848 >> 172.21.15.37:0/1788720848 conn(0x7fa4c4073050 msgr2=0x7fa4c4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 -- 172.21.15.37:0/1788720848 shutdown_connections 2023-07-09T21:23:33.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.001+0000 7fa4ca959640 1 -- 172.21.15.37:0/1788720848 wait complete. 2023-07-09T21:23:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 Processor -- start 2023-07-09T21:23:33.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- start start 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 0x7fa4c4153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b47a0 0x7fa4c4156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41555a0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c41561c0 con 0x7fa4c40b47a0 2023-07-09T21:23:33.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c40ca750 con 0x7fa4c40b4140 2023-07-09T21:23:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42532/0 (socket says 172.21.15.37:42532) 2023-07-09T21:23:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 -- 172.21.15.37:0/865859170 learned_addr learned my addr 172.21.15.37:0/865859170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 0x7fa4c4153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c37fe640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b47a0 0x7fa4c4156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 -- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 msgr2=0x7fa4c4153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 0x7fa4c4153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 -- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b47a0 msgr2=0x7fa4c4156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b47a0 0x7fa4c4156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 -- 172.21.15.37:0/865859170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4b4009420 con 0x7fa4c40b7a60 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 0x7fa4c4153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c8ef6640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00caa0 tx=0x7fa4bc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc00ac00 con 0x7fa4c40b7a60 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc00ad60 con 0x7fa4c40b7a60 2023-07-09T21:23:33.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc012600 con 0x7fa4c40b7a60 2023-07-09T21:23:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c4156430 con 0x7fa4c40b7a60 2023-07-09T21:23:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.005+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c41569f0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c40cdaa0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa4bc007070 con 0x7fa4c40b7a60 2023-07-09T21:23:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4c0ff9640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 0x7fa4b0068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa4bc083820 con 0x7fa4c40b7a60 2023-07-09T21:23:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 0x7fa4b0068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.009+0000 7fa4c3fff640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 0x7fa4b0068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40ad000 tx=0x7fa4b40a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.013+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4bc051090 con 0x7fa4c40b7a60 2023-07-09T21:23:33.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.221+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fa4c404d7d0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.225+0000 7fa4c0ff9640 1 -- 172.21.15.37:0/865859170 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa4bc0546b0 con 0x7fa4c40b7a60 2023-07-09T21:23:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 msgr2=0x7fa4b0068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 0x7fa4b0068730 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa4b40ad000 tx=0x7fa4b40a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 msgr2=0x7fa4c40c9b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc00caa0 tx=0x7fa4bc00cf60 comp rx=0 tx=0).stop 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 shutdown_connections 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa4b0066280 0x7fa4b0068730 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4c40b7a60 0x7fa4c40c9b40 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4c40b47a0 0x7fa4c4156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 --2- 172.21.15.37:0/865859170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4c40b4140 0x7fa4c4153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 >> 172.21.15.37:0/865859170 conn(0x7fa4c4073050 msgr2=0x7fa4c40b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 shutdown_connections 2023-07-09T21:23:33.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.229+0000 7fa4ca959640 1 -- 172.21.15.37:0/865859170 wait complete. 2023-07-09T21:23:33.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-07-09T21:23:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.389+0000 7f413ca18640 1 Processor -- start 2023-07-09T21:23:33.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413ca18640 1 -- start start 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413ca18640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4138072610 0x7f41380694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413ca18640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41381602c0 con 0x7f413815ba10 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413ca18640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4138069e40 con 0x7f4138069a00 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413ca18640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413815f6b0 con 0x7f4138072610 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f412ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4138072610 0x7f41380694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f413815ba10 0x7f41380b0b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47012/0 (socket says 172.21.15.37:47012) 2023-07-09T21:23:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f413659c640 1 -- 172.21.15.37:0/2628371566 learned_addr learned my addr 172.21.15.37:0/2628371566 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f412ffff640 1 -- 172.21.15.37:0/2628371566 >> v1:172.21.15.119:6789/0 conn(0x7f4138069a00 legacy=0x7f413806f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f412ffff640 1 -- 172.21.15.37:0/2628371566 >> v1:172.21.15.37:6789/0 conn(0x7f413815ba10 legacy=0x7f41380b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f412ffff640 1 -- 172.21.15.37:0/2628371566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413815f990 con 0x7f4138072610 2023-07-09T21:23:33.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.393+0000 7f4135d9b640 1 -- 172.21.15.37:0/2628371566 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755994414 0 0) 0x7f41381602c0 con 0x7f413815ba10 2023-07-09T21:23:33.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f412ffff640 1 --2- 172.21.15.37:0/2628371566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138072610 0x7f41380694c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41200097c0 tx=0x7f412001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3cbaf8d93b9e333 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f4135d9b640 1 -- 172.21.15.37:0/2628371566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200ac620 con 0x7f4138072610 2023-07-09T21:23:33.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f4135d9b640 1 -- 172.21.15.37:0/2628371566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41200ac780 con 0x7f4138072610 2023-07-09T21:23:33.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f4135d9b640 1 -- 172.21.15.37:0/2628371566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200acb10 con 0x7f4138072610 2023-07-09T21:23:33.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- 172.21.15.37:0/2628371566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138072610 msgr2=0x7f41380694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 --2- 172.21.15.37:0/2628371566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138072610 0x7f41380694c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f41200097c0 tx=0x7f412001c3c0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- 172.21.15.37:0/2628371566 shutdown_connections 2023-07-09T21:23:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 --2- 172.21.15.37:0/2628371566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138072610 0x7f41380694c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- 172.21.15.37:0/2628371566 >> 172.21.15.37:0/2628371566 conn(0x7f41380ce650 msgr2=0x7f41380cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- 172.21.15.37:0/2628371566 shutdown_connections 2023-07-09T21:23:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- 172.21.15.37:0/2628371566 wait complete. 2023-07-09T21:23:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 Processor -- start 2023-07-09T21:23:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.397+0000 7f413ca18640 1 -- start start 2023-07-09T21:23:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4138072610 0x7f4138153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 0x7f4138152ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41381577e0 con 0x7f4138069a00 2023-07-09T21:23:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41380c4660 con 0x7f413815ba10 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41380c4940 con 0x7f4138072610 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42562/0 (socket says 172.21.15.37:42562) 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 -- 172.21.15.37:0/1377856029 learned_addr learned my addr 172.21.15.37:0/1377856029 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f412ffff640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4138072610 0x7f4138153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f4136d9d640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 0x7f4138152ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 -- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4138072610 msgr2=0x7f4138153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4138072610 0x7f4138153350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 -- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 msgr2=0x7f4138152ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 0x7f4138152ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 -- 172.21.15.37:0/1377856029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120009420 con 0x7f4138069a00 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f4136d9d640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 0x7f4138152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:33.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413659c640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f412800c410 tx=0x7f412800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41280074e0 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4128007640 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41380c4c20 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4128004a30 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4138155ae0 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.401+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f413804d7d0 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.405+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4128004b90 con 0x7f4138069a00 2023-07-09T21:23:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.405+0000 7f412effd640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 0x7f4118068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.405+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4128083760 con 0x7f4138069a00 2023-07-09T21:23:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.405+0000 7f412ffff640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 0x7f4118068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.405+0000 7f412ffff640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 0x7f4118068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41200ae000 tx=0x7f4120008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.409+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4128050e90 con 0x7f4138069a00 2023-07-09T21:23:33.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.613+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f41380cf400 con 0x7f4138069a00 2023-07-09T21:23:33.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.617+0000 7f412effd640 1 -- 172.21.15.37:0/1377856029 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f41280544b0 con 0x7f4138069a00 2023-07-09T21:23:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 msgr2=0x7f4118068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 0x7f4118068760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f41200ae000 tx=0x7f4120008040 comp rx=0 tx=0).stop 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 msgr2=0x7f41380b0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f412800c410 tx=0x7f412800c8d0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 shutdown_connections 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f41180662b0 0x7f4118068760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f413815ba10 0x7f4138152ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4138072610 0x7f4138153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 --2- 172.21.15.37:0/1377856029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4138069a00 0x7f41380b0c80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 >> 172.21.15.37:0/1377856029 conn(0x7f41380ce650 msgr2=0x7f41380b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 shutdown_connections 2023-07-09T21:23:33.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.621+0000 7f413ca18640 1 -- 172.21.15.37:0/1377856029 wait complete. 2023-07-09T21:23:33.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:33.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.781+0000 7f619e0d8640 1 Processor -- start 2023-07-09T21:23:33.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.781+0000 7f619e0d8640 1 -- start start 2023-07-09T21:23:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f619e0d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f619806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f619e0d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f619e0d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61980b49f0 con 0x7f61980b4170 2023-07-09T21:23:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f619e0d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61980b7e80 con 0x7f61980cef80 2023-07-09T21:23:33.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f619e0d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61980b45f0 con 0x7f61980b7ab0 2023-07-09T21:23:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f6196ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f6196ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:56970/0 (socket says 172.21.15.37:56970) 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f61977fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f619806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f6196ffd640 1 -- 172.21.15.37:0/3520034076 learned_addr learned my addr 172.21.15.37:0/3520034076 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f61977fe640 1 -- 172.21.15.37:0/3520034076 >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 msgr2=0x7f61980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f61977fe640 1 --2- 172.21.15.37:0/3520034076 >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f61977fe640 1 -- 172.21.15.37:0/3520034076 >> v1:172.21.15.119:6789/0 conn(0x7f61980b4170 legacy=0x7f619815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f61977fe640 1 -- 172.21.15.37:0/3520034076 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61980cc8a0 con 0x7f61980b7ab0 2023-07-09T21:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.785+0000 7f6196ffd640 1 --2- 172.21.15.37:0/3520034076 >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:33.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f61977fe640 1 --2- 172.21.15.37:0/3520034076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f619806aa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61880097c0 tx=0x7f618801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d261c570d84f4df4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f61967fc640 1 -- 172.21.15.37:0/3520034076 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880ab650 con 0x7f61980b7ab0 2023-07-09T21:23:33.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f61967fc640 1 -- 172.21.15.37:0/3520034076 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880ab7b0 con 0x7f61980b7ab0 2023-07-09T21:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f61967fc640 1 -- 172.21.15.37:0/3520034076 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880abb40 con 0x7f61980b7ab0 2023-07-09T21:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- 172.21.15.37:0/3520034076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 msgr2=0x7f619806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 --2- 172.21.15.37:0/3520034076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f619806aa50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61880097c0 tx=0x7f618801c450 comp rx=0 tx=0).stop 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- 172.21.15.37:0/3520034076 shutdown_connections 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 --2- 172.21.15.37:0/3520034076 >> v2:172.21.15.119:3300/0 conn(0x7f61980cef80 0x7f61980b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 --2- 172.21.15.37:0/3520034076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f619806aa50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- 172.21.15.37:0/3520034076 >> 172.21.15.37:0/3520034076 conn(0x7f6198073090 msgr2=0x7f6198069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- 172.21.15.37:0/3520034076 shutdown_connections 2023-07-09T21:23:33.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- 172.21.15.37:0/3520034076 wait complete. 2023-07-09T21:23:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 Processor -- start 2023-07-09T21:23:33.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.789+0000 7f619e0d8640 1 -- start start 2023-07-09T21:23:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f61981525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 0x7f6198153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6198152af0 con 0x7f61980b4170 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619815c240 con 0x7f61980cef80 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6198153a00 con 0x7f61980b7ab0 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42566/0 (socket says 172.21.15.37:42566) 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 -- 172.21.15.37:0/1336304857 learned_addr learned my addr 172.21.15.37:0/1336304857 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f6196ffd640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f61981525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f6197fff640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 0x7f6198153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 -- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 msgr2=0x7f61981525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f61981525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 -- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 msgr2=0x7f6198153e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 0x7f6198153e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 -- 172.21.15.37:0/1336304857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c0094d0 con 0x7f61980b4170 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f6197fff640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 0x7f6198153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f61977fe640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f61880ad040 tx=0x7f618801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880bf610 con 0x7f61980b4170 2023-07-09T21:23:33.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61880bf770 con 0x7f61980b4170 2023-07-09T21:23:33.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6188009420 con 0x7f61980b4170 2023-07-09T21:23:33.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61880bfb20 con 0x7f61980b4170 2023-07-09T21:23:33.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61981530d0 con 0x7f61980b4170 2023-07-09T21:23:33.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619804d7d0 con 0x7f61980b4170 2023-07-09T21:23:33.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.793+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f61880b5400 con 0x7f61980b4170 2023-07-09T21:23:33.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.797+0000 7f617ffff640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:33.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.797+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f618811eab0 con 0x7f61980b4170 2023-07-09T21:23:33.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.797+0000 7f6196ffd640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:33.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.797+0000 7f6196ffd640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 0x7f6184068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61980b3b40 tx=0x7f618c009240 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:33.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.801+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61880ec3b0 con 0x7f61980b4170 2023-07-09T21:23:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.953+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61980b3f50 con 0x7f61980b4170 2023-07-09T21:23:33.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.953+0000 7f617ffff640 1 -- 172.21.15.37:0/1336304857 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f61880ef9d0 con 0x7f61980b4170 2023-07-09T21:23:33.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:33.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:30.825267+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 msgr2=0x7f6184068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 0x7f6184068730 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f61980b3b40 tx=0x7f618c009240 comp rx=0 tx=0).stop 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 msgr2=0x7f61980cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f61880ad040 tx=0x7f618801ac90 comp rx=0 tx=0).stop 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 shutdown_connections 2023-07-09T21:23:33.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6184066280 0x7f6184068730 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61980cef80 0x7f6198153e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61980b7ab0 0x7f61981525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 --2- 172.21.15.37:0/1336304857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61980b4170 0x7f61980cc100 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 >> 172.21.15.37:0/1336304857 conn(0x7f6198073090 msgr2=0x7f619815b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 shutdown_connections 2023-07-09T21:23:33.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:33.957+0000 7f619e0d8640 1 -- 172.21.15.37:0/1336304857 wait complete. 2023-07-09T21:23:33.982 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:23:33.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:23:34.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.121+0000 7f1e28034640 1 Processor -- start 2023-07-09T21:23:34.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.121+0000 7f1e28034640 1 -- start start 2023-07-09T21:23:34.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e28034640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1e200cf290 0x7f1e20160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e28034640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2015bf80 con 0x7f1e200b7980 2023-07-09T21:23:34.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e28034640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e20160570 con 0x7f1e200d0780 2023-07-09T21:23:34.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e28034640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e200cd070 con 0x7f1e200cf290 2023-07-09T21:23:34.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1e200b7980 0x7f1e200ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47028/0 (socket says 172.21.15.37:47028) 2023-07-09T21:23:34.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 -- 172.21.15.37:0/123890 learned_addr learned my addr 172.21.15.37:0/123890 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:34.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e255cf640 1 --2- 172.21.15.37:0/123890 >> v2:172.21.15.119:3300/0 conn(0x7f1e200cf290 0x7f1e20160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966087913 0 0) 0x7f1e1c001120 con 0x7f1e200b7980 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c003530 con 0x7f1e200b7980 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 546366851 0 0) 0x7f1e0c003530 con 0x7f1e200b7980 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 >> v2:172.21.15.119:3300/0 conn(0x7f1e200cf290 msgr2=0x7f1e20160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 --2- 172.21.15.37:0/123890 >> v2:172.21.15.119:3300/0 conn(0x7f1e200cf290 0x7f1e20160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 >> v1:172.21.15.119:6789/0 conn(0x7f1e200d0780 legacy=0x7f1e200d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200d02f0 con 0x7f1e200b7980 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1e1c001810 con 0x7f1e200b7980 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 >> v1:172.21.15.37:6789/0 conn(0x7f1e200b7980 legacy=0x7f1e200ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 0x7f1e0c003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e0c004370 0x7f1e0c004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c005030 0x7f1e0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e200cd070 con 0x7f1e0c003980 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c00bf80 con 0x7f1e0c005030 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c00c140 con 0x7f1e0c004370 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 0x7f1e0c003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e255cf640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e0c004370 0x7f1e0c004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e265d1640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c005030 0x7f1e0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 -- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e0c004370 msgr2=0x7f1e0c004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e0c004370 0x7f1e0c004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 -- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c005030 msgr2=0x7f1e0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c005030 0x7f1e0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e25dd0640 1 -- 172.21.15.37:0/123890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c003530 con 0x7f1e0c003980 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e265d1640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c005030 0x7f1e0c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:34.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.125+0000 7f1e265d1640 1 -- 172.21.15.37:0/123890 reap_dead start 2023-07-09T21:23:34.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 0x7f1e0c003d50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c190 tx=0x7f1e1c01cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d7f59da720aa09 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c005ae0 con 0x7f1e0c003980 2023-07-09T21:23:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c005c60 con 0x7f1e0c003980 2023-07-09T21:23:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e24dce640 1 -- 172.21.15.37:0/123890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c0072b0 con 0x7f1e0c003980 2023-07-09T21:23:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 -- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 msgr2=0x7f1e0c003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 0x7f1e0c003d50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c190 tx=0x7f1e1c01cbe0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 -- 172.21.15.37:0/123890 shutdown_connections 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 --2- 172.21.15.37:0/123890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e0c003980 0x7f1e0c003d50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 -- 172.21.15.37:0/123890 >> 172.21.15.37:0/123890 conn(0x7f1e20073090 msgr2=0x7f1e20069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 -- 172.21.15.37:0/123890 shutdown_connections 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.129+0000 7f1e28034640 1 -- 172.21.15.37:0/123890 wait complete. 2023-07-09T21:23:34.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 Processor -- start 2023-07-09T21:23:34.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- start start 2023-07-09T21:23:34.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c003980 0x7f1e2014fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e200cb190 0x7f1e201f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e20150020 con 0x7f1e20150900 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e200cb650 con 0x7f1e0c003980 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e200cb930 con 0x7f1e200cb190 2023-07-09T21:23:34.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42576/0 (socket says 172.21.15.37:42576) 2023-07-09T21:23:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 -- 172.21.15.37:0/1003966909 learned_addr learned my addr 172.21.15.37:0/1003966909 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c003980 0x7f1e2014fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e265d1640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e200cb190 0x7f1e201f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 -- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e200cb190 msgr2=0x7f1e201f8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e200cb190 0x7f1e201f8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 -- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c003980 msgr2=0x7f1e2014fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c003980 0x7f1e2014fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 -- 172.21.15.37:0/1003966909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200cbc10 con 0x7f1e20150900 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e255cf640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e100119b0 tx=0x7f1e10011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e10004240 con 0x7f1e20150900 2023-07-09T21:23:34.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e100043a0 con 0x7f1e20150900 2023-07-09T21:23:34.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2015c3f0 con 0x7f1e20150900 2023-07-09T21:23:34.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1000f9c0 con 0x7f1e20150900 2023-07-09T21:23:34.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e201f8c60 con 0x7f1e20150900 2023-07-09T21:23:34.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.133+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2004d7d0 con 0x7f1e20150900 2023-07-09T21:23:34.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.137+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1e1000fb20 con 0x7f1e20150900 2023-07-09T21:23:34.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.137+0000 7f1e167fc640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 0x7f1e04068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.137+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1e10083f00 con 0x7f1e20150900 2023-07-09T21:23:34.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.137+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 0x7f1e04068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.137+0000 7f1e25dd0640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 0x7f1e04068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0ab000 tx=0x7f1e1c0b1040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.141+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1e100516e0 con 0x7f1e20150900 2023-07-09T21:23:34.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.297+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e200c5720 con 0x7f1e20150900 2023-07-09T21:23:34.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.297+0000 7f1e167fc640 1 -- 172.21.15.37:0/1003966909 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e100190a0 con 0x7f1e20150900 2023-07-09T21:23:34.304 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:23:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 msgr2=0x7f1e04068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 0x7f1e04068730 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c0ab000 tx=0x7f1e1c0b1040 comp rx=0 tx=0).stop 2023-07-09T21:23:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 msgr2=0x7f1e201f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1e100119b0 tx=0x7f1e10011db0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 shutdown_connections 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f1e04066280 0x7f1e04068730 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1e200cb190 0x7f1e201f8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e20150900 0x7f1e201f81e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 --2- 172.21.15.37:0/1003966909 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1e0c003980 0x7f1e2014fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 >> 172.21.15.37:0/1003966909 conn(0x7f1e20073090 msgr2=0x7f1e200d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 shutdown_connections 2023-07-09T21:23:34.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.301+0000 7f1e28034640 1 -- 172.21.15.37:0/1003966909 wait complete. 2023-07-09T21:23:34.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:23:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 Processor -- start 2023-07-09T21:23:34.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- start start 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79a40cf290 0x7f79a4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f79a40d0780 0x7f79a40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a415bf80 con 0x7f79a40b7980 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40cd070 con 0x7f79a40cf290 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a40cfd70 con 0x7f79a40d0780 2023-07-09T21:23:34.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79a40cf290 0x7f79a4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79a40cf290 0x7f79a4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42578/0 (socket says 172.21.15.37:42578) 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 -- 172.21.15.37:0/2207281448 learned_addr learned my addr 172.21.15.37:0/2207281448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a9549640 1 --2- 172.21.15.37:0/2207281448 >> v2:172.21.15.119:3300/0 conn(0x7f79a40d0780 0x7f79a40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 -- 172.21.15.37:0/2207281448 >> v2:172.21.15.119:3300/0 conn(0x7f79a40d0780 msgr2=0x7f79a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 --2- 172.21.15.37:0/2207281448 >> v2:172.21.15.119:3300/0 conn(0x7f79a40d0780 0x7f79a40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 -- 172.21.15.37:0/2207281448 >> v1:172.21.15.119:6789/0 conn(0x7f79a40b7980 legacy=0x7f79a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 -- 172.21.15.37:0/2207281448 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a4160570 con 0x7f79a40cf290 2023-07-09T21:23:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a3fff640 1 --2- 172.21.15.37:0/2207281448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a4160030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79a40b1240 tx=0x7f799001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75060d44ec8be53a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a37fe640 1 -- 172.21.15.37:0/2207281448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900ab600 con 0x7f79a40cf290 2023-07-09T21:23:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a37fe640 1 -- 172.21.15.37:0/2207281448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900a7050 con 0x7f79a40cf290 2023-07-09T21:23:34.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79a37fe640 1 -- 172.21.15.37:0/2207281448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900ab980 con 0x7f79a40cf290 2023-07-09T21:23:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- 172.21.15.37:0/2207281448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 msgr2=0x7f79a4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 --2- 172.21.15.37:0/2207281448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a4160030 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f79a40b1240 tx=0x7f799001c500 comp rx=0 tx=0).stop 2023-07-09T21:23:34.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- 172.21.15.37:0/2207281448 shutdown_connections 2023-07-09T21:23:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 --2- 172.21.15.37:0/2207281448 >> v2:172.21.15.119:3300/0 conn(0x7f79a40d0780 0x7f79a40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 --2- 172.21.15.37:0/2207281448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a4160030 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- 172.21.15.37:0/2207281448 >> 172.21.15.37:0/2207281448 conn(0x7f79a4073090 msgr2=0x7f79a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- 172.21.15.37:0/2207281448 shutdown_connections 2023-07-09T21:23:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.469+0000 7f79aafac640 1 -- 172.21.15.37:0/2207281448 wait complete. 2023-07-09T21:23:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 Processor -- start 2023-07-09T21:23:34.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- start start 2023-07-09T21:23:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a40b7980 0x7f79a40c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a40d0780 0x7f79a4154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40b2530 con 0x7f79a40cf290 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a414f650 con 0x7f79a40b7980 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a40b1c00 con 0x7f79a40d0780 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42586/0 (socket says 172.21.15.37:42586) 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 -- 172.21.15.37:0/2013566917 learned_addr learned my addr 172.21.15.37:0/2013566917 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a8d48640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a40b7980 0x7f79a40c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a9549640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a40d0780 0x7f79a4154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 -- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a40d0780 msgr2=0x7f79a4154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a40d0780 0x7f79a4154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 -- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a40b7980 msgr2=0x7f79a40c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a40b7980 0x7f79a40c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 -- 172.21.15.37:0/2013566917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900094d0 con 0x7f79a40cf290 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a3fff640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7990019110 tx=0x7f79900192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900b37d0 con 0x7f79a40cf290 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79900b3930 con 0x7f79a40cf290 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a40b1ee0 con 0x7f79a40cf290 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900b3ca0 con 0x7f79a40cf290 2023-07-09T21:23:34.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.473+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a414f260 con 0x7f79a40cf290 2023-07-09T21:23:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a404d7d0 con 0x7f79a40cf290 2023-07-09T21:23:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f79900b2070 con 0x7f79a40cf290 2023-07-09T21:23:34.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79a17fa640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 0x7f7988068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f799011db60 con 0x7f79a40cf290 2023-07-09T21:23:34.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79a8d48640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 0x7f7988068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.477+0000 7f79a8d48640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 0x7f7988068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7998007fd0 tx=0x7f7998009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.481+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79900eb290 con 0x7f79a40cf290 2023-07-09T21:23:34.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.633+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f79a4160570 con 0x7f79a40cf290 2023-07-09T21:23:34.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79a17fa640 1 -- 172.21.15.37:0/2013566917 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f79a4160570 con 0x7f79a40cf290 2023-07-09T21:23:34.645 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:23:34.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 msgr2=0x7f7988068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 0x7f7988068730 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f7998007fd0 tx=0x7f7998009040 comp rx=0 tx=0).stop 2023-07-09T21:23:34.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 msgr2=0x7f79a414ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7990019110 tx=0x7f79900192a0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 shutdown_connections 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7988066280 0x7f7988068730 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a40d0780 0x7f79a4154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a40cf290 0x7f79a414ed20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 --2- 172.21.15.37:0/2013566917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a40b7980 0x7f79a40c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 >> 172.21.15.37:0/2013566917 conn(0x7f79a4073090 msgr2=0x7f79a415dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 shutdown_connections 2023-07-09T21:23:34.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.637+0000 7f79aafac640 1 -- 172.21.15.37:0/2013566917 wait complete. 2023-07-09T21:23:34.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:23:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 Processor -- start 2023-07-09T21:23:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 -- start start 2023-07-09T21:23:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 0x7f618815fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880ccd40 con 0x7f618806a280 2023-07-09T21:23:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61880cc5a0 con 0x7f61880b7810 2023-07-09T21:23:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618ecbd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618806a700 con 0x7f61880ce1a0 2023-07-09T21:23:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618dcbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 0x7f618815fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:48058/0 (socket says 172.21.15.37:48058) 2023-07-09T21:23:34.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 -- 172.21.15.37:0/2826880048 learned_addr learned my addr 172.21.15.37:0/2826880048 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618dcbb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 0x7f618815fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:57054/0 (socket says 172.21.15.37:57054) 2023-07-09T21:23:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 -- 172.21.15.37:0/2826880048 >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 msgr2=0x7f618815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 --2- 172.21.15.37:0/2826880048 >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 0x7f618815fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 -- 172.21.15.37:0/2826880048 >> v1:172.21.15.119:6789/0 conn(0x7f618806a280 legacy=0x7f618802ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.805+0000 7f618d4ba640 1 -- 172.21.15.37:0/2826880048 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61881602d0 con 0x7f61880ce1a0 2023-07-09T21:23:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618d4ba640 1 --2- 172.21.15.37:0/2826880048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6178009870 tx=0x7f617801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=233a226f6e6d6884 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618ccb9640 1 -- 172.21.15.37:0/2826880048 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780aa670 con 0x7f61880ce1a0 2023-07-09T21:23:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618ccb9640 1 -- 172.21.15.37:0/2826880048 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61780aa7d0 con 0x7f61880ce1a0 2023-07-09T21:23:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618ccb9640 1 -- 172.21.15.37:0/2826880048 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61780aab60 con 0x7f61880ce1a0 2023-07-09T21:23:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618ecbd640 1 -- 172.21.15.37:0/2826880048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 msgr2=0x7f6188069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.809+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2826880048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6178009870 tx=0x7f617801c510 comp rx=0 tx=0).stop 2023-07-09T21:23:34.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2826880048 shutdown_connections 2023-07-09T21:23:34.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2826880048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61880ce1a0 0x7f6188069d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2826880048 >> v2:172.21.15.119:3300/0 conn(0x7f61880b7810 0x7f618815fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2826880048 >> 172.21.15.37:0/2826880048 conn(0x7f61880cea60 msgr2=0x7f61880cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2826880048 shutdown_connections 2023-07-09T21:23:34.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2826880048 wait complete. 2023-07-09T21:23:34.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 Processor -- start 2023-07-09T21:23:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- start start 2023-07-09T21:23:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 0x7f6188156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61880b7810 0x7f6188156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188159540 con 0x7f61880ce1a0 2023-07-09T21:23:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61881589c0 con 0x7f61880b7810 2023-07-09T21:23:34.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6188158ca0 con 0x7f618806a280 2023-07-09T21:23:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618dcbb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 0x7f6188156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42600/0 (socket says 172.21.15.37:42600) 2023-07-09T21:23:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 -- 172.21.15.37:0/2879492006 learned_addr learned my addr 172.21.15.37:0/2879492006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618d4ba640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61880b7810 0x7f6188156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 -- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 msgr2=0x7f6188156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 0x7f6188156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 -- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61880b7810 msgr2=0x7f6188156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61880b7810 0x7f6188156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 -- 172.21.15.37:0/2879492006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61780094d0 con 0x7f61880ce1a0 2023-07-09T21:23:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618dcbb640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 0x7f6188156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618e4bc640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f618000c770 tx=0x7f618000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6180003b80 con 0x7f61880ce1a0 2023-07-09T21:23:34.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6180003ce0 con 0x7f61880ce1a0 2023-07-09T21:23:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f618000aa90 con 0x7f61880ce1a0 2023-07-09T21:23:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6188158f80 con 0x7f61880ce1a0 2023-07-09T21:23:34.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61881570b0 con 0x7f61880ce1a0 2023-07-09T21:23:34.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618804e020 con 0x7f61880ce1a0 2023-07-09T21:23:34.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f618000abf0 con 0x7f61880ce1a0 2023-07-09T21:23:34.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:34.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6180083790 con 0x7f61880ce1a0 2023-07-09T21:23:34.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.813+0000 7f618dcbb640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:34.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.817+0000 7f618dcbb640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 0x7f616c068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f61880c8fd0 tx=0x7f6184009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:34.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.817+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6180050f80 con 0x7f61880ce1a0 2023-07-09T21:23:34.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6188154040 con 0x7f61880ce1a0 2023-07-09T21:23:34.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f617e7fc640 1 -- 172.21.15.37:0/2879492006 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v33) v1 ==== 84+0+126 (secure 0 0 0) 0x7f61800545a0 con 0x7f61880ce1a0 2023-07-09T21:23:34.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:34.983 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:23:34.984 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:23:34.984 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:34.984 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:23:34.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 msgr2=0x7f616c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 0x7f616c068730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f61880c8fd0 tx=0x7f6184009190 comp rx=0 tx=0).stop 2023-07-09T21:23:34.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 msgr2=0x7f6188153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:34.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f618000c770 tx=0x7f618000cc30 comp rx=0 tx=0).stop 2023-07-09T21:23:34.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 shutdown_connections 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f616c066280 0x7f616c068730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61880ce1a0 0x7f6188153420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61880b7810 0x7f6188156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 --2- 172.21.15.37:0/2879492006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f618806a280 0x7f6188156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 >> 172.21.15.37:0/2879492006 conn(0x7f61880cea60 msgr2=0x7f61880d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 shutdown_connections 2023-07-09T21:23:34.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:34.977+0000 7f618ecbd640 1 -- 172.21.15.37:0/2879492006 wait complete. 2023-07-09T21:23:35.003 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:23:35.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:23:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 Processor -- start 2023-07-09T21:23:35.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 -- start start 2023-07-09T21:23:35.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1100cf290 0x7fb110160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb1100d0780 0x7fb1100d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb11015bf80 con 0x7fb1100b7980 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100cd070 con 0x7fb1100cf290 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb11618f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100cfd70 con 0x7fb1100d0780 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1100b7980 0x7fb1100ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47040/0 (socket says 172.21.15.37:47040) 2023-07-09T21:23:35.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1100cf290 0x7fb110160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10f7fe640 1 -- 172.21.15.37:0/1810685505 learned_addr learned my addr 172.21.15.37:0/1810685505 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:35.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10ffff640 1 --2- 172.21.15.37:0/1810685505 >> v2:172.21.15.119:3300/0 conn(0x7fb1100d0780 0x7fb1100d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10effd640 1 -- 172.21.15.37:0/1810685505 >> v2:172.21.15.119:3300/0 conn(0x7fb1100d0780 msgr2=0x7fb1100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:35.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10effd640 1 --2- 172.21.15.37:0/1810685505 >> v2:172.21.15.119:3300/0 conn(0x7fb1100d0780 0x7fb1100d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:35.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10effd640 1 -- 172.21.15.37:0/1810685505 >> v1:172.21.15.37:6789/0 conn(0x7fb1100b7980 legacy=0x7fb1100ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:35.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10effd640 1 -- 172.21.15.37:0/1810685505 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb110160570 con 0x7fb1100cf290 2023-07-09T21:23:35.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.145+0000 7fb10e7fc640 1 -- 172.21.15.37:0/1810685505 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010081716 0 0) 0x7fb100001120 con 0x7fb1100b7980 2023-07-09T21:23:35.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb10effd640 1 --2- 172.21.15.37:0/1810685505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100cf290 0x7fb110160030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b1240 tx=0x7fb10401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb079f8176ee47f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:35.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb10e7fc640 1 -- 172.21.15.37:0/1810685505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040ab600 con 0x7fb1100cf290 2023-07-09T21:23:35.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb10e7fc640 1 -- 172.21.15.37:0/1810685505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1040a7050 con 0x7fb1100cf290 2023-07-09T21:23:35.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb10e7fc640 1 -- 172.21.15.37:0/1810685505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1040ab980 con 0x7fb1100cf290 2023-07-09T21:23:35.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- 172.21.15.37:0/1810685505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100cf290 msgr2=0x7fb110160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:35.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 --2- 172.21.15.37:0/1810685505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100cf290 0x7fb110160030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fb1100b1240 tx=0x7fb10401c460 comp rx=0 tx=0).stop 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- 172.21.15.37:0/1810685505 shutdown_connections 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 --2- 172.21.15.37:0/1810685505 >> v2:172.21.15.119:3300/0 conn(0x7fb1100d0780 0x7fb1100d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 --2- 172.21.15.37:0/1810685505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100cf290 0x7fb110160030 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- 172.21.15.37:0/1810685505 >> 172.21.15.37:0/1810685505 conn(0x7fb110073090 msgr2=0x7fb110069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- 172.21.15.37:0/1810685505 shutdown_connections 2023-07-09T21:23:35.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- 172.21.15.37:0/1810685505 wait complete. 2023-07-09T21:23:35.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 Processor -- start 2023-07-09T21:23:35.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.149+0000 7fb11618f640 1 -- start start 2023-07-09T21:23:35.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1100b7980 0x7fb1100b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1100cf290 0x7fb11015d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11015d570 con 0x7fb1100d0780 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b4b00 con 0x7fb1100b7980 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b3f80 con 0x7fb1100cf290 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42612/0 (socket says 172.21.15.37:42612) 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 -- 172.21.15.37:0/1552215811 learned_addr learned my addr 172.21.15.37:0/1552215811 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:35.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10effd640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1100cf290 0x7fb11015d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10f7fe640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1100b7980 0x7fb1100b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 -- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1100cf290 msgr2=0x7fb11015d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1100cf290 0x7fb11015d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 -- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1100b7980 msgr2=0x7fb1100b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1100b7980 0x7fb1100b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 -- 172.21.15.37:0/1552215811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb104009420 con 0x7fb1100d0780 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb10ffff640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb10800efc0 tx=0x7fb10800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108009ba0 con 0x7fb1100d0780 2023-07-09T21:23:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10800f040 con 0x7fb1100d0780 2023-07-09T21:23:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1080146c0 con 0x7fb1100d0780 2023-07-09T21:23:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100b4260 con 0x7fb1100d0780 2023-07-09T21:23:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100b4820 con 0x7fb1100d0780 2023-07-09T21:23:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.153+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1100c5d40 con 0x7fb1100d0780 2023-07-09T21:23:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.157+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb108014820 con 0x7fb1100d0780 2023-07-09T21:23:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.157+0000 7fb0f7fff640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.157+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb1080843c0 con 0x7fb1100d0780 2023-07-09T21:23:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.157+0000 7fb10f7fe640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:35.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.157+0000 7fb10f7fe640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 0x7fb0fc068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb100000f70 tx=0x7fb100007ba0 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:35.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.161+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1100c5d40 con 0x7fb1100d0780 2023-07-09T21:23:35.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:35.321+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb1100c5d40 con 0x7fb1100d0780 2023-07-09T21:23:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.169+0000 7fb0f7fff640 1 -- 172.21.15.37:0/1552215811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v34) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb1100c5d40 con 0x7fb1100d0780 2023-07-09T21:23:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:23:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 msgr2=0x7fb0fc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 0x7fb0fc068730 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb100000f70 tx=0x7fb100007ba0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 msgr2=0x7fb1100b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb10800efc0 tx=0x7fb10800c490 comp rx=0 tx=0).stop 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 shutdown_connections 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fb0fc066280 0x7fb0fc068730 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1100d0780 0x7fb1100b1e20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1100cf290 0x7fb11015d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 --2- 172.21.15.37:0/1552215811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1100b7980 0x7fb1100b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 >> 172.21.15.37:0/1552215811 conn(0x7fb110073090 msgr2=0x7fb1100ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 shutdown_connections 2023-07-09T21:23:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.173+0000 7fb11618f640 1 -- 172.21.15.37:0/1552215811 wait complete. 2023-07-09T21:23:36.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:23:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.353+0000 7f71b745c640 1 Processor -- start 2023-07-09T21:23:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.353+0000 7f71b745c640 1 -- start start 2023-07-09T21:23:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b745c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71b0160030 0x7f71b00d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b745c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b015bf80 con 0x7f71b00b7980 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b745c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b00d02f0 con 0x7f71b00cf290 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b745c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b00cd070 con 0x7f71b0160030 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b59f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71b0160030 0x7f71b00d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b51f8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f71b00b7980 0x7f71b00ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47046/0 (socket says 172.21.15.37:47046) 2023-07-09T21:23:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b51f8640 1 -- 172.21.15.37:0/3863164363 learned_addr learned my addr 172.21.15.37:0/3863164363 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b59f9640 1 -- 172.21.15.37:0/3863164363 >> v1:172.21.15.119:6789/0 conn(0x7f71b00cf290 legacy=0x7f71b00d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b59f9640 1 -- 172.21.15.37:0/3863164363 >> v1:172.21.15.37:6789/0 conn(0x7f71b00b7980 legacy=0x7f71b00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71b59f9640 1 -- 172.21.15.37:0/3863164363 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b00cc7f0 con 0x7f71b0160030 2023-07-09T21:23:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.357+0000 7f71a7fff640 1 -- 172.21.15.37:0/3863164363 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884482780 0 0) 0x7f71ac001120 con 0x7f71b00b7980 2023-07-09T21:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b59f9640 1 --2- 172.21.15.37:0/3863164363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b00d0e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009d90 tx=0x7f71a801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a750e850c449e3c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71a7fff640 1 -- 172.21.15.37:0/3863164363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80a5810 con 0x7f71b0160030 2023-07-09T21:23:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71a7fff640 1 -- 172.21.15.37:0/3863164363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a80a5970 con 0x7f71b0160030 2023-07-09T21:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71a7fff640 1 -- 172.21.15.37:0/3863164363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80a5d00 con 0x7f71b0160030 2023-07-09T21:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- 172.21.15.37:0/3863164363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 msgr2=0x7f71b00d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 --2- 172.21.15.37:0/3863164363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b00d0e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009d90 tx=0x7f71a801c950 comp rx=0 tx=0).stop 2023-07-09T21:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- 172.21.15.37:0/3863164363 shutdown_connections 2023-07-09T21:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 --2- 172.21.15.37:0/3863164363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b00d0e90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- 172.21.15.37:0/3863164363 >> 172.21.15.37:0/3863164363 conn(0x7f71b0073090 msgr2=0x7f71b0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- 172.21.15.37:0/3863164363 shutdown_connections 2023-07-09T21:23:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- 172.21.15.37:0/3863164363 wait complete. 2023-07-09T21:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 Processor -- start 2023-07-09T21:23:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.361+0000 7f71b745c640 1 -- start start 2023-07-09T21:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b00b7980 0x7f71b0153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71b00cf290 0x7f71b014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b014f2a0 con 0x7f71b0160030 2023-07-09T21:23:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b0153da0 con 0x7f71b00b7980 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b014e620 con 0x7f71b00cf290 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42626/0 (socket says 172.21.15.37:42626) 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 -- 172.21.15.37:0/3628562146 learned_addr learned my addr 172.21.15.37:0/3628562146 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b51f8640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b00b7980 0x7f71b0153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b49f7640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71b00cf290 0x7f71b014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 -- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71b00cf290 msgr2=0x7f71b014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71b00cf290 0x7f71b014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 -- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b00b7980 msgr2=0x7f71b0153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b00b7980 0x7f71b0153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 -- 172.21.15.37:0/3628562146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8009a70 con 0x7f71b0160030 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b59f9640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009d90 tx=0x7f71b00d1be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80be070 con 0x7f71b0160030 2023-07-09T21:23:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a80a57e0 con 0x7f71b0160030 2023-07-09T21:23:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b014e900 con 0x7f71b0160030 2023-07-09T21:23:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a80ad870 con 0x7f71b0160030 2023-07-09T21:23:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b014eec0 con 0x7f71b0160030 2023-07-09T21:23:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.365+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b014f3e0 con 0x7f71b0160030 2023-07-09T21:23:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.369+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f71a80b4040 con 0x7f71b0160030 2023-07-09T21:23:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.369+0000 7f71a5ffb640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 0x7f7194068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.369+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f71a811e7f0 con 0x7f71b0160030 2023-07-09T21:23:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.369+0000 7f71b51f8640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 0x7f7194068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.369+0000 7f71b51f8640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 0x7f7194068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e00 tx=0x7f71ac007d90 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:36.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.373+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f71a80ebe50 con 0x7f71b0160030 2023-07-09T21:23:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:36.525+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f71b014f3e0 con 0x7f71b0160030 2023-07-09T21:23:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.181+0000 7f71a5ffb640 1 -- 172.21.15.37:0/3628562146 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v35) v1 ==== 170+0+0 (secure 0 0 0) 0x7f71b014f3e0 con 0x7f71b0160030 2023-07-09T21:23:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:23:37.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 msgr2=0x7f7194068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 0x7f7194068730 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e00 tx=0x7f71ac007d90 comp rx=0 tx=0).stop 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 msgr2=0x7f71b0157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f71a8009d90 tx=0x7f71b00d1be0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 shutdown_connections 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7194066280 0x7f7194068730 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71ac007e00 tx=0x7f71ac007d90 comp rx=0 tx=0).stop 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71b0160030 0x7f71b0157a90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71b00cf290 0x7f71b014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 --2- 172.21.15.37:0/3628562146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71b00b7980 0x7f71b0153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.189+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 >> 172.21.15.37:0/3628562146 conn(0x7f71b0073090 msgr2=0x7f71b00d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:37.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.193+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 shutdown_connections 2023-07-09T21:23:37.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.193+0000 7f71b745c640 1 -- 172.21.15.37:0/3628562146 wait complete. 2023-07-09T21:23:37.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:23:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.369+0000 7f0a22093640 1 Processor -- start 2023-07-09T21:23:37.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.369+0000 7f0a22093640 1 -- start start 2023-07-09T21:23:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a22093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a22093640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a22093640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a1c15bf80 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a22093640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a1c0cd070 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a22093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0cfd70 con 0x7f0a1c0b7980 2023-07-09T21:23:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38272/0 (socket says 172.21.15.37:38272) 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 -- 172.21.15.37:0/442715035 learned_addr learned my addr 172.21.15.37:0/442715035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1b7fe640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 -- 172.21.15.37:0/442715035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 msgr2=0x7f0a1c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 -- 172.21.15.37:0/442715035 >> v1:172.21.15.119:6789/0 conn(0x7f0a1c0b3c20 legacy=0x7f0a1c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.373+0000 7f0a1affd640 1 -- 172.21.15.37:0/442715035 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c160570 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a1affd640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1707a0859268be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a1a7fc640 1 -- 172.21.15.37:0/442715035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100ab600 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a1a7fc640 1 -- 172.21.15.37:0/442715035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100a7050 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a1a7fc640 1 -- 172.21.15.37:0/442715035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100ab980 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- 172.21.15.37:0/442715035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0ceb80 msgr2=0x7f0a1c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c540 comp rx=0 tx=0).stop 2023-07-09T21:23:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- 172.21.15.37:0/442715035 shutdown_connections 2023-07-09T21:23:37.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c0cef90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 --2- 172.21.15.37:0/442715035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- 172.21.15.37:0/442715035 >> 172.21.15.37:0/442715035 conn(0x7f0a1c073090 msgr2=0x7f0a1c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- 172.21.15.37:0/442715035 shutdown_connections 2023-07-09T21:23:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- 172.21.15.37:0/442715035 wait complete. 2023-07-09T21:23:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 Processor -- start 2023-07-09T21:23:37.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.377+0000 7f0a22093640 1 -- start start 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c15a170 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c15a450 con 0x7f0a1c0ceb80 2023-07-09T21:23:37.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1c0cad10 con 0x7f0a1c0b7980 2023-07-09T21:23:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38280/0 (socket says 172.21.15.37:38280) 2023-07-09T21:23:37.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 -- 172.21.15.37:0/2326338764 learned_addr learned my addr 172.21.15.37:0/2326338764 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1affd640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1bfff640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 -- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 msgr2=0x7f0a1c0cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c0cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 -- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 msgr2=0x7f0a1c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 -- 172.21.15.37:0/2326338764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100094d0 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1affd640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1bfff640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a1b7fe640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e930 tx=0x7f0a0c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c009690 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00ca00 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00cd70 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1c0caff0 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a1c152b70 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a1c04d7d0 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.381+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0a0c013470 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.385+0000 7f0a03fff640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 0x7f0a08068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:37.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.385+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f0a0c0847a0 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.385+0000 7f0a1affd640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 0x7f0a08068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:37.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.385+0000 7f0a1affd640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 0x7f0a08068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c08ad30 tx=0x7f0a100a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:37.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.389+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a0c051d20 con 0x7f0a1c0b3c20 2023-07-09T21:23:37.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:37.573+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0a1c0b1600 con 0x7f0a1c0b3c20 2023-07-09T21:23:38.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.209+0000 7f0a03fff640 1 -- 172.21.15.37:0/2326338764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0a0c055340 con 0x7f0a1c0b3c20 2023-07-09T21:23:38.211 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2023-07-09T21:23:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 msgr2=0x7f0a08068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 0x7f0a08068730 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c08ad30 tx=0x7f0a100a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 msgr2=0x7f0a1c152630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00e930 tx=0x7f0a0c00edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 shutdown_connections 2023-07-09T21:23:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f0a08066280 0x7f0a08068730 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a1c0ceb80 0x7f0a1c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a1c0b7980 0x7f0a1c0cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 --2- 172.21.15.37:0/2326338764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a1c0b3c20 0x7f0a1c152630 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.217+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 >> 172.21.15.37:0/2326338764 conn(0x7f0a1c073090 msgr2=0x7f0a1c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.221+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 shutdown_connections 2023-07-09T21:23:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.221+0000 7f0a22093640 1 -- 172.21.15.37:0/2326338764 wait complete. 2023-07-09T21:23:38.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 Processor -- start 2023-07-09T21:23:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 -- start start 2023-07-09T21:23:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9c240b7810 0x7f9c2415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c240ccd40 con 0x7f9c2406a450 2023-07-09T21:23:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c241602d0 con 0x7f9c240ce1a0 2023-07-09T21:23:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c28b87640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c240cc5a0 con 0x7f9c240b7810 2023-07-09T21:23:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c237fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9c240b7810 0x7f9c2415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c23fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9c2406a450 0x7f9c240cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49406/0 (socket says 172.21.15.37:49406) 2023-07-09T21:23:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c23fff640 1 -- 172.21.15.37:0/1472717468 learned_addr learned my addr 172.21.15.37:0/1472717468 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c237fe640 1 -- 172.21.15.37:0/1472717468 >> v1:172.21.15.119:6789/0 conn(0x7f9c240ce1a0 legacy=0x7f9c24069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c237fe640 1 -- 172.21.15.37:0/1472717468 >> v1:172.21.15.37:6789/0 conn(0x7f9c2406a450 legacy=0x7f9c240cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c237fe640 1 -- 172.21.15.37:0/1472717468 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c240ce680 con 0x7f9c240b7810 2023-07-09T21:23:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.385+0000 7f9c227fc640 1 -- 172.21.15.37:0/1472717468 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310077064 0 0) 0x7f9c240ccd40 con 0x7f9c2406a450 2023-07-09T21:23:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c237fe640 1 --2- 172.21.15.37:0/1472717468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c240b7810 0x7f9c2415fd90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097c0 tx=0x7f9c1401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43637e64647100a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c227fc640 1 -- 172.21.15.37:0/1472717468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140ab650 con 0x7f9c240b7810 2023-07-09T21:23:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c227fc640 1 -- 172.21.15.37:0/1472717468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140ab7b0 con 0x7f9c240b7810 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c227fc640 1 -- 172.21.15.37:0/1472717468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140abb40 con 0x7f9c240b7810 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 -- 172.21.15.37:0/1472717468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c240b7810 msgr2=0x7f9c2415fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 --2- 172.21.15.37:0/1472717468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c240b7810 0x7f9c2415fd90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097c0 tx=0x7f9c1401c450 comp rx=0 tx=0).stop 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 -- 172.21.15.37:0/1472717468 shutdown_connections 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 --2- 172.21.15.37:0/1472717468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c240b7810 0x7f9c2415fd90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 -- 172.21.15.37:0/1472717468 >> 172.21.15.37:0/1472717468 conn(0x7f9c240cea60 msgr2=0x7f9c240cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 -- 172.21.15.37:0/1472717468 shutdown_connections 2023-07-09T21:23:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 -- 172.21.15.37:0/1472717468 wait complete. 2023-07-09T21:23:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.389+0000 7f9c28b87640 1 Processor -- start 2023-07-09T21:23:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- start start 2023-07-09T21:23:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c240b7810 0x7f9c240ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 0x7f9c2414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c24155d40 con 0x7f9c2406a450 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c240cac40 con 0x7f9c240ce1a0 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c241556f0 con 0x7f9c240b7810 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38290/0 (socket says 172.21.15.37:38290) 2023-07-09T21:23:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 -- 172.21.15.37:0/3408770285 learned_addr learned my addr 172.21.15.37:0/3408770285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c22ffd640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c240b7810 0x7f9c240ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c23fff640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 0x7f9c2414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 -- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c240b7810 msgr2=0x7f9c240ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c240b7810 0x7f9c240ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 -- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 msgr2=0x7f9c2414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 0x7f9c2414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 -- 172.21.15.37:0/3408770285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14009420 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c23fff640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 0x7f9c2414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c237fe640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097c0 tx=0x7f9c1401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14004220 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c140b9070 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c140ab630 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c241559d0 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c240ca930 con 0x7f9c2406a450 2023-07-09T21:23:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.393+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2404e020 con 0x7f9c2406a450 2023-07-09T21:23:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.397+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9c140b4610 con 0x7f9c2406a450 2023-07-09T21:23:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.397+0000 7f9c0bfff640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 0x7f9c10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.397+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9c140bb070 con 0x7f9c2406a450 2023-07-09T21:23:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.397+0000 7f9c22ffd640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 0x7f9c10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.397+0000 7f9c22ffd640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 0x7f9c10068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c2415b460 tx=0x7f9c18009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.401+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c140ec260 con 0x7f9c2406a450 2023-07-09T21:23:38.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.557+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c2406bfa0 con 0x7f9c2406a450 2023-07-09T21:23:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.557+0000 7f9c0bfff640 1 -- 172.21.15.37:0/3408770285 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f9c140c4070 con 0x7f9c2406a450 2023-07-09T21:23:38.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:38.561 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:37.575909+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 msgr2=0x7f9c10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 0x7f9c10068730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9c2415b460 tx=0x7f9c18009040 comp rx=0 tx=0).stop 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 msgr2=0x7f9c240c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097c0 tx=0x7f9c1401ac90 comp rx=0 tx=0).stop 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 shutdown_connections 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f9c10066280 0x7f9c10068730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c240ce1a0 0x7f9c2414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c240b7810 0x7f9c240ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 --2- 172.21.15.37:0/3408770285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c2406a450 0x7f9c240c9e50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 >> 172.21.15.37:0/3408770285 conn(0x7f9c240cea60 msgr2=0x7f9c240cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 shutdown_connections 2023-07-09T21:23:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.561+0000 7f9c28b87640 1 -- 172.21.15.37:0/3408770285 wait complete. 2023-07-09T21:23:38.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.721+0000 7f7cee8ec640 1 Processor -- start 2023-07-09T21:23:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.721+0000 7f7cee8ec640 1 -- start start 2023-07-09T21:23:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7cee8ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ce80b7ab0 0x7f7ce806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7cee8ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80b49f0 con 0x7f7ce80b4340 2023-07-09T21:23:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7cee8ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ce80cc8a0 con 0x7f7ce80cef80 2023-07-09T21:23:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7cee8ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ce80b7e80 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ce80b7ab0 0x7f7ce806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ce80b7ab0 0x7f7ce806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38294/0 (socket says 172.21.15.37:38294) 2023-07-09T21:23:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 -- 172.21.15.37:0/61061331 learned_addr learned my addr 172.21.15.37:0/61061331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:38.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 -- 172.21.15.37:0/61061331 >> v1:172.21.15.119:6789/0 conn(0x7f7ce80cef80 legacy=0x7f7ce80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 -- 172.21.15.37:0/61061331 >> v1:172.21.15.37:6789/0 conn(0x7f7ce80b4340 legacy=0x7f7ce80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.725+0000 7f7ce7fff640 1 -- 172.21.15.37:0/61061331 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce80ccb80 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7ce7fff640 1 --2- 172.21.15.37:0/61061331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce806aa50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009870 tx=0x7f7cd801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9186445f45cf02ec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7ce6ffd640 1 -- 172.21.15.37:0/61061331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80aa430 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7ce6ffd640 1 -- 172.21.15.37:0/61061331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80aa590 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7ce6ffd640 1 -- 172.21.15.37:0/61061331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80aa920 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- 172.21.15.37:0/61061331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b7ab0 msgr2=0x7f7ce806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/61061331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce806aa50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009870 tx=0x7f7cd801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- 172.21.15.37:0/61061331 shutdown_connections 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/61061331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce806aa50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- 172.21.15.37:0/61061331 >> 172.21.15.37:0/61061331 conn(0x7f7ce8073090 msgr2=0x7f7ce8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- 172.21.15.37:0/61061331 shutdown_connections 2023-07-09T21:23:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- 172.21.15.37:0/61061331 wait complete. 2023-07-09T21:23:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 Processor -- start 2023-07-09T21:23:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- start start 2023-07-09T21:23:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce81535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ce80cef80 0x7f7ce80ca750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce81f8820 con 0x7f7ce80b4340 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80c8b50 con 0x7f7ce80b7ab0 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.729+0000 7f7cee8ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ce80c82b0 con 0x7f7ce80cef80 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38296/0 (socket says 172.21.15.37:38296) 2023-07-09T21:23:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 -- 172.21.15.37:0/2373910159 learned_addr learned my addr 172.21.15.37:0/2373910159 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7cece89640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ce80cef80 0x7f7ce80ca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce77fe640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce81535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 -- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ce80cef80 msgr2=0x7f7ce80ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ce80cef80 0x7f7ce80ca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 -- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ce80b7ab0 msgr2=0x7f7ce81535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce81535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 -- 172.21.15.37:0/2373910159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80094d0 con 0x7f7ce80b4340 2023-07-09T21:23:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce7fff640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80ac040 tx=0x7f7cd801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80b38c0 con 0x7f7ce80b4340 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd80b3a40 con 0x7f7ce80b4340 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ce80c8590 con 0x7f7ce80b4340 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd80b3df0 con 0x7f7ce80b4340 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ce81f8a10 con 0x7f7ce80b4340 2023-07-09T21:23:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ce80cc200 con 0x7f7ce80b4340 2023-07-09T21:23:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7cd80b2380 con 0x7f7ce80b4340 2023-07-09T21:23:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 0x7f7cd4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.733+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cd811e310 con 0x7f7ce80b4340 2023-07-09T21:23:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.737+0000 7f7ce77fe640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 0x7f7cd4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.737+0000 7f7ce77fe640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 0x7f7cd4068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80c81e0 tx=0x7f7cdc009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.737+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7cd80eb8d0 con 0x7f7ce80b4340 2023-07-09T21:23:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ce804d7d0 con 0x7f7ce80b4340 2023-07-09T21:23:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7ce4ff9640 1 -- 172.21.15.37:0/2373910159 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f7cd80eeef0 con 0x7f7ce80b4340 2023-07-09T21:23:38.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:38.900 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":36,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:37.575909+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 msgr2=0x7f7cd4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 0x7f7cd4068730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80c81e0 tx=0x7f7cdc009040 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 msgr2=0x7f7ce80c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7cd80ac040 tx=0x7f7cd801ad10 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 shutdown_connections 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f7cd4066280 0x7f7cd4068730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ce80cef80 0x7f7ce80ca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ce80b7ab0 0x7f7ce81535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 --2- 172.21.15.37:0/2373910159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ce80b4340 0x7f7ce80c7ca0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:38.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.897+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 >> 172.21.15.37:0/2373910159 conn(0x7f7ce8073090 msgr2=0x7f7ce80b6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.901+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 shutdown_connections 2023-07-09T21:23:38.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:38.901+0000 7f7cee8ec640 1 -- 172.21.15.37:0/2373910159 wait complete. 2023-07-09T21:23:38.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:23:39.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 Processor -- start 2023-07-09T21:23:39.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 -- start start 2023-07-09T21:23:39.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca540ceb80 0x7fca540cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca5415bf80 con 0x7fca540b3c20 2023-07-09T21:23:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca540cd070 con 0x7fca540ceb80 2023-07-09T21:23:39.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca5ba48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540cfd70 con 0x7fca540b7980 2023-07-09T21:23:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca58fe3640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fca540ceb80 0x7fca540cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:35684/0 (socket says 172.21.15.37:35684) 2023-07-09T21:23:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 -- 172.21.15.37:0/142103689 learned_addr learned my addr 172.21.15.37:0/142103689 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 -- 172.21.15.37:0/142103689 >> v2:172.21.15.119:3300/0 conn(0x7fca540ceb80 msgr2=0x7fca540cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 --2- 172.21.15.37:0/142103689 >> v2:172.21.15.119:3300/0 conn(0x7fca540ceb80 0x7fca540cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 -- 172.21.15.37:0/142103689 >> v1:172.21.15.119:6789/0 conn(0x7fca540b3c20 legacy=0x7fca540b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.065+0000 7fca597e4640 1 -- 172.21.15.37:0/142103689 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54160570 con 0x7fca540b7980 2023-07-09T21:23:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca597e4640 1 --2- 172.21.15.37:0/142103689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca50009870 tx=0x7fca5001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b74cae9b3bcebf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca4bfff640 1 -- 172.21.15.37:0/142103689 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500ab600 con 0x7fca540b7980 2023-07-09T21:23:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca4bfff640 1 -- 172.21.15.37:0/142103689 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca500a7050 con 0x7fca540b7980 2023-07-09T21:23:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca4bfff640 1 -- 172.21.15.37:0/142103689 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca500ab980 con 0x7fca540b7980 2023-07-09T21:23:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 -- 172.21.15.37:0/142103689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 msgr2=0x7fca54160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 --2- 172.21.15.37:0/142103689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fca50009870 tx=0x7fca5001c540 comp rx=0 tx=0).stop 2023-07-09T21:23:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 -- 172.21.15.37:0/142103689 shutdown_connections 2023-07-09T21:23:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 --2- 172.21.15.37:0/142103689 >> v2:172.21.15.119:3300/0 conn(0x7fca540ceb80 0x7fca540cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 --2- 172.21.15.37:0/142103689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca54160030 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 -- 172.21.15.37:0/142103689 >> 172.21.15.37:0/142103689 conn(0x7fca54073090 msgr2=0x7fca54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 -- 172.21.15.37:0/142103689 shutdown_connections 2023-07-09T21:23:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.069+0000 7fca5ba48640 1 -- 172.21.15.37:0/142103689 wait complete. 2023-07-09T21:23:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 Processor -- start 2023-07-09T21:23:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- start start 2023-07-09T21:23:39.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca540b3c20 0x7fca54152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca540cab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540c9310 con 0x7fca540ceb80 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540cb610 con 0x7fca540b3c20 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca540cb8f0 con 0x7fca540b7980 2023-07-09T21:23:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca58fe3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca540cab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38314/0 (socket says 172.21.15.37:38314) 2023-07-09T21:23:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 -- 172.21.15.37:0/2053729841 learned_addr learned my addr 172.21.15.37:0/2053729841 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:39.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca597e4640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca540b3c20 0x7fca54152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 -- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 msgr2=0x7fca540cab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca540cab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:39.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 -- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca540b3c20 msgr2=0x7fca54152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca540b3c20 0x7fca54152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 -- 172.21.15.37:0/2053729841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca500094d0 con 0x7fca540ceb80 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca59fe5640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00c730 tx=0x7fca4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c003b80 con 0x7fca540ceb80 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c003ce0 con 0x7fca540ceb80 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c00aa30 con 0x7fca540ceb80 2023-07-09T21:23:39.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca540cbbd0 con 0x7fca540ceb80 2023-07-09T21:23:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.073+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca540cbeb0 con 0x7fca540ceb80 2023-07-09T21:23:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5404d7d0 con 0x7fca540ceb80 2023-07-09T21:23:39.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fca4c00ab90 con 0x7fca540ceb80 2023-07-09T21:23:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca49ffb640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 0x7fca38068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fca4c083950 con 0x7fca540ceb80 2023-07-09T21:23:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca597e4640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 0x7fca38068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:39.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.077+0000 7fca597e4640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 0x7fca38068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca5408ad30 tx=0x7fca50008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:39.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.081+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fca4c050d60 con 0x7fca540ceb80 2023-07-09T21:23:39.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:39.269+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fca5415bf60 con 0x7fca540ceb80 2023-07-09T21:23:40.158 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-09T21:23:40.157+0000 7f4d9440c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:23:40.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.221+0000 7fca49ffb640 1 -- 172.21.15.37:0/2053729841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fca4c054380 con 0x7fca540ceb80 2023-07-09T21:23:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 msgr2=0x7fca38068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 0x7fca38068730 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fca5408ad30 tx=0x7fca50008040 comp rx=0 tx=0).stop 2023-07-09T21:23:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 msgr2=0x7fca54154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fca4c00c730 tx=0x7fca4c00cbf0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 shutdown_connections 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fca38066280 0x7fca38068730 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fca540ceb80 0x7fca54154f80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fca540b7980 0x7fca540cab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 --2- 172.21.15.37:0/2053729841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fca540b3c20 0x7fca54152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 >> 172.21.15.37:0/2053729841 conn(0x7fca54073090 msgr2=0x7fca540b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 shutdown_connections 2023-07-09T21:23:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.225+0000 7fca5ba48640 1 -- 172.21.15.37:0/2053729841 wait complete. 2023-07-09T21:23:40.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:23:40.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:23:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 Processor -- start 2023-07-09T21:23:40.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 -- start start 2023-07-09T21:23:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f32dc0b7980 0x7f32dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32dc0d0780 0x7f32dc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32dc15bf80 con 0x7f32dc0ceb80 2023-07-09T21:23:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc0cd070 con 0x7f32dc0d0780 2023-07-09T21:23:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e2374640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32dc0cfd70 con 0x7f32dc0b7980 2023-07-09T21:23:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32dc0d0780 0x7f32dc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f32dc0d0780 0x7f32dc0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38316/0 (socket says 172.21.15.37:38316) 2023-07-09T21:23:40.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 -- 172.21.15.37:0/3510452802 learned_addr learned my addr 172.21.15.37:0/3510452802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32dbfff640 1 --2- 172.21.15.37:0/3510452802 >> v2:172.21.15.119:3300/0 conn(0x7f32dc0b7980 0x7f32dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 -- 172.21.15.37:0/3510452802 >> v2:172.21.15.119:3300/0 conn(0x7f32dc0b7980 msgr2=0x7f32dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 --2- 172.21.15.37:0/3510452802 >> v2:172.21.15.119:3300/0 conn(0x7f32dc0b7980 0x7f32dc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 -- 172.21.15.37:0/3510452802 >> v1:172.21.15.119:6789/0 conn(0x7f32dc0ceb80 legacy=0x7f32dc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.401+0000 7f32e0911640 1 -- 172.21.15.37:0/3510452802 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32dc160570 con 0x7f32dc0d0780 2023-07-09T21:23:40.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e0911640 1 --2- 172.21.15.37:0/3510452802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0d0b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f32dc069aa0 tx=0x7f32d401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c4e8e2a61b031a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32daffd640 1 -- 172.21.15.37:0/3510452802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a5690 con 0x7f32dc0d0780 2023-07-09T21:23:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32daffd640 1 -- 172.21.15.37:0/3510452802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d40a57f0 con 0x7f32dc0d0780 2023-07-09T21:23:40.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32daffd640 1 -- 172.21.15.37:0/3510452802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40a5b80 con 0x7f32dc0d0780 2023-07-09T21:23:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 -- 172.21.15.37:0/3510452802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 msgr2=0x7f32dc0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 --2- 172.21.15.37:0/3510452802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0d0b80 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f32dc069aa0 tx=0x7f32d401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 -- 172.21.15.37:0/3510452802 shutdown_connections 2023-07-09T21:23:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 --2- 172.21.15.37:0/3510452802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0d0b80 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 --2- 172.21.15.37:0/3510452802 >> v2:172.21.15.119:3300/0 conn(0x7f32dc0b7980 0x7f32dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 -- 172.21.15.37:0/3510452802 >> 172.21.15.37:0/3510452802 conn(0x7f32dc073090 msgr2=0x7f32dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:40.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 -- 172.21.15.37:0/3510452802 shutdown_connections 2023-07-09T21:23:40.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.405+0000 7f32e2374640 1 -- 172.21.15.37:0/3510452802 wait complete. 2023-07-09T21:23:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 Processor -- start 2023-07-09T21:23:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- start start 2023-07-09T21:23:40.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 0x7f32dc0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32dc0ceb80 0x7f32dc151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc0c8ad0 con 0x7f32dc0d0780 2023-07-09T21:23:40.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc154e00 con 0x7f32dc0b7980 2023-07-09T21:23:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32dc159e70 con 0x7f32dc0ceb80 2023-07-09T21:23:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:40.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38330/0 (socket says 172.21.15.37:38330) 2023-07-09T21:23:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 -- 172.21.15.37:0/989613306 learned_addr learned my addr 172.21.15.37:0/989613306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32dbfff640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 0x7f32dc0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 -- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32dc0ceb80 msgr2=0x7f32dc151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32dc0ceb80 0x7f32dc151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 -- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 msgr2=0x7f32dc0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 0x7f32dc0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 -- 172.21.15.37:0/989613306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d4009b30 con 0x7f32dc0d0780 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32dbfff640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 0x7f32dc0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e0911640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f32d40af040 tx=0x7f32d4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40b8880 con 0x7f32dc0d0780 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d40b89e0 con 0x7f32dc0d0780 2023-07-09T21:23:40.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d40b8d90 con 0x7f32dc0d0780 2023-07-09T21:23:40.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32dc154b20 con 0x7f32dc0d0780 2023-07-09T21:23:40.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.409+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32dc159b00 con 0x7f32dc0d0780 2023-07-09T21:23:40.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32dc0ce800 con 0x7f32dc0d0780 2023-07-09T21:23:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f32d40b6440 con 0x7f32dc0d0780 2023-07-09T21:23:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32d8ff9640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 0x7f32c8068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f32d411f2f0 con 0x7f32dc0d0780 2023-07-09T21:23:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32dbfff640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 0x7f32c8068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:40.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.413+0000 7f32dbfff640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 0x7f32c8068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b6710 tx=0x7f32cc008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:40.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.417+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f32d40ec850 con 0x7f32dc0d0780 2023-07-09T21:23:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:40.605+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f32dc160570 con 0x7f32dc0d0780 2023-07-09T21:23:41.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32d8ff9640 1 -- 172.21.15.37:0/989613306 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f32dc160570 con 0x7f32dc0d0780 2023-07-09T21:23:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 msgr2=0x7f32c8068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 0x7f32c8068730 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f32dc0b6710 tx=0x7f32cc008040 comp rx=0 tx=0).stop 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 msgr2=0x7f32dc0c6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f32d40af040 tx=0x7f32d4019770 comp rx=0 tx=0).stop 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 shutdown_connections 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f32c8066280 0x7f32c8068730 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32dc0d0780 0x7f32dc0c6690 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f32dc0ceb80 0x7f32dc151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 --2- 172.21.15.37:0/989613306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f32dc0b7980 0x7f32dc0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 >> 172.21.15.37:0/989613306 conn(0x7f32dc073090 msgr2=0x7f32dc0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 shutdown_connections 2023-07-09T21:23:41.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.233+0000 7f32e2374640 1 -- 172.21.15.37:0/989613306 wait complete. 2023-07-09T21:23:41.258 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:23:41.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 Processor -- start 2023-07-09T21:23:41.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 -- start start 2023-07-09T21:23:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6f2415bbf0 0x7f6f240d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 0x7f6f240ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f240d1380 con 0x7f6f240b1650 2023-07-09T21:23:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f240b13e0 con 0x7f6f2415bbf0 2023-07-09T21:23:41.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f28a5b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2402bbe0 con 0x7f6f2406bc30 2023-07-09T21:23:41.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 0x7f6f240ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f237fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6f2415bbf0 0x7f6f240d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 0x7f6f240ce9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:35704/0 (socket says 172.21.15.37:35704) 2023-07-09T21:23:41.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f22ffd640 1 -- 172.21.15.37:0/872895699 learned_addr learned my addr 172.21.15.37:0/872895699 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:41.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f237fe640 1 -- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 msgr2=0x7f6f240ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:41.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f237fe640 1 --2- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 0x7f6f240ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f237fe640 1 -- 172.21.15.37:0/872895699 >> v1:172.21.15.119:6789/0 conn(0x7f6f240b1650 legacy=0x7f6f240cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.405+0000 7f6f237fe640 1 -- 172.21.15.37:0/872895699 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240b1100 con 0x7f6f2415bbf0 2023-07-09T21:23:41.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f237fe640 1 --2- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f2415bbf0 0x7f6f240d1810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097f0 tx=0x7f6f1401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fed297826c6b6abe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f227fc640 1 -- 172.21.15.37:0/872895699 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140ad660 con 0x7f6f2415bbf0 2023-07-09T21:23:41.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f227fc640 1 -- 172.21.15.37:0/872895699 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140ad7c0 con 0x7f6f2415bbf0 2023-07-09T21:23:41.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f227fc640 1 -- 172.21.15.37:0/872895699 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140adb50 con 0x7f6f2415bbf0 2023-07-09T21:23:41.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 -- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f2415bbf0 msgr2=0x7f6f240d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f2415bbf0 0x7f6f240d1810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6f140097f0 tx=0x7f6f1401c450 comp rx=0 tx=0).stop 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 -- 172.21.15.37:0/872895699 shutdown_connections 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2406bc30 0x7f6f240ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/872895699 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f2415bbf0 0x7f6f240d1810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 -- 172.21.15.37:0/872895699 >> 172.21.15.37:0/872895699 conn(0x7f6f2402b640 msgr2=0x7f6f240d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 -- 172.21.15.37:0/872895699 shutdown_connections 2023-07-09T21:23:41.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.409+0000 7f6f28a5b640 1 -- 172.21.15.37:0/872895699 wait complete. 2023-07-09T21:23:41.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 Processor -- start 2023-07-09T21:23:41.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- start start 2023-07-09T21:23:41.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 0x7f6f240b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2415bbf0 0x7f6f24152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2415c500 con 0x7f6f2406bc30 2023-07-09T21:23:41.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2415d300 con 0x7f6f240b1650 2023-07-09T21:23:41.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2415c6f0 con 0x7f6f2415bbf0 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 0x7f6f240b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f23fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2415bbf0 0x7f6f24152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:59264/0 (socket says 172.21.15.37:59264) 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 -- 172.21.15.37:0/755746338 learned_addr learned my addr 172.21.15.37:0/755746338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:41.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 -- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2415bbf0 msgr2=0x7f6f24152780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2415bbf0 0x7f6f24152780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 -- 172.21.15.37:0/755746338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 msgr2=0x7f6f240b4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 0x7f6f240b4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 -- 172.21.15.37:0/755746338 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f14009420 con 0x7f6f240b1650 2023-07-09T21:23:41.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f237fe640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 0x7f6f240b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f22ffd640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800e820 tx=0x7f6f1800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18009580 con 0x7f6f240b1650 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800c940 con 0x7f6f240b1650 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800ccf0 con 0x7f6f240b1650 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2415c9d0 con 0x7f6f240b1650 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.413+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f2415cf90 con 0x7f6f240b1650 2023-07-09T21:23:41.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f2406b020 con 0x7f6f240b1650 2023-07-09T21:23:41.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f18013470 con 0x7f6f240b1650 2023-07-09T21:23:41.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f0bfff640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 0x7f6f10068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f18083e30 con 0x7f6f240b1650 2023-07-09T21:23:41.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f237fe640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 0x7f6f10068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.417+0000 7f6f237fe640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 0x7f6f10068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f140af000 tx=0x7f6f140a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.421+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f18051230 con 0x7f6f240b1650 2023-07-09T21:23:41.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.609+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f2404e020 con 0x7f6f240b1650 2023-07-09T21:23:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.609+0000 7f6f0bfff640 1 -- 172.21.15.37:0/755746338 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f6f18021090 con 0x7f6f240b1650 2023-07-09T21:23:41.612 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:41.613 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:23:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:23:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 msgr2=0x7f6f10068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 0x7f6f10068730 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6f140af000 tx=0x7f6f140a7000 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 msgr2=0x7f6f2415bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6f1800e820 tx=0x7f6f1800ece0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 shutdown_connections 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f6f10066280 0x7f6f10068730 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f2415bbf0 0x7f6f24152780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f240b1650 0x7f6f2415bfc0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 --2- 172.21.15.37:0/755746338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f2406bc30 0x7f6f240b4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 >> 172.21.15.37:0/755746338 conn(0x7f6f2402b640 msgr2=0x7f6f241591b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 shutdown_connections 2023-07-09T21:23:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.613+0000 7f6f28a5b640 1 -- 172.21.15.37:0/755746338 wait complete. 2023-07-09T21:23:41.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:23:41.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 Processor -- start 2023-07-09T21:23:41.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 -- start start 2023-07-09T21:23:41.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85bc0b4340 0x7f85bc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0b49f0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85bc0cc8a0 con 0x7f85bc0cef80 2023-07-09T21:23:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85c1d82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85bc0b7e80 con 0x7f85bc0b4340 2023-07-09T21:23:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85bb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85bc0b7ab0 0x7f85bc0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49416/0 (socket says 172.21.15.37:49416) 2023-07-09T21:23:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85bb7fe640 1 -- 172.21.15.37:0/2124729071 learned_addr learned my addr 172.21.15.37:0/2124729071 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:41.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85baffd640 1 --2- 172.21.15.37:0/2124729071 >> v2:172.21.15.37:3300/0 conn(0x7f85bc0b4340 0x7f85bc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85ba7fc640 1 -- 172.21.15.37:0/2124729071 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3180193237 0 0) 0x7f85bc0b49f0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85ba7fc640 1 -- 172.21.15.37:0/2124729071 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a4003530 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85baffd640 1 -- 172.21.15.37:0/2124729071 >> v1:172.21.15.119:6789/0 conn(0x7f85bc0cef80 legacy=0x7f85bc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85baffd640 1 -- 172.21.15.37:0/2124729071 >> v1:172.21.15.37:6789/0 conn(0x7f85bc0b7ab0 legacy=0x7f85bc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.773+0000 7f85baffd640 1 -- 172.21.15.37:0/2124729071 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc0ccb80 con 0x7f85bc0b4340 2023-07-09T21:23:41.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85baffd640 1 --2- 172.21.15.37:0/2124729071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b4340 0x7f85bc06aa50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faafbf6665c29a68 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85ba7fc640 1 -- 172.21.15.37:0/2124729071 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00ab650 con 0x7f85bc0b4340 2023-07-09T21:23:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85ba7fc640 1 -- 172.21.15.37:0/2124729071 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00ab7b0 con 0x7f85bc0b4340 2023-07-09T21:23:41.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85ba7fc640 1 -- 172.21.15.37:0/2124729071 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00abb20 con 0x7f85bc0b4340 2023-07-09T21:23:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 -- 172.21.15.37:0/2124729071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b4340 msgr2=0x7f85bc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 --2- 172.21.15.37:0/2124729071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b4340 0x7f85bc06aa50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001c450 comp rx=0 tx=0).stop 2023-07-09T21:23:41.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 -- 172.21.15.37:0/2124729071 shutdown_connections 2023-07-09T21:23:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 --2- 172.21.15.37:0/2124729071 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b4340 0x7f85bc06aa50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 -- 172.21.15.37:0/2124729071 >> 172.21.15.37:0/2124729071 conn(0x7f85bc073090 msgr2=0x7f85bc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 -- 172.21.15.37:0/2124729071 shutdown_connections 2023-07-09T21:23:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.777+0000 7f85c1d82640 1 -- 172.21.15.37:0/2124729071 wait complete. 2023-07-09T21:23:41.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 Processor -- start 2023-07-09T21:23:41.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- start start 2023-07-09T21:23:41.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc0b4340 0x7f85bc0c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85bc0cef80 0x7f85bc150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc1559a0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc155c80 con 0x7f85bc0b4340 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc155f60 con 0x7f85bc0cef80 2023-07-09T21:23:41.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38354/0 (socket says 172.21.15.37:38354) 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 -- 172.21.15.37:0/3680905973 learned_addr learned my addr 172.21.15.37:0/3680905973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85bb7fe640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc0b4340 0x7f85bc0c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85bbfff640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85bc0cef80 0x7f85bc150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 -- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85bc0cef80 msgr2=0x7f85bc150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85bc0cef80 0x7f85bc150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 -- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc0b4340 msgr2=0x7f85bc0c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc0b4340 0x7f85bc0c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 -- 172.21.15.37:0/3680905973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009420 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85baffd640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0004220 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b00b9070 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc156240 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0003620 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.781+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc14fa90 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc04d7d0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f85b0003780 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85a3fff640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 0x7f85a8068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:41.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85b00bb070 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85bb7fe640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 0x7f85a8068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:41.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.785+0000 7f85bb7fe640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 0x7f85a8068760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0011f0 tx=0x7f85ac007d40 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:41.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.789+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85b00ebcc0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85bc1560a0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85a3fff640 1 -- 172.21.15.37:0/3680905973 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f85bc1560a0 con 0x7f85bc0b7ab0 2023-07-09T21:23:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:23:39.181346+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:23:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 msgr2=0x7f85a8068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 0x7f85a8068760 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f85ac0011f0 tx=0x7f85ac007d40 comp rx=0 tx=0).stop 2023-07-09T21:23:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 msgr2=0x7f85bc154fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f85b00097c0 tx=0x7f85b001ac90 comp rx=0 tx=0).stop 2023-07-09T21:23:41.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 shutdown_connections 2023-07-09T21:23:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f85a80662b0 0x7f85a8068760 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85bc0cef80 0x7f85bc150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85bc0b7ab0 0x7f85bc154fe0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 --2- 172.21.15.37:0/3680905973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85bc0b4340 0x7f85bc0c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:41.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 >> 172.21.15.37:0/3680905973 conn(0x7f85bc073090 msgr2=0x7f85bc157840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 shutdown_connections 2023-07-09T21:23:41.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:41.945+0000 7f85c1d82640 1 -- 172.21.15.37:0/3680905973 wait complete. 2023-07-09T21:23:41.969 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:23:41.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:23:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 Processor -- start 2023-07-09T21:23:42.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 -- start start 2023-07-09T21:23:42.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4fd80cef80 0x7f4fd80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd80b49f0 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80b7e80 con 0x7f4fd80cef80 2023-07-09T21:23:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdeb40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd80cc8a0 con 0x7f4fd80b4340 2023-07-09T21:23:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdc8dc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4fd80b7ab0 0x7f4fd80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49426/0 (socket says 172.21.15.37:49426) 2023-07-09T21:23:42.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.109+0000 7f4fdc8dc640 1 -- 172.21.15.37:0/3825988067 learned_addr learned my addr 172.21.15.37:0/3825988067 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 --2- 172.21.15.37:0/3825988067 >> v2:172.21.15.119:3300/0 conn(0x7f4fd80cef80 0x7f4fd80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fd7fff640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fd77fe640 1 -- 172.21.15.37:0/3825988067 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748097367 0 0) 0x7f4fd80b49f0 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fd77fe640 1 -- 172.21.15.37:0/3825988067 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4fc8003530 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 -- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 msgr2=0x7f4fd806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 -- 172.21.15.37:0/3825988067 >> v1:172.21.15.37:6789/0 conn(0x7f4fd80b7ab0 legacy=0x7f4fd80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 -- 172.21.15.37:0/3825988067 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80ccb80 con 0x7f4fd80cef80 2023-07-09T21:23:42.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.113+0000 7f4fdd0dd640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd80d02a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69624e1ac463d780 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd77fe640 1 -- 172.21.15.37:0/3825988067 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00a59e0 con 0x7f4fd80cef80 2023-07-09T21:23:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd77fe640 1 -- 172.21.15.37:0/3825988067 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd00a5b40 con 0x7f4fd80cef80 2023-07-09T21:23:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd77fe640 1 -- 172.21.15.37:0/3825988067 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd00ad440 con 0x7f4fd80cef80 2023-07-09T21:23:42.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 msgr2=0x7f4fd80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd80d02a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009d90 tx=0x7f4fd001c920 comp rx=0 tx=0).stop 2023-07-09T21:23:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- 172.21.15.37:0/3825988067 shutdown_connections 2023-07-09T21:23:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd80d02a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/3825988067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- 172.21.15.37:0/3825988067 >> 172.21.15.37:0/3825988067 conn(0x7f4fd8073090 msgr2=0x7f4fd8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- 172.21.15.37:0/3825988067 shutdown_connections 2023-07-09T21:23:42.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- 172.21.15.37:0/3825988067 wait complete. 2023-07-09T21:23:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 Processor -- start 2023-07-09T21:23:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- start start 2023-07-09T21:23:42.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd81f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd8158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81f8190 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8152dd0 con 0x7f4fd80cef80 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fdeb40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81f78f0 con 0x7f4fd80b4340 2023-07-09T21:23:42.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38360/0 (socket says 172.21.15.37:38360) 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.117+0000 7f4fd7fff640 1 -- 172.21.15.37:0/2222741777 learned_addr learned my addr 172.21.15.37:0/2222741777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 -- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 msgr2=0x7f4fd81f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd81f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 -- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 msgr2=0x7f4fd8158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd8158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 -- 172.21.15.37:0/2222741777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd0009a70 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd7fff640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e8d0 tx=0x7f4fc400ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400c940 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400caa0 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd81f7bd0 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc400ce10 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd8154610 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8154470 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4fc4013470 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 0x7f4fbc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4fc4083f40 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.121+0000 7f4fdc8dc640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 0x7f4fbc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.125+0000 7f4fdc8dc640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 0x7f4fbc068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007fd0 tx=0x7f4fcc007940 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.125+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fd8154470 con 0x7f4fd80b7ab0 2023-07-09T21:23:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.281+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fd80cf4d0 con 0x7f4fbc066280 2023-07-09T21:23:42.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.289+0000 7f4fd57fa640 1 -- 172.21.15.37:0/2222741777 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306014 (secure 0 0 0) 0x7f4fcc0058c0 con 0x7f4fbc066280 2023-07-09T21:23:42.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:42.296 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:23:42.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 msgr2=0x7f4fbc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 0x7f4fbc068730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc007fd0 tx=0x7f4fcc007940 comp rx=0 tx=0).stop 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 msgr2=0x7f4fd8152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400e8d0 tx=0x7f4fc400ed90 comp rx=0 tx=0).stop 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 shutdown_connections 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f4fbc066280 0x7f4fbc068730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fd80cef80 0x7f4fd8158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fd80b7ab0 0x7f4fd8152890 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 --2- 172.21.15.37:0/2222741777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fd80b4340 0x7f4fd81f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 >> 172.21.15.37:0/2222741777 conn(0x7f4fd8073090 msgr2=0x7f4fd8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 shutdown_connections 2023-07-09T21:23:42.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.293+0000 7f4fdeb40640 1 -- 172.21.15.37:0/2222741777 wait complete. 2023-07-09T21:23:42.315 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-09T21:23:41.969776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223964,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750756,"statfs":{"total":773094113280,"available":772864774144,"internally_reserved":0,"allocated":4354048,"data_stored":2466964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795332"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186531+0000","last_change":"2023-07-09T21:23:37.186531+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186531+0000","last_undegraded":"2023-07-09T21:23:37.186531+0000","last_fullsized":"2023-07-09T21:23:37.186531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188108+0000","last_change":"2023-07-09T21:23:37.188108+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188108+0000","last_undegraded":"2023-07-09T21:23:37.188108+0000","last_fullsized":"2023-07-09T21:23:37.188108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189333+0000","last_change":"2023-07-09T21:23:37.189333+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189333+0000","last_undegraded":"2023-07-09T21:23:37.189333+0000","last_fullsized":"2023-07-09T21:23:37.189333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184741+0000","last_change":"2023-07-09T21:23:37.184741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184741+0000","last_undegraded":"2023-07-09T21:23:37.184741+0000","last_fullsized":"2023-07-09T21:23:37.184741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184404+0000","last_change":"2023-07-09T21:23:37.184404+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184404+0000","last_undegraded":"2023-07-09T21:23:37.184404+0000","last_fullsized":"2023-07-09T21:23:37.184404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188406+0000","last_change":"2023-07-09T21:23:37.188406+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188406+0000","last_undegraded":"2023-07-09T21:23:37.188406+0000","last_fullsized":"2023-07-09T21:23:37.188406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192519+0000","last_change":"2023-07-09T21:23:37.192519+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192519+0000","last_undegraded":"2023-07-09T21:23:37.192519+0000","last_fullsized":"2023-07-09T21:23:37.192519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190274+0000","last_change":"2023-07-09T21:23:37.190274+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190274+0000","last_undegraded":"2023-07-09T21:23:37.190274+0000","last_fullsized":"2023-07-09T21:23:37.190274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190250+0000","last_change":"2023-07-09T21:23:37.190250+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190250+0000","last_undegraded":"2023-07-09T21:23:37.190250+0000","last_fullsized":"2023-07-09T21:23:37.190250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185430+0000","last_change":"2023-07-09T21:23:37.185430+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185430+0000","last_undegraded":"2023-07-09T21:23:37.185430+0000","last_fullsized":"2023-07-09T21:23:37.185430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187297+0000","last_change":"2023-07-09T21:23:37.187297+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187297+0000","last_undegraded":"2023-07-09T21:23:37.187297+0000","last_fullsized":"2023-07-09T21:23:37.187297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189875+0000","last_change":"2023-07-09T21:23:37.189875+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189875+0000","last_undegraded":"2023-07-09T21:23:37.189875+0000","last_fullsized":"2023-07-09T21:23:37.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184098+0000","last_change":"2023-07-09T21:23:37.184098+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184098+0000","last_undegraded":"2023-07-09T21:23:37.184098+0000","last_fullsized":"2023-07-09T21:23:37.184098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.196818+0000","last_change":"2023-07-09T21:23:37.196818+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.196818+0000","last_undegraded":"2023-07-09T21:23:37.196818+0000","last_fullsized":"2023-07-09T21:23:37.196818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192006+0000","last_change":"2023-07-09T21:23:37.192006+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192006+0000","last_undegraded":"2023-07-09T21:23:37.192006+0000","last_fullsized":"2023-07-09T21:23:37.192006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185805+0000","last_change":"2023-07-09T21:23:37.185805+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185805+0000","last_undegraded":"2023-07-09T21:23:37.185805+0000","last_fullsized":"2023-07-09T21:23:37.185805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187773+0000","last_change":"2023-07-09T21:23:37.187773+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187773+0000","last_undegraded":"2023-07-09T21:23:37.187773+0000","last_fullsized":"2023-07-09T21:23:37.187773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188178+0000","last_change":"2023-07-09T21:23:37.188178+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188178+0000","last_undegraded":"2023-07-09T21:23:37.188178+0000","last_fullsized":"2023-07-09T21:23:37.188178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184077+0000","last_change":"2023-07-09T21:23:37.184077+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184077+0000","last_undegraded":"2023-07-09T21:23:37.184077+0000","last_fullsized":"2023-07-09T21:23:37.184077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189143+0000","last_change":"2023-07-09T21:23:37.189143+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189143+0000","last_undegraded":"2023-07-09T21:23:37.189143+0000","last_fullsized":"2023-07-09T21:23:37.189143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189344+0000","last_change":"2023-07-09T21:23:37.189344+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189344+0000","last_undegraded":"2023-07-09T21:23:37.189344+0000","last_fullsized":"2023-07-09T21:23:37.189344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.193085+0000","last_change":"2023-07-09T21:23:37.193085+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.193085+0000","last_undegraded":"2023-07-09T21:23:37.193085+0000","last_fullsized":"2023-07-09T21:23:37.193085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185908+0000","last_change":"2023-07-09T21:23:37.185908+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185908+0000","last_undegraded":"2023-07-09T21:23:37.185908+0000","last_fullsized":"2023-07-09T21:23:37.185908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184589+0000","last_change":"2023-07-09T21:23:37.184589+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184589+0000","last_undegraded":"2023-07-09T21:23:37.184589+0000","last_fullsized":"2023-07-09T21:23:37.184589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191291+0000","last_change":"2023-07-09T21:23:37.191291+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191291+0000","last_undegraded":"2023-07-09T21:23:37.191291+0000","last_fullsized":"2023-07-09T21:23:37.191291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188013+0000","last_change":"2023-07-09T21:23:37.188013+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188013+0000","last_undegraded":"2023-07-09T21:23:37.188013+0000","last_fullsized":"2023-07-09T21:23:37.188013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188809+0000","last_change":"2023-07-09T21:23:37.188809+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188809+0000","last_undegraded":"2023-07-09T21:23:37.188809+0000","last_fullsized":"2023-07-09T21:23:37.188809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186390+0000","last_change":"2023-07-09T21:23:37.186390+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186390+0000","last_undegraded":"2023-07-09T21:23:37.186390+0000","last_fullsized":"2023-07-09T21:23:37.186390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187523+0000","last_change":"2023-07-09T21:23:37.187523+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187523+0000","last_undegraded":"2023-07-09T21:23:37.187523+0000","last_fullsized":"2023-07-09T21:23:37.187523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188243+0000","last_change":"2023-07-09T21:23:37.188243+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188243+0000","last_undegraded":"2023-07-09T21:23:37.188243+0000","last_fullsized":"2023-07-09T21:23:37.188243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185244+0000","last_change":"2023-07-09T21:23:37.185244+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185244+0000","last_undegraded":"2023-07-09T21:23:37.185244+0000","last_fullsized":"2023-07-09T21:23:37.185244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188732+0000","last_change":"2023-07-09T21:23:37.188732+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188732+0000","last_undegraded":"2023-07-09T21:23:37.188732+0000","last_fullsized":"2023-07-09T21:23:37.188732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188141+0000","last_change":"2023-07-09T21:23:37.188141+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188141+0000","last_undegraded":"2023-07-09T21:23:37.188141+0000","last_fullsized":"2023-07-09T21:23:37.188141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208541+0000","last_change":"2023-07-09T21:23:37.205856+0000","last_active":"2023-07-09T21:23:37.208541+0000","last_peered":"2023-07-09T21:23:37.208541+0000","last_clean":"2023-07-09T21:23:37.208541+0000","last_became_active":"2023-07-09T21:23:37.205568+0000","last_became_peered":"2023-07-09T21:23:37.205568+0000","last_unstale":"2023-07-09T21:23:37.208541+0000","last_undegraded":"2023-07-09T21:23:37.208541+0000","last_fullsized":"2023-07-09T21:23:37.208541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:25.111293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189520+0000","last_change":"2023-07-09T21:23:37.189520+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189520+0000","last_undegraded":"2023-07-09T21:23:37.189520+0000","last_fullsized":"2023-07-09T21:23:37.189520+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203658+0000","last_change":"2023-07-09T21:23:37.200996+0000","last_active":"2023-07-09T21:23:37.203658+0000","last_peered":"2023-07-09T21:23:37.203658+0000","last_clean":"2023-07-09T21:23:37.203658+0000","last_became_active":"2023-07-09T21:23:37.200647+0000","last_became_peered":"2023-07-09T21:23:37.200647+0000","last_unstale":"2023-07-09T21:23:37.203658+0000","last_undegraded":"2023-07-09T21:23:37.203658+0000","last_fullsized":"2023-07-09T21:23:37.203658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:37.644270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195040+0000","last_change":"2023-07-09T21:23:37.195040+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195040+0000","last_undegraded":"2023-07-09T21:23:37.195040+0000","last_fullsized":"2023-07-09T21:23:37.195040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205065+0000","last_change":"2023-07-09T21:23:37.203576+0000","last_active":"2023-07-09T21:23:37.205065+0000","last_peered":"2023-07-09T21:23:37.205065+0000","last_clean":"2023-07-09T21:23:37.205065+0000","last_became_active":"2023-07-09T21:23:37.203281+0000","last_became_peered":"2023-07-09T21:23:37.203281+0000","last_unstale":"2023-07-09T21:23:37.205065+0000","last_undegraded":"2023-07-09T21:23:37.205065+0000","last_fullsized":"2023-07-09T21:23:37.205065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185936+0000","last_change":"2023-07-09T21:23:37.185936+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185936+0000","last_undegraded":"2023-07-09T21:23:37.185936+0000","last_fullsized":"2023-07-09T21:23:37.185936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205402+0000","last_change":"2023-07-09T21:23:37.199060+0000","last_active":"2023-07-09T21:23:37.205402+0000","last_peered":"2023-07-09T21:23:37.205402+0000","last_clean":"2023-07-09T21:23:37.205402+0000","last_became_active":"2023-07-09T21:23:37.198702+0000","last_became_peered":"2023-07-09T21:23:37.198702+0000","last_unstale":"2023-07-09T21:23:37.205402+0000","last_undegraded":"2023-07-09T21:23:37.205402+0000","last_fullsized":"2023-07-09T21:23:37.205402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190128+0000","last_change":"2023-07-09T21:23:37.190128+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190128+0000","last_undegraded":"2023-07-09T21:23:37.190128+0000","last_fullsized":"2023-07-09T21:23:37.190128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207953+0000","last_change":"2023-07-09T21:23:37.201618+0000","last_active":"2023-07-09T21:23:37.207953+0000","last_peered":"2023-07-09T21:23:37.207953+0000","last_clean":"2023-07-09T21:23:37.207953+0000","last_became_active":"2023-07-09T21:23:37.201315+0000","last_became_peered":"2023-07-09T21:23:37.201315+0000","last_unstale":"2023-07-09T21:23:37.207953+0000","last_undegraded":"2023-07-09T21:23:37.207953+0000","last_fullsized":"2023-07-09T21:23:37.207953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184189+0000","last_change":"2023-07-09T21:23:37.184189+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184189+0000","last_undegraded":"2023-07-09T21:23:37.184189+0000","last_fullsized":"2023-07-09T21:23:37.184189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208983+0000","last_change":"2023-07-09T21:23:37.205993+0000","last_active":"2023-07-09T21:23:37.208983+0000","last_peered":"2023-07-09T21:23:37.208983+0000","last_clean":"2023-07-09T21:23:37.208983+0000","last_became_active":"2023-07-09T21:23:37.205740+0000","last_became_peered":"2023-07-09T21:23:37.205740+0000","last_unstale":"2023-07-09T21:23:37.208983+0000","last_undegraded":"2023-07-09T21:23:37.208983+0000","last_fullsized":"2023-07-09T21:23:37.208983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:03.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194186+0000","last_change":"2023-07-09T21:23:37.194186+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194186+0000","last_undegraded":"2023-07-09T21:23:37.194186+0000","last_fullsized":"2023-07-09T21:23:37.194186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208824+0000","last_change":"2023-07-09T21:23:37.207663+0000","last_active":"2023-07-09T21:23:37.208824+0000","last_peered":"2023-07-09T21:23:37.208824+0000","last_clean":"2023-07-09T21:23:37.208824+0000","last_became_active":"2023-07-09T21:23:37.207389+0000","last_became_peered":"2023-07-09T21:23:37.207389+0000","last_unstale":"2023-07-09T21:23:37.208824+0000","last_undegraded":"2023-07-09T21:23:37.208824+0000","last_fullsized":"2023-07-09T21:23:37.208824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:56.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191820+0000","last_change":"2023-07-09T21:23:37.191820+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191820+0000","last_undegraded":"2023-07-09T21:23:37.191820+0000","last_fullsized":"2023-07-09T21:23:37.191820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205449+0000","last_change":"2023-07-09T21:23:37.200272+0000","last_active":"2023-07-09T21:23:37.205449+0000","last_peered":"2023-07-09T21:23:37.205449+0000","last_clean":"2023-07-09T21:23:37.205449+0000","last_became_active":"2023-07-09T21:23:37.199958+0000","last_became_peered":"2023-07-09T21:23:37.199958+0000","last_unstale":"2023-07-09T21:23:37.205449+0000","last_undegraded":"2023-07-09T21:23:37.205449+0000","last_fullsized":"2023-07-09T21:23:37.205449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184146+0000","last_change":"2023-07-09T21:23:37.184146+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184146+0000","last_undegraded":"2023-07-09T21:23:37.184146+0000","last_fullsized":"2023-07-09T21:23:37.184146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199602+0000","last_change":"2023-07-09T21:23:37.196773+0000","last_active":"2023-07-09T21:23:37.199602+0000","last_peered":"2023-07-09T21:23:37.199602+0000","last_clean":"2023-07-09T21:23:37.199602+0000","last_became_active":"2023-07-09T21:23:37.196447+0000","last_became_peered":"2023-07-09T21:23:37.196447+0000","last_unstale":"2023-07-09T21:23:37.199602+0000","last_undegraded":"2023-07-09T21:23:37.199602+0000","last_fullsized":"2023-07-09T21:23:37.199602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:58:20.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187208+0000","last_change":"2023-07-09T21:23:37.187208+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187208+0000","last_undegraded":"2023-07-09T21:23:37.187208+0000","last_fullsized":"2023-07-09T21:23:37.187208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208100+0000","last_change":"2023-07-09T21:23:37.201060+0000","last_active":"2023-07-09T21:23:37.208100+0000","last_peered":"2023-07-09T21:23:37.208100+0000","last_clean":"2023-07-09T21:23:37.208100+0000","last_became_active":"2023-07-09T21:23:37.200764+0000","last_became_peered":"2023-07-09T21:23:37.200764+0000","last_unstale":"2023-07-09T21:23:37.208100+0000","last_undegraded":"2023-07-09T21:23:37.208100+0000","last_fullsized":"2023-07-09T21:23:37.208100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189822+0000","last_change":"2023-07-09T21:23:37.189822+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189822+0000","last_undegraded":"2023-07-09T21:23:37.189822+0000","last_fullsized":"2023-07-09T21:23:37.189822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207920+0000","last_change":"2023-07-09T21:23:37.201267+0000","last_active":"2023-07-09T21:23:37.207920+0000","last_peered":"2023-07-09T21:23:37.207920+0000","last_clean":"2023-07-09T21:23:37.207920+0000","last_became_active":"2023-07-09T21:23:37.200889+0000","last_became_peered":"2023-07-09T21:23:37.200889+0000","last_unstale":"2023-07-09T21:23:37.207920+0000","last_undegraded":"2023-07-09T21:23:37.207920+0000","last_fullsized":"2023-07-09T21:23:37.207920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191158+0000","last_change":"2023-07-09T21:23:37.191158+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191158+0000","last_undegraded":"2023-07-09T21:23:37.191158+0000","last_fullsized":"2023-07-09T21:23:37.191158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203716+0000","last_change":"2023-07-09T21:23:37.201098+0000","last_active":"2023-07-09T21:23:37.203716+0000","last_peered":"2023-07-09T21:23:37.203716+0000","last_clean":"2023-07-09T21:23:37.203716+0000","last_became_active":"2023-07-09T21:23:37.200492+0000","last_became_peered":"2023-07-09T21:23:37.200492+0000","last_unstale":"2023-07-09T21:23:37.203716+0000","last_undegraded":"2023-07-09T21:23:37.203716+0000","last_fullsized":"2023-07-09T21:23:37.203716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:40.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189578+0000","last_change":"2023-07-09T21:23:37.189578+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189578+0000","last_undegraded":"2023-07-09T21:23:37.189578+0000","last_fullsized":"2023-07-09T21:23:37.189578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203768+0000","last_change":"2023-07-09T21:23:37.200437+0000","last_active":"2023-07-09T21:23:37.203768+0000","last_peered":"2023-07-09T21:23:37.203768+0000","last_clean":"2023-07-09T21:23:37.203768+0000","last_became_active":"2023-07-09T21:23:37.200064+0000","last_became_peered":"2023-07-09T21:23:37.200064+0000","last_unstale":"2023-07-09T21:23:37.203768+0000","last_undegraded":"2023-07-09T21:23:37.203768+0000","last_fullsized":"2023-07-09T21:23:37.203768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.344717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185505+0000","last_change":"2023-07-09T21:23:37.185505+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185505+0000","last_undegraded":"2023-07-09T21:23:37.185505+0000","last_fullsized":"2023-07-09T21:23:37.185505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208833+0000","last_change":"2023-07-09T21:23:37.207562+0000","last_active":"2023-07-09T21:23:37.208833+0000","last_peered":"2023-07-09T21:23:37.208833+0000","last_clean":"2023-07-09T21:23:37.208833+0000","last_became_active":"2023-07-09T21:23:37.207198+0000","last_became_peered":"2023-07-09T21:23:37.207198+0000","last_unstale":"2023-07-09T21:23:37.208833+0000","last_undegraded":"2023-07-09T21:23:37.208833+0000","last_fullsized":"2023-07-09T21:23:37.208833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:02.885873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185287+0000","last_change":"2023-07-09T21:23:37.185287+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185287+0000","last_undegraded":"2023-07-09T21:23:37.185287+0000","last_fullsized":"2023-07-09T21:23:37.185287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200941+0000","last_change":"2023-07-09T21:23:37.198758+0000","last_active":"2023-07-09T21:23:37.200941+0000","last_peered":"2023-07-09T21:23:37.200941+0000","last_clean":"2023-07-09T21:23:37.200941+0000","last_became_active":"2023-07-09T21:23:37.198397+0000","last_became_peered":"2023-07-09T21:23:37.198397+0000","last_unstale":"2023-07-09T21:23:37.200941+0000","last_undegraded":"2023-07-09T21:23:37.200941+0000","last_fullsized":"2023-07-09T21:23:37.200941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:15.211913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191324+0000","last_change":"2023-07-09T21:23:37.191324+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191324+0000","last_undegraded":"2023-07-09T21:23:37.191324+0000","last_fullsized":"2023-07-09T21:23:37.191324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207391+0000","last_change":"2023-07-09T21:23:37.203038+0000","last_active":"2023-07-09T21:23:37.207391+0000","last_peered":"2023-07-09T21:23:37.207391+0000","last_clean":"2023-07-09T21:23:37.207391+0000","last_became_active":"2023-07-09T21:23:37.202669+0000","last_became_peered":"2023-07-09T21:23:37.202669+0000","last_unstale":"2023-07-09T21:23:37.207391+0000","last_undegraded":"2023-07-09T21:23:37.207391+0000","last_fullsized":"2023-07-09T21:23:37.207391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:28:15.632946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186660+0000","last_change":"2023-07-09T21:23:37.186660+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186660+0000","last_undegraded":"2023-07-09T21:23:37.186660+0000","last_fullsized":"2023-07-09T21:23:37.186660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207702+0000","last_change":"2023-07-09T21:23:37.198991+0000","last_active":"2023-07-09T21:23:37.207702+0000","last_peered":"2023-07-09T21:23:37.207702+0000","last_clean":"2023-07-09T21:23:37.207702+0000","last_became_active":"2023-07-09T21:23:37.198697+0000","last_became_peered":"2023-07-09T21:23:37.198697+0000","last_unstale":"2023-07-09T21:23:37.207702+0000","last_undegraded":"2023-07-09T21:23:37.207702+0000","last_fullsized":"2023-07-09T21:23:37.207702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186819+0000","last_change":"2023-07-09T21:23:37.186819+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186819+0000","last_undegraded":"2023-07-09T21:23:37.186819+0000","last_fullsized":"2023-07-09T21:23:37.186819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.211915+0000","last_change":"2023-07-09T21:23:37.208724+0000","last_active":"2023-07-09T21:23:37.211915+0000","last_peered":"2023-07-09T21:23:37.211915+0000","last_clean":"2023-07-09T21:23:37.211915+0000","last_became_active":"2023-07-09T21:23:37.208426+0000","last_became_peered":"2023-07-09T21:23:37.208426+0000","last_unstale":"2023-07-09T21:23:37.211915+0000","last_undegraded":"2023-07-09T21:23:37.211915+0000","last_fullsized":"2023-07-09T21:23:37.211915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:43.089981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195632+0000","last_change":"2023-07-09T21:23:37.195632+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195632+0000","last_undegraded":"2023-07-09T21:23:37.195632+0000","last_fullsized":"2023-07-09T21:23:37.195632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205384+0000","last_change":"2023-07-09T21:23:37.200744+0000","last_active":"2023-07-09T21:23:37.205384+0000","last_peered":"2023-07-09T21:23:37.205384+0000","last_clean":"2023-07-09T21:23:37.205384+0000","last_became_active":"2023-07-09T21:23:37.200385+0000","last_became_peered":"2023-07-09T21:23:37.200385+0000","last_unstale":"2023-07-09T21:23:37.205384+0000","last_undegraded":"2023-07-09T21:23:37.205384+0000","last_fullsized":"2023-07-09T21:23:37.205384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:06:23.401418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.183668+0000","last_change":"2023-07-09T21:23:37.183668+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.183668+0000","last_undegraded":"2023-07-09T21:23:37.183668+0000","last_fullsized":"2023-07-09T21:23:37.183668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205050+0000","last_change":"2023-07-09T21:23:37.202950+0000","last_active":"2023-07-09T21:23:37.205050+0000","last_peered":"2023-07-09T21:23:37.205050+0000","last_clean":"2023-07-09T21:23:37.205050+0000","last_became_active":"2023-07-09T21:23:37.202660+0000","last_became_peered":"2023-07-09T21:23:37.202660+0000","last_unstale":"2023-07-09T21:23:37.205050+0000","last_undegraded":"2023-07-09T21:23:37.205050+0000","last_fullsized":"2023-07-09T21:23:37.205050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:56.528783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185198+0000","last_change":"2023-07-09T21:23:37.185198+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185198+0000","last_undegraded":"2023-07-09T21:23:37.185198+0000","last_fullsized":"2023-07-09T21:23:37.185198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199817+0000","last_change":"2023-07-09T21:23:37.194667+0000","last_active":"2023-07-09T21:23:37.199817+0000","last_peered":"2023-07-09T21:23:37.199817+0000","last_clean":"2023-07-09T21:23:37.199817+0000","last_became_active":"2023-07-09T21:23:37.194395+0000","last_became_peered":"2023-07-09T21:23:37.194395+0000","last_unstale":"2023-07-09T21:23:37.199817+0000","last_undegraded":"2023-07-09T21:23:37.199817+0000","last_fullsized":"2023-07-09T21:23:37.199817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:55.340588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187357+0000","last_change":"2023-07-09T21:23:37.187357+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187357+0000","last_undegraded":"2023-07-09T21:23:37.187357+0000","last_fullsized":"2023-07-09T21:23:37.187357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205401+0000","last_change":"2023-07-09T21:23:37.202646+0000","last_active":"2023-07-09T21:23:37.205401+0000","last_peered":"2023-07-09T21:23:37.205401+0000","last_clean":"2023-07-09T21:23:37.205401+0000","last_became_active":"2023-07-09T21:23:37.202363+0000","last_became_peered":"2023-07-09T21:23:37.202363+0000","last_unstale":"2023-07-09T21:23:37.205401+0000","last_undegraded":"2023-07-09T21:23:37.205401+0000","last_fullsized":"2023-07-09T21:23:37.205401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185914+0000","last_change":"2023-07-09T21:23:37.185914+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185914+0000","last_undegraded":"2023-07-09T21:23:37.185914+0000","last_fullsized":"2023-07-09T21:23:37.185914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204636+0000","last_change":"2023-07-09T21:23:37.201013+0000","last_active":"2023-07-09T21:23:37.204636+0000","last_peered":"2023-07-09T21:23:37.204636+0000","last_clean":"2023-07-09T21:23:37.204636+0000","last_became_active":"2023-07-09T21:23:37.200747+0000","last_became_peered":"2023-07-09T21:23:37.200747+0000","last_unstale":"2023-07-09T21:23:37.204636+0000","last_undegraded":"2023-07-09T21:23:37.204636+0000","last_fullsized":"2023-07-09T21:23:37.204636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:55.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190831+0000","last_change":"2023-07-09T21:23:37.190831+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190831+0000","last_undegraded":"2023-07-09T21:23:37.190831+0000","last_fullsized":"2023-07-09T21:23:37.190831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199774+0000","last_change":"2023-07-09T21:23:37.196001+0000","last_active":"2023-07-09T21:23:37.199774+0000","last_peered":"2023-07-09T21:23:37.199774+0000","last_clean":"2023-07-09T21:23:37.199774+0000","last_became_active":"2023-07-09T21:23:37.195702+0000","last_became_peered":"2023-07-09T21:23:37.195702+0000","last_unstale":"2023-07-09T21:23:37.199774+0000","last_undegraded":"2023-07-09T21:23:37.199774+0000","last_fullsized":"2023-07-09T21:23:37.199774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:12.993263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189370+0000","last_change":"2023-07-09T21:23:37.189370+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189370+0000","last_undegraded":"2023-07-09T21:23:37.189370+0000","last_fullsized":"2023-07-09T21:23:37.189370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204591+0000","last_change":"2023-07-09T21:23:37.200811+0000","last_active":"2023-07-09T21:23:37.204591+0000","last_peered":"2023-07-09T21:23:37.204591+0000","last_clean":"2023-07-09T21:23:37.204591+0000","last_became_active":"2023-07-09T21:23:37.200465+0000","last_became_peered":"2023-07-09T21:23:37.200465+0000","last_unstale":"2023-07-09T21:23:37.204591+0000","last_undegraded":"2023-07-09T21:23:37.204591+0000","last_fullsized":"2023-07-09T21:23:37.204591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.189086+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:23:37.189086+0000","last_peered":"2023-07-09T21:23:37.189086+0000","last_clean":"2023-07-09T21:23:37.189086+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:23:37.189086+0000","last_undegraded":"2023-07-09T21:23:37.189086+0000","last_fullsized":"2023-07-09T21:23:37.189086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:25:06.244008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195491+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:23:37.195491+0000","last_peered":"2023-07-09T21:23:37.195491+0000","last_clean":"2023-07-09T21:23:37.195491+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:23:37.195491+0000","last_undegraded":"2023-07-09T21:23:37.195491+0000","last_fullsized":"2023-07-09T21:23:37.195491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:21.335107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188514+0000","last_change":"2023-07-09T21:23:37.188514+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188514+0000","last_undegraded":"2023-07-09T21:23:37.188514+0000","last_fullsized":"2023-07-09T21:23:37.188514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207655+0000","last_change":"2023-07-09T21:23:37.197379+0000","last_active":"2023-07-09T21:23:37.207655+0000","last_peered":"2023-07-09T21:23:37.207655+0000","last_clean":"2023-07-09T21:23:37.207655+0000","last_became_active":"2023-07-09T21:23:37.197066+0000","last_became_peered":"2023-07-09T21:23:37.197066+0000","last_unstale":"2023-07-09T21:23:37.207655+0000","last_undegraded":"2023-07-09T21:23:37.207655+0000","last_fullsized":"2023-07-09T21:23:37.207655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.188939+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:23:37.188939+0000","last_peered":"2023-07-09T21:23:37.188939+0000","last_clean":"2023-07-09T21:23:37.188939+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:23:37.188939+0000","last_undegraded":"2023-07-09T21:23:37.188939+0000","last_fullsized":"2023-07-09T21:23:37.188939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:56:07.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186741+0000","last_change":"2023-07-09T21:23:37.186741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186741+0000","last_undegraded":"2023-07-09T21:23:37.186741+0000","last_fullsized":"2023-07-09T21:23:37.186741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.197150+0000","last_change":"2023-07-09T21:23:37.193012+0000","last_active":"2023-07-09T21:23:37.197150+0000","last_peered":"2023-07-09T21:23:37.197150+0000","last_clean":"2023-07-09T21:23:37.197150+0000","last_became_active":"2023-07-09T21:23:37.192697+0000","last_became_peered":"2023-07-09T21:23:37.192697+0000","last_unstale":"2023-07-09T21:23:37.197150+0000","last_undegraded":"2023-07-09T21:23:37.197150+0000","last_fullsized":"2023-07-09T21:23:37.197150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:45.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.181302+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:23:37.181302+0000","last_peered":"2023-07-09T21:23:37.181302+0000","last_clean":"2023-07-09T21:23:37.181302+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:23:37.181302+0000","last_undegraded":"2023-07-09T21:23:37.181302+0000","last_fullsized":"2023-07-09T21:23:37.181302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:13.722095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187628+0000","last_change":"2023-07-09T21:23:37.187628+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187628+0000","last_undegraded":"2023-07-09T21:23:37.187628+0000","last_fullsized":"2023-07-09T21:23:37.187628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202533+0000","last_change":"2023-07-09T21:23:37.199308+0000","last_active":"2023-07-09T21:23:37.202533+0000","last_peered":"2023-07-09T21:23:37.202533+0000","last_clean":"2023-07-09T21:23:37.202533+0000","last_became_active":"2023-07-09T21:23:37.199029+0000","last_became_peered":"2023-07-09T21:23:37.199029+0000","last_unstale":"2023-07-09T21:23:37.202533+0000","last_undegraded":"2023-07-09T21:23:37.202533+0000","last_fullsized":"2023-07-09T21:23:37.202533+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:18.349317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195303+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:23:37.195303+0000","last_peered":"2023-07-09T21:23:37.195303+0000","last_clean":"2023-07-09T21:23:37.195303+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:23:37.195303+0000","last_undegraded":"2023-07-09T21:23:37.195303+0000","last_fullsized":"2023-07-09T21:23:37.195303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:31.700784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187329+0000","last_change":"2023-07-09T21:23:37.187329+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187329+0000","last_undegraded":"2023-07-09T21:23:37.187329+0000","last_fullsized":"2023-07-09T21:23:37.187329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202490+0000","last_change":"2023-07-09T21:23:37.198511+0000","last_active":"2023-07-09T21:23:37.202490+0000","last_peered":"2023-07-09T21:23:37.202490+0000","last_clean":"2023-07-09T21:23:37.202490+0000","last_became_active":"2023-07-09T21:23:37.198226+0000","last_became_peered":"2023-07-09T21:23:37.198226+0000","last_unstale":"2023-07-09T21:23:37.202490+0000","last_undegraded":"2023-07-09T21:23:37.202490+0000","last_fullsized":"2023-07-09T21:23:37.202490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184931+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:23:37.184931+0000","last_peered":"2023-07-09T21:23:37.184931+0000","last_clean":"2023-07-09T21:23:37.184931+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:23:37.184931+0000","last_undegraded":"2023-07-09T21:23:37.184931+0000","last_fullsized":"2023-07-09T21:23:37.184931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:26.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187847+0000","last_change":"2023-07-09T21:23:37.187847+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187847+0000","last_undegraded":"2023-07-09T21:23:37.187847+0000","last_fullsized":"2023-07-09T21:23:37.187847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207556+0000","last_change":"2023-07-09T21:23:37.203604+0000","last_active":"2023-07-09T21:23:37.207556+0000","last_peered":"2023-07-09T21:23:37.207556+0000","last_clean":"2023-07-09T21:23:37.207556+0000","last_became_active":"2023-07-09T21:23:37.203306+0000","last_became_peered":"2023-07-09T21:23:37.203306+0000","last_unstale":"2023-07-09T21:23:37.207556+0000","last_undegraded":"2023-07-09T21:23:37.207556+0000","last_fullsized":"2023-07-09T21:23:37.207556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.191596+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:23:37.191596+0000","last_peered":"2023-07-09T21:23:37.191596+0000","last_clean":"2023-07-09T21:23:37.191596+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:23:37.191596+0000","last_undegraded":"2023-07-09T21:23:37.191596+0000","last_fullsized":"2023-07-09T21:23:37.191596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:40.689587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194650+0000","last_change":"2023-07-09T21:23:37.194650+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194650+0000","last_undegraded":"2023-07-09T21:23:37.194650+0000","last_fullsized":"2023-07-09T21:23:37.194650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205466+0000","last_change":"2023-07-09T21:23:37.199737+0000","last_active":"2023-07-09T21:23:37.205466+0000","last_peered":"2023-07-09T21:23:37.205466+0000","last_clean":"2023-07-09T21:23:37.205466+0000","last_became_active":"2023-07-09T21:23:37.199176+0000","last_became_peered":"2023-07-09T21:23:37.199176+0000","last_unstale":"2023-07-09T21:23:37.205466+0000","last_undegraded":"2023-07-09T21:23:37.205466+0000","last_fullsized":"2023-07-09T21:23:37.205466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184583+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:23:37.184583+0000","last_peered":"2023-07-09T21:23:37.184583+0000","last_clean":"2023-07-09T21:23:37.184583+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:23:37.184583+0000","last_undegraded":"2023-07-09T21:23:37.184583+0000","last_fullsized":"2023-07-09T21:23:37.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:06.960119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185692+0000","last_change":"2023-07-09T21:23:37.185692+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185692+0000","last_undegraded":"2023-07-09T21:23:37.185692+0000","last_fullsized":"2023-07-09T21:23:37.185692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200661+0000","last_change":"2023-07-09T21:23:37.197526+0000","last_active":"2023-07-09T21:23:37.200661+0000","last_peered":"2023-07-09T21:23:37.200661+0000","last_clean":"2023-07-09T21:23:37.200661+0000","last_became_active":"2023-07-09T21:23:37.197207+0000","last_became_peered":"2023-07-09T21:23:37.197207+0000","last_unstale":"2023-07-09T21:23:37.200661+0000","last_undegraded":"2023-07-09T21:23:37.200661+0000","last_fullsized":"2023-07-09T21:23:37.200661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:39.261345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.198128+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:23:37.198128+0000","last_peered":"2023-07-09T21:23:37.198128+0000","last_clean":"2023-07-09T21:23:37.198128+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:23:37.198128+0000","last_undegraded":"2023-07-09T21:23:37.198128+0000","last_fullsized":"2023-07-09T21:23:37.198128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:01.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.92800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.745},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65700000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.503}]},{"osd":4,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:23:42.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:23:42.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 Processor -- start 2023-07-09T21:23:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 -- start start 2023-07-09T21:23:42.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0fc0cef80 0x7fd0fc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0b49f0 con 0x7fd0fc0b4340 2023-07-09T21:23:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0cc8a0 con 0x7fd0fc0b7ab0 2023-07-09T21:23:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd100fd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0b7e80 con 0x7fd0fc0cef80 2023-07-09T21:23:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0f3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd0fc0b4340 0x7fd0fc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49428/0 (socket says 172.21.15.37:49428) 2023-07-09T21:23:42.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0f3fff640 1 -- 172.21.15.37:0/2025685680 learned_addr learned my addr 172.21.15.37:0/2025685680 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0fad9d640 1 --2- 172.21.15.37:0/2025685680 >> v2:172.21.15.119:3300/0 conn(0x7fd0fc0cef80 0x7fd0fc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052667895 0 0) 0x7fd0fc0b49f0 con 0x7fd0fc0b4340 2023-07-09T21:23:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e8003530 con 0x7fd0fc0b4340 2023-07-09T21:23:42.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1014830530 0 0) 0x7fd0e8003530 con 0x7fd0fc0b4340 2023-07-09T21:23:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0fad9d640 1 -- 172.21.15.37:0/2025685680 >> v1:172.21.15.119:6789/0 conn(0x7fd0fc0b7ab0 legacy=0x7fd0fc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0fad9d640 1 -- 172.21.15.37:0/2025685680 >> v1:172.21.15.37:6789/0 conn(0x7fd0fc0b4340 legacy=0x7fd0fc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.501+0000 7fd0fad9d640 1 -- 172.21.15.37:0/2025685680 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0ccb80 con 0x7fd0fc0cef80 2023-07-09T21:23:42.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd0fad9d640 1 --2- 172.21.15.37:0/2025685680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0cef80 0x7fd0fc06aa50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009d90 tx=0x7fd0f401c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0b43ddf8fc6a7ac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4001680 con 0x7fd0fc0cef80 2023-07-09T21:23:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f40a5680 con 0x7fd0fc0cef80 2023-07-09T21:23:42.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd0f9d9b640 1 -- 172.21.15.37:0/2025685680 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40a5a10 con 0x7fd0fc0cef80 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 -- 172.21.15.37:0/2025685680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0cef80 msgr2=0x7fd0fc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 --2- 172.21.15.37:0/2025685680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0cef80 0x7fd0fc06aa50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009d90 tx=0x7fd0f401c840 comp rx=0 tx=0).stop 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 -- 172.21.15.37:0/2025685680 shutdown_connections 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 --2- 172.21.15.37:0/2025685680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0cef80 0x7fd0fc06aa50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 -- 172.21.15.37:0/2025685680 >> 172.21.15.37:0/2025685680 conn(0x7fd0fc073090 msgr2=0x7fd0fc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 -- 172.21.15.37:0/2025685680 shutdown_connections 2023-07-09T21:23:42.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.505+0000 7fd100fd2640 1 -- 172.21.15.37:0/2025685680 wait complete. 2023-07-09T21:23:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 Processor -- start 2023-07-09T21:23:42.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- start start 2023-07-09T21:23:42.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0b7ab0 0x7fd0fc156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 0x7fd0fc1567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc154720 con 0x7fd0fc0b4340 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1549c0 con 0x7fd0fc0b7ab0 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc154ca0 con 0x7fd0fc0cef80 2023-07-09T21:23:42.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38362/0 (socket says 172.21.15.37:38362) 2023-07-09T21:23:42.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 -- 172.21.15.37:0/3512100013 learned_addr learned my addr 172.21.15.37:0/3512100013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0b7ab0 0x7fd0fc156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 -- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 msgr2=0x7fd0fc1567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fad9d640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 0x7fd0fc1567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 0x7fd0fc1567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 -- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0b7ab0 msgr2=0x7fd0fc156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0b7ab0 0x7fd0fc156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 -- 172.21.15.37:0/3512100013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f4009a70 con 0x7fd0fc0b4340 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fad9d640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 0x7fd0fc1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0fa59c640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c500 tx=0x7fd0ec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec005220 con 0x7fd0fc0b4340 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec005380 con 0x7fd0fc0b4340 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec007270 con 0x7fd0fc0b4340 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc154f80 con 0x7fd0fc0b4340 2023-07-09T21:23:42.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.509+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc14c470 con 0x7fd0fc0b4340 2023-07-09T21:23:42.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc0b7310 con 0x7fd0fc0b4340 2023-07-09T21:23:42.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0ec0073d0 con 0x7fd0fc0b4340 2023-07-09T21:23:42.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd0f2ffd640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 0x7fd0dc068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd0ec083730 con 0x7fd0fc0b4340 2023-07-09T21:23:42.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 0x7fd0dc068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.513+0000 7fd0f3fff640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 0x7fd0dc068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0c6dd0 tx=0x7fd0e4009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.517+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0ec050b20 con 0x7fd0fc0b4340 2023-07-09T21:23:42.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.669+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0fc0cf4d0 con 0x7fd0dc066280 2023-07-09T21:23:42.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.677+0000 7fd0f2ffd640 1 -- 172.21.15.37:0/3512100013 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306014 (secure 0 0 0) 0x7fd0e40015b0 con 0x7fd0dc066280 2023-07-09T21:23:42.681 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:42.683 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 msgr2=0x7fd0dc068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 0x7fd0dc068730 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc0c6dd0 tx=0x7fd0e4009040 comp rx=0 tx=0).stop 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 msgr2=0x7fd0fc14bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec00c500 tx=0x7fd0ec00c9c0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 shutdown_connections 2023-07-09T21:23:42.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fd0dc066280 0x7fd0dc068730 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0fc0cef80 0x7fd0fc1567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0fc0b7ab0 0x7fd0fc156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 --2- 172.21.15.37:0/3512100013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0fc0b4340 0x7fd0fc14bf30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 >> 172.21.15.37:0/3512100013 conn(0x7fd0fc073090 msgr2=0x7fd0fc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 shutdown_connections 2023-07-09T21:23:42.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.681+0000 7fd100fd2640 1 -- 172.21.15.37:0/3512100013 wait complete. 2023-07-09T21:23:42.702 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-09T21:23:41.969776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223964,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750756,"statfs":{"total":773094113280,"available":772864774144,"internally_reserved":0,"allocated":4354048,"data_stored":2466964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795332"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186531+0000","last_change":"2023-07-09T21:23:37.186531+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186531+0000","last_undegraded":"2023-07-09T21:23:37.186531+0000","last_fullsized":"2023-07-09T21:23:37.186531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188108+0000","last_change":"2023-07-09T21:23:37.188108+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188108+0000","last_undegraded":"2023-07-09T21:23:37.188108+0000","last_fullsized":"2023-07-09T21:23:37.188108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189333+0000","last_change":"2023-07-09T21:23:37.189333+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189333+0000","last_undegraded":"2023-07-09T21:23:37.189333+0000","last_fullsized":"2023-07-09T21:23:37.189333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184741+0000","last_change":"2023-07-09T21:23:37.184741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184741+0000","last_undegraded":"2023-07-09T21:23:37.184741+0000","last_fullsized":"2023-07-09T21:23:37.184741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184404+0000","last_change":"2023-07-09T21:23:37.184404+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184404+0000","last_undegraded":"2023-07-09T21:23:37.184404+0000","last_fullsized":"2023-07-09T21:23:37.184404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188406+0000","last_change":"2023-07-09T21:23:37.188406+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188406+0000","last_undegraded":"2023-07-09T21:23:37.188406+0000","last_fullsized":"2023-07-09T21:23:37.188406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192519+0000","last_change":"2023-07-09T21:23:37.192519+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192519+0000","last_undegraded":"2023-07-09T21:23:37.192519+0000","last_fullsized":"2023-07-09T21:23:37.192519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190274+0000","last_change":"2023-07-09T21:23:37.190274+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190274+0000","last_undegraded":"2023-07-09T21:23:37.190274+0000","last_fullsized":"2023-07-09T21:23:37.190274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190250+0000","last_change":"2023-07-09T21:23:37.190250+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190250+0000","last_undegraded":"2023-07-09T21:23:37.190250+0000","last_fullsized":"2023-07-09T21:23:37.190250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185430+0000","last_change":"2023-07-09T21:23:37.185430+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185430+0000","last_undegraded":"2023-07-09T21:23:37.185430+0000","last_fullsized":"2023-07-09T21:23:37.185430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187297+0000","last_change":"2023-07-09T21:23:37.187297+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187297+0000","last_undegraded":"2023-07-09T21:23:37.187297+0000","last_fullsized":"2023-07-09T21:23:37.187297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189875+0000","last_change":"2023-07-09T21:23:37.189875+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189875+0000","last_undegraded":"2023-07-09T21:23:37.189875+0000","last_fullsized":"2023-07-09T21:23:37.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184098+0000","last_change":"2023-07-09T21:23:37.184098+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184098+0000","last_undegraded":"2023-07-09T21:23:37.184098+0000","last_fullsized":"2023-07-09T21:23:37.184098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.196818+0000","last_change":"2023-07-09T21:23:37.196818+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.196818+0000","last_undegraded":"2023-07-09T21:23:37.196818+0000","last_fullsized":"2023-07-09T21:23:37.196818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192006+0000","last_change":"2023-07-09T21:23:37.192006+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192006+0000","last_undegraded":"2023-07-09T21:23:37.192006+0000","last_fullsized":"2023-07-09T21:23:37.192006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185805+0000","last_change":"2023-07-09T21:23:37.185805+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185805+0000","last_undegraded":"2023-07-09T21:23:37.185805+0000","last_fullsized":"2023-07-09T21:23:37.185805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187773+0000","last_change":"2023-07-09T21:23:37.187773+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187773+0000","last_undegraded":"2023-07-09T21:23:37.187773+0000","last_fullsized":"2023-07-09T21:23:37.187773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188178+0000","last_change":"2023-07-09T21:23:37.188178+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188178+0000","last_undegraded":"2023-07-09T21:23:37.188178+0000","last_fullsized":"2023-07-09T21:23:37.188178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184077+0000","last_change":"2023-07-09T21:23:37.184077+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184077+0000","last_undegraded":"2023-07-09T21:23:37.184077+0000","last_fullsized":"2023-07-09T21:23:37.184077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189143+0000","last_change":"2023-07-09T21:23:37.189143+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189143+0000","last_undegraded":"2023-07-09T21:23:37.189143+0000","last_fullsized":"2023-07-09T21:23:37.189143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189344+0000","last_change":"2023-07-09T21:23:37.189344+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189344+0000","last_undegraded":"2023-07-09T21:23:37.189344+0000","last_fullsized":"2023-07-09T21:23:37.189344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.193085+0000","last_change":"2023-07-09T21:23:37.193085+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.193085+0000","last_undegraded":"2023-07-09T21:23:37.193085+0000","last_fullsized":"2023-07-09T21:23:37.193085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185908+0000","last_change":"2023-07-09T21:23:37.185908+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185908+0000","last_undegraded":"2023-07-09T21:23:37.185908+0000","last_fullsized":"2023-07-09T21:23:37.185908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184589+0000","last_change":"2023-07-09T21:23:37.184589+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184589+0000","last_undegraded":"2023-07-09T21:23:37.184589+0000","last_fullsized":"2023-07-09T21:23:37.184589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191291+0000","last_change":"2023-07-09T21:23:37.191291+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191291+0000","last_undegraded":"2023-07-09T21:23:37.191291+0000","last_fullsized":"2023-07-09T21:23:37.191291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188013+0000","last_change":"2023-07-09T21:23:37.188013+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188013+0000","last_undegraded":"2023-07-09T21:23:37.188013+0000","last_fullsized":"2023-07-09T21:23:37.188013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188809+0000","last_change":"2023-07-09T21:23:37.188809+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188809+0000","last_undegraded":"2023-07-09T21:23:37.188809+0000","last_fullsized":"2023-07-09T21:23:37.188809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186390+0000","last_change":"2023-07-09T21:23:37.186390+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186390+0000","last_undegraded":"2023-07-09T21:23:37.186390+0000","last_fullsized":"2023-07-09T21:23:37.186390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187523+0000","last_change":"2023-07-09T21:23:37.187523+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187523+0000","last_undegraded":"2023-07-09T21:23:37.187523+0000","last_fullsized":"2023-07-09T21:23:37.187523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188243+0000","last_change":"2023-07-09T21:23:37.188243+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188243+0000","last_undegraded":"2023-07-09T21:23:37.188243+0000","last_fullsized":"2023-07-09T21:23:37.188243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185244+0000","last_change":"2023-07-09T21:23:37.185244+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185244+0000","last_undegraded":"2023-07-09T21:23:37.185244+0000","last_fullsized":"2023-07-09T21:23:37.185244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188732+0000","last_change":"2023-07-09T21:23:37.188732+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188732+0000","last_undegraded":"2023-07-09T21:23:37.188732+0000","last_fullsized":"2023-07-09T21:23:37.188732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188141+0000","last_change":"2023-07-09T21:23:37.188141+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188141+0000","last_undegraded":"2023-07-09T21:23:37.188141+0000","last_fullsized":"2023-07-09T21:23:37.188141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208541+0000","last_change":"2023-07-09T21:23:37.205856+0000","last_active":"2023-07-09T21:23:37.208541+0000","last_peered":"2023-07-09T21:23:37.208541+0000","last_clean":"2023-07-09T21:23:37.208541+0000","last_became_active":"2023-07-09T21:23:37.205568+0000","last_became_peered":"2023-07-09T21:23:37.205568+0000","last_unstale":"2023-07-09T21:23:37.208541+0000","last_undegraded":"2023-07-09T21:23:37.208541+0000","last_fullsized":"2023-07-09T21:23:37.208541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:25.111293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189520+0000","last_change":"2023-07-09T21:23:37.189520+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189520+0000","last_undegraded":"2023-07-09T21:23:37.189520+0000","last_fullsized":"2023-07-09T21:23:37.189520+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203658+0000","last_change":"2023-07-09T21:23:37.200996+0000","last_active":"2023-07-09T21:23:37.203658+0000","last_peered":"2023-07-09T21:23:37.203658+0000","last_clean":"2023-07-09T21:23:37.203658+0000","last_became_active":"2023-07-09T21:23:37.200647+0000","last_became_peered":"2023-07-09T21:23:37.200647+0000","last_unstale":"2023-07-09T21:23:37.203658+0000","last_undegraded":"2023-07-09T21:23:37.203658+0000","last_fullsized":"2023-07-09T21:23:37.203658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:37.644270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195040+0000","last_change":"2023-07-09T21:23:37.195040+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195040+0000","last_undegraded":"2023-07-09T21:23:37.195040+0000","last_fullsized":"2023-07-09T21:23:37.195040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205065+0000","last_change":"2023-07-09T21:23:37.203576+0000","last_active":"2023-07-09T21:23:37.205065+0000","last_peered":"2023-07-09T21:23:37.205065+0000","last_clean":"2023-07-09T21:23:37.205065+0000","last_became_active":"2023-07-09T21:23:37.203281+0000","last_became_peered":"2023-07-09T21:23:37.203281+0000","last_unstale":"2023-07-09T21:23:37.205065+0000","last_undegraded":"2023-07-09T21:23:37.205065+0000","last_fullsized":"2023-07-09T21:23:37.205065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185936+0000","last_change":"2023-07-09T21:23:37.185936+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185936+0000","last_undegraded":"2023-07-09T21:23:37.185936+0000","last_fullsized":"2023-07-09T21:23:37.185936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205402+0000","last_change":"2023-07-09T21:23:37.199060+0000","last_active":"2023-07-09T21:23:37.205402+0000","last_peered":"2023-07-09T21:23:37.205402+0000","last_clean":"2023-07-09T21:23:37.205402+0000","last_became_active":"2023-07-09T21:23:37.198702+0000","last_became_peered":"2023-07-09T21:23:37.198702+0000","last_unstale":"2023-07-09T21:23:37.205402+0000","last_undegraded":"2023-07-09T21:23:37.205402+0000","last_fullsized":"2023-07-09T21:23:37.205402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190128+0000","last_change":"2023-07-09T21:23:37.190128+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190128+0000","last_undegraded":"2023-07-09T21:23:37.190128+0000","last_fullsized":"2023-07-09T21:23:37.190128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207953+0000","last_change":"2023-07-09T21:23:37.201618+0000","last_active":"2023-07-09T21:23:37.207953+0000","last_peered":"2023-07-09T21:23:37.207953+0000","last_clean":"2023-07-09T21:23:37.207953+0000","last_became_active":"2023-07-09T21:23:37.201315+0000","last_became_peered":"2023-07-09T21:23:37.201315+0000","last_unstale":"2023-07-09T21:23:37.207953+0000","last_undegraded":"2023-07-09T21:23:37.207953+0000","last_fullsized":"2023-07-09T21:23:37.207953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184189+0000","last_change":"2023-07-09T21:23:37.184189+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184189+0000","last_undegraded":"2023-07-09T21:23:37.184189+0000","last_fullsized":"2023-07-09T21:23:37.184189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208983+0000","last_change":"2023-07-09T21:23:37.205993+0000","last_active":"2023-07-09T21:23:37.208983+0000","last_peered":"2023-07-09T21:23:37.208983+0000","last_clean":"2023-07-09T21:23:37.208983+0000","last_became_active":"2023-07-09T21:23:37.205740+0000","last_became_peered":"2023-07-09T21:23:37.205740+0000","last_unstale":"2023-07-09T21:23:37.208983+0000","last_undegraded":"2023-07-09T21:23:37.208983+0000","last_fullsized":"2023-07-09T21:23:37.208983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:03.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194186+0000","last_change":"2023-07-09T21:23:37.194186+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194186+0000","last_undegraded":"2023-07-09T21:23:37.194186+0000","last_fullsized":"2023-07-09T21:23:37.194186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208824+0000","last_change":"2023-07-09T21:23:37.207663+0000","last_active":"2023-07-09T21:23:37.208824+0000","last_peered":"2023-07-09T21:23:37.208824+0000","last_clean":"2023-07-09T21:23:37.208824+0000","last_became_active":"2023-07-09T21:23:37.207389+0000","last_became_peered":"2023-07-09T21:23:37.207389+0000","last_unstale":"2023-07-09T21:23:37.208824+0000","last_undegraded":"2023-07-09T21:23:37.208824+0000","last_fullsized":"2023-07-09T21:23:37.208824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:56.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191820+0000","last_change":"2023-07-09T21:23:37.191820+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191820+0000","last_undegraded":"2023-07-09T21:23:37.191820+0000","last_fullsized":"2023-07-09T21:23:37.191820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205449+0000","last_change":"2023-07-09T21:23:37.200272+0000","last_active":"2023-07-09T21:23:37.205449+0000","last_peered":"2023-07-09T21:23:37.205449+0000","last_clean":"2023-07-09T21:23:37.205449+0000","last_became_active":"2023-07-09T21:23:37.199958+0000","last_became_peered":"2023-07-09T21:23:37.199958+0000","last_unstale":"2023-07-09T21:23:37.205449+0000","last_undegraded":"2023-07-09T21:23:37.205449+0000","last_fullsized":"2023-07-09T21:23:37.205449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184146+0000","last_change":"2023-07-09T21:23:37.184146+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184146+0000","last_undegraded":"2023-07-09T21:23:37.184146+0000","last_fullsized":"2023-07-09T21:23:37.184146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199602+0000","last_change":"2023-07-09T21:23:37.196773+0000","last_active":"2023-07-09T21:23:37.199602+0000","last_peered":"2023-07-09T21:23:37.199602+0000","last_clean":"2023-07-09T21:23:37.199602+0000","last_became_active":"2023-07-09T21:23:37.196447+0000","last_became_peered":"2023-07-09T21:23:37.196447+0000","last_unstale":"2023-07-09T21:23:37.199602+0000","last_undegraded":"2023-07-09T21:23:37.199602+0000","last_fullsized":"2023-07-09T21:23:37.199602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:58:20.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187208+0000","last_change":"2023-07-09T21:23:37.187208+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187208+0000","last_undegraded":"2023-07-09T21:23:37.187208+0000","last_fullsized":"2023-07-09T21:23:37.187208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208100+0000","last_change":"2023-07-09T21:23:37.201060+0000","last_active":"2023-07-09T21:23:37.208100+0000","last_peered":"2023-07-09T21:23:37.208100+0000","last_clean":"2023-07-09T21:23:37.208100+0000","last_became_active":"2023-07-09T21:23:37.200764+0000","last_became_peered":"2023-07-09T21:23:37.200764+0000","last_unstale":"2023-07-09T21:23:37.208100+0000","last_undegraded":"2023-07-09T21:23:37.208100+0000","last_fullsized":"2023-07-09T21:23:37.208100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189822+0000","last_change":"2023-07-09T21:23:37.189822+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189822+0000","last_undegraded":"2023-07-09T21:23:37.189822+0000","last_fullsized":"2023-07-09T21:23:37.189822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207920+0000","last_change":"2023-07-09T21:23:37.201267+0000","last_active":"2023-07-09T21:23:37.207920+0000","last_peered":"2023-07-09T21:23:37.207920+0000","last_clean":"2023-07-09T21:23:37.207920+0000","last_became_active":"2023-07-09T21:23:37.200889+0000","last_became_peered":"2023-07-09T21:23:37.200889+0000","last_unstale":"2023-07-09T21:23:37.207920+0000","last_undegraded":"2023-07-09T21:23:37.207920+0000","last_fullsized":"2023-07-09T21:23:37.207920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191158+0000","last_change":"2023-07-09T21:23:37.191158+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191158+0000","last_undegraded":"2023-07-09T21:23:37.191158+0000","last_fullsized":"2023-07-09T21:23:37.191158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203716+0000","last_change":"2023-07-09T21:23:37.201098+0000","last_active":"2023-07-09T21:23:37.203716+0000","last_peered":"2023-07-09T21:23:37.203716+0000","last_clean":"2023-07-09T21:23:37.203716+0000","last_became_active":"2023-07-09T21:23:37.200492+0000","last_became_peered":"2023-07-09T21:23:37.200492+0000","last_unstale":"2023-07-09T21:23:37.203716+0000","last_undegraded":"2023-07-09T21:23:37.203716+0000","last_fullsized":"2023-07-09T21:23:37.203716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:40.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189578+0000","last_change":"2023-07-09T21:23:37.189578+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189578+0000","last_undegraded":"2023-07-09T21:23:37.189578+0000","last_fullsized":"2023-07-09T21:23:37.189578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203768+0000","last_change":"2023-07-09T21:23:37.200437+0000","last_active":"2023-07-09T21:23:37.203768+0000","last_peered":"2023-07-09T21:23:37.203768+0000","last_clean":"2023-07-09T21:23:37.203768+0000","last_became_active":"2023-07-09T21:23:37.200064+0000","last_became_peered":"2023-07-09T21:23:37.200064+0000","last_unstale":"2023-07-09T21:23:37.203768+0000","last_undegraded":"2023-07-09T21:23:37.203768+0000","last_fullsized":"2023-07-09T21:23:37.203768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.344717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185505+0000","last_change":"2023-07-09T21:23:37.185505+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185505+0000","last_undegraded":"2023-07-09T21:23:37.185505+0000","last_fullsized":"2023-07-09T21:23:37.185505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208833+0000","last_change":"2023-07-09T21:23:37.207562+0000","last_active":"2023-07-09T21:23:37.208833+0000","last_peered":"2023-07-09T21:23:37.208833+0000","last_clean":"2023-07-09T21:23:37.208833+0000","last_became_active":"2023-07-09T21:23:37.207198+0000","last_became_peered":"2023-07-09T21:23:37.207198+0000","last_unstale":"2023-07-09T21:23:37.208833+0000","last_undegraded":"2023-07-09T21:23:37.208833+0000","last_fullsized":"2023-07-09T21:23:37.208833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:02.885873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185287+0000","last_change":"2023-07-09T21:23:37.185287+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185287+0000","last_undegraded":"2023-07-09T21:23:37.185287+0000","last_fullsized":"2023-07-09T21:23:37.185287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200941+0000","last_change":"2023-07-09T21:23:37.198758+0000","last_active":"2023-07-09T21:23:37.200941+0000","last_peered":"2023-07-09T21:23:37.200941+0000","last_clean":"2023-07-09T21:23:37.200941+0000","last_became_active":"2023-07-09T21:23:37.198397+0000","last_became_peered":"2023-07-09T21:23:37.198397+0000","last_unstale":"2023-07-09T21:23:37.200941+0000","last_undegraded":"2023-07-09T21:23:37.200941+0000","last_fullsized":"2023-07-09T21:23:37.200941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:15.211913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191324+0000","last_change":"2023-07-09T21:23:37.191324+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191324+0000","last_undegraded":"2023-07-09T21:23:37.191324+0000","last_fullsized":"2023-07-09T21:23:37.191324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207391+0000","last_change":"2023-07-09T21:23:37.203038+0000","last_active":"2023-07-09T21:23:37.207391+0000","last_peered":"2023-07-09T21:23:37.207391+0000","last_clean":"2023-07-09T21:23:37.207391+0000","last_became_active":"2023-07-09T21:23:37.202669+0000","last_became_peered":"2023-07-09T21:23:37.202669+0000","last_unstale":"2023-07-09T21:23:37.207391+0000","last_undegraded":"2023-07-09T21:23:37.207391+0000","last_fullsized":"2023-07-09T21:23:37.207391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:28:15.632946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186660+0000","last_change":"2023-07-09T21:23:37.186660+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186660+0000","last_undegraded":"2023-07-09T21:23:37.186660+0000","last_fullsized":"2023-07-09T21:23:37.186660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207702+0000","last_change":"2023-07-09T21:23:37.198991+0000","last_active":"2023-07-09T21:23:37.207702+0000","last_peered":"2023-07-09T21:23:37.207702+0000","last_clean":"2023-07-09T21:23:37.207702+0000","last_became_active":"2023-07-09T21:23:37.198697+0000","last_became_peered":"2023-07-09T21:23:37.198697+0000","last_unstale":"2023-07-09T21:23:37.207702+0000","last_undegraded":"2023-07-09T21:23:37.207702+0000","last_fullsized":"2023-07-09T21:23:37.207702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186819+0000","last_change":"2023-07-09T21:23:37.186819+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186819+0000","last_undegraded":"2023-07-09T21:23:37.186819+0000","last_fullsized":"2023-07-09T21:23:37.186819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.211915+0000","last_change":"2023-07-09T21:23:37.208724+0000","last_active":"2023-07-09T21:23:37.211915+0000","last_peered":"2023-07-09T21:23:37.211915+0000","last_clean":"2023-07-09T21:23:37.211915+0000","last_became_active":"2023-07-09T21:23:37.208426+0000","last_became_peered":"2023-07-09T21:23:37.208426+0000","last_unstale":"2023-07-09T21:23:37.211915+0000","last_undegraded":"2023-07-09T21:23:37.211915+0000","last_fullsized":"2023-07-09T21:23:37.211915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:43.089981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195632+0000","last_change":"2023-07-09T21:23:37.195632+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195632+0000","last_undegraded":"2023-07-09T21:23:37.195632+0000","last_fullsized":"2023-07-09T21:23:37.195632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205384+0000","last_change":"2023-07-09T21:23:37.200744+0000","last_active":"2023-07-09T21:23:37.205384+0000","last_peered":"2023-07-09T21:23:37.205384+0000","last_clean":"2023-07-09T21:23:37.205384+0000","last_became_active":"2023-07-09T21:23:37.200385+0000","last_became_peered":"2023-07-09T21:23:37.200385+0000","last_unstale":"2023-07-09T21:23:37.205384+0000","last_undegraded":"2023-07-09T21:23:37.205384+0000","last_fullsized":"2023-07-09T21:23:37.205384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:06:23.401418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.183668+0000","last_change":"2023-07-09T21:23:37.183668+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.183668+0000","last_undegraded":"2023-07-09T21:23:37.183668+0000","last_fullsized":"2023-07-09T21:23:37.183668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205050+0000","last_change":"2023-07-09T21:23:37.202950+0000","last_active":"2023-07-09T21:23:37.205050+0000","last_peered":"2023-07-09T21:23:37.205050+0000","last_clean":"2023-07-09T21:23:37.205050+0000","last_became_active":"2023-07-09T21:23:37.202660+0000","last_became_peered":"2023-07-09T21:23:37.202660+0000","last_unstale":"2023-07-09T21:23:37.205050+0000","last_undegraded":"2023-07-09T21:23:37.205050+0000","last_fullsized":"2023-07-09T21:23:37.205050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:56.528783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185198+0000","last_change":"2023-07-09T21:23:37.185198+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185198+0000","last_undegraded":"2023-07-09T21:23:37.185198+0000","last_fullsized":"2023-07-09T21:23:37.185198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199817+0000","last_change":"2023-07-09T21:23:37.194667+0000","last_active":"2023-07-09T21:23:37.199817+0000","last_peered":"2023-07-09T21:23:37.199817+0000","last_clean":"2023-07-09T21:23:37.199817+0000","last_became_active":"2023-07-09T21:23:37.194395+0000","last_became_peered":"2023-07-09T21:23:37.194395+0000","last_unstale":"2023-07-09T21:23:37.199817+0000","last_undegraded":"2023-07-09T21:23:37.199817+0000","last_fullsized":"2023-07-09T21:23:37.199817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:55.340588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187357+0000","last_change":"2023-07-09T21:23:37.187357+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187357+0000","last_undegraded":"2023-07-09T21:23:37.187357+0000","last_fullsized":"2023-07-09T21:23:37.187357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205401+0000","last_change":"2023-07-09T21:23:37.202646+0000","last_active":"2023-07-09T21:23:37.205401+0000","last_peered":"2023-07-09T21:23:37.205401+0000","last_clean":"2023-07-09T21:23:37.205401+0000","last_became_active":"2023-07-09T21:23:37.202363+0000","last_became_peered":"2023-07-09T21:23:37.202363+0000","last_unstale":"2023-07-09T21:23:37.205401+0000","last_undegraded":"2023-07-09T21:23:37.205401+0000","last_fullsized":"2023-07-09T21:23:37.205401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185914+0000","last_change":"2023-07-09T21:23:37.185914+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185914+0000","last_undegraded":"2023-07-09T21:23:37.185914+0000","last_fullsized":"2023-07-09T21:23:37.185914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204636+0000","last_change":"2023-07-09T21:23:37.201013+0000","last_active":"2023-07-09T21:23:37.204636+0000","last_peered":"2023-07-09T21:23:37.204636+0000","last_clean":"2023-07-09T21:23:37.204636+0000","last_became_active":"2023-07-09T21:23:37.200747+0000","last_became_peered":"2023-07-09T21:23:37.200747+0000","last_unstale":"2023-07-09T21:23:37.204636+0000","last_undegraded":"2023-07-09T21:23:37.204636+0000","last_fullsized":"2023-07-09T21:23:37.204636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:55.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190831+0000","last_change":"2023-07-09T21:23:37.190831+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190831+0000","last_undegraded":"2023-07-09T21:23:37.190831+0000","last_fullsized":"2023-07-09T21:23:37.190831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199774+0000","last_change":"2023-07-09T21:23:37.196001+0000","last_active":"2023-07-09T21:23:37.199774+0000","last_peered":"2023-07-09T21:23:37.199774+0000","last_clean":"2023-07-09T21:23:37.199774+0000","last_became_active":"2023-07-09T21:23:37.195702+0000","last_became_peered":"2023-07-09T21:23:37.195702+0000","last_unstale":"2023-07-09T21:23:37.199774+0000","last_undegraded":"2023-07-09T21:23:37.199774+0000","last_fullsized":"2023-07-09T21:23:37.199774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:12.993263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189370+0000","last_change":"2023-07-09T21:23:37.189370+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189370+0000","last_undegraded":"2023-07-09T21:23:37.189370+0000","last_fullsized":"2023-07-09T21:23:37.189370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204591+0000","last_change":"2023-07-09T21:23:37.200811+0000","last_active":"2023-07-09T21:23:37.204591+0000","last_peered":"2023-07-09T21:23:37.204591+0000","last_clean":"2023-07-09T21:23:37.204591+0000","last_became_active":"2023-07-09T21:23:37.200465+0000","last_became_peered":"2023-07-09T21:23:37.200465+0000","last_unstale":"2023-07-09T21:23:37.204591+0000","last_undegraded":"2023-07-09T21:23:37.204591+0000","last_fullsized":"2023-07-09T21:23:37.204591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.189086+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:23:37.189086+0000","last_peered":"2023-07-09T21:23:37.189086+0000","last_clean":"2023-07-09T21:23:37.189086+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:23:37.189086+0000","last_undegraded":"2023-07-09T21:23:37.189086+0000","last_fullsized":"2023-07-09T21:23:37.189086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:25:06.244008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195491+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:23:37.195491+0000","last_peered":"2023-07-09T21:23:37.195491+0000","last_clean":"2023-07-09T21:23:37.195491+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:23:37.195491+0000","last_undegraded":"2023-07-09T21:23:37.195491+0000","last_fullsized":"2023-07-09T21:23:37.195491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:21.335107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188514+0000","last_change":"2023-07-09T21:23:37.188514+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188514+0000","last_undegraded":"2023-07-09T21:23:37.188514+0000","last_fullsized":"2023-07-09T21:23:37.188514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207655+0000","last_change":"2023-07-09T21:23:37.197379+0000","last_active":"2023-07-09T21:23:37.207655+0000","last_peered":"2023-07-09T21:23:37.207655+0000","last_clean":"2023-07-09T21:23:37.207655+0000","last_became_active":"2023-07-09T21:23:37.197066+0000","last_became_peered":"2023-07-09T21:23:37.197066+0000","last_unstale":"2023-07-09T21:23:37.207655+0000","last_undegraded":"2023-07-09T21:23:37.207655+0000","last_fullsized":"2023-07-09T21:23:37.207655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.188939+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:23:37.188939+0000","last_peered":"2023-07-09T21:23:37.188939+0000","last_clean":"2023-07-09T21:23:37.188939+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:23:37.188939+0000","last_undegraded":"2023-07-09T21:23:37.188939+0000","last_fullsized":"2023-07-09T21:23:37.188939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:56:07.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186741+0000","last_change":"2023-07-09T21:23:37.186741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186741+0000","last_undegraded":"2023-07-09T21:23:37.186741+0000","last_fullsized":"2023-07-09T21:23:37.186741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.197150+0000","last_change":"2023-07-09T21:23:37.193012+0000","last_active":"2023-07-09T21:23:37.197150+0000","last_peered":"2023-07-09T21:23:37.197150+0000","last_clean":"2023-07-09T21:23:37.197150+0000","last_became_active":"2023-07-09T21:23:37.192697+0000","last_became_peered":"2023-07-09T21:23:37.192697+0000","last_unstale":"2023-07-09T21:23:37.197150+0000","last_undegraded":"2023-07-09T21:23:37.197150+0000","last_fullsized":"2023-07-09T21:23:37.197150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:45.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.181302+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:23:37.181302+0000","last_peered":"2023-07-09T21:23:37.181302+0000","last_clean":"2023-07-09T21:23:37.181302+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:23:37.181302+0000","last_undegraded":"2023-07-09T21:23:37.181302+0000","last_fullsized":"2023-07-09T21:23:37.181302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:13.722095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187628+0000","last_change":"2023-07-09T21:23:37.187628+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187628+0000","last_undegraded":"2023-07-09T21:23:37.187628+0000","last_fullsized":"2023-07-09T21:23:37.187628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202533+0000","last_change":"2023-07-09T21:23:37.199308+0000","last_active":"2023-07-09T21:23:37.202533+0000","last_peered":"2023-07-09T21:23:37.202533+0000","last_clean":"2023-07-09T21:23:37.202533+0000","last_became_active":"2023-07-09T21:23:37.199029+0000","last_became_peered":"2023-07-09T21:23:37.199029+0000","last_unstale":"2023-07-09T21:23:37.202533+0000","last_undegraded":"2023-07-09T21:23:37.202533+0000","last_fullsized":"2023-07-09T21:23:37.202533+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:18.349317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195303+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:23:37.195303+0000","last_peered":"2023-07-09T21:23:37.195303+0000","last_clean":"2023-07-09T21:23:37.195303+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:23:37.195303+0000","last_undegraded":"2023-07-09T21:23:37.195303+0000","last_fullsized":"2023-07-09T21:23:37.195303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:31.700784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187329+0000","last_change":"2023-07-09T21:23:37.187329+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187329+0000","last_undegraded":"2023-07-09T21:23:37.187329+0000","last_fullsized":"2023-07-09T21:23:37.187329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202490+0000","last_change":"2023-07-09T21:23:37.198511+0000","last_active":"2023-07-09T21:23:37.202490+0000","last_peered":"2023-07-09T21:23:37.202490+0000","last_clean":"2023-07-09T21:23:37.202490+0000","last_became_active":"2023-07-09T21:23:37.198226+0000","last_became_peered":"2023-07-09T21:23:37.198226+0000","last_unstale":"2023-07-09T21:23:37.202490+0000","last_undegraded":"2023-07-09T21:23:37.202490+0000","last_fullsized":"2023-07-09T21:23:37.202490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184931+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:23:37.184931+0000","last_peered":"2023-07-09T21:23:37.184931+0000","last_clean":"2023-07-09T21:23:37.184931+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:23:37.184931+0000","last_undegraded":"2023-07-09T21:23:37.184931+0000","last_fullsized":"2023-07-09T21:23:37.184931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:26.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187847+0000","last_change":"2023-07-09T21:23:37.187847+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187847+0000","last_undegraded":"2023-07-09T21:23:37.187847+0000","last_fullsized":"2023-07-09T21:23:37.187847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207556+0000","last_change":"2023-07-09T21:23:37.203604+0000","last_active":"2023-07-09T21:23:37.207556+0000","last_peered":"2023-07-09T21:23:37.207556+0000","last_clean":"2023-07-09T21:23:37.207556+0000","last_became_active":"2023-07-09T21:23:37.203306+0000","last_became_peered":"2023-07-09T21:23:37.203306+0000","last_unstale":"2023-07-09T21:23:37.207556+0000","last_undegraded":"2023-07-09T21:23:37.207556+0000","last_fullsized":"2023-07-09T21:23:37.207556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.191596+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:23:37.191596+0000","last_peered":"2023-07-09T21:23:37.191596+0000","last_clean":"2023-07-09T21:23:37.191596+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:23:37.191596+0000","last_undegraded":"2023-07-09T21:23:37.191596+0000","last_fullsized":"2023-07-09T21:23:37.191596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:40.689587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194650+0000","last_change":"2023-07-09T21:23:37.194650+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194650+0000","last_undegraded":"2023-07-09T21:23:37.194650+0000","last_fullsized":"2023-07-09T21:23:37.194650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205466+0000","last_change":"2023-07-09T21:23:37.199737+0000","last_active":"2023-07-09T21:23:37.205466+0000","last_peered":"2023-07-09T21:23:37.205466+0000","last_clean":"2023-07-09T21:23:37.205466+0000","last_became_active":"2023-07-09T21:23:37.199176+0000","last_became_peered":"2023-07-09T21:23:37.199176+0000","last_unstale":"2023-07-09T21:23:37.205466+0000","last_undegraded":"2023-07-09T21:23:37.205466+0000","last_fullsized":"2023-07-09T21:23:37.205466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184583+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:23:37.184583+0000","last_peered":"2023-07-09T21:23:37.184583+0000","last_clean":"2023-07-09T21:23:37.184583+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:23:37.184583+0000","last_undegraded":"2023-07-09T21:23:37.184583+0000","last_fullsized":"2023-07-09T21:23:37.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:06.960119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185692+0000","last_change":"2023-07-09T21:23:37.185692+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185692+0000","last_undegraded":"2023-07-09T21:23:37.185692+0000","last_fullsized":"2023-07-09T21:23:37.185692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200661+0000","last_change":"2023-07-09T21:23:37.197526+0000","last_active":"2023-07-09T21:23:37.200661+0000","last_peered":"2023-07-09T21:23:37.200661+0000","last_clean":"2023-07-09T21:23:37.200661+0000","last_became_active":"2023-07-09T21:23:37.197207+0000","last_became_peered":"2023-07-09T21:23:37.197207+0000","last_unstale":"2023-07-09T21:23:37.200661+0000","last_undegraded":"2023-07-09T21:23:37.200661+0000","last_fullsized":"2023-07-09T21:23:37.200661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:39.261345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.198128+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:23:37.198128+0000","last_peered":"2023-07-09T21:23:37.198128+0000","last_clean":"2023-07-09T21:23:37.198128+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:23:37.198128+0000","last_undegraded":"2023-07-09T21:23:37.198128+0000","last_fullsized":"2023-07-09T21:23:37.198128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:01.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.92800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.745},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65700000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.503}]},{"osd":4,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:23:42.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:23:42.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 Processor -- start 2023-07-09T21:23:42.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 -- start start 2023-07-09T21:23:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff4680af830 0x7ff4680afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680cbe90 con 0x7ff4680cc320 2023-07-09T21:23:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4680b0140 con 0x7ff46806f6d0 2023-07-09T21:23:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff470511640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46806d370 con 0x7ff4680af830 2023-07-09T21:23:42.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46daac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff4680cc320 0x7ff46806efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49442/0 (socket says 172.21.15.37:49442) 2023-07-09T21:23:42.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46daac640 1 -- 172.21.15.37:0/3502246950 learned_addr learned my addr 172.21.15.37:0/3502246950 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:42.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921864973 0 0) 0x7ff4680cbe90 con 0x7ff4680cc320 2023-07-09T21:23:42.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46e2ad640 1 --2- 172.21.15.37:0/3502246950 >> v2:172.21.15.119:3300/0 conn(0x7ff4680af830 0x7ff4680afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff454003530 con 0x7ff4680cc320 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 109860745 0 0) 0x7ff454003530 con 0x7ff4680cc320 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 >> v2:172.21.15.119:3300/0 conn(0x7ff4680af830 msgr2=0x7ff4680afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 --2- 172.21.15.37:0/3502246950 >> v2:172.21.15.119:3300/0 conn(0x7ff4680af830 0x7ff4680afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 >> v1:172.21.15.119:6789/0 conn(0x7ff46806f6d0 legacy=0x7ff46806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff468159bb0 con 0x7ff4680cc320 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ff458001680 con 0x7ff4680cc320 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 >> v1:172.21.15.37:6789/0 conn(0x7ff4680cc320 legacy=0x7ff46806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff454003980 0x7ff454003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff454004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff454005180 0x7ff45400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46806d370 con 0x7ff4540047d0 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45400c000 con 0x7ff454003980 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.885+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45400c1c0 con 0x7ff454005180 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff454004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46e2ad640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff454003980 0x7ff454003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46eaae640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff454005180 0x7ff45400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 -- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff454005180 msgr2=0x7ff45400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff454005180 0x7ff45400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 -- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff454003980 msgr2=0x7ff454003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff454003980 0x7ff454003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 -- 172.21.15.37:0/3502246950 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454003530 con 0x7ff4540047d0 2023-07-09T21:23:42.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46eaae640 1 -- 172.21.15.37:0/3502246950 reap_dead start 2023-07-09T21:23:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46daac640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff454004c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c240 tx=0x7ff45801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546ea1d304cb1d32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580058e0 con 0x7ff4540047d0 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005a40 con 0x7ff4540047d0 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff46d2ab640 1 -- 172.21.15.37:0/3502246950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458005e70 con 0x7ff4540047d0 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff470511640 1 -- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 msgr2=0x7ff454004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.889+0000 7ff470511640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff454004c40 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff45800c240 tx=0x7ff45801f3b0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- 172.21.15.37:0/3502246950 shutdown_connections 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 --2- 172.21.15.37:0/3502246950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff454004c40 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- 172.21.15.37:0/3502246950 >> 172.21.15.37:0/3502246950 conn(0x7ff4680ca830 msgr2=0x7ff4680cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:42.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- 172.21.15.37:0/3502246950 shutdown_connections 2023-07-09T21:23:42.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- 172.21.15.37:0/3502246950 wait complete. 2023-07-09T21:23:42.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 Processor -- start 2023-07-09T21:23:42.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- start start 2023-07-09T21:23:42.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46815a010 0x7ff4680b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4680b1120 0x7ff468157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680b15c0 con 0x7ff4540047d0 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4680c9d40 con 0x7ff46815a010 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff470511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46815b390 con 0x7ff4680b1120 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38380/0 (socket says 172.21.15.37:38380) 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 -- 172.21.15.37:0/1561741576 learned_addr learned my addr 172.21.15.37:0/1561741576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:42.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46daac640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46815a010 0x7ff4680b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46eaae640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4680b1120 0x7ff468157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 -- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4680b1120 msgr2=0x7ff468157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4680b1120 0x7ff468157920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 -- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46815a010 msgr2=0x7ff4680b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46815a010 0x7ff4680b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.893+0000 7ff46e2ad640 1 -- 172.21.15.37:0/1561741576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46815a780 con 0x7ff4540047d0 2023-07-09T21:23:42.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff46e2ad640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff464011ad0 tx=0x7ff464011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46400fb50 con 0x7ff4540047d0 2023-07-09T21:23:42.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46400fcb0 con 0x7ff4540047d0 2023-07-09T21:23:42.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464014440 con 0x7ff4540047d0 2023-07-09T21:23:42.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46815aa60 con 0x7ff4540047d0 2023-07-09T21:23:42.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46815b020 con 0x7ff4540047d0 2023-07-09T21:23:42.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46804d7d0 con 0x7ff4540047d0 2023-07-09T21:23:42.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff4640145c0 con 0x7ff4540047d0 2023-07-09T21:23:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 0x7ff44c068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff464084610 con 0x7ff4540047d0 2023-07-09T21:23:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.897+0000 7ff46daac640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 0x7ff44c068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.901+0000 7ff46daac640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 0x7ff44c068760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4580ae000 tx=0x7ff4580aa070 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:42.901+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff464051a90 con 0x7ff4540047d0 2023-07-09T21:23:43.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.057+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff46806cdb0 con 0x7ff44c0662b0 2023-07-09T21:23:43.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.065+0000 7ff45effd640 1 -- 172.21.15.37:0/1561741576 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306014 (secure 0 0 0) 0x7ff4580b8040 con 0x7ff44c0662b0 2023-07-09T21:23:43.069 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:43.070 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:23:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 msgr2=0x7ff44c068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 0x7ff44c068760 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4580ae000 tx=0x7ff4580aa070 comp rx=0 tx=0).stop 2023-07-09T21:23:43.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 msgr2=0x7ff4681f1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff464011ad0 tx=0x7ff464011f90 comp rx=0 tx=0).stop 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 shutdown_connections 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ff44c0662b0 0x7ff44c068760 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff4680b1120 0x7ff468157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff46815a010 0x7ff4680b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 --2- 172.21.15.37:0/1561741576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4540047d0 0x7ff4681f1330 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 >> 172.21.15.37:0/1561741576 conn(0x7ff4680ca830 msgr2=0x7ff4680ad7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:43.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 shutdown_connections 2023-07-09T21:23:43.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.069+0000 7ff470511640 1 -- 172.21.15.37:0/1561741576 wait complete. 2023-07-09T21:23:43.089 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-09T21:23:41.969776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223964,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750756,"statfs":{"total":773094113280,"available":772864774144,"internally_reserved":0,"allocated":4354048,"data_stored":2466964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795332"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186531+0000","last_change":"2023-07-09T21:23:37.186531+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186531+0000","last_undegraded":"2023-07-09T21:23:37.186531+0000","last_fullsized":"2023-07-09T21:23:37.186531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188108+0000","last_change":"2023-07-09T21:23:37.188108+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188108+0000","last_undegraded":"2023-07-09T21:23:37.188108+0000","last_fullsized":"2023-07-09T21:23:37.188108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189333+0000","last_change":"2023-07-09T21:23:37.189333+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189333+0000","last_undegraded":"2023-07-09T21:23:37.189333+0000","last_fullsized":"2023-07-09T21:23:37.189333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184741+0000","last_change":"2023-07-09T21:23:37.184741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184741+0000","last_undegraded":"2023-07-09T21:23:37.184741+0000","last_fullsized":"2023-07-09T21:23:37.184741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184404+0000","last_change":"2023-07-09T21:23:37.184404+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184404+0000","last_undegraded":"2023-07-09T21:23:37.184404+0000","last_fullsized":"2023-07-09T21:23:37.184404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188406+0000","last_change":"2023-07-09T21:23:37.188406+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188406+0000","last_undegraded":"2023-07-09T21:23:37.188406+0000","last_fullsized":"2023-07-09T21:23:37.188406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192519+0000","last_change":"2023-07-09T21:23:37.192519+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192519+0000","last_undegraded":"2023-07-09T21:23:37.192519+0000","last_fullsized":"2023-07-09T21:23:37.192519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190274+0000","last_change":"2023-07-09T21:23:37.190274+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190274+0000","last_undegraded":"2023-07-09T21:23:37.190274+0000","last_fullsized":"2023-07-09T21:23:37.190274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190250+0000","last_change":"2023-07-09T21:23:37.190250+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190250+0000","last_undegraded":"2023-07-09T21:23:37.190250+0000","last_fullsized":"2023-07-09T21:23:37.190250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185430+0000","last_change":"2023-07-09T21:23:37.185430+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185430+0000","last_undegraded":"2023-07-09T21:23:37.185430+0000","last_fullsized":"2023-07-09T21:23:37.185430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187297+0000","last_change":"2023-07-09T21:23:37.187297+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187297+0000","last_undegraded":"2023-07-09T21:23:37.187297+0000","last_fullsized":"2023-07-09T21:23:37.187297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189875+0000","last_change":"2023-07-09T21:23:37.189875+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189875+0000","last_undegraded":"2023-07-09T21:23:37.189875+0000","last_fullsized":"2023-07-09T21:23:37.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184098+0000","last_change":"2023-07-09T21:23:37.184098+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184098+0000","last_undegraded":"2023-07-09T21:23:37.184098+0000","last_fullsized":"2023-07-09T21:23:37.184098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.196818+0000","last_change":"2023-07-09T21:23:37.196818+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.196818+0000","last_undegraded":"2023-07-09T21:23:37.196818+0000","last_fullsized":"2023-07-09T21:23:37.196818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192006+0000","last_change":"2023-07-09T21:23:37.192006+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192006+0000","last_undegraded":"2023-07-09T21:23:37.192006+0000","last_fullsized":"2023-07-09T21:23:37.192006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185805+0000","last_change":"2023-07-09T21:23:37.185805+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185805+0000","last_undegraded":"2023-07-09T21:23:37.185805+0000","last_fullsized":"2023-07-09T21:23:37.185805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187773+0000","last_change":"2023-07-09T21:23:37.187773+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187773+0000","last_undegraded":"2023-07-09T21:23:37.187773+0000","last_fullsized":"2023-07-09T21:23:37.187773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188178+0000","last_change":"2023-07-09T21:23:37.188178+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188178+0000","last_undegraded":"2023-07-09T21:23:37.188178+0000","last_fullsized":"2023-07-09T21:23:37.188178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184077+0000","last_change":"2023-07-09T21:23:37.184077+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184077+0000","last_undegraded":"2023-07-09T21:23:37.184077+0000","last_fullsized":"2023-07-09T21:23:37.184077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189143+0000","last_change":"2023-07-09T21:23:37.189143+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189143+0000","last_undegraded":"2023-07-09T21:23:37.189143+0000","last_fullsized":"2023-07-09T21:23:37.189143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189344+0000","last_change":"2023-07-09T21:23:37.189344+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189344+0000","last_undegraded":"2023-07-09T21:23:37.189344+0000","last_fullsized":"2023-07-09T21:23:37.189344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.193085+0000","last_change":"2023-07-09T21:23:37.193085+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.193085+0000","last_undegraded":"2023-07-09T21:23:37.193085+0000","last_fullsized":"2023-07-09T21:23:37.193085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185908+0000","last_change":"2023-07-09T21:23:37.185908+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185908+0000","last_undegraded":"2023-07-09T21:23:37.185908+0000","last_fullsized":"2023-07-09T21:23:37.185908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184589+0000","last_change":"2023-07-09T21:23:37.184589+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184589+0000","last_undegraded":"2023-07-09T21:23:37.184589+0000","last_fullsized":"2023-07-09T21:23:37.184589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191291+0000","last_change":"2023-07-09T21:23:37.191291+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191291+0000","last_undegraded":"2023-07-09T21:23:37.191291+0000","last_fullsized":"2023-07-09T21:23:37.191291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188013+0000","last_change":"2023-07-09T21:23:37.188013+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188013+0000","last_undegraded":"2023-07-09T21:23:37.188013+0000","last_fullsized":"2023-07-09T21:23:37.188013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188809+0000","last_change":"2023-07-09T21:23:37.188809+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188809+0000","last_undegraded":"2023-07-09T21:23:37.188809+0000","last_fullsized":"2023-07-09T21:23:37.188809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186390+0000","last_change":"2023-07-09T21:23:37.186390+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186390+0000","last_undegraded":"2023-07-09T21:23:37.186390+0000","last_fullsized":"2023-07-09T21:23:37.186390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187523+0000","last_change":"2023-07-09T21:23:37.187523+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187523+0000","last_undegraded":"2023-07-09T21:23:37.187523+0000","last_fullsized":"2023-07-09T21:23:37.187523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188243+0000","last_change":"2023-07-09T21:23:37.188243+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188243+0000","last_undegraded":"2023-07-09T21:23:37.188243+0000","last_fullsized":"2023-07-09T21:23:37.188243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185244+0000","last_change":"2023-07-09T21:23:37.185244+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185244+0000","last_undegraded":"2023-07-09T21:23:37.185244+0000","last_fullsized":"2023-07-09T21:23:37.185244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188732+0000","last_change":"2023-07-09T21:23:37.188732+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188732+0000","last_undegraded":"2023-07-09T21:23:37.188732+0000","last_fullsized":"2023-07-09T21:23:37.188732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188141+0000","last_change":"2023-07-09T21:23:37.188141+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188141+0000","last_undegraded":"2023-07-09T21:23:37.188141+0000","last_fullsized":"2023-07-09T21:23:37.188141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208541+0000","last_change":"2023-07-09T21:23:37.205856+0000","last_active":"2023-07-09T21:23:37.208541+0000","last_peered":"2023-07-09T21:23:37.208541+0000","last_clean":"2023-07-09T21:23:37.208541+0000","last_became_active":"2023-07-09T21:23:37.205568+0000","last_became_peered":"2023-07-09T21:23:37.205568+0000","last_unstale":"2023-07-09T21:23:37.208541+0000","last_undegraded":"2023-07-09T21:23:37.208541+0000","last_fullsized":"2023-07-09T21:23:37.208541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:25.111293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189520+0000","last_change":"2023-07-09T21:23:37.189520+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189520+0000","last_undegraded":"2023-07-09T21:23:37.189520+0000","last_fullsized":"2023-07-09T21:23:37.189520+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203658+0000","last_change":"2023-07-09T21:23:37.200996+0000","last_active":"2023-07-09T21:23:37.203658+0000","last_peered":"2023-07-09T21:23:37.203658+0000","last_clean":"2023-07-09T21:23:37.203658+0000","last_became_active":"2023-07-09T21:23:37.200647+0000","last_became_peered":"2023-07-09T21:23:37.200647+0000","last_unstale":"2023-07-09T21:23:37.203658+0000","last_undegraded":"2023-07-09T21:23:37.203658+0000","last_fullsized":"2023-07-09T21:23:37.203658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:37.644270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195040+0000","last_change":"2023-07-09T21:23:37.195040+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195040+0000","last_undegraded":"2023-07-09T21:23:37.195040+0000","last_fullsized":"2023-07-09T21:23:37.195040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205065+0000","last_change":"2023-07-09T21:23:37.203576+0000","last_active":"2023-07-09T21:23:37.205065+0000","last_peered":"2023-07-09T21:23:37.205065+0000","last_clean":"2023-07-09T21:23:37.205065+0000","last_became_active":"2023-07-09T21:23:37.203281+0000","last_became_peered":"2023-07-09T21:23:37.203281+0000","last_unstale":"2023-07-09T21:23:37.205065+0000","last_undegraded":"2023-07-09T21:23:37.205065+0000","last_fullsized":"2023-07-09T21:23:37.205065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185936+0000","last_change":"2023-07-09T21:23:37.185936+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185936+0000","last_undegraded":"2023-07-09T21:23:37.185936+0000","last_fullsized":"2023-07-09T21:23:37.185936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205402+0000","last_change":"2023-07-09T21:23:37.199060+0000","last_active":"2023-07-09T21:23:37.205402+0000","last_peered":"2023-07-09T21:23:37.205402+0000","last_clean":"2023-07-09T21:23:37.205402+0000","last_became_active":"2023-07-09T21:23:37.198702+0000","last_became_peered":"2023-07-09T21:23:37.198702+0000","last_unstale":"2023-07-09T21:23:37.205402+0000","last_undegraded":"2023-07-09T21:23:37.205402+0000","last_fullsized":"2023-07-09T21:23:37.205402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190128+0000","last_change":"2023-07-09T21:23:37.190128+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190128+0000","last_undegraded":"2023-07-09T21:23:37.190128+0000","last_fullsized":"2023-07-09T21:23:37.190128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207953+0000","last_change":"2023-07-09T21:23:37.201618+0000","last_active":"2023-07-09T21:23:37.207953+0000","last_peered":"2023-07-09T21:23:37.207953+0000","last_clean":"2023-07-09T21:23:37.207953+0000","last_became_active":"2023-07-09T21:23:37.201315+0000","last_became_peered":"2023-07-09T21:23:37.201315+0000","last_unstale":"2023-07-09T21:23:37.207953+0000","last_undegraded":"2023-07-09T21:23:37.207953+0000","last_fullsized":"2023-07-09T21:23:37.207953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184189+0000","last_change":"2023-07-09T21:23:37.184189+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184189+0000","last_undegraded":"2023-07-09T21:23:37.184189+0000","last_fullsized":"2023-07-09T21:23:37.184189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208983+0000","last_change":"2023-07-09T21:23:37.205993+0000","last_active":"2023-07-09T21:23:37.208983+0000","last_peered":"2023-07-09T21:23:37.208983+0000","last_clean":"2023-07-09T21:23:37.208983+0000","last_became_active":"2023-07-09T21:23:37.205740+0000","last_became_peered":"2023-07-09T21:23:37.205740+0000","last_unstale":"2023-07-09T21:23:37.208983+0000","last_undegraded":"2023-07-09T21:23:37.208983+0000","last_fullsized":"2023-07-09T21:23:37.208983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:03.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194186+0000","last_change":"2023-07-09T21:23:37.194186+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194186+0000","last_undegraded":"2023-07-09T21:23:37.194186+0000","last_fullsized":"2023-07-09T21:23:37.194186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208824+0000","last_change":"2023-07-09T21:23:37.207663+0000","last_active":"2023-07-09T21:23:37.208824+0000","last_peered":"2023-07-09T21:23:37.208824+0000","last_clean":"2023-07-09T21:23:37.208824+0000","last_became_active":"2023-07-09T21:23:37.207389+0000","last_became_peered":"2023-07-09T21:23:37.207389+0000","last_unstale":"2023-07-09T21:23:37.208824+0000","last_undegraded":"2023-07-09T21:23:37.208824+0000","last_fullsized":"2023-07-09T21:23:37.208824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:56.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191820+0000","last_change":"2023-07-09T21:23:37.191820+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191820+0000","last_undegraded":"2023-07-09T21:23:37.191820+0000","last_fullsized":"2023-07-09T21:23:37.191820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205449+0000","last_change":"2023-07-09T21:23:37.200272+0000","last_active":"2023-07-09T21:23:37.205449+0000","last_peered":"2023-07-09T21:23:37.205449+0000","last_clean":"2023-07-09T21:23:37.205449+0000","last_became_active":"2023-07-09T21:23:37.199958+0000","last_became_peered":"2023-07-09T21:23:37.199958+0000","last_unstale":"2023-07-09T21:23:37.205449+0000","last_undegraded":"2023-07-09T21:23:37.205449+0000","last_fullsized":"2023-07-09T21:23:37.205449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184146+0000","last_change":"2023-07-09T21:23:37.184146+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184146+0000","last_undegraded":"2023-07-09T21:23:37.184146+0000","last_fullsized":"2023-07-09T21:23:37.184146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199602+0000","last_change":"2023-07-09T21:23:37.196773+0000","last_active":"2023-07-09T21:23:37.199602+0000","last_peered":"2023-07-09T21:23:37.199602+0000","last_clean":"2023-07-09T21:23:37.199602+0000","last_became_active":"2023-07-09T21:23:37.196447+0000","last_became_peered":"2023-07-09T21:23:37.196447+0000","last_unstale":"2023-07-09T21:23:37.199602+0000","last_undegraded":"2023-07-09T21:23:37.199602+0000","last_fullsized":"2023-07-09T21:23:37.199602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:58:20.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187208+0000","last_change":"2023-07-09T21:23:37.187208+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187208+0000","last_undegraded":"2023-07-09T21:23:37.187208+0000","last_fullsized":"2023-07-09T21:23:37.187208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208100+0000","last_change":"2023-07-09T21:23:37.201060+0000","last_active":"2023-07-09T21:23:37.208100+0000","last_peered":"2023-07-09T21:23:37.208100+0000","last_clean":"2023-07-09T21:23:37.208100+0000","last_became_active":"2023-07-09T21:23:37.200764+0000","last_became_peered":"2023-07-09T21:23:37.200764+0000","last_unstale":"2023-07-09T21:23:37.208100+0000","last_undegraded":"2023-07-09T21:23:37.208100+0000","last_fullsized":"2023-07-09T21:23:37.208100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189822+0000","last_change":"2023-07-09T21:23:37.189822+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189822+0000","last_undegraded":"2023-07-09T21:23:37.189822+0000","last_fullsized":"2023-07-09T21:23:37.189822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207920+0000","last_change":"2023-07-09T21:23:37.201267+0000","last_active":"2023-07-09T21:23:37.207920+0000","last_peered":"2023-07-09T21:23:37.207920+0000","last_clean":"2023-07-09T21:23:37.207920+0000","last_became_active":"2023-07-09T21:23:37.200889+0000","last_became_peered":"2023-07-09T21:23:37.200889+0000","last_unstale":"2023-07-09T21:23:37.207920+0000","last_undegraded":"2023-07-09T21:23:37.207920+0000","last_fullsized":"2023-07-09T21:23:37.207920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191158+0000","last_change":"2023-07-09T21:23:37.191158+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191158+0000","last_undegraded":"2023-07-09T21:23:37.191158+0000","last_fullsized":"2023-07-09T21:23:37.191158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203716+0000","last_change":"2023-07-09T21:23:37.201098+0000","last_active":"2023-07-09T21:23:37.203716+0000","last_peered":"2023-07-09T21:23:37.203716+0000","last_clean":"2023-07-09T21:23:37.203716+0000","last_became_active":"2023-07-09T21:23:37.200492+0000","last_became_peered":"2023-07-09T21:23:37.200492+0000","last_unstale":"2023-07-09T21:23:37.203716+0000","last_undegraded":"2023-07-09T21:23:37.203716+0000","last_fullsized":"2023-07-09T21:23:37.203716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:40.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189578+0000","last_change":"2023-07-09T21:23:37.189578+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189578+0000","last_undegraded":"2023-07-09T21:23:37.189578+0000","last_fullsized":"2023-07-09T21:23:37.189578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203768+0000","last_change":"2023-07-09T21:23:37.200437+0000","last_active":"2023-07-09T21:23:37.203768+0000","last_peered":"2023-07-09T21:23:37.203768+0000","last_clean":"2023-07-09T21:23:37.203768+0000","last_became_active":"2023-07-09T21:23:37.200064+0000","last_became_peered":"2023-07-09T21:23:37.200064+0000","last_unstale":"2023-07-09T21:23:37.203768+0000","last_undegraded":"2023-07-09T21:23:37.203768+0000","last_fullsized":"2023-07-09T21:23:37.203768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.344717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185505+0000","last_change":"2023-07-09T21:23:37.185505+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185505+0000","last_undegraded":"2023-07-09T21:23:37.185505+0000","last_fullsized":"2023-07-09T21:23:37.185505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208833+0000","last_change":"2023-07-09T21:23:37.207562+0000","last_active":"2023-07-09T21:23:37.208833+0000","last_peered":"2023-07-09T21:23:37.208833+0000","last_clean":"2023-07-09T21:23:37.208833+0000","last_became_active":"2023-07-09T21:23:37.207198+0000","last_became_peered":"2023-07-09T21:23:37.207198+0000","last_unstale":"2023-07-09T21:23:37.208833+0000","last_undegraded":"2023-07-09T21:23:37.208833+0000","last_fullsized":"2023-07-09T21:23:37.208833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:02.885873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185287+0000","last_change":"2023-07-09T21:23:37.185287+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185287+0000","last_undegraded":"2023-07-09T21:23:37.185287+0000","last_fullsized":"2023-07-09T21:23:37.185287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200941+0000","last_change":"2023-07-09T21:23:37.198758+0000","last_active":"2023-07-09T21:23:37.200941+0000","last_peered":"2023-07-09T21:23:37.200941+0000","last_clean":"2023-07-09T21:23:37.200941+0000","last_became_active":"2023-07-09T21:23:37.198397+0000","last_became_peered":"2023-07-09T21:23:37.198397+0000","last_unstale":"2023-07-09T21:23:37.200941+0000","last_undegraded":"2023-07-09T21:23:37.200941+0000","last_fullsized":"2023-07-09T21:23:37.200941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:15.211913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191324+0000","last_change":"2023-07-09T21:23:37.191324+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191324+0000","last_undegraded":"2023-07-09T21:23:37.191324+0000","last_fullsized":"2023-07-09T21:23:37.191324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207391+0000","last_change":"2023-07-09T21:23:37.203038+0000","last_active":"2023-07-09T21:23:37.207391+0000","last_peered":"2023-07-09T21:23:37.207391+0000","last_clean":"2023-07-09T21:23:37.207391+0000","last_became_active":"2023-07-09T21:23:37.202669+0000","last_became_peered":"2023-07-09T21:23:37.202669+0000","last_unstale":"2023-07-09T21:23:37.207391+0000","last_undegraded":"2023-07-09T21:23:37.207391+0000","last_fullsized":"2023-07-09T21:23:37.207391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:28:15.632946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186660+0000","last_change":"2023-07-09T21:23:37.186660+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186660+0000","last_undegraded":"2023-07-09T21:23:37.186660+0000","last_fullsized":"2023-07-09T21:23:37.186660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207702+0000","last_change":"2023-07-09T21:23:37.198991+0000","last_active":"2023-07-09T21:23:37.207702+0000","last_peered":"2023-07-09T21:23:37.207702+0000","last_clean":"2023-07-09T21:23:37.207702+0000","last_became_active":"2023-07-09T21:23:37.198697+0000","last_became_peered":"2023-07-09T21:23:37.198697+0000","last_unstale":"2023-07-09T21:23:37.207702+0000","last_undegraded":"2023-07-09T21:23:37.207702+0000","last_fullsized":"2023-07-09T21:23:37.207702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186819+0000","last_change":"2023-07-09T21:23:37.186819+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186819+0000","last_undegraded":"2023-07-09T21:23:37.186819+0000","last_fullsized":"2023-07-09T21:23:37.186819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.211915+0000","last_change":"2023-07-09T21:23:37.208724+0000","last_active":"2023-07-09T21:23:37.211915+0000","last_peered":"2023-07-09T21:23:37.211915+0000","last_clean":"2023-07-09T21:23:37.211915+0000","last_became_active":"2023-07-09T21:23:37.208426+0000","last_became_peered":"2023-07-09T21:23:37.208426+0000","last_unstale":"2023-07-09T21:23:37.211915+0000","last_undegraded":"2023-07-09T21:23:37.211915+0000","last_fullsized":"2023-07-09T21:23:37.211915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:43.089981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195632+0000","last_change":"2023-07-09T21:23:37.195632+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195632+0000","last_undegraded":"2023-07-09T21:23:37.195632+0000","last_fullsized":"2023-07-09T21:23:37.195632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205384+0000","last_change":"2023-07-09T21:23:37.200744+0000","last_active":"2023-07-09T21:23:37.205384+0000","last_peered":"2023-07-09T21:23:37.205384+0000","last_clean":"2023-07-09T21:23:37.205384+0000","last_became_active":"2023-07-09T21:23:37.200385+0000","last_became_peered":"2023-07-09T21:23:37.200385+0000","last_unstale":"2023-07-09T21:23:37.205384+0000","last_undegraded":"2023-07-09T21:23:37.205384+0000","last_fullsized":"2023-07-09T21:23:37.205384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:06:23.401418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.183668+0000","last_change":"2023-07-09T21:23:37.183668+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.183668+0000","last_undegraded":"2023-07-09T21:23:37.183668+0000","last_fullsized":"2023-07-09T21:23:37.183668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205050+0000","last_change":"2023-07-09T21:23:37.202950+0000","last_active":"2023-07-09T21:23:37.205050+0000","last_peered":"2023-07-09T21:23:37.205050+0000","last_clean":"2023-07-09T21:23:37.205050+0000","last_became_active":"2023-07-09T21:23:37.202660+0000","last_became_peered":"2023-07-09T21:23:37.202660+0000","last_unstale":"2023-07-09T21:23:37.205050+0000","last_undegraded":"2023-07-09T21:23:37.205050+0000","last_fullsized":"2023-07-09T21:23:37.205050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:56.528783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185198+0000","last_change":"2023-07-09T21:23:37.185198+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185198+0000","last_undegraded":"2023-07-09T21:23:37.185198+0000","last_fullsized":"2023-07-09T21:23:37.185198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199817+0000","last_change":"2023-07-09T21:23:37.194667+0000","last_active":"2023-07-09T21:23:37.199817+0000","last_peered":"2023-07-09T21:23:37.199817+0000","last_clean":"2023-07-09T21:23:37.199817+0000","last_became_active":"2023-07-09T21:23:37.194395+0000","last_became_peered":"2023-07-09T21:23:37.194395+0000","last_unstale":"2023-07-09T21:23:37.199817+0000","last_undegraded":"2023-07-09T21:23:37.199817+0000","last_fullsized":"2023-07-09T21:23:37.199817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:55.340588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187357+0000","last_change":"2023-07-09T21:23:37.187357+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187357+0000","last_undegraded":"2023-07-09T21:23:37.187357+0000","last_fullsized":"2023-07-09T21:23:37.187357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205401+0000","last_change":"2023-07-09T21:23:37.202646+0000","last_active":"2023-07-09T21:23:37.205401+0000","last_peered":"2023-07-09T21:23:37.205401+0000","last_clean":"2023-07-09T21:23:37.205401+0000","last_became_active":"2023-07-09T21:23:37.202363+0000","last_became_peered":"2023-07-09T21:23:37.202363+0000","last_unstale":"2023-07-09T21:23:37.205401+0000","last_undegraded":"2023-07-09T21:23:37.205401+0000","last_fullsized":"2023-07-09T21:23:37.205401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185914+0000","last_change":"2023-07-09T21:23:37.185914+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185914+0000","last_undegraded":"2023-07-09T21:23:37.185914+0000","last_fullsized":"2023-07-09T21:23:37.185914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204636+0000","last_change":"2023-07-09T21:23:37.201013+0000","last_active":"2023-07-09T21:23:37.204636+0000","last_peered":"2023-07-09T21:23:37.204636+0000","last_clean":"2023-07-09T21:23:37.204636+0000","last_became_active":"2023-07-09T21:23:37.200747+0000","last_became_peered":"2023-07-09T21:23:37.200747+0000","last_unstale":"2023-07-09T21:23:37.204636+0000","last_undegraded":"2023-07-09T21:23:37.204636+0000","last_fullsized":"2023-07-09T21:23:37.204636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:55.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190831+0000","last_change":"2023-07-09T21:23:37.190831+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190831+0000","last_undegraded":"2023-07-09T21:23:37.190831+0000","last_fullsized":"2023-07-09T21:23:37.190831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199774+0000","last_change":"2023-07-09T21:23:37.196001+0000","last_active":"2023-07-09T21:23:37.199774+0000","last_peered":"2023-07-09T21:23:37.199774+0000","last_clean":"2023-07-09T21:23:37.199774+0000","last_became_active":"2023-07-09T21:23:37.195702+0000","last_became_peered":"2023-07-09T21:23:37.195702+0000","last_unstale":"2023-07-09T21:23:37.199774+0000","last_undegraded":"2023-07-09T21:23:37.199774+0000","last_fullsized":"2023-07-09T21:23:37.199774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:12.993263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189370+0000","last_change":"2023-07-09T21:23:37.189370+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189370+0000","last_undegraded":"2023-07-09T21:23:37.189370+0000","last_fullsized":"2023-07-09T21:23:37.189370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204591+0000","last_change":"2023-07-09T21:23:37.200811+0000","last_active":"2023-07-09T21:23:37.204591+0000","last_peered":"2023-07-09T21:23:37.204591+0000","last_clean":"2023-07-09T21:23:37.204591+0000","last_became_active":"2023-07-09T21:23:37.200465+0000","last_became_peered":"2023-07-09T21:23:37.200465+0000","last_unstale":"2023-07-09T21:23:37.204591+0000","last_undegraded":"2023-07-09T21:23:37.204591+0000","last_fullsized":"2023-07-09T21:23:37.204591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.189086+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:23:37.189086+0000","last_peered":"2023-07-09T21:23:37.189086+0000","last_clean":"2023-07-09T21:23:37.189086+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:23:37.189086+0000","last_undegraded":"2023-07-09T21:23:37.189086+0000","last_fullsized":"2023-07-09T21:23:37.189086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:25:06.244008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195491+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:23:37.195491+0000","last_peered":"2023-07-09T21:23:37.195491+0000","last_clean":"2023-07-09T21:23:37.195491+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:23:37.195491+0000","last_undegraded":"2023-07-09T21:23:37.195491+0000","last_fullsized":"2023-07-09T21:23:37.195491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:21.335107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188514+0000","last_change":"2023-07-09T21:23:37.188514+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188514+0000","last_undegraded":"2023-07-09T21:23:37.188514+0000","last_fullsized":"2023-07-09T21:23:37.188514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207655+0000","last_change":"2023-07-09T21:23:37.197379+0000","last_active":"2023-07-09T21:23:37.207655+0000","last_peered":"2023-07-09T21:23:37.207655+0000","last_clean":"2023-07-09T21:23:37.207655+0000","last_became_active":"2023-07-09T21:23:37.197066+0000","last_became_peered":"2023-07-09T21:23:37.197066+0000","last_unstale":"2023-07-09T21:23:37.207655+0000","last_undegraded":"2023-07-09T21:23:37.207655+0000","last_fullsized":"2023-07-09T21:23:37.207655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.188939+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:23:37.188939+0000","last_peered":"2023-07-09T21:23:37.188939+0000","last_clean":"2023-07-09T21:23:37.188939+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:23:37.188939+0000","last_undegraded":"2023-07-09T21:23:37.188939+0000","last_fullsized":"2023-07-09T21:23:37.188939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:56:07.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186741+0000","last_change":"2023-07-09T21:23:37.186741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186741+0000","last_undegraded":"2023-07-09T21:23:37.186741+0000","last_fullsized":"2023-07-09T21:23:37.186741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.197150+0000","last_change":"2023-07-09T21:23:37.193012+0000","last_active":"2023-07-09T21:23:37.197150+0000","last_peered":"2023-07-09T21:23:37.197150+0000","last_clean":"2023-07-09T21:23:37.197150+0000","last_became_active":"2023-07-09T21:23:37.192697+0000","last_became_peered":"2023-07-09T21:23:37.192697+0000","last_unstale":"2023-07-09T21:23:37.197150+0000","last_undegraded":"2023-07-09T21:23:37.197150+0000","last_fullsized":"2023-07-09T21:23:37.197150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:45.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.181302+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:23:37.181302+0000","last_peered":"2023-07-09T21:23:37.181302+0000","last_clean":"2023-07-09T21:23:37.181302+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:23:37.181302+0000","last_undegraded":"2023-07-09T21:23:37.181302+0000","last_fullsized":"2023-07-09T21:23:37.181302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:13.722095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187628+0000","last_change":"2023-07-09T21:23:37.187628+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187628+0000","last_undegraded":"2023-07-09T21:23:37.187628+0000","last_fullsized":"2023-07-09T21:23:37.187628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202533+0000","last_change":"2023-07-09T21:23:37.199308+0000","last_active":"2023-07-09T21:23:37.202533+0000","last_peered":"2023-07-09T21:23:37.202533+0000","last_clean":"2023-07-09T21:23:37.202533+0000","last_became_active":"2023-07-09T21:23:37.199029+0000","last_became_peered":"2023-07-09T21:23:37.199029+0000","last_unstale":"2023-07-09T21:23:37.202533+0000","last_undegraded":"2023-07-09T21:23:37.202533+0000","last_fullsized":"2023-07-09T21:23:37.202533+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:18.349317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195303+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:23:37.195303+0000","last_peered":"2023-07-09T21:23:37.195303+0000","last_clean":"2023-07-09T21:23:37.195303+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:23:37.195303+0000","last_undegraded":"2023-07-09T21:23:37.195303+0000","last_fullsized":"2023-07-09T21:23:37.195303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:31.700784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187329+0000","last_change":"2023-07-09T21:23:37.187329+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187329+0000","last_undegraded":"2023-07-09T21:23:37.187329+0000","last_fullsized":"2023-07-09T21:23:37.187329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202490+0000","last_change":"2023-07-09T21:23:37.198511+0000","last_active":"2023-07-09T21:23:37.202490+0000","last_peered":"2023-07-09T21:23:37.202490+0000","last_clean":"2023-07-09T21:23:37.202490+0000","last_became_active":"2023-07-09T21:23:37.198226+0000","last_became_peered":"2023-07-09T21:23:37.198226+0000","last_unstale":"2023-07-09T21:23:37.202490+0000","last_undegraded":"2023-07-09T21:23:37.202490+0000","last_fullsized":"2023-07-09T21:23:37.202490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184931+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:23:37.184931+0000","last_peered":"2023-07-09T21:23:37.184931+0000","last_clean":"2023-07-09T21:23:37.184931+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:23:37.184931+0000","last_undegraded":"2023-07-09T21:23:37.184931+0000","last_fullsized":"2023-07-09T21:23:37.184931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:26.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187847+0000","last_change":"2023-07-09T21:23:37.187847+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187847+0000","last_undegraded":"2023-07-09T21:23:37.187847+0000","last_fullsized":"2023-07-09T21:23:37.187847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207556+0000","last_change":"2023-07-09T21:23:37.203604+0000","last_active":"2023-07-09T21:23:37.207556+0000","last_peered":"2023-07-09T21:23:37.207556+0000","last_clean":"2023-07-09T21:23:37.207556+0000","last_became_active":"2023-07-09T21:23:37.203306+0000","last_became_peered":"2023-07-09T21:23:37.203306+0000","last_unstale":"2023-07-09T21:23:37.207556+0000","last_undegraded":"2023-07-09T21:23:37.207556+0000","last_fullsized":"2023-07-09T21:23:37.207556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.191596+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:23:37.191596+0000","last_peered":"2023-07-09T21:23:37.191596+0000","last_clean":"2023-07-09T21:23:37.191596+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:23:37.191596+0000","last_undegraded":"2023-07-09T21:23:37.191596+0000","last_fullsized":"2023-07-09T21:23:37.191596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:40.689587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194650+0000","last_change":"2023-07-09T21:23:37.194650+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194650+0000","last_undegraded":"2023-07-09T21:23:37.194650+0000","last_fullsized":"2023-07-09T21:23:37.194650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205466+0000","last_change":"2023-07-09T21:23:37.199737+0000","last_active":"2023-07-09T21:23:37.205466+0000","last_peered":"2023-07-09T21:23:37.205466+0000","last_clean":"2023-07-09T21:23:37.205466+0000","last_became_active":"2023-07-09T21:23:37.199176+0000","last_became_peered":"2023-07-09T21:23:37.199176+0000","last_unstale":"2023-07-09T21:23:37.205466+0000","last_undegraded":"2023-07-09T21:23:37.205466+0000","last_fullsized":"2023-07-09T21:23:37.205466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184583+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:23:37.184583+0000","last_peered":"2023-07-09T21:23:37.184583+0000","last_clean":"2023-07-09T21:23:37.184583+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:23:37.184583+0000","last_undegraded":"2023-07-09T21:23:37.184583+0000","last_fullsized":"2023-07-09T21:23:37.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:06.960119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185692+0000","last_change":"2023-07-09T21:23:37.185692+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185692+0000","last_undegraded":"2023-07-09T21:23:37.185692+0000","last_fullsized":"2023-07-09T21:23:37.185692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200661+0000","last_change":"2023-07-09T21:23:37.197526+0000","last_active":"2023-07-09T21:23:37.200661+0000","last_peered":"2023-07-09T21:23:37.200661+0000","last_clean":"2023-07-09T21:23:37.200661+0000","last_became_active":"2023-07-09T21:23:37.197207+0000","last_became_peered":"2023-07-09T21:23:37.197207+0000","last_unstale":"2023-07-09T21:23:37.200661+0000","last_undegraded":"2023-07-09T21:23:37.200661+0000","last_fullsized":"2023-07-09T21:23:37.200661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:39.261345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.198128+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:23:37.198128+0000","last_peered":"2023-07-09T21:23:37.198128+0000","last_clean":"2023-07-09T21:23:37.198128+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:23:37.198128+0000","last_undegraded":"2023-07-09T21:23:37.198128+0000","last_fullsized":"2023-07-09T21:23:37.198128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:01.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.92800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.745},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65700000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.503}]},{"osd":4,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:23:43.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-07-09T21:23:43.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.186531+0000', 'last_change': '2023-07-09T21:23:37.186531+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.186531+0000', 'last_undegraded': '2023-07-09T21:23:37.186531+0000', 'last_fullsized': '2023-07-09T21:23:37.186531+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-07-09T21:23:43.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188108+0000', 'last_change': '2023-07-09T21:23:37.188108+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188108+0000', 'last_undegraded': '2023-07-09T21:23:37.188108+0000', 'last_fullsized': '2023-07-09T21:23:37.188108+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-07-09T21:23:43.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189333+0000', 'last_change': '2023-07-09T21:23:37.189333+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189333+0000', 'last_undegraded': '2023-07-09T21:23:37.189333+0000', 'last_fullsized': '2023-07-09T21:23:37.189333+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-07-09T21:23:43.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184741+0000', 'last_change': '2023-07-09T21:23:37.184741+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184741+0000', 'last_undegraded': '2023-07-09T21:23:37.184741+0000', 'last_fullsized': '2023-07-09T21:23:37.184741+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-07-09T21:23:43.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184404+0000', 'last_change': '2023-07-09T21:23:37.184404+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184404+0000', 'last_undegraded': '2023-07-09T21:23:37.184404+0000', 'last_fullsized': '2023-07-09T21:23:37.184404+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2023-07-09T21:23:43.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188406+0000', 'last_change': '2023-07-09T21:23:37.188406+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188406+0000', 'last_undegraded': '2023-07-09T21:23:37.188406+0000', 'last_fullsized': '2023-07-09T21:23:37.188406+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-07-09T21:23:43.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.192519+0000', 'last_change': '2023-07-09T21:23:37.192519+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.192519+0000', 'last_undegraded': '2023-07-09T21:23:37.192519+0000', 'last_fullsized': '2023-07-09T21:23:37.192519+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-07-09T21:23:43.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.190274+0000', 'last_change': '2023-07-09T21:23:37.190274+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.190274+0000', 'last_undegraded': '2023-07-09T21:23:37.190274+0000', 'last_fullsized': '2023-07-09T21:23:37.190274+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-07-09T21:23:43.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.190250+0000', 'last_change': '2023-07-09T21:23:37.190250+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.190250+0000', 'last_undegraded': '2023-07-09T21:23:37.190250+0000', 'last_fullsized': '2023-07-09T21:23:37.190250+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-07-09T21:23:43.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185430+0000', 'last_change': '2023-07-09T21:23:37.185430+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185430+0000', 'last_undegraded': '2023-07-09T21:23:37.185430+0000', 'last_fullsized': '2023-07-09T21:23:37.185430+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-07-09T21:23:43.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187297+0000', 'last_change': '2023-07-09T21:23:37.187297+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187297+0000', 'last_undegraded': '2023-07-09T21:23:37.187297+0000', 'last_fullsized': '2023-07-09T21:23:37.187297+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-07-09T21:23:43.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189875+0000', 'last_change': '2023-07-09T21:23:37.189875+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189875+0000', 'last_undegraded': '2023-07-09T21:23:37.189875+0000', 'last_fullsized': '2023-07-09T21:23:37.189875+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-07-09T21:23:43.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184098+0000', 'last_change': '2023-07-09T21:23:37.184098+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184098+0000', 'last_undegraded': '2023-07-09T21:23:37.184098+0000', 'last_fullsized': '2023-07-09T21:23:37.184098+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-07-09T21:23:43.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.196818+0000', 'last_change': '2023-07-09T21:23:37.196818+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.196818+0000', 'last_undegraded': '2023-07-09T21:23:37.196818+0000', 'last_fullsized': '2023-07-09T21:23:37.196818+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-07-09T21:23:43.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.192006+0000', 'last_change': '2023-07-09T21:23:37.192006+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.192006+0000', 'last_undegraded': '2023-07-09T21:23:37.192006+0000', 'last_fullsized': '2023-07-09T21:23:37.192006+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-07-09T21:23:43.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185805+0000', 'last_change': '2023-07-09T21:23:37.185805+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185805+0000', 'last_undegraded': '2023-07-09T21:23:37.185805+0000', 'last_fullsized': '2023-07-09T21:23:37.185805+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-07-09T21:23:43.106 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187773+0000', 'last_change': '2023-07-09T21:23:37.187773+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187773+0000', 'last_undegraded': '2023-07-09T21:23:37.187773+0000', 'last_fullsized': '2023-07-09T21:23:37.187773+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.106 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-07-09T21:23:43.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188178+0000', 'last_change': '2023-07-09T21:23:37.188178+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188178+0000', 'last_undegraded': '2023-07-09T21:23:37.188178+0000', 'last_fullsized': '2023-07-09T21:23:37.188178+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-07-09T21:23:43.107 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184077+0000', 'last_change': '2023-07-09T21:23:37.184077+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184077+0000', 'last_undegraded': '2023-07-09T21:23:37.184077+0000', 'last_fullsized': '2023-07-09T21:23:37.184077+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.107 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-07-09T21:23:43.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189143+0000', 'last_change': '2023-07-09T21:23:37.189143+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189143+0000', 'last_undegraded': '2023-07-09T21:23:37.189143+0000', 'last_fullsized': '2023-07-09T21:23:37.189143+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.108 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-07-09T21:23:43.108 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189344+0000', 'last_change': '2023-07-09T21:23:37.189344+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189344+0000', 'last_undegraded': '2023-07-09T21:23:37.189344+0000', 'last_fullsized': '2023-07-09T21:23:37.189344+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-07-09T21:23:43.109 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.193085+0000', 'last_change': '2023-07-09T21:23:37.193085+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.193085+0000', 'last_undegraded': '2023-07-09T21:23:37.193085+0000', 'last_fullsized': '2023-07-09T21:23:37.193085+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.109 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-07-09T21:23:43.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185908+0000', 'last_change': '2023-07-09T21:23:37.185908+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185908+0000', 'last_undegraded': '2023-07-09T21:23:37.185908+0000', 'last_fullsized': '2023-07-09T21:23:37.185908+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.110 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-07-09T21:23:43.110 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184589+0000', 'last_change': '2023-07-09T21:23:37.184589+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184589+0000', 'last_undegraded': '2023-07-09T21:23:37.184589+0000', 'last_fullsized': '2023-07-09T21:23:37.184589+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-07-09T21:23:43.111 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.191291+0000', 'last_change': '2023-07-09T21:23:37.191291+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.191291+0000', 'last_undegraded': '2023-07-09T21:23:37.191291+0000', 'last_fullsized': '2023-07-09T21:23:37.191291+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.111 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2023-07-09T21:23:43.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188013+0000', 'last_change': '2023-07-09T21:23:37.188013+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188013+0000', 'last_undegraded': '2023-07-09T21:23:37.188013+0000', 'last_fullsized': '2023-07-09T21:23:37.188013+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.112 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-07-09T21:23:43.112 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188809+0000', 'last_change': '2023-07-09T21:23:37.188809+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188809+0000', 'last_undegraded': '2023-07-09T21:23:37.188809+0000', 'last_fullsized': '2023-07-09T21:23:37.188809+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-07-09T21:23:43.113 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.186390+0000', 'last_change': '2023-07-09T21:23:37.186390+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.186390+0000', 'last_undegraded': '2023-07-09T21:23:37.186390+0000', 'last_fullsized': '2023-07-09T21:23:37.186390+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.113 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-07-09T21:23:43.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187523+0000', 'last_change': '2023-07-09T21:23:37.187523+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187523+0000', 'last_undegraded': '2023-07-09T21:23:37.187523+0000', 'last_fullsized': '2023-07-09T21:23:37.187523+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-07-09T21:23:43.114 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188243+0000', 'last_change': '2023-07-09T21:23:37.188243+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188243+0000', 'last_undegraded': '2023-07-09T21:23:37.188243+0000', 'last_fullsized': '2023-07-09T21:23:37.188243+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:23:43.114 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-07-09T21:23:43.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185244+0000', 'last_change': '2023-07-09T21:23:37.185244+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185244+0000', 'last_undegraded': '2023-07-09T21:23:37.185244+0000', 'last_fullsized': '2023-07-09T21:23:37.185244+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.115 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2023-07-09T21:23:43.115 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188732+0000', 'last_change': '2023-07-09T21:23:37.188732+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188732+0000', 'last_undegraded': '2023-07-09T21:23:37.188732+0000', 'last_fullsized': '2023-07-09T21:23:37.188732+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-07-09T21:23:43.116 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188141+0000', 'last_change': '2023-07-09T21:23:37.188141+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188141+0000', 'last_undegraded': '2023-07-09T21:23:37.188141+0000', 'last_fullsized': '2023-07-09T21:23:37.188141+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.116 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-07-09T21:23:43.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189520+0000', 'last_change': '2023-07-09T21:23:37.189520+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189520+0000', 'last_undegraded': '2023-07-09T21:23:37.189520+0000', 'last_fullsized': '2023-07-09T21:23:37.189520+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.117 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-07-09T21:23:43.117 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.195040+0000', 'last_change': '2023-07-09T21:23:37.195040+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.195040+0000', 'last_undegraded': '2023-07-09T21:23:37.195040+0000', 'last_fullsized': '2023-07-09T21:23:37.195040+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-07-09T21:23:43.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185936+0000', 'last_change': '2023-07-09T21:23:37.185936+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185936+0000', 'last_undegraded': '2023-07-09T21:23:37.185936+0000', 'last_fullsized': '2023-07-09T21:23:37.185936+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-07-09T21:23:43.118 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.190128+0000', 'last_change': '2023-07-09T21:23:37.190128+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.190128+0000', 'last_undegraded': '2023-07-09T21:23:37.190128+0000', 'last_fullsized': '2023-07-09T21:23:37.190128+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-07-09T21:23:43.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184189+0000', 'last_change': '2023-07-09T21:23:37.184189+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184189+0000', 'last_undegraded': '2023-07-09T21:23:37.184189+0000', 'last_fullsized': '2023-07-09T21:23:37.184189+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-07-09T21:23:43.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.194186+0000', 'last_change': '2023-07-09T21:23:37.194186+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.194186+0000', 'last_undegraded': '2023-07-09T21:23:37.194186+0000', 'last_fullsized': '2023-07-09T21:23:37.194186+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-07-09T21:23:43.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.191820+0000', 'last_change': '2023-07-09T21:23:37.191820+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.191820+0000', 'last_undegraded': '2023-07-09T21:23:37.191820+0000', 'last_fullsized': '2023-07-09T21:23:37.191820+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-07-09T21:23:43.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.184146+0000', 'last_change': '2023-07-09T21:23:37.184146+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.184146+0000', 'last_undegraded': '2023-07-09T21:23:37.184146+0000', 'last_fullsized': '2023-07-09T21:23:37.184146+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-07-09T21:23:43.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187208+0000', 'last_change': '2023-07-09T21:23:37.187208+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187208+0000', 'last_undegraded': '2023-07-09T21:23:37.187208+0000', 'last_fullsized': '2023-07-09T21:23:37.187208+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-07-09T21:23:43.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189822+0000', 'last_change': '2023-07-09T21:23:37.189822+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189822+0000', 'last_undegraded': '2023-07-09T21:23:37.189822+0000', 'last_fullsized': '2023-07-09T21:23:37.189822+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-07-09T21:23:43.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.191158+0000', 'last_change': '2023-07-09T21:23:37.191158+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.191158+0000', 'last_undegraded': '2023-07-09T21:23:37.191158+0000', 'last_fullsized': '2023-07-09T21:23:37.191158+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-07-09T21:23:43.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189578+0000', 'last_change': '2023-07-09T21:23:37.189578+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189578+0000', 'last_undegraded': '2023-07-09T21:23:37.189578+0000', 'last_fullsized': '2023-07-09T21:23:37.189578+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-07-09T21:23:43.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185505+0000', 'last_change': '2023-07-09T21:23:37.185505+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185505+0000', 'last_undegraded': '2023-07-09T21:23:37.185505+0000', 'last_fullsized': '2023-07-09T21:23:37.185505+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-07-09T21:23:43.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185287+0000', 'last_change': '2023-07-09T21:23:37.185287+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185287+0000', 'last_undegraded': '2023-07-09T21:23:37.185287+0000', 'last_fullsized': '2023-07-09T21:23:37.185287+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-07-09T21:23:43.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.191324+0000', 'last_change': '2023-07-09T21:23:37.191324+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.191324+0000', 'last_undegraded': '2023-07-09T21:23:37.191324+0000', 'last_fullsized': '2023-07-09T21:23:37.191324+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-07-09T21:23:43.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.186660+0000', 'last_change': '2023-07-09T21:23:37.186660+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.186660+0000', 'last_undegraded': '2023-07-09T21:23:37.186660+0000', 'last_fullsized': '2023-07-09T21:23:37.186660+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-07-09T21:23:43.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.186819+0000', 'last_change': '2023-07-09T21:23:37.186819+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.186819+0000', 'last_undegraded': '2023-07-09T21:23:37.186819+0000', 'last_fullsized': '2023-07-09T21:23:37.186819+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-07-09T21:23:43.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.195632+0000', 'last_change': '2023-07-09T21:23:37.195632+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.195632+0000', 'last_undegraded': '2023-07-09T21:23:37.195632+0000', 'last_fullsized': '2023-07-09T21:23:37.195632+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-07-09T21:23:43.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.183668+0000', 'last_change': '2023-07-09T21:23:37.183668+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.183668+0000', 'last_undegraded': '2023-07-09T21:23:37.183668+0000', 'last_fullsized': '2023-07-09T21:23:37.183668+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:23:43.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-07-09T21:23:43.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185198+0000', 'last_change': '2023-07-09T21:23:37.185198+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185198+0000', 'last_undegraded': '2023-07-09T21:23:37.185198+0000', 'last_fullsized': '2023-07-09T21:23:37.185198+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-07-09T21:23:43.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187357+0000', 'last_change': '2023-07-09T21:23:37.187357+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187357+0000', 'last_undegraded': '2023-07-09T21:23:37.187357+0000', 'last_fullsized': '2023-07-09T21:23:37.187357+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-07-09T21:23:43.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185914+0000', 'last_change': '2023-07-09T21:23:37.185914+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185914+0000', 'last_undegraded': '2023-07-09T21:23:37.185914+0000', 'last_fullsized': '2023-07-09T21:23:37.185914+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-07-09T21:23:43.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.190831+0000', 'last_change': '2023-07-09T21:23:37.190831+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.190831+0000', 'last_undegraded': '2023-07-09T21:23:37.190831+0000', 'last_fullsized': '2023-07-09T21:23:37.190831+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-07-09T21:23:43.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.189370+0000', 'last_change': '2023-07-09T21:23:37.189370+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.189370+0000', 'last_undegraded': '2023-07-09T21:23:37.189370+0000', 'last_fullsized': '2023-07-09T21:23:37.189370+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:23:43.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-07-09T21:23:43.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.188514+0000', 'last_change': '2023-07-09T21:23:37.188514+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.188514+0000', 'last_undegraded': '2023-07-09T21:23:37.188514+0000', 'last_fullsized': '2023-07-09T21:23:37.188514+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-07-09T21:23:43.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.186741+0000', 'last_change': '2023-07-09T21:23:37.186741+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.186741+0000', 'last_undegraded': '2023-07-09T21:23:37.186741+0000', 'last_fullsized': '2023-07-09T21:23:37.186741+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-07-09T21:23:43.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187628+0000', 'last_change': '2023-07-09T21:23:37.187628+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187628+0000', 'last_undegraded': '2023-07-09T21:23:37.187628+0000', 'last_fullsized': '2023-07-09T21:23:37.187628+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:23:43.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-07-09T21:23:43.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187329+0000', 'last_change': '2023-07-09T21:23:37.187329+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187329+0000', 'last_undegraded': '2023-07-09T21:23:37.187329+0000', 'last_fullsized': '2023-07-09T21:23:37.187329+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:23:43.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-07-09T21:23:43.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.187847+0000', 'last_change': '2023-07-09T21:23:37.187847+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.187847+0000', 'last_undegraded': '2023-07-09T21:23:37.187847+0000', 'last_fullsized': '2023-07-09T21:23:37.187847+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:23:43.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-07-09T21:23:43.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.194650+0000', 'last_change': '2023-07-09T21:23:37.194650+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.194650+0000', 'last_undegraded': '2023-07-09T21:23:37.194650+0000', 'last_fullsized': '2023-07-09T21:23:37.194650+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:23:43.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-07-09T21:23:43.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 35, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:23:37.185692+0000', 'last_change': '2023-07-09T21:23:37.185692+0000', 'last_active': '2023-07-09T21:23:37.171191+0000', 'last_peered': '2023-07-09T21:23:37.171191+0000', 'last_clean': '2023-07-09T21:23:37.171191+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:23:37.185692+0000', 'last_undegraded': '2023-07-09T21:23:37.185692+0000', 'last_fullsized': '2023-07-09T21:23:37.185692+0000', 'mapping_epoch': 35, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 35, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'last_clean_scrub_stamp': '2023-07-09T21:23:37.171191+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:23:43.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:23:43.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 Processor -- start 2023-07-09T21:23:43.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 -- start start 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 0x7f36b006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00cef80 0x7f36b00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36b00b4170 0x7f36b015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00b7e80 con 0x7f36b00b4170 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00b4610 con 0x7f36b00b7ab0 2023-07-09T21:23:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36b512c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00b49f0 con 0x7f36b00cef80 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36b00b4170 0x7f36b015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f36b00b4170 0x7f36b015f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38386/0 (socket says 172.21.15.37:38386) 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 -- 172.21.15.37:0/1527750154 learned_addr learned my addr 172.21.15.37:0/1527750154 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36a7fff640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00cef80 0x7f36b00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36aed9d640 1 --2- 172.21.15.37:0/1527750154 >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 0x7f36b006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 -- 172.21.15.37:0/1527750154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00cef80 msgr2=0x7f36b00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00cef80 0x7f36b00b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 -- 172.21.15.37:0/1527750154 >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 msgr2=0x7f36b006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 --2- 172.21.15.37:0/1527750154 >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 0x7f36b006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36af59e640 1 -- 172.21.15.37:0/1527750154 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00cc8a0 con 0x7f36b00b4170 2023-07-09T21:23:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.277+0000 7f36aed9d640 1 --2- 172.21.15.37:0/1527750154 >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 0x7f36b006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:43.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36af59e640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b4170 0x7f36b015f490 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f36b006b360 tx=0x7f36a801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f366da65fee96c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36ae59c640 1 -- 172.21.15.37:0/1527750154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80a5560 con 0x7f36b00b4170 2023-07-09T21:23:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36ae59c640 1 -- 172.21.15.37:0/1527750154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a80a56c0 con 0x7f36b00b4170 2023-07-09T21:23:43.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36ae59c640 1 -- 172.21.15.37:0/1527750154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a80a5a50 con 0x7f36b00b4170 2023-07-09T21:23:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 -- 172.21.15.37:0/1527750154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b4170 msgr2=0x7f36b015f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b4170 0x7f36b015f490 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f36b006b360 tx=0x7f36a801c6e0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 -- 172.21.15.37:0/1527750154 shutdown_connections 2023-07-09T21:23:43.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b4170 0x7f36b015f490 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 --2- 172.21.15.37:0/1527750154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00cef80 0x7f36b00b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 --2- 172.21.15.37:0/1527750154 >> v2:172.21.15.119:3300/0 conn(0x7f36b00b7ab0 0x7f36b006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 -- 172.21.15.37:0/1527750154 >> 172.21.15.37:0/1527750154 conn(0x7f36b0073090 msgr2=0x7f36b0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 -- 172.21.15.37:0/1527750154 shutdown_connections 2023-07-09T21:23:43.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.281+0000 7f36b512c640 1 -- 172.21.15.37:0/1527750154 wait complete. 2023-07-09T21:23:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 Processor -- start 2023-07-09T21:23:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- start start 2023-07-09T21:23:43.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00b4170 0x7f36b00cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b00cef80 0x7f36b0156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00ca260 con 0x7f36b00b7ab0 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00cb190 con 0x7f36b00cef80 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b00cb470 con 0x7f36b00b4170 2023-07-09T21:23:43.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38390/0 (socket says 172.21.15.37:38390) 2023-07-09T21:23:43.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 -- 172.21.15.37:0/3416810357 learned_addr learned my addr 172.21.15.37:0/3416810357 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36aed9d640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00b4170 0x7f36b00cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36af59e640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b00cef80 0x7f36b0156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 -- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00b4170 msgr2=0x7f36b00cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00b4170 0x7f36b00cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 -- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b00cef80 msgr2=0x7f36b0156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b00cef80 0x7f36b0156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 -- 172.21.15.37:0/3416810357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a8009b30 con 0x7f36b00b7ab0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a7fff640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f369800e840 tx=0x7f369800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3698009510 con 0x7f36b00b7ab0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369800ee90 con 0x7f36b00b7ab0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369800cb60 con 0x7f36b00b7ab0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b00cb750 con 0x7f36b00b7ab0 2023-07-09T21:23:43.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.285+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b00cbd10 con 0x7f36b00b7ab0 2023-07-09T21:23:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.289+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b004d7d0 con 0x7f36b00b7ab0 2023-07-09T21:23:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.289+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f369800ccc0 con 0x7f36b00b7ab0 2023-07-09T21:23:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.289+0000 7f36a77fe640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 0x7f3690068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.289+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3698083d80 con 0x7f36b00b7ab0 2023-07-09T21:23:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.289+0000 7f36aed9d640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 0x7f3690068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.293+0000 7f36aed9d640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 0x7f3690068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c900 tx=0x7f36a0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.293+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3698054c80 con 0x7f36b00b7ab0 2023-07-09T21:23:43.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.501+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f36b00ce810 con 0x7f36b00b7ab0 2023-07-09T21:23:43.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.501+0000 7f36a77fe640 1 -- 172.21.15.37:0/3416810357 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1194 (secure 0 0 0) 0x7f36980174c0 con 0x7f36b00b7ab0 2023-07-09T21:23:43.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:43.505 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":98,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":37,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":229339136,"bytes_avail":772864774144,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5361}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-07-09T21:23:27.967059+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:23:43.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 msgr2=0x7f3690068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 0x7f3690068730 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f36a000c900 tx=0x7f36a0008040 comp rx=0 tx=0).stop 2023-07-09T21:23:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 msgr2=0x7f36b00c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f369800e840 tx=0x7f369800ec40 comp rx=0 tx=0).stop 2023-07-09T21:23:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 shutdown_connections 2023-07-09T21:23:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f3690066280 0x7f3690068730 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36b00cef80 0x7f36b0156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36b00b7ab0 0x7f36b00c9d20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 --2- 172.21.15.37:0/3416810357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f36b00b4170 0x7f36b00cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 >> 172.21.15.37:0/3416810357 conn(0x7f36b0073090 msgr2=0x7f36b00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 shutdown_connections 2023-07-09T21:23:43.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.505+0000 7f36b512c640 1 -- 172.21.15.37:0/3416810357 wait complete. 2023-07-09T21:23:43.525 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:23:43.526 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:23:43.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 Processor -- start 2023-07-09T21:23:43.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 -- start start 2023-07-09T21:23:43.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 0x7fe900158f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90015c470 0x7fe9000694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe900069a00 con 0x7fe9000c9670 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90015c8c0 con 0x7fe90015c470 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe907e48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe900069f10 con 0x7fe9000b0ba0 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90015c470 0x7fe9000694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe90015c470 0x7fe9000694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38398/0 (socket says 172.21.15.37:38398) 2023-07-09T21:23:43.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 -- 172.21.15.37:0/1836791541 learned_addr learned my addr 172.21.15.37:0/1836791541 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:43.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe905be4640 1 --2- 172.21.15.37:0/1836791541 >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 0x7fe900158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 -- 172.21.15.37:0/1836791541 >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 msgr2=0x7fe900158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:43.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 --2- 172.21.15.37:0/1836791541 >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 0x7fe900158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 -- 172.21.15.37:0/1836791541 >> v1:172.21.15.119:6789/0 conn(0x7fe9000c9670 legacy=0x7fe90006f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:43.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe9053e3640 1 -- 172.21.15.37:0/1836791541 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900069c30 con 0x7fe90015c470 2023-07-09T21:23:43.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.665+0000 7fe905be4640 1 --2- 172.21.15.37:0/1836791541 >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 0x7fe900158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:43.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe9053e3640 1 --2- 172.21.15.37:0/1836791541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90015c470 0x7fe9000694c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000aa10 tx=0x7fe8f001d860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7059a992dbb2f8fb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe904be2640 1 -- 172.21.15.37:0/1836791541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a6910 con 0x7fe90015c470 2023-07-09T21:23:43.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe904be2640 1 -- 172.21.15.37:0/1836791541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00a6a70 con 0x7fe90015c470 2023-07-09T21:23:43.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe904be2640 1 -- 172.21.15.37:0/1836791541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00a6e00 con 0x7fe90015c470 2023-07-09T21:23:43.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 -- 172.21.15.37:0/1836791541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90015c470 msgr2=0x7fe9000694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 --2- 172.21.15.37:0/1836791541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90015c470 0x7fe9000694c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe8f000aa10 tx=0x7fe8f001d860 comp rx=0 tx=0).stop 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 -- 172.21.15.37:0/1836791541 shutdown_connections 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 --2- 172.21.15.37:0/1836791541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe90015c470 0x7fe9000694c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 --2- 172.21.15.37:0/1836791541 >> v2:172.21.15.119:3300/0 conn(0x7fe9000b0ba0 0x7fe900158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 -- 172.21.15.37:0/1836791541 >> 172.21.15.37:0/1836791541 conn(0x7fe9000ce630 msgr2=0x7fe9000cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 -- 172.21.15.37:0/1836791541 shutdown_connections 2023-07-09T21:23:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.669+0000 7fe907e48640 1 -- 172.21.15.37:0/1836791541 wait complete. 2023-07-09T21:23:43.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 Processor -- start 2023-07-09T21:23:43.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- start start 2023-07-09T21:23:43.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9000c9670 0x7fe9000cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 0x7fe9000c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000cdee0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c87f0 con 0x7fe90015c470 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000cb560 con 0x7fe9000c9670 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38408/0 (socket says 172.21.15.37:38408) 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 -- 172.21.15.37:0/3525982177 learned_addr learned my addr 172.21.15.37:0/3525982177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe9053e3640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9000c9670 0x7fe9000cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe9063e5640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 0x7fe9000c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 -- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9000c9670 msgr2=0x7fe9000cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9000c9670 0x7fe9000cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 -- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 msgr2=0x7fe9000c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 0x7fe9000c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 -- 172.21.15.37:0/3525982177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f000a670 con 0x7fe9000b0ba0 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe9063e5640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 0x7fe9000c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe905be4640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e810 tx=0x7fe8fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00c8d0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00ca30 con 0x7fe9000b0ba0 2023-07-09T21:23:43.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00cdc0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9000cb840 con 0x7fe9000b0ba0 2023-07-09T21:23:43.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.673+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9000c84e0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9000cb3c0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe8fc013410 con 0x7fe9000b0ba0 2023-07-09T21:23:43.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe8f67fc640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 0x7fe8e4068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:43.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8fc083ad0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe9053e3640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 0x7fe8e4068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:43.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.677+0000 7fe9053e3640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 0x7fe8e4068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b0000 tx=0x7fe8f0008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:43.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.681+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9000cb3c0 con 0x7fe9000b0ba0 2023-07-09T21:23:43.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.833+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9000c9f00 con 0x7fe8e4066280 2023-07-09T21:23:43.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.841+0000 7fe8f67fc640 1 -- 172.21.15.37:0/3525982177 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306014 (secure 0 0 0) 0x7fe8f00ae440 con 0x7fe8e4066280 2023-07-09T21:23:43.845 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:43.847 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 msgr2=0x7fe8e4068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 0x7fe8e4068730 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00b0000 tx=0x7fe8f0008040 comp rx=0 tx=0).stop 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 msgr2=0x7fe9000c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e810 tx=0x7fe8fc00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 shutdown_connections 2023-07-09T21:23:43.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fe8e4066280 0x7fe8e4068730 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe90015c470 0x7fe9000c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9000c9670 0x7fe9000cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 --2- 172.21.15.37:0/3525982177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9000b0ba0 0x7fe9000c5c40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 >> 172.21.15.37:0/3525982177 conn(0x7fe9000ce630 msgr2=0x7fe900156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 shutdown_connections 2023-07-09T21:23:43.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:43.845+0000 7fe907e48640 1 -- 172.21.15.37:0/3525982177 wait complete. 2023-07-09T21:23:43.866 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2023-07-09T21:23:41.969776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223964,"kb_used_data":4252,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750756,"statfs":{"total":773094113280,"available":772864774144,"internally_reserved":0,"allocated":4354048,"data_stored":2466964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.795332"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186531+0000","last_change":"2023-07-09T21:23:37.186531+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186531+0000","last_undegraded":"2023-07-09T21:23:37.186531+0000","last_fullsized":"2023-07-09T21:23:37.186531+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188108+0000","last_change":"2023-07-09T21:23:37.188108+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188108+0000","last_undegraded":"2023-07-09T21:23:37.188108+0000","last_fullsized":"2023-07-09T21:23:37.188108+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189333+0000","last_change":"2023-07-09T21:23:37.189333+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189333+0000","last_undegraded":"2023-07-09T21:23:37.189333+0000","last_fullsized":"2023-07-09T21:23:37.189333+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184741+0000","last_change":"2023-07-09T21:23:37.184741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184741+0000","last_undegraded":"2023-07-09T21:23:37.184741+0000","last_fullsized":"2023-07-09T21:23:37.184741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184404+0000","last_change":"2023-07-09T21:23:37.184404+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184404+0000","last_undegraded":"2023-07-09T21:23:37.184404+0000","last_fullsized":"2023-07-09T21:23:37.184404+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188406+0000","last_change":"2023-07-09T21:23:37.188406+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188406+0000","last_undegraded":"2023-07-09T21:23:37.188406+0000","last_fullsized":"2023-07-09T21:23:37.188406+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192519+0000","last_change":"2023-07-09T21:23:37.192519+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192519+0000","last_undegraded":"2023-07-09T21:23:37.192519+0000","last_fullsized":"2023-07-09T21:23:37.192519+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190274+0000","last_change":"2023-07-09T21:23:37.190274+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190274+0000","last_undegraded":"2023-07-09T21:23:37.190274+0000","last_fullsized":"2023-07-09T21:23:37.190274+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190250+0000","last_change":"2023-07-09T21:23:37.190250+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190250+0000","last_undegraded":"2023-07-09T21:23:37.190250+0000","last_fullsized":"2023-07-09T21:23:37.190250+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185430+0000","last_change":"2023-07-09T21:23:37.185430+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185430+0000","last_undegraded":"2023-07-09T21:23:37.185430+0000","last_fullsized":"2023-07-09T21:23:37.185430+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187297+0000","last_change":"2023-07-09T21:23:37.187297+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187297+0000","last_undegraded":"2023-07-09T21:23:37.187297+0000","last_fullsized":"2023-07-09T21:23:37.187297+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189875+0000","last_change":"2023-07-09T21:23:37.189875+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189875+0000","last_undegraded":"2023-07-09T21:23:37.189875+0000","last_fullsized":"2023-07-09T21:23:37.189875+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184098+0000","last_change":"2023-07-09T21:23:37.184098+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184098+0000","last_undegraded":"2023-07-09T21:23:37.184098+0000","last_fullsized":"2023-07-09T21:23:37.184098+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.196818+0000","last_change":"2023-07-09T21:23:37.196818+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.196818+0000","last_undegraded":"2023-07-09T21:23:37.196818+0000","last_fullsized":"2023-07-09T21:23:37.196818+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.192006+0000","last_change":"2023-07-09T21:23:37.192006+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.192006+0000","last_undegraded":"2023-07-09T21:23:37.192006+0000","last_fullsized":"2023-07-09T21:23:37.192006+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185805+0000","last_change":"2023-07-09T21:23:37.185805+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185805+0000","last_undegraded":"2023-07-09T21:23:37.185805+0000","last_fullsized":"2023-07-09T21:23:37.185805+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187773+0000","last_change":"2023-07-09T21:23:37.187773+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187773+0000","last_undegraded":"2023-07-09T21:23:37.187773+0000","last_fullsized":"2023-07-09T21:23:37.187773+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188178+0000","last_change":"2023-07-09T21:23:37.188178+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188178+0000","last_undegraded":"2023-07-09T21:23:37.188178+0000","last_fullsized":"2023-07-09T21:23:37.188178+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184077+0000","last_change":"2023-07-09T21:23:37.184077+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184077+0000","last_undegraded":"2023-07-09T21:23:37.184077+0000","last_fullsized":"2023-07-09T21:23:37.184077+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189143+0000","last_change":"2023-07-09T21:23:37.189143+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189143+0000","last_undegraded":"2023-07-09T21:23:37.189143+0000","last_fullsized":"2023-07-09T21:23:37.189143+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189344+0000","last_change":"2023-07-09T21:23:37.189344+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189344+0000","last_undegraded":"2023-07-09T21:23:37.189344+0000","last_fullsized":"2023-07-09T21:23:37.189344+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.193085+0000","last_change":"2023-07-09T21:23:37.193085+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.193085+0000","last_undegraded":"2023-07-09T21:23:37.193085+0000","last_fullsized":"2023-07-09T21:23:37.193085+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185908+0000","last_change":"2023-07-09T21:23:37.185908+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185908+0000","last_undegraded":"2023-07-09T21:23:37.185908+0000","last_fullsized":"2023-07-09T21:23:37.185908+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184589+0000","last_change":"2023-07-09T21:23:37.184589+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184589+0000","last_undegraded":"2023-07-09T21:23:37.184589+0000","last_fullsized":"2023-07-09T21:23:37.184589+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191291+0000","last_change":"2023-07-09T21:23:37.191291+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191291+0000","last_undegraded":"2023-07-09T21:23:37.191291+0000","last_fullsized":"2023-07-09T21:23:37.191291+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188013+0000","last_change":"2023-07-09T21:23:37.188013+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188013+0000","last_undegraded":"2023-07-09T21:23:37.188013+0000","last_fullsized":"2023-07-09T21:23:37.188013+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188809+0000","last_change":"2023-07-09T21:23:37.188809+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188809+0000","last_undegraded":"2023-07-09T21:23:37.188809+0000","last_fullsized":"2023-07-09T21:23:37.188809+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186390+0000","last_change":"2023-07-09T21:23:37.186390+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186390+0000","last_undegraded":"2023-07-09T21:23:37.186390+0000","last_fullsized":"2023-07-09T21:23:37.186390+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187523+0000","last_change":"2023-07-09T21:23:37.187523+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187523+0000","last_undegraded":"2023-07-09T21:23:37.187523+0000","last_fullsized":"2023-07-09T21:23:37.187523+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188243+0000","last_change":"2023-07-09T21:23:37.188243+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188243+0000","last_undegraded":"2023-07-09T21:23:37.188243+0000","last_fullsized":"2023-07-09T21:23:37.188243+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185244+0000","last_change":"2023-07-09T21:23:37.185244+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185244+0000","last_undegraded":"2023-07-09T21:23:37.185244+0000","last_fullsized":"2023-07-09T21:23:37.185244+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188732+0000","last_change":"2023-07-09T21:23:37.188732+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188732+0000","last_undegraded":"2023-07-09T21:23:37.188732+0000","last_fullsized":"2023-07-09T21:23:37.188732+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188141+0000","last_change":"2023-07-09T21:23:37.188141+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188141+0000","last_undegraded":"2023-07-09T21:23:37.188141+0000","last_fullsized":"2023-07-09T21:23:37.188141+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208541+0000","last_change":"2023-07-09T21:23:37.205856+0000","last_active":"2023-07-09T21:23:37.208541+0000","last_peered":"2023-07-09T21:23:37.208541+0000","last_clean":"2023-07-09T21:23:37.208541+0000","last_became_active":"2023-07-09T21:23:37.205568+0000","last_became_peered":"2023-07-09T21:23:37.205568+0000","last_unstale":"2023-07-09T21:23:37.208541+0000","last_undegraded":"2023-07-09T21:23:37.208541+0000","last_fullsized":"2023-07-09T21:23:37.208541+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:25.111293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189520+0000","last_change":"2023-07-09T21:23:37.189520+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189520+0000","last_undegraded":"2023-07-09T21:23:37.189520+0000","last_fullsized":"2023-07-09T21:23:37.189520+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203658+0000","last_change":"2023-07-09T21:23:37.200996+0000","last_active":"2023-07-09T21:23:37.203658+0000","last_peered":"2023-07-09T21:23:37.203658+0000","last_clean":"2023-07-09T21:23:37.203658+0000","last_became_active":"2023-07-09T21:23:37.200647+0000","last_became_peered":"2023-07-09T21:23:37.200647+0000","last_unstale":"2023-07-09T21:23:37.203658+0000","last_undegraded":"2023-07-09T21:23:37.203658+0000","last_fullsized":"2023-07-09T21:23:37.203658+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:37.644270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195040+0000","last_change":"2023-07-09T21:23:37.195040+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195040+0000","last_undegraded":"2023-07-09T21:23:37.195040+0000","last_fullsized":"2023-07-09T21:23:37.195040+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205065+0000","last_change":"2023-07-09T21:23:37.203576+0000","last_active":"2023-07-09T21:23:37.205065+0000","last_peered":"2023-07-09T21:23:37.205065+0000","last_clean":"2023-07-09T21:23:37.205065+0000","last_became_active":"2023-07-09T21:23:37.203281+0000","last_became_peered":"2023-07-09T21:23:37.203281+0000","last_unstale":"2023-07-09T21:23:37.205065+0000","last_undegraded":"2023-07-09T21:23:37.205065+0000","last_fullsized":"2023-07-09T21:23:37.205065+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185936+0000","last_change":"2023-07-09T21:23:37.185936+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185936+0000","last_undegraded":"2023-07-09T21:23:37.185936+0000","last_fullsized":"2023-07-09T21:23:37.185936+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205402+0000","last_change":"2023-07-09T21:23:37.199060+0000","last_active":"2023-07-09T21:23:37.205402+0000","last_peered":"2023-07-09T21:23:37.205402+0000","last_clean":"2023-07-09T21:23:37.205402+0000","last_became_active":"2023-07-09T21:23:37.198702+0000","last_became_peered":"2023-07-09T21:23:37.198702+0000","last_unstale":"2023-07-09T21:23:37.205402+0000","last_undegraded":"2023-07-09T21:23:37.205402+0000","last_fullsized":"2023-07-09T21:23:37.205402+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190128+0000","last_change":"2023-07-09T21:23:37.190128+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190128+0000","last_undegraded":"2023-07-09T21:23:37.190128+0000","last_fullsized":"2023-07-09T21:23:37.190128+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207953+0000","last_change":"2023-07-09T21:23:37.201618+0000","last_active":"2023-07-09T21:23:37.207953+0000","last_peered":"2023-07-09T21:23:37.207953+0000","last_clean":"2023-07-09T21:23:37.207953+0000","last_became_active":"2023-07-09T21:23:37.201315+0000","last_became_peered":"2023-07-09T21:23:37.201315+0000","last_unstale":"2023-07-09T21:23:37.207953+0000","last_undegraded":"2023-07-09T21:23:37.207953+0000","last_fullsized":"2023-07-09T21:23:37.207953+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184189+0000","last_change":"2023-07-09T21:23:37.184189+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184189+0000","last_undegraded":"2023-07-09T21:23:37.184189+0000","last_fullsized":"2023-07-09T21:23:37.184189+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208983+0000","last_change":"2023-07-09T21:23:37.205993+0000","last_active":"2023-07-09T21:23:37.208983+0000","last_peered":"2023-07-09T21:23:37.208983+0000","last_clean":"2023-07-09T21:23:37.208983+0000","last_became_active":"2023-07-09T21:23:37.205740+0000","last_became_peered":"2023-07-09T21:23:37.205740+0000","last_unstale":"2023-07-09T21:23:37.208983+0000","last_undegraded":"2023-07-09T21:23:37.208983+0000","last_fullsized":"2023-07-09T21:23:37.208983+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:03.872602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194186+0000","last_change":"2023-07-09T21:23:37.194186+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194186+0000","last_undegraded":"2023-07-09T21:23:37.194186+0000","last_fullsized":"2023-07-09T21:23:37.194186+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208824+0000","last_change":"2023-07-09T21:23:37.207663+0000","last_active":"2023-07-09T21:23:37.208824+0000","last_peered":"2023-07-09T21:23:37.208824+0000","last_clean":"2023-07-09T21:23:37.208824+0000","last_became_active":"2023-07-09T21:23:37.207389+0000","last_became_peered":"2023-07-09T21:23:37.207389+0000","last_unstale":"2023-07-09T21:23:37.208824+0000","last_undegraded":"2023-07-09T21:23:37.208824+0000","last_fullsized":"2023-07-09T21:23:37.208824+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:56.208823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191820+0000","last_change":"2023-07-09T21:23:37.191820+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191820+0000","last_undegraded":"2023-07-09T21:23:37.191820+0000","last_fullsized":"2023-07-09T21:23:37.191820+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205449+0000","last_change":"2023-07-09T21:23:37.200272+0000","last_active":"2023-07-09T21:23:37.205449+0000","last_peered":"2023-07-09T21:23:37.205449+0000","last_clean":"2023-07-09T21:23:37.205449+0000","last_became_active":"2023-07-09T21:23:37.199958+0000","last_became_peered":"2023-07-09T21:23:37.199958+0000","last_unstale":"2023-07-09T21:23:37.205449+0000","last_undegraded":"2023-07-09T21:23:37.205449+0000","last_fullsized":"2023-07-09T21:23:37.205449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.184146+0000","last_change":"2023-07-09T21:23:37.184146+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.184146+0000","last_undegraded":"2023-07-09T21:23:37.184146+0000","last_fullsized":"2023-07-09T21:23:37.184146+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199602+0000","last_change":"2023-07-09T21:23:37.196773+0000","last_active":"2023-07-09T21:23:37.199602+0000","last_peered":"2023-07-09T21:23:37.199602+0000","last_clean":"2023-07-09T21:23:37.199602+0000","last_became_active":"2023-07-09T21:23:37.196447+0000","last_became_peered":"2023-07-09T21:23:37.196447+0000","last_unstale":"2023-07-09T21:23:37.199602+0000","last_undegraded":"2023-07-09T21:23:37.199602+0000","last_fullsized":"2023-07-09T21:23:37.199602+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:58:20.083683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187208+0000","last_change":"2023-07-09T21:23:37.187208+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187208+0000","last_undegraded":"2023-07-09T21:23:37.187208+0000","last_fullsized":"2023-07-09T21:23:37.187208+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208100+0000","last_change":"2023-07-09T21:23:37.201060+0000","last_active":"2023-07-09T21:23:37.208100+0000","last_peered":"2023-07-09T21:23:37.208100+0000","last_clean":"2023-07-09T21:23:37.208100+0000","last_became_active":"2023-07-09T21:23:37.200764+0000","last_became_peered":"2023-07-09T21:23:37.200764+0000","last_unstale":"2023-07-09T21:23:37.208100+0000","last_undegraded":"2023-07-09T21:23:37.208100+0000","last_fullsized":"2023-07-09T21:23:37.208100+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189822+0000","last_change":"2023-07-09T21:23:37.189822+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189822+0000","last_undegraded":"2023-07-09T21:23:37.189822+0000","last_fullsized":"2023-07-09T21:23:37.189822+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207920+0000","last_change":"2023-07-09T21:23:37.201267+0000","last_active":"2023-07-09T21:23:37.207920+0000","last_peered":"2023-07-09T21:23:37.207920+0000","last_clean":"2023-07-09T21:23:37.207920+0000","last_became_active":"2023-07-09T21:23:37.200889+0000","last_became_peered":"2023-07-09T21:23:37.200889+0000","last_unstale":"2023-07-09T21:23:37.207920+0000","last_undegraded":"2023-07-09T21:23:37.207920+0000","last_fullsized":"2023-07-09T21:23:37.207920+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191158+0000","last_change":"2023-07-09T21:23:37.191158+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191158+0000","last_undegraded":"2023-07-09T21:23:37.191158+0000","last_fullsized":"2023-07-09T21:23:37.191158+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203716+0000","last_change":"2023-07-09T21:23:37.201098+0000","last_active":"2023-07-09T21:23:37.203716+0000","last_peered":"2023-07-09T21:23:37.203716+0000","last_clean":"2023-07-09T21:23:37.203716+0000","last_became_active":"2023-07-09T21:23:37.200492+0000","last_became_peered":"2023-07-09T21:23:37.200492+0000","last_unstale":"2023-07-09T21:23:37.203716+0000","last_undegraded":"2023-07-09T21:23:37.203716+0000","last_fullsized":"2023-07-09T21:23:37.203716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:40.481653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189578+0000","last_change":"2023-07-09T21:23:37.189578+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189578+0000","last_undegraded":"2023-07-09T21:23:37.189578+0000","last_fullsized":"2023-07-09T21:23:37.189578+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.203768+0000","last_change":"2023-07-09T21:23:37.200437+0000","last_active":"2023-07-09T21:23:37.203768+0000","last_peered":"2023-07-09T21:23:37.203768+0000","last_clean":"2023-07-09T21:23:37.203768+0000","last_became_active":"2023-07-09T21:23:37.200064+0000","last_became_peered":"2023-07-09T21:23:37.200064+0000","last_unstale":"2023-07-09T21:23:37.203768+0000","last_undegraded":"2023-07-09T21:23:37.203768+0000","last_fullsized":"2023-07-09T21:23:37.203768+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.344717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185505+0000","last_change":"2023-07-09T21:23:37.185505+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185505+0000","last_undegraded":"2023-07-09T21:23:37.185505+0000","last_fullsized":"2023-07-09T21:23:37.185505+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.208833+0000","last_change":"2023-07-09T21:23:37.207562+0000","last_active":"2023-07-09T21:23:37.208833+0000","last_peered":"2023-07-09T21:23:37.208833+0000","last_clean":"2023-07-09T21:23:37.208833+0000","last_became_active":"2023-07-09T21:23:37.207198+0000","last_became_peered":"2023-07-09T21:23:37.207198+0000","last_unstale":"2023-07-09T21:23:37.208833+0000","last_undegraded":"2023-07-09T21:23:37.208833+0000","last_fullsized":"2023-07-09T21:23:37.208833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:02.885873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185287+0000","last_change":"2023-07-09T21:23:37.185287+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185287+0000","last_undegraded":"2023-07-09T21:23:37.185287+0000","last_fullsized":"2023-07-09T21:23:37.185287+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200941+0000","last_change":"2023-07-09T21:23:37.198758+0000","last_active":"2023-07-09T21:23:37.200941+0000","last_peered":"2023-07-09T21:23:37.200941+0000","last_clean":"2023-07-09T21:23:37.200941+0000","last_became_active":"2023-07-09T21:23:37.198397+0000","last_became_peered":"2023-07-09T21:23:37.198397+0000","last_unstale":"2023-07-09T21:23:37.200941+0000","last_undegraded":"2023-07-09T21:23:37.200941+0000","last_fullsized":"2023-07-09T21:23:37.200941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:15.211913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.191324+0000","last_change":"2023-07-09T21:23:37.191324+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.191324+0000","last_undegraded":"2023-07-09T21:23:37.191324+0000","last_fullsized":"2023-07-09T21:23:37.191324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207391+0000","last_change":"2023-07-09T21:23:37.203038+0000","last_active":"2023-07-09T21:23:37.207391+0000","last_peered":"2023-07-09T21:23:37.207391+0000","last_clean":"2023-07-09T21:23:37.207391+0000","last_became_active":"2023-07-09T21:23:37.202669+0000","last_became_peered":"2023-07-09T21:23:37.202669+0000","last_unstale":"2023-07-09T21:23:37.207391+0000","last_undegraded":"2023-07-09T21:23:37.207391+0000","last_fullsized":"2023-07-09T21:23:37.207391+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:28:15.632946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186660+0000","last_change":"2023-07-09T21:23:37.186660+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186660+0000","last_undegraded":"2023-07-09T21:23:37.186660+0000","last_fullsized":"2023-07-09T21:23:37.186660+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207702+0000","last_change":"2023-07-09T21:23:37.198991+0000","last_active":"2023-07-09T21:23:37.207702+0000","last_peered":"2023-07-09T21:23:37.207702+0000","last_clean":"2023-07-09T21:23:37.207702+0000","last_became_active":"2023-07-09T21:23:37.198697+0000","last_became_peered":"2023-07-09T21:23:37.198697+0000","last_unstale":"2023-07-09T21:23:37.207702+0000","last_undegraded":"2023-07-09T21:23:37.207702+0000","last_fullsized":"2023-07-09T21:23:37.207702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186819+0000","last_change":"2023-07-09T21:23:37.186819+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186819+0000","last_undegraded":"2023-07-09T21:23:37.186819+0000","last_fullsized":"2023-07-09T21:23:37.186819+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.211915+0000","last_change":"2023-07-09T21:23:37.208724+0000","last_active":"2023-07-09T21:23:37.211915+0000","last_peered":"2023-07-09T21:23:37.211915+0000","last_clean":"2023-07-09T21:23:37.211915+0000","last_became_active":"2023-07-09T21:23:37.208426+0000","last_became_peered":"2023-07-09T21:23:37.208426+0000","last_unstale":"2023-07-09T21:23:37.211915+0000","last_undegraded":"2023-07-09T21:23:37.211915+0000","last_fullsized":"2023-07-09T21:23:37.211915+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:43.089981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.195632+0000","last_change":"2023-07-09T21:23:37.195632+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.195632+0000","last_undegraded":"2023-07-09T21:23:37.195632+0000","last_fullsized":"2023-07-09T21:23:37.195632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205384+0000","last_change":"2023-07-09T21:23:37.200744+0000","last_active":"2023-07-09T21:23:37.205384+0000","last_peered":"2023-07-09T21:23:37.205384+0000","last_clean":"2023-07-09T21:23:37.205384+0000","last_became_active":"2023-07-09T21:23:37.200385+0000","last_became_peered":"2023-07-09T21:23:37.200385+0000","last_unstale":"2023-07-09T21:23:37.205384+0000","last_undegraded":"2023-07-09T21:23:37.205384+0000","last_fullsized":"2023-07-09T21:23:37.205384+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:06:23.401418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.183668+0000","last_change":"2023-07-09T21:23:37.183668+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.183668+0000","last_undegraded":"2023-07-09T21:23:37.183668+0000","last_fullsized":"2023-07-09T21:23:37.183668+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205050+0000","last_change":"2023-07-09T21:23:37.202950+0000","last_active":"2023-07-09T21:23:37.205050+0000","last_peered":"2023-07-09T21:23:37.205050+0000","last_clean":"2023-07-09T21:23:37.205050+0000","last_became_active":"2023-07-09T21:23:37.202660+0000","last_became_peered":"2023-07-09T21:23:37.202660+0000","last_unstale":"2023-07-09T21:23:37.205050+0000","last_undegraded":"2023-07-09T21:23:37.205050+0000","last_fullsized":"2023-07-09T21:23:37.205050+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:56.528783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185198+0000","last_change":"2023-07-09T21:23:37.185198+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185198+0000","last_undegraded":"2023-07-09T21:23:37.185198+0000","last_fullsized":"2023-07-09T21:23:37.185198+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199817+0000","last_change":"2023-07-09T21:23:37.194667+0000","last_active":"2023-07-09T21:23:37.199817+0000","last_peered":"2023-07-09T21:23:37.199817+0000","last_clean":"2023-07-09T21:23:37.199817+0000","last_became_active":"2023-07-09T21:23:37.194395+0000","last_became_peered":"2023-07-09T21:23:37.194395+0000","last_unstale":"2023-07-09T21:23:37.199817+0000","last_undegraded":"2023-07-09T21:23:37.199817+0000","last_fullsized":"2023-07-09T21:23:37.199817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:55.340588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187357+0000","last_change":"2023-07-09T21:23:37.187357+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187357+0000","last_undegraded":"2023-07-09T21:23:37.187357+0000","last_fullsized":"2023-07-09T21:23:37.187357+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205401+0000","last_change":"2023-07-09T21:23:37.202646+0000","last_active":"2023-07-09T21:23:37.205401+0000","last_peered":"2023-07-09T21:23:37.205401+0000","last_clean":"2023-07-09T21:23:37.205401+0000","last_became_active":"2023-07-09T21:23:37.202363+0000","last_became_peered":"2023-07-09T21:23:37.202363+0000","last_unstale":"2023-07-09T21:23:37.205401+0000","last_undegraded":"2023-07-09T21:23:37.205401+0000","last_fullsized":"2023-07-09T21:23:37.205401+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185914+0000","last_change":"2023-07-09T21:23:37.185914+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185914+0000","last_undegraded":"2023-07-09T21:23:37.185914+0000","last_fullsized":"2023-07-09T21:23:37.185914+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204636+0000","last_change":"2023-07-09T21:23:37.201013+0000","last_active":"2023-07-09T21:23:37.204636+0000","last_peered":"2023-07-09T21:23:37.204636+0000","last_clean":"2023-07-09T21:23:37.204636+0000","last_became_active":"2023-07-09T21:23:37.200747+0000","last_became_peered":"2023-07-09T21:23:37.200747+0000","last_unstale":"2023-07-09T21:23:37.204636+0000","last_undegraded":"2023-07-09T21:23:37.204636+0000","last_fullsized":"2023-07-09T21:23:37.204636+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:55.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.190831+0000","last_change":"2023-07-09T21:23:37.190831+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.190831+0000","last_undegraded":"2023-07-09T21:23:37.190831+0000","last_fullsized":"2023-07-09T21:23:37.190831+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.199774+0000","last_change":"2023-07-09T21:23:37.196001+0000","last_active":"2023-07-09T21:23:37.199774+0000","last_peered":"2023-07-09T21:23:37.199774+0000","last_clean":"2023-07-09T21:23:37.199774+0000","last_became_active":"2023-07-09T21:23:37.195702+0000","last_became_peered":"2023-07-09T21:23:37.195702+0000","last_unstale":"2023-07-09T21:23:37.199774+0000","last_undegraded":"2023-07-09T21:23:37.199774+0000","last_fullsized":"2023-07-09T21:23:37.199774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:12.993263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.189370+0000","last_change":"2023-07-09T21:23:37.189370+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.189370+0000","last_undegraded":"2023-07-09T21:23:37.189370+0000","last_fullsized":"2023-07-09T21:23:37.189370+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.204591+0000","last_change":"2023-07-09T21:23:37.200811+0000","last_active":"2023-07-09T21:23:37.204591+0000","last_peered":"2023-07-09T21:23:37.204591+0000","last_clean":"2023-07-09T21:23:37.204591+0000","last_became_active":"2023-07-09T21:23:37.200465+0000","last_became_peered":"2023-07-09T21:23:37.200465+0000","last_unstale":"2023-07-09T21:23:37.204591+0000","last_undegraded":"2023-07-09T21:23:37.204591+0000","last_fullsized":"2023-07-09T21:23:37.204591+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.599154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":191,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.189086+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:23:37.189086+0000","last_peered":"2023-07-09T21:23:37.189086+0000","last_clean":"2023-07-09T21:23:37.189086+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:23:37.189086+0000","last_undegraded":"2023-07-09T21:23:37.189086+0000","last_fullsized":"2023-07-09T21:23:37.189086+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:25:06.244008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195491+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:23:37.195491+0000","last_peered":"2023-07-09T21:23:37.195491+0000","last_clean":"2023-07-09T21:23:37.195491+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:23:37.195491+0000","last_undegraded":"2023-07-09T21:23:37.195491+0000","last_fullsized":"2023-07-09T21:23:37.195491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:21.335107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.188514+0000","last_change":"2023-07-09T21:23:37.188514+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.188514+0000","last_undegraded":"2023-07-09T21:23:37.188514+0000","last_fullsized":"2023-07-09T21:23:37.188514+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207655+0000","last_change":"2023-07-09T21:23:37.197379+0000","last_active":"2023-07-09T21:23:37.207655+0000","last_peered":"2023-07-09T21:23:37.207655+0000","last_clean":"2023-07-09T21:23:37.207655+0000","last_became_active":"2023-07-09T21:23:37.197066+0000","last_became_peered":"2023-07-09T21:23:37.197066+0000","last_unstale":"2023-07-09T21:23:37.207655+0000","last_undegraded":"2023-07-09T21:23:37.207655+0000","last_fullsized":"2023-07-09T21:23:37.207655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:32.542493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.188939+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:23:37.188939+0000","last_peered":"2023-07-09T21:23:37.188939+0000","last_clean":"2023-07-09T21:23:37.188939+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:23:37.188939+0000","last_undegraded":"2023-07-09T21:23:37.188939+0000","last_fullsized":"2023-07-09T21:23:37.188939+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:56:07.373088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.186741+0000","last_change":"2023-07-09T21:23:37.186741+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.186741+0000","last_undegraded":"2023-07-09T21:23:37.186741+0000","last_fullsized":"2023-07-09T21:23:37.186741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.197150+0000","last_change":"2023-07-09T21:23:37.193012+0000","last_active":"2023-07-09T21:23:37.197150+0000","last_peered":"2023-07-09T21:23:37.197150+0000","last_clean":"2023-07-09T21:23:37.197150+0000","last_became_active":"2023-07-09T21:23:37.192697+0000","last_became_peered":"2023-07-09T21:23:37.192697+0000","last_unstale":"2023-07-09T21:23:37.197150+0000","last_undegraded":"2023-07-09T21:23:37.197150+0000","last_fullsized":"2023-07-09T21:23:37.197150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:45.754766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":39,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.181302+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:23:37.181302+0000","last_peered":"2023-07-09T21:23:37.181302+0000","last_clean":"2023-07-09T21:23:37.181302+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:23:37.181302+0000","last_undegraded":"2023-07-09T21:23:37.181302+0000","last_fullsized":"2023-07-09T21:23:37.181302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:13.722095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187628+0000","last_change":"2023-07-09T21:23:37.187628+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187628+0000","last_undegraded":"2023-07-09T21:23:37.187628+0000","last_fullsized":"2023-07-09T21:23:37.187628+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202533+0000","last_change":"2023-07-09T21:23:37.199308+0000","last_active":"2023-07-09T21:23:37.202533+0000","last_peered":"2023-07-09T21:23:37.202533+0000","last_clean":"2023-07-09T21:23:37.202533+0000","last_became_active":"2023-07-09T21:23:37.199029+0000","last_became_peered":"2023-07-09T21:23:37.199029+0000","last_unstale":"2023-07-09T21:23:37.202533+0000","last_undegraded":"2023-07-09T21:23:37.202533+0000","last_fullsized":"2023-07-09T21:23:37.202533+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:18.349317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.195303+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:23:37.195303+0000","last_peered":"2023-07-09T21:23:37.195303+0000","last_clean":"2023-07-09T21:23:37.195303+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:23:37.195303+0000","last_undegraded":"2023-07-09T21:23:37.195303+0000","last_fullsized":"2023-07-09T21:23:37.195303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:31.700784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187329+0000","last_change":"2023-07-09T21:23:37.187329+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187329+0000","last_undegraded":"2023-07-09T21:23:37.187329+0000","last_fullsized":"2023-07-09T21:23:37.187329+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.202490+0000","last_change":"2023-07-09T21:23:37.198511+0000","last_active":"2023-07-09T21:23:37.202490+0000","last_peered":"2023-07-09T21:23:37.202490+0000","last_clean":"2023-07-09T21:23:37.202490+0000","last_became_active":"2023-07-09T21:23:37.198226+0000","last_became_peered":"2023-07-09T21:23:37.198226+0000","last_unstale":"2023-07-09T21:23:37.202490+0000","last_undegraded":"2023-07-09T21:23:37.202490+0000","last_fullsized":"2023-07-09T21:23:37.202490+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:33.009836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184931+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:23:37.184931+0000","last_peered":"2023-07-09T21:23:37.184931+0000","last_clean":"2023-07-09T21:23:37.184931+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:23:37.184931+0000","last_undegraded":"2023-07-09T21:23:37.184931+0000","last_fullsized":"2023-07-09T21:23:37.184931+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:26.255072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.187847+0000","last_change":"2023-07-09T21:23:37.187847+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.187847+0000","last_undegraded":"2023-07-09T21:23:37.187847+0000","last_fullsized":"2023-07-09T21:23:37.187847+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.207556+0000","last_change":"2023-07-09T21:23:37.203604+0000","last_active":"2023-07-09T21:23:37.207556+0000","last_peered":"2023-07-09T21:23:37.207556+0000","last_clean":"2023-07-09T21:23:37.207556+0000","last_became_active":"2023-07-09T21:23:37.203306+0000","last_became_peered":"2023-07-09T21:23:37.203306+0000","last_unstale":"2023-07-09T21:23:37.207556+0000","last_undegraded":"2023-07-09T21:23:37.207556+0000","last_fullsized":"2023-07-09T21:23:37.207556+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.648074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.191596+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:23:37.191596+0000","last_peered":"2023-07-09T21:23:37.191596+0000","last_clean":"2023-07-09T21:23:37.191596+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:23:37.191596+0000","last_undegraded":"2023-07-09T21:23:37.191596+0000","last_fullsized":"2023-07-09T21:23:37.191596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:40.689587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.194650+0000","last_change":"2023-07-09T21:23:37.194650+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.194650+0000","last_undegraded":"2023-07-09T21:23:37.194650+0000","last_fullsized":"2023-07-09T21:23:37.194650+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.205466+0000","last_change":"2023-07-09T21:23:37.199737+0000","last_active":"2023-07-09T21:23:37.205466+0000","last_peered":"2023-07-09T21:23:37.205466+0000","last_clean":"2023-07-09T21:23:37.205466+0000","last_became_active":"2023-07-09T21:23:37.199176+0000","last_became_peered":"2023-07-09T21:23:37.199176+0000","last_unstale":"2023-07-09T21:23:37.205466+0000","last_undegraded":"2023-07-09T21:23:37.205466+0000","last_fullsized":"2023-07-09T21:23:37.205466+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.184583+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:23:37.184583+0000","last_peered":"2023-07-09T21:23:37.184583+0000","last_clean":"2023-07-09T21:23:37.184583+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:23:37.184583+0000","last_undegraded":"2023-07-09T21:23:37.184583+0000","last_fullsized":"2023-07-09T21:23:37.184583+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:06.960119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":35,"state":"creating+peering","last_fresh":"2023-07-09T21:23:37.185692+0000","last_change":"2023-07-09T21:23:37.185692+0000","last_active":"2023-07-09T21:23:37.171191+0000","last_peered":"2023-07-09T21:23:37.171191+0000","last_clean":"2023-07-09T21:23:37.171191+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:23:37.185692+0000","last_undegraded":"2023-07-09T21:23:37.185692+0000","last_fullsized":"2023-07-09T21:23:37.185692+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.200661+0000","last_change":"2023-07-09T21:23:37.197526+0000","last_active":"2023-07-09T21:23:37.200661+0000","last_peered":"2023-07-09T21:23:37.200661+0000","last_clean":"2023-07-09T21:23:37.200661+0000","last_became_active":"2023-07-09T21:23:37.197207+0000","last_became_peered":"2023-07-09T21:23:37.197207+0000","last_unstale":"2023-07-09T21:23:37.200661+0000","last_undegraded":"2023-07-09T21:23:37.200661+0000","last_fullsized":"2023-07-09T21:23:37.200661+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:39.261345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-07-09T21:23:37.198128+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:23:37.198128+0000","last_peered":"2023-07-09T21:23:37.198128+0000","last_clean":"2023-07-09T21:23:37.198128+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:23:37.198128+0000","last_undegraded":"2023-07-09T21:23:37.198128+0000","last_fullsized":"2023-07-09T21:23:37.198128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:01.604065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343920,"statfs":{"total":96636764160,"available":96608174080,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.628}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.499},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.59099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.85899999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.83599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.92800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.77200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.745},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.439},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61399999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65400000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.68500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":376,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":385024,"data_stored":154979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.85399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.70899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.375},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.53400000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.72499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.47799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.57599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.83299999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.72499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27340,"kb_used_data":388,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344500,"statfs":{"total":96636764160,"available":96608768000,"internally_reserved":0,"allocated":397312,"data_stored":161607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.61099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.65700000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.503}]},{"osd":4,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":0.83499999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.80000000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.67500000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":751975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.49299999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.70599999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.69199999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.86599999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.78100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:23:46.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:23:47.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 Processor -- start 2023-07-09T21:23:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 -- start start 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f4c15ba60 0x7f2f4c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c06acb0 con 0x7f2f4c0cf260 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4c1605f0 con 0x7f2f4c0cc800 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f519d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f4c0ccc90 con 0x7f2f4c15ba60 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f4c15ba60 0x7f2f4c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2f4c0cf260 0x7f2f4c0d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49444/0 (socket says 172.21.15.37:49444) 2023-07-09T21:23:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4b7fe640 1 -- 172.21.15.37:0/3988222671 learned_addr learned my addr 172.21.15.37:0/3988222671 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4affd640 1 -- 172.21.15.37:0/3988222671 >> v1:172.21.15.119:6789/0 conn(0x7f2f4c0cc800 legacy=0x7f2f4c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4affd640 1 -- 172.21.15.37:0/3988222671 >> v1:172.21.15.37:6789/0 conn(0x7f2f4c0cf260 legacy=0x7f2f4c0d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.029+0000 7f2f4affd640 1 -- 172.21.15.37:0/3988222671 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f4c0cfe20 con 0x7f2f4c15ba60 2023-07-09T21:23:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f4affd640 1 --2- 172.21.15.37:0/3988222671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c15ba60 0x7f2f4c1600b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0097c0 tx=0x7f2f3c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dddaa1a1020220b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f4a7fc640 1 -- 172.21.15.37:0/3988222671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0ac620 con 0x7f2f4c15ba60 2023-07-09T21:23:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f4a7fc640 1 -- 172.21.15.37:0/3988222671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c0ac780 con 0x7f2f4c15ba60 2023-07-09T21:23:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f4a7fc640 1 -- 172.21.15.37:0/3988222671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c0acb10 con 0x7f2f4c15ba60 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 -- 172.21.15.37:0/3988222671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c15ba60 msgr2=0x7f2f4c1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 --2- 172.21.15.37:0/3988222671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c15ba60 0x7f2f4c1600b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0097c0 tx=0x7f2f3c01c3c0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 -- 172.21.15.37:0/3988222671 shutdown_connections 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 --2- 172.21.15.37:0/3988222671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c15ba60 0x7f2f4c1600b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 -- 172.21.15.37:0/3988222671 >> 172.21.15.37:0/3988222671 conn(0x7f2f4c073090 msgr2=0x7f2f4c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:47.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.033+0000 7f2f519d2640 1 -- 172.21.15.37:0/3988222671 shutdown_connections 2023-07-09T21:23:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 -- 172.21.15.37:0/3988222671 wait complete. 2023-07-09T21:23:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 Processor -- start 2023-07-09T21:23:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 -- start start 2023-07-09T21:23:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 0x7f2f4c15c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 0x7f2f4c0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c15c730 con 0x7f2f4c0cf260 2023-07-09T21:23:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c1f71a0 con 0x7f2f4c0cc800 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f519d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4c150fc0 con 0x7f2f4c15ba60 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38430/0 (socket says 172.21.15.37:38430) 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 -- 172.21.15.37:0/465587020 learned_addr learned my addr 172.21.15.37:0/465587020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f4affd640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 0x7f2f4c15c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f4b7fe640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 0x7f2f4c0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 -- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 msgr2=0x7f2f4c0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 0x7f2f4c0c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 -- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 msgr2=0x7f2f4c15c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 0x7f2f4c15c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 -- 172.21.15.37:0/465587020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009420 con 0x7f2f4c0cf260 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f4affd640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 0x7f2f4c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f4b7fe640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 0x7f2f4c0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:47.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.037+0000 7f2f43fff640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c3c0 tx=0x7f2f3400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f340052d0 con 0x7f2f4c0cf260 2023-07-09T21:23:47.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f34005430 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f34003820 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f4c1512a0 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4c151860 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4c0668f0 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f34003980 con 0x7f2f4c0cf260 2023-07-09T21:23:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 0x7f2f2c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2f340832a0 con 0x7f2f4c0cf260 2023-07-09T21:23:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.041+0000 7f2f4affd640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 0x7f2f2c068780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.045+0000 7f2f4affd640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 0x7f2f2c068780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae000 tx=0x7f2f3c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.045+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f34050700 con 0x7f2f4c0cf260 2023-07-09T21:23:47.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.201+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f4c0ccf70 con 0x7f2f2c0662d0 2023-07-09T21:23:47.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.209+0000 7f2f48ff9640 1 -- 172.21.15.37:0/465587020 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311375 (secure 0 0 0) 0x7f2f3c0bc090 con 0x7f2f2c0662d0 2023-07-09T21:23:47.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:23:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 msgr2=0x7f2f2c068780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 0x7f2f2c068780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c0ae000 tx=0x7f2f3c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 msgr2=0x7f2f4c1f6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c3c0 tx=0x7f2f3400c880 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 shutdown_connections 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f2f2c0662d0 0x7f2f2c068780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f4c15ba60 0x7f2f4c0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f4c0cf260 0x7f2f4c1f6c60 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 --2- 172.21.15.37:0/465587020 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f4c0cc800 0x7f2f4c15c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 >> 172.21.15.37:0/465587020 conn(0x7f2f4c073090 msgr2=0x7f2f4c0ce4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 shutdown_connections 2023-07-09T21:23:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.213+0000 7f2f519d2640 1 -- 172.21.15.37:0/465587020 wait complete. 2023-07-09T21:23:47.234 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-07-09T21:23:45.970646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224232,"kb_used_data":4520,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750488,"statfs":{"total":773094113280,"available":772864499712,"internally_reserved":0,"allocated":4628480,"data_stored":2588564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001615"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679079+0000","last_change":"2023-07-09T21:23:38.200897+0000","last_active":"2023-07-09T21:23:39.679079+0000","last_peered":"2023-07-09T21:23:39.679079+0000","last_clean":"2023-07-09T21:23:39.679079+0000","last_became_active":"2023-07-09T21:23:38.200581+0000","last_became_peered":"2023-07-09T21:23:38.200581+0000","last_unstale":"2023-07-09T21:23:39.679079+0000","last_undegraded":"2023-07-09T21:23:39.679079+0000","last_fullsized":"2023-07-09T21:23:39.679079+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:51:47.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678409+0000","last_change":"2023-07-09T21:23:38.201471+0000","last_active":"2023-07-09T21:23:39.678409+0000","last_peered":"2023-07-09T21:23:39.678409+0000","last_clean":"2023-07-09T21:23:39.678409+0000","last_became_active":"2023-07-09T21:23:38.201187+0000","last_became_peered":"2023-07-09T21:23:38.201187+0000","last_unstale":"2023-07-09T21:23:39.678409+0000","last_undegraded":"2023-07-09T21:23:39.678409+0000","last_fullsized":"2023-07-09T21:23:39.678409+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:44.098267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679451+0000","last_change":"2023-07-09T21:23:38.207827+0000","last_active":"2023-07-09T21:23:39.679451+0000","last_peered":"2023-07-09T21:23:39.679451+0000","last_clean":"2023-07-09T21:23:39.679451+0000","last_became_active":"2023-07-09T21:23:38.207477+0000","last_became_peered":"2023-07-09T21:23:38.207477+0000","last_unstale":"2023-07-09T21:23:39.679451+0000","last_undegraded":"2023-07-09T21:23:39.679451+0000","last_fullsized":"2023-07-09T21:23:39.679451+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:44.098267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343666+0000","last_change":"2023-07-09T21:23:38.213881+0000","last_active":"2023-07-09T21:23:39.343666+0000","last_peered":"2023-07-09T21:23:39.343666+0000","last_clean":"2023-07-09T21:23:39.343666+0000","last_became_active":"2023-07-09T21:23:38.213336+0000","last_became_peered":"2023-07-09T21:23:38.213336+0000","last_unstale":"2023-07-09T21:23:39.343666+0000","last_undegraded":"2023-07-09T21:23:39.343666+0000","last_fullsized":"2023-07-09T21:23:39.343666+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:50.114510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343392+0000","last_change":"2023-07-09T21:23:38.213646+0000","last_active":"2023-07-09T21:23:39.343392+0000","last_peered":"2023-07-09T21:23:39.343392+0000","last_clean":"2023-07-09T21:23:39.343392+0000","last_became_active":"2023-07-09T21:23:38.213294+0000","last_became_peered":"2023-07-09T21:23:38.213294+0000","last_unstale":"2023-07-09T21:23:39.343392+0000","last_undegraded":"2023-07-09T21:23:39.343392+0000","last_fullsized":"2023-07-09T21:23:39.343392+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:27:22.281527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678394+0000","last_change":"2023-07-09T21:23:38.200853+0000","last_active":"2023-07-09T21:23:39.678394+0000","last_peered":"2023-07-09T21:23:39.678394+0000","last_clean":"2023-07-09T21:23:39.678394+0000","last_became_active":"2023-07-09T21:23:38.200585+0000","last_became_peered":"2023-07-09T21:23:38.200585+0000","last_unstale":"2023-07-09T21:23:39.678394+0000","last_undegraded":"2023-07-09T21:23:39.678394+0000","last_fullsized":"2023-07-09T21:23:39.678394+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:33.550779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188734+0000","last_change":"2023-07-09T21:23:38.198112+0000","last_active":"2023-07-09T21:23:39.188734+0000","last_peered":"2023-07-09T21:23:39.188734+0000","last_clean":"2023-07-09T21:23:39.188734+0000","last_became_active":"2023-07-09T21:23:38.197858+0000","last_became_peered":"2023-07-09T21:23:38.197858+0000","last_unstale":"2023-07-09T21:23:39.188734+0000","last_undegraded":"2023-07-09T21:23:39.188734+0000","last_fullsized":"2023-07-09T21:23:39.188734+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:27.248066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.677753+0000","last_change":"2023-07-09T21:23:38.200238+0000","last_active":"2023-07-09T21:23:39.677753+0000","last_peered":"2023-07-09T21:23:39.677753+0000","last_clean":"2023-07-09T21:23:39.677753+0000","last_became_active":"2023-07-09T21:23:38.199974+0000","last_became_peered":"2023-07-09T21:23:38.199974+0000","last_unstale":"2023-07-09T21:23:39.677753+0000","last_undegraded":"2023-07-09T21:23:39.677753+0000","last_fullsized":"2023-07-09T21:23:39.677753+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:26:25.045618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679652+0000","last_change":"2023-07-09T21:23:38.216546+0000","last_active":"2023-07-09T21:23:39.679652+0000","last_peered":"2023-07-09T21:23:39.679652+0000","last_clean":"2023-07-09T21:23:39.679652+0000","last_became_active":"2023-07-09T21:23:38.216269+0000","last_became_peered":"2023-07-09T21:23:38.216269+0000","last_unstale":"2023-07-09T21:23:39.679652+0000","last_undegraded":"2023-07-09T21:23:39.679652+0000","last_fullsized":"2023-07-09T21:23:39.679652+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:06:01.168260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189399+0000","last_change":"2023-07-09T21:23:38.203301+0000","last_active":"2023-07-09T21:23:39.189399+0000","last_peered":"2023-07-09T21:23:39.189399+0000","last_clean":"2023-07-09T21:23:39.189399+0000","last_became_active":"2023-07-09T21:23:38.200003+0000","last_became_peered":"2023-07-09T21:23:38.200003+0000","last_unstale":"2023-07-09T21:23:39.189399+0000","last_undegraded":"2023-07-09T21:23:39.189399+0000","last_fullsized":"2023-07-09T21:23:39.189399+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:03.625282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189309+0000","last_change":"2023-07-09T21:23:38.214480+0000","last_active":"2023-07-09T21:23:39.189309+0000","last_peered":"2023-07-09T21:23:39.189309+0000","last_clean":"2023-07-09T21:23:39.189309+0000","last_became_active":"2023-07-09T21:23:38.214200+0000","last_became_peered":"2023-07-09T21:23:38.214200+0000","last_unstale":"2023-07-09T21:23:39.189309+0000","last_undegraded":"2023-07-09T21:23:39.189309+0000","last_fullsized":"2023-07-09T21:23:39.189309+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:14.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679400+0000","last_change":"2023-07-09T21:23:38.201270+0000","last_active":"2023-07-09T21:23:39.679400+0000","last_peered":"2023-07-09T21:23:39.679400+0000","last_clean":"2023-07-09T21:23:39.679400+0000","last_became_active":"2023-07-09T21:23:38.200984+0000","last_became_peered":"2023-07-09T21:23:38.200984+0000","last_unstale":"2023-07-09T21:23:39.679400+0000","last_undegraded":"2023-07-09T21:23:39.679400+0000","last_fullsized":"2023-07-09T21:23:39.679400+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:33.550779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189600+0000","last_change":"2023-07-09T21:23:38.200001+0000","last_active":"2023-07-09T21:23:39.189600+0000","last_peered":"2023-07-09T21:23:39.189600+0000","last_clean":"2023-07-09T21:23:39.189600+0000","last_became_active":"2023-07-09T21:23:38.199708+0000","last_became_peered":"2023-07-09T21:23:38.199708+0000","last_unstale":"2023-07-09T21:23:39.189600+0000","last_undegraded":"2023-07-09T21:23:39.189600+0000","last_fullsized":"2023-07-09T21:23:39.189600+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:15:20.552537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188395+0000","last_change":"2023-07-09T21:23:38.214324+0000","last_active":"2023-07-09T21:23:39.188395+0000","last_peered":"2023-07-09T21:23:39.188395+0000","last_clean":"2023-07-09T21:23:39.188395+0000","last_became_active":"2023-07-09T21:23:38.214055+0000","last_became_peered":"2023-07-09T21:23:38.214055+0000","last_unstale":"2023-07-09T21:23:39.188395+0000","last_undegraded":"2023-07-09T21:23:39.188395+0000","last_fullsized":"2023-07-09T21:23:39.188395+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:57.580823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189048+0000","last_change":"2023-07-09T21:23:38.202861+0000","last_active":"2023-07-09T21:23:39.189048+0000","last_peered":"2023-07-09T21:23:39.189048+0000","last_clean":"2023-07-09T21:23:39.189048+0000","last_became_active":"2023-07-09T21:23:38.202301+0000","last_became_peered":"2023-07-09T21:23:38.202301+0000","last_unstale":"2023-07-09T21:23:39.189048+0000","last_undegraded":"2023-07-09T21:23:39.189048+0000","last_fullsized":"2023-07-09T21:23:39.189048+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:54.343662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679110+0000","last_change":"2023-07-09T21:23:38.210054+0000","last_active":"2023-07-09T21:23:39.679110+0000","last_peered":"2023-07-09T21:23:39.679110+0000","last_clean":"2023-07-09T21:23:39.679110+0000","last_became_active":"2023-07-09T21:23:38.209683+0000","last_became_peered":"2023-07-09T21:23:38.209683+0000","last_unstale":"2023-07-09T21:23:39.679110+0000","last_undegraded":"2023-07-09T21:23:39.679110+0000","last_fullsized":"2023-07-09T21:23:39.679110+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:04:07.806770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679679+0000","last_change":"2023-07-09T21:23:38.201142+0000","last_active":"2023-07-09T21:23:39.679679+0000","last_peered":"2023-07-09T21:23:39.679679+0000","last_clean":"2023-07-09T21:23:39.679679+0000","last_became_active":"2023-07-09T21:23:38.200895+0000","last_became_peered":"2023-07-09T21:23:38.200895+0000","last_unstale":"2023-07-09T21:23:39.679679+0000","last_undegraded":"2023-07-09T21:23:39.679679+0000","last_fullsized":"2023-07-09T21:23:39.679679+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:38.019033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187664+0000","last_change":"2023-07-09T21:23:38.214170+0000","last_active":"2023-07-09T21:23:39.187664+0000","last_peered":"2023-07-09T21:23:39.187664+0000","last_clean":"2023-07-09T21:23:39.187664+0000","last_became_active":"2023-07-09T21:23:38.213848+0000","last_became_peered":"2023-07-09T21:23:38.213848+0000","last_unstale":"2023-07-09T21:23:39.187664+0000","last_undegraded":"2023-07-09T21:23:39.187664+0000","last_fullsized":"2023-07-09T21:23:39.187664+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:37:22.708044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343643+0000","last_change":"2023-07-09T21:23:38.196479+0000","last_active":"2023-07-09T21:23:39.343643+0000","last_peered":"2023-07-09T21:23:39.343643+0000","last_clean":"2023-07-09T21:23:39.343643+0000","last_became_active":"2023-07-09T21:23:38.196163+0000","last_became_peered":"2023-07-09T21:23:38.196163+0000","last_unstale":"2023-07-09T21:23:39.343643+0000","last_undegraded":"2023-07-09T21:23:39.343643+0000","last_fullsized":"2023-07-09T21:23:39.343643+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:34.412909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187882+0000","last_change":"2023-07-09T21:23:38.214173+0000","last_active":"2023-07-09T21:23:39.187882+0000","last_peered":"2023-07-09T21:23:39.187882+0000","last_clean":"2023-07-09T21:23:39.187882+0000","last_became_active":"2023-07-09T21:23:38.213880+0000","last_became_peered":"2023-07-09T21:23:38.213880+0000","last_unstale":"2023-07-09T21:23:39.187882+0000","last_undegraded":"2023-07-09T21:23:39.187882+0000","last_fullsized":"2023-07-09T21:23:39.187882+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:45.885346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188872+0000","last_change":"2023-07-09T21:23:38.197428+0000","last_active":"2023-07-09T21:23:39.188872+0000","last_peered":"2023-07-09T21:23:39.188872+0000","last_clean":"2023-07-09T21:23:39.188872+0000","last_became_active":"2023-07-09T21:23:38.197109+0000","last_became_peered":"2023-07-09T21:23:38.197109+0000","last_unstale":"2023-07-09T21:23:39.188872+0000","last_undegraded":"2023-07-09T21:23:39.188872+0000","last_fullsized":"2023-07-09T21:23:39.188872+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:29.392228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188799+0000","last_change":"2023-07-09T21:23:38.206688+0000","last_active":"2023-07-09T21:23:39.188799+0000","last_peered":"2023-07-09T21:23:39.188799+0000","last_clean":"2023-07-09T21:23:39.188799+0000","last_became_active":"2023-07-09T21:23:38.206124+0000","last_became_peered":"2023-07-09T21:23:38.206124+0000","last_unstale":"2023-07-09T21:23:39.188799+0000","last_undegraded":"2023-07-09T21:23:39.188799+0000","last_fullsized":"2023-07-09T21:23:39.188799+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:51:45.578342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679081+0000","last_change":"2023-07-09T21:23:38.200239+0000","last_active":"2023-07-09T21:23:39.679081+0000","last_peered":"2023-07-09T21:23:39.679081+0000","last_clean":"2023-07-09T21:23:39.679081+0000","last_became_active":"2023-07-09T21:23:38.199548+0000","last_became_peered":"2023-07-09T21:23:38.199548+0000","last_unstale":"2023-07-09T21:23:39.679081+0000","last_undegraded":"2023-07-09T21:23:39.679081+0000","last_fullsized":"2023-07-09T21:23:39.679081+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:19.083131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343352+0000","last_change":"2023-07-09T21:23:38.191561+0000","last_active":"2023-07-09T21:23:39.343352+0000","last_peered":"2023-07-09T21:23:39.343352+0000","last_clean":"2023-07-09T21:23:39.343352+0000","last_became_active":"2023-07-09T21:23:38.191277+0000","last_became_peered":"2023-07-09T21:23:38.191277+0000","last_unstale":"2023-07-09T21:23:39.343352+0000","last_undegraded":"2023-07-09T21:23:39.343352+0000","last_fullsized":"2023-07-09T21:23:39.343352+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:31.250618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187663+0000","last_change":"2023-07-09T21:23:38.200961+0000","last_active":"2023-07-09T21:23:39.187663+0000","last_peered":"2023-07-09T21:23:39.187663+0000","last_clean":"2023-07-09T21:23:39.187663+0000","last_became_active":"2023-07-09T21:23:38.200692+0000","last_became_peered":"2023-07-09T21:23:38.200692+0000","last_unstale":"2023-07-09T21:23:39.187663+0000","last_undegraded":"2023-07-09T21:23:39.187663+0000","last_fullsized":"2023-07-09T21:23:39.187663+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:13:57.202679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678845+0000","last_change":"2023-07-09T21:23:38.209243+0000","last_active":"2023-07-09T21:23:39.678845+0000","last_peered":"2023-07-09T21:23:39.678845+0000","last_clean":"2023-07-09T21:23:39.678845+0000","last_became_active":"2023-07-09T21:23:38.208934+0000","last_became_peered":"2023-07-09T21:23:38.208934+0000","last_unstale":"2023-07-09T21:23:39.678845+0000","last_undegraded":"2023-07-09T21:23:39.678845+0000","last_fullsized":"2023-07-09T21:23:39.678845+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:51:47.196686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188149+0000","last_change":"2023-07-09T21:23:38.204282+0000","last_active":"2023-07-09T21:23:39.188149+0000","last_peered":"2023-07-09T21:23:39.188149+0000","last_clean":"2023-07-09T21:23:39.188149+0000","last_became_active":"2023-07-09T21:23:38.203984+0000","last_became_peered":"2023-07-09T21:23:38.203984+0000","last_unstale":"2023-07-09T21:23:39.188149+0000","last_undegraded":"2023-07-09T21:23:39.188149+0000","last_fullsized":"2023-07-09T21:23:39.188149+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:31.250618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189302+0000","last_change":"2023-07-09T21:23:38.199662+0000","last_active":"2023-07-09T21:23:39.189302+0000","last_peered":"2023-07-09T21:23:39.189302+0000","last_clean":"2023-07-09T21:23:39.189302+0000","last_became_active":"2023-07-09T21:23:38.199338+0000","last_became_peered":"2023-07-09T21:23:38.199338+0000","last_unstale":"2023-07-09T21:23:39.189302+0000","last_undegraded":"2023-07-09T21:23:39.189302+0000","last_fullsized":"2023-07-09T21:23:39.189302+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:07.063883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187716+0000","last_change":"2023-07-09T21:23:38.205839+0000","last_active":"2023-07-09T21:23:39.187716+0000","last_peered":"2023-07-09T21:23:39.187716+0000","last_clean":"2023-07-09T21:23:39.187716+0000","last_became_active":"2023-07-09T21:23:38.205575+0000","last_became_peered":"2023-07-09T21:23:38.205575+0000","last_unstale":"2023-07-09T21:23:39.187716+0000","last_undegraded":"2023-07-09T21:23:39.187716+0000","last_fullsized":"2023-07-09T21:23:39.187716+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:24.792377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187450+0000","last_change":"2023-07-09T21:23:38.200116+0000","last_active":"2023-07-09T21:23:39.187450+0000","last_peered":"2023-07-09T21:23:39.187450+0000","last_clean":"2023-07-09T21:23:39.187450+0000","last_became_active":"2023-07-09T21:23:38.199816+0000","last_became_peered":"2023-07-09T21:23:38.199816+0000","last_unstale":"2023-07-09T21:23:39.187450+0000","last_undegraded":"2023-07-09T21:23:39.187450+0000","last_fullsized":"2023-07-09T21:23:39.187450+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:30.411796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679151+0000","last_change":"2023-07-09T21:23:38.200613+0000","last_active":"2023-07-09T21:23:39.679151+0000","last_peered":"2023-07-09T21:23:39.679151+0000","last_clean":"2023-07-09T21:23:39.679151+0000","last_became_active":"2023-07-09T21:23:38.200002+0000","last_became_peered":"2023-07-09T21:23:38.200002+0000","last_unstale":"2023-07-09T21:23:39.679151+0000","last_undegraded":"2023-07-09T21:23:39.679151+0000","last_fullsized":"2023-07-09T21:23:39.679151+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:01.682532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678132+0000","last_change":"2023-07-09T21:23:38.201976+0000","last_active":"2023-07-09T21:23:39.678132+0000","last_peered":"2023-07-09T21:23:39.678132+0000","last_clean":"2023-07-09T21:23:39.678132+0000","last_became_active":"2023-07-09T21:23:38.201257+0000","last_became_peered":"2023-07-09T21:23:38.201257+0000","last_unstale":"2023-07-09T21:23:39.678132+0000","last_undegraded":"2023-07-09T21:23:39.678132+0000","last_fullsized":"2023-07-09T21:23:39.678132+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:20.607440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679363+0000","last_change":"2023-07-09T21:23:38.201940+0000","last_active":"2023-07-09T21:23:39.679363+0000","last_peered":"2023-07-09T21:23:39.679363+0000","last_clean":"2023-07-09T21:23:39.679363+0000","last_became_active":"2023-07-09T21:23:38.201114+0000","last_became_peered":"2023-07-09T21:23:38.201114+0000","last_unstale":"2023-07-09T21:23:39.679363+0000","last_undegraded":"2023-07-09T21:23:39.679363+0000","last_fullsized":"2023-07-09T21:23:39.679363+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:33:10.684295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"36'4","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187825+0000","last_change":"2023-07-09T21:23:37.205856+0000","last_active":"2023-07-09T21:23:39.187825+0000","last_peered":"2023-07-09T21:23:39.187825+0000","last_clean":"2023-07-09T21:23:39.187825+0000","last_became_active":"2023-07-09T21:23:37.205568+0000","last_became_peered":"2023-07-09T21:23:37.205568+0000","last_unstale":"2023-07-09T21:23:39.187825+0000","last_undegraded":"2023-07-09T21:23:39.187825+0000","last_fullsized":"2023-07-09T21:23:39.187825+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:14.704825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678371+0000","last_change":"2023-07-09T21:23:38.216560+0000","last_active":"2023-07-09T21:23:39.678371+0000","last_peered":"2023-07-09T21:23:39.678371+0000","last_clean":"2023-07-09T21:23:39.678371+0000","last_became_active":"2023-07-09T21:23:38.216249+0000","last_became_peered":"2023-07-09T21:23:38.216249+0000","last_unstale":"2023-07-09T21:23:39.678371+0000","last_undegraded":"2023-07-09T21:23:39.678371+0000","last_fullsized":"2023-07-09T21:23:39.678371+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:00.177490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679426+0000","last_change":"2023-07-09T21:23:37.200996+0000","last_active":"2023-07-09T21:23:39.679426+0000","last_peered":"2023-07-09T21:23:39.679426+0000","last_clean":"2023-07-09T21:23:39.679426+0000","last_became_active":"2023-07-09T21:23:37.200647+0000","last_became_peered":"2023-07-09T21:23:37.200647+0000","last_unstale":"2023-07-09T21:23:39.679426+0000","last_undegraded":"2023-07-09T21:23:39.679426+0000","last_fullsized":"2023-07-09T21:23:39.679426+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189760+0000","last_change":"2023-07-09T21:23:38.207892+0000","last_active":"2023-07-09T21:23:39.189760+0000","last_peered":"2023-07-09T21:23:39.189760+0000","last_clean":"2023-07-09T21:23:39.189760+0000","last_became_active":"2023-07-09T21:23:38.207312+0000","last_became_peered":"2023-07-09T21:23:38.207312+0000","last_unstale":"2023-07-09T21:23:39.189760+0000","last_undegraded":"2023-07-09T21:23:39.189760+0000","last_fullsized":"2023-07-09T21:23:39.189760+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:54:33.452768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678631+0000","last_change":"2023-07-09T21:23:37.203576+0000","last_active":"2023-07-09T21:23:39.678631+0000","last_peered":"2023-07-09T21:23:39.678631+0000","last_clean":"2023-07-09T21:23:39.678631+0000","last_became_active":"2023-07-09T21:23:37.203281+0000","last_became_peered":"2023-07-09T21:23:37.203281+0000","last_unstale":"2023-07-09T21:23:39.678631+0000","last_undegraded":"2023-07-09T21:23:39.678631+0000","last_fullsized":"2023-07-09T21:23:39.678631+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:43.089981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678934+0000","last_change":"2023-07-09T21:23:38.200289+0000","last_active":"2023-07-09T21:23:39.678934+0000","last_peered":"2023-07-09T21:23:39.678934+0000","last_clean":"2023-07-09T21:23:39.678934+0000","last_became_active":"2023-07-09T21:23:38.199890+0000","last_became_peered":"2023-07-09T21:23:38.199890+0000","last_unstale":"2023-07-09T21:23:39.678934+0000","last_undegraded":"2023-07-09T21:23:39.678934+0000","last_fullsized":"2023-07-09T21:23:39.678934+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:06:01.168260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189187+0000","last_change":"2023-07-09T21:23:37.199060+0000","last_active":"2023-07-09T21:23:39.189187+0000","last_peered":"2023-07-09T21:23:39.189187+0000","last_clean":"2023-07-09T21:23:39.189187+0000","last_became_active":"2023-07-09T21:23:37.198702+0000","last_became_peered":"2023-07-09T21:23:37.198702+0000","last_unstale":"2023-07-09T21:23:39.189187+0000","last_undegraded":"2023-07-09T21:23:39.189187+0000","last_fullsized":"2023-07-09T21:23:39.189187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:04:06.798484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678851+0000","last_change":"2023-07-09T21:23:38.195211+0000","last_active":"2023-07-09T21:23:39.678851+0000","last_peered":"2023-07-09T21:23:39.678851+0000","last_clean":"2023-07-09T21:23:39.678851+0000","last_became_active":"2023-07-09T21:23:38.194961+0000","last_became_peered":"2023-07-09T21:23:38.194961+0000","last_unstale":"2023-07-09T21:23:39.678851+0000","last_undegraded":"2023-07-09T21:23:39.678851+0000","last_fullsized":"2023-07-09T21:23:39.678851+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:04.880887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189468+0000","last_change":"2023-07-09T21:23:37.201618+0000","last_active":"2023-07-09T21:23:39.189468+0000","last_peered":"2023-07-09T21:23:39.189468+0000","last_clean":"2023-07-09T21:23:39.189468+0000","last_became_active":"2023-07-09T21:23:37.201315+0000","last_became_peered":"2023-07-09T21:23:37.201315+0000","last_unstale":"2023-07-09T21:23:39.189468+0000","last_undegraded":"2023-07-09T21:23:39.189468+0000","last_fullsized":"2023-07-09T21:23:39.189468+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:37.010747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188909+0000","last_change":"2023-07-09T21:23:38.202620+0000","last_active":"2023-07-09T21:23:39.188909+0000","last_peered":"2023-07-09T21:23:39.188909+0000","last_clean":"2023-07-09T21:23:39.188909+0000","last_became_active":"2023-07-09T21:23:38.201891+0000","last_became_peered":"2023-07-09T21:23:38.201891+0000","last_unstale":"2023-07-09T21:23:39.188909+0000","last_undegraded":"2023-07-09T21:23:39.188909+0000","last_fullsized":"2023-07-09T21:23:39.188909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:40:49.368627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679063+0000","last_change":"2023-07-09T21:23:37.205993+0000","last_active":"2023-07-09T21:23:39.679063+0000","last_peered":"2023-07-09T21:23:39.679063+0000","last_clean":"2023-07-09T21:23:39.679063+0000","last_became_active":"2023-07-09T21:23:37.205740+0000","last_became_peered":"2023-07-09T21:23:37.205740+0000","last_unstale":"2023-07-09T21:23:39.679063+0000","last_undegraded":"2023-07-09T21:23:39.679063+0000","last_fullsized":"2023-07-09T21:23:39.679063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:51:44.570056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188576+0000","last_change":"2023-07-09T21:23:38.209539+0000","last_active":"2023-07-09T21:23:39.188576+0000","last_peered":"2023-07-09T21:23:39.188576+0000","last_clean":"2023-07-09T21:23:39.188576+0000","last_became_active":"2023-07-09T21:23:38.209280+0000","last_became_peered":"2023-07-09T21:23:38.209280+0000","last_unstale":"2023-07-09T21:23:39.188576+0000","last_undegraded":"2023-07-09T21:23:39.188576+0000","last_fullsized":"2023-07-09T21:23:39.188576+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:19.083131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678237+0000","last_change":"2023-07-09T21:23:37.207663+0000","last_active":"2023-07-09T21:23:39.678237+0000","last_peered":"2023-07-09T21:23:39.678237+0000","last_clean":"2023-07-09T21:23:39.678237+0000","last_became_active":"2023-07-09T21:23:37.207389+0000","last_became_peered":"2023-07-09T21:23:37.207389+0000","last_unstale":"2023-07-09T21:23:39.678237+0000","last_undegraded":"2023-07-09T21:23:39.678237+0000","last_fullsized":"2023-07-09T21:23:39.678237+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678018+0000","last_change":"2023-07-09T21:23:38.198982+0000","last_active":"2023-07-09T21:23:39.678018+0000","last_peered":"2023-07-09T21:23:39.678018+0000","last_clean":"2023-07-09T21:23:39.678018+0000","last_became_active":"2023-07-09T21:23:38.198387+0000","last_became_peered":"2023-07-09T21:23:38.198387+0000","last_unstale":"2023-07-09T21:23:39.678018+0000","last_undegraded":"2023-07-09T21:23:39.678018+0000","last_fullsized":"2023-07-09T21:23:39.678018+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:09:53.087070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188452+0000","last_change":"2023-07-09T21:23:37.200272+0000","last_active":"2023-07-09T21:23:39.188452+0000","last_peered":"2023-07-09T21:23:39.188452+0000","last_clean":"2023-07-09T21:23:39.188452+0000","last_became_active":"2023-07-09T21:23:37.199958+0000","last_became_peered":"2023-07-09T21:23:37.199958+0000","last_unstale":"2023-07-09T21:23:39.188452+0000","last_undegraded":"2023-07-09T21:23:39.188452+0000","last_fullsized":"2023-07-09T21:23:39.188452+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:50.775036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343788+0000","last_change":"2023-07-09T21:23:38.213335+0000","last_active":"2023-07-09T21:23:39.343788+0000","last_peered":"2023-07-09T21:23:39.343788+0000","last_clean":"2023-07-09T21:23:39.343788+0000","last_became_active":"2023-07-09T21:23:38.213037+0000","last_became_peered":"2023-07-09T21:23:38.213037+0000","last_unstale":"2023-07-09T21:23:39.343788+0000","last_undegraded":"2023-07-09T21:23:39.343788+0000","last_fullsized":"2023-07-09T21:23:39.343788+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:58:21.091968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679105+0000","last_change":"2023-07-09T21:23:37.196773+0000","last_active":"2023-07-09T21:23:39.679105+0000","last_peered":"2023-07-09T21:23:39.679105+0000","last_clean":"2023-07-09T21:23:39.679105+0000","last_became_active":"2023-07-09T21:23:37.196447+0000","last_became_peered":"2023-07-09T21:23:37.196447+0000","last_unstale":"2023-07-09T21:23:39.679105+0000","last_undegraded":"2023-07-09T21:23:39.679105+0000","last_fullsized":"2023-07-09T21:23:39.679105+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:53:53.090182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679364+0000","last_change":"2023-07-09T21:23:38.205226+0000","last_active":"2023-07-09T21:23:39.679364+0000","last_peered":"2023-07-09T21:23:39.679364+0000","last_clean":"2023-07-09T21:23:39.679364+0000","last_became_active":"2023-07-09T21:23:38.204669+0000","last_became_peered":"2023-07-09T21:23:38.204669+0000","last_unstale":"2023-07-09T21:23:39.679364+0000","last_undegraded":"2023-07-09T21:23:39.679364+0000","last_fullsized":"2023-07-09T21:23:39.679364+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:54.343662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.190333+0000","last_change":"2023-07-09T21:23:37.201060+0000","last_active":"2023-07-09T21:23:39.190333+0000","last_peered":"2023-07-09T21:23:39.190333+0000","last_clean":"2023-07-09T21:23:39.190333+0000","last_became_active":"2023-07-09T21:23:37.200764+0000","last_became_peered":"2023-07-09T21:23:37.200764+0000","last_unstale":"2023-07-09T21:23:39.190333+0000","last_undegraded":"2023-07-09T21:23:39.190333+0000","last_fullsized":"2023-07-09T21:23:39.190333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:42:35.191657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679260+0000","last_change":"2023-07-09T21:23:38.198456+0000","last_active":"2023-07-09T21:23:39.679260+0000","last_peered":"2023-07-09T21:23:39.679260+0000","last_clean":"2023-07-09T21:23:39.679260+0000","last_became_active":"2023-07-09T21:23:38.198114+0000","last_became_peered":"2023-07-09T21:23:38.198114+0000","last_unstale":"2023-07-09T21:23:39.679260+0000","last_undegraded":"2023-07-09T21:23:39.679260+0000","last_fullsized":"2023-07-09T21:23:39.679260+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:00.177490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"36'3","reported_seq":16,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189478+0000","last_change":"2023-07-09T21:23:37.201267+0000","last_active":"2023-07-09T21:23:39.189478+0000","last_peered":"2023-07-09T21:23:39.189478+0000","last_clean":"2023-07-09T21:23:39.189478+0000","last_became_active":"2023-07-09T21:23:37.200889+0000","last_became_peered":"2023-07-09T21:23:37.200889+0000","last_unstale":"2023-07-09T21:23:39.189478+0000","last_undegraded":"2023-07-09T21:23:39.189478+0000","last_fullsized":"2023-07-09T21:23:39.189478+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:28.319211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189997+0000","last_change":"2023-07-09T21:23:38.213669+0000","last_active":"2023-07-09T21:23:39.189997+0000","last_peered":"2023-07-09T21:23:39.189997+0000","last_clean":"2023-07-09T21:23:39.189997+0000","last_became_active":"2023-07-09T21:23:38.213200+0000","last_became_peered":"2023-07-09T21:23:38.213200+0000","last_unstale":"2023-07-09T21:23:39.189997+0000","last_undegraded":"2023-07-09T21:23:39.189997+0000","last_fullsized":"2023-07-09T21:23:39.189997+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:29.392228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"36'6","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678264+0000","last_change":"2023-07-09T21:23:37.201098+0000","last_active":"2023-07-09T21:23:39.678264+0000","last_peered":"2023-07-09T21:23:39.678264+0000","last_clean":"2023-07-09T21:23:39.678264+0000","last_became_active":"2023-07-09T21:23:37.200492+0000","last_became_peered":"2023-07-09T21:23:37.200492+0000","last_unstale":"2023-07-09T21:23:39.678264+0000","last_undegraded":"2023-07-09T21:23:39.678264+0000","last_fullsized":"2023-07-09T21:23:39.678264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678990+0000","last_change":"2023-07-09T21:23:38.209557+0000","last_active":"2023-07-09T21:23:39.678990+0000","last_peered":"2023-07-09T21:23:39.678990+0000","last_clean":"2023-07-09T21:23:39.678990+0000","last_became_active":"2023-07-09T21:23:38.209271+0000","last_became_peered":"2023-07-09T21:23:38.209271+0000","last_unstale":"2023-07-09T21:23:39.678990+0000","last_undegraded":"2023-07-09T21:23:39.678990+0000","last_fullsized":"2023-07-09T21:23:39.678990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:09:53.087070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678187+0000","last_change":"2023-07-09T21:23:37.200437+0000","last_active":"2023-07-09T21:23:39.678187+0000","last_peered":"2023-07-09T21:23:39.678187+0000","last_clean":"2023-07-09T21:23:39.678187+0000","last_became_active":"2023-07-09T21:23:37.200064+0000","last_became_peered":"2023-07-09T21:23:37.200064+0000","last_unstale":"2023-07-09T21:23:39.678187+0000","last_undegraded":"2023-07-09T21:23:39.678187+0000","last_fullsized":"2023-07-09T21:23:39.678187+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:59.169204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.677874+0000","last_change":"2023-07-09T21:23:38.202743+0000","last_active":"2023-07-09T21:23:39.677874+0000","last_peered":"2023-07-09T21:23:39.677874+0000","last_clean":"2023-07-09T21:23:39.677874+0000","last_became_active":"2023-07-09T21:23:38.201829+0000","last_became_peered":"2023-07-09T21:23:38.201829+0000","last_unstale":"2023-07-09T21:23:39.677874+0000","last_undegraded":"2023-07-09T21:23:39.677874+0000","last_fullsized":"2023-07-09T21:23:39.677874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:04.880887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678530+0000","last_change":"2023-07-09T21:23:37.207562+0000","last_active":"2023-07-09T21:23:39.678530+0000","last_peered":"2023-07-09T21:23:39.678530+0000","last_clean":"2023-07-09T21:23:39.678530+0000","last_became_active":"2023-07-09T21:23:37.207198+0000","last_became_peered":"2023-07-09T21:23:37.207198+0000","last_unstale":"2023-07-09T21:23:39.678530+0000","last_undegraded":"2023-07-09T21:23:39.678530+0000","last_fullsized":"2023-07-09T21:23:39.678530+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:55.841227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679073+0000","last_change":"2023-07-09T21:23:38.200107+0000","last_active":"2023-07-09T21:23:39.679073+0000","last_peered":"2023-07-09T21:23:39.679073+0000","last_clean":"2023-07-09T21:23:39.679073+0000","last_became_active":"2023-07-09T21:23:38.199535+0000","last_became_peered":"2023-07-09T21:23:38.199535+0000","last_unstale":"2023-07-09T21:23:39.679073+0000","last_undegraded":"2023-07-09T21:23:39.679073+0000","last_fullsized":"2023-07-09T21:23:39.679073+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:27.248066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187337+0000","last_change":"2023-07-09T21:23:37.198758+0000","last_active":"2023-07-09T21:23:39.187337+0000","last_peered":"2023-07-09T21:23:39.187337+0000","last_clean":"2023-07-09T21:23:39.187337+0000","last_became_active":"2023-07-09T21:23:37.198397+0000","last_became_peered":"2023-07-09T21:23:37.198397+0000","last_unstale":"2023-07-09T21:23:39.187337+0000","last_undegraded":"2023-07-09T21:23:39.187337+0000","last_fullsized":"2023-07-09T21:23:39.187337+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:35.350099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678027+0000","last_change":"2023-07-09T21:23:38.200779+0000","last_active":"2023-07-09T21:23:39.678027+0000","last_peered":"2023-07-09T21:23:39.678027+0000","last_clean":"2023-07-09T21:23:39.678027+0000","last_became_active":"2023-07-09T21:23:38.200502+0000","last_became_peered":"2023-07-09T21:23:38.200502+0000","last_unstale":"2023-07-09T21:23:39.678027+0000","last_undegraded":"2023-07-09T21:23:39.678027+0000","last_fullsized":"2023-07-09T21:23:39.678027+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:20.607440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"36'8","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678978+0000","last_change":"2023-07-09T21:23:37.203038+0000","last_active":"2023-07-09T21:23:39.678978+0000","last_peered":"2023-07-09T21:23:39.678978+0000","last_clean":"2023-07-09T21:23:39.678978+0000","last_became_active":"2023-07-09T21:23:37.202669+0000","last_became_peered":"2023-07-09T21:23:37.202669+0000","last_unstale":"2023-07-09T21:23:39.678978+0000","last_undegraded":"2023-07-09T21:23:39.678978+0000","last_fullsized":"2023-07-09T21:23:39.678978+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:27.328423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678136+0000","last_change":"2023-07-09T21:23:38.201659+0000","last_active":"2023-07-09T21:23:39.678136+0000","last_peered":"2023-07-09T21:23:39.678136+0000","last_clean":"2023-07-09T21:23:39.678136+0000","last_became_active":"2023-07-09T21:23:38.201347+0000","last_became_peered":"2023-07-09T21:23:38.201347+0000","last_unstale":"2023-07-09T21:23:39.678136+0000","last_undegraded":"2023-07-09T21:23:39.678136+0000","last_fullsized":"2023-07-09T21:23:39.678136+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:02.122626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.190450+0000","last_change":"2023-07-09T21:23:37.198991+0000","last_active":"2023-07-09T21:23:39.190450+0000","last_peered":"2023-07-09T21:23:39.190450+0000","last_clean":"2023-07-09T21:23:39.190450+0000","last_became_active":"2023-07-09T21:23:37.198697+0000","last_became_peered":"2023-07-09T21:23:37.198697+0000","last_unstale":"2023-07-09T21:23:39.190450+0000","last_undegraded":"2023-07-09T21:23:39.190450+0000","last_fullsized":"2023-07-09T21:23:39.190450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:46:19.932143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189366+0000","last_change":"2023-07-09T21:23:38.197469+0000","last_active":"2023-07-09T21:23:39.189366+0000","last_peered":"2023-07-09T21:23:39.189366+0000","last_clean":"2023-07-09T21:23:39.189366+0000","last_became_active":"2023-07-09T21:23:38.197127+0000","last_became_peered":"2023-07-09T21:23:38.197127+0000","last_unstale":"2023-07-09T21:23:39.189366+0000","last_undegraded":"2023-07-09T21:23:39.189366+0000","last_fullsized":"2023-07-09T21:23:39.189366+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:19.301982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189844+0000","last_change":"2023-07-09T21:23:37.208724+0000","last_active":"2023-07-09T21:23:39.189844+0000","last_peered":"2023-07-09T21:23:39.189844+0000","last_clean":"2023-07-09T21:23:39.189844+0000","last_became_active":"2023-07-09T21:23:37.208426+0000","last_became_peered":"2023-07-09T21:23:37.208426+0000","last_unstale":"2023-07-09T21:23:39.189844+0000","last_undegraded":"2023-07-09T21:23:39.189844+0000","last_fullsized":"2023-07-09T21:23:39.189844+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:26.239781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189662+0000","last_change":"2023-07-09T21:23:38.208073+0000","last_active":"2023-07-09T21:23:39.189662+0000","last_peered":"2023-07-09T21:23:39.189662+0000","last_clean":"2023-07-09T21:23:39.189662+0000","last_became_active":"2023-07-09T21:23:38.207591+0000","last_became_peered":"2023-07-09T21:23:38.207591+0000","last_unstale":"2023-07-09T21:23:39.189662+0000","last_undegraded":"2023-07-09T21:23:39.189662+0000","last_fullsized":"2023-07-09T21:23:39.189662+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:01.682532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343779+0000","last_change":"2023-07-09T21:23:37.200744+0000","last_active":"2023-07-09T21:23:39.343779+0000","last_peered":"2023-07-09T21:23:39.343779+0000","last_clean":"2023-07-09T21:23:39.343779+0000","last_became_active":"2023-07-09T21:23:37.200385+0000","last_became_peered":"2023-07-09T21:23:37.200385+0000","last_unstale":"2023-07-09T21:23:39.343779+0000","last_undegraded":"2023-07-09T21:23:39.343779+0000","last_fullsized":"2023-07-09T21:23:39.343779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.344717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343678+0000","last_change":"2023-07-09T21:23:38.196052+0000","last_active":"2023-07-09T21:23:39.343678+0000","last_peered":"2023-07-09T21:23:39.343678+0000","last_clean":"2023-07-09T21:23:39.343678+0000","last_became_active":"2023-07-09T21:23:38.195608+0000","last_became_peered":"2023-07-09T21:23:38.195608+0000","last_unstale":"2023-07-09T21:23:39.343678+0000","last_undegraded":"2023-07-09T21:23:39.343678+0000","last_fullsized":"2023-07-09T21:23:39.343678+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:19:31.898078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678790+0000","last_change":"2023-07-09T21:23:37.202950+0000","last_active":"2023-07-09T21:23:39.678790+0000","last_peered":"2023-07-09T21:23:39.678790+0000","last_clean":"2023-07-09T21:23:39.678790+0000","last_became_active":"2023-07-09T21:23:37.202660+0000","last_became_peered":"2023-07-09T21:23:37.202660+0000","last_unstale":"2023-07-09T21:23:39.678790+0000","last_undegraded":"2023-07-09T21:23:39.678790+0000","last_fullsized":"2023-07-09T21:23:39.678790+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:06:00.159974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679324+0000","last_change":"2023-07-09T21:23:38.200949+0000","last_active":"2023-07-09T21:23:39.679324+0000","last_peered":"2023-07-09T21:23:39.679324+0000","last_clean":"2023-07-09T21:23:39.679324+0000","last_became_active":"2023-07-09T21:23:38.200617+0000","last_became_peered":"2023-07-09T21:23:38.200617+0000","last_unstale":"2023-07-09T21:23:39.679324+0000","last_undegraded":"2023-07-09T21:23:39.679324+0000","last_fullsized":"2023-07-09T21:23:39.679324+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:40:49.368627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343542+0000","last_change":"2023-07-09T21:23:37.194667+0000","last_active":"2023-07-09T21:23:39.343542+0000","last_peered":"2023-07-09T21:23:39.343542+0000","last_clean":"2023-07-09T21:23:39.343542+0000","last_became_active":"2023-07-09T21:23:37.194395+0000","last_became_peered":"2023-07-09T21:23:37.194395+0000","last_unstale":"2023-07-09T21:23:39.343542+0000","last_undegraded":"2023-07-09T21:23:39.343542+0000","last_fullsized":"2023-07-09T21:23:39.343542+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:56:00.157857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679632+0000","last_change":"2023-07-09T21:23:38.198327+0000","last_active":"2023-07-09T21:23:39.679632+0000","last_peered":"2023-07-09T21:23:39.679632+0000","last_clean":"2023-07-09T21:23:39.679632+0000","last_became_active":"2023-07-09T21:23:38.198024+0000","last_became_peered":"2023-07-09T21:23:38.198024+0000","last_unstale":"2023-07-09T21:23:39.679632+0000","last_undegraded":"2023-07-09T21:23:39.679632+0000","last_fullsized":"2023-07-09T21:23:39.679632+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:33.732590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343450+0000","last_change":"2023-07-09T21:23:37.202646+0000","last_active":"2023-07-09T21:23:39.343450+0000","last_peered":"2023-07-09T21:23:39.343450+0000","last_clean":"2023-07-09T21:23:39.343450+0000","last_became_active":"2023-07-09T21:23:37.202363+0000","last_became_peered":"2023-07-09T21:23:37.202363+0000","last_unstale":"2023-07-09T21:23:39.343450+0000","last_undegraded":"2023-07-09T21:23:39.343450+0000","last_fullsized":"2023-07-09T21:23:39.343450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:07:04.204358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188891+0000","last_change":"2023-07-09T21:23:38.202353+0000","last_active":"2023-07-09T21:23:39.188891+0000","last_peered":"2023-07-09T21:23:39.188891+0000","last_clean":"2023-07-09T21:23:39.188891+0000","last_became_active":"2023-07-09T21:23:38.202071+0000","last_became_peered":"2023-07-09T21:23:38.202071+0000","last_unstale":"2023-07-09T21:23:39.188891+0000","last_undegraded":"2023-07-09T21:23:39.188891+0000","last_fullsized":"2023-07-09T21:23:39.188891+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:33:10.684295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679261+0000","last_change":"2023-07-09T21:23:37.201013+0000","last_active":"2023-07-09T21:23:39.679261+0000","last_peered":"2023-07-09T21:23:39.679261+0000","last_clean":"2023-07-09T21:23:39.679261+0000","last_became_active":"2023-07-09T21:23:37.200747+0000","last_became_peered":"2023-07-09T21:23:37.200747+0000","last_unstale":"2023-07-09T21:23:39.679261+0000","last_undegraded":"2023-07-09T21:23:39.679261+0000","last_fullsized":"2023-07-09T21:23:39.679261+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:28.383942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678192+0000","last_change":"2023-07-09T21:23:38.199164+0000","last_active":"2023-07-09T21:23:39.678192+0000","last_peered":"2023-07-09T21:23:39.678192+0000","last_clean":"2023-07-09T21:23:39.678192+0000","last_became_active":"2023-07-09T21:23:38.198727+0000","last_became_peered":"2023-07-09T21:23:38.198727+0000","last_unstale":"2023-07-09T21:23:39.678192+0000","last_undegraded":"2023-07-09T21:23:39.678192+0000","last_fullsized":"2023-07-09T21:23:39.678192+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:33.550779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343366+0000","last_change":"2023-07-09T21:23:37.196001+0000","last_active":"2023-07-09T21:23:39.343366+0000","last_peered":"2023-07-09T21:23:39.343366+0000","last_clean":"2023-07-09T21:23:39.343366+0000","last_became_active":"2023-07-09T21:23:37.195702+0000","last_became_peered":"2023-07-09T21:23:37.195702+0000","last_unstale":"2023-07-09T21:23:39.343366+0000","last_undegraded":"2023-07-09T21:23:39.343366+0000","last_fullsized":"2023-07-09T21:23:39.343366+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:51.109186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.190369+0000","last_change":"2023-07-09T21:23:38.199507+0000","last_active":"2023-07-09T21:23:39.190369+0000","last_peered":"2023-07-09T21:23:39.190369+0000","last_clean":"2023-07-09T21:23:39.190369+0000","last_became_active":"2023-07-09T21:23:38.199122+0000","last_became_peered":"2023-07-09T21:23:38.199122+0000","last_unstale":"2023-07-09T21:23:39.190369+0000","last_undegraded":"2023-07-09T21:23:39.190369+0000","last_fullsized":"2023-07-09T21:23:39.190369+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:15:19.666245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679487+0000","last_change":"2023-07-09T21:23:37.200811+0000","last_active":"2023-07-09T21:23:39.679487+0000","last_peered":"2023-07-09T21:23:39.679487+0000","last_clean":"2023-07-09T21:23:39.679487+0000","last_became_active":"2023-07-09T21:23:37.200465+0000","last_became_peered":"2023-07-09T21:23:37.200465+0000","last_unstale":"2023-07-09T21:23:39.679487+0000","last_undegraded":"2023-07-09T21:23:39.679487+0000","last_fullsized":"2023-07-09T21:23:39.679487+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:06.055597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":195,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679382+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:23:39.679382+0000","last_peered":"2023-07-09T21:23:39.679382+0000","last_clean":"2023-07-09T21:23:39.679382+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:23:39.679382+0000","last_undegraded":"2023-07-09T21:23:39.679382+0000","last_fullsized":"2023-07-09T21:23:39.679382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:49:53.573317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189704+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:23:39.189704+0000","last_peered":"2023-07-09T21:23:39.189704+0000","last_clean":"2023-07-09T21:23:39.189704+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:23:39.189704+0000","last_undegraded":"2023-07-09T21:23:39.189704+0000","last_fullsized":"2023-07-09T21:23:39.189704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:16.341565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678691+0000","last_change":"2023-07-09T21:23:38.203354+0000","last_active":"2023-07-09T21:23:39.678691+0000","last_peered":"2023-07-09T21:23:39.678691+0000","last_clean":"2023-07-09T21:23:39.678691+0000","last_became_active":"2023-07-09T21:23:38.203104+0000","last_became_peered":"2023-07-09T21:23:38.203104+0000","last_unstale":"2023-07-09T21:23:39.678691+0000","last_undegraded":"2023-07-09T21:23:39.678691+0000","last_fullsized":"2023-07-09T21:23:39.678691+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:33.732590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"36'2","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.190570+0000","last_change":"2023-07-09T21:23:37.197379+0000","last_active":"2023-07-09T21:23:39.190570+0000","last_peered":"2023-07-09T21:23:39.190570+0000","last_clean":"2023-07-09T21:23:39.190570+0000","last_became_active":"2023-07-09T21:23:37.197066+0000","last_became_peered":"2023-07-09T21:23:37.197066+0000","last_unstale":"2023-07-09T21:23:39.190570+0000","last_undegraded":"2023-07-09T21:23:39.190570+0000","last_fullsized":"2023-07-09T21:23:39.190570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:05:02.110001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679181+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:23:39.679181+0000","last_peered":"2023-07-09T21:23:39.679181+0000","last_clean":"2023-07-09T21:23:39.679181+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:23:39.679181+0000","last_undegraded":"2023-07-09T21:23:39.679181+0000","last_fullsized":"2023-07-09T21:23:39.679181+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:21.055285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679507+0000","last_change":"2023-07-09T21:23:38.205016+0000","last_active":"2023-07-09T21:23:39.679507+0000","last_peered":"2023-07-09T21:23:39.679507+0000","last_clean":"2023-07-09T21:23:39.679507+0000","last_became_active":"2023-07-09T21:23:38.204327+0000","last_became_peered":"2023-07-09T21:23:38.204327+0000","last_unstale":"2023-07-09T21:23:39.679507+0000","last_undegraded":"2023-07-09T21:23:39.679507+0000","last_fullsized":"2023-07-09T21:23:39.679507+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:19.301982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"37'1","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343684+0000","last_change":"2023-07-09T21:23:37.193012+0000","last_active":"2023-07-09T21:23:39.343684+0000","last_peered":"2023-07-09T21:23:39.343684+0000","last_clean":"2023-07-09T21:23:39.343684+0000","last_became_active":"2023-07-09T21:23:37.192697+0000","last_became_peered":"2023-07-09T21:23:37.192697+0000","last_unstale":"2023-07-09T21:23:39.343684+0000","last_undegraded":"2023-07-09T21:23:39.343684+0000","last_fullsized":"2023-07-09T21:23:39.343684+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:47:43.253345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.343395+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:23:39.343395+0000","last_peered":"2023-07-09T21:23:39.343395+0000","last_clean":"2023-07-09T21:23:39.343395+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:23:39.343395+0000","last_undegraded":"2023-07-09T21:23:39.343395+0000","last_fullsized":"2023-07-09T21:23:39.343395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:04.744964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678536+0000","last_change":"2023-07-09T21:23:38.215271+0000","last_active":"2023-07-09T21:23:39.678536+0000","last_peered":"2023-07-09T21:23:39.678536+0000","last_clean":"2023-07-09T21:23:39.678536+0000","last_became_active":"2023-07-09T21:23:38.214770+0000","last_became_peered":"2023-07-09T21:23:38.214770+0000","last_unstale":"2023-07-09T21:23:39.678536+0000","last_undegraded":"2023-07-09T21:23:39.678536+0000","last_fullsized":"2023-07-09T21:23:39.678536+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:33.732590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679246+0000","last_change":"2023-07-09T21:23:37.199308+0000","last_active":"2023-07-09T21:23:39.679246+0000","last_peered":"2023-07-09T21:23:39.679246+0000","last_clean":"2023-07-09T21:23:39.679246+0000","last_became_active":"2023-07-09T21:23:37.199029+0000","last_became_peered":"2023-07-09T21:23:37.199029+0000","last_unstale":"2023-07-09T21:23:39.679246+0000","last_undegraded":"2023-07-09T21:23:39.679246+0000","last_fullsized":"2023-07-09T21:23:39.679246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:01.114340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.189078+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:23:39.189078+0000","last_peered":"2023-07-09T21:23:39.189078+0000","last_clean":"2023-07-09T21:23:39.189078+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:23:39.189078+0000","last_undegraded":"2023-07-09T21:23:39.189078+0000","last_fullsized":"2023-07-09T21:23:39.189078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:49:59.977443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679107+0000","last_change":"2023-07-09T21:23:38.197309+0000","last_active":"2023-07-09T21:23:39.679107+0000","last_peered":"2023-07-09T21:23:39.679107+0000","last_clean":"2023-07-09T21:23:39.679107+0000","last_became_active":"2023-07-09T21:23:38.197049+0000","last_became_peered":"2023-07-09T21:23:38.197049+0000","last_unstale":"2023-07-09T21:23:39.679107+0000","last_undegraded":"2023-07-09T21:23:39.679107+0000","last_fullsized":"2023-07-09T21:23:39.679107+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:20.607440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679651+0000","last_change":"2023-07-09T21:23:37.198511+0000","last_active":"2023-07-09T21:23:39.679651+0000","last_peered":"2023-07-09T21:23:39.679651+0000","last_clean":"2023-07-09T21:23:39.679651+0000","last_became_active":"2023-07-09T21:23:37.198226+0000","last_became_peered":"2023-07-09T21:23:37.198226+0000","last_unstale":"2023-07-09T21:23:39.679651+0000","last_undegraded":"2023-07-09T21:23:39.679651+0000","last_fullsized":"2023-07-09T21:23:39.679651+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:51:46.188401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678916+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:23:39.678916+0000","last_peered":"2023-07-09T21:23:39.678916+0000","last_clean":"2023-07-09T21:23:39.678916+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:23:39.678916+0000","last_undegraded":"2023-07-09T21:23:39.678916+0000","last_fullsized":"2023-07-09T21:23:39.678916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:41.700984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678121+0000","last_change":"2023-07-09T21:23:38.205875+0000","last_active":"2023-07-09T21:23:39.678121+0000","last_peered":"2023-07-09T21:23:39.678121+0000","last_clean":"2023-07-09T21:23:39.678121+0000","last_became_active":"2023-07-09T21:23:38.205373+0000","last_became_peered":"2023-07-09T21:23:38.205373+0000","last_unstale":"2023-07-09T21:23:39.678121+0000","last_undegraded":"2023-07-09T21:23:39.678121+0000","last_fullsized":"2023-07-09T21:23:39.678121+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:09:53.087070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.187600+0000","last_change":"2023-07-09T21:23:37.203604+0000","last_active":"2023-07-09T21:23:39.187600+0000","last_peered":"2023-07-09T21:23:39.187600+0000","last_clean":"2023-07-09T21:23:39.187600+0000","last_became_active":"2023-07-09T21:23:37.203306+0000","last_became_peered":"2023-07-09T21:23:37.203306+0000","last_unstale":"2023-07-09T21:23:39.187600+0000","last_undegraded":"2023-07-09T21:23:39.187600+0000","last_fullsized":"2023-07-09T21:23:39.187600+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:08.886299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679633+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:23:39.679633+0000","last_peered":"2023-07-09T21:23:39.679633+0000","last_clean":"2023-07-09T21:23:39.679633+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:23:39.679633+0000","last_undegraded":"2023-07-09T21:23:39.679633+0000","last_fullsized":"2023-07-09T21:23:39.679633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:51.227798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188502+0000","last_change":"2023-07-09T21:23:38.206864+0000","last_active":"2023-07-09T21:23:39.188502+0000","last_peered":"2023-07-09T21:23:39.188502+0000","last_clean":"2023-07-09T21:23:39.188502+0000","last_became_active":"2023-07-09T21:23:38.206421+0000","last_became_peered":"2023-07-09T21:23:38.206421+0000","last_unstale":"2023-07-09T21:23:39.188502+0000","last_undegraded":"2023-07-09T21:23:39.188502+0000","last_fullsized":"2023-07-09T21:23:39.188502+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:28.336708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188438+0000","last_change":"2023-07-09T21:23:37.199737+0000","last_active":"2023-07-09T21:23:39.188438+0000","last_peered":"2023-07-09T21:23:39.188438+0000","last_clean":"2023-07-09T21:23:39.188438+0000","last_became_active":"2023-07-09T21:23:37.199176+0000","last_became_peered":"2023-07-09T21:23:37.199176+0000","last_unstale":"2023-07-09T21:23:39.188438+0000","last_undegraded":"2023-07-09T21:23:39.188438+0000","last_fullsized":"2023-07-09T21:23:39.188438+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:50.421745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.678970+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:23:39.678970+0000","last_peered":"2023-07-09T21:23:39.678970+0000","last_clean":"2023-07-09T21:23:39.678970+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:23:39.678970+0000","last_undegraded":"2023-07-09T21:23:39.678970+0000","last_fullsized":"2023-07-09T21:23:39.678970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:39:15.493724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.679478+0000","last_change":"2023-07-09T21:23:38.202457+0000","last_active":"2023-07-09T21:23:39.679478+0000","last_peered":"2023-07-09T21:23:39.679478+0000","last_clean":"2023-07-09T21:23:39.679478+0000","last_became_active":"2023-07-09T21:23:38.202176+0000","last_became_peered":"2023-07-09T21:23:38.202176+0000","last_unstale":"2023-07-09T21:23:39.679478+0000","last_undegraded":"2023-07-09T21:23:39.679478+0000","last_fullsized":"2023-07-09T21:23:39.679478+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:37.171191+0000","last_clean_scrub_stamp":"2023-07-09T21:23:37.171191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:14.021964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.677784+0000","last_change":"2023-07-09T21:23:37.197526+0000","last_active":"2023-07-09T21:23:39.677784+0000","last_peered":"2023-07-09T21:23:39.677784+0000","last_clean":"2023-07-09T21:23:39.677784+0000","last_became_active":"2023-07-09T21:23:37.197207+0000","last_became_peered":"2023-07-09T21:23:37.197207+0000","last_unstale":"2023-07-09T21:23:39.677784+0000","last_undegraded":"2023-07-09T21:23:39.677784+0000","last_fullsized":"2023-07-09T21:23:39.677784+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:23:36.162905+0000","last_clean_scrub_stamp":"2023-07-09T21:23:36.162905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:55.604222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-07-09T21:23:39.188040+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:23:39.188040+0000","last_peered":"2023-07-09T21:23:39.188040+0000","last_clean":"2023-07-09T21:23:39.188040+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:23:39.188040+0000","last_undegraded":"2023-07-09T21:23:39.188040+0000","last_fullsized":"2023-07-09T21:23:39.188040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:39.719988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":1032192,"data_stored":767390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.84099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.619,"5min":1.619,"15min":1.619},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.877}]},{"osd":3,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.665,"5min":1.665,"15min":1.665},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.72799999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65400000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.80600000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.82999999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.78600000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.42899999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.58899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.50700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.79800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.878},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76900000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.63900000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:23:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.78100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":420,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":430080,"data_stored":175992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.622},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.79100000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.70799999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.82699999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:23:22 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.77100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":438272,"data_stored":176986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.498},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.438}]},{"osd":2,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.72799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.67200000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.90700000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:23:19 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.63400000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.36799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51800000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.495},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.64700000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:23:20 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.76700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":425984,"data_stored":175478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.438,"5min":0.438,"15min":0.438},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.68999999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.66500000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.419,"5min":1.419,"15min":1.419},"last":1.0229999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.90300000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.0509999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":1019904,"data_stored":765790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63600000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.55600000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.94799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.871},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.84199999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:23:18 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":0.89500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:23:47.241 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:23:47.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:23:47.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.421+0000 7ffb54900640 1 Processor -- start 2023-07-09T21:23:47.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 -- start start 2023-07-09T21:23:47.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb500b7980 0x7ffb50160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5015bf80 con 0x7ffb500b3c20 2023-07-09T21:23:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb500cd070 con 0x7ffb500b7980 2023-07-09T21:23:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb54900640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb500cfd70 con 0x7ffb500ceb80 2023-07-09T21:23:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb4e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffb500b7980 0x7ffb50160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33696/0 (socket says 172.21.15.37:33696) 2023-07-09T21:23:47.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 -- 172.21.15.37:0/2717758477 learned_addr learned my addr 172.21.15.37:0/2717758477 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 -- 172.21.15.37:0/2717758477 >> v2:172.21.15.119:3300/0 conn(0x7ffb500b7980 msgr2=0x7ffb50160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 --2- 172.21.15.37:0/2717758477 >> v2:172.21.15.119:3300/0 conn(0x7ffb500b7980 0x7ffb50160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 -- 172.21.15.37:0/2717758477 >> v1:172.21.15.119:6789/0 conn(0x7ffb500b3c20 legacy=0x7ffb500b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.425+0000 7ffb47fff640 1 -- 172.21.15.37:0/2717758477 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb50160570 con 0x7ffb500ceb80 2023-07-09T21:23:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb47fff640 1 --2- 172.21.15.37:0/2717758477 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009870 tx=0x7ffb3801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6d694dbe862a0b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb4dd9b640 1 -- 172.21.15.37:0/2717758477 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380ab600 con 0x7ffb500ceb80 2023-07-09T21:23:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb4dd9b640 1 -- 172.21.15.37:0/2717758477 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380a7050 con 0x7ffb500ceb80 2023-07-09T21:23:47.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb4dd9b640 1 -- 172.21.15.37:0/2717758477 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb380ab980 con 0x7ffb500ceb80 2023-07-09T21:23:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 -- 172.21.15.37:0/2717758477 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 msgr2=0x7ffb500cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 --2- 172.21.15.37:0/2717758477 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009870 tx=0x7ffb3801c540 comp rx=0 tx=0).stop 2023-07-09T21:23:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 -- 172.21.15.37:0/2717758477 shutdown_connections 2023-07-09T21:23:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 --2- 172.21.15.37:0/2717758477 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500cef90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 --2- 172.21.15.37:0/2717758477 >> v2:172.21.15.119:3300/0 conn(0x7ffb500b7980 0x7ffb50160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 -- 172.21.15.37:0/2717758477 >> 172.21.15.37:0/2717758477 conn(0x7ffb50073090 msgr2=0x7ffb50069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 -- 172.21.15.37:0/2717758477 shutdown_connections 2023-07-09T21:23:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.429+0000 7ffb54900640 1 -- 172.21.15.37:0/2717758477 wait complete. 2023-07-09T21:23:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 Processor -- start 2023-07-09T21:23:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- start start 2023-07-09T21:23:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 0x7ffb501522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500b5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5015a9a0 con 0x7ffb500b3c20 2023-07-09T21:23:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50159db0 con 0x7ffb500b7980 2023-07-09T21:23:47.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5015a000 con 0x7ffb500ceb80 2023-07-09T21:23:47.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59530/0 (socket says 172.21.15.37:59530) 2023-07-09T21:23:47.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 -- 172.21.15.37:0/848367359 learned_addr learned my addr 172.21.15.37:0/848367359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:47.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4ed9d640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500b5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb47fff640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 0x7ffb501522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 -- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 msgr2=0x7ffb500b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500b5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 -- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 msgr2=0x7ffb501522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 0x7ffb501522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 -- 172.21.15.37:0/848367359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094d0 con 0x7ffb500b3c20 2023-07-09T21:23:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb47fff640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 0x7ffb501522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:47.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb4e59c640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e960 tx=0x7ffb4000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb40009690 con 0x7ffb500b3c20 2023-07-09T21:23:47.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4000ca00 con 0x7ffb500b3c20 2023-07-09T21:23:47.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4000cd70 con 0x7ffb500b3c20 2023-07-09T21:23:47.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5015a2e0 con 0x7ffb500b3c20 2023-07-09T21:23:47.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5015c5c0 con 0x7ffb500b3c20 2023-07-09T21:23:47.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.433+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5004d7d0 con 0x7ffb500b3c20 2023-07-09T21:23:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.437+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffb40013470 con 0x7ffb500b3c20 2023-07-09T21:23:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.437+0000 7ffb46ffd640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 0x7ffb30068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.437+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ffb40083e90 con 0x7ffb500b3c20 2023-07-09T21:23:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.437+0000 7ffb47fff640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 0x7ffb30068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.437+0000 7ffb47fff640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 0x7ffb30068760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb5008ad30 tx=0x7ffb380a6000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.441+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffb400513b0 con 0x7ffb500b3c20 2023-07-09T21:23:47.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.649+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ffb5008b120 con 0x7ffb500b3c20 2023-07-09T21:23:47.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb46ffd640 1 -- 172.21.15.37:0/848367359 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7ffb400170e0 con 0x7ffb500b3c20 2023-07-09T21:23:47.658 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:23:47.658 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:23:47.658 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:23:47.658 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:23:47.659 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:23:47.659 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:23:47.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 msgr2=0x7ffb30068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 0x7ffb30068760 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7ffb5008ad30 tx=0x7ffb380a6000 comp rx=0 tx=0).stop 2023-07-09T21:23:47.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 msgr2=0x7ffb5015cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ffb4000e960 tx=0x7ffb4000ee20 comp rx=0 tx=0).stop 2023-07-09T21:23:47.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 shutdown_connections 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7ffb300662b0 0x7ffb30068760 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb500ceb80 0x7ffb500b5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb500b7980 0x7ffb501522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 --2- 172.21.15.37:0/848367359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb500b3c20 0x7ffb5015cb30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 >> 172.21.15.37:0/848367359 conn(0x7ffb50073090 msgr2=0x7ffb500b69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 shutdown_connections 2023-07-09T21:23:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.657+0000 7ffb54900640 1 -- 172.21.15.37:0/848367359 wait complete. 2023-07-09T21:23:47.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:23:47.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 Processor -- start 2023-07-09T21:23:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 -- start start 2023-07-09T21:23:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67780b7ab0 0x7f677806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 0x7f67780d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67780b49f0 con 0x7f67780cef80 2023-07-09T21:23:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67780b7e80 con 0x7f67780b7ab0 2023-07-09T21:23:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ec7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780cc8a0 con 0x7f67780b4340 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67780b7ab0 0x7f677806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677d218640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 0x7f67780d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67780b7ab0 0x7f677806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55196/0 (socket says 172.21.15.37:55196) 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 -- 172.21.15.37:0/3941472565 learned_addr learned my addr 172.21.15.37:0/3941472565 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 -- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 msgr2=0x7f67780d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 0x7f67780d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 -- 172.21.15.37:0/3941472565 >> v1:172.21.15.119:6789/0 conn(0x7f67780cef80 legacy=0x7f67780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f67777fe640 1 -- 172.21.15.37:0/3941472565 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628062397 0 0) 0x7f67780b49f0 con 0x7f67780cef80 2023-07-09T21:23:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677ca17640 1 -- 172.21.15.37:0/3941472565 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780ccb80 con 0x7f67780b7ab0 2023-07-09T21:23:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.821+0000 7f677d218640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 0x7f67780d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:47.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ca17640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b7ab0 0x7f677806aa50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f676c009870 tx=0x7f676c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d64cfcd657a645d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f67777fe640 1 -- 172.21.15.37:0/3941472565 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0aa670 con 0x7f67780b7ab0 2023-07-09T21:23:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f67777fe640 1 -- 172.21.15.37:0/3941472565 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676c0aa7d0 con 0x7f67780b7ab0 2023-07-09T21:23:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f67777fe640 1 -- 172.21.15.37:0/3941472565 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676c0aab60 con 0x7f67780b7ab0 2023-07-09T21:23:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 -- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b7ab0 msgr2=0x7f677806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b7ab0 0x7f677806aa50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f676c009870 tx=0x7f676c01c510 comp rx=0 tx=0).stop 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 -- 172.21.15.37:0/3941472565 shutdown_connections 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780b4340 0x7f67780d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 --2- 172.21.15.37:0/3941472565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b7ab0 0x7f677806aa50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 -- 172.21.15.37:0/3941472565 >> 172.21.15.37:0/3941472565 conn(0x7f6778073090 msgr2=0x7f6778069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 -- 172.21.15.37:0/3941472565 shutdown_connections 2023-07-09T21:23:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.825+0000 7f677ec7b640 1 -- 172.21.15.37:0/3941472565 wait complete. 2023-07-09T21:23:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 Processor -- start 2023-07-09T21:23:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- start start 2023-07-09T21:23:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 0x7f677814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780cef80 0x7f6778155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67781568c0 con 0x7f67780b7ab0 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f677814f5e0 con 0x7f67780b4340 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780c6530 con 0x7f67780cef80 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59542/0 (socket says 172.21.15.37:59542) 2023-07-09T21:23:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 -- 172.21.15.37:0/2432869369 learned_addr learned my addr 172.21.15.37:0/2432869369 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ca17640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 0x7f677814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677d218640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780cef80 0x7f6778155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 -- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780cef80 msgr2=0x7f6778155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780cef80 0x7f6778155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 -- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 msgr2=0x7f677814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 0x7f677814f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 -- 172.21.15.37:0/2432869369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6770009a70 con 0x7f67780b7ab0 2023-07-09T21:23:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ca17640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 0x7f677814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f6777fff640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f676400c3f0 tx=0x7f676400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67640054e0 con 0x7f67780b7ab0 2023-07-09T21:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6764003600 con 0x7f67780b7ab0 2023-07-09T21:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764003990 con 0x7f67780b7ab0 2023-07-09T21:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c0094d0 con 0x7f67780b7ab0 2023-07-09T21:23:47.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.829+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6778150c20 con 0x7f67780b7ab0 2023-07-09T21:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778156a00 con 0x7f67780b7ab0 2023-07-09T21:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6764003af0 con 0x7f67780b7ab0 2023-07-09T21:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f67757fa640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 0x7f675c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:47.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6764083460 con 0x7f67780b7ab0 2023-07-09T21:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f677ca17640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 0x7f675c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.833+0000 7f677ca17640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 0x7f675c068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ae000 tx=0x7f676c0a7000 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:47.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:47.837+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67640507b0 con 0x7f67780b7ab0 2023-07-09T21:23:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f677804d7d0 con 0x7f67780b7ab0 2023-07-09T21:23:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f67757fa640 1 -- 172.21.15.37:0/2432869369 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f6764017090 con 0x7f67780b7ab0 2023-07-09T21:23:48.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:23:48.027 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:23:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:23:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 msgr2=0x7f675c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 0x7f675c068730 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f676c0ae000 tx=0x7f676c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:23:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 msgr2=0x7f67780c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f676400c3f0 tx=0x7f676400c8b0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 shutdown_connections 2023-07-09T21:23:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f675c066280 0x7f675c068730 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67780cef80 0x7f6778155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67780b7ab0 0x7f67780c5ce0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 --2- 172.21.15.37:0/2432869369 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67780b4340 0x7f677814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 >> 172.21.15.37:0/2432869369 conn(0x7f6778073090 msgr2=0x7f67780b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 shutdown_connections 2023-07-09T21:23:48.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.025+0000 7f677ec7b640 1 -- 172.21.15.37:0/2432869369 wait complete. 2023-07-09T21:23:48.450 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:23:37.576393+0000', 'modified': '2023-07-09T21:23:41.222270+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5361}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5361': {'gid': 5361, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6834/723627337', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 723627337}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 723627337}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:23:48.451 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:23:48.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T21:23:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 Processor -- start 2023-07-09T21:23:48.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 -- start start 2023-07-09T21:23:48.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f704c06d010 0x7f704c06fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c06afa0 con 0x7f704c070bb0 2023-07-09T21:23:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704c06b280 con 0x7f704c159830 2023-07-09T21:23:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7054774640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f704c070000 con 0x7f704c06d010 2023-07-09T21:23:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052d11640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f704c070bb0 0x7f704c0cbde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60256/0 (socket says 172.21.15.37:60256) 2023-07-09T21:23:48.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052d11640 1 -- 172.21.15.37:0/2512762054 learned_addr learned my addr 172.21.15.37:0/2512762054 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7051d0f640 1 --2- 172.21.15.37:0/2512762054 >> v2:172.21.15.119:3300/0 conn(0x7f704c06d010 0x7f704c06fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838264066 0 0) 0x7f704c06afa0 con 0x7f704c070bb0 2023-07-09T21:23:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7038003530 con 0x7f704c070bb0 2023-07-09T21:23:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794609968 0 0) 0x7f7038003530 con 0x7f704c070bb0 2023-07-09T21:23:48.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 >> v2:172.21.15.119:3300/0 conn(0x7f704c06d010 msgr2=0x7f704c06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 --2- 172.21.15.37:0/2512762054 >> v2:172.21.15.119:3300/0 conn(0x7f704c06d010 0x7f704c06fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 >> v1:172.21.15.119:6789/0 conn(0x7f704c159830 legacy=0x7f704c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c06b560 con 0x7f704c070bb0 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7044001a00 con 0x7f704c070bb0 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 >> v1:172.21.15.37:6789/0 conn(0x7f704c070bb0 legacy=0x7f704c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f7038003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70380047d0 0x7f7038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7038005180 0x7f703800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c070000 con 0x7f7038003980 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703800c000 con 0x7f70380047d0 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f703800c1c0 con 0x7f7038005180 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f7038003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7051d0f640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70380047d0 0x7f7038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052d11640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7038005180 0x7f703800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 -- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7038005180 msgr2=0x7f703800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7038005180 0x7f703800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 -- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70380047d0 msgr2=0x7f7038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70380047d0 0x7f7038004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052510640 1 -- 172.21.15.37:0/2512762054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038003530 con 0x7f7038003980 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7051d0f640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70380047d0 0x7f7038004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052d11640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7038005180 0x7f703800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.597+0000 7f7052d11640 1 -- 172.21.15.37:0/2512762054 reap_dead start 2023-07-09T21:23:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7052510640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f7038003d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f70480017b0 tx=0x7f704801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cec6143521a0755 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480052d0 con 0x7f7038003980 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70480a7050 con 0x7f7038003980 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f705150e640 1 -- 172.21.15.37:0/2512762054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048003650 con 0x7f7038003980 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 -- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 msgr2=0x7f7038003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f7038003d90 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f70480017b0 tx=0x7f704801c390 comp rx=0 tx=0).stop 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 -- 172.21.15.37:0/2512762054 shutdown_connections 2023-07-09T21:23:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 --2- 172.21.15.37:0/2512762054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f7038003d90 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 -- 172.21.15.37:0/2512762054 >> 172.21.15.37:0/2512762054 conn(0x7f704c0694c0 msgr2=0x7f704c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 -- 172.21.15.37:0/2512762054 shutdown_connections 2023-07-09T21:23:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.601+0000 7f7054774640 1 -- 172.21.15.37:0/2512762054 wait complete. 2023-07-09T21:23:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 Processor -- start 2023-07-09T21:23:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- start start 2023-07-09T21:23:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 0x7f704c1575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 0x7f704c1f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c1522c0 con 0x7f7038003980 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704c157b10 con 0x7f704c1f4430 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704c15c960 con 0x7f704c157160 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59566/0 (socket says 172.21.15.37:59566) 2023-07-09T21:23:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 -- 172.21.15.37:0/1838396884 learned_addr learned my addr 172.21.15.37:0/1838396884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 0x7f704c1575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052d11640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 0x7f704c1f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 -- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 msgr2=0x7f704c1575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 0x7f704c1575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 -- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 msgr2=0x7f704c1f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 0x7f704c1f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 -- 172.21.15.37:0/1838396884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c1f51a0 con 0x7f7038003980 2023-07-09T21:23:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 0x7f704c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052d11640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 0x7f704c1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7052510640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f704801c1c0 tx=0x7f7038005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7042ffd640 1 -- 172.21.15.37:0/1838396884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048006d00 con 0x7f7038003980 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7042ffd640 1 -- 172.21.15.37:0/1838396884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7048006e60 con 0x7f7038003980 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7042ffd640 1 -- 172.21.15.37:0/1838396884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7048007280 con 0x7f7038003980 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704c15c030 con 0x7f7038003980 2023-07-09T21:23:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.605+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c15c5f0 con 0x7f7038003980 2023-07-09T21:23:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7042ffd640 1 -- 172.21.15.37:0/1838396884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f70480073e0 con 0x7f7038003980 2023-07-09T21:23:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7042ffd640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 0x7f7030068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7042ffd640 1 -- 172.21.15.37:0/1838396884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f704811e220 con 0x7f7038003980 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7057af7000 1 Processor -- start 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 0x7f7030068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.609+0000 7f7057af7000 1 -- start start 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 0x7f7030068760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f704c153f00 tx=0x7f703c008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fef110 0x564931fa4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564931fa5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931e6bf80 con 0x564931fee800 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931da5c60 con 0x564931fef110 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x564931df9700 con 0x564931fa4f90 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59574/0 (socket says 172.21.15.37:59574) 2023-07-09T21:23:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 -- 172.21.15.37:0/1493287580 learned_addr learned my addr 172.21.15.37:0/1493287580 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052d11640 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564931fa5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fef110 0x564931fa4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 -- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 msgr2=0x564931fa5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564931fa5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 -- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fef110 msgr2=0x564931fa4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fef110 0x564931fa4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 -- 172.21.15.37:0/1493287580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564931aee890 con 0x564931fee800 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7052510640 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f70480050a0 tx=0x7f70480f7610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6eab58cfac3712b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f702ffff640 1 -- 172.21.15.37:0/1493287580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480ed660 con 0x564931fee800 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f702ffff640 1 -- 172.21.15.37:0/1493287580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70480013d0 con 0x564931fee800 2023-07-09T21:23:48.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f702ffff640 1 -- 172.21.15.37:0/1493287580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70480f7180 con 0x564931fee800 2023-07-09T21:23:48.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- 172.21.15.37:0/1493287580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 msgr2=0x564931feebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f70480050a0 tx=0x7f70480f7610 comp rx=0 tx=0).stop 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- 172.21.15.37:0/1493287580 shutdown_connections 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564931fa5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fef110 0x564931fa4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 --2- 172.21.15.37:0/1493287580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fee800 0x564931feebd0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- 172.21.15.37:0/1493287580 >> 172.21.15.37:0/1493287580 conn(0x564931e67a70 msgr2=0x564931fa3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- 172.21.15.37:0/1493287580 shutdown_connections 2023-07-09T21:23:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- 172.21.15.37:0/1493287580 wait complete. 2023-07-09T21:23:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 -- start start 2023-07-09T21:23:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.613+0000 7f7057af7000 1 Processor -- start 2023-07-09T21:23:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x564931fafdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x564931fb0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931df27a0 con 0x564931fef110 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931daef00 con 0x564931fa4f90 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x564931daeba0 con 0x564931fee800 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 10 client.0 _ll_register_callbacks cb 0x564931f90930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59586/0 (socket says 172.21.15.37:59586) 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 -- 172.21.15.37:0/1463857203 learned_addr learned my addr 172.21.15.37:0/1463857203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052510640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x564931fafdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7051d0f640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x564931fb0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 -- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 msgr2=0x564931fb0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x564931fb0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 -- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 msgr2=0x564931fafdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x564931fafdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 -- 172.21.15.37:0/1463857203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704c15c5f0 con 0x564931fef110 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052d11640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f704c0ca220 tx=0x7f70440073b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28dbb037baae03c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044014430 con 0x564931fef110 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7044006850 con 0x564931fef110 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564931df10f0 con 0x564931fef110 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7044006a10 con 0x564931fef110 2023-07-09T21:23:48.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 10 client.5553 fetch_fsmap learned FSMap version 16 2023-07-09T21:23:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564931db7130 con 0x564931fef110 2023-07-09T21:23:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564931df10f0 con 0x564931fef110 2023-07-09T21:23:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7044012040 con 0x564931fef110 2023-07-09T21:23:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 10 client.5553 fetch_fsmap finished waiting for FSMap version 16 2023-07-09T21:23:48.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 10 client.5553 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 20 client.5553 populate_metadata read hostname 'smithi037' 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931ffd870 0x564931fffc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 4 client.5553 mds_command: new command op to 5361 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 --> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564931db9e40 con 0x564931ffd870 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052510640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931ffd870 0x564931fffc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 10 client.5553 ms_handle_connect on v2:172.21.15.37:6832/723627337 2023-07-09T21:23:48.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7052510640 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931ffd870 0x564931fffc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=437c2c340c84aeda server_cookie=7513014d912ac93c in_seq=0 out_seq=0 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 1 -- 172.21.15.37:0/1463857203 <== mds.0 v2:172.21.15.37:6832/723627337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564931db9e40 con 0x564931ffd870 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f702d7fa640 10 client.5553 handle_command_reply: tid=0 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.617+0000 7f7057af7000 1 client.5553 shutdown 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 msgr2=0x564931fb0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f704c0ca220 tx=0x7f70440073b0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 shutdown_connections 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931ffd870 0x564931fffc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fb0870 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x564931fb0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f702d7fa640 0 client.5553 ms_handle_reset on v2:172.21.15.37:6832/723627337 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 --2- 172.21.15.37:0/1463857203 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x564931fafdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 >> 172.21.15.37:0/1463857203 conn(0x564931e67a70 msgr2=0x564931fa3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 shutdown_connections 2023-07-09T21:23:48.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 1 -- 172.21.15.37:0/1463857203 wait complete. 2023-07-09T21:23:48.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.621+0000 7f7057af7000 20 client.5553 trim_cache size 0 max 16384 2023-07-09T21:23:48.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.633+0000 7f7057af7000 1 Processor -- start 2023-07-09T21:23:48.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- start start 2023-07-09T21:23:48.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564932001370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fee800 0x5649320018b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931aaf940 con 0x564931fef110 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931db9a50 con 0x564931fee800 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x564931e6bf80 con 0x564931fa4f90 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59598/0 (socket says 172.21.15.37:59598) 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 -- 172.21.15.37:0/2547463928 learned_addr learned my addr 172.21.15.37:0/2547463928 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052510640 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564932001370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7051d0f640 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fee800 0x5649320018b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 -- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 msgr2=0x564932001370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564932001370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 -- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fee800 msgr2=0x5649320018b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fee800 0x5649320018b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 -- 172.21.15.37:0/2547463928 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564931d9d3c0 con 0x564931fef110 2023-07-09T21:23:48.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7052d11640 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7044009010 tx=0x7f704400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f707cdd66912f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7040ff9640 1 -- 172.21.15.37:0/2547463928 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70440060d0 con 0x564931fef110 2023-07-09T21:23:48.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7040ff9640 1 -- 172.21.15.37:0/2547463928 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f704400d040 con 0x564931fef110 2023-07-09T21:23:48.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7040ff9640 1 -- 172.21.15.37:0/2547463928 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044006450 con 0x564931fef110 2023-07-09T21:23:48.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- 172.21.15.37:0/2547463928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 msgr2=0x564931fe97a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7044009010 tx=0x7f704400e000 comp rx=0 tx=0).stop 2023-07-09T21:23:48.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- 172.21.15.37:0/2547463928 shutdown_connections 2023-07-09T21:23:48.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fe97a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fee800 0x5649320018b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 --2- 172.21.15.37:0/2547463928 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fa4f90 0x564932001370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- 172.21.15.37:0/2547463928 >> 172.21.15.37:0/2547463928 conn(0x564931e67a70 msgr2=0x564931fffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- 172.21.15.37:0/2547463928 shutdown_connections 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- 172.21.15.37:0/2547463928 wait complete. 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 -- start start 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.637+0000 7f7057af7000 1 Processor -- start 2023-07-09T21:23:48.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x56493204bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x56493204c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fec400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931deffb0 con 0x564931fef110 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x564931df5300 con 0x564931fa4f90 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x564931decaa0 con 0x564931fee800 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 10 client.0 _ll_register_callbacks cb 0x564931f714d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052510640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x56493204bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7051d0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x56493204c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052510640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x56493204bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55262/0 (socket says 172.21.15.37:55262) 2023-07-09T21:23:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052510640 1 -- 172.21.15.37:0/3833272028 learned_addr learned my addr 172.21.15.37:0/3833272028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 -- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 msgr2=0x56493204c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x56493204c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 -- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 msgr2=0x56493204bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x56493204bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 -- 172.21.15.37:0/3833272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564931db7130 con 0x564931fef110 2023-07-09T21:23:48.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052d11640 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fec400 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x564931dba830 tx=0x7f70440014e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf1846bb49553a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:23:48.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7044014430 con 0x564931fef110 2023-07-09T21:23:48.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7044031070 con 0x564931fef110 2023-07-09T21:23:48.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564931fa8920 con 0x564931fef110 2023-07-09T21:23:48.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7044014590 con 0x564931fef110 2023-07-09T21:23:48.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 10 client.5559 fetch_fsmap learned FSMap version 16 2023-07-09T21:23:48.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x564931aeecc0 con 0x564931fef110 2023-07-09T21:23:48.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564931fa8920 con 0x564931fef110 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f70440147b0 con 0x564931fef110 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 10 client.5559 fetch_fsmap finished waiting for FSMap version 16 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 10 client.5559 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 20 client.5559 populate_metadata read hostname 'smithi037' 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931fecdc0 0x564931fed190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 4 client.5559 mds_command: new command op to 5361 tid=0[{"prefix": "status"}] 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 --> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564931dab6f0 con 0x564931fecdc0 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052510640 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931fecdc0 0x564931fed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7052510640 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931fecdc0 0x564931fed190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d653e876e452220 server_cookie=caa41d0a0e4fe33d in_seq=0 out_seq=0 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 10 client.5559 ms_handle_connect on v2:172.21.15.37:6832/723627337 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 1 -- 172.21.15.37:0/3833272028 <== mds.0 v2:172.21.15.37:6832/723627337 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564931dab6f0 con 0x564931fecdc0 2023-07-09T21:23:48.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f702d7fa640 10 client.5559 handle_command_reply: tid=0 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.641+0000 7f7057af7000 1 client.5559 shutdown 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 msgr2=0x564931fec400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fec400 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x564931dba830 tx=0x7f70440014e0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 shutdown_connections 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:6832/723627337,v1:172.21.15.37:6834/723627337] conn(0x564931fecdc0 0x564931fed190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564931fef110 0x564931fec400 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564931fee800 0x56493204c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 --2- 172.21.15.37:0/3833272028 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564931fa4f90 0x56493204bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f702d7fa640 0 client.5559 ms_handle_reset on v2:172.21.15.37:6832/723627337 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 >> 172.21.15.37:0/3833272028 conn(0x564931e67a70 msgr2=0x5649320004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 shutdown_connections 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 1 -- 172.21.15.37:0/3833272028 wait complete. 2023-07-09T21:23:48.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7057af7000 20 client.5559 trim_cache size 0 max 16384 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5361, 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:23:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.441187459, 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 16, 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 37, 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 37, 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 19.307258003000001 2023-07-09T21:23:48.657 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:23:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 msgr2=0x7f7030068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 0x7f7030068760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f704c153f00 tx=0x7f703c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 msgr2=0x7f704c0c97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f704801c1c0 tx=0x7f7038005800 comp rx=0 tx=0).stop 2023-07-09T21:23:48.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 shutdown_connections 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f70300662b0 0x7f7030068760 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f704c1f4430 0x7f704c1f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f704c157160 0x7f704c1575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 --2- 172.21.15.37:0/1838396884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7038003980 0x7f704c0c97d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 >> 172.21.15.37:0/1838396884 conn(0x7f704c0694c0 msgr2=0x7f704c0ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 shutdown_connections 2023-07-09T21:23:48.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.645+0000 7f7054774640 1 -- 172.21.15.37:0/1838396884 wait complete. 2023-07-09T21:23:48.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:23:48.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.805+0000 7fbf4646d640 1 Processor -- start 2023-07-09T21:23:48.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.805+0000 7fbf4646d640 1 -- start start 2023-07-09T21:23:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf4646d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbf400b7ab0 0x7fbf4006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf4646d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf400b4340 0x7fbf400d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf4646d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf400b49f0 con 0x7fbf400cef80 2023-07-09T21:23:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf4646d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400b7e80 con 0x7fbf400b4340 2023-07-09T21:23:48.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf4646d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf400cc8a0 con 0x7fbf400b7ab0 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf400b4340 0x7fbf400d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf400b4340 0x7fbf400d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59618/0 (socket says 172.21.15.37:59618) 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 -- 172.21.15.37:0/2732498233 learned_addr learned my addr 172.21.15.37:0/2732498233 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf3ffff640 1 --2- 172.21.15.37:0/2732498233 >> v2:172.21.15.119:3300/0 conn(0x7fbf400b7ab0 0x7fbf4006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 -- 172.21.15.37:0/2732498233 >> v2:172.21.15.119:3300/0 conn(0x7fbf400b7ab0 msgr2=0x7fbf4006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:48.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 --2- 172.21.15.37:0/2732498233 >> v2:172.21.15.119:3300/0 conn(0x7fbf400b7ab0 0x7fbf4006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 -- 172.21.15.37:0/2732498233 >> v1:172.21.15.119:6789/0 conn(0x7fbf400cef80 legacy=0x7fbf400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.809+0000 7fbf44a0a640 1 -- 172.21.15.37:0/2732498233 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf400ccb80 con 0x7fbf400b4340 2023-07-09T21:23:48.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf44a0a640 1 --2- 172.21.15.37:0/2732498233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400d02a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006b360 tx=0x7fbf3801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ee137520c83f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf3effd640 1 -- 172.21.15.37:0/2732498233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a5860 con 0x7fbf400b4340 2023-07-09T21:23:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf3effd640 1 -- 172.21.15.37:0/2732498233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf380a59c0 con 0x7fbf400b4340 2023-07-09T21:23:48.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf3effd640 1 -- 172.21.15.37:0/2732498233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf380a5d50 con 0x7fbf400b4340 2023-07-09T21:23:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- 172.21.15.37:0/2732498233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 msgr2=0x7fbf400d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 --2- 172.21.15.37:0/2732498233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400d02a0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbf4006b360 tx=0x7fbf3801c9a0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- 172.21.15.37:0/2732498233 shutdown_connections 2023-07-09T21:23:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 --2- 172.21.15.37:0/2732498233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400d02a0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 --2- 172.21.15.37:0/2732498233 >> v2:172.21.15.119:3300/0 conn(0x7fbf400b7ab0 0x7fbf4006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- 172.21.15.37:0/2732498233 >> 172.21.15.37:0/2732498233 conn(0x7fbf40073090 msgr2=0x7fbf40069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- 172.21.15.37:0/2732498233 shutdown_connections 2023-07-09T21:23:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- 172.21.15.37:0/2732498233 wait complete. 2023-07-09T21:23:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 Processor -- start 2023-07-09T21:23:48.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.813+0000 7fbf4646d640 1 -- start start 2023-07-09T21:23:48.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf400b7ab0 0x7fbf400c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 0x7fbf400cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf40150df0 con 0x7fbf400b4340 2023-07-09T21:23:48.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401569f0 con 0x7fbf400b7ab0 2023-07-09T21:23:48.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf401501e0 con 0x7fbf400cef80 2023-07-09T21:23:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59620/0 (socket says 172.21.15.37:59620) 2023-07-09T21:23:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 -- 172.21.15.37:0/3122627462 learned_addr learned my addr 172.21.15.37:0/3122627462 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3f7fe640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf400b7ab0 0x7fbf400c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf44a0a640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 0x7fbf400cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 -- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 msgr2=0x7fbf400cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 0x7fbf400cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 -- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf400b7ab0 msgr2=0x7fbf400c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf400b7ab0 0x7fbf400c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 -- 172.21.15.37:0/3122627462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf38009b30 con 0x7fbf400b4340 2023-07-09T21:23:48.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf44a0a640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 0x7fbf400cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:48.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3ffff640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000e9b0 tx=0x7fbf3000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf300096b0 con 0x7fbf400b4340 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3000c9a0 con 0x7fbf400b4340 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3000cd30 con 0x7fbf400b4340 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf401504c0 con 0x7fbf400b4340 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf40150a80 con 0x7fbf400b4340 2023-07-09T21:23:48.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf4004d7d0 con 0x7fbf400b4340 2023-07-09T21:23:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.817+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf30013470 con 0x7fbf400b4340 2023-07-09T21:23:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.821+0000 7fbf3cff9640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 0x7fbf2c068730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.821+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf30083ef0 con 0x7fbf400b4340 2023-07-09T21:23:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.821+0000 7fbf3f7fe640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 0x7fbf2c068730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:48.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.821+0000 7fbf3f7fe640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 0x7fbf2c068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf400c84e0 tx=0x7fbf34009040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:48.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:48.825+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf30051420 con 0x7fbf400b4340 2023-07-09T21:23:49.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf4006a830 con 0x7fbf400b4340 2023-07-09T21:23:49.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf3cff9640 1 -- 172.21.15.37:0/3122627462 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbf30017070 con 0x7fbf400b4340 2023-07-09T21:23:49.016 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:23:49.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 msgr2=0x7fbf2c068730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:49.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 0x7fbf2c068730 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fbf400c84e0 tx=0x7fbf34009040 comp rx=0 tx=0).stop 2023-07-09T21:23:49.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 msgr2=0x7fbf400c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:49.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fbf3000e9b0 tx=0x7fbf3000ee70 comp rx=0 tx=0).stop 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 shutdown_connections 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbf2c066280 0x7fbf2c068730 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf400cef80 0x7fbf400cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf400b7ab0 0x7fbf400c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 --2- 172.21.15.37:0/3122627462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf400b4340 0x7fbf400c9280 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.013+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 >> 172.21.15.37:0/3122627462 conn(0x7fbf40073090 msgr2=0x7fbf400d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:49.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.017+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 shutdown_connections 2023-07-09T21:23:49.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:49.017+0000 7fbf4646d640 1 -- 172.21.15.37:0/3122627462 wait complete. 2023-07-09T21:23:49.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:23:49.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:23:49.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:23:49.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:23:49.039 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:49.039 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:23:49.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:23:49.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:23:49.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:23:49.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.040 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.050 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:23:49.051 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.052 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:23:49.053 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:23:49.054 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:23:49.055 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:23:49.055 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:23:49.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.056 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:23:49.116 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:23:49.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.119 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:23:49.175 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:23:49.175 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:23:49.175 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:23:49.175 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:23:49.175 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:23:49.176 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:23:49.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.176 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:23:49.177 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:23:49.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:23:49.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:23:49.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:23:49.178 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:23:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.274 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:23:49.283 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:23:49.283 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:23:49.284 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:23:49.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:23:49.346 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:23:49.346 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:23:49.347 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:49.397 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:23:49.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:23:49.398 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:49.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:23:49.510 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:23:49.511 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:23:49.572 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:23:49.574 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:23:49.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.575 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:23:49.625 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:23:49.625 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:23:49.668 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:23:49.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:23:49.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:23:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:23:49.754 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:23:49.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:49.755 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:23:49.766 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:23:49.765+0000 7fcb80094580 -1 init, newargv = 0x557a34a7c210 newargc=15 2023-07-09T21:23:49.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[48345]: starting ceph client 2023-07-09T21:23:49.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[48345]: starting fuse 2023-07-09T21:23:49.776 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:23:49.777 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:23:49.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:23:49.778 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:23:49.778 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:23:49.779 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:23:49.779 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:23:49.779 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:23:49.779 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:23:49.780 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:23:49.780 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:23:49.780 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:23:49.781 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:23:49.781 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:23:49.781 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:23:49.781 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:23:49.782 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:23:49.782 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:23:49.782 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:23:49.783 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:23:49.783 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:23:49.783 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:23:49.784 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:23:49.784 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:23:49.784 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:23:49.785 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:23:49.785 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:23:49.785 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:23:49.786 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:23:49.903 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.48345.asok 2023-07-09T21:23:50.087 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48345.asok 2023-07-09T21:23:50.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:50.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48345.asok status 2023-07-09T21:23:50.264 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:23:50.264 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:23:50.264 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:23:50.264 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "48345", 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:23:50.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5574, 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:23:50.266 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 5574 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1486689228 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:50.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1486689228 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.5574 192.168.0.1:0/1486689228", 2023-07-09T21:23:50.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/1486689228", 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 16, 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 37, 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:23:50.269 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:23:50.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:50.280 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:23:50.281 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:50.290 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:23:50.290 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:50.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:50.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:23:50.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:23:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 Processor -- start 2023-07-09T21:23:50.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 -- start start 2023-07-09T21:23:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad200b7a60 0x7fad200cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fad200b47a0 0x7fad200b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200cef80 con 0x7fad200b4140 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200b45e0 con 0x7fad200b7a60 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad27b59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad200cf260 con 0x7fad200b47a0 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad258f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad200b7a60 0x7fad200cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad260f6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad200b4140 0x7fad2015f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60260/0 (socket says 172.21.15.37:60260) 2023-07-09T21:23:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.537+0000 7fad260f6640 1 -- 172.21.15.37:0/1290074278 learned_addr learned my addr 172.21.15.37:0/1290074278 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad250f4640 1 --2- 172.21.15.37:0/1290074278 >> v2:172.21.15.119:3300/0 conn(0x7fad200b47a0 0x7fad200b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad258f5640 1 -- 172.21.15.37:0/1290074278 >> v2:172.21.15.119:3300/0 conn(0x7fad200b47a0 msgr2=0x7fad200b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad258f5640 1 --2- 172.21.15.37:0/1290074278 >> v2:172.21.15.119:3300/0 conn(0x7fad200b47a0 0x7fad200b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad258f5640 1 -- 172.21.15.37:0/1290074278 >> v1:172.21.15.37:6789/0 conn(0x7fad200b4140 legacy=0x7fad2015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad258f5640 1 -- 172.21.15.37:0/1290074278 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200cf540 con 0x7fad200b7a60 2023-07-09T21:23:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.541+0000 7fad248f3640 1 -- 172.21.15.37:0/1290074278 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338012848 0 0) 0x7fad200cef80 con 0x7fad200b4140 2023-07-09T21:23:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad258f5640 1 --2- 172.21.15.37:0/1290074278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b7a60 0x7fad200cc7d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad200c91b0 tx=0x7fad1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288408cbc6ab5a2e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad248f3640 1 -- 172.21.15.37:0/1290074278 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c004230 con 0x7fad200b7a60 2023-07-09T21:23:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad248f3640 1 -- 172.21.15.37:0/1290074278 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c0a7050 con 0x7fad200b7a60 2023-07-09T21:23:50.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad248f3640 1 -- 172.21.15.37:0/1290074278 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003620 con 0x7fad200b7a60 2023-07-09T21:23:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 -- 172.21.15.37:0/1290074278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b7a60 msgr2=0x7fad200cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 --2- 172.21.15.37:0/1290074278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b7a60 0x7fad200cc7d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad200c91b0 tx=0x7fad1c01c460 comp rx=0 tx=0).stop 2023-07-09T21:23:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 -- 172.21.15.37:0/1290074278 shutdown_connections 2023-07-09T21:23:50.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 --2- 172.21.15.37:0/1290074278 >> v2:172.21.15.119:3300/0 conn(0x7fad200b47a0 0x7fad200b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 --2- 172.21.15.37:0/1290074278 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b7a60 0x7fad200cc7d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 -- 172.21.15.37:0/1290074278 >> 172.21.15.37:0/1290074278 conn(0x7fad20073050 msgr2=0x7fad20069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 -- 172.21.15.37:0/1290074278 shutdown_connections 2023-07-09T21:23:50.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.545+0000 7fad27b59640 1 -- 172.21.15.37:0/1290074278 wait complete. 2023-07-09T21:23:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 Processor -- start 2023-07-09T21:23:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- start start 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200b47a0 0x7fad2015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad200b7a60 0x7fad200b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2015d540 con 0x7fad200b4140 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2015d820 con 0x7fad200b47a0 2023-07-09T21:23:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2015db00 con 0x7fad200b7a60 2023-07-09T21:23:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59642/0 (socket says 172.21.15.37:59642) 2023-07-09T21:23:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 -- 172.21.15.37:0/417637489 learned_addr learned my addr 172.21.15.37:0/417637489 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad250f4640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200b47a0 0x7fad2015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad260f6640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad200b7a60 0x7fad200b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 -- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad200b7a60 msgr2=0x7fad200b6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad200b7a60 0x7fad200b6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 -- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200b47a0 msgr2=0x7fad2015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200b47a0 0x7fad2015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 -- 172.21.15.37:0/417637489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c009420 con 0x7fad200b4140 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad258f5640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fad1c019070 tx=0x7fad1c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003b70 con 0x7fad200b4140 2023-07-09T21:23:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c003cd0 con 0x7fad200b4140 2023-07-09T21:23:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c0ab640 con 0x7fad200b4140 2023-07-09T21:23:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2015dde0 con 0x7fad200b4140 2023-07-09T21:23:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad20153080 con 0x7fad200b4140 2023-07-09T21:23:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.549+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad200cdaa0 con 0x7fad200b4140 2023-07-09T21:23:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.553+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad1c0b2050 con 0x7fad200b4140 2023-07-09T21:23:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.553+0000 7fad167fc640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 0x7fad04068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.553+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad1c11df30 con 0x7fad200b4140 2023-07-09T21:23:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.553+0000 7fad250f4640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 0x7fad04068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.553+0000 7fad250f4640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 0x7fad04068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fad200b10c0 tx=0x7fad10009190 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.557+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad1c0eb4f0 con 0x7fad200b4140 2023-07-09T21:23:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.733+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fad2015d990 con 0x7fad040662b0 2023-07-09T21:23:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.733+0000 7fad167fc640 1 -- 172.21.15.37:0/417637489 <== mgr.4099 v2:172.21.15.119:6832/1139343796 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fad2015d990 con 0x7fad040662b0 2023-07-09T21:23:50.736 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:23:50.737 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:23:50.737 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:23:50.737 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:23:50.737 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:23:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 msgr2=0x7fad04068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 0x7fad04068760 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fad200b10c0 tx=0x7fad10009190 comp rx=0 tx=0).stop 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 msgr2=0x7fad20155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fad1c019070 tx=0x7fad1c019200 comp rx=0 tx=0).stop 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 shutdown_connections 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fad040662b0 0x7fad04068760 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad200b7a60 0x7fad200b6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad200b47a0 0x7fad2015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 --2- 172.21.15.37:0/417637489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad200b4140 0x7fad20155d60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 >> 172.21.15.37:0/417637489 conn(0x7fad20073050 msgr2=0x7fad200b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 shutdown_connections 2023-07-09T21:23:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.737+0000 7fad27b59640 1 -- 172.21.15.37:0/417637489 wait complete. 2023-07-09T21:23:50.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:23:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 Processor -- start 2023-07-09T21:23:50.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 -- start start 2023-07-09T21:23:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03f40c3e10 0x7f03f40c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f415c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f40c9090 con 0x7f03f41585b0 2023-07-09T21:23:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f40cbf40 con 0x7f03f40c3e10 2023-07-09T21:23:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03fa0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40c47d0 con 0x7f03f415c200 2023-07-09T21:23:50.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03f40c3e10 0x7f03f40c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03f40c3e10 0x7f03f40c4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55296/0 (socket says 172.21.15.37:55296) 2023-07-09T21:23:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 -- 172.21.15.37:0/1321039167 learned_addr learned my addr 172.21.15.37:0/1321039167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 -- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 msgr2=0x7f03f415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:50.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 -- 172.21.15.37:0/1321039167 >> v1:172.21.15.119:6789/0 conn(0x7f03f41585b0 legacy=0x7f03f406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.901+0000 7f03f2ffd640 1 -- 172.21.15.37:0/1321039167 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f415cbc0 con 0x7f03f40c3e10 2023-07-09T21:23:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40c3e10 0x7f03f40c4290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e801e750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4051138614a4dcd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03f27fc640 1 -- 172.21.15.37:0/1321039167 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a7730 con 0x7f03f40c3e10 2023-07-09T21:23:50.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03f27fc640 1 -- 172.21.15.37:0/1321039167 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e80a7890 con 0x7f03f40c3e10 2023-07-09T21:23:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03f27fc640 1 -- 172.21.15.37:0/1321039167 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e80a7c20 con 0x7f03f40c3e10 2023-07-09T21:23:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40c3e10 msgr2=0x7f03f40c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40c3e10 0x7f03f40c4290 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009870 tx=0x7f03e801e750 comp rx=0 tx=0).stop 2023-07-09T21:23:50.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1321039167 shutdown_connections 2023-07-09T21:23:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1321039167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f40c3e10 0x7f03f40c4290 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1321039167 >> 172.21.15.37:0/1321039167 conn(0x7f03f40cde40 msgr2=0x7f03f40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:50.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1321039167 shutdown_connections 2023-07-09T21:23:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.905+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1321039167 wait complete. 2023-07-09T21:23:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 Processor -- start 2023-07-09T21:23:50.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- start start 2023-07-09T21:23:50.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 0x7f03f4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f40aea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f4157d60 con 0x7f03f40c3e10 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40af2a0 con 0x7f03f41585b0 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f40af580 con 0x7f03f415c200 2023-07-09T21:23:50.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59648/0 (socket says 172.21.15.37:59648) 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 -- 172.21.15.37:0/1937207775 learned_addr learned my addr 172.21.15.37:0/1937207775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 0x7f03f4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f3fff640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f40aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 -- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 msgr2=0x7f03f40aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f40aea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 -- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 msgr2=0x7f03f4157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:50.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 0x7f03f4157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 -- 172.21.15.37:0/1937207775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80094d0 con 0x7f03f40c3e10 2023-07-09T21:23:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 0x7f03f4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:23:50.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03f37fe640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c500 tx=0x7f03e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4005220 con 0x7f03f40c3e10 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4005380 con 0x7f03f40c3e10 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4007270 con 0x7f03f40c3e10 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f40af860 con 0x7f03f40c3e10 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.909+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f40aef90 con 0x7f03f40c3e10 2023-07-09T21:23:50.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f40afd80 con 0x7f03f40c3e10 2023-07-09T21:23:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f03e40073d0 con 0x7f03f40c3e10 2023-07-09T21:23:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03dbfff640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 0x7f03e0068760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:50.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f03e40836c0 con 0x7f03f40c3e10 2023-07-09T21:23:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 0x7f03e0068760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:50.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.913+0000 7f03f2ffd640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 0x7f03e0068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03e80b1000 tx=0x7f03e8008040 comp rx=0 tx=0).ready entity=mgr.4099 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:50.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:50.917+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03f40afd80 con 0x7f03f40c3e10 2023-07-09T21:23:51.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.109+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f03f40afd80 con 0x7f03f40c3e10 2023-07-09T21:23:51.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.825+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f03e4081a80 con 0x7f03f40c3e10 2023-07-09T21:23:51.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.829+0000 7f03dbfff640 1 -- 172.21.15.37:0/1937207775 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) v1 ==== 92+0+0 (secure 0 0 0) 0x7f03e407bbc0 con 0x7f03f40c3e10 2023-07-09T21:23:51.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.829+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 msgr2=0x7f03e0068760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:51.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.829+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 0x7f03e0068760 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f03e80b1000 tx=0x7f03e8008040 comp rx=0 tx=0).stop 2023-07-09T21:23:51.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.829+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 msgr2=0x7f03f414d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.829+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c500 tx=0x7f03e400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:23:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 shutdown_connections 2023-07-09T21:23:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f03e00662b0 0x7f03e0068760 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:51.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03f415c200 0x7f03f40aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03f41585b0 0x7f03f4157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 --2- 172.21.15.37:0/1937207775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03f40c3e10 0x7f03f414d4b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 >> 172.21.15.37:0/1937207775 conn(0x7f03f40cde40 msgr2=0x7f03f406b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:51.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 shutdown_connections 2023-07-09T21:23:51.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:51.833+0000 7f03fa0ec640 1 -- 172.21.15.37:0/1937207775 wait complete. 2023-07-09T21:23:51.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:23:52.002 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:51.997+0000 7f60e602c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:23:52.007 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:52.005+0000 7f293ae3a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:23:52.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 Processor -- start 2023-07-09T21:23:52.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 -- start start 2023-07-09T21:23:52.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcbc0b7980 0x7fbcbc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbcbc0d0780 0x7fbcbc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcbc15bf80 con 0x7fbcbc0ceb80 2023-07-09T21:23:52.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc0cd070 con 0x7fbcbc0b7980 2023-07-09T21:23:52.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcc149c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcbc0cfd70 con 0x7fbcbc0d0780 2023-07-09T21:23:52.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcbc0b7980 0x7fbcbc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbcbc0b7980 0x7fbcbc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59666/0 (socket says 172.21.15.37:59666) 2023-07-09T21:23:52.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 -- 172.21.15.37:0/382471628 learned_addr learned my addr 172.21.15.37:0/382471628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:52.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbb7fe640 1 --2- 172.21.15.37:0/382471628 >> v2:172.21.15.119:3300/0 conn(0x7fbcbc0d0780 0x7fbcbc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 -- 172.21.15.37:0/382471628 >> v2:172.21.15.119:3300/0 conn(0x7fbcbc0d0780 msgr2=0x7fbcbc0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:52.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 --2- 172.21.15.37:0/382471628 >> v2:172.21.15.119:3300/0 conn(0x7fbcbc0d0780 0x7fbcbc0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 -- 172.21.15.37:0/382471628 >> v1:172.21.15.37:6789/0 conn(0x7fbcbc0ceb80 legacy=0x7fbcbc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.013+0000 7fbcbaffd640 1 -- 172.21.15.37:0/382471628 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc160570 con 0x7fbcbc0b7980 2023-07-09T21:23:52.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcbaffd640 1 --2- 172.21.15.37:0/382471628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0b7980 0x7fbcbc160030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b1240 tx=0x7fbcac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260425fe9ca4e15c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcba7fc640 1 -- 172.21.15.37:0/382471628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0ab600 con 0x7fbcbc0b7980 2023-07-09T21:23:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcba7fc640 1 -- 172.21.15.37:0/382471628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac0a7050 con 0x7fbcbc0b7980 2023-07-09T21:23:52.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcba7fc640 1 -- 172.21.15.37:0/382471628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcac0ab980 con 0x7fbcbc0b7980 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 -- 172.21.15.37:0/382471628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0b7980 msgr2=0x7fbcbc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 --2- 172.21.15.37:0/382471628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0b7980 0x7fbcbc160030 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0b1240 tx=0x7fbcac01c500 comp rx=0 tx=0).stop 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 -- 172.21.15.37:0/382471628 shutdown_connections 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 --2- 172.21.15.37:0/382471628 >> v2:172.21.15.119:3300/0 conn(0x7fbcbc0d0780 0x7fbcbc0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 --2- 172.21.15.37:0/382471628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0b7980 0x7fbcbc160030 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 -- 172.21.15.37:0/382471628 >> 172.21.15.37:0/382471628 conn(0x7fbcbc073090 msgr2=0x7fbcbc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:52.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 -- 172.21.15.37:0/382471628 shutdown_connections 2023-07-09T21:23:52.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 -- 172.21.15.37:0/382471628 wait complete. 2023-07-09T21:23:52.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.017+0000 7fbcc149c640 1 Processor -- start 2023-07-09T21:23:52.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- start start 2023-07-09T21:23:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcbc0b7980 0x7fbcbc0b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 0x7fbcbc148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 0x7fbcbc1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc149bb0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc148680 con 0x7fbcbc0ceb80 2023-07-09T21:23:52.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcbc149030 con 0x7fbcbc0b7980 2023-07-09T21:23:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 0x7fbcbc148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 0x7fbcbc1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbaffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcbc0b7980 0x7fbcbc0b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 0x7fbcbc148140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55338/0 (socket says 172.21.15.37:55338) 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb3fff640 1 -- 172.21.15.37:0/368866749 learned_addr learned my addr 172.21.15.37:0/368866749 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 -- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcbc0b7980 msgr2=0x7fbcbc0b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcbc0b7980 0x7fbcbc0b6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 -- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 msgr2=0x7fbcbc148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 0x7fbcbc148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 -- 172.21.15.37:0/368866749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0094d0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcbb7fe640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 0x7fbcbc1487e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400eba0 tx=0x7fbcb400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb400cd20 con 0x7fbcbc0d0780 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb400f040 con 0x7fbcbc0d0780 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb40146c0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcbc149310 con 0x7fbcbc0d0780 2023-07-09T21:23:52.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcbc1498d0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.021+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcbc04d7d0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.025+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7fbcb4014820 con 0x7fbcbc0d0780 2023-07-09T21:23:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.025+0000 7fbcb37fe640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 0x7fbc9c068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.025+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbcb40849c0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.025+0000 7fbcbaffd640 1 -- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 msgr2=0x7fbc9c068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:52.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.025+0000 7fbcbaffd640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 0x7fbc9c068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:23:52.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.029+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbcb4051e50 con 0x7fbcbc0d0780 2023-07-09T21:23:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.197+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fbcbc0b1600 con 0x7fbcbc0d0780 2023-07-09T21:23:52.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcb37fe640 1 -- 172.21.15.37:0/368866749 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v11)=0 v11) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbcb40180d0 con 0x7fbcbc0d0780 2023-07-09T21:23:52.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 msgr2=0x7fbc9c068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:23:52.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 0x7fbc9c068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 msgr2=0x7fbcbc1487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 0x7fbcbc1487e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fbcb400eba0 tx=0x7fbcb400c490 comp rx=0 tx=0).stop 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 shutdown_connections 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fbc9c0662d0 0x7fbc9c068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbcbc0d0780 0x7fbcbc1487e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbcbc0ceb80 0x7fbcbc148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 --2- 172.21.15.37:0/368866749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbcbc0b7980 0x7fbcbc0b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 >> 172.21.15.37:0/368866749 conn(0x7fbcbc073090 msgr2=0x7fbcbc158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 shutdown_connections 2023-07-09T21:23:52.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.205+0000 7fbcc149c640 1 -- 172.21.15.37:0/368866749 wait complete. 2023-07-09T21:23:52.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:23:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 Processor -- start 2023-07-09T21:23:52.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 -- start start 2023-07-09T21:23:52.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15000b7980 0x7f1500160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000ceb80 0x7f15000cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150015bf80 con 0x7f15000b3c20 2023-07-09T21:23:52.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15000cd070 con 0x7f15000b7980 2023-07-09T21:23:52.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f1505c9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cfd70 con 0x7f15000ceb80 2023-07-09T21:23:52.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15000b7980 0x7f1500160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15000b7980 0x7f1500160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59678/0 (socket says 172.21.15.37:59678) 2023-07-09T21:23:52.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 -- 172.21.15.37:0/1030129982 learned_addr learned my addr 172.21.15.37:0/1030129982 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:52.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14feffd640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000ceb80 0x7f15000cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 -- 172.21.15.37:0/1030129982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000ceb80 msgr2=0x7f15000cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:52.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000ceb80 0x7f15000cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 -- 172.21.15.37:0/1030129982 >> v1:172.21.15.119:6789/0 conn(0x7f15000b3c20 legacy=0x7f15000b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.373+0000 7f14ff7fe640 1 -- 172.21.15.37:0/1030129982 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500160570 con 0x7f15000b7980 2023-07-09T21:23:52.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f14ff7fe640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500160030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009870 tx=0x7f14f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807e5b30cd327cdd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f14fe7fc640 1 -- 172.21.15.37:0/1030129982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40ab600 con 0x7f15000b7980 2023-07-09T21:23:52.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f14fe7fc640 1 -- 172.21.15.37:0/1030129982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f40a7050 con 0x7f15000b7980 2023-07-09T21:23:52.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f14fe7fc640 1 -- 172.21.15.37:0/1030129982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f40ab980 con 0x7f15000b7980 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 -- 172.21.15.37:0/1030129982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 msgr2=0x7f1500160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500160030 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009870 tx=0x7f14f401c540 comp rx=0 tx=0).stop 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 -- 172.21.15.37:0/1030129982 shutdown_connections 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000ceb80 0x7f15000cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 --2- 172.21.15.37:0/1030129982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500160030 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 -- 172.21.15.37:0/1030129982 >> 172.21.15.37:0/1030129982 conn(0x7f1500073090 msgr2=0x7f1500069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:52.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 -- 172.21.15.37:0/1030129982 shutdown_connections 2023-07-09T21:23:52.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.377+0000 7f1505c9e640 1 -- 172.21.15.37:0/1030129982 wait complete. 2023-07-09T21:23:52.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 Processor -- start 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- start start 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b3c20 0x7f150015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000ceb80 0x7f15000c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150015c120 con 0x7f15000b7980 2023-07-09T21:23:52.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150015c400 con 0x7f15000ceb80 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150015c6e0 con 0x7f15000b3c20 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59694/0 (socket says 172.21.15.37:59694) 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 -- 172.21.15.37:0/2997501835 learned_addr learned my addr 172.21.15.37:0/2997501835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14ff7fe640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b3c20 0x7f150015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14fffff640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000ceb80 0x7f15000c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 -- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b3c20 msgr2=0x7f150015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b3c20 0x7f150015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 -- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000ceb80 msgr2=0x7f15000c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000ceb80 0x7f15000c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 -- 172.21.15.37:0/2997501835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f40094d0 con 0x7f15000b7980 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14feffd640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f14f000d800 tx=0x7f14f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000b6c0 con 0x7f15000b7980 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f000b820 con 0x7f15000b7980 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f000bb90 con 0x7f15000b7980 2023-07-09T21:23:52.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f150015c9c0 con 0x7f15000b7980 2023-07-09T21:23:52.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.381+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15000c9e00 con 0x7f15000b7980 2023-07-09T21:23:52.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150004d7d0 con 0x7f15000b7980 2023-07-09T21:23:52.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7f14f000bcf0 con 0x7f15000b7980 2023-07-09T21:23:52.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f14e7fff640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 0x7f14ec068780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f14f0084260 con 0x7f15000b7980 2023-07-09T21:23:52.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f14ff7fe640 1 -- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 msgr2=0x7f14ec068780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:52.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.385+0000 7f14ff7fe640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 0x7f14ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:23:52.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.393+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14f0055180 con 0x7f15000b7980 2023-07-09T21:23:52.421 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:52.417+0000 7f60e602c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:23:52.473 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:52.469+0000 7f293ae3a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:23:52.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.553+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f150006a800 con 0x7f15000b7980 2023-07-09T21:23:52.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.557+0000 7f14e7fff640 1 -- 172.21.15.37:0/2997501835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v12)=0 v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f14f0054d10 con 0x7f15000b7980 2023-07-09T21:23:52.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.557+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 msgr2=0x7f14ec068780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.557+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 0x7f14ec068780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.557+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 msgr2=0x7f1500154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.557+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f14f000d800 tx=0x7f14f000dcc0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 shutdown_connections 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7f14ec0662d0 0x7f14ec068780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000ceb80 0x7f15000c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7980 0x7f1500154160 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 --2- 172.21.15.37:0/2997501835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b3c20 0x7f150015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 >> 172.21.15.37:0/2997501835 conn(0x7f1500073090 msgr2=0x7f15000b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 shutdown_connections 2023-07-09T21:23:52.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.561+0000 7f1505c9e640 1 -- 172.21.15.37:0/2997501835 wait complete. 2023-07-09T21:23:52.572 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:52.569+0000 7f60e602c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:23:52.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:52.581 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:23:52.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:52.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2023-07-09T21:23:52.635 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:52.633+0000 7f293ae3a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:23:52.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir0 1M 2023-07-09T21:23:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.833+0000 7fa5c1634640 1 Processor -- start 2023-07-09T21:23:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.833+0000 7fa5c1634640 1 -- start start 2023-07-09T21:23:52.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5c1634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc15f130 0x7fa5bc0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5c1634640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5bc0d0530 0x7fa5bc0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5c1634640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5bc0b3bb0 con 0x7fa5bc0b74e0 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5c1634640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5bc0b7930 con 0x7fa5bc0d0530 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5c1634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0cccb0 con 0x7fa5bc15f130 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5bc0d0530 0x7fa5bc0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5ba7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa5bc0b74e0 0x7fa5bc0cfe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60298/0 (socket says 172.21.15.37:60298) 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa5bc0d0530 0x7fa5bc0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59710/0 (socket says 172.21.15.37:59710) 2023-07-09T21:23:52.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5ba7fc640 1 -- 172.21.15.37:0/348426749 learned_addr learned my addr 172.21.15.37:0/348426749 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5baffd640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc15f130 0x7fa5bc0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/348426749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc15f130 msgr2=0x7fa5bc0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc15f130 0x7fa5bc0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/348426749 >> v1:172.21.15.37:6789/0 conn(0x7fa5bc0b74e0 legacy=0x7fa5bc0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.837+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/348426749 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0b8100 con 0x7fa5bc0d0530 2023-07-09T21:23:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5bb7fe640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0cd140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009d90 tx=0x7fa5b401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59efabcea433f9b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5b9ffb640 1 -- 172.21.15.37:0/348426749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40a5950 con 0x7fa5bc0d0530 2023-07-09T21:23:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5b9ffb640 1 -- 172.21.15.37:0/348426749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b40a5ab0 con 0x7fa5bc0d0530 2023-07-09T21:23:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5b9ffb640 1 -- 172.21.15.37:0/348426749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40a5e40 con 0x7fa5bc0d0530 2023-07-09T21:23:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- 172.21.15.37:0/348426749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc0d0530 msgr2=0x7fa5bc0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0cd140 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009d90 tx=0x7fa5b401c890 comp rx=0 tx=0).stop 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- 172.21.15.37:0/348426749 shutdown_connections 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0cd140 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 --2- 172.21.15.37:0/348426749 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc15f130 0x7fa5bc0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- 172.21.15.37:0/348426749 >> 172.21.15.37:0/348426749 conn(0x7fa5bc072d20 msgr2=0x7fa5bc0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- 172.21.15.37:0/348426749 shutdown_connections 2023-07-09T21:23:52.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- 172.21.15.37:0/348426749 wait complete. 2023-07-09T21:23:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 Processor -- start 2023-07-09T21:23:52.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.841+0000 7fa5c1634640 1 -- start start 2023-07-09T21:23:52.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc0b74e0 0x7fa5bc1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 0x7fa5bc0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc1f7f00 con 0x7fa5bc15f130 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c85a0 con 0x7fa5bc0d0530 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc0c79d0 con 0x7fa5bc0b74e0 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 0x7fa5bc0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 0x7fa5bc0c6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59714/0 (socket says 172.21.15.37:59714) 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/2446123628 learned_addr learned my addr 172.21.15.37:0/2446123628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:52.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5ba7fc640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc0b74e0 0x7fa5bc1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc0b74e0 msgr2=0x7fa5bc1589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa5bc0b74e0 0x7fa5bc1589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5bc0d0530 msgr2=0x7fa5bc0c5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa5bc0d0530 0x7fa5bc0c5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b4009a70 con 0x7fa5bc15f130 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5bb7fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 0x7fa5bc0c6040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa5b401af40 tx=0x7fa5b4019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:52.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40add90 con 0x7fa5bc15f130 2023-07-09T21:23:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b4009450 con 0x7fa5bc15f130 2023-07-09T21:23:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b40b9670 con 0x7fa5bc15f130 2023-07-09T21:23:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc0c7c70 con 0x7fa5bc15f130 2023-07-09T21:23:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc0c8230 con 0x7fa5bc15f130 2023-07-09T21:23:52.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.845+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc0668f0 con 0x7fa5bc15f130 2023-07-09T21:23:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.849+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 6) v1 ==== 85675+0+0 (secure 0 0 0) 0x7fa5b40039a0 con 0x7fa5bc15f130 2023-07-09T21:23:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.849+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.849+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5b411f3a0 con 0x7fa5bc15f130 2023-07-09T21:23:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.849+0000 7fa5baffd640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 msgr2=0x7fa5a80687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:52.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.849+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:23:52.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:52.853+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa5b40ec950 con 0x7fa5bc15f130 2023-07-09T21:23:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:53.025+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5bc0cc940 con 0x7fa5a8066300 2023-07-09T21:23:53.053 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.049+0000 7f60e602c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:23:53.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:53.053+0000 7fa5baffd640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 msgr2=0x7fa5a80687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:53.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:53.053+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:23:53.112 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.109+0000 7f60e602c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:23:53.149 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.145+0000 7f293ae3a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:23:53.167 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.165+0000 7f60e602c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:23:53.212 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.209+0000 7f293ae3a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:23:53.255 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.249+0000 7f60e602c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:23:53.271 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.269+0000 7f293ae3a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:23:53.312 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.309+0000 7f60e602c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:23:53.362 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.361+0000 7f293ae3a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:23:53.397 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.393+0000 7f60e602c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:23:53.421 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.421+0000 7f293ae3a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:23:53.453 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.449+0000 7f60e602c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:23:53.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:53.457+0000 7fa5baffd640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 msgr2=0x7fa5a80687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:53.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:53.457+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:23:53.510 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.509+0000 7f293ae3a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:23:53.569 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.569+0000 7f293ae3a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:23:53.594 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.589+0000 7f60e602c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:23:53.652 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.649+0000 7f60e602c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:23:53.719 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.717+0000 7f293ae3a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:23:53.781 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:53.777+0000 7f293ae3a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:23:53.892 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:23:53.892 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:23:53.892 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:23:53.900 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:53.897+0000 7f60e602c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:23:54.031 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:23:54.032 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:23:54.032 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:23:54.033 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.029+0000 7f60e602c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:23:54.040 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:54.037+0000 7f293ae3a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:23:54.159 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.157+0000 7f60e602c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:23:54.181 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:54.177+0000 7f293ae3a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:23:54.232 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.229+0000 7f60e602c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:23:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:54.261+0000 7fa5baffd640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 msgr2=0x7fa5a80687b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1139343796 2023-07-09T21:23:54.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:54.261+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:23:54.315 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:54.313+0000 7f293ae3a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:23:54.366 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.361+0000 7f60e602c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:23:54.391 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:54.389+0000 7f293ae3a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:23:54.532 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:54.529+0000 7f293ae3a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:23:54.903 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.901+0000 7f60e602c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:23:54.987 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:54.985+0000 7f60e602c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:23:55.101 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.097+0000 7f293ae3a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:23:55.135 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.129+0000 7f60e602c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:23:55.190 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.189+0000 7f293ae3a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:23:55.218 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.213+0000 7f60e602c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:23:55.345 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.341+0000 7f293ae3a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:23:55.433 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.433+0000 7f293ae3a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:23:55.488 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.485+0000 7f60e602c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:23:55.548 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.545+0000 7f60e602c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:23:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:55.557+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fa5b40ecd20 con 0x7fa5bc15f130 2023-07-09T21:23:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:55.557+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 msgr2=0x7fa5a80687b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:23:55.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:55.557+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/1139343796,v1:172.21.15.119:6833/1139343796] conn(0x7fa5a8066300 0x7fa5a80687b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:55.693 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6064212640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6064212640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6064212640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6064212640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6064212640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6067218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6067218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.694 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6067218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.695 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6067218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.695 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:23:55.689+0000 7f6067218640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:23:55.739 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.737+0000 7f293ae3a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:23:55.802 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:23:55.801+0000 7f293ae3a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:23:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.565+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa5b40f8420 con 0x7fa5bc15f130 2023-07-09T21:23:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.565+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa5a8033dc0 0x7fa5a80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.565+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5a8009860 con 0x7fa5a8033dc0 2023-07-09T21:23:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.565+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa5a8033dc0 0x7fa5a80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.569+0000 7fa5baffd640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa5a8033dc0 0x7fa5a80707d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009730 tx=0x7fa5ac009190 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:56.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5a37fe640 1 -- 172.21.15.37:0/2446123628 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa5a8009860 con 0x7fa5a8033dc0 2023-07-09T21:23:56.703 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir0 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa5a8033dc0 msgr2=0x7fa5a80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa5a8033dc0 0x7fa5a80707d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac009730 tx=0x7fa5ac009190 comp rx=0 tx=0).stop 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 msgr2=0x7fa5bc0c6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 --2- 172.21.15.37:0/2446123628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5bc15f130 0x7fa5bc0c6040 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fa5b401af40 tx=0x7fa5b4019630 comp rx=0 tx=0).stop 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5bb7fe640 1 -- 172.21.15.37:0/2446123628 reap_dead start 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 shutdown_connections 2023-07-09T21:23:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 >> 172.21.15.37:0/2446123628 conn(0x7fa5bc072d20 msgr2=0x7fa5bc06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:56.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 shutdown_connections 2023-07-09T21:23:56.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.701+0000 7fa5c1634640 1 -- 172.21.15.37:0/2446123628 wait complete. 2023-07-09T21:23:56.726 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2023-07-09T21:23:56.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:56.726 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2023-07-09T21:23:56.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir1 1M 2023-07-09T21:23:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 Processor -- start 2023-07-09T21:23:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 -- start start 2023-07-09T21:23:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f499c0cf290 0x7f499c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c15bf80 con 0x7f499c0b7980 2023-07-09T21:23:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c0cd070 con 0x7f499c0cf290 2023-07-09T21:23:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a279f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0cfd70 con 0x7f499c0d0780 2023-07-09T21:23:56.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f499c0cf290 0x7f499c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f499c0cf290 0x7f499c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59726/0 (socket says 172.21.15.37:59726) 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499bfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f499c0b7980 0x7f499c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:46470/0 (socket says 172.21.15.37:46470) 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 -- 172.21.15.37:0/3462430594 learned_addr learned my addr 172.21.15.37:0/3462430594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f49a0d3c640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 -- 172.21.15.37:0/3462430594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 msgr2=0x7f499c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 -- 172.21.15.37:0/3462430594 >> v1:172.21.15.119:6789/0 conn(0x7f499c0b7980 legacy=0x7f499c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.929+0000 7f499b7fe640 1 -- 172.21.15.37:0/3462430594 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c160570 con 0x7f499c0cf290 2023-07-09T21:23:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f499b7fe640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c160030 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4990009870 tx=0x7f499001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe045a7d27943779 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f499affd640 1 -- 172.21.15.37:0/3462430594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900ab600 con 0x7f499c0cf290 2023-07-09T21:23:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f499affd640 1 -- 172.21.15.37:0/3462430594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49900a7050 con 0x7f499c0cf290 2023-07-09T21:23:56.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f499affd640 1 -- 172.21.15.37:0/3462430594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900ab980 con 0x7f499c0cf290 2023-07-09T21:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 -- 172.21.15.37:0/3462430594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 msgr2=0x7f499c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c160030 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4990009870 tx=0x7f499001c540 comp rx=0 tx=0).stop 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 -- 172.21.15.37:0/3462430594 shutdown_connections 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 --2- 172.21.15.37:0/3462430594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c160030 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 -- 172.21.15.37:0/3462430594 >> 172.21.15.37:0/3462430594 conn(0x7f499c073090 msgr2=0x7f499c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 -- 172.21.15.37:0/3462430594 shutdown_connections 2023-07-09T21:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 -- 172.21.15.37:0/3462430594 wait complete. 2023-07-09T21:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.933+0000 7f49a279f640 1 Processor -- start 2023-07-09T21:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- start start 2023-07-09T21:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f499c0b7980 0x7f499c14e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c156610 con 0x7f499c0cf290 2023-07-09T21:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c154350 con 0x7f499c0b7980 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c1568b0 con 0x7f499c0d0780 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59732/0 (socket says 172.21.15.37:59732) 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 -- 172.21.15.37:0/527533094 learned_addr learned my addr 172.21.15.37:0/527533094 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499bfff640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f499c0b7980 0x7f499c14e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a0d3c640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 -- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 msgr2=0x7f499c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 -- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f499c0b7980 msgr2=0x7f499c14e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f499c0b7980 0x7f499c14e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 -- 172.21.15.37:0/527533094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900094d0 con 0x7f499c0cf290 2023-07-09T21:23:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f499b7fe640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f499001a170 tx=0x7f49900192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900aa7b0 con 0x7f499c0cf290 2023-07-09T21:23:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49900aa910 con 0x7f499c0cf290 2023-07-09T21:23:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c156b90 con 0x7f499c0cf290 2023-07-09T21:23:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49900aac80 con 0x7f499c0cf290 2023-07-09T21:23:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c14eec0 con 0x7f499c0cf290 2023-07-09T21:23:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.937+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c156db0 con 0x7f499c0cf290 2023-07-09T21:23:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.941+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f49900acd50 con 0x7f499c0cf290 2023-07-09T21:23:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.941+0000 7f4998ff9640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 0x7f49880685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.941+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f499011ce30 con 0x7f499c0cf290 2023-07-09T21:23:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.941+0000 7f499bfff640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 0x7f49880685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.941+0000 7f499bfff640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 0x7f49880685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f498c000f70 tx=0x7f498c007e50 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:56.945+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49900ea580 con 0x7f499c0cf290 2023-07-09T21:23:57.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.117+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f499c156a20 con 0x7f4988066120 2023-07-09T21:23:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.177+0000 7f4998ff9640 1 -- 172.21.15.37:0/527533094 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f499c156a20 con 0x7f4988066120 2023-07-09T21:23:57.181 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir1 2023-07-09T21:23:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 msgr2=0x7f49880685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 0x7f49880685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f498c000f70 tx=0x7f498c007e50 comp rx=0 tx=0).stop 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 msgr2=0x7f499c1539e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f499001a170 tx=0x7f49900192e0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 shutdown_connections 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4988066120 0x7f49880685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f499c0d0780 0x7f499c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f499c0cf290 0x7f499c1539e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 --2- 172.21.15.37:0/527533094 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f499c0b7980 0x7f499c14e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 >> 172.21.15.37:0/527533094 conn(0x7f499c073090 msgr2=0x7f499c0ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 shutdown_connections 2023-07-09T21:23:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.181+0000 7f49a279f640 1 -- 172.21.15.37:0/527533094 wait complete. 2023-07-09T21:23:57.201 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2023-07-09T21:23:57.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:57.202 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2023-07-09T21:23:57.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir2 1M 2023-07-09T21:23:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 Processor -- start 2023-07-09T21:23:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 -- start start 2023-07-09T21:23:57.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b7980 0x7f0798160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07980ceb80 0x7f07980cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079815bf80 con 0x7f07980b3c20 2023-07-09T21:23:57.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07980cd070 con 0x7f07980ceb80 2023-07-09T21:23:57.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079f511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07980cfd70 con 0x7f07980b7980 2023-07-09T21:23:57.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079caac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07980ceb80 0x7f07980cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079caac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07980ceb80 0x7f07980cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32896/0 (socket says 172.21.15.37:32896) 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.405+0000 7f079caac640 1 -- 172.21.15.37:0/919748599 learned_addr learned my addr 172.21.15.37:0/919748599 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079d2ad640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b7980 0x7f0798160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079caac640 1 -- 172.21.15.37:0/919748599 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b7980 msgr2=0x7f0798160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079caac640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b7980 0x7f0798160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079caac640 1 -- 172.21.15.37:0/919748599 >> v1:172.21.15.119:6789/0 conn(0x7f07980b3c20 legacy=0x7f07980b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079caac640 1 -- 172.21.15.37:0/919748599 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0798160570 con 0x7f07980ceb80 2023-07-09T21:23:57.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079caac640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980ceb80 0x7f07980cef90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0788009870 tx=0x7f078801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c2e22b5c12fd8a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f078ffff640 1 -- 172.21.15.37:0/919748599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880ab600 con 0x7f07980ceb80 2023-07-09T21:23:57.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f078ffff640 1 -- 172.21.15.37:0/919748599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880a7050 con 0x7f07980ceb80 2023-07-09T21:23:57.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f078ffff640 1 -- 172.21.15.37:0/919748599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880ab980 con 0x7f07980ceb80 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079f511640 1 -- 172.21.15.37:0/919748599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980ceb80 msgr2=0x7f07980cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.409+0000 7f079f511640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980ceb80 0x7f07980cef90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0788009870 tx=0x7f078801c540 comp rx=0 tx=0).stop 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- 172.21.15.37:0/919748599 shutdown_connections 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980ceb80 0x7f07980cef90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 --2- 172.21.15.37:0/919748599 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b7980 0x7f0798160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- 172.21.15.37:0/919748599 >> 172.21.15.37:0/919748599 conn(0x7f0798073090 msgr2=0x7f0798069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- 172.21.15.37:0/919748599 shutdown_connections 2023-07-09T21:23:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- 172.21.15.37:0/919748599 wait complete. 2023-07-09T21:23:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 Processor -- start 2023-07-09T21:23:57.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- start start 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b3c20 0x7f07981520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07980ceb80 0x7f079815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0798153460 con 0x7f07980b7980 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079815d3a0 con 0x7f07980ceb80 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079f511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079815cb00 con 0x7f07980b3c20 2023-07-09T21:23:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32908/0 (socket says 172.21.15.37:32908) 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 -- 172.21.15.37:0/2044819947 learned_addr learned my addr 172.21.15.37:0/2044819947 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079d2ad640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b3c20 0x7f07981520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079daae640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07980ceb80 0x7f079815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 -- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b3c20 msgr2=0x7f07981520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b3c20 0x7f07981520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 -- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07980ceb80 msgr2=0x7f079815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07980ceb80 0x7f079815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 -- 172.21.15.37:0/2044819947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07880094d0 con 0x7f07980b7980 2023-07-09T21:23:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.413+0000 7f079caac640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f078801a170 tx=0x7f07880192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880b5850 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880b59b0 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07880b5d40 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f079815cde0 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f079815aa10 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07980737d0 con 0x7f07980b7980 2023-07-09T21:23:57.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f07880b43a0 con 0x7f07980b7980 2023-07-09T21:23:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 0x7f077c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f078811deb0 con 0x7f07980b7980 2023-07-09T21:23:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.417+0000 7f079d2ad640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 0x7f077c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.421+0000 7f079d2ad640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 0x7f077c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07940079c0 tx=0x7f0794008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.421+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f07980737d0 con 0x7f07980b7980 2023-07-09T21:23:57.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.565+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f07880eb890 con 0x7f07980b7980 2023-07-09T21:23:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.597+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f07980ccab0 con 0x7f077c066120 2023-07-09T21:23:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f078dffb640 1 -- 172.21.15.37:0/2044819947 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f07940108d0 con 0x7f077c066120 2023-07-09T21:23:57.662 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir2 2023-07-09T21:23:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 msgr2=0x7f077c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 0x7f077c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f07940079c0 tx=0x7f0794008040 comp rx=0 tx=0).stop 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 msgr2=0x7f0798152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f078801a170 tx=0x7f07880192e0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 shutdown_connections 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f077c066120 0x7f077c0685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07980ceb80 0x7f079815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07980b7980 0x7f0798152f20 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 --2- 172.21.15.37:0/2044819947 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07980b3c20 0x7f07981520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 >> 172.21.15.37:0/2044819947 conn(0x7f0798073090 msgr2=0x7f0798156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 shutdown_connections 2023-07-09T21:23:57.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.661+0000 7f079f511640 1 -- 172.21.15.37:0/2044819947 wait complete. 2023-07-09T21:23:57.683 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2023-07-09T21:23:57.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:57.684 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2023-07-09T21:23:57.696 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir3 1M 2023-07-09T21:23:57.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.881+0000 7f6c2cebd640 1 Processor -- start 2023-07-09T21:23:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.881+0000 7f6c2cebd640 1 -- start start 2023-07-09T21:23:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c2cebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c280c3e10 0x7f6c280c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c2cebd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c2815c200 0x7f6c2815c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c2cebd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c280c47a0 con 0x7f6c281585b0 2023-07-09T21:23:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c2cebd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c280cbf40 con 0x7f6c2815c200 2023-07-09T21:23:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c2cebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280c9090 con 0x7f6c280c3e10 2023-07-09T21:23:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c2815c200 0x7f6c2815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c2815c200 0x7f6c2815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32924/0 (socket says 172.21.15.37:32924) 2023-07-09T21:23:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 -- 172.21.15.37:0/1741292675 learned_addr learned my addr 172.21.15.37:0/1741292675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c1ffff640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c280c3e10 0x7f6c280c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 -- 172.21.15.37:0/1741292675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c280c3e10 msgr2=0x7f6c280c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c280c3e10 0x7f6c280c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 -- 172.21.15.37:0/1741292675 >> v1:172.21.15.119:6789/0 conn(0x7f6c281585b0 legacy=0x7f6c2806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 -- 172.21.15.37:0/1741292675 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2815cbc0 con 0x7f6c2815c200 2023-07-09T21:23:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.885+0000 7f6c26d9d640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2815c200 0x7f6c2815c680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009e50 tx=0x7f6c2001ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af48232c94dc6fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c25d9b640 1 -- 172.21.15.37:0/1741292675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200a7b10 con 0x7f6c2815c200 2023-07-09T21:23:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c25d9b640 1 -- 172.21.15.37:0/1741292675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c200a7c70 con 0x7f6c2815c200 2023-07-09T21:23:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c25d9b640 1 -- 172.21.15.37:0/1741292675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c200af3f0 con 0x7f6c2815c200 2023-07-09T21:23:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- 172.21.15.37:0/1741292675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2815c200 msgr2=0x7f6c2815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2815c200 0x7f6c2815c680 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6c20009e50 tx=0x7f6c2001ec20 comp rx=0 tx=0).stop 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- 172.21.15.37:0/1741292675 shutdown_connections 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c280c3e10 0x7f6c280c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/1741292675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c2815c200 0x7f6c2815c680 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- 172.21.15.37:0/1741292675 >> 172.21.15.37:0/1741292675 conn(0x7f6c280cde40 msgr2=0x7f6c280ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- 172.21.15.37:0/1741292675 shutdown_connections 2023-07-09T21:23:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- 172.21.15.37:0/1741292675 wait complete. 2023-07-09T21:23:57.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 Processor -- start 2023-07-09T21:23:57.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- start start 2023-07-09T21:23:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c280c3e10 0x7f6c2813f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c2815c200 0x7f6c281f74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280ad1d0 con 0x7f6c281585b0 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280acc10 con 0x7f6c280c3e10 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.889+0000 7f6c2cebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c280acef0 con 0x7f6c2815c200 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32926/0 (socket says 172.21.15.37:32926) 2023-07-09T21:23:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 -- 172.21.15.37:0/896719891 learned_addr learned my addr 172.21.15.37:0/896719891 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c2659c640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c280c3e10 0x7f6c2813f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c26d9d640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c2815c200 0x7f6c281f74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 -- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c2815c200 msgr2=0x7f6c281f74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c2815c200 0x7f6c281f74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 -- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c280c3e10 msgr2=0x7f6c2813f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c280c3e10 0x7f6c2813f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 -- 172.21.15.37:0/896719891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c20009b30 con 0x7f6c281585b0 2023-07-09T21:23:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1ffff640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e930 tx=0x7f6c1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c10009690 con 0x7f6c281585b0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1000ca00 con 0x7f6c281585b0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1000cd70 con 0x7f6c281585b0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c280af010 con 0x7f6c281585b0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2813fd40 con 0x7f6c281585b0 2023-07-09T21:23:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2804d7d0 con 0x7f6c281585b0 2023-07-09T21:23:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.893+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f6c10013470 con 0x7f6c281585b0 2023-07-09T21:23:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.897+0000 7f6c1effd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 0x7f6c08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.897+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6c10084230 con 0x7f6c281585b0 2023-07-09T21:23:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.897+0000 7f6c2659c640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 0x7f6c08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:57.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.897+0000 7f6c2659c640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 0x7f6c08068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c18007fd0 tx=0x7f6c18009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:57.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:57.901+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c10051550 con 0x7f6c281585b0 2023-07-09T21:23:58.046 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:23:58.050 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:23:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.073+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c280c8d20 con 0x7f6c080664b0 2023-07-09T21:23:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.141+0000 7f6c1effd640 1 -- 172.21.15.37:0/896719891 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6c180014f0 con 0x7f6c080664b0 2023-07-09T21:23:58.145 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir3 2023-07-09T21:23:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 msgr2=0x7f6c08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 0x7f6c08068960 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6c18007fd0 tx=0x7f6c18009040 comp rx=0 tx=0).stop 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 msgr2=0x7f6c280ac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6c1000e930 tx=0x7f6c1000edf0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 shutdown_connections 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c080664b0 0x7f6c08068960 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c2815c200 0x7f6c281f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c281585b0 0x7f6c280ac270 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 --2- 172.21.15.37:0/896719891 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c280c3e10 0x7f6c2813f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 >> 172.21.15.37:0/896719891 conn(0x7f6c280cde40 msgr2=0x7f6c280cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 shutdown_connections 2023-07-09T21:23:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.145+0000 7f6c2cebd640 1 -- 172.21.15.37:0/896719891 wait complete. 2023-07-09T21:23:58.165 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2023-07-09T21:23:58.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:58.166 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2023-07-09T21:23:58.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir4 1M 2023-07-09T21:23:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.369+0000 7f533247b640 1 Processor -- start 2023-07-09T21:23:58.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.369+0000 7f533247b640 1 -- start start 2023-07-09T21:23:58.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f533247b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f532c1585b0 0x7f532c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f533247b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f532c0c4520 0x7f532c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f533247b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c0c9090 con 0x7f532c06b970 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f533247b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0cbf40 con 0x7f532c1585b0 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f533247b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0c8a60 con 0x7f532c0c4520 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f532c1585b0 0x7f532c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f532c1585b0 0x7f532c06b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32928/0 (socket says 172.21.15.37:32928) 2023-07-09T21:23:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 -- 172.21.15.37:0/3824197838 learned_addr learned my addr 172.21.15.37:0/3824197838 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 -- 172.21.15.37:0/3824197838 >> v2:172.21.15.119:3300/0 conn(0x7f532c0c4520 msgr2=0x7f532c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:58.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 --2- 172.21.15.37:0/3824197838 >> v2:172.21.15.119:3300/0 conn(0x7f532c0c4520 0x7f532c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 -- 172.21.15.37:0/3824197838 >> v1:172.21.15.119:6789/0 conn(0x7f532c06b970 legacy=0x7f532c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:58.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.373+0000 7f532bfff640 1 -- 172.21.15.37:0/3824197838 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c15ce10 con 0x7f532c1585b0 2023-07-09T21:23:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f532bfff640 1 --2- 172.21.15.37:0/3824197838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c1585b0 0x7f532c06b430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f532c06b1b0 tx=0x7f531c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fcf9ed2904b5b48 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f532affd640 1 -- 172.21.15.37:0/3824197838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0aa610 con 0x7f532c1585b0 2023-07-09T21:23:58.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f532affd640 1 -- 172.21.15.37:0/3824197838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0a6040 con 0x7f532c1585b0 2023-07-09T21:23:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f532affd640 1 -- 172.21.15.37:0/3824197838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0aa990 con 0x7f532c1585b0 2023-07-09T21:23:58.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- 172.21.15.37:0/3824197838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c1585b0 msgr2=0x7f532c06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 --2- 172.21.15.37:0/3824197838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c1585b0 0x7f532c06b430 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f532c06b1b0 tx=0x7f531c01c490 comp rx=0 tx=0).stop 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- 172.21.15.37:0/3824197838 shutdown_connections 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 --2- 172.21.15.37:0/3824197838 >> v2:172.21.15.119:3300/0 conn(0x7f532c0c4520 0x7f532c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 --2- 172.21.15.37:0/3824197838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c1585b0 0x7f532c06b430 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- 172.21.15.37:0/3824197838 >> 172.21.15.37:0/3824197838 conn(0x7f532c0cde40 msgr2=0x7f532c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:58.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- 172.21.15.37:0/3824197838 shutdown_connections 2023-07-09T21:23:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- 172.21.15.37:0/3824197838 wait complete. 2023-07-09T21:23:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 Processor -- start 2023-07-09T21:23:58.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.377+0000 7f533247b640 1 -- start start 2023-07-09T21:23:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532c0c4520 0x7f532c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f532c1585b0 0x7f532c14ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c143bb0 con 0x7f532c06b970 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15b800 con 0x7f532c0c4520 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c15abf0 con 0x7f532c1585b0 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32934/0 (socket says 172.21.15.37:32934) 2023-07-09T21:23:58.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 -- 172.21.15.37:0/2591395043 learned_addr learned my addr 172.21.15.37:0/2591395043 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:58.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532b7fe640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532c0c4520 0x7f532c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f5330a18640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f532c1585b0 0x7f532c14ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 -- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f532c1585b0 msgr2=0x7f532c14ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f532c1585b0 0x7f532c14ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 -- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532c0c4520 msgr2=0x7f532c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532c0c4520 0x7f532c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 -- 172.21.15.37:0/2591395043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c0094d0 con 0x7f532c06b970 2023-07-09T21:23:58.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f532bfff640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f531c01a0c0 tx=0x7f531c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b38c0 con 0x7f532c06b970 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c0b3a40 con 0x7f532c06b970 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c0b3df0 con 0x7f532c06b970 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c15aed0 con 0x7f532c06b970 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c15b490 con 0x7f532c06b970 2023-07-09T21:23:58.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.381+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c04d7d0 con 0x7f532c06b970 2023-07-09T21:23:58.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.385+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f531c0b2380 con 0x7f532c06b970 2023-07-09T21:23:58.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.385+0000 7f5328ff9640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 0x7f5318068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.385+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f531c11e980 con 0x7f532c06b970 2023-07-09T21:23:58.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.385+0000 7f532b7fe640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 0x7f5318068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.385+0000 7f532b7fe640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 0x7f5318068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f532c1fbfb0 tx=0x7f5320009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.389+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f531c0ebae0 con 0x7f532c06b970 2023-07-09T21:23:58.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.561+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f532c15d0f0 con 0x7f53180664b0 2023-07-09T21:23:58.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f5328ff9640 1 -- 172.21.15.37:0/2591395043 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5320001490 con 0x7f53180664b0 2023-07-09T21:23:58.634 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir4 2023-07-09T21:23:58.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 msgr2=0x7f5318068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 0x7f5318068960 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f532c1fbfb0 tx=0x7f5320009040 comp rx=0 tx=0).stop 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 msgr2=0x7f532c0aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f531c01a0c0 tx=0x7f531c01acd0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 shutdown_connections 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f53180664b0 0x7f5318068960 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f532c1585b0 0x7f532c14ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f532c0c4520 0x7f532c15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 --2- 172.21.15.37:0/2591395043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f532c06b970 0x7f532c0aef80 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 >> 172.21.15.37:0/2591395043 conn(0x7f532c0cde40 msgr2=0x7f532c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 shutdown_connections 2023-07-09T21:23:58.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.633+0000 7f533247b640 1 -- 172.21.15.37:0/2591395043 wait complete. 2023-07-09T21:23:58.654 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2023-07-09T21:23:58.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:58.655 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2023-07-09T21:23:58.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir5 1M 2023-07-09T21:23:58.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 Processor -- start 2023-07-09T21:23:58.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 -- start start 2023-07-09T21:23:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f797c0b7980 0x7f797c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c15bf80 con 0x7f797c0ceb80 2023-07-09T21:23:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c0cd070 con 0x7f797c0b7980 2023-07-09T21:23:58.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f7980aaa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0cfd70 con 0x7f797c0d0780 2023-07-09T21:23:58.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f797a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f797c0b7980 0x7f797c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f797a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f797c0b7980 0x7f797c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32946/0 (socket says 172.21.15.37:32946) 2023-07-09T21:23:58.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f797a59c640 1 -- 172.21.15.37:0/1424361510 learned_addr learned my addr 172.21.15.37:0/1424361510 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:58.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.853+0000 7f797ad9d640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f797a59c640 1 -- 172.21.15.37:0/1424361510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 msgr2=0x7f797c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:58.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f797a59c640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f797a59c640 1 -- 172.21.15.37:0/1424361510 >> v1:172.21.15.119:6789/0 conn(0x7f797c0ceb80 legacy=0x7f797c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f797a59c640 1 -- 172.21.15.37:0/1424361510 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c160570 con 0x7f797c0b7980 2023-07-09T21:23:58.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f797a59c640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c160030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f33594b4b8ada93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f7979d9b640 1 -- 172.21.15.37:0/1424361510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab600 con 0x7f797c0b7980 2023-07-09T21:23:58.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f7979d9b640 1 -- 172.21.15.37:0/1424361510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796c0a7050 con 0x7f797c0b7980 2023-07-09T21:23:58.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f7979d9b640 1 -- 172.21.15.37:0/1424361510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0ab980 con 0x7f797c0b7980 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f7980aaa640 1 -- 172.21.15.37:0/1424361510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 msgr2=0x7f797c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.857+0000 7f7980aaa640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c160030 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f796c009870 tx=0x7f796c01c540 comp rx=0 tx=0).stop 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- 172.21.15.37:0/1424361510 shutdown_connections 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 --2- 172.21.15.37:0/1424361510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c160030 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- 172.21.15.37:0/1424361510 >> 172.21.15.37:0/1424361510 conn(0x7f797c073090 msgr2=0x7f797c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:58.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- 172.21.15.37:0/1424361510 shutdown_connections 2023-07-09T21:23:58.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- 172.21.15.37:0/1424361510 wait complete. 2023-07-09T21:23:58.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 Processor -- start 2023-07-09T21:23:58.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- start start 2023-07-09T21:23:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f797c0ceb80 0x7f797c0b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0b5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b4120 con 0x7f797c0b7980 2023-07-09T21:23:58.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b4400 con 0x7f797c0ceb80 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7980aaa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c0b46e0 con 0x7f797c0d0780 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32950/0 (socket says 172.21.15.37:32950) 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797a59c640 1 -- 172.21.15.37:0/230381041 learned_addr learned my addr 172.21.15.37:0/230381041 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0b5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f7973fff640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f797c0ceb80 0x7f797c0b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 -- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f797c0ceb80 msgr2=0x7f797c0b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f797c0ceb80 0x7f797c0b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 -- 172.21.15.37:0/230381041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 msgr2=0x7f797c1526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 -- 172.21.15.37:0/230381041 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0094d0 con 0x7f797c0d0780 2023-07-09T21:23:58.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797a59c640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:58.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.861+0000 7f797ad9d640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0b5c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f797400eba0 tx=0x7f797400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400cd20 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400f040 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740146c0 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c0b49c0 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c152c00 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c0c5f10 con 0x7f797c0d0780 2023-07-09T21:23:58.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f7974014820 con 0x7f797c0d0780 2023-07-09T21:23:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 0x7f795c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f7974084f80 con 0x7f797c0d0780 2023-07-09T21:23:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f797a59c640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 0x7f795c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:58.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.865+0000 7f797a59c640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 0x7f795c068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f796c01c580 tx=0x7f796c008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:58.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:58.869+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f797c0c5f10 con 0x7f797c0d0780 2023-07-09T21:23:59.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.041+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f797c0cff80 con 0x7f795c066480 2023-07-09T21:23:59.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7972ffd640 1 -- 172.21.15.37:0/230381041 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f796c0acb20 con 0x7f795c066480 2023-07-09T21:23:59.115 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir5 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 msgr2=0x7f795c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 0x7f795c068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f796c01c580 tx=0x7f796c008040 comp rx=0 tx=0).stop 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 msgr2=0x7f797c0b5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0b5c10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f797400eba0 tx=0x7f797400c490 comp rx=0 tx=0).stop 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 shutdown_connections 2023-07-09T21:23:59.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f795c066480 0x7f795c068930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f797c0d0780 0x7f797c0b5c10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f797c0ceb80 0x7f797c0b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 --2- 172.21.15.37:0/230381041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f797c0b7980 0x7f797c1526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 >> 172.21.15.37:0/230381041 conn(0x7f797c073090 msgr2=0x7f797c15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 shutdown_connections 2023-07-09T21:23:59.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.113+0000 7f7980aaa640 1 -- 172.21.15.37:0/230381041 wait complete. 2023-07-09T21:23:59.136 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2023-07-09T21:23:59.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:59.136 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2023-07-09T21:23:59.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir6 1M 2023-07-09T21:23:59.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 Processor -- start 2023-07-09T21:23:59.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 -- start start 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9480b7980 0x7fe948160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94815bf80 con 0x7fe9480d0780 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe948160570 con 0x7fe9480ceb80 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94c9c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9480cd070 con 0x7fe9480b7980 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe946d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9480d0780 0x7fe9480d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51652/0 (socket says 172.21.15.37:51652) 2023-07-09T21:23:59.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe946d9d640 1 -- 172.21.15.37:0/3286183818 learned_addr learned my addr 172.21.15.37:0/3286183818 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.337+0000 7fe94659c640 1 --2- 172.21.15.37:0/3286183818 >> v2:172.21.15.119:3300/0 conn(0x7fe9480b7980 0x7fe948160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.341+0000 7fe945d9b640 1 -- 172.21.15.37:0/3286183818 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592230553 0 0) 0x7fe9400014a0 con 0x7fe9480d0780 2023-07-09T21:23:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.341+0000 7fe945d9b640 1 -- 172.21.15.37:0/3286183818 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe934003530 con 0x7fe9480d0780 2023-07-09T21:23:59.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.341+0000 7fe94659c640 1 -- 172.21.15.37:0/3286183818 >> v1:172.21.15.119:6789/0 conn(0x7fe9480ceb80 legacy=0x7fe9480cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.341+0000 7fe94659c640 1 -- 172.21.15.37:0/3286183818 >> v1:172.21.15.37:6789/0 conn(0x7fe9480d0780 legacy=0x7fe9480d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.341+0000 7fe94659c640 1 -- 172.21.15.37:0/3286183818 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9480d02f0 con 0x7fe9480b7980 2023-07-09T21:23:59.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94659c640 1 --2- 172.21.15.37:0/3286183818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480b7980 0x7fe948160030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd936ee47ebaf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe945d9b640 1 -- 172.21.15.37:0/3286183818 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380ab600 con 0x7fe9480b7980 2023-07-09T21:23:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe945d9b640 1 -- 172.21.15.37:0/3286183818 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9380a7050 con 0x7fe9480b7980 2023-07-09T21:23:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe945d9b640 1 -- 172.21.15.37:0/3286183818 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380ab980 con 0x7fe9480b7980 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- 172.21.15.37:0/3286183818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480b7980 msgr2=0x7fe948160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/3286183818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480b7980 0x7fe948160030 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe9380097c0 tx=0x7fe93801c480 comp rx=0 tx=0).stop 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- 172.21.15.37:0/3286183818 shutdown_connections 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/3286183818 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480b7980 0x7fe948160030 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- 172.21.15.37:0/3286183818 >> 172.21.15.37:0/3286183818 conn(0x7fe948073090 msgr2=0x7fe948069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:59.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- 172.21.15.37:0/3286183818 shutdown_connections 2023-07-09T21:23:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- 172.21.15.37:0/3286183818 wait complete. 2023-07-09T21:23:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 Processor -- start 2023-07-09T21:23:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.345+0000 7fe94c9c5640 1 -- start start 2023-07-09T21:23:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 0x7fe94814fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 0x7fe9480c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe948150a20 con 0x7fe9480d0780 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9480cc140 con 0x7fe9480ceb80 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9480c5cb0 con 0x7fe9480b7980 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe946d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 0x7fe9480c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe93ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 0x7fe94814fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40504/0 (socket says 172.21.15.37:40504) 2023-07-09T21:23:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 -- 172.21.15.37:0/2464948874 learned_addr learned my addr 172.21.15.37:0/2464948874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 -- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 msgr2=0x7fe94814fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 0x7fe94814fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 -- 172.21.15.37:0/2464948874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 msgr2=0x7fe9480c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 0x7fe9480c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 -- 172.21.15.37:0/2464948874 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe938009420 con 0x7fe9480b7980 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe946d9d640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 0x7fe9480c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe93ffff640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 0x7fe94814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:23:59.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94659c640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9380ae040 tx=0x7fe938019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b4840 con 0x7fe9480b7980 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9380b49c0 con 0x7fe9480b7980 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9380b4d70 con 0x7fe9480b7980 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9480c6270 con 0x7fe9480b7980 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9480b4200 con 0x7fe9480b7980 2023-07-09T21:23:59.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.349+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe94804d7d0 con 0x7fe9480b7980 2023-07-09T21:23:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe9380b2040 con 0x7fe9480b7980 2023-07-09T21:23:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93effd640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 0x7fe928068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe93811ef30 con 0x7fe9480b7980 2023-07-09T21:23:59.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93ffff640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 0x7fe928068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93ffff640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 0x7fe928068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe948167930 tx=0x7fe930009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.353+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe938149700 con 0x7fe9480b7980 2023-07-09T21:23:59.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.525+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9480cff80 con 0x7fe928066480 2023-07-09T21:23:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe93effd640 1 -- 172.21.15.37:0/2464948874 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe9300018e0 con 0x7fe928066480 2023-07-09T21:23:59.595 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir6 2023-07-09T21:23:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 msgr2=0x7fe928068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 0x7fe928068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe948167930 tx=0x7fe930009040 comp rx=0 tx=0).stop 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 msgr2=0x7fe9480cbc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe9380ae040 tx=0x7fe938019220 comp rx=0 tx=0).stop 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 shutdown_connections 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe928066480 0x7fe928068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9480d0780 0x7fe9480c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9480ceb80 0x7fe94814fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 --2- 172.21.15.37:0/2464948874 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9480b7980 0x7fe9480cbc00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 >> 172.21.15.37:0/2464948874 conn(0x7fe948073090 msgr2=0x7fe9480d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 shutdown_connections 2023-07-09T21:23:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.593+0000 7fe94c9c5640 1 -- 172.21.15.37:0/2464948874 wait complete. 2023-07-09T21:23:59.615 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2023-07-09T21:23:59.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:23:59.616 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2023-07-09T21:23:59.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir7 1M 2023-07-09T21:23:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.817+0000 7fa0d7c6d640 1 Processor -- start 2023-07-09T21:23:59.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.817+0000 7fa0d7c6d640 1 -- start start 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d7c6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0d00cf290 0x7fa0d0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d7c6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0d00d0780 0x7fa0d00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d7c6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d015bf80 con 0x7fa0d00b7980 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d7c6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00cd070 con 0x7fa0d00d0780 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d7c6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00cfd70 con 0x7fa0d00cf290 2023-07-09T21:23:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d5a09640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0d00b7980 0x7fa0d00ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51660/0 (socket says 172.21.15.37:51660) 2023-07-09T21:23:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d5a09640 1 -- 172.21.15.37:0/2018569353 learned_addr learned my addr 172.21.15.37:0/2018569353 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:23:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 --2- 172.21.15.37:0/2018569353 >> v2:172.21.15.37:3300/0 conn(0x7fa0d00d0780 0x7fa0d00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d5208640 1 --2- 172.21.15.37:0/2018569353 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00cf290 0x7fa0d0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d4a07640 1 -- 172.21.15.37:0/2018569353 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144728663 0 0) 0x7fa0cc001120 con 0x7fa0d00b7980 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d4a07640 1 -- 172.21.15.37:0/2018569353 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0bc003530 con 0x7fa0d00b7980 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 -- 172.21.15.37:0/2018569353 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00cf290 msgr2=0x7fa0d0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 --2- 172.21.15.37:0/2018569353 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00cf290 0x7fa0d0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 -- 172.21.15.37:0/2018569353 >> v1:172.21.15.37:6789/0 conn(0x7fa0d00b7980 legacy=0x7fa0d00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 -- 172.21.15.37:0/2018569353 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0160570 con 0x7fa0d00d0780 2023-07-09T21:23:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.821+0000 7fa0d620a640 1 --2- 172.21.15.37:0/2018569353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00d0780 0x7fa0d00d0b80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00b4cd0 tx=0x7fa0c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ce5bebd0b0bfad server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d4a07640 1 -- 172.21.15.37:0/2018569353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80a57d0 con 0x7fa0d00d0780 2023-07-09T21:23:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d4a07640 1 -- 172.21.15.37:0/2018569353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a5930 con 0x7fa0d00d0780 2023-07-09T21:23:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d4a07640 1 -- 172.21.15.37:0/2018569353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80a5cc0 con 0x7fa0d00d0780 2023-07-09T21:23:59.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/2018569353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00d0780 msgr2=0x7fa0d00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/2018569353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00d0780 0x7fa0d00d0b80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00b4cd0 tx=0x7fa0c801c910 comp rx=0 tx=0).stop 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/2018569353 shutdown_connections 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/2018569353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00d0780 0x7fa0d00d0b80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/2018569353 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00cf290 0x7fa0d0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/2018569353 >> 172.21.15.37:0/2018569353 conn(0x7fa0d0073090 msgr2=0x7fa0d0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/2018569353 shutdown_connections 2023-07-09T21:23:59.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/2018569353 wait complete. 2023-07-09T21:23:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 Processor -- start 2023-07-09T21:23:59.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- start start 2023-07-09T21:23:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b7980 0x7fa0d0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00d0780 0x7fa0d015cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0152580 con 0x7fa0d00cf290 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00b2b80 con 0x7fa0d00d0780 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d7c6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01561e0 con 0x7fa0d00b7980 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d5208640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.825+0000 7fa0d5208640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:32982/0 (socket says 172.21.15.37:32982) 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 -- 172.21.15.37:0/3999130393 learned_addr learned my addr 172.21.15.37:0/3999130393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:23:59.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d620a640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00d0780 0x7fa0d015cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5a09640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b7980 0x7fa0d0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 -- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b7980 msgr2=0x7fa0d0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b7980 0x7fa0d0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 -- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00d0780 msgr2=0x7fa0d015cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00d0780 0x7fa0d015cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 -- 172.21.15.37:0/3999130393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8009a70 con 0x7fa0d00cf290 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d5208640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e900 tx=0x7fa0c000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0009690 con 0x7fa0d00cf290 2023-07-09T21:23:59.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c000ca00 con 0x7fa0d00cf290 2023-07-09T21:23:59.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d01564c0 con 0x7fa0d00cf290 2023-07-09T21:23:59.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000cdb0 con 0x7fa0d00cf290 2023-07-09T21:23:59.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d0156a80 con 0x7fa0d00cf290 2023-07-09T21:23:59.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d004d7d0 con 0x7fa0d00cf290 2023-07-09T21:23:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa0c0013470 con 0x7fa0d00cf290 2023-07-09T21:23:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.829+0000 7fa0c67fc640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 0x7fa0b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:23:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.833+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fa0c0084310 con 0x7fa0d00cf290 2023-07-09T21:23:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.833+0000 7fa0d5a09640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 0x7fa0b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:23:59.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.833+0000 7fa0d5a09640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 0x7fa0b4068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc001280 tx=0x7fa0cc007bc0 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:23:59.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:23:59.837+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0c00514f0 con 0x7fa0d00cf290 2023-07-09T21:24:00.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.013+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0d0156350 con 0x7fa0b4066480 2023-07-09T21:24:00.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.077+0000 7fa0c67fc640 1 -- 172.21.15.37:0/3999130393 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fa0d0156350 con 0x7fa0b4066480 2023-07-09T21:24:00.080 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir7 2023-07-09T21:24:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 msgr2=0x7fa0b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 0x7fa0b4068930 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc001280 tx=0x7fa0cc007bc0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 msgr2=0x7fa0d015c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000e900 tx=0x7fa0c000edc0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 shutdown_connections 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fa0b4066480 0x7fa0b4068930 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00d0780 0x7fa0d015cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00cf290 0x7fa0d015c710 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 --2- 172.21.15.37:0/3999130393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b7980 0x7fa0d0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 >> 172.21.15.37:0/3999130393 conn(0x7fa0d0073090 msgr2=0x7fa0d00d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 shutdown_connections 2023-07-09T21:24:00.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.081+0000 7fa0d7c6d640 1 -- 172.21.15.37:0/3999130393 wait complete. 2023-07-09T21:24:00.101 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2023-07-09T21:24:00.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:24:00.102 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2023-07-09T21:24:00.114 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir8 1M 2023-07-09T21:24:00.124 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:24:00.121+0000 7f60541f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:24:00.125 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:24:00.121+0000 7f60541f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:24:00.125 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:24:00.121+0000 7f60541f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:24:00.125 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:24:00.121+0000 7f60541f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:24:00.125 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:24:00.121+0000 7f60541f2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:24:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.317+0000 7f982abdb640 1 Processor -- start 2023-07-09T21:24:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 -- start start 2023-07-09T21:24:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98240b76b0 0x7f98240cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98240d0360 0x7f98240cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98240b3bb0 con 0x7f982415f130 2023-07-09T21:24:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98240cccb0 con 0x7f98240b76b0 2023-07-09T21:24:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f982abdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98240d07a0 con 0x7f98240d0360 2023-07-09T21:24:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9823fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98240b76b0 0x7f98240cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9828977640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f982415f130 0x7f98240b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57028/0 (socket says 172.21.15.37:57028) 2023-07-09T21:24:00.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9828977640 1 -- 172.21.15.37:0/4268026134 learned_addr learned my addr 172.21.15.37:0/4268026134 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9829178640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98240d0360 0x7f98240cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9823fff640 1 -- 172.21.15.37:0/4268026134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98240d0360 msgr2=0x7f98240cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9823fff640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98240d0360 0x7f98240cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9823fff640 1 -- 172.21.15.37:0/4268026134 >> v1:172.21.15.119:6789/0 conn(0x7f982415f130 legacy=0x7f98240b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f9823fff640 1 -- 172.21.15.37:0/4268026134 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98240b8100 con 0x7f98240b76b0 2023-07-09T21:24:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.321+0000 7f98237fe640 1 -- 172.21.15.37:0/4268026134 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357609719 0 0) 0x7f98240b3bb0 con 0x7f982415f130 2023-07-09T21:24:00.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f9823fff640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240cfe20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98100097c0 tx=0x7f981001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dacc1a85b36a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f98237fe640 1 -- 172.21.15.37:0/4268026134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100ac620 con 0x7f98240b76b0 2023-07-09T21:24:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f98237fe640 1 -- 172.21.15.37:0/4268026134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98100ac780 con 0x7f98240b76b0 2023-07-09T21:24:00.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f98237fe640 1 -- 172.21.15.37:0/4268026134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98100acb10 con 0x7f98240b76b0 2023-07-09T21:24:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 -- 172.21.15.37:0/4268026134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 msgr2=0x7f98240cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240cfe20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f98100097c0 tx=0x7f981001c3c0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 -- 172.21.15.37:0/4268026134 shutdown_connections 2023-07-09T21:24:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98240d0360 0x7f98240cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 --2- 172.21.15.37:0/4268026134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240cfe20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 -- 172.21.15.37:0/4268026134 >> 172.21.15.37:0/4268026134 conn(0x7f9824072d20 msgr2=0x7f98240d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 -- 172.21.15.37:0/4268026134 shutdown_connections 2023-07-09T21:24:00.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.325+0000 7f982abdb640 1 -- 172.21.15.37:0/4268026134 wait complete. 2023-07-09T21:24:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 Processor -- start 2023-07-09T21:24:00.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- start start 2023-07-09T21:24:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 0x7f982414f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f982415f130 0x7f9824150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9824150ac0 con 0x7f98240b76b0 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982414fc60 con 0x7f98240d0360 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982414fef0 con 0x7f982415f130 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33006/0 (socket says 172.21.15.37:33006) 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 -- 172.21.15.37:0/3927006289 learned_addr learned my addr 172.21.15.37:0/3927006289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9823fff640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 0x7f982414f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9829178640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f982415f130 0x7f9824150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 -- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f982415f130 msgr2=0x7f9824150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f982415f130 0x7f9824150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 -- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 msgr2=0x7f982414f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 0x7f982414f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 -- 172.21.15.37:0/3927006289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810009420 con 0x7f98240b76b0 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9823fff640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 0x7f982414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f9828977640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f981800c580 tx=0x7f981800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818005cf0 con 0x7f98240b76b0 2023-07-09T21:24:00.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9818005e70 con 0x7f98240b76b0 2023-07-09T21:24:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9818007310 con 0x7f98240b76b0 2023-07-09T21:24:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9824150190 con 0x7f98240b76b0 2023-07-09T21:24:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9824150750 con 0x7f98240b76b0 2023-07-09T21:24:00.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.329+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98240cc920 con 0x7f98240b76b0 2023-07-09T21:24:00.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.333+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f9818007470 con 0x7f98240b76b0 2023-07-09T21:24:00.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.333+0000 7f98217fa640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 0x7f9808068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.333+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f9818083730 con 0x7f98240b76b0 2023-07-09T21:24:00.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.333+0000 7f9823fff640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 0x7f9808068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.333+0000 7f9823fff640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 0x7f9808068960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae000 tx=0x7f9810008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.337+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98240cc920 con 0x7f98240b76b0 2023-07-09T21:24:00.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.509+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f98240b7e20 con 0x7f98080664b0 2023-07-09T21:24:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.569+0000 7f98217fa640 1 -- 172.21.15.37:0/3927006289 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f98100acca0 con 0x7f98080664b0 2023-07-09T21:24:00.573 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir8 2023-07-09T21:24:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 msgr2=0x7f9808068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 0x7f9808068960 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f98100ae000 tx=0x7f9810008040 comp rx=0 tx=0).stop 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 msgr2=0x7f98240c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f981800c580 tx=0x7f981800ca40 comp rx=0 tx=0).stop 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 shutdown_connections 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f98080664b0 0x7f9808068960 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f982415f130 0x7f9824150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98240d0360 0x7f982414f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 --2- 172.21.15.37:0/3927006289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98240b76b0 0x7f98240c6260 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 >> 172.21.15.37:0/3927006289 conn(0x7f9824072d20 msgr2=0x7f982406a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 shutdown_connections 2023-07-09T21:24:00.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.573+0000 7f982abdb640 1 -- 172.21.15.37:0/3927006289 wait complete. 2023-07-09T21:24:00.593 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2023-07-09T21:24:00.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:24:00.594 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2023-07-09T21:24:00.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/dir9 1M 2023-07-09T21:24:00.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.809+0000 7fe4d74d8640 1 Processor -- start 2023-07-09T21:24:00.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 -- start start 2023-07-09T21:24:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00b7980 0x7fe4d0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4d015bf80 con 0x7fe4d00b3c20 2023-07-09T21:24:00.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4d00cd070 con 0x7fe4d00b7980 2023-07-09T21:24:00.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d74d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d00cfd70 con 0x7fe4d00ceb80 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00b7980 0x7fe4d0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d4a73640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d4a73640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40530/0 (socket says 172.21.15.37:40530) 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4d00b7980 0x7fe4d0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33010/0 (socket says 172.21.15.37:33010) 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d4a73640 1 -- 172.21.15.37:0/1979679688 learned_addr learned my addr 172.21.15.37:0/1979679688 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:00.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5a75640 1 --1- 172.21.15.37:0/1979679688 >> v1:172.21.15.119:6789/0 conn(0x7fe4d00b3c20 0x7fe4d00b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57032/0 (socket says 172.21.15.37:57032) 2023-07-09T21:24:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 -- 172.21.15.37:0/1979679688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 msgr2=0x7fe4d00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 -- 172.21.15.37:0/1979679688 >> v1:172.21.15.119:6789/0 conn(0x7fe4d00b3c20 legacy=0x7fe4d00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d5274640 1 -- 172.21.15.37:0/1979679688 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0160570 con 0x7fe4d00b7980 2023-07-09T21:24:00.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.813+0000 7fe4d4a73640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:00.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d5274640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0160030 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e22b74459f9170 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4c7fff640 1 -- 172.21.15.37:0/1979679688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0ab600 con 0x7fe4d00b7980 2023-07-09T21:24:00.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4c7fff640 1 -- 172.21.15.37:0/1979679688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4cc0a7050 con 0x7fe4d00b7980 2023-07-09T21:24:00.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4c7fff640 1 -- 172.21.15.37:0/1979679688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4cc0ab980 con 0x7fe4d00b7980 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 -- 172.21.15.37:0/1979679688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 msgr2=0x7fe4d0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0160030 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0097c0 tx=0x7fe4cc01c480 comp rx=0 tx=0).stop 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 -- 172.21.15.37:0/1979679688 shutdown_connections 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/1979679688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0160030 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 -- 172.21.15.37:0/1979679688 >> 172.21.15.37:0/1979679688 conn(0x7fe4d0073090 msgr2=0x7fe4d0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 -- 172.21.15.37:0/1979679688 shutdown_connections 2023-07-09T21:24:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.817+0000 7fe4d74d8640 1 -- 172.21.15.37:0/1979679688 wait complete. 2023-07-09T21:24:00.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 Processor -- start 2023-07-09T21:24:00.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- start start 2023-07-09T21:24:00.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00b3c20 0x7fe4d015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d015c120 con 0x7fe4d00b7980 2023-07-09T21:24:00.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d015c400 con 0x7fe4d00b3c20 2023-07-09T21:24:00.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d015c6e0 con 0x7fe4d00ceb80 2023-07-09T21:24:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d5a75640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33020/0 (socket says 172.21.15.37:33020) 2023-07-09T21:24:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 -- 172.21.15.37:0/2539494579 learned_addr learned my addr 172.21.15.37:0/2539494579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:00.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d5274640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00b3c20 0x7fe4d015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 -- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 msgr2=0x7fe4d00c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 -- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00b3c20 msgr2=0x7fe4d015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00b3c20 0x7fe4d015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:00.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 -- 172.21.15.37:0/2539494579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c00094d0 con 0x7fe4d00b7980 2023-07-09T21:24:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d4a73640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000e9d0 tx=0x7fe4c000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000ca60 con 0x7fe4d00b7980 2023-07-09T21:24:00.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000cbc0 con 0x7fe4d00b7980 2023-07-09T21:24:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc009420 con 0x7fe4d00b7980 2023-07-09T21:24:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0013470 con 0x7fe4d00b7980 2023-07-09T21:24:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.821+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d015cca0 con 0x7fe4d00b7980 2023-07-09T21:24:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.825+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4d004d7d0 con 0x7fe4d00b7980 2023-07-09T21:24:00.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.825+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe4c00135d0 con 0x7fe4d00b7980 2023-07-09T21:24:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.825+0000 7fe4c5ffb640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 0x7fe4b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.825+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fe4c0084410 con 0x7fe4d00b7980 2023-07-09T21:24:00.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.825+0000 7fe4d5274640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 0x7fe4b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.829+0000 7fe4d5274640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 0x7fe4b4068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0ad000 tx=0x7fe4cc008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:00.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:00.829+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4c00515f0 con 0x7fe4d00b7980 2023-07-09T21:24:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.009+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4d015c570 con 0x7fe4b4066480 2023-07-09T21:24:01.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.069+0000 7fe4c5ffb640 1 -- 172.21.15.37:0/2539494579 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fe4d015c570 con 0x7fe4b4066480 2023-07-09T21:24:01.073 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/dir9 2023-07-09T21:24:01.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 msgr2=0x7fe4b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 0x7fe4b4068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc0ad000 tx=0x7fe4cc008040 comp rx=0 tx=0).stop 2023-07-09T21:24:01.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 msgr2=0x7fe4d0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000e9d0 tx=0x7fe4c000ee90 comp rx=0 tx=0).stop 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 shutdown_connections 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe4b4066480 0x7fe4b4068930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4d00ceb80 0x7fe4d00c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4d00b7980 0x7fe4d0154160 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 --2- 172.21.15.37:0/2539494579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4d00b3c20 0x7fe4d015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 >> 172.21.15.37:0/2539494579 conn(0x7fe4d0073090 msgr2=0x7fe4d00b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:01.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 shutdown_connections 2023-07-09T21:24:01.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.073+0000 7fe4d74d8640 1 -- 172.21.15.37:0/2539494579 wait complete. 2023-07-09T21:24:01.094 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2023-07-09T21:24:01.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-09T21:24:01.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 Processor -- start 2023-07-09T21:24:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 -- start start 2023-07-09T21:24:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f7044160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70440d0780 0x7f70440d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f704415bf80 con 0x7f70440b7980 2023-07-09T21:24:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70440cd070 con 0x7f70440d0780 2023-07-09T21:24:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f704affa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440cfd70 con 0x7f70440cf290 2023-07-09T21:24:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f7049597640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70440d0780 0x7f70440d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f7048d96640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f70440b7980 0x7f70440ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57036/0 (socket says 172.21.15.37:57036) 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f7048d96640 1 -- 172.21.15.37:0/1593885119 learned_addr learned my addr 172.21.15.37:0/1593885119 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.241+0000 7f7043fff640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f7044160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f70437fe640 1 -- 172.21.15.37:0/1593885119 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422892394 0 0) 0x7f7038001120 con 0x7f70440b7980 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f70437fe640 1 -- 172.21.15.37:0/1593885119 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7034003530 con 0x7f70440b7980 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7049597640 1 -- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 msgr2=0x7f7044160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7049597640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f7044160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7049597640 1 -- 172.21.15.37:0/1593885119 >> v1:172.21.15.119:6789/0 conn(0x7f70440b7980 legacy=0x7f70440ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7049597640 1 -- 172.21.15.37:0/1593885119 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044160570 con 0x7f70440d0780 2023-07-09T21:24:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7043fff640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f7044160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f7049597640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440d0c00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d90 tx=0x7f703c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabb92f4166eb6f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f70437fe640 1 -- 172.21.15.37:0/1593885119 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a5810 con 0x7f70440d0780 2023-07-09T21:24:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f70437fe640 1 -- 172.21.15.37:0/1593885119 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703c0a5970 con 0x7f70440d0780 2023-07-09T21:24:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f70437fe640 1 -- 172.21.15.37:0/1593885119 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c0a5d00 con 0x7f70440d0780 2023-07-09T21:24:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f704affa640 1 -- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 msgr2=0x7f70440d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f704affa640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440d0c00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f703c009d90 tx=0x7f703c01c950 comp rx=0 tx=0).stop 2023-07-09T21:24:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.245+0000 7f704affa640 1 -- 172.21.15.37:0/1593885119 shutdown_connections 2023-07-09T21:24:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440d0c00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 --2- 172.21.15.37:0/1593885119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f7044160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- 172.21.15.37:0/1593885119 >> 172.21.15.37:0/1593885119 conn(0x7f7044073090 msgr2=0x7f7044069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- 172.21.15.37:0/1593885119 shutdown_connections 2023-07-09T21:24:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- 172.21.15.37:0/1593885119 wait complete. 2023-07-09T21:24:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 Processor -- start 2023-07-09T21:24:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- start start 2023-07-09T21:24:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f70440b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70441551c0 con 0x7f70440b7980 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70440cbac0 con 0x7f70440d0780 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f704affa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70440cbda0 con 0x7f70440cf290 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33028/0 (socket says 172.21.15.37:33028) 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 -- 172.21.15.37:0/1228801597 learned_addr learned my addr 172.21.15.37:0/1228801597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7043fff640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f70440b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7049597640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 -- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 msgr2=0x7f70440b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f70440b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 -- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 msgr2=0x7f70440b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 -- 172.21.15.37:0/1228801597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009420 con 0x7f70440b7980 2023-07-09T21:24:01.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.249+0000 7f7048d96640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f703800c4d0 tx=0x7f703800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038005cf0 con 0x7f70440b7980 2023-07-09T21:24:01.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7038005e50 con 0x7f70440b7980 2023-07-09T21:24:01.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7038007290 con 0x7f70440b7980 2023-07-09T21:24:01.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703c009a70 con 0x7f70440b7980 2023-07-09T21:24:01.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70440cc080 con 0x7f70440b7980 2023-07-09T21:24:01.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704404d7d0 con 0x7f70440b7980 2023-07-09T21:24:01.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f70380073f0 con 0x7f70440b7980 2023-07-09T21:24:01.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 0x7f7028068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f7038083520 con 0x7f70440b7980 2023-07-09T21:24:01.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f7043fff640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 0x7f7028068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.253+0000 7f7043fff640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 0x7f7028068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70440c8890 tx=0x7f7030009190 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.257+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7038050780 con 0x7f70440b7980 2023-07-09T21:24:01.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.433+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f70440cff80 con 0x7f7028066480 2023-07-09T21:24:01.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f70417fa640 1 -- 172.21.15.37:0/1228801597 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f7030009940 con 0x7f7028066480 2023-07-09T21:24:01.482 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir0 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 msgr2=0x7f7028068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 0x7f7028068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70440c8890 tx=0x7f7030009190 comp rx=0 tx=0).stop 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 msgr2=0x7f70441505f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f703800c4d0 tx=0x7f703800c990 comp rx=0 tx=0).stop 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 shutdown_connections 2023-07-09T21:24:01.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7028066480 0x7f7028068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70440d0780 0x7f70440b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70440cf290 0x7f70440b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 --2- 172.21.15.37:0/1228801597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70440b7980 0x7f70441505f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 >> 172.21.15.37:0/1228801597 conn(0x7f7044073090 msgr2=0x7f704415c620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 shutdown_connections 2023-07-09T21:24:01.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.481+0000 7f704affa640 1 -- 172.21.15.37:0/1228801597 wait complete. 2023-07-09T21:24:01.503 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2023-07-09T21:24:01.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-09T21:24:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 Processor -- start 2023-07-09T21:24:01.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 -- start start 2023-07-09T21:24:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 0x7f6c34160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c340d0780 0x7f6c340d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3415bf80 con 0x7f6c340ceb80 2023-07-09T21:24:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340cd070 con 0x7f6c340d0780 2023-07-09T21:24:01.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c39911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340cfd70 con 0x7f6c340b7980 2023-07-09T21:24:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c340d0780 0x7f6c340d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c340d0780 0x7f6c340d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33044/0 (socket says 172.21.15.37:33044) 2023-07-09T21:24:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.649+0000 7f6c337fe640 1 -- 172.21.15.37:0/1750678789 learned_addr learned my addr 172.21.15.37:0/1750678789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:01.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c32ffd640 1 --2- 172.21.15.37:0/1750678789 >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 0x7f6c34160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c337fe640 1 -- 172.21.15.37:0/1750678789 >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 msgr2=0x7f6c34160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c337fe640 1 --2- 172.21.15.37:0/1750678789 >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 0x7f6c34160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c337fe640 1 -- 172.21.15.37:0/1750678789 >> v1:172.21.15.119:6789/0 conn(0x7f6c340ceb80 legacy=0x7f6c340cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c337fe640 1 -- 172.21.15.37:0/1750678789 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34160570 con 0x7f6c340d0780 2023-07-09T21:24:01.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c32ffd640 1 --2- 172.21.15.37:0/1750678789 >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 0x7f6c34160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:24:01.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c337fe640 1 --2- 172.21.15.37:0/1750678789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c340d0b80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c34069aa0 tx=0x7f6c2c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7a061b8c6938ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c327fc640 1 -- 172.21.15.37:0/1750678789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0a5690 con 0x7f6c340d0780 2023-07-09T21:24:01.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c327fc640 1 -- 172.21.15.37:0/1750678789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0a57f0 con 0x7f6c340d0780 2023-07-09T21:24:01.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c327fc640 1 -- 172.21.15.37:0/1750678789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0a5b80 con 0x7f6c340d0780 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c39911640 1 -- 172.21.15.37:0/1750678789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 msgr2=0x7f6c340d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.653+0000 7f6c39911640 1 --2- 172.21.15.37:0/1750678789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c340d0b80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c34069aa0 tx=0x7f6c2c01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- 172.21.15.37:0/1750678789 shutdown_connections 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 --2- 172.21.15.37:0/1750678789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c340d0b80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 --2- 172.21.15.37:0/1750678789 >> v2:172.21.15.119:3300/0 conn(0x7f6c340b7980 0x7f6c34160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- 172.21.15.37:0/1750678789 >> 172.21.15.37:0/1750678789 conn(0x7f6c34073090 msgr2=0x7f6c34069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- 172.21.15.37:0/1750678789 shutdown_connections 2023-07-09T21:24:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- 172.21.15.37:0/1750678789 wait complete. 2023-07-09T21:24:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 Processor -- start 2023-07-09T21:24:01.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- start start 2023-07-09T21:24:01.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c340b7980 0x7f6c340b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c340ceb80 0x7f6c34152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340b2040 con 0x7f6c340d0780 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415b6d0 con 0x7f6c340ceb80 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c39911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340b1ca0 con 0x7f6c340b7980 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2023-07-09T21:24:01.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 -- 172.21.15.37:0/1812220823 learned_addr learned my addr 172.21.15.37:0/1812220823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c2bfff640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c340ceb80 0x7f6c34152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c32ffd640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c340b7980 0x7f6c340b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 -- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c340b7980 msgr2=0x7f6c340b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c340b7980 0x7f6c340b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 -- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c340ceb80 msgr2=0x7f6c34152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c340ceb80 0x7f6c34152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 -- 172.21.15.37:0/1812220823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009b30 con 0x7f6c340d0780 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.657+0000 7f6c337fe640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c01a600 tx=0x7f6c2c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0b8880 con 0x7f6c340d0780 2023-07-09T21:24:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c0b8a00 con 0x7f6c340d0780 2023-07-09T21:24:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0b8db0 con 0x7f6c340d0780 2023-07-09T21:24:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c3415b920 con 0x7f6c340d0780 2023-07-09T21:24:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340b29a0 con 0x7f6c340d0780 2023-07-09T21:24:01.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c340b2180 con 0x7f6c340d0780 2023-07-09T21:24:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f6c2c0c3460 con 0x7f6c340d0780 2023-07-09T21:24:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 0x7f6c14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6c2c11f720 con 0x7f6c340d0780 2023-07-09T21:24:01.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.661+0000 7f6c32ffd640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 0x7f6c14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:01.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.665+0000 7f6c32ffd640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 0x7f6c14068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c3415c200 tx=0x7f6c24008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:01.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.665+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6c340b2180 con 0x7f6c340d0780 2023-07-09T21:24:01.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.825+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f6c2c0ece10 con 0x7f6c340d0780 2023-07-09T21:24:01.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.841+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c340cff80 con 0x7f6c14066480 2023-07-09T21:24:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c30ff9640 1 -- 172.21.15.37:0/1812220823 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6c240108a0 con 0x7f6c14066480 2023-07-09T21:24:01.890 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir1 2023-07-09T21:24:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 msgr2=0x7f6c14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 0x7f6c14068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c3415c200 tx=0x7f6c24008040 comp rx=0 tx=0).stop 2023-07-09T21:24:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 msgr2=0x7f6c341504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c01a600 tx=0x7f6c2c019770 comp rx=0 tx=0).stop 2023-07-09T21:24:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 shutdown_connections 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6c14066480 0x7f6c14068930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c340d0780 0x7f6c341504e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6c340ceb80 0x7f6c34152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 --2- 172.21.15.37:0/1812220823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6c340b7980 0x7f6c340b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 >> 172.21.15.37:0/1812220823 conn(0x7f6c34073090 msgr2=0x7f6c341586c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 shutdown_connections 2023-07-09T21:24:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:01.889+0000 7f6c39911640 1 -- 172.21.15.37:0/1812220823 wait complete. 2023-07-09T21:24:01.910 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2023-07-09T21:24:01.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-09T21:24:02.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 Processor -- start 2023-07-09T21:24:02.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 -- start start 2023-07-09T21:24:02.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f47240d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f472415bf80 con 0x7f47240b7980 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47240d02f0 con 0x7f47240cf290 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472c374640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cd070 con 0x7f4724160030 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472a110640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f47240b7980 0x7f47240ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51664/0 (socket says 172.21.15.37:51664) 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472a110640 1 -- 172.21.15.37:0/1280599289 learned_addr learned my addr 172.21.15.37:0/1280599289 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043529185 0 0) 0x7f4720001120 con 0x7f47240b7980 2023-07-09T21:24:02.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472a911640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f47240d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4710003530 con 0x7f47240b7980 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1560480840 0 0) 0x7f4710003530 con 0x7f47240b7980 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 msgr2=0x7f47240d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f47240d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 >> v1:172.21.15.119:6789/0 conn(0x7f47240cf290 legacy=0x7f47240d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240cc7f0 con 0x7f47240b7980 2023-07-09T21:24:02.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f4720001810 con 0x7f47240b7980 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 >> v1:172.21.15.37:6789/0 conn(0x7f47240b7980 legacy=0x7f47240ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47100039b0 0x7f4710003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4710004350 0x7f4710004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f4710005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cd070 con 0x7f4710004350 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471000b990 con 0x7f47100039b0 2023-07-09T21:24:02.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.057+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471000bb20 con 0x7f4724160030 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4710004350 0x7f4710004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472a110640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47100039b0 0x7f4710003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472a911640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f4710005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 -- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 msgr2=0x7f4710005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4724160030 0x7f4710005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 -- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47100039b0 msgr2=0x7f4710003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47100039b0 0x7f4710003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 -- 172.21.15.37:0/1280599289 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4710003530 con 0x7f4710004350 2023-07-09T21:24:02.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472990f640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4710004350 0x7f4710004810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47240cf6b0 tx=0x7f471401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe533a7f9b4b15 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140a88b0 con 0x7f4710004350 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47140a8a30 con 0x7f4710004350 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.061+0000 7f472910e640 1 -- 172.21.15.37:0/1280599289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140a8de0 con 0x7f4710004350 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- 172.21.15.37:0/1280599289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4710004350 msgr2=0x7f4710004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 --2- 172.21.15.37:0/1280599289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4710004350 0x7f4710004810 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47240cf6b0 tx=0x7f471401ec90 comp rx=0 tx=0).stop 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 -- 172.21.15.37:0/1280599289 reap_dead start 2023-07-09T21:24:02.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- 172.21.15.37:0/1280599289 shutdown_connections 2023-07-09T21:24:02.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- 172.21.15.37:0/1280599289 >> 172.21.15.37:0/1280599289 conn(0x7f4724073090 msgr2=0x7f4724069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:02.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- 172.21.15.37:0/1280599289 shutdown_connections 2023-07-09T21:24:02.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- 172.21.15.37:0/1280599289 wait complete. 2023-07-09T21:24:02.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 Processor -- start 2023-07-09T21:24:02.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- start start 2023-07-09T21:24:02.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4710004350 0x7f47241501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 0x7f47240c6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4724150700 con 0x7f47240cb4f0 2023-07-09T21:24:02.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47240cbea0 con 0x7f47240c6830 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472c374640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47240ca000 con 0x7f4710004350 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472990f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 0x7f47240c6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33074/0 (socket says 172.21.15.37:33074) 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a110640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4710004350 0x7f47241501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 -- 172.21.15.37:0/3938363763 learned_addr learned my addr 172.21.15.37:0/3938363763 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 -- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4710004350 msgr2=0x7f47241501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4710004350 0x7f47241501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 -- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 msgr2=0x7f47240c6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 0x7f47240c6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472a911640 1 -- 172.21.15.37:0/3938363763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47240c93f0 con 0x7f47240cb4f0 2023-07-09T21:24:02.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.065+0000 7f472990f640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 0x7f47240c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f472a911640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47240cd370 tx=0x7f471c011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c00e040 con 0x7f47240cb4f0 2023-07-09T21:24:02.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47240c96d0 con 0x7f47240cb4f0 2023-07-09T21:24:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c00f040 con 0x7f47240cb4f0 2023-07-09T21:24:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c015b60 con 0x7f47240cb4f0 2023-07-09T21:24:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47240c9c90 con 0x7f47240cb4f0 2023-07-09T21:24:02.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f472404d7d0 con 0x7f47240cb4f0 2023-07-09T21:24:02.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f471c015cc0 con 0x7f47240cb4f0 2023-07-09T21:24:02.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 0x7f47080689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f471c0845f0 con 0x7f47240cb4f0 2023-07-09T21:24:02.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.069+0000 7f472a110640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 0x7f47080689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.073+0000 7f472a110640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 0x7f47080689c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47200013a0 tx=0x7f4720000f90 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.073+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f471c054fd0 con 0x7f47240cb4f0 2023-07-09T21:24:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.252+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f47240ccd90 con 0x7f4708066510 2023-07-09T21:24:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f471affd640 1 -- 172.21.15.37:0/3938363763 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f4720007730 con 0x7f4708066510 2023-07-09T21:24:02.302 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir2 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 msgr2=0x7f47080689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 0x7f47080689c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f47200013a0 tx=0x7f4720000f90 comp rx=0 tx=0).stop 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 msgr2=0x7f47240cb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47240cd370 tx=0x7f471c011d40 comp rx=0 tx=0).stop 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 shutdown_connections 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f4708066510 0x7f47080689c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47240cb4f0 0x7f47240cb960 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47240c6830 0x7f47240c6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 --2- 172.21.15.37:0/3938363763 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4710004350 0x7f47241501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 >> 172.21.15.37:0/3938363763 conn(0x7f4724073090 msgr2=0x7f472415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 shutdown_connections 2023-07-09T21:24:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.300+0000 7f472c374640 1 -- 172.21.15.37:0/3938363763 wait complete. 2023-07-09T21:24:02.323 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2023-07-09T21:24:02.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-09T21:24:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 Processor -- start 2023-07-09T21:24:02.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 -- start start 2023-07-09T21:24:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06900b1420 0x7f06900af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 0x7f06900afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06900ce080 con 0x7f06900cfb40 2023-07-09T21:24:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900ce640 con 0x7f06900b0ed0 2023-07-09T21:24:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f0694bf4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900ce360 con 0x7f06900b1420 2023-07-09T21:24:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06900cfb40 0x7f06900cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51666/0 (socket says 172.21.15.37:51666) 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068f7fe640 1 -- 172.21.15.37:0/4220647554 learned_addr learned my addr 172.21.15.37:0/4220647554 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068ffff640 1 --2- 172.21.15.37:0/4220647554 >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 0x7f06900afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068effd640 1 --2- 172.21.15.37:0/4220647554 >> v2:172.21.15.119:3300/0 conn(0x7f06900b1420 0x7f06900af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068e7fc640 1 -- 172.21.15.37:0/4220647554 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306831851 0 0) 0x7f06900ce080 con 0x7f06900cfb40 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068e7fc640 1 -- 172.21.15.37:0/4220647554 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0678003530 con 0x7f06900cfb40 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068effd640 1 -- 172.21.15.37:0/4220647554 >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 msgr2=0x7f06900afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068effd640 1 --2- 172.21.15.37:0/4220647554 >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 0x7f06900afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068effd640 1 -- 172.21.15.37:0/4220647554 >> v1:172.21.15.37:6789/0 conn(0x7f06900cfb40 legacy=0x7f06900cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068effd640 1 -- 172.21.15.37:0/4220647554 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06900aed30 con 0x7f06900b1420 2023-07-09T21:24:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.468+0000 7f068ffff640 1 --2- 172.21.15.37:0/4220647554 >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 0x7f06900afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f068effd640 1 --2- 172.21.15.37:0/4220647554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f06900af530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f06900716f0 tx=0x7f068401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b0bebeecb2f989c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f068e7fc640 1 -- 172.21.15.37:0/4220647554 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840ab5f0 con 0x7f06900b1420 2023-07-09T21:24:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f068e7fc640 1 -- 172.21.15.37:0/4220647554 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06840ab750 con 0x7f06900b1420 2023-07-09T21:24:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f068e7fc640 1 -- 172.21.15.37:0/4220647554 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06840abac0 con 0x7f06900b1420 2023-07-09T21:24:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 -- 172.21.15.37:0/4220647554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 msgr2=0x7f06900af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 --2- 172.21.15.37:0/4220647554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f06900af530 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f06900716f0 tx=0x7f068401c430 comp rx=0 tx=0).stop 2023-07-09T21:24:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 -- 172.21.15.37:0/4220647554 shutdown_connections 2023-07-09T21:24:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 --2- 172.21.15.37:0/4220647554 >> v2:172.21.15.37:3300/0 conn(0x7f06900b0ed0 0x7f06900afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 --2- 172.21.15.37:0/4220647554 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f06900af530 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 -- 172.21.15.37:0/4220647554 >> 172.21.15.37:0/4220647554 conn(0x7f0690072d20 msgr2=0x7f06900d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 -- 172.21.15.37:0/4220647554 shutdown_connections 2023-07-09T21:24:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.472+0000 7f0694bf4640 1 -- 172.21.15.37:0/4220647554 wait complete. 2023-07-09T21:24:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 Processor -- start 2023-07-09T21:24:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- start start 2023-07-09T21:24:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f0690154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06900cfb40 0x7f0690154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069014bff0 con 0x7f06900b0ed0 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0690154d30 con 0x7f06900b1420 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0690155010 con 0x7f06900cfb40 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33092/0 (socket says 172.21.15.37:33092) 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 -- 172.21.15.37:0/1861881903 learned_addr learned my addr 172.21.15.37:0/1861881903 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068ffff640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06900cfb40 0x7f0690154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068effd640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f0690154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 -- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06900cfb40 msgr2=0x7f0690154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06900cfb40 0x7f0690154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 -- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 msgr2=0x7f0690154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f0690154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 -- 172.21.15.37:0/1861881903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688009a70 con 0x7f06900b0ed0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f068f7fe640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f068000c3c0 tx=0x7f068000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0680005db0 con 0x7f06900b0ed0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800070d0 con 0x7f06900b0ed0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0684009420 con 0x7f06900b0ed0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06800074a0 con 0x7f06900b0ed0 2023-07-09T21:24:02.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.476+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069014bc80 con 0x7f06900b0ed0 2023-07-09T21:24:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069014b800 con 0x7f06900b0ed0 2023-07-09T21:24:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f0680007600 con 0x7f06900b0ed0 2023-07-09T21:24:02.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f0677fff640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 0x7f067c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f06800837b0 con 0x7f06900b0ed0 2023-07-09T21:24:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f068effd640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 0x7f067c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.480+0000 7f068effd640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 0x7f067c0689f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06840af000 tx=0x7f06840a7000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.484+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f069014b800 con 0x7f06900b0ed0 2023-07-09T21:24:02.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.660+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f06901683f0 con 0x7f067c066540 2023-07-09T21:24:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.704+0000 7f0677fff640 1 -- 172.21.15.37:0/1861881903 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f06840ab3f0 con 0x7f067c066540 2023-07-09T21:24:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir3 2023-07-09T21:24:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 msgr2=0x7f067c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 0x7f067c0689f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f06840af000 tx=0x7f06840a7000 comp rx=0 tx=0).stop 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 msgr2=0x7f06900c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f068000c3c0 tx=0x7f068000c7c0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 shutdown_connections 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f067c066540 0x7f067c0689f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06900cfb40 0x7f0690154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06900b1420 0x7f0690154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 --2- 172.21.15.37:0/1861881903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06900b0ed0 0x7f06900c4ea0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 >> 172.21.15.37:0/1861881903 conn(0x7f0690072d20 msgr2=0x7f069015d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:02.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 shutdown_connections 2023-07-09T21:24:02.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.708+0000 7f0694bf4640 1 -- 172.21.15.37:0/1861881903 wait complete. 2023-07-09T21:24:02.729 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2023-07-09T21:24:02.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-09T21:24:02.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.872+0000 7f8703740640 1 Processor -- start 2023-07-09T21:24:02.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.872+0000 7f8703740640 1 -- start start 2023-07-09T21:24:02.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8703740640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86fc0cf290 0x7f86fc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8703740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0d0780 0x7f86fc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8703740640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc15bf80 con 0x7f86fc0b7980 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8703740640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cd070 con 0x7f86fc0cf290 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8703740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0cfd70 con 0x7f86fc0d0780 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8700cdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86fc0cf290 0x7f86fc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f87014dc640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f86fc0b7980 0x7f86fc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57060/0 (socket says 172.21.15.37:57060) 2023-07-09T21:24:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f87014dc640 1 -- 172.21.15.37:0/2351543394 learned_addr learned my addr 172.21.15.37:0/2351543394 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8701cdd640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0d0780 0x7f86fc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8700cdb640 1 -- 172.21.15.37:0/2351543394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0d0780 msgr2=0x7f86fc0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8700cdb640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0d0780 0x7f86fc0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8700cdb640 1 -- 172.21.15.37:0/2351543394 >> v1:172.21.15.119:6789/0 conn(0x7f86fc0b7980 legacy=0x7f86fc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f8700cdb640 1 -- 172.21.15.37:0/2351543394 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc160570 con 0x7f86fc0cf290 2023-07-09T21:24:02.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.876+0000 7f86f3fff640 1 -- 172.21.15.37:0/2351543394 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3548791972 0 0) 0x7f86f8001120 con 0x7f86fc0b7980 2023-07-09T21:24:02.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8700cdb640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0cf290 0x7f86fc160030 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097c0 tx=0x7f86ec01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b46f193f820b9120 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f86f3fff640 1 -- 172.21.15.37:0/2351543394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0ab600 con 0x7f86fc0cf290 2023-07-09T21:24:02.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f86f3fff640 1 -- 172.21.15.37:0/2351543394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0a7050 con 0x7f86fc0cf290 2023-07-09T21:24:02.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f86f3fff640 1 -- 172.21.15.37:0/2351543394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0ab980 con 0x7f86fc0cf290 2023-07-09T21:24:02.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- 172.21.15.37:0/2351543394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0cf290 msgr2=0x7f86fc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0cf290 0x7f86fc160030 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f86ec0097c0 tx=0x7f86ec01c480 comp rx=0 tx=0).stop 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- 172.21.15.37:0/2351543394 shutdown_connections 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0d0780 0x7f86fc0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 --2- 172.21.15.37:0/2351543394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0cf290 0x7f86fc160030 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- 172.21.15.37:0/2351543394 >> 172.21.15.37:0/2351543394 conn(0x7f86fc073090 msgr2=0x7f86fc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- 172.21.15.37:0/2351543394 shutdown_connections 2023-07-09T21:24:02.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- 172.21.15.37:0/2351543394 wait complete. 2023-07-09T21:24:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 Processor -- start 2023-07-09T21:24:02.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.880+0000 7f8703740640 1 -- start start 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86fc0b7980 0x7f86fc1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0cf290 0x7f86fc0c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc15aa00 con 0x7f86fc0d0780 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc15ace0 con 0x7f86fc0b7980 2023-07-09T21:24:02.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc15afc0 con 0x7f86fc0cf290 2023-07-09T21:24:02.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33106/0 (socket says 172.21.15.37:33106) 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 -- 172.21.15.37:0/3365779949 learned_addr learned my addr 172.21.15.37:0/3365779949 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8700cdb640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0cf290 0x7f86fc0c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f87014dc640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86fc0b7980 0x7f86fc1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 -- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0cf290 msgr2=0x7f86fc0c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0cf290 0x7f86fc0c7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 -- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86fc0b7980 msgr2=0x7f86fc1501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86fc0b7980 0x7f86fc1501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 -- 172.21.15.37:0/3365779949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009420 con 0x7f86fc0d0780 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8701cdd640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f86f400efc0 tx=0x7f86f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4009ba0 con 0x7f86fc0d0780 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f400f040 con 0x7f86fc0d0780 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f40146c0 con 0x7f86fc0d0780 2023-07-09T21:24:02.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc15b2a0 con 0x7f86fc0d0780 2023-07-09T21:24:02.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc150700 con 0x7f86fc0d0780 2023-07-09T21:24:02.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc04d7d0 con 0x7f86fc0d0780 2023-07-09T21:24:02.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.884+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f86f4014820 con 0x7f86fc0d0780 2023-07-09T21:24:02.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.888+0000 7f86f1ffb640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 0x7f86e00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:02.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.888+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f86f4084e30 con 0x7f86fc0d0780 2023-07-09T21:24:02.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.888+0000 7f87014dc640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 0x7f86e00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:02.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.888+0000 7f87014dc640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 0x7f86e00689c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000f70 tx=0x7f86f8007ba0 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:02.892+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86f4051d70 con 0x7f86fc0d0780 2023-07-09T21:24:03.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.064+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f86fc15ae50 con 0x7f86e0066510 2023-07-09T21:24:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.108+0000 7f86f1ffb640 1 -- 172.21.15.37:0/3365779949 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f86fc15ae50 con 0x7f86e0066510 2023-07-09T21:24:03.113 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir4 2023-07-09T21:24:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 msgr2=0x7f86e00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 0x7f86e00689c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000f70 tx=0x7f86f8007ba0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 msgr2=0x7f86fc151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f86f400efc0 tx=0x7f86f400c490 comp rx=0 tx=0).stop 2023-07-09T21:24:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 shutdown_connections 2023-07-09T21:24:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f86e0066510 0x7f86e00689c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86fc0d0780 0x7f86fc151f70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86fc0cf290 0x7f86fc0c7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 --2- 172.21.15.37:0/3365779949 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86fc0b7980 0x7f86fc1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 >> 172.21.15.37:0/3365779949 conn(0x7f86fc073090 msgr2=0x7f86fc15d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 shutdown_connections 2023-07-09T21:24:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.112+0000 7f8703740640 1 -- 172.21.15.37:0/3365779949 wait complete. 2023-07-09T21:24:03.133 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2023-07-09T21:24:03.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-09T21:24:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.276+0000 7f6a48e9e640 1 Processor -- start 2023-07-09T21:24:03.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.276+0000 7f6a48e9e640 1 -- start start 2023-07-09T21:24:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a48e9e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 0x7f6a4406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a48e9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a440c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a48e9e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a440c9090 con 0x7f6a440c4350 2023-07-09T21:24:03.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a48e9e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440c47f0 con 0x7f6a441585b0 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a48e9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a440cbf40 con 0x7f6a4406b970 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a42d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6a440c4350 0x7f6a4415c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51668/0 (socket says 172.21.15.37:51668) 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a42d9d640 1 -- 172.21.15.37:0/1784569209 learned_addr learned my addr 172.21.15.37:0/1784569209 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1784569209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a440c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1784569209 >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 0x7f6a4406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a41d9b640 1 -- 172.21.15.37:0/1784569209 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146539433 0 0) 0x7f6a440c9090 con 0x7f6a440c4350 2023-07-09T21:24:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a41d9b640 1 -- 172.21.15.37:0/1784569209 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a30005740 con 0x7f6a440c4350 2023-07-09T21:24:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1784569209 >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 msgr2=0x7f6a4406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1784569209 >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 0x7f6a4406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1784569209 >> v1:172.21.15.37:6789/0 conn(0x7f6a440c4350 legacy=0x7f6a4415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1784569209 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440c8a60 con 0x7f6a4406b970 2023-07-09T21:24:03.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.280+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1784569209 >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 0x7f6a4406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1784569209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a440c3e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fe08640db9bdd34 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a41d9b640 1 -- 172.21.15.37:0/1784569209 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0ab650 con 0x7f6a4406b970 2023-07-09T21:24:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a41d9b640 1 -- 172.21.15.37:0/1784569209 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0ab7b0 con 0x7f6a4406b970 2023-07-09T21:24:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a41d9b640 1 -- 172.21.15.37:0/1784569209 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0abb20 con 0x7f6a4406b970 2023-07-09T21:24:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1784569209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 msgr2=0x7f6a440c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1784569209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a440c3e10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c0097c0 tx=0x7f6a2c01c450 comp rx=0 tx=0).stop 2023-07-09T21:24:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1784569209 shutdown_connections 2023-07-09T21:24:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1784569209 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a440c3e10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1784569209 >> v2:172.21.15.119:3300/0 conn(0x7f6a441585b0 0x7f6a4406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1784569209 >> 172.21.15.37:0/1784569209 conn(0x7f6a440cde40 msgr2=0x7f6a440ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1784569209 shutdown_connections 2023-07-09T21:24:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1784569209 wait complete. 2023-07-09T21:24:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 Processor -- start 2023-07-09T21:24:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.284+0000 7f6a48e9e640 1 -- start start 2023-07-09T21:24:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a441599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a441585b0 0x7f6a4414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f06a0 con 0x7f6a440c4350 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f0980 con 0x7f6a441585b0 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f0c60 con 0x7f6a4406b970 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33112/0 (socket says 172.21.15.37:33112) 2023-07-09T21:24:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1839412807 learned_addr learned my addr 172.21.15.37:0/1839412807 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a42d9d640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a441585b0 0x7f6a4414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a441599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 msgr2=0x7f6a441599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a441599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a441585b0 msgr2=0x7f6a4414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a441585b0 0x7f6a4414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 -- 172.21.15.37:0/1839412807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009420 con 0x7f6a440c4350 2023-07-09T21:24:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a441599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3bfff640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01a080 tx=0x7f6a2c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c0abd30 con 0x7f6a440c4350 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a2c0abe90 con 0x7f6a440c4350 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c004240 con 0x7f6a440c4350 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2c009420 con 0x7f6a440c4350 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a441438c0 con 0x7f6a440c4350 2023-07-09T21:24:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4404d7d0 con 0x7f6a440c4350 2023-07-09T21:24:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.288+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f6a2c0043a0 con 0x7f6a440c4350 2023-07-09T21:24:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.292+0000 7f6a3affd640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 0x7f6a240689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.292+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f6a2c11ecf0 con 0x7f6a440c4350 2023-07-09T21:24:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.292+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 0x7f6a240689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.292+0000 7f6a4259c640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 0x7f6a240689c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009ca0 tx=0x7f6a34008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.296+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a2c0ebe70 con 0x7f6a440c4350 2023-07-09T21:24:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.468+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a441f0af0 con 0x7f6a24066510 2023-07-09T21:24:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.512+0000 7f6a3affd640 1 -- 172.21.15.37:0/1839412807 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f6a441f0af0 con 0x7f6a24066510 2023-07-09T21:24:03.516 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir5 2023-07-09T21:24:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.512+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 msgr2=0x7f6a240689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.512+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 0x7f6a240689c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6a34009ca0 tx=0x7f6a34008040 comp rx=0 tx=0).stop 2023-07-09T21:24:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.512+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 msgr2=0x7f6a440b00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.512+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c01a080 tx=0x7f6a2c01ac90 comp rx=0 tx=0).stop 2023-07-09T21:24:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 shutdown_connections 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6a24066510 0x7f6a240689c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a441585b0 0x7f6a4414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a440c4350 0x7f6a440b00f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 --2- 172.21.15.37:0/1839412807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a4406b970 0x7f6a441599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 >> 172.21.15.37:0/1839412807 conn(0x7f6a440cde40 msgr2=0x7f6a44070b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 shutdown_connections 2023-07-09T21:24:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.516+0000 7f6a48e9e640 1 -- 172.21.15.37:0/1839412807 wait complete. 2023-07-09T21:24:03.536 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2023-07-09T21:24:03.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-09T21:24:03.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.680+0000 7fef56174640 1 Processor -- start 2023-07-09T21:24:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.680+0000 7fef56174640 1 -- start start 2023-07-09T21:24:03.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.680+0000 7fef56174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 0x7fef50160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef56174640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef5015bf80 con 0x7fef500d0780 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef56174640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef50160570 con 0x7fef500b7980 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef56174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef500cd070 con 0x7fef500cf290 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef500d0780 0x7fef500d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51674/0 (socket says 172.21.15.37:51674) 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4ffff640 1 -- 172.21.15.37:0/1411008046 learned_addr learned my addr 172.21.15.37:0/1411008046 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:03.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4effd640 1 --2- 172.21.15.37:0/1411008046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 0x7fef50160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089512851 0 0) 0x7fef480014a0 con 0x7fef500d0780 2023-07-09T21:24:03.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef38003530 con 0x7fef500d0780 2023-07-09T21:24:03.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137287872 0 0) 0x7fef40001120 con 0x7fef500b7980 2023-07-09T21:24:03.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef480014a0 con 0x7fef500b7980 2023-07-09T21:24:03.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4effd640 1 -- 172.21.15.37:0/1411008046 >> v1:172.21.15.119:6789/0 conn(0x7fef500b7980 legacy=0x7fef500ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4effd640 1 -- 172.21.15.37:0/1411008046 >> v1:172.21.15.37:6789/0 conn(0x7fef500d0780 legacy=0x7fef500d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4effd640 1 -- 172.21.15.37:0/1411008046 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef500d02f0 con 0x7fef500cf290 2023-07-09T21:24:03.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4effd640 1 --2- 172.21.15.37:0/1411008046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 0x7fef50160030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef440097f0 tx=0x7fef4401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5ae338968bdadeb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440ab600 con 0x7fef500cf290 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440a7050 con 0x7fef500cf290 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.684+0000 7fef4e7fc640 1 -- 172.21.15.37:0/1411008046 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440ab960 con 0x7fef500cf290 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- 172.21.15.37:0/1411008046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 msgr2=0x7fef50160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 --2- 172.21.15.37:0/1411008046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 0x7fef50160030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef440097f0 tx=0x7fef4401c4c0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- 172.21.15.37:0/1411008046 shutdown_connections 2023-07-09T21:24:03.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 --2- 172.21.15.37:0/1411008046 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500cf290 0x7fef50160030 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- 172.21.15.37:0/1411008046 >> 172.21.15.37:0/1411008046 conn(0x7fef50073090 msgr2=0x7fef50069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- 172.21.15.37:0/1411008046 shutdown_connections 2023-07-09T21:24:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- 172.21.15.37:0/1411008046 wait complete. 2023-07-09T21:24:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 Processor -- start 2023-07-09T21:24:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- start start 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef500b7980 0x7fef5014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500d0780 0x7fef500b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50150c10 con 0x7fef500cf290 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef50153a00 con 0x7fef500b7980 2023-07-09T21:24:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef56174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef50152df0 con 0x7fef500d0780 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef4effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef4effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33116/0 (socket says 172.21.15.37:33116) 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef4effd640 1 -- 172.21.15.37:0/3091490957 learned_addr learned my addr 172.21.15.37:0/3091490957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef4ffff640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500d0780 0x7fef500b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.688+0000 7fef4f7fe640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef500b7980 0x7fef5014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 -- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500d0780 msgr2=0x7fef500b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500d0780 0x7fef500b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 -- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef500b7980 msgr2=0x7fef5014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef500b7980 0x7fef5014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 -- 172.21.15.37:0/3091490957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef44009420 con 0x7fef500cf290 2023-07-09T21:24:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef4effd640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c10 tx=0x7fef44019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440b4810 con 0x7fef500cf290 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef440b4970 con 0x7fef500cf290 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef440b4d00 con 0x7fef500cf290 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef501530d0 con 0x7fef500cf290 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef50153690 con 0x7fef500cf290 2023-07-09T21:24:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef50153b70 con 0x7fef500cf290 2023-07-09T21:24:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fef440b2040 con 0x7fef500cf290 2023-07-09T21:24:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 0x7fef3c0689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.692+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fef4411e160 con 0x7fef500cf290 2023-07-09T21:24:03.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.696+0000 7fef4f7fe640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 0x7fef3c0689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:03.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.696+0000 7fef4f7fe640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 0x7fef3c0689f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef40001280 tx=0x7fef40009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:03.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.696+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fef440eb170 con 0x7fef500cf290 2023-07-09T21:24:03.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.876+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fef500cff80 con 0x7fef3c066540 2023-07-09T21:24:03.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef37fff640 1 -- 172.21.15.37:0/3091490957 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fef40001d00 con 0x7fef3c066540 2023-07-09T21:24:03.922 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir6 2023-07-09T21:24:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 msgr2=0x7fef3c0689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 0x7fef3c0689f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef40001280 tx=0x7fef40009040 comp rx=0 tx=0).stop 2023-07-09T21:24:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 msgr2=0x7fef500b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fef44000c10 tx=0x7fef44019260 comp rx=0 tx=0).stop 2023-07-09T21:24:03.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 shutdown_connections 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fef3c066540 0x7fef3c0689f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fef500d0780 0x7fef500b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef500cf290 0x7fef500b3490 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 --2- 172.21.15.37:0/3091490957 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fef500b7980 0x7fef5014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 >> 172.21.15.37:0/3091490957 conn(0x7fef50073090 msgr2=0x7fef5015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 shutdown_connections 2023-07-09T21:24:03.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:03.920+0000 7fef56174640 1 -- 172.21.15.37:0/3091490957 wait complete. 2023-07-09T21:24:03.943 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2023-07-09T21:24:03.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-09T21:24:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.088+0000 7fed0811f640 1 Processor -- start 2023-07-09T21:24:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.088+0000 7fed0811f640 1 -- start start 2023-07-09T21:24:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed0811f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed001585b0 0x7fed0006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed0811f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed000c4520 0x7fed0015c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed0811f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed000c9090 con 0x7fed0006b970 2023-07-09T21:24:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed0811f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed000cbf40 con 0x7fed001585b0 2023-07-09T21:24:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed0811f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed000c8a60 con 0x7fed000c4520 2023-07-09T21:24:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed001585b0 0x7fed0006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed001585b0 0x7fed0006b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33130/0 (socket says 172.21.15.37:33130) 2023-07-09T21:24:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 -- 172.21.15.37:0/2240388743 learned_addr learned my addr 172.21.15.37:0/2240388743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 -- 172.21.15.37:0/2240388743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed000c4520 msgr2=0x7fed0015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 --2- 172.21.15.37:0/2240388743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed000c4520 0x7fed0015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 -- 172.21.15.37:0/2240388743 >> v1:172.21.15.119:6789/0 conn(0x7fed0006b970 legacy=0x7fed000c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.092+0000 7fed05ebb640 1 -- 172.21.15.37:0/2240388743 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0015ce10 con 0x7fed001585b0 2023-07-09T21:24:04.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed05ebb640 1 --2- 172.21.15.37:0/2240388743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed001585b0 0x7fed0006b430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009870 tx=0x7fecfc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dd48696408663e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed04eb9640 1 -- 172.21.15.37:0/2240388743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0aa610 con 0x7fed001585b0 2023-07-09T21:24:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed04eb9640 1 -- 172.21.15.37:0/2240388743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0a6040 con 0x7fed001585b0 2023-07-09T21:24:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed04eb9640 1 -- 172.21.15.37:0/2240388743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0aa990 con 0x7fed001585b0 2023-07-09T21:24:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- 172.21.15.37:0/2240388743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed001585b0 msgr2=0x7fed0006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- 172.21.15.37:0/2240388743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed001585b0 0x7fed0006b430 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009870 tx=0x7fecfc01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- 172.21.15.37:0/2240388743 shutdown_connections 2023-07-09T21:24:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- 172.21.15.37:0/2240388743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed000c4520 0x7fed0015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- 172.21.15.37:0/2240388743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed001585b0 0x7fed0006b430 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- 172.21.15.37:0/2240388743 >> 172.21.15.37:0/2240388743 conn(0x7fed000cde40 msgr2=0x7fed000ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:04.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- 172.21.15.37:0/2240388743 shutdown_connections 2023-07-09T21:24:04.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- 172.21.15.37:0/2240388743 wait complete. 2023-07-09T21:24:04.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 Processor -- start 2023-07-09T21:24:04.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- start start 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed0006b970 0x7fed00159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed001585b0 0x7fed0015a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed00159030 con 0x7fed000c4520 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014cee0 con 0x7fed0006b970 2023-07-09T21:24:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.096+0000 7fed0811f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0014d1c0 con 0x7fed001585b0 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33144/0 (socket says 172.21.15.37:33144) 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 -- 172.21.15.37:0/1422838184 learned_addr learned my addr 172.21.15.37:0/1422838184 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed05ebb640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed0006b970 0x7fed00159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed066bc640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed001585b0 0x7fed0015a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 -- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed001585b0 msgr2=0x7fed0015a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed001585b0 0x7fed0015a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 -- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed0006b970 msgr2=0x7fed00159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed0006b970 0x7fed00159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 -- 172.21.15.37:0/1422838184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecfc0094d0 con 0x7fed000c4520 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed056ba640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c450 tx=0x7fecf000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0012830 con 0x7fed000c4520 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecf00129b0 con 0x7fed000c4520 2023-07-09T21:24:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf0012d60 con 0x7fed000c4520 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0014d4a0 con 0x7fed000c4520 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0014c2d0 con 0x7fed000c4520 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0014d950 con 0x7fed000c4520 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.100+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fecf001c460 con 0x7fed000c4520 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.104+0000 7fecf67fc640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 0x7fece40689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.104+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fecf0084120 con 0x7fed000c4520 2023-07-09T21:24:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.104+0000 7fed05ebb640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 0x7fece40689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.104+0000 7fed05ebb640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 0x7fece40689c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ae000 tx=0x7fecfc0b5040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.104+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed0014d950 con 0x7fed000c4520 2023-07-09T21:24:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.280+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed0015d0f0 con 0x7fece4066510 2023-07-09T21:24:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.320+0000 7fecf67fc640 1 -- 172.21.15.37:0/1422838184 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fecfc0aa750 con 0x7fece4066510 2023-07-09T21:24:04.325 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir7 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 msgr2=0x7fece40689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 0x7fece40689c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0ae000 tx=0x7fecfc0b5040 comp rx=0 tx=0).stop 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 msgr2=0x7fed0015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fecf000c450 tx=0x7fecf000c910 comp rx=0 tx=0).stop 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 shutdown_connections 2023-07-09T21:24:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fece4066510 0x7fece40689c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed001585b0 0x7fed0015a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed000c4520 0x7fed0015a420 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 --2- 172.21.15.37:0/1422838184 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed0006b970 0x7fed00159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 >> 172.21.15.37:0/1422838184 conn(0x7fed000cde40 msgr2=0x7fed001515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 shutdown_connections 2023-07-09T21:24:04.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.324+0000 7fed0811f640 1 -- 172.21.15.37:0/1422838184 wait complete. 2023-07-09T21:24:04.346 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2023-07-09T21:24:04.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-09T21:24:04.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 Processor -- start 2023-07-09T21:24:04.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 -- start start 2023-07-09T21:24:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdac0b7980 0x7fbdac160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdac0d0780 0x7fbdac0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdac15bf80 con 0x7fbdac0ceb80 2023-07-09T21:24:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0cd070 con 0x7fbdac0b7980 2023-07-09T21:24:04.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb29fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdac0cfd70 con 0x7fbdac0d0780 2023-07-09T21:24:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdac0b7980 0x7fbdac160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdb0f97640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbdac0d0780 0x7fbdac0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbdac0b7980 0x7fbdac160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33152/0 (socket says 172.21.15.37:33152) 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 -- 172.21.15.37:0/2320990135 learned_addr learned my addr 172.21.15.37:0/2320990135 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 -- 172.21.15.37:0/2320990135 >> v2:172.21.15.119:3300/0 conn(0x7fbdac0d0780 msgr2=0x7fbdac0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 --2- 172.21.15.37:0/2320990135 >> v2:172.21.15.119:3300/0 conn(0x7fbdac0d0780 0x7fbdac0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 -- 172.21.15.37:0/2320990135 >> v1:172.21.15.119:6789/0 conn(0x7fbdac0ceb80 legacy=0x7fbdac0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.492+0000 7fbdabfff640 1 -- 172.21.15.37:0/2320990135 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdac160570 con 0x7fbdac0b7980 2023-07-09T21:24:04.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdabfff640 1 --2- 172.21.15.37:0/2320990135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac160030 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0b1240 tx=0x7fbd9c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183990e175c7a02f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdaaffd640 1 -- 172.21.15.37:0/2320990135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0ab600 con 0x7fbdac0b7980 2023-07-09T21:24:04.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdaaffd640 1 -- 172.21.15.37:0/2320990135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0a7050 con 0x7fbdac0b7980 2023-07-09T21:24:04.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdaaffd640 1 -- 172.21.15.37:0/2320990135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0ab980 con 0x7fbdac0b7980 2023-07-09T21:24:04.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 -- 172.21.15.37:0/2320990135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 msgr2=0x7fbdac160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/2320990135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac160030 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fbdac0b1240 tx=0x7fbd9c01c500 comp rx=0 tx=0).stop 2023-07-09T21:24:04.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 -- 172.21.15.37:0/2320990135 shutdown_connections 2023-07-09T21:24:04.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/2320990135 >> v2:172.21.15.119:3300/0 conn(0x7fbdac0d0780 0x7fbdac0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/2320990135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac160030 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 -- 172.21.15.37:0/2320990135 >> 172.21.15.37:0/2320990135 conn(0x7fbdac073090 msgr2=0x7fbdac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:04.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 -- 172.21.15.37:0/2320990135 shutdown_connections 2023-07-09T21:24:04.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 -- 172.21.15.37:0/2320990135 wait complete. 2023-07-09T21:24:04.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.496+0000 7fbdb29fa640 1 Processor -- start 2023-07-09T21:24:04.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- start start 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdac0ceb80 0x7fbdac15c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 0x7fbdac150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0b62b0 con 0x7fbdac0b7980 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0b1da0 con 0x7fbdac0d0780 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdac0b2080 con 0x7fbdac0ceb80 2023-07-09T21:24:04.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33162/0 (socket says 172.21.15.37:33162) 2023-07-09T21:24:04.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 -- 172.21.15.37:0/3224130386 learned_addr learned my addr 172.21.15.37:0/3224130386 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:04.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb0f97640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 0x7fbdac150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdab7fe640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdac0ceb80 0x7fbdac15c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 -- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdac0ceb80 msgr2=0x7fbdac15c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdac0ceb80 0x7fbdac15c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 -- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 msgr2=0x7fbdac150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 0x7fbdac150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 -- 172.21.15.37:0/3224130386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0094d0 con 0x7fbdac0b7980 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb0f97640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 0x7fbdac150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdabfff640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c019110 tx=0x7fbd9c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0b37d0 con 0x7fbdac0b7980 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c0b3930 con 0x7fbdac0b7980 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdac0b2360 con 0x7fbdac0b7980 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c0b3ca0 con 0x7fbdac0b7980 2023-07-09T21:24:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdac0b2880 con 0x7fbdac0b7980 2023-07-09T21:24:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.500+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdac0cd600 con 0x7fbdac0b7980 2023-07-09T21:24:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.504+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7fbd9c0b2070 con 0x7fbdac0b7980 2023-07-09T21:24:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.504+0000 7fbda8ff9640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 0x7fbd980689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.504+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7fbd9c11e310 con 0x7fbdac0b7980 2023-07-09T21:24:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.504+0000 7fbdab7fe640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 0x7fbd980689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.504+0000 7fbdab7fe640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 0x7fbd980689f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdac15d720 tx=0x7fbda0009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.508+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbdac0cd600 con 0x7fbdac0b7980 2023-07-09T21:24:04.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.680+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fbdac0cff80 con 0x7fbd98066540 2023-07-09T21:24:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbda8ff9640 1 -- 172.21.15.37:0/3224130386 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fbda00014f0 con 0x7fbd98066540 2023-07-09T21:24:04.726 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir8 2023-07-09T21:24:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 msgr2=0x7fbd980689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 0x7fbd980689f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbdac15d720 tx=0x7fbda0009040 comp rx=0 tx=0).stop 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 msgr2=0x7fbdac157c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c019110 tx=0x7fbd9c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 shutdown_connections 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbd98066540 0x7fbd980689f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbdac0d0780 0x7fbdac150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbdac0ceb80 0x7fbdac15c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 --2- 172.21.15.37:0/3224130386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbdac0b7980 0x7fbdac157c10 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 >> 172.21.15.37:0/3224130386 conn(0x7fbdac073090 msgr2=0x7fbdac0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 shutdown_connections 2023-07-09T21:24:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.724+0000 7fbdb29fa640 1 -- 172.21.15.37:0/3224130386 wait complete. 2023-07-09T21:24:04.747 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2023-07-09T21:24:04.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-09T21:24:04.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 Processor -- start 2023-07-09T21:24:04.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 -- start start 2023-07-09T21:24:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00c41585b0 0x7f00c406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40c9090 con 0x7f00c40c4520 2023-07-09T21:24:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40c8a60 con 0x7f00c406b970 2023-07-09T21:24:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00cac56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40cbf40 con 0x7f00c41585b0 2023-07-09T21:24:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c89f2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f00c41585b0 0x7f00c406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c91f3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f00c40c4520 0x7f00c415c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51680/0 (socket says 172.21.15.37:51680) 2023-07-09T21:24:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c91f3640 1 -- 172.21.15.37:0/121514605 learned_addr learned my addr 172.21.15.37:0/121514605 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:24:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c89f2640 1 -- 172.21.15.37:0/121514605 >> v1:172.21.15.119:6789/0 conn(0x7f00c406b970 legacy=0x7f00c40c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:24:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c89f2640 1 -- 172.21.15.37:0/121514605 >> v1:172.21.15.37:6789/0 conn(0x7f00c40c4520 legacy=0x7f00c415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.892+0000 7f00c37fe640 1 -- 172.21.15.37:0/121514605 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324133650 0 0) 0x7f00c40c9090 con 0x7f00c40c4520 2023-07-09T21:24:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00c89f2640 1 -- 172.21.15.37:0/121514605 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c415ce10 con 0x7f00c41585b0 2023-07-09T21:24:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00c89f2640 1 --2- 172.21.15.37:0/121514605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c41585b0 0x7f00c406b430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f00b80097c0 tx=0x7f00b801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7bc79b5eee9f0b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00c37fe640 1 -- 172.21.15.37:0/121514605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80a7070 con 0x7f00c41585b0 2023-07-09T21:24:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00c37fe640 1 -- 172.21.15.37:0/121514605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80ab430 con 0x7f00c41585b0 2023-07-09T21:24:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00c37fe640 1 -- 172.21.15.37:0/121514605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80ab7c0 con 0x7f00c41585b0 2023-07-09T21:24:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 -- 172.21.15.37:0/121514605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c41585b0 msgr2=0x7f00c406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 --2- 172.21.15.37:0/121514605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c41585b0 0x7f00c406b430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f00b80097c0 tx=0x7f00b801c410 comp rx=0 tx=0).stop 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 -- 172.21.15.37:0/121514605 shutdown_connections 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 --2- 172.21.15.37:0/121514605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c41585b0 0x7f00c406b430 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 -- 172.21.15.37:0/121514605 >> 172.21.15.37:0/121514605 conn(0x7f00c40cde40 msgr2=0x7f00c40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 -- 172.21.15.37:0/121514605 shutdown_connections 2023-07-09T21:24:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.896+0000 7f00cac56640 1 -- 172.21.15.37:0/121514605 wait complete. 2023-07-09T21:24:04.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 Processor -- start 2023-07-09T21:24:04.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- start start 2023-07-09T21:24:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 0x7f00c414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00c41585b0 0x7f00c4141ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c412ded0 con 0x7f00c40c4520 2023-07-09T21:24:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c412d420 con 0x7f00c406b970 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c412d630 con 0x7f00c41585b0 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33170/0 (socket says 172.21.15.37:33170) 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 -- 172.21.15.37:0/3616260869 learned_addr learned my addr 172.21.15.37:0/3616260869 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c91f3640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00c41585b0 0x7f00c4141ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c89f2640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 0x7f00c414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 -- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00c41585b0 msgr2=0x7f00c4141ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00c41585b0 0x7f00c4141ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 -- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 msgr2=0x7f00c414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 0x7f00c414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 -- 172.21.15.37:0/3616260869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009420 con 0x7f00c40c4520 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c89f2640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 0x7f00c414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c3fff640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c450 tx=0x7f00b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0012830 con 0x7f00c40c4520 2023-07-09T21:24:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b00129b0 con 0x7f00c40c4520 2023-07-09T21:24:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b0012d60 con 0x7f00c40c4520 2023-07-09T21:24:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c412d910 con 0x7f00c40c4520 2023-07-09T21:24:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.900+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c40adba0 con 0x7f00c40c4520 2023-07-09T21:24:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.904+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c40addc0 con 0x7f00c40c4520 2023-07-09T21:24:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.904+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 10) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f00b001c460 con 0x7f00c40c4520 2023-07-09T21:24:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.904+0000 7f00c17fa640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 0x7f00a80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:24:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.904+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6320+0+0 (secure 0 0 0) 0x7f00b00840d0 con 0x7f00c40c4520 2023-07-09T21:24:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.904+0000 7f00c89f2640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 0x7f00a80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:24:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.908+0000 7f00c89f2640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 0x7f00a80689c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00b80af000 tx=0x7f00b8008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:24:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:04.908+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00b0051100 con 0x7f00c40c4520 2023-07-09T21:24:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.084+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f00c40c2d00 con 0x7f00a8066510 2023-07-09T21:24:05.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.128+0000 7f00c17fa640 1 -- 172.21.15.37:0/3616260869 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f00b80bc0d0 con 0x7f00a8066510 2023-07-09T21:24:05.133 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/dir9 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 msgr2=0x7f00a80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 0x7f00a80689c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f00b80af000 tx=0x7f00b8008040 comp rx=0 tx=0).stop 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 msgr2=0x7f00c412cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00b000c450 tx=0x7f00b000c910 comp rx=0 tx=0).stop 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 shutdown_connections 2023-07-09T21:24:05.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00a8066510 0x7f00a80689c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f00c41585b0 0x7f00c4141ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f00c40c4520 0x7f00c412cee0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 --2- 172.21.15.37:0/3616260869 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f00c406b970 0x7f00c414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 >> 172.21.15.37:0/3616260869 conn(0x7f00c40cde40 msgr2=0x7f00c4070170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 shutdown_connections 2023-07-09T21:24:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:24:05.132+0000 7f00cac56640 1 -- 172.21.15.37:0/3616260869 wait complete. 2023-07-09T21:24:05.154 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2023-07-09T21:24:28.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:24:28.185 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:24:58.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:24:58.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:25:28.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:25:28.374 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:25:58.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:25:58.453 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:26:28.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:26:28.518 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:26:58.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:26:58.631 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:27:28.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:27:28.787 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:27:58.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:27:58.851 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:28:00.746 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:28:00.744+0000 7f60551f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:28:00.747 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:28:00.744+0000 7f60551f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:28:00.747 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:28:00.744+0000 7f60551f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:28:00.747 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:28:00.744+0000 7f60551f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:28:00.747 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:28:00.744+0000 7f60551f4640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:28:28.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:28:28.905 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:28:58.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:28:58.968 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:29:29.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:29:29.107 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:29:59.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:29:59.220 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:30:29.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:30:29.526 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:30:59.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:30:59.606 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:31:29.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:31:29.663 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:31:59.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:31:59.800 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:32:29.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:32:29.858 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:32:59.981 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:32:59.985 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:33:30.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:33:30.037 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:34:00.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:34:00.161 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:34:30.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:34:30.267 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:35:00.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:35:00.413 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:35:19.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir0 1M 2023-07-09T21:35:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.310+0000 7f1c7293a640 1 Processor -- start 2023-07-09T21:35:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.310+0000 7f1c7293a640 1 -- start start 2023-07-09T21:35:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c7293a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c159990 0x7f1c6c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c7293a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0c4c90 con 0x7f1c6c1595c0 2023-07-09T21:35:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c7293a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0ca170 con 0x7f1c6c0c99e0 2023-07-09T21:35:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c7293a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0ca730 con 0x7f1c6c159990 2023-07-09T21:35:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1c6c1595c0 0x7f1c6c15dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53202/0 (socket says 172.21.15.37:53202) 2023-07-09T21:35:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 -- 172.21.15.37:0/1964448796 learned_addr learned my addr 172.21.15.37:0/1964448796 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c159990 0x7f1c6c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2280159640 0 0) 0x7f1c5c001120 con 0x7f1c6c1595c0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c54003530 con 0x7f1c6c1595c0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046705770 0 0) 0x7f1c6c0ca170 con 0x7f1c6c0c99e0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c5c001120 con 0x7f1c6c0c99e0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503144873 0 0) 0x7f1c54003530 con 0x7f1c6c1595c0 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c159990 msgr2=0x7f1c6c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c159990 0x7f1c6c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 >> v1:172.21.15.119:6789/0 conn(0x7f1c6c0c99e0 legacy=0x7f1c6c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0ca450 con 0x7f1c6c1595c0 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1c5c001810 con 0x7f1c6c1595c0 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c159990 0x7f1c6c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 >> v1:172.21.15.37:6789/0 conn(0x7f1c6c1595c0 legacy=0x7f1c6c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c54003b40 0x7f1c54003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c540047d0 0x7f1c54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54005180 0x7f1c5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0ca730 con 0x7f1c54003b40 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5400bfb0 con 0x7f1c54005180 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5400c170 con 0x7f1c540047d0 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c54003b40 0x7f1c54003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c540047d0 0x7f1c54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c70ed7640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54005180 0x7f1c5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 -- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c540047d0 msgr2=0x7f1c54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c540047d0 0x7f1c54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 -- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54005180 msgr2=0x7f1c5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54005180 0x7f1c5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c6bfff640 1 -- 172.21.15.37:0/1964448796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54003530 con 0x7f1c54003b40 2023-07-09T21:35:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.314+0000 7f1c70ed7640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54005180 0x7f1c5400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c54003b40 0x7f1c54003f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007fb0 tx=0x7f1c5c01cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d96cbde57ea7be1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c005ae0 con 0x7f1c54003b40 2023-07-09T21:35:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c005c40 con 0x7f1c54003b40 2023-07-09T21:35:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c6affd640 1 -- 172.21.15.37:0/1964448796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0a57a0 con 0x7f1c54003b40 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 -- 172.21.15.37:0/1964448796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c54003b40 msgr2=0x7f1c54003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1964448796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c54003b40 0x7f1c54003f30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c007fb0 tx=0x7f1c5c01cad0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c70ed7640 1 -- 172.21.15.37:0/1964448796 reap_dead start 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 -- 172.21.15.37:0/1964448796 shutdown_connections 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 -- 172.21.15.37:0/1964448796 >> 172.21.15.37:0/1964448796 conn(0x7f1c6c0cde40 msgr2=0x7f1c6c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 -- 172.21.15.37:0/1964448796 shutdown_connections 2023-07-09T21:35:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 -- 172.21.15.37:0/1964448796 wait complete. 2023-07-09T21:35:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.318+0000 7f1c7293a640 1 Processor -- start 2023-07-09T21:35:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- start start 2023-07-09T21:35:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54003b40 0x7f1c6c149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 0x7f1c6c06fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1556e0 con 0x7f1c6c14a890 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c155980 con 0x7f1c54003b40 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c155c60 con 0x7f1c6c14f070 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39320/0 (socket says 172.21.15.37:39320) 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 -- 172.21.15.37:0/1892302201 learned_addr learned my addr 172.21.15.37:0/1892302201 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c70ed7640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 0x7f1c6c06fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54003b40 0x7f1c6c149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 -- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 msgr2=0x7f1c6c06fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 0x7f1c6c06fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 -- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54003b40 msgr2=0x7f1c6c149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54003b40 0x7f1c6c149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 -- 172.21.15.37:0/1892302201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c155f40 con 0x7f1c6c14a890 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c70ed7640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 0x7f1c6c06fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c6b7fe640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c60011c00 tx=0x7f1c60011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c60009e10 con 0x7f1c6c14a890 2023-07-09T21:35:19.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000fa30 con 0x7f1c6c14a890 2023-07-09T21:35:19.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000fda0 con 0x7f1c6c14a890 2023-07-09T21:35:19.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c149f50 con 0x7f1c6c14a890 2023-07-09T21:35:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c14a1f0 con 0x7f1c6c14a890 2023-07-09T21:35:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.322+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c04d7d0 con 0x7f1c6c14a890 2023-07-09T21:35:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.326+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f1c60014440 con 0x7f1c6c14a890 2023-07-09T21:35:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.326+0000 7f1c68ff9640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 0x7f1c58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.326+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1c600848a0 con 0x7f1c6c14a890 2023-07-09T21:35:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.326+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 0x7f1c58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.326+0000 7f1c6bfff640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 0x7f1c58068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ab000 tx=0x7f1c5c0a7070 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.330+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c60051850 con 0x7f1c6c14a890 2023-07-09T21:35:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.502+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c6c0c9de0 con 0x7f1c58066480 2023-07-09T21:35:19.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.574+0000 7f1c68ff9640 1 -- 172.21.15.37:0/1892302201 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f1c5c0b5040 con 0x7f1c58066480 2023-07-09T21:35:19.577 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2023-07-09T21:35:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 msgr2=0x7f1c58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 0x7f1c58068930 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ab000 tx=0x7f1c5c0a7070 comp rx=0 tx=0).stop 2023-07-09T21:35:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 msgr2=0x7f1c6c06f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f1c60011c00 tx=0x7f1c60011cf0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 shutdown_connections 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1c58066480 0x7f1c58068930 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c6c14f070 0x7f1c6c06fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c6c14a890 0x7f1c6c06f5a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 --2- 172.21.15.37:0/1892302201 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c54003b40 0x7f1c6c149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 >> 172.21.15.37:0/1892302201 conn(0x7f1c6c0cde40 msgr2=0x7f1c6c15e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:19.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 shutdown_connections 2023-07-09T21:35:19.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.578+0000 7f1c7293a640 1 -- 172.21.15.37:0/1892302201 wait complete. 2023-07-09T21:35:19.598 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2023-07-09T21:35:19.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir1 1M 2023-07-09T21:35:19.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.742+0000 7fd21979c640 1 Processor -- start 2023-07-09T21:35:19.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.742+0000 7fd21979c640 1 -- start start 2023-07-09T21:35:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd21979c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140cfb40 0x7fd2140cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd21979c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2140b0540 0x7fd2140cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd21979c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140d0450 con 0x7fd2140b1420 2023-07-09T21:35:19.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd21979c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ce640 con 0x7fd2140b0540 2023-07-09T21:35:19.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd21979c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140ce080 con 0x7fd2140cfb40 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2140b0540 0x7fd2140cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2140b0540 0x7fd2140cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39332/0 (socket says 172.21.15.37:39332) 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 -- 172.21.15.37:0/2348118376 learned_addr learned my addr 172.21.15.37:0/2348118376 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd213fff640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140cfb40 0x7fd2140cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 -- 172.21.15.37:0/2348118376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140cfb40 msgr2=0x7fd2140cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:19.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140cfb40 0x7fd2140cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 -- 172.21.15.37:0/2348118376 >> v1:172.21.15.119:6789/0 conn(0x7fd2140b1420 legacy=0x7fd2140cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:19.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.746+0000 7fd218f9b640 1 -- 172.21.15.37:0/2348118376 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140ce360 con 0x7fd2140b0540 2023-07-09T21:35:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd218f9b640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd2140cccd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009e50 tx=0x7fd20c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84eccc4e99018e15 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd212ffd640 1 -- 172.21.15.37:0/2348118376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0a58a0 con 0x7fd2140b0540 2023-07-09T21:35:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd212ffd640 1 -- 172.21.15.37:0/2348118376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c0a5a00 con 0x7fd2140b0540 2023-07-09T21:35:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd212ffd640 1 -- 172.21.15.37:0/2348118376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c0a5d90 con 0x7fd2140b0540 2023-07-09T21:35:19.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- 172.21.15.37:0/2348118376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 msgr2=0x7fd2140cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd2140cccd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009e50 tx=0x7fd20c01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- 172.21.15.37:0/2348118376 shutdown_connections 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd2140cccd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 --2- 172.21.15.37:0/2348118376 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140cfb40 0x7fd2140cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- 172.21.15.37:0/2348118376 >> 172.21.15.37:0/2348118376 conn(0x7fd214072d20 msgr2=0x7fd2140d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- 172.21.15.37:0/2348118376 shutdown_connections 2023-07-09T21:35:19.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- 172.21.15.37:0/2348118376 wait complete. 2023-07-09T21:35:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 Processor -- start 2023-07-09T21:35:19.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.750+0000 7fd21979c640 1 -- start start 2023-07-09T21:35:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140b1420 0x7fd214154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 0x7fd214154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214152610 con 0x7fd2140b0540 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b38a0 con 0x7fd2140cfb40 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b3b80 con 0x7fd2140b1420 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39336/0 (socket says 172.21.15.37:39336) 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 -- 172.21.15.37:0/3780260398 learned_addr learned my addr 172.21.15.37:0/3780260398 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd2137fe640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140b1420 0x7fd214154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd218f9b640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 0x7fd214154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 -- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140b1420 msgr2=0x7fd214154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140b1420 0x7fd214154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 -- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 msgr2=0x7fd214154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 0x7fd214154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 -- 172.21.15.37:0/3780260398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c009b30 con 0x7fd2140b0540 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd218f9b640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 0x7fd214154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd213fff640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d5f0 tx=0x7fd20400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2040125f0 con 0x7fd2140b0540 2023-07-09T21:35:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd204012750 con 0x7fd2140b0540 2023-07-09T21:35:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140b3e60 con 0x7fd2140b0540 2023-07-09T21:35:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd204012ae0 con 0x7fd2140b0540 2023-07-09T21:35:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21414dca0 con 0x7fd2140b0540 2023-07-09T21:35:19.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21404e020 con 0x7fd2140b0540 2023-07-09T21:35:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.754+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fd204012c40 con 0x7fd2140b0540 2023-07-09T21:35:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.758+0000 7fd210ff9640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 0x7fd200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.758+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fd204084660 con 0x7fd2140b0540 2023-07-09T21:35:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.758+0000 7fd2137fe640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 0x7fd200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:19.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.758+0000 7fd2137fe640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 0x7fd200068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2140b8030 tx=0x7fd208009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:19.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.758+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd204051730 con 0x7fd2140b0540 2023-07-09T21:35:19.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:19.938+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2140d1d60 con 0x7fd200066480 2023-07-09T21:35:20.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd210ff9640 1 -- 172.21.15.37:0/3780260398 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fd208001450 con 0x7fd200066480 2023-07-09T21:35:20.013 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2023-07-09T21:35:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 msgr2=0x7fd200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 0x7fd200068930 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd2140b8030 tx=0x7fd208009040 comp rx=0 tx=0).stop 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 msgr2=0x7fd21414d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd20400d5f0 tx=0x7fd20400dab0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 shutdown_connections 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fd200066480 0x7fd200068930 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2140cfb40 0x7fd214154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2140b1420 0x7fd214154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 --2- 172.21.15.37:0/3780260398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2140b0540 0x7fd21414d440 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 >> 172.21.15.37:0/3780260398 conn(0x7fd214072d20 msgr2=0x7fd21415e1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 shutdown_connections 2023-07-09T21:35:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.010+0000 7fd21979c640 1 -- 172.21.15.37:0/3780260398 wait complete. 2023-07-09T21:35:20.034 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2023-07-09T21:35:20.034 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir2 1M 2023-07-09T21:35:20.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 Processor -- start 2023-07-09T21:35:20.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 -- start start 2023-07-09T21:35:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51400b7980 0x7f5140160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51400d0780 0x7f51400d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514015bf80 con 0x7f51400ceb80 2023-07-09T21:35:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51400cd070 con 0x7f51400d0780 2023-07-09T21:35:20.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5146cd8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51400cfd70 con 0x7f51400b7980 2023-07-09T21:35:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f513ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f51400ceb80 0x7f51400cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53216/0 (socket says 172.21.15.37:53216) 2023-07-09T21:35:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f513ffff640 1 -- 172.21.15.37:0/37764765 learned_addr learned my addr 172.21.15.37:0/37764765 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:20.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5145275640 1 --2- 172.21.15.37:0/37764765 >> v2:172.21.15.37:3300/0 conn(0x7f51400d0780 0x7f51400d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5144a74640 1 --2- 172.21.15.37:0/37764765 >> v2:172.21.15.119:3300/0 conn(0x7f51400b7980 0x7f5140160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5145275640 1 -- 172.21.15.37:0/37764765 >> v2:172.21.15.119:3300/0 conn(0x7f51400b7980 msgr2=0x7f5140160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5145275640 1 --2- 172.21.15.37:0/37764765 >> v2:172.21.15.119:3300/0 conn(0x7f51400b7980 0x7f5140160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f513f7fe640 1 -- 172.21.15.37:0/37764765 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614771293 0 0) 0x7f512c001120 con 0x7f51400ceb80 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.178+0000 7f5145275640 1 -- 172.21.15.37:0/37764765 >> v1:172.21.15.37:6789/0 conn(0x7f51400ceb80 legacy=0x7f51400cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5145275640 1 -- 172.21.15.37:0/37764765 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5140160570 con 0x7f51400d0780 2023-07-09T21:35:20.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5145275640 1 --2- 172.21.15.37:0/37764765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400d0780 0x7f51400d0b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5140069aa0 tx=0x7f513801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8567e5d73aa7c988 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f513f7fe640 1 -- 172.21.15.37:0/37764765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380a57d0 con 0x7f51400d0780 2023-07-09T21:35:20.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f513f7fe640 1 -- 172.21.15.37:0/37764765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51380a5930 con 0x7f51400d0780 2023-07-09T21:35:20.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f513f7fe640 1 -- 172.21.15.37:0/37764765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380a5cc0 con 0x7f51400d0780 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 -- 172.21.15.37:0/37764765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400d0780 msgr2=0x7f51400d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 --2- 172.21.15.37:0/37764765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400d0780 0x7f51400d0b80 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f5140069aa0 tx=0x7f513801c910 comp rx=0 tx=0).stop 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 -- 172.21.15.37:0/37764765 shutdown_connections 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 --2- 172.21.15.37:0/37764765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400d0780 0x7f51400d0b80 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 --2- 172.21.15.37:0/37764765 >> v2:172.21.15.119:3300/0 conn(0x7f51400b7980 0x7f5140160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 -- 172.21.15.37:0/37764765 >> 172.21.15.37:0/37764765 conn(0x7f5140073090 msgr2=0x7f5140069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.182+0000 7f5146cd8640 1 -- 172.21.15.37:0/37764765 shutdown_connections 2023-07-09T21:35:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 -- 172.21.15.37:0/37764765 wait complete. 2023-07-09T21:35:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 Processor -- start 2023-07-09T21:35:20.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 -- start start 2023-07-09T21:35:20.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51400b7980 0x7f514015e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 0x7f51400b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51400b5e90 con 0x7f51400ceb80 2023-07-09T21:35:20.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514015ed10 con 0x7f51400d0780 2023-07-09T21:35:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5146cd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514015e340 con 0x7f51400b7980 2023-07-09T21:35:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39354/0 (socket says 172.21.15.37:39354) 2023-07-09T21:35:20.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 -- 172.21.15.37:0/3585952803 learned_addr learned my addr 172.21.15.37:0/3585952803 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:20.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5144a74640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51400b7980 0x7f514015e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5145275640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 0x7f51400b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 -- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51400b7980 msgr2=0x7f514015e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51400b7980 0x7f514015e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 -- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 msgr2=0x7f51400b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 0x7f51400b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 -- 172.21.15.37:0/3585952803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5138009a70 con 0x7f51400ceb80 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f5145275640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 0x7f51400b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.186+0000 7f513ffff640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c7b0 tx=0x7f512c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0072d0 con 0x7f51400ceb80 2023-07-09T21:35:20.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5140153ca0 con 0x7f51400ceb80 2023-07-09T21:35:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c007450 con 0x7f51400ceb80 2023-07-09T21:35:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0047f0 con 0x7f51400ceb80 2023-07-09T21:35:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514015dcf0 con 0x7f51400ceb80 2023-07-09T21:35:20.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514015db50 con 0x7f51400ceb80 2023-07-09T21:35:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f512c004950 con 0x7f51400ceb80 2023-07-09T21:35:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 0x7f5124068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f512c083670 con 0x7f51400ceb80 2023-07-09T21:35:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f5144a74640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 0x7f5124068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.190+0000 7f5144a74640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 0x7f5124068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5134009b60 tx=0x7f5134009190 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.194+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f514015db50 con 0x7f51400ceb80 2023-07-09T21:35:20.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.370+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f51400cff80 con 0x7f5124066480 2023-07-09T21:35:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.442+0000 7f513d7fa640 1 -- 172.21.15.37:0/3585952803 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f5134011ac0 con 0x7f5124066480 2023-07-09T21:35:20.446 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2023-07-09T21:35:20.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 msgr2=0x7f5124068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 0x7f5124068930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5134009b60 tx=0x7f5134009190 comp rx=0 tx=0).stop 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 msgr2=0x7f5140157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c7b0 tx=0x7f512c00cc70 comp rx=0 tx=0).stop 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 shutdown_connections 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5124066480 0x7f5124068930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51400d0780 0x7f51400b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51400ceb80 0x7f5140157de0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 --2- 172.21.15.37:0/3585952803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51400b7980 0x7f514015e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 >> 172.21.15.37:0/3585952803 conn(0x7f5140073090 msgr2=0x7f5140158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 shutdown_connections 2023-07-09T21:35:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.446+0000 7f5146cd8640 1 -- 172.21.15.37:0/3585952803 wait complete. 2023-07-09T21:35:20.466 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2023-07-09T21:35:20.467 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir3 1M 2023-07-09T21:35:20.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.610+0000 7f9d2311e640 1 Processor -- start 2023-07-09T21:35:20.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.610+0000 7f9d2311e640 1 -- start start 2023-07-09T21:35:20.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d2311e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9d1c0cf290 0x7f9d1c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d2311e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0d0780 0x7f9d1c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d2311e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c15bf80 con 0x7f9d1c0b7980 2023-07-09T21:35:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d2311e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cd070 con 0x7f9d1c0cf290 2023-07-09T21:35:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d2311e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0cfd70 con 0x7f9d1c0d0780 2023-07-09T21:35:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d20eba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d1c0b7980 0x7f9d1c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53222/0 (socket says 172.21.15.37:53222) 2023-07-09T21:35:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d20eba640 1 -- 172.21.15.37:0/1574119903 learned_addr learned my addr 172.21.15.37:0/1574119903 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:20.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1bfff640 1 --2- 172.21.15.37:0/1574119903 >> v2:172.21.15.37:3300/0 conn(0x7f9d1c0cf290 0x7f9d1c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d216bb640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0d0780 0x7f9d1c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1b7fe640 1 -- 172.21.15.37:0/1574119903 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601499224 0 0) 0x7f9d10001120 con 0x7f9d1c0b7980 2023-07-09T21:35:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1b7fe640 1 -- 172.21.15.37:0/1574119903 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d0c003530 con 0x7f9d1c0b7980 2023-07-09T21:35:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1bfff640 1 -- 172.21.15.37:0/1574119903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0d0780 msgr2=0x7f9d1c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1bfff640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0d0780 0x7f9d1c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1bfff640 1 -- 172.21.15.37:0/1574119903 >> v1:172.21.15.37:6789/0 conn(0x7f9d1c0b7980 legacy=0x7f9d1c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.614+0000 7f9d1bfff640 1 -- 172.21.15.37:0/1574119903 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c160570 con 0x7f9d1c0cf290 2023-07-09T21:35:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d1bfff640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c160030 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9d080097c0 tx=0x7f9d0801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56afc5bd0131ff0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d1b7fe640 1 -- 172.21.15.37:0/1574119903 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d080ab600 con 0x7f9d1c0cf290 2023-07-09T21:35:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d1b7fe640 1 -- 172.21.15.37:0/1574119903 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d080a7050 con 0x7f9d1c0cf290 2023-07-09T21:35:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d1b7fe640 1 -- 172.21.15.37:0/1574119903 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d080ab980 con 0x7f9d1c0cf290 2023-07-09T21:35:20.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- 172.21.15.37:0/1574119903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0cf290 msgr2=0x7f9d1c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c160030 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9d080097c0 tx=0x7f9d0801c480 comp rx=0 tx=0).stop 2023-07-09T21:35:20.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- 172.21.15.37:0/1574119903 shutdown_connections 2023-07-09T21:35:20.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0d0780 0x7f9d1c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- 172.21.15.37:0/1574119903 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c160030 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- 172.21.15.37:0/1574119903 >> 172.21.15.37:0/1574119903 conn(0x7f9d1c073090 msgr2=0x7f9d1c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- 172.21.15.37:0/1574119903 shutdown_connections 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- 172.21.15.37:0/1574119903 wait complete. 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 Processor -- start 2023-07-09T21:35:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- start start 2023-07-09T21:35:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0b7980 0x7f9d1c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c0c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15d030 con 0x7f9d1c0d0780 2023-07-09T21:35:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15b820 con 0x7f9d1c0cf290 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.618+0000 7f9d2311e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c15c740 con 0x7f9d1c0b7980 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39376/0 (socket says 172.21.15.37:39376) 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 -- 172.21.15.37:0/4227791445 learned_addr learned my addr 172.21.15.37:0/4227791445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d20eba640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0b7980 0x7f9d1c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d1bfff640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c0c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 -- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0b7980 msgr2=0x7f9d1c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0b7980 0x7f9d1c15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 -- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 msgr2=0x7f9d1c0c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c0c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 -- 172.21.15.37:0/4227791445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d08009420 con 0x7f9d1c0d0780 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d1bfff640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d216bb640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400efc0 tx=0x7f9d1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14009ba0 con 0x7f9d1c0d0780 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400f040 con 0x7f9d1c0d0780 2023-07-09T21:35:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c15c9e0 con 0x7f9d1c0d0780 2023-07-09T21:35:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d140146c0 con 0x7f9d1c0d0780 2023-07-09T21:35:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c151f80 con 0x7f9d1c0d0780 2023-07-09T21:35:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c15d1a0 con 0x7f9d1c0d0780 2023-07-09T21:35:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.622+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9d14014820 con 0x7f9d1c0d0780 2023-07-09T21:35:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.626+0000 7f9d197fa640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 0x7f9d00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.626+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9d14084dd0 con 0x7f9d1c0d0780 2023-07-09T21:35:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.626+0000 7f9d20eba640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 0x7f9d00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.626+0000 7f9d20eba640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 0x7f9d00068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9d10001280 tx=0x7f9d10009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.626+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9d14051d90 con 0x7f9d1c0d0780 2023-07-09T21:35:20.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.802+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d1c0cff80 con 0x7f9d00066480 2023-07-09T21:35:20.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d197fa640 1 -- 172.21.15.37:0/4227791445 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f9d10001d20 con 0x7f9d00066480 2023-07-09T21:35:20.875 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2023-07-09T21:35:20.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 msgr2=0x7f9d00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 0x7f9d00068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9d10001280 tx=0x7f9d10009040 comp rx=0 tx=0).stop 2023-07-09T21:35:20.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 msgr2=0x7f9d1c151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:20.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400efc0 tx=0x7f9d1400c490 comp rx=0 tx=0).stop 2023-07-09T21:35:20.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 shutdown_connections 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9d00066480 0x7f9d00068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d1c0d0780 0x7f9d1c151a40 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9d1c0cf290 0x7f9d1c0c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 --2- 172.21.15.37:0/4227791445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9d1c0b7980 0x7f9d1c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 >> 172.21.15.37:0/4227791445 conn(0x7f9d1c073090 msgr2=0x7f9d1c0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 shutdown_connections 2023-07-09T21:35:20.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:20.874+0000 7f9d2311e640 1 -- 172.21.15.37:0/4227791445 wait complete. 2023-07-09T21:35:20.896 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2023-07-09T21:35:20.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir4 1M 2023-07-09T21:35:21.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 Processor -- start 2023-07-09T21:35:21.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 -- start start 2023-07-09T21:35:21.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ae80b7980 0x7f8ae8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae815bf80 con 0x7f8ae80d0780 2023-07-09T21:35:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae8160570 con 0x7f8ae80ceb80 2023-07-09T21:35:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aeefba640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae80cd070 con 0x7f8ae80b7980 2023-07-09T21:35:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aecd56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ae80b7980 0x7f8ae8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aed557640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8ae80d0780 0x7f8ae80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53232/0 (socket says 172.21.15.37:53232) 2023-07-09T21:35:21.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.042+0000 7f8aed557640 1 -- 172.21.15.37:0/482407857 learned_addr learned my addr 172.21.15.37:0/482407857 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:21.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8aecd56640 1 -- 172.21.15.37:0/482407857 >> v1:172.21.15.119:6789/0 conn(0x7f8ae80ceb80 legacy=0x7f8ae80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8aecd56640 1 -- 172.21.15.37:0/482407857 >> v1:172.21.15.37:6789/0 conn(0x7f8ae80d0780 legacy=0x7f8ae80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8ae77fe640 1 -- 172.21.15.37:0/482407857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558889121 0 0) 0x7f8ae00014a0 con 0x7f8ae80d0780 2023-07-09T21:35:21.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8aecd56640 1 -- 172.21.15.37:0/482407857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80d02f0 con 0x7f8ae80b7980 2023-07-09T21:35:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8aecd56640 1 --2- 172.21.15.37:0/482407857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80b7980 0x7f8ae8160030 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0097c0 tx=0x7f8adc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a19df3528b3f6ed server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8ae77fe640 1 -- 172.21.15.37:0/482407857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0ab600 con 0x7f8ae80b7980 2023-07-09T21:35:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8ae77fe640 1 -- 172.21.15.37:0/482407857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0a7050 con 0x7f8ae80b7980 2023-07-09T21:35:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.046+0000 7f8ae77fe640 1 -- 172.21.15.37:0/482407857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0ab980 con 0x7f8ae80b7980 2023-07-09T21:35:21.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- 172.21.15.37:0/482407857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80b7980 msgr2=0x7f8ae8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 --2- 172.21.15.37:0/482407857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80b7980 0x7f8ae8160030 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0097c0 tx=0x7f8adc01c480 comp rx=0 tx=0).stop 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- 172.21.15.37:0/482407857 shutdown_connections 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 --2- 172.21.15.37:0/482407857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80b7980 0x7f8ae8160030 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- 172.21.15.37:0/482407857 >> 172.21.15.37:0/482407857 conn(0x7f8ae8073090 msgr2=0x7f8ae8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- 172.21.15.37:0/482407857 shutdown_connections 2023-07-09T21:35:21.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- 172.21.15.37:0/482407857 wait complete. 2023-07-09T21:35:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 Processor -- start 2023-07-09T21:35:21.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- start start 2023-07-09T21:35:21.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 0x7f8ae80c5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 0x7f8ae814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae814fa60 con 0x7f8ae80ceb80 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae81508d0 con 0x7f8ae80d0780 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aeefba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae814fc50 con 0x7f8ae80b7980 2023-07-09T21:35:21.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39396/0 (socket says 172.21.15.37:39396) 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 -- 172.21.15.37:0/2907350759 learned_addr learned my addr 172.21.15.37:0/2907350759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aed557640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 0x7f8ae814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aecd56640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 0x7f8ae80c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 -- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 msgr2=0x7f8ae80c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 0x7f8ae80c5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 -- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 msgr2=0x7f8ae814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 0x7f8ae814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8ae7fff640 1 -- 172.21.15.37:0/2907350759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009420 con 0x7f8ae80ceb80 2023-07-09T21:35:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aecd56640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 0x7f8ae80c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.050+0000 7f8aed557640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 0x7f8ae814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae7fff640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c500 tx=0x7f8ad400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4005220 con 0x7f8ae80ceb80 2023-07-09T21:35:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad4005380 con 0x7f8ae80ceb80 2023-07-09T21:35:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4007270 con 0x7f8ae80ceb80 2023-07-09T21:35:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae814ff30 con 0x7f8ae80ceb80 2023-07-09T21:35:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae81504f0 con 0x7f8ae80ceb80 2023-07-09T21:35:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae804d7d0 con 0x7f8ae80ceb80 2023-07-09T21:35:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f8ad40073d0 con 0x7f8ae80ceb80 2023-07-09T21:35:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 0x7f8acc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f8ad4083a10 con 0x7f8ae80ceb80 2023-07-09T21:35:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.054+0000 7f8aecd56640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 0x7f8acc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.058+0000 7f8aecd56640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 0x7f8acc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0ad000 tx=0x7f8adc008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.058+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ad4050a60 con 0x7f8ae80ceb80 2023-07-09T21:35:21.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.234+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ae80cff80 con 0x7f8acc066480 2023-07-09T21:35:21.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8ae57fa640 1 -- 172.21.15.37:0/2907350759 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8adc0ab880 con 0x7f8acc066480 2023-07-09T21:35:21.301 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2023-07-09T21:35:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 msgr2=0x7f8acc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 0x7f8acc068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8adc0ad000 tx=0x7f8adc008040 comp rx=0 tx=0).stop 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 msgr2=0x7f8ae814e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8ad400c500 tx=0x7f8ad400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 shutdown_connections 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f8acc066480 0x7f8acc068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae80d0780 0x7f8ae814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80ceb80 0x7f8ae814e300 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 --2- 172.21.15.37:0/2907350759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae80b7980 0x7f8ae80c5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 >> 172.21.15.37:0/2907350759 conn(0x7f8ae8073090 msgr2=0x7f8ae8154110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 shutdown_connections 2023-07-09T21:35:21.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.298+0000 7f8aeefba640 1 -- 172.21.15.37:0/2907350759 wait complete. 2023-07-09T21:35:21.322 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2023-07-09T21:35:21.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir5 1M 2023-07-09T21:35:21.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 Processor -- start 2023-07-09T21:35:21.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 -- start start 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed400cf290 0x7fed40160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed400d0780 0x7fed400d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4015bf80 con 0x7fed400b7980 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400cd070 con 0x7fed400cf290 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.466+0000 7fed4669c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed400cfd70 con 0x7fed400d0780 2023-07-09T21:35:21.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed400b7980 0x7fed400ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53248/0 (socket says 172.21.15.37:53248) 2023-07-09T21:35:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3ffff640 1 -- 172.21.15.37:0/1289392930 learned_addr learned my addr 172.21.15.37:0/1289392930 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1289392930 >> v2:172.21.15.37:3300/0 conn(0x7fed400cf290 0x7fed40160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed44c39640 1 --2- 172.21.15.37:0/1289392930 >> v2:172.21.15.119:3300/0 conn(0x7fed400d0780 0x7fed400d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3effd640 1 -- 172.21.15.37:0/1289392930 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039695271 0 0) 0x7fed30001120 con 0x7fed400b7980 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3effd640 1 -- 172.21.15.37:0/1289392930 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed28003530 con 0x7fed400b7980 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 -- 172.21.15.37:0/1289392930 >> v2:172.21.15.119:3300/0 conn(0x7fed400d0780 msgr2=0x7fed400d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1289392930 >> v2:172.21.15.119:3300/0 conn(0x7fed400d0780 0x7fed400d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 -- 172.21.15.37:0/1289392930 >> v1:172.21.15.37:6789/0 conn(0x7fed400b7980 legacy=0x7fed400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 -- 172.21.15.37:0/1289392930 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed40160570 con 0x7fed400cf290 2023-07-09T21:35:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/1289392930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400cf290 0x7fed40160030 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed400b1240 tx=0x7fed3401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1f037877bddbb17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3effd640 1 -- 172.21.15.37:0/1289392930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340ab600 con 0x7fed400cf290 2023-07-09T21:35:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3effd640 1 -- 172.21.15.37:0/1289392930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340a7050 con 0x7fed400cf290 2023-07-09T21:35:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.470+0000 7fed3effd640 1 -- 172.21.15.37:0/1289392930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340ab980 con 0x7fed400cf290 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- 172.21.15.37:0/1289392930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400cf290 msgr2=0x7fed40160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- 172.21.15.37:0/1289392930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400cf290 0x7fed40160030 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fed400b1240 tx=0x7fed3401c460 comp rx=0 tx=0).stop 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- 172.21.15.37:0/1289392930 shutdown_connections 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- 172.21.15.37:0/1289392930 >> v2:172.21.15.119:3300/0 conn(0x7fed400d0780 0x7fed400d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- 172.21.15.37:0/1289392930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400cf290 0x7fed40160030 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- 172.21.15.37:0/1289392930 >> 172.21.15.37:0/1289392930 conn(0x7fed40073090 msgr2=0x7fed40069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- 172.21.15.37:0/1289392930 shutdown_connections 2023-07-09T21:35:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- 172.21.15.37:0/1289392930 wait complete. 2023-07-09T21:35:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 Processor -- start 2023-07-09T21:35:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- start start 2023-07-09T21:35:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 0x7fed400b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 0x7fed400b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4015a470 con 0x7fed400d0780 2023-07-09T21:35:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed40159860 con 0x7fed400b7980 2023-07-09T21:35:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed4669c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed40159b40 con 0x7fed400cf290 2023-07-09T21:35:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed44c39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed44c39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39420/0 (socket says 172.21.15.37:39420) 2023-07-09T21:35:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed44c39640 1 -- 172.21.15.37:0/3238834901 learned_addr learned my addr 172.21.15.37:0/3238834901 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 0x7fed400b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.474+0000 7fed3ffff640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 0x7fed400b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 -- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 msgr2=0x7fed400b5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 0x7fed400b5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 -- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 msgr2=0x7fed400b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 0x7fed400b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 -- 172.21.15.37:0/3238834901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed34009420 con 0x7fed400d0780 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3f7fe640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 0x7fed400b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3ffff640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 0x7fed400b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed44c39640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fed3800efc0 tx=0x7fed3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed38009ba0 con 0x7fed400d0780 2023-07-09T21:35:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3800f040 con 0x7fed400d0780 2023-07-09T21:35:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed380146c0 con 0x7fed400d0780 2023-07-09T21:35:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed40159e20 con 0x7fed400d0780 2023-07-09T21:35:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed400b48e0 con 0x7fed400d0780 2023-07-09T21:35:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4015a5e0 con 0x7fed400d0780 2023-07-09T21:35:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fed38014820 con 0x7fed400d0780 2023-07-09T21:35:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.478+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fed38084dd0 con 0x7fed400d0780 2023-07-09T21:35:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.482+0000 7fed3ffff640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.482+0000 7fed3ffff640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 0x7fed2c068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed30007fd0 tx=0x7fed30009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.482+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed38051d90 con 0x7fed400d0780 2023-07-09T21:35:21.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.658+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fed400cff80 con 0x7fed2c066480 2023-07-09T21:35:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed3cff9640 1 -- 172.21.15.37:0/3238834901 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fed30001470 con 0x7fed2c066480 2023-07-09T21:35:21.725 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2023-07-09T21:35:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 msgr2=0x7fed2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 0x7fed2c068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fed30007fd0 tx=0x7fed30009040 comp rx=0 tx=0).stop 2023-07-09T21:35:21.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 msgr2=0x7fed400b1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fed3800efc0 tx=0x7fed3800c490 comp rx=0 tx=0).stop 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 shutdown_connections 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fed2c066480 0x7fed2c068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed400d0780 0x7fed400b1f30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed400cf290 0x7fed400b5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 --2- 172.21.15.37:0/3238834901 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed400b7980 0x7fed400b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 >> 172.21.15.37:0/3238834901 conn(0x7fed40073090 msgr2=0x7fed40158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:21.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 shutdown_connections 2023-07-09T21:35:21.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.722+0000 7fed4669c640 1 -- 172.21.15.37:0/3238834901 wait complete. 2023-07-09T21:35:21.745 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2023-07-09T21:35:21.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir6 1M 2023-07-09T21:35:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.890+0000 7fe7c978f640 1 Processor -- start 2023-07-09T21:35:21.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.890+0000 7fe7c978f640 1 -- start start 2023-07-09T21:35:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c978f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe7c40cf290 0x7fe7c4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c978f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c415bf80 con 0x7fe7c40d0780 2023-07-09T21:35:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c978f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c4160570 con 0x7fe7c40b7980 2023-07-09T21:35:21.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c978f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd070 con 0x7fe7c40cf290 2023-07-09T21:35:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe7c40d0780 0x7fe7c40d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53262/0 (socket says 172.21.15.37:53262) 2023-07-09T21:35:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2132759604 learned_addr learned my addr 172.21.15.37:0/2132759604 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2132759604 >> v2:172.21.15.119:3300/0 conn(0x7fe7c40cf290 0x7fe7c4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471702874 0 0) 0x7fe7bc0014a0 con 0x7fe7c40d0780 2023-07-09T21:35:21.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b0003530 con 0x7fe7c40d0780 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719750879 0 0) 0x7fe7b0003530 con 0x7fe7c40d0780 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 >> v2:172.21.15.119:3300/0 conn(0x7fe7c40cf290 msgr2=0x7fe7c4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 --2- 172.21.15.37:0/2132759604 >> v2:172.21.15.119:3300/0 conn(0x7fe7c40cf290 0x7fe7c4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 >> v1:172.21.15.119:6789/0 conn(0x7fe7c40b7980 legacy=0x7fe7c40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c40d02f0 con 0x7fe7c40d0780 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe7bc001b90 con 0x7fe7c40d0780 2023-07-09T21:35:21.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 >> v1:172.21.15.37:6789/0 conn(0x7fe7c40d0780 legacy=0x7fe7c40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0003980 0x7fe7b0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 0x7fe7b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b0005180 0x7fe7b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40cd070 con 0x7fe7b00047d0 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000c000 con 0x7fe7b0003980 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b000c1c0 con 0x7fe7b0005180 2023-07-09T21:35:21.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 0x7fe7b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c2ffd640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0003980 0x7fe7b0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c37fe640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b0005180 0x7fe7b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 -- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b0005180 msgr2=0x7fe7b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b0005180 0x7fe7b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 -- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0003980 msgr2=0x7fe7b0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7b0003980 0x7fe7b0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7bbfff640 1 -- 172.21.15.37:0/2132759604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b0003530 con 0x7fe7b00047d0 2023-07-09T21:35:21.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.894+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2132759604 reap_dead start 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 0x7fe7b0004c40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009ab0 tx=0x7fe7ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6553c3ed29f1b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0a5540 con 0x7fe7b00047d0 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac0a56a0 con 0x7fe7b00047d0 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c27fc640 1 -- 172.21.15.37:0/2132759604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0a5a50 con 0x7fe7b00047d0 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 msgr2=0x7fe7b0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 0x7fe7b0004c40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009ab0 tx=0x7fe7ac01ca30 comp rx=0 tx=0).stop 2023-07-09T21:35:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- 172.21.15.37:0/2132759604 shutdown_connections 2023-07-09T21:35:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2132759604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7b00047d0 0x7fe7b0004c40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- 172.21.15.37:0/2132759604 >> 172.21.15.37:0/2132759604 conn(0x7fe7c4073090 msgr2=0x7fe7c4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- 172.21.15.37:0/2132759604 shutdown_connections 2023-07-09T21:35:21.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- 172.21.15.37:0/2132759604 wait complete. 2023-07-09T21:35:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 Processor -- start 2023-07-09T21:35:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.898+0000 7fe7c978f640 1 -- start start 2023-07-09T21:35:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b00047d0 0x7fe7c41501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7c40c9270 0x7fe7c40d1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c40cb970 con 0x7fe7c40c96e0 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c415c120 con 0x7fe7c40c9270 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4150700 con 0x7fe7b00047d0 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39442/0 (socket says 172.21.15.37:39442) 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2505033161 learned_addr learned my addr 172.21.15.37:0/2505033161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:21.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7bbfff640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7c40c9270 0x7fe7c40d1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c2ffd640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b00047d0 0x7fe7c41501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b00047d0 msgr2=0x7fe7c41501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b00047d0 0x7fe7c41501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7c40c9270 msgr2=0x7fe7c40d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7c40c9270 0x7fe7c40d1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 -- 172.21.15.37:0/2505033161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c415c370 con 0x7fe7c40c96e0 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c37fe640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe7c408ad30 tx=0x7fe7bc011620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc011de0 con 0x7fe7c40c96e0 2023-07-09T21:35:21.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7bc014370 con 0x7fe7c40c96e0 2023-07-09T21:35:21.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc014720 con 0x7fe7c40c96e0 2023-07-09T21:35:21.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c415c650 con 0x7fe7c40c96e0 2023-07-09T21:35:21.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c415cc10 con 0x7fe7c40c96e0 2023-07-09T21:35:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c415ce30 con 0x7fe7c40c96e0 2023-07-09T21:35:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.902+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe7bc014880 con 0x7fe7c40c96e0 2023-07-09T21:35:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.906+0000 7fe7bb7fe640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 0x7fe7a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.906+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fe7bc0860d0 con 0x7fe7c40c96e0 2023-07-09T21:35:21.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.906+0000 7fe7c2ffd640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 0x7fe7a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:21.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.906+0000 7fe7c2ffd640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 0x7fe7a4068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000c10 tx=0x7fe7b4009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:21.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:21.910+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe7bc053270 con 0x7fe7c40c96e0 2023-07-09T21:35:22.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.086+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c40ccab0 con 0x7fe7a4066480 2023-07-09T21:35:22.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.146+0000 7fe7bb7fe640 1 -- 172.21.15.37:0/2505033161 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fe7b4001590 con 0x7fe7a4066480 2023-07-09T21:35:22.150 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2023-07-09T21:35:22.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 msgr2=0x7fe7a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 0x7fe7a4068930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4000c10 tx=0x7fe7b4009040 comp rx=0 tx=0).stop 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 msgr2=0x7fe7c40d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe7c408ad30 tx=0x7fe7bc011620 comp rx=0 tx=0).stop 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 shutdown_connections 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe7a4066480 0x7fe7a4068930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe7c40c96e0 0x7fe7c40d15d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe7c40c9270 0x7fe7c40d1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 --2- 172.21.15.37:0/2505033161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe7b00047d0 0x7fe7c41501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 >> 172.21.15.37:0/2505033161 conn(0x7fe7c4073090 msgr2=0x7fe7c415a390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:22.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 shutdown_connections 2023-07-09T21:35:22.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.150+0000 7fe7c978f640 1 -- 172.21.15.37:0/2505033161 wait complete. 2023-07-09T21:35:22.171 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2023-07-09T21:35:22.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir7 1M 2023-07-09T21:35:22.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.318+0000 7f6ef679f640 1 Processor -- start 2023-07-09T21:35:22.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.318+0000 7f6ef679f640 1 -- start start 2023-07-09T21:35:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.318+0000 7f6ef679f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ef01585b0 0x7f6ef006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6ef679f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00c9090 con 0x7f6ef00c4520 2023-07-09T21:35:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6ef679f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef00c8a60 con 0x7f6ef006b970 2023-07-09T21:35:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6ef679f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef00cbf40 con 0x7f6ef01585b0 2023-07-09T21:35:22.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ef01585b0 0x7f6ef006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6ef4d3c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6ef00c4520 0x7f6ef015c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53266/0 (socket says 172.21.15.37:53266) 2023-07-09T21:35:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6ef4d3c640 1 -- 172.21.15.37:0/1901715668 learned_addr learned my addr 172.21.15.37:0/1901715668 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:22.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134625318 0 0) 0x7f6ef00c9090 con 0x7f6ef00c4520 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed8005740 con 0x7f6ef00c4520 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244839449 0 0) 0x7f6ef00c8a60 con 0x7f6ef006b970 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef00c9090 con 0x7f6ef006b970 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeffff640 1 -- 172.21.15.37:0/1901715668 >> v1:172.21.15.119:6789/0 conn(0x7f6ef006b970 legacy=0x7f6ef00c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeffff640 1 -- 172.21.15.37:0/1901715668 >> v1:172.21.15.37:6789/0 conn(0x7f6ef00c4520 legacy=0x7f6ef015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeffff640 1 -- 172.21.15.37:0/1901715668 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef015ce10 con 0x7f6ef01585b0 2023-07-09T21:35:22.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeffff640 1 --2- 172.21.15.37:0/1901715668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef01585b0 0x7f6ef006b430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d099c8167ddac077 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00ab670 con 0x7f6ef01585b0 2023-07-09T21:35:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00ab7d0 con 0x7f6ef01585b0 2023-07-09T21:35:22.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.322+0000 7f6eeeffd640 1 -- 172.21.15.37:0/1901715668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00abb60 con 0x7f6ef01585b0 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- 172.21.15.37:0/1901715668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef01585b0 msgr2=0x7f6ef006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 --2- 172.21.15.37:0/1901715668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef01585b0 0x7f6ef006b430 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee001c450 comp rx=0 tx=0).stop 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- 172.21.15.37:0/1901715668 shutdown_connections 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 --2- 172.21.15.37:0/1901715668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef01585b0 0x7f6ef006b430 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- 172.21.15.37:0/1901715668 >> 172.21.15.37:0/1901715668 conn(0x7f6ef00cde40 msgr2=0x7f6ef00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:22.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- 172.21.15.37:0/1901715668 shutdown_connections 2023-07-09T21:35:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- 172.21.15.37:0/1901715668 wait complete. 2023-07-09T21:35:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 Processor -- start 2023-07-09T21:35:22.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- start start 2023-07-09T21:35:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef006b970 0x7f6ef015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef01585b0 0x7f6ef014bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0158fd0 con 0x7f6ef00c4520 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015b7e0 con 0x7f6ef006b970 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef679f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0158c80 con 0x7f6ef01585b0 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6eef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6eef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39466/0 (socket says 172.21.15.37:39466) 2023-07-09T21:35:22.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6eef7fe640 1 -- 172.21.15.37:0/3192083313 learned_addr learned my addr 172.21.15.37:0/3192083313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6eeffff640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef006b970 0x7f6ef015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.326+0000 7f6ef4d3c640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef01585b0 0x7f6ef014bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 -- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef01585b0 msgr2=0x7f6ef014bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef01585b0 0x7f6ef014bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 -- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef006b970 msgr2=0x7f6ef015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef006b970 0x7f6ef015b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 -- 172.21.15.37:0/3192083313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009420 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c4c0 tx=0x7f6ee400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee40052d0 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4005430 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4012870 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef0144e90 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef0145450 con 0x7f6ef00c4520 2023-07-09T21:35:22.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0159110 con 0x7f6ef00c4520 2023-07-09T21:35:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f6ee40129d0 con 0x7f6ef00c4520 2023-07-09T21:35:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 0x7f6edc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.330+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f6ee4083c70 con 0x7f6ef00c4520 2023-07-09T21:35:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.334+0000 7f6eeffff640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 0x7f6edc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.334+0000 7f6eeffff640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 0x7f6edc068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00af000 tx=0x7f6ee00a7000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.334+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ef0159110 con 0x7f6ef00c4520 2023-07-09T21:35:22.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.514+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef00c2d00 con 0x7f6edc066480 2023-07-09T21:35:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6eecff9640 1 -- 172.21.15.37:0/3192083313 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f6ee00ab940 con 0x7f6edc066480 2023-07-09T21:35:22.583 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2023-07-09T21:35:22.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 msgr2=0x7f6edc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 0x7f6edc068930 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00af000 tx=0x7f6ee00a7000 comp rx=0 tx=0).stop 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 msgr2=0x7f6ef0144640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6ee400c4c0 tx=0x7f6ee400c980 comp rx=0 tx=0).stop 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 shutdown_connections 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6edc066480 0x7f6edc068930 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef01585b0 0x7f6ef014bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef00c4520 0x7f6ef0144640 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 --2- 172.21.15.37:0/3192083313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef006b970 0x7f6ef015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 >> 172.21.15.37:0/3192083313 conn(0x7f6ef00cde40 msgr2=0x7f6ef006c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 shutdown_connections 2023-07-09T21:35:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.582+0000 7f6ef679f640 1 -- 172.21.15.37:0/3192083313 wait complete. 2023-07-09T21:35:22.604 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2023-07-09T21:35:22.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir8 1M 2023-07-09T21:35:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 Processor -- start 2023-07-09T21:35:22.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 -- start start 2023-07-09T21:35:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34ec0d0780 0x7f34ec0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ec15bf80 con 0x7f34ec0b7980 2023-07-09T21:35:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ec0cd070 con 0x7f34ec0d0780 2023-07-09T21:35:22.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f38ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec0cfd70 con 0x7f34ec0cf290 2023-07-09T21:35:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34ec0d0780 0x7f34ec0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f0e87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f34ec0d0780 0x7f34ec0d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:44584/0 (socket says 172.21.15.37:44584) 2023-07-09T21:35:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 -- 172.21.15.37:0/463546165 learned_addr learned my addr 172.21.15.37:0/463546165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 -- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 msgr2=0x7f34ec160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 --2- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 -- 172.21.15.37:0/463546165 >> v1:172.21.15.119:6789/0 conn(0x7f34ec0b7980 legacy=0x7f34ec0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.750+0000 7f34f1e89640 1 -- 172.21.15.37:0/463546165 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec160570 con 0x7f34ec0d0780 2023-07-09T21:35:22.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f1e89640 1 --2- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0d0780 0x7f34ec0d0c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009e50 tx=0x7f34e401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64f544eb312bdcbb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34e3fff640 1 -- 172.21.15.37:0/463546165 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40a56e0 con 0x7f34ec0d0780 2023-07-09T21:35:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34e3fff640 1 -- 172.21.15.37:0/463546165 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e40a5840 con 0x7f34ec0d0780 2023-07-09T21:35:22.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34e3fff640 1 -- 172.21.15.37:0/463546165 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40a5bd0 con 0x7f34ec0d0780 2023-07-09T21:35:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 -- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0d0780 msgr2=0x7f34ec0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 --2- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0d0780 0x7f34ec0d0c00 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f34e4009e50 tx=0x7f34e401ca10 comp rx=0 tx=0).stop 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 -- 172.21.15.37:0/463546165 shutdown_connections 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 --2- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0d0780 0x7f34ec0d0c00 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 --2- 172.21.15.37:0/463546165 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 -- 172.21.15.37:0/463546165 >> 172.21.15.37:0/463546165 conn(0x7f34ec073090 msgr2=0x7f34ec069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 -- 172.21.15.37:0/463546165 shutdown_connections 2023-07-09T21:35:22.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.754+0000 7f34f38ec640 1 -- 172.21.15.37:0/463546165 wait complete. 2023-07-09T21:35:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 Processor -- start 2023-07-09T21:35:22.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- start start 2023-07-09T21:35:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0b7980 0x7f34ec151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec0b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec152140 con 0x7f34ec0d0780 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15a3d0 con 0x7f34ec0b7980 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec15a6b0 con 0x7f34ec0cf290 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39482/0 (socket says 172.21.15.37:39482) 2023-07-09T21:35:22.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 -- 172.21.15.37:0/1672079142 learned_addr learned my addr 172.21.15.37:0/1672079142 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f0e87640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec0b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1688640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0b7980 0x7f34ec151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 -- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 msgr2=0x7f34ec0b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec0b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 -- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0b7980 msgr2=0x7f34ec151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0b7980 0x7f34ec151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:22.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 -- 172.21.15.37:0/1672079142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e4009b30 con 0x7f34ec0d0780 2023-07-09T21:35:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f1e89640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f34e401a640 tx=0x7f34e40197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40a56e0 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e40b88a0 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e40b8c50 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec15a990 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.758+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec15af50 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec04d7d0 con 0x7f34ec0d0780 2023-07-09T21:35:22.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f34e40b6440 con 0x7f34ec0d0780 2023-07-09T21:35:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34e1ffb640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 0x7f34d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f34e411f890 con 0x7f34ec0d0780 2023-07-09T21:35:22.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34f1688640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 0x7f34d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:22.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.762+0000 7f34f1688640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 0x7f34d0068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34ec15f0d0 tx=0x7f34e8009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:22.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.766+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34e40ec9a0 con 0x7f34ec0d0780 2023-07-09T21:35:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:22.938+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ec0cff80 con 0x7f34d0066480 2023-07-09T21:35:23.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.002+0000 7f34e1ffb640 1 -- 172.21.15.37:0/1672079142 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f34e80050d0 con 0x7f34d0066480 2023-07-09T21:35:23.007 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 msgr2=0x7f34d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 0x7f34d0068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34ec15f0d0 tx=0x7f34e8009040 comp rx=0 tx=0).stop 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 msgr2=0x7f34ec15b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f34e401a640 tx=0x7f34e40197b0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 shutdown_connections 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f34d0066480 0x7f34d0068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ec0d0780 0x7f34ec15b470 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34ec0cf290 0x7f34ec0b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 --2- 172.21.15.37:0/1672079142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34ec0b7980 0x7f34ec151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 >> 172.21.15.37:0/1672079142 conn(0x7f34ec073090 msgr2=0x7f34ec1586a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 shutdown_connections 2023-07-09T21:35:23.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.006+0000 7f34f38ec640 1 -- 172.21.15.37:0/1672079142 wait complete. 2023-07-09T21:35:23.027 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2023-07-09T21:35:23.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/dir9 1M 2023-07-09T21:35:23.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 Processor -- start 2023-07-09T21:35:23.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 -- start start 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fce14160030 0x7fce140d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1415bf80 con 0x7fce140cf290 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce140d02f0 con 0x7fce140b7980 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce18e7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce140cd070 con 0x7fce14160030 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce11d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce140cf290 0x7fce140d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53268/0 (socket says 172.21.15.37:53268) 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.174+0000 7fce11d9b640 1 -- 172.21.15.37:0/1644276730 learned_addr learned my addr 172.21.15.37:0/1644276730 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:23.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1644276730 >> v2:172.21.15.119:3300/0 conn(0x7fce14160030 0x7fce140d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498571643 0 0) 0x7fce08001120 con 0x7fce140cf290 2023-07-09T21:35:23.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdfc003530 con 0x7fce140cf290 2023-07-09T21:35:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 966864514 0 0) 0x7fcdfc003530 con 0x7fce140cf290 2023-07-09T21:35:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 >> v2:172.21.15.119:3300/0 conn(0x7fce14160030 msgr2=0x7fce140d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:23.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 --2- 172.21.15.37:0/1644276730 >> v2:172.21.15.119:3300/0 conn(0x7fce14160030 0x7fce140d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 >> v1:172.21.15.119:6789/0 conn(0x7fce140b7980 legacy=0x7fce140ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce140cc7f0 con 0x7fce140cf290 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fce08001810 con 0x7fce140cf290 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1644276730 >> v2:172.21.15.119:3300/0 conn(0x7fce14160030 0x7fce140d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 >> v1:172.21.15.37:6789/0 conn(0x7fce140cf290 legacy=0x7fce140d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdfc003980 0x7fcdfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 0x7fcdfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc005180 0x7fcdfc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140cd070 con 0x7fcdfc0047d0 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc00c000 con 0x7fcdfc005180 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc00c1c0 con 0x7fcdfc003980 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 0x7fcdfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc005180 0x7fcdfc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce1259c640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdfc003980 0x7fcdfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 -- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdfc003980 msgr2=0x7fcdfc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcdfc003980 0x7fcdfc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 -- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc005180 msgr2=0x7fcdfc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc005180 0x7fcdfc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce11d9b640 1 -- 172.21.15.37:0/1644276730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc003530 con 0x7fcdfc0047d0 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc005180 0x7fcdfc00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:23.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.178+0000 7fce12d9d640 1 -- 172.21.15.37:0/1644276730 reap_dead start 2023-07-09T21:35:23.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce11d9b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 0x7fcdfc004c40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c210 tx=0x7fce0801f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add83803652cbb06 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce080a8e10 con 0x7fcdfc0047d0 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce080058e0 con 0x7fcdfc0047d0 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce1159a640 1 -- 172.21.15.37:0/1644276730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce08005cd0 con 0x7fcdfc0047d0 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 msgr2=0x7fcdfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 0x7fcdfc004c40 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fce0800c210 tx=0x7fce0801f2f0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- 172.21.15.37:0/1644276730 shutdown_connections 2023-07-09T21:35:23.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1644276730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047d0 0x7fcdfc004c40 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- 172.21.15.37:0/1644276730 >> 172.21.15.37:0/1644276730 conn(0x7fce14073090 msgr2=0x7fce14069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- 172.21.15.37:0/1644276730 shutdown_connections 2023-07-09T21:35:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- 172.21.15.37:0/1644276730 wait complete. 2023-07-09T21:35:23.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 Processor -- start 2023-07-09T21:35:23.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.182+0000 7fce18e7b640 1 -- start start 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc0047d0 0x7fce141502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce1415d6f0 0x7fce1415aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce140c5cb0 con 0x7fce1415db40 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1415e100 con 0x7fcdfc0047d0 2023-07-09T21:35:23.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce140c5e90 con 0x7fce1415d6f0 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39494/0 (socket says 172.21.15.37:39494) 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 -- 172.21.15.37:0/1800095988 learned_addr learned my addr 172.21.15.37:0/1800095988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce1259c640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc0047d0 0x7fce141502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce11d9b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce1415d6f0 0x7fce1415aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 -- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce1415d6f0 msgr2=0x7fce1415aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce1415d6f0 0x7fce1415aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 -- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc0047d0 msgr2=0x7fce141502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc0047d0 0x7fce141502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 -- 172.21.15.37:0/1800095988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce140c6170 con 0x7fce1415db40 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce12d9d640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fce1408ad30 tx=0x7fce0c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c00e040 con 0x7fce1415db40 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c00f040 con 0x7fce1415db40 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c003da0 con 0x7fce1415db40 2023-07-09T21:35:23.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce140c6450 con 0x7fce1415db40 2023-07-09T21:35:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce14150a90 con 0x7fce1415db40 2023-07-09T21:35:23.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce140c6b40 con 0x7fce1415db40 2023-07-09T21:35:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.186+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fce0c00f730 con 0x7fce1415db40 2023-07-09T21:35:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.190+0000 7fce02ffd640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 0x7fcdf4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.190+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fce0c0843f0 con 0x7fce1415db40 2023-07-09T21:35:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.190+0000 7fce1259c640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 0x7fcdf4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.190+0000 7fce1259c640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 0x7fcdf4068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fce04007fd0 tx=0x7fce04009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.194+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce0c051460 con 0x7fce1415db40 2023-07-09T21:35:23.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.366+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fce14150cb0 con 0x7fcdf40664b0 2023-07-09T21:35:23.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.430+0000 7fce02ffd640 1 -- 172.21.15.37:0/1800095988 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fce14150cb0 con 0x7fcdf40664b0 2023-07-09T21:35:23.434 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2023-07-09T21:35:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 msgr2=0x7fcdf4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 0x7fcdf4068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fce04007fd0 tx=0x7fce04009040 comp rx=0 tx=0).stop 2023-07-09T21:35:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 msgr2=0x7fce1415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fce1408ad30 tx=0x7fce0c00f4a0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 shutdown_connections 2023-07-09T21:35:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fcdf40664b0 0x7fcdf4068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce1415db40 0x7fce1415b000 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fce1415d6f0 0x7fce1415aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 --2- 172.21.15.37:0/1800095988 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcdfc0047d0 0x7fce141502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 >> 172.21.15.37:0/1800095988 conn(0x7fce14073090 msgr2=0x7fce140d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 shutdown_connections 2023-07-09T21:35:23.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.434+0000 7fce18e7b640 1 -- 172.21.15.37:0/1800095988 wait complete. 2023-07-09T21:35:23.455 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2023-07-09T21:35:23.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:23.456 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:23.472 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_01_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:23.473 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:23.474 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_01_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:23.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir0 2023-07-09T21:35:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 Processor -- start 2023-07-09T21:35:23.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 -- start start 2023-07-09T21:35:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57380ceb80 0x7f57380cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573815bf80 con 0x7f57380b3c20 2023-07-09T21:35:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57380cd070 con 0x7f57380ceb80 2023-07-09T21:35:23.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f573d4a9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57380cfd70 con 0x7f57380b7980 2023-07-09T21:35:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f5736ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f572ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57380ceb80 0x7f57380cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f5736ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:59444/0 (socket says 172.21.15.37:59444) 2023-07-09T21:35:23.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f5736ffd640 1 -- 172.21.15.37:0/3717392655 learned_addr learned my addr 172.21.15.37:0/3717392655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f572ffff640 1 -- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 msgr2=0x7f5738160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f572ffff640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f572ffff640 1 -- 172.21.15.37:0/3717392655 >> v1:172.21.15.119:6789/0 conn(0x7f57380b3c20 legacy=0x7f57380b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f572ffff640 1 -- 172.21.15.37:0/3717392655 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738160570 con 0x7f57380ceb80 2023-07-09T21:35:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f57367fc640 1 -- 172.21.15.37:0/3717392655 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709665431 0 0) 0x7f57300014a0 con 0x7f57380b3c20 2023-07-09T21:35:23.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.658+0000 7f5736ffd640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f572ffff640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380ceb80 0x7f57380cef90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57200097c0 tx=0x7f572001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67368192ba111df6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f57367fc640 1 -- 172.21.15.37:0/3717392655 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200ab600 con 0x7f57380ceb80 2023-07-09T21:35:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f57367fc640 1 -- 172.21.15.37:0/3717392655 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57200a7050 con 0x7f57380ceb80 2023-07-09T21:35:23.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f57367fc640 1 -- 172.21.15.37:0/3717392655 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200ab980 con 0x7f57380ceb80 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 -- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380ceb80 msgr2=0x7f57380cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380ceb80 0x7f57380cef90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f57200097c0 tx=0x7f572001c480 comp rx=0 tx=0).stop 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 -- 172.21.15.37:0/3717392655 shutdown_connections 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380ceb80 0x7f57380cef90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3717392655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b7980 0x7f5738160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 -- 172.21.15.37:0/3717392655 >> 172.21.15.37:0/3717392655 conn(0x7f5738073090 msgr2=0x7f5738069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 -- 172.21.15.37:0/3717392655 shutdown_connections 2023-07-09T21:35:23.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.662+0000 7f573d4a9640 1 -- 172.21.15.37:0/3717392655 wait complete. 2023-07-09T21:35:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 Processor -- start 2023-07-09T21:35:23.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- start start 2023-07-09T21:35:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b3c20 0x7f5738157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380b7980 0x7f57381528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738154050 con 0x7f57380ceb80 2023-07-09T21:35:23.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738158390 con 0x7f57380b7980 2023-07-09T21:35:23.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5738153440 con 0x7f57380b3c20 2023-07-09T21:35:23.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39510/0 (socket says 172.21.15.37:39510) 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 -- 172.21.15.37:0/3831763048 learned_addr learned my addr 172.21.15.37:0/3831763048 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f5736ffd640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b3c20 0x7f5738157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f572ffff640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380b7980 0x7f57381528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 -- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b3c20 msgr2=0x7f5738157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b3c20 0x7f5738157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 -- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380b7980 msgr2=0x7f57381528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380b7980 0x7f57381528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 -- 172.21.15.37:0/3831763048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280094d0 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f57377fe640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f573000c780 tx=0x7f573000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5730003db0 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573000ce30 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300052b0 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5720009420 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.666+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5738153a00 con 0x7f57380ceb80 2023-07-09T21:35:23.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57381541c0 con 0x7f57380ceb80 2023-07-09T21:35:23.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f5730005410 con 0x7f57380ceb80 2023-07-09T21:35:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f572f7fe640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 0x7f5718068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f5730083d80 con 0x7f57380ceb80 2023-07-09T21:35:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f5736ffd640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 0x7f5718068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:23.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.670+0000 7f5736ffd640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 0x7f5718068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57380d31c0 tx=0x7f5728009240 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:23.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.674+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5730050e70 con 0x7f57380ceb80 2023-07-09T21:35:23.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.850+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f57380ccd90 con 0x7f57180664b0 2023-07-09T21:35:23.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f572f7fe640 1 -- 172.21.15.37:0/3831763048 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f5728009980 con 0x7f57180664b0 2023-07-09T21:35:23.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:23.861 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:56", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 msgr2=0x7f5718068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 0x7f5718068960 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57380d31c0 tx=0x7f5728009240 comp rx=0 tx=0).stop 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 msgr2=0x7f573815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f573000c780 tx=0x7f573000cc40 comp rx=0 tx=0).stop 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 shutdown_connections 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f57180664b0 0x7f5718068960 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380ceb80 0x7f573815b0a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57380b7980 0x7f57381528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 --2- 172.21.15.37:0/3831763048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57380b3c20 0x7f5738157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 >> 172.21.15.37:0/3831763048 conn(0x7f5738073090 msgr2=0x7f57380d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 shutdown_connections 2023-07-09T21:35:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:23.858+0000 7f573d4a9640 1 -- 172.21.15.37:0/3831763048 wait complete. 2023-07-09T21:35:23.881 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:56", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:23.881 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:56', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:23.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:23.882 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-09T21:35:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:23.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:23.898 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:23.899 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:23.899 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:23.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir1 2023-07-09T21:35:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 Processor -- start 2023-07-09T21:35:24.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 -- start start 2023-07-09T21:35:24.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e940b7980 0x7f9e94160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9415bf80 con 0x7f9e940b3c20 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e940cd070 con 0x7f9e940b7980 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9c29e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940cfd70 con 0x7f9e940ceb80 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9a83b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e940b3c20 0x7f9e940b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53280/0 (socket says 172.21.15.37:53280) 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9a83b640 1 -- 172.21.15.37:0/236680543 learned_addr learned my addr 172.21.15.37:0/236680543 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:24.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.090+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/236680543 >> v2:172.21.15.37:3300/0 conn(0x7f9e940b7980 0x7f9e94160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e99839640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9a03a640 1 -- 172.21.15.37:0/236680543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 msgr2=0x7f9e940cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9a03a640 1 -- 172.21.15.37:0/236680543 >> v1:172.21.15.37:6789/0 conn(0x7f9e940b3c20 legacy=0x7f9e940b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9a03a640 1 -- 172.21.15.37:0/236680543 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94160570 con 0x7f9e940b7980 2023-07-09T21:35:24.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e99839640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:24.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e94160030 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e900097c0 tx=0x7f9e9001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5aa59beaf2d75bf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e99038640 1 -- 172.21.15.37:0/236680543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900ab600 con 0x7f9e940b7980 2023-07-09T21:35:24.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e99038640 1 -- 172.21.15.37:0/236680543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e900a7050 con 0x7f9e940b7980 2023-07-09T21:35:24.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e99038640 1 -- 172.21.15.37:0/236680543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e900ab980 con 0x7f9e940b7980 2023-07-09T21:35:24.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9c29e640 1 -- 172.21.15.37:0/236680543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 msgr2=0x7f9e94160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.094+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e94160030 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f9e900097c0 tx=0x7f9e9001c480 comp rx=0 tx=0).stop 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- 172.21.15.37:0/236680543 shutdown_connections 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/236680543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e94160030 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- 172.21.15.37:0/236680543 >> 172.21.15.37:0/236680543 conn(0x7f9e94073090 msgr2=0x7f9e94069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- 172.21.15.37:0/236680543 shutdown_connections 2023-07-09T21:35:24.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- 172.21.15.37:0/236680543 wait complete. 2023-07-09T21:35:24.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 Processor -- start 2023-07-09T21:35:24.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- start start 2023-07-09T21:35:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e940b3c20 0x7f9e940c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940c84f0 con 0x7f9e940b7980 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940c9de0 con 0x7f9e940b3c20 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9c29e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e940ca0c0 con 0x7f9e940ceb80 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39522/0 (socket says 172.21.15.37:39522) 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 -- 172.21.15.37:0/2518534058 learned_addr learned my addr 172.21.15.37:0/2518534058 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:24.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e940b3c20 0x7f9e940c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e9a83b640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 -- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 msgr2=0x7f9e940c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 -- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e940b3c20 msgr2=0x7f9e940c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e940b3c20 0x7f9e940c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 -- 172.21.15.37:0/2518534058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009420 con 0x7f9e940b7980 2023-07-09T21:35:24.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.098+0000 7f9e99839640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e810 tx=0x7f9e8400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400c8d0 con 0x7f9e940b7980 2023-07-09T21:35:24.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400ca30 con 0x7f9e940b7980 2023-07-09T21:35:24.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e940ca3a0 con 0x7f9e940b7980 2023-07-09T21:35:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400cde0 con 0x7f9e940b7980 2023-07-09T21:35:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e940ca960 con 0x7f9e940b7980 2023-07-09T21:35:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e940cab20 con 0x7f9e940b7980 2023-07-09T21:35:24.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f9e84013410 con 0x7f9e940b7980 2023-07-09T21:35:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 0x7f9e78068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f9e84084090 con 0x7f9e940b7980 2023-07-09T21:35:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.102+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 0x7f9e78068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.106+0000 7f9e9a03a640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 0x7f9e78068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e900ad000 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.106+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e84051120 con 0x7f9e940b7980 2023-07-09T21:35:24.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.278+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9e940ccd90 con 0x7f9e78066480 2023-07-09T21:35:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e8affd640 1 -- 172.21.15.37:0/2518534058 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f9e900ab780 con 0x7f9e78066480 2023-07-09T21:35:24.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:24.291 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:57", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 msgr2=0x7f9e78068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 0x7f9e78068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e900ad000 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2023-07-09T21:35:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 msgr2=0x7f9e940c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e810 tx=0x7f9e8400ecd0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 shutdown_connections 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9e78066480 0x7f9e78068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e940ceb80 0x7f9e940c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e940b7980 0x7f9e940c9270 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 --2- 172.21.15.37:0/2518534058 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e940b3c20 0x7f9e940c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 >> 172.21.15.37:0/2518534058 conn(0x7f9e94073090 msgr2=0x7f9e9415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 shutdown_connections 2023-07-09T21:35:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.290+0000 7f9e9c29e640 1 -- 172.21.15.37:0/2518534058 wait complete. 2023-07-09T21:35:24.311 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:57", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:24.312 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:57', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:24.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:24.312 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-09T21:35:24.327 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:24.327 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:24.328 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:24.329 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:24.329 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:24.329 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:24.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir2 2023-07-09T21:35:24.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 Processor -- start 2023-07-09T21:35:24.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 -- start start 2023-07-09T21:35:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f428c0d0780 0x7f428c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c15bf80 con 0x7f428c0ceb80 2023-07-09T21:35:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0cd070 con 0x7f428c0d0780 2023-07-09T21:35:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f429149e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0cfd70 con 0x7f428c0b7980 2023-07-09T21:35:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428affd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f428c0d0780 0x7f428c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428affd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:59460/0 (socket says 172.21.15.37:59460) 2023-07-09T21:35:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428affd640 1 -- 172.21.15.37:0/2262203090 learned_addr learned my addr 172.21.15.37:0/2262203090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428b7fe640 1 -- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 msgr2=0x7f428c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428b7fe640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428b7fe640 1 -- 172.21.15.37:0/2262203090 >> v1:172.21.15.119:6789/0 conn(0x7f428c0ceb80 legacy=0x7f428c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428b7fe640 1 -- 172.21.15.37:0/2262203090 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c160570 con 0x7f428c0d0780 2023-07-09T21:35:24.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.518+0000 7f428affd640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:24.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f428b7fe640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0d0780 0x7f428c0d0c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4284009d90 tx=0x7f428401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684195bfb29b0ee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f428a7fc640 1 -- 172.21.15.37:0/2262203090 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5810 con 0x7f428c0d0780 2023-07-09T21:35:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f428a7fc640 1 -- 172.21.15.37:0/2262203090 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840a5970 con 0x7f428c0d0780 2023-07-09T21:35:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f428a7fc640 1 -- 172.21.15.37:0/2262203090 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840a5d00 con 0x7f428c0d0780 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 -- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0d0780 msgr2=0x7f428c0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0d0780 0x7f428c0d0c00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4284009d90 tx=0x7f428401c950 comp rx=0 tx=0).stop 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 -- 172.21.15.37:0/2262203090 shutdown_connections 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0d0780 0x7f428c0d0c00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 --2- 172.21.15.37:0/2262203090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0b7980 0x7f428c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 -- 172.21.15.37:0/2262203090 >> 172.21.15.37:0/2262203090 conn(0x7f428c073090 msgr2=0x7f428c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 -- 172.21.15.37:0/2262203090 shutdown_connections 2023-07-09T21:35:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.522+0000 7f429149e640 1 -- 172.21.15.37:0/2262203090 wait complete. 2023-07-09T21:35:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 Processor -- start 2023-07-09T21:35:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 -- start start 2023-07-09T21:35:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 0x7f428c0b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0ceb80 0x7f428c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c1510e0 con 0x7f428c0d0780 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15dc40 con 0x7f428c0b7980 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c152ab0 con 0x7f428c0ceb80 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39538/0 (socket says 172.21.15.37:39538) 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 -- 172.21.15.37:0/335904712 learned_addr learned my addr 172.21.15.37:0/335904712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 0x7f428c0b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f4283fff640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0ceb80 0x7f428c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 -- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0ceb80 msgr2=0x7f428c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0ceb80 0x7f428c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 -- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 msgr2=0x7f428c0b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 0x7f428c0b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 -- 172.21.15.37:0/335904712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0094d0 con 0x7f428c0d0780 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428affd640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 0x7f428c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f428b7fe640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f42840b0040 tx=0x7f42840196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840b9860 con 0x7f428c0d0780 2023-07-09T21:35:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42840b99c0 con 0x7f428c0d0780 2023-07-09T21:35:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840b9d70 con 0x7f428c0d0780 2023-07-09T21:35:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.526+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4284009a70 con 0x7f428c0d0780 2023-07-09T21:35:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c159b50 con 0x7f428c0d0780 2023-07-09T21:35:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c04d7d0 con 0x7f428c0d0780 2023-07-09T21:35:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f42840ad440 con 0x7f428c0d0780 2023-07-09T21:35:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f42837fe640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 0x7f426c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f428411f370 con 0x7f428c0d0780 2023-07-09T21:35:24.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f428affd640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 0x7f426c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.530+0000 7f428affd640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 0x7f426c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f428c0b2e70 tx=0x7f427c009240 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.534+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f42840ec610 con 0x7f428c0d0780 2023-07-09T21:35:24.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.706+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f428c0cff80 con 0x7f426c066480 2023-07-09T21:35:24.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.714+0000 7f42837fe640 1 -- 172.21.15.37:0/335904712 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f427c009d70 con 0x7f426c066480 2023-07-09T21:35:24.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:24.718 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:57", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 msgr2=0x7f426c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 0x7f426c068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f428c0b2e70 tx=0x7f427c009240 comp rx=0 tx=0).stop 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 msgr2=0x7f428c150ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f42840b0040 tx=0x7f42840196f0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 shutdown_connections 2023-07-09T21:35:24.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f426c066480 0x7f426c068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c0d0780 0x7f428c150ba0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f428c0ceb80 0x7f428c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 --2- 172.21.15.37:0/335904712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f428c0b7980 0x7f428c0b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 >> 172.21.15.37:0/335904712 conn(0x7f428c073090 msgr2=0x7f428c0cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 shutdown_connections 2023-07-09T21:35:24.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.718+0000 7f429149e640 1 -- 172.21.15.37:0/335904712 wait complete. 2023-07-09T21:35:24.739 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:57", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:24.739 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:57', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:24.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:24.740 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-09T21:35:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:24.758 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:24.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir3 2023-07-09T21:35:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 Processor -- start 2023-07-09T21:35:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 -- start start 2023-07-09T21:35:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc7c0b7980 0x7fbc7c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc7c15bf80 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cd070 con 0x7fbc7c0b7980 2023-07-09T21:35:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc82182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0cfd70 con 0x7fbc7c0ceb80 2023-07-09T21:35:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc7c0b7980 0x7fbc7c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbc7c0b7980 0x7fbc7c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39546/0 (socket says 172.21.15.37:39546) 2023-07-09T21:35:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/205031811 learned_addr learned my addr 172.21.15.37:0/205031811 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7affd640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/205031811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 msgr2=0x7fbc7c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/205031811 >> v1:172.21.15.119:6789/0 conn(0x7fbc7c0b3c20 legacy=0x7fbc7c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.946+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/205031811 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c160570 con 0x7fbc7c0b7980 2023-07-09T21:35:24.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc7b7fe640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c160030 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009870 tx=0x7fbc6c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dec07b1ae2da2d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/205031811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0ab600 con 0x7fbc7c0b7980 2023-07-09T21:35:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/205031811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0a7050 con 0x7fbc7c0b7980 2023-07-09T21:35:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc7a7fc640 1 -- 172.21.15.37:0/205031811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0ab980 con 0x7fbc7c0b7980 2023-07-09T21:35:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 -- 172.21.15.37:0/205031811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b7980 msgr2=0x7fbc7c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c160030 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009870 tx=0x7fbc6c01c500 comp rx=0 tx=0).stop 2023-07-09T21:35:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 -- 172.21.15.37:0/205031811 shutdown_connections 2023-07-09T21:35:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 --2- 172.21.15.37:0/205031811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c160030 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 -- 172.21.15.37:0/205031811 >> 172.21.15.37:0/205031811 conn(0x7fbc7c073090 msgr2=0x7fbc7c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:24.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 -- 172.21.15.37:0/205031811 shutdown_connections 2023-07-09T21:35:24.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.950+0000 7fbc82182640 1 -- 172.21.15.37:0/205031811 wait complete. 2023-07-09T21:35:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 Processor -- start 2023-07-09T21:35:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- start start 2023-07-09T21:35:24.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b2ae0 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c0b2800 con 0x7fbc7c0b7980 2023-07-09T21:35:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c15a370 con 0x7fbc7c0ceb80 2023-07-09T21:35:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39556/0 (socket says 172.21.15.37:39556) 2023-07-09T21:35:24.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/3839737205 learned_addr learned my addr 172.21.15.37:0/3839737205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7affd640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7bfff640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 msgr2=0x7fbc7c0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 msgr2=0x7fbc7c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 -- 172.21.15.37:0/3839737205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0094d0 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7affd640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc7b7fe640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0ae040 tx=0x7fbc6c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b4640 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c0b47a0 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0b4b50 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c15a650 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c0b24f0 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.954+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c15ab70 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.958+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fbc6c0b2070 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.958+0000 7fbc63fff640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 0x7fbc68068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.958+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fbc6c11e1b0 con 0x7fbc7c0b3c20 2023-07-09T21:35:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.958+0000 7fbc7affd640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 0x7fbc68068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.958+0000 7fbc7affd640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 0x7fbc68068900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c06a050 tx=0x7fbc70008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:24.962+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbc7c15ab70 con 0x7fbc7c0b3c20 2023-07-09T21:35:25.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.134+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc7c0ccd90 con 0x7fbc68066450 2023-07-09T21:35:25.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc63fff640 1 -- 172.21.15.37:0/3839737205 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fbc7000f8f0 con 0x7fbc68066450 2023-07-09T21:35:25.148 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:25.149 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:58", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:25.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 msgr2=0x7fbc68068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 0x7fbc68068900 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c06a050 tx=0x7fbc70008040 comp rx=0 tx=0).stop 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 msgr2=0x7fbc7c1521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0ae040 tx=0x7fbc6c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 shutdown_connections 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fbc68066450 0x7fbc68068900 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbc7c0ceb80 0x7fbc7c0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbc7c0b7980 0x7fbc7c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 --2- 172.21.15.37:0/3839737205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc7c0b3c20 0x7fbc7c1521e0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 >> 172.21.15.37:0/3839737205 conn(0x7fbc7c073090 msgr2=0x7fbc7c0b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:25.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 shutdown_connections 2023-07-09T21:35:25.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.146+0000 7fbc82182640 1 -- 172.21.15.37:0/3839737205 wait complete. 2023-07-09T21:35:25.168 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:58", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:25.169 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:58', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:25.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:25.170 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:25.185 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:25.186 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:25.187 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:25.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir4 2023-07-09T21:35:25.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 Processor -- start 2023-07-09T21:35:25.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 -- start start 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4c80cf290 0x7fc4c8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c815bf80 con 0x7fc4c80d0780 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c8160570 con 0x7fc4c80b7980 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4d01c5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c80cd070 con 0x7fc4c80cf290 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4cd760640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4c80cf290 0x7fc4c8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4ce762640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc4c80d0780 0x7fc4c80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53282/0 (socket says 172.21.15.37:53282) 2023-07-09T21:35:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4ce762640 1 -- 172.21.15.37:0/1906139838 learned_addr learned my addr 172.21.15.37:0/1906139838 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4cd760640 1 -- 172.21.15.37:0/1906139838 >> v1:172.21.15.119:6789/0 conn(0x7fc4c80b7980 legacy=0x7fc4c80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4cd760640 1 -- 172.21.15.37:0/1906139838 >> v1:172.21.15.37:6789/0 conn(0x7fc4c80d0780 legacy=0x7fc4c80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4cd760640 1 -- 172.21.15.37:0/1906139838 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c80d02f0 con 0x7fc4c80cf290 2023-07-09T21:35:25.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.374+0000 7fc4ccf5f640 1 -- 172.21.15.37:0/1906139838 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3746006204 0 0) 0x7fc4c00014a0 con 0x7fc4c80d0780 2023-07-09T21:35:25.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4cd760640 1 --2- 172.21.15.37:0/1906139838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8160030 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b82fa7aba0b1f7e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4ccf5f640 1 -- 172.21.15.37:0/1906139838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ab600 con 0x7fc4c80cf290 2023-07-09T21:35:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4ccf5f640 1 -- 172.21.15.37:0/1906139838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b80a7050 con 0x7fc4c80cf290 2023-07-09T21:35:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4ccf5f640 1 -- 172.21.15.37:0/1906139838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ab980 con 0x7fc4c80cf290 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 -- 172.21.15.37:0/1906139838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 msgr2=0x7fc4c8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/1906139838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8160030 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c480 comp rx=0 tx=0).stop 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 -- 172.21.15.37:0/1906139838 shutdown_connections 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/1906139838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8160030 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 -- 172.21.15.37:0/1906139838 >> 172.21.15.37:0/1906139838 conn(0x7fc4c8073090 msgr2=0x7fc4c8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 -- 172.21.15.37:0/1906139838 shutdown_connections 2023-07-09T21:35:25.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.378+0000 7fc4d01c5640 1 -- 172.21.15.37:0/1906139838 wait complete. 2023-07-09T21:35:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 Processor -- start 2023-07-09T21:35:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- start start 2023-07-09T21:35:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 0x7fc4c814df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 0x7fc4c815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b39c0 con 0x7fc4c80cf290 2023-07-09T21:35:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b2b10 con 0x7fc4c80d0780 2023-07-09T21:35:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80b2db0 con 0x7fc4c80b7980 2023-07-09T21:35:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39570/0 (socket says 172.21.15.37:39570) 2023-07-09T21:35:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 -- 172.21.15.37:0/325432225 learned_addr learned my addr 172.21.15.37:0/325432225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4ce762640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 0x7fc4c815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cdf61640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 0x7fc4c814df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 -- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 msgr2=0x7fc4c814df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 0x7fc4c814df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 -- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 msgr2=0x7fc4c815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 0x7fc4c815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 -- 172.21.15.37:0/325432225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b8009420 con 0x7fc4c80cf290 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4ce762640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 0x7fc4c815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cdf61640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 0x7fc4c814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:25.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4cd760640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4b801a0b0 tx=0x7fc4b8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8004220 con 0x7fc4c80cf290 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b8004380 con 0x7fc4c80cf290 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b8003820 con 0x7fc4c80cf290 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c80b3090 con 0x7fc4c80cf290 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80b3650 con 0x7fc4c80cf290 2023-07-09T21:35:25.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.382+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c804d7d0 con 0x7fc4c80cf290 2023-07-09T21:35:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.386+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc4b80b2040 con 0x7fc4c80cf290 2023-07-09T21:35:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.386+0000 7fc4be7fc640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 0x7fc4ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.386+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fc4b811dae0 con 0x7fc4c80cf290 2023-07-09T21:35:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.386+0000 7fc4cdf61640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 0x7fc4ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.386+0000 7fc4cdf61640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 0x7fc4ac068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80d2d70 tx=0x7fc4c4009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.390+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4b80eaa10 con 0x7fc4c80cf290 2023-07-09T21:35:25.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.562+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4c80ccd90 con 0x7fc4ac066480 2023-07-09T21:35:25.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.570+0000 7fc4be7fc640 1 -- 172.21.15.37:0/325432225 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fc4c4001ce0 con 0x7fc4ac066480 2023-07-09T21:35:25.574 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:25.574 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:58", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 msgr2=0x7fc4ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 0x7fc4ac068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80d2d70 tx=0x7fc4c4009040 comp rx=0 tx=0).stop 2023-07-09T21:35:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 msgr2=0x7fc4c8152910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc4b801a0b0 tx=0x7fc4b8019220 comp rx=0 tx=0).stop 2023-07-09T21:35:25.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 shutdown_connections 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc4ac066480 0x7fc4ac068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4c80d0780 0x7fc4c815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4c80cf290 0x7fc4c8152910 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 --2- 172.21.15.37:0/325432225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4c80b7980 0x7fc4c814df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 >> 172.21.15.37:0/325432225 conn(0x7fc4c8073090 msgr2=0x7fc4c815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:25.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 shutdown_connections 2023-07-09T21:35:25.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.574+0000 7fc4d01c5640 1 -- 172.21.15.37:0/325432225 wait complete. 2023-07-09T21:35:25.594 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:58", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:25.595 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:58', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:25.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:25.595 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-09T21:35:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:25.613 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:25.614 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:25.615 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:25.615 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:25.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir5 2023-07-09T21:35:25.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 Processor -- start 2023-07-09T21:35:25.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 -- start start 2023-07-09T21:35:25.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f64740b7980 0x7f6474160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64740d0780 0x7f64740d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647415bf80 con 0x7f64740ceb80 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740cd070 con 0x7f64740d0780 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f647b1fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64740cfd70 con 0x7f64740b7980 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6473fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f64740ceb80 0x7f64740cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53288/0 (socket says 172.21.15.37:53288) 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6473fff640 1 -- 172.21.15.37:0/1883465017 learned_addr learned my addr 172.21.15.37:0/1883465017 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:25.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6479797640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64740d0780 0x7f64740d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6478f96640 1 --2- 172.21.15.37:0/1883465017 >> v2:172.21.15.119:3300/0 conn(0x7f64740b7980 0x7f6474160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6479797640 1 -- 172.21.15.37:0/1883465017 >> v2:172.21.15.119:3300/0 conn(0x7f64740b7980 msgr2=0x7f6474160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6479797640 1 --2- 172.21.15.37:0/1883465017 >> v2:172.21.15.119:3300/0 conn(0x7f64740b7980 0x7f6474160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6479797640 1 -- 172.21.15.37:0/1883465017 >> v1:172.21.15.37:6789/0 conn(0x7f64740ceb80 legacy=0x7f64740cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f6479797640 1 -- 172.21.15.37:0/1883465017 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474160570 con 0x7f64740d0780 2023-07-09T21:35:25.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.802+0000 7f64737fe640 1 -- 172.21.15.37:0/1883465017 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301987268 0 0) 0x7f6460001120 con 0x7f64740ceb80 2023-07-09T21:35:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f6479797640 1 --2- 172.21.15.37:0/1883465017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740d0780 0x7f64740d0b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6474069aa0 tx=0x7f646c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7142eff17e23acbb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f64737fe640 1 -- 172.21.15.37:0/1883465017 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0a57d0 con 0x7f64740d0780 2023-07-09T21:35:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f64737fe640 1 -- 172.21.15.37:0/1883465017 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0a5930 con 0x7f64740d0780 2023-07-09T21:35:25.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f64737fe640 1 -- 172.21.15.37:0/1883465017 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0a5cc0 con 0x7f64740d0780 2023-07-09T21:35:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 -- 172.21.15.37:0/1883465017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740d0780 msgr2=0x7f64740d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 --2- 172.21.15.37:0/1883465017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740d0780 0x7f64740d0b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f6474069aa0 tx=0x7f646c01c910 comp rx=0 tx=0).stop 2023-07-09T21:35:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 -- 172.21.15.37:0/1883465017 shutdown_connections 2023-07-09T21:35:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 --2- 172.21.15.37:0/1883465017 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740d0780 0x7f64740d0b80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 --2- 172.21.15.37:0/1883465017 >> v2:172.21.15.119:3300/0 conn(0x7f64740b7980 0x7f6474160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 -- 172.21.15.37:0/1883465017 >> 172.21.15.37:0/1883465017 conn(0x7f6474073090 msgr2=0x7f6474069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 -- 172.21.15.37:0/1883465017 shutdown_connections 2023-07-09T21:35:25.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.806+0000 7f647b1fa640 1 -- 172.21.15.37:0/1883465017 wait complete. 2023-07-09T21:35:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 Processor -- start 2023-07-09T21:35:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- start start 2023-07-09T21:35:25.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740ceb80 0x7f6474154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64740d0780 0x7f6474154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740cc100 con 0x7f64740b7980 2023-07-09T21:35:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64740ca560 con 0x7f64740ceb80 2023-07-09T21:35:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647415d4d0 con 0x7f64740d0780 2023-07-09T21:35:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39586/0 (socket says 172.21.15.37:39586) 2023-07-09T21:35:25.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 -- 172.21.15.37:0/3177689116 learned_addr learned my addr 172.21.15.37:0/3177689116 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:25.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6479797640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64740d0780 0x7f6474154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6473fff640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740ceb80 0x7f6474154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 -- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64740d0780 msgr2=0x7f6474154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64740d0780 0x7f6474154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 -- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740ceb80 msgr2=0x7f6474154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740ceb80 0x7f6474154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 -- 172.21.15.37:0/3177689116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c009a70 con 0x7f64740b7980 2023-07-09T21:35:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f6478f96640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f646800e930 tx=0x7f646800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6468009690 con 0x7f64740b7980 2023-07-09T21:35:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646800ca00 con 0x7f64740b7980 2023-07-09T21:35:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646800cd70 con 0x7f64740b7980 2023-07-09T21:35:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64740c9c30 con 0x7f64740b7980 2023-07-09T21:35:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.810+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64740ca1f0 con 0x7f64740b7980 2023-07-09T21:35:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647404d7d0 con 0x7f64740b7980 2023-07-09T21:35:25.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f6468013470 con 0x7f64740b7980 2023-07-09T21:35:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f64717fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 0x7f6458068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f6468084470 con 0x7f64740b7980 2023-07-09T21:35:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f6473fff640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 0x7f6458068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.814+0000 7f6473fff640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 0x7f6458068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f64600079c0 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.818+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6468051600 con 0x7f64740b7980 2023-07-09T21:35:25.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.990+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64740ccd90 con 0x7f64580664b0 2023-07-09T21:35:26.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:25.998+0000 7f64717fa640 1 -- 172.21.15.37:0/3177689116 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f6460001450 con 0x7f64580664b0 2023-07-09T21:35:26.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:26.003 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:59", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 msgr2=0x7f6458068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 0x7f6458068960 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6460007fd0 tx=0x7f64600079c0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 msgr2=0x7f64740b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f646800e930 tx=0x7f646800edf0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 shutdown_connections 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f64580664b0 0x7f6458068960 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64740d0780 0x7f6474154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64740ceb80 0x7f6474154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 --2- 172.21.15.37:0/3177689116 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64740b7980 0x7f64740b3590 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 >> 172.21.15.37:0/3177689116 conn(0x7f6474073090 msgr2=0x7f64740cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 shutdown_connections 2023-07-09T21:35:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.002+0000 7f647b1fa640 1 -- 172.21.15.37:0/3177689116 wait complete. 2023-07-09T21:35:26.023 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:59", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.024 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:59', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:26.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:26.024 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-09T21:35:26.041 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:26.041 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:26.042 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:26.043 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:26.043 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:26.043 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:26.044 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_24_00_UTC', 'scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:26.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir6 2023-07-09T21:35:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 Processor -- start 2023-07-09T21:35:26.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 -- start start 2023-07-09T21:35:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda840c3e10 0x7fda840c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda840c9090 con 0x7fda8415c200 2023-07-09T21:35:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda840c8a60 con 0x7fda841585b0 2023-07-09T21:35:26.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda89cb3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda840cbf40 con 0x7fda840c3e10 2023-07-09T21:35:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda83fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda8415c200 0x7fda8415c660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53290/0 (socket says 172.21.15.37:53290) 2023-07-09T21:35:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda83fff640 1 -- 172.21.15.37:0/992006031 learned_addr learned my addr 172.21.15.37:0/992006031 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.230+0000 7fda82ffd640 1 --2- 172.21.15.37:0/992006031 >> v2:172.21.15.37:3300/0 conn(0x7fda840c3e10 0x7fda840c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda82ffd640 1 -- 172.21.15.37:0/992006031 >> v1:172.21.15.119:6789/0 conn(0x7fda841585b0 legacy=0x7fda8406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda82ffd640 1 -- 172.21.15.37:0/992006031 >> v1:172.21.15.37:6789/0 conn(0x7fda8415c200 legacy=0x7fda8415c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda82ffd640 1 -- 172.21.15.37:0/992006031 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8406bb40 con 0x7fda840c3e10 2023-07-09T21:35:26.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda827fc640 1 -- 172.21.15.37:0/992006031 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897982456 0 0) 0x7fda840c9090 con 0x7fda8415c200 2023-07-09T21:35:26.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda82ffd640 1 --2- 172.21.15.37:0/992006031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda840c4290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fda780097c0 tx=0x7fda7801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0c9406c167dd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda827fc640 1 -- 172.21.15.37:0/992006031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780ab600 con 0x7fda840c3e10 2023-07-09T21:35:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda827fc640 1 -- 172.21.15.37:0/992006031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda780a7050 con 0x7fda840c3e10 2023-07-09T21:35:26.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda827fc640 1 -- 172.21.15.37:0/992006031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda780ab980 con 0x7fda840c3e10 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 -- 172.21.15.37:0/992006031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 msgr2=0x7fda840c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 --2- 172.21.15.37:0/992006031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda840c4290 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fda780097c0 tx=0x7fda7801c440 comp rx=0 tx=0).stop 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 -- 172.21.15.37:0/992006031 shutdown_connections 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 --2- 172.21.15.37:0/992006031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda840c4290 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 -- 172.21.15.37:0/992006031 >> 172.21.15.37:0/992006031 conn(0x7fda840cde40 msgr2=0x7fda840ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:26.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 -- 172.21.15.37:0/992006031 shutdown_connections 2023-07-09T21:35:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.234+0000 7fda89cb3640 1 -- 172.21.15.37:0/992006031 wait complete. 2023-07-09T21:35:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 Processor -- start 2023-07-09T21:35:26.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 -- start start 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda841585b0 0x7fda84159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda8415c200 0x7fda84146000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda840b0110 con 0x7fda840c3e10 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8415b430 con 0x7fda841585b0 2023-07-09T21:35:26.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda840afc80 con 0x7fda8415c200 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39606/0 (socket says 172.21.15.37:39606) 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 -- 172.21.15.37:0/2447141775 learned_addr learned my addr 172.21.15.37:0/2447141775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 -- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda8415c200 msgr2=0x7fda84146000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda8415c200 0x7fda84146000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 -- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda841585b0 msgr2=0x7fda84159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda841585b0 0x7fda84159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 -- 172.21.15.37:0/2447141775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda78009420 con 0x7fda840c3e10 2023-07-09T21:35:26.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda837fe640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c480 tx=0x7fda7400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74012830 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda740129b0 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74012d60 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.238+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda840af0d0 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda840af910 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda840c4290 con 0x7fda840c3e10 2023-07-09T21:35:26.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fda7401c460 con 0x7fda840c3e10 2023-07-09T21:35:26.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda6bfff640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 0x7fda70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7fda74084000 con 0x7fda840c3e10 2023-07-09T21:35:26.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda82ffd640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 0x7fda70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.242+0000 7fda82ffd640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 0x7fda70068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fda780ad000 tx=0x7fda78004740 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.246+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda74051170 con 0x7fda840c3e10 2023-07-09T21:35:26.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.418+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda8415d0f0 con 0x7fda70066480 2023-07-09T21:35:26.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.426+0000 7fda6bfff640 1 -- 172.21.15.37:0/2447141775 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7fda78004120 con 0x7fda70066480 2023-07-09T21:35:26.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:26.430 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:59", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 msgr2=0x7fda70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 0x7fda70068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fda780ad000 tx=0x7fda78004740 comp rx=0 tx=0).stop 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 msgr2=0x7fda8415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fda7400c480 tx=0x7fda7400c940 comp rx=0 tx=0).stop 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 shutdown_connections 2023-07-09T21:35:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fda70066480 0x7fda70068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda8415c200 0x7fda84146000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda841585b0 0x7fda84159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 --2- 172.21.15.37:0/2447141775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda840c3e10 0x7fda8415aef0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 >> 172.21.15.37:0/2447141775 conn(0x7fda840cde40 msgr2=0x7fda8414ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 shutdown_connections 2023-07-09T21:35:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.430+0000 7fda89cb3640 1 -- 172.21.15.37:0/2447141775 wait complete. 2023-07-09T21:35:26.451 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:23:59", "first": "2023-07-09T21:24:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 12, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.451 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:23:59', 'first': '2023-07-09T21:24:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 12, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:26.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:26.452 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-09T21:35:26.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:26.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:26.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:26.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:26.469 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:26.470 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:26.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir7 2023-07-09T21:35:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 Processor -- start 2023-07-09T21:35:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 -- start start 2023-07-09T21:35:26.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12e80b7980 0x7f12e8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12e80d0780 0x7f12e80d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e815bf80 con 0x7f12e80ceb80 2023-07-09T21:35:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80cd070 con 0x7f12e80b7980 2023-07-09T21:35:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12f00d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e80cfd70 con 0x7f12e80d0780 2023-07-09T21:35:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12e80b7980 0x7f12e8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12e80b7980 0x7f12e8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39622/0 (socket says 172.21.15.37:39622) 2023-07-09T21:35:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 -- 172.21.15.37:0/3548208387 learned_addr learned my addr 172.21.15.37:0/3548208387 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ee675640 1 --2- 172.21.15.37:0/3548208387 >> v2:172.21.15.119:3300/0 conn(0x7f12e80d0780 0x7f12e80d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 -- 172.21.15.37:0/3548208387 >> v2:172.21.15.119:3300/0 conn(0x7f12e80d0780 msgr2=0x7f12e80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 --2- 172.21.15.37:0/3548208387 >> v2:172.21.15.119:3300/0 conn(0x7f12e80d0780 0x7f12e80d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 -- 172.21.15.37:0/3548208387 >> v1:172.21.15.119:6789/0 conn(0x7f12e80ceb80 legacy=0x7f12e80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.658+0000 7f12ede74640 1 -- 172.21.15.37:0/3548208387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8160570 con 0x7f12e80b7980 2023-07-09T21:35:26.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12ede74640 1 --2- 172.21.15.37:0/3548208387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e8160030 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b1240 tx=0x7f12e401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afc36891cd1e6a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12ece72640 1 -- 172.21.15.37:0/3548208387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40ab600 con 0x7f12e80b7980 2023-07-09T21:35:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12ece72640 1 -- 172.21.15.37:0/3548208387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e40a7050 con 0x7f12e80b7980 2023-07-09T21:35:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12ece72640 1 -- 172.21.15.37:0/3548208387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40ab980 con 0x7f12e80b7980 2023-07-09T21:35:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 -- 172.21.15.37:0/3548208387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 msgr2=0x7f12e8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 --2- 172.21.15.37:0/3548208387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e8160030 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b1240 tx=0x7f12e401c4c0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 -- 172.21.15.37:0/3548208387 shutdown_connections 2023-07-09T21:35:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 --2- 172.21.15.37:0/3548208387 >> v2:172.21.15.119:3300/0 conn(0x7f12e80d0780 0x7f12e80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 --2- 172.21.15.37:0/3548208387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e8160030 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 -- 172.21.15.37:0/3548208387 >> 172.21.15.37:0/3548208387 conn(0x7f12e8073090 msgr2=0x7f12e8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 -- 172.21.15.37:0/3548208387 shutdown_connections 2023-07-09T21:35:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.662+0000 7f12f00d8640 1 -- 172.21.15.37:0/3548208387 wait complete. 2023-07-09T21:35:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 Processor -- start 2023-07-09T21:35:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- start start 2023-07-09T21:35:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12e80ceb80 0x7f12e8150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12e80d0780 0x7f12e80b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80caab0 con 0x7f12e80b7980 2023-07-09T21:35:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80b1fa0 con 0x7f12e80ceb80 2023-07-09T21:35:26.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e80b2280 con 0x7f12e80d0780 2023-07-09T21:35:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39632/0 (socket says 172.21.15.37:39632) 2023-07-09T21:35:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 -- 172.21.15.37:0/2544804410 learned_addr learned my addr 172.21.15.37:0/2544804410 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:26.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ed673640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12e80ceb80 0x7f12e8150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ee675640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12e80d0780 0x7f12e80b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 -- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12e80d0780 msgr2=0x7f12e80b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12e80d0780 0x7f12e80b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 -- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12e80ceb80 msgr2=0x7f12e8150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12e80ceb80 0x7f12e8150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 -- 172.21.15.37:0/2544804410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e40094d0 con 0x7f12e80b7980 2023-07-09T21:35:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12ede74640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f12e401a0f0 tx=0x7f12e4019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40b37d0 con 0x7f12e80b7980 2023-07-09T21:35:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e40b3930 con 0x7f12e80b7980 2023-07-09T21:35:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e40b3ca0 con 0x7f12e80b7980 2023-07-09T21:35:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e80b2560 con 0x7f12e80b7980 2023-07-09T21:35:26.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.666+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e80b2b20 con 0x7f12e80b7980 2023-07-09T21:35:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e80cd600 con 0x7f12e80b7980 2023-07-09T21:35:26.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f12e40b2070 con 0x7f12e80b7980 2023-07-09T21:35:26.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12de7fc640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 0x7f12cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f12e411e410 con 0x7f12e80b7980 2023-07-09T21:35:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12ed673640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 0x7f12cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:26.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.670+0000 7f12ed673640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 0x7f12cc068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b13d0 tx=0x7f12d8009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:26.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.674+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12e80cd600 con 0x7f12e80b7980 2023-07-09T21:35:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.846+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f12e80cff80 con 0x7f12cc066480 2023-07-09T21:35:26.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.854+0000 7f12de7fc640 1 -- 172.21.15.37:0/2544804410 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f12d8005380 con 0x7f12cc066480 2023-07-09T21:35:26.858 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:26.858 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:00", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 msgr2=0x7f12cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 0x7f12cc068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f12e80b13d0 tx=0x7f12d8009040 comp rx=0 tx=0).stop 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 msgr2=0x7f12e80ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f12e401a0f0 tx=0x7f12e4019260 comp rx=0 tx=0).stop 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 shutdown_connections 2023-07-09T21:35:26.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f12cc066480 0x7f12cc068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12e80d0780 0x7f12e80b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12e80ceb80 0x7f12e8150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 --2- 172.21.15.37:0/2544804410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12e80b7980 0x7f12e80ca570 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 >> 172.21.15.37:0/2544804410 conn(0x7f12e8073090 msgr2=0x7f12e80cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 shutdown_connections 2023-07-09T21:35:26.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:26.858+0000 7f12f00d8640 1 -- 172.21.15.37:0/2544804410 wait complete. 2023-07-09T21:35:26.878 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:00", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:26.879 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:24:00', 'first': '2023-07-09T21:25:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:26.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:26.879 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-09T21:35:26.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:26.896 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:26.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:26.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:26.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:26.897 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:26.898 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:26.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir8 2023-07-09T21:35:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 Processor -- start 2023-07-09T21:35:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 -- start start 2023-07-09T21:35:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f017c0c99e0 0x7f017c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017c0c4c90 con 0x7f017c1595c0 2023-07-09T21:35:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017c0ca730 con 0x7f017c0c99e0 2023-07-09T21:35:27.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f01841ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c0ca170 con 0x7f017c159990 2023-07-09T21:35:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0182757640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f017c0c99e0 0x7f017c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0182757640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f017c0c99e0 0x7f017c0cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39646/0 (socket says 172.21.15.37:39646) 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0182757640 1 -- 172.21.15.37:0/2356316036 learned_addr learned my addr 172.21.15.37:0/2356316036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0181755640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0182757640 1 -- 172.21.15.37:0/2356316036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 msgr2=0x7f017c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.082+0000 7f0182757640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0182757640 1 -- 172.21.15.37:0/2356316036 >> v1:172.21.15.119:6789/0 conn(0x7f017c1595c0 legacy=0x7f017c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0182757640 1 -- 172.21.15.37:0/2356316036 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017c0ca450 con 0x7f017c0c99e0 2023-07-09T21:35:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0180f54640 1 -- 172.21.15.37:0/2356316036 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449930637 0 0) 0x7f0178001120 con 0x7f017c1595c0 2023-07-09T21:35:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0182757640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c0cd300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0174009e50 tx=0x7f017401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881b62b5db6fc01e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0180f54640 1 -- 172.21.15.37:0/2356316036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740a57c0 con 0x7f017c0c99e0 2023-07-09T21:35:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0180f54640 1 -- 172.21.15.37:0/2356316036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01740a5920 con 0x7f017c0c99e0 2023-07-09T21:35:27.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f0180f54640 1 -- 172.21.15.37:0/2356316036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01740a5cb0 con 0x7f017c0c99e0 2023-07-09T21:35:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 -- 172.21.15.37:0/2356316036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 msgr2=0x7f017c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c0cd300 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f0174009e50 tx=0x7f017401c9e0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 -- 172.21.15.37:0/2356316036 shutdown_connections 2023-07-09T21:35:27.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 --2- 172.21.15.37:0/2356316036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c0cd300 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 -- 172.21.15.37:0/2356316036 >> 172.21.15.37:0/2356316036 conn(0x7f017c0cde40 msgr2=0x7f017c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 -- 172.21.15.37:0/2356316036 shutdown_connections 2023-07-09T21:35:27.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.086+0000 7f01841ba640 1 -- 172.21.15.37:0/2356316036 wait complete. 2023-07-09T21:35:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 Processor -- start 2023-07-09T21:35:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- start start 2023-07-09T21:35:27.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c1595c0 0x7f017c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c152510 con 0x7f017c0c99e0 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017c1527f0 con 0x7f017c1595c0 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017c152ad0 con 0x7f017c159990 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39660/0 (socket says 172.21.15.37:39660) 2023-07-09T21:35:27.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 -- 172.21.15.37:0/2382147490 learned_addr learned my addr 172.21.15.37:0/2382147490 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181755640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c1595c0 0x7f017c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0182757640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 -- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 msgr2=0x7f017c1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 -- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c1595c0 msgr2=0x7f017c06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c1595c0 0x7f017c06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 -- 172.21.15.37:0/2382147490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0174009b30 con 0x7f017c0c99e0 2023-07-09T21:35:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0182757640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f0181f56640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0178001ec0 tx=0x7f017800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780054e0 con 0x7f017c0c99e0 2023-07-09T21:35:27.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0178003600 con 0x7f017c0c99e0 2023-07-09T21:35:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01780039b0 con 0x7f017c0c99e0 2023-07-09T21:35:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017c152db0 con 0x7f017c0c99e0 2023-07-09T21:35:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.090+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017c1535b0 con 0x7f017c0c99e0 2023-07-09T21:35:27.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017c152160 con 0x7f017c0c99e0 2023-07-09T21:35:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f0178003b10 con 0x7f017c0c99e0 2023-07-09T21:35:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f01727fc640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 0x7f0160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f0178083790 con 0x7f017c0c99e0 2023-07-09T21:35:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f0181755640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 0x7f0160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.094+0000 7f0181755640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 0x7f0160068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f017c0c34a0 tx=0x7f016c008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.098+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0178050740 con 0x7f017c0c99e0 2023-07-09T21:35:27.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.266+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f017c0c9e80 con 0x7f0160066480 2023-07-09T21:35:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.278+0000 7f01727fc640 1 -- 172.21.15.37:0/2382147490 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f016c011950 con 0x7f0160066480 2023-07-09T21:35:27.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:27.282 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:00", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 msgr2=0x7f0160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 0x7f0160068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f017c0c34a0 tx=0x7f016c008040 comp rx=0 tx=0).stop 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 msgr2=0x7f017c151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0178001ec0 tx=0x7f017800c8e0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 shutdown_connections 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f0160066480 0x7f0160068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f017c159990 0x7f017c1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f017c1595c0 0x7f017c06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 --2- 172.21.15.37:0/2382147490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f017c0c99e0 0x7f017c151c20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 >> 172.21.15.37:0/2382147490 conn(0x7f017c0cde40 msgr2=0x7f017c0c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 shutdown_connections 2023-07-09T21:35:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.282+0000 7f01841ba640 1 -- 172.21.15.37:0/2382147490 wait complete. 2023-07-09T21:35:27.302 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:00", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:27.303 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:24:00', 'first': '2023-07-09T21:25:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:27.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:27.303 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-09T21:35:27.319 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:27.319 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:27.319 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:27.320 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:27.321 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:27.321 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_25_00_UTC', 'scheduled-2023-07-09-21_26_00_UTC', 'scheduled-2023-07-09-21_27_00_UTC', 'scheduled-2023-07-09-21_28_00_UTC', 'scheduled-2023-07-09-21_29_00_UTC', 'scheduled-2023-07-09-21_30_00_UTC', 'scheduled-2023-07-09-21_31_00_UTC', 'scheduled-2023-07-09-21_32_00_UTC', 'scheduled-2023-07-09-21_33_00_UTC', 'scheduled-2023-07-09-21_34_00_UTC', 'scheduled-2023-07-09-21_35_00_UTC'] 2023-07-09T21:35:27.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/dir9 2023-07-09T21:35:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.506+0000 7f14d9b82640 1 Processor -- start 2023-07-09T21:35:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.506+0000 7f14d9b82640 1 -- start start 2023-07-09T21:35:27.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d9b82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14d415f130 0x7f14d40b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d9b82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14d40d0530 0x7f14d40cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d9b82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d40b3bb0 con 0x7f14d40b74e0 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d9b82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d40b7960 con 0x7f14d40d0530 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d9b82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d40cccb0 con 0x7f14d415f130 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14d40d0530 0x7f14d40cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14d40d0530 0x7f14d40cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49800/0 (socket says 172.21.15.37:49800) 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 -- 172.21.15.37:0/859686837 learned_addr learned my addr 172.21.15.37:0/859686837 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d37fe640 1 --2- 172.21.15.37:0/859686837 >> v2:172.21.15.119:3300/0 conn(0x7f14d415f130 0x7f14d40b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 -- 172.21.15.37:0/859686837 >> v2:172.21.15.119:3300/0 conn(0x7f14d415f130 msgr2=0x7f14d40b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 --2- 172.21.15.37:0/859686837 >> v2:172.21.15.119:3300/0 conn(0x7f14d415f130 0x7f14d40b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 -- 172.21.15.37:0/859686837 >> v1:172.21.15.119:6789/0 conn(0x7f14d40b74e0 legacy=0x7f14d40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 -- 172.21.15.37:0/859686837 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40b8100 con 0x7f14d40d0530 2023-07-09T21:35:27.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d3fff640 1 --2- 172.21.15.37:0/859686837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40d0530 0x7f14d40cd140 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f14d408a900 tx=0x7f14cc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7783b885f381ab92 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d27fc640 1 -- 172.21.15.37:0/859686837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0a5790 con 0x7f14d40d0530 2023-07-09T21:35:27.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d27fc640 1 -- 172.21.15.37:0/859686837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc0a58f0 con 0x7f14d40d0530 2023-07-09T21:35:27.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.510+0000 7f14d27fc640 1 -- 172.21.15.37:0/859686837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0a5c80 con 0x7f14d40d0530 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- 172.21.15.37:0/859686837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40d0530 msgr2=0x7f14d40cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- 172.21.15.37:0/859686837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40d0530 0x7f14d40cd140 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f14d408a900 tx=0x7f14cc01c8d0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- 172.21.15.37:0/859686837 shutdown_connections 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- 172.21.15.37:0/859686837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40d0530 0x7f14d40cd140 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- 172.21.15.37:0/859686837 >> v2:172.21.15.119:3300/0 conn(0x7f14d415f130 0x7f14d40b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- 172.21.15.37:0/859686837 >> 172.21.15.37:0/859686837 conn(0x7f14d4072d20 msgr2=0x7f14d40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:27.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- 172.21.15.37:0/859686837 shutdown_connections 2023-07-09T21:35:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- 172.21.15.37:0/859686837 wait complete. 2023-07-09T21:35:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 Processor -- start 2023-07-09T21:35:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- start start 2023-07-09T21:35:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14d40d0530 0x7f14d40c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 0x7f14d4150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40c8c50 con 0x7f14d40b74e0 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d40c87c0 con 0x7f14d415f130 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d9b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d415dfc0 con 0x7f14d40d0530 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49810/0 (socket says 172.21.15.37:49810) 2023-07-09T21:35:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d37fe640 1 -- 172.21.15.37:0/4181157908 learned_addr learned my addr 172.21.15.37:0/4181157908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d2ffd640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14d40d0530 0x7f14d40c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.514+0000 7f14d3fff640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 0x7f14d4150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 -- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14d40d0530 msgr2=0x7f14d40c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14d40d0530 0x7f14d40c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 -- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 msgr2=0x7f14d4150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 0x7f14d4150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 -- 172.21.15.37:0/4181157908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc009b30 con 0x7f14d40b74e0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d3fff640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 0x7f14d4150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d37fe640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d830 tx=0x7f14c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400b6c0 con 0x7f14d40b74e0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c400b820 con 0x7f14d40b74e0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c400bb90 con 0x7f14d40b74e0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d4151050 con 0x7f14d40b74e0 2023-07-09T21:35:27.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d41516a0 con 0x7f14d40b74e0 2023-07-09T21:35:27.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d40668f0 con 0x7f14d40b74e0 2023-07-09T21:35:27.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.518+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f14c401e460 con 0x7f14d40b74e0 2023-07-09T21:35:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.522+0000 7f14bbfff640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 0x7f14c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.522+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f14c4084910 con 0x7f14d40b74e0 2023-07-09T21:35:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.522+0000 7f14d2ffd640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 0x7f14c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.522+0000 7f14d2ffd640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 0x7f14c0068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14d4157500 tx=0x7f14c8008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.526+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14c4051a80 con 0x7f14d40b74e0 2023-07-09T21:35:27.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.694+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f14d40cc940 con 0x7f14c00664b0 2023-07-09T21:35:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14bbfff640 1 -- 172.21.15.37:0/4181157908 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+345 (secure 0 0 0) 0x7f14c800bdc0 con 0x7f14c00664b0 2023-07-09T21:35:27.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:27.708 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:01", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 msgr2=0x7f14c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 0x7f14c0068960 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f14d4157500 tx=0x7f14c8008040 comp rx=0 tx=0).stop 2023-07-09T21:35:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 msgr2=0x7f14d415c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f14c400d830 tx=0x7f14c400dcf0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 shutdown_connections 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f14c00664b0 0x7f14c0068960 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14d415f130 0x7f14d4150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14d40d0530 0x7f14d40c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 --2- 172.21.15.37:0/4181157908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14d40b74e0 0x7f14d415c010 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 >> 172.21.15.37:0/4181157908 conn(0x7f14d4072d20 msgr2=0x7f14d415b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 shutdown_connections 2023-07-09T21:35:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.706+0000 7f14d9b82640 1 -- 172.21.15.37:0/4181157908 wait complete. 2023-07-09T21:35:27.729 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:24:01", "first": "2023-07-09T21:25:00", "last": "2023-07-09T21:35:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2023-07-09T21:35:27.730 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:24:01', 'first': '2023-07-09T21:25:00', 'last': '2023-07-09T21:35:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2023-07-09T21:35:27.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir0 1M 2023-07-09T21:35:27.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.874+0000 7f1bcfe19640 1 Processor -- start 2023-07-09T21:35:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.874+0000 7f1bcfe19640 1 -- start start 2023-07-09T21:35:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcfe19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bc815c910 0x7f1bc80c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcfe19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80c9090 con 0x7f1bc80c3e10 2023-07-09T21:35:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcfe19640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc80c8a60 con 0x7f1bc81585b0 2023-07-09T21:35:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcfe19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc80cbf40 con 0x7f1bc815c910 2023-07-09T21:35:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcd3b4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1bc80c3e10 0x7f1bc815c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2023-07-09T21:35:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcd3b4640 1 -- 172.21.15.37:0/2931793483 learned_addr learned my addr 172.21.15.37:0/2931793483 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076046795 0 0) 0x7f1bc80c9090 con 0x7f1bc80c3e10 2023-07-09T21:35:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/2931793483 >> v2:172.21.15.119:3300/0 conn(0x7f1bc815c910 0x7f1bc80c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bb4003530 con 0x7f1bc80c3e10 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495218716 0 0) 0x7f1bb4003530 con 0x7f1bc80c3e10 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 >> v2:172.21.15.119:3300/0 conn(0x7f1bc815c910 msgr2=0x7f1bc80c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 --2- 172.21.15.37:0/2931793483 >> v2:172.21.15.119:3300/0 conn(0x7f1bc815c910 0x7f1bc80c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 >> v1:172.21.15.119:6789/0 conn(0x7f1bc81585b0 legacy=0x7f1bc806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc806bb40 con 0x7f1bc80c3e10 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1bb8001680 con 0x7f1bc80c3e10 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 >> v1:172.21.15.37:6789/0 conn(0x7f1bc80c3e10 legacy=0x7f1bc815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4003980 0x7f1bb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb40047d0 0x7f1bb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 0x7f1bb400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80cbf40 con 0x7f1bb4005180 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb400e210 con 0x7f1bb40047d0 2023-07-09T21:35:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb400e3d0 con 0x7f1bb4003980 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 0x7f1bb400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcdbb5640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4003980 0x7f1bb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bcd3b4640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb40047d0 0x7f1bb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 -- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4003980 msgr2=0x7f1bb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4003980 0x7f1bb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 -- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb40047d0 msgr2=0x7f1bb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bb40047d0 0x7f1bb4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.878+0000 7f1bce3b6640 1 -- 172.21.15.37:0/2931793483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb4003530 con 0x7f1bb4005180 2023-07-09T21:35:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bce3b6640 1 -- 172.21.15.37:0/2931793483 reap_dead start 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 0x7f1bb400dba0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fc0 tx=0x7f1bc001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb479f684960f2b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00a5cb0 con 0x7f1bb4005180 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc000f040 con 0x7f1bb4005180 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bccbb3640 1 -- 172.21.15.37:0/2931793483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0003be0 con 0x7f1bb4005180 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 msgr2=0x7f1bb400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 0x7f1bb400dba0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009fc0 tx=0x7f1bc001cca0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- 172.21.15.37:0/2931793483 shutdown_connections 2023-07-09T21:35:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/2931793483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bb4005180 0x7f1bb400dba0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- 172.21.15.37:0/2931793483 >> 172.21.15.37:0/2931793483 conn(0x7f1bc80cde40 msgr2=0x7f1bc80ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- 172.21.15.37:0/2931793483 shutdown_connections 2023-07-09T21:35:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- 172.21.15.37:0/2931793483 wait complete. 2023-07-09T21:35:27.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 Processor -- start 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.882+0000 7f1bcfe19640 1 -- start start 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4005180 0x7f1bc80ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc81f02b0 0x7f1bc81f0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc80c7e30 con 0x7f1bc8152a30 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81533e0 con 0x7f1bc81f02b0 2023-07-09T21:35:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc81f1040 con 0x7f1bb4005180 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49834/0 (socket says 172.21.15.37:49834) 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 -- 172.21.15.37:0/519322796 learned_addr learned my addr 172.21.15.37:0/519322796 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcdbb5640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4005180 0x7f1bc80ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bce3b6640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc81f02b0 0x7f1bc81f0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 -- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4005180 msgr2=0x7f1bc80ade90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4005180 0x7f1bc80ade90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 -- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc81f02b0 msgr2=0x7f1bc81f0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc81f02b0 0x7f1bc81f0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 -- 172.21.15.37:0/519322796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc81eda30 con 0x7f1bc8152a30 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcd3b4640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80072c0 tx=0x7f1bb8007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb800f9c0 con 0x7f1bc8152a30 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb800fb40 con 0x7f1bc8152a30 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc81ecc70 con 0x7f1bc8152a30 2023-07-09T21:35:27.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb8012350 con 0x7f1bc8152a30 2023-07-09T21:35:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc81ed230 con 0x7f1bc8152a30 2023-07-09T21:35:27.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc804d7d0 con 0x7f1bc8152a30 2023-07-09T21:35:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.886+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f1bb80124b0 con 0x7f1bc8152a30 2023-07-09T21:35:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.890+0000 7f1bbe7fc640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 0x7f1bac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.890+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f1bb8083dd0 con 0x7f1bc8152a30 2023-07-09T21:35:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.890+0000 7f1bcdbb5640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 0x7f1bac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:27.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.890+0000 7f1bcdbb5640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 0x7f1bac068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c10 tx=0x7f1bc4009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:27.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:27.894+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bb8050f70 con 0x7f1bc8152a30 2023-07-09T21:35:28.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.065+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir0", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bc815d0f0 con 0x7f1bac066480 2023-07-09T21:35:28.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.141+0000 7f1bbe7fc640 1 -- 172.21.15.37:0/519322796 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f1bc4001530 con 0x7f1bac066480 2023-07-09T21:35:28.146 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir0 2023-07-09T21:35:28.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 msgr2=0x7f1bac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 0x7f1bac068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c10 tx=0x7f1bc4009040 comp rx=0 tx=0).stop 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 msgr2=0x7f1bc8152ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80072c0 tx=0x7f1bb8007780 comp rx=0 tx=0).stop 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 shutdown_connections 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f1bac066480 0x7f1bac068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:28.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bc81f02b0 0x7f1bc81f0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bc8152a30 0x7f1bc8152ea0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 --2- 172.21.15.37:0/519322796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bb4005180 0x7f1bc80ade90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 >> 172.21.15.37:0/519322796 conn(0x7f1bc80cde40 msgr2=0x7f1bc806c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 shutdown_connections 2023-07-09T21:35:28.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:28.145+0000 7f1bcfe19640 1 -- 172.21.15.37:0/519322796 wait complete. 2023-07-09T21:35:28.166 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2023-07-09T21:35:28.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.167 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2023-07-09T21:35:28.182 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:28.182 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:28.183 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:28.184 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_01_UTC 2023-07-09T21:35:28.184 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:28.184 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:28.185 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:28.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.185 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:28.249 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:28.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.250 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:28.312 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:28.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.313 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:28.376 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:28.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.377 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:28.441 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:28.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.442 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:28.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:28.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.504 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:28.563 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:28.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.564 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:28.624 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:28.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.624 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:28.684 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:28.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.685 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:28.743 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_33_01_UTC 2023-07-09T21:35:28.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.744 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_33_01_UTC) 2023-07-09T21:35:28.803 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:28.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.804 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:28.864 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:28.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.865 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:28.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:28.928 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2023-07-09T21:35:28.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir1 1M 2023-07-09T21:35:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 Processor -- start 2023-07-09T21:35:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 -- start start 2023-07-09T21:35:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67280b7980 0x7f6728160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672815bf80 con 0x7f67280ceb80 2023-07-09T21:35:29.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6728160570 con 0x7f67280d0780 2023-07-09T21:35:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f672e219640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67280cd070 con 0x7f67280b7980 2023-07-09T21:35:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f67277fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67280b7980 0x7f6728160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f6726ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67280ceb80 0x7f67280cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51714/0 (socket says 172.21.15.37:51714) 2023-07-09T21:35:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.169+0000 7f6726ffd640 1 -- 172.21.15.37:0/2026728768 learned_addr learned my addr 172.21.15.37:0/2026728768 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67277fe640 1 -- 172.21.15.37:0/2026728768 >> v1:172.21.15.119:6789/0 conn(0x7f67280d0780 legacy=0x7f67280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67277fe640 1 -- 172.21.15.37:0/2026728768 >> v1:172.21.15.37:6789/0 conn(0x7f67280ceb80 legacy=0x7f67280cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67277fe640 1 -- 172.21.15.37:0/2026728768 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280d02f0 con 0x7f67280b7980 2023-07-09T21:35:29.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67267fc640 1 -- 172.21.15.37:0/2026728768 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 185982109 0 0) 0x7f671c001120 con 0x7f67280ceb80 2023-07-09T21:35:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67277fe640 1 --2- 172.21.15.37:0/2026728768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728160030 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f67180097c0 tx=0x7f671801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1416be4971f2f401 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67267fc640 1 -- 172.21.15.37:0/2026728768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180ab600 con 0x7f67280b7980 2023-07-09T21:35:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67267fc640 1 -- 172.21.15.37:0/2026728768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67180a7050 con 0x7f67280b7980 2023-07-09T21:35:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f67267fc640 1 -- 172.21.15.37:0/2026728768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180ab980 con 0x7f67280b7980 2023-07-09T21:35:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f672e219640 1 -- 172.21.15.37:0/2026728768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 msgr2=0x7f6728160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f672e219640 1 --2- 172.21.15.37:0/2026728768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728160030 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f67180097c0 tx=0x7f671801c440 comp rx=0 tx=0).stop 2023-07-09T21:35:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f672e219640 1 -- 172.21.15.37:0/2026728768 shutdown_connections 2023-07-09T21:35:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f672e219640 1 --2- 172.21.15.37:0/2026728768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728160030 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.173+0000 7f672e219640 1 -- 172.21.15.37:0/2026728768 >> 172.21.15.37:0/2026728768 conn(0x7f6728073090 msgr2=0x7f6728069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- 172.21.15.37:0/2026728768 shutdown_connections 2023-07-09T21:35:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- 172.21.15.37:0/2026728768 wait complete. 2023-07-09T21:35:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 Processor -- start 2023-07-09T21:35:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- start start 2023-07-09T21:35:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 0x7f67280cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 0x7f67280cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67280c9270 con 0x7f67280b7980 2023-07-09T21:35:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67280c9b10 con 0x7f67280ceb80 2023-07-09T21:35:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f672e219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67280cb5f0 con 0x7f67280d0780 2023-07-09T21:35:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49864/0 (socket says 172.21.15.37:49864) 2023-07-09T21:35:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 -- 172.21.15.37:0/2508493345 learned_addr learned my addr 172.21.15.37:0/2508493345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f6726ffd640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 0x7f67280cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f6727fff640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 0x7f67280cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 -- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 msgr2=0x7f67280cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 0x7f67280cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 -- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 msgr2=0x7f67280cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 0x7f67280cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 -- 172.21.15.37:0/2508493345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6718009420 con 0x7f67280b7980 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f6726ffd640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 0x7f67280cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f6727fff640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 0x7f67280cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.177+0000 7f67277fe640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6718019050 tx=0x7f671801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180b7860 con 0x7f67280b7980 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67180b79c0 con 0x7f67280b7980 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67180b7d70 con 0x7f67280b7980 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67280cb880 con 0x7f67280b7980 2023-07-09T21:35:29.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67280c97a0 con 0x7f67280b7980 2023-07-09T21:35:29.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67280737d0 con 0x7f67280b7980 2023-07-09T21:35:29.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f67180b5400 con 0x7f67280b7980 2023-07-09T21:35:29.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 0x7f6714068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6349+0+0 (secure 0 0 0) 0x7f671811ed30 con 0x7f67280b7980 2023-07-09T21:35:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.181+0000 7f6726ffd640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 0x7f6714068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.185+0000 7f6726ffd640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 0x7f6714068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f672815be30 tx=0x7f671c007a60 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.185+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f67280737d0 con 0x7f67280b7980 2023-07-09T21:35:29.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.361+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir1", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f67280cff50 con 0x7f6714066480 2023-07-09T21:35:29.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f670ffff640 1 -- 172.21.15.37:0/2508493345 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f67280cff50 con 0x7f6714066480 2023-07-09T21:35:29.440 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir1 2023-07-09T21:35:29.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 msgr2=0x7f6714068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 0x7f6714068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f672815be30 tx=0x7f671c007a60 comp rx=0 tx=0).stop 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 msgr2=0x7f6728157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f6718019050 tx=0x7f671801ac80 comp rx=0 tx=0).stop 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 shutdown_connections 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6714066480 0x7f6714068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67280d0780 0x7f67280cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67280ceb80 0x7f67280cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 --2- 172.21.15.37:0/2508493345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67280b7980 0x7f6728157980 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 >> 172.21.15.37:0/2508493345 conn(0x7f6728073090 msgr2=0x7f67280b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 shutdown_connections 2023-07-09T21:35:29.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:29.437+0000 7f672e219640 1 -- 172.21.15.37:0/2508493345 wait complete. 2023-07-09T21:35:29.460 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2023-07-09T21:35:29.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.461 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2023-07-09T21:35:29.478 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:29.478 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:29.478 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:29.478 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:29.479 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:29.480 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:29.480 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:29.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:29.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.481 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:29.541 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:29.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.542 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:29.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:29.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.601 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:29.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:29.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.662 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:29.720 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:29.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.721 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:29.780 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:29.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.781 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:29.841 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:29.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.842 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:29.902 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:29.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.903 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:29.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:29.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:29.963 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:30.020 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:30.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.021 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:30.102 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:30.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.103 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:30.166 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:30.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.167 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:30.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.235 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2023-07-09T21:35:30.287 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir2 1M 2023-07-09T21:35:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 Processor -- start 2023-07-09T21:35:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 -- start start 2023-07-09T21:35:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15400cf290 0x7f1540160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 0x7f15400d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154015bf80 con 0x7f15400b7980 2023-07-09T21:35:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400cd070 con 0x7f15400cf290 2023-07-09T21:35:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1546cd8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400cfd70 con 0x7f15400d0780 2023-07-09T21:35:30.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1537fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15400cf290 0x7f1540160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1544a74640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15400b7980 0x7f15400ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51720/0 (socket says 172.21.15.37:51720) 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1544a74640 1 -- 172.21.15.37:0/2591403695 learned_addr learned my addr 172.21.15.37:0/2591403695 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1545275640 1 --2- 172.21.15.37:0/2591403695 >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 0x7f15400d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1537fff640 1 -- 172.21.15.37:0/2591403695 >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 msgr2=0x7f15400d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1537fff640 1 --2- 172.21.15.37:0/2591403695 >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 0x7f15400d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1537fff640 1 -- 172.21.15.37:0/2591403695 >> v1:172.21.15.37:6789/0 conn(0x7f15400b7980 legacy=0x7f15400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1537fff640 1 -- 172.21.15.37:0/2591403695 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1540160570 con 0x7f15400cf290 2023-07-09T21:35:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.489+0000 7f1545275640 1 --2- 172.21.15.37:0/2591403695 >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 0x7f15400d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1537fff640 1 --2- 172.21.15.37:0/2591403695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400cf290 0x7f1540160030 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f15400b1240 tx=0x7f153001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9a88ae169de48c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f15377fe640 1 -- 172.21.15.37:0/2591403695 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300ab600 con 0x7f15400cf290 2023-07-09T21:35:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f15377fe640 1 -- 172.21.15.37:0/2591403695 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15300a7050 con 0x7f15400cf290 2023-07-09T21:35:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f15377fe640 1 -- 172.21.15.37:0/2591403695 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15300ab980 con 0x7f15400cf290 2023-07-09T21:35:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 -- 172.21.15.37:0/2591403695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400cf290 msgr2=0x7f1540160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 --2- 172.21.15.37:0/2591403695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400cf290 0x7f1540160030 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f15400b1240 tx=0x7f153001c460 comp rx=0 tx=0).stop 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 -- 172.21.15.37:0/2591403695 shutdown_connections 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 --2- 172.21.15.37:0/2591403695 >> v2:172.21.15.119:3300/0 conn(0x7f15400d0780 0x7f15400d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 --2- 172.21.15.37:0/2591403695 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400cf290 0x7f1540160030 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 -- 172.21.15.37:0/2591403695 >> 172.21.15.37:0/2591403695 conn(0x7f1540073090 msgr2=0x7f1540069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 -- 172.21.15.37:0/2591403695 shutdown_connections 2023-07-09T21:35:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.493+0000 7f1546cd8640 1 -- 172.21.15.37:0/2591403695 wait complete. 2023-07-09T21:35:30.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 Processor -- start 2023-07-09T21:35:30.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 -- start start 2023-07-09T21:35:30.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400cf290 0x7f15400b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15400d0780 0x7f154013dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540151720 con 0x7f15400b7980 2023-07-09T21:35:30.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1540157410 con 0x7f15400cf290 2023-07-09T21:35:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1546cd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1540156800 con 0x7f15400d0780 2023-07-09T21:35:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1544a74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1544a74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49882/0 (socket says 172.21.15.37:49882) 2023-07-09T21:35:30.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1544a74640 1 -- 172.21.15.37:0/1355188132 learned_addr learned my addr 172.21.15.37:0/1355188132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1545275640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15400d0780 0x7f154013dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.497+0000 7f1537fff640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400cf290 0x7f15400b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 -- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15400d0780 msgr2=0x7f154013dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15400d0780 0x7f154013dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 -- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400cf290 msgr2=0x7f15400b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400cf290 0x7f15400b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 -- 172.21.15.37:0/1355188132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530009420 con 0x7f15400b7980 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1544a74640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c500 tx=0x7f153c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c005cf0 con 0x7f15400b7980 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153c005e50 con 0x7f15400b7980 2023-07-09T21:35:30.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1540156ae0 con 0x7f15400b7980 2023-07-09T21:35:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153c0072f0 con 0x7f15400b7980 2023-07-09T21:35:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15401570a0 con 0x7f15400b7980 2023-07-09T21:35:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154004d7d0 con 0x7f15400b7980 2023-07-09T21:35:30.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f153c007450 con 0x7f15400b7980 2023-07-09T21:35:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 0x7f152c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6725+0+0 (secure 0 0 0) 0x7f153c083600 con 0x7f15400b7980 2023-07-09T21:35:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.501+0000 7f1537fff640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 0x7f152c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:30.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.505+0000 7f1537fff640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 0x7f152c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15300ad000 tx=0x7f1530008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:30.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.505+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f153c0506b0 con 0x7f15400b7980 2023-07-09T21:35:30.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:35:30.567 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:35:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.721+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir2", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f15400ccd90 con 0x7f152c0664b0 2023-07-09T21:35:30.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.789+0000 7f15357fa640 1 -- 172.21.15.37:0/1355188132 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f15300bb0d0 con 0x7f152c0664b0 2023-07-09T21:35:30.795 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir2 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 msgr2=0x7f152c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 0x7f152c068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f15300ad000 tx=0x7f1530008040 comp rx=0 tx=0).stop 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 msgr2=0x7f1540157f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f153c00c500 tx=0x7f153c00c9c0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 shutdown_connections 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f152c0664b0 0x7f152c068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15400d0780 0x7f154013dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15400cf290 0x7f15400b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 --2- 172.21.15.37:0/1355188132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15400b7980 0x7f1540157f60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 >> 172.21.15.37:0/1355188132 conn(0x7f1540073090 msgr2=0x7f154015fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 shutdown_connections 2023-07-09T21:35:30.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:30.793+0000 7f1546cd8640 1 -- 172.21.15.37:0/1355188132 wait complete. 2023-07-09T21:35:30.815 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2023-07-09T21:35:30.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.816 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2023-07-09T21:35:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:30.835 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:30.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:30.837 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:30.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.838 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:30.897 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:30.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.898 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:30.957 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:30.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:30.958 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:31.018 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:31.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.020 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:31.107 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:31.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.108 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:31.172 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:31.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.173 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:31.232 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:31.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.233 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:31.292 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:31.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.293 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:31.352 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:31.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.353 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:31.411 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:31.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.412 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:31.478 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:31.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.478 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:31.536 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:31.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.536 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:31.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:31.596 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2023-07-09T21:35:31.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir3 1M 2023-07-09T21:35:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 Processor -- start 2023-07-09T21:35:31.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 -- start start 2023-07-09T21:35:31.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f93e00cda10 0x7f93e00c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00c4c90 con 0x7f93e0159990 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e00ca170 con 0x7f93e01595c0 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e8559640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e00ca730 con 0x7f93e00cda10 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e5af4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93e0159990 0x7f93e00cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51736/0 (socket says 172.21.15.37:51736) 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e5af4640 1 -- 172.21.15.37:0/4177917664 learned_addr learned my addr 172.21.15.37:0/4177917664 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:31.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.857+0000 7f93e6af6640 1 --2- 172.21.15.37:0/4177917664 >> v2:172.21.15.37:3300/0 conn(0x7f93e00cda10 0x7f93e00c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e52f3640 1 -- 172.21.15.37:0/4177917664 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932220024 0 0) 0x7f93d0001120 con 0x7f93e0159990 2023-07-09T21:35:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e52f3640 1 -- 172.21.15.37:0/4177917664 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93cc003530 con 0x7f93e0159990 2023-07-09T21:35:31.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e6af6640 1 -- 172.21.15.37:0/4177917664 >> v1:172.21.15.119:6789/0 conn(0x7f93e01595c0 legacy=0x7f93e015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e6af6640 1 -- 172.21.15.37:0/4177917664 >> v1:172.21.15.37:6789/0 conn(0x7f93e0159990 legacy=0x7f93e00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e6af6640 1 -- 172.21.15.37:0/4177917664 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e00ca450 con 0x7f93e00cda10 2023-07-09T21:35:31.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e6af6640 1 --2- 172.21.15.37:0/4177917664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e00cda10 0x7f93e00c4750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc9ea1e7b2e05b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:31.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e52f3640 1 -- 172.21.15.37:0/4177917664 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80a59e0 con 0x7f93e00cda10 2023-07-09T21:35:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e52f3640 1 -- 172.21.15.37:0/4177917664 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d80a5b40 con 0x7f93e00cda10 2023-07-09T21:35:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e52f3640 1 -- 172.21.15.37:0/4177917664 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d80ad440 con 0x7f93e00cda10 2023-07-09T21:35:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 -- 172.21.15.37:0/4177917664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e00cda10 msgr2=0x7f93e00c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:31.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 --2- 172.21.15.37:0/4177917664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e00cda10 0x7f93e00c4750 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009d90 tx=0x7f93d801c920 comp rx=0 tx=0).stop 2023-07-09T21:35:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 -- 172.21.15.37:0/4177917664 shutdown_connections 2023-07-09T21:35:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 --2- 172.21.15.37:0/4177917664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e00cda10 0x7f93e00c4750 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 -- 172.21.15.37:0/4177917664 >> 172.21.15.37:0/4177917664 conn(0x7f93e00cde40 msgr2=0x7f93e00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.861+0000 7f93e8559640 1 -- 172.21.15.37:0/4177917664 shutdown_connections 2023-07-09T21:35:31.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- 172.21.15.37:0/4177917664 wait complete. 2023-07-09T21:35:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 Processor -- start 2023-07-09T21:35:31.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- start start 2023-07-09T21:35:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93e00cda10 0x7f93e0147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93e0159990 0x7f93e0150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e006ae20 con 0x7f93e01595c0 2023-07-09T21:35:31.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e00c7c90 con 0x7f93e00cda10 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e0164e30 con 0x7f93e0159990 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49910/0 (socket says 172.21.15.37:49910) 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 -- 172.21.15.37:0/642918013 learned_addr learned my addr 172.21.15.37:0/642918013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e62f5640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93e00cda10 0x7f93e0147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e6af6640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93e0159990 0x7f93e0150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 -- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93e0159990 msgr2=0x7f93e0150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:31.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93e0159990 0x7f93e0150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 -- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93e00cda10 msgr2=0x7f93e0147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93e00cda10 0x7f93e0147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:31.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 -- 172.21.15.37:0/642918013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009a70 con 0x7f93e01595c0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e5af4640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c730 tx=0x7f93d000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0005ac0 con 0x7f93e01595c0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d0005c20 con 0x7f93e01595c0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d0007070 con 0x7f93e01595c0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e0165110 con 0x7f93e01595c0 2023-07-09T21:35:31.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.865+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e01628d0 con 0x7f93e01595c0 2023-07-09T21:35:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.869+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e006af90 con 0x7f93e01595c0 2023-07-09T21:35:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.869+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f93d00071d0 con 0x7f93e01595c0 2023-07-09T21:35:31.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.869+0000 7f93d6ffd640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 0x7f93c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.869+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f93d0083720 con 0x7f93e01595c0 2023-07-09T21:35:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.869+0000 7f93e62f5640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 0x7f93c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:31.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.873+0000 7f93e62f5640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 0x7f93c4068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93dc007fd0 tx=0x7f93dc009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:31.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:31.873+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93e006af90 con 0x7f93e01595c0 2023-07-09T21:35:32.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.057+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir3", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f93e00c9df0 con 0x7f93c4066480 2023-07-09T21:35:32.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93d6ffd640 1 -- 172.21.15.37:0/642918013 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f93dc0014f0 con 0x7f93c4066480 2023-07-09T21:35:32.176 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir3 2023-07-09T21:35:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 msgr2=0x7f93c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 0x7f93c4068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93dc007fd0 tx=0x7f93dc009040 comp rx=0 tx=0).stop 2023-07-09T21:35:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 msgr2=0x7f93e00c7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:32.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f93d000c730 tx=0x7f93d000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:35:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 shutdown_connections 2023-07-09T21:35:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f93c4066480 0x7f93c4068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:32.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f93e0159990 0x7f93e0150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93e01595c0 0x7f93e00c7750 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 --2- 172.21.15.37:0/642918013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f93e00cda10 0x7f93e0147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 >> 172.21.15.37:0/642918013 conn(0x7f93e00cde40 msgr2=0x7f93e01518b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:32.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 shutdown_connections 2023-07-09T21:35:32.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:32.173+0000 7f93e8559640 1 -- 172.21.15.37:0/642918013 wait complete. 2023-07-09T21:35:32.197 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2023-07-09T21:35:32.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.198 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2023-07-09T21:35:32.217 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:32.217 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:32.217 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:32.217 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:32.218 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:32.219 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:32.219 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:32.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.220 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:32.281 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:32.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.281 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:32.340 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:32.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.341 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:32.400 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:32.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.400 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:32.459 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:32.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.460 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:32.520 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:32.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.520 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:32.579 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:32.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.580 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:32.646 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:32.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.647 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:32.704 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:32.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.705 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:32.768 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:32.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.769 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:32.832 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:32.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.833 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:32.896 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:32.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.896 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:32.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:32.960 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2023-07-09T21:35:33.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir4 1M 2023-07-09T21:35:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 Processor -- start 2023-07-09T21:35:33.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 -- start start 2023-07-09T21:35:33.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe63c0b7980 0x7fe63c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0ceb80 0x7fe63c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 0x7fe63c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0cd070 con 0x7fe63c0b7980 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63c0cfd70 con 0x7fe63c0b3c20 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe643c5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c15bf80 con 0x7fe63c0ceb80 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe63c0b7980 0x7fe63c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe63c0b7980 0x7fe63c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49926/0 (socket says 172.21.15.37:49926) 2023-07-09T21:35:33.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 -- 172.21.15.37:0/1089043809 learned_addr learned my addr 172.21.15.37:0/1089043809 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:33.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6421f9640 1 --2- 172.21.15.37:0/1089043809 >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 0x7fe63c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6411f7640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0ceb80 0x7fe63c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 -- 172.21.15.37:0/1089043809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0ceb80 msgr2=0x7fe63c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0ceb80 0x7fe63c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 -- 172.21.15.37:0/1089043809 >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 msgr2=0x7fe63c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 --2- 172.21.15.37:0/1089043809 >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 0x7fe63c0b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6419f8640 1 -- 172.21.15.37:0/1089043809 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c160570 con 0x7fe63c0b7980 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.221+0000 7fe6421f9640 1 --2- 172.21.15.37:0/1089043809 >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 0x7fe63c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:33.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe6419f8640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0b7980 0x7fe63c160030 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe63c08ad30 tx=0x7fe63801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb5803133107b217 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:33.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe6409f6640 1 -- 172.21.15.37:0/1089043809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ab600 con 0x7fe63c0b7980 2023-07-09T21:35:33.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe6409f6640 1 -- 172.21.15.37:0/1089043809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6380a7050 con 0x7fe63c0b7980 2023-07-09T21:35:33.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe6409f6640 1 -- 172.21.15.37:0/1089043809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ab980 con 0x7fe63c0b7980 2023-07-09T21:35:33.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- 172.21.15.37:0/1089043809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0b7980 msgr2=0x7fe63c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:33.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0b7980 0x7fe63c160030 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe63c08ad30 tx=0x7fe63801c500 comp rx=0 tx=0).stop 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- 172.21.15.37:0/1089043809 shutdown_connections 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 --2- 172.21.15.37:0/1089043809 >> v2:172.21.15.119:3300/0 conn(0x7fe63c0b3c20 0x7fe63c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0ceb80 0x7fe63c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 --2- 172.21.15.37:0/1089043809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0b7980 0x7fe63c160030 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- 172.21.15.37:0/1089043809 >> 172.21.15.37:0/1089043809 conn(0x7fe63c073090 msgr2=0x7fe63c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- 172.21.15.37:0/1089043809 shutdown_connections 2023-07-09T21:35:33.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- 172.21.15.37:0/1089043809 wait complete. 2023-07-09T21:35:33.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 Processor -- start 2023-07-09T21:35:33.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.225+0000 7fe643c5c640 1 -- start start 2023-07-09T21:35:33.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 0x7fe63c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0b7980 0x7fe63c156590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0d1b40 con 0x7fe63c0ceb80 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0d1de0 con 0x7fe63c0b3c20 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe63c0d20c0 con 0x7fe63c0b7980 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49938/0 (socket says 172.21.15.37:49938) 2023-07-09T21:35:33.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 -- 172.21.15.37:0/3544033710 learned_addr learned my addr 172.21.15.37:0/3544033710 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6411f7640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0b7980 0x7fe63c156590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6419f8640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 0x7fe63c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 -- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0b7980 msgr2=0x7fe63c156590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0b7980 0x7fe63c156590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 -- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 msgr2=0x7fe63c14e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 0x7fe63c14e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 -- 172.21.15.37:0/3544033710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6380094d0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6419f8640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 0x7fe63c14e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6421f9640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe634007e70 tx=0x7fe63400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:33.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634003ba0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63400f040 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63c14eeb0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63400de80 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63c156ad0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.229+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63c04d7d0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.233+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fe634004030 con 0x7fe63c0ceb80 2023-07-09T21:35:33.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.233+0000 7fe6327fc640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 0x7fe620068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:33.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.233+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 7061+0+0 (secure 0 0 0) 0x7fe6340849d0 con 0x7fe63c0ceb80 2023-07-09T21:35:33.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.233+0000 7fe6419f8640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 0x7fe620068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:33.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.233+0000 7fe6419f8640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 0x7fe620068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe638008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:33.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.237+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe634051630 con 0x7fe63c0ceb80 2023-07-09T21:35:33.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.453+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir4", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fe63c0d1f50 con 0x7fe620066480 2023-07-09T21:35:33.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe6327fc640 1 -- 172.21.15.37:0/3544033710 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fe63c0d1f50 con 0x7fe620066480 2023-07-09T21:35:33.529 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir4 2023-07-09T21:35:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 msgr2=0x7fe620068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 0x7fe620068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe638008040 comp rx=0 tx=0).stop 2023-07-09T21:35:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 msgr2=0x7fe63c1f46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe634007e70 tx=0x7fe63400d4a0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 shutdown_connections 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fe620066480 0x7fe620068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe63c0ceb80 0x7fe63c1f46e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe63c0b7980 0x7fe63c156590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 --2- 172.21.15.37:0/3544033710 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe63c0b3c20 0x7fe63c14e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.525+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 >> 172.21.15.37:0/3544033710 conn(0x7fe63c073090 msgr2=0x7fe63c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.529+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 shutdown_connections 2023-07-09T21:35:33.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:33.529+0000 7fe643c5c640 1 -- 172.21.15.37:0/3544033710 wait complete. 2023-07-09T21:35:33.549 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2023-07-09T21:35:33.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.550 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:33.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:33.570 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:33.570 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:33.570 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:33.570 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:33.570 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:33.571 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:33.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.571 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:33.633 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:33.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.633 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:33.692 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:33.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.693 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:33.751 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:33.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.752 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:33.816 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:33.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.816 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:33.876 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:33.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.877 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:33.940 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:33.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:33.942 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:34.001 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:34.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.002 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:34.064 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:34.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.065 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:34.153 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:34.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.154 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:34.251 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:34.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.252 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:34.270 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:34.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.271 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:34.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.336 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2023-07-09T21:35:34.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir5 1M 2023-07-09T21:35:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 Processor -- start 2023-07-09T21:35:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 -- start start 2023-07-09T21:35:34.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84e00b7980 0x7f84e0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e015bf80 con 0x7f84e00b3c20 2023-07-09T21:35:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e00cd070 con 0x7f84e00b7980 2023-07-09T21:35:34.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.581+0000 7f84e606d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e00cfd70 con 0x7f84e00ceb80 2023-07-09T21:35:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84dffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84e00b3c20 0x7f84e00b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51748/0 (socket says 172.21.15.37:51748) 2023-07-09T21:35:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84dffff640 1 -- 172.21.15.37:0/1281981840 learned_addr learned my addr 172.21.15.37:0/1281981840 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 --2- 172.21.15.37:0/1281981840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84df7fe640 1 --2- 172.21.15.37:0/1281981840 >> v2:172.21.15.119:3300/0 conn(0x7f84e00b7980 0x7f84e0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84de7fc640 1 -- 172.21.15.37:0/1281981840 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716320716 0 0) 0x7f84d80014a0 con 0x7f84e00b3c20 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84de7fc640 1 -- 172.21.15.37:0/1281981840 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c8003530 con 0x7f84e00b3c20 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 -- 172.21.15.37:0/1281981840 >> v2:172.21.15.119:3300/0 conn(0x7f84e00b7980 msgr2=0x7f84e0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 --2- 172.21.15.37:0/1281981840 >> v2:172.21.15.119:3300/0 conn(0x7f84e00b7980 0x7f84e0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 -- 172.21.15.37:0/1281981840 >> v1:172.21.15.37:6789/0 conn(0x7f84e00b3c20 legacy=0x7f84e00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 -- 172.21.15.37:0/1281981840 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0160570 con 0x7f84e00ceb80 2023-07-09T21:35:34.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.585+0000 7f84deffd640 1 --2- 172.21.15.37:0/1281981840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e00cef90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84d40097c0 tx=0x7f84d401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b51cda869e2cc558 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84de7fc640 1 -- 172.21.15.37:0/1281981840 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40ab600 con 0x7f84e00ceb80 2023-07-09T21:35:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84de7fc640 1 -- 172.21.15.37:0/1281981840 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d40a7050 con 0x7f84e00ceb80 2023-07-09T21:35:34.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84de7fc640 1 -- 172.21.15.37:0/1281981840 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d40ab980 con 0x7f84e00ceb80 2023-07-09T21:35:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- 172.21.15.37:0/1281981840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 msgr2=0x7f84e00cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- 172.21.15.37:0/1281981840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e00cef90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84d40097c0 tx=0x7f84d401c480 comp rx=0 tx=0).stop 2023-07-09T21:35:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- 172.21.15.37:0/1281981840 shutdown_connections 2023-07-09T21:35:34.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- 172.21.15.37:0/1281981840 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e00cef90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- 172.21.15.37:0/1281981840 >> v2:172.21.15.119:3300/0 conn(0x7f84e00b7980 0x7f84e0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- 172.21.15.37:0/1281981840 >> 172.21.15.37:0/1281981840 conn(0x7f84e0073090 msgr2=0x7f84e0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- 172.21.15.37:0/1281981840 shutdown_connections 2023-07-09T21:35:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- 172.21.15.37:0/1281981840 wait complete. 2023-07-09T21:35:34.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 Processor -- start 2023-07-09T21:35:34.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- start start 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e00b7980 0x7f84e00b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e0159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e015deb0 con 0x7f84e00b3c20 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e015ba10 con 0x7f84e00b7980 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84e606d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e015e0c0 con 0x7f84e00ceb80 2023-07-09T21:35:34.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.589+0000 7f84df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49952/0 (socket says 172.21.15.37:49952) 2023-07-09T21:35:34.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 -- 172.21.15.37:0/1610979731 learned_addr learned my addr 172.21.15.37:0/1610979731 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84deffd640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e00b7980 0x7f84e00b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 -- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 msgr2=0x7f84e0159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84dffff640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e0159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e0159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 -- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e00b7980 msgr2=0x7f84e00b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e00b7980 0x7f84e00b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 -- 172.21.15.37:0/1610979731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4009420 con 0x7f84e00b3c20 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84df7fe640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f84d000e870 tx=0x7f84d000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0009510 con 0x7f84e00b3c20 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000eec0 con 0x7f84e00b3c20 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000cb40 con 0x7f84e00b3c20 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e015e3a0 con 0x7f84e00b3c20 2023-07-09T21:35:34.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e015e960 con 0x7f84e00b3c20 2023-07-09T21:35:34.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e004d7d0 con 0x7f84e00b3c20 2023-07-09T21:35:34.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.593+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f84d000cca0 con 0x7f84e00b3c20 2023-07-09T21:35:34.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.597+0000 7f84c7fff640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 0x7f84cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:34.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.597+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f84d00846c0 con 0x7f84e00b3c20 2023-07-09T21:35:34.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.597+0000 7f84deffd640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 0x7f84cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:34.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.597+0000 7f84deffd640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 0x7f84cc068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ad000 tx=0x7f84d40a6000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:34.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.601+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84d0051410 con 0x7f84e00b3c20 2023-07-09T21:35:34.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.773+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir5", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f84e00ccd90 con 0x7f84cc066480 2023-07-09T21:35:34.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.849+0000 7f84c7fff640 1 -- 172.21.15.37:0/1610979731 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f84d40bb0d0 con 0x7f84cc066480 2023-07-09T21:35:34.854 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir5 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 msgr2=0x7f84cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 0x7f84cc068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f84d40ad000 tx=0x7f84d40a6000 comp rx=0 tx=0).stop 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 msgr2=0x7f84e015b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f84d000e870 tx=0x7f84d000ec70 comp rx=0 tx=0).stop 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 shutdown_connections 2023-07-09T21:35:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f84cc066480 0x7f84cc068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84e00ceb80 0x7f84e0159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84e00b7980 0x7f84e00b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 --2- 172.21.15.37:0/1610979731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84e00b3c20 0x7f84e015b4d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 >> 172.21.15.37:0/1610979731 conn(0x7f84e0073090 msgr2=0x7f84e0158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 shutdown_connections 2023-07-09T21:35:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:34.853+0000 7f84e606d640 1 -- 172.21.15.37:0/1610979731 wait complete. 2023-07-09T21:35:34.874 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2023-07-09T21:35:34.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.875 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2023-07-09T21:35:34.893 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:34.894 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:34.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:34.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:34.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:34.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:34.896 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:34.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.896 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:34.961 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:34.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:34.962 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:35.101 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:35.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.102 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:35.130 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:35.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.130 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:35.191 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:35.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.192 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:35.273 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:35.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.273 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:35.336 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:35.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.337 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:35.400 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:35.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.401 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:35.459 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:35.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.460 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:35.519 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:35.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.520 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:35.583 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:35.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.584 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:35.647 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:35.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.649 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:35.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:35.713 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2023-07-09T21:35:35.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir6 1M 2023-07-09T21:35:35.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 Processor -- start 2023-07-09T21:35:35.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 -- start start 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 0x7fad7c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad7c0ceb80 0x7fad7c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7c15bf80 con 0x7fad7c0b3c20 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0cd070 con 0x7fad7c0ceb80 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad8430d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad7c0cfd70 con 0x7fad7c0b7980 2023-07-09T21:35:35.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad7c0ceb80 0x7fad7c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad7c0ceb80 0x7fad7c0cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49960/0 (socket says 172.21.15.37:49960) 2023-07-09T21:35:35.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 -- 172.21.15.37:0/3424636293 learned_addr learned my addr 172.21.15.37:0/3424636293 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:35.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad820a9640 1 --2- 172.21.15.37:0/3424636293 >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 0x7fad7c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 -- 172.21.15.37:0/3424636293 >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 msgr2=0x7fad7c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 --2- 172.21.15.37:0/3424636293 >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 0x7fad7c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 -- 172.21.15.37:0/3424636293 >> v1:172.21.15.119:6789/0 conn(0x7fad7c0b3c20 legacy=0x7fad7c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad818a8640 1 -- 172.21.15.37:0/3424636293 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7c160570 con 0x7fad7c0ceb80 2023-07-09T21:35:35.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.957+0000 7fad820a9640 1 --2- 172.21.15.37:0/3424636293 >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 0x7fad7c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:35.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad818a8640 1 --2- 172.21.15.37:0/3424636293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0cefc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad7c069aa0 tx=0x7fad6c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0f583a7695ced8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad810a7640 1 -- 172.21.15.37:0/3424636293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0ab600 con 0x7fad7c0ceb80 2023-07-09T21:35:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad810a7640 1 -- 172.21.15.37:0/3424636293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c0a7050 con 0x7fad7c0ceb80 2023-07-09T21:35:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad810a7640 1 -- 172.21.15.37:0/3424636293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0ab980 con 0x7fad7c0ceb80 2023-07-09T21:35:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 -- 172.21.15.37:0/3424636293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 msgr2=0x7fad7c0cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:35.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 --2- 172.21.15.37:0/3424636293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0cefc0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fad7c069aa0 tx=0x7fad6c01c500 comp rx=0 tx=0).stop 2023-07-09T21:35:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 -- 172.21.15.37:0/3424636293 shutdown_connections 2023-07-09T21:35:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 --2- 172.21.15.37:0/3424636293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0cefc0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 --2- 172.21.15.37:0/3424636293 >> v2:172.21.15.119:3300/0 conn(0x7fad7c0b7980 0x7fad7c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 -- 172.21.15.37:0/3424636293 >> 172.21.15.37:0/3424636293 conn(0x7fad7c073090 msgr2=0x7fad7c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:35.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 -- 172.21.15.37:0/3424636293 shutdown_connections 2023-07-09T21:35:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.961+0000 7fad8430d640 1 -- 172.21.15.37:0/3424636293 wait complete. 2023-07-09T21:35:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 Processor -- start 2023-07-09T21:35:35.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- start start 2023-07-09T21:35:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7c0b3c20 0x7fad7c153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad7c0b7980 0x7fad7c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c154500 con 0x7fad7c0ceb80 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c152c40 con 0x7fad7c0b3c20 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c152f20 con 0x7fad7c0b7980 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49962/0 (socket says 172.21.15.37:49962) 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 -- 172.21.15.37:0/561375149 learned_addr learned my addr 172.21.15.37:0/561375149 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad818a8640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad7c0b7980 0x7fad7c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad820a9640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7c0b3c20 0x7fad7c153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 -- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad7c0b7980 msgr2=0x7fad7c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad7c0b7980 0x7fad7c152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 -- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7c0b3c20 msgr2=0x7fad7c153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7c0b3c20 0x7fad7c153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:35.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 -- 172.21.15.37:0/561375149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0094d0 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad828aa640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad7400c770 tx=0x7fad7400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad74003b80 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad74003ce0 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad7400aa90 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad7c153200 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.965+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7c1537c0 con 0x7fad7c0ceb80 2023-07-09T21:35:35.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7c04d7d0 con 0x7fad7c0ceb80 2023-07-09T21:35:35.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fad7400abf0 con 0x7fad7c0ceb80 2023-07-09T21:35:35.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad72ffd640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 0x7fad60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:35.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 7489+0+0 (secure 0 0 0) 0x7fad74084230 con 0x7fad7c0ceb80 2023-07-09T21:35:35.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad820a9640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 0x7fad60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:35.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.969+0000 7fad820a9640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 0x7fad60068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad7c155c50 tx=0x7fad78008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:35.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:35.973+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad74050f30 con 0x7fad7c0ceb80 2023-07-09T21:35:36.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.161+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir6", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fad7c0ccd90 con 0x7fad60066480 2023-07-09T21:35:36.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad72ffd640 1 -- 172.21.15.37:0/561375149 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fad780118b0 con 0x7fad60066480 2023-07-09T21:35:36.244 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir6 2023-07-09T21:35:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 msgr2=0x7fad60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:36.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 0x7fad60068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fad7c155c50 tx=0x7fad78008040 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 msgr2=0x7fad7c0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fad7400c770 tx=0x7fad7400cc30 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 shutdown_connections 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fad60066480 0x7fad60068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad7c0ceb80 0x7fad7c0c5cb0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fad7c0b7980 0x7fad7c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 --2- 172.21.15.37:0/561375149 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fad7c0b3c20 0x7fad7c153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:36.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 >> 172.21.15.37:0/561375149 conn(0x7fad7c073090 msgr2=0x7fad7c0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 shutdown_connections 2023-07-09T21:35:36.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:36.241+0000 7fad8430d640 1 -- 172.21.15.37:0/561375149 wait complete. 2023-07-09T21:35:36.265 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2023-07-09T21:35:36.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.265 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2023-07-09T21:35:36.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:36.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:36.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:36.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:36.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:36.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:36.288 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_24_00_UTC 2023-07-09T21:35:36.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.289 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_24_00_UTC) 2023-07-09T21:35:36.348 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:36.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.349 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:36.408 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:36.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.409 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:36.473 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:36.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.473 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:36.532 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:36.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.533 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:36.591 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:36.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.592 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:36.655 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:36.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.656 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:36.716 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:36.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.717 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:36.776 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:36.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:36.839 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:36.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.840 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:36.899 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:36.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.900 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:36.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:36.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:36.965 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:37.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.072 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2023-07-09T21:35:37.102 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir7 1M 2023-07-09T21:35:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 Processor -- start 2023-07-09T21:35:37.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 -- start start 2023-07-09T21:35:37.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc3040b7980 0x7fc304160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc30415bf80 con 0x7fc3040d0780 2023-07-09T21:35:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc304160570 con 0x7fc3040ceb80 2023-07-09T21:35:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30887b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3040cd070 con 0x7fc3040b7980 2023-07-09T21:35:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc302d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3040d0780 0x7fc3040d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51750/0 (socket says 172.21.15.37:51750) 2023-07-09T21:35:37.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc302d9d640 1 -- 172.21.15.37:0/2102457865 learned_addr learned my addr 172.21.15.37:0/2102457865 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30259c640 1 --2- 172.21.15.37:0/2102457865 >> v2:172.21.15.119:3300/0 conn(0x7fc3040b7980 0x7fc304160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30159a640 1 -- 172.21.15.37:0/2102457865 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1360756357 0 0) 0x7fc2fc0014a0 con 0x7fc3040d0780 2023-07-09T21:35:37.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30159a640 1 -- 172.21.15.37:0/2102457865 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2ec003530 con 0x7fc3040d0780 2023-07-09T21:35:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30259c640 1 -- 172.21.15.37:0/2102457865 >> v1:172.21.15.119:6789/0 conn(0x7fc3040ceb80 legacy=0x7fc3040cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30259c640 1 -- 172.21.15.37:0/2102457865 >> v1:172.21.15.37:6789/0 conn(0x7fc3040d0780 legacy=0x7fc3040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.297+0000 7fc30259c640 1 -- 172.21.15.37:0/2102457865 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3040d02f0 con 0x7fc3040b7980 2023-07-09T21:35:37.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30259c640 1 --2- 172.21.15.37:0/2102457865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040b7980 0x7fc304160030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40097c0 tx=0x7fc2f401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a256015fef92f7cf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30159a640 1 -- 172.21.15.37:0/2102457865 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40ab600 con 0x7fc3040b7980 2023-07-09T21:35:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30159a640 1 -- 172.21.15.37:0/2102457865 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f40a7050 con 0x7fc3040b7980 2023-07-09T21:35:37.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30159a640 1 -- 172.21.15.37:0/2102457865 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f40ab980 con 0x7fc3040b7980 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 -- 172.21.15.37:0/2102457865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040b7980 msgr2=0x7fc304160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 --2- 172.21.15.37:0/2102457865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040b7980 0x7fc304160030 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40097c0 tx=0x7fc2f401c480 comp rx=0 tx=0).stop 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 -- 172.21.15.37:0/2102457865 shutdown_connections 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 --2- 172.21.15.37:0/2102457865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040b7980 0x7fc304160030 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 -- 172.21.15.37:0/2102457865 >> 172.21.15.37:0/2102457865 conn(0x7fc304073090 msgr2=0x7fc304069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:37.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 -- 172.21.15.37:0/2102457865 shutdown_connections 2023-07-09T21:35:37.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.301+0000 7fc30887b640 1 -- 172.21.15.37:0/2102457865 wait complete. 2023-07-09T21:35:37.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 Processor -- start 2023-07-09T21:35:37.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- start start 2023-07-09T21:35:37.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 0x7fc3040cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040d0780 0x7fc3040c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc304150a20 con 0x7fc3040ceb80 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040cc140 con 0x7fc3040d0780 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3040c5cb0 con 0x7fc3040b7980 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49966/0 (socket says 172.21.15.37:49966) 2023-07-09T21:35:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 -- 172.21.15.37:0/2090781555 learned_addr learned my addr 172.21.15.37:0/2090781555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30259c640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 0x7fc3040cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc302d9d640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040d0780 0x7fc3040c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 -- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 msgr2=0x7fc3040cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 0x7fc3040cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 -- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040d0780 msgr2=0x7fc3040c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040d0780 0x7fc3040c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 -- 172.21.15.37:0/2090781555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009420 con 0x7fc3040ceb80 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30259c640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 0x7fc3040cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc301d9b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c530 tx=0x7fc2f800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8005220 con 0x7fc3040ceb80 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8005380 con 0x7fc3040ceb80 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8007270 con 0x7fc3040ceb80 2023-07-09T21:35:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3040c6270 con 0x7fc3040ceb80 2023-07-09T21:35:37.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3040b4200 con 0x7fc3040ceb80 2023-07-09T21:35:37.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.305+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30404d7d0 con 0x7fc3040ceb80 2023-07-09T21:35:37.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.309+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fc2f80073d0 con 0x7fc3040ceb80 2023-07-09T21:35:37.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.309+0000 7fc2f2ffd640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 0x7fc2e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:37.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.309+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 7285+0+0 (secure 0 0 0) 0x7fc2f8083b40 con 0x7fc3040ceb80 2023-07-09T21:35:37.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.309+0000 7fc30259c640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 0x7fc2e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:37.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.309+0000 7fc30259c640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 0x7fc2e4068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40ad000 tx=0x7fc2f4008040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.313+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2f8050910 con 0x7fc3040ceb80 2023-07-09T21:35:37.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.485+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir7", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3040cff80 con 0x7fc2e4066480 2023-07-09T21:35:37.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc2f2ffd640 1 -- 172.21.15.37:0/2090781555 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fc2f40bb0d0 con 0x7fc2e4066480 2023-07-09T21:35:37.624 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir7 2023-07-09T21:35:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 msgr2=0x7fc2e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 0x7fc2e4068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2f40ad000 tx=0x7fc2f4008040 comp rx=0 tx=0).stop 2023-07-09T21:35:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 msgr2=0x7fc30414fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800c530 tx=0x7fc2f800c9f0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 shutdown_connections 2023-07-09T21:35:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fc2e4066480 0x7fc2e4068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3040d0780 0x7fc3040c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3040ceb80 0x7fc30414fee0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 --2- 172.21.15.37:0/2090781555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3040b7980 0x7fc3040cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:37.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 >> 172.21.15.37:0/2090781555 conn(0x7fc304073090 msgr2=0x7fc3040d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 shutdown_connections 2023-07-09T21:35:37.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:37.621+0000 7fc30887b640 1 -- 172.21.15.37:0/2090781555 wait complete. 2023-07-09T21:35:37.644 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2023-07-09T21:35:37.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.645 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2023-07-09T21:35:37.663 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:37.664 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:37.665 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:37.665 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:37.665 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:37.665 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:37.666 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:37.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.667 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:37.725 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:37.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.726 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:37.784 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:37.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.784 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:37.843 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:37.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.844 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:37.903 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:37.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.904 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:37.964 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:37.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:37.965 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:38.038 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:38.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.039 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:38.104 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:38.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.105 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:38.165 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:38.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.165 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:38.229 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:38.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.230 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:38.287 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:38.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.288 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:38.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.348 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2023-07-09T21:35:38.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir8 1M 2023-07-09T21:35:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 Processor -- start 2023-07-09T21:35:38.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 -- start start 2023-07-09T21:35:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac600b7980 0x7fac60160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac600d0780 0x7fac600d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6015bf80 con 0x7fac600ceb80 2023-07-09T21:35:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600cd070 con 0x7fac600b7980 2023-07-09T21:35:38.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac68448640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac600cfd70 con 0x7fac600d0780 2023-07-09T21:35:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac659e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac600ceb80 0x7fac600cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53642/0 (socket says 172.21.15.37:53642) 2023-07-09T21:35:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac659e3640 1 -- 172.21.15.37:0/197238223 learned_addr learned my addr 172.21.15.37:0/197238223 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac661e4640 1 --2- 172.21.15.37:0/197238223 >> v2:172.21.15.37:3300/0 conn(0x7fac600b7980 0x7fac60160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac669e5640 1 --2- 172.21.15.37:0/197238223 >> v2:172.21.15.119:3300/0 conn(0x7fac600d0780 0x7fac600d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac651e2640 1 -- 172.21.15.37:0/197238223 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237072987 0 0) 0x7fac50001120 con 0x7fac600ceb80 2023-07-09T21:35:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac651e2640 1 -- 172.21.15.37:0/197238223 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac4c003530 con 0x7fac600ceb80 2023-07-09T21:35:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac661e4640 1 -- 172.21.15.37:0/197238223 >> v2:172.21.15.119:3300/0 conn(0x7fac600d0780 msgr2=0x7fac600d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac661e4640 1 --2- 172.21.15.37:0/197238223 >> v2:172.21.15.119:3300/0 conn(0x7fac600d0780 0x7fac600d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac661e4640 1 -- 172.21.15.37:0/197238223 >> v1:172.21.15.37:6789/0 conn(0x7fac600ceb80 legacy=0x7fac600cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.613+0000 7fac661e4640 1 -- 172.21.15.37:0/197238223 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac60160570 con 0x7fac600b7980 2023-07-09T21:35:38.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac661e4640 1 --2- 172.21.15.37:0/197238223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60160030 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fac600b1240 tx=0x7fac5c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f1dd16160c41e50 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:38.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac651e2640 1 -- 172.21.15.37:0/197238223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0ab600 con 0x7fac600b7980 2023-07-09T21:35:38.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac651e2640 1 -- 172.21.15.37:0/197238223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c0a7050 con 0x7fac600b7980 2023-07-09T21:35:38.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac651e2640 1 -- 172.21.15.37:0/197238223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0ab960 con 0x7fac600b7980 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 -- 172.21.15.37:0/197238223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 msgr2=0x7fac60160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 --2- 172.21.15.37:0/197238223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60160030 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fac600b1240 tx=0x7fac5c01c460 comp rx=0 tx=0).stop 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 -- 172.21.15.37:0/197238223 shutdown_connections 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 --2- 172.21.15.37:0/197238223 >> v2:172.21.15.119:3300/0 conn(0x7fac600d0780 0x7fac600d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 --2- 172.21.15.37:0/197238223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60160030 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 -- 172.21.15.37:0/197238223 >> 172.21.15.37:0/197238223 conn(0x7fac60073090 msgr2=0x7fac60069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:38.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 -- 172.21.15.37:0/197238223 shutdown_connections 2023-07-09T21:35:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.617+0000 7fac68448640 1 -- 172.21.15.37:0/197238223 wait complete. 2023-07-09T21:35:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 Processor -- start 2023-07-09T21:35:38.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- start start 2023-07-09T21:35:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac600ceb80 0x7fac601598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac600d0780 0x7fac601550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac60152180 con 0x7fac600b7980 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac601515b0 con 0x7fac600ceb80 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac60151850 con 0x7fac600d0780 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50192/0 (socket says 172.21.15.37:50192) 2023-07-09T21:35:38.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 -- 172.21.15.37:0/2974029148 learned_addr learned my addr 172.21.15.37:0/2974029148 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac659e3640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac600ceb80 0x7fac601598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac669e5640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac600d0780 0x7fac601550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 -- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac600d0780 msgr2=0x7fac601550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac600d0780 0x7fac601550b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 -- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac600ceb80 msgr2=0x7fac601598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac600ceb80 0x7fac601598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 -- 172.21.15.37:0/2974029148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c009420 con 0x7fac600b7980 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac661e4640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000c10 tx=0x7fac5c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:38.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0b4810 con 0x7fac600b7980 2023-07-09T21:35:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c0b4970 con 0x7fac600b7980 2023-07-09T21:35:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0b4d20 con 0x7fac600b7980 2023-07-09T21:35:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac60151b30 con 0x7fac600b7980 2023-07-09T21:35:38.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac601511a0 con 0x7fac600b7980 2023-07-09T21:35:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.621+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600cd600 con 0x7fac600b7980 2023-07-09T21:35:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.625+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7fac5c0b2040 con 0x7fac600b7980 2023-07-09T21:35:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.625+0000 7fac56ffd640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 0x7fac44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.625+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 7125+0+0 (secure 0 0 0) 0x7fac5c11e8c0 con 0x7fac600b7980 2023-07-09T21:35:38.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.625+0000 7fac659e3640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 0x7fac44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:38.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.625+0000 7fac659e3640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 0x7fac44068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac6015be30 tx=0x7fac50009040 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:38.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.629+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac600cd600 con 0x7fac600b7980 2023-07-09T21:35:38.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.801+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir8", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fac600cff80 con 0x7fac44066480 2023-07-09T21:35:38.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.873+0000 7fac56ffd640 1 -- 172.21.15.37:0/2974029148 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7fac50001ca0 con 0x7fac44066480 2023-07-09T21:35:38.879 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir8 2023-07-09T21:35:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 msgr2=0x7fac44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 0x7fac44068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac6015be30 tx=0x7fac50009040 comp rx=0 tx=0).stop 2023-07-09T21:35:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 msgr2=0x7fac60150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fac5c000c10 tx=0x7fac5c019200 comp rx=0 tx=0).stop 2023-07-09T21:35:38.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 shutdown_connections 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fac44066480 0x7fac44068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac600d0780 0x7fac601550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac600ceb80 0x7fac601598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 --2- 172.21.15.37:0/2974029148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac600b7980 0x7fac60150c60 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 >> 172.21.15.37:0/2974029148 conn(0x7fac60073090 msgr2=0x7fac60158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 shutdown_connections 2023-07-09T21:35:38.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:38.877+0000 7fac68448640 1 -- 172.21.15.37:0/2974029148 wait complete. 2023-07-09T21:35:38.899 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2023-07-09T21:35:38.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.900 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2023-07-09T21:35:38.918 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:38.918 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:38.918 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:38.918 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:38.919 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:38.920 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:38.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.921 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:38.984 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:38.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:38.985 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:39.081 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:39.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.082 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:39.126 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:39.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.127 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:39.188 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:39.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.189 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:39.248 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:39.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.249 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:39.308 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:39.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.308 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:39.373 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:39.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.374 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:39.431 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:39.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.432 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:39.494 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:39.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.495 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:39.553 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:39.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.554 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:39.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:39.616 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2023-07-09T21:35:39.670 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/dir9 1M 2023-07-09T21:35:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.853+0000 7f7d533fa640 1 Processor -- start 2023-07-09T21:35:39.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.853+0000 7f7d533fa640 1 -- start start 2023-07-09T21:35:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d533fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0cfb40 0x7f7d4c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d533fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d533fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0d0450 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d533fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ce640 con 0x7f7d4c0b1420 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d533fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0ce080 con 0x7f7d4c0cfb40 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50204/0 (socket says 172.21.15.37:50204) 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 -- 172.21.15.37:0/334937573 learned_addr learned my addr 172.21.15.37:0/334937573 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:39.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d523f8640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0cfb40 0x7f7d4c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 -- 172.21.15.37:0/334937573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0cfb40 msgr2=0x7f7d4c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:39.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0cfb40 0x7f7d4c0cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:39.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 -- 172.21.15.37:0/334937573 >> v1:172.21.15.119:6789/0 conn(0x7f7d4c0b0ed0 legacy=0x7f7d4c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:39.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 -- 172.21.15.37:0/334937573 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0ce360 con 0x7f7d4c0b1420 2023-07-09T21:35:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.857+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009870 tx=0x7f7d3c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f469f45ee1da1f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d513f6640 1 -- 172.21.15.37:0/334937573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0aa670 con 0x7f7d4c0b1420 2023-07-09T21:35:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d513f6640 1 -- 172.21.15.37:0/334937573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c0aa7d0 con 0x7f7d4c0b1420 2023-07-09T21:35:39.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d513f6640 1 -- 172.21.15.37:0/334937573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0aab60 con 0x7f7d4c0b1420 2023-07-09T21:35:39.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- 172.21.15.37:0/334937573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b1420 msgr2=0x7f7d4c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:39.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009870 tx=0x7f7d3c01c510 comp rx=0 tx=0).stop 2023-07-09T21:35:39.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- 172.21.15.37:0/334937573 shutdown_connections 2023-07-09T21:35:39.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b1420 0x7f7d4c0cc5c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- 172.21.15.37:0/334937573 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0cfb40 0x7f7d4c0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- 172.21.15.37:0/334937573 >> 172.21.15.37:0/334937573 conn(0x7f7d4c072d20 msgr2=0x7f7d4c0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- 172.21.15.37:0/334937573 shutdown_connections 2023-07-09T21:35:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- 172.21.15.37:0/334937573 wait complete. 2023-07-09T21:35:39.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 Processor -- start 2023-07-09T21:35:39.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- start start 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 0x7f7d4c14da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c0cfb40 0x7f7d4c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c157050 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c152b80 con 0x7f7d4c0cfb40 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d533fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c152e60 con 0x7f7d4c0b1420 2023-07-09T21:35:39.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d523f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d523f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50208/0 (socket says 172.21.15.37:50208) 2023-07-09T21:35:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d523f8640 1 -- 172.21.15.37:0/2064675752 learned_addr learned my addr 172.21.15.37:0/2064675752 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.861+0000 7f7d52bf9640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c0cfb40 0x7f7d4c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 0x7f7d4c14da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 -- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 msgr2=0x7f7d4c14da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:39.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 0x7f7d4c14da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:39.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 -- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c0cfb40 msgr2=0x7f7d4c155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:39.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c0cfb40 0x7f7d4c155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 -- 172.21.15.37:0/2064675752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0094d0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 0x7f7d4c14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d523f8640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800e870 tx=0x7f7d4800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48009510 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4800eec0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1572f0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4800cb40 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c158030 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c04e020 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f7d4800cca0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 0x7f7d30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:39.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.865+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 7045+0+0 (secure 0 0 0) 0x7f7d480845a0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:39.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.869+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 0x7f7d30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:39.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.869+0000 7f7d51bf7640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 0x7f7d30068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0ae000 tx=0x7f7d3c0a7000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:39.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:39.873+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d480513d0 con 0x7f7d4c0b0ed0 2023-07-09T21:35:40.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.073+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 --> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/dir9", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d4c0d1d60 con 0x7f7d30066480 2023-07-09T21:35:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.177+0000 7f7d42ffd640 1 -- 172.21.15.37:0/2064675752 <== mgr.5090 v2:172.21.15.119:6832/247577371 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7d3c0aaa30 con 0x7f7d30066480 2023-07-09T21:35:40.182 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/dir9 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 msgr2=0x7f7d30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 0x7f7d30068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c0ae000 tx=0x7f7d3c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 msgr2=0x7f7d4c157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7d4800e870 tx=0x7f7d4800ec70 comp rx=0 tx=0).stop 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 shutdown_connections 2023-07-09T21:35:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f7d30066480 0x7f7d30068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c0cfb40 0x7f7d4c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c0b1420 0x7f7d4c14da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 --2- 172.21.15.37:0/2064675752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c0b0ed0 0x7f7d4c157af0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 >> 172.21.15.37:0/2064675752 conn(0x7f7d4c072d20 msgr2=0x7f7d4c06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 shutdown_connections 2023-07-09T21:35:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:40.181+0000 7f7d533fa640 1 -- 172.21.15.37:0/2064675752 wait complete. 2023-07-09T21:35:40.203 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2023-07-09T21:35:40.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.204 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2023-07-09T21:35:40.237 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:40.238 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:40.239 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:40.239 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:40.239 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:40.239 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:40.240 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_25_00_UTC 2023-07-09T21:35:40.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.240 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_25_00_UTC) 2023-07-09T21:35:40.301 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_26_00_UTC 2023-07-09T21:35:40.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.301 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_26_00_UTC) 2023-07-09T21:35:40.360 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_27_00_UTC 2023-07-09T21:35:40.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.361 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_27_00_UTC) 2023-07-09T21:35:40.420 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_28_00_UTC 2023-07-09T21:35:40.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.421 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_28_00_UTC) 2023-07-09T21:35:40.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_29_00_UTC 2023-07-09T21:35:40.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.481 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_29_00_UTC) 2023-07-09T21:35:40.541 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_30_00_UTC 2023-07-09T21:35:40.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.542 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_30_00_UTC) 2023-07-09T21:35:40.628 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_31_00_UTC 2023-07-09T21:35:40.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.629 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_31_00_UTC) 2023-07-09T21:35:40.691 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_32_00_UTC 2023-07-09T21:35:40.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.691 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_32_00_UTC) 2023-07-09T21:35:40.752 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_33_00_UTC 2023-07-09T21:35:40.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.754 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_33_00_UTC) 2023-07-09T21:35:40.813 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_34_00_UTC 2023-07-09T21:35:40.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.814 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_34_00_UTC) 2023-07-09T21:35:40.874 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_35_00_UTC 2023-07-09T21:35:40.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.875 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2023-07-09-21_35_00_UTC) 2023-07-09T21:35:40.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:40.932 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2023-07-09T21:35:40.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:35:41.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 Processor -- start 2023-07-09T21:35:41.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 -- start start 2023-07-09T21:35:41.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07780cf290 0x7f0778160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:41.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f077815bf80 con 0x7f07780d0780 2023-07-09T21:35:41.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0778160570 con 0x7f07780b7980 2023-07-09T21:35:41.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077f09e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07780cd070 con 0x7f07780cf290 2023-07-09T21:35:41.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f0777fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f07780cf290 0x7f0778160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077d63b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07780d0780 0x7f07780d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53644/0 (socket says 172.21.15.37:53644) 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f077d63b640 1 -- 172.21.15.37:0/890731586 learned_addr learned my addr 172.21.15.37:0/890731586 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f0777fff640 1 -- 172.21.15.37:0/890731586 >> v1:172.21.15.119:6789/0 conn(0x7f07780b7980 legacy=0x7f07780ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f0777fff640 1 -- 172.21.15.37:0/890731586 >> v1:172.21.15.37:6789/0 conn(0x7f07780d0780 legacy=0x7f07780d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f0777fff640 1 -- 172.21.15.37:0/890731586 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07780d02f0 con 0x7f07780cf290 2023-07-09T21:35:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.181+0000 7f07777fe640 1 -- 172.21.15.37:0/890731586 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057837226 0 0) 0x7f076c001120 con 0x7f07780b7980 2023-07-09T21:35:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f0777fff640 1 --2- 172.21.15.37:0/890731586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780cf290 0x7f0778160030 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f07640097c0 tx=0x7f076401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fb4c8c4ad05a36 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f07777fe640 1 -- 172.21.15.37:0/890731586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640ab600 con 0x7f07780cf290 2023-07-09T21:35:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f07777fe640 1 -- 172.21.15.37:0/890731586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07640a7050 con 0x7f07780cf290 2023-07-09T21:35:41.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f07777fe640 1 -- 172.21.15.37:0/890731586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07640ab980 con 0x7f07780cf290 2023-07-09T21:35:41.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 -- 172.21.15.37:0/890731586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780cf290 msgr2=0x7f0778160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:41.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 --2- 172.21.15.37:0/890731586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780cf290 0x7f0778160030 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f07640097c0 tx=0x7f076401c310 comp rx=0 tx=0).stop 2023-07-09T21:35:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 -- 172.21.15.37:0/890731586 shutdown_connections 2023-07-09T21:35:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 --2- 172.21.15.37:0/890731586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780cf290 0x7f0778160030 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 -- 172.21.15.37:0/890731586 >> 172.21.15.37:0/890731586 conn(0x7f0778073090 msgr2=0x7f0778069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 -- 172.21.15.37:0/890731586 shutdown_connections 2023-07-09T21:35:41.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.185+0000 7f077f09e640 1 -- 172.21.15.37:0/890731586 wait complete. 2023-07-09T21:35:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 Processor -- start 2023-07-09T21:35:41.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- start start 2023-07-09T21:35:41.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:41.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07780cf290 0x7f07780cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:41.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07780d0780 0x7f07781e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07781e79b0 con 0x7f07780b7980 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07780ca810 con 0x7f07780cf290 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07780caaf0 con 0x7f07780d0780 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50222/0 (socket says 172.21.15.37:50222) 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 -- 172.21.15.37:0/45757835 learned_addr learned my addr 172.21.15.37:0/45757835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:41.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f0777fff640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07780cf290 0x7f07780cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:41.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077d63b640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07780d0780 0x7f07781e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:41.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 -- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07780d0780 msgr2=0x7f07781e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07780d0780 0x7f07781e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 -- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07780cf290 msgr2=0x7f07780cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07780cf290 0x7f07780cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 -- 172.21.15.37:0/45757835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0764009420 con 0x7f07780b7980 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077ce3a640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f076c001ec0 tx=0x7f076c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:41.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0054e0 con 0x7f07780b7980 2023-07-09T21:35:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076c003600 con 0x7f07780b7980 2023-07-09T21:35:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076c0039b0 con 0x7f07780b7980 2023-07-09T21:35:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07780cadd0 con 0x7f07780b7980 2023-07-09T21:35:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.189+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07780cb390 con 0x7f07780b7980 2023-07-09T21:35:41.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f077804d7d0 con 0x7f07780b7980 2023-07-09T21:35:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 85846+0+0 (secure 0 0 0) 0x7f076c003b10 con 0x7f07780b7980 2023-07-09T21:35:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f07757fa640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 0x7f075c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 7141+0+0 (secure 0 0 0) 0x7f076c0838c0 con 0x7f07780b7980 2023-07-09T21:35:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f0777fff640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 0x7f075c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:41.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.193+0000 7f0777fff640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 0x7f075c068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07640ad000 tx=0x7f07640a6000 comp rx=0 tx=0).ready entity=mgr.5090 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:41.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.197+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f076c050740 con 0x7f07780b7980 2023-07-09T21:35:41.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:41.397+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f0778160570 con 0x7f07780b7980 2023-07-09T21:35:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.081+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f076c050b10 con 0x7f07780b7980 2023-07-09T21:35:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.081+0000 7f07757fa640 1 -- 172.21.15.37:0/45757835 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v13) v1 ==== 93+0+0 (secure 0 0 0) 0x7f076c04d0f0 con 0x7f07780b7980 2023-07-09T21:35:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 msgr2=0x7f075c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 0x7f075c068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07640ad000 tx=0x7f07640a6000 comp rx=0 tx=0).stop 2023-07-09T21:35:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 msgr2=0x7f07781501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f076c001ec0 tx=0x7f076c00c8e0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 shutdown_connections 2023-07-09T21:35:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f075c066480 0x7f075c068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07780d0780 0x7f07781e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07780cf290 0x7f07780cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 --2- 172.21.15.37:0/45757835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07780b7980 0x7f07781501c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 >> 172.21.15.37:0/45757835 conn(0x7f0778073090 msgr2=0x7f07780ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 shutdown_connections 2023-07-09T21:35:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.089+0000 7f077f09e640 1 -- 172.21.15.37:0/45757835 wait complete. 2023-07-09T21:35:42.120 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:35:42.120 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:35:42.177 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:35:42.249 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:35:42.249 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:35:42.250 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:42.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:35:42.277 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:42.273+0000 7f5aacc2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:35:42.307 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:42.309+0000 7fb469369180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:35:42.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 Processor -- start 2023-07-09T21:35:42.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 -- start start 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0cef80 0x7f2f7c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7c0b49f0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7c0b7e80 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f830cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0b4610 con 0x7f2f7c0cef80 2023-07-09T21:35:42.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f80e67640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f80e67640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50240/0 (socket says 172.21.15.37:50240) 2023-07-09T21:35:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.433+0000 7f2f80e67640 1 -- 172.21.15.37:0/1315452213 learned_addr learned my addr 172.21.15.37:0/1315452213 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:42.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f7bfff640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0cef80 0x7f2f7c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f80e67640 1 -- 172.21.15.37:0/1315452213 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0cef80 msgr2=0x7f2f7c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f80e67640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0cef80 0x7f2f7c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f80e67640 1 -- 172.21.15.37:0/1315452213 >> v1:172.21.15.119:6789/0 conn(0x7f2f7c0b4170 legacy=0x7f2f7c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f80e67640 1 -- 172.21.15.37:0/1315452213 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c0cc8a0 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f80e67640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009870 tx=0x7f2f7001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d3e6c3bc56f1187 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f7b7fe640 1 -- 172.21.15.37:0/1315452213 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700aa670 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f7b7fe640 1 -- 172.21.15.37:0/1315452213 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700aa7d0 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.437+0000 7f2f7b7fe640 1 -- 172.21.15.37:0/1315452213 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700aab60 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- 172.21.15.37:0/1315452213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0b7ab0 msgr2=0x7f2f7c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f2f70009870 tx=0x7f2f7001c510 comp rx=0 tx=0).stop 2023-07-09T21:35:42.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- 172.21.15.37:0/1315452213 shutdown_connections 2023-07-09T21:35:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0cef80 0x7f2f7c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1315452213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0b7ab0 0x7f2f7c06aa50 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- 172.21.15.37:0/1315452213 >> 172.21.15.37:0/1315452213 conn(0x7f2f7c073090 msgr2=0x7f2f7c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- 172.21.15.37:0/1315452213 shutdown_connections 2023-07-09T21:35:42.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- 172.21.15.37:0/1315452213 wait complete. 2023-07-09T21:35:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 Processor -- start 2023-07-09T21:35:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.441+0000 7f2f830cb640 1 -- start start 2023-07-09T21:35:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 0x7f2f7c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0b7ab0 0x7f2f7c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c152c70 con 0x7f2f7c0cef80 2023-07-09T21:35:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c1511b0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7c0c6910 con 0x7f2f7c0b7ab0 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f81668640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 0x7f2f7c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f81668640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50244/0 (socket says 172.21.15.37:50244) 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f81668640 1 -- 172.21.15.37:0/1031713767 learned_addr learned my addr 172.21.15.37:0/1031713767 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f7bfff640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0b7ab0 0x7f2f7c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 -- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0b7ab0 msgr2=0x7f2f7c0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0b7ab0 0x7f2f7c0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 -- 172.21.15.37:0/1031713767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 msgr2=0x7f2f7c0b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 -- 172.21.15.37:0/1031713767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f700094d0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f81668640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f80e67640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 0x7f2f7c150c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ab000 tx=0x7f2f7001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b3800 con 0x7f2f7c0b4170 2023-07-09T21:35:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f700b3960 con 0x7f2f7c0b4170 2023-07-09T21:35:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7c0c6bf0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f700b3d10 con 0x7f2f7c0b4170 2023-07-09T21:35:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7c0c71b0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.445+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f7c04d7d0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.449+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f2f700059a0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.449+0000 7f2f797fa640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 0x7f2f60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.449+0000 7f2f7bfff640 1 -- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 msgr2=0x7f2f60068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:42.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.449+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7f2f7011f300 con 0x7f2f7c0b4170 2023-07-09T21:35:42.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.449+0000 7f2f7bfff640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 0x7f2f60068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.453+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f700ec070 con 0x7f2f7c0b4170 2023-07-09T21:35:42.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.609+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f7c0b56d0 con 0x7f2f7c0b4170 2023-07-09T21:35:42.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.609+0000 7f2f797fa640 1 -- 172.21.15.37:0/1031713767 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20351 (secure 0 0 0) 0x7f2f700aa630 con 0x7f2f7c0b4170 2023-07-09T21:35:42.615 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:42.615 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":53,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:35:42.033492+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":234,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1387781828":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6833/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/4267916423":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/2798932044":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/3050580235":"2023-07-10T21:23:55.550650+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":2},{"begin":21,"length":1},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":30,"length":1},{"begin":32,"length":1},{"begin":34,"length":1},{"begin":36,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":42,"length":1},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":2},{"begin":51,"length":1},{"begin":53,"length":1},{"begin":55,"length":1},{"begin":57,"length":1},{"begin":60,"length":1},{"begin":62,"length":1},{"begin":64,"length":1},{"begin":66,"length":1},{"begin":68,"length":1},{"begin":70,"length":1},{"begin":72,"length":1},{"begin":74,"length":1},{"begin":76,"length":1},{"begin":78,"length":2},{"begin":81,"length":1},{"begin":83,"length":1},{"begin":85,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":91,"length":1},{"begin":93,"length":1},{"begin":95,"length":1},{"begin":97,"length":1},{"begin":100,"length":1},{"begin":102,"length":1},{"begin":104,"length":1},{"begin":106,"length":1},{"begin":108,"length":2},{"begin":111,"length":1},{"begin":113,"length":1},{"begin":115,"length":2},{"begin":178,"length":57}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":1},{"begin":32,"length":1},{"begin":42,"length":1},{"begin":53,"length":1},{"begin":64,"length":1},{"begin":74,"length":1},{"begin":85,"length":1},{"begin":95,"length":1},{"begin":106,"length":1},{"begin":113,"length":1},{"begin":224,"length":11}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:35:42.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 msgr2=0x7f2f60068930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:42.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 0x7f2f60068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 msgr2=0x7f2f7c150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 0x7f2f7c150c70 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f700ab000 tx=0x7f2f7001ad50 comp rx=0 tx=0).stop 2023-07-09T21:35:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 shutdown_connections 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f2f60066480 0x7f2f60068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2f7c0cef80 0x7f2f7c0b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2f7c0b7ab0 0x7f2f7c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 --2- 172.21.15.37:0/1031713767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2f7c0b4170 0x7f2f7c150c70 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 >> 172.21.15.37:0/1031713767 conn(0x7f2f7c073090 msgr2=0x7f2f7c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 shutdown_connections 2023-07-09T21:35:42.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.613+0000 7f2f830cb640 1 -- 172.21.15.37:0/1031713767 wait complete. 2023-07-09T21:35:42.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:23:35.367399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:23:36.572999+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 234, 'snap_epoch': 53, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:35:42.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:35:42.750 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:42.753+0000 7fb469369180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:35:42.778 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:42.773+0000 7f5aacc2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:35:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 Processor -- start 2023-07-09T21:35:42.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 -- start start 2023-07-09T21:35:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 0x7f1214160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121415bf80 con 0x7f12140b7980 2023-07-09T21:35:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1214160570 con 0x7f12140d0780 2023-07-09T21:35:42.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f121af11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12140cd070 con 0x7f12140cf290 2023-07-09T21:35:42.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f1218cad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12140b7980 0x7f12140ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53656/0 (socket says 172.21.15.37:53656) 2023-07-09T21:35:42.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f1218cad640 1 -- 172.21.15.37:0/2635546582 learned_addr learned my addr 172.21.15.37:0/2635546582 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:42.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f1213fff640 1 --2- 172.21.15.37:0/2635546582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 0x7f1214160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935850480 0 0) 0x7f1208001120 con 0x7f12140b7980 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.821+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1204003530 con 0x7f12140b7980 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153983785 0 0) 0x7f120c0014a0 con 0x7f12140d0780 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1208001120 con 0x7f12140d0780 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f1213fff640 1 -- 172.21.15.37:0/2635546582 >> v1:172.21.15.119:6789/0 conn(0x7f12140d0780 legacy=0x7f12140d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f1213fff640 1 -- 172.21.15.37:0/2635546582 >> v1:172.21.15.37:6789/0 conn(0x7f12140b7980 legacy=0x7f12140ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f1213fff640 1 -- 172.21.15.37:0/2635546582 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140d02f0 con 0x7f12140cf290 2023-07-09T21:35:42.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f1213fff640 1 --2- 172.21.15.37:0/2635546582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 0x7f1214160030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12000097f0 tx=0x7f120001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=594677125d4e4505 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:42.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000ab600 con 0x7f12140cf290 2023-07-09T21:35:42.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000a7050 con 0x7f12140cf290 2023-07-09T21:35:42.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.825+0000 7f12137fe640 1 -- 172.21.15.37:0/2635546582 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000ab960 con 0x7f12140cf290 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- 172.21.15.37:0/2635546582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 msgr2=0x7f1214160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 --2- 172.21.15.37:0/2635546582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 0x7f1214160030 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f12000097f0 tx=0x7f120001c4c0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- 172.21.15.37:0/2635546582 shutdown_connections 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 --2- 172.21.15.37:0/2635546582 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140cf290 0x7f1214160030 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- 172.21.15.37:0/2635546582 >> 172.21.15.37:0/2635546582 conn(0x7f1214073090 msgr2=0x7f1214069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:42.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- 172.21.15.37:0/2635546582 shutdown_connections 2023-07-09T21:35:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- 172.21.15.37:0/2635546582 wait complete. 2023-07-09T21:35:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 Processor -- start 2023-07-09T21:35:42.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- start start 2023-07-09T21:35:42.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12140cf290 0x7f12140b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 0x7f1214152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1214153120 con 0x7f12140b7980 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12140b36f0 con 0x7f12140cf290 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f121af11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1214152b60 con 0x7f12140d0780 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f1218cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 0x7f1214152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f1218cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50250/0 (socket says 172.21.15.37:50250) 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f1218cad640 1 -- 172.21.15.37:0/1542959765 learned_addr learned my addr 172.21.15.37:0/1542959765 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f1213fff640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12140cf290 0x7f12140b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 -- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12140cf290 msgr2=0x7f12140b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12140cf290 0x7f12140b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 -- 172.21.15.37:0/1542959765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 msgr2=0x7f121414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:42.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f12194ae640 1 -- 172.21.15.37:0/1542959765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200009420 con 0x7f12140d0780 2023-07-09T21:35:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.829+0000 7f1218cad640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:42.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12194ae640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 0x7f1214152110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f120c002240 tx=0x7f120c00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c003b80 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120c003d00 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f120c005310 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1214152e40 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1214150100 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12140b3860 con 0x7f12140d0780 2023-07-09T21:35:42.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f120c005680 con 0x7f12140d0780 2023-07-09T21:35:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 0x7f11f80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7f120c084370 con 0x7f12140d0780 2023-07-09T21:35:42.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f1218cad640 1 -- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 msgr2=0x7f11f80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:42.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.833+0000 7f1218cad640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 0x7f11f80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:42.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:42.837+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f120c051030 con 0x7f12140d0780 2023-07-09T21:35:42.903 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:42.905+0000 7fb469369180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:35:42.939 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:42.937+0000 7f5aacc2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:35:43.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1214160570 con 0x7f12140d0780 2023-07-09T21:35:43.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f12117fa640 1 -- 172.21.15.37:0/1542959765 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f120c058e60 con 0x7f12140d0780 2023-07-09T21:35:43.008 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:35:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 msgr2=0x7f11f80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 0x7f11f80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 msgr2=0x7f1214152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 0x7f1214152110 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f120c002240 tx=0x7f120c00cb90 comp rx=0 tx=0).stop 2023-07-09T21:35:43.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 shutdown_connections 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f11f8066430 0x7f11f80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12140d0780 0x7f1214152110 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12140cf290 0x7f12140b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 --2- 172.21.15.37:0/1542959765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12140b7980 0x7f121414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 >> 172.21.15.37:0/1542959765 conn(0x7f1214073090 msgr2=0x7f12140ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 shutdown_connections 2023-07-09T21:35:43.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.005+0000 7f121af11640 1 -- 172.21.15.37:0/1542959765 wait complete. 2023-07-09T21:35:43.030 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:35:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 Processor -- start 2023-07-09T21:35:43.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 -- start start 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcb00ceb80 0x7fdcb00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 0x7fdcb00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00cd070 con 0x7fdcb00b7980 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00cfd70 con 0x7fdcb00ceb80 2023-07-09T21:35:43.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.173+0000 7fdcb5e19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015bf80 con 0x7fdcb00b3c20 2023-07-09T21:35:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdcb00ceb80 0x7fdcb00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 0x7fdcb00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50266/0 (socket says 172.21.15.37:50266) 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaf7fe640 1 -- 172.21.15.37:0/780304446 learned_addr learned my addr 172.21.15.37:0/780304446 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 -- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 msgr2=0x7fdcb00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 0x7fdcb00b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 -- 172.21.15.37:0/780304446 >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 msgr2=0x7fdcb0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/780304446 >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 -- 172.21.15.37:0/780304446 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0160570 con 0x7fdcb00ceb80 2023-07-09T21:35:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaffff640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 0x7fdcb00b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaf7fe640 1 --2- 172.21.15.37:0/780304446 >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:43.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.177+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00cefc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00b4cd0 tx=0x7fdca401c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a03c48cf2ad6148 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcae7fc640 1 -- 172.21.15.37:0/780304446 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40ab600 con 0x7fdcb00ceb80 2023-07-09T21:35:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcae7fc640 1 -- 172.21.15.37:0/780304446 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca40a7050 con 0x7fdcb00ceb80 2023-07-09T21:35:43.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcae7fc640 1 -- 172.21.15.37:0/780304446 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40ab980 con 0x7fdcb00ceb80 2023-07-09T21:35:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 msgr2=0x7fdcb00cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00cefc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdcb00b4cd0 tx=0x7fdca401c460 comp rx=0 tx=0).stop 2023-07-09T21:35:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- 172.21.15.37:0/780304446 shutdown_connections 2023-07-09T21:35:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b3c20 0x7fdcb00b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/780304446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00cefc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/780304446 >> v2:172.21.15.37:3300/0 conn(0x7fdcb00b7980 0x7fdcb0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- 172.21.15.37:0/780304446 >> 172.21.15.37:0/780304446 conn(0x7fdcb0073090 msgr2=0x7fdcb0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- 172.21.15.37:0/780304446 shutdown_connections 2023-07-09T21:35:43.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- 172.21.15.37:0/780304446 wait complete. 2023-07-09T21:35:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 Processor -- start 2023-07-09T21:35:43.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- start start 2023-07-09T21:35:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 0x7fdcb00c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c88e0 con 0x7fdcb00b3c20 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb015ec60 con 0x7fdcb00ceb80 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.181+0000 7fdcb5e19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0156480 con 0x7fdcb00b7980 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50268/0 (socket says 172.21.15.37:50268) 2023-07-09T21:35:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 0x7fdcb00c7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaf7fe640 1 -- 172.21.15.37:0/1089155870 learned_addr learned my addr 172.21.15.37:0/1089155870 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaffff640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 -- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 msgr2=0x7fdcb00c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 -- 172.21.15.37:0/1089155870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 msgr2=0x7fdcb0154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 -- 172.21.15.37:0/1089155870 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca8009a70 con 0x7fdcb00b7980 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaf7fe640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcaeffd640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 0x7fdcb00c7e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdca40ab000 tx=0x7fdca4019200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40bc070 con 0x7fdcb00b7980 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca4006e20 con 0x7fdcb00b7980 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca40b4850 con 0x7fdcb00b7980 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca00094d0 con 0x7fdcb00b7980 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca4009420 con 0x7fdcb00b7980 2023-07-09T21:35:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb004d7d0 con 0x7fdcb00b7980 2023-07-09T21:35:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.185+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7fdca40abd50 con 0x7fdcb00b7980 2023-07-09T21:35:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.189+0000 7fdc97fff640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 0x7fdc9c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.189+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7fdca411e0f0 con 0x7fdcb00b7980 2023-07-09T21:35:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.189+0000 7fdcaf7fe640 1 -- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 msgr2=0x7fdc9c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.189+0000 7fdcaf7fe640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 0x7fdc9c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.193+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdca40eabf0 con 0x7fdcb00b7980 2023-07-09T21:35:43.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.345+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdcb0160570 con 0x7fdcb00b7980 2023-07-09T21:35:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.345+0000 7fdc97fff640 1 -- 172.21.15.37:0/1089155870 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v53) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdcb0160570 con 0x7fdcb00b7980 2023-07-09T21:35:43.350 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:35:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 msgr2=0x7fdc9c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 0x7fdc9c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 msgr2=0x7fdcb00c7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 0x7fdcb00c7e60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fdca40ab000 tx=0x7fdca4019200 comp rx=0 tx=0).stop 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 shutdown_connections 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7fdc9c066430 0x7fdc9c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdcb00ceb80 0x7fdcb00c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdcb00b7980 0x7fdcb00c7e60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 --2- 172.21.15.37:0/1089155870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcb00b3c20 0x7fdcb0154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 >> 172.21.15.37:0/1089155870 conn(0x7fdcb0073090 msgr2=0x7fdcb00d2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 shutdown_connections 2023-07-09T21:35:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.349+0000 7fdcb5e19640 1 -- 172.21.15.37:0/1089155870 wait complete. 2023-07-09T21:35:43.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:35:43.382 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.385+0000 7fb469369180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:35:43.441 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.441+0000 7fb469369180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:35:43.456 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.453+0000 7f5aacc2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:35:43.496 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.497+0000 7fb469369180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:35:43.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.513+0000 7f955be93640 1 Processor -- start 2023-07-09T21:35:43.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 -- start start 2023-07-09T21:35:43.520 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f5aacc2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:35:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95540cf290 0x7f9554160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540d0780 0x7f95540d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955415bf80 con 0x7f95540b7980 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95540cd070 con 0x7f95540cf290 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955be93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540cfd70 con 0x7f95540d0780 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95540cf290 0x7f9554160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95540cf290 0x7f9554160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50272/0 (socket says 172.21.15.37:50272) 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 -- 172.21.15.37:0/998820080 learned_addr learned my addr 172.21.15.37:0/998820080 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955a430640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540d0780 0x7f95540d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 -- 172.21.15.37:0/998820080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540d0780 msgr2=0x7f95540d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540d0780 0x7f95540d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 -- 172.21.15.37:0/998820080 >> v1:172.21.15.119:6789/0 conn(0x7f95540b7980 legacy=0x7f95540ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f9558c2d640 1 -- 172.21.15.37:0/998820080 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998661395 0 0) 0x7f9550001120 con 0x7f95540b7980 2023-07-09T21:35:43.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.517+0000 7f955942e640 1 -- 172.21.15.37:0/998820080 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554160570 con 0x7f95540cf290 2023-07-09T21:35:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955942e640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f9554160030 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9544009870 tx=0x7f954401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3b801c59c3fc34 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f9558c2d640 1 -- 172.21.15.37:0/998820080 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440ab600 con 0x7f95540cf290 2023-07-09T21:35:43.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f9558c2d640 1 -- 172.21.15.37:0/998820080 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440a7050 con 0x7f95540cf290 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f9558c2d640 1 -- 172.21.15.37:0/998820080 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95440ab980 con 0x7f95540cf290 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 -- 172.21.15.37:0/998820080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 msgr2=0x7f9554160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f9554160030 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f9544009870 tx=0x7f954401c540 comp rx=0 tx=0).stop 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 -- 172.21.15.37:0/998820080 shutdown_connections 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540d0780 0x7f95540d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 --2- 172.21.15.37:0/998820080 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f9554160030 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 -- 172.21.15.37:0/998820080 >> 172.21.15.37:0/998820080 conn(0x7f9554073090 msgr2=0x7f9554069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 -- 172.21.15.37:0/998820080 shutdown_connections 2023-07-09T21:35:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 -- 172.21.15.37:0/998820080 wait complete. 2023-07-09T21:35:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.521+0000 7f955be93640 1 Processor -- start 2023-07-09T21:35:43.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- start start 2023-07-09T21:35:43.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540b7980 0x7f9554153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 0x7f95540b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540c9780 con 0x7f95540cf290 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95540b2640 con 0x7f95540d0780 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95540b2920 con 0x7f95540b7980 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955942e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955942e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50282/0 (socket says 172.21.15.37:50282) 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955942e640 1 -- 172.21.15.37:0/3356132475 learned_addr learned my addr 172.21.15.37:0/3356132475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 0x7f95540b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f9559c2f640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540b7980 0x7f9554153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 -- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540b7980 msgr2=0x7f9554153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540b7980 0x7f9554153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 -- 172.21.15.37:0/3356132475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 msgr2=0x7f955415b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 -- 172.21.15.37:0/3356132475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95440094d0 con 0x7f95540d0780 2023-07-09T21:35:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955942e640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:43.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955a430640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 0x7f95540b4fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f954c00ebd0 tx=0x7f954c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c00cd20 con 0x7f95540d0780 2023-07-09T21:35:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954c00f040 con 0x7f95540d0780 2023-07-09T21:35:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954c0146c0 con 0x7f95540d0780 2023-07-09T21:35:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95540c93a0 con 0x7f95540d0780 2023-07-09T21:35:43.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95540b2c00 con 0x7f95540d0780 2023-07-09T21:35:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.525+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95540c98c0 con 0x7f95540d0780 2023-07-09T21:35:43.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.529+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f954c014820 con 0x7f95540d0780 2023-07-09T21:35:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.529+0000 7f954a7fc640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 0x7f95380688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.529+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7f954c085320 con 0x7f95540d0780 2023-07-09T21:35:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.529+0000 7f9559c2f640 1 -- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 msgr2=0x7f95380688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:43.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.529+0000 7f9559c2f640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 0x7f95380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:43.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.533+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f95540c98c0 con 0x7f95540d0780 2023-07-09T21:35:43.581 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.577+0000 7f5aacc2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:35:43.583 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.585+0000 7fb469369180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:35:43.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.641+0000 7fb469369180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:35:43.672 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.669+0000 7f5aacc2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:35:43.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f95540c98c0 con 0x7f95540d0780 2023-07-09T21:35:43.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f954a7fc640 1 -- 172.21.15.37:0/3356132475 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f95540c98c0 con 0x7f95540d0780 2023-07-09T21:35:43.693 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:35:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 msgr2=0x7f95380688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 0x7f95380688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 msgr2=0x7f95540b4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 0x7f95540b4fd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f954c00ebd0 tx=0x7f954c00c490 comp rx=0 tx=0).stop 2023-07-09T21:35:43.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 shutdown_connections 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f9538066430 0x7f95380688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95540d0780 0x7f95540b4fd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95540cf290 0x7f955415b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 --2- 172.21.15.37:0/3356132475 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95540b7980 0x7f9554153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 >> 172.21.15.37:0/3356132475 conn(0x7f9554073090 msgr2=0x7f95541557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 shutdown_connections 2023-07-09T21:35:43.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.689+0000 7f955be93640 1 -- 172.21.15.37:0/3356132475 wait complete. 2023-07-09T21:35:43.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:35:43.725 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.725+0000 7fb469369180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:35:43.735 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.733+0000 7f5aacc2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:35:43.781 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.781+0000 7fb469369180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:35:43.826 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.821+0000 7f5aacc2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:35:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 Processor -- start 2023-07-09T21:35:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 -- start start 2023-07-09T21:35:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7980 0x7f5a74160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 0x7f5a740cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740b3c20 0x7f5a740b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740cd070 con 0x7f5a740b3c20 2023-07-09T21:35:43.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740cfd70 con 0x7f5a740ceb80 2023-07-09T21:35:43.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7c53a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7415bf80 con 0x7f5a740b7980 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740b3c20 0x7f5a740b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740b3c20 0x7f5a740b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50290/0 (socket says 172.21.15.37:50290) 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 -- 172.21.15.37:0/1103514955 learned_addr learned my addr 172.21.15.37:0/1103514955 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a79ad5640 1 --2- 172.21.15.37:0/1103514955 >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 0x7f5a740cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7a2d6640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7980 0x7f5a74160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 -- 172.21.15.37:0/1103514955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7980 msgr2=0x7f5a74160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:43.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7980 0x7f5a74160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 -- 172.21.15.37:0/1103514955 >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 msgr2=0x7f5a740cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:43.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 --2- 172.21.15.37:0/1103514955 >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 0x7f5a740cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a7aad7640 1 -- 172.21.15.37:0/1103514955 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74160570 con 0x7f5a740b3c20 2023-07-09T21:35:43.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.861+0000 7f5a79ad5640 1 --2- 172.21.15.37:0/1103514955 >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 0x7f5a740cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7aad7640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b3c20 0x7f5a740b4080 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5a740b4ca0 tx=0x7f5a6c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e8d117a04d1bc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a792d4640 1 -- 172.21.15.37:0/1103514955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a5650 con 0x7f5a740b3c20 2023-07-09T21:35:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a792d4640 1 -- 172.21.15.37:0/1103514955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0a57b0 con 0x7f5a740b3c20 2023-07-09T21:35:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a792d4640 1 -- 172.21.15.37:0/1103514955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a5b40 con 0x7f5a740b3c20 2023-07-09T21:35:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1103514955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b3c20 msgr2=0x7f5a740b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b3c20 0x7f5a740b4080 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5a740b4ca0 tx=0x7f5a6c01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1103514955 shutdown_connections 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b3c20 0x7f5a740b4080 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1103514955 >> v2:172.21.15.119:3300/0 conn(0x7f5a740ceb80 0x7f5a740cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1103514955 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7980 0x7f5a74160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1103514955 >> 172.21.15.37:0/1103514955 conn(0x7f5a74073090 msgr2=0x7f5a74069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1103514955 shutdown_connections 2023-07-09T21:35:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.865+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1103514955 wait complete. 2023-07-09T21:35:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 Processor -- start 2023-07-09T21:35:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- start start 2023-07-09T21:35:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b7980 0x7f5a740c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740ceb80 0x7f5a74158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740c9530 con 0x7f5a740b7980 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740cbc40 con 0x7f5a740b3c20 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740cbf20 con 0x7f5a740ceb80 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a79ad5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b7980 0x7f5a740c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41522/0 (socket says 172.21.15.37:41522) 2023-07-09T21:35:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 -- 172.21.15.37:0/1258813396 learned_addr learned my addr 172.21.15.37:0/1258813396 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7aad7640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740ceb80 0x7f5a74158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 -- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740ceb80 msgr2=0x7f5a74158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740ceb80 0x7f5a74158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 -- 172.21.15.37:0/1258813396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b7980 msgr2=0x7f5a740c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b7980 0x7f5a740c7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:43.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 -- 172.21.15.37:0/1258813396 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6c009b30 con 0x7f5a740b3c20 2023-07-09T21:35:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7a2d6640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000d5f0 tx=0x7f5a7000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a700125f0 con 0x7f5a740b3c20 2023-07-09T21:35:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70012750 con 0x7f5a740b3c20 2023-07-09T21:35:43.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70012ae0 con 0x7f5a740b3c20 2023-07-09T21:35:43.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a740cc200 con 0x7f5a740b3c20 2023-07-09T21:35:43.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.869+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7415c400 con 0x7f5a740b3c20 2023-07-09T21:35:43.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7415c5c0 con 0x7f5a740b3c20 2023-07-09T21:35:43.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f5a70012c40 con 0x7f5a740b3c20 2023-07-09T21:35:43.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a6affd640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 0x7f5a580688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:43.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7f5a70084940 con 0x7f5a740b3c20 2023-07-09T21:35:43.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a79ad5640 1 -- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 msgr2=0x7f5a580688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:43.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.873+0000 7f5a79ad5640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 0x7f5a580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:43.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:43.877+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a700516a0 con 0x7f5a740b3c20 2023-07-09T21:35:43.889 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:43.885+0000 7f5aacc2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:35:43.924 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.925+0000 7fb469369180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:35:43.983 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:43.985+0000 7fb469369180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:35:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5a7404d7d0 con 0x7f5a740b3c20 2023-07-09T21:35:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a6affd640 1 -- 172.21.15.37:0/1258813396 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5a70007380 con 0x7f5a740b3c20 2023-07-09T21:35:44.037 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 msgr2=0x7f5a580688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 0x7f5a580688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 msgr2=0x7f5a740cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000d5f0 tx=0x7f5a7000dab0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 shutdown_connections 2023-07-09T21:35:44.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f5a58066430 0x7f5a580688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740ceb80 0x7f5a74158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740b7980 0x7f5a740c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 --2- 172.21.15.37:0/1258813396 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b3c20 0x7f5a740cb540 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.033+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 >> 172.21.15.37:0/1258813396 conn(0x7f5a74073090 msgr2=0x7f5a740b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.037+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 shutdown_connections 2023-07-09T21:35:44.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.037+0000 7f5a7c53a640 1 -- 172.21.15.37:0/1258813396 wait complete. 2023-07-09T21:35:44.041 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.037+0000 7f5aacc2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:35:44.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:35:44.103 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.101+0000 7f5aacc2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:35:44.225 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:35:44.225 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:35:44.225 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:35:44.233 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:44.233+0000 7fb469369180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:35:44.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.237+0000 7f0104e7b640 1 Processor -- start 2023-07-09T21:35:44.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 -- start start 2023-07-09T21:35:44.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f01000b47a0 0x7f01000b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01000cef80 con 0x7f01000b4140 2023-07-09T21:35:44.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01000b45b0 con 0x7f01000b47a0 2023-07-09T21:35:44.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f0104e7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01000cf260 con 0x7f01000b7a60 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fdd9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f01000b47a0 0x7f01000b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:34974/0 (socket says 172.21.15.37:34974) 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 -- 172.21.15.37:0/4124260424 learned_addr learned my addr 172.21.15.37:0/4124260424 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 -- 172.21.15.37:0/4124260424 >> v2:172.21.15.119:3300/0 conn(0x7f01000b47a0 msgr2=0x7f01000b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:44.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 --2- 172.21.15.37:0/4124260424 >> v2:172.21.15.119:3300/0 conn(0x7f01000b47a0 0x7f01000b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 -- 172.21.15.37:0/4124260424 >> v1:172.21.15.119:6789/0 conn(0x7f01000b4140 legacy=0x7f010015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.241+0000 7f00fe59c640 1 -- 172.21.15.37:0/4124260424 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01000cf540 con 0x7f01000b7a60 2023-07-09T21:35:44.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f00fe59c640 1 --2- 172.21.15.37:0/4124260424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009870 tx=0x7f00f001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba2446c05eb6937 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:44.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f00fd59a640 1 -- 172.21.15.37:0/4124260424 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00a7070 con 0x7f01000b7a60 2023-07-09T21:35:44.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f00fd59a640 1 -- 172.21.15.37:0/4124260424 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f00ab430 con 0x7f01000b7a60 2023-07-09T21:35:44.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f00fd59a640 1 -- 172.21.15.37:0/4124260424 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00ab7c0 con 0x7f01000b7a60 2023-07-09T21:35:44.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 -- 172.21.15.37:0/4124260424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 msgr2=0x7f01000cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 --2- 172.21.15.37:0/4124260424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009870 tx=0x7f00f001c540 comp rx=0 tx=0).stop 2023-07-09T21:35:44.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 -- 172.21.15.37:0/4124260424 shutdown_connections 2023-07-09T21:35:44.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 --2- 172.21.15.37:0/4124260424 >> v2:172.21.15.119:3300/0 conn(0x7f01000b47a0 0x7f01000b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 --2- 172.21.15.37:0/4124260424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b7a60 0x7f01000cc7d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 -- 172.21.15.37:0/4124260424 >> 172.21.15.37:0/4124260424 conn(0x7f0100073050 msgr2=0x7f0100069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:44.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 -- 172.21.15.37:0/4124260424 shutdown_connections 2023-07-09T21:35:44.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.245+0000 7f0104e7b640 1 -- 172.21.15.37:0/4124260424 wait complete. 2023-07-09T21:35:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.249+0000 7f0104e7b640 1 Processor -- start 2023-07-09T21:35:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.249+0000 7f0104e7b640 1 -- start start 2023-07-09T21:35:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 0x7f0100150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01000b7a60 0x7f010015e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010015b7f0 con 0x7f01000b7a60 2023-07-09T21:35:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010015b360 con 0x7f01000b4140 2023-07-09T21:35:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010015a750 con 0x7f01000b47a0 2023-07-09T21:35:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fdd9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 0x7f0100150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41548/0 (socket says 172.21.15.37:41548) 2023-07-09T21:35:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 -- 172.21.15.37:0/913712383 learned_addr learned my addr 172.21.15.37:0/913712383 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fed9d640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01000b7a60 0x7f010015e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 msgr2=0x7f0100150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 0x7f0100150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01000b7a60 msgr2=0x7f010015e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01000b7a60 0x7f010015e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 -- 172.21.15.37:0/913712383 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f00094d0 con 0x7f01000b4140 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fdd9b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 0x7f0100150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00fe59c640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00f00ad040 tx=0x7f00f00192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00bc070 con 0x7f01000b4140 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f00b4420 con 0x7f01000b4140 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010015aa30 con 0x7f01000b4140 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f00b47d0 con 0x7f01000b4140 2023-07-09T21:35:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.253+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010015aff0 con 0x7f01000b4140 2023-07-09T21:35:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.257+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f00f00b4930 con 0x7f01000b4140 2023-07-09T21:35:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.257+0000 7f00eeffd640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 0x7f00e00688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.257+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 7413+0+0 (secure 0 0 0) 0x7f00f011de20 con 0x7f01000b4140 2023-07-09T21:35:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.257+0000 7f00fdd9b640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 msgr2=0x7f00e00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:44.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.257+0000 7f00fdd9b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 0x7f00e00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:44.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.261+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01000cdaa0 con 0x7f01000b4140 2023-07-09T21:35:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.265+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00f00eab00 con 0x7f01000b4140 2023-07-09T21:35:44.361 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:35:44.362 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:35:44.362 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:35:44.370 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:44.373+0000 7fb469369180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:35:44.371 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.369+0000 7f5aacc2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:35:44.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.461+0000 7f00fdd9b640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 msgr2=0x7f00e00688b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:44.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.461+0000 7f00fdd9b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 0x7f00e00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:35:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.469+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f010004d7d0 con 0x7f01000b4140 2023-07-09T21:35:44.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.469+0000 7f00eeffd640 1 -- 172.21.15.37:0/913712383 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v53) v1 ==== 80+0+360 (secure 0 0 0) 0x7f00f00ee120 con 0x7f01000b4140 2023-07-09T21:35:44.475 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1387781828 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.475 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/1139343796 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.475 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/1139343796 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.475 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4267916423 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.476 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2798932044 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.476 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3050580235 2023-07-10T21:23:55.550650+0000 2023-07-09T21:35:44.476 INFO:teuthology.orchestra.run.smithi037.stderr:listed 6 entries 2023-07-09T21:35:44.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 msgr2=0x7f00e00688b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:44.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 0x7f00e00688b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 msgr2=0x7f0100152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:44.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f00f00ad040 tx=0x7f00f00192e0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 shutdown_connections 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f00e0066400 0x7f00e00688b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01000b7a60 0x7f010015e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01000b47a0 0x7f0100150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 --2- 172.21.15.37:0/913712383 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01000b4140 0x7f0100152440 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 >> 172.21.15.37:0/913712383 conn(0x7f0100073050 msgr2=0x7f01000b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 shutdown_connections 2023-07-09T21:35:44.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:44.473+0000 7f0104e7b640 1 -- 172.21.15.37:0/913712383 wait complete. 2023-07-09T21:35:44.497 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:35:44.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:44.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:35:44.498 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:44.497+0000 7fb469369180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:35:44.515 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.509+0000 7f5aacc2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:35:44.533 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[48345]: fuse finished with error 0 and tester_r 0 2023-07-09T21:35:44.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:35:44.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:44.537 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:35:44.567 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:44.569+0000 7fb469369180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:35:44.649 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.645+0000 7f5aacc2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:35:44.701 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:44.701+0000 7fb469369180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:35:44.702 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:35:44.702 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:44.711 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:35:44.712 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:35:44.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:44.712 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:35:44.723 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.721+0000 7f5aacc2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:35:44.761 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:35:44.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:35:44.762 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:35:44.763 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:44.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:35:44.773 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:35:44.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:44.774 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:35:44.822 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:35:44.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:35:44.824 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:35:44.824 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:44.833 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:35:44.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:35:44.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:35:44.834 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:35:44.865 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:44.861+0000 7f5aacc2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:35:44.880 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:35:44.881 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:35:44.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:35:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.021+0000 7f625089c640 1 Processor -- start 2023-07-09T21:35:45.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.021+0000 7f625089c640 1 -- start start 2023-07-09T21:35:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f625089c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f624c0b7ab0 0x7f624c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f625089c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f624c0cef80 0x7f624c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f625089c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f624c0b49f0 con 0x7f624c0b4170 2023-07-09T21:35:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f625089c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0b7e80 con 0x7f624c0cef80 2023-07-09T21:35:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f625089c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0b4610 con 0x7f624c0b7ab0 2023-07-09T21:35:45.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f6243fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f624c0cef80 0x7f624c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f624ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f624c0b4170 0x7f624c15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53670/0 (socket says 172.21.15.37:53670) 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f624ad9d640 1 -- 172.21.15.37:0/294594463 learned_addr learned my addr 172.21.15.37:0/294594463 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f624a59c640 1 --2- 172.21.15.37:0/294594463 >> v2:172.21.15.119:3300/0 conn(0x7f624c0b7ab0 0x7f624c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f6243fff640 1 -- 172.21.15.37:0/294594463 >> v2:172.21.15.119:3300/0 conn(0x7f624c0b7ab0 msgr2=0x7f624c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f6243fff640 1 --2- 172.21.15.37:0/294594463 >> v2:172.21.15.119:3300/0 conn(0x7f624c0b7ab0 0x7f624c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f6243fff640 1 -- 172.21.15.37:0/294594463 >> v1:172.21.15.37:6789/0 conn(0x7f624c0b4170 legacy=0x7f624c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.025+0000 7f6243fff640 1 -- 172.21.15.37:0/294594463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0cc8a0 con 0x7f624c0cef80 2023-07-09T21:35:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.029+0000 7f6243fff640 1 --2- 172.21.15.37:0/294594463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0cef80 0x7f624c0b3c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f624c06b360 tx=0x7f623401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa4de88638a8bd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f6249d9b640 1 -- 172.21.15.37:0/294594463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340a7070 con 0x7f624c0cef80 2023-07-09T21:35:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f6249d9b640 1 -- 172.21.15.37:0/294594463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62340ab430 con 0x7f624c0cef80 2023-07-09T21:35:45.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f6249d9b640 1 -- 172.21.15.37:0/294594463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340ab7c0 con 0x7f624c0cef80 2023-07-09T21:35:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- 172.21.15.37:0/294594463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0cef80 msgr2=0x7f624c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 --2- 172.21.15.37:0/294594463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0cef80 0x7f624c0b3c30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f624c06b360 tx=0x7f623401c430 comp rx=0 tx=0).stop 2023-07-09T21:35:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- 172.21.15.37:0/294594463 shutdown_connections 2023-07-09T21:35:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 --2- 172.21.15.37:0/294594463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0cef80 0x7f624c0b3c30 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 --2- 172.21.15.37:0/294594463 >> v2:172.21.15.119:3300/0 conn(0x7f624c0b7ab0 0x7f624c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- 172.21.15.37:0/294594463 >> 172.21.15.37:0/294594463 conn(0x7f624c073090 msgr2=0x7f624c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- 172.21.15.37:0/294594463 shutdown_connections 2023-07-09T21:35:45.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- 172.21.15.37:0/294594463 wait complete. 2023-07-09T21:35:45.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 Processor -- start 2023-07-09T21:35:45.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.033+0000 7f625089c640 1 -- start start 2023-07-09T21:35:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f624c0b4170 0x7f624c1543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f624c0cef80 0x7f624c0c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1596e0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0ca430 con 0x7f624c0b4170 2023-07-09T21:35:45.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c0ca710 con 0x7f624c0cef80 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50316/0 (socket says 172.21.15.37:50316) 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 -- 172.21.15.37:0/1284959433 learned_addr learned my addr 172.21.15.37:0/1284959433 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f624a59c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f624c0b4170 0x7f624c1543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 -- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f624c0cef80 msgr2=0x7f624c0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f624c0cef80 0x7f624c0c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 -- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f624c0b4170 msgr2=0x7f624c1543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f624c0b4170 0x7f624c1543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 -- 172.21.15.37:0/1284959433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6234009420 con 0x7f624c0b7ab0 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6243fff640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6234019040 tx=0x7f62340191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340bf450 con 0x7f624c0b7ab0 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62340bf5b0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c0ca9f0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62340bf920 con 0x7f624c0b7ab0 2023-07-09T21:35:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c0c67e0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c04d7d0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.037+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f62340b43f0 con 0x7f624c0b7ab0 2023-07-09T21:35:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.041+0000 7f6242ffd640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 0x7f622c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.041+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f623411ed40 con 0x7f624c0b7ab0 2023-07-09T21:35:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.041+0000 7f624a59c640 1 -- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 msgr2=0x7f622c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:45.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.041+0000 7f624a59c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 0x7f622c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:45.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.045+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62340eb980 con 0x7f624c0b7ab0 2023-07-09T21:35:45.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.237+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f624c06a830 con 0x7f624c0b7ab0 2023-07-09T21:35:45.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.237+0000 7f6242ffd640 1 -- 172.21.15.37:0/1284959433 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f62340c4090 con 0x7f624c0b7ab0 2023-07-09T21:35:45.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:45.242 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:35:45.243 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:35:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 msgr2=0x7f622c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 0x7f622c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 msgr2=0x7f624c0c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6234019040 tx=0x7f62340191d0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 shutdown_connections 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f622c066430 0x7f622c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f624c0cef80 0x7f624c0c7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624c0b7ab0 0x7f624c0c6ad0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 --2- 172.21.15.37:0/1284959433 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f624c0b4170 0x7f624c1543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 >> 172.21.15.37:0/1284959433 conn(0x7f624c073090 msgr2=0x7f624c155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 shutdown_connections 2023-07-09T21:35:45.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.241+0000 7f625089c640 1 -- 172.21.15.37:0/1284959433 wait complete. 2023-07-09T21:35:45.255 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.257+0000 7fb469369180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:35:45.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:35:45.339 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.341+0000 7fb469369180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:35:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 Processor -- start 2023-07-09T21:35:45.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 -- start start 2023-07-09T21:35:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ea00b4340 0x7f6ea006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00b49f0 con 0x7f6ea00b7ab0 2023-07-09T21:35:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea00cc8a0 con 0x7f6ea00cef80 2023-07-09T21:35:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea726d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00b7e80 con 0x7f6ea00b4340 2023-07-09T21:35:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea5009640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6ea00b7ab0 0x7f6ea00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53684/0 (socket says 172.21.15.37:53684) 2023-07-09T21:35:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea5009640 1 -- 172.21.15.37:0/1001511565 learned_addr learned my addr 172.21.15.37:0/1001511565 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.405+0000 7f6ea4808640 1 --2- 172.21.15.37:0/1001511565 >> v2:172.21.15.119:3300/0 conn(0x7f6ea00b4340 0x7f6ea006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3070765467 0 0) 0x7f6ea00b49f0 con 0x7f6ea00b7ab0 2023-07-09T21:35:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c003530 con 0x7f6ea00b7ab0 2023-07-09T21:35:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532441736 0 0) 0x7f6ea00cc8a0 con 0x7f6ea00cef80 2023-07-09T21:35:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea00b49f0 con 0x7f6ea00cef80 2023-07-09T21:35:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150684493 0 0) 0x7f6e8c003530 con 0x7f6ea00b7ab0 2023-07-09T21:35:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6ea4808640 1 -- 172.21.15.37:0/1001511565 >> v1:172.21.15.119:6789/0 conn(0x7f6ea00cef80 legacy=0x7f6ea00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6ea4808640 1 -- 172.21.15.37:0/1001511565 >> v1:172.21.15.37:6789/0 conn(0x7f6ea00b7ab0 legacy=0x7f6ea00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6ea4808640 1 -- 172.21.15.37:0/1001511565 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00ccb80 con 0x7f6ea00b4340 2023-07-09T21:35:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6ea4808640 1 --2- 172.21.15.37:0/1001511565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea006aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097c0 tx=0x7f6e9001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fd388a6d2155459 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c001680 con 0x7f6ea00b4340 2023-07-09T21:35:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900a7050 con 0x7f6ea00b4340 2023-07-09T21:35:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.409+0000 7f6e97fff640 1 -- 172.21.15.37:0/1001511565 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900ab600 con 0x7f6ea00b4340 2023-07-09T21:35:45.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- 172.21.15.37:0/1001511565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 msgr2=0x7f6ea006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 --2- 172.21.15.37:0/1001511565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea006aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6e900097c0 tx=0x7f6e9001c370 comp rx=0 tx=0).stop 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- 172.21.15.37:0/1001511565 shutdown_connections 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 --2- 172.21.15.37:0/1001511565 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea006aa50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- 172.21.15.37:0/1001511565 >> 172.21.15.37:0/1001511565 conn(0x7f6ea0073090 msgr2=0x7f6ea0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- 172.21.15.37:0/1001511565 shutdown_connections 2023-07-09T21:35:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- 172.21.15.37:0/1001511565 wait complete. 2023-07-09T21:35:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 Processor -- start 2023-07-09T21:35:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- start start 2023-07-09T21:35:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 0x7f6ea01f74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ea00cef80 0x7f6ea01f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f7db0 con 0x7f6ea00cef80 2023-07-09T21:35:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f8090 con 0x7f6ea00b4340 2023-07-09T21:35:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea726d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f8370 con 0x7f6ea00b7ab0 2023-07-09T21:35:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea5009640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea4808640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 0x7f6ea01f74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea5009640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41588/0 (socket says 172.21.15.37:41588) 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea5009640 1 -- 172.21.15.37:0/4146807624 learned_addr learned my addr 172.21.15.37:0/4146807624 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea580a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ea00cef80 0x7f6ea01f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.413+0000 7f6ea4808640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 0x7f6ea01f74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:34992/0 (socket says 172.21.15.37:34992) 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 -- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 msgr2=0x7f6ea01f74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 0x7f6ea01f74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 -- 172.21.15.37:0/4146807624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ea00cef80 msgr2=0x7f6ea01f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ea00cef80 0x7f6ea01f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 -- 172.21.15.37:0/4146807624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e90009420 con 0x7f6ea00b4340 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea5009640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00c750 tx=0x7f6e9c00cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c005af0 con 0x7f6ea00b4340 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9c005c50 con 0x7f6ea00b4340 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c007070 con 0x7f6ea00b4340 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea01f3ff0 con 0x7f6ea00b4340 2023-07-09T21:35:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea01f7a10 con 0x7f6ea00b4340 2023-07-09T21:35:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea004d7d0 con 0x7f6ea00b4340 2023-07-09T21:35:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f6e9c0071d0 con 0x7f6ea00b4340 2023-07-09T21:35:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.417+0000 7f6e95ffb640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 0x7f6e84068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.421+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f6e9c084120 con 0x7f6ea00b4340 2023-07-09T21:35:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.421+0000 7f6ea4808640 1 -- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 msgr2=0x7f6e84068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.421+0000 7f6ea4808640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 0x7f6e84068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.421+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e9c050f20 con 0x7f6ea00b4340 2023-07-09T21:35:45.450 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:45.445+0000 7f5aacc2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:35:45.492 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.493+0000 7fb469369180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:35:45.541 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:45.537+0000 7f5aacc2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:35:45.577 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.581+0000 7fb469369180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:35:45.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.581+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ea0070f60 con 0x7f6ea00b4340 2023-07-09T21:35:45.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6e95ffb640 1 -- 172.21.15.37:0/4146807624 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20085 (secure 0 0 0) 0x7f6e9c054540 con 0x7f6ea00b4340 2023-07-09T21:35:45.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:45.588 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":54,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:35:45.032241+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":234,"snap_epoch":53,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1387781828":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6833/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/4267916423":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/2798932044":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/3050580235":"2023-07-10T21:23:55.550650+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":1},{"begin":32,"length":1},{"begin":42,"length":1},{"begin":53,"length":1},{"begin":60,"length":1},{"begin":64,"length":1},{"begin":70,"length":1},{"begin":74,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":102,"length":1},{"begin":106,"length":1},{"begin":113,"length":1},{"begin":219,"length":16}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1},{"begin":12,"length":1},{"begin":14,"length":1},{"begin":16,"length":1},{"begin":18,"length":2},{"begin":23,"length":1},{"begin":25,"length":1},{"begin":27,"length":1},{"begin":30,"length":1},{"begin":34,"length":1},{"begin":36,"length":1},{"begin":38,"length":1},{"begin":40,"length":1},{"begin":44,"length":1},{"begin":46,"length":1},{"begin":48,"length":2},{"begin":51,"length":1},{"begin":55,"length":1},{"begin":57,"length":1},{"begin":62,"length":1},{"begin":66,"length":1},{"begin":68,"length":1},{"begin":72,"length":1},{"begin":76,"length":1},{"begin":78,"length":2},{"begin":83,"length":1},{"begin":87,"length":1},{"begin":89,"length":1},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":100,"length":1},{"begin":104,"length":1},{"begin":108,"length":2},{"begin":111,"length":1},{"begin":115,"length":2},{"begin":178,"length":41}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:35:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 msgr2=0x7f6e84068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 0x7f6e84068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 msgr2=0x7f6ea00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00c750 tx=0x7f6e9c00cc10 comp rx=0 tx=0).stop 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 shutdown_connections 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f6e84066460 0x7f6e84068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ea00cef80 0x7f6ea01f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ea00b7ab0 0x7f6ea01f74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 --2- 172.21.15.37:0/4146807624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ea00b4340 0x7f6ea00cbaa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 >> 172.21.15.37:0/4146807624 conn(0x7f6ea0073090 msgr2=0x7f6ea00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 shutdown_connections 2023-07-09T21:35:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.585+0000 7f6ea726d640 1 -- 172.21.15.37:0/4146807624 wait complete. 2023-07-09T21:35:45.611 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:23:35.367399+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:23:36.572999+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 234, 'snap_epoch': 53, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:35:45.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:35:45.703 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:45.697+0000 7f5aacc2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:35:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 Processor -- start 2023-07-09T21:35:45.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 -- start start 2023-07-09T21:35:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89dc0b7980 0x7f89dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89dc15bf80 con 0x7f89dc0ceb80 2023-07-09T21:35:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89dc0cd070 con 0x7f89dc0b7980 2023-07-09T21:35:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e45fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0cfd70 con 0x7f89dc0d0780 2023-07-09T21:35:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e1b95640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f89dc0ceb80 0x7f89dc0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53686/0 (socket says 172.21.15.37:53686) 2023-07-09T21:35:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e1b95640 1 -- 172.21.15.37:0/3863833205 learned_addr learned my addr 172.21.15.37:0/3863833205 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e2396640 1 --2- 172.21.15.37:0/3863833205 >> v2:172.21.15.37:3300/0 conn(0x7f89dc0b7980 0x7f89dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.757+0000 7f89e2b97640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e2396640 1 -- 172.21.15.37:0/3863833205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 msgr2=0x7f89dc0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:45.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e2396640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e2396640 1 -- 172.21.15.37:0/3863833205 >> v1:172.21.15.37:6789/0 conn(0x7f89dc0ceb80 legacy=0x7f89dc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e2396640 1 -- 172.21.15.37:0/3863833205 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc160570 con 0x7f89dc0b7980 2023-07-09T21:35:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e1394640 1 -- 172.21.15.37:0/3863833205 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738380781 0 0) 0x7f89cc001120 con 0x7f89dc0ceb80 2023-07-09T21:35:45.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e2396640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0b7980 0x7f89dc160030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a197d7696b9c21 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e1394640 1 -- 172.21.15.37:0/3863833205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80ab600 con 0x7f89dc0b7980 2023-07-09T21:35:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e1394640 1 -- 172.21.15.37:0/3863833205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d80a7050 con 0x7f89dc0b7980 2023-07-09T21:35:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e1394640 1 -- 172.21.15.37:0/3863833205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d80ab980 con 0x7f89dc0b7980 2023-07-09T21:35:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e45fa640 1 -- 172.21.15.37:0/3863833205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0b7980 msgr2=0x7f89dc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.761+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0b7980 0x7f89dc160030 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f89d80097c0 tx=0x7f89d801c480 comp rx=0 tx=0).stop 2023-07-09T21:35:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- 172.21.15.37:0/3863833205 shutdown_connections 2023-07-09T21:35:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3863833205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0b7980 0x7f89dc160030 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- 172.21.15.37:0/3863833205 >> 172.21.15.37:0/3863833205 conn(0x7f89dc073090 msgr2=0x7f89dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- 172.21.15.37:0/3863833205 shutdown_connections 2023-07-09T21:35:45.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- 172.21.15.37:0/3863833205 wait complete. 2023-07-09T21:35:45.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 Processor -- start 2023-07-09T21:35:45.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- start start 2023-07-09T21:35:45.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89dc0b7980 0x7f89dc153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15bb30 con 0x7f89dc0ceb80 2023-07-09T21:35:45.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc0ca9d0 con 0x7f89dc0b7980 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e45fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc15aa90 con 0x7f89dc0d0780 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50354/0 (socket says 172.21.15.37:50354) 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 -- 172.21.15.37:0/3183978692 learned_addr learned my addr 172.21.15.37:0/3183978692 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e2396640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89dc0b7980 0x7f89dc153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e2b97640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:45.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 -- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 msgr2=0x7f89dc14ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc14ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 -- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89dc0b7980 msgr2=0x7f89dc153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89dc0b7980 0x7f89dc153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.765+0000 7f89e1b95640 1 -- 172.21.15.37:0/3183978692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009420 con 0x7f89dc0ceb80 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89e1b95640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c780 tx=0x7f89cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0072d0 con 0x7f89dc0ceb80 2023-07-09T21:35:45.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc007450 con 0x7f89dc0ceb80 2023-07-09T21:35:45.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89dc15ad70 con 0x7f89dc0ceb80 2023-07-09T21:35:45.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0047f0 con 0x7f89dc0ceb80 2023-07-09T21:35:45.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89dc15b330 con 0x7f89dc0ceb80 2023-07-09T21:35:45.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89dc04d7d0 con 0x7f89dc0ceb80 2023-07-09T21:35:45.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.769+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 85829+0+0 (secure 0 0 0) 0x7f89cc004950 con 0x7f89dc0ceb80 2023-07-09T21:35:45.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.773+0000 7f89d2ffd640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 0x7f89c00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:45.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.773+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 7237+0+0 (secure 0 0 0) 0x7f89cc083790 con 0x7f89dc0ceb80 2023-07-09T21:35:45.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.773+0000 7f89e2396640 1 -- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 msgr2=0x7f89c00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/247577371 2023-07-09T21:35:45.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.773+0000 7f89e2396640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 0x7f89c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:35:45.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.773+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f89cc050640 con 0x7f89dc0ceb80 2023-07-09T21:35:45.795 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:45.789+0000 7f5aacc2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:35:45.850 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.853+0000 7fb469369180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:35:45.910 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:45.913+0000 7fb469369180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:35:45.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.921+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f89cc050a10 con 0x7f89dc0ceb80 2023-07-09T21:35:45.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.921+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 msgr2=0x7f89c00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:35:45.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.921+0000 7f89d2ffd640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 0x7f89c00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.941+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89dc0b1600 con 0x7f89dc0ceb80 2023-07-09T21:35:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.941+0000 7f89d2ffd640 1 -- 172.21.15.37:0/3183978692 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89cc0811a0 con 0x7f89dc0ceb80 2023-07-09T21:35:45.947 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:35:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 msgr2=0x7f89dc15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c780 tx=0x7f89cc00cc40 comp rx=0 tx=0).stop 2023-07-09T21:35:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 shutdown_connections 2023-07-09T21:35:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:6832/247577371,v1:172.21.15.119:6833/247577371] conn(0x7f89c0066430 0x7f89c00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f89dc0d0780 0x7f89dc14ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89dc0ceb80 0x7f89dc15a0f0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 --2- 172.21.15.37:0/3183978692 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f89dc0b7980 0x7f89dc153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 >> 172.21.15.37:0/3183978692 conn(0x7f89dc073090 msgr2=0x7f89dc0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 shutdown_connections 2023-07-09T21:35:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:45.945+0000 7f89e45fa640 1 -- 172.21.15.37:0/3183978692 wait complete. 2023-07-09T21:35:45.968 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:35:45.999 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f4ce7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.000 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f4ce7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.000 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f4ce7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.000 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f4ce7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.000 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f4ce7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.001 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f24e2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.001 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f24e2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.001 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f24e2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.001 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f24e2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.001 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:35:46.001+0000 7fb3f24e2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:35:46.107 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:46.105+0000 7f5aacc2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:35:46.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 Processor -- start 2023-07-09T21:35:46.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 -- start start 2023-07-09T21:35:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 0x7fb6d4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6d40d0780 0x7fb6d40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d415bf80 con 0x7fb6d40ceb80 2023-07-09T21:35:46.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40cd070 con 0x7fb6d40d0780 2023-07-09T21:35:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6db6cb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6d40cfd70 con 0x7fb6d40b7980 2023-07-09T21:35:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6d40d0780 0x7fb6d40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb6d40d0780 0x7fb6d40d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50366/0 (socket says 172.21.15.37:50366) 2023-07-09T21:35:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3389542533 learned_addr learned my addr 172.21.15.37:0/3389542533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:46.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9467640 1 --2- 172.21.15.37:0/3389542533 >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 0x7fb6d4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3389542533 >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 msgr2=0x7fb6d4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 --2- 172.21.15.37:0/3389542533 >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 0x7fb6d4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3389542533 >> v1:172.21.15.119:6789/0 conn(0x7fb6d40ceb80 legacy=0x7fb6d40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3389542533 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d4160570 con 0x7fb6d40d0780 2023-07-09T21:35:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.121+0000 7fb6d9467640 1 --2- 172.21.15.37:0/3389542533 >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 0x7fb6d4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:46.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6d9c68640 1 --2- 172.21.15.37:0/3389542533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40d0b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4069aa0 tx=0x7fb6cc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f539cd16f6abdb53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6cbfff640 1 -- 172.21.15.37:0/3389542533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0a5690 con 0x7fb6d40d0780 2023-07-09T21:35:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6cbfff640 1 -- 172.21.15.37:0/3389542533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc0a57f0 con 0x7fb6d40d0780 2023-07-09T21:35:46.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6cbfff640 1 -- 172.21.15.37:0/3389542533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0a5b80 con 0x7fb6d40d0780 2023-07-09T21:35:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3389542533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 msgr2=0x7fb6d40d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3389542533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40d0b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4069aa0 tx=0x7fb6cc01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3389542533 shutdown_connections 2023-07-09T21:35:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3389542533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40d0b80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3389542533 >> v2:172.21.15.119:3300/0 conn(0x7fb6d40b7980 0x7fb6d4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3389542533 >> 172.21.15.37:0/3389542533 conn(0x7fb6d4073090 msgr2=0x7fb6d4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3389542533 shutdown_connections 2023-07-09T21:35:46.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.125+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3389542533 wait complete. 2023-07-09T21:35:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 Processor -- start 2023-07-09T21:35:46.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 -- start start 2023-07-09T21:35:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6d40b7980 0x7fb6d414f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6d40ceb80 0x7fb6d40b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40ca0e0 con 0x7fb6d40d0780 2023-07-09T21:35:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d40cc170 con 0x7fb6d40ceb80 2023-07-09T21:35:46.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6db6cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d415b9c0 con 0x7fb6d40b7980 2023-07-09T21:35:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6d9c68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6d9c68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50374/0 (socket says 172.21.15.37:50374) 2023-07-09T21:35:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3118139365 learned_addr learned my addr 172.21.15.37:0/3118139365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:46.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6d8c66640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6d40ceb80 0x7fb6d40b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.129+0000 7fb6d9467640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6d40b7980 0x7fb6d414f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6d40b7980 msgr2=0x7fb6d414f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6d40b7980 0x7fb6d414f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6d40ceb80 msgr2=0x7fb6d40b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6d40ceb80 0x7fb6d40b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 -- 172.21.15.37:0/3118139365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc009b30 con 0x7fb6d40d0780 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6d9c68640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0af040 tx=0x7fb6cc019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0b8880 con 0x7fb6d40d0780 2023-07-09T21:35:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6cc0b89e0 con 0x7fb6d40d0780 2023-07-09T21:35:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6cc0b8d90 con 0x7fb6d40d0780 2023-07-09T21:35:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d41f4b70 con 0x7fb6d40d0780 2023-07-09T21:35:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d41f5130 con 0x7fb6d40d0780 2023-07-09T21:35:46.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d404d7d0 con 0x7fb6d40d0780 2023-07-09T21:35:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.133+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fb6cc0c3460 con 0x7fb6d40d0780 2023-07-09T21:35:46.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.137+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7fb6cc11f110 con 0x7fb6d40d0780 2023-07-09T21:35:46.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.145+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6cc0ec640 con 0x7fb6d40d0780 2023-07-09T21:35:46.178 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:35:46.173+0000 7f5aacc2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:35:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb6d4160570 con 0x7fb6d40d0780 2023-07-09T21:35:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6c9ffb640 1 -- 172.21.15.37:0/3118139365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb6d4160570 con 0x7fb6d40d0780 2023-07-09T21:35:46.305 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:35:46.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 msgr2=0x7fb6d40b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0af040 tx=0x7fb6cc019770 comp rx=0 tx=0).stop 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 shutdown_connections 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb6d40d0780 0x7fb6d40b5510 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb6d40ceb80 0x7fb6d40b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 --2- 172.21.15.37:0/3118139365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb6d40b7980 0x7fb6d414f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 >> 172.21.15.37:0/3118139365 conn(0x7fb6d4073090 msgr2=0x7fb6d40cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 shutdown_connections 2023-07-09T21:35:46.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.301+0000 7fb6db6cb640 1 -- 172.21.15.37:0/3118139365 wait complete. 2023-07-09T21:35:46.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:35:46.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.465+0000 7f94652aa640 1 Processor -- start 2023-07-09T21:35:46.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.465+0000 7f94652aa640 1 -- start start 2023-07-09T21:35:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f94652aa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94601595c0 0x7f94600c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f94652aa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9460159990 0x7f94600c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f94652aa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600c4c90 con 0x7f946015dd10 2023-07-09T21:35:46.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f94652aa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600ca730 con 0x7f94601595c0 2023-07-09T21:35:46.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f94652aa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600c9f20 con 0x7f9460159990 2023-07-09T21:35:46.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94601595c0 0x7f94600c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f946015dd10 0x7f94600cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53694/0 (socket says 172.21.15.37:53694) 2023-07-09T21:35:46.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945f7fe640 1 -- 172.21.15.37:0/2434998825 learned_addr learned my addr 172.21.15.37:0/2434998825 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f9457fff640 1 --2- 172.21.15.37:0/2434998825 >> v2:172.21.15.119:3300/0 conn(0x7f9460159990 0x7f94600c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945effd640 1 -- 172.21.15.37:0/2434998825 >> v2:172.21.15.119:3300/0 conn(0x7f9460159990 msgr2=0x7f94600c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945effd640 1 --2- 172.21.15.37:0/2434998825 >> v2:172.21.15.119:3300/0 conn(0x7f9460159990 0x7f94600c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945effd640 1 -- 172.21.15.37:0/2434998825 >> v1:172.21.15.37:6789/0 conn(0x7f946015dd10 legacy=0x7f94600cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.469+0000 7f945effd640 1 -- 172.21.15.37:0/2434998825 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94600ca170 con 0x7f94601595c0 2023-07-09T21:35:46.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f945effd640 1 --2- 172.21.15.37:0/2434998825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94601595c0 0x7f94600c4750 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f946006e8c0 tx=0x7f945001c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292092cf8e8b4bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f945e7fc640 1 -- 172.21.15.37:0/2434998825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500ab600 con 0x7f94601595c0 2023-07-09T21:35:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f945e7fc640 1 -- 172.21.15.37:0/2434998825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94500a7050 con 0x7f94601595c0 2023-07-09T21:35:46.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f945e7fc640 1 -- 172.21.15.37:0/2434998825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94500ab980 con 0x7f94601595c0 2023-07-09T21:35:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- 172.21.15.37:0/2434998825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94601595c0 msgr2=0x7f94600c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 --2- 172.21.15.37:0/2434998825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94601595c0 0x7f94600c4750 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f946006e8c0 tx=0x7f945001c2f0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- 172.21.15.37:0/2434998825 shutdown_connections 2023-07-09T21:35:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 --2- 172.21.15.37:0/2434998825 >> v2:172.21.15.119:3300/0 conn(0x7f9460159990 0x7f94600c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 --2- 172.21.15.37:0/2434998825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94601595c0 0x7f94600c4750 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- 172.21.15.37:0/2434998825 >> 172.21.15.37:0/2434998825 conn(0x7f94600cde40 msgr2=0x7f94600ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- 172.21.15.37:0/2434998825 shutdown_connections 2023-07-09T21:35:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- 172.21.15.37:0/2434998825 wait complete. 2023-07-09T21:35:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 Processor -- start 2023-07-09T21:35:46.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.473+0000 7f94652aa640 1 -- start start 2023-07-09T21:35:46.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94601595c0 0x7f94601f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9460159990 0x7f94601f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94601f5800 con 0x7f946015dd10 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94601f12e0 con 0x7f9460159990 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94601f2230 con 0x7f94601595c0 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50390/0 (socket says 172.21.15.37:50390) 2023-07-09T21:35:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 -- 172.21.15.37:0/1652393579 learned_addr learned my addr 172.21.15.37:0/1652393579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945effd640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94601595c0 0x7f94601f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f9457fff640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9460159990 0x7f94601f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 -- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94601595c0 msgr2=0x7f94601f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94601595c0 0x7f94601f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 -- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9460159990 msgr2=0x7f94601f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9460159990 0x7f94601f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 -- 172.21.15.37:0/1652393579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450009420 con 0x7f946015dd10 2023-07-09T21:35:46.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f945f7fe640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f945800d390 tx=0x7f945800d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800a580 con 0x7f946015dd10 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800a6e0 con 0x7f946015dd10 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94601f5240 con 0x7f946015dd10 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800aa50 con 0x7f946015dd10 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94601f14f0 con 0x7f946015dd10 2023-07-09T21:35:46.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f946004d7d0 con 0x7f946015dd10 2023-07-09T21:35:46.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.477+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f945801e3b0 con 0x7f946015dd10 2023-07-09T21:35:46.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.481+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f9458087220 con 0x7f946015dd10 2023-07-09T21:35:46.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.485+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94580546b0 con 0x7f946015dd10 2023-07-09T21:35:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.641+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94600c4c90 con 0x7f946015dd10 2023-07-09T21:35:46.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.641+0000 7f94577fe640 1 -- 172.21.15.37:0/1652393579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v55) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94600c4c90 con 0x7f946015dd10 2023-07-09T21:35:46.645 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:35:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 msgr2=0x7f946015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f945800d390 tx=0x7f945800d850 comp rx=0 tx=0).stop 2023-07-09T21:35:46.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 shutdown_connections 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f946015dd10 0x7f946015be00 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9460159990 0x7f94601f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 --2- 172.21.15.37:0/1652393579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94601595c0 0x7f94601f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 >> 172.21.15.37:0/1652393579 conn(0x7f94600cde40 msgr2=0x7f94600cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 shutdown_connections 2023-07-09T21:35:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.645+0000 7f94652aa640 1 -- 172.21.15.37:0/1652393579 wait complete. 2023-07-09T21:35:46.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:35:46.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 Processor -- start 2023-07-09T21:35:46.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 -- start start 2023-07-09T21:35:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33cc0b7980 0x7f33cc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33cc0ceb80 0x7f33cc0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc15bf80 con 0x7f33cc0b3c20 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0cd070 con 0x7f33cc0b7980 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33d152c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc0cfd70 con 0x7f33cc0ceb80 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33cc0b7980 0x7f33cc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f33cc0b7980 0x7f33cc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50398/0 (socket says 172.21.15.37:50398) 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 -- 172.21.15.37:0/644252120 learned_addr learned my addr 172.21.15.37:0/644252120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:46.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33c3fff640 1 --2- 172.21.15.37:0/644252120 >> v2:172.21.15.119:3300/0 conn(0x7f33cc0ceb80 0x7f33cc0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 -- 172.21.15.37:0/644252120 >> v2:172.21.15.119:3300/0 conn(0x7f33cc0ceb80 msgr2=0x7f33cc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 --2- 172.21.15.37:0/644252120 >> v2:172.21.15.119:3300/0 conn(0x7f33cc0ceb80 0x7f33cc0cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 -- 172.21.15.37:0/644252120 >> v1:172.21.15.119:6789/0 conn(0x7f33cc0b3c20 legacy=0x7f33cc0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.809+0000 7f33caffd640 1 -- 172.21.15.37:0/644252120 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc160570 con 0x7f33cc0b7980 2023-07-09T21:35:46.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33caffd640 1 --2- 172.21.15.37:0/644252120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0b7980 0x7f33cc160030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0b4cd0 tx=0x7f33bc01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e65e9c0d03e36e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33ca7fc640 1 -- 172.21.15.37:0/644252120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ab600 con 0x7f33cc0b7980 2023-07-09T21:35:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33ca7fc640 1 -- 172.21.15.37:0/644252120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc0a7050 con 0x7f33cc0b7980 2023-07-09T21:35:46.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33ca7fc640 1 -- 172.21.15.37:0/644252120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc0ab980 con 0x7f33cc0b7980 2023-07-09T21:35:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 -- 172.21.15.37:0/644252120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0b7980 msgr2=0x7f33cc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 --2- 172.21.15.37:0/644252120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0b7980 0x7f33cc160030 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0b4cd0 tx=0x7f33bc01c500 comp rx=0 tx=0).stop 2023-07-09T21:35:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 -- 172.21.15.37:0/644252120 shutdown_connections 2023-07-09T21:35:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 --2- 172.21.15.37:0/644252120 >> v2:172.21.15.119:3300/0 conn(0x7f33cc0ceb80 0x7f33cc0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 --2- 172.21.15.37:0/644252120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0b7980 0x7f33cc160030 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 -- 172.21.15.37:0/644252120 >> 172.21.15.37:0/644252120 conn(0x7f33cc073090 msgr2=0x7f33cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 -- 172.21.15.37:0/644252120 shutdown_connections 2023-07-09T21:35:46.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.813+0000 7f33d152c640 1 -- 172.21.15.37:0/644252120 wait complete. 2023-07-09T21:35:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 Processor -- start 2023-07-09T21:35:46.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- start start 2023-07-09T21:35:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33cc0b3c20 0x7f33cc14db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33cc0b7980 0x7f33cc1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc155b30 con 0x7f33cc0ceb80 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc1528f0 con 0x7f33cc0b7980 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc152bd0 con 0x7f33cc0b3c20 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50414/0 (socket says 172.21.15.37:50414) 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 -- 172.21.15.37:0/2568868402 learned_addr learned my addr 172.21.15.37:0/2568868402 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33c3fff640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33cc0b7980 0x7f33cc1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33caffd640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33cc0b3c20 0x7f33cc14db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 -- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33cc0b3c20 msgr2=0x7f33cc14db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33cc0b3c20 0x7f33cc14db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 -- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33cc0b7980 msgr2=0x7f33cc1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33cc0b7980 0x7f33cc1522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 -- 172.21.15.37:0/2568868402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0094d0 con 0x7f33cc0ceb80 2023-07-09T21:35:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33cb7fe640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c770 tx=0x7f33c400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c4003b80 con 0x7f33cc0ceb80 2023-07-09T21:35:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c4003ce0 con 0x7f33cc0ceb80 2023-07-09T21:35:46.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400aa90 con 0x7f33cc0ceb80 2023-07-09T21:35:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc152eb0 con 0x7f33cc0ceb80 2023-07-09T21:35:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.817+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc153470 con 0x7f33cc0ceb80 2023-07-09T21:35:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.821+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc04d7d0 con 0x7f33cc0ceb80 2023-07-09T21:35:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.821+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f33c400abf0 con 0x7f33cc0ceb80 2023-07-09T21:35:46.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.821+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f33c4083800 con 0x7f33cc0ceb80 2023-07-09T21:35:46.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.825+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33c4050c90 con 0x7f33cc0ceb80 2023-07-09T21:35:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.925+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f33c4050740 con 0x7f33cc0ceb80 2023-07-09T21:35:46.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.925+0000 7f33c37fe640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 0x7f33ac06e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:46.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.925+0000 7f33caffd640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 0x7f33ac06e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:46.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.929+0000 7f33caffd640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 0x7f33ac06e820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ad000 tx=0x7f33bc008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:46.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33cc15bf80 con 0x7f33cc0ceb80 2023-07-09T21:35:46.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33c37fe640 1 -- 172.21.15.37:0/2568868402 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v55) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33cc15bf80 con 0x7f33cc0ceb80 2023-07-09T21:35:46.988 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 msgr2=0x7f33ac06e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 0x7f33ac06e820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0ad000 tx=0x7f33bc008040 comp rx=0 tx=0).stop 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 msgr2=0x7f33cc154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f33c400c770 tx=0x7f33c400cc30 comp rx=0 tx=0).stop 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 shutdown_connections 2023-07-09T21:35:46.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33cc0ceb80 0x7f33cc154d60 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33cc0b7980 0x7f33cc1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f33ac06c440 0x7f33ac06e820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 --2- 172.21.15.37:0/2568868402 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33cc0b3c20 0x7f33cc14db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 >> 172.21.15.37:0/2568868402 conn(0x7f33cc073090 msgr2=0x7f33cc0b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 shutdown_connections 2023-07-09T21:35:46.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:46.985+0000 7f33d152c640 1 -- 172.21.15.37:0/2568868402 wait complete. 2023-07-09T21:35:47.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:35:47.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 Processor -- start 2023-07-09T21:35:47.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 -- start start 2023-07-09T21:35:47.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22880b4340 0x7f228806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880b49f0 con 0x7f22880b7ab0 2023-07-09T21:35:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880cc8a0 con 0x7f22880cef80 2023-07-09T21:35:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f228dffa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880b7e80 con 0x7f22880b4340 2023-07-09T21:35:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22877fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22880b7ab0 0x7f22880b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53696/0 (socket says 172.21.15.37:53696) 2023-07-09T21:35:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22877fe640 1 -- 172.21.15.37:0/2350972608 learned_addr learned my addr 172.21.15.37:0/2350972608 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f2286ffd640 1 --2- 172.21.15.37:0/2350972608 >> v2:172.21.15.119:3300/0 conn(0x7f22880b4340 0x7f228806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611476643 0 0) 0x7f22880b49f0 con 0x7f22880b7ab0 2023-07-09T21:35:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2270003530 con 0x7f22880b7ab0 2023-07-09T21:35:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852902116 0 0) 0x7f22880cc8a0 con 0x7f22880cef80 2023-07-09T21:35:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22880b49f0 con 0x7f22880cef80 2023-07-09T21:35:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f2286ffd640 1 -- 172.21.15.37:0/2350972608 >> v1:172.21.15.119:6789/0 conn(0x7f22880cef80 legacy=0x7f22880d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f2286ffd640 1 -- 172.21.15.37:0/2350972608 >> v1:172.21.15.37:6789/0 conn(0x7f22880b7ab0 legacy=0x7f22880b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.149+0000 7f2286ffd640 1 -- 172.21.15.37:0/2350972608 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880ccb80 con 0x7f22880b4340 2023-07-09T21:35:47.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f2286ffd640 1 --2- 172.21.15.37:0/2350972608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f228806aa50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e274dc89466da4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0ab650 con 0x7f22880b4340 2023-07-09T21:35:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0ab7b0 con 0x7f22880b4340 2023-07-09T21:35:47.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f22867fc640 1 -- 172.21.15.37:0/2350972608 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0abb40 con 0x7f22880b4340 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 -- 172.21.15.37:0/2350972608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 msgr2=0x7f228806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 --2- 172.21.15.37:0/2350972608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f228806aa50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c450 comp rx=0 tx=0).stop 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 -- 172.21.15.37:0/2350972608 shutdown_connections 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 --2- 172.21.15.37:0/2350972608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f228806aa50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 -- 172.21.15.37:0/2350972608 >> 172.21.15.37:0/2350972608 conn(0x7f2288073090 msgr2=0x7f2288069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:47.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 -- 172.21.15.37:0/2350972608 shutdown_connections 2023-07-09T21:35:47.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.153+0000 7f228dffa640 1 -- 172.21.15.37:0/2350972608 wait complete. 2023-07-09T21:35:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 Processor -- start 2023-07-09T21:35:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- start start 2023-07-09T21:35:47.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f22880b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2288150120 con 0x7f22880cef80 2023-07-09T21:35:47.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b63c0 con 0x7f22880b4340 2023-07-09T21:35:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880b6660 con 0x7f22880b7ab0 2023-07-09T21:35:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:35030/0 (socket says 172.21.15.37:35030) 2023-07-09T21:35:47.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2286ffd640 1 -- 172.21.15.37:0/1444658604 learned_addr learned my addr 172.21.15.37:0/1444658604 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:47.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50418/0 (socket says 172.21.15.37:50418) 2023-07-09T21:35:47.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f22877fe640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f22880b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 -- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 msgr2=0x7f22880c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 -- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 msgr2=0x7f22880b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f22880b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 -- 172.21.15.37:0/1444658604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009420 con 0x7f22880cef80 2023-07-09T21:35:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2286ffd640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:47.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f2287fff640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f22880cf400 tx=0x7f228000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280006d60 con 0x7f22880cef80 2023-07-09T21:35:47.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2280005020 con 0x7f22880cef80 2023-07-09T21:35:47.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2280005430 con 0x7f22880cef80 2023-07-09T21:35:47.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228814fb60 con 0x7f22880cef80 2023-07-09T21:35:47.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.157+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288156400 con 0x7f22880cef80 2023-07-09T21:35:47.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2288154a40 con 0x7f22880cef80 2023-07-09T21:35:47.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f2280005590 con 0x7f22880cef80 2023-07-09T21:35:47.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f226ffff640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 0x7f2274068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f22800836b0 con 0x7f22880cef80 2023-07-09T21:35:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f22877fe640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 0x7f2274068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.161+0000 7f22877fe640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 0x7f2274068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2278007fd0 tx=0x7f2278007d60 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.165+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2288154a40 con 0x7f22880cef80 2023-07-09T21:35:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.353+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2288154a40 con 0x7f22880cef80 2023-07-09T21:35:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.353+0000 7f226ffff640 1 -- 172.21.15.37:0/1444658604 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f2288154a40 con 0x7f22880cef80 2023-07-09T21:35:47.359 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:47.359 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:35:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:35:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 msgr2=0x7f2274068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 0x7f2274068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2278007fd0 tx=0x7f2278007d60 comp rx=0 tx=0).stop 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 msgr2=0x7f22880c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f22880cf400 tx=0x7f228000cb90 comp rx=0 tx=0).stop 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 shutdown_connections 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22880cef80 0x7f22880c6b30 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f22740660d0 0x7f2274068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22880b7ab0 0x7f22880c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 --2- 172.21.15.37:0/1444658604 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22880b4340 0x7f22880b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 >> 172.21.15.37:0/1444658604 conn(0x7f2288073090 msgr2=0x7f22880b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 shutdown_connections 2023-07-09T21:35:47.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.357+0000 7f228dffa640 1 -- 172.21.15.37:0/1444658604 wait complete. 2023-07-09T21:35:47.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:35:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.517+0000 7f5ac0174640 1 Processor -- start 2023-07-09T21:35:47.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.517+0000 7f5ac0174640 1 -- start start 2023-07-09T21:35:47.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5ac0174640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ab815fce0 0x7f5ab80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5ac0174640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5ab81600b0 0x7f5ab8163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5ac0174640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80cd080 con 0x7f5ab80c9df0 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5ac0174640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80cd920 con 0x7f5ab815fce0 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5ac0174640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80ca2f0 con 0x7f5ab81600b0 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ab815fce0 0x7f5ab80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ab815fce0 0x7f5ab80c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43374/0 (socket says 172.21.15.37:43374) 2023-07-09T21:35:47.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 -- 172.21.15.37:0/2111175456 learned_addr learned my addr 172.21.15.37:0/2111175456 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abd70f640 1 --2- 172.21.15.37:0/2111175456 >> v2:172.21.15.119:3300/0 conn(0x7f5ab81600b0 0x7f5ab8163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 -- 172.21.15.37:0/2111175456 >> v2:172.21.15.119:3300/0 conn(0x7f5ab81600b0 msgr2=0x7f5ab8163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 --2- 172.21.15.37:0/2111175456 >> v2:172.21.15.119:3300/0 conn(0x7f5ab81600b0 0x7f5ab8163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 -- 172.21.15.37:0/2111175456 >> v1:172.21.15.119:6789/0 conn(0x7f5ab80c9df0 legacy=0x7f5ab80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:47.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.521+0000 7f5abdf10640 1 -- 172.21.15.37:0/2111175456 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab80cd2d0 con 0x7f5ab815fce0 2023-07-09T21:35:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5abdf10640 1 --2- 172.21.15.37:0/2111175456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815fce0 0x7f5ab80c9620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80c8360 tx=0x7f5ab401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc62d87f099333c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5abcf0e640 1 -- 172.21.15.37:0/2111175456 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40ab620 con 0x7f5ab815fce0 2023-07-09T21:35:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5abcf0e640 1 -- 172.21.15.37:0/2111175456 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab40ab780 con 0x7f5ab815fce0 2023-07-09T21:35:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5abcf0e640 1 -- 172.21.15.37:0/2111175456 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40abb10 con 0x7f5ab815fce0 2023-07-09T21:35:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- 172.21.15.37:0/2111175456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815fce0 msgr2=0x7f5ab80c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 --2- 172.21.15.37:0/2111175456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815fce0 0x7f5ab80c9620 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80c8360 tx=0x7f5ab401c400 comp rx=0 tx=0).stop 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- 172.21.15.37:0/2111175456 shutdown_connections 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 --2- 172.21.15.37:0/2111175456 >> v2:172.21.15.119:3300/0 conn(0x7f5ab81600b0 0x7f5ab8163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 --2- 172.21.15.37:0/2111175456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815fce0 0x7f5ab80c9620 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- 172.21.15.37:0/2111175456 >> 172.21.15.37:0/2111175456 conn(0x7f5ab80ca830 msgr2=0x7f5ab80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- 172.21.15.37:0/2111175456 shutdown_connections 2023-07-09T21:35:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- 172.21.15.37:0/2111175456 wait complete. 2023-07-09T21:35:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 Processor -- start 2023-07-09T21:35:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.525+0000 7f5ac0174640 1 -- start start 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab815fce0 0x7f5ab8156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815df70 con 0x7f5ab815f010 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815e250 con 0x7f5ab80c9df0 2023-07-09T21:35:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab815e530 con 0x7f5ab815fce0 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abe711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55364/0 (socket says 172.21.15.37:55364) 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 -- 172.21.15.37:0/182692822 learned_addr learned my addr 172.21.15.37:0/182692822 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abe711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43386/0 (socket says 172.21.15.37:43386) 2023-07-09T21:35:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abd70f640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab815fce0 0x7f5ab8156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 -- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab815fce0 msgr2=0x7f5ab8156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab815fce0 0x7f5ab8156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 -- 172.21.15.37:0/182692822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 msgr2=0x7f5ab80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 -- 172.21.15.37:0/182692822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab40094d0 con 0x7f5ab80c9df0 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abe711640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5abdf10640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5ab401a030 tx=0x7f5ab401ac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40abe80 con 0x7f5ab80c9df0 2023-07-09T21:35:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab40be3f0 con 0x7f5ab80c9df0 2023-07-09T21:35:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab40be760 con 0x7f5ab80c9df0 2023-07-09T21:35:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab815e810 con 0x7f5ab80c9df0 2023-07-09T21:35:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab8156990 con 0x7f5ab80c9df0 2023-07-09T21:35:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab804d7d0 con 0x7f5ab80c9df0 2023-07-09T21:35:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.529+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5ab40b43f0 con 0x7f5ab80c9df0 2023-07-09T21:35:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.533+0000 7f5aae7fc640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.533+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f5ab411e4e0 con 0x7f5ab80c9df0 2023-07-09T21:35:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.533+0000 7f5abd70f640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.533+0000 7f5abd70f640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 0x7f5a9c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b2a10 tx=0x7f5aa8008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.537+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ab40eb880 con 0x7f5ab80c9df0 2023-07-09T21:35:47.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.693+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ab806f210 con 0x7f5ab80c9df0 2023-07-09T21:35:47.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.693+0000 7f5aae7fc640 1 -- 172.21.15.37:0/182692822 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+19836 (secure 0 0 0) 0x7f5ab4106e60 con 0x7f5ab80c9df0 2023-07-09T21:35:47.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:47.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:35:45.915256+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":235,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1331108823":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/2889093569":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/3050580235":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/2798932044":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/4267916423":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/1093473604":"2023-07-10T21:35:45.915222+0000","172.21.15.119:6833/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/247577371":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/1387781828":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6833/247577371":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/692103513":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/3017579858":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/1667719479":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/482562953":"2023-07-10T21:35:45.915222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":1},{"begin":32,"length":1},{"begin":42,"length":1},{"begin":53,"length":1},{"begin":60,"length":1},{"begin":64,"length":1},{"begin":70,"length":1},{"begin":74,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":102,"length":1},{"begin":106,"length":1},{"begin":113,"length":1},{"begin":117,"length":1},{"begin":219,"length":17}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":117,"length":1},{"begin":235,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:35:47.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 msgr2=0x7f5a9c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 0x7f5a9c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80b2a10 tx=0x7f5aa8008040 comp rx=0 tx=0).stop 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 msgr2=0x7f5ab80b3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5ab401a030 tx=0x7f5ab401ac40 comp rx=0 tx=0).stop 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 shutdown_connections 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ab815f010 0x7f5ab80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f5a9c0660d0 0x7f5a9c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ab815fce0 0x7f5ab8156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 --2- 172.21.15.37:0/182692822 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ab80c9df0 0x7f5ab80b3430 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 >> 172.21.15.37:0/182692822 conn(0x7f5ab80ca830 msgr2=0x7f5ab815c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 shutdown_connections 2023-07-09T21:35:47.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.697+0000 7f5ac0174640 1 -- 172.21.15.37:0/182692822 wait complete. 2023-07-09T21:35:47.719 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:35:47.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:35:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.857+0000 7f70450cb640 1 Processor -- start 2023-07-09T21:35:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.857+0000 7f70450cb640 1 -- start start 2023-07-09T21:35:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.857+0000 7f70450cb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70400b7ab0 0x7f704006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f70450cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f70400d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f70450cb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70400b49f0 con 0x7f70400cef80 2023-07-09T21:35:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f70450cb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400b7e80 con 0x7f70400b7ab0 2023-07-09T21:35:47.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f70450cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400cc8a0 con 0x7f70400b4340 2023-07-09T21:35:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f7037fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f70400cef80 0x7f70400b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42120/0 (socket says 172.21.15.37:42120) 2023-07-09T21:35:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f7037fff640 1 -- 172.21.15.37:0/2372935680 learned_addr learned my addr 172.21.15.37:0/2372935680 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:47.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 --2- 172.21.15.37:0/2372935680 >> v2:172.21.15.119:3300/0 conn(0x7f70400b7ab0 0x7f704006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703f59e640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f70400d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703e59c640 1 -- 172.21.15.37:0/2372935680 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496138250 0 0) 0x7f70400b49f0 con 0x7f70400cef80 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 -- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 msgr2=0x7f70400d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f70400d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 -- 172.21.15.37:0/2372935680 >> v1:172.21.15.37:6789/0 conn(0x7f70400cef80 legacy=0x7f70400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 -- 172.21.15.37:0/2372935680 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70400ccb80 con 0x7f70400b7ab0 2023-07-09T21:35:47.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.861+0000 7f703ed9d640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400b7ab0 0x7f704006aa50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70300097c0 tx=0x7f703001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab66f35e3a4e302d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f703e59c640 1 -- 172.21.15.37:0/2372935680 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300ab650 con 0x7f70400b7ab0 2023-07-09T21:35:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f703e59c640 1 -- 172.21.15.37:0/2372935680 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300ab7b0 con 0x7f70400b7ab0 2023-07-09T21:35:47.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f703e59c640 1 -- 172.21.15.37:0/2372935680 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300abb40 con 0x7f70400b7ab0 2023-07-09T21:35:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400b7ab0 msgr2=0x7f704006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400b7ab0 0x7f704006aa50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f70300097c0 tx=0x7f703001c450 comp rx=0 tx=0).stop 2023-07-09T21:35:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- 172.21.15.37:0/2372935680 shutdown_connections 2023-07-09T21:35:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f70400d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- 172.21.15.37:0/2372935680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400b7ab0 0x7f704006aa50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- 172.21.15.37:0/2372935680 >> 172.21.15.37:0/2372935680 conn(0x7f7040073090 msgr2=0x7f7040069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:47.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- 172.21.15.37:0/2372935680 shutdown_connections 2023-07-09T21:35:47.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- 172.21.15.37:0/2372935680 wait complete. 2023-07-09T21:35:47.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 Processor -- start 2023-07-09T21:35:47.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- start start 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f704014f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400cef80 0x7f7040155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70401568c0 con 0x7f70400b7ab0 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f704014f5e0 con 0x7f70400cef80 2023-07-09T21:35:47.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f70450cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70400c6530 con 0x7f70400b4340 2023-07-09T21:35:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.865+0000 7f7037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f704014f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f7037fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43392/0 (socket says 172.21.15.37:43392) 2023-07-09T21:35:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f7037fff640 1 -- 172.21.15.37:0/3972350590 learned_addr learned my addr 172.21.15.37:0/3972350590 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:47.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703f59e640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400cef80 0x7f7040155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 -- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400cef80 msgr2=0x7f7040155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400cef80 0x7f7040155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 -- 172.21.15.37:0/3972350590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 msgr2=0x7f70400c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:47.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:47.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 -- 172.21.15.37:0/3972350590 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009420 con 0x7f70400b4340 2023-07-09T21:35:47.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f7037fff640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f703ed9d640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f704014f0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70300ac000 tx=0x7f703001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300b5600 con 0x7f70400b4340 2023-07-09T21:35:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70300b5760 con 0x7f70400b4340 2023-07-09T21:35:47.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300b5b10 con 0x7f70400b4340 2023-07-09T21:35:47.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7040150940 con 0x7f70400b4340 2023-07-09T21:35:47.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70400c6220 con 0x7f70400b4340 2023-07-09T21:35:47.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704004d7d0 con 0x7f70400b4340 2023-07-09T21:35:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.869+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 15) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f70300059a0 con 0x7f70400b4340 2023-07-09T21:35:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.873+0000 7f70377fe640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 0x7f7020068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.873+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f70300dd080 con 0x7f70400b4340 2023-07-09T21:35:47.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.873+0000 7f7037fff640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 0x7f7020068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.873+0000 7f7037fff640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 0x7f7020068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f704006ac30 tx=0x7f7028007e80 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:47.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:47.873+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70300ec020 con 0x7f70400b4340 2023-07-09T21:35:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.061+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f704006a830 con 0x7f70400b4340 2023-07-09T21:35:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.061+0000 7f70377fe640 1 -- 172.21.15.37:0/3972350590 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f70300ef640 con 0x7f70400b4340 2023-07-09T21:35:48.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:48.067 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:35:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 msgr2=0x7f7020068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 0x7f7020068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f704006ac30 tx=0x7f7028007e80 comp rx=0 tx=0).stop 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 msgr2=0x7f704014f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f704014f0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f70300ac000 tx=0x7f703001ac90 comp rx=0 tx=0).stop 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 shutdown_connections 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70400cef80 0x7f7040155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70400b7ab0 0x7f70400c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f70200660d0 0x7f7020068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 --2- 172.21.15.37:0/3972350590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70400b4340 0x7f704014f0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 >> 172.21.15.37:0/3972350590 conn(0x7f7040073090 msgr2=0x7f70400b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 shutdown_connections 2023-07-09T21:35:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.065+0000 7f70450cb640 1 -- 172.21.15.37:0/3972350590 wait complete. 2023-07-09T21:35:48.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:35:48.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 Processor -- start 2023-07-09T21:35:48.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 -- start start 2023-07-09T21:35:48.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18980b7ab0 0x7f189806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980b49f0 con 0x7f18980cef80 2023-07-09T21:35:48.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18980cc8a0 con 0x7f18980b4340 2023-07-09T21:35:48.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f189e40b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18980b7e80 con 0x7f18980b7ab0 2023-07-09T21:35:48.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f1897fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18980b7ab0 0x7f189806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.229+0000 7f18977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f18980cef80 0x7f18980b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42132/0 (socket says 172.21.15.37:42132) 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f18977fe640 1 -- 172.21.15.37:0/2617129857 learned_addr learned my addr 172.21.15.37:0/2617129857 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1897fff640 1 -- 172.21.15.37:0/2617129857 >> v1:172.21.15.119:6789/0 conn(0x7f18980b4340 legacy=0x7f18980d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1896ffd640 1 -- 172.21.15.37:0/2617129857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516178155 0 0) 0x7f18980b49f0 con 0x7f18980cef80 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1897fff640 1 -- 172.21.15.37:0/2617129857 >> v1:172.21.15.37:6789/0 conn(0x7f18980cef80 legacy=0x7f18980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1897fff640 1 -- 172.21.15.37:0/2617129857 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18980ccb80 con 0x7f18980b7ab0 2023-07-09T21:35:48.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1897fff640 1 --2- 172.21.15.37:0/2617129857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980b7ab0 0x7f189806aa50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18880097c0 tx=0x7f188801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be8c89c2ff27105 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1896ffd640 1 -- 172.21.15.37:0/2617129857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880ab650 con 0x7f18980b7ab0 2023-07-09T21:35:48.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1896ffd640 1 -- 172.21.15.37:0/2617129857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18880ab7b0 con 0x7f18980b7ab0 2023-07-09T21:35:48.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.233+0000 7f1896ffd640 1 -- 172.21.15.37:0/2617129857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18880abb40 con 0x7f18980b7ab0 2023-07-09T21:35:48.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- 172.21.15.37:0/2617129857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980b7ab0 msgr2=0x7f189806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 --2- 172.21.15.37:0/2617129857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980b7ab0 0x7f189806aa50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f18880097c0 tx=0x7f188801c450 comp rx=0 tx=0).stop 2023-07-09T21:35:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- 172.21.15.37:0/2617129857 shutdown_connections 2023-07-09T21:35:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 --2- 172.21.15.37:0/2617129857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980b7ab0 0x7f189806aa50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- 172.21.15.37:0/2617129857 >> 172.21.15.37:0/2617129857 conn(0x7f1898073090 msgr2=0x7f1898069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- 172.21.15.37:0/2617129857 shutdown_connections 2023-07-09T21:35:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- 172.21.15.37:0/2617129857 wait complete. 2023-07-09T21:35:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 Processor -- start 2023-07-09T21:35:48.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- start start 2023-07-09T21:35:48.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18980b4340 0x7f189814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18980b7ab0 0x7f189814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189814ef80 con 0x7f18980cef80 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189814e370 con 0x7f18980b7ab0 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189e40b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189814e650 con 0x7f18980b4340 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189c9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189c9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43410/0 (socket says 172.21.15.37:43410) 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f189c9a8640 1 -- 172.21.15.37:0/528821562 learned_addr learned my addr 172.21.15.37:0/528821562 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:48.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f1897fff640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18980b4340 0x7f189814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.237+0000 7f18977fe640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18980b7ab0 0x7f189814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 -- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18980b4340 msgr2=0x7f189814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18980b4340 0x7f189814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 -- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18980b7ab0 msgr2=0x7f189814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18980b7ab0 0x7f189814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 -- 172.21.15.37:0/528821562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1888009420 con 0x7f18980cef80 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189c9a8640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f189000c730 tx=0x7f189000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890003b80 con 0x7f18980cef80 2023-07-09T21:35:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1890003ce0 con 0x7f18980cef80 2023-07-09T21:35:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000aa30 con 0x7f18980cef80 2023-07-09T21:35:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189814e930 con 0x7f18980cef80 2023-07-09T21:35:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189814f950 con 0x7f18980cef80 2023-07-09T21:35:48.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189814f130 con 0x7f18980cef80 2023-07-09T21:35:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f189000ab90 con 0x7f18980cef80 2023-07-09T21:35:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 0x7f1884068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7f1890083f30 con 0x7f18980cef80 2023-07-09T21:35:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.241+0000 7f1897fff640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 0x7f1884068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.245+0000 7f1897fff640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 0x7f1884068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18880af000 tx=0x7f18880a7000 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.245+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f189814f130 con 0x7f18980cef80 2023-07-09T21:35:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f189804d7d0 con 0x7f18980cef80 2023-07-09T21:35:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f1894ff9640 1 -- 172.21.15.37:0/528821562 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4674 (secure 0 0 0) 0x7f1890050eb0 con 0x7f18980cef80 2023-07-09T21:35:48.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:48.441 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:23:37.576393+0000","modified":"2023-07-09T21:23:41.222270+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5361},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5361":{"gid":5361,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6834/723627337","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":723627337},{"type":"v1","addr":"172.21.15.37:6834","nonce":723627337}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-07-09T21:35:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2023-07-09T21:35:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 msgr2=0x7f1884068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 0x7f1884068880 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f18880af000 tx=0x7f18880a7000 comp rx=0 tx=0).stop 2023-07-09T21:35:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 msgr2=0x7f1898157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f189000c730 tx=0x7f189000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 shutdown_connections 2023-07-09T21:35:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18980cef80 0x7f1898157680 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18980b7ab0 0x7f189814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f18840663d0 0x7f1884068880 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 --2- 172.21.15.37:0/528821562 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18980b4340 0x7f189814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 >> 172.21.15.37:0/528821562 conn(0x7f1898073090 msgr2=0x7f18980d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 shutdown_connections 2023-07-09T21:35:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.437+0000 7f189e40b640 1 -- 172.21.15.37:0/528821562 wait complete. 2023-07-09T21:35:48.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:35:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 Processor -- start 2023-07-09T21:35:48.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 -- start start 2023-07-09T21:35:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2ec15ba20 0x7ff2ec0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2ec06c330 0x7ff2ec0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ec15bdf0 con 0x7ff2ec0b1a30 2023-07-09T21:35:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec06b650 con 0x7ff2ec06c330 2023-07-09T21:35:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f2d59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ec0b2720 con 0x7ff2ec15ba20 2023-07-09T21:35:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2ec06c330 0x7ff2ec0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2ec06c330 0x7ff2ec0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43420/0 (socket says 172.21.15.37:43420) 2023-07-09T21:35:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 -- 172.21.15.37:0/3023518211 learned_addr learned my addr 172.21.15.37:0/3023518211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2f0af5640 1 --2- 172.21.15.37:0/3023518211 >> v2:172.21.15.119:3300/0 conn(0x7ff2ec15ba20 0x7ff2ec0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 -- 172.21.15.37:0/3023518211 >> v2:172.21.15.119:3300/0 conn(0x7ff2ec15ba20 msgr2=0x7ff2ec0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 --2- 172.21.15.37:0/3023518211 >> v2:172.21.15.119:3300/0 conn(0x7ff2ec15ba20 0x7ff2ec0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 -- 172.21.15.37:0/3023518211 >> v1:172.21.15.119:6789/0 conn(0x7ff2ec0b1a30 legacy=0x7ff2ec0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.601+0000 7ff2ebfff640 1 -- 172.21.15.37:0/3023518211 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ec06b850 con 0x7ff2ec06c330 2023-07-09T21:35:48.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2ebfff640 1 --2- 172.21.15.37:0/3023518211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec0ccf00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec06d0b0 tx=0x7ff2d801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcc4657890b50ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2eb7fe640 1 -- 172.21.15.37:0/3023518211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80ac630 con 0x7ff2ec06c330 2023-07-09T21:35:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2eb7fe640 1 -- 172.21.15.37:0/3023518211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d80ac790 con 0x7ff2ec06c330 2023-07-09T21:35:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2eb7fe640 1 -- 172.21.15.37:0/3023518211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80acb20 con 0x7ff2ec06c330 2023-07-09T21:35:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 -- 172.21.15.37:0/3023518211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 msgr2=0x7ff2ec0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/3023518211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec0ccf00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec06d0b0 tx=0x7ff2d801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 -- 172.21.15.37:0/3023518211 shutdown_connections 2023-07-09T21:35:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/3023518211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec0ccf00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/3023518211 >> v2:172.21.15.119:3300/0 conn(0x7ff2ec15ba20 0x7ff2ec0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 -- 172.21.15.37:0/3023518211 >> 172.21.15.37:0/3023518211 conn(0x7ff2ec072400 msgr2=0x7ff2ec072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 -- 172.21.15.37:0/3023518211 shutdown_connections 2023-07-09T21:35:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.605+0000 7ff2f2d59640 1 -- 172.21.15.37:0/3023518211 wait complete. 2023-07-09T21:35:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 Processor -- start 2023-07-09T21:35:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- start start 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2ec0b1a30 0x7ff2ec155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec15ba20 0x7ff2ec148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec145740 con 0x7ff2ec06c330 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec156550 con 0x7ff2ec15ba20 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ec156830 con 0x7ff2ec0b1a30 2023-07-09T21:35:48.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43424/0 (socket says 172.21.15.37:43424) 2023-07-09T21:35:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 -- 172.21.15.37:0/873448055 learned_addr learned my addr 172.21.15.37:0/873448055 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f12f6640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec15ba20 0x7ff2ec148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2ebfff640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2ec0b1a30 0x7ff2ec155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 -- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2ec0b1a30 msgr2=0x7ff2ec155cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2ec0b1a30 0x7ff2ec155cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 -- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec15ba20 msgr2=0x7ff2ec148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec15ba20 0x7ff2ec148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 -- 172.21.15.37:0/873448055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094d0 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f0af5640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000d5f0 tx=0x7ff2e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e00125f0 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e0012750 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0012ae0 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ec156b10 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ec14d080 con 0x7ff2ec06c330 2023-07-09T21:35:48.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.609+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ec04d7d0 con 0x7ff2ec06c330 2023-07-09T21:35:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.613+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff2e0012c40 con 0x7ff2ec06c330 2023-07-09T21:35:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.613+0000 7ff2e97fa640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 0x7ff2d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.613+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7ff2e0084660 con 0x7ff2ec06c330 2023-07-09T21:35:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.613+0000 7ff2ebfff640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 0x7ff2d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.613+0000 7ff2ebfff640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 0x7ff2d0068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ae000 tx=0x7ff2d8008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.617+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2e0051680 con 0x7ff2ec06c330 2023-07-09T21:35:48.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.773+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2ec0afe70 con 0x7ff2ec06c330 2023-07-09T21:35:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.773+0000 7ff2e97fa640 1 -- 172.21.15.37:0/873448055 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+19836 (secure 0 0 0) 0x7ff2e0007380 con 0x7ff2ec06c330 2023-07-09T21:35:48.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:48.779 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:35:45.915256+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:23:35.367399+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-07-09T21:23:36.572999+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":235,"snap_epoch":55,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.33","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1331108823":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/2889093569":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/3050580235":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/2798932044":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/4267916423":"2023-07-10T21:23:55.550650+0000","172.21.15.119:0/1093473604":"2023-07-10T21:35:45.915222+0000","172.21.15.119:6833/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/1139343796":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6832/247577371":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/1387781828":"2023-07-10T21:23:55.550650+0000","172.21.15.119:6833/247577371":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/692103513":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/3017579858":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/1667719479":"2023-07-10T21:35:45.915222+0000","172.21.15.119:0/482562953":"2023-07-10T21:35:45.915222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":10,"length":1},{"begin":21,"length":1},{"begin":32,"length":1},{"begin":42,"length":1},{"begin":53,"length":1},{"begin":60,"length":1},{"begin":64,"length":1},{"begin":70,"length":1},{"begin":74,"length":1},{"begin":81,"length":1},{"begin":85,"length":1},{"begin":91,"length":1},{"begin":95,"length":1},{"begin":102,"length":1},{"begin":106,"length":1},{"begin":113,"length":1},{"begin":117,"length":1},{"begin":219,"length":17}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":117,"length":1},{"begin":235,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 msgr2=0x7ff2d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 0x7ff2d0068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80ae000 tx=0x7ff2d8008040 comp rx=0 tx=0).stop 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 msgr2=0x7ff2ec145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff2e000d5f0 tx=0x7ff2e000dab0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 shutdown_connections 2023-07-09T21:35:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2ec15ba20 0x7ff2ec148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7ff2d00663a0 0x7ff2d0068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2ec0b1a30 0x7ff2ec155cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 --2- 172.21.15.37:0/873448055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2ec06c330 0x7ff2ec145200 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 >> 172.21.15.37:0/873448055 conn(0x7ff2ec072400 msgr2=0x7ff2ec0c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 shutdown_connections 2023-07-09T21:35:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.777+0000 7ff2f2d59640 1 -- 172.21.15.37:0/873448055 wait complete. 2023-07-09T21:35:48.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:35:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 Processor -- start 2023-07-09T21:35:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 -- start start 2023-07-09T21:35:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab900b7a60 0x7fab900cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab900b4310 0x7fab900d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab900cef80 con 0x7fab900b47a0 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900cf260 con 0x7fab900b7a60 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab9529c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab900cf540 con 0x7fab900b4310 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab900b7a60 0x7fab900cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab900b7a60 0x7fab900cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43430/0 (socket says 172.21.15.37:43430) 2023-07-09T21:35:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 -- 172.21.15.37:0/3509882376 learned_addr learned my addr 172.21.15.37:0/3509882376 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8f7fe640 1 --2- 172.21.15.37:0/3509882376 >> v2:172.21.15.119:3300/0 conn(0x7fab900b4310 0x7fab900d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 -- 172.21.15.37:0/3509882376 >> v2:172.21.15.119:3300/0 conn(0x7fab900b4310 msgr2=0x7fab900d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 --2- 172.21.15.37:0/3509882376 >> v2:172.21.15.119:3300/0 conn(0x7fab900b4310 0x7fab900d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 -- 172.21.15.37:0/3509882376 >> v1:172.21.15.119:6789/0 conn(0x7fab900b47a0 legacy=0x7fab900b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.941+0000 7fab8effd640 1 -- 172.21.15.37:0/3509882376 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900cfdf0 con 0x7fab900b7a60 2023-07-09T21:35:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab8effd640 1 --2- 172.21.15.37:0/3509882376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b7a60 0x7fab900cc7d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab9006aed0 tx=0x7fab8001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa9962caedf349c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab8e7fc640 1 -- 172.21.15.37:0/3509882376 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800ab600 con 0x7fab900b7a60 2023-07-09T21:35:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab8e7fc640 1 -- 172.21.15.37:0/3509882376 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab800a7050 con 0x7fab900b7a60 2023-07-09T21:35:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab8e7fc640 1 -- 172.21.15.37:0/3509882376 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab800ab980 con 0x7fab900b7a60 2023-07-09T21:35:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- 172.21.15.37:0/3509882376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b7a60 msgr2=0x7fab900cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 --2- 172.21.15.37:0/3509882376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b7a60 0x7fab900cc7d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fab9006aed0 tx=0x7fab8001c500 comp rx=0 tx=0).stop 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- 172.21.15.37:0/3509882376 shutdown_connections 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 --2- 172.21.15.37:0/3509882376 >> v2:172.21.15.119:3300/0 conn(0x7fab900b4310 0x7fab900d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 --2- 172.21.15.37:0/3509882376 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b7a60 0x7fab900cc7d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- 172.21.15.37:0/3509882376 >> 172.21.15.37:0/3509882376 conn(0x7fab90073050 msgr2=0x7fab90069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- 172.21.15.37:0/3509882376 shutdown_connections 2023-07-09T21:35:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- 172.21.15.37:0/3509882376 wait complete. 2023-07-09T21:35:48.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 Processor -- start 2023-07-09T21:35:48.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.945+0000 7fab9529c640 1 -- start start 2023-07-09T21:35:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab900b4310 0x7fab90151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab900b7a60 0x7fab900c7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab90153900 con 0x7fab900b47a0 2023-07-09T21:35:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015cea0 con 0x7fab900b7a60 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9015d180 con 0x7fab900b4310 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43434/0 (socket says 172.21.15.37:43434) 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 -- 172.21.15.37:0/681466983 learned_addr learned my addr 172.21.15.37:0/681466983 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab8f7fe640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab900b7a60 0x7fab900c7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab8effd640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab900b4310 0x7fab90151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 -- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab900b4310 msgr2=0x7fab90151a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab900b4310 0x7fab90151a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 -- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab900b7a60 msgr2=0x7fab900c7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab900b7a60 0x7fab900c7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 -- 172.21.15.37:0/681466983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800094d0 con 0x7fab900b47a0 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab87fff640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c500 tx=0x7fab7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78005220 con 0x7fab900b47a0 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab78005380 con 0x7fab900b47a0 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900c7ca0 con 0x7fab900b47a0 2023-07-09T21:35:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78007270 con 0x7fab900b47a0 2023-07-09T21:35:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab900c81c0 con 0x7fab900b47a0 2023-07-09T21:35:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab900cdaa0 con 0x7fab900b47a0 2023-07-09T21:35:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.949+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab780073d0 con 0x7fab900b47a0 2023-07-09T21:35:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.953+0000 7fab877fe640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 0x7fab70068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.953+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 7080+0+0 (secure 0 0 0) 0x7fab78083a60 con 0x7fab900b47a0 2023-07-09T21:35:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.953+0000 7fab8effd640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 0x7fab70068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.953+0000 7fab8effd640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 0x7fab70068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab800ad000 tx=0x7fab80008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:48.957+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab780509f0 con 0x7fab900b47a0 2023-07-09T21:35:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.141+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fab900c7e90 con 0x7fab900b47a0 2023-07-09T21:35:49.147 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:35:49.141+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:35:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab877fe640 1 -- 172.21.15.37:0/681466983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7fab78054010 con 0x7fab900b47a0 2023-07-09T21:35:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 msgr2=0x7fab70068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 0x7fab70068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fab800ad000 tx=0x7fab80008040 comp rx=0 tx=0).stop 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 msgr2=0x7fab900c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c500 tx=0x7fab7800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 shutdown_connections 2023-07-09T21:35:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab900b7a60 0x7fab900c7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab900b47a0 0x7fab900c6ef0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab700663d0 0x7fab70068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 --2- 172.21.15.37:0/681466983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab900b4310 0x7fab90151a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 >> 172.21.15.37:0/681466983 conn(0x7fab90073050 msgr2=0x7fab900b6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 shutdown_connections 2023-07-09T21:35:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.149+0000 7fab9529c640 1 -- 172.21.15.37:0/681466983 wait complete. 2023-07-09T21:35:49.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:35:49.217 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:35:49.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.317+0000 7fc5703c5640 1 Processor -- start 2023-07-09T21:35:49.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.317+0000 7fc5703c5640 1 -- start start 2023-07-09T21:35:49.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5680b7980 0x7fc568160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680ceb80 0x7fc5680cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 0x7fc5680b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680cd070 con 0x7fc5680b7980 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5680cfd70 con 0x7fc5680b3c20 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc5703c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc56815bf80 con 0x7fc5680ceb80 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5680b7980 0x7fc568160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5680b7980 0x7fc568160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43458/0 (socket says 172.21.15.37:43458) 2023-07-09T21:35:49.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 -- 172.21.15.37:0/1678863535 learned_addr learned my addr 172.21.15.37:0/1678863535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:49.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56d960640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680ceb80 0x7fc5680cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e962640 1 --2- 172.21.15.37:0/1678863535 >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 0x7fc5680b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 -- 172.21.15.37:0/1678863535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680ceb80 msgr2=0x7fc5680cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680ceb80 0x7fc5680cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 -- 172.21.15.37:0/1678863535 >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 msgr2=0x7fc5680b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 --2- 172.21.15.37:0/1678863535 >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 0x7fc5680b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 -- 172.21.15.37:0/1678863535 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568160570 con 0x7fc5680b7980 2023-07-09T21:35:49.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e962640 1 --2- 172.21.15.37:0/1678863535 >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 0x7fc5680b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:49.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.321+0000 7fc56e161640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc568160030 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc56808ad30 tx=0x7fc56401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b1e8d80397963c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:49.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d15f640 1 -- 172.21.15.37:0/1678863535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640ab600 con 0x7fc5680b7980 2023-07-09T21:35:49.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d15f640 1 -- 172.21.15.37:0/1678863535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5640a7050 con 0x7fc5680b7980 2023-07-09T21:35:49.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d15f640 1 -- 172.21.15.37:0/1678863535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640ab980 con 0x7fc5680b7980 2023-07-09T21:35:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- 172.21.15.37:0/1678863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 msgr2=0x7fc568160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc568160030 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fc56808ad30 tx=0x7fc56401c500 comp rx=0 tx=0).stop 2023-07-09T21:35:49.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- 172.21.15.37:0/1678863535 shutdown_connections 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1678863535 >> v2:172.21.15.119:3300/0 conn(0x7fc5680b3c20 0x7fc5680b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680ceb80 0x7fc5680cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1678863535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc568160030 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- 172.21.15.37:0/1678863535 >> 172.21.15.37:0/1678863535 conn(0x7fc568073090 msgr2=0x7fc568069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- 172.21.15.37:0/1678863535 shutdown_connections 2023-07-09T21:35:49.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- 172.21.15.37:0/1678863535 wait complete. 2023-07-09T21:35:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 Processor -- start 2023-07-09T21:35:49.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- start start 2023-07-09T21:35:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680b3c20 0x7fc5681525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5680ceb80 0x7fc568155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681572d0 con 0x7fc5680b7980 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5681575b0 con 0x7fc5680ceb80 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc5703c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc568155470 con 0x7fc5680b3c20 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d960640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d960640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43460/0 (socket says 172.21.15.37:43460) 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56d960640 1 -- 172.21.15.37:0/1565760880 learned_addr learned my addr 172.21.15.37:0/1565760880 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56e962640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5680ceb80 0x7fc568155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.325+0000 7fc56e161640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680b3c20 0x7fc5681525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 -- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680b3c20 msgr2=0x7fc5681525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680b3c20 0x7fc5681525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 -- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5680ceb80 msgr2=0x7fc568155c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5680ceb80 0x7fc568155c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 -- 172.21.15.37:0/1565760880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640094d0 con 0x7fc5680b7980 2023-07-09T21:35:49.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc56d960640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc55800d800 tx=0x7fc55800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800b6c0 con 0x7fc5680b7980 2023-07-09T21:35:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55800b820 con 0x7fc5680b7980 2023-07-09T21:35:49.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55800bb90 con 0x7fc5680b7980 2023-07-09T21:35:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc568155750 con 0x7fc5680b7980 2023-07-09T21:35:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc568152ae0 con 0x7fc5680b7980 2023-07-09T21:35:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56804d7d0 con 0x7fc5680b7980 2023-07-09T21:35:49.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc55800bcf0 con 0x7fc5680b7980 2023-07-09T21:35:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 0x7fc54c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.329+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 7122+0+0 (secure 0 0 0) 0x7fc558084670 con 0x7fc5680b7980 2023-07-09T21:35:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.333+0000 7fc56e161640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 0x7fc54c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:49.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.333+0000 7fc56e161640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 0x7fc54c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ad000 tx=0x7fc564008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:49.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.333+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5580550e0 con 0x7fc5680b7980 2023-07-09T21:35:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:49.525+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc5680d30d0 con 0x7fc5680b7980 2023-07-09T21:35:50.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.153+0000 7fc55effd640 1 -- 172.21.15.37:0/1565760880 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc558054c70 con 0x7fc5680b7980 2023-07-09T21:35:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 msgr2=0x7fc54c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 0x7fc54c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc5640ad000 tx=0x7fc564008040 comp rx=0 tx=0).stop 2023-07-09T21:35:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 msgr2=0x7fc5681569d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fc55800d800 tx=0x7fc55800dcc0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 shutdown_connections 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5680ceb80 0x7fc568155c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5680b7980 0x7fc5681569d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc54c0663a0 0x7fc54c068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 --2- 172.21.15.37:0/1565760880 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5680b3c20 0x7fc5681525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 >> 172.21.15.37:0/1565760880 conn(0x7fc568073090 msgr2=0x7fc5680b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:50.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 shutdown_connections 2023-07-09T21:35:50.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.157+0000 7fc5703c5640 1 -- 172.21.15.37:0/1565760880 wait complete. 2023-07-09T21:35:50.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:35:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 Processor -- start 2023-07-09T21:35:50.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 -- start start 2023-07-09T21:35:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f22040cf290 0x7f2204160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f220415bf80 con 0x7f22040d0780 2023-07-09T21:35:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2204160570 con 0x7f22040b7980 2023-07-09T21:35:50.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f220a27b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040cd070 con 0x7f22040cf290 2023-07-09T21:35:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f2208818640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22040d0780 0x7f22040d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42152/0 (socket says 172.21.15.37:42152) 2023-07-09T21:35:50.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f2208818640 1 -- 172.21.15.37:0/4058251739 learned_addr learned my addr 172.21.15.37:0/4058251739 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f22037fe640 1 --2- 172.21.15.37:0/4058251739 >> v2:172.21.15.119:3300/0 conn(0x7f22040cf290 0x7f2204160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f2202ffd640 1 -- 172.21.15.37:0/4058251739 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2132898456 0 0) 0x7f21fc0014a0 con 0x7f22040d0780 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f2202ffd640 1 -- 172.21.15.37:0/4058251739 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21ec003530 con 0x7f22040d0780 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f22037fe640 1 -- 172.21.15.37:0/4058251739 >> v1:172.21.15.119:6789/0 conn(0x7f22040b7980 legacy=0x7f22040ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f22037fe640 1 -- 172.21.15.37:0/4058251739 >> v1:172.21.15.37:6789/0 conn(0x7f22040d0780 legacy=0x7f22040d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.369+0000 7f22037fe640 1 -- 172.21.15.37:0/4058251739 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040d02f0 con 0x7f22040cf290 2023-07-09T21:35:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f22037fe640 1 --2- 172.21.15.37:0/4058251739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040cf290 0x7f2204160030 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f21f80097c0 tx=0x7f21f801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9283974bb078438 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f2202ffd640 1 -- 172.21.15.37:0/4058251739 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f80ab600 con 0x7f22040cf290 2023-07-09T21:35:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f2202ffd640 1 -- 172.21.15.37:0/4058251739 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f80a7050 con 0x7f22040cf290 2023-07-09T21:35:50.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f2202ffd640 1 -- 172.21.15.37:0/4058251739 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f80ab980 con 0x7f22040cf290 2023-07-09T21:35:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 -- 172.21.15.37:0/4058251739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040cf290 msgr2=0x7f2204160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 --2- 172.21.15.37:0/4058251739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040cf290 0x7f2204160030 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f21f80097c0 tx=0x7f21f801c480 comp rx=0 tx=0).stop 2023-07-09T21:35:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 -- 172.21.15.37:0/4058251739 shutdown_connections 2023-07-09T21:35:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 --2- 172.21.15.37:0/4058251739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040cf290 0x7f2204160030 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 -- 172.21.15.37:0/4058251739 >> 172.21.15.37:0/4058251739 conn(0x7f2204073090 msgr2=0x7f2204069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 -- 172.21.15.37:0/4058251739 shutdown_connections 2023-07-09T21:35:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.373+0000 7f220a27b640 1 -- 172.21.15.37:0/4058251739 wait complete. 2023-07-09T21:35:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 Processor -- start 2023-07-09T21:35:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- start start 2023-07-09T21:35:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040b7980 0x7f2204151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22040cf290 0x7f22040b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22040c7330 con 0x7f22040d0780 2023-07-09T21:35:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204151bd0 con 0x7f22040b7980 2023-07-09T21:35:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22040c6620 con 0x7f22040cf290 2023-07-09T21:35:50.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43474/0 (socket says 172.21.15.37:43474) 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 -- 172.21.15.37:0/1039361362 learned_addr learned my addr 172.21.15.37:0/1039361362 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2203fff640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040b7980 0x7f2204151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f22037fe640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22040cf290 0x7f22040b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 -- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22040cf290 msgr2=0x7f22040b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22040cf290 0x7f22040b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 -- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040b7980 msgr2=0x7f2204151690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040b7980 0x7f2204151690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 -- 172.21.15.37:0/1039361362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f8009420 con 0x7f22040d0780 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2208818640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00cb10 tx=0x7f21fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc00ac70 con 0x7f22040d0780 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21fc00add0 con 0x7f22040d0780 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22040cb8b0 con 0x7f22040d0780 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21fc012620 con 0x7f22040d0780 2023-07-09T21:35:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.377+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22040c6fc0 con 0x7f22040d0780 2023-07-09T21:35:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22040c74e0 con 0x7f22040d0780 2023-07-09T21:35:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f21fc007070 con 0x7f22040d0780 2023-07-09T21:35:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f2200ff9640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 0x7f21f0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 7122+0+0 (secure 0 0 0) 0x7f21fc084130 con 0x7f22040d0780 2023-07-09T21:35:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f2203fff640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 0x7f21f0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:50.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.381+0000 7f2203fff640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 0x7f21f0068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22040cbf10 tx=0x7f21f4009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:50.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.385+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f22040c74e0 con 0x7f22040d0780 2023-07-09T21:35:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:50.541+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f22040c74e0 con 0x7f22040d0780 2023-07-09T21:35:51.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.157+0000 7f2200ff9640 1 -- 172.21.15.37:0/1039361362 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7f22040c74e0 con 0x7f22040d0780 2023-07-09T21:35:51.162 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:35:51.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 msgr2=0x7f21f0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 0x7f21f0068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f22040cbf10 tx=0x7f21f4009040 comp rx=0 tx=0).stop 2023-07-09T21:35:51.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 msgr2=0x7f22040b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00cb10 tx=0x7f21fc00a060 comp rx=0 tx=0).stop 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 shutdown_connections 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22040d0780 0x7f22040b2140 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f21f00663d0 0x7f21f0068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22040cf290 0x7f22040b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 --2- 172.21.15.37:0/1039361362 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f22040b7980 0x7f2204151690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 >> 172.21.15.37:0/1039361362 conn(0x7f2204073090 msgr2=0x7f220415ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:51.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 shutdown_connections 2023-07-09T21:35:51.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.161+0000 7f220a27b640 1 -- 172.21.15.37:0/1039361362 wait complete. 2023-07-09T21:35:51.186 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:35:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.329+0000 7f2a50ffa640 1 Processor -- start 2023-07-09T21:35:51.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.329+0000 7f2a50ffa640 1 -- start start 2023-07-09T21:35:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a50ffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a4c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a50ffa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c15bf80 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a50ffa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c160570 con 0x7f2a4c0d0780 2023-07-09T21:35:51.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a50ffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0cd070 con 0x7f2a4c0b7980 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a43fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a4c0ceb80 0x7f2a4c0cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42156/0 (socket says 172.21.15.37:42156) 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a43fff640 1 -- 172.21.15.37:0/2938408731 learned_addr learned my addr 172.21.15.37:0/2938408731 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a4c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456802565 0 0) 0x7f2a34001120 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a38003530 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2182130336 0 0) 0x7f2a38003530 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 msgr2=0x7f2a4c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a4c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 >> v1:172.21.15.119:6789/0 conn(0x7f2a4c0d0780 legacy=0x7f2a4c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c0d02f0 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2a34001810 con 0x7f2a4c0ceb80 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 >> v1:172.21.15.37:6789/0 conn(0x7f2a4c0ceb80 legacy=0x7f2a4c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a380039b0 0x7f2a38003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38004d10 0x7f2a38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0cd070 con 0x7f2a380039b0 2023-07-09T21:35:51.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3800b990 con 0x7f2a38004d10 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a3800bb20 con 0x7f2a4c0b7980 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a380039b0 0x7f2a38003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4ad9d640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38004d10 0x7f2a38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a43fff640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 -- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 msgr2=0x7f2a380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a4c0b7980 0x7f2a380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 -- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38004d10 msgr2=0x7f2a38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a38004d10 0x7f2a38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.333+0000 7f2a4a59c640 1 -- 172.21.15.37:0/2938408731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a38003530 con 0x7f2a380039b0 2023-07-09T21:35:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a380039b0 0x7f2a38003d80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009ae0 tx=0x7f2a3c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8cc6736841498f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0a5640 con 0x7f2a380039b0 2023-07-09T21:35:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0a57a0 con 0x7f2a380039b0 2023-07-09T21:35:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a49d9b640 1 -- 172.21.15.37:0/2938408731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c0a5b50 con 0x7f2a380039b0 2023-07-09T21:35:51.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- 172.21.15.37:0/2938408731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a380039b0 msgr2=0x7f2a38003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/2938408731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a380039b0 0x7f2a38003d80 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009ae0 tx=0x7f2a3c01ca50 comp rx=0 tx=0).stop 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a4ad9d640 1 -- 172.21.15.37:0/2938408731 reap_dead start 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- 172.21.15.37:0/2938408731 shutdown_connections 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- 172.21.15.37:0/2938408731 >> 172.21.15.37:0/2938408731 conn(0x7f2a4c073090 msgr2=0x7f2a4c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- 172.21.15.37:0/2938408731 shutdown_connections 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- 172.21.15.37:0/2938408731 wait complete. 2023-07-09T21:35:51.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 Processor -- start 2023-07-09T21:35:51.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.337+0000 7f2a50ffa640 1 -- start start 2023-07-09T21:35:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a380039b0 0x7f2a4c1f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 0x7f2a4c156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1f35e0 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c157580 con 0x7f2a4c15cac0 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1f2710 con 0x7f2a380039b0 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43492/0 (socket says 172.21.15.37:43492) 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 -- 172.21.15.37:0/3470967474 learned_addr learned my addr 172.21.15.37:0/3470967474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a4ad9d640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 0x7f2a4c156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a380039b0 0x7f2a4c1f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 -- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a380039b0 msgr2=0x7f2a4c1f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a380039b0 0x7f2a4c1f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 -- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 msgr2=0x7f2a4c156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 0x7f2a4c156320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 -- 172.21.15.37:0/3470967474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c154d90 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a4ad9d640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 0x7f2a4c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:51.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a43fff640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001ec0 tx=0x7f2a34007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34007e90 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3400e8f0 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3400ec80 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c1f2960 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c1f2f20 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c1f3720 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.341+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a3401d460 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.345+0000 7f2a42ffd640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 0x7f2a2c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.345+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f2a34083e20 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.345+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 0x7f2a2c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:51.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.345+0000 7f2a4a59c640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 0x7f2a2c068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0af000 tx=0x7f2a3c0046d0 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:51.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.349+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a4c1f3720 con 0x7f2a4c0c9e20 2023-07-09T21:35:51.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:51.505+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a4c15bf80 con 0x7f2a4c0c9e20 2023-07-09T21:35:52.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.169+0000 7f2a42ffd640 1 -- 172.21.15.37:0/3470967474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2a4c15bf80 con 0x7f2a4c0c9e20 2023-07-09T21:35:52.173 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:35:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 msgr2=0x7f2a2c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 0x7f2a2c068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0af000 tx=0x7f2a3c0046d0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 msgr2=0x7f2a4c154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2a34001ec0 tx=0x7f2a34007790 comp rx=0 tx=0).stop 2023-07-09T21:35:52.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 shutdown_connections 2023-07-09T21:35:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a4c15cac0 0x7f2a4c156320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a4c0c9e20 0x7f2a4c154850 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2a2c0663d0 0x7f2a2c068880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 --2- 172.21.15.37:0/3470967474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a380039b0 0x7f2a4c1f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 >> 172.21.15.37:0/3470967474 conn(0x7f2a4c073090 msgr2=0x7f2a4c15a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 shutdown_connections 2023-07-09T21:35:52.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.173+0000 7f2a50ffa640 1 -- 172.21.15.37:0/3470967474 wait complete. 2023-07-09T21:35:52.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:35:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 Processor -- start 2023-07-09T21:35:52.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 -- start start 2023-07-09T21:35:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 0x7f6a500c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500c99e0 0x7f6a500cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a500c4c90 con 0x7f6a50159990 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500ca730 con 0x7f6a500c99e0 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a58374640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a500ca170 con 0x7f6a501595c0 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500c99e0 0x7f6a500cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a500c99e0 0x7f6a500cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43506/0 (socket says 172.21.15.37:43506) 2023-07-09T21:35:52.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 -- 172.21.15.37:0/1547392161 learned_addr learned my addr 172.21.15.37:0/1547392161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56110640 1 --2- 172.21.15.37:0/1547392161 >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 0x7f6a500c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 -- 172.21.15.37:0/1547392161 >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 msgr2=0x7f6a500c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 --2- 172.21.15.37:0/1547392161 >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 0x7f6a500c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 -- 172.21.15.37:0/1547392161 >> v1:172.21.15.119:6789/0 conn(0x7f6a50159990 legacy=0x7f6a5015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56911640 1 -- 172.21.15.37:0/1547392161 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a500ca450 con 0x7f6a500c99e0 2023-07-09T21:35:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.393+0000 7f6a56110640 1 --2- 172.21.15.37:0/1547392161 >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 0x7f6a500c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:52.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a56911640 1 --2- 172.21.15.37:0/1547392161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500c99e0 0x7f6a500cd300 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006e9e0 tx=0x7f6a4801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830ad29a6ae80079 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a5510e640 1 -- 172.21.15.37:0/1547392161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a5730 con 0x7f6a500c99e0 2023-07-09T21:35:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a5510e640 1 -- 172.21.15.37:0/1547392161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a480a5890 con 0x7f6a500c99e0 2023-07-09T21:35:52.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a5510e640 1 -- 172.21.15.37:0/1547392161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a480a5c20 con 0x7f6a500c99e0 2023-07-09T21:35:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 -- 172.21.15.37:0/1547392161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500c99e0 msgr2=0x7f6a500cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 --2- 172.21.15.37:0/1547392161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500c99e0 0x7f6a500cd300 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a5006e9e0 tx=0x7f6a4801c960 comp rx=0 tx=0).stop 2023-07-09T21:35:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 -- 172.21.15.37:0/1547392161 shutdown_connections 2023-07-09T21:35:52.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 --2- 172.21.15.37:0/1547392161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a500c99e0 0x7f6a500cd300 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 --2- 172.21.15.37:0/1547392161 >> v2:172.21.15.119:3300/0 conn(0x7f6a501595c0 0x7f6a500c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 -- 172.21.15.37:0/1547392161 >> 172.21.15.37:0/1547392161 conn(0x7f6a500cde40 msgr2=0x7f6a500ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 -- 172.21.15.37:0/1547392161 shutdown_connections 2023-07-09T21:35:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.397+0000 7f6a58374640 1 -- 172.21.15.37:0/1547392161 wait complete. 2023-07-09T21:35:52.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 Processor -- start 2023-07-09T21:35:52.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- start start 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a500c99e0 0x7f6a50152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a50159990 0x7f6a50150230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5006ae20 con 0x7f6a501595c0 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a50150770 con 0x7f6a50159990 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5006b030 con 0x7f6a500c99e0 2023-07-09T21:35:52.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43518/0 (socket says 172.21.15.37:43518) 2023-07-09T21:35:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 -- 172.21.15.37:0/752639882 learned_addr learned my addr 172.21.15.37:0/752639882 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a56110640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a500c99e0 0x7f6a50152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a56911640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a50159990 0x7f6a50150230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 -- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a500c99e0 msgr2=0x7f6a50152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a500c99e0 0x7f6a50152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 -- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a50159990 msgr2=0x7f6a50150230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a50159990 0x7f6a50150230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 -- 172.21.15.37:0/752639882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48009b30 con 0x7f6a501595c0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a5590f640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c440 tx=0x7f6a4000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40012830 con 0x7f6a501595c0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a40012990 con 0x7f6a501595c0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40012d40 con 0x7f6a501595c0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a5006b310 con 0x7f6a501595c0 2023-07-09T21:35:52.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.401+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a5006b8d0 con 0x7f6a501595c0 2023-07-09T21:35:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5006baf0 con 0x7f6a501595c0 2023-07-09T21:35:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6a4001b400 con 0x7f6a501595c0 2023-07-09T21:35:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a46ffd640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 0x7f6a34068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f6a40083fe0 con 0x7f6a501595c0 2023-07-09T21:35:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a56110640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 0x7f6a34068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.405+0000 7f6a56110640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 0x7f6a34068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a50152820 tx=0x7f6a4c008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.409+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6a400513d0 con 0x7f6a501595c0 2023-07-09T21:35:52.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.561+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6a5004d7d0 con 0x7f6a501595c0 2023-07-09T21:35:52.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a46ffd640 1 -- 172.21.15.37:0/752639882 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6a400160a0 con 0x7f6a501595c0 2023-07-09T21:35:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 msgr2=0x7f6a34068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 0x7f6a34068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6a50152820 tx=0x7f6a4c008040 comp rx=0 tx=0).stop 2023-07-09T21:35:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 msgr2=0x7f6a5014fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c440 tx=0x7f6a4000c900 comp rx=0 tx=0).stop 2023-07-09T21:35:52.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 shutdown_connections 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6a50159990 0x7f6a50150230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a501595c0 0x7f6a5014fcf0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6a340663a0 0x7f6a34068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 --2- 172.21.15.37:0/752639882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6a500c99e0 0x7f6a50152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.569+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 >> 172.21.15.37:0/752639882 conn(0x7f6a500cde40 msgr2=0x7f6a5015b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.573+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 shutdown_connections 2023-07-09T21:35:52.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.573+0000 7f6a58374640 1 -- 172.21.15.37:0/752639882 wait complete. 2023-07-09T21:35:52.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:35:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 Processor -- start 2023-07-09T21:35:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 -- start start 2023-07-09T21:35:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02d00b7980 0x7f02d0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 0x7f02d00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02d015bf80 con 0x7f02d00b3c20 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00cd070 con 0x7f02d00b7980 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d6e5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02d00cfd70 con 0x7f02d00ceb80 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02d00b7980 0x7f02d0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02d00b7980 0x7f02d0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43522/0 (socket says 172.21.15.37:43522) 2023-07-09T21:35:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 -- 172.21.15.37:0/3301380294 learned_addr learned my addr 172.21.15.37:0/3301380294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 -- 172.21.15.37:0/3301380294 >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 msgr2=0x7f02d00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02cffff640 1 --2- 172.21.15.37:0/3301380294 >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 0x7f02d00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 --2- 172.21.15.37:0/3301380294 >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 0x7f02d00cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 -- 172.21.15.37:0/3301380294 >> v1:172.21.15.119:6789/0 conn(0x7f02d00b3c20 legacy=0x7f02d00b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02d4bf8640 1 -- 172.21.15.37:0/3301380294 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d0160570 con 0x7f02d00b7980 2023-07-09T21:35:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.737+0000 7f02cffff640 1 --2- 172.21.15.37:0/3301380294 >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 0x7f02d00cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:35:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d4bf8640 1 --2- 172.21.15.37:0/3301380294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00b7980 0x7f02d0160030 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f02d00b4cd0 tx=0x7f02c401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4c05e5d5023b6a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02cf7fe640 1 -- 172.21.15.37:0/3301380294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ab600 con 0x7f02d00b7980 2023-07-09T21:35:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02cf7fe640 1 -- 172.21.15.37:0/3301380294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c40a7050 con 0x7f02d00b7980 2023-07-09T21:35:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02cf7fe640 1 -- 172.21.15.37:0/3301380294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40ab980 con 0x7f02d00b7980 2023-07-09T21:35:52.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 -- 172.21.15.37:0/3301380294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00b7980 msgr2=0x7f02d0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/3301380294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00b7980 0x7f02d0160030 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f02d00b4cd0 tx=0x7f02c401c4c0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 -- 172.21.15.37:0/3301380294 shutdown_connections 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/3301380294 >> v2:172.21.15.119:3300/0 conn(0x7f02d00ceb80 0x7f02d00cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/3301380294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00b7980 0x7f02d0160030 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 -- 172.21.15.37:0/3301380294 >> 172.21.15.37:0/3301380294 conn(0x7f02d0073090 msgr2=0x7f02d0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 -- 172.21.15.37:0/3301380294 shutdown_connections 2023-07-09T21:35:52.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 -- 172.21.15.37:0/3301380294 wait complete. 2023-07-09T21:35:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.741+0000 7f02d6e5c640 1 Processor -- start 2023-07-09T21:35:52.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- start start 2023-07-09T21:35:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d00b3c20 0x7f02d0158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 0x7f02d01525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d01592f0 con 0x7f02d00ceb80 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d00cc0f0 con 0x7f02d00b3c20 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02d0153b80 con 0x7f02d00b7980 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d4bf8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d00b3c20 0x7f02d0158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43532/0 (socket says 172.21.15.37:43532) 2023-07-09T21:35:52.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 -- 172.21.15.37:0/1484686325 learned_addr learned my addr 172.21.15.37:0/1484686325 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02cffff640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 0x7f02d01525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 -- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 msgr2=0x7f02d01525c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 0x7f02d01525c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 -- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d00b3c20 msgr2=0x7f02d0158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d00b3c20 0x7f02d0158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 -- 172.21.15.37:0/1484686325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c40094d0 con 0x7f02d00ceb80 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02cffff640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 0x7f02d01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d53f9640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c7b0 tx=0x7f02c800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8004b70 con 0x7f02d00ceb80 2023-07-09T21:35:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8004cd0 con 0x7f02d00ceb80 2023-07-09T21:35:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c800aa90 con 0x7f02d00ceb80 2023-07-09T21:35:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d0152b00 con 0x7f02d00ceb80 2023-07-09T21:35:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d00cbb30 con 0x7f02d00ceb80 2023-07-09T21:35:52.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.745+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d004d7d0 con 0x7f02d00ceb80 2023-07-09T21:35:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.749+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02c800abf0 con 0x7f02d00ceb80 2023-07-09T21:35:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.749+0000 7f02cd7fa640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 0x7f02b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:52.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.749+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f02c8083f20 con 0x7f02d00ceb80 2023-07-09T21:35:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.749+0000 7f02d4bf8640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 0x7f02b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:52.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.749+0000 7f02d4bf8640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 0x7f02b4068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ad000 tx=0x7f02c4008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:52.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.753+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02c80512f0 con 0x7f02d00ceb80 2023-07-09T21:35:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.913+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f02d0153cc0 con 0x7f02d00ceb80 2023-07-09T21:35:52.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.917+0000 7f02cd7fa640 1 -- 172.21.15.37:0/1484686325 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v14) v1 ==== 120+0+0 (secure 0 0 0) 0x7f02c8054910 con 0x7f02d00ceb80 2023-07-09T21:35:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.917+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 msgr2=0x7f02b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.917+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 0x7f02b4068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f02c40ad000 tx=0x7f02c4008040 comp rx=0 tx=0).stop 2023-07-09T21:35:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.917+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 msgr2=0x7f02d00cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:52.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.917+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f02c800c7b0 tx=0x7f02c800cc70 comp rx=0 tx=0).stop 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 shutdown_connections 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d00ceb80 0x7f02d00cadf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f02b40663a0 0x7f02b4068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02d00b7980 0x7f02d01525c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 --2- 172.21.15.37:0/1484686325 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02d00b3c20 0x7f02d0158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:52.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 >> 172.21.15.37:0/1484686325 conn(0x7f02d0073090 msgr2=0x7f02d00b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:52.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 shutdown_connections 2023-07-09T21:35:52.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:52.921+0000 7f02d6e5c640 1 -- 172.21.15.37:0/1484686325 wait complete. 2023-07-09T21:35:52.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:35:53.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 Processor -- start 2023-07-09T21:35:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 -- start start 2023-07-09T21:35:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6bac0b7980 0x7f6bac160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bac0ceb80 0x7f6bac0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac15bf80 con 0x7f6bac0b3c20 2023-07-09T21:35:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac0cd070 con 0x7f6bac0ceb80 2023-07-09T21:35:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bb21c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bac0cfd70 con 0x7f6bac0b7980 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6bac0ceb80 0x7f6bac0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6babfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6bac0b3c20 0x7f6bac0b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42168/0 (socket says 172.21.15.37:42168) 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6babfff640 1 -- 172.21.15.37:0/2390984948 learned_addr learned my addr 172.21.15.37:0/2390984948 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6bab7fe640 1 --2- 172.21.15.37:0/2390984948 >> v2:172.21.15.119:3300/0 conn(0x7f6bac0b7980 0x7f6bac160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baaffd640 1 -- 172.21.15.37:0/2390984948 >> v2:172.21.15.119:3300/0 conn(0x7f6bac0b7980 msgr2=0x7f6bac160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baaffd640 1 --2- 172.21.15.37:0/2390984948 >> v2:172.21.15.119:3300/0 conn(0x7f6bac0b7980 0x7f6bac160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baaffd640 1 -- 172.21.15.37:0/2390984948 >> v1:172.21.15.37:6789/0 conn(0x7f6bac0b3c20 legacy=0x7f6bac0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baaffd640 1 -- 172.21.15.37:0/2390984948 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac160570 con 0x7f6bac0ceb80 2023-07-09T21:35:53.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.085+0000 7f6baa7fc640 1 -- 172.21.15.37:0/2390984948 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371061603 0 0) 0x7f6ba40014a0 con 0x7f6bac0b3c20 2023-07-09T21:35:53.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6baaffd640 1 --2- 172.21.15.37:0/2390984948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac0cefc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6bac069aa0 tx=0x7f6ba001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daae74907c3a35f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6baa7fc640 1 -- 172.21.15.37:0/2390984948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ab600 con 0x7f6bac0ceb80 2023-07-09T21:35:53.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6baa7fc640 1 -- 172.21.15.37:0/2390984948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba00a7050 con 0x7f6bac0ceb80 2023-07-09T21:35:53.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6baa7fc640 1 -- 172.21.15.37:0/2390984948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba00ab980 con 0x7f6bac0ceb80 2023-07-09T21:35:53.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 -- 172.21.15.37:0/2390984948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 msgr2=0x7f6bac0cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/2390984948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac0cefc0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6bac069aa0 tx=0x7f6ba001c460 comp rx=0 tx=0).stop 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 -- 172.21.15.37:0/2390984948 shutdown_connections 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/2390984948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac0cefc0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/2390984948 >> v2:172.21.15.119:3300/0 conn(0x7f6bac0b7980 0x7f6bac160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 -- 172.21.15.37:0/2390984948 >> 172.21.15.37:0/2390984948 conn(0x7f6bac073090 msgr2=0x7f6bac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 -- 172.21.15.37:0/2390984948 shutdown_connections 2023-07-09T21:35:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 -- 172.21.15.37:0/2390984948 wait complete. 2023-07-09T21:35:53.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.089+0000 7f6bb21c5640 1 Processor -- start 2023-07-09T21:35:53.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- start start 2023-07-09T21:35:53.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bac0b3c20 0x7f6bac152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 0x7f6bac152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0cbe20 con 0x7f6bac0ceb80 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0cb230 con 0x7f6bac0b7980 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac0cb480 con 0x7f6bac0b3c20 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43548/0 (socket says 172.21.15.37:43548) 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 -- 172.21.15.37:0/1043256418 learned_addr learned my addr 172.21.15.37:0/1043256418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6baaffd640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 0x7f6bac152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bab7fe640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bac0b3c20 0x7f6bac152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 -- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bac0b3c20 msgr2=0x7f6bac152500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bac0b3c20 0x7f6bac152500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 -- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 msgr2=0x7f6bac152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 0x7f6bac152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 -- 172.21.15.37:0/1043256418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0009420 con 0x7f6bac0ceb80 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6baaffd640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 0x7f6bac152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6babfff640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c7a0 tx=0x7f6ba400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400a640 con 0x7f6bac0ceb80 2023-07-09T21:35:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba400a7a0 con 0x7f6bac0ceb80 2023-07-09T21:35:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac0cb760 con 0x7f6bac0ceb80 2023-07-09T21:35:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba400ab50 con 0x7f6bac0ceb80 2023-07-09T21:35:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac1549d0 con 0x7f6bac0ceb80 2023-07-09T21:35:53.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.093+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac04d7d0 con 0x7f6bac0ceb80 2023-07-09T21:35:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.097+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ba400acb0 con 0x7f6bac0ceb80 2023-07-09T21:35:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.097+0000 7f6b93fff640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 0x7f6b98068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.097+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f6ba4083520 con 0x7f6bac0ceb80 2023-07-09T21:35:53.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.097+0000 7f6bab7fe640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 0x7f6b98068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.097+0000 7f6bab7fe640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 0x7f6b98068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0b7d70 tx=0x7f6b9c008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.101+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ba40508f0 con 0x7f6bac0ceb80 2023-07-09T21:35:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.257+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6bac15bf60 con 0x7f6bac0ceb80 2023-07-09T21:35:53.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.261+0000 7f6b93fff640 1 -- 172.21.15.37:0/1043256418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v15) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6ba4053f10 con 0x7f6bac0ceb80 2023-07-09T21:35:53.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 msgr2=0x7f6b98068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 0x7f6b98068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0b7d70 tx=0x7f6b9c008040 comp rx=0 tx=0).stop 2023-07-09T21:35:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 msgr2=0x7f6bac152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6ba400c7a0 tx=0x7f6ba400cc60 comp rx=0 tx=0).stop 2023-07-09T21:35:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 shutdown_connections 2023-07-09T21:35:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6bac0ceb80 0x7f6bac152f80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6bac0b7980 0x7f6bac152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6b980663a0 0x7f6b98068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 --2- 172.21.15.37:0/1043256418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6bac0b3c20 0x7f6bac152500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 >> 172.21.15.37:0/1043256418 conn(0x7f6bac073090 msgr2=0x7f6bac0b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 shutdown_connections 2023-07-09T21:35:53.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.265+0000 7f6bb21c5640 1 -- 172.21.15.37:0/1043256418 wait complete. 2023-07-09T21:35:53.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2023-07-09T21:35:53.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 Processor -- start 2023-07-09T21:35:53.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 -- start start 2023-07-09T21:35:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f986415fce0 0x7f98640c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98641600b0 0x7f9864163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98640cd080 con 0x7f98640c9df0 2023-07-09T21:35:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640cd920 con 0x7f986415fce0 2023-07-09T21:35:53.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.425+0000 7f986be48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640ca2f0 con 0x7f98641600b0 2023-07-09T21:35:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f986415fce0 0x7f98640c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f986415fce0 0x7f98640c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43562/0 (socket says 172.21.15.37:43562) 2023-07-09T21:35:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 -- 172.21.15.37:0/1617303203 learned_addr learned my addr 172.21.15.37:0/1617303203 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:53.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f98693e3640 1 --2- 172.21.15.37:0/1617303203 >> v2:172.21.15.119:3300/0 conn(0x7f98641600b0 0x7f9864163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 -- 172.21.15.37:0/1617303203 >> v2:172.21.15.119:3300/0 conn(0x7f98641600b0 msgr2=0x7f9864163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 --2- 172.21.15.37:0/1617303203 >> v2:172.21.15.119:3300/0 conn(0x7f98641600b0 0x7f9864163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 -- 172.21.15.37:0/1617303203 >> v1:172.21.15.119:6789/0 conn(0x7f98640c9df0 legacy=0x7f98640af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:53.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 -- 172.21.15.37:0/1617303203 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98640cd2d0 con 0x7f986415fce0 2023-07-09T21:35:53.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9869be4640 1 --2- 172.21.15.37:0/1617303203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f98640c9620 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f98640c8360 tx=0x7f986001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9437b3da5925303d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9868be2640 1 -- 172.21.15.37:0/1617303203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600ab620 con 0x7f986415fce0 2023-07-09T21:35:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9868be2640 1 -- 172.21.15.37:0/1617303203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98600ab780 con 0x7f986415fce0 2023-07-09T21:35:53.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.429+0000 7f9868be2640 1 -- 172.21.15.37:0/1617303203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98600abb10 con 0x7f986415fce0 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- 172.21.15.37:0/1617303203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 msgr2=0x7f98640c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- 172.21.15.37:0/1617303203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f98640c9620 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f98640c8360 tx=0x7f986001c400 comp rx=0 tx=0).stop 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- 172.21.15.37:0/1617303203 shutdown_connections 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- 172.21.15.37:0/1617303203 >> v2:172.21.15.119:3300/0 conn(0x7f98641600b0 0x7f9864163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- 172.21.15.37:0/1617303203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f98640c9620 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- 172.21.15.37:0/1617303203 >> 172.21.15.37:0/1617303203 conn(0x7f98640ca830 msgr2=0x7f98640cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:53.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- 172.21.15.37:0/1617303203 shutdown_connections 2023-07-09T21:35:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- 172.21.15.37:0/1617303203 wait complete. 2023-07-09T21:35:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 Processor -- start 2023-07-09T21:35:53.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- start start 2023-07-09T21:35:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 0x7f98640b3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986415f010 0x7f98640b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986415df70 con 0x7f986415fce0 2023-07-09T21:35:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986415e250 con 0x7f98640c9df0 2023-07-09T21:35:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986be48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986415e530 con 0x7f986415f010 2023-07-09T21:35:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43578/0 (socket says 172.21.15.37:43578) 2023-07-09T21:35:53.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 -- 172.21.15.37:0/413369853 learned_addr learned my addr 172.21.15.37:0/413369853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:53.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f9869be4640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 0x7f98640b3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f986a3e5640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986415f010 0x7f98640b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 -- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986415f010 msgr2=0x7f98640b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986415f010 0x7f98640b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 -- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 msgr2=0x7f98640b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 0x7f98640b3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f98693e3640 1 -- 172.21.15.37:0/413369853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98600094d0 con 0x7f986415fce0 2023-07-09T21:35:53.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.433+0000 7f9869be4640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 0x7f98640b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f98693e3640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f985400d5f0 tx=0x7f985400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98540125f0 con 0x7f986415fce0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9854012750 con 0x7f986415fce0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986415e810 con 0x7f986415fce0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854012ae0 con 0x7f986415fce0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9864156990 con 0x7f986415fce0 2023-07-09T21:35:53.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986404d7d0 con 0x7f986415fce0 2023-07-09T21:35:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9854012c40 con 0x7f986415fce0 2023-07-09T21:35:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 0x7f9848068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f9854084400 con 0x7f986415fce0 2023-07-09T21:35:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.437+0000 7f9869be4640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 0x7f9848068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:53.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.441+0000 7f9869be4640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 0x7f9848068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f98600af000 tx=0x7f98600a7000 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:53.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.441+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9854051740 con 0x7f986415fce0 2023-07-09T21:35:53.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:53.653+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) v1 -- 0x7f986406f210 con 0x7f986415fce0 2023-07-09T21:35:54.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.173+0000 7f985a7fc640 1 -- 172.21.15.37:0/413369853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v482) v1 ==== 158+0+0 (secure 0 0 0) 0x7f9854054d60 con 0x7f986415fce0 2023-07-09T21:35:54.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 msgr2=0x7f9848068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 0x7f9848068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f98600af000 tx=0x7f98600a7000 comp rx=0 tx=0).stop 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 msgr2=0x7f9864156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f985400d5f0 tx=0x7f985400dab0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 shutdown_connections 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f98480663a0 0x7f9848068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986415f010 0x7f98640b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415fce0 0x7f9864156d10 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 --2- 172.21.15.37:0/413369853 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98640c9df0 0x7f98640b3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 >> 172.21.15.37:0/413369853 conn(0x7f98640ca830 msgr2=0x7f986415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 shutdown_connections 2023-07-09T21:35:54.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.177+0000 7f986be48640 1 -- 172.21.15.37:0/413369853 wait complete. 2023-07-09T21:35:54.201 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2023-07-09T21:35:54.201 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2023-07-09T21:35:54.201 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:35:54.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-09T21:35:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 Processor -- start 2023-07-09T21:35:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 -- start start 2023-07-09T21:35:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d380b4340 0x7f8d3806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380b49f0 con 0x7f8d380cef80 2023-07-09T21:35:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d380cc8a0 con 0x7f8d380b7ab0 2023-07-09T21:35:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d3d819640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d380b7e80 con 0x7f8d380b4340 2023-07-09T21:35:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d380b4340 0x7f8d3806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d380b4340 0x7f8d3806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43586/0 (socket says 172.21.15.37:43586) 2023-07-09T21:35:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d377fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8d380cef80 0x7f8d380d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42180/0 (socket says 172.21.15.37:42180) 2023-07-09T21:35:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 -- 172.21.15.37:0/1822361246 learned_addr learned my addr 172.21.15.37:0/1822361246 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 -- 172.21.15.37:0/1822361246 >> v1:172.21.15.119:6789/0 conn(0x7f8d380b7ab0 legacy=0x7f8d380b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 -- 172.21.15.37:0/1822361246 >> v1:172.21.15.37:6789/0 conn(0x7f8d380cef80 legacy=0x7f8d380d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.345+0000 7f8d2ffff640 1 -- 172.21.15.37:0/1822361246 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d380ccb80 con 0x7f8d380b4340 2023-07-09T21:35:54.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d2ffff640 1 --2- 172.21.15.37:0/1822361246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380b4340 0x7f8d3806aa50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009870 tx=0x7f8d2801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c4c3e24520f3c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:54.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d367fc640 1 -- 172.21.15.37:0/1822361246 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280aa430 con 0x7f8d380b4340 2023-07-09T21:35:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d367fc640 1 -- 172.21.15.37:0/1822361246 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d280aa590 con 0x7f8d380b4340 2023-07-09T21:35:54.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d367fc640 1 -- 172.21.15.37:0/1822361246 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d280aa920 con 0x7f8d380b4340 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 -- 172.21.15.37:0/1822361246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380b4340 msgr2=0x7f8d3806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1822361246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380b4340 0x7f8d3806aa50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f8d28009870 tx=0x7f8d2801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 -- 172.21.15.37:0/1822361246 shutdown_connections 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1822361246 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380b4340 0x7f8d3806aa50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 -- 172.21.15.37:0/1822361246 >> 172.21.15.37:0/1822361246 conn(0x7f8d38073090 msgr2=0x7f8d38069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:54.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 -- 172.21.15.37:0/1822361246 shutdown_connections 2023-07-09T21:35:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 -- 172.21.15.37:0/1822361246 wait complete. 2023-07-09T21:35:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.349+0000 7f8d3d819640 1 Processor -- start 2023-07-09T21:35:54.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- start start 2023-07-09T21:35:54.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 0x7f8d3814aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:54.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 0x7f8d38155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d381551f0 con 0x7f8d380cef80 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3814ebc0 con 0x7f8d380b7ab0 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3814eea0 con 0x7f8d380b4340 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43592/0 (socket says 172.21.15.37:43592) 2023-07-09T21:35:54.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 -- 172.21.15.37:0/1420658355 learned_addr learned my addr 172.21.15.37:0/1420658355 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d36ffd640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 0x7f8d3814aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d2ffff640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 0x7f8d38155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 -- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 msgr2=0x7f8d3814aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 0x7f8d3814aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 -- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 msgr2=0x7f8d38155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 0x7f8d38155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 -- 172.21.15.37:0/1420658355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d280094d0 con 0x7f8d380cef80 2023-07-09T21:35:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d2ffff640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 0x7f8d38155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:54.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d36ffd640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 0x7f8d3814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d377fe640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c6c0 tx=0x7f8d3000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d30004d70 con 0x7f8d380cef80 2023-07-09T21:35:54.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3000a640 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3000a9f0 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d38154e80 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d38155bc0 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.353+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d38154ce0 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.357+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d3000ab50 con 0x7f8d380cef80 2023-07-09T21:35:54.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.357+0000 7f8d34ff9640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 0x7f8d18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.357+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f8d30083140 con 0x7f8d380cef80 2023-07-09T21:35:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.357+0000 7f8d36ffd640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 0x7f8d18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:54.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.357+0000 7f8d36ffd640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 0x7f8d18068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d20003ec0 tx=0x7f8d20009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:54.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.361+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d38154ce0 con 0x7f8d380cef80 2023-07-09T21:35:54.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:54.581+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f8d38154ce0 con 0x7f8d380cef80 2023-07-09T21:35:55.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.173+0000 7f8d34ff9640 1 -- 172.21.15.37:0/1420658355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v483) v1 ==== 157+0+0 (secure 0 0 0) 0x7f8d38154ce0 con 0x7f8d380cef80 2023-07-09T21:35:55.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 msgr2=0x7f8d18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 0x7f8d18068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8d20003ec0 tx=0x7f8d20009040 comp rx=0 tx=0).stop 2023-07-09T21:35:55.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 msgr2=0x7f8d3814e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000c6c0 tx=0x7f8d3000cb80 comp rx=0 tx=0).stop 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 shutdown_connections 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d380cef80 0x7f8d3814e1e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d380b7ab0 0x7f8d38155680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f8d180663a0 0x7f8d18068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 --2- 172.21.15.37:0/1420658355 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d380b4340 0x7f8d3814aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 >> 172.21.15.37:0/1420658355 conn(0x7f8d38073090 msgr2=0x7f8d38157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 shutdown_connections 2023-07-09T21:35:55.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.177+0000 7f8d3d819640 1 -- 172.21.15.37:0/1420658355 wait complete. 2023-07-09T21:35:55.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:35:55.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 Processor -- start 2023-07-09T21:35:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 -- start start 2023-07-09T21:35:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0dc0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc015bf80 con 0x7f0dc00b7980 2023-07-09T21:35:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc0160570 con 0x7f0dc00d0780 2023-07-09T21:35:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dc5f00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cd070 con 0x7f0dc00cf290 2023-07-09T21:35:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbf7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0dc00b7980 0x7f0dc00ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42194/0 (socket says 172.21.15.37:42194) 2023-07-09T21:35:55.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbf7fe640 1 -- 172.21.15.37:0/1444664991 learned_addr learned my addr 172.21.15.37:0/1444664991 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0dc0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355776025 0 0) 0x7f0db0001120 con 0x7f0dc00b7980 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da8003530 con 0x7f0dc00b7980 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1923184939 0 0) 0x7f0da8003530 con 0x7f0dc00b7980 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 msgr2=0x7f0dc0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0dc0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 >> v1:172.21.15.119:6789/0 conn(0x7f0dc00d0780 legacy=0x7f0dc00d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00d02f0 con 0x7f0dc00b7980 2023-07-09T21:35:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f0db0001810 con 0x7f0dc00b7980 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 >> v1:172.21.15.37:6789/0 conn(0x7f0dc00b7980 legacy=0x7f0dc00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0da80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0da80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da8004d10 0x7f0da8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00cd070 con 0x7f0da8003f30 2023-07-09T21:35:55.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da800ba70 con 0x7f0da8004d10 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da800bc30 con 0x7f0dc00cf290 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0da80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbf7fe640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0da80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbffff640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da8004d10 0x7f0da8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 -- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 msgr2=0x7f0da80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00cf290 0x7f0da80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 -- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da8004d10 msgr2=0x7f0da8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da8004d10 0x7f0da8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbeffd640 1 -- 172.21.15.37:0/1444664991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da8003530 con 0x7f0da8003f30 2023-07-09T21:35:55.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.349+0000 7f0dbffff640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0da8004d10 0x7f0da8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0da80047d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ab0 tx=0x7f0db401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e6fa37f0d0adfc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40a5510 con 0x7f0da8003f30 2023-07-09T21:35:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db40a5670 con 0x7f0da8003f30 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dbe7fc640 1 -- 172.21.15.37:0/1444664991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db40a5a20 con 0x7f0da8003f30 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 -- 172.21.15.37:0/1444664991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 msgr2=0x7f0da80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/1444664991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0da80047d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009ab0 tx=0x7f0db401ca30 comp rx=0 tx=0).stop 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dbffff640 1 -- 172.21.15.37:0/1444664991 reap_dead start 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 -- 172.21.15.37:0/1444664991 shutdown_connections 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 -- 172.21.15.37:0/1444664991 >> 172.21.15.37:0/1444664991 conn(0x7f0dc0073090 msgr2=0x7f0dc0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 -- 172.21.15.37:0/1444664991 shutdown_connections 2023-07-09T21:35:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.353+0000 7f0dc5f00640 1 -- 172.21.15.37:0/1444664991 wait complete. 2023-07-09T21:35:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 Processor -- start 2023-07-09T21:35:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- start start 2023-07-09T21:35:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc00ca310 0x7f0dc00ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00b42d0 0x7f0dc00b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b3eb0 con 0x7f0da8003f30 2023-07-09T21:35:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b3230 con 0x7f0dc00ca310 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00b3510 con 0x7f0dc00b42d0 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43608/0 (socket says 172.21.15.37:43608) 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 -- 172.21.15.37:0/880393717 learned_addr learned my addr 172.21.15.37:0/880393717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbffff640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00b42d0 0x7f0dc00b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc00ca310 0x7f0dc00ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 -- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00b42d0 msgr2=0x7f0dc00b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00b42d0 0x7f0dc00b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 -- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc00ca310 msgr2=0x7f0dc00ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc00ca310 0x7f0dc00ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 -- 172.21.15.37:0/880393717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00b37f0 con 0x7f0da8003f30 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dbf7fe640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0db0001e30 tx=0x7f0db00129a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0014750 con 0x7f0da8003f30 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db00148b0 con 0x7f0da8003f30 2023-07-09T21:35:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc00b3ad0 con 0x7f0da8003f30 2023-07-09T21:35:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0014c20 con 0x7f0da8003f30 2023-07-09T21:35:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.357+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00cece0 con 0x7f0da8003f30 2023-07-09T21:35:55.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc00b3ff0 con 0x7f0da8003f30 2023-07-09T21:35:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0db00153e0 con 0x7f0da8003f30 2023-07-09T21:35:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0da7fff640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 0x7f0dac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7f0db00868b0 con 0x7f0da8003f30 2023-07-09T21:35:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 0x7f0dac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.361+0000 7f0dbeffd640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 0x7f0dac068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0db40af000 tx=0x7f0db40046d0 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.365+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0dc00b3ff0 con 0x7f0da8003f30 2023-07-09T21:35:55.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.521+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0dc015bf80 con 0x7f0da8003f30 2023-07-09T21:35:55.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.525+0000 7f0da7fff640 1 -- 172.21.15.37:0/880393717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0dc015bf80 con 0x7f0da8003f30 2023-07-09T21:35:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 msgr2=0x7f0dac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 0x7f0dac068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0db40af000 tx=0x7f0db40046d0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 msgr2=0x7f0dc00b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f0db0001e30 tx=0x7f0db00129a0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 shutdown_connections 2023-07-09T21:35:55.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0dac0663d0 0x7f0dac068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0dc00b42d0 0x7f0dc00b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0dc00ca310 0x7f0dc00ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 --2- 172.21.15.37:0/880393717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0da8003f30 0x7f0dc00b2c50 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 >> 172.21.15.37:0/880393717 conn(0x7f0dc0073090 msgr2=0x7f0dc015e910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 shutdown_connections 2023-07-09T21:35:55.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.529+0000 7f0dc5f00640 1 -- 172.21.15.37:0/880393717 wait complete. 2023-07-09T21:35:55.551 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:35:55.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:35:55.605 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:35:55.660 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:35:55.661 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:35:55.661 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:55.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:35:55.670 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:35:55.670 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:55.679 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:35:55.680 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:35:55.680 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:55.718 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:35:55.719 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:35:55.719 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:35:55.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:35:55.729 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:35:55.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:35:55.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 Processor -- start 2023-07-09T21:35:55.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 -- start start 2023-07-09T21:35:55.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400b49f0 con 0x7fdb400b7ab0 2023-07-09T21:35:55.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb400b7e80 con 0x7fdb400cef80 2023-07-09T21:35:55.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb4512c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400cc8a0 con 0x7fdb400b4340 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb3f59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb3f59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55600/0 (socket says 172.21.15.37:55600) 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb3f59e640 1 -- 172.21.15.37:0/3435020792 learned_addr learned my addr 172.21.15.37:0/3435020792 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40144/0 (socket says 172.21.15.37:40144) 2023-07-09T21:35:55.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb3ed9d640 1 --1- 172.21.15.37:0/3435020792 >> v1:172.21.15.119:6789/0 conn(0x7fdb400b7ab0 0x7fdb400b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:37574/0 (socket says 172.21.15.37:37574) 2023-07-09T21:35:55.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 -- 172.21.15.37:0/3435020792 >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 msgr2=0x7fdb400d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:55.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 --2- 172.21.15.37:0/3435020792 >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 -- 172.21.15.37:0/3435020792 >> v1:172.21.15.119:6789/0 conn(0x7fdb400b7ab0 legacy=0x7fdb400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb37fff640 1 -- 172.21.15.37:0/3435020792 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400ccb80 con 0x7fdb400b4340 2023-07-09T21:35:55.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.897+0000 7fdb3f59e640 1 --2- 172.21.15.37:0/3435020792 >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:55.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb37fff640 1 --2- 172.21.15.37:0/3435020792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb280097c0 tx=0x7fdb2801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc24b2d5aa2c85a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb3e59c640 1 -- 172.21.15.37:0/3435020792 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280ab650 con 0x7fdb400b4340 2023-07-09T21:35:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb3e59c640 1 -- 172.21.15.37:0/3435020792 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb280ab7b0 con 0x7fdb400b4340 2023-07-09T21:35:55.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb3e59c640 1 -- 172.21.15.37:0/3435020792 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb280abb40 con 0x7fdb400b4340 2023-07-09T21:35:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 -- 172.21.15.37:0/3435020792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 msgr2=0x7fdb4006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3435020792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb280097c0 tx=0x7fdb2801c450 comp rx=0 tx=0).stop 2023-07-09T21:35:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 -- 172.21.15.37:0/3435020792 shutdown_connections 2023-07-09T21:35:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3435020792 >> v2:172.21.15.119:3300/0 conn(0x7fdb400cef80 0x7fdb400d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3435020792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b4340 0x7fdb4006aa50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 -- 172.21.15.37:0/3435020792 >> 172.21.15.37:0/3435020792 conn(0x7fdb40073090 msgr2=0x7fdb40069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 -- 172.21.15.37:0/3435020792 shutdown_connections 2023-07-09T21:35:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.901+0000 7fdb4512c640 1 -- 172.21.15.37:0/3435020792 wait complete. 2023-07-09T21:35:55.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 Processor -- start 2023-07-09T21:35:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- start start 2023-07-09T21:35:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb400b4340 0x7fdb4014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 0x7fdb400b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4014f090 con 0x7fdb400cef80 2023-07-09T21:35:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c9bd0 con 0x7fdb400b4340 2023-07-09T21:35:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400c81f0 con 0x7fdb400b7ab0 2023-07-09T21:35:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43614/0 (socket says 172.21.15.37:43614) 2023-07-09T21:35:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 -- 172.21.15.37:0/3036530492 learned_addr learned my addr 172.21.15.37:0/3036530492 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:55.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb37fff640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 0x7fdb400b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3ed9d640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb400b4340 0x7fdb4014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 -- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 msgr2=0x7fdb400b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 0x7fdb400b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 -- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb400b4340 msgr2=0x7fdb4014eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb400b4340 0x7fdb4014eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 -- 172.21.15.37:0/3036530492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb38009b30 con 0x7fdb400cef80 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb37fff640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 0x7fdb400b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb3f59e640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800ef90 tx=0x7fdb3800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38018070 con 0x7fdb400cef80 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800f040 con 0x7fdb400cef80 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3800ce20 con 0x7fdb400cef80 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb28009420 con 0x7fdb400cef80 2023-07-09T21:35:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.905+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400c78c0 con 0x7fdb400cef80 2023-07-09T21:35:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.909+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb400c9d40 con 0x7fdb400cef80 2023-07-09T21:35:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.909+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdb38014480 con 0x7fdb400cef80 2023-07-09T21:35:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.909+0000 7fdb377fe640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 0x7fdb20068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.909+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fdb38084150 con 0x7fdb400cef80 2023-07-09T21:35:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.909+0000 7fdb3ed9d640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 0x7fdb20068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.913+0000 7fdb3ed9d640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 0x7fdb20068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb30000f70 tx=0x7fdb30007c90 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:55.913+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb380514b0 con 0x7fdb400cef80 2023-07-09T21:35:56.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb4004d7d0 con 0x7fdb400cef80 2023-07-09T21:35:56.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb377fe640 1 -- 172.21.15.37:0/3036530492 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fdb38054ad0 con 0x7fdb400cef80 2023-07-09T21:35:56.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:56.105 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4934,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2726662639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2726662639},{"type":"v1","addr":"172.21.15.37:6835","nonce":2726662639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4937,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3646266827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3646266827},{"type":"v1","addr":"172.21.15.119:6837","nonce":3646266827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5164,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/4008085392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":4008085392},{"type":"v1","addr":"172.21.15.119:6835","nonce":4008085392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":6183,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/2401965025","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2401965025},{"type":"v1","addr":"172.21.15.37:6834","nonce":2401965025}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2023-07-09T21:35:56.105 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2023-07-09T21:35:56.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 msgr2=0x7fdb20068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 0x7fdb20068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb30000f70 tx=0x7fdb30007c90 comp rx=0 tx=0).stop 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 msgr2=0x7fdb400b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800ef90 tx=0x7fdb3800c490 comp rx=0 tx=0).stop 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 shutdown_connections 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb400cef80 0x7fdb400b6570 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fdb200663a0 0x7fdb20068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb400b7ab0 0x7fdb400b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 --2- 172.21.15.37:0/3036530492 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb400b4340 0x7fdb4014eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 >> 172.21.15.37:0/3036530492 conn(0x7fdb40073090 msgr2=0x7fdb40069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 shutdown_connections 2023-07-09T21:35:56.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.101+0000 7fdb4512c640 1 -- 172.21.15.37:0/3036530492 wait complete. 2023-07-09T21:35:56.126 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:35:56.126 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:35:56.126 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:35:56.127 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:35:56.127 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:35:56.127 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:35:56.127 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:35:56.128 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:35:56.128 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:35:56.128 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:35:56.128 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:35:56.128 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:35:56.129 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:35:56.129 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:35:56.129 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:35:56.129 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:35:56.139 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:35:56.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:35:56.141 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:35:56.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:35:56.144 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:35:56.145 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:35:56.145 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:35:56.146 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:35:56.188 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:35:56.188 DEBUG:teuthology.parallel:result is None 2023-07-09T21:35:56.189 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:35:56.190 DEBUG:teuthology.parallel:result is None 2023-07-09T21:35:56.190 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:35:56.191 DEBUG:teuthology.parallel:result is None 2023-07-09T21:35:56.191 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:35:56.191 DEBUG:teuthology.parallel:result is None 2023-07-09T21:35:56.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:35:56.277 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:35:56.279 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:35:56.280 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:35:56.281 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:35:56.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 Processor -- start 2023-07-09T21:35:56.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 -- start start 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5c80b7a60 0x7fc5c80cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c80b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c80cef80 con 0x7fc5c80b4140 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c80b45b0 con 0x7fc5c80b7a60 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cf339640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80cf260 con 0x7fc5c80b47a0 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd8d6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5c80b4140 0x7fc5c815f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42200/0 (socket says 172.21.15.37:42200) 2023-07-09T21:35:56.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd8d6640 1 -- 172.21.15.37:0/432706584 learned_addr learned my addr 172.21.15.37:0/432706584 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cc8d4640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c80b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/432706584 >> v2:172.21.15.119:3300/0 conn(0x7fc5c80b7a60 0x7fc5c80cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd0d5640 1 -- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 msgr2=0x7fc5c80b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5bffff640 1 -- 172.21.15.37:0/432706584 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573281948 0 0) 0x7fc5c80cef80 con 0x7fc5c80b4140 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c80b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd0d5640 1 -- 172.21.15.37:0/432706584 >> v1:172.21.15.37:6789/0 conn(0x7fc5c80b4140 legacy=0x7fc5c815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.337+0000 7fc5cd0d5640 1 -- 172.21.15.37:0/432706584 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80cf540 con 0x7fc5c80b7a60 2023-07-09T21:35:56.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b7a60 0x7fc5c80cc7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40097c0 tx=0x7fc5c401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=771a8a26825f650b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5bffff640 1 -- 172.21.15.37:0/432706584 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40ab600 con 0x7fc5c80b7a60 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5bffff640 1 -- 172.21.15.37:0/432706584 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c40a7050 con 0x7fc5c80b7a60 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5bffff640 1 -- 172.21.15.37:0/432706584 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c40ab980 con 0x7fc5c80b7a60 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 -- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b7a60 msgr2=0x7fc5c80cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b7a60 0x7fc5c80cc7d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40097c0 tx=0x7fc5c401c480 comp rx=0 tx=0).stop 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 -- 172.21.15.37:0/432706584 shutdown_connections 2023-07-09T21:35:56.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c80b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 --2- 172.21.15.37:0/432706584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b7a60 0x7fc5c80cc7d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 -- 172.21.15.37:0/432706584 >> 172.21.15.37:0/432706584 conn(0x7fc5c8073050 msgr2=0x7fc5c8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 -- 172.21.15.37:0/432706584 shutdown_connections 2023-07-09T21:35:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.341+0000 7fc5cf339640 1 -- 172.21.15.37:0/432706584 wait complete. 2023-07-09T21:35:56.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 Processor -- start 2023-07-09T21:35:56.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- start start 2023-07-09T21:35:56.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-07-09T21:35:56.348 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-09T21:35:56.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b4140 0x7fc5c815b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b1e30 con 0x7fc5c80b7a60 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c8153fd0 con 0x7fc5c80b4140 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b1ae0 con 0x7fc5c80b47a0 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43666/0 (socket says 172.21.15.37:43666) 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 -- 172.21.15.37:0/3799832802 learned_addr learned my addr 172.21.15.37:0/3799832802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cc8d4640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b4140 0x7fc5c815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 -- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 msgr2=0x7fc5c81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 -- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b4140 msgr2=0x7fc5c815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b4140 0x7fc5c815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 -- 172.21.15.37:0/3799832802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c4009420 con 0x7fc5c80b7a60 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cd8d6640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c750 tx=0x7fc5c000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000ce60 con 0x7fc5c80b7a60 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c000a640 con 0x7fc5c80b7a60 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c000a9b0 con 0x7fc5c80b7a60 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c81532d0 con 0x7fc5c80b7a60 2023-07-09T21:35:56.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c8153890 con 0x7fc5c80b7a60 2023-07-09T21:35:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.345+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c80cdaa0 con 0x7fc5c80b7a60 2023-07-09T21:35:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.349+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc5c000ab10 con 0x7fc5c80b7a60 2023-07-09T21:35:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.349+0000 7fc5bdffb640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 0x7fc5ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.349+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5941+0+0 (secure 0 0 0) 0x7fc5c0083360 con 0x7fc5c80b7a60 2023-07-09T21:35:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.349+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 0x7fc5ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.349+0000 7fc5cd0d5640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 0x7fc5ac068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40ad000 tx=0x7fc5c4008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.353+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc5c00506a0 con 0x7fc5c80b7a60 2023-07-09T21:35:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:56.521+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc5c80b1f70 con 0x7fc5c80b7a60 2023-07-09T21:35:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5bdffb640 1 -- 172.21.15.37:0/3799832802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc5c80b1f70 con 0x7fc5c80b7a60 2023-07-09T21:35:57.560 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:35:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 msgr2=0x7fc5ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 0x7fc5ac068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc5c40ad000 tx=0x7fc5c4008040 comp rx=0 tx=0).stop 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 msgr2=0x7fc5c8152c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc5c000c750 tx=0x7fc5c000cc10 comp rx=0 tx=0).stop 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 shutdown_connections 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5c80b7a60 0x7fc5c8152c00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc5ac0663a0 0x7fc5ac068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5c80b47a0 0x7fc5c81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 --2- 172.21.15.37:0/3799832802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5c80b4140 0x7fc5c815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 >> 172.21.15.37:0/3799832802 conn(0x7fc5c8073050 msgr2=0x7fc5c815f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 shutdown_connections 2023-07-09T21:35:57.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.557+0000 7fc5cf339640 1 -- 172.21.15.37:0/3799832802 wait complete. 2023-07-09T21:35:57.587 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:35:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.729+0000 7fe9db47b640 1 Processor -- start 2023-07-09T21:35:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.729+0000 7fe9db47b640 1 -- start start 2023-07-09T21:35:57.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9db47b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9d415fce0 0x7fe9d40c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9db47b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 0x7fe9d4163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9db47b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d40cd080 con 0x7fe9d40c9df0 2023-07-09T21:35:57.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9db47b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40cd920 con 0x7fe9d415fce0 2023-07-09T21:35:57.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9db47b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40ca2f0 con 0x7fe9d41600b0 2023-07-09T21:35:57.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d8a16640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 0x7fe9d4163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9217640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9d415fce0 0x7fe9d40c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9a18640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe9d40c9df0 0x7fe9d40af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:52180/0 (socket says 172.21.15.37:52180) 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9a18640 1 -- 172.21.15.37:0/3290945888 learned_addr learned my addr 172.21.15.37:0/3290945888 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9217640 1 -- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 msgr2=0x7fe9d4163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9217640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 0x7fe9d4163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9217640 1 -- 172.21.15.37:0/3290945888 >> v1:172.21.15.119:6789/0 conn(0x7fe9d40c9df0 legacy=0x7fe9d40af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d9217640 1 -- 172.21.15.37:0/3290945888 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d40cd2d0 con 0x7fe9d415fce0 2023-07-09T21:35:57.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.733+0000 7fe9d8a16640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 0x7fe9d4163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9d9217640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d40c9620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00097c0 tx=0x7fe9d001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b4d3478c62c282b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:57.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9cbfff640 1 -- 172.21.15.37:0/3290945888 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00ac640 con 0x7fe9d415fce0 2023-07-09T21:35:57.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9cbfff640 1 -- 172.21.15.37:0/3290945888 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d00ac7a0 con 0x7fe9d415fce0 2023-07-09T21:35:57.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9cbfff640 1 -- 172.21.15.37:0/3290945888 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00acb30 con 0x7fe9d415fce0 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 msgr2=0x7fe9d40c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d40c9620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00097c0 tx=0x7fe9d001c3c0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- 172.21.15.37:0/3290945888 shutdown_connections 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d41600b0 0x7fe9d4163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 --2- 172.21.15.37:0/3290945888 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d40c9620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- 172.21.15.37:0/3290945888 >> 172.21.15.37:0/3290945888 conn(0x7fe9d40ca830 msgr2=0x7fe9d40cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- 172.21.15.37:0/3290945888 shutdown_connections 2023-07-09T21:35:57.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- 172.21.15.37:0/3290945888 wait complete. 2023-07-09T21:35:57.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 Processor -- start 2023-07-09T21:35:57.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.737+0000 7fe9db47b640 1 -- start start 2023-07-09T21:35:57.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d415e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d4151ff0 0x7fe9d41502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d415de30 con 0x7fe9d40c9df0 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d4150810 con 0x7fe9d415fce0 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d415db50 con 0x7fe9d4151ff0 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33280/0 (socket says 172.21.15.37:33280) 2023-07-09T21:35:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 -- 172.21.15.37:0/1111213467 learned_addr learned my addr 172.21.15.37:0/1111213467 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:57.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9a18640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d4151ff0 0x7fe9d41502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d8a16640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d415e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 -- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d4151ff0 msgr2=0x7fe9d41502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d4151ff0 0x7fe9d41502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 -- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 msgr2=0x7fe9d415e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d415e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 -- 172.21.15.37:0/1111213467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009420 con 0x7fe9d40c9df0 2023-07-09T21:35:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9d9217640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0018fd0 tx=0x7fe9d0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00b5600 con 0x7fe9d40c9df0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d00b5760 con 0x7fe9d40c9df0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00b5b10 con 0x7fe9d40c9df0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d0009420 con 0x7fe9d40c9df0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d415ec50 con 0x7fe9d40c9df0 2023-07-09T21:35:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d404d7d0 con 0x7fe9d40c9df0 2023-07-09T21:35:57.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.741+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9d00b3040 con 0x7fe9d40c9df0 2023-07-09T21:35:57.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.745+0000 7fe9c9ffb640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 0x7fe9b8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:57.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.745+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe9d011db00 con 0x7fe9d40c9df0 2023-07-09T21:35:57.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.745+0000 7fe9d8a16640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 0x7fe9b8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:57.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.745+0000 7fe9d8a16640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 0x7fe9b8068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4158440 tx=0x7fe9c4008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:57.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.749+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9d011fe60 con 0x7fe9d40c9df0 2023-07-09T21:35:57.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe9d4157420 con 0x7fe9d40c9df0 2023-07-09T21:35:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9c9ffb640 1 -- 172.21.15.37:0/1111213467 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe9d00b1090 con 0x7fe9d40c9df0 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:35:57.961 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:35:57.963 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.964 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:35:57.965 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.966 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.968 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:35:57.970 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.972 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.972 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:35:57.972 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:35:57.972 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.973 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.974 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.976 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:35:57.977 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.978 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:35:57.979 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.980 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:35:57.981 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:35:57.981 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:35:57.981 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.981 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.981 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.982 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:35:57.982 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:35:57.982 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.983 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:35:57.983 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:35:57.983 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:35:57.983 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:35:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.984 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:35:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:35:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:35:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:35:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:35:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:35:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:57.988 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:57.989 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:35:57.990 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:35:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 msgr2=0x7fe9b8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 0x7fe9b8068880 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4158440 tx=0x7fe9c4008040 comp rx=0 tx=0).stop 2023-07-09T21:35:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 msgr2=0x7fe9d4157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe9d0018fd0 tx=0x7fe9d0019160 comp rx=0 tx=0).stop 2023-07-09T21:35:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 shutdown_connections 2023-07-09T21:35:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe9b80663d0 0x7fe9b8068880 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9d4151ff0 0x7fe9d41502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9d415fce0 0x7fe9d415e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 --2- 172.21.15.37:0/1111213467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9d40c9df0 0x7fe9d4157800 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 >> 172.21.15.37:0/1111213467 conn(0x7fe9d40ca830 msgr2=0x7fe9d406bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 shutdown_connections 2023-07-09T21:35:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:57.957+0000 7fe9db47b640 1 -- 172.21.15.37:0/1111213467 wait complete. 2023-07-09T21:35:57.993 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:35:58.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 Processor -- start 2023-07-09T21:35:58.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 -- start start 2023-07-09T21:35:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9080cef80 0x7fe90806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080b49f0 con 0x7fe9080b4340 2023-07-09T21:35:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080cc8a0 con 0x7fe9080b7ab0 2023-07-09T21:35:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90fe48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080b7e80 con 0x7fe9080cef80 2023-07-09T21:35:58.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90d3e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9080b4340 0x7fe9080d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33852/0 (socket says 172.21.15.37:33852) 2023-07-09T21:35:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90d3e3640 1 -- 172.21.15.37:0/4009417511 learned_addr learned my addr 172.21.15.37:0/4009417511 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:35:58.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90e3e5640 1 --2- 172.21.15.37:0/4009417511 >> v2:172.21.15.119:3300/0 conn(0x7fe9080cef80 0x7fe90806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69448611 0 0) 0x7fe9080b49f0 con 0x7fe9080b4340 2023-07-09T21:35:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f4003530 con 0x7fe9080b4340 2023-07-09T21:35:58.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231706639 0 0) 0x7fe9080cc8a0 con 0x7fe9080b7ab0 2023-07-09T21:35:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.133+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9080b49f0 con 0x7fe9080b7ab0 2023-07-09T21:35:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90e3e5640 1 -- 172.21.15.37:0/4009417511 >> v1:172.21.15.119:6789/0 conn(0x7fe9080b7ab0 legacy=0x7fe9080b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90e3e5640 1 -- 172.21.15.37:0/4009417511 >> v1:172.21.15.37:6789/0 conn(0x7fe9080b4340 legacy=0x7fe9080d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90e3e5640 1 -- 172.21.15.37:0/4009417511 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080ccb80 con 0x7fe9080cef80 2023-07-09T21:35:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90e3e5640 1 --2- 172.21.15.37:0/4009417511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080cef80 0x7fe90806aa50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4666d9b37b231733 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a59e0 con 0x7fe9080cef80 2023-07-09T21:35:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000a5b40 con 0x7fe9080cef80 2023-07-09T21:35:58.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90cbe2640 1 -- 172.21.15.37:0/4009417511 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000ad440 con 0x7fe9080cef80 2023-07-09T21:35:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 -- 172.21.15.37:0/4009417511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080cef80 msgr2=0x7fe90806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 --2- 172.21.15.37:0/4009417511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080cef80 0x7fe90806aa50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe90001c920 comp rx=0 tx=0).stop 2023-07-09T21:35:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 -- 172.21.15.37:0/4009417511 shutdown_connections 2023-07-09T21:35:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 --2- 172.21.15.37:0/4009417511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080cef80 0x7fe90806aa50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 -- 172.21.15.37:0/4009417511 >> 172.21.15.37:0/4009417511 conn(0x7fe908073090 msgr2=0x7fe908069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.137+0000 7fe90fe48640 1 -- 172.21.15.37:0/4009417511 shutdown_connections 2023-07-09T21:35:58.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- 172.21.15.37:0/4009417511 wait complete. 2023-07-09T21:35:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 Processor -- start 2023-07-09T21:35:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- start start 2023-07-09T21:35:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080b4340 0x7fe9081568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080b7ab0 0x7fe9080c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c8270 con 0x7fe9080cef80 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908154830 con 0x7fe9080b4340 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080c84c0 con 0x7fe9080b7ab0 2023-07-09T21:35:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33292/0 (socket says 172.21.15.37:33292) 2023-07-09T21:35:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 -- 172.21.15.37:0/266026038 learned_addr learned my addr 172.21.15.37:0/266026038 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90d3e3640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080b7ab0 0x7fe9080c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90dbe4640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080b4340 0x7fe9081568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 -- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080b7ab0 msgr2=0x7fe9080c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080b7ab0 0x7fe9080c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 -- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080b4340 msgr2=0x7fe9081568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080b4340 0x7fe9081568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 -- 172.21.15.37:0/266026038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe900009a70 con 0x7fe9080cef80 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90e3e5640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe9000196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000adce0 con 0x7fe9080cef80 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000ade40 con 0x7fe9080cef80 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000b9690 con 0x7fe9080cef80 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.141+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9080c87a0 con 0x7fe9080cef80 2023-07-09T21:35:58.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90814c490 con 0x7fe9080cef80 2023-07-09T21:35:58.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9081549c0 con 0x7fe9080cef80 2023-07-09T21:35:58.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9000b97f0 con 0x7fe9080cef80 2023-07-09T21:35:58.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe8fe7fc640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 0x7fe8ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe90011eb40 con 0x7fe9080cef80 2023-07-09T21:35:58.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe90dbe4640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 0x7fe8ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.145+0000 7fe90dbe4640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 0x7fe8ec068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9040011f0 tx=0x7fe904009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.149+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9000ec1f0 con 0x7fe9080cef80 2023-07-09T21:35:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.309+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe90804d7d0 con 0x7fe9080cef80 2023-07-09T21:35:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe8fe7fc640 1 -- 172.21.15.37:0/266026038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+14627 (secure 0 0 0) 0x7fe900009450 con 0x7fe9080cef80 2023-07-09T21:35:58.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:58.315 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:35:57.553541+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:35:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 msgr2=0x7fe8ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 0x7fe8ec068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe9040011f0 tx=0x7fe904009040 comp rx=0 tx=0).stop 2023-07-09T21:35:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 msgr2=0x7fe90814bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fe900009d90 tx=0x7fe9000196c0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 shutdown_connections 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9080cef80 0x7fe90814bf50 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe8ec0663d0 0x7fe8ec068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9080b7ab0 0x7fe9080c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 --2- 172.21.15.37:0/266026038 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9080b4340 0x7fe9081568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 >> 172.21.15.37:0/266026038 conn(0x7fe908073090 msgr2=0x7fe9080b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 shutdown_connections 2023-07-09T21:35:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.313+0000 7fe90fe48640 1 -- 172.21.15.37:0/266026038 wait complete. 2023-07-09T21:35:58.336 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:35:58.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:35:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.477+0000 7f30cdddb640 1 Processor -- start 2023-07-09T21:35:58.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.477+0000 7f30cdddb640 1 -- start start 2023-07-09T21:35:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30cdddb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30c81585b0 0x7f30c806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30cdddb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30cdddb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30c80c9090 con 0x7f30c806b970 2023-07-09T21:35:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30cdddb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c80cbf40 con 0x7f30c81585b0 2023-07-09T21:35:58.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30cdddb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c80c8a60 con 0x7f30c80c4520 2023-07-09T21:35:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30c81585b0 0x7f30c806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30c81585b0 0x7f30c806b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:38322/0 (socket says 172.21.15.37:38322) 2023-07-09T21:35:58.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33484/0 (socket says 172.21.15.37:33484) 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 -- 172.21.15.37:0/2165001672 learned_addr learned my addr 172.21.15.37:0/2165001672 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c6ffd640 1 --1- 172.21.15.37:0/2165001672 >> v1:172.21.15.119:6789/0 conn(0x7f30c806b970 0x7f30c80c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:52206/0 (socket says 172.21.15.37:52206) 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 -- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 msgr2=0x7f30c815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 -- 172.21.15.37:0/2165001672 >> v1:172.21.15.119:6789/0 conn(0x7f30c806b970 legacy=0x7f30c80c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c77fe640 1 -- 172.21.15.37:0/2165001672 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c815ce10 con 0x7f30c81585b0 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c7fff640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.481+0000 7f30c67fc640 1 -- 172.21.15.37:0/2165001672 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017511796 0 0) 0x7f30c80c9090 con 0x7f30c806b970 2023-07-09T21:35:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30c77fe640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c81585b0 0x7f30c806b430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d70b79ba089ecad6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30c67fc640 1 -- 172.21.15.37:0/2165001672 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80a95f0 con 0x7f30c81585b0 2023-07-09T21:35:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30c67fc640 1 -- 172.21.15.37:0/2165001672 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b80a9750 con 0x7f30c81585b0 2023-07-09T21:35:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30c67fc640 1 -- 172.21.15.37:0/2165001672 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b80a9ae0 con 0x7f30c81585b0 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 -- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c81585b0 msgr2=0x7f30c806b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c81585b0 0x7f30c806b430 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f30b8009870 tx=0x7f30b801c510 comp rx=0 tx=0).stop 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 -- 172.21.15.37:0/2165001672 shutdown_connections 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c80c4520 0x7f30c815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2165001672 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c81585b0 0x7f30c806b430 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 -- 172.21.15.37:0/2165001672 >> 172.21.15.37:0/2165001672 conn(0x7f30c80cde40 msgr2=0x7f30c80ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 -- 172.21.15.37:0/2165001672 shutdown_connections 2023-07-09T21:35:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.485+0000 7f30cdddb640 1 -- 172.21.15.37:0/2165001672 wait complete. 2023-07-09T21:35:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 Processor -- start 2023-07-09T21:35:58.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- start start 2023-07-09T21:35:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c806b970 0x7f30c813b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c81585b0 0x7f30c8158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c814dae0 con 0x7f30c80c4520 2023-07-09T21:35:58.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c814d520 con 0x7f30c806b970 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c814d800 con 0x7f30c81585b0 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33300/0 (socket says 172.21.15.37:33300) 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 -- 172.21.15.37:0/2546627005 learned_addr learned my addr 172.21.15.37:0/2546627005 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c77fe640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c806b970 0x7f30c813b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c7fff640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c81585b0 0x7f30c8158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 -- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c81585b0 msgr2=0x7f30c8158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c81585b0 0x7f30c8158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 -- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c806b970 msgr2=0x7f30c813b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c806b970 0x7f30c813b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 -- 172.21.15.37:0/2546627005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009a70 con 0x7f30c80c4520 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30c6ffd640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0011f0 tx=0x7f30bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0074e0 con 0x7f30c80c4520 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc007640 con 0x7f30c80c4520 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30b80094d0 con 0x7f30c80c4520 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0049f0 con 0x7f30c80c4520 2023-07-09T21:35:58.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.489+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c806f2b0 con 0x7f30c80c4520 2023-07-09T21:35:58.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c804d7d0 con 0x7f30c80c4520 2023-07-09T21:35:58.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f30bc004b50 con 0x7f30c80c4520 2023-07-09T21:35:58.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30affff640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 0x7f30b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f30bc0839c0 con 0x7f30c80c4520 2023-07-09T21:35:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30c77fe640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 0x7f30b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.493+0000 7f30c77fe640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 0x7f30b4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30b80ae000 tx=0x7f30b8009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.497+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30bc050f50 con 0x7f30c80c4520 2023-07-09T21:35:58.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.649+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30c806f470 con 0x7f30c80c4520 2023-07-09T21:35:58.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30affff640 1 -- 172.21.15.37:0/2546627005 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v64) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30bc054570 con 0x7f30c80c4520 2023-07-09T21:35:58.655 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 msgr2=0x7f30b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 0x7f30b4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f30b80ae000 tx=0x7f30b8009040 comp rx=0 tx=0).stop 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 msgr2=0x7f30c814ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f30bc0011f0 tx=0x7f30bc00c8f0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 shutdown_connections 2023-07-09T21:35:58.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f30b40663a0 0x7f30b4068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30c81585b0 0x7f30c8158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30c80c4520 0x7f30c814ca40 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 --2- 172.21.15.37:0/2546627005 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30c806b970 0x7f30c813b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 >> 172.21.15.37:0/2546627005 conn(0x7f30c80cde40 msgr2=0x7f30c814eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 shutdown_connections 2023-07-09T21:35:58.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.653+0000 7f30cdddb640 1 -- 172.21.15.37:0/2546627005 wait complete. 2023-07-09T21:35:58.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:35:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.817+0000 7fab21f40640 1 Processor -- start 2023-07-09T21:35:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.817+0000 7fab21f40640 1 -- start start 2023-07-09T21:35:58.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab21f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab21f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab1c06b970 0x7fab1c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab21f40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c0c9090 con 0x7fab1c0c4350 2023-07-09T21:35:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab21f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0c47f0 con 0x7fab1c06b970 2023-07-09T21:35:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab21f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0cbf40 con 0x7fab1c1585b0 2023-07-09T21:35:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1affd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab1c06b970 0x7fab1c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33488/0 (socket says 172.21.15.37:33488) 2023-07-09T21:35:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1b7fe640 1 -- 172.21.15.37:0/3247032351 learned_addr learned my addr 172.21.15.37:0/3247032351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1affd640 1 -- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 msgr2=0x7fab1c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1affd640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1affd640 1 -- 172.21.15.37:0/3247032351 >> v1:172.21.15.119:6789/0 conn(0x7fab1c0c4350 legacy=0x7fab1c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1affd640 1 -- 172.21.15.37:0/3247032351 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c0c8a60 con 0x7fab1c06b970 2023-07-09T21:35:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1a7fc640 1 -- 172.21.15.37:0/3247032351 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651113333 0 0) 0x7fab1c0c9090 con 0x7fab1c0c4350 2023-07-09T21:35:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.821+0000 7fab1b7fe640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab1affd640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c0c3e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fab100097f0 tx=0x7fab1001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=caa460dd3118773b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab1a7fc640 1 -- 172.21.15.37:0/3247032351 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100ab650 con 0x7fab1c06b970 2023-07-09T21:35:58.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab1a7fc640 1 -- 172.21.15.37:0/3247032351 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab100ab7b0 con 0x7fab1c06b970 2023-07-09T21:35:58.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab1a7fc640 1 -- 172.21.15.37:0/3247032351 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab100abb40 con 0x7fab1c06b970 2023-07-09T21:35:58.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 msgr2=0x7fab1c0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c0c3e10 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fab100097f0 tx=0x7fab1001c450 comp rx=0 tx=0).stop 2023-07-09T21:35:58.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- 172.21.15.37:0/3247032351 shutdown_connections 2023-07-09T21:35:58.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c0c3e10 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 --2- 172.21.15.37:0/3247032351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c1585b0 0x7fab1c06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- 172.21.15.37:0/3247032351 >> 172.21.15.37:0/3247032351 conn(0x7fab1c0cde40 msgr2=0x7fab1c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- 172.21.15.37:0/3247032351 shutdown_connections 2023-07-09T21:35:58.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- 172.21.15.37:0/3247032351 wait complete. 2023-07-09T21:35:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 Processor -- start 2023-07-09T21:35:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.825+0000 7fab21f40640 1 -- start start 2023-07-09T21:35:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c0c4350 0x7fab1c0b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c1592f0 con 0x7fab1c1585b0 2023-07-09T21:35:58.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c158f50 con 0x7fab1c06b970 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c0adb10 con 0x7fab1c0c4350 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33310/0 (socket says 172.21.15.37:33310) 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 -- 172.21.15.37:0/2526679258 learned_addr learned my addr 172.21.15.37:0/2526679258 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1affd640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c0c4350 0x7fab1c0b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1b7fe640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 -- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c0c4350 msgr2=0x7fab1c0b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c0c4350 0x7fab1c0b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 -- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 msgr2=0x7fab1c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 -- 172.21.15.37:0/2526679258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c0094d0 con 0x7fab1c1585b0 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab1bfff640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fab14001570 tx=0x7fab1400cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14003db0 con 0x7fab1c1585b0 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14005070 con 0x7fab1c1585b0 2023-07-09T21:35:58.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab10009420 con 0x7fab1c1585b0 2023-07-09T21:35:58.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14005420 con 0x7fab1c1585b0 2023-07-09T21:35:58.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c15b5b0 con 0x7fab1c1585b0 2023-07-09T21:35:58.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.829+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c159430 con 0x7fab1c1585b0 2023-07-09T21:35:58.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.833+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab14005580 con 0x7fab1c1585b0 2023-07-09T21:35:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.833+0000 7fab03fff640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 0x7fab08068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.833+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab14083330 con 0x7fab1c1585b0 2023-07-09T21:35:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.833+0000 7fab1b7fe640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 0x7fab08068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:58.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.833+0000 7fab1b7fe640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 0x7fab08068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab0c006cb0 tx=0x7fab0c009240 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:58.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.837+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab1c159430 con 0x7fab1c1585b0 2023-07-09T21:35:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.989+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fab1c159430 con 0x7fab1c1585b0 2023-07-09T21:35:58.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.989+0000 7fab03fff640 1 -- 172.21.15.37:0/2526679258 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v64) v1 ==== 92+0+10 (secure 0 0 0) 0x7fab14017020 con 0x7fab1c1585b0 2023-07-09T21:35:58.994 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:35:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 msgr2=0x7fab08068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 0x7fab08068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fab0c006cb0 tx=0x7fab0c009240 comp rx=0 tx=0).stop 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 msgr2=0x7fab1c0701b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fab14001570 tx=0x7fab1400cd20 comp rx=0 tx=0).stop 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 shutdown_connections 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c1585b0 0x7fab1c0701b0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fab080663d0 0x7fab08068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c0c4350 0x7fab1c0b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 --2- 172.21.15.37:0/2526679258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c06b970 0x7fab1c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 >> 172.21.15.37:0/2526679258 conn(0x7fab1c0cde40 msgr2=0x7fab1c15bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 shutdown_connections 2023-07-09T21:35:58.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:58.993+0000 7fab21f40640 1 -- 172.21.15.37:0/2526679258 wait complete. 2023-07-09T21:35:59.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:35:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 Processor -- start 2023-07-09T21:35:59.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 -- start start 2023-07-09T21:35:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61400af830 0x7f61400afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61400cbe90 con 0x7f614006f6d0 2023-07-09T21:35:59.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61400b0140 con 0x7f61400cc320 2023-07-09T21:35:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f61465ba640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614006d370 con 0x7f61400af830 2023-07-09T21:35:59.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f613ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61400af830 0x7f61400afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f613ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61400af830 0x7f61400afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33324/0 (socket says 172.21.15.37:33324) 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f613ffff640 1 -- 172.21.15.37:0/4023293032 learned_addr learned my addr 172.21.15.37:0/4023293032 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.153+0000 7f6144b57640 1 --1- 172.21.15.37:0/4023293032 >> v1:172.21.15.37:6789/0 conn(0x7f614006f6d0 0x7f614006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33860/0 (socket says 172.21.15.37:33860) 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613ffff640 1 -- 172.21.15.37:0/4023293032 >> v1:172.21.15.119:6789/0 conn(0x7f61400cc320 legacy=0x7f614006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613ffff640 1 -- 172.21.15.37:0/4023293032 >> v1:172.21.15.37:6789/0 conn(0x7f614006f6d0 legacy=0x7f614006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613ffff640 1 -- 172.21.15.37:0/4023293032 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140159bb0 con 0x7f61400af830 2023-07-09T21:35:59.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613ffff640 1 --2- 172.21.15.37:0/4023293032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400af830 0x7f61400afc00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6130009870 tx=0x7f613001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1736a1abae837f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613effd640 1 -- 172.21.15.37:0/4023293032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300aa670 con 0x7f61400af830 2023-07-09T21:35:59.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613effd640 1 -- 172.21.15.37:0/4023293032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61300aa7d0 con 0x7f61400af830 2023-07-09T21:35:59.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f613effd640 1 -- 172.21.15.37:0/4023293032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61300aab60 con 0x7f61400af830 2023-07-09T21:35:59.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 -- 172.21.15.37:0/4023293032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400af830 msgr2=0x7f61400afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 --2- 172.21.15.37:0/4023293032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400af830 0x7f61400afc00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6130009870 tx=0x7f613001c510 comp rx=0 tx=0).stop 2023-07-09T21:35:59.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 -- 172.21.15.37:0/4023293032 shutdown_connections 2023-07-09T21:35:59.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 --2- 172.21.15.37:0/4023293032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400af830 0x7f61400afc00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 -- 172.21.15.37:0/4023293032 >> 172.21.15.37:0/4023293032 conn(0x7f61400ca830 msgr2=0x7f61400cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.157+0000 7f61465ba640 1 -- 172.21.15.37:0/4023293032 shutdown_connections 2023-07-09T21:35:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 -- 172.21.15.37:0/4023293032 wait complete. 2023-07-09T21:35:59.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 Processor -- start 2023-07-09T21:35:59.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 -- start start 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 0x7f61400c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61400af830 0x7f61400acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c1d10 con 0x7f61400cc320 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c1ff0 con 0x7f614006f6d0 2023-07-09T21:35:59.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f61465ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61400c22d0 con 0x7f61400af830 2023-07-09T21:35:59.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f613ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 0x7f61400c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33326/0 (socket says 172.21.15.37:33326) 2023-07-09T21:35:59.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 -- 172.21.15.37:0/2519726123 learned_addr learned my addr 172.21.15.37:0/2519726123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:59.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f613f7fe640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61400af830 0x7f61400acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 -- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61400af830 msgr2=0x7f61400acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61400af830 0x7f61400acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 -- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 msgr2=0x7f61400c16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 0x7f61400c16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 -- 172.21.15.37:0/2519726123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61300094d0 con 0x7f61400cc320 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f613ffff640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 0x7f61400c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.161+0000 7f6144b57640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f613800cb40 tx=0x7f613800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613800aca0 con 0x7f61400cc320 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613800ae00 con 0x7f61400cc320 2023-07-09T21:35:59.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61380072b0 con 0x7f61400cc320 2023-07-09T21:35:59.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61400c25b0 con 0x7f61400cc320 2023-07-09T21:35:59.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6140151700 con 0x7f61400cc320 2023-07-09T21:35:59.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61400c2ad0 con 0x7f61400cc320 2023-07-09T21:35:59.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6138007410 con 0x7f61400cc320 2023-07-09T21:35:59.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 0x7f612c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6138083ae0 con 0x7f61400cc320 2023-07-09T21:35:59.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.165+0000 7f613ffff640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 0x7f612c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.169+0000 7f613ffff640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 0x7f612c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61300ae000 tx=0x7f61300b5040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.169+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61400c2ad0 con 0x7f61400cc320 2023-07-09T21:35:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61400c2ad0 con 0x7f61400cc320 2023-07-09T21:35:59.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f613cff9640 1 -- 172.21.15.37:0/2519726123 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v64) v1 ==== 84+0+126 (secure 0 0 0) 0x7f61400c2ad0 con 0x7f61400cc320 2023-07-09T21:35:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:35:59.332 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:35:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:35:59.332 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:35:59.333 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:35:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 msgr2=0x7f612c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 0x7f612c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f61300ae000 tx=0x7f61300b5040 comp rx=0 tx=0).stop 2023-07-09T21:35:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 msgr2=0x7f61400c2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f613800cb40 tx=0x7f613800a060 comp rx=0 tx=0).stop 2023-07-09T21:35:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 shutdown_connections 2023-07-09T21:35:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61400cc320 0x7f61400c2db0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f612c0663a0 0x7f612c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61400af830 0x7f61400acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 --2- 172.21.15.37:0/2519726123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f614006f6d0 0x7f61400c16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 >> 172.21.15.37:0/2519726123 conn(0x7f61400ca830 msgr2=0x7f61400b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:59.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 shutdown_connections 2023-07-09T21:35:59.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.329+0000 7f61465ba640 1 -- 172.21.15.37:0/2519726123 wait complete. 2023-07-09T21:35:59.353 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:35:59.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:35:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 Processor -- start 2023-07-09T21:35:59.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 -- start start 2023-07-09T21:35:59.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb81c0b7980 0x7fb81c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb81c0b3c20 0x7fb81c0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0cd070 con 0x7fb81c0b7980 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb81c0cfd70 con 0x7fb81c0b3c20 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb821bdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c15bf80 con 0x7fb81c0ceb80 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb81c0b7980 0x7fb81c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb81c0b7980 0x7fb81c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33334/0 (socket says 172.21.15.37:33334) 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 -- 172.21.15.37:0/1610290051 learned_addr learned my addr 172.21.15.37:0/1610290051 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81bfff640 1 --2- 172.21.15.37:0/1610290051 >> v2:172.21.15.119:3300/0 conn(0x7fb81c0b3c20 0x7fb81c0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81affd640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 -- 172.21.15.37:0/1610290051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 msgr2=0x7fb81c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 -- 172.21.15.37:0/1610290051 >> v2:172.21.15.119:3300/0 conn(0x7fb81c0b3c20 msgr2=0x7fb81c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:35:59.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/1610290051 >> v2:172.21.15.119:3300/0 conn(0x7fb81c0b3c20 0x7fb81c0b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.497+0000 7fb81b7fe640 1 -- 172.21.15.37:0/1610290051 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c160570 con 0x7fb81c0b7980 2023-07-09T21:35:59.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c160030 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb81c08ad30 tx=0x7fb80c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a14fe6808428788 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb81a7fc640 1 -- 172.21.15.37:0/1610290051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0ab600 con 0x7fb81c0b7980 2023-07-09T21:35:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb81a7fc640 1 -- 172.21.15.37:0/1610290051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c0a7050 con 0x7fb81c0b7980 2023-07-09T21:35:59.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb81a7fc640 1 -- 172.21.15.37:0/1610290051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c0ab980 con 0x7fb81c0b7980 2023-07-09T21:35:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 -- 172.21.15.37:0/1610290051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 msgr2=0x7fb81c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c160030 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fb81c08ad30 tx=0x7fb80c01c500 comp rx=0 tx=0).stop 2023-07-09T21:35:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 -- 172.21.15.37:0/1610290051 shutdown_connections 2023-07-09T21:35:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 --2- 172.21.15.37:0/1610290051 >> v2:172.21.15.119:3300/0 conn(0x7fb81c0b3c20 0x7fb81c0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 --2- 172.21.15.37:0/1610290051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c160030 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 -- 172.21.15.37:0/1610290051 >> 172.21.15.37:0/1610290051 conn(0x7fb81c073090 msgr2=0x7fb81c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:35:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 -- 172.21.15.37:0/1610290051 shutdown_connections 2023-07-09T21:35:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.501+0000 7fb821bdb640 1 -- 172.21.15.37:0/1610290051 wait complete. 2023-07-09T21:35:59.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 Processor -- start 2023-07-09T21:35:59.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- start start 2023-07-09T21:35:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb81c0b3c20 0x7fb81c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c154960 con 0x7fb81c0b7980 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c15a1e0 con 0x7fb81c0b3c20 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb81c154680 con 0x7fb81c0ceb80 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33340/0 (socket says 172.21.15.37:33340) 2023-07-09T21:35:59.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 -- 172.21.15.37:0/3832561811 learned_addr learned my addr 172.21.15.37:0/3832561811 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb81c0b3c20 0x7fb81c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81bfff640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 -- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 msgr2=0x7fb81c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 -- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb81c0b3c20 msgr2=0x7fb81c151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb81c0b3c20 0x7fb81c151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 -- 172.21.15.37:0/3832561811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb80c0094d0 con 0x7fb81c0b7980 2023-07-09T21:35:59.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb81affd640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb81000d830 tx=0x7fb81000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000b6c0 con 0x7fb81c0b7980 2023-07-09T21:35:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81000b820 con 0x7fb81c0b7980 2023-07-09T21:35:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb81c159b90 con 0x7fb81c0b7980 2023-07-09T21:35:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81000bb90 con 0x7fb81c0b7980 2023-07-09T21:35:59.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb81c15ae80 con 0x7fb81c0b7980 2023-07-09T21:35:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.505+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb81c1599f0 con 0x7fb81c0b7980 2023-07-09T21:35:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.509+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb81001e460 con 0x7fb81c0b7980 2023-07-09T21:35:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.509+0000 7fb803fff640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:35:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.509+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fb8100841c0 con 0x7fb81c0b7980 2023-07-09T21:35:59.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.509+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:35:59.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.509+0000 7fb81b7fe640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 0x7fb808068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0ad000 tx=0x7fb80c008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:35:59.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.513+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb81c1599f0 con 0x7fb81c0b7980 2023-07-09T21:35:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:35:59.665+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb81c1599f0 con 0x7fb81c0b7980 2023-07-09T21:36:00.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb803fff640 1 -- 172.21.15.37:0/3832561811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb81c1599f0 con 0x7fb81c0b7980 2023-07-09T21:36:00.201 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:36:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 msgr2=0x7fb808068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 0x7fb808068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0ad000 tx=0x7fb80c008040 comp rx=0 tx=0).stop 2023-07-09T21:36:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 msgr2=0x7fb81c0d11f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fb81000d830 tx=0x7fb81000dcf0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 shutdown_connections 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb8080663a0 0x7fb808068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb81c0ceb80 0x7fb81c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb81c0b7980 0x7fb81c0d11f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 --2- 172.21.15.37:0/3832561811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb81c0b3c20 0x7fb81c151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.201+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 >> 172.21.15.37:0/3832561811 conn(0x7fb81c073090 msgr2=0x7fb81c0b5190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.205+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 shutdown_connections 2023-07-09T21:36:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.205+0000 7fb821bdb640 1 -- 172.21.15.37:0/3832561811 wait complete. 2023-07-09T21:36:00.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:36:00.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 Processor -- start 2023-07-09T21:36:00.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 -- start start 2023-07-09T21:36:00.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd7300b7980 0x7fd730160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7300ceb80 0x7fd7300cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd73015bf80 con 0x7fd7300b3c20 2023-07-09T21:36:00.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7300cd070 con 0x7fd7300ceb80 2023-07-09T21:36:00.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.373+0000 7fd736c19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7300cfd70 con 0x7fd7300b7980 2023-07-09T21:36:00.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7300ceb80 0x7fd7300cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7300ceb80 0x7fd7300cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33354/0 (socket says 172.21.15.37:33354) 2023-07-09T21:36:00.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 -- 172.21.15.37:0/3096743395 learned_addr learned my addr 172.21.15.37:0/3096743395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd7349b5640 1 --2- 172.21.15.37:0/3096743395 >> v2:172.21.15.119:3300/0 conn(0x7fd7300b7980 0x7fd730160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 -- 172.21.15.37:0/3096743395 >> v2:172.21.15.119:3300/0 conn(0x7fd7300b7980 msgr2=0x7fd730160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 --2- 172.21.15.37:0/3096743395 >> v2:172.21.15.119:3300/0 conn(0x7fd7300b7980 0x7fd730160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 -- 172.21.15.37:0/3096743395 >> v1:172.21.15.119:6789/0 conn(0x7fd7300b3c20 legacy=0x7fd7300b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 -- 172.21.15.37:0/3096743395 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd730160570 con 0x7fd7300ceb80 2023-07-09T21:36:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72ffff640 1 --2- 172.21.15.37:0/3096743395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300ceb80 0x7fd7300cefc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd730069aa0 tx=0x7fd71c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40186e5d07b7651 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72f7fe640 1 -- 172.21.15.37:0/3096743395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0ab600 con 0x7fd7300ceb80 2023-07-09T21:36:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72f7fe640 1 -- 172.21.15.37:0/3096743395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0a7050 con 0x7fd7300ceb80 2023-07-09T21:36:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.377+0000 7fd72f7fe640 1 -- 172.21.15.37:0/3096743395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0ab980 con 0x7fd7300ceb80 2023-07-09T21:36:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- 172.21.15.37:0/3096743395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300ceb80 msgr2=0x7fd7300cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- 172.21.15.37:0/3096743395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300ceb80 0x7fd7300cefc0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd730069aa0 tx=0x7fd71c01c500 comp rx=0 tx=0).stop 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- 172.21.15.37:0/3096743395 shutdown_connections 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- 172.21.15.37:0/3096743395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300ceb80 0x7fd7300cefc0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- 172.21.15.37:0/3096743395 >> v2:172.21.15.119:3300/0 conn(0x7fd7300b7980 0x7fd730160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- 172.21.15.37:0/3096743395 >> 172.21.15.37:0/3096743395 conn(0x7fd730073090 msgr2=0x7fd730069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- 172.21.15.37:0/3096743395 shutdown_connections 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- 172.21.15.37:0/3096743395 wait complete. 2023-07-09T21:36:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 Processor -- start 2023-07-09T21:36:00.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- start start 2023-07-09T21:36:00.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7300b3c20 0x7fd7300cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 0x7fd7300c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300ca440 con 0x7fd7300b7980 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300ca720 con 0x7fd7300ceb80 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd736c19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7300caa00 con 0x7fd7300b3c20 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd72ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd72ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33368/0 (socket says 172.21.15.37:33368) 2023-07-09T21:36:00.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd72ffff640 1 -- 172.21.15.37:0/859500729 learned_addr learned my addr 172.21.15.37:0/859500729 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd7349b5640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7300b3c20 0x7fd7300cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.381+0000 7fd7351b6640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 0x7fd7300c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 -- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7300b3c20 msgr2=0x7fd7300cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7300b3c20 0x7fd7300cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 -- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 msgr2=0x7fd7300c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 0x7fd7300c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:00.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 -- 172.21.15.37:0/859500729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c0094d0 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd7351b6640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 0x7fd7300c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72ffff640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd71c019110 tx=0x7fd71c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b3890 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0b39f0 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c0b3da0 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7300cace0 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7300ca060 con 0x7fd7300b7980 2023-07-09T21:36:00.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7300cd600 con 0x7fd7300b7980 2023-07-09T21:36:00.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd71c0b2070 con 0x7fd7300b7980 2023-07-09T21:36:00.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.385+0000 7fd72d7fa640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 0x7fd714068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:00.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.389+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd71c11de20 con 0x7fd7300b7980 2023-07-09T21:36:00.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.389+0000 7fd7349b5640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 0x7fd714068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:00.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.389+0000 7fd7349b5640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 0x7fd714068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd724007a60 tx=0x7fd724008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:00.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.393+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7300cd600 con 0x7fd7300b7980 2023-07-09T21:36:00.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:00.545+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd730160570 con 0x7fd7300b7980 2023-07-09T21:36:00.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:36:00.640 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:36:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.205+0000 7fd72d7fa640 1 -- 172.21.15.37:0/859500729 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v66) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd730160570 con 0x7fd7300b7980 2023-07-09T21:36:01.207 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:36:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.213+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 msgr2=0x7fd714068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.213+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 0x7fd714068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd724007a60 tx=0x7fd724008040 comp rx=0 tx=0).stop 2023-07-09T21:36:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.213+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 msgr2=0x7fd7301544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd71c019110 tx=0x7fd71c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 shutdown_connections 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7300ceb80 0x7fd7300c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7300b7980 0x7fd7301544b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fd7140663d0 0x7fd714068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 --2- 172.21.15.37:0/859500729 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7300b3c20 0x7fd7300cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 >> 172.21.15.37:0/859500729 conn(0x7fd730073090 msgr2=0x7fd7300d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:01.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 shutdown_connections 2023-07-09T21:36:01.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.217+0000 7fd736c19640 1 -- 172.21.15.37:0/859500729 wait complete. 2023-07-09T21:36:01.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:36:01.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 Processor -- start 2023-07-09T21:36:01.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 -- start start 2023-07-09T21:36:01.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fa80cf290 0x7f7fa8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:01.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa815bf80 con 0x7f7fa80d0780 2023-07-09T21:36:01.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa8160570 con 0x7f7fa80b7980 2023-07-09T21:36:01.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fad9e2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa80cd070 con 0x7f7fa80cf290 2023-07-09T21:36:01.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7f9ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fa80cf290 0x7f7fa8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:01.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fa77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7fa80d0780 0x7f7fa80d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33868/0 (socket says 172.21.15.37:33868) 2023-07-09T21:36:01.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fa77fe640 1 -- 172.21.15.37:0/1750525199 learned_addr learned my addr 172.21.15.37:0/1750525199 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:01.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7f9ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7fa80cf290 0x7f7fa8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33374/0 (socket says 172.21.15.37:33374) 2023-07-09T21:36:01.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7f9ffff640 1 -- 172.21.15.37:0/1750525199 >> v1:172.21.15.119:6789/0 conn(0x7f7fa80b7980 legacy=0x7f7fa80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7f9ffff640 1 -- 172.21.15.37:0/1750525199 >> v1:172.21.15.37:6789/0 conn(0x7f7fa80d0780 legacy=0x7f7fa80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7f9ffff640 1 -- 172.21.15.37:0/1750525199 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa80d02f0 con 0x7f7fa80cf290 2023-07-09T21:36:01.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.401+0000 7f7fa67fc640 1 -- 172.21.15.37:0/1750525199 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 350013252 0 0) 0x7f7f98001120 con 0x7f7fa80b7980 2023-07-09T21:36:01.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7f9ffff640 1 --2- 172.21.15.37:0/1750525199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80cf290 0x7f7fa8160030 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7f900097c0 tx=0x7f7f9001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ec61ce0e6363db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:01.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fa67fc640 1 -- 172.21.15.37:0/1750525199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900ab600 con 0x7f7fa80cf290 2023-07-09T21:36:01.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fa67fc640 1 -- 172.21.15.37:0/1750525199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f900a7050 con 0x7f7fa80cf290 2023-07-09T21:36:01.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fa67fc640 1 -- 172.21.15.37:0/1750525199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f900ab980 con 0x7f7fa80cf290 2023-07-09T21:36:01.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 -- 172.21.15.37:0/1750525199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80cf290 msgr2=0x7f7fa8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/1750525199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80cf290 0x7f7fa8160030 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7f900097c0 tx=0x7f7f9001c310 comp rx=0 tx=0).stop 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 -- 172.21.15.37:0/1750525199 shutdown_connections 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/1750525199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80cf290 0x7f7fa8160030 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 -- 172.21.15.37:0/1750525199 >> 172.21.15.37:0/1750525199 conn(0x7f7fa8073090 msgr2=0x7f7fa8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 -- 172.21.15.37:0/1750525199 shutdown_connections 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 -- 172.21.15.37:0/1750525199 wait complete. 2023-07-09T21:36:01.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.405+0000 7f7fad9e2640 1 Processor -- start 2023-07-09T21:36:01.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- start start 2023-07-09T21:36:01.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:01.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 0x7f7fa80cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:01.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fa80d0780 0x7f7fa81e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa81e79b0 con 0x7f7fa80b7980 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80ca810 con 0x7f7fa80cf290 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa80caaf0 con 0x7f7fa80d0780 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33386/0 (socket says 172.21.15.37:33386) 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 -- 172.21.15.37:0/526808527 learned_addr learned my addr 172.21.15.37:0/526808527 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7f9ffff640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 0x7f7fa80cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:01.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa77fe640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fa80d0780 0x7f7fa81e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 -- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fa80d0780 msgr2=0x7f7fa81e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fa80d0780 0x7f7fa81e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 -- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 msgr2=0x7f7fa80cb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 0x7f7fa80cb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:01.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 -- 172.21.15.37:0/526808527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009420 con 0x7f7fa80b7980 2023-07-09T21:36:01.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7f9ffff640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 0x7f7fa80cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:01.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa6ffd640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c4a0 tx=0x7f7f9800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:01.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98005480 con 0x7f7fa80b7980 2023-07-09T21:36:01.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98003600 con 0x7f7fa80b7980 2023-07-09T21:36:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f980039f0 con 0x7f7fa80b7980 2023-07-09T21:36:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa80cadd0 con 0x7f7fa80b7980 2023-07-09T21:36:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa80cb390 con 0x7f7fa80b7980 2023-07-09T21:36:01.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.409+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa804d7d0 con 0x7f7fa80b7980 2023-07-09T21:36:01.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.413+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f98003b50 con 0x7f7fa80b7980 2023-07-09T21:36:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.413+0000 7f7fa4ff9640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 0x7f7f88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.413+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7f98083730 con 0x7f7fa80b7980 2023-07-09T21:36:01.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.413+0000 7f7f9ffff640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 0x7f7f88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.413+0000 7f7f9ffff640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 0x7f7f88068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ad000 tx=0x7f7f900a6000 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:01.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.417+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f98054570 con 0x7f7fa80b7980 2023-07-09T21:36:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:01.601+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7fa8160570 con 0x7f7fa80b7980 2023-07-09T21:36:02.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.221+0000 7f7fa4ff9640 1 -- 172.21.15.37:0/526808527 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7fa8160570 con 0x7f7fa80b7980 2023-07-09T21:36:02.236 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 7 and data pool 8 2023-07-09T21:36:02.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 msgr2=0x7f7f88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 0x7f7f88068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ad000 tx=0x7f7f900a6000 comp rx=0 tx=0).stop 2023-07-09T21:36:02.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 msgr2=0x7f7fa81501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7f9800c4a0 tx=0x7f7f9800c960 comp rx=0 tx=0).stop 2023-07-09T21:36:02.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 shutdown_connections 2023-07-09T21:36:02.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7f880663a0 0x7f7f88068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fa80d0780 0x7f7fa81e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fa80cf290 0x7f7fa80cb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 --2- 172.21.15.37:0/526808527 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fa80b7980 0x7f7fa81501c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 >> 172.21.15.37:0/526808527 conn(0x7f7fa8073090 msgr2=0x7f7fa80ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 shutdown_connections 2023-07-09T21:36:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.241+0000 7f7fad9e2640 1 -- 172.21.15.37:0/526808527 wait complete. 2023-07-09T21:36:02.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:36:02.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 Processor -- start 2023-07-09T21:36:02.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 -- start start 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90540b7ab0 0x7f905406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b4340 0x7f90540d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90540b49f0 con 0x7f90540cef80 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90540b7e80 con 0x7f90540b7ab0 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f905b72c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90540cc8a0 con 0x7f90540b4340 2023-07-09T21:36:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90540b7ab0 0x7f905406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f90540b7ab0 0x7f905406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33388/0 (socket says 172.21.15.37:33388) 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 -- 172.21.15.37:0/3041445221 learned_addr learned my addr 172.21.15.37:0/3041445221 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f9059cc9640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b4340 0x7f90540d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 -- 172.21.15.37:0/3041445221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b4340 msgr2=0x7f90540d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b4340 0x7f90540d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 -- 172.21.15.37:0/3041445221 >> v1:172.21.15.119:6789/0 conn(0x7f90540cef80 legacy=0x7f90540b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.421+0000 7f90594c8640 1 -- 172.21.15.37:0/3041445221 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540ccb80 con 0x7f90540b7ab0 2023-07-09T21:36:02.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f90594c8640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540b7ab0 0x7f905406aa50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9050009870 tx=0x7f905001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa071ceac9dd16e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f904bfff640 1 -- 172.21.15.37:0/3041445221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500aa670 con 0x7f90540b7ab0 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f904bfff640 1 -- 172.21.15.37:0/3041445221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90500aa7d0 con 0x7f90540b7ab0 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f904bfff640 1 -- 172.21.15.37:0/3041445221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500aab60 con 0x7f90540b7ab0 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 -- 172.21.15.37:0/3041445221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540b7ab0 msgr2=0x7f905406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540b7ab0 0x7f905406aa50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9050009870 tx=0x7f905001c510 comp rx=0 tx=0).stop 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 -- 172.21.15.37:0/3041445221 shutdown_connections 2023-07-09T21:36:02.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b4340 0x7f90540d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 --2- 172.21.15.37:0/3041445221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540b7ab0 0x7f905406aa50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 -- 172.21.15.37:0/3041445221 >> 172.21.15.37:0/3041445221 conn(0x7f9054073090 msgr2=0x7f9054069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 -- 172.21.15.37:0/3041445221 shutdown_connections 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.425+0000 7f905b72c640 1 -- 172.21.15.37:0/3041445221 wait complete. 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 Processor -- start 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- start start 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 0x7f905414dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b7ab0 0x7f9054156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90541576e0 con 0x7f90540cef80 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905414e0f0 con 0x7f90540b4340 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90540c74a0 con 0x7f90540b7ab0 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33398/0 (socket says 172.21.15.37:33398) 2023-07-09T21:36:02.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f90594c8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 0x7f905414dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 -- 172.21.15.37:0/39071520 learned_addr learned my addr 172.21.15.37:0/39071520 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9058cc7640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b7ab0 0x7f9054156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 -- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b7ab0 msgr2=0x7f9054156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b7ab0 0x7f9054156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 -- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 msgr2=0x7f905414dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 0x7f905414dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 -- 172.21.15.37:0/39071520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90500094d0 con 0x7f90540cef80 2023-07-09T21:36:02.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f90594c8640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 0x7f905414dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9059cc9640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f904c007e60 tx=0x7f904c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c014620 con 0x7f90540cef80 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f904c014780 con 0x7f90540cef80 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f904c014b30 con 0x7f90540cef80 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9054157120 con 0x7f90540cef80 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90540c7130 con 0x7f90540cef80 2023-07-09T21:36:02.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.429+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90540c6f90 con 0x7f90540cef80 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.433+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f904c014c90 con 0x7f90540cef80 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.433+0000 7f9049ffb640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 0x7f9038068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.433+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f904c0846f0 con 0x7f90540cef80 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.433+0000 7f90594c8640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 0x7f9038068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.433+0000 7f90594c8640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 0x7f9038068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90500ae000 tx=0x7f90500b5040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.437+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90540c6f90 con 0x7f90540cef80 2023-07-09T21:36:02.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90540c6f90 con 0x7f90540cef80 2023-07-09T21:36:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f9049ffb640 1 -- 172.21.15.37:0/39071520 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18352 (secure 0 0 0) 0x7f90540c6f90 con 0x7f90540cef80 2023-07-09T21:36:02.597 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:02.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:36:01.605317+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 msgr2=0x7f9038068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 0x7f9038068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f90500ae000 tx=0x7f90500b5040 comp rx=0 tx=0).stop 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 msgr2=0x7f90540c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f904c007e60 tx=0x7f904c00e4b0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 shutdown_connections 2023-07-09T21:36:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90540cef80 0x7f90540c7930 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f90380663a0 0x7f9038068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90540b7ab0 0x7f9054156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 --2- 172.21.15.37:0/39071520 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90540b4340 0x7f905414dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.597+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 >> 172.21.15.37:0/39071520 conn(0x7f9054073090 msgr2=0x7f905415e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.601+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 shutdown_connections 2023-07-09T21:36:02.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.601+0000 7f905b72c640 1 -- 172.21.15.37:0/39071520 wait complete. 2023-07-09T21:36:02.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:36:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 Processor -- start 2023-07-09T21:36:02.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 -- start start 2023-07-09T21:36:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8b00b7ab0 0x7fe8b006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe8b00b4340 0x7fe8b00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b00b49f0 con 0x7fe8b00cef80 2023-07-09T21:36:02.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b00b7e80 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8b5b40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b00cc8a0 con 0x7fe8b00b4340 2023-07-09T21:36:02.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8af7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8b00b7ab0 0x7fe8b006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8af7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe8b00b7ab0 0x7fe8b006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33414/0 (socket says 172.21.15.37:33414) 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8af7fe640 1 -- 172.21.15.37:0/905345724 learned_addr learned my addr 172.21.15.37:0/905345724 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.761+0000 7fe8affff640 1 --2- 172.21.15.37:0/905345724 >> v2:172.21.15.119:3300/0 conn(0x7fe8b00b4340 0x7fe8b00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8af7fe640 1 -- 172.21.15.37:0/905345724 >> v2:172.21.15.119:3300/0 conn(0x7fe8b00b4340 msgr2=0x7fe8b00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/905345724 >> v2:172.21.15.119:3300/0 conn(0x7fe8b00b4340 0x7fe8b00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8af7fe640 1 -- 172.21.15.37:0/905345724 >> v1:172.21.15.119:6789/0 conn(0x7fe8b00cef80 legacy=0x7fe8b00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8af7fe640 1 -- 172.21.15.37:0/905345724 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b00ccb80 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/905345724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00b7ab0 0x7fe8b006aa50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00b4710 tx=0x7fe8a001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c3456f75366d2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8ae7fc640 1 -- 172.21.15.37:0/905345724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00aa430 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8ae7fc640 1 -- 172.21.15.37:0/905345724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a00aa590 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8ae7fc640 1 -- 172.21.15.37:0/905345724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a00aa920 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 -- 172.21.15.37:0/905345724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00b7ab0 msgr2=0x7fe8b006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/905345724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00b7ab0 0x7fe8b006aa50 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe8b00b4710 tx=0x7fe8a001c4d0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 -- 172.21.15.37:0/905345724 shutdown_connections 2023-07-09T21:36:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/905345724 >> v2:172.21.15.119:3300/0 conn(0x7fe8b00b4340 0x7fe8b00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/905345724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00b7ab0 0x7fe8b006aa50 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 -- 172.21.15.37:0/905345724 >> 172.21.15.37:0/905345724 conn(0x7fe8b0073090 msgr2=0x7fe8b0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 -- 172.21.15.37:0/905345724 shutdown_connections 2023-07-09T21:36:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.765+0000 7fe8b5b40640 1 -- 172.21.15.37:0/905345724 wait complete. 2023-07-09T21:36:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 Processor -- start 2023-07-09T21:36:02.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 -- start start 2023-07-09T21:36:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8b00b4340 0x7fe8b00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8b00b7ab0 0x7fe8b01420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0154720 con 0x7fe8b00cef80 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b00c8470 con 0x7fe8b00b4340 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8b5b40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b01425f0 con 0x7fe8b00b7ab0 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33418/0 (socket says 172.21.15.37:33418) 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 -- 172.21.15.37:0/459775523 learned_addr learned my addr 172.21.15.37:0/459775523 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8b00b4340 0x7fe8b00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8aeffd640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8b00b7ab0 0x7fe8b01420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 -- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8b00b7ab0 msgr2=0x7fe8b01420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8b00b7ab0 0x7fe8b01420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 -- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8b00b4340 msgr2=0x7fe8b00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8b00b4340 0x7fe8b00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 -- 172.21.15.37:0/459775523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00094d0 con 0x7fe8b00cef80 2023-07-09T21:36:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe8affff640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800efc0 tx=0x7fe8a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.769+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8014480 con 0x7fe8b00cef80 2023-07-09T21:36:02.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a800f040 con 0x7fe8b00cef80 2023-07-09T21:36:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a8014820 con 0x7fe8b00cef80 2023-07-09T21:36:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b0153b10 con 0x7fe8b00cef80 2023-07-09T21:36:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b01540d0 con 0x7fe8b00cef80 2023-07-09T21:36:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b0154890 con 0x7fe8b00cef80 2023-07-09T21:36:02.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe8a8014980 con 0x7fe8b00cef80 2023-07-09T21:36:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe897fff640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 0x7fe89c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8a8084eb0 con 0x7fe8b00cef80 2023-07-09T21:36:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.773+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 0x7fe89c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:02.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.777+0000 7fe8af7fe640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 0x7fe89c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00ae000 tx=0x7fe8a00b5040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:02.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.777+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8a8052070 con 0x7fe8b00cef80 2023-07-09T21:36:02.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.933+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8b004d7d0 con 0x7fe8b00cef80 2023-07-09T21:36:02.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.933+0000 7fe897fff640 1 -- 172.21.15.37:0/459775523 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+18352 (secure 0 0 0) 0x7fe8a8018090 con 0x7fe8b00cef80 2023-07-09T21:36:02.934 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:02.934 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":67,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:36:01.605317+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:36:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 msgr2=0x7fe89c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 0x7fe89c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00ae000 tx=0x7fe8a00b5040 comp rx=0 tx=0).stop 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 msgr2=0x7fe8b0156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe8a800efc0 tx=0x7fe8a800c490 comp rx=0 tx=0).stop 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 shutdown_connections 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8b00cef80 0x7fe8b0156b60 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fe89c0663a0 0x7fe89c068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe8b00b7ab0 0x7fe8b01420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 --2- 172.21.15.37:0/459775523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe8b00b4340 0x7fe8b00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 >> 172.21.15.37:0/459775523 conn(0x7fe8b0073090 msgr2=0x7fe8b00b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 shutdown_connections 2023-07-09T21:36:02.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:02.937+0000 7fe8b5b40640 1 -- 172.21.15.37:0/459775523 wait complete. 2023-07-09T21:36:02.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:36:03.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-07-09T21:36:03.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-09T21:36:03.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.101+0000 7fc45500b640 1 Processor -- start 2023-07-09T21:36:03.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.101+0000 7fc45500b640 1 -- start start 2023-07-09T21:36:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc45500b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4500cf290 0x7fc450160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc45500b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 0x7fc4500d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc45500b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45015bf80 con 0x7fc4500b7980 2023-07-09T21:36:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc45500b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4500cd070 con 0x7fc4500cf290 2023-07-09T21:36:03.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc45500b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4500cfd70 con 0x7fc4500d0780 2023-07-09T21:36:03.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4500cf290 0x7fc450160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4500cf290 0x7fc450160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33420/0 (socket says 172.21.15.37:33420) 2023-07-09T21:36:03.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 -- 172.21.15.37:0/4271234689 learned_addr learned my addr 172.21.15.37:0/4271234689 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 -- 172.21.15.37:0/4271234689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 msgr2=0x7fc4500d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc44f59e640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 0x7fc4500d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 0x7fc4500d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 -- 172.21.15.37:0/4271234689 >> v1:172.21.15.119:6789/0 conn(0x7fc4500b7980 legacy=0x7fc4500ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc447fff640 1 -- 172.21.15.37:0/4271234689 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc450160570 con 0x7fc4500cf290 2023-07-09T21:36:03.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.105+0000 7fc44f59e640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 0x7fc4500d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:36:03.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc447fff640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500cf290 0x7fc450160030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc438009870 tx=0x7fc43801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79058d58d324b68 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:03.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc44e59c640 1 -- 172.21.15.37:0/4271234689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ab600 con 0x7fc4500cf290 2023-07-09T21:36:03.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc44e59c640 1 -- 172.21.15.37:0/4271234689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380a7050 con 0x7fc4500cf290 2023-07-09T21:36:03.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc44e59c640 1 -- 172.21.15.37:0/4271234689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380ab980 con 0x7fc4500cf290 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- 172.21.15.37:0/4271234689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500cf290 msgr2=0x7fc450160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500cf290 0x7fc450160030 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc438009870 tx=0x7fc43801c500 comp rx=0 tx=0).stop 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- 172.21.15.37:0/4271234689 shutdown_connections 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500d0780 0x7fc4500d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 --2- 172.21.15.37:0/4271234689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500cf290 0x7fc450160030 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:03.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- 172.21.15.37:0/4271234689 >> 172.21.15.37:0/4271234689 conn(0x7fc450073090 msgr2=0x7fc450069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:03.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- 172.21.15.37:0/4271234689 shutdown_connections 2023-07-09T21:36:03.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- 172.21.15.37:0/4271234689 wait complete. 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 Processor -- start 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.109+0000 7fc45500b640 1 -- start start 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 0x7fc450152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4500d0780 0x7fc4501543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450157640 con 0x7fc4500b7980 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc450156a30 con 0x7fc4500d0780 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc450156d10 con 0x7fc4500cf290 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33428/0 (socket says 172.21.15.37:33428) 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 -- 172.21.15.37:0/708725991 learned_addr learned my addr 172.21.15.37:0/708725991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44f59e640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4500d0780 0x7fc4501543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc447fff640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 0x7fc450152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 -- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 msgr2=0x7fc450152a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:03.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 0x7fc450152a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 -- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4500d0780 msgr2=0x7fc4501543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4500d0780 0x7fc4501543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 -- 172.21.15.37:0/708725991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4380094d0 con 0x7fc4500b7980 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc447fff640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 0x7fc450152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc44ed9d640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c450 tx=0x7fc44000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440012830 con 0x7fc4500b7980 2023-07-09T21:36:03.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4400129b0 con 0x7fc4500b7980 2023-07-09T21:36:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc450156ff0 con 0x7fc4500b7980 2023-07-09T21:36:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc440012d60 con 0x7fc4500b7980 2023-07-09T21:36:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4500b49c0 con 0x7fc4500b7980 2023-07-09T21:36:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc45004d7d0 con 0x7fc4500b7980 2023-07-09T21:36:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.113+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc44001c460 con 0x7fc4500b7980 2023-07-09T21:36:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.117+0000 7fc4477fe640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 0x7fc430068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.117+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc440083c30 con 0x7fc4500b7980 2023-07-09T21:36:03.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.117+0000 7fc447fff640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 0x7fc430068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.117+0000 7fc447fff640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 0x7fc430068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4380ad000 tx=0x7fc438008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.121+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc44008a080 con 0x7fc4500b7980 2023-07-09T21:36:03.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:03.309+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc4500b1600 con 0x7fc4500b7980 2023-07-09T21:36:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.257+0000 7fc4477fe640 1 -- 172.21.15.37:0/708725991 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc440058e60 con 0x7fc4500b7980 2023-07-09T21:36:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 msgr2=0x7fc430068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 0x7fc430068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc4380ad000 tx=0x7fc438008040 comp rx=0 tx=0).stop 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 msgr2=0x7fc4500b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc44000c450 tx=0x7fc44000c910 comp rx=0 tx=0).stop 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 shutdown_connections 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4500d0780 0x7fc4501543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fc4300663d0 0x7fc430068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4500cf290 0x7fc450152a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 --2- 172.21.15.37:0/708725991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4500b7980 0x7fc4500b4480 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 >> 172.21.15.37:0/708725991 conn(0x7fc450073090 msgr2=0x7fc45015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:04.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 shutdown_connections 2023-07-09T21:36:04.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.261+0000 7fc45500b640 1 -- 172.21.15.37:0/708725991 wait complete. 2023-07-09T21:36:04.284 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:36:04.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:36:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.433+0000 7f2c50d11640 1 Processor -- start 2023-07-09T21:36:04.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.433+0000 7f2c50d11640 1 -- start start 2023-07-09T21:36:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c50d11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c4c0b7980 0x7f2c4c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c50d11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 0x7f2c4c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c50d11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c15bf80 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c50d11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cd070 con 0x7f2c4c0b7980 2023-07-09T21:36:04.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c50d11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cfd70 con 0x7f2c4c0ceb80 2023-07-09T21:36:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c4c0b7980 0x7f2c4c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2c4c0b3c20 0x7f2c4c0b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33878/0 (socket says 172.21.15.37:33878) 2023-07-09T21:36:04.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4ad9d640 1 -- 172.21.15.37:0/3580356882 learned_addr learned my addr 172.21.15.37:0/3580356882 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c43fff640 1 --2- 172.21.15.37:0/3580356882 >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 0x7f2c4c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4a59c640 1 -- 172.21.15.37:0/3580356882 >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 msgr2=0x7f2c4c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4a59c640 1 --2- 172.21.15.37:0/3580356882 >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 0x7f2c4c0cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4a59c640 1 -- 172.21.15.37:0/3580356882 >> v1:172.21.15.37:6789/0 conn(0x7f2c4c0b3c20 legacy=0x7f2c4c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c4a59c640 1 -- 172.21.15.37:0/3580356882 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c160570 con 0x7f2c4c0b7980 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c49d9b640 1 -- 172.21.15.37:0/3580356882 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052884613 0 0) 0x7f2c440014a0 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.437+0000 7f2c43fff640 1 --2- 172.21.15.37:0/3580356882 >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 0x7f2c4c0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c4a59c640 1 --2- 172.21.15.37:0/3580356882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c160030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0b4cd0 tx=0x7f2c3c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb54e55917f1973 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:04.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c49d9b640 1 -- 172.21.15.37:0/3580356882 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0ab600 con 0x7f2c4c0b7980 2023-07-09T21:36:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c49d9b640 1 -- 172.21.15.37:0/3580356882 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0a7050 con 0x7f2c4c0b7980 2023-07-09T21:36:04.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c49d9b640 1 -- 172.21.15.37:0/3580356882 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0ab980 con 0x7f2c4c0b7980 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- 172.21.15.37:0/3580356882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b7980 msgr2=0x7f2c4c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 --2- 172.21.15.37:0/3580356882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c160030 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0b4cd0 tx=0x7f2c3c01c460 comp rx=0 tx=0).stop 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- 172.21.15.37:0/3580356882 shutdown_connections 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 --2- 172.21.15.37:0/3580356882 >> v2:172.21.15.119:3300/0 conn(0x7f2c4c0ceb80 0x7f2c4c0cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 --2- 172.21.15.37:0/3580356882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c160030 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- 172.21.15.37:0/3580356882 >> 172.21.15.37:0/3580356882 conn(0x7f2c4c073090 msgr2=0x7f2c4c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:04.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- 172.21.15.37:0/3580356882 shutdown_connections 2023-07-09T21:36:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- 172.21.15.37:0/3580356882 wait complete. 2023-07-09T21:36:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 Processor -- start 2023-07-09T21:36:04.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.441+0000 7f2c50d11640 1 -- start start 2023-07-09T21:36:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c15a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 0x7f2c4c15a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0c94a0 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cc5d0 con 0x7f2c4c0b7980 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c155490 con 0x7f2c4c0ceb80 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33436/0 (socket says 172.21.15.37:33436) 2023-07-09T21:36:04.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 -- 172.21.15.37:0/2807039035 learned_addr learned my addr 172.21.15.37:0/2807039035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:04.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c43fff640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c15a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4ad9d640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 0x7f2c4c15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 -- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 msgr2=0x7f2c4c15a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 0x7f2c4c15a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 -- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c4c0b7980 msgr2=0x7f2c4c15a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c15a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:04.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 -- 172.21.15.37:0/2807039035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c009420 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4ad9d640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 0x7f2c4c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c4a59c640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0ae040 tx=0x7f2c3c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b4820 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c0b4980 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c0b4d30 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c0cc010 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c155800 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c04d7d0 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.445+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2c3c0b2040 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.449+0000 7f2c42ffd640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 0x7f2c2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:04.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.449+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2c3c11e0a0 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.449+0000 7f2c43fff640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 0x7f2c2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.449+0000 7f2c43fff640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 0x7f2c2c068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c15b400 tx=0x7f2c34008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:04.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.453+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c3c0eb400 con 0x7f2c4c0b3c20 2023-07-09T21:36:04.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:04.637+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2c4c160570 con 0x7f2c4c0b3c20 2023-07-09T21:36:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.261+0000 7f2c42ffd640 1 -- 172.21.15.37:0/2807039035 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2c4c160570 con 0x7f2c4c0b3c20 2023-07-09T21:36:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 msgr2=0x7f2c2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 0x7f2c2c068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c15b400 tx=0x7f2c34008040 comp rx=0 tx=0).stop 2023-07-09T21:36:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 msgr2=0x7f2c4c154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0ae040 tx=0x7f2c3c019200 comp rx=0 tx=0).stop 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 shutdown_connections 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2c2c0663a0 0x7f2c2c068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c4c0ceb80 0x7f2c4c15a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c4c0b7980 0x7f2c4c15a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 --2- 172.21.15.37:0/2807039035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c4c0b3c20 0x7f2c4c154a70 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 >> 172.21.15.37:0/2807039035 conn(0x7f2c4c073090 msgr2=0x7f2c4c0b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:05.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 shutdown_connections 2023-07-09T21:36:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.265+0000 7f2c50d11640 1 -- 172.21.15.37:0/2807039035 wait complete. 2023-07-09T21:36:05.289 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:36:05.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:36:05.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 Processor -- start 2023-07-09T21:36:05.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 -- start start 2023-07-09T21:36:05.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240b7ab0 0x7f802406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80240cef80 0x7f80240b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80240b49f0 con 0x7f80240b4170 2023-07-09T21:36:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80240b7e80 con 0x7f80240cef80 2023-07-09T21:36:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f802bf11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80240b45f0 con 0x7f80240b7ab0 2023-07-09T21:36:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80240cef80 0x7f80240b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80240cef80 0x7f80240b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33446/0 (socket says 172.21.15.37:33446) 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 -- 172.21.15.37:0/2563542132 learned_addr learned my addr 172.21.15.37:0/2563542132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f8029cad640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240b7ab0 0x7f802406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 -- 172.21.15.37:0/2563542132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240b7ab0 msgr2=0x7f802406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240b7ab0 0x7f802406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 -- 172.21.15.37:0/2563542132 >> v1:172.21.15.119:6789/0 conn(0x7f80240b4170 legacy=0x7f802415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.437+0000 7f80294ac640 1 -- 172.21.15.37:0/2563542132 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80240cc8a0 con 0x7f80240cef80 2023-07-09T21:36:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f80294ac640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240cef80 0x7f80240b3c30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8014009870 tx=0x7f801401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa2236a5d008e0b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f8028cab640 1 -- 172.21.15.37:0/2563542132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140aa670 con 0x7f80240cef80 2023-07-09T21:36:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f8028cab640 1 -- 172.21.15.37:0/2563542132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80140aa7d0 con 0x7f80240cef80 2023-07-09T21:36:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f8028cab640 1 -- 172.21.15.37:0/2563542132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140aab60 con 0x7f80240cef80 2023-07-09T21:36:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 -- 172.21.15.37:0/2563542132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240cef80 msgr2=0x7f80240b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240cef80 0x7f80240b3c30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8014009870 tx=0x7f801401c510 comp rx=0 tx=0).stop 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 -- 172.21.15.37:0/2563542132 shutdown_connections 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240cef80 0x7f80240b3c30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 --2- 172.21.15.37:0/2563542132 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240b7ab0 0x7f802406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 -- 172.21.15.37:0/2563542132 >> 172.21.15.37:0/2563542132 conn(0x7f8024073090 msgr2=0x7f8024069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 -- 172.21.15.37:0/2563542132 shutdown_connections 2023-07-09T21:36:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 -- 172.21.15.37:0/2563542132 wait complete. 2023-07-09T21:36:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.441+0000 7f802bf11640 1 Processor -- start 2023-07-09T21:36:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- start start 2023-07-09T21:36:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80240b7ab0 0x7f8024147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240cef80 0x7f802414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80240c6330 con 0x7f80240b4170 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8024149870 con 0x7f80240b7ab0 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8024157fb0 con 0x7f80240cef80 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33450/0 (socket says 172.21.15.37:33450) 2023-07-09T21:36:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 -- 172.21.15.37:0/2360496321 learned_addr learned my addr 172.21.15.37:0/2360496321 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f80294ac640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80240b7ab0 0x7f8024147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802a4ae640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240cef80 0x7f802414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 -- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240cef80 msgr2=0x7f802414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240cef80 0x7f802414ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 -- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80240b7ab0 msgr2=0x7f8024147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80240b7ab0 0x7f8024147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 -- 172.21.15.37:0/2360496321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80140094d0 con 0x7f80240b4170 2023-07-09T21:36:05.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f8029cad640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f802000d800 tx=0x7f802000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000b6c0 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802000b860 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802000bc10 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8024158290 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80240c5fc0 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.445+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802404d7d0 con 0x7f80240b4170 2023-07-09T21:36:05.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.449+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f802001e460 con 0x7f80240b4170 2023-07-09T21:36:05.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.449+0000 7f801a7fc640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 0x7f8008068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.449+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f80200842b0 con 0x7f80240b4170 2023-07-09T21:36:05.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.449+0000 7f80294ac640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 0x7f8008068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.449+0000 7f80294ac640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 0x7f8008068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80140ae000 tx=0x7f80140b5040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.453+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8020051760 con 0x7f80240b4170 2023-07-09T21:36:05.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80240cc550 con 0x7f80240b4170 2023-07-09T21:36:05.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f801a7fc640 1 -- 172.21.15.37:0/2360496321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f8020054d80 con 0x7f80240b4170 2023-07-09T21:36:05.645 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:05.645 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:36:05.645 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 msgr2=0x7f8008068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 0x7f8008068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80140ae000 tx=0x7f80140b5040 comp rx=0 tx=0).stop 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 msgr2=0x7f80240c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f802000d800 tx=0x7f802000dcc0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 shutdown_connections 2023-07-09T21:36:05.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f80080663a0 0x7f8008068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80240cef80 0x7f802414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80240b7ab0 0x7f8024147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 --2- 172.21.15.37:0/2360496321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80240b4170 0x7f80240c84d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 >> 172.21.15.37:0/2360496321 conn(0x7f8024073090 msgr2=0x7f80240b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.645+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 shutdown_connections 2023-07-09T21:36:05.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.649+0000 7f802bf11640 1 -- 172.21.15.37:0/2360496321 wait complete. 2023-07-09T21:36:05.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:36:05.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 Processor -- start 2023-07-09T21:36:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 -- start start 2023-07-09T21:36:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f73a80b4340 0x7f73a806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a80b49f0 con 0x7f73a80b7ab0 2023-07-09T21:36:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a80cc8a0 con 0x7f73a80cef80 2023-07-09T21:36:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.809+0000 7f73ae234640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a80b7e80 con 0x7f73a80b4340 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73a80b7ab0 0x7f73a80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33884/0 (socket says 172.21.15.37:33884) 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a77fe640 1 -- 172.21.15.37:0/422618305 learned_addr learned my addr 172.21.15.37:0/422618305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a6ffd640 1 --2- 172.21.15.37:0/422618305 >> v2:172.21.15.119:3300/0 conn(0x7f73a80b4340 0x7f73a806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a67fc640 1 -- 172.21.15.37:0/422618305 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143997636 0 0) 0x7f73a80b49f0 con 0x7f73a80b7ab0 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a67fc640 1 -- 172.21.15.37:0/422618305 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7390003530 con 0x7f73a80b7ab0 2023-07-09T21:36:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a6ffd640 1 -- 172.21.15.37:0/422618305 >> v1:172.21.15.119:6789/0 conn(0x7f73a80cef80 legacy=0x7f73a80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a6ffd640 1 -- 172.21.15.37:0/422618305 >> v1:172.21.15.37:6789/0 conn(0x7f73a80b7ab0 legacy=0x7f73a80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a6ffd640 1 -- 172.21.15.37:0/422618305 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80ccb80 con 0x7f73a80b4340 2023-07-09T21:36:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.813+0000 7f73a6ffd640 1 --2- 172.21.15.37:0/422618305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a806aa50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097c0 tx=0x7f739c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37cb51a82b8f90bd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a67fc640 1 -- 172.21.15.37:0/422618305 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0ab650 con 0x7f73a80b4340 2023-07-09T21:36:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a67fc640 1 -- 172.21.15.37:0/422618305 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c0ab7b0 con 0x7f73a80b4340 2023-07-09T21:36:05.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a67fc640 1 -- 172.21.15.37:0/422618305 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0abb40 con 0x7f73a80b4340 2023-07-09T21:36:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- 172.21.15.37:0/422618305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 msgr2=0x7f73a806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 --2- 172.21.15.37:0/422618305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a806aa50 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f739c0097c0 tx=0x7f739c01c450 comp rx=0 tx=0).stop 2023-07-09T21:36:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- 172.21.15.37:0/422618305 shutdown_connections 2023-07-09T21:36:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 --2- 172.21.15.37:0/422618305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a806aa50 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- 172.21.15.37:0/422618305 >> 172.21.15.37:0/422618305 conn(0x7f73a8073090 msgr2=0x7f73a8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- 172.21.15.37:0/422618305 shutdown_connections 2023-07-09T21:36:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- 172.21.15.37:0/422618305 wait complete. 2023-07-09T21:36:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 Processor -- start 2023-07-09T21:36:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- start start 2023-07-09T21:36:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a81f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a80cef80 0x7f73a81542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a814ead0 con 0x7f73a80b7ab0 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a814dec0 con 0x7f73a80b4340 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73ae234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a814e1a0 con 0x7f73a80cef80 2023-07-09T21:36:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33466/0 (socket says 172.21.15.37:33466) 2023-07-09T21:36:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a6ffd640 1 -- 172.21.15.37:0/1534583059 learned_addr learned my addr 172.21.15.37:0/1534583059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a77fe640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a81f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.817+0000 7f73a7fff640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a80cef80 0x7f73a81542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 -- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a80cef80 msgr2=0x7f73a81542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a80cef80 0x7f73a81542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 -- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 msgr2=0x7f73a81f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a81f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 -- 172.21.15.37:0/1534583059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c009420 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73a6ffd640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f739c0ad040 tx=0x7f739c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0b5810 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c0b5990 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a814e480 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0b5d40 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a81f6ed0 con 0x7f73a80b7ab0 2023-07-09T21:36:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a804d7d0 con 0x7f73a80b7ab0 2023-07-09T21:36:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f739c0b4390 con 0x7f73a80b7ab0 2023-07-09T21:36:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 0x7f7394068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.821+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f739c11e980 con 0x7f73a80b7ab0 2023-07-09T21:36:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.825+0000 7f73a77fe640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 0x7f7394068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.825+0000 7f73a77fe640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 0x7f7394068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73980011f0 tx=0x7f7398007d40 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:05.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.829+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f739c0ebc80 con 0x7f73a80b7ab0 2023-07-09T21:36:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.981+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73a806a830 con 0x7f73a80b7ab0 2023-07-09T21:36:05.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f738ffff640 1 -- 172.21.15.37:0/1534583059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+18339 (secure 0 0 0) 0x7f739c0ab610 con 0x7f73a80b7ab0 2023-07-09T21:36:05.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:05.985 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":68,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:36:03.239615+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:36:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 msgr2=0x7f7394068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 0x7f7394068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f73980011f0 tx=0x7f7398007d40 comp rx=0 tx=0).stop 2023-07-09T21:36:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 msgr2=0x7f73a8153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:05.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f739c0ad040 tx=0x7f739c01ac90 comp rx=0 tx=0).stop 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 shutdown_connections 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73940663a0 0x7f7394068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73a80cef80 0x7f73a81542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73a80b7ab0 0x7f73a8153d90 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 --2- 172.21.15.37:0/1534583059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73a80b4340 0x7f73a81f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 >> 172.21.15.37:0/1534583059 conn(0x7f73a8073090 msgr2=0x7f73a8069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 shutdown_connections 2023-07-09T21:36:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:05.985+0000 7f73ae234640 1 -- 172.21.15.37:0/1534583059 wait complete. 2023-07-09T21:36:06.006 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:36:06.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:36:06.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 Processor -- start 2023-07-09T21:36:06.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 -- start start 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f198406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f19840b4340 0x7f19840d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b49f0 con 0x7f19840cef80 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19840b7e80 con 0x7f19840b4340 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1989b8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19840cc8a0 con 0x7f19840b7ab0 2023-07-09T21:36:06.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1982ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f19840cef80 0x7f19840b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33890/0 (socket says 172.21.15.37:33890) 2023-07-09T21:36:06.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1982ffd640 1 -- 172.21.15.37:0/423668544 learned_addr learned my addr 172.21.15.37:0/423668544 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19837fe640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f198406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f1983fff640 1 --2- 172.21.15.37:0/423668544 >> v2:172.21.15.119:3300/0 conn(0x7f19840b4340 0x7f19840d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374205056 0 0) 0x7f19840b49f0 con 0x7f19840cef80 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f196c003530 con 0x7f19840cef80 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568053333 0 0) 0x7f196c003530 con 0x7f19840cef80 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 msgr2=0x7f198406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f198406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 >> v2:172.21.15.119:3300/0 conn(0x7f19840b4340 msgr2=0x7f19840d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 --2- 172.21.15.37:0/423668544 >> v2:172.21.15.119:3300/0 conn(0x7f19840b4340 0x7f19840d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840ccb80 con 0x7f19840cef80 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1978001680 con 0x7f19840cef80 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.149+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 >> v1:172.21.15.37:6789/0 conn(0x7f19840cef80 legacy=0x7f19840b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f196c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c003f00 0x7f196c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c004d10 0x7f196c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19840cc8a0 con 0x7f196c003f00 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c00b990 con 0x7f196c004d10 2023-07-09T21:36:06.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c00bad0 con 0x7f19840b7ab0 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c003f00 0x7f196c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19837fe640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f196c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1983fff640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c004d10 0x7f196c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 -- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 msgr2=0x7f196c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19840b7ab0 0x7f196c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 -- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c004d10 msgr2=0x7f196c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:06.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c004d10 0x7f196c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 -- 172.21.15.37:0/423668544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c003530 con 0x7f196c003f00 2023-07-09T21:36:06.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1983fff640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f196c004d10 0x7f196c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f1982ffd640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c003f00 0x7f196c0047d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f197800c240 tx=0x7f197801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66e3fab0676a6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978005ae0 con 0x7f196c003f00 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19780ab070 con 0x7f196c003f00 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.153+0000 7f19827fc640 1 -- 172.21.15.37:0/423668544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978007070 con 0x7f196c003f00 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- 172.21.15.37:0/423668544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c003f00 msgr2=0x7f196c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 --2- 172.21.15.37:0/423668544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c003f00 0x7f196c0047d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f197800c240 tx=0x7f197801f3d0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1983fff640 1 -- 172.21.15.37:0/423668544 reap_dead start 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- 172.21.15.37:0/423668544 shutdown_connections 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- 172.21.15.37:0/423668544 >> 172.21.15.37:0/423668544 conn(0x7f1984073090 msgr2=0x7f1984069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- 172.21.15.37:0/423668544 shutdown_connections 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- 172.21.15.37:0/423668544 wait complete. 2023-07-09T21:36:06.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 Processor -- start 2023-07-09T21:36:06.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- start start 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c003f00 0x7f198415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19840cbab0 0x7f19840d1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198415cd00 con 0x7f198414b500 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198414beb0 con 0x7f19840cbab0 2023-07-09T21:36:06.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1989b8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198415e9f0 con 0x7f196c003f00 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1983fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1983fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33482/0 (socket says 172.21.15.37:33482) 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1983fff640 1 -- 172.21.15.37:0/4016119609 learned_addr learned my addr 172.21.15.37:0/4016119609 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f1982ffd640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19840cbab0 0x7f19840d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.157+0000 7f19837fe640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c003f00 0x7f198415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 -- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c003f00 msgr2=0x7f198415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c003f00 0x7f198415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 -- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19840cbab0 msgr2=0x7f19840d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19840cbab0 0x7f19840d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 -- 172.21.15.37:0/4016119609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198415ecd0 con 0x7f198414b500 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1983fff640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f19840b4d10 tx=0x7f197c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c01b070 con 0x7f198414b500 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197c00f040 con 0x7f198414b500 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c00e050 con 0x7f198414b500 2023-07-09T21:36:06.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198415efb0 con 0x7f198414b500 2023-07-09T21:36:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198415e600 con 0x7f198414b500 2023-07-09T21:36:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198404d7d0 con 0x7f198414b500 2023-07-09T21:36:06.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f197c015650 con 0x7f198414b500 2023-07-09T21:36:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 0x7f1970068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f197c083eb0 con 0x7f198414b500 2023-07-09T21:36:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.161+0000 7f19837fe640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 0x7f1970068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.165+0000 7f19837fe640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 0x7f1970068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1974009a40 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.165+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f197c051100 con 0x7f198414b500 2023-07-09T21:36:06.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.325+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f19840c5ce0 con 0x7f19700663d0 2023-07-09T21:36:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.333+0000 7f196bfff640 1 -- 172.21.15.37:0/4016119609 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306281 (secure 0 0 0) 0x7f1974014a90 con 0x7f19700663d0 2023-07-09T21:36:06.337 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:06.339 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:36:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 msgr2=0x7f1970068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 0x7f1970068880 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1974009a40 tx=0x7f1974008040 comp rx=0 tx=0).stop 2023-07-09T21:36:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 msgr2=0x7f198414b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f19840b4d10 tx=0x7f197c007e40 comp rx=0 tx=0).stop 2023-07-09T21:36:06.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 shutdown_connections 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f198414b500 0x7f198414b970 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19840cbab0 0x7f19840d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f19700663d0 0x7f1970068880 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 --2- 172.21.15.37:0/4016119609 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f196c003f00 0x7f198415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 >> 172.21.15.37:0/4016119609 conn(0x7f1984073090 msgr2=0x7f19840b67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 shutdown_connections 2023-07-09T21:36:06.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.337+0000 7f1989b8f640 1 -- 172.21.15.37:0/4016119609 wait complete. 2023-07-09T21:36:06.357 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:36:05.953666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304060,"kb_used_data":7292,"kb_used_omap":0,"kb_used_meta":296704,"kb_avail":754670660,"statfs":{"total":773094113280,"available":772782755840,"internally_reserved":0,"allocated":7467008,"data_stored":4277484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":303824896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.749329"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214625+0000","last_change":"2023-07-09T21:36:01.214625+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214625+0000","last_undegraded":"2023-07-09T21:36:01.214625+0000","last_fullsized":"2023-07-09T21:36:01.214625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219141+0000","last_change":"2023-07-09T21:36:01.219141+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219141+0000","last_undegraded":"2023-07-09T21:36:01.219141+0000","last_fullsized":"2023-07-09T21:36:01.219141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.231962+0000","last_change":"2023-07-09T21:36:01.231962+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.231962+0000","last_undegraded":"2023-07-09T21:36:01.231962+0000","last_fullsized":"2023-07-09T21:36:01.231962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218103+0000","last_change":"2023-07-09T21:36:01.218103+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218103+0000","last_undegraded":"2023-07-09T21:36:01.218103+0000","last_fullsized":"2023-07-09T21:36:01.218103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214657+0000","last_change":"2023-07-09T21:36:01.214657+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214657+0000","last_undegraded":"2023-07-09T21:36:01.214657+0000","last_fullsized":"2023-07-09T21:36:01.214657+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213994+0000","last_change":"2023-07-09T21:36:01.213994+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213994+0000","last_undegraded":"2023-07-09T21:36:01.213994+0000","last_fullsized":"2023-07-09T21:36:01.213994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229978+0000","last_change":"2023-07-09T21:36:01.229978+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229978+0000","last_undegraded":"2023-07-09T21:36:01.229978+0000","last_fullsized":"2023-07-09T21:36:01.229978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221067+0000","last_change":"2023-07-09T21:36:01.221067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221067+0000","last_undegraded":"2023-07-09T21:36:01.221067+0000","last_fullsized":"2023-07-09T21:36:01.221067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218815+0000","last_change":"2023-07-09T21:36:01.218815+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218815+0000","last_undegraded":"2023-07-09T21:36:01.218815+0000","last_fullsized":"2023-07-09T21:36:01.218815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214407+0000","last_change":"2023-07-09T21:36:01.214407+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214407+0000","last_undegraded":"2023-07-09T21:36:01.214407+0000","last_fullsized":"2023-07-09T21:36:01.214407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216728+0000","last_change":"2023-07-09T21:36:01.216728+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216728+0000","last_undegraded":"2023-07-09T21:36:01.216728+0000","last_fullsized":"2023-07-09T21:36:01.216728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219230+0000","last_change":"2023-07-09T21:36:01.219230+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219230+0000","last_undegraded":"2023-07-09T21:36:01.219230+0000","last_fullsized":"2023-07-09T21:36:01.219230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214210+0000","last_change":"2023-07-09T21:36:01.214210+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214210+0000","last_undegraded":"2023-07-09T21:36:01.214210+0000","last_fullsized":"2023-07-09T21:36:01.214210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229391+0000","last_change":"2023-07-09T21:36:01.229391+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229391+0000","last_undegraded":"2023-07-09T21:36:01.229391+0000","last_fullsized":"2023-07-09T21:36:01.229391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218771+0000","last_change":"2023-07-09T21:36:01.218771+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218771+0000","last_undegraded":"2023-07-09T21:36:01.218771+0000","last_fullsized":"2023-07-09T21:36:01.218771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211974+0000","last_change":"2023-07-09T21:36:01.211974+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211974+0000","last_undegraded":"2023-07-09T21:36:01.211974+0000","last_fullsized":"2023-07-09T21:36:01.211974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228930+0000","last_change":"2023-07-09T21:36:01.228930+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228930+0000","last_undegraded":"2023-07-09T21:36:01.228930+0000","last_fullsized":"2023-07-09T21:36:01.228930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218691+0000","last_change":"2023-07-09T21:36:01.218691+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218691+0000","last_undegraded":"2023-07-09T21:36:01.218691+0000","last_fullsized":"2023-07-09T21:36:01.218691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227921+0000","last_change":"2023-07-09T21:36:01.227921+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227921+0000","last_undegraded":"2023-07-09T21:36:01.227921+0000","last_fullsized":"2023-07-09T21:36:01.227921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219378+0000","last_change":"2023-07-09T21:36:01.219378+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219378+0000","last_undegraded":"2023-07-09T21:36:01.219378+0000","last_fullsized":"2023-07-09T21:36:01.219378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218309+0000","last_change":"2023-07-09T21:36:01.218309+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218309+0000","last_undegraded":"2023-07-09T21:36:01.218309+0000","last_fullsized":"2023-07-09T21:36:01.218309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217281+0000","last_change":"2023-07-09T21:36:01.217281+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217281+0000","last_undegraded":"2023-07-09T21:36:01.217281+0000","last_fullsized":"2023-07-09T21:36:01.217281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217020+0000","last_change":"2023-07-09T21:36:01.217020+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217020+0000","last_undegraded":"2023-07-09T21:36:01.217020+0000","last_fullsized":"2023-07-09T21:36:01.217020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227401+0000","last_change":"2023-07-09T21:36:01.227401+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227401+0000","last_undegraded":"2023-07-09T21:36:01.227401+0000","last_fullsized":"2023-07-09T21:36:01.227401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228500+0000","last_change":"2023-07-09T21:36:01.228500+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228500+0000","last_undegraded":"2023-07-09T21:36:01.228500+0000","last_fullsized":"2023-07-09T21:36:01.228500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217871+0000","last_change":"2023-07-09T21:36:01.217871+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217871+0000","last_undegraded":"2023-07-09T21:36:01.217871+0000","last_fullsized":"2023-07-09T21:36:01.217871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.212461+0000","last_change":"2023-07-09T21:36:01.212461+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.212461+0000","last_undegraded":"2023-07-09T21:36:01.212461+0000","last_fullsized":"2023-07-09T21:36:01.212461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218886+0000","last_change":"2023-07-09T21:36:01.218886+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218886+0000","last_undegraded":"2023-07-09T21:36:01.218886+0000","last_fullsized":"2023-07-09T21:36:01.218886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.224476+0000","last_change":"2023-07-09T21:36:01.224476+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.224476+0000","last_undegraded":"2023-07-09T21:36:01.224476+0000","last_fullsized":"2023-07-09T21:36:01.224476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219617+0000","last_change":"2023-07-09T21:36:01.219617+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219617+0000","last_undegraded":"2023-07-09T21:36:01.219617+0000","last_fullsized":"2023-07-09T21:36:01.219617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222811+0000","last_change":"2023-07-09T21:36:01.222811+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222811+0000","last_undegraded":"2023-07-09T21:36:01.222811+0000","last_fullsized":"2023-07-09T21:36:01.222811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216709+0000","last_change":"2023-07-09T21:36:01.216709+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216709+0000","last_undegraded":"2023-07-09T21:36:01.216709+0000","last_fullsized":"2023-07-09T21:36:01.216709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217987+0000","last_change":"2023-07-09T21:36:01.217987+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217987+0000","last_undegraded":"2023-07-09T21:36:01.217987+0000","last_fullsized":"2023-07-09T21:36:01.217987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230310+0000","last_change":"2023-07-09T21:36:01.225140+0000","last_active":"2023-07-09T21:36:01.230310+0000","last_peered":"2023-07-09T21:36:01.230310+0000","last_clean":"2023-07-09T21:36:01.230310+0000","last_became_active":"2023-07-09T21:36:01.224854+0000","last_became_peered":"2023-07-09T21:36:01.224854+0000","last_unstale":"2023-07-09T21:36:01.230310+0000","last_undegraded":"2023-07-09T21:36:01.230310+0000","last_fullsized":"2023-07-09T21:36:01.230310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:54.307331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217313+0000","last_change":"2023-07-09T21:36:01.217313+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217313+0000","last_undegraded":"2023-07-09T21:36:01.217313+0000","last_fullsized":"2023-07-09T21:36:01.217313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228361+0000","last_change":"2023-07-09T21:36:01.222625+0000","last_active":"2023-07-09T21:36:01.228361+0000","last_peered":"2023-07-09T21:36:01.228361+0000","last_clean":"2023-07-09T21:36:01.228361+0000","last_became_active":"2023-07-09T21:36:01.222368+0000","last_became_peered":"2023-07-09T21:36:01.222368+0000","last_unstale":"2023-07-09T21:36:01.228361+0000","last_undegraded":"2023-07-09T21:36:01.228361+0000","last_fullsized":"2023-07-09T21:36:01.228361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218875+0000","last_change":"2023-07-09T21:36:01.218875+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218875+0000","last_undegraded":"2023-07-09T21:36:01.218875+0000","last_fullsized":"2023-07-09T21:36:01.218875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228491+0000","last_change":"2023-07-09T21:36:01.223626+0000","last_active":"2023-07-09T21:36:01.228491+0000","last_peered":"2023-07-09T21:36:01.228491+0000","last_clean":"2023-07-09T21:36:01.228491+0000","last_became_active":"2023-07-09T21:36:01.223318+0000","last_became_peered":"2023-07-09T21:36:01.223318+0000","last_unstale":"2023-07-09T21:36:01.228491+0000","last_undegraded":"2023-07-09T21:36:01.228491+0000","last_fullsized":"2023-07-09T21:36:01.228491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215990+0000","last_change":"2023-07-09T21:36:01.215990+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215990+0000","last_undegraded":"2023-07-09T21:36:01.215990+0000","last_fullsized":"2023-07-09T21:36:01.215990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229331+0000","last_change":"2023-07-09T21:36:01.228047+0000","last_active":"2023-07-09T21:36:01.229331+0000","last_peered":"2023-07-09T21:36:01.229331+0000","last_clean":"2023-07-09T21:36:01.229331+0000","last_became_active":"2023-07-09T21:36:01.227750+0000","last_became_peered":"2023-07-09T21:36:01.227750+0000","last_unstale":"2023-07-09T21:36:01.229331+0000","last_undegraded":"2023-07-09T21:36:01.229331+0000","last_fullsized":"2023-07-09T21:36:01.229331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:02.308925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213951+0000","last_change":"2023-07-09T21:36:01.213951+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213951+0000","last_undegraded":"2023-07-09T21:36:01.213951+0000","last_fullsized":"2023-07-09T21:36:01.213951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235458+0000","last_change":"2023-07-09T21:36:01.230840+0000","last_active":"2023-07-09T21:36:01.235458+0000","last_peered":"2023-07-09T21:36:01.235458+0000","last_clean":"2023-07-09T21:36:01.235458+0000","last_became_active":"2023-07-09T21:36:01.230598+0000","last_became_peered":"2023-07-09T21:36:01.230598+0000","last_unstale":"2023-07-09T21:36:01.235458+0000","last_undegraded":"2023-07-09T21:36:01.235458+0000","last_fullsized":"2023-07-09T21:36:01.235458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219981+0000","last_change":"2023-07-09T21:36:01.219981+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219981+0000","last_undegraded":"2023-07-09T21:36:01.219981+0000","last_fullsized":"2023-07-09T21:36:01.219981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229798+0000","last_change":"2023-07-09T21:36:01.225992+0000","last_active":"2023-07-09T21:36:01.229798+0000","last_peered":"2023-07-09T21:36:01.229798+0000","last_clean":"2023-07-09T21:36:01.229798+0000","last_became_active":"2023-07-09T21:36:01.225688+0000","last_became_peered":"2023-07-09T21:36:01.225688+0000","last_unstale":"2023-07-09T21:36:01.229798+0000","last_undegraded":"2023-07-09T21:36:01.229798+0000","last_fullsized":"2023-07-09T21:36:01.229798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.823883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215352+0000","last_change":"2023-07-09T21:36:01.215352+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215352+0000","last_undegraded":"2023-07-09T21:36:01.215352+0000","last_fullsized":"2023-07-09T21:36:01.215352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231389+0000","last_change":"2023-07-09T21:36:01.228681+0000","last_active":"2023-07-09T21:36:01.231389+0000","last_peered":"2023-07-09T21:36:01.231389+0000","last_clean":"2023-07-09T21:36:01.231389+0000","last_became_active":"2023-07-09T21:36:01.228276+0000","last_became_peered":"2023-07-09T21:36:01.228276+0000","last_unstale":"2023-07-09T21:36:01.231389+0000","last_undegraded":"2023-07-09T21:36:01.231389+0000","last_fullsized":"2023-07-09T21:36:01.231389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:27.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220096+0000","last_change":"2023-07-09T21:36:01.220096+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220096+0000","last_undegraded":"2023-07-09T21:36:01.220096+0000","last_fullsized":"2023-07-09T21:36:01.220096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235518+0000","last_change":"2023-07-09T21:36:01.231014+0000","last_active":"2023-07-09T21:36:01.235518+0000","last_peered":"2023-07-09T21:36:01.235518+0000","last_clean":"2023-07-09T21:36:01.235518+0000","last_became_active":"2023-07-09T21:36:01.230682+0000","last_became_peered":"2023-07-09T21:36:01.230682+0000","last_unstale":"2023-07-09T21:36:01.235518+0000","last_undegraded":"2023-07-09T21:36:01.235518+0000","last_fullsized":"2023-07-09T21:36:01.235518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:36:43.375800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213586+0000","last_change":"2023-07-09T21:36:01.213586+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213586+0000","last_undegraded":"2023-07-09T21:36:01.213586+0000","last_fullsized":"2023-07-09T21:36:01.213586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229490+0000","last_change":"2023-07-09T21:36:01.225914+0000","last_active":"2023-07-09T21:36:01.229490+0000","last_peered":"2023-07-09T21:36:01.229490+0000","last_clean":"2023-07-09T21:36:01.229490+0000","last_became_active":"2023-07-09T21:36:01.225617+0000","last_became_peered":"2023-07-09T21:36:01.225617+0000","last_unstale":"2023-07-09T21:36:01.229490+0000","last_undegraded":"2023-07-09T21:36:01.229490+0000","last_fullsized":"2023-07-09T21:36:01.229490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:11.663547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219802+0000","last_change":"2023-07-09T21:36:01.219802+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219802+0000","last_undegraded":"2023-07-09T21:36:01.219802+0000","last_fullsized":"2023-07-09T21:36:01.219802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.238164+0000","last_change":"2023-07-09T21:36:01.237174+0000","last_active":"2023-07-09T21:36:01.238164+0000","last_peered":"2023-07-09T21:36:01.238164+0000","last_clean":"2023-07-09T21:36:01.238164+0000","last_became_active":"2023-07-09T21:36:01.236851+0000","last_became_peered":"2023-07-09T21:36:01.236851+0000","last_unstale":"2023-07-09T21:36:01.238164+0000","last_undegraded":"2023-07-09T21:36:01.238164+0000","last_fullsized":"2023-07-09T21:36:01.238164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:09.546508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220826+0000","last_change":"2023-07-09T21:36:01.220826+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220826+0000","last_undegraded":"2023-07-09T21:36:01.220826+0000","last_fullsized":"2023-07-09T21:36:01.220826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.233574+0000","last_change":"2023-07-09T21:36:01.232591+0000","last_active":"2023-07-09T21:36:01.233574+0000","last_peered":"2023-07-09T21:36:01.233574+0000","last_clean":"2023-07-09T21:36:01.233574+0000","last_became_active":"2023-07-09T21:36:01.232256+0000","last_became_peered":"2023-07-09T21:36:01.232256+0000","last_unstale":"2023-07-09T21:36:01.233574+0000","last_undegraded":"2023-07-09T21:36:01.233574+0000","last_fullsized":"2023-07-09T21:36:01.233574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:46.363306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214067+0000","last_change":"2023-07-09T21:36:01.214067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214067+0000","last_undegraded":"2023-07-09T21:36:01.214067+0000","last_fullsized":"2023-07-09T21:36:01.214067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229726+0000","last_change":"2023-07-09T21:36:01.223493+0000","last_active":"2023-07-09T21:36:01.229726+0000","last_peered":"2023-07-09T21:36:01.229726+0000","last_clean":"2023-07-09T21:36:01.229726+0000","last_became_active":"2023-07-09T21:36:01.223158+0000","last_became_peered":"2023-07-09T21:36:01.223158+0000","last_unstale":"2023-07-09T21:36:01.229726+0000","last_undegraded":"2023-07-09T21:36:01.229726+0000","last_fullsized":"2023-07-09T21:36:01.229726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:58.832715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217572+0000","last_change":"2023-07-09T21:36:01.217572+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217572+0000","last_undegraded":"2023-07-09T21:36:01.217572+0000","last_fullsized":"2023-07-09T21:36:01.217572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236780+0000","last_change":"2023-07-09T21:36:01.234205+0000","last_active":"2023-07-09T21:36:01.236780+0000","last_peered":"2023-07-09T21:36:01.236780+0000","last_clean":"2023-07-09T21:36:01.236780+0000","last_became_active":"2023-07-09T21:36:01.233906+0000","last_became_peered":"2023-07-09T21:36:01.233906+0000","last_unstale":"2023-07-09T21:36:01.236780+0000","last_undegraded":"2023-07-09T21:36:01.236780+0000","last_fullsized":"2023-07-09T21:36:01.236780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222268+0000","last_change":"2023-07-09T21:36:01.222268+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222268+0000","last_undegraded":"2023-07-09T21:36:01.222268+0000","last_fullsized":"2023-07-09T21:36:01.222268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240088+0000","last_change":"2023-07-09T21:36:01.239215+0000","last_active":"2023-07-09T21:36:01.240088+0000","last_peered":"2023-07-09T21:36:01.240088+0000","last_clean":"2023-07-09T21:36:01.240088+0000","last_became_active":"2023-07-09T21:36:01.238884+0000","last_became_peered":"2023-07-09T21:36:01.238884+0000","last_unstale":"2023-07-09T21:36:01.240088+0000","last_undegraded":"2023-07-09T21:36:01.240088+0000","last_fullsized":"2023-07-09T21:36:01.240088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:15.058041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217348+0000","last_change":"2023-07-09T21:36:01.217348+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217348+0000","last_undegraded":"2023-07-09T21:36:01.217348+0000","last_fullsized":"2023-07-09T21:36:01.217348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229642+0000","last_change":"2023-07-09T21:36:01.227138+0000","last_active":"2023-07-09T21:36:01.229642+0000","last_peered":"2023-07-09T21:36:01.229642+0000","last_clean":"2023-07-09T21:36:01.229642+0000","last_became_active":"2023-07-09T21:36:01.226875+0000","last_became_peered":"2023-07-09T21:36:01.226875+0000","last_unstale":"2023-07-09T21:36:01.229642+0000","last_undegraded":"2023-07-09T21:36:01.229642+0000","last_fullsized":"2023-07-09T21:36:01.229642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:05.648987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221078+0000","last_change":"2023-07-09T21:36:01.221078+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221078+0000","last_undegraded":"2023-07-09T21:36:01.221078+0000","last_fullsized":"2023-07-09T21:36:01.221078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236579+0000","last_change":"2023-07-09T21:36:01.229147+0000","last_active":"2023-07-09T21:36:01.236579+0000","last_peered":"2023-07-09T21:36:01.236579+0000","last_clean":"2023-07-09T21:36:01.236579+0000","last_became_active":"2023-07-09T21:36:01.228799+0000","last_became_peered":"2023-07-09T21:36:01.228799+0000","last_unstale":"2023-07-09T21:36:01.236579+0000","last_undegraded":"2023-07-09T21:36:01.236579+0000","last_fullsized":"2023-07-09T21:36:01.236579+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216012+0000","last_change":"2023-07-09T21:36:01.216012+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216012+0000","last_undegraded":"2023-07-09T21:36:01.216012+0000","last_fullsized":"2023-07-09T21:36:01.216012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.241954+0000","last_change":"2023-07-09T21:36:01.237532+0000","last_active":"2023-07-09T21:36:01.241954+0000","last_peered":"2023-07-09T21:36:01.241954+0000","last_clean":"2023-07-09T21:36:01.241954+0000","last_became_active":"2023-07-09T21:36:01.237228+0000","last_became_peered":"2023-07-09T21:36:01.237228+0000","last_unstale":"2023-07-09T21:36:01.241954+0000","last_undegraded":"2023-07-09T21:36:01.241954+0000","last_fullsized":"2023-07-09T21:36:01.241954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.210677+0000","last_change":"2023-07-09T21:36:01.210677+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.210677+0000","last_undegraded":"2023-07-09T21:36:01.210677+0000","last_fullsized":"2023-07-09T21:36:01.210677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230258+0000","last_change":"2023-07-09T21:36:01.227765+0000","last_active":"2023-07-09T21:36:01.230258+0000","last_peered":"2023-07-09T21:36:01.230258+0000","last_clean":"2023-07-09T21:36:01.230258+0000","last_became_active":"2023-07-09T21:36:01.227290+0000","last_became_peered":"2023-07-09T21:36:01.227290+0000","last_unstale":"2023-07-09T21:36:01.230258+0000","last_undegraded":"2023-07-09T21:36:01.230258+0000","last_fullsized":"2023-07-09T21:36:01.230258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:31.702346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214479+0000","last_change":"2023-07-09T21:36:01.214479+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214479+0000","last_undegraded":"2023-07-09T21:36:01.214479+0000","last_fullsized":"2023-07-09T21:36:01.214479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231430+0000","last_change":"2023-07-09T21:36:01.229042+0000","last_active":"2023-07-09T21:36:01.231430+0000","last_peered":"2023-07-09T21:36:01.231430+0000","last_clean":"2023-07-09T21:36:01.231430+0000","last_became_active":"2023-07-09T21:36:01.228766+0000","last_became_peered":"2023-07-09T21:36:01.228766+0000","last_unstale":"2023-07-09T21:36:01.231430+0000","last_undegraded":"2023-07-09T21:36:01.231430+0000","last_fullsized":"2023-07-09T21:36:01.231430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:46.414811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211343+0000","last_change":"2023-07-09T21:36:01.211343+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211343+0000","last_undegraded":"2023-07-09T21:36:01.211343+0000","last_fullsized":"2023-07-09T21:36:01.211343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230810+0000","last_change":"2023-07-09T21:36:01.227794+0000","last_active":"2023-07-09T21:36:01.230810+0000","last_peered":"2023-07-09T21:36:01.230810+0000","last_clean":"2023-07-09T21:36:01.230810+0000","last_became_active":"2023-07-09T21:36:01.227432+0000","last_became_peered":"2023-07-09T21:36:01.227432+0000","last_unstale":"2023-07-09T21:36:01.230810+0000","last_undegraded":"2023-07-09T21:36:01.230810+0000","last_fullsized":"2023-07-09T21:36:01.230810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:39.920318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216112+0000","last_change":"2023-07-09T21:36:01.216112+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216112+0000","last_undegraded":"2023-07-09T21:36:01.216112+0000","last_fullsized":"2023-07-09T21:36:01.216112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227748+0000","last_change":"2023-07-09T21:36:01.219033+0000","last_active":"2023-07-09T21:36:01.227748+0000","last_peered":"2023-07-09T21:36:01.227748+0000","last_clean":"2023-07-09T21:36:01.227748+0000","last_became_active":"2023-07-09T21:36:01.218767+0000","last_became_peered":"2023-07-09T21:36:01.218767+0000","last_unstale":"2023-07-09T21:36:01.227748+0000","last_undegraded":"2023-07-09T21:36:01.227748+0000","last_fullsized":"2023-07-09T21:36:01.227748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220334+0000","last_change":"2023-07-09T21:36:01.220334+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220334+0000","last_undegraded":"2023-07-09T21:36:01.220334+0000","last_fullsized":"2023-07-09T21:36:01.220334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229396+0000","last_change":"2023-07-09T21:36:01.223457+0000","last_active":"2023-07-09T21:36:01.229396+0000","last_peered":"2023-07-09T21:36:01.229396+0000","last_clean":"2023-07-09T21:36:01.229396+0000","last_became_active":"2023-07-09T21:36:01.223181+0000","last_became_peered":"2023-07-09T21:36:01.223181+0000","last_unstale":"2023-07-09T21:36:01.229396+0000","last_undegraded":"2023-07-09T21:36:01.229396+0000","last_fullsized":"2023-07-09T21:36:01.229396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:00.759984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215192+0000","last_change":"2023-07-09T21:36:01.215192+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215192+0000","last_undegraded":"2023-07-09T21:36:01.215192+0000","last_fullsized":"2023-07-09T21:36:01.215192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.239311+0000","last_change":"2023-07-09T21:36:01.236520+0000","last_active":"2023-07-09T21:36:01.239311+0000","last_peered":"2023-07-09T21:36:01.239311+0000","last_clean":"2023-07-09T21:36:01.239311+0000","last_became_active":"2023-07-09T21:36:01.236238+0000","last_became_peered":"2023-07-09T21:36:01.236238+0000","last_unstale":"2023-07-09T21:36:01.239311+0000","last_undegraded":"2023-07-09T21:36:01.239311+0000","last_fullsized":"2023-07-09T21:36:01.239311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:13.796084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211744+0000","last_change":"2023-07-09T21:36:01.211744+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211744+0000","last_undegraded":"2023-07-09T21:36:01.211744+0000","last_fullsized":"2023-07-09T21:36:01.211744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228077+0000","last_change":"2023-07-09T21:36:01.224143+0000","last_active":"2023-07-09T21:36:01.228077+0000","last_peered":"2023-07-09T21:36:01.228077+0000","last_clean":"2023-07-09T21:36:01.228077+0000","last_became_active":"2023-07-09T21:36:01.223798+0000","last_became_peered":"2023-07-09T21:36:01.223798+0000","last_unstale":"2023-07-09T21:36:01.228077+0000","last_undegraded":"2023-07-09T21:36:01.228077+0000","last_fullsized":"2023-07-09T21:36:01.228077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:38.870308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218134+0000","last_change":"2023-07-09T21:36:01.218134+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218134+0000","last_undegraded":"2023-07-09T21:36:01.218134+0000","last_fullsized":"2023-07-09T21:36:01.218134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236756+0000","last_change":"2023-07-09T21:36:01.234283+0000","last_active":"2023-07-09T21:36:01.236756+0000","last_peered":"2023-07-09T21:36:01.236756+0000","last_clean":"2023-07-09T21:36:01.236756+0000","last_became_active":"2023-07-09T21:36:01.233983+0000","last_became_peered":"2023-07-09T21:36:01.233983+0000","last_unstale":"2023-07-09T21:36:01.236756+0000","last_undegraded":"2023-07-09T21:36:01.236756+0000","last_fullsized":"2023-07-09T21:36:01.236756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:58.265039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"55'139","reported_seq":331,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218456+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:36:01.218456+0000","last_peered":"2023-07-09T21:36:01.218456+0000","last_clean":"2023-07-09T21:36:01.218456+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:36:01.218456+0000","last_undegraded":"2023-07-09T21:36:01.218456+0000","last_fullsized":"2023-07-09T21:36:01.218456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:49.314189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216570+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:36:01.216570+0000","last_peered":"2023-07-09T21:36:01.216570+0000","last_clean":"2023-07-09T21:36:01.216570+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:36:01.216570+0000","last_undegraded":"2023-07-09T21:36:01.216570+0000","last_fullsized":"2023-07-09T21:36:01.216570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:51.035872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211305+0000","last_change":"2023-07-09T21:36:01.211305+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211305+0000","last_undegraded":"2023-07-09T21:36:01.211305+0000","last_fullsized":"2023-07-09T21:36:01.211305+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231101+0000","last_change":"2023-07-09T21:36:01.229874+0000","last_active":"2023-07-09T21:36:01.231101+0000","last_peered":"2023-07-09T21:36:01.231101+0000","last_clean":"2023-07-09T21:36:01.231101+0000","last_became_active":"2023-07-09T21:36:01.229556+0000","last_became_peered":"2023-07-09T21:36:01.229556+0000","last_unstale":"2023-07-09T21:36:01.231101+0000","last_undegraded":"2023-07-09T21:36:01.231101+0000","last_fullsized":"2023-07-09T21:36:01.231101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:59.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218335+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:36:01.218335+0000","last_peered":"2023-07-09T21:36:01.218335+0000","last_clean":"2023-07-09T21:36:01.218335+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:36:01.218335+0000","last_undegraded":"2023-07-09T21:36:01.218335+0000","last_fullsized":"2023-07-09T21:36:01.218335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:54.317984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215481+0000","last_change":"2023-07-09T21:36:01.215481+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215481+0000","last_undegraded":"2023-07-09T21:36:01.215481+0000","last_fullsized":"2023-07-09T21:36:01.215481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235554+0000","last_change":"2023-07-09T21:36:01.231246+0000","last_active":"2023-07-09T21:36:01.235554+0000","last_peered":"2023-07-09T21:36:01.235554+0000","last_clean":"2023-07-09T21:36:01.235554+0000","last_became_active":"2023-07-09T21:36:01.230971+0000","last_became_peered":"2023-07-09T21:36:01.230971+0000","last_unstale":"2023-07-09T21:36:01.235554+0000","last_undegraded":"2023-07-09T21:36:01.235554+0000","last_fullsized":"2023-07-09T21:36:01.235554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:44.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.217285+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:36:01.217285+0000","last_peered":"2023-07-09T21:36:01.217285+0000","last_clean":"2023-07-09T21:36:01.217285+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:36:01.217285+0000","last_undegraded":"2023-07-09T21:36:01.217285+0000","last_fullsized":"2023-07-09T21:36:01.217285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:21.876274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216235+0000","last_change":"2023-07-09T21:36:01.216235+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216235+0000","last_undegraded":"2023-07-09T21:36:01.216235+0000","last_fullsized":"2023-07-09T21:36:01.216235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240091+0000","last_change":"2023-07-09T21:36:01.239273+0000","last_active":"2023-07-09T21:36:01.240091+0000","last_peered":"2023-07-09T21:36:01.240091+0000","last_clean":"2023-07-09T21:36:01.240091+0000","last_became_active":"2023-07-09T21:36:01.238953+0000","last_became_peered":"2023-07-09T21:36:01.238953+0000","last_unstale":"2023-07-09T21:36:01.240091+0000","last_undegraded":"2023-07-09T21:36:01.240091+0000","last_fullsized":"2023-07-09T21:36:01.240091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:42.934428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216460+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:36:01.216460+0000","last_peered":"2023-07-09T21:36:01.216460+0000","last_clean":"2023-07-09T21:36:01.216460+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:36:01.216460+0000","last_undegraded":"2023-07-09T21:36:01.216460+0000","last_fullsized":"2023-07-09T21:36:01.216460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:38.533925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221267+0000","last_change":"2023-07-09T21:36:01.221267+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221267+0000","last_undegraded":"2023-07-09T21:36:01.221267+0000","last_fullsized":"2023-07-09T21:36:01.221267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.225523+0000","last_change":"2023-07-09T21:36:01.222592+0000","last_active":"2023-07-09T21:36:01.225523+0000","last_peered":"2023-07-09T21:36:01.225523+0000","last_clean":"2023-07-09T21:36:01.225523+0000","last_became_active":"2023-07-09T21:36:01.222323+0000","last_became_peered":"2023-07-09T21:36:01.222323+0000","last_unstale":"2023-07-09T21:36:01.225523+0000","last_undegraded":"2023-07-09T21:36:01.225523+0000","last_fullsized":"2023-07-09T21:36:01.225523+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:23.403556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206151+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:36:01.206151+0000","last_peered":"2023-07-09T21:36:01.206151+0000","last_clean":"2023-07-09T21:36:01.206151+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:36:01.206151+0000","last_undegraded":"2023-07-09T21:36:01.206151+0000","last_fullsized":"2023-07-09T21:36:01.206151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:07.957199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215389+0000","last_change":"2023-07-09T21:36:01.215389+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215389+0000","last_undegraded":"2023-07-09T21:36:01.215389+0000","last_fullsized":"2023-07-09T21:36:01.215389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227098+0000","last_change":"2023-07-09T21:36:01.224719+0000","last_active":"2023-07-09T21:36:01.227098+0000","last_peered":"2023-07-09T21:36:01.227098+0000","last_clean":"2023-07-09T21:36:01.227098+0000","last_became_active":"2023-07-09T21:36:01.224442+0000","last_became_peered":"2023-07-09T21:36:01.224442+0000","last_unstale":"2023-07-09T21:36:01.227098+0000","last_undegraded":"2023-07-09T21:36:01.227098+0000","last_fullsized":"2023-07-09T21:36:01.227098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:26.112728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.220918+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:36:01.220918+0000","last_peered":"2023-07-09T21:36:01.220918+0000","last_clean":"2023-07-09T21:36:01.220918+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:36:01.220918+0000","last_undegraded":"2023-07-09T21:36:01.220918+0000","last_fullsized":"2023-07-09T21:36:01.220918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:13.185257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220209+0000","last_change":"2023-07-09T21:36:01.220209+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220209+0000","last_undegraded":"2023-07-09T21:36:01.220209+0000","last_fullsized":"2023-07-09T21:36:01.220209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229435+0000","last_change":"2023-07-09T21:36:01.224105+0000","last_active":"2023-07-09T21:36:01.229435+0000","last_peered":"2023-07-09T21:36:01.229435+0000","last_clean":"2023-07-09T21:36:01.229435+0000","last_became_active":"2023-07-09T21:36:01.223766+0000","last_became_peered":"2023-07-09T21:36:01.223766+0000","last_unstale":"2023-07-09T21:36:01.229435+0000","last_undegraded":"2023-07-09T21:36:01.229435+0000","last_fullsized":"2023-07-09T21:36:01.229435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:44.479678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206231+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:36:01.206231+0000","last_peered":"2023-07-09T21:36:01.206231+0000","last_clean":"2023-07-09T21:36:01.206231+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:36:01.206231+0000","last_undegraded":"2023-07-09T21:36:01.206231+0000","last_fullsized":"2023-07-09T21:36:01.206231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.377484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217046+0000","last_change":"2023-07-09T21:36:01.217046+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217046+0000","last_undegraded":"2023-07-09T21:36:01.217046+0000","last_fullsized":"2023-07-09T21:36:01.217046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235421+0000","last_change":"2023-07-09T21:36:01.228012+0000","last_active":"2023-07-09T21:36:01.235421+0000","last_peered":"2023-07-09T21:36:01.235421+0000","last_clean":"2023-07-09T21:36:01.235421+0000","last_became_active":"2023-07-09T21:36:01.227731+0000","last_became_peered":"2023-07-09T21:36:01.227731+0000","last_unstale":"2023-07-09T21:36:01.235421+0000","last_undegraded":"2023-07-09T21:36:01.235421+0000","last_fullsized":"2023-07-09T21:36:01.235421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.245605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.221584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:36:01.221584+0000","last_peered":"2023-07-09T21:36:01.221584+0000","last_clean":"2023-07-09T21:36:01.221584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:36:01.221584+0000","last_undegraded":"2023-07-09T21:36:01.221584+0000","last_fullsized":"2023-07-09T21:36:01.221584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:15.554044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575016,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313204,"statfs":{"total":96636764160,"available":96576720896,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93799999999999994,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":0.95599999999999996,"15min":0.998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85699999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.88100000000000001,"5min":0.96199999999999997,"15min":1.619},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81799999999999995,"5min":0.96999999999999997,"15min":1.008},"last":0.87}]},{"osd":3,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":1.665},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.054,"15min":1.2629999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.70199999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.002},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.439,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76800000000000002,"5min":0.93600000000000005,"15min":1.0569999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.52600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.96299999999999997,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.39600000000000002},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":0.97599999999999998},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.996,"15min":1.0569999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76100000000000001,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96999999999999997,"5min":1.0049999999999999,"15min":1.1519999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.45500000000000002},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.165},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45900000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.745,"5min":0.90000000000000002,"15min":1.111},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.871,"5min":0.90600000000000003,"15min":1.1950000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.2070000000000001},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72499999999999998,"15min":0.70399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.246},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90100000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":1.02,"15min":1.02},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.91200000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97199999999999998,"5min":1.01,"15min":1.01},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":1.0169999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.872,"5min":0.998,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":1.014},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.92000000000000004,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.33600000000000002},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":1.02},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":1.165},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0629999999999999,"15min":1.107},"last":0.754}]},{"osd":7,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":0.93600000000000005,"15min":0.997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.98099999999999998,"15min":1.042},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.97799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.92600000000000005,"15min":0.96599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.47099999999999997},"max":{"1min":1.262,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.503},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.016,"5min":1.1799999999999999,"15min":1.208},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2370000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.296},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.48599999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.323},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317880,"statfs":{"total":96636764160,"available":96581509120,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":1.0409999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.374},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.54200000000000004},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.121,"5min":1.2609999999999999,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.995,"5min":1.319,"15min":1.3839999999999999},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.2090000000000001,"15min":1.337},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50800000000000001},"max":{"1min":1.05,"5min":1.417,"15min":1.4850000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3340000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1399999999999999,"5min":1.478,"15min":1.478},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.78800000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624}]},{"osd":3,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.385},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":1.212,"5min":1.212,"15min":1.419},"last":0.93300000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"max":{"1min":1.169,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.083,"5min":1.149,"15min":1.242},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"max":{"1min":0.98099999999999998,"5min":0.999,"15min":1.335},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.83499999999999996,"15min":0.81599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2230000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53600000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83499999999999996,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.753,"15min":0.753},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":1.0489999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.433}]},{"osd":3,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.143},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.274},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.151,"15min":1.6559999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.294,"15min":1.319},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.4350000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.81799999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53500000000000003},"max":{"1min":1.222,"5min":1.3460000000000001,"15min":1.3660000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98899999999999999,"5min":1.2689999999999999,"15min":1.5980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.0780000000000001,"5min":1.365,"15min":1.5740000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:36:06.368 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:36:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.541+0000 7fb991419640 1 Processor -- start 2023-07-09T21:36:06.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.541+0000 7fb991419640 1 -- start start 2023-07-09T21:36:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb991419640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb98c0cef80 0x7fb98c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb991419640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c0b49f0 con 0x7fb98c0b4340 2023-07-09T21:36:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb991419640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb98c0cc8a0 con 0x7fb98c0b7ab0 2023-07-09T21:36:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb991419640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0b7e80 con 0x7fb98c0cef80 2023-07-09T21:36:06.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb983fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb98c0b4340 0x7fb98c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33900/0 (socket says 172.21.15.37:33900) 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb983fff640 1 -- 172.21.15.37:0/4041863136 learned_addr learned my addr 172.21.15.37:0/4041863136 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98b7fe640 1 --2- 172.21.15.37:0/4041863136 >> v2:172.21.15.37:3300/0 conn(0x7fb98c0cef80 0x7fb98c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98a7fc640 1 -- 172.21.15.37:0/4041863136 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744389662 0 0) 0x7fb98c0b49f0 con 0x7fb98c0b4340 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98a7fc640 1 -- 172.21.15.37:0/4041863136 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb978003530 con 0x7fb98c0b4340 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98b7fe640 1 -- 172.21.15.37:0/4041863136 >> v1:172.21.15.119:6789/0 conn(0x7fb98c0b7ab0 legacy=0x7fb98c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98b7fe640 1 -- 172.21.15.37:0/4041863136 >> v1:172.21.15.37:6789/0 conn(0x7fb98c0b4340 legacy=0x7fb98c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98b7fe640 1 -- 172.21.15.37:0/4041863136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c0ccb80 con 0x7fb98c0cef80 2023-07-09T21:36:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.545+0000 7fb98b7fe640 1 --2- 172.21.15.37:0/4041863136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c06aa50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb98401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edde84c1a0452a90 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb98a7fc640 1 -- 172.21.15.37:0/4041863136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9840a59e0 con 0x7fb98c0cef80 2023-07-09T21:36:06.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb98a7fc640 1 -- 172.21.15.37:0/4041863136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9840a5b40 con 0x7fb98c0cef80 2023-07-09T21:36:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb98a7fc640 1 -- 172.21.15.37:0/4041863136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9840ad440 con 0x7fb98c0cef80 2023-07-09T21:36:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- 172.21.15.37:0/4041863136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 msgr2=0x7fb98c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 --2- 172.21.15.37:0/4041863136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c06aa50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb98401c920 comp rx=0 tx=0).stop 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- 172.21.15.37:0/4041863136 shutdown_connections 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 --2- 172.21.15.37:0/4041863136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c06aa50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- 172.21.15.37:0/4041863136 >> 172.21.15.37:0/4041863136 conn(0x7fb98c073090 msgr2=0x7fb98c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- 172.21.15.37:0/4041863136 shutdown_connections 2023-07-09T21:36:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- 172.21.15.37:0/4041863136 wait complete. 2023-07-09T21:36:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 Processor -- start 2023-07-09T21:36:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- start start 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb98c0b4340 0x7fb98c0c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb98c0b7ab0 0x7fb98c1f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c1f7f30 con 0x7fb98c0cef80 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c149e70 con 0x7fb98c0b7ab0 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.549+0000 7fb991419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c0ca7f0 con 0x7fb98c0b4340 2023-07-09T21:36:06.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33502/0 (socket says 172.21.15.37:33502) 2023-07-09T21:36:06.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 -- 172.21.15.37:0/1313992568 learned_addr learned my addr 172.21.15.37:0/1313992568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98affd640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb98c0b4340 0x7fb98c0c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb983fff640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb98c0b7ab0 0x7fb98c1f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 -- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb98c0b4340 msgr2=0x7fb98c0c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb98c0b4340 0x7fb98c0c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 -- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb98c0b7ab0 msgr2=0x7fb98c1f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb98c0b7ab0 0x7fb98c1f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 -- 172.21.15.37:0/1313992568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb984009a70 con 0x7fb98c0cef80 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb98b7fe640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb9840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9840add90 con 0x7fb98c0cef80 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb984009450 con 0x7fb98c0cef80 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9840b9690 con 0x7fb98c0cef80 2023-07-09T21:36:06.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c0caad0 con 0x7fb98c0cef80 2023-07-09T21:36:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c0cb090 con 0x7fb98c0cef80 2023-07-09T21:36:06.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c04d7d0 con 0x7fb98c0cef80 2023-07-09T21:36:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.553+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb9840b97f0 con 0x7fb98c0cef80 2023-07-09T21:36:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.557+0000 7fb9837fe640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 0x7fb96c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.557+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb98411f590 con 0x7fb98c0cef80 2023-07-09T21:36:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.557+0000 7fb98affd640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 0x7fb96c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.557+0000 7fb98affd640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 0x7fb96c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0711b0 tx=0x7fb97c009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.557+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9840ec860 con 0x7fb98c0cef80 2023-07-09T21:36:06.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.709+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb98c0cf4d0 con 0x7fb96c0663a0 2023-07-09T21:36:06.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.717+0000 7fb9837fe640 1 -- 172.21.15.37:0/1313992568 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306281 (secure 0 0 0) 0x7fb97c001c80 con 0x7fb96c0663a0 2023-07-09T21:36:06.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:06.721 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:36:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 msgr2=0x7fb96c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 0x7fb96c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0711b0 tx=0x7fb97c009040 comp rx=0 tx=0).stop 2023-07-09T21:36:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 msgr2=0x7fb98c0b2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb984009d90 tx=0x7fb9840196c0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 shutdown_connections 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb98c0cef80 0x7fb98c0b2470 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb98c0b7ab0 0x7fb98c1f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb96c0663a0 0x7fb96c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 --2- 172.21.15.37:0/1313992568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb98c0b4340 0x7fb98c0c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 >> 172.21.15.37:0/1313992568 conn(0x7fb98c073090 msgr2=0x7fb98c069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:06.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 shutdown_connections 2023-07-09T21:36:06.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.721+0000 7fb991419640 1 -- 172.21.15.37:0/1313992568 wait complete. 2023-07-09T21:36:06.740 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:36:05.953666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304060,"kb_used_data":7292,"kb_used_omap":0,"kb_used_meta":296704,"kb_avail":754670660,"statfs":{"total":773094113280,"available":772782755840,"internally_reserved":0,"allocated":7467008,"data_stored":4277484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":303824896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.749329"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214625+0000","last_change":"2023-07-09T21:36:01.214625+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214625+0000","last_undegraded":"2023-07-09T21:36:01.214625+0000","last_fullsized":"2023-07-09T21:36:01.214625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219141+0000","last_change":"2023-07-09T21:36:01.219141+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219141+0000","last_undegraded":"2023-07-09T21:36:01.219141+0000","last_fullsized":"2023-07-09T21:36:01.219141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.231962+0000","last_change":"2023-07-09T21:36:01.231962+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.231962+0000","last_undegraded":"2023-07-09T21:36:01.231962+0000","last_fullsized":"2023-07-09T21:36:01.231962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218103+0000","last_change":"2023-07-09T21:36:01.218103+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218103+0000","last_undegraded":"2023-07-09T21:36:01.218103+0000","last_fullsized":"2023-07-09T21:36:01.218103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214657+0000","last_change":"2023-07-09T21:36:01.214657+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214657+0000","last_undegraded":"2023-07-09T21:36:01.214657+0000","last_fullsized":"2023-07-09T21:36:01.214657+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213994+0000","last_change":"2023-07-09T21:36:01.213994+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213994+0000","last_undegraded":"2023-07-09T21:36:01.213994+0000","last_fullsized":"2023-07-09T21:36:01.213994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229978+0000","last_change":"2023-07-09T21:36:01.229978+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229978+0000","last_undegraded":"2023-07-09T21:36:01.229978+0000","last_fullsized":"2023-07-09T21:36:01.229978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221067+0000","last_change":"2023-07-09T21:36:01.221067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221067+0000","last_undegraded":"2023-07-09T21:36:01.221067+0000","last_fullsized":"2023-07-09T21:36:01.221067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218815+0000","last_change":"2023-07-09T21:36:01.218815+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218815+0000","last_undegraded":"2023-07-09T21:36:01.218815+0000","last_fullsized":"2023-07-09T21:36:01.218815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214407+0000","last_change":"2023-07-09T21:36:01.214407+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214407+0000","last_undegraded":"2023-07-09T21:36:01.214407+0000","last_fullsized":"2023-07-09T21:36:01.214407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216728+0000","last_change":"2023-07-09T21:36:01.216728+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216728+0000","last_undegraded":"2023-07-09T21:36:01.216728+0000","last_fullsized":"2023-07-09T21:36:01.216728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219230+0000","last_change":"2023-07-09T21:36:01.219230+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219230+0000","last_undegraded":"2023-07-09T21:36:01.219230+0000","last_fullsized":"2023-07-09T21:36:01.219230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214210+0000","last_change":"2023-07-09T21:36:01.214210+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214210+0000","last_undegraded":"2023-07-09T21:36:01.214210+0000","last_fullsized":"2023-07-09T21:36:01.214210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229391+0000","last_change":"2023-07-09T21:36:01.229391+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229391+0000","last_undegraded":"2023-07-09T21:36:01.229391+0000","last_fullsized":"2023-07-09T21:36:01.229391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218771+0000","last_change":"2023-07-09T21:36:01.218771+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218771+0000","last_undegraded":"2023-07-09T21:36:01.218771+0000","last_fullsized":"2023-07-09T21:36:01.218771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211974+0000","last_change":"2023-07-09T21:36:01.211974+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211974+0000","last_undegraded":"2023-07-09T21:36:01.211974+0000","last_fullsized":"2023-07-09T21:36:01.211974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228930+0000","last_change":"2023-07-09T21:36:01.228930+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228930+0000","last_undegraded":"2023-07-09T21:36:01.228930+0000","last_fullsized":"2023-07-09T21:36:01.228930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218691+0000","last_change":"2023-07-09T21:36:01.218691+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218691+0000","last_undegraded":"2023-07-09T21:36:01.218691+0000","last_fullsized":"2023-07-09T21:36:01.218691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227921+0000","last_change":"2023-07-09T21:36:01.227921+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227921+0000","last_undegraded":"2023-07-09T21:36:01.227921+0000","last_fullsized":"2023-07-09T21:36:01.227921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219378+0000","last_change":"2023-07-09T21:36:01.219378+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219378+0000","last_undegraded":"2023-07-09T21:36:01.219378+0000","last_fullsized":"2023-07-09T21:36:01.219378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218309+0000","last_change":"2023-07-09T21:36:01.218309+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218309+0000","last_undegraded":"2023-07-09T21:36:01.218309+0000","last_fullsized":"2023-07-09T21:36:01.218309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217281+0000","last_change":"2023-07-09T21:36:01.217281+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217281+0000","last_undegraded":"2023-07-09T21:36:01.217281+0000","last_fullsized":"2023-07-09T21:36:01.217281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217020+0000","last_change":"2023-07-09T21:36:01.217020+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217020+0000","last_undegraded":"2023-07-09T21:36:01.217020+0000","last_fullsized":"2023-07-09T21:36:01.217020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227401+0000","last_change":"2023-07-09T21:36:01.227401+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227401+0000","last_undegraded":"2023-07-09T21:36:01.227401+0000","last_fullsized":"2023-07-09T21:36:01.227401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228500+0000","last_change":"2023-07-09T21:36:01.228500+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228500+0000","last_undegraded":"2023-07-09T21:36:01.228500+0000","last_fullsized":"2023-07-09T21:36:01.228500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217871+0000","last_change":"2023-07-09T21:36:01.217871+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217871+0000","last_undegraded":"2023-07-09T21:36:01.217871+0000","last_fullsized":"2023-07-09T21:36:01.217871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.212461+0000","last_change":"2023-07-09T21:36:01.212461+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.212461+0000","last_undegraded":"2023-07-09T21:36:01.212461+0000","last_fullsized":"2023-07-09T21:36:01.212461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218886+0000","last_change":"2023-07-09T21:36:01.218886+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218886+0000","last_undegraded":"2023-07-09T21:36:01.218886+0000","last_fullsized":"2023-07-09T21:36:01.218886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.224476+0000","last_change":"2023-07-09T21:36:01.224476+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.224476+0000","last_undegraded":"2023-07-09T21:36:01.224476+0000","last_fullsized":"2023-07-09T21:36:01.224476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219617+0000","last_change":"2023-07-09T21:36:01.219617+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219617+0000","last_undegraded":"2023-07-09T21:36:01.219617+0000","last_fullsized":"2023-07-09T21:36:01.219617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222811+0000","last_change":"2023-07-09T21:36:01.222811+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222811+0000","last_undegraded":"2023-07-09T21:36:01.222811+0000","last_fullsized":"2023-07-09T21:36:01.222811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216709+0000","last_change":"2023-07-09T21:36:01.216709+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216709+0000","last_undegraded":"2023-07-09T21:36:01.216709+0000","last_fullsized":"2023-07-09T21:36:01.216709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217987+0000","last_change":"2023-07-09T21:36:01.217987+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217987+0000","last_undegraded":"2023-07-09T21:36:01.217987+0000","last_fullsized":"2023-07-09T21:36:01.217987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230310+0000","last_change":"2023-07-09T21:36:01.225140+0000","last_active":"2023-07-09T21:36:01.230310+0000","last_peered":"2023-07-09T21:36:01.230310+0000","last_clean":"2023-07-09T21:36:01.230310+0000","last_became_active":"2023-07-09T21:36:01.224854+0000","last_became_peered":"2023-07-09T21:36:01.224854+0000","last_unstale":"2023-07-09T21:36:01.230310+0000","last_undegraded":"2023-07-09T21:36:01.230310+0000","last_fullsized":"2023-07-09T21:36:01.230310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:54.307331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217313+0000","last_change":"2023-07-09T21:36:01.217313+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217313+0000","last_undegraded":"2023-07-09T21:36:01.217313+0000","last_fullsized":"2023-07-09T21:36:01.217313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228361+0000","last_change":"2023-07-09T21:36:01.222625+0000","last_active":"2023-07-09T21:36:01.228361+0000","last_peered":"2023-07-09T21:36:01.228361+0000","last_clean":"2023-07-09T21:36:01.228361+0000","last_became_active":"2023-07-09T21:36:01.222368+0000","last_became_peered":"2023-07-09T21:36:01.222368+0000","last_unstale":"2023-07-09T21:36:01.228361+0000","last_undegraded":"2023-07-09T21:36:01.228361+0000","last_fullsized":"2023-07-09T21:36:01.228361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218875+0000","last_change":"2023-07-09T21:36:01.218875+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218875+0000","last_undegraded":"2023-07-09T21:36:01.218875+0000","last_fullsized":"2023-07-09T21:36:01.218875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228491+0000","last_change":"2023-07-09T21:36:01.223626+0000","last_active":"2023-07-09T21:36:01.228491+0000","last_peered":"2023-07-09T21:36:01.228491+0000","last_clean":"2023-07-09T21:36:01.228491+0000","last_became_active":"2023-07-09T21:36:01.223318+0000","last_became_peered":"2023-07-09T21:36:01.223318+0000","last_unstale":"2023-07-09T21:36:01.228491+0000","last_undegraded":"2023-07-09T21:36:01.228491+0000","last_fullsized":"2023-07-09T21:36:01.228491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215990+0000","last_change":"2023-07-09T21:36:01.215990+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215990+0000","last_undegraded":"2023-07-09T21:36:01.215990+0000","last_fullsized":"2023-07-09T21:36:01.215990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229331+0000","last_change":"2023-07-09T21:36:01.228047+0000","last_active":"2023-07-09T21:36:01.229331+0000","last_peered":"2023-07-09T21:36:01.229331+0000","last_clean":"2023-07-09T21:36:01.229331+0000","last_became_active":"2023-07-09T21:36:01.227750+0000","last_became_peered":"2023-07-09T21:36:01.227750+0000","last_unstale":"2023-07-09T21:36:01.229331+0000","last_undegraded":"2023-07-09T21:36:01.229331+0000","last_fullsized":"2023-07-09T21:36:01.229331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:02.308925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213951+0000","last_change":"2023-07-09T21:36:01.213951+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213951+0000","last_undegraded":"2023-07-09T21:36:01.213951+0000","last_fullsized":"2023-07-09T21:36:01.213951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235458+0000","last_change":"2023-07-09T21:36:01.230840+0000","last_active":"2023-07-09T21:36:01.235458+0000","last_peered":"2023-07-09T21:36:01.235458+0000","last_clean":"2023-07-09T21:36:01.235458+0000","last_became_active":"2023-07-09T21:36:01.230598+0000","last_became_peered":"2023-07-09T21:36:01.230598+0000","last_unstale":"2023-07-09T21:36:01.235458+0000","last_undegraded":"2023-07-09T21:36:01.235458+0000","last_fullsized":"2023-07-09T21:36:01.235458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219981+0000","last_change":"2023-07-09T21:36:01.219981+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219981+0000","last_undegraded":"2023-07-09T21:36:01.219981+0000","last_fullsized":"2023-07-09T21:36:01.219981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229798+0000","last_change":"2023-07-09T21:36:01.225992+0000","last_active":"2023-07-09T21:36:01.229798+0000","last_peered":"2023-07-09T21:36:01.229798+0000","last_clean":"2023-07-09T21:36:01.229798+0000","last_became_active":"2023-07-09T21:36:01.225688+0000","last_became_peered":"2023-07-09T21:36:01.225688+0000","last_unstale":"2023-07-09T21:36:01.229798+0000","last_undegraded":"2023-07-09T21:36:01.229798+0000","last_fullsized":"2023-07-09T21:36:01.229798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.823883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215352+0000","last_change":"2023-07-09T21:36:01.215352+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215352+0000","last_undegraded":"2023-07-09T21:36:01.215352+0000","last_fullsized":"2023-07-09T21:36:01.215352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231389+0000","last_change":"2023-07-09T21:36:01.228681+0000","last_active":"2023-07-09T21:36:01.231389+0000","last_peered":"2023-07-09T21:36:01.231389+0000","last_clean":"2023-07-09T21:36:01.231389+0000","last_became_active":"2023-07-09T21:36:01.228276+0000","last_became_peered":"2023-07-09T21:36:01.228276+0000","last_unstale":"2023-07-09T21:36:01.231389+0000","last_undegraded":"2023-07-09T21:36:01.231389+0000","last_fullsized":"2023-07-09T21:36:01.231389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:27.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220096+0000","last_change":"2023-07-09T21:36:01.220096+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220096+0000","last_undegraded":"2023-07-09T21:36:01.220096+0000","last_fullsized":"2023-07-09T21:36:01.220096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235518+0000","last_change":"2023-07-09T21:36:01.231014+0000","last_active":"2023-07-09T21:36:01.235518+0000","last_peered":"2023-07-09T21:36:01.235518+0000","last_clean":"2023-07-09T21:36:01.235518+0000","last_became_active":"2023-07-09T21:36:01.230682+0000","last_became_peered":"2023-07-09T21:36:01.230682+0000","last_unstale":"2023-07-09T21:36:01.235518+0000","last_undegraded":"2023-07-09T21:36:01.235518+0000","last_fullsized":"2023-07-09T21:36:01.235518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:36:43.375800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213586+0000","last_change":"2023-07-09T21:36:01.213586+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213586+0000","last_undegraded":"2023-07-09T21:36:01.213586+0000","last_fullsized":"2023-07-09T21:36:01.213586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229490+0000","last_change":"2023-07-09T21:36:01.225914+0000","last_active":"2023-07-09T21:36:01.229490+0000","last_peered":"2023-07-09T21:36:01.229490+0000","last_clean":"2023-07-09T21:36:01.229490+0000","last_became_active":"2023-07-09T21:36:01.225617+0000","last_became_peered":"2023-07-09T21:36:01.225617+0000","last_unstale":"2023-07-09T21:36:01.229490+0000","last_undegraded":"2023-07-09T21:36:01.229490+0000","last_fullsized":"2023-07-09T21:36:01.229490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:11.663547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219802+0000","last_change":"2023-07-09T21:36:01.219802+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219802+0000","last_undegraded":"2023-07-09T21:36:01.219802+0000","last_fullsized":"2023-07-09T21:36:01.219802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.238164+0000","last_change":"2023-07-09T21:36:01.237174+0000","last_active":"2023-07-09T21:36:01.238164+0000","last_peered":"2023-07-09T21:36:01.238164+0000","last_clean":"2023-07-09T21:36:01.238164+0000","last_became_active":"2023-07-09T21:36:01.236851+0000","last_became_peered":"2023-07-09T21:36:01.236851+0000","last_unstale":"2023-07-09T21:36:01.238164+0000","last_undegraded":"2023-07-09T21:36:01.238164+0000","last_fullsized":"2023-07-09T21:36:01.238164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:09.546508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220826+0000","last_change":"2023-07-09T21:36:01.220826+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220826+0000","last_undegraded":"2023-07-09T21:36:01.220826+0000","last_fullsized":"2023-07-09T21:36:01.220826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.233574+0000","last_change":"2023-07-09T21:36:01.232591+0000","last_active":"2023-07-09T21:36:01.233574+0000","last_peered":"2023-07-09T21:36:01.233574+0000","last_clean":"2023-07-09T21:36:01.233574+0000","last_became_active":"2023-07-09T21:36:01.232256+0000","last_became_peered":"2023-07-09T21:36:01.232256+0000","last_unstale":"2023-07-09T21:36:01.233574+0000","last_undegraded":"2023-07-09T21:36:01.233574+0000","last_fullsized":"2023-07-09T21:36:01.233574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:46.363306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214067+0000","last_change":"2023-07-09T21:36:01.214067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214067+0000","last_undegraded":"2023-07-09T21:36:01.214067+0000","last_fullsized":"2023-07-09T21:36:01.214067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229726+0000","last_change":"2023-07-09T21:36:01.223493+0000","last_active":"2023-07-09T21:36:01.229726+0000","last_peered":"2023-07-09T21:36:01.229726+0000","last_clean":"2023-07-09T21:36:01.229726+0000","last_became_active":"2023-07-09T21:36:01.223158+0000","last_became_peered":"2023-07-09T21:36:01.223158+0000","last_unstale":"2023-07-09T21:36:01.229726+0000","last_undegraded":"2023-07-09T21:36:01.229726+0000","last_fullsized":"2023-07-09T21:36:01.229726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:58.832715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217572+0000","last_change":"2023-07-09T21:36:01.217572+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217572+0000","last_undegraded":"2023-07-09T21:36:01.217572+0000","last_fullsized":"2023-07-09T21:36:01.217572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236780+0000","last_change":"2023-07-09T21:36:01.234205+0000","last_active":"2023-07-09T21:36:01.236780+0000","last_peered":"2023-07-09T21:36:01.236780+0000","last_clean":"2023-07-09T21:36:01.236780+0000","last_became_active":"2023-07-09T21:36:01.233906+0000","last_became_peered":"2023-07-09T21:36:01.233906+0000","last_unstale":"2023-07-09T21:36:01.236780+0000","last_undegraded":"2023-07-09T21:36:01.236780+0000","last_fullsized":"2023-07-09T21:36:01.236780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222268+0000","last_change":"2023-07-09T21:36:01.222268+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222268+0000","last_undegraded":"2023-07-09T21:36:01.222268+0000","last_fullsized":"2023-07-09T21:36:01.222268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240088+0000","last_change":"2023-07-09T21:36:01.239215+0000","last_active":"2023-07-09T21:36:01.240088+0000","last_peered":"2023-07-09T21:36:01.240088+0000","last_clean":"2023-07-09T21:36:01.240088+0000","last_became_active":"2023-07-09T21:36:01.238884+0000","last_became_peered":"2023-07-09T21:36:01.238884+0000","last_unstale":"2023-07-09T21:36:01.240088+0000","last_undegraded":"2023-07-09T21:36:01.240088+0000","last_fullsized":"2023-07-09T21:36:01.240088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:15.058041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217348+0000","last_change":"2023-07-09T21:36:01.217348+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217348+0000","last_undegraded":"2023-07-09T21:36:01.217348+0000","last_fullsized":"2023-07-09T21:36:01.217348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229642+0000","last_change":"2023-07-09T21:36:01.227138+0000","last_active":"2023-07-09T21:36:01.229642+0000","last_peered":"2023-07-09T21:36:01.229642+0000","last_clean":"2023-07-09T21:36:01.229642+0000","last_became_active":"2023-07-09T21:36:01.226875+0000","last_became_peered":"2023-07-09T21:36:01.226875+0000","last_unstale":"2023-07-09T21:36:01.229642+0000","last_undegraded":"2023-07-09T21:36:01.229642+0000","last_fullsized":"2023-07-09T21:36:01.229642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:05.648987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221078+0000","last_change":"2023-07-09T21:36:01.221078+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221078+0000","last_undegraded":"2023-07-09T21:36:01.221078+0000","last_fullsized":"2023-07-09T21:36:01.221078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236579+0000","last_change":"2023-07-09T21:36:01.229147+0000","last_active":"2023-07-09T21:36:01.236579+0000","last_peered":"2023-07-09T21:36:01.236579+0000","last_clean":"2023-07-09T21:36:01.236579+0000","last_became_active":"2023-07-09T21:36:01.228799+0000","last_became_peered":"2023-07-09T21:36:01.228799+0000","last_unstale":"2023-07-09T21:36:01.236579+0000","last_undegraded":"2023-07-09T21:36:01.236579+0000","last_fullsized":"2023-07-09T21:36:01.236579+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216012+0000","last_change":"2023-07-09T21:36:01.216012+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216012+0000","last_undegraded":"2023-07-09T21:36:01.216012+0000","last_fullsized":"2023-07-09T21:36:01.216012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.241954+0000","last_change":"2023-07-09T21:36:01.237532+0000","last_active":"2023-07-09T21:36:01.241954+0000","last_peered":"2023-07-09T21:36:01.241954+0000","last_clean":"2023-07-09T21:36:01.241954+0000","last_became_active":"2023-07-09T21:36:01.237228+0000","last_became_peered":"2023-07-09T21:36:01.237228+0000","last_unstale":"2023-07-09T21:36:01.241954+0000","last_undegraded":"2023-07-09T21:36:01.241954+0000","last_fullsized":"2023-07-09T21:36:01.241954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.210677+0000","last_change":"2023-07-09T21:36:01.210677+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.210677+0000","last_undegraded":"2023-07-09T21:36:01.210677+0000","last_fullsized":"2023-07-09T21:36:01.210677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230258+0000","last_change":"2023-07-09T21:36:01.227765+0000","last_active":"2023-07-09T21:36:01.230258+0000","last_peered":"2023-07-09T21:36:01.230258+0000","last_clean":"2023-07-09T21:36:01.230258+0000","last_became_active":"2023-07-09T21:36:01.227290+0000","last_became_peered":"2023-07-09T21:36:01.227290+0000","last_unstale":"2023-07-09T21:36:01.230258+0000","last_undegraded":"2023-07-09T21:36:01.230258+0000","last_fullsized":"2023-07-09T21:36:01.230258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:31.702346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214479+0000","last_change":"2023-07-09T21:36:01.214479+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214479+0000","last_undegraded":"2023-07-09T21:36:01.214479+0000","last_fullsized":"2023-07-09T21:36:01.214479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231430+0000","last_change":"2023-07-09T21:36:01.229042+0000","last_active":"2023-07-09T21:36:01.231430+0000","last_peered":"2023-07-09T21:36:01.231430+0000","last_clean":"2023-07-09T21:36:01.231430+0000","last_became_active":"2023-07-09T21:36:01.228766+0000","last_became_peered":"2023-07-09T21:36:01.228766+0000","last_unstale":"2023-07-09T21:36:01.231430+0000","last_undegraded":"2023-07-09T21:36:01.231430+0000","last_fullsized":"2023-07-09T21:36:01.231430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:46.414811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211343+0000","last_change":"2023-07-09T21:36:01.211343+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211343+0000","last_undegraded":"2023-07-09T21:36:01.211343+0000","last_fullsized":"2023-07-09T21:36:01.211343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230810+0000","last_change":"2023-07-09T21:36:01.227794+0000","last_active":"2023-07-09T21:36:01.230810+0000","last_peered":"2023-07-09T21:36:01.230810+0000","last_clean":"2023-07-09T21:36:01.230810+0000","last_became_active":"2023-07-09T21:36:01.227432+0000","last_became_peered":"2023-07-09T21:36:01.227432+0000","last_unstale":"2023-07-09T21:36:01.230810+0000","last_undegraded":"2023-07-09T21:36:01.230810+0000","last_fullsized":"2023-07-09T21:36:01.230810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:39.920318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216112+0000","last_change":"2023-07-09T21:36:01.216112+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216112+0000","last_undegraded":"2023-07-09T21:36:01.216112+0000","last_fullsized":"2023-07-09T21:36:01.216112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227748+0000","last_change":"2023-07-09T21:36:01.219033+0000","last_active":"2023-07-09T21:36:01.227748+0000","last_peered":"2023-07-09T21:36:01.227748+0000","last_clean":"2023-07-09T21:36:01.227748+0000","last_became_active":"2023-07-09T21:36:01.218767+0000","last_became_peered":"2023-07-09T21:36:01.218767+0000","last_unstale":"2023-07-09T21:36:01.227748+0000","last_undegraded":"2023-07-09T21:36:01.227748+0000","last_fullsized":"2023-07-09T21:36:01.227748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220334+0000","last_change":"2023-07-09T21:36:01.220334+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220334+0000","last_undegraded":"2023-07-09T21:36:01.220334+0000","last_fullsized":"2023-07-09T21:36:01.220334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229396+0000","last_change":"2023-07-09T21:36:01.223457+0000","last_active":"2023-07-09T21:36:01.229396+0000","last_peered":"2023-07-09T21:36:01.229396+0000","last_clean":"2023-07-09T21:36:01.229396+0000","last_became_active":"2023-07-09T21:36:01.223181+0000","last_became_peered":"2023-07-09T21:36:01.223181+0000","last_unstale":"2023-07-09T21:36:01.229396+0000","last_undegraded":"2023-07-09T21:36:01.229396+0000","last_fullsized":"2023-07-09T21:36:01.229396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:00.759984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215192+0000","last_change":"2023-07-09T21:36:01.215192+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215192+0000","last_undegraded":"2023-07-09T21:36:01.215192+0000","last_fullsized":"2023-07-09T21:36:01.215192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.239311+0000","last_change":"2023-07-09T21:36:01.236520+0000","last_active":"2023-07-09T21:36:01.239311+0000","last_peered":"2023-07-09T21:36:01.239311+0000","last_clean":"2023-07-09T21:36:01.239311+0000","last_became_active":"2023-07-09T21:36:01.236238+0000","last_became_peered":"2023-07-09T21:36:01.236238+0000","last_unstale":"2023-07-09T21:36:01.239311+0000","last_undegraded":"2023-07-09T21:36:01.239311+0000","last_fullsized":"2023-07-09T21:36:01.239311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:13.796084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211744+0000","last_change":"2023-07-09T21:36:01.211744+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211744+0000","last_undegraded":"2023-07-09T21:36:01.211744+0000","last_fullsized":"2023-07-09T21:36:01.211744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228077+0000","last_change":"2023-07-09T21:36:01.224143+0000","last_active":"2023-07-09T21:36:01.228077+0000","last_peered":"2023-07-09T21:36:01.228077+0000","last_clean":"2023-07-09T21:36:01.228077+0000","last_became_active":"2023-07-09T21:36:01.223798+0000","last_became_peered":"2023-07-09T21:36:01.223798+0000","last_unstale":"2023-07-09T21:36:01.228077+0000","last_undegraded":"2023-07-09T21:36:01.228077+0000","last_fullsized":"2023-07-09T21:36:01.228077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:38.870308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218134+0000","last_change":"2023-07-09T21:36:01.218134+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218134+0000","last_undegraded":"2023-07-09T21:36:01.218134+0000","last_fullsized":"2023-07-09T21:36:01.218134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236756+0000","last_change":"2023-07-09T21:36:01.234283+0000","last_active":"2023-07-09T21:36:01.236756+0000","last_peered":"2023-07-09T21:36:01.236756+0000","last_clean":"2023-07-09T21:36:01.236756+0000","last_became_active":"2023-07-09T21:36:01.233983+0000","last_became_peered":"2023-07-09T21:36:01.233983+0000","last_unstale":"2023-07-09T21:36:01.236756+0000","last_undegraded":"2023-07-09T21:36:01.236756+0000","last_fullsized":"2023-07-09T21:36:01.236756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:58.265039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"55'139","reported_seq":331,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218456+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:36:01.218456+0000","last_peered":"2023-07-09T21:36:01.218456+0000","last_clean":"2023-07-09T21:36:01.218456+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:36:01.218456+0000","last_undegraded":"2023-07-09T21:36:01.218456+0000","last_fullsized":"2023-07-09T21:36:01.218456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:49.314189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216570+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:36:01.216570+0000","last_peered":"2023-07-09T21:36:01.216570+0000","last_clean":"2023-07-09T21:36:01.216570+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:36:01.216570+0000","last_undegraded":"2023-07-09T21:36:01.216570+0000","last_fullsized":"2023-07-09T21:36:01.216570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:51.035872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211305+0000","last_change":"2023-07-09T21:36:01.211305+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211305+0000","last_undegraded":"2023-07-09T21:36:01.211305+0000","last_fullsized":"2023-07-09T21:36:01.211305+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231101+0000","last_change":"2023-07-09T21:36:01.229874+0000","last_active":"2023-07-09T21:36:01.231101+0000","last_peered":"2023-07-09T21:36:01.231101+0000","last_clean":"2023-07-09T21:36:01.231101+0000","last_became_active":"2023-07-09T21:36:01.229556+0000","last_became_peered":"2023-07-09T21:36:01.229556+0000","last_unstale":"2023-07-09T21:36:01.231101+0000","last_undegraded":"2023-07-09T21:36:01.231101+0000","last_fullsized":"2023-07-09T21:36:01.231101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:59.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218335+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:36:01.218335+0000","last_peered":"2023-07-09T21:36:01.218335+0000","last_clean":"2023-07-09T21:36:01.218335+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:36:01.218335+0000","last_undegraded":"2023-07-09T21:36:01.218335+0000","last_fullsized":"2023-07-09T21:36:01.218335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:54.317984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215481+0000","last_change":"2023-07-09T21:36:01.215481+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215481+0000","last_undegraded":"2023-07-09T21:36:01.215481+0000","last_fullsized":"2023-07-09T21:36:01.215481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235554+0000","last_change":"2023-07-09T21:36:01.231246+0000","last_active":"2023-07-09T21:36:01.235554+0000","last_peered":"2023-07-09T21:36:01.235554+0000","last_clean":"2023-07-09T21:36:01.235554+0000","last_became_active":"2023-07-09T21:36:01.230971+0000","last_became_peered":"2023-07-09T21:36:01.230971+0000","last_unstale":"2023-07-09T21:36:01.235554+0000","last_undegraded":"2023-07-09T21:36:01.235554+0000","last_fullsized":"2023-07-09T21:36:01.235554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:44.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.217285+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:36:01.217285+0000","last_peered":"2023-07-09T21:36:01.217285+0000","last_clean":"2023-07-09T21:36:01.217285+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:36:01.217285+0000","last_undegraded":"2023-07-09T21:36:01.217285+0000","last_fullsized":"2023-07-09T21:36:01.217285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:21.876274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216235+0000","last_change":"2023-07-09T21:36:01.216235+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216235+0000","last_undegraded":"2023-07-09T21:36:01.216235+0000","last_fullsized":"2023-07-09T21:36:01.216235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240091+0000","last_change":"2023-07-09T21:36:01.239273+0000","last_active":"2023-07-09T21:36:01.240091+0000","last_peered":"2023-07-09T21:36:01.240091+0000","last_clean":"2023-07-09T21:36:01.240091+0000","last_became_active":"2023-07-09T21:36:01.238953+0000","last_became_peered":"2023-07-09T21:36:01.238953+0000","last_unstale":"2023-07-09T21:36:01.240091+0000","last_undegraded":"2023-07-09T21:36:01.240091+0000","last_fullsized":"2023-07-09T21:36:01.240091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:42.934428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216460+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:36:01.216460+0000","last_peered":"2023-07-09T21:36:01.216460+0000","last_clean":"2023-07-09T21:36:01.216460+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:36:01.216460+0000","last_undegraded":"2023-07-09T21:36:01.216460+0000","last_fullsized":"2023-07-09T21:36:01.216460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:38.533925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221267+0000","last_change":"2023-07-09T21:36:01.221267+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221267+0000","last_undegraded":"2023-07-09T21:36:01.221267+0000","last_fullsized":"2023-07-09T21:36:01.221267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.225523+0000","last_change":"2023-07-09T21:36:01.222592+0000","last_active":"2023-07-09T21:36:01.225523+0000","last_peered":"2023-07-09T21:36:01.225523+0000","last_clean":"2023-07-09T21:36:01.225523+0000","last_became_active":"2023-07-09T21:36:01.222323+0000","last_became_peered":"2023-07-09T21:36:01.222323+0000","last_unstale":"2023-07-09T21:36:01.225523+0000","last_undegraded":"2023-07-09T21:36:01.225523+0000","last_fullsized":"2023-07-09T21:36:01.225523+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:23.403556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206151+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:36:01.206151+0000","last_peered":"2023-07-09T21:36:01.206151+0000","last_clean":"2023-07-09T21:36:01.206151+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:36:01.206151+0000","last_undegraded":"2023-07-09T21:36:01.206151+0000","last_fullsized":"2023-07-09T21:36:01.206151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:07.957199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215389+0000","last_change":"2023-07-09T21:36:01.215389+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215389+0000","last_undegraded":"2023-07-09T21:36:01.215389+0000","last_fullsized":"2023-07-09T21:36:01.215389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227098+0000","last_change":"2023-07-09T21:36:01.224719+0000","last_active":"2023-07-09T21:36:01.227098+0000","last_peered":"2023-07-09T21:36:01.227098+0000","last_clean":"2023-07-09T21:36:01.227098+0000","last_became_active":"2023-07-09T21:36:01.224442+0000","last_became_peered":"2023-07-09T21:36:01.224442+0000","last_unstale":"2023-07-09T21:36:01.227098+0000","last_undegraded":"2023-07-09T21:36:01.227098+0000","last_fullsized":"2023-07-09T21:36:01.227098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:26.112728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.220918+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:36:01.220918+0000","last_peered":"2023-07-09T21:36:01.220918+0000","last_clean":"2023-07-09T21:36:01.220918+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:36:01.220918+0000","last_undegraded":"2023-07-09T21:36:01.220918+0000","last_fullsized":"2023-07-09T21:36:01.220918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:13.185257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220209+0000","last_change":"2023-07-09T21:36:01.220209+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220209+0000","last_undegraded":"2023-07-09T21:36:01.220209+0000","last_fullsized":"2023-07-09T21:36:01.220209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229435+0000","last_change":"2023-07-09T21:36:01.224105+0000","last_active":"2023-07-09T21:36:01.229435+0000","last_peered":"2023-07-09T21:36:01.229435+0000","last_clean":"2023-07-09T21:36:01.229435+0000","last_became_active":"2023-07-09T21:36:01.223766+0000","last_became_peered":"2023-07-09T21:36:01.223766+0000","last_unstale":"2023-07-09T21:36:01.229435+0000","last_undegraded":"2023-07-09T21:36:01.229435+0000","last_fullsized":"2023-07-09T21:36:01.229435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:44.479678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206231+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:36:01.206231+0000","last_peered":"2023-07-09T21:36:01.206231+0000","last_clean":"2023-07-09T21:36:01.206231+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:36:01.206231+0000","last_undegraded":"2023-07-09T21:36:01.206231+0000","last_fullsized":"2023-07-09T21:36:01.206231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.377484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217046+0000","last_change":"2023-07-09T21:36:01.217046+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217046+0000","last_undegraded":"2023-07-09T21:36:01.217046+0000","last_fullsized":"2023-07-09T21:36:01.217046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235421+0000","last_change":"2023-07-09T21:36:01.228012+0000","last_active":"2023-07-09T21:36:01.235421+0000","last_peered":"2023-07-09T21:36:01.235421+0000","last_clean":"2023-07-09T21:36:01.235421+0000","last_became_active":"2023-07-09T21:36:01.227731+0000","last_became_peered":"2023-07-09T21:36:01.227731+0000","last_unstale":"2023-07-09T21:36:01.235421+0000","last_undegraded":"2023-07-09T21:36:01.235421+0000","last_fullsized":"2023-07-09T21:36:01.235421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.245605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.221584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:36:01.221584+0000","last_peered":"2023-07-09T21:36:01.221584+0000","last_clean":"2023-07-09T21:36:01.221584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:36:01.221584+0000","last_undegraded":"2023-07-09T21:36:01.221584+0000","last_fullsized":"2023-07-09T21:36:01.221584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:15.554044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575016,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313204,"statfs":{"total":96636764160,"available":96576720896,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93799999999999994,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":0.95599999999999996,"15min":0.998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85699999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.88100000000000001,"5min":0.96199999999999997,"15min":1.619},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81799999999999995,"5min":0.96999999999999997,"15min":1.008},"last":0.87}]},{"osd":3,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":1.665},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.054,"15min":1.2629999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.70199999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.002},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.439,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76800000000000002,"5min":0.93600000000000005,"15min":1.0569999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.52600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.96299999999999997,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.39600000000000002},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":0.97599999999999998},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.996,"15min":1.0569999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76100000000000001,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96999999999999997,"5min":1.0049999999999999,"15min":1.1519999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.45500000000000002},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.165},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45900000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.745,"5min":0.90000000000000002,"15min":1.111},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.871,"5min":0.90600000000000003,"15min":1.1950000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.2070000000000001},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72499999999999998,"15min":0.70399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.246},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90100000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":1.02,"15min":1.02},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.91200000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97199999999999998,"5min":1.01,"15min":1.01},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":1.0169999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.872,"5min":0.998,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":1.014},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.92000000000000004,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.33600000000000002},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":1.02},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":1.165},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0629999999999999,"15min":1.107},"last":0.754}]},{"osd":7,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":0.93600000000000005,"15min":0.997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.98099999999999998,"15min":1.042},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.97799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.92600000000000005,"15min":0.96599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.47099999999999997},"max":{"1min":1.262,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.503},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.016,"5min":1.1799999999999999,"15min":1.208},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2370000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.296},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.48599999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.323},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317880,"statfs":{"total":96636764160,"available":96581509120,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":1.0409999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.374},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.54200000000000004},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.121,"5min":1.2609999999999999,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.995,"5min":1.319,"15min":1.3839999999999999},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.2090000000000001,"15min":1.337},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50800000000000001},"max":{"1min":1.05,"5min":1.417,"15min":1.4850000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3340000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1399999999999999,"5min":1.478,"15min":1.478},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.78800000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624}]},{"osd":3,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.385},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":1.212,"5min":1.212,"15min":1.419},"last":0.93300000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"max":{"1min":1.169,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.083,"5min":1.149,"15min":1.242},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"max":{"1min":0.98099999999999998,"5min":0.999,"15min":1.335},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.83499999999999996,"15min":0.81599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2230000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53600000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83499999999999996,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.753,"15min":0.753},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":1.0489999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.433}]},{"osd":3,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.143},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.274},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.151,"15min":1.6559999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.294,"15min":1.319},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.4350000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.81799999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53500000000000003},"max":{"1min":1.222,"5min":1.3460000000000001,"15min":1.3660000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98899999999999999,"5min":1.2689999999999999,"15min":1.5980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.0780000000000001,"5min":1.365,"15min":1.5740000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:36:06.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:36:06.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 Processor -- start 2023-07-09T21:36:06.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 -- start start 2023-07-09T21:36:06.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74040b4340 0x7f740406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74040b49f0 con 0x7f74040b7ab0 2023-07-09T21:36:06.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040b7e80 con 0x7f74040b4340 2023-07-09T21:36:06.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f740b759640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74040cc8a0 con 0x7f74040cef80 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7409cf6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74040b4340 0x7f740406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74040b4340 0x7f740406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:38552/0 (socket says 172.21.15.37:38552) 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7409cf6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33646/0 (socket says 172.21.15.37:33646) 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f74094f5640 1 --1- 172.21.15.37:0/2421072466 >> v1:172.21.15.119:6789/0 conn(0x7f74040b7ab0 0x7f74040b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:52324/0 (socket says 172.21.15.37:52324) 2023-07-09T21:36:06.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 -- 172.21.15.37:0/2421072466 learned_addr learned my addr 172.21.15.37:0/2421072466 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 -- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 msgr2=0x7f74040d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 -- 172.21.15.37:0/2421072466 >> v1:172.21.15.119:6789/0 conn(0x7f74040b7ab0 legacy=0x7f74040b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7408cf4640 1 -- 172.21.15.37:0/2421072466 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040ccb80 con 0x7f74040b4340 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f73fbfff640 1 -- 172.21.15.37:0/2421072466 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356144483 0 0) 0x7f74040b49f0 con 0x7f74040b7ab0 2023-07-09T21:36:06.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.925+0000 7f7409cf6640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f7408cf4640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040b4340 0x7f740406aa50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009870 tx=0x7f73f401c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70b03f8fc37acb76 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f73fbfff640 1 -- 172.21.15.37:0/2421072466 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40aa670 con 0x7f74040b4340 2023-07-09T21:36:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f73fbfff640 1 -- 172.21.15.37:0/2421072466 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f40aa7d0 con 0x7f74040b4340 2023-07-09T21:36:06.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f73fbfff640 1 -- 172.21.15.37:0/2421072466 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40aab60 con 0x7f74040b4340 2023-07-09T21:36:06.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f740b759640 1 -- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040b4340 msgr2=0x7f740406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.929+0000 7f740b759640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040b4340 0x7f740406aa50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009870 tx=0x7f73f401c510 comp rx=0 tx=0).stop 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- 172.21.15.37:0/2421072466 shutdown_connections 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040cef80 0x7f74040d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 --2- 172.21.15.37:0/2421072466 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040b4340 0x7f740406aa50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- 172.21.15.37:0/2421072466 >> 172.21.15.37:0/2421072466 conn(0x7f7404073090 msgr2=0x7f7404069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- 172.21.15.37:0/2421072466 shutdown_connections 2023-07-09T21:36:06.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- 172.21.15.37:0/2421072466 wait complete. 2023-07-09T21:36:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 Processor -- start 2023-07-09T21:36:06.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- start start 2023-07-09T21:36:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040b4340 0x7f74040c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 0x7f74040c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041533b0 con 0x7f74040b7ab0 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404153690 con 0x7f74040cef80 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f740b759640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7404153970 con 0x7f74040b4340 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33508/0 (socket says 172.21.15.37:33508) 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 -- 172.21.15.37:0/372374550 learned_addr learned my addr 172.21.15.37:0/372374550 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7409cf6640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 0x7f74040c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f74094f5640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040b4340 0x7f74040c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 -- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040b4340 msgr2=0x7f74040c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040b4340 0x7f74040c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 -- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 msgr2=0x7f74040c6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 0x7f74040c6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7408cf4640 1 -- 172.21.15.37:0/372374550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73fc009a70 con 0x7f74040b7ab0 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.933+0000 7f7409cf6640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 0x7f74040c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f7408cf4640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f73f40ac040 tx=0x7f73f401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40bd5f0 con 0x7f74040b7ab0 2023-07-09T21:36:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f40bd770 con 0x7f74040b7ab0 2023-07-09T21:36:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f40bdb20 con 0x7f74040b7ab0 2023-07-09T21:36:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f40094d0 con 0x7f74040b7ab0 2023-07-09T21:36:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74041530a0 con 0x7f74040b7ab0 2023-07-09T21:36:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f740404d7d0 con 0x7f74040b7ab0 2023-07-09T21:36:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f73f40b3600 con 0x7f74040b7ab0 2023-07-09T21:36:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 0x7f73e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.937+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f73f411f030 con 0x7f74040b7ab0 2023-07-09T21:36:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.941+0000 7f74094f5640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 0x7f73e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:06.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.941+0000 7f74094f5640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 0x7f73e8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7400000f70 tx=0x7f7400007b60 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:06.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:06.941+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73f40ec340 con 0x7f74040b7ab0 2023-07-09T21:36:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.093+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74040cf4d0 con 0x7f73e80663a0 2023-07-09T21:36:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.101+0000 7f73f9ffb640 1 -- 172.21.15.37:0/372374550 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306281 (secure 0 0 0) 0x7f74000071f0 con 0x7f73e80663a0 2023-07-09T21:36:07.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:36:07.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 msgr2=0x7f73e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 0x7f73e8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7400000f70 tx=0x7f7400007b60 comp rx=0 tx=0).stop 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 msgr2=0x7f7404154170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f73f40ac040 tx=0x7f73f401ad50 comp rx=0 tx=0).stop 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 shutdown_connections 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74040cef80 0x7f74040c6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74040b7ab0 0x7f7404154170 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f73e80663a0 0x7f73e8068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 --2- 172.21.15.37:0/372374550 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74040b4340 0x7f74040c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 >> 172.21.15.37:0/372374550 conn(0x7f7404073090 msgr2=0x7f7404158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 shutdown_connections 2023-07-09T21:36:07.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.105+0000 7f740b759640 1 -- 172.21.15.37:0/372374550 wait complete. 2023-07-09T21:36:07.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:36:05.953666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304060,"kb_used_data":7292,"kb_used_omap":0,"kb_used_meta":296704,"kb_avail":754670660,"statfs":{"total":773094113280,"available":772782755840,"internally_reserved":0,"allocated":7467008,"data_stored":4277484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":303824896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.749329"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214625+0000","last_change":"2023-07-09T21:36:01.214625+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214625+0000","last_undegraded":"2023-07-09T21:36:01.214625+0000","last_fullsized":"2023-07-09T21:36:01.214625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219141+0000","last_change":"2023-07-09T21:36:01.219141+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219141+0000","last_undegraded":"2023-07-09T21:36:01.219141+0000","last_fullsized":"2023-07-09T21:36:01.219141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.231962+0000","last_change":"2023-07-09T21:36:01.231962+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.231962+0000","last_undegraded":"2023-07-09T21:36:01.231962+0000","last_fullsized":"2023-07-09T21:36:01.231962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218103+0000","last_change":"2023-07-09T21:36:01.218103+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218103+0000","last_undegraded":"2023-07-09T21:36:01.218103+0000","last_fullsized":"2023-07-09T21:36:01.218103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214657+0000","last_change":"2023-07-09T21:36:01.214657+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214657+0000","last_undegraded":"2023-07-09T21:36:01.214657+0000","last_fullsized":"2023-07-09T21:36:01.214657+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213994+0000","last_change":"2023-07-09T21:36:01.213994+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213994+0000","last_undegraded":"2023-07-09T21:36:01.213994+0000","last_fullsized":"2023-07-09T21:36:01.213994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229978+0000","last_change":"2023-07-09T21:36:01.229978+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229978+0000","last_undegraded":"2023-07-09T21:36:01.229978+0000","last_fullsized":"2023-07-09T21:36:01.229978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221067+0000","last_change":"2023-07-09T21:36:01.221067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221067+0000","last_undegraded":"2023-07-09T21:36:01.221067+0000","last_fullsized":"2023-07-09T21:36:01.221067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218815+0000","last_change":"2023-07-09T21:36:01.218815+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218815+0000","last_undegraded":"2023-07-09T21:36:01.218815+0000","last_fullsized":"2023-07-09T21:36:01.218815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214407+0000","last_change":"2023-07-09T21:36:01.214407+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214407+0000","last_undegraded":"2023-07-09T21:36:01.214407+0000","last_fullsized":"2023-07-09T21:36:01.214407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216728+0000","last_change":"2023-07-09T21:36:01.216728+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216728+0000","last_undegraded":"2023-07-09T21:36:01.216728+0000","last_fullsized":"2023-07-09T21:36:01.216728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219230+0000","last_change":"2023-07-09T21:36:01.219230+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219230+0000","last_undegraded":"2023-07-09T21:36:01.219230+0000","last_fullsized":"2023-07-09T21:36:01.219230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214210+0000","last_change":"2023-07-09T21:36:01.214210+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214210+0000","last_undegraded":"2023-07-09T21:36:01.214210+0000","last_fullsized":"2023-07-09T21:36:01.214210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229391+0000","last_change":"2023-07-09T21:36:01.229391+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229391+0000","last_undegraded":"2023-07-09T21:36:01.229391+0000","last_fullsized":"2023-07-09T21:36:01.229391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218771+0000","last_change":"2023-07-09T21:36:01.218771+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218771+0000","last_undegraded":"2023-07-09T21:36:01.218771+0000","last_fullsized":"2023-07-09T21:36:01.218771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211974+0000","last_change":"2023-07-09T21:36:01.211974+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211974+0000","last_undegraded":"2023-07-09T21:36:01.211974+0000","last_fullsized":"2023-07-09T21:36:01.211974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228930+0000","last_change":"2023-07-09T21:36:01.228930+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228930+0000","last_undegraded":"2023-07-09T21:36:01.228930+0000","last_fullsized":"2023-07-09T21:36:01.228930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218691+0000","last_change":"2023-07-09T21:36:01.218691+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218691+0000","last_undegraded":"2023-07-09T21:36:01.218691+0000","last_fullsized":"2023-07-09T21:36:01.218691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227921+0000","last_change":"2023-07-09T21:36:01.227921+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227921+0000","last_undegraded":"2023-07-09T21:36:01.227921+0000","last_fullsized":"2023-07-09T21:36:01.227921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219378+0000","last_change":"2023-07-09T21:36:01.219378+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219378+0000","last_undegraded":"2023-07-09T21:36:01.219378+0000","last_fullsized":"2023-07-09T21:36:01.219378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218309+0000","last_change":"2023-07-09T21:36:01.218309+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218309+0000","last_undegraded":"2023-07-09T21:36:01.218309+0000","last_fullsized":"2023-07-09T21:36:01.218309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217281+0000","last_change":"2023-07-09T21:36:01.217281+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217281+0000","last_undegraded":"2023-07-09T21:36:01.217281+0000","last_fullsized":"2023-07-09T21:36:01.217281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217020+0000","last_change":"2023-07-09T21:36:01.217020+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217020+0000","last_undegraded":"2023-07-09T21:36:01.217020+0000","last_fullsized":"2023-07-09T21:36:01.217020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227401+0000","last_change":"2023-07-09T21:36:01.227401+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227401+0000","last_undegraded":"2023-07-09T21:36:01.227401+0000","last_fullsized":"2023-07-09T21:36:01.227401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228500+0000","last_change":"2023-07-09T21:36:01.228500+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228500+0000","last_undegraded":"2023-07-09T21:36:01.228500+0000","last_fullsized":"2023-07-09T21:36:01.228500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217871+0000","last_change":"2023-07-09T21:36:01.217871+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217871+0000","last_undegraded":"2023-07-09T21:36:01.217871+0000","last_fullsized":"2023-07-09T21:36:01.217871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.212461+0000","last_change":"2023-07-09T21:36:01.212461+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.212461+0000","last_undegraded":"2023-07-09T21:36:01.212461+0000","last_fullsized":"2023-07-09T21:36:01.212461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218886+0000","last_change":"2023-07-09T21:36:01.218886+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218886+0000","last_undegraded":"2023-07-09T21:36:01.218886+0000","last_fullsized":"2023-07-09T21:36:01.218886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.224476+0000","last_change":"2023-07-09T21:36:01.224476+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.224476+0000","last_undegraded":"2023-07-09T21:36:01.224476+0000","last_fullsized":"2023-07-09T21:36:01.224476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219617+0000","last_change":"2023-07-09T21:36:01.219617+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219617+0000","last_undegraded":"2023-07-09T21:36:01.219617+0000","last_fullsized":"2023-07-09T21:36:01.219617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222811+0000","last_change":"2023-07-09T21:36:01.222811+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222811+0000","last_undegraded":"2023-07-09T21:36:01.222811+0000","last_fullsized":"2023-07-09T21:36:01.222811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216709+0000","last_change":"2023-07-09T21:36:01.216709+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216709+0000","last_undegraded":"2023-07-09T21:36:01.216709+0000","last_fullsized":"2023-07-09T21:36:01.216709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217987+0000","last_change":"2023-07-09T21:36:01.217987+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217987+0000","last_undegraded":"2023-07-09T21:36:01.217987+0000","last_fullsized":"2023-07-09T21:36:01.217987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230310+0000","last_change":"2023-07-09T21:36:01.225140+0000","last_active":"2023-07-09T21:36:01.230310+0000","last_peered":"2023-07-09T21:36:01.230310+0000","last_clean":"2023-07-09T21:36:01.230310+0000","last_became_active":"2023-07-09T21:36:01.224854+0000","last_became_peered":"2023-07-09T21:36:01.224854+0000","last_unstale":"2023-07-09T21:36:01.230310+0000","last_undegraded":"2023-07-09T21:36:01.230310+0000","last_fullsized":"2023-07-09T21:36:01.230310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:54.307331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217313+0000","last_change":"2023-07-09T21:36:01.217313+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217313+0000","last_undegraded":"2023-07-09T21:36:01.217313+0000","last_fullsized":"2023-07-09T21:36:01.217313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228361+0000","last_change":"2023-07-09T21:36:01.222625+0000","last_active":"2023-07-09T21:36:01.228361+0000","last_peered":"2023-07-09T21:36:01.228361+0000","last_clean":"2023-07-09T21:36:01.228361+0000","last_became_active":"2023-07-09T21:36:01.222368+0000","last_became_peered":"2023-07-09T21:36:01.222368+0000","last_unstale":"2023-07-09T21:36:01.228361+0000","last_undegraded":"2023-07-09T21:36:01.228361+0000","last_fullsized":"2023-07-09T21:36:01.228361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218875+0000","last_change":"2023-07-09T21:36:01.218875+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218875+0000","last_undegraded":"2023-07-09T21:36:01.218875+0000","last_fullsized":"2023-07-09T21:36:01.218875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228491+0000","last_change":"2023-07-09T21:36:01.223626+0000","last_active":"2023-07-09T21:36:01.228491+0000","last_peered":"2023-07-09T21:36:01.228491+0000","last_clean":"2023-07-09T21:36:01.228491+0000","last_became_active":"2023-07-09T21:36:01.223318+0000","last_became_peered":"2023-07-09T21:36:01.223318+0000","last_unstale":"2023-07-09T21:36:01.228491+0000","last_undegraded":"2023-07-09T21:36:01.228491+0000","last_fullsized":"2023-07-09T21:36:01.228491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215990+0000","last_change":"2023-07-09T21:36:01.215990+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215990+0000","last_undegraded":"2023-07-09T21:36:01.215990+0000","last_fullsized":"2023-07-09T21:36:01.215990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229331+0000","last_change":"2023-07-09T21:36:01.228047+0000","last_active":"2023-07-09T21:36:01.229331+0000","last_peered":"2023-07-09T21:36:01.229331+0000","last_clean":"2023-07-09T21:36:01.229331+0000","last_became_active":"2023-07-09T21:36:01.227750+0000","last_became_peered":"2023-07-09T21:36:01.227750+0000","last_unstale":"2023-07-09T21:36:01.229331+0000","last_undegraded":"2023-07-09T21:36:01.229331+0000","last_fullsized":"2023-07-09T21:36:01.229331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:02.308925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213951+0000","last_change":"2023-07-09T21:36:01.213951+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213951+0000","last_undegraded":"2023-07-09T21:36:01.213951+0000","last_fullsized":"2023-07-09T21:36:01.213951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235458+0000","last_change":"2023-07-09T21:36:01.230840+0000","last_active":"2023-07-09T21:36:01.235458+0000","last_peered":"2023-07-09T21:36:01.235458+0000","last_clean":"2023-07-09T21:36:01.235458+0000","last_became_active":"2023-07-09T21:36:01.230598+0000","last_became_peered":"2023-07-09T21:36:01.230598+0000","last_unstale":"2023-07-09T21:36:01.235458+0000","last_undegraded":"2023-07-09T21:36:01.235458+0000","last_fullsized":"2023-07-09T21:36:01.235458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219981+0000","last_change":"2023-07-09T21:36:01.219981+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219981+0000","last_undegraded":"2023-07-09T21:36:01.219981+0000","last_fullsized":"2023-07-09T21:36:01.219981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229798+0000","last_change":"2023-07-09T21:36:01.225992+0000","last_active":"2023-07-09T21:36:01.229798+0000","last_peered":"2023-07-09T21:36:01.229798+0000","last_clean":"2023-07-09T21:36:01.229798+0000","last_became_active":"2023-07-09T21:36:01.225688+0000","last_became_peered":"2023-07-09T21:36:01.225688+0000","last_unstale":"2023-07-09T21:36:01.229798+0000","last_undegraded":"2023-07-09T21:36:01.229798+0000","last_fullsized":"2023-07-09T21:36:01.229798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.823883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215352+0000","last_change":"2023-07-09T21:36:01.215352+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215352+0000","last_undegraded":"2023-07-09T21:36:01.215352+0000","last_fullsized":"2023-07-09T21:36:01.215352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231389+0000","last_change":"2023-07-09T21:36:01.228681+0000","last_active":"2023-07-09T21:36:01.231389+0000","last_peered":"2023-07-09T21:36:01.231389+0000","last_clean":"2023-07-09T21:36:01.231389+0000","last_became_active":"2023-07-09T21:36:01.228276+0000","last_became_peered":"2023-07-09T21:36:01.228276+0000","last_unstale":"2023-07-09T21:36:01.231389+0000","last_undegraded":"2023-07-09T21:36:01.231389+0000","last_fullsized":"2023-07-09T21:36:01.231389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:27.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220096+0000","last_change":"2023-07-09T21:36:01.220096+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220096+0000","last_undegraded":"2023-07-09T21:36:01.220096+0000","last_fullsized":"2023-07-09T21:36:01.220096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235518+0000","last_change":"2023-07-09T21:36:01.231014+0000","last_active":"2023-07-09T21:36:01.235518+0000","last_peered":"2023-07-09T21:36:01.235518+0000","last_clean":"2023-07-09T21:36:01.235518+0000","last_became_active":"2023-07-09T21:36:01.230682+0000","last_became_peered":"2023-07-09T21:36:01.230682+0000","last_unstale":"2023-07-09T21:36:01.235518+0000","last_undegraded":"2023-07-09T21:36:01.235518+0000","last_fullsized":"2023-07-09T21:36:01.235518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:36:43.375800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213586+0000","last_change":"2023-07-09T21:36:01.213586+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213586+0000","last_undegraded":"2023-07-09T21:36:01.213586+0000","last_fullsized":"2023-07-09T21:36:01.213586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229490+0000","last_change":"2023-07-09T21:36:01.225914+0000","last_active":"2023-07-09T21:36:01.229490+0000","last_peered":"2023-07-09T21:36:01.229490+0000","last_clean":"2023-07-09T21:36:01.229490+0000","last_became_active":"2023-07-09T21:36:01.225617+0000","last_became_peered":"2023-07-09T21:36:01.225617+0000","last_unstale":"2023-07-09T21:36:01.229490+0000","last_undegraded":"2023-07-09T21:36:01.229490+0000","last_fullsized":"2023-07-09T21:36:01.229490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:11.663547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219802+0000","last_change":"2023-07-09T21:36:01.219802+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219802+0000","last_undegraded":"2023-07-09T21:36:01.219802+0000","last_fullsized":"2023-07-09T21:36:01.219802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.238164+0000","last_change":"2023-07-09T21:36:01.237174+0000","last_active":"2023-07-09T21:36:01.238164+0000","last_peered":"2023-07-09T21:36:01.238164+0000","last_clean":"2023-07-09T21:36:01.238164+0000","last_became_active":"2023-07-09T21:36:01.236851+0000","last_became_peered":"2023-07-09T21:36:01.236851+0000","last_unstale":"2023-07-09T21:36:01.238164+0000","last_undegraded":"2023-07-09T21:36:01.238164+0000","last_fullsized":"2023-07-09T21:36:01.238164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:09.546508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220826+0000","last_change":"2023-07-09T21:36:01.220826+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220826+0000","last_undegraded":"2023-07-09T21:36:01.220826+0000","last_fullsized":"2023-07-09T21:36:01.220826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.233574+0000","last_change":"2023-07-09T21:36:01.232591+0000","last_active":"2023-07-09T21:36:01.233574+0000","last_peered":"2023-07-09T21:36:01.233574+0000","last_clean":"2023-07-09T21:36:01.233574+0000","last_became_active":"2023-07-09T21:36:01.232256+0000","last_became_peered":"2023-07-09T21:36:01.232256+0000","last_unstale":"2023-07-09T21:36:01.233574+0000","last_undegraded":"2023-07-09T21:36:01.233574+0000","last_fullsized":"2023-07-09T21:36:01.233574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:46.363306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214067+0000","last_change":"2023-07-09T21:36:01.214067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214067+0000","last_undegraded":"2023-07-09T21:36:01.214067+0000","last_fullsized":"2023-07-09T21:36:01.214067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229726+0000","last_change":"2023-07-09T21:36:01.223493+0000","last_active":"2023-07-09T21:36:01.229726+0000","last_peered":"2023-07-09T21:36:01.229726+0000","last_clean":"2023-07-09T21:36:01.229726+0000","last_became_active":"2023-07-09T21:36:01.223158+0000","last_became_peered":"2023-07-09T21:36:01.223158+0000","last_unstale":"2023-07-09T21:36:01.229726+0000","last_undegraded":"2023-07-09T21:36:01.229726+0000","last_fullsized":"2023-07-09T21:36:01.229726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:58.832715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217572+0000","last_change":"2023-07-09T21:36:01.217572+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217572+0000","last_undegraded":"2023-07-09T21:36:01.217572+0000","last_fullsized":"2023-07-09T21:36:01.217572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236780+0000","last_change":"2023-07-09T21:36:01.234205+0000","last_active":"2023-07-09T21:36:01.236780+0000","last_peered":"2023-07-09T21:36:01.236780+0000","last_clean":"2023-07-09T21:36:01.236780+0000","last_became_active":"2023-07-09T21:36:01.233906+0000","last_became_peered":"2023-07-09T21:36:01.233906+0000","last_unstale":"2023-07-09T21:36:01.236780+0000","last_undegraded":"2023-07-09T21:36:01.236780+0000","last_fullsized":"2023-07-09T21:36:01.236780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222268+0000","last_change":"2023-07-09T21:36:01.222268+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222268+0000","last_undegraded":"2023-07-09T21:36:01.222268+0000","last_fullsized":"2023-07-09T21:36:01.222268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240088+0000","last_change":"2023-07-09T21:36:01.239215+0000","last_active":"2023-07-09T21:36:01.240088+0000","last_peered":"2023-07-09T21:36:01.240088+0000","last_clean":"2023-07-09T21:36:01.240088+0000","last_became_active":"2023-07-09T21:36:01.238884+0000","last_became_peered":"2023-07-09T21:36:01.238884+0000","last_unstale":"2023-07-09T21:36:01.240088+0000","last_undegraded":"2023-07-09T21:36:01.240088+0000","last_fullsized":"2023-07-09T21:36:01.240088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:15.058041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217348+0000","last_change":"2023-07-09T21:36:01.217348+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217348+0000","last_undegraded":"2023-07-09T21:36:01.217348+0000","last_fullsized":"2023-07-09T21:36:01.217348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229642+0000","last_change":"2023-07-09T21:36:01.227138+0000","last_active":"2023-07-09T21:36:01.229642+0000","last_peered":"2023-07-09T21:36:01.229642+0000","last_clean":"2023-07-09T21:36:01.229642+0000","last_became_active":"2023-07-09T21:36:01.226875+0000","last_became_peered":"2023-07-09T21:36:01.226875+0000","last_unstale":"2023-07-09T21:36:01.229642+0000","last_undegraded":"2023-07-09T21:36:01.229642+0000","last_fullsized":"2023-07-09T21:36:01.229642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:05.648987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221078+0000","last_change":"2023-07-09T21:36:01.221078+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221078+0000","last_undegraded":"2023-07-09T21:36:01.221078+0000","last_fullsized":"2023-07-09T21:36:01.221078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236579+0000","last_change":"2023-07-09T21:36:01.229147+0000","last_active":"2023-07-09T21:36:01.236579+0000","last_peered":"2023-07-09T21:36:01.236579+0000","last_clean":"2023-07-09T21:36:01.236579+0000","last_became_active":"2023-07-09T21:36:01.228799+0000","last_became_peered":"2023-07-09T21:36:01.228799+0000","last_unstale":"2023-07-09T21:36:01.236579+0000","last_undegraded":"2023-07-09T21:36:01.236579+0000","last_fullsized":"2023-07-09T21:36:01.236579+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216012+0000","last_change":"2023-07-09T21:36:01.216012+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216012+0000","last_undegraded":"2023-07-09T21:36:01.216012+0000","last_fullsized":"2023-07-09T21:36:01.216012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.241954+0000","last_change":"2023-07-09T21:36:01.237532+0000","last_active":"2023-07-09T21:36:01.241954+0000","last_peered":"2023-07-09T21:36:01.241954+0000","last_clean":"2023-07-09T21:36:01.241954+0000","last_became_active":"2023-07-09T21:36:01.237228+0000","last_became_peered":"2023-07-09T21:36:01.237228+0000","last_unstale":"2023-07-09T21:36:01.241954+0000","last_undegraded":"2023-07-09T21:36:01.241954+0000","last_fullsized":"2023-07-09T21:36:01.241954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.210677+0000","last_change":"2023-07-09T21:36:01.210677+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.210677+0000","last_undegraded":"2023-07-09T21:36:01.210677+0000","last_fullsized":"2023-07-09T21:36:01.210677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230258+0000","last_change":"2023-07-09T21:36:01.227765+0000","last_active":"2023-07-09T21:36:01.230258+0000","last_peered":"2023-07-09T21:36:01.230258+0000","last_clean":"2023-07-09T21:36:01.230258+0000","last_became_active":"2023-07-09T21:36:01.227290+0000","last_became_peered":"2023-07-09T21:36:01.227290+0000","last_unstale":"2023-07-09T21:36:01.230258+0000","last_undegraded":"2023-07-09T21:36:01.230258+0000","last_fullsized":"2023-07-09T21:36:01.230258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:31.702346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214479+0000","last_change":"2023-07-09T21:36:01.214479+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214479+0000","last_undegraded":"2023-07-09T21:36:01.214479+0000","last_fullsized":"2023-07-09T21:36:01.214479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231430+0000","last_change":"2023-07-09T21:36:01.229042+0000","last_active":"2023-07-09T21:36:01.231430+0000","last_peered":"2023-07-09T21:36:01.231430+0000","last_clean":"2023-07-09T21:36:01.231430+0000","last_became_active":"2023-07-09T21:36:01.228766+0000","last_became_peered":"2023-07-09T21:36:01.228766+0000","last_unstale":"2023-07-09T21:36:01.231430+0000","last_undegraded":"2023-07-09T21:36:01.231430+0000","last_fullsized":"2023-07-09T21:36:01.231430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:46.414811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211343+0000","last_change":"2023-07-09T21:36:01.211343+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211343+0000","last_undegraded":"2023-07-09T21:36:01.211343+0000","last_fullsized":"2023-07-09T21:36:01.211343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230810+0000","last_change":"2023-07-09T21:36:01.227794+0000","last_active":"2023-07-09T21:36:01.230810+0000","last_peered":"2023-07-09T21:36:01.230810+0000","last_clean":"2023-07-09T21:36:01.230810+0000","last_became_active":"2023-07-09T21:36:01.227432+0000","last_became_peered":"2023-07-09T21:36:01.227432+0000","last_unstale":"2023-07-09T21:36:01.230810+0000","last_undegraded":"2023-07-09T21:36:01.230810+0000","last_fullsized":"2023-07-09T21:36:01.230810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:39.920318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216112+0000","last_change":"2023-07-09T21:36:01.216112+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216112+0000","last_undegraded":"2023-07-09T21:36:01.216112+0000","last_fullsized":"2023-07-09T21:36:01.216112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227748+0000","last_change":"2023-07-09T21:36:01.219033+0000","last_active":"2023-07-09T21:36:01.227748+0000","last_peered":"2023-07-09T21:36:01.227748+0000","last_clean":"2023-07-09T21:36:01.227748+0000","last_became_active":"2023-07-09T21:36:01.218767+0000","last_became_peered":"2023-07-09T21:36:01.218767+0000","last_unstale":"2023-07-09T21:36:01.227748+0000","last_undegraded":"2023-07-09T21:36:01.227748+0000","last_fullsized":"2023-07-09T21:36:01.227748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220334+0000","last_change":"2023-07-09T21:36:01.220334+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220334+0000","last_undegraded":"2023-07-09T21:36:01.220334+0000","last_fullsized":"2023-07-09T21:36:01.220334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229396+0000","last_change":"2023-07-09T21:36:01.223457+0000","last_active":"2023-07-09T21:36:01.229396+0000","last_peered":"2023-07-09T21:36:01.229396+0000","last_clean":"2023-07-09T21:36:01.229396+0000","last_became_active":"2023-07-09T21:36:01.223181+0000","last_became_peered":"2023-07-09T21:36:01.223181+0000","last_unstale":"2023-07-09T21:36:01.229396+0000","last_undegraded":"2023-07-09T21:36:01.229396+0000","last_fullsized":"2023-07-09T21:36:01.229396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:00.759984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215192+0000","last_change":"2023-07-09T21:36:01.215192+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215192+0000","last_undegraded":"2023-07-09T21:36:01.215192+0000","last_fullsized":"2023-07-09T21:36:01.215192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.239311+0000","last_change":"2023-07-09T21:36:01.236520+0000","last_active":"2023-07-09T21:36:01.239311+0000","last_peered":"2023-07-09T21:36:01.239311+0000","last_clean":"2023-07-09T21:36:01.239311+0000","last_became_active":"2023-07-09T21:36:01.236238+0000","last_became_peered":"2023-07-09T21:36:01.236238+0000","last_unstale":"2023-07-09T21:36:01.239311+0000","last_undegraded":"2023-07-09T21:36:01.239311+0000","last_fullsized":"2023-07-09T21:36:01.239311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:13.796084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211744+0000","last_change":"2023-07-09T21:36:01.211744+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211744+0000","last_undegraded":"2023-07-09T21:36:01.211744+0000","last_fullsized":"2023-07-09T21:36:01.211744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228077+0000","last_change":"2023-07-09T21:36:01.224143+0000","last_active":"2023-07-09T21:36:01.228077+0000","last_peered":"2023-07-09T21:36:01.228077+0000","last_clean":"2023-07-09T21:36:01.228077+0000","last_became_active":"2023-07-09T21:36:01.223798+0000","last_became_peered":"2023-07-09T21:36:01.223798+0000","last_unstale":"2023-07-09T21:36:01.228077+0000","last_undegraded":"2023-07-09T21:36:01.228077+0000","last_fullsized":"2023-07-09T21:36:01.228077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:38.870308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218134+0000","last_change":"2023-07-09T21:36:01.218134+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218134+0000","last_undegraded":"2023-07-09T21:36:01.218134+0000","last_fullsized":"2023-07-09T21:36:01.218134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236756+0000","last_change":"2023-07-09T21:36:01.234283+0000","last_active":"2023-07-09T21:36:01.236756+0000","last_peered":"2023-07-09T21:36:01.236756+0000","last_clean":"2023-07-09T21:36:01.236756+0000","last_became_active":"2023-07-09T21:36:01.233983+0000","last_became_peered":"2023-07-09T21:36:01.233983+0000","last_unstale":"2023-07-09T21:36:01.236756+0000","last_undegraded":"2023-07-09T21:36:01.236756+0000","last_fullsized":"2023-07-09T21:36:01.236756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:58.265039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"55'139","reported_seq":331,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218456+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:36:01.218456+0000","last_peered":"2023-07-09T21:36:01.218456+0000","last_clean":"2023-07-09T21:36:01.218456+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:36:01.218456+0000","last_undegraded":"2023-07-09T21:36:01.218456+0000","last_fullsized":"2023-07-09T21:36:01.218456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:49.314189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216570+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:36:01.216570+0000","last_peered":"2023-07-09T21:36:01.216570+0000","last_clean":"2023-07-09T21:36:01.216570+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:36:01.216570+0000","last_undegraded":"2023-07-09T21:36:01.216570+0000","last_fullsized":"2023-07-09T21:36:01.216570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:51.035872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211305+0000","last_change":"2023-07-09T21:36:01.211305+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211305+0000","last_undegraded":"2023-07-09T21:36:01.211305+0000","last_fullsized":"2023-07-09T21:36:01.211305+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231101+0000","last_change":"2023-07-09T21:36:01.229874+0000","last_active":"2023-07-09T21:36:01.231101+0000","last_peered":"2023-07-09T21:36:01.231101+0000","last_clean":"2023-07-09T21:36:01.231101+0000","last_became_active":"2023-07-09T21:36:01.229556+0000","last_became_peered":"2023-07-09T21:36:01.229556+0000","last_unstale":"2023-07-09T21:36:01.231101+0000","last_undegraded":"2023-07-09T21:36:01.231101+0000","last_fullsized":"2023-07-09T21:36:01.231101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:59.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218335+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:36:01.218335+0000","last_peered":"2023-07-09T21:36:01.218335+0000","last_clean":"2023-07-09T21:36:01.218335+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:36:01.218335+0000","last_undegraded":"2023-07-09T21:36:01.218335+0000","last_fullsized":"2023-07-09T21:36:01.218335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:54.317984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215481+0000","last_change":"2023-07-09T21:36:01.215481+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215481+0000","last_undegraded":"2023-07-09T21:36:01.215481+0000","last_fullsized":"2023-07-09T21:36:01.215481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235554+0000","last_change":"2023-07-09T21:36:01.231246+0000","last_active":"2023-07-09T21:36:01.235554+0000","last_peered":"2023-07-09T21:36:01.235554+0000","last_clean":"2023-07-09T21:36:01.235554+0000","last_became_active":"2023-07-09T21:36:01.230971+0000","last_became_peered":"2023-07-09T21:36:01.230971+0000","last_unstale":"2023-07-09T21:36:01.235554+0000","last_undegraded":"2023-07-09T21:36:01.235554+0000","last_fullsized":"2023-07-09T21:36:01.235554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:44.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.217285+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:36:01.217285+0000","last_peered":"2023-07-09T21:36:01.217285+0000","last_clean":"2023-07-09T21:36:01.217285+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:36:01.217285+0000","last_undegraded":"2023-07-09T21:36:01.217285+0000","last_fullsized":"2023-07-09T21:36:01.217285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:21.876274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216235+0000","last_change":"2023-07-09T21:36:01.216235+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216235+0000","last_undegraded":"2023-07-09T21:36:01.216235+0000","last_fullsized":"2023-07-09T21:36:01.216235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240091+0000","last_change":"2023-07-09T21:36:01.239273+0000","last_active":"2023-07-09T21:36:01.240091+0000","last_peered":"2023-07-09T21:36:01.240091+0000","last_clean":"2023-07-09T21:36:01.240091+0000","last_became_active":"2023-07-09T21:36:01.238953+0000","last_became_peered":"2023-07-09T21:36:01.238953+0000","last_unstale":"2023-07-09T21:36:01.240091+0000","last_undegraded":"2023-07-09T21:36:01.240091+0000","last_fullsized":"2023-07-09T21:36:01.240091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:42.934428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216460+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:36:01.216460+0000","last_peered":"2023-07-09T21:36:01.216460+0000","last_clean":"2023-07-09T21:36:01.216460+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:36:01.216460+0000","last_undegraded":"2023-07-09T21:36:01.216460+0000","last_fullsized":"2023-07-09T21:36:01.216460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:38.533925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221267+0000","last_change":"2023-07-09T21:36:01.221267+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221267+0000","last_undegraded":"2023-07-09T21:36:01.221267+0000","last_fullsized":"2023-07-09T21:36:01.221267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.225523+0000","last_change":"2023-07-09T21:36:01.222592+0000","last_active":"2023-07-09T21:36:01.225523+0000","last_peered":"2023-07-09T21:36:01.225523+0000","last_clean":"2023-07-09T21:36:01.225523+0000","last_became_active":"2023-07-09T21:36:01.222323+0000","last_became_peered":"2023-07-09T21:36:01.222323+0000","last_unstale":"2023-07-09T21:36:01.225523+0000","last_undegraded":"2023-07-09T21:36:01.225523+0000","last_fullsized":"2023-07-09T21:36:01.225523+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:23.403556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206151+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:36:01.206151+0000","last_peered":"2023-07-09T21:36:01.206151+0000","last_clean":"2023-07-09T21:36:01.206151+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:36:01.206151+0000","last_undegraded":"2023-07-09T21:36:01.206151+0000","last_fullsized":"2023-07-09T21:36:01.206151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:07.957199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215389+0000","last_change":"2023-07-09T21:36:01.215389+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215389+0000","last_undegraded":"2023-07-09T21:36:01.215389+0000","last_fullsized":"2023-07-09T21:36:01.215389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227098+0000","last_change":"2023-07-09T21:36:01.224719+0000","last_active":"2023-07-09T21:36:01.227098+0000","last_peered":"2023-07-09T21:36:01.227098+0000","last_clean":"2023-07-09T21:36:01.227098+0000","last_became_active":"2023-07-09T21:36:01.224442+0000","last_became_peered":"2023-07-09T21:36:01.224442+0000","last_unstale":"2023-07-09T21:36:01.227098+0000","last_undegraded":"2023-07-09T21:36:01.227098+0000","last_fullsized":"2023-07-09T21:36:01.227098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:26.112728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.220918+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:36:01.220918+0000","last_peered":"2023-07-09T21:36:01.220918+0000","last_clean":"2023-07-09T21:36:01.220918+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:36:01.220918+0000","last_undegraded":"2023-07-09T21:36:01.220918+0000","last_fullsized":"2023-07-09T21:36:01.220918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:13.185257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220209+0000","last_change":"2023-07-09T21:36:01.220209+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220209+0000","last_undegraded":"2023-07-09T21:36:01.220209+0000","last_fullsized":"2023-07-09T21:36:01.220209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229435+0000","last_change":"2023-07-09T21:36:01.224105+0000","last_active":"2023-07-09T21:36:01.229435+0000","last_peered":"2023-07-09T21:36:01.229435+0000","last_clean":"2023-07-09T21:36:01.229435+0000","last_became_active":"2023-07-09T21:36:01.223766+0000","last_became_peered":"2023-07-09T21:36:01.223766+0000","last_unstale":"2023-07-09T21:36:01.229435+0000","last_undegraded":"2023-07-09T21:36:01.229435+0000","last_fullsized":"2023-07-09T21:36:01.229435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:44.479678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206231+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:36:01.206231+0000","last_peered":"2023-07-09T21:36:01.206231+0000","last_clean":"2023-07-09T21:36:01.206231+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:36:01.206231+0000","last_undegraded":"2023-07-09T21:36:01.206231+0000","last_fullsized":"2023-07-09T21:36:01.206231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.377484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217046+0000","last_change":"2023-07-09T21:36:01.217046+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217046+0000","last_undegraded":"2023-07-09T21:36:01.217046+0000","last_fullsized":"2023-07-09T21:36:01.217046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235421+0000","last_change":"2023-07-09T21:36:01.228012+0000","last_active":"2023-07-09T21:36:01.235421+0000","last_peered":"2023-07-09T21:36:01.235421+0000","last_clean":"2023-07-09T21:36:01.235421+0000","last_became_active":"2023-07-09T21:36:01.227731+0000","last_became_peered":"2023-07-09T21:36:01.227731+0000","last_unstale":"2023-07-09T21:36:01.235421+0000","last_undegraded":"2023-07-09T21:36:01.235421+0000","last_fullsized":"2023-07-09T21:36:01.235421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.245605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.221584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:36:01.221584+0000","last_peered":"2023-07-09T21:36:01.221584+0000","last_clean":"2023-07-09T21:36:01.221584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:36:01.221584+0000","last_undegraded":"2023-07-09T21:36:01.221584+0000","last_fullsized":"2023-07-09T21:36:01.221584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:15.554044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575016,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313204,"statfs":{"total":96636764160,"available":96576720896,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93799999999999994,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":0.95599999999999996,"15min":0.998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85699999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.88100000000000001,"5min":0.96199999999999997,"15min":1.619},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81799999999999995,"5min":0.96999999999999997,"15min":1.008},"last":0.87}]},{"osd":3,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":1.665},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.054,"15min":1.2629999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.70199999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.002},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.439,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76800000000000002,"5min":0.93600000000000005,"15min":1.0569999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.52600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.96299999999999997,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.39600000000000002},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":0.97599999999999998},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.996,"15min":1.0569999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76100000000000001,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96999999999999997,"5min":1.0049999999999999,"15min":1.1519999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.45500000000000002},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.165},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45900000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.745,"5min":0.90000000000000002,"15min":1.111},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.871,"5min":0.90600000000000003,"15min":1.1950000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.2070000000000001},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72499999999999998,"15min":0.70399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.246},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90100000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":1.02,"15min":1.02},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.91200000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97199999999999998,"5min":1.01,"15min":1.01},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":1.0169999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.872,"5min":0.998,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":1.014},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.92000000000000004,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.33600000000000002},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":1.02},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":1.165},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0629999999999999,"15min":1.107},"last":0.754}]},{"osd":7,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":0.93600000000000005,"15min":0.997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.98099999999999998,"15min":1.042},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.97799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.92600000000000005,"15min":0.96599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.47099999999999997},"max":{"1min":1.262,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.503},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.016,"5min":1.1799999999999999,"15min":1.208},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2370000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.296},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.48599999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.323},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317880,"statfs":{"total":96636764160,"available":96581509120,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":1.0409999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.374},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.54200000000000004},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.121,"5min":1.2609999999999999,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.995,"5min":1.319,"15min":1.3839999999999999},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.2090000000000001,"15min":1.337},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50800000000000001},"max":{"1min":1.05,"5min":1.417,"15min":1.4850000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3340000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1399999999999999,"5min":1.478,"15min":1.478},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.78800000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624}]},{"osd":3,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.385},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":1.212,"5min":1.212,"15min":1.419},"last":0.93300000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"max":{"1min":1.169,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.083,"5min":1.149,"15min":1.242},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"max":{"1min":0.98099999999999998,"5min":0.999,"15min":1.335},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.83499999999999996,"15min":0.81599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2230000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53600000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83499999999999996,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.753,"15min":0.753},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":1.0489999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.433}]},{"osd":3,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.143},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.274},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.151,"15min":1.6559999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.294,"15min":1.319},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.4350000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.81799999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53500000000000003},"max":{"1min":1.222,"5min":1.3460000000000001,"15min":1.3660000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98899999999999999,"5min":1.2689999999999999,"15min":1.5980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.0780000000000001,"5min":1.365,"15min":1.5740000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:36:07.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-07-09T21:36:07.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214625+0000', 'last_change': '2023-07-09T21:36:01.214625+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214625+0000', 'last_undegraded': '2023-07-09T21:36:01.214625+0000', 'last_fullsized': '2023-07-09T21:36:01.214625+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3e is not active+clean 2023-07-09T21:36:07.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219141+0000', 'last_change': '2023-07-09T21:36:01.219141+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219141+0000', 'last_undegraded': '2023-07-09T21:36:01.219141+0000', 'last_fullsized': '2023-07-09T21:36:01.219141+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3d is not active+clean 2023-07-09T21:36:07.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.231962+0000', 'last_change': '2023-07-09T21:36:01.231962+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.231962+0000', 'last_undegraded': '2023-07-09T21:36:01.231962+0000', 'last_fullsized': '2023-07-09T21:36:01.231962+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3c is not active+clean 2023-07-09T21:36:07.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218103+0000', 'last_change': '2023-07-09T21:36:01.218103+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218103+0000', 'last_undegraded': '2023-07-09T21:36:01.218103+0000', 'last_fullsized': '2023-07-09T21:36:01.218103+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-07-09T21:36:07.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214657+0000', 'last_change': '2023-07-09T21:36:01.214657+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214657+0000', 'last_undegraded': '2023-07-09T21:36:01.214657+0000', 'last_fullsized': '2023-07-09T21:36:01.214657+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:36:07.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-07-09T21:36:07.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.213994+0000', 'last_change': '2023-07-09T21:36:01.213994+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.213994+0000', 'last_undegraded': '2023-07-09T21:36:01.213994+0000', 'last_fullsized': '2023-07-09T21:36:01.213994+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.39 is not active+clean 2023-07-09T21:36:07.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.229978+0000', 'last_change': '2023-07-09T21:36:01.229978+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.229978+0000', 'last_undegraded': '2023-07-09T21:36:01.229978+0000', 'last_fullsized': '2023-07-09T21:36:01.229978+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.38 is not active+clean 2023-07-09T21:36:07.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.221067+0000', 'last_change': '2023-07-09T21:36:01.221067+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.221067+0000', 'last_undegraded': '2023-07-09T21:36:01.221067+0000', 'last_fullsized': '2023-07-09T21:36:01.221067+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.37 is not active+clean 2023-07-09T21:36:07.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218815+0000', 'last_change': '2023-07-09T21:36:01.218815+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218815+0000', 'last_undegraded': '2023-07-09T21:36:01.218815+0000', 'last_fullsized': '2023-07-09T21:36:01.218815+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-07-09T21:36:07.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214407+0000', 'last_change': '2023-07-09T21:36:01.214407+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214407+0000', 'last_undegraded': '2023-07-09T21:36:01.214407+0000', 'last_fullsized': '2023-07-09T21:36:01.214407+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.35 is not active+clean 2023-07-09T21:36:07.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.216728+0000', 'last_change': '2023-07-09T21:36:01.216728+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.216728+0000', 'last_undegraded': '2023-07-09T21:36:01.216728+0000', 'last_fullsized': '2023-07-09T21:36:01.216728+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:36:07.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.34 is not active+clean 2023-07-09T21:36:07.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219230+0000', 'last_change': '2023-07-09T21:36:01.219230+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219230+0000', 'last_undegraded': '2023-07-09T21:36:01.219230+0000', 'last_fullsized': '2023-07-09T21:36:01.219230+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-07-09T21:36:07.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214210+0000', 'last_change': '2023-07-09T21:36:01.214210+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214210+0000', 'last_undegraded': '2023-07-09T21:36:01.214210+0000', 'last_fullsized': '2023-07-09T21:36:01.214210+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.32 is not active+clean 2023-07-09T21:36:07.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.229391+0000', 'last_change': '2023-07-09T21:36:01.229391+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.229391+0000', 'last_undegraded': '2023-07-09T21:36:01.229391+0000', 'last_fullsized': '2023-07-09T21:36:01.229391+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.31 is not active+clean 2023-07-09T21:36:07.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218771+0000', 'last_change': '2023-07-09T21:36:01.218771+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218771+0000', 'last_undegraded': '2023-07-09T21:36:01.218771+0000', 'last_fullsized': '2023-07-09T21:36:01.218771+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-07-09T21:36:07.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.211974+0000', 'last_change': '2023-07-09T21:36:01.211974+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.211974+0000', 'last_undegraded': '2023-07-09T21:36:01.211974+0000', 'last_fullsized': '2023-07-09T21:36:01.211974+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2f is not active+clean 2023-07-09T21:36:07.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.228930+0000', 'last_change': '2023-07-09T21:36:01.228930+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.228930+0000', 'last_undegraded': '2023-07-09T21:36:01.228930+0000', 'last_fullsized': '2023-07-09T21:36:01.228930+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2e is not active+clean 2023-07-09T21:36:07.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218691+0000', 'last_change': '2023-07-09T21:36:01.218691+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218691+0000', 'last_undegraded': '2023-07-09T21:36:01.218691+0000', 'last_fullsized': '2023-07-09T21:36:01.218691+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2d is not active+clean 2023-07-09T21:36:07.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.227921+0000', 'last_change': '2023-07-09T21:36:01.227921+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.227921+0000', 'last_undegraded': '2023-07-09T21:36:01.227921+0000', 'last_fullsized': '2023-07-09T21:36:01.227921+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-07-09T21:36:07.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219378+0000', 'last_change': '2023-07-09T21:36:01.219378+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219378+0000', 'last_undegraded': '2023-07-09T21:36:01.219378+0000', 'last_fullsized': '2023-07-09T21:36:01.219378+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-07-09T21:36:07.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218309+0000', 'last_change': '2023-07-09T21:36:01.218309+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218309+0000', 'last_undegraded': '2023-07-09T21:36:01.218309+0000', 'last_fullsized': '2023-07-09T21:36:01.218309+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2a is not active+clean 2023-07-09T21:36:07.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217281+0000', 'last_change': '2023-07-09T21:36:01.217281+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217281+0000', 'last_undegraded': '2023-07-09T21:36:01.217281+0000', 'last_fullsized': '2023-07-09T21:36:01.217281+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.29 is not active+clean 2023-07-09T21:36:07.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217020+0000', 'last_change': '2023-07-09T21:36:01.217020+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217020+0000', 'last_undegraded': '2023-07-09T21:36:01.217020+0000', 'last_fullsized': '2023-07-09T21:36:01.217020+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:36:07.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.28 is not active+clean 2023-07-09T21:36:07.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.227401+0000', 'last_change': '2023-07-09T21:36:01.227401+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.227401+0000', 'last_undegraded': '2023-07-09T21:36:01.227401+0000', 'last_fullsized': '2023-07-09T21:36:01.227401+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.27 is not active+clean 2023-07-09T21:36:07.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.228500+0000', 'last_change': '2023-07-09T21:36:01.228500+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.228500+0000', 'last_undegraded': '2023-07-09T21:36:01.228500+0000', 'last_fullsized': '2023-07-09T21:36:01.228500+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.26 is not active+clean 2023-07-09T21:36:07.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217871+0000', 'last_change': '2023-07-09T21:36:01.217871+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217871+0000', 'last_undegraded': '2023-07-09T21:36:01.217871+0000', 'last_fullsized': '2023-07-09T21:36:01.217871+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-07-09T21:36:07.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.212461+0000', 'last_change': '2023-07-09T21:36:01.212461+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.212461+0000', 'last_undegraded': '2023-07-09T21:36:01.212461+0000', 'last_fullsized': '2023-07-09T21:36:01.212461+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-07-09T21:36:07.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218886+0000', 'last_change': '2023-07-09T21:36:01.218886+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218886+0000', 'last_undegraded': '2023-07-09T21:36:01.218886+0000', 'last_fullsized': '2023-07-09T21:36:01.218886+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.23 is not active+clean 2023-07-09T21:36:07.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.224476+0000', 'last_change': '2023-07-09T21:36:01.224476+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.224476+0000', 'last_undegraded': '2023-07-09T21:36:01.224476+0000', 'last_fullsized': '2023-07-09T21:36:01.224476+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.22 is not active+clean 2023-07-09T21:36:07.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219617+0000', 'last_change': '2023-07-09T21:36:01.219617+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219617+0000', 'last_undegraded': '2023-07-09T21:36:01.219617+0000', 'last_fullsized': '2023-07-09T21:36:01.219617+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.21 is not active+clean 2023-07-09T21:36:07.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.222811+0000', 'last_change': '2023-07-09T21:36:01.222811+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.222811+0000', 'last_undegraded': '2023-07-09T21:36:01.222811+0000', 'last_fullsized': '2023-07-09T21:36:01.222811+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.20 is not active+clean 2023-07-09T21:36:07.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.216709+0000', 'last_change': '2023-07-09T21:36:01.216709+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.216709+0000', 'last_undegraded': '2023-07-09T21:36:01.216709+0000', 'last_fullsized': '2023-07-09T21:36:01.216709+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-07-09T21:36:07.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217987+0000', 'last_change': '2023-07-09T21:36:01.217987+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217987+0000', 'last_undegraded': '2023-07-09T21:36:01.217987+0000', 'last_fullsized': '2023-07-09T21:36:01.217987+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-07-09T21:36:07.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217313+0000', 'last_change': '2023-07-09T21:36:01.217313+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217313+0000', 'last_undegraded': '2023-07-09T21:36:01.217313+0000', 'last_fullsized': '2023-07-09T21:36:01.217313+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-07-09T21:36:07.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218875+0000', 'last_change': '2023-07-09T21:36:01.218875+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218875+0000', 'last_undegraded': '2023-07-09T21:36:01.218875+0000', 'last_fullsized': '2023-07-09T21:36:01.218875+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-07-09T21:36:07.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.215990+0000', 'last_change': '2023-07-09T21:36:01.215990+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.215990+0000', 'last_undegraded': '2023-07-09T21:36:01.215990+0000', 'last_fullsized': '2023-07-09T21:36:01.215990+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-07-09T21:36:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.213951+0000', 'last_change': '2023-07-09T21:36:01.213951+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.213951+0000', 'last_undegraded': '2023-07-09T21:36:01.213951+0000', 'last_fullsized': '2023-07-09T21:36:01.213951+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:36:07.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-07-09T21:36:07.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219981+0000', 'last_change': '2023-07-09T21:36:01.219981+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219981+0000', 'last_undegraded': '2023-07-09T21:36:01.219981+0000', 'last_fullsized': '2023-07-09T21:36:01.219981+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-07-09T21:36:07.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.215352+0000', 'last_change': '2023-07-09T21:36:01.215352+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.215352+0000', 'last_undegraded': '2023-07-09T21:36:01.215352+0000', 'last_fullsized': '2023-07-09T21:36:01.215352+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-07-09T21:36:07.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.220096+0000', 'last_change': '2023-07-09T21:36:01.220096+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.220096+0000', 'last_undegraded': '2023-07-09T21:36:01.220096+0000', 'last_fullsized': '2023-07-09T21:36:01.220096+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:36:07.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-07-09T21:36:07.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.213586+0000', 'last_change': '2023-07-09T21:36:01.213586+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.213586+0000', 'last_undegraded': '2023-07-09T21:36:01.213586+0000', 'last_fullsized': '2023-07-09T21:36:01.213586+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:36:07.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-07-09T21:36:07.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.219802+0000', 'last_change': '2023-07-09T21:36:01.219802+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.219802+0000', 'last_undegraded': '2023-07-09T21:36:01.219802+0000', 'last_fullsized': '2023-07-09T21:36:01.219802+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-07-09T21:36:07.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.220826+0000', 'last_change': '2023-07-09T21:36:01.220826+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.220826+0000', 'last_undegraded': '2023-07-09T21:36:01.220826+0000', 'last_fullsized': '2023-07-09T21:36:01.220826+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-07-09T21:36:07.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214067+0000', 'last_change': '2023-07-09T21:36:01.214067+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214067+0000', 'last_undegraded': '2023-07-09T21:36:01.214067+0000', 'last_fullsized': '2023-07-09T21:36:01.214067+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:36:07.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-07-09T21:36:07.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217572+0000', 'last_change': '2023-07-09T21:36:01.217572+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217572+0000', 'last_undegraded': '2023-07-09T21:36:01.217572+0000', 'last_fullsized': '2023-07-09T21:36:01.217572+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-07-09T21:36:07.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.222268+0000', 'last_change': '2023-07-09T21:36:01.222268+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.222268+0000', 'last_undegraded': '2023-07-09T21:36:01.222268+0000', 'last_fullsized': '2023-07-09T21:36:01.222268+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-07-09T21:36:07.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217348+0000', 'last_change': '2023-07-09T21:36:01.217348+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217348+0000', 'last_undegraded': '2023-07-09T21:36:01.217348+0000', 'last_fullsized': '2023-07-09T21:36:01.217348+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-07-09T21:36:07.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.221078+0000', 'last_change': '2023-07-09T21:36:01.221078+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.221078+0000', 'last_undegraded': '2023-07-09T21:36:01.221078+0000', 'last_fullsized': '2023-07-09T21:36:01.221078+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-07-09T21:36:07.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.216012+0000', 'last_change': '2023-07-09T21:36:01.216012+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.216012+0000', 'last_undegraded': '2023-07-09T21:36:01.216012+0000', 'last_fullsized': '2023-07-09T21:36:01.216012+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-07-09T21:36:07.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.210677+0000', 'last_change': '2023-07-09T21:36:01.210677+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.210677+0000', 'last_undegraded': '2023-07-09T21:36:01.210677+0000', 'last_fullsized': '2023-07-09T21:36:01.210677+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-07-09T21:36:07.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.214479+0000', 'last_change': '2023-07-09T21:36:01.214479+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.214479+0000', 'last_undegraded': '2023-07-09T21:36:01.214479+0000', 'last_fullsized': '2023-07-09T21:36:01.214479+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:36:07.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-07-09T21:36:07.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.211343+0000', 'last_change': '2023-07-09T21:36:01.211343+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.211343+0000', 'last_undegraded': '2023-07-09T21:36:01.211343+0000', 'last_fullsized': '2023-07-09T21:36:01.211343+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-07-09T21:36:07.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.216112+0000', 'last_change': '2023-07-09T21:36:01.216112+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.216112+0000', 'last_undegraded': '2023-07-09T21:36:01.216112+0000', 'last_fullsized': '2023-07-09T21:36:01.216112+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-07-09T21:36:07.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.220334+0000', 'last_change': '2023-07-09T21:36:01.220334+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.220334+0000', 'last_undegraded': '2023-07-09T21:36:01.220334+0000', 'last_fullsized': '2023-07-09T21:36:01.220334+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-07-09T21:36:07.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.215192+0000', 'last_change': '2023-07-09T21:36:01.215192+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.215192+0000', 'last_undegraded': '2023-07-09T21:36:01.215192+0000', 'last_fullsized': '2023-07-09T21:36:01.215192+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-07-09T21:36:07.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.211744+0000', 'last_change': '2023-07-09T21:36:01.211744+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.211744+0000', 'last_undegraded': '2023-07-09T21:36:01.211744+0000', 'last_fullsized': '2023-07-09T21:36:01.211744+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-07-09T21:36:07.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.218134+0000', 'last_change': '2023-07-09T21:36:01.218134+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.218134+0000', 'last_undegraded': '2023-07-09T21:36:01.218134+0000', 'last_fullsized': '2023-07-09T21:36:01.218134+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:36:07.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-07-09T21:36:07.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.211305+0000', 'last_change': '2023-07-09T21:36:01.211305+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.211305+0000', 'last_undegraded': '2023-07-09T21:36:01.211305+0000', 'last_fullsized': '2023-07-09T21:36:01.211305+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:36:07.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-07-09T21:36:07.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.215481+0000', 'last_change': '2023-07-09T21:36:01.215481+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.215481+0000', 'last_undegraded': '2023-07-09T21:36:01.215481+0000', 'last_fullsized': '2023-07-09T21:36:01.215481+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-07-09T21:36:07.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.216235+0000', 'last_change': '2023-07-09T21:36:01.216235+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.216235+0000', 'last_undegraded': '2023-07-09T21:36:01.216235+0000', 'last_fullsized': '2023-07-09T21:36:01.216235+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-07-09T21:36:07.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.221267+0000', 'last_change': '2023-07-09T21:36:01.221267+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.221267+0000', 'last_undegraded': '2023-07-09T21:36:01.221267+0000', 'last_fullsized': '2023-07-09T21:36:01.221267+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-07-09T21:36:07.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.215389+0000', 'last_change': '2023-07-09T21:36:01.215389+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.215389+0000', 'last_undegraded': '2023-07-09T21:36:01.215389+0000', 'last_fullsized': '2023-07-09T21:36:01.215389+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:36:07.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-07-09T21:36:07.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.220209+0000', 'last_change': '2023-07-09T21:36:01.220209+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.220209+0000', 'last_undegraded': '2023-07-09T21:36:01.220209+0000', 'last_fullsized': '2023-07-09T21:36:01.220209+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:36:07.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-07-09T21:36:07.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 66, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:36:01.217046+0000', 'last_change': '2023-07-09T21:36:01.217046+0000', 'last_active': '2023-07-09T21:36:01.199614+0000', 'last_peered': '2023-07-09T21:36:01.199614+0000', 'last_clean': '2023-07-09T21:36:01.199614+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:36:01.217046+0000', 'last_undegraded': '2023-07-09T21:36:01.217046+0000', 'last_fullsized': '2023-07-09T21:36:01.217046+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'last_clean_scrub_stamp': '2023-07-09T21:36:01.199614+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:36:07.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:36:07.189 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-09T21:36:07.189+0000 7f90ceaa7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:36:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.317+0000 7f2b3b59e640 1 Processor -- start 2023-07-09T21:36:07.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.317+0000 7f2b3b59e640 1 -- start start 2023-07-09T21:36:07.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3b59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c15bbf0 0x7f2b3c0d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3b59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c0d1380 con 0x7f2b3c06bc30 2023-07-09T21:36:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3b59e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c0b13e0 con 0x7f2b3c0cf100 2023-07-09T21:36:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3b59e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c02bbe0 con 0x7f2b3c15bbf0 2023-07-09T21:36:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2b3c06bc30 0x7f2b3c0ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36232/0 (socket says 172.21.15.37:36232) 2023-07-09T21:36:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 -- 172.21.15.37:0/3255919737 learned_addr learned my addr 172.21.15.37:0/3255919737 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c15bbf0 0x7f2b3c0d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307987215 0 0) 0x7f2b3c0d1380 con 0x7f2b3c06bc30 2023-07-09T21:36:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b24003530 con 0x7f2b3c06bc30 2023-07-09T21:36:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501110858 0 0) 0x7f2b3c0b13e0 con 0x7f2b3c0cf100 2023-07-09T21:36:07.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b3c0d1380 con 0x7f2b3c0cf100 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 387225536 0 0) 0x7f2b24003530 con 0x7f2b3c06bc30 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c15bbf0 msgr2=0x7f2b3c0d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c15bbf0 0x7f2b3c0d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 >> v1:172.21.15.119:6789/0 conn(0x7f2b3c0cf100 legacy=0x7f2b3c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c0b1100 con 0x7f2b3c06bc30 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2b30001680 con 0x7f2b3c06bc30 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 >> v1:172.21.15.37:6789/0 conn(0x7f2b3c06bc30 legacy=0x7f2b3c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b24003b40 0x7f2b24003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b24005180 0x7f2b2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c02bbe0 con 0x7f2b240047d0 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400bf50 con 0x7f2b24005180 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2400c110 con 0x7f2b24003b40 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c15bbf0 0x7f2b3c0d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3ad9d640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b24005180 0x7f2b2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b24003b40 0x7f2b24003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 -- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b24003b40 msgr2=0x7f2b24003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b24003b40 0x7f2b24003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 -- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b24005180 msgr2=0x7f2b2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:07.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b24005180 0x7f2b2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b39d9b640 1 -- 172.21.15.37:0/3255919737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b24003530 con 0x7f2b240047d0 2023-07-09T21:36:07.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.321+0000 7f2b3ad9d640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b24005180 0x7f2b2400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b24004c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000c190 tx=0x7f2b3001cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d5eb548f4262879 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b300058e0 con 0x7f2b240047d0 2023-07-09T21:36:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b30005a40 con 0x7f2b240047d0 2023-07-09T21:36:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3959a640 1 -- 172.21.15.37:0/3255919737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b30005e50 con 0x7f2b240047d0 2023-07-09T21:36:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 -- 172.21.15.37:0/3255919737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 msgr2=0x7f2b24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/3255919737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b24004c40 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000c190 tx=0x7f2b3001cae0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3ad9d640 1 -- 172.21.15.37:0/3255919737 reap_dead start 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 -- 172.21.15.37:0/3255919737 shutdown_connections 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 -- 172.21.15.37:0/3255919737 >> 172.21.15.37:0/3255919737 conn(0x7f2b3c02b640 msgr2=0x7f2b3c0d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 -- 172.21.15.37:0/3255919737 shutdown_connections 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.325+0000 7f2b3b59e640 1 -- 172.21.15.37:0/3255919737 wait complete. 2023-07-09T21:36:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 Processor -- start 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- start start 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c157380 0x7f2b3c0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c149f30 0x7f2b3c14a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c1f5370 con 0x7f2b240047d0 2023-07-09T21:36:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c157c40 con 0x7f2b3c149f30 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c09e240 con 0x7f2b3c157380 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53526/0 (socket says 172.21.15.37:53526) 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 -- 172.21.15.37:0/2970873802 learned_addr learned my addr 172.21.15.37:0/2970873802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c157380 0x7f2b3c0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3ad9d640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c149f30 0x7f2b3c14a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 -- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c157380 msgr2=0x7f2b3c0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c157380 0x7f2b3c0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 -- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c149f30 msgr2=0x7f2b3c14a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c149f30 0x7f2b3c14a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 -- 172.21.15.37:0/2970873802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c1f4ad0 con 0x7f2b240047d0 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3a59c640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c011830 tx=0x7f2b2c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c015870 con 0x7f2b240047d0 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0159d0 con 0x7f2b240047d0 2023-07-09T21:36:07.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c015d80 con 0x7f2b240047d0 2023-07-09T21:36:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c1f4db0 con 0x7f2b240047d0 2023-07-09T21:36:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c09e4e0 con 0x7f2b240047d0 2023-07-09T21:36:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.329+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c04e020 con 0x7f2b240047d0 2023-07-09T21:36:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.333+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2b2c0143e0 con 0x7f2b240047d0 2023-07-09T21:36:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.333+0000 7f2b2affd640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 0x7f2b1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.333+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2b2c083c60 con 0x7f2b240047d0 2023-07-09T21:36:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.333+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 0x7f2b1c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.333+0000 7f2b39d9b640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 0x7f2b1c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b300aa000 tx=0x7f2b30001990 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.337+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b2c050fe0 con 0x7f2b240047d0 2023-07-09T21:36:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.545+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2b3c06ac90 con 0x7f2b240047d0 2023-07-09T21:36:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.545+0000 7f2b2affd640 1 -- 172.21.15.37:0/2970873802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7f2b2c023cb0 con 0x7f2b240047d0 2023-07-09T21:36:07.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:07.547 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":842,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":68,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":311357440,"bytes_avail":772782755840,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":24,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":6267}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-07-09T21:35:49.949536+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:36:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 msgr2=0x7f2b1c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 0x7f2b1c068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2b300aa000 tx=0x7f2b30001990 comp rx=0 tx=0).stop 2023-07-09T21:36:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 msgr2=0x7f2b3c1f43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c011830 tx=0x7f2b2c011860 comp rx=0 tx=0).stop 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 shutdown_connections 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c149f30 0x7f2b3c14a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f2b1c0663d0 0x7f2b1c068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c157380 0x7f2b3c0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 --2- 172.21.15.37:0/2970873802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b240047d0 0x7f2b3c1f43d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 >> 172.21.15.37:0/2970873802 conn(0x7f2b3c02b640 msgr2=0x7f2b3c0d1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 shutdown_connections 2023-07-09T21:36:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.549+0000 7f2b3b59e640 1 -- 172.21.15.37:0/2970873802 wait complete. 2023-07-09T21:36:07.567 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:36:07.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:36:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 Processor -- start 2023-07-09T21:36:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 -- start start 2023-07-09T21:36:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68780b7ab0 0x7f687806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780b49f0 con 0x7f68780cef80 2023-07-09T21:36:07.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780cc8a0 con 0x7f68780b4340 2023-07-09T21:36:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687ca7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780b7e80 con 0x7f68780b7ab0 2023-07-09T21:36:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68780b7ab0 0x7f687806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68780b7ab0 0x7f687806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53540/0 (socket says 172.21.15.37:53540) 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 -- 172.21.15.37:0/1670178379 learned_addr learned my addr 172.21.15.37:0/1670178379 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 -- 172.21.15.37:0/1670178379 >> v1:172.21.15.119:6789/0 conn(0x7f68780b4340 legacy=0x7f68780d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 -- 172.21.15.37:0/1670178379 >> v1:172.21.15.37:6789/0 conn(0x7f68780cef80 legacy=0x7f68780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687559a640 1 -- 172.21.15.37:0/1670178379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707895169 0 0) 0x7f68780b49f0 con 0x7f68780cef80 2023-07-09T21:36:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.757+0000 7f687659c640 1 -- 172.21.15.37:0/1670178379 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780ccb80 con 0x7f68780b7ab0 2023-07-09T21:36:07.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687659c640 1 --2- 172.21.15.37:0/1670178379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687806aa50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f686801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b42c3966b949a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687559a640 1 -- 172.21.15.37:0/1670178379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680aa670 con 0x7f68780b7ab0 2023-07-09T21:36:07.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687559a640 1 -- 172.21.15.37:0/1670178379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68680aa7d0 con 0x7f68780b7ab0 2023-07-09T21:36:07.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687559a640 1 -- 172.21.15.37:0/1670178379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68680aab60 con 0x7f68780b7ab0 2023-07-09T21:36:07.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 -- 172.21.15.37:0/1670178379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 msgr2=0x7f687806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1670178379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687806aa50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6868009870 tx=0x7f686801c510 comp rx=0 tx=0).stop 2023-07-09T21:36:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 -- 172.21.15.37:0/1670178379 shutdown_connections 2023-07-09T21:36:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1670178379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687806aa50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 -- 172.21.15.37:0/1670178379 >> 172.21.15.37:0/1670178379 conn(0x7f6878073090 msgr2=0x7f6878069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:07.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 -- 172.21.15.37:0/1670178379 shutdown_connections 2023-07-09T21:36:07.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.761+0000 7f687ca7b640 1 -- 172.21.15.37:0/1670178379 wait complete. 2023-07-09T21:36:07.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 Processor -- start 2023-07-09T21:36:07.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 -- start start 2023-07-09T21:36:07.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68780b4340 0x7f687814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68780cef80 0x7f6878157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687814ef80 con 0x7f68780b7ab0 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687814e370 con 0x7f68780cef80 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687814e650 con 0x7f68780b4340 2023-07-09T21:36:07.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53554/0 (socket says 172.21.15.37:53554) 2023-07-09T21:36:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 -- 172.21.15.37:0/1355964335 learned_addr learned my addr 172.21.15.37:0/1355964335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687659c640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68780b4340 0x7f687814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6876d9d640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68780cef80 0x7f6878157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 -- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68780b4340 msgr2=0x7f687814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68780b4340 0x7f687814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 -- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68780cef80 msgr2=0x7f6878157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68780cef80 0x7f6878157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 -- 172.21.15.37:0/1355964335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68680094d0 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6875d9b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c3e0 tx=0x7f686c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0054e0 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c003600 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c0039b0 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.765+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687814e930 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687814f950 con 0x7f68780b7ab0 2023-07-09T21:36:07.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687814f130 con 0x7f68780b7ab0 2023-07-09T21:36:07.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f686c003b10 con 0x7f68780b7ab0 2023-07-09T21:36:07.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f6866ffd640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 0x7f6858068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:07.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f686c083280 con 0x7f68780b7ab0 2023-07-09T21:36:07.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f687659c640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 0x7f6858068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:07.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.769+0000 7f687659c640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 0x7f6858068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68680ae000 tx=0x7f68680a7000 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:07.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.773+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f687814f130 con 0x7f68780b7ab0 2023-07-09T21:36:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.925+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f68780cf4d0 con 0x7f68580663d0 2023-07-09T21:36:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.933+0000 7f6866ffd640 1 -- 172.21.15.37:0/1355964335 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306281 (secure 0 0 0) 0x7f6868004090 con 0x7f68580663d0 2023-07-09T21:36:07.934 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 msgr2=0x7f6858068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 0x7f6858068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f68680ae000 tx=0x7f68680a7000 comp rx=0 tx=0).stop 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 msgr2=0x7f687814d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f686c00c3e0 tx=0x7f686c00c8a0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 shutdown_connections 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68780cef80 0x7f6878157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68780b7ab0 0x7f687814d3b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f68580663d0 0x7f6858068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 --2- 172.21.15.37:0/1355964335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68780b4340 0x7f687814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 >> 172.21.15.37:0/1355964335 conn(0x7f6878073090 msgr2=0x7f68780d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 shutdown_connections 2023-07-09T21:36:07.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:07.937+0000 7f687ca7b640 1 -- 172.21.15.37:0/1355964335 wait complete. 2023-07-09T21:36:07.954 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:36:05.953666+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":304060,"kb_used_data":7292,"kb_used_omap":0,"kb_used_meta":296704,"kb_avail":754670660,"statfs":{"total":773094113280,"available":772782755840,"internally_reserved":0,"allocated":7467008,"data_stored":4277484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":303824896},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.749329"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214625+0000","last_change":"2023-07-09T21:36:01.214625+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214625+0000","last_undegraded":"2023-07-09T21:36:01.214625+0000","last_fullsized":"2023-07-09T21:36:01.214625+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219141+0000","last_change":"2023-07-09T21:36:01.219141+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219141+0000","last_undegraded":"2023-07-09T21:36:01.219141+0000","last_fullsized":"2023-07-09T21:36:01.219141+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.231962+0000","last_change":"2023-07-09T21:36:01.231962+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.231962+0000","last_undegraded":"2023-07-09T21:36:01.231962+0000","last_fullsized":"2023-07-09T21:36:01.231962+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218103+0000","last_change":"2023-07-09T21:36:01.218103+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218103+0000","last_undegraded":"2023-07-09T21:36:01.218103+0000","last_fullsized":"2023-07-09T21:36:01.218103+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214657+0000","last_change":"2023-07-09T21:36:01.214657+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214657+0000","last_undegraded":"2023-07-09T21:36:01.214657+0000","last_fullsized":"2023-07-09T21:36:01.214657+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213994+0000","last_change":"2023-07-09T21:36:01.213994+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213994+0000","last_undegraded":"2023-07-09T21:36:01.213994+0000","last_fullsized":"2023-07-09T21:36:01.213994+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229978+0000","last_change":"2023-07-09T21:36:01.229978+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229978+0000","last_undegraded":"2023-07-09T21:36:01.229978+0000","last_fullsized":"2023-07-09T21:36:01.229978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221067+0000","last_change":"2023-07-09T21:36:01.221067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221067+0000","last_undegraded":"2023-07-09T21:36:01.221067+0000","last_fullsized":"2023-07-09T21:36:01.221067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218815+0000","last_change":"2023-07-09T21:36:01.218815+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218815+0000","last_undegraded":"2023-07-09T21:36:01.218815+0000","last_fullsized":"2023-07-09T21:36:01.218815+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214407+0000","last_change":"2023-07-09T21:36:01.214407+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214407+0000","last_undegraded":"2023-07-09T21:36:01.214407+0000","last_fullsized":"2023-07-09T21:36:01.214407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216728+0000","last_change":"2023-07-09T21:36:01.216728+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216728+0000","last_undegraded":"2023-07-09T21:36:01.216728+0000","last_fullsized":"2023-07-09T21:36:01.216728+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219230+0000","last_change":"2023-07-09T21:36:01.219230+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219230+0000","last_undegraded":"2023-07-09T21:36:01.219230+0000","last_fullsized":"2023-07-09T21:36:01.219230+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214210+0000","last_change":"2023-07-09T21:36:01.214210+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214210+0000","last_undegraded":"2023-07-09T21:36:01.214210+0000","last_fullsized":"2023-07-09T21:36:01.214210+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.229391+0000","last_change":"2023-07-09T21:36:01.229391+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.229391+0000","last_undegraded":"2023-07-09T21:36:01.229391+0000","last_fullsized":"2023-07-09T21:36:01.229391+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218771+0000","last_change":"2023-07-09T21:36:01.218771+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218771+0000","last_undegraded":"2023-07-09T21:36:01.218771+0000","last_fullsized":"2023-07-09T21:36:01.218771+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211974+0000","last_change":"2023-07-09T21:36:01.211974+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211974+0000","last_undegraded":"2023-07-09T21:36:01.211974+0000","last_fullsized":"2023-07-09T21:36:01.211974+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228930+0000","last_change":"2023-07-09T21:36:01.228930+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228930+0000","last_undegraded":"2023-07-09T21:36:01.228930+0000","last_fullsized":"2023-07-09T21:36:01.228930+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218691+0000","last_change":"2023-07-09T21:36:01.218691+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218691+0000","last_undegraded":"2023-07-09T21:36:01.218691+0000","last_fullsized":"2023-07-09T21:36:01.218691+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227921+0000","last_change":"2023-07-09T21:36:01.227921+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227921+0000","last_undegraded":"2023-07-09T21:36:01.227921+0000","last_fullsized":"2023-07-09T21:36:01.227921+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219378+0000","last_change":"2023-07-09T21:36:01.219378+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219378+0000","last_undegraded":"2023-07-09T21:36:01.219378+0000","last_fullsized":"2023-07-09T21:36:01.219378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218309+0000","last_change":"2023-07-09T21:36:01.218309+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218309+0000","last_undegraded":"2023-07-09T21:36:01.218309+0000","last_fullsized":"2023-07-09T21:36:01.218309+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217281+0000","last_change":"2023-07-09T21:36:01.217281+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217281+0000","last_undegraded":"2023-07-09T21:36:01.217281+0000","last_fullsized":"2023-07-09T21:36:01.217281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217020+0000","last_change":"2023-07-09T21:36:01.217020+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217020+0000","last_undegraded":"2023-07-09T21:36:01.217020+0000","last_fullsized":"2023-07-09T21:36:01.217020+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.227401+0000","last_change":"2023-07-09T21:36:01.227401+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.227401+0000","last_undegraded":"2023-07-09T21:36:01.227401+0000","last_fullsized":"2023-07-09T21:36:01.227401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.228500+0000","last_change":"2023-07-09T21:36:01.228500+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.228500+0000","last_undegraded":"2023-07-09T21:36:01.228500+0000","last_fullsized":"2023-07-09T21:36:01.228500+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217871+0000","last_change":"2023-07-09T21:36:01.217871+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217871+0000","last_undegraded":"2023-07-09T21:36:01.217871+0000","last_fullsized":"2023-07-09T21:36:01.217871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.212461+0000","last_change":"2023-07-09T21:36:01.212461+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.212461+0000","last_undegraded":"2023-07-09T21:36:01.212461+0000","last_fullsized":"2023-07-09T21:36:01.212461+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218886+0000","last_change":"2023-07-09T21:36:01.218886+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218886+0000","last_undegraded":"2023-07-09T21:36:01.218886+0000","last_fullsized":"2023-07-09T21:36:01.218886+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.224476+0000","last_change":"2023-07-09T21:36:01.224476+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.224476+0000","last_undegraded":"2023-07-09T21:36:01.224476+0000","last_fullsized":"2023-07-09T21:36:01.224476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219617+0000","last_change":"2023-07-09T21:36:01.219617+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219617+0000","last_undegraded":"2023-07-09T21:36:01.219617+0000","last_fullsized":"2023-07-09T21:36:01.219617+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222811+0000","last_change":"2023-07-09T21:36:01.222811+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222811+0000","last_undegraded":"2023-07-09T21:36:01.222811+0000","last_fullsized":"2023-07-09T21:36:01.222811+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216709+0000","last_change":"2023-07-09T21:36:01.216709+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216709+0000","last_undegraded":"2023-07-09T21:36:01.216709+0000","last_fullsized":"2023-07-09T21:36:01.216709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217987+0000","last_change":"2023-07-09T21:36:01.217987+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217987+0000","last_undegraded":"2023-07-09T21:36:01.217987+0000","last_fullsized":"2023-07-09T21:36:01.217987+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230310+0000","last_change":"2023-07-09T21:36:01.225140+0000","last_active":"2023-07-09T21:36:01.230310+0000","last_peered":"2023-07-09T21:36:01.230310+0000","last_clean":"2023-07-09T21:36:01.230310+0000","last_became_active":"2023-07-09T21:36:01.224854+0000","last_became_peered":"2023-07-09T21:36:01.224854+0000","last_unstale":"2023-07-09T21:36:01.230310+0000","last_undegraded":"2023-07-09T21:36:01.230310+0000","last_fullsized":"2023-07-09T21:36:01.230310+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:58:54.307331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217313+0000","last_change":"2023-07-09T21:36:01.217313+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217313+0000","last_undegraded":"2023-07-09T21:36:01.217313+0000","last_fullsized":"2023-07-09T21:36:01.217313+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228361+0000","last_change":"2023-07-09T21:36:01.222625+0000","last_active":"2023-07-09T21:36:01.228361+0000","last_peered":"2023-07-09T21:36:01.228361+0000","last_clean":"2023-07-09T21:36:01.228361+0000","last_became_active":"2023-07-09T21:36:01.222368+0000","last_became_peered":"2023-07-09T21:36:01.222368+0000","last_unstale":"2023-07-09T21:36:01.228361+0000","last_undegraded":"2023-07-09T21:36:01.228361+0000","last_fullsized":"2023-07-09T21:36:01.228361+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218875+0000","last_change":"2023-07-09T21:36:01.218875+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218875+0000","last_undegraded":"2023-07-09T21:36:01.218875+0000","last_fullsized":"2023-07-09T21:36:01.218875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228491+0000","last_change":"2023-07-09T21:36:01.223626+0000","last_active":"2023-07-09T21:36:01.228491+0000","last_peered":"2023-07-09T21:36:01.228491+0000","last_clean":"2023-07-09T21:36:01.228491+0000","last_became_active":"2023-07-09T21:36:01.223318+0000","last_became_peered":"2023-07-09T21:36:01.223318+0000","last_unstale":"2023-07-09T21:36:01.228491+0000","last_undegraded":"2023-07-09T21:36:01.228491+0000","last_fullsized":"2023-07-09T21:36:01.228491+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215990+0000","last_change":"2023-07-09T21:36:01.215990+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215990+0000","last_undegraded":"2023-07-09T21:36:01.215990+0000","last_fullsized":"2023-07-09T21:36:01.215990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229331+0000","last_change":"2023-07-09T21:36:01.228047+0000","last_active":"2023-07-09T21:36:01.229331+0000","last_peered":"2023-07-09T21:36:01.229331+0000","last_clean":"2023-07-09T21:36:01.229331+0000","last_became_active":"2023-07-09T21:36:01.227750+0000","last_became_peered":"2023-07-09T21:36:01.227750+0000","last_unstale":"2023-07-09T21:36:01.229331+0000","last_undegraded":"2023-07-09T21:36:01.229331+0000","last_fullsized":"2023-07-09T21:36:01.229331+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:02.308925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213951+0000","last_change":"2023-07-09T21:36:01.213951+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213951+0000","last_undegraded":"2023-07-09T21:36:01.213951+0000","last_fullsized":"2023-07-09T21:36:01.213951+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235458+0000","last_change":"2023-07-09T21:36:01.230840+0000","last_active":"2023-07-09T21:36:01.235458+0000","last_peered":"2023-07-09T21:36:01.235458+0000","last_clean":"2023-07-09T21:36:01.235458+0000","last_became_active":"2023-07-09T21:36:01.230598+0000","last_became_peered":"2023-07-09T21:36:01.230598+0000","last_unstale":"2023-07-09T21:36:01.235458+0000","last_undegraded":"2023-07-09T21:36:01.235458+0000","last_fullsized":"2023-07-09T21:36:01.235458+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:16.807354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219981+0000","last_change":"2023-07-09T21:36:01.219981+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219981+0000","last_undegraded":"2023-07-09T21:36:01.219981+0000","last_fullsized":"2023-07-09T21:36:01.219981+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229798+0000","last_change":"2023-07-09T21:36:01.225992+0000","last_active":"2023-07-09T21:36:01.229798+0000","last_peered":"2023-07-09T21:36:01.229798+0000","last_clean":"2023-07-09T21:36:01.229798+0000","last_became_active":"2023-07-09T21:36:01.225688+0000","last_became_peered":"2023-07-09T21:36:01.225688+0000","last_unstale":"2023-07-09T21:36:01.229798+0000","last_undegraded":"2023-07-09T21:36:01.229798+0000","last_fullsized":"2023-07-09T21:36:01.229798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:12.823883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215352+0000","last_change":"2023-07-09T21:36:01.215352+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215352+0000","last_undegraded":"2023-07-09T21:36:01.215352+0000","last_fullsized":"2023-07-09T21:36:01.215352+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231389+0000","last_change":"2023-07-09T21:36:01.228681+0000","last_active":"2023-07-09T21:36:01.231389+0000","last_peered":"2023-07-09T21:36:01.231389+0000","last_clean":"2023-07-09T21:36:01.231389+0000","last_became_active":"2023-07-09T21:36:01.228276+0000","last_became_peered":"2023-07-09T21:36:01.228276+0000","last_unstale":"2023-07-09T21:36:01.231389+0000","last_undegraded":"2023-07-09T21:36:01.231389+0000","last_fullsized":"2023-07-09T21:36:01.231389+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:27.829239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220096+0000","last_change":"2023-07-09T21:36:01.220096+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220096+0000","last_undegraded":"2023-07-09T21:36:01.220096+0000","last_fullsized":"2023-07-09T21:36:01.220096+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235518+0000","last_change":"2023-07-09T21:36:01.231014+0000","last_active":"2023-07-09T21:36:01.235518+0000","last_peered":"2023-07-09T21:36:01.235518+0000","last_clean":"2023-07-09T21:36:01.235518+0000","last_became_active":"2023-07-09T21:36:01.230682+0000","last_became_peered":"2023-07-09T21:36:01.230682+0000","last_unstale":"2023-07-09T21:36:01.235518+0000","last_undegraded":"2023-07-09T21:36:01.235518+0000","last_fullsized":"2023-07-09T21:36:01.235518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:36:43.375800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.213586+0000","last_change":"2023-07-09T21:36:01.213586+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.213586+0000","last_undegraded":"2023-07-09T21:36:01.213586+0000","last_fullsized":"2023-07-09T21:36:01.213586+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229490+0000","last_change":"2023-07-09T21:36:01.225914+0000","last_active":"2023-07-09T21:36:01.229490+0000","last_peered":"2023-07-09T21:36:01.229490+0000","last_clean":"2023-07-09T21:36:01.229490+0000","last_became_active":"2023-07-09T21:36:01.225617+0000","last_became_peered":"2023-07-09T21:36:01.225617+0000","last_unstale":"2023-07-09T21:36:01.229490+0000","last_undegraded":"2023-07-09T21:36:01.229490+0000","last_fullsized":"2023-07-09T21:36:01.229490+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:11.663547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.219802+0000","last_change":"2023-07-09T21:36:01.219802+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.219802+0000","last_undegraded":"2023-07-09T21:36:01.219802+0000","last_fullsized":"2023-07-09T21:36:01.219802+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.238164+0000","last_change":"2023-07-09T21:36:01.237174+0000","last_active":"2023-07-09T21:36:01.238164+0000","last_peered":"2023-07-09T21:36:01.238164+0000","last_clean":"2023-07-09T21:36:01.238164+0000","last_became_active":"2023-07-09T21:36:01.236851+0000","last_became_peered":"2023-07-09T21:36:01.236851+0000","last_unstale":"2023-07-09T21:36:01.238164+0000","last_undegraded":"2023-07-09T21:36:01.238164+0000","last_fullsized":"2023-07-09T21:36:01.238164+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:09.546508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220826+0000","last_change":"2023-07-09T21:36:01.220826+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220826+0000","last_undegraded":"2023-07-09T21:36:01.220826+0000","last_fullsized":"2023-07-09T21:36:01.220826+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.233574+0000","last_change":"2023-07-09T21:36:01.232591+0000","last_active":"2023-07-09T21:36:01.233574+0000","last_peered":"2023-07-09T21:36:01.233574+0000","last_clean":"2023-07-09T21:36:01.233574+0000","last_became_active":"2023-07-09T21:36:01.232256+0000","last_became_peered":"2023-07-09T21:36:01.232256+0000","last_unstale":"2023-07-09T21:36:01.233574+0000","last_undegraded":"2023-07-09T21:36:01.233574+0000","last_fullsized":"2023-07-09T21:36:01.233574+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:46.363306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214067+0000","last_change":"2023-07-09T21:36:01.214067+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214067+0000","last_undegraded":"2023-07-09T21:36:01.214067+0000","last_fullsized":"2023-07-09T21:36:01.214067+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229726+0000","last_change":"2023-07-09T21:36:01.223493+0000","last_active":"2023-07-09T21:36:01.229726+0000","last_peered":"2023-07-09T21:36:01.229726+0000","last_clean":"2023-07-09T21:36:01.229726+0000","last_became_active":"2023-07-09T21:36:01.223158+0000","last_became_peered":"2023-07-09T21:36:01.223158+0000","last_unstale":"2023-07-09T21:36:01.229726+0000","last_undegraded":"2023-07-09T21:36:01.229726+0000","last_fullsized":"2023-07-09T21:36:01.229726+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:58.832715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217572+0000","last_change":"2023-07-09T21:36:01.217572+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217572+0000","last_undegraded":"2023-07-09T21:36:01.217572+0000","last_fullsized":"2023-07-09T21:36:01.217572+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236780+0000","last_change":"2023-07-09T21:36:01.234205+0000","last_active":"2023-07-09T21:36:01.236780+0000","last_peered":"2023-07-09T21:36:01.236780+0000","last_clean":"2023-07-09T21:36:01.236780+0000","last_became_active":"2023-07-09T21:36:01.233906+0000","last_became_peered":"2023-07-09T21:36:01.233906+0000","last_unstale":"2023-07-09T21:36:01.236780+0000","last_undegraded":"2023-07-09T21:36:01.236780+0000","last_fullsized":"2023-07-09T21:36:01.236780+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.222268+0000","last_change":"2023-07-09T21:36:01.222268+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.222268+0000","last_undegraded":"2023-07-09T21:36:01.222268+0000","last_fullsized":"2023-07-09T21:36:01.222268+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240088+0000","last_change":"2023-07-09T21:36:01.239215+0000","last_active":"2023-07-09T21:36:01.240088+0000","last_peered":"2023-07-09T21:36:01.240088+0000","last_clean":"2023-07-09T21:36:01.240088+0000","last_became_active":"2023-07-09T21:36:01.238884+0000","last_became_peered":"2023-07-09T21:36:01.238884+0000","last_unstale":"2023-07-09T21:36:01.240088+0000","last_undegraded":"2023-07-09T21:36:01.240088+0000","last_fullsized":"2023-07-09T21:36:01.240088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:15.058041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217348+0000","last_change":"2023-07-09T21:36:01.217348+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217348+0000","last_undegraded":"2023-07-09T21:36:01.217348+0000","last_fullsized":"2023-07-09T21:36:01.217348+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229642+0000","last_change":"2023-07-09T21:36:01.227138+0000","last_active":"2023-07-09T21:36:01.229642+0000","last_peered":"2023-07-09T21:36:01.229642+0000","last_clean":"2023-07-09T21:36:01.229642+0000","last_became_active":"2023-07-09T21:36:01.226875+0000","last_became_peered":"2023-07-09T21:36:01.226875+0000","last_unstale":"2023-07-09T21:36:01.229642+0000","last_undegraded":"2023-07-09T21:36:01.229642+0000","last_fullsized":"2023-07-09T21:36:01.229642+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:05.648987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221078+0000","last_change":"2023-07-09T21:36:01.221078+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221078+0000","last_undegraded":"2023-07-09T21:36:01.221078+0000","last_fullsized":"2023-07-09T21:36:01.221078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236579+0000","last_change":"2023-07-09T21:36:01.229147+0000","last_active":"2023-07-09T21:36:01.236579+0000","last_peered":"2023-07-09T21:36:01.236579+0000","last_clean":"2023-07-09T21:36:01.236579+0000","last_became_active":"2023-07-09T21:36:01.228799+0000","last_became_peered":"2023-07-09T21:36:01.228799+0000","last_unstale":"2023-07-09T21:36:01.236579+0000","last_undegraded":"2023-07-09T21:36:01.236579+0000","last_fullsized":"2023-07-09T21:36:01.236579+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216012+0000","last_change":"2023-07-09T21:36:01.216012+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216012+0000","last_undegraded":"2023-07-09T21:36:01.216012+0000","last_fullsized":"2023-07-09T21:36:01.216012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.241954+0000","last_change":"2023-07-09T21:36:01.237532+0000","last_active":"2023-07-09T21:36:01.241954+0000","last_peered":"2023-07-09T21:36:01.241954+0000","last_clean":"2023-07-09T21:36:01.241954+0000","last_became_active":"2023-07-09T21:36:01.237228+0000","last_became_peered":"2023-07-09T21:36:01.237228+0000","last_unstale":"2023-07-09T21:36:01.241954+0000","last_undegraded":"2023-07-09T21:36:01.241954+0000","last_fullsized":"2023-07-09T21:36:01.241954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:59.958255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.210677+0000","last_change":"2023-07-09T21:36:01.210677+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.210677+0000","last_undegraded":"2023-07-09T21:36:01.210677+0000","last_fullsized":"2023-07-09T21:36:01.210677+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230258+0000","last_change":"2023-07-09T21:36:01.227765+0000","last_active":"2023-07-09T21:36:01.230258+0000","last_peered":"2023-07-09T21:36:01.230258+0000","last_clean":"2023-07-09T21:36:01.230258+0000","last_became_active":"2023-07-09T21:36:01.227290+0000","last_became_peered":"2023-07-09T21:36:01.227290+0000","last_unstale":"2023-07-09T21:36:01.230258+0000","last_undegraded":"2023-07-09T21:36:01.230258+0000","last_fullsized":"2023-07-09T21:36:01.230258+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:31.702346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.214479+0000","last_change":"2023-07-09T21:36:01.214479+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.214479+0000","last_undegraded":"2023-07-09T21:36:01.214479+0000","last_fullsized":"2023-07-09T21:36:01.214479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231430+0000","last_change":"2023-07-09T21:36:01.229042+0000","last_active":"2023-07-09T21:36:01.231430+0000","last_peered":"2023-07-09T21:36:01.231430+0000","last_clean":"2023-07-09T21:36:01.231430+0000","last_became_active":"2023-07-09T21:36:01.228766+0000","last_became_peered":"2023-07-09T21:36:01.228766+0000","last_unstale":"2023-07-09T21:36:01.231430+0000","last_undegraded":"2023-07-09T21:36:01.231430+0000","last_fullsized":"2023-07-09T21:36:01.231430+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:46.414811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211343+0000","last_change":"2023-07-09T21:36:01.211343+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211343+0000","last_undegraded":"2023-07-09T21:36:01.211343+0000","last_fullsized":"2023-07-09T21:36:01.211343+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.230810+0000","last_change":"2023-07-09T21:36:01.227794+0000","last_active":"2023-07-09T21:36:01.230810+0000","last_peered":"2023-07-09T21:36:01.230810+0000","last_clean":"2023-07-09T21:36:01.230810+0000","last_became_active":"2023-07-09T21:36:01.227432+0000","last_became_peered":"2023-07-09T21:36:01.227432+0000","last_unstale":"2023-07-09T21:36:01.230810+0000","last_undegraded":"2023-07-09T21:36:01.230810+0000","last_fullsized":"2023-07-09T21:36:01.230810+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:39.920318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216112+0000","last_change":"2023-07-09T21:36:01.216112+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216112+0000","last_undegraded":"2023-07-09T21:36:01.216112+0000","last_fullsized":"2023-07-09T21:36:01.216112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227748+0000","last_change":"2023-07-09T21:36:01.219033+0000","last_active":"2023-07-09T21:36:01.227748+0000","last_peered":"2023-07-09T21:36:01.227748+0000","last_clean":"2023-07-09T21:36:01.227748+0000","last_became_active":"2023-07-09T21:36:01.218767+0000","last_became_peered":"2023-07-09T21:36:01.218767+0000","last_unstale":"2023-07-09T21:36:01.227748+0000","last_undegraded":"2023-07-09T21:36:01.227748+0000","last_fullsized":"2023-07-09T21:36:01.227748+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:37.946642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220334+0000","last_change":"2023-07-09T21:36:01.220334+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220334+0000","last_undegraded":"2023-07-09T21:36:01.220334+0000","last_fullsized":"2023-07-09T21:36:01.220334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229396+0000","last_change":"2023-07-09T21:36:01.223457+0000","last_active":"2023-07-09T21:36:01.229396+0000","last_peered":"2023-07-09T21:36:01.229396+0000","last_clean":"2023-07-09T21:36:01.229396+0000","last_became_active":"2023-07-09T21:36:01.223181+0000","last_became_peered":"2023-07-09T21:36:01.223181+0000","last_unstale":"2023-07-09T21:36:01.229396+0000","last_undegraded":"2023-07-09T21:36:01.229396+0000","last_fullsized":"2023-07-09T21:36:01.229396+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:00.759984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215192+0000","last_change":"2023-07-09T21:36:01.215192+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215192+0000","last_undegraded":"2023-07-09T21:36:01.215192+0000","last_fullsized":"2023-07-09T21:36:01.215192+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.239311+0000","last_change":"2023-07-09T21:36:01.236520+0000","last_active":"2023-07-09T21:36:01.239311+0000","last_peered":"2023-07-09T21:36:01.239311+0000","last_clean":"2023-07-09T21:36:01.239311+0000","last_became_active":"2023-07-09T21:36:01.236238+0000","last_became_peered":"2023-07-09T21:36:01.236238+0000","last_unstale":"2023-07-09T21:36:01.239311+0000","last_undegraded":"2023-07-09T21:36:01.239311+0000","last_fullsized":"2023-07-09T21:36:01.239311+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:13.796084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211744+0000","last_change":"2023-07-09T21:36:01.211744+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211744+0000","last_undegraded":"2023-07-09T21:36:01.211744+0000","last_fullsized":"2023-07-09T21:36:01.211744+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.228077+0000","last_change":"2023-07-09T21:36:01.224143+0000","last_active":"2023-07-09T21:36:01.228077+0000","last_peered":"2023-07-09T21:36:01.228077+0000","last_clean":"2023-07-09T21:36:01.228077+0000","last_became_active":"2023-07-09T21:36:01.223798+0000","last_became_peered":"2023-07-09T21:36:01.223798+0000","last_unstale":"2023-07-09T21:36:01.228077+0000","last_undegraded":"2023-07-09T21:36:01.228077+0000","last_fullsized":"2023-07-09T21:36:01.228077+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:21:38.870308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.218134+0000","last_change":"2023-07-09T21:36:01.218134+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.218134+0000","last_undegraded":"2023-07-09T21:36:01.218134+0000","last_fullsized":"2023-07-09T21:36:01.218134+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.236756+0000","last_change":"2023-07-09T21:36:01.234283+0000","last_active":"2023-07-09T21:36:01.236756+0000","last_peered":"2023-07-09T21:36:01.236756+0000","last_clean":"2023-07-09T21:36:01.236756+0000","last_became_active":"2023-07-09T21:36:01.233983+0000","last_became_peered":"2023-07-09T21:36:01.233983+0000","last_unstale":"2023-07-09T21:36:01.236756+0000","last_undegraded":"2023-07-09T21:36:01.236756+0000","last_fullsized":"2023-07-09T21:36:01.236756+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:58.265039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"55'139","reported_seq":331,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218456+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:36:01.218456+0000","last_peered":"2023-07-09T21:36:01.218456+0000","last_clean":"2023-07-09T21:36:01.218456+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:36:01.218456+0000","last_undegraded":"2023-07-09T21:36:01.218456+0000","last_fullsized":"2023-07-09T21:36:01.218456+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:57:49.314189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216570+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:36:01.216570+0000","last_peered":"2023-07-09T21:36:01.216570+0000","last_clean":"2023-07-09T21:36:01.216570+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:36:01.216570+0000","last_undegraded":"2023-07-09T21:36:01.216570+0000","last_fullsized":"2023-07-09T21:36:01.216570+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:51.035872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.211305+0000","last_change":"2023-07-09T21:36:01.211305+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.211305+0000","last_undegraded":"2023-07-09T21:36:01.211305+0000","last_fullsized":"2023-07-09T21:36:01.211305+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.231101+0000","last_change":"2023-07-09T21:36:01.229874+0000","last_active":"2023-07-09T21:36:01.231101+0000","last_peered":"2023-07-09T21:36:01.231101+0000","last_clean":"2023-07-09T21:36:01.231101+0000","last_became_active":"2023-07-09T21:36:01.229556+0000","last_became_peered":"2023-07-09T21:36:01.229556+0000","last_unstale":"2023-07-09T21:36:01.231101+0000","last_undegraded":"2023-07-09T21:36:01.231101+0000","last_fullsized":"2023-07-09T21:36:01.231101+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:59.436060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.218335+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:36:01.218335+0000","last_peered":"2023-07-09T21:36:01.218335+0000","last_clean":"2023-07-09T21:36:01.218335+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:36:01.218335+0000","last_undegraded":"2023-07-09T21:36:01.218335+0000","last_fullsized":"2023-07-09T21:36:01.218335+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:54.317984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215481+0000","last_change":"2023-07-09T21:36:01.215481+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215481+0000","last_undegraded":"2023-07-09T21:36:01.215481+0000","last_fullsized":"2023-07-09T21:36:01.215481+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235554+0000","last_change":"2023-07-09T21:36:01.231246+0000","last_active":"2023-07-09T21:36:01.235554+0000","last_peered":"2023-07-09T21:36:01.235554+0000","last_clean":"2023-07-09T21:36:01.235554+0000","last_became_active":"2023-07-09T21:36:01.230971+0000","last_became_peered":"2023-07-09T21:36:01.230971+0000","last_unstale":"2023-07-09T21:36:01.235554+0000","last_undegraded":"2023-07-09T21:36:01.235554+0000","last_fullsized":"2023-07-09T21:36:01.235554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:44.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.217285+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:36:01.217285+0000","last_peered":"2023-07-09T21:36:01.217285+0000","last_clean":"2023-07-09T21:36:01.217285+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:36:01.217285+0000","last_undegraded":"2023-07-09T21:36:01.217285+0000","last_fullsized":"2023-07-09T21:36:01.217285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:51:21.876274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.216235+0000","last_change":"2023-07-09T21:36:01.216235+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.216235+0000","last_undegraded":"2023-07-09T21:36:01.216235+0000","last_fullsized":"2023-07-09T21:36:01.216235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.240091+0000","last_change":"2023-07-09T21:36:01.239273+0000","last_active":"2023-07-09T21:36:01.240091+0000","last_peered":"2023-07-09T21:36:01.240091+0000","last_clean":"2023-07-09T21:36:01.240091+0000","last_became_active":"2023-07-09T21:36:01.238953+0000","last_became_peered":"2023-07-09T21:36:01.238953+0000","last_unstale":"2023-07-09T21:36:01.240091+0000","last_undegraded":"2023-07-09T21:36:01.240091+0000","last_fullsized":"2023-07-09T21:36:01.240091+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:42.934428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.216460+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:36:01.216460+0000","last_peered":"2023-07-09T21:36:01.216460+0000","last_clean":"2023-07-09T21:36:01.216460+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:36:01.216460+0000","last_undegraded":"2023-07-09T21:36:01.216460+0000","last_fullsized":"2023-07-09T21:36:01.216460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:38.533925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.221267+0000","last_change":"2023-07-09T21:36:01.221267+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.221267+0000","last_undegraded":"2023-07-09T21:36:01.221267+0000","last_fullsized":"2023-07-09T21:36:01.221267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.225523+0000","last_change":"2023-07-09T21:36:01.222592+0000","last_active":"2023-07-09T21:36:01.225523+0000","last_peered":"2023-07-09T21:36:01.225523+0000","last_clean":"2023-07-09T21:36:01.225523+0000","last_became_active":"2023-07-09T21:36:01.222323+0000","last_became_peered":"2023-07-09T21:36:01.222323+0000","last_unstale":"2023-07-09T21:36:01.225523+0000","last_undegraded":"2023-07-09T21:36:01.225523+0000","last_fullsized":"2023-07-09T21:36:01.225523+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:23.403556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206151+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:36:01.206151+0000","last_peered":"2023-07-09T21:36:01.206151+0000","last_clean":"2023-07-09T21:36:01.206151+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:36:01.206151+0000","last_undegraded":"2023-07-09T21:36:01.206151+0000","last_fullsized":"2023-07-09T21:36:01.206151+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:23:07.957199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.215389+0000","last_change":"2023-07-09T21:36:01.215389+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.215389+0000","last_undegraded":"2023-07-09T21:36:01.215389+0000","last_fullsized":"2023-07-09T21:36:01.215389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.227098+0000","last_change":"2023-07-09T21:36:01.224719+0000","last_active":"2023-07-09T21:36:01.227098+0000","last_peered":"2023-07-09T21:36:01.227098+0000","last_clean":"2023-07-09T21:36:01.227098+0000","last_became_active":"2023-07-09T21:36:01.224442+0000","last_became_peered":"2023-07-09T21:36:01.224442+0000","last_unstale":"2023-07-09T21:36:01.227098+0000","last_undegraded":"2023-07-09T21:36:01.227098+0000","last_fullsized":"2023-07-09T21:36:01.227098+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:26.112728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.220918+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:36:01.220918+0000","last_peered":"2023-07-09T21:36:01.220918+0000","last_clean":"2023-07-09T21:36:01.220918+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:36:01.220918+0000","last_undegraded":"2023-07-09T21:36:01.220918+0000","last_fullsized":"2023-07-09T21:36:01.220918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:13.185257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.220209+0000","last_change":"2023-07-09T21:36:01.220209+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.220209+0000","last_undegraded":"2023-07-09T21:36:01.220209+0000","last_fullsized":"2023-07-09T21:36:01.220209+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.229435+0000","last_change":"2023-07-09T21:36:01.224105+0000","last_active":"2023-07-09T21:36:01.229435+0000","last_peered":"2023-07-09T21:36:01.229435+0000","last_clean":"2023-07-09T21:36:01.229435+0000","last_became_active":"2023-07-09T21:36:01.223766+0000","last_became_peered":"2023-07-09T21:36:01.223766+0000","last_unstale":"2023-07-09T21:36:01.229435+0000","last_undegraded":"2023-07-09T21:36:01.229435+0000","last_fullsized":"2023-07-09T21:36:01.229435+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:44.479678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":97,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.206231+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:36:01.206231+0000","last_peered":"2023-07-09T21:36:01.206231+0000","last_clean":"2023-07-09T21:36:01.206231+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:36:01.206231+0000","last_undegraded":"2023-07-09T21:36:01.206231+0000","last_fullsized":"2023-07-09T21:36:01.206231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:38.377484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":66,"state":"creating+peering","last_fresh":"2023-07-09T21:36:01.217046+0000","last_change":"2023-07-09T21:36:01.217046+0000","last_active":"2023-07-09T21:36:01.199614+0000","last_peered":"2023-07-09T21:36:01.199614+0000","last_clean":"2023-07-09T21:36:01.199614+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:36:01.217046+0000","last_undegraded":"2023-07-09T21:36:01.217046+0000","last_fullsized":"2023-07-09T21:36:01.217046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.235421+0000","last_change":"2023-07-09T21:36:01.228012+0000","last_active":"2023-07-09T21:36:01.235421+0000","last_peered":"2023-07-09T21:36:01.235421+0000","last_clean":"2023-07-09T21:36:01.235421+0000","last_became_active":"2023-07-09T21:36:01.227731+0000","last_became_peered":"2023-07-09T21:36:01.227731+0000","last_unstale":"2023-07-09T21:36:01.235421+0000","last_undegraded":"2023-07-09T21:36:01.235421+0000","last_fullsized":"2023-07-09T21:36:01.235421+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.245605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-07-09T21:36:01.221584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:36:01.221584+0000","last_peered":"2023-07-09T21:36:01.221584+0000","last_clean":"2023-07-09T21:36:01.221584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:36:01.221584+0000","last_undegraded":"2023-07-09T21:36:01.221584+0000","last_fullsized":"2023-07-09T21:36:01.221584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:15.554044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575016,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58636,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313204,"statfs":{"total":96636764160,"available":96576720896,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93799999999999994,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.59399999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":0.95599999999999996,"15min":0.998},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85699999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.71599999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.88100000000000001,"5min":0.96199999999999997,"15min":1.619},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81799999999999995,"5min":0.96999999999999997,"15min":1.008},"last":0.87}]},{"osd":3,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":1.665},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.054,"15min":1.2629999999999999},"last":0.68899999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.70199999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.441},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.002},"last":0.56100000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.439,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98499999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76800000000000002,"5min":0.93600000000000005,"15min":1.0569999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.52600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.96299999999999997,"15min":1.0569999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.39600000000000002},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":0.97599999999999998},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575015,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31804,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340036,"statfs":{"total":96636764160,"available":96604196864,"internally_reserved":0,"allocated":774144,"data_stored":381294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.996,"15min":1.0569999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76100000000000001,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96999999999999997,"5min":1.0049999999999999,"15min":1.1519999999999999},"last":0.63800000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.70899999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.45500000000000002},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.165},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45900000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.72999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.745,"5min":0.90000000000000002,"15min":1.111},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.68400000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.871,"5min":0.90600000000000003,"15min":1.1950000000000001},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.006},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.2070000000000001},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575014,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72499999999999998,"15min":0.70399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.246},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90100000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.79800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":1.02,"15min":1.02},"last":0.77800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.91200000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76300000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97199999999999998,"5min":1.01,"15min":1.01},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":1.0169999999999999},"last":0.71299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.872,"5min":0.998,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":1.014},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.84099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.92000000000000004,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.33600000000000002},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":1.02},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.78700000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":1.165},"last":0.60599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0629999999999999,"15min":1.107},"last":0.754}]},{"osd":7,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":0.93600000000000005,"15min":0.997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.98099999999999998,"15min":1.042},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575015,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.42599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.97799999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.40600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.92600000000000005,"15min":0.96599999999999997},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.51100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.47099999999999997},"max":{"1min":1.262,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.503},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.016,"5min":1.1799999999999999,"15min":1.208},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2370000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.56200000000000006}]},{"osd":7,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.296},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.48599999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.323},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834575016,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53960,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317880,"statfs":{"total":96636764160,"available":96581509120,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.45100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":1.0409999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.374},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.54200000000000004},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.121,"5min":1.2609999999999999,"15min":1.4570000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.995,"5min":1.319,"15min":1.3839999999999999},"last":0.622},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.2090000000000001,"15min":1.337},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50800000000000001},"max":{"1min":1.05,"5min":1.417,"15min":1.4850000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3340000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1399999999999999,"5min":1.478,"15min":1.478},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":786432,"data_stored":387922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.871},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.78800000000000003},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.624}]},{"osd":3,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.385},"last":0.67600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":1.212,"5min":1.212,"15min":1.419},"last":0.93300000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"max":{"1min":1.169,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.083,"5min":1.149,"15min":1.242},"last":0.91300000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"max":{"1min":0.98099999999999998,"5min":0.999,"15min":1.335},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.83499999999999996,"15min":0.81599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2230000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.97399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53600000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83499999999999996,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.88}]}]},{"osd":0,"up_from":13,"seq":55834575016,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1348,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1380352,"data_stored":978290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.753,"15min":0.753},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":1.0489999999999999},"last":0.47099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.433}]},{"osd":3,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.143},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.274},"last":0.51200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.151,"15min":1.6559999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.294,"15min":1.319},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.4350000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.68500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.81799999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53500000000000003},"max":{"1min":1.222,"5min":1.3460000000000001,"15min":1.3660000000000001},"last":0.59799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98899999999999999,"5min":1.2689999999999999,"15min":1.5980000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.0780000000000001,"5min":1.365,"15min":1.5740000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:36:10.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:36:11.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 Processor -- start 2023-07-09T21:36:11.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 -- start start 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b7ab0 0x7fa7e806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7e80cef80 0x7fa7e80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e80b49f0 con 0x7fa7e80b4170 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e80b7e80 con 0x7fa7e80cef80 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ef86d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80b45f0 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7e80cef80 0x7fa7e80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7e80cef80 0x7fa7e80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53566/0 (socket says 172.21.15.37:53566) 2023-07-09T21:36:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ede0a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7e80b4170 0x7fa7e815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36244/0 (socket says 172.21.15.37:36244) 2023-07-09T21:36:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 -- 172.21.15.37:0/1276217643 learned_addr learned my addr 172.21.15.37:0/1276217643 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:11.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ed609640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b7ab0 0x7fa7e806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 -- 172.21.15.37:0/1276217643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b7ab0 msgr2=0x7fa7e806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b7ab0 0x7fa7e806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 -- 172.21.15.37:0/1276217643 >> v1:172.21.15.37:6789/0 conn(0x7fa7e80b4170 legacy=0x7fa7e815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.129+0000 7fa7ece08640 1 -- 172.21.15.37:0/1276217643 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e80cc8a0 con 0x7fa7e80cef80 2023-07-09T21:36:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ece08640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80cef80 0x7fa7e80b3c30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009870 tx=0x7fa7d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d98ddfe2800143 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7dffff640 1 -- 172.21.15.37:0/1276217643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80aa670 con 0x7fa7e80cef80 2023-07-09T21:36:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7dffff640 1 -- 172.21.15.37:0/1276217643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80aa7d0 con 0x7fa7e80cef80 2023-07-09T21:36:11.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7dffff640 1 -- 172.21.15.37:0/1276217643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80aab60 con 0x7fa7e80cef80 2023-07-09T21:36:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 -- 172.21.15.37:0/1276217643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80cef80 msgr2=0x7fa7e80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80cef80 0x7fa7e80b3c30 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009870 tx=0x7fa7d801c510 comp rx=0 tx=0).stop 2023-07-09T21:36:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 -- 172.21.15.37:0/1276217643 shutdown_connections 2023-07-09T21:36:11.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80cef80 0x7fa7e80b3c30 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/1276217643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b7ab0 0x7fa7e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 -- 172.21.15.37:0/1276217643 >> 172.21.15.37:0/1276217643 conn(0x7fa7e8073090 msgr2=0x7fa7e8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:11.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 -- 172.21.15.37:0/1276217643 shutdown_connections 2023-07-09T21:36:11.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.133+0000 7fa7ef86d640 1 -- 172.21.15.37:0/1276217643 wait complete. 2023-07-09T21:36:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 Processor -- start 2023-07-09T21:36:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- start start 2023-07-09T21:36:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 0x7fa7e80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7e80cef80 0x7fa7e814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e80c6330 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8149870 con 0x7fa7e80cef80 2023-07-09T21:36:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e8157fb0 con 0x7fa7e80b4170 2023-07-09T21:36:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ed609640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 0x7fa7e80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ed609640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 0x7fa7e80c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:45016/0 (socket says 172.21.15.37:45016) 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ed609640 1 -- 172.21.15.37:0/2138724189 learned_addr learned my addr 172.21.15.37:0/2138724189 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53578/0 (socket says 172.21.15.37:53578) 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ede0a640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7e80cef80 0x7fa7e814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 -- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 msgr2=0x7fa7e80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 0x7fa7e80c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 -- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7e80cef80 msgr2=0x7fa7e814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7e80cef80 0x7fa7e814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 -- 172.21.15.37:0/2138724189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80094d0 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ece08640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80ab000 tx=0x7fa7d801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b3800 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80b39a0 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e8158290 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b3d50 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.137+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e80c5fc0 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e80c64a0 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa7d80b2380 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ddffb640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 0x7fa7cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7d811e840 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ed609640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 0x7fa7cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.141+0000 7fa7ed609640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 0x7fa7cc068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4007b10 tx=0x7fa7e4008040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.145+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7d80ebb40 con 0x7fa7e80b7ab0 2023-07-09T21:36:11.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.297+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7e80cf4d0 con 0x7fa7cc0663a0 2023-07-09T21:36:11.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ddffb640 1 -- 172.21.15.37:0/2138724189 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311567 (secure 0 0 0) 0x7fa7e40109c0 con 0x7fa7cc0663a0 2023-07-09T21:36:11.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:11.311 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:36:11.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 msgr2=0x7fa7cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 0x7fa7cc068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4007b10 tx=0x7fa7e4008040 comp rx=0 tx=0).stop 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 msgr2=0x7fa7e8147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80ab000 tx=0x7fa7d801ad50 comp rx=0 tx=0).stop 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.309+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 shutdown_connections 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7e80cef80 0x7fa7e814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7e80b7ab0 0x7fa7e8147720 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fa7cc0663a0 0x7fa7cc068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 --2- 172.21.15.37:0/2138724189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7e80b4170 0x7fa7e80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 >> 172.21.15.37:0/2138724189 conn(0x7fa7e8073090 msgr2=0x7fa7e80b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 shutdown_connections 2023-07-09T21:36:11.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.313+0000 7fa7ef86d640 1 -- 172.21.15.37:0/2138724189 wait complete. 2023-07-09T21:36:11.330 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:36:09.954726+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":244,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":178,"ondisk_log_size":178,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":322376,"kb_used_data":7560,"kb_used_omap":0,"kb_used_meta":314752,"kb_avail":754652344,"statfs":{"total":773094113280,"available":772764000256,"internally_reserved":0,"allocated":7741440,"data_stored":4399084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":322306048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002059"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935496+0000","last_change":"2023-07-09T21:36:02.236423+0000","last_active":"2023-07-09T21:36:03.935496+0000","last_peered":"2023-07-09T21:36:03.935496+0000","last_clean":"2023-07-09T21:36:03.935496+0000","last_became_active":"2023-07-09T21:36:02.236115+0000","last_became_peered":"2023-07-09T21:36:02.236115+0000","last_unstale":"2023-07-09T21:36:03.935496+0000","last_undegraded":"2023-07-09T21:36:03.935496+0000","last_fullsized":"2023-07-09T21:36:03.935496+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:08:48.774157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256236+0000","last_change":"2023-07-09T21:36:02.242636+0000","last_active":"2023-07-09T21:36:03.256236+0000","last_peered":"2023-07-09T21:36:03.256236+0000","last_clean":"2023-07-09T21:36:03.256236+0000","last_became_active":"2023-07-09T21:36:02.242213+0000","last_became_peered":"2023-07-09T21:36:02.242213+0000","last_unstale":"2023-07-09T21:36:03.256236+0000","last_undegraded":"2023-07-09T21:36:03.256236+0000","last_fullsized":"2023-07-09T21:36:03.256236+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:27:11.631164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935062+0000","last_change":"2023-07-09T21:36:02.253003+0000","last_active":"2023-07-09T21:36:03.935062+0000","last_peered":"2023-07-09T21:36:03.935062+0000","last_clean":"2023-07-09T21:36:03.935062+0000","last_became_active":"2023-07-09T21:36:02.252736+0000","last_became_peered":"2023-07-09T21:36:02.252736+0000","last_unstale":"2023-07-09T21:36:03.935062+0000","last_undegraded":"2023-07-09T21:36:03.935062+0000","last_fullsized":"2023-07-09T21:36:03.935062+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:13:53.473732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256223+0000","last_change":"2023-07-09T21:36:02.255971+0000","last_active":"2023-07-09T21:36:03.256223+0000","last_peered":"2023-07-09T21:36:03.256223+0000","last_clean":"2023-07-09T21:36:03.256223+0000","last_became_active":"2023-07-09T21:36:02.255669+0000","last_became_peered":"2023-07-09T21:36:02.255669+0000","last_unstale":"2023-07-09T21:36:03.256223+0000","last_undegraded":"2023-07-09T21:36:03.256223+0000","last_fullsized":"2023-07-09T21:36:03.256223+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:53.877187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936604+0000","last_change":"2023-07-09T21:36:02.242432+0000","last_active":"2023-07-09T21:36:03.936604+0000","last_peered":"2023-07-09T21:36:03.936604+0000","last_clean":"2023-07-09T21:36:03.936604+0000","last_became_active":"2023-07-09T21:36:02.242145+0000","last_became_peered":"2023-07-09T21:36:02.242145+0000","last_unstale":"2023-07-09T21:36:03.936604+0000","last_undegraded":"2023-07-09T21:36:03.936604+0000","last_fullsized":"2023-07-09T21:36:03.936604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:33:56.930864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935356+0000","last_change":"2023-07-09T21:36:02.250284+0000","last_active":"2023-07-09T21:36:03.935356+0000","last_peered":"2023-07-09T21:36:03.935356+0000","last_clean":"2023-07-09T21:36:03.935356+0000","last_became_active":"2023-07-09T21:36:02.249858+0000","last_became_peered":"2023-07-09T21:36:02.249858+0000","last_unstale":"2023-07-09T21:36:03.935356+0000","last_undegraded":"2023-07-09T21:36:03.935356+0000","last_fullsized":"2023-07-09T21:36:03.935356+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:17.101636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932895+0000","last_change":"2023-07-09T21:36:02.247048+0000","last_active":"2023-07-09T21:36:03.932895+0000","last_peered":"2023-07-09T21:36:03.932895+0000","last_clean":"2023-07-09T21:36:03.932895+0000","last_became_active":"2023-07-09T21:36:02.245670+0000","last_became_peered":"2023-07-09T21:36:02.245670+0000","last_unstale":"2023-07-09T21:36:03.932895+0000","last_undegraded":"2023-07-09T21:36:03.932895+0000","last_fullsized":"2023-07-09T21:36:03.932895+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:45.486984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932891+0000","last_change":"2023-07-09T21:36:02.254920+0000","last_active":"2023-07-09T21:36:03.932891+0000","last_peered":"2023-07-09T21:36:03.932891+0000","last_clean":"2023-07-09T21:36:03.932891+0000","last_became_active":"2023-07-09T21:36:02.254671+0000","last_became_peered":"2023-07-09T21:36:02.254671+0000","last_unstale":"2023-07-09T21:36:03.932891+0000","last_undegraded":"2023-07-09T21:36:03.932891+0000","last_fullsized":"2023-07-09T21:36:03.932891+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:32:17.313891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934186+0000","last_change":"2023-07-09T21:36:02.261801+0000","last_active":"2023-07-09T21:36:03.934186+0000","last_peered":"2023-07-09T21:36:03.934186+0000","last_clean":"2023-07-09T21:36:03.934186+0000","last_became_active":"2023-07-09T21:36:02.261518+0000","last_became_peered":"2023-07-09T21:36:02.261518+0000","last_unstale":"2023-07-09T21:36:03.934186+0000","last_undegraded":"2023-07-09T21:36:03.934186+0000","last_fullsized":"2023-07-09T21:36:03.934186+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:27:46.813445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935514+0000","last_change":"2023-07-09T21:36:02.238910+0000","last_active":"2023-07-09T21:36:03.935514+0000","last_peered":"2023-07-09T21:36:03.935514+0000","last_clean":"2023-07-09T21:36:03.935514+0000","last_became_active":"2023-07-09T21:36:02.238633+0000","last_became_peered":"2023-07-09T21:36:02.238633+0000","last_unstale":"2023-07-09T21:36:03.935514+0000","last_undegraded":"2023-07-09T21:36:03.935514+0000","last_fullsized":"2023-07-09T21:36:03.935514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:00.599546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933470+0000","last_change":"2023-07-09T21:36:02.241192+0000","last_active":"2023-07-09T21:36:03.933470+0000","last_peered":"2023-07-09T21:36:03.933470+0000","last_clean":"2023-07-09T21:36:03.933470+0000","last_became_active":"2023-07-09T21:36:02.240893+0000","last_became_peered":"2023-07-09T21:36:02.240893+0000","last_unstale":"2023-07-09T21:36:03.933470+0000","last_undegraded":"2023-07-09T21:36:03.933470+0000","last_fullsized":"2023-07-09T21:36:03.933470+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:15:17.894965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933590+0000","last_change":"2023-07-09T21:36:02.234940+0000","last_active":"2023-07-09T21:36:03.933590+0000","last_peered":"2023-07-09T21:36:03.933590+0000","last_clean":"2023-07-09T21:36:03.933590+0000","last_became_active":"2023-07-09T21:36:02.234677+0000","last_became_peered":"2023-07-09T21:36:02.234677+0000","last_unstale":"2023-07-09T21:36:03.933590+0000","last_undegraded":"2023-07-09T21:36:03.933590+0000","last_fullsized":"2023-07-09T21:36:03.933590+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:29:32.969949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935584+0000","last_change":"2023-07-09T21:36:02.238497+0000","last_active":"2023-07-09T21:36:03.935584+0000","last_peered":"2023-07-09T21:36:03.935584+0000","last_clean":"2023-07-09T21:36:03.935584+0000","last_became_active":"2023-07-09T21:36:02.238169+0000","last_became_peered":"2023-07-09T21:36:02.238169+0000","last_unstale":"2023-07-09T21:36:03.935584+0000","last_undegraded":"2023-07-09T21:36:03.935584+0000","last_fullsized":"2023-07-09T21:36:03.935584+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:31.883208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933193+0000","last_change":"2023-07-09T21:36:02.257218+0000","last_active":"2023-07-09T21:36:03.933193+0000","last_peered":"2023-07-09T21:36:03.933193+0000","last_clean":"2023-07-09T21:36:03.933193+0000","last_became_active":"2023-07-09T21:36:02.256594+0000","last_became_peered":"2023-07-09T21:36:02.256594+0000","last_unstale":"2023-07-09T21:36:03.933193+0000","last_undegraded":"2023-07-09T21:36:03.933193+0000","last_fullsized":"2023-07-09T21:36:03.933193+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:45.252911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256336+0000","last_change":"2023-07-09T21:36:02.245377+0000","last_active":"2023-07-09T21:36:03.256336+0000","last_peered":"2023-07-09T21:36:03.256336+0000","last_clean":"2023-07-09T21:36:03.256336+0000","last_became_active":"2023-07-09T21:36:02.242278+0000","last_became_peered":"2023-07-09T21:36:02.242278+0000","last_unstale":"2023-07-09T21:36:03.256336+0000","last_undegraded":"2023-07-09T21:36:03.256336+0000","last_fullsized":"2023-07-09T21:36:03.256336+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:48.845037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935225+0000","last_change":"2023-07-09T21:36:02.238770+0000","last_active":"2023-07-09T21:36:03.935225+0000","last_peered":"2023-07-09T21:36:03.935225+0000","last_clean":"2023-07-09T21:36:03.935225+0000","last_became_active":"2023-07-09T21:36:02.238465+0000","last_became_peered":"2023-07-09T21:36:02.238465+0000","last_unstale":"2023-07-09T21:36:03.935225+0000","last_undegraded":"2023-07-09T21:36:03.935225+0000","last_fullsized":"2023-07-09T21:36:03.935225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:48:39.419977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934393+0000","last_change":"2023-07-09T21:36:02.253650+0000","last_active":"2023-07-09T21:36:03.934393+0000","last_peered":"2023-07-09T21:36:03.934393+0000","last_clean":"2023-07-09T21:36:03.934393+0000","last_became_active":"2023-07-09T21:36:02.253093+0000","last_became_peered":"2023-07-09T21:36:02.253093+0000","last_unstale":"2023-07-09T21:36:03.934393+0000","last_undegraded":"2023-07-09T21:36:03.934393+0000","last_fullsized":"2023-07-09T21:36:03.934393+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:11.229828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256358+0000","last_change":"2023-07-09T21:36:02.245224+0000","last_active":"2023-07-09T21:36:03.256358+0000","last_peered":"2023-07-09T21:36:03.256358+0000","last_clean":"2023-07-09T21:36:03.256358+0000","last_became_active":"2023-07-09T21:36:02.244132+0000","last_became_peered":"2023-07-09T21:36:02.244132+0000","last_unstale":"2023-07-09T21:36:03.256358+0000","last_undegraded":"2023-07-09T21:36:03.256358+0000","last_fullsized":"2023-07-09T21:36:03.256358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:12.696687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935073+0000","last_change":"2023-07-09T21:36:02.262286+0000","last_active":"2023-07-09T21:36:03.935073+0000","last_peered":"2023-07-09T21:36:03.935073+0000","last_clean":"2023-07-09T21:36:03.935073+0000","last_became_active":"2023-07-09T21:36:02.260649+0000","last_became_peered":"2023-07-09T21:36:02.260649+0000","last_unstale":"2023-07-09T21:36:03.935073+0000","last_undegraded":"2023-07-09T21:36:03.935073+0000","last_fullsized":"2023-07-09T21:36:03.935073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:57:21.243959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253668+0000","last_change":"2023-07-09T21:36:02.243796+0000","last_active":"2023-07-09T21:36:03.253668+0000","last_peered":"2023-07-09T21:36:03.253668+0000","last_clean":"2023-07-09T21:36:03.253668+0000","last_became_active":"2023-07-09T21:36:02.243073+0000","last_became_peered":"2023-07-09T21:36:02.243073+0000","last_unstale":"2023-07-09T21:36:03.253668+0000","last_undegraded":"2023-07-09T21:36:03.253668+0000","last_fullsized":"2023-07-09T21:36:03.253668+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:03.444468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254049+0000","last_change":"2023-07-09T21:36:02.246138+0000","last_active":"2023-07-09T21:36:03.254049+0000","last_peered":"2023-07-09T21:36:03.254049+0000","last_clean":"2023-07-09T21:36:03.254049+0000","last_became_active":"2023-07-09T21:36:02.245851+0000","last_became_peered":"2023-07-09T21:36:02.245851+0000","last_unstale":"2023-07-09T21:36:03.254049+0000","last_undegraded":"2023-07-09T21:36:03.254049+0000","last_fullsized":"2023-07-09T21:36:03.254049+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:36:05.775340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932630+0000","last_change":"2023-07-09T21:36:02.240653+0000","last_active":"2023-07-09T21:36:03.932630+0000","last_peered":"2023-07-09T21:36:03.932630+0000","last_clean":"2023-07-09T21:36:03.932630+0000","last_became_active":"2023-07-09T21:36:02.240315+0000","last_became_peered":"2023-07-09T21:36:02.240315+0000","last_unstale":"2023-07-09T21:36:03.932630+0000","last_undegraded":"2023-07-09T21:36:03.932630+0000","last_fullsized":"2023-07-09T21:36:03.932630+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:19.268638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932789+0000","last_change":"2023-07-09T21:36:02.241138+0000","last_active":"2023-07-09T21:36:03.932789+0000","last_peered":"2023-07-09T21:36:03.932789+0000","last_clean":"2023-07-09T21:36:03.932789+0000","last_became_active":"2023-07-09T21:36:02.240828+0000","last_became_peered":"2023-07-09T21:36:02.240828+0000","last_unstale":"2023-07-09T21:36:03.932789+0000","last_undegraded":"2023-07-09T21:36:03.932789+0000","last_fullsized":"2023-07-09T21:36:03.932789+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:42.657319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934791+0000","last_change":"2023-07-09T21:36:02.247326+0000","last_active":"2023-07-09T21:36:03.934791+0000","last_peered":"2023-07-09T21:36:03.934791+0000","last_clean":"2023-07-09T21:36:03.934791+0000","last_became_active":"2023-07-09T21:36:02.245342+0000","last_became_peered":"2023-07-09T21:36:02.245342+0000","last_unstale":"2023-07-09T21:36:03.934791+0000","last_undegraded":"2023-07-09T21:36:03.934791+0000","last_fullsized":"2023-07-09T21:36:03.934791+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:32:53.097551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934558+0000","last_change":"2023-07-09T21:36:02.260381+0000","last_active":"2023-07-09T21:36:03.934558+0000","last_peered":"2023-07-09T21:36:03.934558+0000","last_clean":"2023-07-09T21:36:03.934558+0000","last_became_active":"2023-07-09T21:36:02.260110+0000","last_became_peered":"2023-07-09T21:36:02.260110+0000","last_unstale":"2023-07-09T21:36:03.934558+0000","last_undegraded":"2023-07-09T21:36:03.934558+0000","last_fullsized":"2023-07-09T21:36:03.934558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:30.113358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934012+0000","last_change":"2023-07-09T21:36:02.242612+0000","last_active":"2023-07-09T21:36:03.934012+0000","last_peered":"2023-07-09T21:36:03.934012+0000","last_clean":"2023-07-09T21:36:03.934012+0000","last_became_active":"2023-07-09T21:36:02.241774+0000","last_became_peered":"2023-07-09T21:36:02.241774+0000","last_unstale":"2023-07-09T21:36:03.934012+0000","last_undegraded":"2023-07-09T21:36:03.934012+0000","last_fullsized":"2023-07-09T21:36:03.934012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:39:25.610731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935749+0000","last_change":"2023-07-09T21:36:02.253703+0000","last_active":"2023-07-09T21:36:03.935749+0000","last_peered":"2023-07-09T21:36:03.935749+0000","last_clean":"2023-07-09T21:36:03.935749+0000","last_became_active":"2023-07-09T21:36:02.253422+0000","last_became_peered":"2023-07-09T21:36:02.253422+0000","last_unstale":"2023-07-09T21:36:03.935749+0000","last_undegraded":"2023-07-09T21:36:03.935749+0000","last_fullsized":"2023-07-09T21:36:03.935749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:01.767290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254794+0000","last_change":"2023-07-09T21:36:02.244010+0000","last_active":"2023-07-09T21:36:03.254794+0000","last_peered":"2023-07-09T21:36:03.254794+0000","last_clean":"2023-07-09T21:36:03.254794+0000","last_became_active":"2023-07-09T21:36:02.243492+0000","last_became_peered":"2023-07-09T21:36:02.243492+0000","last_unstale":"2023-07-09T21:36:03.254794+0000","last_undegraded":"2023-07-09T21:36:03.254794+0000","last_fullsized":"2023-07-09T21:36:03.254794+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:10.594991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933727+0000","last_change":"2023-07-09T21:36:02.250411+0000","last_active":"2023-07-09T21:36:03.933727+0000","last_peered":"2023-07-09T21:36:03.933727+0000","last_clean":"2023-07-09T21:36:03.933727+0000","last_became_active":"2023-07-09T21:36:02.250039+0000","last_became_peered":"2023-07-09T21:36:02.250039+0000","last_unstale":"2023-07-09T21:36:03.933727+0000","last_undegraded":"2023-07-09T21:36:03.933727+0000","last_fullsized":"2023-07-09T21:36:03.933727+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:42.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256058+0000","last_change":"2023-07-09T21:36:02.245866+0000","last_active":"2023-07-09T21:36:03.256058+0000","last_peered":"2023-07-09T21:36:03.256058+0000","last_clean":"2023-07-09T21:36:03.256058+0000","last_became_active":"2023-07-09T21:36:02.245592+0000","last_became_peered":"2023-07-09T21:36:02.245592+0000","last_unstale":"2023-07-09T21:36:03.256058+0000","last_undegraded":"2023-07-09T21:36:03.256058+0000","last_fullsized":"2023-07-09T21:36:03.256058+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:08.875299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933036+0000","last_change":"2023-07-09T21:36:02.247513+0000","last_active":"2023-07-09T21:36:03.933036+0000","last_peered":"2023-07-09T21:36:03.933036+0000","last_clean":"2023-07-09T21:36:03.933036+0000","last_became_active":"2023-07-09T21:36:02.245989+0000","last_became_peered":"2023-07-09T21:36:02.245989+0000","last_unstale":"2023-07-09T21:36:03.933036+0000","last_undegraded":"2023-07-09T21:36:03.933036+0000","last_fullsized":"2023-07-09T21:36:03.933036+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:01.767290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254189+0000","last_change":"2023-07-09T21:36:02.257450+0000","last_active":"2023-07-09T21:36:03.254189+0000","last_peered":"2023-07-09T21:36:03.254189+0000","last_clean":"2023-07-09T21:36:03.254189+0000","last_became_active":"2023-07-09T21:36:02.257008+0000","last_became_peered":"2023-07-09T21:36:02.257008+0000","last_unstale":"2023-07-09T21:36:03.254189+0000","last_undegraded":"2023-07-09T21:36:03.254189+0000","last_fullsized":"2023-07-09T21:36:03.254189+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:01.393361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255454+0000","last_change":"2023-07-09T21:36:02.245558+0000","last_active":"2023-07-09T21:36:03.255454+0000","last_peered":"2023-07-09T21:36:03.255454+0000","last_clean":"2023-07-09T21:36:03.255454+0000","last_became_active":"2023-07-09T21:36:02.244190+0000","last_became_peered":"2023-07-09T21:36:02.244190+0000","last_unstale":"2023-07-09T21:36:03.255454+0000","last_undegraded":"2023-07-09T21:36:03.255454+0000","last_fullsized":"2023-07-09T21:36:03.255454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:56.002706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"67'4","reported_seq":17,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254929+0000","last_change":"2023-07-09T21:36:01.225140+0000","last_active":"2023-07-09T21:36:03.254929+0000","last_peered":"2023-07-09T21:36:03.254929+0000","last_clean":"2023-07-09T21:36:03.254929+0000","last_became_active":"2023-07-09T21:36:01.224854+0000","last_became_peered":"2023-07-09T21:36:01.224854+0000","last_unstale":"2023-07-09T21:36:03.254929+0000","last_undegraded":"2023-07-09T21:36:03.254929+0000","last_fullsized":"2023-07-09T21:36:03.254929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:09:37.224596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253772+0000","last_change":"2023-07-09T21:36:02.246626+0000","last_active":"2023-07-09T21:36:03.253772+0000","last_peered":"2023-07-09T21:36:03.253772+0000","last_clean":"2023-07-09T21:36:03.253772+0000","last_became_active":"2023-07-09T21:36:02.246363+0000","last_became_peered":"2023-07-09T21:36:02.246363+0000","last_unstale":"2023-07-09T21:36:03.253772+0000","last_undegraded":"2023-07-09T21:36:03.253772+0000","last_fullsized":"2023-07-09T21:36:03.253772+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:16:15.575455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935660+0000","last_change":"2023-07-09T21:36:01.222625+0000","last_active":"2023-07-09T21:36:03.935660+0000","last_peered":"2023-07-09T21:36:03.935660+0000","last_clean":"2023-07-09T21:36:03.935660+0000","last_became_active":"2023-07-09T21:36:01.222368+0000","last_became_peered":"2023-07-09T21:36:01.222368+0000","last_unstale":"2023-07-09T21:36:03.935660+0000","last_undegraded":"2023-07-09T21:36:03.935660+0000","last_fullsized":"2023-07-09T21:36:03.935660+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:03:44.144938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254157+0000","last_change":"2023-07-09T21:36:02.246315+0000","last_active":"2023-07-09T21:36:03.254157+0000","last_peered":"2023-07-09T21:36:03.254157+0000","last_clean":"2023-07-09T21:36:03.254157+0000","last_became_active":"2023-07-09T21:36:02.246015+0000","last_became_peered":"2023-07-09T21:36:02.246015+0000","last_unstale":"2023-07-09T21:36:03.254157+0000","last_undegraded":"2023-07-09T21:36:03.254157+0000","last_fullsized":"2023-07-09T21:36:03.254157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:11:06.095356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935856+0000","last_change":"2023-07-09T21:36:01.223626+0000","last_active":"2023-07-09T21:36:03.935856+0000","last_peered":"2023-07-09T21:36:03.935856+0000","last_clean":"2023-07-09T21:36:03.935856+0000","last_became_active":"2023-07-09T21:36:01.223318+0000","last_became_peered":"2023-07-09T21:36:01.223318+0000","last_unstale":"2023-07-09T21:36:03.935856+0000","last_undegraded":"2023-07-09T21:36:03.935856+0000","last_fullsized":"2023-07-09T21:36:03.935856+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:37:44.245605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933568+0000","last_change":"2023-07-09T21:36:02.241237+0000","last_active":"2023-07-09T21:36:03.933568+0000","last_peered":"2023-07-09T21:36:03.933568+0000","last_clean":"2023-07-09T21:36:03.933568+0000","last_became_active":"2023-07-09T21:36:02.240608+0000","last_became_peered":"2023-07-09T21:36:02.240608+0000","last_unstale":"2023-07-09T21:36:03.933568+0000","last_undegraded":"2023-07-09T21:36:03.933568+0000","last_fullsized":"2023-07-09T21:36:03.933568+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:34.239601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254026+0000","last_change":"2023-07-09T21:36:01.228047+0000","last_active":"2023-07-09T21:36:03.254026+0000","last_peered":"2023-07-09T21:36:03.254026+0000","last_clean":"2023-07-09T21:36:03.254026+0000","last_became_active":"2023-07-09T21:36:01.227750+0000","last_became_peered":"2023-07-09T21:36:01.227750+0000","last_unstale":"2023-07-09T21:36:03.254026+0000","last_undegraded":"2023-07-09T21:36:03.254026+0000","last_fullsized":"2023-07-09T21:36:03.254026+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:56.360723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936827+0000","last_change":"2023-07-09T21:36:02.256539+0000","last_active":"2023-07-09T21:36:03.936827+0000","last_peered":"2023-07-09T21:36:03.936827+0000","last_clean":"2023-07-09T21:36:03.936827+0000","last_became_active":"2023-07-09T21:36:02.256204+0000","last_became_peered":"2023-07-09T21:36:02.256204+0000","last_unstale":"2023-07-09T21:36:03.936827+0000","last_undegraded":"2023-07-09T21:36:03.936827+0000","last_fullsized":"2023-07-09T21:36:03.936827+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:08:20.083164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933868+0000","last_change":"2023-07-09T21:36:01.230840+0000","last_active":"2023-07-09T21:36:03.933868+0000","last_peered":"2023-07-09T21:36:03.933868+0000","last_clean":"2023-07-09T21:36:03.933868+0000","last_became_active":"2023-07-09T21:36:01.230598+0000","last_became_peered":"2023-07-09T21:36:01.230598+0000","last_unstale":"2023-07-09T21:36:03.933868+0000","last_undegraded":"2023-07-09T21:36:03.933868+0000","last_fullsized":"2023-07-09T21:36:03.933868+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:09:00.706882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255698+0000","last_change":"2023-07-09T21:36:02.245388+0000","last_active":"2023-07-09T21:36:03.255698+0000","last_peered":"2023-07-09T21:36:03.255698+0000","last_clean":"2023-07-09T21:36:03.255698+0000","last_became_active":"2023-07-09T21:36:02.245090+0000","last_became_peered":"2023-07-09T21:36:02.245090+0000","last_unstale":"2023-07-09T21:36:03.255698+0000","last_undegraded":"2023-07-09T21:36:03.255698+0000","last_fullsized":"2023-07-09T21:36:03.255698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:38:37.653290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936448+0000","last_change":"2023-07-09T21:36:01.225992+0000","last_active":"2023-07-09T21:36:03.936448+0000","last_peered":"2023-07-09T21:36:03.936448+0000","last_clean":"2023-07-09T21:36:03.936448+0000","last_became_active":"2023-07-09T21:36:01.225688+0000","last_became_peered":"2023-07-09T21:36:01.225688+0000","last_unstale":"2023-07-09T21:36:03.936448+0000","last_undegraded":"2023-07-09T21:36:03.936448+0000","last_fullsized":"2023-07-09T21:36:03.936448+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:55.019392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934285+0000","last_change":"2023-07-09T21:36:02.242782+0000","last_active":"2023-07-09T21:36:03.934285+0000","last_peered":"2023-07-09T21:36:03.934285+0000","last_clean":"2023-07-09T21:36:03.934285+0000","last_became_active":"2023-07-09T21:36:02.242309+0000","last_became_peered":"2023-07-09T21:36:02.242309+0000","last_unstale":"2023-07-09T21:36:03.934285+0000","last_undegraded":"2023-07-09T21:36:03.934285+0000","last_fullsized":"2023-07-09T21:36:03.934285+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:04.169614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254155+0000","last_change":"2023-07-09T21:36:01.228681+0000","last_active":"2023-07-09T21:36:03.254155+0000","last_peered":"2023-07-09T21:36:03.254155+0000","last_clean":"2023-07-09T21:36:03.254155+0000","last_became_active":"2023-07-09T21:36:01.228276+0000","last_became_peered":"2023-07-09T21:36:01.228276+0000","last_unstale":"2023-07-09T21:36:03.254155+0000","last_undegraded":"2023-07-09T21:36:03.254155+0000","last_fullsized":"2023-07-09T21:36:03.254155+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:48:07.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256206+0000","last_change":"2023-07-09T21:36:02.265155+0000","last_active":"2023-07-09T21:36:03.256206+0000","last_peered":"2023-07-09T21:36:03.256206+0000","last_clean":"2023-07-09T21:36:03.256206+0000","last_became_active":"2023-07-09T21:36:02.264806+0000","last_became_peered":"2023-07-09T21:36:02.264806+0000","last_unstale":"2023-07-09T21:36:03.256206+0000","last_undegraded":"2023-07-09T21:36:03.256206+0000","last_fullsized":"2023-07-09T21:36:03.256206+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:55.046296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934926+0000","last_change":"2023-07-09T21:36:01.231014+0000","last_active":"2023-07-09T21:36:03.934926+0000","last_peered":"2023-07-09T21:36:03.934926+0000","last_clean":"2023-07-09T21:36:03.934926+0000","last_became_active":"2023-07-09T21:36:01.230682+0000","last_became_peered":"2023-07-09T21:36:01.230682+0000","last_unstale":"2023-07-09T21:36:03.934926+0000","last_undegraded":"2023-07-09T21:36:03.934926+0000","last_fullsized":"2023-07-09T21:36:03.934926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:45.772442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936409+0000","last_change":"2023-07-09T21:36:02.257165+0000","last_active":"2023-07-09T21:36:03.936409+0000","last_peered":"2023-07-09T21:36:03.936409+0000","last_clean":"2023-07-09T21:36:03.936409+0000","last_became_active":"2023-07-09T21:36:02.256776+0000","last_became_peered":"2023-07-09T21:36:02.256776+0000","last_unstale":"2023-07-09T21:36:03.936409+0000","last_undegraded":"2023-07-09T21:36:03.936409+0000","last_fullsized":"2023-07-09T21:36:03.936409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:17.762338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256051+0000","last_change":"2023-07-09T21:36:01.225914+0000","last_active":"2023-07-09T21:36:03.256051+0000","last_peered":"2023-07-09T21:36:03.256051+0000","last_clean":"2023-07-09T21:36:03.256051+0000","last_became_active":"2023-07-09T21:36:01.225617+0000","last_became_peered":"2023-07-09T21:36:01.225617+0000","last_unstale":"2023-07-09T21:36:03.256051+0000","last_undegraded":"2023-07-09T21:36:03.256051+0000","last_fullsized":"2023-07-09T21:36:03.256051+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:26:41.398663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253560+0000","last_change":"2023-07-09T21:36:02.239060+0000","last_active":"2023-07-09T21:36:03.253560+0000","last_peered":"2023-07-09T21:36:03.253560+0000","last_clean":"2023-07-09T21:36:03.253560+0000","last_became_active":"2023-07-09T21:36:02.238757+0000","last_became_peered":"2023-07-09T21:36:02.238757+0000","last_unstale":"2023-07-09T21:36:03.253560+0000","last_undegraded":"2023-07-09T21:36:03.253560+0000","last_fullsized":"2023-07-09T21:36:03.253560+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:04.569631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936845+0000","last_change":"2023-07-09T21:36:01.237174+0000","last_active":"2023-07-09T21:36:03.936845+0000","last_peered":"2023-07-09T21:36:03.936845+0000","last_clean":"2023-07-09T21:36:03.936845+0000","last_became_active":"2023-07-09T21:36:01.236851+0000","last_became_peered":"2023-07-09T21:36:01.236851+0000","last_unstale":"2023-07-09T21:36:03.936845+0000","last_undegraded":"2023-07-09T21:36:03.936845+0000","last_fullsized":"2023-07-09T21:36:03.936845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:21.290738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933486+0000","last_change":"2023-07-09T21:36:02.256993+0000","last_active":"2023-07-09T21:36:03.933486+0000","last_peered":"2023-07-09T21:36:03.933486+0000","last_clean":"2023-07-09T21:36:03.933486+0000","last_became_active":"2023-07-09T21:36:02.256139+0000","last_became_peered":"2023-07-09T21:36:02.256139+0000","last_unstale":"2023-07-09T21:36:03.933486+0000","last_undegraded":"2023-07-09T21:36:03.933486+0000","last_fullsized":"2023-07-09T21:36:03.933486+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:59.840021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"67'3","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255963+0000","last_change":"2023-07-09T21:36:01.232591+0000","last_active":"2023-07-09T21:36:03.255963+0000","last_peered":"2023-07-09T21:36:03.255963+0000","last_clean":"2023-07-09T21:36:03.255963+0000","last_became_active":"2023-07-09T21:36:01.232256+0000","last_became_peered":"2023-07-09T21:36:01.232256+0000","last_unstale":"2023-07-09T21:36:03.255963+0000","last_undegraded":"2023-07-09T21:36:03.255963+0000","last_fullsized":"2023-07-09T21:36:03.255963+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:05:42.450539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936688+0000","last_change":"2023-07-09T21:36:02.243115+0000","last_active":"2023-07-09T21:36:03.936688+0000","last_peered":"2023-07-09T21:36:03.936688+0000","last_clean":"2023-07-09T21:36:03.936688+0000","last_became_active":"2023-07-09T21:36:02.242811+0000","last_became_peered":"2023-07-09T21:36:02.242811+0000","last_unstale":"2023-07-09T21:36:03.936688+0000","last_undegraded":"2023-07-09T21:36:03.936688+0000","last_fullsized":"2023-07-09T21:36:03.936688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:32.098954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"67'6","reported_seq":19,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933735+0000","last_change":"2023-07-09T21:36:01.223493+0000","last_active":"2023-07-09T21:36:03.933735+0000","last_peered":"2023-07-09T21:36:03.933735+0000","last_clean":"2023-07-09T21:36:03.933735+0000","last_became_active":"2023-07-09T21:36:01.223158+0000","last_became_peered":"2023-07-09T21:36:01.223158+0000","last_unstale":"2023-07-09T21:36:03.933735+0000","last_undegraded":"2023-07-09T21:36:03.933735+0000","last_fullsized":"2023-07-09T21:36:03.933735+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:39:17.285592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253716+0000","last_change":"2023-07-09T21:36:02.236901+0000","last_active":"2023-07-09T21:36:03.253716+0000","last_peered":"2023-07-09T21:36:03.253716+0000","last_clean":"2023-07-09T21:36:03.253716+0000","last_became_active":"2023-07-09T21:36:02.236600+0000","last_became_peered":"2023-07-09T21:36:02.236600+0000","last_unstale":"2023-07-09T21:36:03.253716+0000","last_undegraded":"2023-07-09T21:36:03.253716+0000","last_fullsized":"2023-07-09T21:36:03.253716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:38.492421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934015+0000","last_change":"2023-07-09T21:36:01.234205+0000","last_active":"2023-07-09T21:36:03.934015+0000","last_peered":"2023-07-09T21:36:03.934015+0000","last_clean":"2023-07-09T21:36:03.934015+0000","last_became_active":"2023-07-09T21:36:01.233906+0000","last_became_peered":"2023-07-09T21:36:01.233906+0000","last_unstale":"2023-07-09T21:36:03.934015+0000","last_undegraded":"2023-07-09T21:36:03.934015+0000","last_fullsized":"2023-07-09T21:36:03.934015+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:58:15.395418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935819+0000","last_change":"2023-07-09T21:36:02.260643+0000","last_active":"2023-07-09T21:36:03.935819+0000","last_peered":"2023-07-09T21:36:03.935819+0000","last_clean":"2023-07-09T21:36:03.935819+0000","last_became_active":"2023-07-09T21:36:02.260375+0000","last_became_peered":"2023-07-09T21:36:02.260375+0000","last_unstale":"2023-07-09T21:36:03.935819+0000","last_undegraded":"2023-07-09T21:36:03.935819+0000","last_fullsized":"2023-07-09T21:36:03.935819+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:33:50.050215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254357+0000","last_change":"2023-07-09T21:36:01.239215+0000","last_active":"2023-07-09T21:36:03.254357+0000","last_peered":"2023-07-09T21:36:03.254357+0000","last_clean":"2023-07-09T21:36:03.254357+0000","last_became_active":"2023-07-09T21:36:01.238884+0000","last_became_peered":"2023-07-09T21:36:01.238884+0000","last_unstale":"2023-07-09T21:36:03.254357+0000","last_undegraded":"2023-07-09T21:36:03.254357+0000","last_fullsized":"2023-07-09T21:36:03.254357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:45:56.932142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934153+0000","last_change":"2023-07-09T21:36:02.244382+0000","last_active":"2023-07-09T21:36:03.934153+0000","last_peered":"2023-07-09T21:36:03.934153+0000","last_clean":"2023-07-09T21:36:03.934153+0000","last_became_active":"2023-07-09T21:36:02.244113+0000","last_became_peered":"2023-07-09T21:36:02.244113+0000","last_unstale":"2023-07-09T21:36:03.934153+0000","last_undegraded":"2023-07-09T21:36:03.934153+0000","last_fullsized":"2023-07-09T21:36:03.934153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:18.807471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255740+0000","last_change":"2023-07-09T21:36:01.227138+0000","last_active":"2023-07-09T21:36:03.255740+0000","last_peered":"2023-07-09T21:36:03.255740+0000","last_clean":"2023-07-09T21:36:03.255740+0000","last_became_active":"2023-07-09T21:36:01.226875+0000","last_became_peered":"2023-07-09T21:36:01.226875+0000","last_unstale":"2023-07-09T21:36:03.255740+0000","last_undegraded":"2023-07-09T21:36:03.255740+0000","last_fullsized":"2023-07-09T21:36:03.255740+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:38.323697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934530+0000","last_change":"2023-07-09T21:36:02.253432+0000","last_active":"2023-07-09T21:36:03.934530+0000","last_peered":"2023-07-09T21:36:03.934530+0000","last_clean":"2023-07-09T21:36:03.934530+0000","last_became_active":"2023-07-09T21:36:02.252292+0000","last_became_peered":"2023-07-09T21:36:02.252292+0000","last_unstale":"2023-07-09T21:36:03.934530+0000","last_undegraded":"2023-07-09T21:36:03.934530+0000","last_fullsized":"2023-07-09T21:36:03.934530+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:22.525817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"67'8","reported_seq":21,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933225+0000","last_change":"2023-07-09T21:36:01.229147+0000","last_active":"2023-07-09T21:36:03.933225+0000","last_peered":"2023-07-09T21:36:03.933225+0000","last_clean":"2023-07-09T21:36:03.933225+0000","last_became_active":"2023-07-09T21:36:01.228799+0000","last_became_peered":"2023-07-09T21:36:01.228799+0000","last_unstale":"2023-07-09T21:36:03.933225+0000","last_undegraded":"2023-07-09T21:36:03.933225+0000","last_fullsized":"2023-07-09T21:36:03.933225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:10.851730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933031+0000","last_change":"2023-07-09T21:36:02.251990+0000","last_active":"2023-07-09T21:36:03.933031+0000","last_peered":"2023-07-09T21:36:03.933031+0000","last_clean":"2023-07-09T21:36:03.933031+0000","last_became_active":"2023-07-09T21:36:02.251401+0000","last_became_peered":"2023-07-09T21:36:02.251401+0000","last_unstale":"2023-07-09T21:36:03.933031+0000","last_undegraded":"2023-07-09T21:36:03.933031+0000","last_fullsized":"2023-07-09T21:36:03.933031+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:00:32.402273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934724+0000","last_change":"2023-07-09T21:36:01.237532+0000","last_active":"2023-07-09T21:36:03.934724+0000","last_peered":"2023-07-09T21:36:03.934724+0000","last_clean":"2023-07-09T21:36:03.934724+0000","last_became_active":"2023-07-09T21:36:01.237228+0000","last_became_peered":"2023-07-09T21:36:01.237228+0000","last_unstale":"2023-07-09T21:36:03.934724+0000","last_undegraded":"2023-07-09T21:36:03.934724+0000","last_fullsized":"2023-07-09T21:36:03.934724+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:01:55.580870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935262+0000","last_change":"2023-07-09T21:36:02.252572+0000","last_active":"2023-07-09T21:36:03.935262+0000","last_peered":"2023-07-09T21:36:03.935262+0000","last_clean":"2023-07-09T21:36:03.935262+0000","last_became_active":"2023-07-09T21:36:02.252012+0000","last_became_peered":"2023-07-09T21:36:02.252012+0000","last_unstale":"2023-07-09T21:36:03.935262+0000","last_undegraded":"2023-07-09T21:36:03.935262+0000","last_fullsized":"2023-07-09T21:36:03.935262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:29.005407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933835+0000","last_change":"2023-07-09T21:36:01.227765+0000","last_active":"2023-07-09T21:36:03.933835+0000","last_peered":"2023-07-09T21:36:03.933835+0000","last_clean":"2023-07-09T21:36:03.933835+0000","last_became_active":"2023-07-09T21:36:01.227290+0000","last_became_peered":"2023-07-09T21:36:01.227290+0000","last_unstale":"2023-07-09T21:36:03.933835+0000","last_undegraded":"2023-07-09T21:36:03.933835+0000","last_fullsized":"2023-07-09T21:36:03.933835+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:15:18.682281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936467+0000","last_change":"2023-07-09T21:36:02.256403+0000","last_active":"2023-07-09T21:36:03.936467+0000","last_peered":"2023-07-09T21:36:03.936467+0000","last_clean":"2023-07-09T21:36:03.936467+0000","last_became_active":"2023-07-09T21:36:02.256098+0000","last_became_peered":"2023-07-09T21:36:02.256098+0000","last_unstale":"2023-07-09T21:36:03.936467+0000","last_undegraded":"2023-07-09T21:36:03.936467+0000","last_fullsized":"2023-07-09T21:36:03.936467+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:51.111904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"67'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254822+0000","last_change":"2023-07-09T21:36:01.229042+0000","last_active":"2023-07-09T21:36:03.254822+0000","last_peered":"2023-07-09T21:36:03.254822+0000","last_clean":"2023-07-09T21:36:03.254822+0000","last_became_active":"2023-07-09T21:36:01.228766+0000","last_became_peered":"2023-07-09T21:36:01.228766+0000","last_unstale":"2023-07-09T21:36:03.254822+0000","last_undegraded":"2023-07-09T21:36:03.254822+0000","last_fullsized":"2023-07-09T21:36:03.254822+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:54:37.019868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935666+0000","last_change":"2023-07-09T21:36:02.236950+0000","last_active":"2023-07-09T21:36:03.935666+0000","last_peered":"2023-07-09T21:36:03.935666+0000","last_clean":"2023-07-09T21:36:03.935666+0000","last_became_active":"2023-07-09T21:36:02.236557+0000","last_became_peered":"2023-07-09T21:36:02.236557+0000","last_unstale":"2023-07-09T21:36:03.935666+0000","last_undegraded":"2023-07-09T21:36:03.935666+0000","last_fullsized":"2023-07-09T21:36:03.935666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:55.744760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254926+0000","last_change":"2023-07-09T21:36:01.227794+0000","last_active":"2023-07-09T21:36:03.254926+0000","last_peered":"2023-07-09T21:36:03.254926+0000","last_clean":"2023-07-09T21:36:03.254926+0000","last_became_active":"2023-07-09T21:36:01.227432+0000","last_became_peered":"2023-07-09T21:36:01.227432+0000","last_unstale":"2023-07-09T21:36:03.254926+0000","last_undegraded":"2023-07-09T21:36:03.254926+0000","last_fullsized":"2023-07-09T21:36:03.254926+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:30.725487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253884+0000","last_change":"2023-07-09T21:36:02.232630+0000","last_active":"2023-07-09T21:36:03.253884+0000","last_peered":"2023-07-09T21:36:03.253884+0000","last_clean":"2023-07-09T21:36:03.253884+0000","last_became_active":"2023-07-09T21:36:02.232347+0000","last_became_peered":"2023-07-09T21:36:02.232347+0000","last_unstale":"2023-07-09T21:36:03.253884+0000","last_undegraded":"2023-07-09T21:36:03.253884+0000","last_fullsized":"2023-07-09T21:36:03.253884+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:51:26.128944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935816+0000","last_change":"2023-07-09T21:36:01.219033+0000","last_active":"2023-07-09T21:36:03.935816+0000","last_peered":"2023-07-09T21:36:03.935816+0000","last_clean":"2023-07-09T21:36:03.935816+0000","last_became_active":"2023-07-09T21:36:01.218767+0000","last_became_peered":"2023-07-09T21:36:01.218767+0000","last_unstale":"2023-07-09T21:36:03.935816+0000","last_undegraded":"2023-07-09T21:36:03.935816+0000","last_fullsized":"2023-07-09T21:36:03.935816+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254626+0000","last_change":"2023-07-09T21:36:02.248640+0000","last_active":"2023-07-09T21:36:03.254626+0000","last_peered":"2023-07-09T21:36:03.254626+0000","last_clean":"2023-07-09T21:36:03.254626+0000","last_became_active":"2023-07-09T21:36:02.248332+0000","last_became_peered":"2023-07-09T21:36:02.248332+0000","last_unstale":"2023-07-09T21:36:03.254626+0000","last_undegraded":"2023-07-09T21:36:03.254626+0000","last_fullsized":"2023-07-09T21:36:03.254626+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:01:16.867061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932774+0000","last_change":"2023-07-09T21:36:01.223457+0000","last_active":"2023-07-09T21:36:03.932774+0000","last_peered":"2023-07-09T21:36:03.932774+0000","last_clean":"2023-07-09T21:36:03.932774+0000","last_became_active":"2023-07-09T21:36:01.223181+0000","last_became_peered":"2023-07-09T21:36:01.223181+0000","last_unstale":"2023-07-09T21:36:03.932774+0000","last_undegraded":"2023-07-09T21:36:03.932774+0000","last_fullsized":"2023-07-09T21:36:03.932774+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:32:47.442358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934761+0000","last_change":"2023-07-09T21:36:02.261012+0000","last_active":"2023-07-09T21:36:03.934761+0000","last_peered":"2023-07-09T21:36:03.934761+0000","last_clean":"2023-07-09T21:36:03.934761+0000","last_became_active":"2023-07-09T21:36:02.260709+0000","last_became_peered":"2023-07-09T21:36:02.260709+0000","last_unstale":"2023-07-09T21:36:03.934761+0000","last_undegraded":"2023-07-09T21:36:03.934761+0000","last_fullsized":"2023-07-09T21:36:03.934761+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:59.038309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933078+0000","last_change":"2023-07-09T21:36:01.236520+0000","last_active":"2023-07-09T21:36:03.933078+0000","last_peered":"2023-07-09T21:36:03.933078+0000","last_clean":"2023-07-09T21:36:03.933078+0000","last_became_active":"2023-07-09T21:36:01.236238+0000","last_became_peered":"2023-07-09T21:36:01.236238+0000","last_unstale":"2023-07-09T21:36:03.933078+0000","last_undegraded":"2023-07-09T21:36:03.933078+0000","last_fullsized":"2023-07-09T21:36:03.933078+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:32.491788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935865+0000","last_change":"2023-07-09T21:36:02.256380+0000","last_active":"2023-07-09T21:36:03.935865+0000","last_peered":"2023-07-09T21:36:03.935865+0000","last_clean":"2023-07-09T21:36:03.935865+0000","last_became_active":"2023-07-09T21:36:02.256102+0000","last_became_peered":"2023-07-09T21:36:02.256102+0000","last_unstale":"2023-07-09T21:36:03.935865+0000","last_undegraded":"2023-07-09T21:36:03.935865+0000","last_fullsized":"2023-07-09T21:36:03.935865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:42.651830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932604+0000","last_change":"2023-07-09T21:36:01.224143+0000","last_active":"2023-07-09T21:36:03.932604+0000","last_peered":"2023-07-09T21:36:03.932604+0000","last_clean":"2023-07-09T21:36:03.932604+0000","last_became_active":"2023-07-09T21:36:01.223798+0000","last_became_peered":"2023-07-09T21:36:01.223798+0000","last_unstale":"2023-07-09T21:36:03.932604+0000","last_undegraded":"2023-07-09T21:36:03.932604+0000","last_fullsized":"2023-07-09T21:36:03.932604+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:46:46.354480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254358+0000","last_change":"2023-07-09T21:36:02.239594+0000","last_active":"2023-07-09T21:36:03.254358+0000","last_peered":"2023-07-09T21:36:03.254358+0000","last_clean":"2023-07-09T21:36:03.254358+0000","last_became_active":"2023-07-09T21:36:02.239299+0000","last_became_peered":"2023-07-09T21:36:02.239299+0000","last_unstale":"2023-07-09T21:36:03.254358+0000","last_undegraded":"2023-07-09T21:36:03.254358+0000","last_fullsized":"2023-07-09T21:36:03.254358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:30:20.303344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"68'1","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934927+0000","last_change":"2023-07-09T21:36:01.234283+0000","last_active":"2023-07-09T21:36:03.934927+0000","last_peered":"2023-07-09T21:36:03.934927+0000","last_clean":"2023-07-09T21:36:03.934927+0000","last_became_active":"2023-07-09T21:36:01.233983+0000","last_became_peered":"2023-07-09T21:36:01.233983+0000","last_unstale":"2023-07-09T21:36:03.934927+0000","last_undegraded":"2023-07-09T21:36:03.934927+0000","last_fullsized":"2023-07-09T21:36:03.934927+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:15.642108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"55'139","reported_seq":335,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255823+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:36:03.255823+0000","last_peered":"2023-07-09T21:36:03.255823+0000","last_clean":"2023-07-09T21:36:03.255823+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:36:03.255823+0000","last_undegraded":"2023-07-09T21:36:03.255823+0000","last_fullsized":"2023-07-09T21:36:03.255823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:28.631350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253890+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:36:03.253890+0000","last_peered":"2023-07-09T21:36:03.253890+0000","last_clean":"2023-07-09T21:36:03.253890+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:36:03.253890+0000","last_undegraded":"2023-07-09T21:36:03.253890+0000","last_fullsized":"2023-07-09T21:36:03.253890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:27.907739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935390+0000","last_change":"2023-07-09T21:36:02.239449+0000","last_active":"2023-07-09T21:36:03.935390+0000","last_peered":"2023-07-09T21:36:03.935390+0000","last_clean":"2023-07-09T21:36:03.935390+0000","last_became_active":"2023-07-09T21:36:02.239185+0000","last_became_peered":"2023-07-09T21:36:02.239185+0000","last_unstale":"2023-07-09T21:36:03.935390+0000","last_undegraded":"2023-07-09T21:36:03.935390+0000","last_fullsized":"2023-07-09T21:36:03.935390+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:12.561268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255979+0000","last_change":"2023-07-09T21:36:01.229874+0000","last_active":"2023-07-09T21:36:03.255979+0000","last_peered":"2023-07-09T21:36:03.255979+0000","last_clean":"2023-07-09T21:36:03.255979+0000","last_became_active":"2023-07-09T21:36:01.229556+0000","last_became_peered":"2023-07-09T21:36:01.229556+0000","last_unstale":"2023-07-09T21:36:03.255979+0000","last_undegraded":"2023-07-09T21:36:03.255979+0000","last_fullsized":"2023-07-09T21:36:03.255979+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:05.923448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255675+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:36:03.255675+0000","last_peered":"2023-07-09T21:36:03.255675+0000","last_clean":"2023-07-09T21:36:03.255675+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:36:03.255675+0000","last_undegraded":"2023-07-09T21:36:03.255675+0000","last_fullsized":"2023-07-09T21:36:03.255675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:21:20.206404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933715+0000","last_change":"2023-07-09T21:36:02.241421+0000","last_active":"2023-07-09T21:36:03.933715+0000","last_peered":"2023-07-09T21:36:03.933715+0000","last_clean":"2023-07-09T21:36:03.933715+0000","last_became_active":"2023-07-09T21:36:02.240973+0000","last_became_peered":"2023-07-09T21:36:02.240973+0000","last_unstale":"2023-07-09T21:36:03.933715+0000","last_undegraded":"2023-07-09T21:36:03.933715+0000","last_fullsized":"2023-07-09T21:36:03.933715+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:45:44.158536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934344+0000","last_change":"2023-07-09T21:36:01.231246+0000","last_active":"2023-07-09T21:36:03.934344+0000","last_peered":"2023-07-09T21:36:03.934344+0000","last_clean":"2023-07-09T21:36:03.934344+0000","last_became_active":"2023-07-09T21:36:01.230971+0000","last_became_peered":"2023-07-09T21:36:01.230971+0000","last_unstale":"2023-07-09T21:36:03.934344+0000","last_undegraded":"2023-07-09T21:36:03.934344+0000","last_fullsized":"2023-07-09T21:36:03.934344+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:50.619171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932916+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:36:03.932916+0000","last_peered":"2023-07-09T21:36:03.932916+0000","last_clean":"2023-07-09T21:36:03.932916+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:36:03.932916+0000","last_undegraded":"2023-07-09T21:36:03.932916+0000","last_fullsized":"2023-07-09T21:36:03.932916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:56.172110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253640+0000","last_change":"2023-07-09T21:36:02.257328+0000","last_active":"2023-07-09T21:36:03.253640+0000","last_peered":"2023-07-09T21:36:03.253640+0000","last_clean":"2023-07-09T21:36:03.253640+0000","last_became_active":"2023-07-09T21:36:02.256992+0000","last_became_peered":"2023-07-09T21:36:02.256992+0000","last_unstale":"2023-07-09T21:36:03.253640+0000","last_undegraded":"2023-07-09T21:36:03.253640+0000","last_fullsized":"2023-07-09T21:36:03.253640+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:44.944925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"67'2","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254937+0000","last_change":"2023-07-09T21:36:01.239273+0000","last_active":"2023-07-09T21:36:03.254937+0000","last_peered":"2023-07-09T21:36:03.254937+0000","last_clean":"2023-07-09T21:36:03.254937+0000","last_became_active":"2023-07-09T21:36:01.238953+0000","last_became_peered":"2023-07-09T21:36:01.238953+0000","last_unstale":"2023-07-09T21:36:03.254937+0000","last_undegraded":"2023-07-09T21:36:03.254937+0000","last_fullsized":"2023-07-09T21:36:03.254937+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:06:16.747877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":115,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253550+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:36:03.253550+0000","last_peered":"2023-07-09T21:36:03.253550+0000","last_clean":"2023-07-09T21:36:03.253550+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:36:03.253550+0000","last_undegraded":"2023-07-09T21:36:03.253550+0000","last_fullsized":"2023-07-09T21:36:03.253550+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:39:53.328044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934446+0000","last_change":"2023-07-09T21:36:02.253700+0000","last_active":"2023-07-09T21:36:03.934446+0000","last_peered":"2023-07-09T21:36:03.934446+0000","last_clean":"2023-07-09T21:36:03.934446+0000","last_became_active":"2023-07-09T21:36:02.253285+0000","last_became_peered":"2023-07-09T21:36:02.253285+0000","last_unstale":"2023-07-09T21:36:03.934446+0000","last_undegraded":"2023-07-09T21:36:03.934446+0000","last_fullsized":"2023-07-09T21:36:03.934446+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:35.489746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.936431+0000","last_change":"2023-07-09T21:36:01.222592+0000","last_active":"2023-07-09T21:36:03.936431+0000","last_peered":"2023-07-09T21:36:03.936431+0000","last_clean":"2023-07-09T21:36:03.936431+0000","last_became_active":"2023-07-09T21:36:01.222323+0000","last_became_peered":"2023-07-09T21:36:01.222323+0000","last_unstale":"2023-07-09T21:36:03.936431+0000","last_undegraded":"2023-07-09T21:36:03.936431+0000","last_fullsized":"2023-07-09T21:36:03.936431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:57.298995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935652+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:36:03.935652+0000","last_peered":"2023-07-09T21:36:03.935652+0000","last_clean":"2023-07-09T21:36:03.935652+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:36:03.935652+0000","last_undegraded":"2023-07-09T21:36:03.935652+0000","last_fullsized":"2023-07-09T21:36:03.935652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:58:23.414114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934333+0000","last_change":"2023-07-09T21:36:02.248442+0000","last_active":"2023-07-09T21:36:03.934333+0000","last_peered":"2023-07-09T21:36:03.934333+0000","last_clean":"2023-07-09T21:36:03.934333+0000","last_became_active":"2023-07-09T21:36:02.248180+0000","last_became_peered":"2023-07-09T21:36:02.248180+0000","last_unstale":"2023-07-09T21:36:03.934333+0000","last_undegraded":"2023-07-09T21:36:03.934333+0000","last_fullsized":"2023-07-09T21:36:03.934333+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:09.234334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.253757+0000","last_change":"2023-07-09T21:36:01.224719+0000","last_active":"2023-07-09T21:36:03.253757+0000","last_peered":"2023-07-09T21:36:03.253757+0000","last_clean":"2023-07-09T21:36:03.253757+0000","last_became_active":"2023-07-09T21:36:01.224442+0000","last_became_peered":"2023-07-09T21:36:01.224442+0000","last_unstale":"2023-07-09T21:36:03.253757+0000","last_undegraded":"2023-07-09T21:36:03.253757+0000","last_fullsized":"2023-07-09T21:36:03.253757+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:44:12.692376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.256114+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:36:03.256114+0000","last_peered":"2023-07-09T21:36:03.256114+0000","last_clean":"2023-07-09T21:36:03.256114+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:36:03.256114+0000","last_undegraded":"2023-07-09T21:36:03.256114+0000","last_fullsized":"2023-07-09T21:36:03.256114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:13:35.961507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.934149+0000","last_change":"2023-07-09T21:36:02.252534+0000","last_active":"2023-07-09T21:36:03.934149+0000","last_peered":"2023-07-09T21:36:03.934149+0000","last_clean":"2023-07-09T21:36:03.934149+0000","last_became_active":"2023-07-09T21:36:02.252133+0000","last_became_peered":"2023-07-09T21:36:02.252133+0000","last_unstale":"2023-07-09T21:36:03.934149+0000","last_undegraded":"2023-07-09T21:36:03.934149+0000","last_fullsized":"2023-07-09T21:36:03.934149+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:39.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.933834+0000","last_change":"2023-07-09T21:36:01.224105+0000","last_active":"2023-07-09T21:36:03.933834+0000","last_peered":"2023-07-09T21:36:03.933834+0000","last_clean":"2023-07-09T21:36:03.933834+0000","last_became_active":"2023-07-09T21:36:01.223766+0000","last_became_peered":"2023-07-09T21:36:01.223766+0000","last_unstale":"2023-07-09T21:36:03.933834+0000","last_undegraded":"2023-07-09T21:36:03.933834+0000","last_fullsized":"2023-07-09T21:36:03.933834+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:30.603049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.935706+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:36:03.935706+0000","last_peered":"2023-07-09T21:36:03.935706+0000","last_clean":"2023-07-09T21:36:03.935706+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:36:03.935706+0000","last_undegraded":"2023-07-09T21:36:03.935706+0000","last_fullsized":"2023-07-09T21:36:03.935706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:32:09.061077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":11,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.254366+0000","last_change":"2023-07-09T21:36:02.245081+0000","last_active":"2023-07-09T21:36:03.254366+0000","last_peered":"2023-07-09T21:36:03.254366+0000","last_clean":"2023-07-09T21:36:03.254366+0000","last_became_active":"2023-07-09T21:36:02.244547+0000","last_became_peered":"2023-07-09T21:36:02.244547+0000","last_unstale":"2023-07-09T21:36:03.254366+0000","last_undegraded":"2023-07-09T21:36:03.254366+0000","last_fullsized":"2023-07-09T21:36:03.254366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:01.199614+0000","last_clean_scrub_stamp":"2023-07-09T21:36:01.199614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:32:44.614358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.932899+0000","last_change":"2023-07-09T21:36:01.228012+0000","last_active":"2023-07-09T21:36:03.932899+0000","last_peered":"2023-07-09T21:36:03.932899+0000","last_clean":"2023-07-09T21:36:03.932899+0000","last_became_active":"2023-07-09T21:36:01.227731+0000","last_became_peered":"2023-07-09T21:36:01.227731+0000","last_unstale":"2023-07-09T21:36:03.932899+0000","last_undegraded":"2023-07-09T21:36:03.932899+0000","last_fullsized":"2023-07-09T21:36:03.932899+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:36:00.192308+0000","last_clean_scrub_stamp":"2023-07-09T21:36:00.192308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:27:48.944946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":99,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-07-09T21:36:03.255067+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:36:03.255067+0000","last_peered":"2023-07-09T21:36:03.255067+0000","last_clean":"2023-07-09T21:36:03.255067+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:36:03.255067+0000","last_undegraded":"2023-07-09T21:36:03.255067+0000","last_fullsized":"2023-07-09T21:36:03.255067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:52:41.529390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":308,"num_read_kb":512,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575017,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58668,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313172,"statfs":{"total":96636764160,"available":96576688128,"internally_reserved":0,"allocated":1413120,"data_stored":992195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.93799999999999994,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.71399999999999997,"15min":0.71299999999999997},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.80200000000000005,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.872}]},{"osd":1,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.72399999999999998,"15min":0.71599999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82199999999999995,"5min":0.95599999999999996,"15min":0.998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.73299999999999998,"15min":0.71999999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.85699999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.92800000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.71199999999999997,"15min":0.71899999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.88100000000000001,"5min":0.96199999999999997,"15min":1.619},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.73399999999999999,"15min":0.72699999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.81799999999999995,"5min":0.96999999999999997,"15min":1.008},"last":0.65900000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.748,"15min":0.75700000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90800000000000003,"5min":0.97799999999999998,"15min":1.665},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.78800000000000003,"15min":0.78700000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.89900000000000002,"5min":1.054,"15min":1.2629999999999999},"last":0.751}]},{"osd":4,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.36099999999999999,"15min":0.33600000000000002},"max":{"1min":0.70199999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59499999999999997,"15min":0.61699999999999999},"min":{"1min":0.372,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.72799999999999998,"5min":0.93700000000000006,"15min":1.002},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.625},"min":{"1min":0.439,"5min":0.41599999999999998,"15min":0.29599999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.98499999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.65300000000000002,"15min":0.67100000000000004},"min":{"1min":0.45400000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76800000000000002,"5min":0.93600000000000005,"15min":1.0569999999999999},"last":0.628}]},{"osd":6,"last update":"Sun Jul 9 21:35:45 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.70699999999999996,"15min":0.71599999999999997},"min":{"1min":0.52600000000000002,"5min":0.375,"15min":0.375},"max":{"1min":0.82699999999999996,"5min":0.96299999999999997,"15min":1.0569999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.66100000000000003,"15min":0.67600000000000005},"min":{"1min":0.47699999999999998,"5min":0.40999999999999998,"15min":0.39600000000000002},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":0.97599999999999998},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575016,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":819200,"data_stored":402355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.69499999999999995,"15min":0.69899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.996,"15min":1.0569999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72199999999999998,"15min":0.73499999999999999},"min":{"1min":0.438,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.72299999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.76100000000000001,"15min":0.73599999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96999999999999997,"5min":1.0049999999999999,"15min":1.1519999999999999},"last":0.83899999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.745,"15min":0.73599999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":0.89300000000000002,"5min":1.0249999999999999,"15min":1.0589999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.3730000000000002,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.70099999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.75800000000000001,"15min":0.76200000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.45500000000000002},"max":{"1min":0.95199999999999996,"5min":1.0389999999999999,"15min":1.165},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76300000000000001,"15min":0.75600000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45900000000000002},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.59699999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56799999999999995,"15min":0.58999999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.745,"5min":0.90000000000000002,"15min":1.111},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.60699999999999998,"15min":0.61799999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.90100000000000002,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.85799999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60999999999999999,"15min":0.63},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80700000000000005,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.66200000000000003},"min":{"1min":0.441,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.871,"5min":0.90600000000000003,"15min":1.1950000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:35:42 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.65600000000000003,"15min":0.68600000000000005},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":1.006},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67200000000000004,"15min":0.70299999999999996},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.46000000000000002},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":1.2070000000000001},"last":0.78100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575015,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49888,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321952,"statfs":{"total":96636764160,"available":96585678848,"internally_reserved":0,"allocated":811008,"data_stored":401703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.72499999999999998,"15min":0.70399999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.246},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.495},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71899999999999997,"15min":0.71499999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90100000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.83299999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.747,"15min":0.73099999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.94299999999999995,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.71099999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.86399999999999999,"5min":1.02,"15min":1.02},"last":0.71699999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.73399999999999999},"min":{"1min":0.51400000000000001,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.94399999999999995,"5min":0.98399999999999999,"15min":0.999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72899999999999998,"15min":0.71799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.91200000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54700000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.753,"15min":0.73099999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.97199999999999998,"5min":1.01,"15min":1.01},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.75800000000000001,"15min":0.747},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.45400000000000001},"max":{"1min":0.85199999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56899999999999995},"min":{"1min":0.311,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.78400000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":1.0169999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.60699999999999998,"15min":0.623},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.92000000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64400000000000002},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.40699999999999997},"max":{"1min":0.872,"5min":0.998,"15min":1.038},"last":0.70399999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:35:44 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.67000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":0.96099999999999997,"15min":1.014},"last":0.877},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.69199999999999995},"min":{"1min":0.48499999999999999,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.94499999999999995,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575017,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31844,"kb_used_data":796,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339996,"statfs":{"total":96636764160,"available":96604155904,"internally_reserved":0,"allocated":815104,"data_stored":402285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72099999999999997,"15min":0.70699999999999996},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.92000000000000004,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.70399999999999996,"15min":0.69399999999999995},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.69199999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73899999999999999,"15min":0.71399999999999997},"min":{"1min":0.43099999999999999,"5min":0.40699999999999997,"15min":0.33600000000000002},"max":{"1min":0.89100000000000001,"5min":0.97099999999999997,"15min":1.02},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72599999999999998,"15min":0.71799999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.88900000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.73699999999999999,"15min":0.72999999999999998},"min":{"1min":0.47099999999999997,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.84299999999999997,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76200000000000001,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.753}]},{"osd":3,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73099999999999998,"15min":0.71399999999999997},"min":{"1min":0.53100000000000003,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.76000000000000001},"min":{"1min":0.53700000000000003,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.90500000000000003,"5min":0.98099999999999998,"15min":1.165},"last":0.80600000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59199999999999997,"15min":0.61399999999999999},"min":{"1min":0.42799999999999999,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.72199999999999998,"5min":0.97799999999999998,"15min":1.1859999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.32400000000000001},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.78600000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.48999999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64600000000000002,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.41899999999999998,"15min":0.39300000000000002},"max":{"1min":0.77600000000000002,"5min":1.0629999999999999,"15min":1.107},"last":0.84199999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.64800000000000002,"15min":0.67200000000000004},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.376},"max":{"1min":0.92800000000000005,"5min":0.93600000000000005,"15min":0.997},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69199999999999995,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.84899999999999998,"5min":0.98099999999999998,"15min":1.042},"last":0.86699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575016,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":827392,"data_stored":403289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46000000000000002,"15min":0.45400000000000001},"min":{"1min":0.32400000000000001,"5min":0.307,"15min":0.26700000000000002},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.34699999999999998},"max":{"1min":0.69699999999999995,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.41799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45800000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.97799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52100000000000002,"15min":0.50600000000000001},"min":{"1min":0.376,"5min":0.36599999999999999,"15min":0.312},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.39900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.57499999999999996,"15min":0.56499999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76900000000000002,"5min":0.92600000000000005,"15min":0.96599999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.47799999999999998,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.51600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.46200000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.871},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82499999999999996,"15min":0.81799999999999995},"min":{"1min":0.621,"5min":0.54200000000000004,"15min":0.47099999999999997},"max":{"1min":1.262,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83399999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81799999999999995,"15min":0.81999999999999995},"min":{"1min":0.57099999999999995,"5min":0.56799999999999995,"15min":0.503},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79800000000000004,"15min":0.80400000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.016,"5min":1.1799999999999999,"15min":1.208},"last":0.92500000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.77500000000000002},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.075,"5min":1.0800000000000001,"15min":1.2370000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:35:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79500000000000004,"15min":0.79200000000000004},"min":{"1min":0.53500000000000003,"5min":0.53200000000000003,"15min":0.50600000000000001},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.296},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.53400000000000003,"15min":0.48599999999999999},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.323},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575017,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53996,"kb_used_data":804,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317844,"statfs":{"total":96636764160,"available":96581472256,"internally_reserved":0,"allocated":823296,"data_stored":403267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46999999999999997,"15min":0.45300000000000001},"min":{"1min":0.34300000000000003,"5min":0.27700000000000002,"15min":0.24099999999999999},"max":{"1min":0.69499999999999995,"5min":0.70499999999999996,"15min":0.76400000000000001},"last":0.501},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.35599999999999998,"5min":0.32900000000000001,"15min":0.311},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.28899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.46500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.81299999999999994,"5min":0.88900000000000001,"15min":1.0409999999999999},"last":0.35199999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58499999999999996,"15min":0.56499999999999995},"min":{"1min":0.376,"5min":0.376,"15min":0.374},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56799999999999995,"15min":0.54200000000000004},"min":{"1min":0.39900000000000002,"5min":0.38300000000000001,"15min":0.33800000000000002},"max":{"1min":1.7050000000000001,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79300000000000004,"15min":0.79000000000000004},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.121,"5min":1.2609999999999999,"15min":1.4570000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3009999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.81699999999999995,"15min":0.82199999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.995,"5min":1.319,"15min":1.3839999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.103,"5min":1.2090000000000001,"15min":1.337},"last":0.626}]},{"osd":6,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.83999999999999997,"15min":0.84099999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.50800000000000001},"max":{"1min":1.05,"5min":1.417,"15min":1.4850000000000001},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.58699999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.3340000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83699999999999997,"15min":0.84799999999999998},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1399999999999999,"5min":1.478,"15min":1.478},"last":0.66400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":800,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":819200,"data_stored":401863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.46200000000000002,"15min":0.45500000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23899999999999999},"max":{"1min":0.72999999999999998,"5min":0.76800000000000002,"15min":0.871},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.38,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.72499999999999998,"5min":0.73999999999999999,"15min":0.78800000000000003},"last":0.42399999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.503,"15min":0.47999999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.5129999999999999,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.32600000000000001},"max":{"1min":0.70399999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.44700000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.55100000000000005},"min":{"1min":0.378,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":1.385},"last":0.48299999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.81799999999999995,"15min":0.80900000000000005},"min":{"1min":0.54500000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.82599999999999996,"15min":0.82299999999999995},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.443},"max":{"1min":1.212,"5min":1.212,"15min":1.419},"last":0.752}]},{"osd":5,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.56699999999999995,"5min":0.54200000000000004,"15min":0.51800000000000002},"max":{"1min":1.169,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.62},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.083,"5min":1.149,"15min":1.242},"last":0.68000000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76600000000000001,"15min":0.77200000000000002},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.49299999999999999},"max":{"1min":0.98099999999999998,"5min":0.999,"15min":1.335},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.83499999999999996,"15min":0.81599999999999995},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2230000000000001,"5min":1.258,"15min":1.3799999999999999},"last":0.70299999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:35:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81399999999999995,"15min":0.80200000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.53600000000000003},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.83499999999999996,"15min":0.82199999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.72899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575017,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32428,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339412,"statfs":{"total":96636764160,"available":96603557888,"internally_reserved":0,"allocated":1413120,"data_stored":992127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.47199999999999998},"min":{"1min":0.29299999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.63400000000000001,"5min":0.753,"15min":0.753},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.55500000000000005,"15min":0.54300000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.66300000000000003,"5min":0.77600000000000002,"15min":1.0489999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52500000000000002,"15min":0.51800000000000002},"min":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.54100000000000004,"15min":0.52500000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64300000000000002,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.502}]},{"osd":3,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":1.143},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.05,"5min":1.05,"15min":1.274},"last":0.44700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80100000000000005},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":0.91300000000000003,"5min":1.151,"15min":1.6559999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78700000000000003,"15min":0.78600000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.022,"5min":1.294,"15min":1.319},"last":0.53900000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.81100000000000005,"15min":0.79800000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.1319999999999999,"5min":1.2290000000000001,"15min":1.4350000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80200000000000005,"15min":0.79800000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0509999999999999,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.56799999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.80200000000000005,"15min":0.79600000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.0369999999999999,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.81799999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53500000000000003},"max":{"1min":1.222,"5min":1.3460000000000001,"15min":1.3660000000000001},"last":0.52200000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:35:47 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.81499999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.98899999999999999,"5min":1.2689999999999999,"15min":1.5980000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.81299999999999994,"15min":0.82199999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.0780000000000001,"5min":1.365,"15min":1.5740000000000001},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:36:11.341 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:36:11.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 Processor -- start 2023-07-09T21:36:11.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 -- start start 2023-07-09T21:36:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f948c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c15bf80 con 0x7f948c0b7980 2023-07-09T21:36:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c160570 con 0x7f948c0d0780 2023-07-09T21:36:11.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f94912bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0cd070 con 0x7f948c0cf290 2023-07-09T21:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f948c0b7980 0x7f948c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36246/0 (socket says 172.21.15.37:36246) 2023-07-09T21:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948affd640 1 -- 172.21.15.37:0/2481747112 learned_addr learned my addr 172.21.15.37:0/2481747112 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:11.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f9483fff640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f948c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643873699 0 0) 0x7f947c001120 con 0x7f948c0b7980 2023-07-09T21:36:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9478003530 con 0x7f948c0b7980 2023-07-09T21:36:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591708679 0 0) 0x7f9478003530 con 0x7f948c0b7980 2023-07-09T21:36:11.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 msgr2=0x7f948c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f948c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 >> v1:172.21.15.119:6789/0 conn(0x7f948c0d0780 legacy=0x7f948c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0d02f0 con 0x7f948c0b7980 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f947c001810 con 0x7f948c0b7980 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 >> v1:172.21.15.37:6789/0 conn(0x7f948c0b7980 legacy=0x7f948c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94780039b0 0x7f9478003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f94780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478004d10 0x7f9478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0cd070 con 0x7f9478004d10 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947800ba40 con 0x7f94780039b0 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947800bc00 con 0x7f948c0cf290 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478004d10 0x7f9478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f9483fff640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f94780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948affd640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94780039b0 0x7f9478003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 -- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 msgr2=0x7f94780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f94780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 -- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94780039b0 msgr2=0x7f9478003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94780039b0 0x7f9478003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f948b7fe640 1 -- 172.21.15.37:0/2481747112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478003530 con 0x7f9478004d10 2023-07-09T21:36:11.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.525+0000 7f9483fff640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c0cf290 0x7f94780047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478004d10 0x7f9478005180 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9484001cd0 tx=0x7f948401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b3c307ecc6d49f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484003b80 con 0x7f9478004d10 2023-07-09T21:36:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9484003ce0 con 0x7f9478004d10 2023-07-09T21:36:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f948a7fc640 1 -- 172.21.15.37:0/2481747112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9484005310 con 0x7f9478004d10 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 -- 172.21.15.37:0/2481747112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478004d10 msgr2=0x7f9478005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 --2- 172.21.15.37:0/2481747112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478004d10 0x7f9478005180 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f9484001cd0 tx=0x7f948401c5c0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f948b7fe640 1 -- 172.21.15.37:0/2481747112 reap_dead start 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 -- 172.21.15.37:0/2481747112 shutdown_connections 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 -- 172.21.15.37:0/2481747112 >> 172.21.15.37:0/2481747112 conn(0x7f948c073090 msgr2=0x7f948c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 -- 172.21.15.37:0/2481747112 shutdown_connections 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.529+0000 7f94912bd640 1 -- 172.21.15.37:0/2481747112 wait complete. 2023-07-09T21:36:11.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 Processor -- start 2023-07-09T21:36:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- start start 2023-07-09T21:36:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f948c150620 0x7f948c0c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 0x7f948c15acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15b230 con 0x7f948c150250 2023-07-09T21:36:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b2e70 con 0x7f948c150620 2023-07-09T21:36:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b2260 con 0x7f948c15a880 2023-07-09T21:36:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53600/0 (socket says 172.21.15.37:53600) 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 -- 172.21.15.37:0/2914410174 learned_addr learned my addr 172.21.15.37:0/2914410174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f9483fff640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f948c150620 0x7f948c0c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 0x7f948c15acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 -- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 msgr2=0x7f948c15acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 0x7f948c15acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 -- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f948c150620 msgr2=0x7f948c0c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f948c150620 0x7f948c0c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 -- 172.21.15.37:0/2914410174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0b2540 con 0x7f948c150250 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948b7fe640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 0x7f948c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f948affd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f947c007110 tx=0x7f947c007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c007760 con 0x7f948c150250 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00f9c0 con 0x7f948c150250 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00fd70 con 0x7f948c150250 2023-07-09T21:36:11.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0b2820 con 0x7f948c150250 2023-07-09T21:36:11.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.533+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c0c7640 con 0x7f948c150250 2023-07-09T21:36:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c04d7d0 con 0x7f948c150250 2023-07-09T21:36:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f947c01d460 con 0x7f948c150250 2023-07-09T21:36:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f94837fe640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f947c083e10 con 0x7f948c150250 2023-07-09T21:36:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f9483fff640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.537+0000 7f9483fff640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 0x7f946c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f948c0c7290 tx=0x7f9474009190 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.541+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f947c087030 con 0x7f948c150250 2023-07-09T21:36:11.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.749+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f948c15bf80 con 0x7f948c150250 2023-07-09T21:36:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.753+0000 7f94837fe640 1 -- 172.21.15.37:0/2914410174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+147 (secure 0 0 0) 0x7f948c15bf80 con 0x7f948c150250 2023-07-09T21:36:11.753 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:36:11.754 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:36:11.754 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:36:11.754 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:36:11.754 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:36:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:36:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.753+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 msgr2=0x7f946c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.753+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 0x7f946c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f948c0c7290 tx=0x7f9474009190 comp rx=0 tx=0).stop 2023-07-09T21:36:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.753+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 msgr2=0x7f948c0b3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.753+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f947c007110 tx=0x7f947c007510 comp rx=0 tx=0).stop 2023-07-09T21:36:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 shutdown_connections 2023-07-09T21:36:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f946c0663a0 0x7f946c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f948c15a880 0x7f948c15acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f948c150620 0x7f948c0c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 --2- 172.21.15.37:0/2914410174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f948c150250 0x7f948c0b3300 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 >> 172.21.15.37:0/2914410174 conn(0x7f948c073090 msgr2=0x7f948c0d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 shutdown_connections 2023-07-09T21:36:11.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.757+0000 7f94912bd640 1 -- 172.21.15.37:0/2914410174 wait complete. 2023-07-09T21:36:11.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:36:11.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 Processor -- start 2023-07-09T21:36:11.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 -- start start 2023-07-09T21:36:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7aa40b7ab0 0x7f7aa406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7aa40b4340 0x7f7aa40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa40b49f0 con 0x7f7aa40cef80 2023-07-09T21:36:11.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40b7e80 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aaaffa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa40cc8a0 con 0x7f7aa40b4340 2023-07-09T21:36:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7aa40b7ab0 0x7f7aa406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7aa40b7ab0 0x7f7aa406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53616/0 (socket says 172.21.15.37:53616) 2023-07-09T21:36:11.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7aa40cef80 0x7f7aa40b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36254/0 (socket says 172.21.15.37:36254) 2023-07-09T21:36:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 -- 172.21.15.37:0/2278584627 learned_addr learned my addr 172.21.15.37:0/2278584627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa9597640 1 --2- 172.21.15.37:0/2278584627 >> v2:172.21.15.119:3300/0 conn(0x7f7aa40b4340 0x7f7aa40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 -- 172.21.15.37:0/2278584627 >> v2:172.21.15.119:3300/0 conn(0x7f7aa40b4340 msgr2=0x7f7aa40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:11.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 --2- 172.21.15.37:0/2278584627 >> v2:172.21.15.119:3300/0 conn(0x7f7aa40b4340 0x7f7aa40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 -- 172.21.15.37:0/2278584627 >> v1:172.21.15.37:6789/0 conn(0x7f7aa40cef80 legacy=0x7f7aa40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.917+0000 7f7aa8d96640 1 -- 172.21.15.37:0/2278584627 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa40ccb80 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aa8d96640 1 --2- 172.21.15.37:0/2278584627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa406aa50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b4710 tx=0x7f7a9801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddade3d88fdf5b9b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aa37fe640 1 -- 172.21.15.37:0/2278584627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980aa430 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aa37fe640 1 -- 172.21.15.37:0/2278584627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a980aa590 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aa37fe640 1 -- 172.21.15.37:0/2278584627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980aa920 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 -- 172.21.15.37:0/2278584627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b7ab0 msgr2=0x7f7aa406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/2278584627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa406aa50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b4710 tx=0x7f7a9801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 -- 172.21.15.37:0/2278584627 shutdown_connections 2023-07-09T21:36:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/2278584627 >> v2:172.21.15.119:3300/0 conn(0x7f7aa40b4340 0x7f7aa40d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/2278584627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa406aa50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 -- 172.21.15.37:0/2278584627 >> 172.21.15.37:0/2278584627 conn(0x7f7aa4073090 msgr2=0x7f7aa4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:11.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 -- 172.21.15.37:0/2278584627 shutdown_connections 2023-07-09T21:36:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.921+0000 7f7aaaffa640 1 -- 172.21.15.37:0/2278584627 wait complete. 2023-07-09T21:36:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 Processor -- start 2023-07-09T21:36:11.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 -- start start 2023-07-09T21:36:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa41420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7aa40cef80 0x7f7aa4156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa4154720 con 0x7f7aa40b4340 2023-07-09T21:36:11.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa40c8470 con 0x7f7aa40b7ab0 2023-07-09T21:36:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa41425f0 con 0x7f7aa40cef80 2023-07-09T21:36:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53632/0 (socket says 172.21.15.37:53632) 2023-07-09T21:36:11.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 -- 172.21.15.37:0/3601182743 learned_addr learned my addr 172.21.15.37:0/3601182743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa3fff640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa41420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa9597640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7aa40cef80 0x7f7aa4156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 -- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7aa40cef80 msgr2=0x7f7aa4156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7aa40cef80 0x7f7aa4156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 -- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa40b7ab0 msgr2=0x7f7aa41420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa41420b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 -- 172.21.15.37:0/3601182743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a980094d0 con 0x7f7aa40b4340 2023-07-09T21:36:11.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa8d96640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7a980190e0 tx=0x7f7a9801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980b3800 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a980b3960 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a980b3cf0 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.925+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa4153b10 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa41540d0 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa404d7d0 con 0x7f7aa40b4340 2023-07-09T21:36:11.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a980b2380 con 0x7f7aa40b4340 2023-07-09T21:36:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aa17fa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 0x7f7a88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7a9811e540 con 0x7f7aa40b4340 2023-07-09T21:36:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aa3fff640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 0x7f7a88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.929+0000 7f7aa3fff640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 0x7f7a88068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b2990 tx=0x7f7a90007c90 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:11.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:11.933+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a980eb7b0 con 0x7f7aa40b4340 2023-07-09T21:36:12.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7aa40cc3d0 con 0x7f7aa40b4340 2023-07-09T21:36:12.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aa17fa640 1 -- 172.21.15.37:0/3601182743 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f7a980eedd0 con 0x7f7aa40b4340 2023-07-09T21:36:12.121 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:12.121 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:36:12.121 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:36:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 msgr2=0x7f7a88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 0x7f7a88068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40b2990 tx=0x7f7a90007c90 comp rx=0 tx=0).stop 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 msgr2=0x7f7aa40c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f7a980190e0 tx=0x7f7a9801ad10 comp rx=0 tx=0).stop 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 shutdown_connections 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f7a880663a0 0x7f7a88068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7aa40cef80 0x7f7aa4156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7aa40b7ab0 0x7f7aa41420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 --2- 172.21.15.37:0/3601182743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7aa40b4340 0x7f7aa40c7f30 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 >> 172.21.15.37:0/3601182743 conn(0x7f7aa4073090 msgr2=0x7f7aa40b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 shutdown_connections 2023-07-09T21:36:12.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.121+0000 7f7aaaffa640 1 -- 172.21.15.37:0/3601182743 wait complete. 2023-07-09T21:36:12.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:36:01.605674+0000', 'modified': '2023-07-09T21:36:05.257863+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6267': {'gid': 6267, 'name': 'c', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/35979618', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 35979618}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 35979618}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:36:12.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:36:12.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T21:36:12.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 Processor -- start 2023-07-09T21:36:12.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 -- start start 2023-07-09T21:36:12.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba300b7a60 0x7fba300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba300d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba300cef80 con 0x7fba300b47a0 2023-07-09T21:36:12.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300cf260 con 0x7fba300b7a60 2023-07-09T21:36:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba36a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300cf540 con 0x7fba300b4310 2023-07-09T21:36:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba300b47a0 0x7fba300b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36264/0 (socket says 172.21.15.37:36264) 2023-07-09T21:36:12.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2f7fe640 1 -- 172.21.15.37:0/1328272673 learned_addr learned my addr 172.21.15.37:0/1328272673 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2ffff640 1 --2- 172.21.15.37:0/1328272673 >> v2:172.21.15.119:3300/0 conn(0x7fba300b7a60 0x7fba300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba34ff3640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba300d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216477203 0 0) 0x7fba300cef80 con 0x7fba300b47a0 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba18003530 con 0x7fba300b47a0 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2ffff640 1 -- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 msgr2=0x7fba300d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2ffff640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba300d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2ffff640 1 -- 172.21.15.37:0/1328272673 >> v1:172.21.15.37:6789/0 conn(0x7fba300b47a0 legacy=0x7fba300b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1724653609 0 0) 0x7fba18003530 con 0x7fba300b47a0 2023-07-09T21:36:12.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.693+0000 7fba2ffff640 1 -- 172.21.15.37:0/1328272673 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300cfdf0 con 0x7fba300b7a60 2023-07-09T21:36:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba2ffff640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300cc7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fba200097c0 tx=0x7fba2001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5b441bcc3c285cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24001680 con 0x7fba300b7a60 2023-07-09T21:36:12.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba200a7050 con 0x7fba300b7a60 2023-07-09T21:36:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba2effd640 1 -- 172.21.15.37:0/1328272673 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200ab620 con 0x7fba300b7a60 2023-07-09T21:36:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 -- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 msgr2=0x7fba300cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300cc7d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fba200097c0 tx=0x7fba2001c3a0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 -- 172.21.15.37:0/1328272673 shutdown_connections 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba300d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 --2- 172.21.15.37:0/1328272673 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300cc7d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 -- 172.21.15.37:0/1328272673 >> 172.21.15.37:0/1328272673 conn(0x7fba30073050 msgr2=0x7fba30069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 -- 172.21.15.37:0/1328272673 shutdown_connections 2023-07-09T21:36:12.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.697+0000 7fba36a56640 1 -- 172.21.15.37:0/1328272673 wait complete. 2023-07-09T21:36:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 Processor -- start 2023-07-09T21:36:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- start start 2023-07-09T21:36:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba30152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30152b60 con 0x7fba300b47a0 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba30152e40 con 0x7fba300b7a60 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300c7510 con 0x7fba300b4310 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53640/0 (socket says 172.21.15.37:53640) 2023-07-09T21:36:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2288243247 learned_addr learned my addr 172.21.15.37:0/2288243247 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba30152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba34ff3640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 msgr2=0x7fba30152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba30152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 msgr2=0x7fba300c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2288243247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009420 con 0x7fba300b47a0 2023-07-09T21:36:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c780 tx=0x7fba2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2cff9640 1 -- 172.21.15.37:0/2288243247 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24005ae0 con 0x7fba300b47a0 2023-07-09T21:36:12.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2cff9640 1 -- 172.21.15.37:0/2288243247 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba24005c40 con 0x7fba300b47a0 2023-07-09T21:36:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba300c77f0 con 0x7fba300b47a0 2023-07-09T21:36:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba2cff9640 1 -- 172.21.15.37:0/2288243247 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24007070 con 0x7fba300b47a0 2023-07-09T21:36:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.701+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba301536d0 con 0x7fba300b47a0 2023-07-09T21:36:12.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba2cff9640 1 -- 172.21.15.37:0/2288243247 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba240071d0 con 0x7fba300b47a0 2023-07-09T21:36:12.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba2cff9640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 0x7fba1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba2cff9640 1 -- 172.21.15.37:0/2288243247 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba24083b50 con 0x7fba300b47a0 2023-07-09T21:36:12.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba39dbf000 1 Processor -- start 2023-07-09T21:36:12.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 0x7fba1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.705+0000 7fba39dbf000 1 -- start start 2023-07-09T21:36:12.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 0x7fba1c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba200ad000 tx=0x7fba200a6000 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e43ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 0x55bf4e3f5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e2bbf80 con 0x55bf4e43f110 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e1f5c60 con 0x55bf4e43e800 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e249700 con 0x55bf4e3f4f90 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53646/0 (socket says 172.21.15.37:53646) 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 -- 172.21.15.37:0/3979258488 learned_addr learned my addr 172.21.15.37:0/3979258488 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2ffff640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e43ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba34ff3640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 0x55bf4e3f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 -- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 msgr2=0x55bf4e3f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 0x55bf4e3f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 -- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 msgr2=0x55bf4e43ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e43ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 -- 172.21.15.37:0/3979258488 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf4df3e890 con 0x55bf4e43f110 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba34ff3640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 0x55bf4e3f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fba240510d0 tx=0x7fba2405cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37eae2395be3c40 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba15ffb640 1 -- 172.21.15.37:0/3979258488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24053030 con 0x55bf4e43f110 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba15ffb640 1 -- 172.21.15.37:0/3979258488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2405c9e0 con 0x55bf4e43f110 2023-07-09T21:36:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba15ffb640 1 -- 172.21.15.37:0/3979258488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24007480 con 0x55bf4e43f110 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- 172.21.15.37:0/3979258488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 msgr2=0x55bf4e3f4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fba240510d0 tx=0x7fba2405cfb0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- 172.21.15.37:0/3979258488 shutdown_connections 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e3f4f90 0x55bf4e3f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43f110 0x55bf4e3f4a50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3979258488 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e43ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- 172.21.15.37:0/3979258488 >> 172.21.15.37:0/3979258488 conn(0x55bf4e2b7a70 msgr2=0x55bf4e3f3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- 172.21.15.37:0/3979258488 shutdown_connections 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- 172.21.15.37:0/3979258488 wait complete. 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 -- start start 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.709+0000 7fba39dbf000 1 Processor -- start 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e400120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e400660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e2427a0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e1fef00 con 0x55bf4e43e800 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e1feba0 con 0x55bf4e43f110 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 10 client.0 _ll_register_callbacks cb 0x55bf4e3e0930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53658/0 (socket says 172.21.15.37:53658) 2023-07-09T21:36:12.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 -- 172.21.15.37:0/3459386170 learned_addr learned my addr 172.21.15.37:0/3459386170 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e400120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba34ff3640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e400660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 -- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 msgr2=0x55bf4e400660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e400660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 -- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 msgr2=0x55bf4e400120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e400120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 -- 172.21.15.37:0/3459386170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba301536d0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba34ff3640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e400660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2ffff640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fba2001cc40 tx=0x7fba2001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d318d7e63bacc527 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200b6870 con 0x55bf4e3f4f90 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba200b69d0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf4e2410f0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba200b6b90 con 0x55bf4e3f4f90 2023-07-09T21:36:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 10 client.6432 fetch_fsmap learned FSMap version 24 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55bf4e207130 con 0x55bf4e3f4f90 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf4e2410f0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba200be070 con 0x55bf4e3f4f90 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 10 client.6432 fetch_fsmap finished waiting for FSMap version 24 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 10 client.6432 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 20 client.6432 populate_metadata read hostname 'smithi037' 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e44d870 0x55bf4e44fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 4 client.6432 mds_command: new command op to 6267 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:36:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 --> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf4e209e40 con 0x55bf4e44d870 2023-07-09T21:36:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e44d870 0x55bf4e44fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e44d870 0x55bf4e44fc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e0cdee7c5c9878a server_cookie=d56d2f6790d515d4 in_seq=0 out_seq=0 2023-07-09T21:36:12.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 10 client.6432 ms_handle_connect on v2:172.21.15.37:6832/35979618 2023-07-09T21:36:12.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 1 -- 172.21.15.37:0/3459386170 <== mds.0 v2:172.21.15.37:6832/35979618 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bf4e209e40 con 0x55bf4e44d870 2023-07-09T21:36:12.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.713+0000 7fba0effd640 10 client.6432 handle_command_reply: tid=0 2023-07-09T21:36:12.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 client.6432 shutdown 2023-07-09T21:36:12.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 msgr2=0x55bf4e3ffbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fba2001cc40 tx=0x7fba2001abe0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 shutdown_connections 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e44d870 0x55bf4e44fc50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e400660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e400120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 --2- 172.21.15.37:0/3459386170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e3ffbe0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba0effd640 0 client.6432 ms_handle_reset on v2:172.21.15.37:6832/35979618 2023-07-09T21:36:12.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 >> 172.21.15.37:0/3459386170 conn(0x55bf4e2b7a70 msgr2=0x55bf4e3f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 shutdown_connections 2023-07-09T21:36:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 1 -- 172.21.15.37:0/3459386170 wait complete. 2023-07-09T21:36:12.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.717+0000 7fba39dbf000 20 client.6432 trim_cache size 0 max 16384 2023-07-09T21:36:12.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.729+0000 7fba39dbf000 1 Processor -- start 2023-07-09T21:36:12.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- start start 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e4518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e439560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4deff940 con 0x55bf4e3f4f90 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e245300 con 0x55bf4e43e800 2023-07-09T21:36:12.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e1ea870 con 0x55bf4e43f110 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53666/0 (socket says 172.21.15.37:53666) 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 -- 172.21.15.37:0/672325644 learned_addr learned my addr 172.21.15.37:0/672325644 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e4518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba34ff3640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e439560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 -- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 msgr2=0x55bf4e439560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e439560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 -- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 msgr2=0x55bf4e4518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e4518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 -- 172.21.15.37:0/672325644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf4e1ed3c0 con 0x55bf4e3f4f90 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e4518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba34ff3640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e439560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba2ffff640 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fba2001c880 tx=0x7fba200c5070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1304f8318a7167f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba167fc640 1 -- 172.21.15.37:0/672325644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200dd070 con 0x55bf4e3f4f90 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba167fc640 1 -- 172.21.15.37:0/672325644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba200c7070 con 0x55bf4e3f4f90 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba167fc640 1 -- 172.21.15.37:0/672325644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200cce00 con 0x55bf4e3f4f90 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- 172.21.15.37:0/672325644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 msgr2=0x55bf4e451370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fba2001c880 tx=0x7fba200c5070 comp rx=0 tx=0).stop 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- 172.21.15.37:0/672325644 shutdown_connections 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e439560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e43e800 0x55bf4e4518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 --2- 172.21.15.37:0/672325644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e3f4f90 0x55bf4e451370 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- 172.21.15.37:0/672325644 >> 172.21.15.37:0/672325644 conn(0x55bf4e2b7a70 msgr2=0x55bf4e44fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- 172.21.15.37:0/672325644 shutdown_connections 2023-07-09T21:36:12.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- 172.21.15.37:0/672325644 wait complete. 2023-07-09T21:36:12.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 -- start start 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.733+0000 7fba39dbf000 1 Processor -- start 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e3f4f90 0x55bf4e49bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e43c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e1dfea0 con 0x55bf4e43e800 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e20e760 con 0x55bf4e3f4f90 2023-07-09T21:36:12.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf4e24a990 con 0x55bf4e43f110 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 10 client.0 _ll_register_callbacks cb 0x55bf4e3c14d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53678/0 (socket says 172.21.15.37:53678) 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2836764214 learned_addr learned my addr 172.21.15.37:0/2836764214 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e3f4f90 0x55bf4e49bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba34ff3640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e43c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 msgr2=0x55bf4e43c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e43c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e3f4f90 msgr2=0x55bf4e49bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e3f4f90 0x55bf4e49bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 -- 172.21.15.37:0/2836764214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf4e207130 con 0x55bf4e43e800 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba34ff3640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e43c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2f7fe640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fba240510d0 tx=0x7fba24001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde78f57234ca9e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:36:12.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24054710 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fba24080040 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf4e3f88c0 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba2405c9e0 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 10 client.6438 fetch_fsmap learned FSMap version 24 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55bf4df3ecc0 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf4e3f88c0 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba24019020 con 0x55bf4e43e800 2023-07-09T21:36:12.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 10 client.6438 fetch_fsmap finished waiting for FSMap version 24 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 10 client.6438 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 20 client.6438 populate_metadata read hostname 'smithi037' 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e43cac0 0x55bf4e43ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 4 client.6438 mds_command: new command op to 6267 tid=0[{"prefix": "status"}] 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 --> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bf4e1fb6f0 con 0x55bf4e43cac0 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e43cac0 0x55bf4e43ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba2ffff640 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e43cac0 0x55bf4e43ce90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24929617952e121b server_cookie=fd3dbed1cc82749a in_seq=0 out_seq=0 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 10 client.6438 ms_handle_connect on v2:172.21.15.37:6832/35979618 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 1 -- 172.21.15.37:0/2836764214 <== mds.0 v2:172.21.15.37:6832/35979618 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55bf4e1fb6f0 con 0x55bf4e43cac0 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 10 client.6438 handle_command_reply: tid=0 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 client.6438 shutdown 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 msgr2=0x55bf4e49c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fba240510d0 tx=0x7fba24001a60 comp rx=0 tx=0).stop 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 shutdown_connections 2023-07-09T21:36:12.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:6832/35979618,v1:172.21.15.37:6835/35979618] conn(0x55bf4e43cac0 0x55bf4e43ce90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55bf4e43f110 0x55bf4e43c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55bf4e43e800 0x55bf4e49c290 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 --2- 172.21.15.37:0/2836764214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55bf4e3f4f90 0x55bf4e49bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba0effd640 0 client.6438 ms_handle_reset on v2:172.21.15.37:6832/35979618 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 >> 172.21.15.37:0/2836764214 conn(0x55bf4e2b7a70 msgr2=0x55bf4e4504e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.737+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 shutdown_connections 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba39dbf000 1 -- 172.21.15.37:0/2836764214 wait complete. 2023-07-09T21:36:12.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba39dbf000 20 client.6438 trim_cache size 0 max 16384 2023-07-09T21:36:12.747 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:36:12.747 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:36:12.747 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:36:12.747 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6267, 2023-07-09T21:36:12.747 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.521499769, 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 24, 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 68, 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 68, 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.456530216000001 2023-07-09T21:36:12.748 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:36:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 msgr2=0x7fba1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 0x7fba1c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fba200ad000 tx=0x7fba200a6000 comp rx=0 tx=0).stop 2023-07-09T21:36:12.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 msgr2=0x7fba301530b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fba2400c780 tx=0x7fba2400cc40 comp rx=0 tx=0).stop 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 shutdown_connections 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba300b7a60 0x7fba300c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba300b47a0 0x7fba301530b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fba1c0663a0 0x7fba1c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 --2- 172.21.15.37:0/2288243247 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba300b4310 0x7fba30152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 >> 172.21.15.37:0/2288243247 conn(0x7fba30073050 msgr2=0x7fba3015e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 shutdown_connections 2023-07-09T21:36:12.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.741+0000 7fba36a56640 1 -- 172.21.15.37:0/2288243247 wait complete. 2023-07-09T21:36:12.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:36:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 Processor -- start 2023-07-09T21:36:12.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 -- start start 2023-07-09T21:36:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 0x7f99bc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc0cef80 0x7f99bc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b49f0 con 0x7f99bc0b4170 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc0b7e80 con 0x7f99bc0cef80 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99c287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b45f0 con 0x7f99bc0b7ab0 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc0cef80 0x7f99bc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99bb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f99bc0cef80 0x7f99bc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53684/0 (socket says 172.21.15.37:53684) 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99bb7fe640 1 -- 172.21.15.37:0/98444832 learned_addr learned my addr 172.21.15.37:0/98444832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.901+0000 7f99bbfff640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 0x7f99bc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bb7fe640 1 -- 172.21.15.37:0/98444832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 msgr2=0x7f99bc06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bb7fe640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 0x7f99bc06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bb7fe640 1 -- 172.21.15.37:0/98444832 >> v1:172.21.15.119:6789/0 conn(0x7f99bc0b4170 legacy=0x7f99bc15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bb7fe640 1 -- 172.21.15.37:0/98444832 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0cc8a0 con 0x7f99bc0cef80 2023-07-09T21:36:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bbfff640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 0x7f99bc06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:12.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99bb7fe640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0cef80 0x7f99bc0b3c30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009870 tx=0x7f99b001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f390f7bb999784 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99baffd640 1 -- 172.21.15.37:0/98444832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00aa670 con 0x7f99bc0cef80 2023-07-09T21:36:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99baffd640 1 -- 172.21.15.37:0/98444832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b00aa7d0 con 0x7f99bc0cef80 2023-07-09T21:36:12.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99baffd640 1 -- 172.21.15.37:0/98444832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00aab60 con 0x7f99bc0cef80 2023-07-09T21:36:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 -- 172.21.15.37:0/98444832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0cef80 msgr2=0x7f99bc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0cef80 0x7f99bc0b3c30 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009870 tx=0x7f99b001c510 comp rx=0 tx=0).stop 2023-07-09T21:36:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 -- 172.21.15.37:0/98444832 shutdown_connections 2023-07-09T21:36:12.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0cef80 0x7f99bc0b3c30 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 --2- 172.21.15.37:0/98444832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0b7ab0 0x7f99bc06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.905+0000 7f99c287b640 1 -- 172.21.15.37:0/98444832 >> 172.21.15.37:0/98444832 conn(0x7f99bc073090 msgr2=0x7f99bc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- 172.21.15.37:0/98444832 shutdown_connections 2023-07-09T21:36:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- 172.21.15.37:0/98444832 wait complete. 2023-07-09T21:36:12.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 Processor -- start 2023-07-09T21:36:12.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- start start 2023-07-09T21:36:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99bc0b7ab0 0x7f99bc0c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 0x7f99bc156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc155a40 con 0x7f99bc0b4170 2023-07-09T21:36:12.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc155c90 con 0x7f99bc0b7ab0 2023-07-09T21:36:12.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc155f70 con 0x7f99bc0cef80 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53696/0 (socket says 172.21.15.37:53696) 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 -- 172.21.15.37:0/3056559461 learned_addr learned my addr 172.21.15.37:0/3056559461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bb7fe640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99bc0b7ab0 0x7f99bc0c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c0e18640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 0x7f99bc156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 -- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 msgr2=0x7f99bc156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 0x7f99bc156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 -- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99bc0b7ab0 msgr2=0x7f99bc0c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99bc0b7ab0 0x7f99bc0c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99bbfff640 1 -- 172.21.15.37:0/3056559461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00094d0 con 0x7f99bc0b4170 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.909+0000 7f99c0e18640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 0x7f99bc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99bbfff640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e810 tx=0x7f99ac00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00c8d0 con 0x7f99bc0b4170 2023-07-09T21:36:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00ca30 con 0x7f99bc0b4170 2023-07-09T21:36:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99bc156250 con 0x7f99bc0b4170 2023-07-09T21:36:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00cde0 con 0x7f99bc0b4170 2023-07-09T21:36:12.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc0cc150 con 0x7f99bc0b4170 2023-07-09T21:36:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc156770 con 0x7f99bc0b4170 2023-07-09T21:36:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f99ac013410 con 0x7f99bc0b4170 2023-07-09T21:36:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 0x7f99a80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f99ac083cf0 con 0x7f99bc0b4170 2023-07-09T21:36:12.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.913+0000 7f99bb7fe640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 0x7f99a80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:12.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.917+0000 7f99bb7fe640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 0x7f99a80688a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ae000 tx=0x7f99b00b5040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:12.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:12.917+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99ac051050 con 0x7f99bc0b4170 2023-07-09T21:36:13.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f99bc04d7d0 con 0x7f99bc0b4170 2023-07-09T21:36:13.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99b8ff9640 1 -- 172.21.15.37:0/3056559461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f99ac021070 con 0x7f99bc0b4170 2023-07-09T21:36:13.105 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:36:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 msgr2=0x7f99a80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 0x7f99a80688a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f99b00ae000 tx=0x7f99b00b5040 comp rx=0 tx=0).stop 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 msgr2=0x7f99bc0cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e810 tx=0x7f99ac00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 shutdown_connections 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f99a80663f0 0x7f99a80688a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:13.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99bc0cef80 0x7f99bc156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99bc0b7ab0 0x7f99bc0c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 --2- 172.21.15.37:0/3056559461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99bc0b4170 0x7f99bc0cbc10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 >> 172.21.15.37:0/3056559461 conn(0x7f99bc073090 msgr2=0x7f99bc0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 shutdown_connections 2023-07-09T21:36:13.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:13.105+0000 7f99c287b640 1 -- 172.21.15.37:0/3056559461 wait complete. 2023-07-09T21:36:13.126 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:36:13.126 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:36:13.126 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:36:13.127 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:36:13.127 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:13.127 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:36:13.127 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:36:13.128 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:36:13.128 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:36:13.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.129 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:36:13.138 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:36:13.138 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:36:13.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:36:13.138 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.138 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:36:13.139 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41630sec preferred_lft 41630sec 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.140 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:36:13.141 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:36:13.142 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:36:13.143 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.143 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:36:13.143 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:36:13.143 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:36:13.143 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:36:13.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.144 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:36:13.206 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:36:13.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.208 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:36:13.260 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:36:13.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.262 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:36:13.262 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:36:13.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:36:13.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:36:13.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:36:13.263 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:36:13.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.360 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:36:13.369 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:36:13.370 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:36:13.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:36:13.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:36:13.435 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:36:13.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:36:13.436 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:13.487 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:36:13.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:36:13.487 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:13.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:36:13.600 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:36:13.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:36:13.662 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:36:13.664 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:36:13.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.665 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:36:13.715 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:36:13.715 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:36:13.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:36:13.784 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:36:13.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:36:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:36:13.851 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:36:13.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:13.853 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:36:13.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:36:13.861+0000 7fde6560a580 -1 init, newargv = 0x5628710e12d0 newargc=15 2023-07-09T21:36:13.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[51815]: starting ceph client 2023-07-09T21:36:13.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[51815]: starting fuse 2023-07-09T21:36:13.870 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:36:13.870 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:36:13.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:36:13.871 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:36:13.871 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:36:13.871 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:36:13.872 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:36:13.872 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:36:13.873 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:36:13.873 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:36:13.874 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:36:13.874 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:36:13.875 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:36:13.875 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:36:13.875 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:36:13.875 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:36:13.876 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:36:13.876 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:36:13.876 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:36:13.877 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:36:13.877 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:36:13.877 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:36:13.878 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:36:13.878 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:36:13.878 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:36:13.878 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:36:13.879 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:36:13.879 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:36:13.880 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:36:13.994 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.51815.asok 2023-07-09T21:36:14.177 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51815.asok 2023-07-09T21:36:14.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:14.178 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51815.asok status 2023-07-09T21:36:14.352 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:36:14.352 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:36:14.352 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:36:14.352 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:36:14.352 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "51815", 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:36:14.353 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6453, 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 6453 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:36:14.354 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3904843444 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:36:14.355 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3904843444 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.6453 192.168.0.1:0/3904843444", 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3904843444", 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 24, 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 68, 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:36:14.356 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:36:14.357 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:36:14.357 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:36:14.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:14.367 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:36:14.368 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:14.377 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:36:14.377 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:14.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:14.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:36:14.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:36:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 Processor -- start 2023-07-09T21:36:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 -- start start 2023-07-09T21:36:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba040b47a0 0x7fba040b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba040b4140 0x7fba040d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba040cef80 con 0x7fba040b7a60 2023-07-09T21:36:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040ccee0 con 0x7fba040b47a0 2023-07-09T21:36:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba095e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba040b45e0 con 0x7fba040b4140 2023-07-09T21:36:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba040b47a0 0x7fba040b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fba040b47a0 0x7fba040b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53708/0 (socket says 172.21.15.37:53708) 2023-07-09T21:36:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 -- 172.21.15.37:0/1767225655 learned_addr learned my addr 172.21.15.37:0/1767225655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fba037fe640 1 --2- 172.21.15.37:0/1767225655 >> v2:172.21.15.119:3300/0 conn(0x7fba040b4140 0x7fba040d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 -- 172.21.15.37:0/1767225655 >> v2:172.21.15.119:3300/0 conn(0x7fba040b4140 msgr2=0x7fba040d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/1767225655 >> v2:172.21.15.119:3300/0 conn(0x7fba040b4140 0x7fba040d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 -- 172.21.15.37:0/1767225655 >> v1:172.21.15.119:6789/0 conn(0x7fba040b7a60 legacy=0x7fba040cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.629+0000 7fb9fbfff640 1 -- 172.21.15.37:0/1767225655 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040cf260 con 0x7fba040b47a0 2023-07-09T21:36:14.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/1767225655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b47a0 0x7fba040b3c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fba0406b440 tx=0x7fb9ec01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620a05d9f7e5ebd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba027fc640 1 -- 172.21.15.37:0/1767225655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ac410 con 0x7fba040b47a0 2023-07-09T21:36:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba027fc640 1 -- 172.21.15.37:0/1767225655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ec0ac570 con 0x7fba040b47a0 2023-07-09T21:36:14.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba027fc640 1 -- 172.21.15.37:0/1767225655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec0ac900 con 0x7fba040b47a0 2023-07-09T21:36:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 -- 172.21.15.37:0/1767225655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b47a0 msgr2=0x7fba040b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 --2- 172.21.15.37:0/1767225655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b47a0 0x7fba040b3c00 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fba0406b440 tx=0x7fb9ec01c4c0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 -- 172.21.15.37:0/1767225655 shutdown_connections 2023-07-09T21:36:14.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 --2- 172.21.15.37:0/1767225655 >> v2:172.21.15.119:3300/0 conn(0x7fba040b4140 0x7fba040d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 --2- 172.21.15.37:0/1767225655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b47a0 0x7fba040b3c00 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 -- 172.21.15.37:0/1767225655 >> 172.21.15.37:0/1767225655 conn(0x7fba04073050 msgr2=0x7fba04069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 -- 172.21.15.37:0/1767225655 shutdown_connections 2023-07-09T21:36:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.633+0000 7fba095e9640 1 -- 172.21.15.37:0/1767225655 wait complete. 2023-07-09T21:36:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 Processor -- start 2023-07-09T21:36:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- start start 2023-07-09T21:36:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b47a0 0x7fba04153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba040b7a60 0x7fba040b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba040c77b0 con 0x7fba040b4140 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba040c6ba0 con 0x7fba040b47a0 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba040c6e80 con 0x7fba040b7a60 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53714/0 (socket says 172.21.15.37:53714) 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 -- 172.21.15.37:0/3992449390 learned_addr learned my addr 172.21.15.37:0/3992449390 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba037fe640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba040b7a60 0x7fba040b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b47a0 0x7fba04153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 -- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba040b7a60 msgr2=0x7fba040b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba040b7a60 0x7fba040b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 -- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b47a0 msgr2=0x7fba04153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b47a0 0x7fba04153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 -- 172.21.15.37:0/3992449390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ec0094d0 con 0x7fba040b4140 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba02ffd640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400b410 tx=0x7fb9f400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4004020 con 0x7fba040b4140 2023-07-09T21:36:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f4004180 con 0x7fba040b4140 2023-07-09T21:36:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4011630 con 0x7fba040b4140 2023-07-09T21:36:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba040c7160 con 0x7fba040b4140 2023-07-09T21:36:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.637+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba041539a0 con 0x7fba040b4140 2023-07-09T21:36:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.641+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba040cdaa0 con 0x7fba040b4140 2023-07-09T21:36:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.641+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb9f4011790 con 0x7fba040b4140 2023-07-09T21:36:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.641+0000 7fb9fb7fe640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 0x7fb9e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.641+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb9f4083b30 con 0x7fba040b4140 2023-07-09T21:36:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.641+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 0x7fb9e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.645+0000 7fb9fbfff640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 0x7fb9e4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0ae000 tx=0x7fb9ec009040 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:14.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.645+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9f4050eb0 con 0x7fba040b4140 2023-07-09T21:36:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.821+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fba040d00d0 con 0x7fb9e40663a0 2023-07-09T21:36:14.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.821+0000 7fb9fb7fe640 1 -- 172.21.15.37:0/3992449390 <== mgr.5375 v2:172.21.15.119:6832/1375084468 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fb9ec0bb080 con 0x7fb9e40663a0 2023-07-09T21:36:14.822 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:36:14.823 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:36:14.823 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:36:14.823 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:36:14.824 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:36:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 msgr2=0x7fb9e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 0x7fb9e4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0ae000 tx=0x7fb9ec009040 comp rx=0 tx=0).stop 2023-07-09T21:36:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 msgr2=0x7fba040c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb9f400b410 tx=0x7fb9f400b8d0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 shutdown_connections 2023-07-09T21:36:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fb9e40663a0 0x7fb9e4068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba040b7a60 0x7fba040b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba040b47a0 0x7fba04153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 --2- 172.21.15.37:0/3992449390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba040b4140 0x7fba040c7c40 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 >> 172.21.15.37:0/3992449390 conn(0x7fba04073050 msgr2=0x7fba040cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 shutdown_connections 2023-07-09T21:36:14.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.825+0000 7fba095e9640 1 -- 172.21.15.37:0/3992449390 wait complete. 2023-07-09T21:36:14.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:36:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 Processor -- start 2023-07-09T21:36:14.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 -- start start 2023-07-09T21:36:14.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f7038160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f70380d0780 0x7f70380d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f703815bf80 con 0x7f70380ceb80 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70380cd070 con 0x7f70380d0780 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f7040711640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380cfd70 con 0x7f70380b7980 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703dcac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f70380ceb80 0x7f70380cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36270/0 (socket says 172.21.15.37:36270) 2023-07-09T21:36:14.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703dcac640 1 -- 172.21.15.37:0/1792588486 learned_addr learned my addr 172.21.15.37:0/1792588486 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703ecae640 1 --2- 172.21.15.37:0/1792588486 >> v2:172.21.15.119:3300/0 conn(0x7f70380d0780 0x7f70380d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703e4ad640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f7038160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286561433 0 0) 0x7f7028001120 con 0x7f70380ceb80 2023-07-09T21:36:14.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7024003530 con 0x7f70380ceb80 2023-07-09T21:36:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1086340437 0 0) 0x7f7024003530 con 0x7f70380ceb80 2023-07-09T21:36:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 msgr2=0x7f7038160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f7038160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 >> v2:172.21.15.119:3300/0 conn(0x7f70380d0780 msgr2=0x7f70380d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 --2- 172.21.15.37:0/1792588486 >> v2:172.21.15.119:3300/0 conn(0x7f70380d0780 0x7f70380d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038160570 con 0x7f70380ceb80 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7028001810 con 0x7f70380ceb80 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 >> v1:172.21.15.37:6789/0 conn(0x7f70380ceb80 legacy=0x7f70380cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024003980 0x7f7024003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f70240047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7024004d10 0x7f7024005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380cd070 con 0x7f7024004d10 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380cfd70 con 0x7f7024003980 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702400b990 con 0x7f70380b7980 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703ecae640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7024004d10 0x7f7024005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703e4ad640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024003980 0x7f7024003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.989+0000 7f703dcac640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f70240047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 -- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 msgr2=0x7f70240047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70380b7980 0x7f70240047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 -- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024003980 msgr2=0x7f7024003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024003980 0x7f7024003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 -- 172.21.15.37:0/1792588486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024003530 con 0x7f7024004d10 2023-07-09T21:36:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7024004d10 0x7f7024005180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7030009fc0 tx=0x7f703001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd49b5db6f60b34d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300a5cb0 con 0x7f7024004d10 2023-07-09T21:36:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000f040 con 0x7f7024004d10 2023-07-09T21:36:14.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703d4ab640 1 -- 172.21.15.37:0/1792588486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70300ad680 con 0x7f7024004d10 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 -- 172.21.15.37:0/1792588486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7024004d10 msgr2=0x7f7024005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 --2- 172.21.15.37:0/1792588486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7024004d10 0x7f7024005180 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f7030009fc0 tx=0x7f703001cc40 comp rx=0 tx=0).stop 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f703ecae640 1 -- 172.21.15.37:0/1792588486 reap_dead start 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 -- 172.21.15.37:0/1792588486 shutdown_connections 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 -- 172.21.15.37:0/1792588486 >> 172.21.15.37:0/1792588486 conn(0x7f7038073090 msgr2=0x7f7038069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 -- 172.21.15.37:0/1792588486 shutdown_connections 2023-07-09T21:36:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.993+0000 7f7040711640 1 -- 172.21.15.37:0/1792588486 wait complete. 2023-07-09T21:36:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 Processor -- start 2023-07-09T21:36:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- start start 2023-07-09T21:36:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024004d10 0x7f70380c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 0x7f70381534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70380b2dc0 con 0x7f703815dbc0 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038153a10 con 0x7f7024004d10 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70380b4910 con 0x7f703815e030 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53728/0 (socket says 172.21.15.37:53728) 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 -- 172.21.15.37:0/939628267 learned_addr learned my addr 172.21.15.37:0/939628267 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703e4ad640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024004d10 0x7f70380c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703ecae640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 0x7f70381534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 -- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 msgr2=0x7f70381534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 0x7f70381534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 -- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024004d10 msgr2=0x7f70380c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024004d10 0x7f70380c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 -- 172.21.15.37:0/939628267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70380b21b0 con 0x7f703815dbc0 2023-07-09T21:36:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703ecae640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 0x7f70381534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f703dcac640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7028007360 tx=0x7f7028007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028007e70 con 0x7f703815dbc0 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702800e950 con 0x7f703815dbc0 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70380b2490 con 0x7f703815dbc0 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800ed00 con 0x7f703815dbc0 2023-07-09T21:36:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:14.997+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70380b2a50 con 0x7f703815dbc0 2023-07-09T21:36:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70380b2f70 con 0x7f703815dbc0 2023-07-09T21:36:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 16) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f702801d460 con 0x7f703815dbc0 2023-07-09T21:36:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f702effd640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 0x7f701c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7028083c60 con 0x7f703815dbc0 2023-07-09T21:36:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f703e4ad640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 0x7f701c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.001+0000 7f703e4ad640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 0x7f701c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7034009b60 tx=0x7f7034009190 comp rx=0 tx=0).ready entity=mgr.5375 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.005+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70380b2f70 con 0x7f703815dbc0 2023-07-09T21:36:15.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:15.205+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f703815bf80 con 0x7f703815dbc0 2023-07-09T21:36:16.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f7028051300 con 0x7f703815dbc0 2023-07-09T21:36:16.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f702effd640 1 -- 172.21.15.37:0/939628267 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v17) v1 ==== 92+0+0 (secure 0 0 0) 0x7f702806e8c0 con 0x7f703815dbc0 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 msgr2=0x7f701c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 0x7f701c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7034009b60 tx=0x7f7034009190 comp rx=0 tx=0).stop 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 msgr2=0x7f7038152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f7028007360 tx=0x7f7028007760 comp rx=0 tx=0).stop 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 shutdown_connections 2023-07-09T21:36:16.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f701c0663d0 0x7f701c068880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f703815e030 0x7f70381534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f703815dbc0 0x7f7038152f90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 --2- 172.21.15.37:0/939628267 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7024004d10 0x7f70380c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 >> 172.21.15.37:0/939628267 conn(0x7f7038073090 msgr2=0x7f70380cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 shutdown_connections 2023-07-09T21:36:16.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.085+0000 7f7040711640 1 -- 172.21.15.37:0/939628267 wait complete. 2023-07-09T21:36:16.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:36:16.254 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:16.257+0000 7fd548446180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:36:16.262 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:16.261+0000 7f9fcfb24180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:36:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 Processor -- start 2023-07-09T21:36:16.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 -- start start 2023-07-09T21:36:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0b980b7980 0x7f0b98160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b980ceb80 0x7f0b980cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9815bf80 con 0x7f0b980b3c20 2023-07-09T21:36:16.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980cd070 con 0x7f0b980ceb80 2023-07-09T21:36:16.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9d111640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b980cfd70 con 0x7f0b980b7980 2023-07-09T21:36:16.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b980ceb80 0x7f0b980cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0b980ceb80 0x7f0b980cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53760/0 (socket says 172.21.15.37:53760) 2023-07-09T21:36:16.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 -- 172.21.15.37:0/1758027830 learned_addr learned my addr 172.21.15.37:0/1758027830 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:16.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b96d9d640 1 --2- 172.21.15.37:0/1758027830 >> v2:172.21.15.119:3300/0 conn(0x7f0b980b7980 0x7f0b98160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 -- 172.21.15.37:0/1758027830 >> v2:172.21.15.119:3300/0 conn(0x7f0b980b7980 msgr2=0x7f0b98160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:16.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 --2- 172.21.15.37:0/1758027830 >> v2:172.21.15.119:3300/0 conn(0x7f0b980b7980 0x7f0b98160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 -- 172.21.15.37:0/1758027830 >> v1:172.21.15.119:6789/0 conn(0x7f0b980b3c20 legacy=0x7f0b980b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.265+0000 7f0b9659c640 1 -- 172.21.15.37:0/1758027830 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b98160570 con 0x7f0b980ceb80 2023-07-09T21:36:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9659c640 1 --2- 172.21.15.37:0/1758027830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980cefc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b98069aa0 tx=0x7f0b8c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa781318d87f2348 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b95d9b640 1 -- 172.21.15.37:0/1758027830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0ab600 con 0x7f0b980ceb80 2023-07-09T21:36:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b95d9b640 1 -- 172.21.15.37:0/1758027830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c0a7050 con 0x7f0b980ceb80 2023-07-09T21:36:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b95d9b640 1 -- 172.21.15.37:0/1758027830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0ab980 con 0x7f0b980ceb80 2023-07-09T21:36:16.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 -- 172.21.15.37:0/1758027830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 msgr2=0x7f0b980cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 --2- 172.21.15.37:0/1758027830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980cefc0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0b98069aa0 tx=0x7f0b8c01c500 comp rx=0 tx=0).stop 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 -- 172.21.15.37:0/1758027830 shutdown_connections 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 --2- 172.21.15.37:0/1758027830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980cefc0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 --2- 172.21.15.37:0/1758027830 >> v2:172.21.15.119:3300/0 conn(0x7f0b980b7980 0x7f0b98160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 -- 172.21.15.37:0/1758027830 >> 172.21.15.37:0/1758027830 conn(0x7f0b98073090 msgr2=0x7f0b98069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 -- 172.21.15.37:0/1758027830 shutdown_connections 2023-07-09T21:36:16.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.269+0000 7f0b9d111640 1 -- 172.21.15.37:0/1758027830 wait complete. 2023-07-09T21:36:16.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 Processor -- start 2023-07-09T21:36:16.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- start start 2023-07-09T21:36:16.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b980b3c20 0x7f0b980cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 0x7f0b981544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980ca440 con 0x7f0b980ceb80 2023-07-09T21:36:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980ca720 con 0x7f0b980b7980 2023-07-09T21:36:16.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b980caa00 con 0x7f0b980b3c20 2023-07-09T21:36:16.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 0x7f0b981544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53766/0 (socket says 172.21.15.37:53766) 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b96d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b980b3c20 0x7f0b980cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9759e640 1 -- 172.21.15.37:0/2966433345 learned_addr learned my addr 172.21.15.37:0/2966433345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 -- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b980b3c20 msgr2=0x7f0b980cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b980b3c20 0x7f0b980cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 -- 172.21.15.37:0/2966433345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 msgr2=0x7f0b980c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 -- 172.21.15.37:0/2966433345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c0094d0 con 0x7f0b980b7980 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9759e640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9659c640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 0x7f0b981544b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0ab000 tx=0x7f0b8c0192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0b8070 con 0x7f0b980b7980 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8c0b35d0 con 0x7f0b980b7980 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8c0b3960 con 0x7f0b980b7980 2023-07-09T21:36:16.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b980cace0 con 0x7f0b980b7980 2023-07-09T21:36:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.273+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b980ca060 con 0x7f0b980b7980 2023-07-09T21:36:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9804d7d0 con 0x7f0b980b7980 2023-07-09T21:36:16.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f0b8c0b2070 con 0x7f0b980b7980 2023-07-09T21:36:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b7f7fe640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 0x7f0b840688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b8c11d5e0 con 0x7f0b980b7980 2023-07-09T21:36:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b96d9d640 1 -- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 msgr2=0x7f0b840688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:16.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.277+0000 7f0b96d9d640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 0x7f0b840688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:36:16.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.281+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b8c0ea8e0 con 0x7f0b980b7980 2023-07-09T21:36:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.441+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f0b98160570 con 0x7f0b980b7980 2023-07-09T21:36:16.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b7f7fe640 1 -- 172.21.15.37:0/2966433345 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v17)=0 v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b98160570 con 0x7f0b980b7980 2023-07-09T21:36:16.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 msgr2=0x7f0b840688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 0x7f0b840688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 msgr2=0x7f0b981544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 0x7f0b981544b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c0ab000 tx=0x7f0b8c0192a0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 shutdown_connections 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b980ceb80 0x7f0b980c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b980b7980 0x7f0b981544b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f0b84066420 0x7f0b840688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 --2- 172.21.15.37:0/2966433345 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b980b3c20 0x7f0b980cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 >> 172.21.15.37:0/2966433345 conn(0x7f0b98073090 msgr2=0x7f0b980d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 shutdown_connections 2023-07-09T21:36:16.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.449+0000 7f0b9d111640 1 -- 172.21.15.37:0/2966433345 wait complete. 2023-07-09T21:36:16.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:36:16.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.617+0000 7fec8ce19640 1 Processor -- start 2023-07-09T21:36:16.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.617+0000 7fec8ce19640 1 -- start start 2023-07-09T21:36:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8ce19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec880b7980 0x7fec88160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8ce19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec880cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8ce19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8815bf80 con 0x7fec880b3c20 2023-07-09T21:36:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8ce19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec880cd070 con 0x7fec880b7980 2023-07-09T21:36:16.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8ce19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec880cfd70 con 0x7fec880ceb80 2023-07-09T21:36:16.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec86d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec880b3c20 0x7fec880b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36286/0 (socket says 172.21.15.37:36286) 2023-07-09T21:36:16.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec86d9d640 1 -- 172.21.15.37:0/1759848860 learned_addr learned my addr 172.21.15.37:0/1759848860 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:16.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8659c640 1 --2- 172.21.15.37:0/1759848860 >> v2:172.21.15.119:3300/0 conn(0x7fec880b7980 0x7fec88160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec7ffff640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec880cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8659c640 1 -- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 msgr2=0x7fec880cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8659c640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec880cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8659c640 1 -- 172.21.15.37:0/1759848860 >> v1:172.21.15.37:6789/0 conn(0x7fec880b3c20 legacy=0x7fec880b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec8659c640 1 -- 172.21.15.37:0/1759848860 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec88160570 con 0x7fec880b7980 2023-07-09T21:36:16.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.621+0000 7fec85d9b640 1 -- 172.21.15.37:0/1759848860 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928616037 0 0) 0x7fec800014a0 con 0x7fec880b3c20 2023-07-09T21:36:16.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8659c640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88160030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fec780097c0 tx=0x7fec7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d735b2372fbb57c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:16.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec85d9b640 1 -- 172.21.15.37:0/1759848860 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab600 con 0x7fec880b7980 2023-07-09T21:36:16.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec85d9b640 1 -- 172.21.15.37:0/1759848860 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec780a7050 con 0x7fec880b7980 2023-07-09T21:36:16.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec85d9b640 1 -- 172.21.15.37:0/1759848860 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec780ab980 con 0x7fec880b7980 2023-07-09T21:36:16.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 msgr2=0x7fec88160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88160030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fec780097c0 tx=0x7fec7801c480 comp rx=0 tx=0).stop 2023-07-09T21:36:16.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- 172.21.15.37:0/1759848860 shutdown_connections 2023-07-09T21:36:16.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec880cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 --2- 172.21.15.37:0/1759848860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88160030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- 172.21.15.37:0/1759848860 >> 172.21.15.37:0/1759848860 conn(0x7fec88073090 msgr2=0x7fec88069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- 172.21.15.37:0/1759848860 shutdown_connections 2023-07-09T21:36:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- 172.21.15.37:0/1759848860 wait complete. 2023-07-09T21:36:16.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 Processor -- start 2023-07-09T21:36:16.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.625+0000 7fec8ce19640 1 -- start start 2023-07-09T21:36:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec8815e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88153850 con 0x7fec880b3c20 2023-07-09T21:36:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec88153aa0 con 0x7fec880b7980 2023-07-09T21:36:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec88153d80 con 0x7fec880ceb80 2023-07-09T21:36:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53780/0 (socket says 172.21.15.37:53780) 2023-07-09T21:36:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8659c640 1 -- 172.21.15.37:0/3405103050 learned_addr learned my addr 172.21.15.37:0/3405103050 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec86d9d640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec8815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 -- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 msgr2=0x7fec8815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec8815e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 -- 172.21.15.37:0/3405103050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 msgr2=0x7fec8815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 -- 172.21.15.37:0/3405103050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78009420 con 0x7fec880b7980 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8659c640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7ffff640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88154340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fec7000e870 tx=0x7fec7000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700095d0 con 0x7fec880b7980 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7000c940 con 0x7fec880b7980 2023-07-09T21:36:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7000ccb0 con 0x7fec880b7980 2023-07-09T21:36:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec88154060 con 0x7fec880b7980 2023-07-09T21:36:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec880ca8c0 con 0x7fec880b7980 2023-07-09T21:36:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.629+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec880cab40 con 0x7fec880b7980 2023-07-09T21:36:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.633+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fec70013470 con 0x7fec880b7980 2023-07-09T21:36:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.633+0000 7fec7effd640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 0x7fec680688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.633+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fec70083fc0 con 0x7fec880b7980 2023-07-09T21:36:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.633+0000 7fec8659c640 1 -- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 msgr2=0x7fec680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.633+0000 7fec8659c640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 0x7fec680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:36:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.637+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec700b4700 con 0x7fec880b7980 2023-07-09T21:36:16.673 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:16.673+0000 7fd548446180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:36:16.713 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:16.713+0000 7f9fcfb24180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:36:16.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.797+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fec8804d7d0 con 0x7fec880b7980 2023-07-09T21:36:16.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec7effd640 1 -- 172.21.15.37:0/3405103050 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v18)=0 v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fec700170c0 con 0x7fec880b7980 2023-07-09T21:36:16.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 msgr2=0x7fec680688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 0x7fec680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 msgr2=0x7fec88154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88154340 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fec7000e870 tx=0x7fec7000ed30 comp rx=0 tx=0).stop 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 shutdown_connections 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7fec680663f0 0x7fec680688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec880ceb80 0x7fec8815e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec880b7980 0x7fec88154340 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 --2- 172.21.15.37:0/3405103050 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec880b3c20 0x7fec8815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 >> 172.21.15.37:0/3405103050 conn(0x7fec88073090 msgr2=0x7fec880b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 shutdown_connections 2023-07-09T21:36:16.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:16.805+0000 7fec8ce19640 1 -- 172.21.15.37:0/3405103050 wait complete. 2023-07-09T21:36:16.823 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:16.825+0000 7fd548446180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:36:16.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:16.827 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:36:16.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-09T21:36:16.875 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:16.873+0000 7f9fcfb24180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:36:17.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 Processor -- start 2023-07-09T21:36:17.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 -- start start 2023-07-09T21:36:17.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f62280b7980 0x7f6228160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:17.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622815bf80 con 0x7f62280d0780 2023-07-09T21:36:17.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6228160570 con 0x7f62280ceb80 2023-07-09T21:36:17.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622e40b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62280cd070 con 0x7f62280b7980 2023-07-09T21:36:17.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622c9a8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62280d0780 0x7f62280d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:36302/0 (socket says 172.21.15.37:36302) 2023-07-09T21:36:17.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f622c9a8640 1 -- 172.21.15.37:0/2635524641 learned_addr learned my addr 172.21.15.37:0/2635524641 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:17.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6227fff640 1 --2- 172.21.15.37:0/2635524641 >> v2:172.21.15.119:3300/0 conn(0x7f62280b7980 0x7f6228160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:17.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769535847 0 0) 0x7f62200014a0 con 0x7f62280d0780 2023-07-09T21:36:17.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6210003530 con 0x7f62280d0780 2023-07-09T21:36:17.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6227fff640 1 -- 172.21.15.37:0/2635524641 >> v1:172.21.15.119:6789/0 conn(0x7f62280ceb80 legacy=0x7f62280cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:17.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489904668 0 0) 0x7f621c001120 con 0x7f62280ceb80 2023-07-09T21:36:17.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6227fff640 1 -- 172.21.15.37:0/2635524641 >> v1:172.21.15.37:6789/0 conn(0x7f62280d0780 legacy=0x7f62280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:17.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.025+0000 7f6227fff640 1 -- 172.21.15.37:0/2635524641 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62280d02f0 con 0x7f62280b7980 2023-07-09T21:36:17.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f6227fff640 1 --2- 172.21.15.37:0/2635524641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f6228160030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f62180097c0 tx=0x7f621801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3dface87425ba67 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:17.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180ab600 con 0x7f62280b7980 2023-07-09T21:36:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62180a7050 con 0x7f62280b7980 2023-07-09T21:36:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f6226ffd640 1 -- 172.21.15.37:0/2635524641 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62180ab980 con 0x7f62280b7980 2023-07-09T21:36:17.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 -- 172.21.15.37:0/2635524641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 msgr2=0x7f6228160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 --2- 172.21.15.37:0/2635524641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f6228160030 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f62180097c0 tx=0x7f621801c480 comp rx=0 tx=0).stop 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 -- 172.21.15.37:0/2635524641 shutdown_connections 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 --2- 172.21.15.37:0/2635524641 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f6228160030 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 -- 172.21.15.37:0/2635524641 >> 172.21.15.37:0/2635524641 conn(0x7f6228073090 msgr2=0x7f6228069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 -- 172.21.15.37:0/2635524641 shutdown_connections 2023-07-09T21:36:17.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.029+0000 7f622e40b640 1 -- 172.21.15.37:0/2635524641 wait complete. 2023-07-09T21:36:17.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 Processor -- start 2023-07-09T21:36:17.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 -- start start 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f62280c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 0x7f6228158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62280d0780 0x7f62280cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280b2590 con 0x7f62280ceb80 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62280b1ca0 con 0x7f62280b7980 2023-07-09T21:36:17.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622e40b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62280b1f40 con 0x7f62280d0780 2023-07-09T21:36:17.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 0x7f6228158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:17.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f6227fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f62280c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:17.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 0x7f6228158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53796/0 (socket says 172.21.15.37:53796) 2023-07-09T21:36:17.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 -- 172.21.15.37:0/2585775913 learned_addr learned my addr 172.21.15.37:0/2585775913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:17.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f622c9a8640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62280d0780 0x7f62280cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62280d0780 msgr2=0x7f62280cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62280d0780 0x7f62280cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:17.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 msgr2=0x7f62280c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f62280c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6218009420 con 0x7f62280ceb80 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62280b7980 0x7f62280c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f62277fe640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 0x7f6228158fb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c750 tx=0x7f621c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.033+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c005270 con 0x7f62280ceb80 2023-07-09T21:36:17.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621c0053f0 con 0x7f62280ceb80 2023-07-09T21:36:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621c00a880 con 0x7f62280ceb80 2023-07-09T21:36:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62280b2220 con 0x7f62280ceb80 2023-07-09T21:36:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62280c5990 con 0x7f62280ceb80 2023-07-09T21:36:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622804d7d0 con 0x7f62280ceb80 2023-07-09T21:36:17.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.037+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f621c00a9e0 con 0x7f62280ceb80 2023-07-09T21:36:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.041+0000 7f6224ff9640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.041+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f621c083200 con 0x7f62280ceb80 2023-07-09T21:36:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.041+0000 7f6227fff640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 msgr2=0x7f62140688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:17.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.041+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:36:17.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.045+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f621c0506b0 con 0x7f62280ceb80 2023-07-09T21:36:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.221+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f62280cff80 con 0x7f6214066420 2023-07-09T21:36:17.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.245+0000 7f6227fff640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 msgr2=0x7f62140688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:17.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.245+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:36:17.307 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.309+0000 7fd548446180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:36:17.365 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.369+0000 7fd548446180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:36:17.390 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.389+0000 7f9fcfb24180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:36:17.421 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.425+0000 7fd548446180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:36:17.451 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.453+0000 7f9fcfb24180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:36:17.507 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.509+0000 7fd548446180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:36:17.510 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.509+0000 7f9fcfb24180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:36:17.566 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.569+0000 7fd548446180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:36:17.602 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.601+0000 7f9fcfb24180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:36:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.649+0000 7f6227fff640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 msgr2=0x7f62140688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:17.649+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:36:17.649 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.649+0000 7fd548446180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:36:17.661 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.661+0000 7f9fcfb24180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:36:17.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.709+0000 7fd548446180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:36:17.750 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.749+0000 7f9fcfb24180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:36:17.809 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.809+0000 7f9fcfb24180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:36:17.847 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.849+0000 7fd548446180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:36:17.904 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:17.905+0000 7fd548446180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:36:17.958 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:17.957+0000 7f9fcfb24180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:36:18.020 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.021+0000 7f9fcfb24180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:36:18.144 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:36:18.144 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:36:18.144 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:36:18.152 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:18.153+0000 7fd548446180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:36:18.272 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:36:18.272 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:36:18.272 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:36:18.281 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.281+0000 7f9fcfb24180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:36:18.289 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:18.293+0000 7fd548446180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:36:18.414 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:18.417+0000 7fd548446180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:36:18.421 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.421+0000 7f9fcfb24180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:36:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:18.453+0000 7f6227fff640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 msgr2=0x7f62140688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1375084468 2023-07-09T21:36:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:18.453+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:36:18.484 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:18.485+0000 7fd548446180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:36:18.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.553+0000 7f9fcfb24180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:36:18.616 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:18.617+0000 7fd548446180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:36:18.626 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.625+0000 7f9fcfb24180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:36:18.767 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:18.765+0000 7f9fcfb24180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:36:19.152 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.153+0000 7fd548446180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:36:19.236 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.237+0000 7fd548446180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:36:19.332 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:19.333+0000 7f9fcfb24180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:36:19.383 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.385+0000 7fd548446180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:36:19.421 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:19.421+0000 7f9fcfb24180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:36:19.467 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.469+0000 7fd548446180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:36:19.575 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:19.573+0000 7f9fcfb24180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:36:19.662 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:19.661+0000 7f9fcfb24180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:36:19.734 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.737+0000 7fd548446180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:36:19.794 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.797+0000 7fd548446180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:36:19.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:19.805+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 18) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f621c050a80 con 0x7f62280ceb80 2023-07-09T21:36:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:19.805+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 msgr2=0x7f62140688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:36:19.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:19.805+0000 7f6224ff9640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/1375084468,v1:172.21.15.119:6833/1375084468] conn(0x7f6214066420 0x7f62140688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:19.928 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c9a6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.928 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c9a6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.928 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c9a6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.928 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c9a6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c9a6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c6a68640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c6a68640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c6a68640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c6a68640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.929 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:36:19.929+0000 7fd4c6a68640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:36:19.963 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:19.965+0000 7f9fcfb24180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:36:20.027 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:36:20.025+0000 7f9fcfb24180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:36:20.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.813+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f621c081590 con 0x7f62280ceb80 2023-07-09T21:36:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.813+0000 7f6224ff9640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f6214033e90 0x7f62140708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.813+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 --> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f6214034260 con 0x7f6214033e90 2023-07-09T21:36:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.817+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f6214033e90 0x7f62140708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.821+0000 7f6227fff640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f6214033e90 0x7f62140708f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62180ad000 tx=0x7f62180a6000 comp rx=0 tx=0).ready entity=mgr.5693 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:20.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f6224ff9640 1 -- 172.21.15.37:0/2585775913 <== mgr.5693 v2:172.21.15.119:6832/2506503407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6214034260 con 0x7f6214033e90 2023-07-09T21:36:20.885 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f6214033e90 msgr2=0x7f62140708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f6214033e90 0x7f62140708f0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f62180ad000 tx=0x7f62180a6000 comp rx=0 tx=0).stop 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 msgr2=0x7f6228158fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 --2- 172.21.15.37:0/2585775913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62280ceb80 0x7f6228158fb0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c750 tx=0x7f621c00cc10 comp rx=0 tx=0).stop 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622c9a8640 1 -- 172.21.15.37:0/2585775913 reap_dead start 2023-07-09T21:36:20.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 shutdown_connections 2023-07-09T21:36:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 >> 172.21.15.37:0/2585775913 conn(0x7f6228073090 msgr2=0x7f62281580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 shutdown_connections 2023-07-09T21:36:20.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:20.885+0000 7f622e40b640 1 -- 172.21.15.37:0/2585775913 wait complete. 2023-07-09T21:36:20.908 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T21:36:20.909 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 2M 2023-07-09T21:36:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 Processor -- start 2023-07-09T21:36:21.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 -- start start 2023-07-09T21:36:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4bc0cffc0 0x7fc4bc0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0d08d0 con 0x7fc4bc15bbc0 2023-07-09T21:36:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0cca70 con 0x7fc4bc06ad50 2023-07-09T21:36:21.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c4234640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc06b150 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c17cf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc4bc15bbc0 0x7fc4bc06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53120/0 (socket says 172.21.15.37:53120) 2023-07-09T21:36:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c17cf640 1 -- 172.21.15.37:0/10069360 learned_addr learned my addr 172.21.15.37:0/10069360 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c1fd0640 1 --2- 172.21.15.37:0/10069360 >> v2:172.21.15.119:3300/0 conn(0x7fc4bc0cffc0 0x7fc4bc0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 49433114 0 0) 0x7fc4bc0d08d0 con 0x7fc4bc15bbc0 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4a8003530 con 0x7fc4bc15bbc0 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653326078 0 0) 0x7fc4bc0cca70 con 0x7fc4bc06ad50 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc0d08d0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/10069360 >> v1:172.21.15.119:6789/0 conn(0x7fc4bc06ad50 legacy=0x7fc4bc0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/10069360 >> v1:172.21.15.37:6789/0 conn(0x7fc4bc15bbc0 legacy=0x7fc4bc06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.057+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/10069360 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0ccd50 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c1fd0640 1 --2- 172.21.15.37:0/10069360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0d0390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3ce474b481fa813 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ac620 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b80ac780 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c0fce640 1 -- 172.21.15.37:0/10069360 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80acb10 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 -- 172.21.15.37:0/10069360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 msgr2=0x7fc4bc0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 --2- 172.21.15.37:0/10069360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0d0390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4b80097c0 tx=0x7fc4b801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 -- 172.21.15.37:0/10069360 shutdown_connections 2023-07-09T21:36:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 --2- 172.21.15.37:0/10069360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0d0390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 -- 172.21.15.37:0/10069360 >> 172.21.15.37:0/10069360 conn(0x7fc4bc099320 msgr2=0x7fc4bc072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 -- 172.21.15.37:0/10069360 shutdown_connections 2023-07-09T21:36:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.061+0000 7fc4c4234640 1 -- 172.21.15.37:0/10069360 wait complete. 2023-07-09T21:36:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 Processor -- start 2023-07-09T21:36:21.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- start start 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4bc0c86b0 0x7fc4bc0c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c7160 con 0x7fc4bc06ad50 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c73b0 con 0x7fc4bc0cffc0 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c7690 con 0x7fc4bc0c86b0 2023-07-09T21:36:21.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49026/0 (socket says 172.21.15.37:49026) 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/2591260895 learned_addr learned my addr 172.21.15.37:0/2591260895 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c17cf640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c27d1640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4bc0c86b0 0x7fc4bc0c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4bc0c86b0 msgr2=0x7fc4bc0c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4bc0c86b0 0x7fc4bc0c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 msgr2=0x7fc4bc0c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 -- 172.21.15.37:0/2591260895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b8009420 con 0x7fc4bc06ad50 2023-07-09T21:36:21.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c1fd0640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8018fd0 tx=0x7fc4b8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80ac620 con 0x7fc4bc06ad50 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b80b5410 con 0x7fc4bc06ad50 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0c7970 con 0x7fc4bc06ad50 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b80b57c0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.065+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc1523c0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc0d0fb0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fc4b80b3040 con 0x7fc4bc06ad50 2023-07-09T21:36:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4b27fc640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 0x7fc4a00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fc4b811dcc0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4c17cf640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 0x7fc4a00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.069+0000 7fc4c17cf640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 0x7fc4a00685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc166e00 tx=0x7fc4ac007d80 comp rx=0 tx=0).ready entity=mgr.5693 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.073+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4b80eb2e0 con 0x7fc4bc06ad50 2023-07-09T21:36:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.249+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 --> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "2M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4bc0cd5f0 con 0x7fc4a0066120 2023-07-09T21:36:21.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4b27fc640 1 -- 172.21.15.37:0/2591260895 <== mgr.5693 v2:172.21.15.119:6832/2506503407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc4ac005860 con 0x7fc4a0066120 2023-07-09T21:36:21.303 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T21:36:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 msgr2=0x7fc4a00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 0x7fc4a00685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc4bc166e00 tx=0x7fc4ac007d80 comp rx=0 tx=0).stop 2023-07-09T21:36:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 msgr2=0x7fc4bc151e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8018fd0 tx=0x7fc4b8019160 comp rx=0 tx=0).stop 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 shutdown_connections 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4a0066120 0x7fc4a00685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4bc0c86b0 0x7fc4bc0c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4bc0cffc0 0x7fc4bc0c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 --2- 172.21.15.37:0/2591260895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4bc06ad50 0x7fc4bc151e80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 >> 172.21.15.37:0/2591260895 conn(0x7fc4bc099320 msgr2=0x7fc4bc06a590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:21.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 shutdown_connections 2023-07-09T21:36:21.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.305+0000 7fc4c4234640 1 -- 172.21.15.37:0/2591260895 wait complete. 2023-07-09T21:36:21.324 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T21:36:21.324 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-09-21_37_00 in ~39s... 2023-07-09T21:36:21.325 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-09-21_38_00 in ~99s... 2023-07-09T21:36:21.325 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M', '2M'], expected_retention: [] 2023-07-09T21:36:21.326 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-09T21:36:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 Processor -- start 2023-07-09T21:36:21.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 -- start start 2023-07-09T21:36:21.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 0x7f48380c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380c4c90 con 0x7f48380c99e0 2023-07-09T21:36:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48380ca170 con 0x7f48381595c0 2023-07-09T21:36:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483f111640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380ca730 con 0x7f4838159990 2023-07-09T21:36:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483d6ae640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48380c99e0 0x7f48380cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53122/0 (socket says 172.21.15.37:53122) 2023-07-09T21:36:21.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f483d6ae640 1 -- 172.21.15.37:0/1104816732 learned_addr learned my addr 172.21.15.37:0/1104816732 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:36:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f4837fff640 1 --2- 172.21.15.37:0/1104816732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 0x7f48380c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714340897 0 0) 0x7f48300014a0 con 0x7f48380c99e0 2023-07-09T21:36:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4828003530 con 0x7f48380c99e0 2023-07-09T21:36:21.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505298883 0 0) 0x7f48380ca170 con 0x7f48381595c0 2023-07-09T21:36:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48300014a0 con 0x7f48381595c0 2023-07-09T21:36:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f4837fff640 1 -- 172.21.15.37:0/1104816732 >> v1:172.21.15.119:6789/0 conn(0x7f48381595c0 legacy=0x7f483815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f4837fff640 1 -- 172.21.15.37:0/1104816732 >> v1:172.21.15.37:6789/0 conn(0x7f48380c99e0 legacy=0x7f48380cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.473+0000 7f4837fff640 1 -- 172.21.15.37:0/1104816732 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380ca450 con 0x7f4838159990 2023-07-09T21:36:21.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f4837fff640 1 --2- 172.21.15.37:0/1104816732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 0x7f48380c4750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48240097f0 tx=0x7f482401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c64b5875e018081 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240aa5f0 con 0x7f4838159990 2023-07-09T21:36:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48240aa750 con 0x7f4838159990 2023-07-09T21:36:21.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f48377fe640 1 -- 172.21.15.37:0/1104816732 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240aaae0 con 0x7f4838159990 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 -- 172.21.15.37:0/1104816732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 msgr2=0x7f48380c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 --2- 172.21.15.37:0/1104816732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 0x7f48380c4750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48240097f0 tx=0x7f482401c490 comp rx=0 tx=0).stop 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 -- 172.21.15.37:0/1104816732 shutdown_connections 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 --2- 172.21.15.37:0/1104816732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4838159990 0x7f48380c4750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 -- 172.21.15.37:0/1104816732 >> 172.21.15.37:0/1104816732 conn(0x7f48380cde40 msgr2=0x7f48380ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 -- 172.21.15.37:0/1104816732 shutdown_connections 2023-07-09T21:36:21.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.477+0000 7f483f111640 1 -- 172.21.15.37:0/1104816732 wait complete. 2023-07-09T21:36:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 Processor -- start 2023-07-09T21:36:21.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 -- start start 2023-07-09T21:36:21.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48380c99e0 0x7f483814fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48381595c0 0x7f48380b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838150670 con 0x7f4838159990 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4838150950 con 0x7f48380c99e0 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483f111640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380b1840 con 0x7f48381595c0 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49028/0 (socket says 172.21.15.37:49028) 2023-07-09T21:36:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 -- 172.21.15.37:0/463194494 learned_addr learned my addr 172.21.15.37:0/463194494 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:36:21.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f4837fff640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48381595c0 0x7f48380b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483cead640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48380c99e0 0x7f483814fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 -- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48381595c0 msgr2=0x7f48380b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48381595c0 0x7f48380b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 -- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48380c99e0 msgr2=0x7f483814fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48380c99e0 0x7f483814fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 -- 172.21.15.37:0/463194494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4824009420 con 0x7f4838159990 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.481+0000 7f483d6ae640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f483000cc30 tx=0x7f483000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483000ce40 con 0x7f4838159990 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4830012400 con 0x7f4838159990 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4830012790 con 0x7f4838159990 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48380b1b20 con 0x7f4838159990 2023-07-09T21:36:21.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4838150c30 con 0x7f4838159990 2023-07-09T21:36:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48380b1d60 con 0x7f4838159990 2023-07-09T21:36:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f4830007070 con 0x7f4838159990 2023-07-09T21:36:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 0x7f481c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:36:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4830083b10 con 0x7f4838159990 2023-07-09T21:36:21.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f483cead640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 0x7f481c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:36:21.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.485+0000 7f483cead640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 0x7f481c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f482c0011f0 tx=0x7f482c009040 comp rx=0 tx=0).ready entity=mgr.5693 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:36:21.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.489+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48380b1d60 con 0x7f4838159990 2023-07-09T21:36:21.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.661+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 --> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f48380c9e00 con 0x7f481c066120 2023-07-09T21:36:21.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f48357fa640 1 -- 172.21.15.37:0/463194494 <== mgr.5693 v2:172.21.15.119:6832/2506503407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+76 (secure 0 0 0) 0x7f482c0014e0 con 0x7f481c066120 2023-07-09T21:36:21.669 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:36:21.669 INFO:teuthology.orchestra.run.smithi037.stdout:{"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 msgr2=0x7f481c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 0x7f481c0685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f482c0011f0 tx=0x7f482c009040 comp rx=0 tx=0).stop 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 msgr2=0x7f48380b2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f483000cc30 tx=0x7f483000a430 comp rx=0 tx=0).stop 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 shutdown_connections 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f481c066120 0x7f481c0685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4838159990 0x7f48380b2040 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48381595c0 0x7f48380b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 --2- 172.21.15.37:0/463194494 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48380c99e0 0x7f483814fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:36:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 >> 172.21.15.37:0/463194494 conn(0x7f48380cde40 msgr2=0x7f4838070870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:36:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 shutdown_connections 2023-07-09T21:36:21.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:36:21.669+0000 7f483f111640 1 -- 172.21.15.37:0/463194494 wait complete. 2023-07-09T21:36:21.690 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M", "2M"], "retention": [{}, {}]} 2023-07-09T21:36:21.691 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M', '2M'], 'retention': [{}, {}]} 2023-07-09T21:36:21.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:21.692 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:21.707 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:21.707 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:21.707 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:22.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:22.709 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:22.727 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:22.728 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:22.728 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:23.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:23.730 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:23.748 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:23.749 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:23.749 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:24.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:24.750 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:24.767 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:24.768 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:24.768 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:25.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:25.770 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:25.787 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:25.787 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:25.788 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:26.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:26.790 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:26.807 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:26.808 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:26.808 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:27.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:27.810 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:27.827 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:27.827 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:27.827 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:28.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:28.829 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:28.847 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:28.848 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:28.848 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:29.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:29.849 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:29.867 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:29.867 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:29.868 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:30.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:36:30.696 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:36:30.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:30.869 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:30.885 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:30.886 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:30.886 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:31.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:31.888 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:31.906 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:31.906 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:31.906 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:32.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:32.908 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:32.925 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:32.925 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:32.926 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:33.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:33.928 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:33.946 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:33.946 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:33.946 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:34.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:34.948 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:34.965 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:34.966 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:34.966 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:35.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:35.967 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:35.984 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:35.984 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:35.985 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:36.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:36.986 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:37.004 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:37.005 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:37.005 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:38.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:38.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:38.024 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:38.025 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:38.025 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:39.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:39.027 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:39.045 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:39.046 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:39.046 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:40.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:40.047 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:40.064 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:40.065 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:40.065 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:41.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:41.066 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:41.084 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:41.084 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:41.084 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:42.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:42.086 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:42.104 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:42.105 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:42.105 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:43.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:43.106 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:43.123 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:43.124 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:43.124 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:44.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:44.125 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:44.142 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:44.143 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:44.143 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:45.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:45.145 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:45.162 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:45.163 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:45.163 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:46.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:46.165 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:46.183 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:46.184 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:46.184 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:47.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:47.185 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:47.204 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:47.205 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:47.205 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:48.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:48.207 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:48.224 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:48.224 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:48.225 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:49.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:49.226 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:49.243 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:49.244 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:49.244 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:50.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:50.246 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:50.263 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:50.263 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:50.264 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:51.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:51.265 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:51.282 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:51.282 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:51.282 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:52.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:52.284 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:52.301 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:52.301 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:52.302 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:53.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:53.304 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:53.321 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:53.322 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:53.322 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:54.324 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:54.342 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:54.342 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:54.343 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:55.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:55.345 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:55.363 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:55.363 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:55.363 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:56.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:56.365 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:56.382 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:56.383 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:56.383 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:57.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:57.384 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:57.402 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:57.402 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:57.402 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:58.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:58.404 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:58.422 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:58.422 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:58.423 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:36:59.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:36:59.425 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:36:59.443 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:36:59.443 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:36:59.444 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:00.317 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:37:00.316+0000 7fd4b8a4c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:37:00.317 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:37:00.316+0000 7fd4b8a4c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:37:00.317 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:37:00.316+0000 7fd4b8a4c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:37:00.318 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:37:00.316+0000 7fd4b8a4c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:37:00.318 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:37:00.316+0000 7fd4b8a4c640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:37:00.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:00.445 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:00.461 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:00.462 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:00.462 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:00.463 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:00.463 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-09-21_37_00_UTC'] 2023-07-09T21:37:00.463 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688938581.3249242, now = 1688938620.463642, timo = 39 2023-07-09T21:37:00.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:37:00.810 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:37:01.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:01.465 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:01.482 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:01.483 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:01.483 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:01.483 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:02.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:02.485 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:02.502 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:02.503 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:02.504 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:02.504 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:03.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:03.506 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:03.522 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:03.523 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:03.524 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:03.524 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:04.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:04.526 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:04.542 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:04.543 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:04.543 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:04.544 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:05.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:05.545 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:05.562 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:05.563 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:05.563 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:05.563 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:06.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:06.565 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:06.582 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:06.583 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:06.583 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:06.583 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:07.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:07.585 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:07.601 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:07.602 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:07.602 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:07.603 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:08.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:08.604 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:08.621 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:08.622 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:08.622 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:08.622 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:09.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:09.624 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:09.640 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:09.642 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:09.642 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:09.643 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:10.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:10.645 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:10.660 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:10.661 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:10.662 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:10.662 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:11.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:11.664 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:11.681 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:11.681 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:11.682 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:11.682 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:12.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:12.683 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:12.700 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:12.701 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:12.701 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:12.701 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:13.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:13.703 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:13.720 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:13.721 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:13.721 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:13.721 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:14.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:14.723 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:14.739 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:14.740 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:14.741 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:14.741 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:15.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:15.743 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:15.758 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:15.760 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:15.760 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:15.760 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:16.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:16.762 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:16.778 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:16.779 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:16.779 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:16.780 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:17.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:17.781 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:17.797 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:17.798 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:17.798 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:17.799 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:18.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:18.800 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:18.816 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:18.817 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:18.817 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:18.818 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:19.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:19.819 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:19.836 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:19.837 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:19.837 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:19.837 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:20.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:20.839 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:20.856 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:20.858 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:20.858 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:20.858 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:21.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:21.860 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:21.876 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:21.877 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:21.877 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:21.877 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:22.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:22.879 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:22.895 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:22.896 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:22.900 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:22.900 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:23.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:23.902 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:23.918 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:23.919 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:23.920 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:23.920 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:24.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:24.922 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:24.938 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:24.939 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:24.939 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:24.940 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:25.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:25.941 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:25.957 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:25.958 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:25.958 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:25.958 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:26.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:26.960 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:26.976 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:26.977 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:26.977 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:26.977 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:27.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:27.979 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:27.995 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:27.996 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:27.996 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:27.997 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:28.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:28.999 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:29.015 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:29.016 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:29.017 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:29.017 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:30.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:30.019 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:30.035 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:30.035 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:30.036 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:30.036 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:30.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:37:30.940 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:37:31.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:31.038 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:31.054 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:31.055 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:31.056 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:31.057 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:32.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:32.059 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:32.076 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:32.077 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:32.077 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:32.077 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:33.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:33.079 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:33.095 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:33.096 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:33.097 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:33.097 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:34.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:34.099 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:34.116 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:34.117 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:34.117 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:34.117 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:35.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:35.119 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:35.135 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:35.136 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:35.137 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:35.137 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:36.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:36.139 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:36.157 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:36.158 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:36.158 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:36.158 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:37.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:37.160 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:37.176 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:37.177 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:37.177 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:37.177 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:38.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:38.179 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:38.196 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:38.197 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:38.197 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:38.198 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:39.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:39.200 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:39.216 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:39.217 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:39.217 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:39.218 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:40.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:40.432 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:40.450 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:40.450 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:40.450 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:40.451 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:41.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:41.452 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:41.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:41.470 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:41.470 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:41.471 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:42.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:42.473 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:42.490 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:42.491 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:42.492 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:42.492 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:43.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:43.494 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:43.510 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:43.511 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:43.511 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:43.512 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:44.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:44.513 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:44.528 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:44.529 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:44.530 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:44.530 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:45.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:45.532 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:45.548 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:45.549 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:45.549 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:45.549 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:46.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:46.550 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:46.566 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:46.568 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:46.568 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:46.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:47.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:47.569 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:47.586 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:47.587 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:47.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:47.589 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:48.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:48.590 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:48.606 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:48.609 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:48.611 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:48.612 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:49.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:49.617 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:49.633 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:49.634 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:49.634 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:49.634 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:50.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:50.635 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:50.653 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:50.655 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:50.656 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:50.656 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:51.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:51.659 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:51.677 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:51.678 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:51.678 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:51.678 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:52.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:52.680 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:52.696 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:52.698 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:52.698 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:52.698 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:53.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:53.700 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:53.717 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:53.718 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:53.718 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:53.719 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:54.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:54.721 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:54.737 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:54.738 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:54.738 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:54.738 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:55.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:55.740 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:55.756 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:55.757 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:55.758 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:55.758 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:56.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:56.759 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:56.776 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:56.777 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:56.777 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:56.777 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:57.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:57.779 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:57.798 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:57.799 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:57.800 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:57.800 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:58.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:58.802 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:58.818 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:58.819 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:58.819 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:58.819 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:37:59.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:37:59.821 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:37:59.837 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:37:59.838 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:37:59.838 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:37:59.839 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:38:00.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:00.840 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:38:00.859 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:38:00.860 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_38_00_UTC 2023-07-09T21:38:00.861 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_38_00_UTC', 'scheduled-2023-07-09-21_37_00_UTC'} 2023-07-09T21:38:00.862 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-09-21_38_00_UTC'} 2023-07-09T21:38:00.862 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:38:00.863 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-09-21_38_00_UTC'] 2023-07-09T21:38:00.863 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688938581.3249242, now = 1688938680.8635235, timo = 99 2023-07-09T21:38:00.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:38:01.006 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:38:01.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-09T21:38:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.019+0000 7ff8e0d82640 1 Processor -- start 2023-07-09T21:38:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.019+0000 7ff8e0d82640 1 -- start start 2023-07-09T21:38:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc1595c0 0x7ff8dc0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc159990 0x7ff8dc0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 0x7ff8dc0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0ca730 con 0x7ff8dc159990 2023-07-09T21:38:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc0c4c90 con 0x7ff8dc15dd10 2023-07-09T21:38:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8e0d82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0c9f20 con 0x7ff8dc1595c0 2023-07-09T21:38:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc159990 0x7ff8dc0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff8dc159990 0x7ff8dc0c99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40036/0 (socket says 172.21.15.37:40036) 2023-07-09T21:38:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 -- 172.21.15.37:0/2484733720 learned_addr learned my addr 172.21.15.37:0/2484733720 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8dad9d640 1 --2- 172.21.15.37:0/2484733720 >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 0x7ff8dc0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8da59c640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc1595c0 0x7ff8dc0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 -- 172.21.15.37:0/2484733720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc1595c0 msgr2=0x7ff8dc0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc1595c0 0x7ff8dc0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 -- 172.21.15.37:0/2484733720 >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 msgr2=0x7ff8dc0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 --2- 172.21.15.37:0/2484733720 >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 0x7ff8dc0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8d3fff640 1 -- 172.21.15.37:0/2484733720 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc0ca170 con 0x7ff8dc159990 2023-07-09T21:38:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.023+0000 7ff8dad9d640 1 --2- 172.21.15.37:0/2484733720 >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 0x7ff8dc0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8d3fff640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc159990 0x7ff8dc0c99e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc06d510 tx=0x7ff8c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995c0e566ff4d15b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8d9d9b640 1 -- 172.21.15.37:0/2484733720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ac600 con 0x7ff8dc159990 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8d9d9b640 1 -- 172.21.15.37:0/2484733720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c40a8050 con 0x7ff8dc159990 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8d9d9b640 1 -- 172.21.15.37:0/2484733720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c40ac980 con 0x7ff8dc159990 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- 172.21.15.37:0/2484733720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc159990 msgr2=0x7ff8dc0c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc159990 0x7ff8dc0c99e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc06d510 tx=0x7ff8c401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- 172.21.15.37:0/2484733720 shutdown_connections 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc159990 0x7ff8dc0c99e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/2484733720 >> v2:172.21.15.119:3300/0 conn(0x7ff8dc15dd10 0x7ff8dc0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/2484733720 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc1595c0 0x7ff8dc0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- 172.21.15.37:0/2484733720 >> 172.21.15.37:0/2484733720 conn(0x7ff8dc0cde40 msgr2=0x7ff8dc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- 172.21.15.37:0/2484733720 shutdown_connections 2023-07-09T21:38:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- 172.21.15.37:0/2484733720 wait complete. 2023-07-09T21:38:02.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 Processor -- start 2023-07-09T21:38:02.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.027+0000 7ff8e0d82640 1 -- start start 2023-07-09T21:38:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 0x7ff8dc151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc159990 0x7ff8dc06b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc153430 con 0x7ff8dc15dd10 2023-07-09T21:38:02.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc152c20 con 0x7ff8dc1595c0 2023-07-09T21:38:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc0b1450 con 0x7ff8dc159990 2023-07-09T21:38:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40038/0 (socket says 172.21.15.37:40038) 2023-07-09T21:38:02.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 -- 172.21.15.37:0/1675523056 learned_addr learned my addr 172.21.15.37:0/1675523056 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:02.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8d3fff640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc159990 0x7ff8dc06b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8da59c640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 0x7ff8dc151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 -- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc159990 msgr2=0x7ff8dc06b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc159990 0x7ff8dc06b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 -- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 msgr2=0x7ff8dc151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 0x7ff8dc151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 -- 172.21.15.37:0/1675523056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40094d0 con 0x7ff8dc15dd10 2023-07-09T21:38:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8da59c640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 0x7ff8dc151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:02.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8dad9d640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4007ea0 tx=0x7ff8d4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4003ba0 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d400f040 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400de70 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc152240 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc152e70 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc0b15e0 con 0x7ff8dc15dd10 2023-07-09T21:38:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.031+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) v1 ==== 85789+0+0 (secure 0 0 0) 0x7ff8d4004030 con 0x7ff8dc15dd10 2023-07-09T21:38:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.035+0000 7ff8d2ffd640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 0x7ff8bc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.035+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff8d40843d0 con 0x7ff8dc15dd10 2023-07-09T21:38:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.035+0000 7ff8da59c640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 0x7ff8bc0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.035+0000 7ff8da59c640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 0x7ff8bc0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc159330 tx=0x7ff8cc008040 comp rx=0 tx=0).ready entity=mgr.5693 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.039+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff8d4051550 con 0x7ff8dc15dd10 2023-07-09T21:38:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.215+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 --> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff8dc15d7f0 con 0x7ff8bc0663f0 2023-07-09T21:38:02.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.283+0000 7ff8d2ffd640 1 -- 172.21.15.37:0/1675523056 <== mgr.5693 v2:172.21.15.119:6832/2506503407 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7ff8cc007680 con 0x7ff8bc0663f0 2023-07-09T21:38:02.287 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path snap_test_dir1 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 msgr2=0x7ff8bc0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 0x7ff8bc0688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc159330 tx=0x7ff8cc008040 comp rx=0 tx=0).stop 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 msgr2=0x7ff8dc157b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4007ea0 tx=0x7ff8d4007f90 comp rx=0 tx=0).stop 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 shutdown_connections 2023-07-09T21:38:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff8bc0663f0 0x7ff8bc0688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8dc15dd10 0x7ff8dc157b80 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8dc159990 0x7ff8dc06b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 --2- 172.21.15.37:0/1675523056 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff8dc1595c0 0x7ff8dc151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 >> 172.21.15.37:0/1675523056 conn(0x7ff8dc0cde40 msgr2=0x7ff8dc0cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 shutdown_connections 2023-07-09T21:38:02.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.287+0000 7ff8e0d82640 1 -- 172.21.15.37:0/1675523056 wait complete. 2023-07-09T21:38:02.308 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-09T21:38:02.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:02.309 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:38:02.322 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:38:02.323 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_38_00_UTC 2023-07-09T21:38:02.324 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-09-21_37_00_UTC 2023-07-09T21:38:02.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:02.324 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-09-21_37_00_UTC) 2023-07-09T21:38:02.383 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-09-21_38_00_UTC 2023-07-09T21:38:02.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:02.384 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-09-21_38_00_UTC) 2023-07-09T21:38:02.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:02.442 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T21:38:02.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:38:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.679+0000 7f11f88ec640 1 Processor -- start 2023-07-09T21:38:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.679+0000 7f11f88ec640 1 -- start start 2023-07-09T21:38:02.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f88ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11f40cf290 0x7f11f4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f88ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f88ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f415bf80 con 0x7f11f40b7980 2023-07-09T21:38:02.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f88ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f40cd070 con 0x7f11f40cf290 2023-07-09T21:38:02.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f88ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40cfd70 con 0x7f11f40d0780 2023-07-09T21:38:02.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11f40cf290 0x7f11f4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11f40cf290 0x7f11f4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40052/0 (socket says 172.21.15.37:40052) 2023-07-09T21:38:02.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 -- 172.21.15.37:0/2078279401 learned_addr learned my addr 172.21.15.37:0/2078279401 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:02.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f2d9d640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 -- 172.21.15.37:0/2078279401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 msgr2=0x7f11f40d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:02.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f40d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 -- 172.21.15.37:0/2078279401 >> v1:172.21.15.119:6789/0 conn(0x7f11f40b7980 legacy=0x7f11f40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:02.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.683+0000 7f11f1d9b640 1 -- 172.21.15.37:0/2078279401 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f4160570 con 0x7f11f40cf290 2023-07-09T21:38:02.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f1d9b640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40cf290 0x7f11f4160030 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009870 tx=0x7f11e801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=795cbba108d36445 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f159a640 1 -- 172.21.15.37:0/2078279401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80ab600 con 0x7f11f40cf290 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f159a640 1 -- 172.21.15.37:0/2078279401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80a7050 con 0x7f11f40cf290 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f159a640 1 -- 172.21.15.37:0/2078279401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e80ab980 con 0x7f11f40cf290 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- 172.21.15.37:0/2078279401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40cf290 msgr2=0x7f11f4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40cf290 0x7f11f4160030 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009870 tx=0x7f11e801c540 comp rx=0 tx=0).stop 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- 172.21.15.37:0/2078279401 shutdown_connections 2023-07-09T21:38:02.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f40d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2078279401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40cf290 0x7f11f4160030 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- 172.21.15.37:0/2078279401 >> 172.21.15.37:0/2078279401 conn(0x7f11f4073090 msgr2=0x7f11f4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- 172.21.15.37:0/2078279401 shutdown_connections 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- 172.21.15.37:0/2078279401 wait complete. 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 Processor -- start 2023-07-09T21:38:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.687+0000 7f11f88ec640 1 -- start start 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11f40cf290 0x7f11f41532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f4151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f415ba40 con 0x7f11f40b7980 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b2660 con 0x7f11f40cf290 2023-07-09T21:38:02.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f40b1d30 con 0x7f11f40d0780 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40056/0 (socket says 172.21.15.37:40056) 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 -- 172.21.15.37:0/2441881530 learned_addr learned my addr 172.21.15.37:0/2441881530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f2d9d640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f4151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f1d9b640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11f40cf290 0x7f11f41532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 -- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 msgr2=0x7f11f4151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f4151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 -- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11f40cf290 msgr2=0x7f11f41532f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11f40cf290 0x7f11f41532f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 -- 172.21.15.37:0/2441881530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80094d0 con 0x7f11f40b7980 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f259c640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f11e400c500 tx=0x7f11e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4005220 con 0x7f11f40b7980 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e4005380 con 0x7f11f40b7980 2023-07-09T21:38:02.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f40b2010 con 0x7f11f40b7980 2023-07-09T21:38:02.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e4007270 con 0x7f11f40b7980 2023-07-09T21:38:02.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f415b5b0 con 0x7f11f40b7980 2023-07-09T21:38:02.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.691+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f40b27d0 con 0x7f11f40b7980 2023-07-09T21:38:02.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.695+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 22) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f11e40073d0 con 0x7f11f40b7980 2023-07-09T21:38:02.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.695+0000 7f11e2ffd640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 0x7f11d40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:02.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.695+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f11e4083740 con 0x7f11f40b7980 2023-07-09T21:38:02.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.695+0000 7f11f1d9b640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 0x7f11d40688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:02.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.695+0000 7f11f1d9b640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 0x7f11d40688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11f4069aa0 tx=0x7f11e8008040 comp rx=0 tx=0).ready entity=mgr.5693 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:02.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.699+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11e4050960 con 0x7f11f40b7980 2023-07-09T21:38:02.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:02.891+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f11f415bf80 con 0x7f11f40b7980 2023-07-09T21:38:03.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.143+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f11e4050d30 con 0x7f11f40b7980 2023-07-09T21:38:03.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.143+0000 7f11e2ffd640 1 -- 172.21.15.37:0/2441881530 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v23) v1 ==== 93+0+0 (secure 0 0 0) 0x7f11e407e6b0 con 0x7f11f40b7980 2023-07-09T21:38:03.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 msgr2=0x7f11d40688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 0x7f11d40688a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f11f4069aa0 tx=0x7f11e8008040 comp rx=0 tx=0).stop 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 msgr2=0x7f11f4152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f11e400c500 tx=0x7f11e400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 shutdown_connections 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f11d40663f0 0x7f11d40688a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11f40d0780 0x7f11f4151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11f40cf290 0x7f11f41532f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 --2- 172.21.15.37:0/2441881530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11f40b7980 0x7f11f4152db0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 >> 172.21.15.37:0/2441881530 conn(0x7f11f4073090 msgr2=0x7f11f40d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 shutdown_connections 2023-07-09T21:38:03.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.147+0000 7f11f88ec640 1 -- 172.21.15.37:0/2441881530 wait complete. 2023-07-09T21:38:03.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:38:03.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:03.247 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:03.317 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:03.315+0000 7f6960387180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:03.318 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:38:03.319 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:03.319 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:03.323 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:03.327+0000 7f038b341180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:03.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 Processor -- start 2023-07-09T21:38:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 -- start start 2023-07-09T21:38:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff27c0b7ab0 0x7ff27c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0b49f0 con 0x7ff27c0b4340 2023-07-09T21:38:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff27c0cc8a0 con 0x7ff27c0cef80 2023-07-09T21:38:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff28299f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff27c0b7e80 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff280f3c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff27c0b4340 0x7ff27c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50254/0 (socket says 172.21.15.37:50254) 2023-07-09T21:38:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff280f3c640 1 -- 172.21.15.37:0/3787222438 learned_addr learned my addr 172.21.15.37:0/3787222438 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff27bfff640 1 --2- 172.21.15.37:0/3787222438 >> v2:172.21.15.119:3300/0 conn(0x7ff27c0b7ab0 0x7ff27c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff27b7fe640 1 -- 172.21.15.37:0/3787222438 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716767480 0 0) 0x7ff27c0b49f0 con 0x7ff27c0b4340 2023-07-09T21:38:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff27bfff640 1 -- 172.21.15.37:0/3787222438 >> v1:172.21.15.119:6789/0 conn(0x7ff27c0cef80 legacy=0x7ff27c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff27bfff640 1 -- 172.21.15.37:0/3787222438 >> v1:172.21.15.37:6789/0 conn(0x7ff27c0b4340 legacy=0x7ff27c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.515+0000 7ff27bfff640 1 -- 172.21.15.37:0/3787222438 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0ccb80 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff27bfff640 1 --2- 172.21.15.37:0/3787222438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c06aa50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0097c0 tx=0x7ff26c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=873a271d58d57ba2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff27b7fe640 1 -- 172.21.15.37:0/3787222438 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0ab670 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff27b7fe640 1 -- 172.21.15.37:0/3787222438 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0ab7d0 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff27b7fe640 1 -- 172.21.15.37:0/3787222438 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0abb60 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 -- 172.21.15.37:0/3787222438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 msgr2=0x7ff27c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 --2- 172.21.15.37:0/3787222438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c06aa50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0097c0 tx=0x7ff26c01c470 comp rx=0 tx=0).stop 2023-07-09T21:38:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 -- 172.21.15.37:0/3787222438 shutdown_connections 2023-07-09T21:38:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 --2- 172.21.15.37:0/3787222438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c06aa50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 -- 172.21.15.37:0/3787222438 >> 172.21.15.37:0/3787222438 conn(0x7ff27c073090 msgr2=0x7ff27c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 -- 172.21.15.37:0/3787222438 shutdown_connections 2023-07-09T21:38:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.519+0000 7ff28299f640 1 -- 172.21.15.37:0/3787222438 wait complete. 2023-07-09T21:38:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 Processor -- start 2023-07-09T21:38:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- start start 2023-07-09T21:38:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c0b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0cef80 0x7ff27c0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c7960 con 0x7ff27c0b4340 2023-07-09T21:38:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c6ce0 con 0x7ff27c0b7ab0 2023-07-09T21:38:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c0c6fc0 con 0x7ff27c0cef80 2023-07-09T21:38:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40082/0 (socket says 172.21.15.37:40082) 2023-07-09T21:38:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 -- 172.21.15.37:0/3101839721 learned_addr learned my addr 172.21.15.37:0/3101839721 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff273fff640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c0b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff280f3c640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0cef80 0x7ff27c0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 -- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0cef80 msgr2=0x7ff27c0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0cef80 0x7ff27c0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 -- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 msgr2=0x7ff27c0b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c0b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 -- 172.21.15.37:0/3101839721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c009420 con 0x7ff27c0b4340 2023-07-09T21:38:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff27bfff640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ad040 tx=0x7ff26c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b5810 con 0x7ff27c0b4340 2023-07-09T21:38:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff26c0b59b0 con 0x7ff27c0b4340 2023-07-09T21:38:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b5d60 con 0x7ff27c0b4340 2023-07-09T21:38:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c0c72a0 con 0x7ff27c0b4340 2023-07-09T21:38:03.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.523+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c0b3e60 con 0x7ff27c0b4340 2023-07-09T21:38:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff27c0c7aa0 con 0x7ff27c0b4340 2023-07-09T21:38:03.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ff26c0b4390 con 0x7ff27c0b4340 2023-07-09T21:38:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff2797fa640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ff26c11ed20 con 0x7ff27c0b4340 2023-07-09T21:38:03.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff273fff640 1 -- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 msgr2=0x7ff25c068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:03.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.527+0000 7ff273fff640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:03.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.531+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff26c0ebf30 con 0x7ff27c0b4340 2023-07-09T21:38:03.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.687+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff27c04d7d0 con 0x7ff27c0b4340 2023-07-09T21:38:03.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff2797fa640 1 -- 172.21.15.37:0/3101839721 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+18940 (secure 0 0 0) 0x7ff26c0ef550 con 0x7ff27c0b4340 2023-07-09T21:38:03.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:03.693 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":71,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:37:21.085488+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2232161020":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3086453693":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6833/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/48663712":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3666390931":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/609733224":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2471493969":"2023-07-10T21:36:19.799042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:03.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 msgr2=0x7ff25c068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 msgr2=0x7ff27c14cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0ad040 tx=0x7ff26c01acb0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 shutdown_connections 2023-07-09T21:38:03.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ff25c0663a0 0x7ff25c068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff27c0cef80 0x7ff27c0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff27c0b7ab0 0x7ff27c0b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 --2- 172.21.15.37:0/3101839721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff27c0b4340 0x7ff27c14cfa0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 >> 172.21.15.37:0/3101839721 conn(0x7ff27c073090 msgr2=0x7ff27c0b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 shutdown_connections 2023-07-09T21:38:03.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.691+0000 7ff28299f640 1 -- 172.21.15.37:0/3101839721 wait complete. 2023-07-09T21:38:03.715 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:35:59.718392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:36:00.596893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:03.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:03.740 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:03.743+0000 7f038b341180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:03.765 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:03.763+0000 7f6960387180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 Processor -- start 2023-07-09T21:38:03.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 -- start start 2023-07-09T21:38:03.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a4c0cf290 0x7f5a4c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c15bf80 con 0x7f5a4c0b7980 2023-07-09T21:38:03.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c160570 con 0x7f5a4c0d0780 2023-07-09T21:38:03.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a52a34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c0cd070 con 0x7f5a4c0cf290 2023-07-09T21:38:03.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.867+0000 7f5a4b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a4c0cf290 0x7f5a4c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5a4c0b7980 0x7f5a4c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50258/0 (socket says 172.21.15.37:50258) 2023-07-09T21:38:03.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4bfff640 1 -- 172.21.15.37:0/1124028895 learned_addr learned my addr 172.21.15.37:0/1124028895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:03.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4b7fe640 1 -- 172.21.15.37:0/1124028895 >> v1:172.21.15.119:6789/0 conn(0x7f5a4c0d0780 legacy=0x7f5a4c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4b7fe640 1 -- 172.21.15.37:0/1124028895 >> v1:172.21.15.37:6789/0 conn(0x7f5a4c0b7980 legacy=0x7f5a4c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4b7fe640 1 -- 172.21.15.37:0/1124028895 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0d02f0 con 0x7f5a4c0cf290 2023-07-09T21:38:03.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4affd640 1 -- 172.21.15.37:0/1124028895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942281824 0 0) 0x7f5a3c001120 con 0x7f5a4c0b7980 2023-07-09T21:38:03.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4b7fe640 1 --2- 172.21.15.37:0/1124028895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c160030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5a400097c0 tx=0x7f5a4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8f142ad6b14b3c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:03.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4affd640 1 -- 172.21.15.37:0/1124028895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ab600 con 0x7f5a4c0cf290 2023-07-09T21:38:03.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4affd640 1 -- 172.21.15.37:0/1124028895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400a7050 con 0x7f5a4c0cf290 2023-07-09T21:38:03.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.871+0000 7f5a4affd640 1 -- 172.21.15.37:0/1124028895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ab980 con 0x7f5a4c0cf290 2023-07-09T21:38:03.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- 172.21.15.37:0/1124028895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0cf290 msgr2=0x7f5a4c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 --2- 172.21.15.37:0/1124028895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c160030 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5a400097c0 tx=0x7f5a4001c480 comp rx=0 tx=0).stop 2023-07-09T21:38:03.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- 172.21.15.37:0/1124028895 shutdown_connections 2023-07-09T21:38:03.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 --2- 172.21.15.37:0/1124028895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c160030 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- 172.21.15.37:0/1124028895 >> 172.21.15.37:0/1124028895 conn(0x7f5a4c073090 msgr2=0x7f5a4c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:03.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- 172.21.15.37:0/1124028895 shutdown_connections 2023-07-09T21:38:03.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- 172.21.15.37:0/1124028895 wait complete. 2023-07-09T21:38:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 Processor -- start 2023-07-09T21:38:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- start start 2023-07-09T21:38:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c0c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a4c0d0780 0x7f5a4c155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c156f50 con 0x7f5a4c0b7980 2023-07-09T21:38:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c157230 con 0x7f5a4c0cf290 2023-07-09T21:38:03.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a52a34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c1553c0 con 0x7f5a4c0d0780 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40100/0 (socket says 172.21.15.37:40100) 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a4bfff640 1 -- 172.21.15.37:0/2305892607 learned_addr learned my addr 172.21.15.37:0/2305892607 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a4b7fe640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c0c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.875+0000 7f5a50fd1640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a4c0d0780 0x7f5a4c155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 -- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a4c0d0780 msgr2=0x7f5a4c155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a4c0d0780 0x7f5a4c155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 -- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4c0cf290 msgr2=0x7f5a4c0c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c0c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 -- 172.21.15.37:0/2305892607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009420 con 0x7f5a4c0b7980 2023-07-09T21:38:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a4bfff640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c780 tx=0x7f5a3c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c0072d0 con 0x7f5a4c0b7980 2023-07-09T21:38:03.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c007430 con 0x7f5a4c0b7980 2023-07-09T21:38:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c001d20 con 0x7f5a4c0b7980 2023-07-09T21:38:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c1556a0 con 0x7f5a4c0b7980 2023-07-09T21:38:03.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c0b2490 con 0x7f5a4c0b7980 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c157450 con 0x7f5a4c0b7980 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.879+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f5a3c0047f0 con 0x7f5a4c0b7980 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.883+0000 7f5a48ff9640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 0x7f5a38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.883+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5a3c0831f0 con 0x7f5a4c0b7980 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.883+0000 7f5a4b7fe640 1 -- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 msgr2=0x7f5a38068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:03.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.883+0000 7f5a4b7fe640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 0x7f5a38068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:03.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:03.887+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a3c050400 con 0x7f5a4c0b7980 2023-07-09T21:38:03.892 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:03.891+0000 7f038b341180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:03.927 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:03.927+0000 7f6960387180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:04.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a4c15d0e0 con 0x7f5a4c0b7980 2023-07-09T21:38:04.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a48ff9640 1 -- 172.21.15.37:0/2305892607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a3c053a20 con 0x7f5a4c0b7980 2023-07-09T21:38:04.044 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:04.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 msgr2=0x7f5a38068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:04.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 0x7f5a38068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 msgr2=0x7f5a4c0b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00c780 tx=0x7f5a3c00cc40 comp rx=0 tx=0).stop 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 shutdown_connections 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5a380663a0 0x7f5a38068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a4c0d0780 0x7f5a4c155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a4c0cf290 0x7f5a4c0c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 --2- 172.21.15.37:0/2305892607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a4c0b7980 0x7f5a4c0b1f50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 >> 172.21.15.37:0/2305892607 conn(0x7f5a4c073090 msgr2=0x7f5a4c0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 shutdown_connections 2023-07-09T21:38:04.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.043+0000 7f5a52a34640 1 -- 172.21.15.37:0/2305892607 wait complete. 2023-07-09T21:38:04.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 Processor -- start 2023-07-09T21:38:04.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 -- start start 2023-07-09T21:38:04.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4cc15bf80 con 0x7fc4cc0b7980 2023-07-09T21:38:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4cc0cd070 con 0x7fc4cc0cf290 2023-07-09T21:38:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4d106d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0cfd70 con 0x7fc4cc0d0780 2023-07-09T21:38:04.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4ca59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4cb59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4ca59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50372/0 (socket says 172.21.15.37:50372) 2023-07-09T21:38:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4ca59c640 1 -- 172.21.15.37:0/2825724607 learned_addr learned my addr 172.21.15.37:0/2825724607 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:04.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4cb59e640 1 -- 172.21.15.37:0/2825724607 >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 msgr2=0x7fc4cc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4cb59e640 1 --2- 172.21.15.37:0/2825724607 >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4cb59e640 1 -- 172.21.15.37:0/2825724607 >> v1:172.21.15.119:6789/0 conn(0x7fc4cc0b7980 legacy=0x7fc4cc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4cb59e640 1 -- 172.21.15.37:0/2825724607 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc160570 con 0x7fc4cc0d0780 2023-07-09T21:38:04.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.251+0000 7fc4ca59c640 1 --2- 172.21.15.37:0/2825724607 >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:04.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4cb59e640 1 --2- 172.21.15.37:0/2825724607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc0d0bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3f535537f2ef103 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4c9d9b640 1 -- 172.21.15.37:0/2825724607 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40a5810 con 0x7fc4cc0d0780 2023-07-09T21:38:04.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4c9d9b640 1 -- 172.21.15.37:0/2825724607 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c40a5970 con 0x7fc4cc0d0780 2023-07-09T21:38:04.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4c9d9b640 1 -- 172.21.15.37:0/2825724607 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40a5d00 con 0x7fc4cc0d0780 2023-07-09T21:38:04.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 -- 172.21.15.37:0/2825724607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 msgr2=0x7fc4cc0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 --2- 172.21.15.37:0/2825724607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc0d0bc0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c401c950 comp rx=0 tx=0).stop 2023-07-09T21:38:04.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 -- 172.21.15.37:0/2825724607 shutdown_connections 2023-07-09T21:38:04.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 --2- 172.21.15.37:0/2825724607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc0d0bc0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 --2- 172.21.15.37:0/2825724607 >> v2:172.21.15.119:3300/0 conn(0x7fc4cc0cf290 0x7fc4cc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 -- 172.21.15.37:0/2825724607 >> 172.21.15.37:0/2825724607 conn(0x7fc4cc073090 msgr2=0x7fc4cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 -- 172.21.15.37:0/2825724607 shutdown_connections 2023-07-09T21:38:04.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.255+0000 7fc4d106d640 1 -- 172.21.15.37:0/2825724607 wait complete. 2023-07-09T21:38:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 Processor -- start 2023-07-09T21:38:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 -- start start 2023-07-09T21:38:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0b7980 0x7fc4cc150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4cc0cf290 0x7fc4cc0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc0b4280 con 0x7fc4cc0b7980 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc15b1c0 con 0x7fc4cc0cf290 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4d106d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4cc15b950 con 0x7fc4cc0d0780 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0b7980 0x7fc4cc150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33314/0 (socket says 172.21.15.37:33314) 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 -- 172.21.15.37:0/1803569894 learned_addr learned my addr 172.21.15.37:0/1803569894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:04.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4ca59c640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4cc0cf290 0x7fc4cc0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 -- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4cc0cf290 msgr2=0x7fc4cc0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4cc0cf290 0x7fc4cc0b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 -- 172.21.15.37:0/1803569894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0b7980 msgr2=0x7fc4cc150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0b7980 0x7fc4cc150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 -- 172.21.15.37:0/1803569894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c00094d0 con 0x7fc4cc0d0780 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4cb59e640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c40196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.259+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40b9860 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c40b99c0 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c4009a70 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c40b9d70 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4cc0b4790 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4cc04d7d0 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc4c40c4460 con 0x7fc4cc0d0780 2023-07-09T21:38:04.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4b37fe640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 0x7fc4b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fc4c411f210 con 0x7fc4cc0d0780 2023-07-09T21:38:04.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4cad9d640 1 -- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 msgr2=0x7fc4b8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:04.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.263+0000 7fc4cad9d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 0x7fc4b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:04.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.267+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc4c40ec420 con 0x7fc4cc0d0780 2023-07-09T21:38:04.373 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.379+0000 7f038b341180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:04.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4cc160570 con 0x7fc4cc0d0780 2023-07-09T21:38:04.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4b37fe640 1 -- 172.21.15.37:0/1803569894 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4cc160570 con 0x7fc4cc0d0780 2023-07-09T21:38:04.429 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 msgr2=0x7fc4b8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:04.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 0x7fc4b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 msgr2=0x7fc4cc1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4009d90 tx=0x7fc4c40196f0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 shutdown_connections 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fc4b80663a0 0x7fc4b8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4cc0d0780 0x7fc4cc1510d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4cc0cf290 0x7fc4cc0b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 --2- 172.21.15.37:0/1803569894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4cc0b7980 0x7fc4cc150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 >> 172.21.15.37:0/1803569894 conn(0x7fc4cc073090 msgr2=0x7fc4cc15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 shutdown_connections 2023-07-09T21:38:04.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.427+0000 7fc4d106d640 1 -- 172.21.15.37:0/1803569894 wait complete. 2023-07-09T21:38:04.434 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.435+0000 7f038b341180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:04.444 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.443+0000 7f6960387180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:04.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:38:04.487 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.491+0000 7f038b341180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:04.507 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.507+0000 7f6960387180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:04.567 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.563+0000 7f6960387180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:04.572 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.579+0000 7f038b341180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:04.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.595+0000 7f05e8256640 1 Processor -- start 2023-07-09T21:38:04.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 -- start start 2023-07-09T21:38:04.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05e00cf290 0x7f05e0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05e00d0780 0x7f05e00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e015bf80 con 0x7f05e00b7980 2023-07-09T21:38:04.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00cd070 con 0x7f05e00d0780 2023-07-09T21:38:04.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e8256640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e00cfd70 con 0x7f05e00cf290 2023-07-09T21:38:04.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e5ff2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f05e00b7980 0x7f05e00ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50270/0 (socket says 172.21.15.37:50270) 2023-07-09T21:38:04.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e5ff2640 1 -- 172.21.15.37:0/1521443929 learned_addr learned my addr 172.21.15.37:0/1521443929 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:04.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e67f3640 1 --2- 172.21.15.37:0/1521443929 >> v2:172.21.15.37:3300/0 conn(0x7f05e00d0780 0x7f05e00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e57f1640 1 --2- 172.21.15.37:0/1521443929 >> v2:172.21.15.119:3300/0 conn(0x7f05e00cf290 0x7f05e0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e67f3640 1 -- 172.21.15.37:0/1521443929 >> v2:172.21.15.119:3300/0 conn(0x7f05e00cf290 msgr2=0x7f05e0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e67f3640 1 --2- 172.21.15.37:0/1521443929 >> v2:172.21.15.119:3300/0 conn(0x7f05e00cf290 0x7f05e0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e67f3640 1 -- 172.21.15.37:0/1521443929 >> v1:172.21.15.37:6789/0 conn(0x7f05e00b7980 legacy=0x7f05e00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.599+0000 7f05e67f3640 1 -- 172.21.15.37:0/1521443929 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0160570 con 0x7f05e00d0780 2023-07-09T21:38:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.603+0000 7f05e67f3640 1 --2- 172.21.15.37:0/1521443929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00d0780 0x7f05e00d0b80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f05e00b4cd0 tx=0x7f05d801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f57bb5ef444918 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.603+0000 7f05e4ff0640 1 -- 172.21.15.37:0/1521443929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a57d0 con 0x7f05e00d0780 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e4ff0640 1 -- 172.21.15.37:0/1521443929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d80a5930 con 0x7f05e00d0780 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e4ff0640 1 -- 172.21.15.37:0/1521443929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80a5cc0 con 0x7f05e00d0780 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- 172.21.15.37:0/1521443929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00d0780 msgr2=0x7f05e00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- 172.21.15.37:0/1521443929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00d0780 0x7f05e00d0b80 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f05e00b4cd0 tx=0x7f05d801c910 comp rx=0 tx=0).stop 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- 172.21.15.37:0/1521443929 shutdown_connections 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- 172.21.15.37:0/1521443929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00d0780 0x7f05e00d0b80 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- 172.21.15.37:0/1521443929 >> v2:172.21.15.119:3300/0 conn(0x7f05e00cf290 0x7f05e0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- 172.21.15.37:0/1521443929 >> 172.21.15.37:0/1521443929 conn(0x7f05e0073090 msgr2=0x7f05e0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- 172.21.15.37:0/1521443929 shutdown_connections 2023-07-09T21:38:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- 172.21.15.37:0/1521443929 wait complete. 2023-07-09T21:38:04.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 Processor -- start 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 -- start start 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e00b7980 0x7f05e00c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.607+0000 7f05e8256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e00d0780 0x7f05e015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e015ae00 con 0x7f05e00cf290 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e015a1f0 con 0x7f05e00d0780 2023-07-09T21:38:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e015a4d0 con 0x7f05e00b7980 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40138/0 (socket says 172.21.15.37:40138) 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 -- 172.21.15.37:0/1803118390 learned_addr learned my addr 172.21.15.37:0/1803118390 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e5ff2640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e00b7980 0x7f05e00c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e67f3640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e00d0780 0x7f05e015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 -- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e00b7980 msgr2=0x7f05e00c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e00b7980 0x7f05e00c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 -- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e00d0780 msgr2=0x7f05e015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e00d0780 0x7f05e015b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 -- 172.21.15.37:0/1803118390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d8009a70 con 0x7f05e00cf290 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e57f1640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f05d000d7d0 tx=0x7f05d000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000b6c0 con 0x7f05e00cf290 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d000b820 con 0x7f05e00cf290 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e015a7b0 con 0x7f05e00cf290 2023-07-09T21:38:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d000bbd0 con 0x7f05e00cf290 2023-07-09T21:38:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e0159e80 con 0x7f05e00cf290 2023-07-09T21:38:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e004d7d0 con 0x7f05e00cf290 2023-07-09T21:38:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.611+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f05d000bd30 con 0x7f05e00cf290 2023-07-09T21:38:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.615+0000 7f05d67fc640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 0x7f05c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.615+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f05d0084510 con 0x7f05e00cf290 2023-07-09T21:38:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.615+0000 7f05e5ff2640 1 -- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 msgr2=0x7f05c4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.615+0000 7f05e5ff2640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 0x7f05c4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:04.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.619+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05d00551b0 con 0x7f05e00cf290 2023-07-09T21:38:04.630 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.635+0000 7f038b341180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:04.662 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.659+0000 7f6960387180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:04.714 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.719+0000 7f038b341180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:04.723 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.723+0000 7f6960387180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:04.770 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.775+0000 7f038b341180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:04.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.771+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05e006a800 con 0x7f05e00cf290 2023-07-09T21:38:04.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05d67fc640 1 -- 172.21.15.37:0/1803118390 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v71) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05d0054d40 con 0x7f05e00cf290 2023-07-09T21:38:04.776 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:38:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 msgr2=0x7f05c4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 0x7f05c4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 msgr2=0x7f05e0151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f05d000d7d0 tx=0x7f05d000dc90 comp rx=0 tx=0).stop 2023-07-09T21:38:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 shutdown_connections 2023-07-09T21:38:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f05c40663a0 0x7f05c4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e00d0780 0x7f05e015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e00cf290 0x7f05e0151e90 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 --2- 172.21.15.37:0/1803118390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e00b7980 0x7f05e00c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 >> 172.21.15.37:0/1803118390 conn(0x7f05e0073090 msgr2=0x7f05e00d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 shutdown_connections 2023-07-09T21:38:04.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.775+0000 7f05e8256640 1 -- 172.21.15.37:0/1803118390 wait complete. 2023-07-09T21:38:04.798 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:38:04.813 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.811+0000 7f6960387180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:04.874 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:04.871+0000 7f6960387180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:04.912 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.915+0000 7f038b341180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.943+0000 7f5d40182640 1 Processor -- start 2023-07-09T21:38:04.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.943+0000 7f5d40182640 1 -- start start 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d40182640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 0x7f5d38160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d40182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d40182640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3815bf80 con 0x7f5d380ceb80 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d40182640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380cd070 con 0x7f5d380b7980 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d40182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380cfd70 con 0x7f5d380d0780 2023-07-09T21:38:04.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3df1e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 0x7f5d38160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33322/0 (socket says 172.21.15.37:33322) 2023-07-09T21:38:04.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 -- 172.21.15.37:0/1755767757 learned_addr learned my addr 172.21.15.37:0/1755767757 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:04.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 -- 172.21.15.37:0/1755767757 >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 msgr2=0x7f5d38160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:04.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 --2- 172.21.15.37:0/1755767757 >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 0x7f5d38160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 -- 172.21.15.37:0/1755767757 >> v1:172.21.15.119:6789/0 conn(0x7f5d380ceb80 legacy=0x7f5d380cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3e71f640 1 -- 172.21.15.37:0/1755767757 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38160570 con 0x7f5d380d0780 2023-07-09T21:38:04.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.947+0000 7f5d3df1e640 1 --2- 172.21.15.37:0/1755767757 >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 0x7f5d38160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:04.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d3e71f640 1 --2- 172.21.15.37:0/1755767757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009e50 tx=0x7f5d3001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e26686e868af716d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d3cf1c640 1 -- 172.21.15.37:0/1755767757 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300a56e0 con 0x7f5d380d0780 2023-07-09T21:38:04.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d3cf1c640 1 -- 172.21.15.37:0/1755767757 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300a5840 con 0x7f5d380d0780 2023-07-09T21:38:04.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d3cf1c640 1 -- 172.21.15.37:0/1755767757 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d300a5bd0 con 0x7f5d380d0780 2023-07-09T21:38:04.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- 172.21.15.37:0/1755767757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 msgr2=0x7f5d380d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- 172.21.15.37:0/1755767757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009e50 tx=0x7f5d3001ca10 comp rx=0 tx=0).stop 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- 172.21.15.37:0/1755767757 shutdown_connections 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- 172.21.15.37:0/1755767757 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380d0780 0x7f5d380d0bc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- 172.21.15.37:0/1755767757 >> v2:172.21.15.119:3300/0 conn(0x7f5d380b7980 0x7f5d38160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- 172.21.15.37:0/1755767757 >> 172.21.15.37:0/1755767757 conn(0x7f5d38073090 msgr2=0x7f5d38069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- 172.21.15.37:0/1755767757 shutdown_connections 2023-07-09T21:38:04.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- 172.21.15.37:0/1755767757 wait complete. 2023-07-09T21:38:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 Processor -- start 2023-07-09T21:38:04.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- start start 2023-07-09T21:38:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d380b7980 0x7f5d3815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 0x7f5d380c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3815b4b0 con 0x7f5d380d0780 2023-07-09T21:38:04.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d38152be0 con 0x7f5d380b7980 2023-07-09T21:38:04.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.951+0000 7f5d40182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3815a830 con 0x7f5d380ceb80 2023-07-09T21:38:04.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3df1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d380b7980 0x7f5d3815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3e71f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 0x7f5d380c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33328/0 (socket says 172.21.15.37:33328) 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 -- 172.21.15.37:0/2515954447 learned_addr learned my addr 172.21.15.37:0/2515954447 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 -- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d380b7980 msgr2=0x7f5d3815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d380b7980 0x7f5d3815b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 -- 172.21.15.37:0/2515954447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 msgr2=0x7f5d380c9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 0x7f5d380c9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 -- 172.21.15.37:0/2515954447 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34009420 con 0x7f5d380ceb80 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3e71f640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 0x7f5d380c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d3d71d640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c500 tx=0x7f5d2800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28005220 con 0x7f5d380ceb80 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28005380 con 0x7f5d380ceb80 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28007270 con 0x7f5d380ceb80 2023-07-09T21:38:04.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30009b30 con 0x7f5d380ceb80 2023-07-09T21:38:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3815adf0 con 0x7f5d380ceb80 2023-07-09T21:38:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.955+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3815b5f0 con 0x7f5d380ceb80 2023-07-09T21:38:04.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.959+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f5d280073d0 con 0x7f5d380ceb80 2023-07-09T21:38:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.959+0000 7f5d2e7fc640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 0x7f5d1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.959+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f5d28083620 con 0x7f5d380ceb80 2023-07-09T21:38:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.959+0000 7f5d3df1e640 1 -- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 msgr2=0x7f5d1c068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:04.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.959+0000 7f5d3df1e640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 0x7f5d1c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:04.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:04.963+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d3815b5f0 con 0x7f5d380ceb80 2023-07-09T21:38:04.970 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:04.975+0000 7f038b341180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:05.028 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.027+0000 7f6960387180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:05.090 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.087+0000 7f6960387180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:05.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d3815b5f0 con 0x7f5d380ceb80 2023-07-09T21:38:05.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d2e7fc640 1 -- 172.21.15.37:0/2515954447 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v71) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d3815b5f0 con 0x7f5d380ceb80 2023-07-09T21:38:05.120 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:38:05.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 msgr2=0x7f5d1c068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:05.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 0x7f5d1c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 msgr2=0x7f5d381526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c500 tx=0x7f5d2800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 shutdown_connections 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f5d1c0663d0 0x7f5d1c068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d380d0780 0x7f5d380c9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d380ceb80 0x7f5d381526a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 --2- 172.21.15.37:0/2515954447 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d380b7980 0x7f5d3815b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 >> 172.21.15.37:0/2515954447 conn(0x7f5d38073090 msgr2=0x7f5d380cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 shutdown_connections 2023-07-09T21:38:05.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.119+0000 7f5d40182640 1 -- 172.21.15.37:0/2515954447 wait complete. 2023-07-09T21:38:05.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:38:05.212 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:05.213 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:05.213 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:05.221 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:05.227+0000 7f038b341180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:05.344 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:05.344 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:05.345 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:05.353 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.351+0000 7f6960387180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:05.355 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:05.359+0000 7f038b341180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:05.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.363+0000 7fb77edac640 1 Processor -- start 2023-07-09T21:38:05.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.363+0000 7fb77edac640 1 -- start start 2023-07-09T21:38:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7780b47a0 0x7fb7780b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7780b4140 0x7fb77815f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780b45b0 con 0x7fb7780b47a0 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7780cef80 con 0x7fb7780b4140 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77edac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780cf260 con 0x7fb7780b7a60 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7780b47a0 0x7fb7780b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7780b47a0 0x7fb7780b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40156/0 (socket says 172.21.15.37:40156) 2023-07-09T21:38:05.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 -- 172.21.15.37:0/3737400635 learned_addr learned my addr 172.21.15.37:0/3737400635 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77cb48640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb77d349640 1 --2- 172.21.15.37:0/3737400635 >> v2:172.21.15.119:3300/0 conn(0x7fb7780b4140 0x7fb77815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 -- 172.21.15.37:0/3737400635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 msgr2=0x7fb7780cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:05.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 -- 172.21.15.37:0/3737400635 >> v2:172.21.15.119:3300/0 conn(0x7fb7780b4140 msgr2=0x7fb77815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 --2- 172.21.15.37:0/3737400635 >> v2:172.21.15.119:3300/0 conn(0x7fb7780b4140 0x7fb77815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.367+0000 7fb777fff640 1 -- 172.21.15.37:0/3737400635 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780cf540 con 0x7fb7780b47a0 2023-07-09T21:38:05.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb777fff640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780b3c00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb778160650 tx=0x7fb76401c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce32dad3a0b6c59 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:05.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb7777fe640 1 -- 172.21.15.37:0/3737400635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640ab600 con 0x7fb7780b47a0 2023-07-09T21:38:05.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb7777fe640 1 -- 172.21.15.37:0/3737400635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7640a7050 con 0x7fb7780b47a0 2023-07-09T21:38:05.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb7777fe640 1 -- 172.21.15.37:0/3737400635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640ab980 con 0x7fb7780b47a0 2023-07-09T21:38:05.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- 172.21.15.37:0/3737400635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 msgr2=0x7fb7780b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:05.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780b3c00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb778160650 tx=0x7fb76401c240 comp rx=0 tx=0).stop 2023-07-09T21:38:05.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- 172.21.15.37:0/3737400635 shutdown_connections 2023-07-09T21:38:05.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780b3c00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 --2- 172.21.15.37:0/3737400635 >> v2:172.21.15.119:3300/0 conn(0x7fb7780b4140 0x7fb77815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 --2- 172.21.15.37:0/3737400635 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- 172.21.15.37:0/3737400635 >> 172.21.15.37:0/3737400635 conn(0x7fb778073050 msgr2=0x7fb778069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:05.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- 172.21.15.37:0/3737400635 shutdown_connections 2023-07-09T21:38:05.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- 172.21.15.37:0/3737400635 wait complete. 2023-07-09T21:38:05.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 Processor -- start 2023-07-09T21:38:05.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.371+0000 7fb77edac640 1 -- start start 2023-07-09T21:38:05.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7780b4140 0x7fb77815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815c5b0 con 0x7fb7780b47a0 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780cc420 con 0x7fb7780b4140 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780cbc20 con 0x7fb7780b7a60 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40162/0 (socket says 172.21.15.37:40162) 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 -- 172.21.15.37:0/1437607668 learned_addr learned my addr 172.21.15.37:0/1437607668 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:05.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77cb48640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7780b4140 0x7fb77815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77d349640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 -- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 msgr2=0x7fb7780caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 -- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7780b4140 msgr2=0x7fb77815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7780b4140 0x7fb77815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 -- 172.21.15.37:0/1437607668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094d0 con 0x7fb7780b47a0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb777fff640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb76401a8f0 tx=0x7fb764018fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640b4420 con 0x7fb7780b47a0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7640b4580 con 0x7fb7780b47a0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7780cc6c0 con 0x7fb7780b47a0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640b48f0 con 0x7fb7780b47a0 2023-07-09T21:38:05.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7780cbf00 con 0x7fb7780b47a0 2023-07-09T21:38:05.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7780cdaa0 con 0x7fb7780b47a0 2023-07-09T21:38:05.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.375+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fb7640b2070 con 0x7fb7780b47a0 2023-07-09T21:38:05.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.379+0000 7fb7757fa640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 0x7fb75c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:05.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.379+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7fb76411db60 con 0x7fb7780b47a0 2023-07-09T21:38:05.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.379+0000 7fb77cb48640 1 -- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 msgr2=0x7fb75c068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:05.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.379+0000 7fb77cb48640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 0x7fb75c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:05.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.387+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7640eacf0 con 0x7fb7780b47a0 2023-07-09T21:38:05.481 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:05.487+0000 7f038b341180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:05.501 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.499+0000 7f6960387180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:05.551 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:05.555+0000 7f038b341180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb77804d7d0 con 0x7fb7780b47a0 2023-07-09T21:38:05.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb7757fa640 1 -- 172.21.15.37:0/1437607668 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v71) v1 ==== 80+0+475 (secure 0 0 0) 0x7fb7640ee310 con 0x7fb7780b47a0 2023-07-09T21:38:05.558 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2232161020 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3086453693 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/1375084468 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/1375084468 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/48663712 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3666390931 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/609733224 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.559 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2471493969 2023-07-10T21:36:19.799042+0000 2023-07-09T21:38:05.560 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 msgr2=0x7fb75c068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 0x7fb75c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 msgr2=0x7fb7780ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fb76401a8f0 tx=0x7fb764018fe0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 shutdown_connections 2023-07-09T21:38:05.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7fb75c0663a0 0x7fb75c068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7780b7a60 0x7fb7780caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7780b47a0 0x7fb7780ca590 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 --2- 172.21.15.37:0/1437607668 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7780b4140 0x7fb77815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 >> 172.21.15.37:0/1437607668 conn(0x7fb778073050 msgr2=0x7fb7780b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 shutdown_connections 2023-07-09T21:38:05.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:05.555+0000 7fb77edac640 1 -- 172.21.15.37:0/1437607668 wait complete. 2023-07-09T21:38:05.578 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:38:05.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:05.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:05.599 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[51815]: fuse finished with error 0 and tester_r 0 2023-07-09T21:38:05.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:38:05.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:05.603 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:38:05.637 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.635+0000 7f6960387180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:05.684 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:05.691+0000 7f038b341180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:05.713 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.711+0000 7f6960387180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:05.764 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:05.765 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:05.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:05.777 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:38:05.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:05.778 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:38:05.828 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:38:05.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:05.830 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:05.831 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:05.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:05.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:38:05.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:05.842 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:38:05.856 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:05.855+0000 7f6960387180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:38:05.865 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:05.866 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:05.866 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:05.879 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:05.880 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:38:05.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:05.880 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:38:05.932 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:38:05.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:05.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:06.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.075+0000 7ffa7b6bd640 1 Processor -- start 2023-07-09T21:38:06.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.075+0000 7ffa7b6bd640 1 -- start start 2023-07-09T21:38:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa7b6bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffa740b4340 0x7ffa7406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa7b6bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa740b49f0 con 0x7ffa740cef80 2023-07-09T21:38:06.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa7b6bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa740cc8a0 con 0x7ffa740b7ab0 2023-07-09T21:38:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa7b6bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa740b7e80 con 0x7ffa740b4340 2023-07-09T21:38:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa79c5a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffa740cef80 0x7ffa740d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50282/0 (socket says 172.21.15.37:50282) 2023-07-09T21:38:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa79c5a640 1 -- 172.21.15.37:0/1364755570 learned_addr learned my addr 172.21.15.37:0/1364755570 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:06.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa78c58640 1 --2- 172.21.15.37:0/1364755570 >> v2:172.21.15.119:3300/0 conn(0x7ffa740b4340 0x7ffa7406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654309856 0 0) 0x7ffa740b49f0 con 0x7ffa740cef80 2023-07-09T21:38:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa60003530 con 0x7ffa740cef80 2023-07-09T21:38:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200101194 0 0) 0x7ffa740cc8a0 con 0x7ffa740b7ab0 2023-07-09T21:38:06.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa740b49f0 con 0x7ffa740b7ab0 2023-07-09T21:38:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa78c58640 1 -- 172.21.15.37:0/1364755570 >> v1:172.21.15.119:6789/0 conn(0x7ffa740b7ab0 legacy=0x7ffa740b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa78c58640 1 -- 172.21.15.37:0/1364755570 >> v1:172.21.15.37:6789/0 conn(0x7ffa740cef80 legacy=0x7ffa740d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.079+0000 7ffa78c58640 1 -- 172.21.15.37:0/1364755570 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740ccb80 con 0x7ffa740b4340 2023-07-09T21:38:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa78c58640 1 --2- 172.21.15.37:0/1364755570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b4340 0x7ffa7406aa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ce1722a76978188 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640ab650 con 0x7ffa740b4340 2023-07-09T21:38:06.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa640ab7b0 con 0x7ffa740b4340 2023-07-09T21:38:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa6bfff640 1 -- 172.21.15.37:0/1364755570 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640abb40 con 0x7ffa740b4340 2023-07-09T21:38:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1364755570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b4340 msgr2=0x7ffa7406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1364755570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b4340 0x7ffa7406aa50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ffa640097c0 tx=0x7ffa6401c450 comp rx=0 tx=0).stop 2023-07-09T21:38:06.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1364755570 shutdown_connections 2023-07-09T21:38:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1364755570 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b4340 0x7ffa7406aa50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1364755570 >> 172.21.15.37:0/1364755570 conn(0x7ffa74073090 msgr2=0x7ffa74069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:06.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1364755570 shutdown_connections 2023-07-09T21:38:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.083+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1364755570 wait complete. 2023-07-09T21:38:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 Processor -- start 2023-07-09T21:38:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- start start 2023-07-09T21:38:06.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b7ab0 0x7ffa740c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa740cef80 0x7ffa7415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c6b40 con 0x7ffa740b4340 2023-07-09T21:38:06.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c6e20 con 0x7ffa740b7ab0 2023-07-09T21:38:06.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa740c7100 con 0x7ffa740cef80 2023-07-09T21:38:06.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40166/0 (socket says 172.21.15.37:40166) 2023-07-09T21:38:06.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 -- 172.21.15.37:0/1355626985 learned_addr learned my addr 172.21.15.37:0/1355626985 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:06.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa78c58640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b7ab0 0x7ffa740c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79c5a640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa740cef80 0x7ffa7415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa740cef80 msgr2=0x7ffa7415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa740cef80 0x7ffa7415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b7ab0 msgr2=0x7ffa740c83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b7ab0 0x7ffa740c83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 -- 172.21.15.37:0/1355626985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa64009420 con 0x7ffa740b4340 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa79459640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c490 tx=0x7ffa7000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa700052d0 con 0x7ffa740b4340 2023-07-09T21:38:06.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa70005430 con 0x7ffa740b4340 2023-07-09T21:38:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa740c73e0 con 0x7ffa740b4340 2023-07-09T21:38:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70012870 con 0x7ffa740b4340 2023-07-09T21:38:06.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.087+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa74156c30 con 0x7ffa740b4340 2023-07-09T21:38:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7404d7d0 con 0x7ffa740b4340 2023-07-09T21:38:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7ffa700129d0 con 0x7ffa740b4340 2023-07-09T21:38:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa69ffb640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 0x7ffa58068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7ffa70083ae0 con 0x7ffa740b4340 2023-07-09T21:38:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa78c58640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 msgr2=0x7ffa58068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.091+0000 7ffa78c58640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 0x7ffa58068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:06.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.095+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa70050cf0 con 0x7ffa740b4340 2023-07-09T21:38:06.226 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.231+0000 7f038b341180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:06.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.295+0000 7ffa78c58640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 msgr2=0x7ffa58068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:06.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.295+0000 7ffa78c58640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 0x7ffa58068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:38:06.311 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.315+0000 7f038b341180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:06.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.315+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa7406a830 con 0x7ffa740b4340 2023-07-09T21:38:06.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.315+0000 7ffa69ffb640 1 -- 172.21.15.37:0/1355626985 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7ffa70054310 con 0x7ffa740b4340 2023-07-09T21:38:06.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:06.319 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:38:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:38:06.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 msgr2=0x7ffa58068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:06.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 0x7ffa58068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 msgr2=0x7ffa741566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c490 tx=0x7ffa7000c950 comp rx=0 tx=0).stop 2023-07-09T21:38:06.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 shutdown_connections 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7ffa580663d0 0x7ffa58068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa740cef80 0x7ffa7415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa740b7ab0 0x7ffa740c83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 --2- 172.21.15.37:0/1355626985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa740b4340 0x7ffa741566f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 >> 172.21.15.37:0/1355626985 conn(0x7ffa74073090 msgr2=0x7ffa74069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 shutdown_connections 2023-07-09T21:38:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.319+0000 7ffa7b6bd640 1 -- 172.21.15.37:0/1355626985 wait complete. 2023-07-09T21:38:06.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:06.455 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:06.455+0000 7f6960387180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:06.457 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.463+0000 7f038b341180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:06.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 Processor -- start 2023-07-09T21:38:06.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 -- start start 2023-07-09T21:38:06.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f2406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f240b49f0 con 0x7f0f240b4340 2023-07-09T21:38:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f240cc8a0 con 0x7f0f240cef80 2023-07-09T21:38:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f28fdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240b7e80 con 0x7f0f240b7ab0 2023-07-09T21:38:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f22d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0f240b4340 0x7f0f240d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50284/0 (socket says 172.21.15.37:50284) 2023-07-09T21:38:06.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f22d9d640 1 -- 172.21.15.37:0/2085764199 learned_addr learned my addr 172.21.15.37:0/2085764199 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:06.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.483+0000 7f0f2259c640 1 --2- 172.21.15.37:0/2085764199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f2406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527195245 0 0) 0x7f0f240b49f0 con 0x7f0f240b4340 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f0c003530 con 0x7f0f240b4340 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275183998 0 0) 0x7f0f240cc8a0 con 0x7f0f240cef80 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2259c640 1 -- 172.21.15.37:0/2085764199 >> v1:172.21.15.119:6789/0 conn(0x7f0f240cef80 legacy=0x7f0f240b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2259c640 1 -- 172.21.15.37:0/2085764199 >> v1:172.21.15.37:6789/0 conn(0x7f0f240b4340 legacy=0x7f0f240d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2259c640 1 -- 172.21.15.37:0/2085764199 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240ccb80 con 0x7f0f240b7ab0 2023-07-09T21:38:06.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2259c640 1 --2- 172.21.15.37:0/2085764199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f2406aa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097f0 tx=0x7f0f1401c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f3fd8fd54802c23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140aa5f0 con 0x7f0f240b7ab0 2023-07-09T21:38:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f140aa750 con 0x7f0f240b7ab0 2023-07-09T21:38:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.487+0000 7f0f2159a640 1 -- 172.21.15.37:0/2085764199 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140aaae0 con 0x7f0f240b7ab0 2023-07-09T21:38:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- 172.21.15.37:0/2085764199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 msgr2=0x7f0f2406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/2085764199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f2406aa50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0f140097f0 tx=0x7f0f1401c490 comp rx=0 tx=0).stop 2023-07-09T21:38:06.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- 172.21.15.37:0/2085764199 shutdown_connections 2023-07-09T21:38:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/2085764199 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f2406aa50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- 172.21.15.37:0/2085764199 >> 172.21.15.37:0/2085764199 conn(0x7f0f24073090 msgr2=0x7f0f24069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- 172.21.15.37:0/2085764199 shutdown_connections 2023-07-09T21:38:06.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- 172.21.15.37:0/2085764199 wait complete. 2023-07-09T21:38:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 Processor -- start 2023-07-09T21:38:06.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- start start 2023-07-09T21:38:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f240c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 0x7f0f240c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2414da60 con 0x7f0f240cef80 2023-07-09T21:38:06.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240c8a40 con 0x7f0f240b4340 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f28fdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f240c8110 con 0x7f0f240b7ab0 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f22d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 0x7f0f240c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f2259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f2259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:50464/0 (socket says 172.21.15.37:50464) 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f21d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f240c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.491+0000 7f0f2259c640 1 -- 172.21.15.37:0/733246353 learned_addr learned my addr 172.21.15.37:0/733246353 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 -- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 msgr2=0x7f0f240c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f240c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 -- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 msgr2=0x7f0f240c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 -- 172.21.15.37:0/733246353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f14009420 con 0x7f0f240cef80 2023-07-09T21:38:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f2259c640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f22d9d640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 0x7f0f240c7ab0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00caa0 tx=0x7f0f1c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00ab40 con 0x7f0f240cef80 2023-07-09T21:38:06.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c00aca0 con 0x7f0f240cef80 2023-07-09T21:38:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c012600 con 0x7f0f240cef80 2023-07-09T21:38:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f240c83f0 con 0x7f0f240cef80 2023-07-09T21:38:06.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f240c6910 con 0x7f0f240cef80 2023-07-09T21:38:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f2414dbd0 con 0x7f0f240cef80 2023-07-09T21:38:06.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0f1c007070 con 0x7f0f240cef80 2023-07-09T21:38:06.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.495+0000 7f0f12ffd640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 0x7f0f04068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.499+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f0f1c083eb0 con 0x7f0f240cef80 2023-07-09T21:38:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.499+0000 7f0f2259c640 1 -- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 msgr2=0x7f0f04068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:06.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.499+0000 7f0f2259c640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 0x7f0f04068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:06.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.499+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f1c051030 con 0x7f0f240cef80 2023-07-09T21:38:06.541 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.547+0000 7f038b341180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:06.546 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:06.543+0000 7f6960387180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:06.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.659+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f2404d7d0 con 0x7f0f240cef80 2023-07-09T21:38:06.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.659+0000 7f0f12ffd640 1 -- 172.21.15.37:0/733246353 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+18940 (secure 0 0 0) 0x7f0f1c017070 con 0x7f0f240cef80 2023-07-09T21:38:06.663 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:06.663 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":71,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:37:21.085488+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2232161020":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3086453693":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6833/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/48663712":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3666390931":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/609733224":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2471493969":"2023-07-10T21:36:19.799042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 msgr2=0x7f0f04068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:06.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 0x7f0f04068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 msgr2=0x7f0f240c7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 0x7f0f240c7ab0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c00caa0 tx=0x7f0f1c00cea0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 shutdown_connections 2023-07-09T21:38:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f0f040663d0 0x7f0f04068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f240cef80 0x7f0f240c7ab0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f240b7ab0 0x7f0f240c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 --2- 172.21.15.37:0/733246353 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f240b4340 0x7f0f240c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 >> 172.21.15.37:0/733246353 conn(0x7f0f24073090 msgr2=0x7f0f240b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:06.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 shutdown_connections 2023-07-09T21:38:06.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.663+0000 7f0f28fdb640 1 -- 172.21.15.37:0/733246353 wait complete. 2023-07-09T21:38:06.684 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:35:59.718392+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '67', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:36:00.596893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:06.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:06.707 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:06.703+0000 7f6960387180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:06.796 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:06.795+0000 7f6960387180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:06.810 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.815+0000 7f038b341180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:06.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 Processor -- start 2023-07-09T21:38:06.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 -- start start 2023-07-09T21:38:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74c80ceb80 0x7f74c80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c815bf80 con 0x7f74c80b3c20 2023-07-09T21:38:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c80cd070 con 0x7f74c80ceb80 2023-07-09T21:38:06.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.831+0000 7f74cf8cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c80cfd70 con 0x7f74c80b7980 2023-07-09T21:38:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74c80ceb80 0x7f74c80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f74c80ceb80 0x7f74c80cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40180/0 (socket says 172.21.15.37:40180) 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cde68640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74c80b3c20 0x7f74c80b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50290/0 (socket says 172.21.15.37:50290) 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 -- 172.21.15.37:0/2325222140 learned_addr learned my addr 172.21.15.37:0/2325222140 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cd667640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 -- 172.21.15.37:0/2325222140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 msgr2=0x7f74c8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74bffff640 1 -- 172.21.15.37:0/2325222140 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2916720331 0 0) 0x7f74c00014a0 con 0x7f74c80b3c20 2023-07-09T21:38:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 -- 172.21.15.37:0/2325222140 >> v1:172.21.15.37:6789/0 conn(0x7f74c80b3c20 legacy=0x7f74c80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 -- 172.21.15.37:0/2325222140 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c8160570 con 0x7f74c80ceb80 2023-07-09T21:38:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74cce66640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80ceb80 0x7f74c80cef90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009870 tx=0x7f74b801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9d1ab9c017fa47 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.835+0000 7f74bffff640 1 -- 172.21.15.37:0/2325222140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80ab600 con 0x7f74c80ceb80 2023-07-09T21:38:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74bffff640 1 -- 172.21.15.37:0/2325222140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80a7050 con 0x7f74c80ceb80 2023-07-09T21:38:06.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74bffff640 1 -- 172.21.15.37:0/2325222140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80ab980 con 0x7f74c80ceb80 2023-07-09T21:38:06.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- 172.21.15.37:0/2325222140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80ceb80 msgr2=0x7f74c80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80ceb80 0x7f74c80cef90 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f74b8009870 tx=0x7f74b801c540 comp rx=0 tx=0).stop 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- 172.21.15.37:0/2325222140 shutdown_connections 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80ceb80 0x7f74c80cef90 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/2325222140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- 172.21.15.37:0/2325222140 >> 172.21.15.37:0/2325222140 conn(0x7f74c8073090 msgr2=0x7f74c8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- 172.21.15.37:0/2325222140 shutdown_connections 2023-07-09T21:38:06.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- 172.21.15.37:0/2325222140 wait complete. 2023-07-09T21:38:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 Processor -- start 2023-07-09T21:38:06.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- start start 2023-07-09T21:38:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c815e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c80ceb80 0x7f74c815e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c8159d70 con 0x7f74c80b3c20 2023-07-09T21:38:06.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c81596d0 con 0x7f74c80ceb80 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cf8cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c815ec00 con 0x7f74c80b7980 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cd667640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cd667640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40194/0 (socket says 172.21.15.37:40194) 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cd667640 1 -- 172.21.15.37:0/1504975338 learned_addr learned my addr 172.21.15.37:0/1504975338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cce66640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c815e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.839+0000 7f74cde68640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c80ceb80 0x7f74c815e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:06.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 -- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 msgr2=0x7f74c815e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c815e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 -- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c80ceb80 msgr2=0x7f74c815e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c80ceb80 0x7f74c815e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 -- 172.21.15.37:0/1504975338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80094d0 con 0x7f74c80b3c20 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cd667640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e870 tx=0x7f74c400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c4009510 con 0x7f74c80b3c20 2023-07-09T21:38:06.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c400eec0 con 0x7f74c80b3c20 2023-07-09T21:38:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c815eee0 con 0x7f74c80b3c20 2023-07-09T21:38:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c400cb40 con 0x7f74c80b3c20 2023-07-09T21:38:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c80c8230 con 0x7f74c80b3c20 2023-07-09T21:38:06.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c8159fe0 con 0x7f74c80b3c20 2023-07-09T21:38:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 23) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f74c400cca0 con 0x7f74c80b3c20 2023-07-09T21:38:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.843+0000 7f74bdffb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 0x7f74ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.847+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6464+0+0 (secure 0 0 0) 0x7f74c4084090 con 0x7f74c80b3c20 2023-07-09T21:38:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.847+0000 7f74cce66640 1 -- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 msgr2=0x7f74ac068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2506503407 2023-07-09T21:38:06.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.847+0000 7f74cce66640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 0x7f74ac068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:06.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.847+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74c40b4700 con 0x7f74c80b3c20 2023-07-09T21:38:06.870 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.875+0000 7f038b341180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.883+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f74c4051700 con 0x7f74c80b3c20 2023-07-09T21:38:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.883+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 msgr2=0x7f74ac068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:06.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:06.883+0000 7f74bdffb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 0x7f74ac068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:06.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0315bb2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0315bb2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0315bb2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.963 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0315bb2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.963 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0315bb2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.963 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0313bae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.964 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0313bae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.965 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0313bae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.965 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0313bae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:06.965 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:06.967+0000 7f0313bae640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:07.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74c804d7d0 con 0x7f74c80b3c20 2023-07-09T21:38:07.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74bdffb640 1 -- 172.21.15.37:0/1504975338 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74c4021070 con 0x7f74c80b3c20 2023-07-09T21:38:07.037 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:07.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 msgr2=0x7f74c80c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f74c400e870 tx=0x7f74c400ec70 comp rx=0 tx=0).stop 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 shutdown_connections 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:6832/2506503407,v1:172.21.15.119:6833/2506503407] conn(0x7f74ac0663a0 0x7f74ac068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74c80ceb80 0x7f74c815e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74c80b7980 0x7f74c815e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 --2- 172.21.15.37:0/1504975338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74c80b3c20 0x7f74c80c7cf0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.035+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 >> 172.21.15.37:0/1504975338 conn(0x7f74c8073090 msgr2=0x7f74c8158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.039+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 shutdown_connections 2023-07-09T21:38:07.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.039+0000 7f74cf8cb640 1 -- 172.21.15.37:0/1504975338 wait complete. 2023-07-09T21:38:07.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:07.119 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:07.119+0000 7f6960387180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:07.185 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:07.183+0000 7f6960387180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 Processor -- start 2023-07-09T21:38:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 -- start start 2023-07-09T21:38:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc2e00b7980 0x7fc2e0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2e00d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e015bf80 con 0x7fc2e00ceb80 2023-07-09T21:38:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e00cd070 con 0x7fc2e00b7980 2023-07-09T21:38:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2e4eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00cfd70 con 0x7fc2e00d0780 2023-07-09T21:38:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2d7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc2e00ceb80 0x7fc2e00cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:50302/0 (socket says 172.21.15.37:50302) 2023-07-09T21:38:07.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2d7fff640 1 -- 172.21.15.37:0/3508221136 learned_addr learned my addr 172.21.15.37:0/3508221136 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2de59c640 1 --2- 172.21.15.37:0/3508221136 >> v2:172.21.15.119:3300/0 conn(0x7fc2e00b7980 0x7fc2e0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2e00d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163340053 0 0) 0x7fc2c8001120 con 0x7fc2e00ceb80 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2cc003530 con 0x7fc2e00ceb80 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 866608757 0 0) 0x7fc2cc003530 con 0x7fc2e00ceb80 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 msgr2=0x7fc2e00d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2e00d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 >> v2:172.21.15.119:3300/0 conn(0x7fc2e00b7980 msgr2=0x7fc2e0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 --2- 172.21.15.37:0/3508221136 >> v2:172.21.15.119:3300/0 conn(0x7fc2e00b7980 0x7fc2e0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0160570 con 0x7fc2e00ceb80 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fc2c8001810 con 0x7fc2e00ceb80 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 >> v1:172.21.15.37:6789/0 conn(0x7fc2e00ceb80 legacy=0x7fc2e00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2cc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc003f00 0x7fc2cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2cc004d10 0x7fc2cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00cd070 con 0x7fc2cc004d10 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00cfd70 con 0x7fc2cc003f00 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc00b990 con 0x7fc2e00d0780 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2de59c640 1 --2- 172.21.15.37:0/3508221136 >> v2:172.21.15.119:3300/0 conn(0x7fc2e00b7980 0x7fc2e0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2cc004d10 0x7fc2cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc003f00 0x7fc2cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.255+0000 7fc2de59c640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2cc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 -- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 msgr2=0x7fc2cc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2e00d0780 0x7fc2cc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 -- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc003f00 msgr2=0x7fc2cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc003f00 0x7fc2cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 -- 172.21.15.37:0/3508221136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc003530 con 0x7fc2cc004d10 2023-07-09T21:38:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2cc003f00 0x7fc2cc0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2cc004d10 0x7fc2cc005180 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fc0 tx=0x7fc2d801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e625c5265ad12d31 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80a5c70 con 0x7fc2cc004d10 2023-07-09T21:38:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d800f040 con 0x7fc2cc004d10 2023-07-09T21:38:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ddd9b640 1 -- 172.21.15.37:0/3508221136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d80ad440 con 0x7fc2cc004d10 2023-07-09T21:38:07.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 -- 172.21.15.37:0/3508221136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2cc004d10 msgr2=0x7fc2cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 --2- 172.21.15.37:0/3508221136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2cc004d10 0x7fc2cc005180 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009fc0 tx=0x7fc2d801cc60 comp rx=0 tx=0).stop 2023-07-09T21:38:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2ded9d640 1 -- 172.21.15.37:0/3508221136 reap_dead start 2023-07-09T21:38:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 -- 172.21.15.37:0/3508221136 shutdown_connections 2023-07-09T21:38:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 -- 172.21.15.37:0/3508221136 >> 172.21.15.37:0/3508221136 conn(0x7fc2e0073090 msgr2=0x7fc2e0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 -- 172.21.15.37:0/3508221136 shutdown_connections 2023-07-09T21:38:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.259+0000 7fc2e4eec640 1 -- 172.21.15.37:0/3508221136 wait complete. 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 Processor -- start 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 -- start start 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 0x7fc2e00b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e00c8670 0x7fc2e00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e014e1a0 con 0x7fc2e00b1c00 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00c7ca0 con 0x7fc2e00c8670 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2e4eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00b2070 con 0x7fc2cc004d10 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40210/0 (socket says 172.21.15.37:40210) 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 -- 172.21.15.37:0/2704541533 learned_addr learned my addr 172.21.15.37:0/2704541533 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:07.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2de59c640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 0x7fc2e00b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2ded9d640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e00c8670 0x7fc2e00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 -- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 msgr2=0x7fc2e00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 0x7fc2e00b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 -- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e00c8670 msgr2=0x7fc2e00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e00c8670 0x7fc2e00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 -- 172.21.15.37:0/2704541533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00caa60 con 0x7fc2e00b1c00 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2de59c640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 0x7fc2e00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:07.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d7fff640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8007310 tx=0x7fc2c80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.263+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800f9c0 con 0x7fc2e00b1c00 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c800fb20 con 0x7fc2e00b1c00 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00c7650 con 0x7fc2e00b1c00 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c800fe90 con 0x7fc2e00b1c00 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00c7300 con 0x7fc2e00b1c00 2023-07-09T21:38:07.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e004d7d0 con 0x7fc2e00b1c00 2023-07-09T21:38:07.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fc2c801d460 con 0x7fc2e00b1c00 2023-07-09T21:38:07.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.267+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fc2c8083bf0 con 0x7fc2e00b1c00 2023-07-09T21:38:07.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.271+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2c8051190 con 0x7fc2e00b1c00 2023-07-09T21:38:07.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc2e015bf80 con 0x7fc2e00b1c00 2023-07-09T21:38:07.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2d6ffd640 1 -- 172.21.15.37:0/2704541533 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc2e015bf80 con 0x7fc2e00b1c00 2023-07-09T21:38:07.429 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:07.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 msgr2=0x7fc2e00c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8007310 tx=0x7fc2c80077d0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 shutdown_connections 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2e00c8670 0x7fc2e00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2e00b1c00 0x7fc2e00c8130 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 --2- 172.21.15.37:0/2704541533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2cc004d10 0x7fc2e00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 >> 172.21.15.37:0/2704541533 conn(0x7fc2e0073090 msgr2=0x7fc2e015b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 shutdown_connections 2023-07-09T21:38:07.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.427+0000 7fc2e4eec640 1 -- 172.21.15.37:0/2704541533 wait complete. 2023-07-09T21:38:07.450 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:38:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.631+0000 7fda42982640 1 Processor -- start 2023-07-09T21:38:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 -- start start 2023-07-09T21:38:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda3c0b7980 0x7fda3c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda3c0ceb80 0x7fda3c0cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3c15bf80 con 0x7fda3c0b3c20 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c0cd070 con 0x7fda3c0ceb80 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda42982640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3c0cfd70 con 0x7fda3c0b7980 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda3c0ceb80 0x7fda3c0cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda3c0ceb80 0x7fda3c0cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56202/0 (socket says 172.21.15.37:56202) 2023-07-09T21:38:07.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 -- 172.21.15.37:0/2443018780 learned_addr learned my addr 172.21.15.37:0/2443018780 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3bfff640 1 --2- 172.21.15.37:0/2443018780 >> v2:172.21.15.119:3300/0 conn(0x7fda3c0b7980 0x7fda3c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 -- 172.21.15.37:0/2443018780 >> v2:172.21.15.119:3300/0 conn(0x7fda3c0b7980 msgr2=0x7fda3c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 --2- 172.21.15.37:0/2443018780 >> v2:172.21.15.119:3300/0 conn(0x7fda3c0b7980 0x7fda3c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 -- 172.21.15.37:0/2443018780 >> v1:172.21.15.119:6789/0 conn(0x7fda3c0b3c20 legacy=0x7fda3c0b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.635+0000 7fda3b7fe640 1 -- 172.21.15.37:0/2443018780 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c160570 con 0x7fda3c0ceb80 2023-07-09T21:38:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda3b7fe640 1 --2- 172.21.15.37:0/2443018780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0ceb80 0x7fda3c0cefc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fda3c069aa0 tx=0x7fda3001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f42e76ac5d601b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda3affd640 1 -- 172.21.15.37:0/2443018780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300ab600 con 0x7fda3c0ceb80 2023-07-09T21:38:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda3affd640 1 -- 172.21.15.37:0/2443018780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda300a7050 con 0x7fda3c0ceb80 2023-07-09T21:38:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda3affd640 1 -- 172.21.15.37:0/2443018780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda300ab980 con 0x7fda3c0ceb80 2023-07-09T21:38:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- 172.21.15.37:0/2443018780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0ceb80 msgr2=0x7fda3c0cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 --2- 172.21.15.37:0/2443018780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0ceb80 0x7fda3c0cefc0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fda3c069aa0 tx=0x7fda3001c500 comp rx=0 tx=0).stop 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- 172.21.15.37:0/2443018780 shutdown_connections 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 --2- 172.21.15.37:0/2443018780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0ceb80 0x7fda3c0cefc0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 --2- 172.21.15.37:0/2443018780 >> v2:172.21.15.119:3300/0 conn(0x7fda3c0b7980 0x7fda3c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- 172.21.15.37:0/2443018780 >> 172.21.15.37:0/2443018780 conn(0x7fda3c073090 msgr2=0x7fda3c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- 172.21.15.37:0/2443018780 shutdown_connections 2023-07-09T21:38:07.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- 172.21.15.37:0/2443018780 wait complete. 2023-07-09T21:38:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 Processor -- start 2023-07-09T21:38:07.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.639+0000 7fda42982640 1 -- start start 2023-07-09T21:38:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3c0b7980 0x7fda3c15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3c0ceb80 0x7fda3c153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c15b4e0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c15b7c0 con 0x7fda3c0b7980 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c152f60 con 0x7fda3c0ceb80 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56206/0 (socket says 172.21.15.37:56206) 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 -- 172.21.15.37:0/3939266225 learned_addr learned my addr 172.21.15.37:0/3939266225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3b7fe640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3c0b7980 0x7fda3c15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda40f1f640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3c0ceb80 0x7fda3c153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 -- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3c0ceb80 msgr2=0x7fda3c153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3c0ceb80 0x7fda3c153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 -- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3c0b7980 msgr2=0x7fda3c15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3c0b7980 0x7fda3c15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 -- 172.21.15.37:0/3939266225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda300094d0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda3bfff640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e9b0 tx=0x7fda2c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c0096b0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c00c9a0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c00cd30 con 0x7fda3c0b3c20 2023-07-09T21:38:07.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda3c153240 con 0x7fda3c0b3c20 2023-07-09T21:38:07.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda3c0c89b0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3c04d7d0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.643+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 24) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fda2c013470 con 0x7fda3c0b3c20 2023-07-09T21:38:07.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.647+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fda2c083da0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.651+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda2c051330 con 0x7fda3c0b3c20 2023-07-09T21:38:07.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.803+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda3c1536f0 con 0x7fda3c0b3c20 2023-07-09T21:38:07.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.803+0000 7fda38ff9640 1 -- 172.21.15.37:0/3939266225 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda2c017020 con 0x7fda3c0b3c20 2023-07-09T21:38:07.807 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:38:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 msgr2=0x7fda3c0c8470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fda2c00e9b0 tx=0x7fda2c00ee70 comp rx=0 tx=0).stop 2023-07-09T21:38:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 shutdown_connections 2023-07-09T21:38:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda3c0ceb80 0x7fda3c153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda3c0b7980 0x7fda3c15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 --2- 172.21.15.37:0/3939266225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda3c0b3c20 0x7fda3c0c8470 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 >> 172.21.15.37:0/3939266225 conn(0x7fda3c073090 msgr2=0x7fda3c0d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 shutdown_connections 2023-07-09T21:38:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.807+0000 7fda42982640 1 -- 172.21.15.37:0/3939266225 wait complete. 2023-07-09T21:38:07.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:38:07.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.975+0000 7fb1ddde9640 1 Processor -- start 2023-07-09T21:38:07.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.975+0000 7fb1ddde9640 1 -- start start 2023-07-09T21:38:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1ddde9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80cf290 0x7fb1d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1ddde9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d80d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1ddde9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d815bf80 con 0x7fb1d80b7980 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1ddde9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80cd070 con 0x7fb1d80cf290 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1ddde9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d80cfd70 con 0x7fb1d80d0780 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80cf290 0x7fb1d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1d80cf290 0x7fb1d8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56210/0 (socket says 172.21.15.37:56210) 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 -- 172.21.15.37:0/4095025421 learned_addr learned my addr 172.21.15.37:0/4095025421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d7fff640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d80d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 -- 172.21.15.37:0/4095025421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 msgr2=0x7fb1d80d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d80d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 -- 172.21.15.37:0/4095025421 >> v1:172.21.15.119:6789/0 conn(0x7fb1d80b7980 legacy=0x7fb1d80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d6ffd640 1 -- 172.21.15.37:0/4095025421 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d8160570 con 0x7fb1d80cf290 2023-07-09T21:38:07.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.979+0000 7fb1d7fff640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d80d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80cf290 0x7fb1d8160030 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009870 tx=0x7fb1cc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2183ca9d20c78e0f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1d67fc640 1 -- 172.21.15.37:0/4095025421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0ab600 con 0x7fb1d80cf290 2023-07-09T21:38:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1d67fc640 1 -- 172.21.15.37:0/4095025421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0a7050 con 0x7fb1d80cf290 2023-07-09T21:38:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1d67fc640 1 -- 172.21.15.37:0/4095025421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc0ab980 con 0x7fb1d80cf290 2023-07-09T21:38:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- 172.21.15.37:0/4095025421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80cf290 msgr2=0x7fb1d8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80cf290 0x7fb1d8160030 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009870 tx=0x7fb1cc01c540 comp rx=0 tx=0).stop 2023-07-09T21:38:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- 172.21.15.37:0/4095025421 shutdown_connections 2023-07-09T21:38:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d80d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/4095025421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80cf290 0x7fb1d8160030 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- 172.21.15.37:0/4095025421 >> 172.21.15.37:0/4095025421 conn(0x7fb1d8073090 msgr2=0x7fb1d8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- 172.21.15.37:0/4095025421 shutdown_connections 2023-07-09T21:38:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- 172.21.15.37:0/4095025421 wait complete. 2023-07-09T21:38:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 Processor -- start 2023-07-09T21:38:07.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.983+0000 7fb1ddde9640 1 -- start start 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d80cf290 0x7fb1d8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8151af0 con 0x7fb1d80b7980 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8151dd0 con 0x7fb1d80cf290 2023-07-09T21:38:07.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d81520b0 con 0x7fb1d80d0780 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56212/0 (socket says 172.21.15.37:56212) 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 -- 172.21.15.37:0/3407442399 learned_addr learned my addr 172.21.15.37:0/3407442399 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d80cf290 0x7fb1d8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d7fff640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 -- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 msgr2=0x7fb1d8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 -- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d80cf290 msgr2=0x7fb1d8152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d80cf290 0x7fb1d8152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:07.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 -- 172.21.15.37:0/3407442399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0094d0 con 0x7fb1d80b7980 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1d77fe640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c500 tx=0x7fb1c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8005220 con 0x7fb1d80b7980 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8005380 con 0x7fb1d80b7980 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8007270 con 0x7fb1d80b7980 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d8152390 con 0x7fb1d80b7980 2023-07-09T21:38:07.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d80cc150 con 0x7fb1d80b7980 2023-07-09T21:38:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d804d7d0 con 0x7fb1d80b7980 2023-07-09T21:38:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.987+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb1c80073d0 con 0x7fb1d80b7980 2023-07-09T21:38:07.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.991+0000 7fb1bffff640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 0x7fb1c4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:07.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.991+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7fb1c80833f0 con 0x7fb1d80b7980 2023-07-09T21:38:07.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.991+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 0x7fb1c4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:07.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.991+0000 7fb1d6ffd640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 0x7fb1c4068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8069aa0 tx=0x7fb1cc008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:07.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:07.995+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1c80508c0 con 0x7fb1d80b7980 2023-07-09T21:38:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.151+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1d815d100 con 0x7fb1d80b7980 2023-07-09T21:38:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.151+0000 7fb1bffff640 1 -- 172.21.15.37:0/3407442399 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1c8053ee0 con 0x7fb1d80b7980 2023-07-09T21:38:08.155 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:38:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 msgr2=0x7fb1c4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 0x7fb1c4068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8069aa0 tx=0x7fb1cc008040 comp rx=0 tx=0).stop 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 msgr2=0x7fb1d8151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800c500 tx=0x7fb1c800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 shutdown_connections 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1c40660d0 0x7fb1c4068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1d80d0780 0x7fb1d8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1d80cf290 0x7fb1d8152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 --2- 172.21.15.37:0/3407442399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1d80b7980 0x7fb1d8151510 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 >> 172.21.15.37:0/3407442399 conn(0x7fb1d8073090 msgr2=0x7fb1d80ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 shutdown_connections 2023-07-09T21:38:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.155+0000 7fb1ddde9640 1 -- 172.21.15.37:0/3407442399 wait complete. 2023-07-09T21:38:08.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.315+0000 7f3aa089c640 1 Processor -- start 2023-07-09T21:38:08.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.315+0000 7f3aa089c640 1 -- start start 2023-07-09T21:38:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0b7ab0 0x7f3a9c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3a9c0b4170 0x7f3a9c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c0b7e80 con 0x7f3a9c0cef80 2023-07-09T21:38:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a9c0b45f0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3aa089c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c0b49f0 con 0x7f3a9c0b7ab0 2023-07-09T21:38:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56218/0 (socket says 172.21.15.37:56218) 2023-07-09T21:38:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 -- 172.21.15.37:0/3740254787 learned_addr learned my addr 172.21.15.37:0/3740254787 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:08.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a9ad9d640 1 --2- 172.21.15.37:0/3740254787 >> v2:172.21.15.119:3300/0 conn(0x7f3a9c0b4170 0x7f3a9c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a9a59c640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0b7ab0 0x7f3a9c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 -- 172.21.15.37:0/3740254787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0b7ab0 msgr2=0x7f3a9c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0b7ab0 0x7f3a9c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 -- 172.21.15.37:0/3740254787 >> v2:172.21.15.119:3300/0 conn(0x7f3a9c0b4170 msgr2=0x7f3a9c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 --2- 172.21.15.37:0/3740254787 >> v2:172.21.15.119:3300/0 conn(0x7f3a9c0b4170 0x7f3a9c15f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.319+0000 7f3a93fff640 1 -- 172.21.15.37:0/3740254787 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9c0cc8a0 con 0x7f3a9c0cef80 2023-07-09T21:38:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3a93fff640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0716a0 tx=0x7f3a8401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8604f14344e6206 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3a99d9b640 1 -- 172.21.15.37:0/3740254787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ab600 con 0x7f3a9c0cef80 2023-07-09T21:38:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3a99d9b640 1 -- 172.21.15.37:0/3740254787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840a7050 con 0x7f3a9c0cef80 2023-07-09T21:38:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3a99d9b640 1 -- 172.21.15.37:0/3740254787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a840ab980 con 0x7f3a9c0cef80 2023-07-09T21:38:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- 172.21.15.37:0/3740254787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0cef80 msgr2=0x7f3a9c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0716a0 tx=0x7f3a8401c210 comp rx=0 tx=0).stop 2023-07-09T21:38:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- 172.21.15.37:0/3740254787 shutdown_connections 2023-07-09T21:38:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0cef80 0x7f3a9c0b3c30 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 --2- 172.21.15.37:0/3740254787 >> v2:172.21.15.119:3300/0 conn(0x7f3a9c0b4170 0x7f3a9c15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 --2- 172.21.15.37:0/3740254787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0b7ab0 0x7f3a9c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- 172.21.15.37:0/3740254787 >> 172.21.15.37:0/3740254787 conn(0x7f3a9c073090 msgr2=0x7f3a9c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- 172.21.15.37:0/3740254787 shutdown_connections 2023-07-09T21:38:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- 172.21.15.37:0/3740254787 wait complete. 2023-07-09T21:38:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 Processor -- start 2023-07-09T21:38:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.323+0000 7f3aa089c640 1 -- start start 2023-07-09T21:38:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a9c0b7ab0 0x7f3a9c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0cef80 0x7f3a9c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c156dc0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c155d40 con 0x7f3a9c0b7ab0 2023-07-09T21:38:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9c155f10 con 0x7f3a9c0cef80 2023-07-09T21:38:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56228/0 (socket says 172.21.15.37:56228) 2023-07-09T21:38:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 -- 172.21.15.37:0/2862521027 learned_addr learned my addr 172.21.15.37:0/2862521027 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a93fff640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a9c0b7ab0 0x7f3a9c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9ad9d640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0cef80 0x7f3a9c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 -- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0cef80 msgr2=0x7f3a9c0d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0cef80 0x7f3a9c0d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 -- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a9c0b7ab0 msgr2=0x7f3a9c159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a9c0b7ab0 0x7f3a9c159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 -- 172.21.15.37:0/2862521027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840094d0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a9a59c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00d800 tx=0x7f3a8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00b6c0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c00b820 con 0x7f3a9c0b4170 2023-07-09T21:38:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c00bb90 con 0x7f3a9c0b4170 2023-07-09T21:38:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9c157250 con 0x7f3a9c0b4170 2023-07-09T21:38:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a9c156490 con 0x7f3a9c0b4170 2023-07-09T21:38:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a9c04d7d0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.327+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f3a8c00bcf0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.331+0000 7f3a92ffd640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 0x7f3a7c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.331+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f3a8c0840e0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.331+0000 7f3a93fff640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 0x7f3a7c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.331+0000 7f3a93fff640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 0x7f3a7c068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a840ad000 tx=0x7f3a84008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.335+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a8c055010 con 0x7f3a9c0b4170 2023-07-09T21:38:08.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.519+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a9c0b6910 con 0x7f3a9c0b4170 2023-07-09T21:38:08.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.519+0000 7f3a92ffd640 1 -- 172.21.15.37:0/2862521027 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f3a8c054ba0 con 0x7f3a9c0b4170 2023-07-09T21:38:08.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:08.522 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:38:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:38:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 msgr2=0x7f3a7c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 0x7f3a7c068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3a840ad000 tx=0x7f3a84008040 comp rx=0 tx=0).stop 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 msgr2=0x7f3a9c155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00d800 tx=0x7f3a8c00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 shutdown_connections 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3a7c0660d0 0x7f3a7c068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3a9c0cef80 0x7f3a9c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3a9c0b7ab0 0x7f3a9c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 --2- 172.21.15.37:0/2862521027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a9c0b4170 0x7f3a9c155800 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 >> 172.21.15.37:0/2862521027 conn(0x7f3a9c073090 msgr2=0x7f3a9c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 shutdown_connections 2023-07-09T21:38:08.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.523+0000 7f3aa089c640 1 -- 172.21.15.37:0/2862521027 wait complete. 2023-07-09T21:38:08.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.683+0000 7f8665b82640 1 Processor -- start 2023-07-09T21:38:08.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.683+0000 7f8665b82640 1 -- start start 2023-07-09T21:38:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86600b7ab0 0x7f866006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 0x7f866015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600b7e80 con 0x7f86600b7ab0 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600b4610 con 0x7f86600b4170 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f8665b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600b49f0 con 0x7f86600cef80 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86600b7ab0 0x7f866006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86600b7ab0 0x7f866006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56230/0 (socket says 172.21.15.37:56230) 2023-07-09T21:38:08.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 -- 172.21.15.37:0/699709256 learned_addr learned my addr 172.21.15.37:0/699709256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:08.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 -- 172.21.15.37:0/699709256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 msgr2=0x7f86600b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 --2- 172.21.15.37:0/699709256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 -- 172.21.15.37:0/699709256 >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 msgr2=0x7f866015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865ffff640 1 --2- 172.21.15.37:0/699709256 >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 0x7f866015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 --2- 172.21.15.37:0/699709256 >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 0x7f866015f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 -- 172.21.15.37:0/699709256 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600cc8a0 con 0x7f86600b7ab0 2023-07-09T21:38:08.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865ffff640 1 --2- 172.21.15.37:0/699709256 >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 0x7f866015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.687+0000 7f865f7fe640 1 --2- 172.21.15.37:0/699709256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f866006aa50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f86600716a0 tx=0x7f865001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256be1f90606b70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865e7fc640 1 -- 172.21.15.37:0/699709256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500ab600 con 0x7f86600b7ab0 2023-07-09T21:38:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865e7fc640 1 -- 172.21.15.37:0/699709256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86500a7050 con 0x7f86600b7ab0 2023-07-09T21:38:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865e7fc640 1 -- 172.21.15.37:0/699709256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86500ab980 con 0x7f86600b7ab0 2023-07-09T21:38:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- 172.21.15.37:0/699709256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 msgr2=0x7f866006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- 172.21.15.37:0/699709256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f866006aa50 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f86600716a0 tx=0x7f865001c210 comp rx=0 tx=0).stop 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- 172.21.15.37:0/699709256 shutdown_connections 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- 172.21.15.37:0/699709256 >> v2:172.21.15.119:3300/0 conn(0x7f86600b4170 0x7f866015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- 172.21.15.37:0/699709256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- 172.21.15.37:0/699709256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f866006aa50 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- 172.21.15.37:0/699709256 >> 172.21.15.37:0/699709256 conn(0x7f8660073090 msgr2=0x7f8660069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- 172.21.15.37:0/699709256 shutdown_connections 2023-07-09T21:38:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- 172.21.15.37:0/699709256 wait complete. 2023-07-09T21:38:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 Processor -- start 2023-07-09T21:38:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- start start 2023-07-09T21:38:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86600b4170 0x7f866014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660156b50 con 0x7f86600b7ab0 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8660155f40 con 0x7f86600b4170 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f8665b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8660156220 con 0x7f86600cef80 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56232/0 (socket says 172.21.15.37:56232) 2023-07-09T21:38:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.691+0000 7f865effd640 1 -- 172.21.15.37:0/572677553 learned_addr learned my addr 172.21.15.37:0/572677553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865f7fe640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86600b4170 0x7f866014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865ffff640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 -- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 msgr2=0x7f86600b5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 -- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86600b4170 msgr2=0x7f866014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86600b4170 0x7f866014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 -- 172.21.15.37:0/572677553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500094d0 con 0x7f86600b7ab0 2023-07-09T21:38:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865ffff640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f865effd640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f865400b3f0 tx=0x7f865400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011830 con 0x7f86600b7ab0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86540119b0 con 0x7f86600b7ab0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654011d60 con 0x7f86600b7ab0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8660156500 con 0x7f86600b7ab0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600c5ce0 con 0x7f86600b7ab0 2023-07-09T21:38:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8660156d00 con 0x7f86600b7ab0 2023-07-09T21:38:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.695+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f865401a400 con 0x7f86600b7ab0 2023-07-09T21:38:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.699+0000 7f8647fff640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 0x7f864c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.699+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f8654083d90 con 0x7f86600b7ab0 2023-07-09T21:38:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.699+0000 7f865f7fe640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 0x7f864c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.699+0000 7f865f7fe640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 0x7f864c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86500ad000 tx=0x7f86500a6000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:08.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.699+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8654051180 con 0x7f86600b7ab0 2023-07-09T21:38:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.855+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f866004d7d0 con 0x7f86600b7ab0 2023-07-09T21:38:08.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8647fff640 1 -- 172.21.15.37:0/572677553 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+19557 (secure 0 0 0) 0x7f8654015020 con 0x7f86600b7ab0 2023-07-09T21:38:08.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:08.861 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:06.874744+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/2506503407":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/3135063437":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/4056762435":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2439510301":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2700601116":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2232161020":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/2506503407":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/3086453693":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2377658735":"2023-07-10T21:38:06.874703+0000","172.21.15.119:6833/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/48663712":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3666390931":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/730688049":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/609733224":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2471493969":"2023-07-10T21:36:19.799042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 msgr2=0x7f864c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 0x7f864c068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f86500ad000 tx=0x7f86500a6000 comp rx=0 tx=0).stop 2023-07-09T21:38:08.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 msgr2=0x7f86600b5980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f865400b3f0 tx=0x7f865400b8b0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 shutdown_connections 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f864c0660d0 0x7f864c068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86600cef80 0x7f86600b5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86600b7ab0 0x7f86600b5980 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 --2- 172.21.15.37:0/572677553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86600b4170 0x7f866014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 >> 172.21.15.37:0/572677553 conn(0x7f8660073090 msgr2=0x7f86600d06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 shutdown_connections 2023-07-09T21:38:08.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:08.859+0000 7f8665b82640 1 -- 172.21.15.37:0/572677553 wait complete. 2023-07-09T21:38:08.881 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:38:08.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:09.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 Processor -- start 2023-07-09T21:38:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 -- start start 2023-07-09T21:38:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33bc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0b49f0 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33bc0cc8a0 con 0x7f33bc0b4340 2023-07-09T21:38:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33c2656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0b7e80 con 0x7f33bc0cef80 2023-07-09T21:38:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33bbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33bc0b7ab0 0x7f33bc0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45744/0 (socket says 172.21.15.37:45744) 2023-07-09T21:38:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.023+0000 7f33bbfff640 1 -- 172.21.15.37:0/2308915685 learned_addr learned my addr 172.21.15.37:0/2308915685 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33c0bf3640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33bc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014379009 0 0) 0x7f33bc0b49f0 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a4003530 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 620309253 0 0) 0x7f33a4003530 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 msgr2=0x7f33bc06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33bc06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 >> v1:172.21.15.119:6789/0 conn(0x7f33bc0b4340 legacy=0x7f33bc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0ccb80 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f33ac001680 con 0x7f33bc0b7ab0 2023-07-09T21:38:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 >> v1:172.21.15.37:6789/0 conn(0x7f33bc0b7ab0 legacy=0x7f33bc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a4004d10 0x7f33a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400ba40 con 0x7f33a40039b0 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400bb80 con 0x7f33a4004d10 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a400bd10 con 0x7f33bc0cef80 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33c0bf3640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a4004d10 0x7f33a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bb7fe640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 -- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 msgr2=0x7f33a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc0cef80 0x7f33a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 -- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a4004d10 msgr2=0x7f33a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a4004d10 0x7f33a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33bbfff640 1 -- 172.21.15.37:0/2308915685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a4003530 con 0x7f33a40039b0 2023-07-09T21:38:09.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.027+0000 7f33c0bf3640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33a4004d10 0x7f33a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:09.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33bbfff640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33a4003dc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c240 tx=0x7f33ac01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac8b586f2ed88e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac005ae0 con 0x7f33a40039b0 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac005c40 con 0x7f33a40039b0 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33baffd640 1 -- 172.21.15.37:0/2308915685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0a5800 con 0x7f33a40039b0 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- 172.21.15.37:0/2308915685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 msgr2=0x7f33a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 --2- 172.21.15.37:0/2308915685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33a4003dc0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f33ac00c240 tx=0x7f33ac01cc10 comp rx=0 tx=0).stop 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c0bf3640 1 -- 172.21.15.37:0/2308915685 reap_dead start 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- 172.21.15.37:0/2308915685 shutdown_connections 2023-07-09T21:38:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- 172.21.15.37:0/2308915685 >> 172.21.15.37:0/2308915685 conn(0x7f33bc073090 msgr2=0x7f33bc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- 172.21.15.37:0/2308915685 shutdown_connections 2023-07-09T21:38:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- 172.21.15.37:0/2308915685 wait complete. 2023-07-09T21:38:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 Processor -- start 2023-07-09T21:38:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- start start 2023-07-09T21:38:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 0x7f33bc0d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc155120 0x7f33bc0d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0ca790 con 0x7f33a40039b0 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0c6d30 con 0x7f33bc155770 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.031+0000 7f33c2656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33bc0c7010 con 0x7f33bc155120 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56248/0 (socket says 172.21.15.37:56248) 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 -- 172.21.15.37:0/3380955747 learned_addr learned my addr 172.21.15.37:0/3380955747 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bb7fe640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 0x7f33bc0d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33c0bf3640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc155120 0x7f33bc0d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 -- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc155120 msgr2=0x7f33bc0d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc155120 0x7f33bc0d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 -- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 msgr2=0x7f33bc0d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 0x7f33bc0d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 -- 172.21.15.37:0/3380955747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33bc0c72f0 con 0x7f33a40039b0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bb7fe640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 0x7f33bc0d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33bbfff640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f33ac01cc50 tx=0x7f33a4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0b4070 con 0x7f33a40039b0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ac001440 con 0x7f33a40039b0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0017d0 con 0x7f33a40039b0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33bc0c75d0 con 0x7f33a40039b0 2023-07-09T21:38:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33bc15aec0 con 0x7f33a40039b0 2023-07-09T21:38:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33bc15b0e0 con 0x7f33a40039b0 2023-07-09T21:38:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f33ac0a5800 con 0x7f33a40039b0 2023-07-09T21:38:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.035+0000 7f33b8ff9640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 0x7f33a80685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.039+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f33ac11d710 con 0x7f33a40039b0 2023-07-09T21:38:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.039+0000 7f33bb7fe640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 0x7f33a80685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.039+0000 7f33bb7fe640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 0x7f33a80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cecb0 tx=0x7f33b0009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.039+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33bc15b0e0 con 0x7f33a40039b0 2023-07-09T21:38:09.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.167+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f33ac0eaed0 con 0x7f33a40039b0 2023-07-09T21:38:09.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.231+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33bc15b0e0 con 0x7f33a40039b0 2023-07-09T21:38:09.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.231+0000 7f33b8ff9640 1 -- 172.21.15.37:0/3380955747 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f33bc15b0e0 con 0x7f33a40039b0 2023-07-09T21:38:09.235 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:09.236 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:38:09.236 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:38:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 msgr2=0x7f33a80685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 0x7f33a80685b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f33bc0cecb0 tx=0x7f33b0009040 comp rx=0 tx=0).stop 2023-07-09T21:38:09.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 msgr2=0x7f33bc1548d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f33ac01cc50 tx=0x7f33a4005800 comp rx=0 tx=0).stop 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 shutdown_connections 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f33a8066100 0x7f33a80685b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33bc155120 0x7f33bc0d2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33bc155770 0x7f33bc0d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 --2- 172.21.15.37:0/3380955747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33a40039b0 0x7f33bc1548d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 >> 172.21.15.37:0/3380955747 conn(0x7f33bc073090 msgr2=0x7f33bc0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 shutdown_connections 2023-07-09T21:38:09.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.235+0000 7f33c2656640 1 -- 172.21.15.37:0/3380955747 wait complete. 2023-07-09T21:38:09.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 Processor -- start 2023-07-09T21:38:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 -- start start 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f313c0ce2e0 0x7f313c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c0cde50 con 0x7f313c0b10d0 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313c0cd240 con 0x7f313c0ce2e0 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f314179f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0cd520 con 0x7f313c15bc40 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f313c0ce2e0 0x7f313c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f313c0ce2e0 0x7f313c0d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56252/0 (socket says 172.21.15.37:56252) 2023-07-09T21:38:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 -- 172.21.15.37:0/354537943 learned_addr learned my addr 172.21.15.37:0/354537943 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313affd640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 -- 172.21.15.37:0/354537943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 msgr2=0x7f313c0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 -- 172.21.15.37:0/354537943 >> v1:172.21.15.119:6789/0 conn(0x7f313c0b10d0 legacy=0x7f313c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.399+0000 7f313a7fc640 1 -- 172.21.15.37:0/354537943 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0cd800 con 0x7f313c0ce2e0 2023-07-09T21:38:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f313a7fc640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0ce2e0 0x7f313c0d01c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f31300098a0 tx=0x7f313001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfec0405405e8b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f3139ffb640 1 -- 172.21.15.37:0/354537943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300ab600 con 0x7f313c0ce2e0 2023-07-09T21:38:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f3139ffb640 1 -- 172.21.15.37:0/354537943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31300a7050 con 0x7f313c0ce2e0 2023-07-09T21:38:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f3139ffb640 1 -- 172.21.15.37:0/354537943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31300ab980 con 0x7f313c0ce2e0 2023-07-09T21:38:09.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 -- 172.21.15.37:0/354537943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0ce2e0 msgr2=0x7f313c0d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0ce2e0 0x7f313c0d01c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f31300098a0 tx=0x7f313001c3d0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 -- 172.21.15.37:0/354537943 shutdown_connections 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0ce2e0 0x7f313c0d01c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 --2- 172.21.15.37:0/354537943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 -- 172.21.15.37:0/354537943 >> 172.21.15.37:0/354537943 conn(0x7f313c072d20 msgr2=0x7f313c0d20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 -- 172.21.15.37:0/354537943 shutdown_connections 2023-07-09T21:38:09.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 -- 172.21.15.37:0/354537943 wait complete. 2023-07-09T21:38:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.403+0000 7f314179f640 1 Processor -- start 2023-07-09T21:38:09.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- start start 2023-07-09T21:38:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f313c0ce2e0 0x7f313c0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c153300 con 0x7f313c0b10d0 2023-07-09T21:38:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0b7640 con 0x7f313c0ce2e0 2023-07-09T21:38:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0c6da0 con 0x7f313c15bc40 2023-07-09T21:38:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56266/0 (socket says 172.21.15.37:56266) 2023-07-09T21:38:09.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 -- 172.21.15.37:0/1406597464 learned_addr learned my addr 172.21.15.37:0/1406597464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313a7fc640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f313c0ce2e0 0x7f313c0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313b7fe640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 -- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 msgr2=0x7f313c0c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 -- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f313c0ce2e0 msgr2=0x7f313c0c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f313c0ce2e0 0x7f313c0c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 -- 172.21.15.37:0/1406597464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31300094d0 con 0x7f313c0b10d0 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f313affd640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d7d0 tx=0x7f312c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00b6c0 con 0x7f313c0b10d0 2023-07-09T21:38:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c00b820 con 0x7f313c0b10d0 2023-07-09T21:38:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c00bbd0 con 0x7f313c0b10d0 2023-07-09T21:38:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c0b7890 con 0x7f313c0b10d0 2023-07-09T21:38:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c1525c0 con 0x7f313c0b10d0 2023-07-09T21:38:09.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.407+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313c152420 con 0x7f313c0b10d0 2023-07-09T21:38:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.411+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f312c00bd30 con 0x7f313c0b10d0 2023-07-09T21:38:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.411+0000 7f31237fe640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 0x7f3128068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.411+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f312c084620 con 0x7f313c0b10d0 2023-07-09T21:38:09.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.411+0000 7f313a7fc640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 0x7f3128068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.411+0000 7f313a7fc640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 0x7f3128068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31300ad000 tx=0x7f3130008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.415+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f313c152420 con 0x7f313c0b10d0 2023-07-09T21:38:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f313c152420 con 0x7f313c0b10d0 2023-07-09T21:38:09.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f31237fe640 1 -- 172.21.15.37:0/1406597464 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4671 (secure 0 0 0) 0x7f313c152420 con 0x7f313c0b10d0 2023-07-09T21:38:09.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:09.605 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:36:01.605674+0000","modified":"2023-07-09T21:36:05.257863+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6267":{"gid":6267,"name":"c","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/35979618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":35979618},{"type":"v1","addr":"172.21.15.37:6835","nonce":35979618}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-07-09T21:38:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2023-07-09T21:38:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 msgr2=0x7f3128068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 0x7f3128068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31300ad000 tx=0x7f3130008040 comp rx=0 tx=0).stop 2023-07-09T21:38:09.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 msgr2=0x7f313c152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f312c00d7d0 tx=0x7f312c00dc90 comp rx=0 tx=0).stop 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 shutdown_connections 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f31280663a0 0x7f3128068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313c15bc40 0x7f313c0c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f313c0ce2e0 0x7f313c0c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 --2- 172.21.15.37:0/1406597464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313c0b10d0 0x7f313c152dc0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 >> 172.21.15.37:0/1406597464 conn(0x7f313c072d20 msgr2=0x7f313c0b0860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 shutdown_connections 2023-07-09T21:38:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.603+0000 7f314179f640 1 -- 172.21.15.37:0/1406597464 wait complete. 2023-07-09T21:38:09.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 Processor -- start 2023-07-09T21:38:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 -- start start 2023-07-09T21:38:09.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f67940b4340 0x7f679406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940b49f0 con 0x7f67940b7ab0 2023-07-09T21:38:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67940cc8a0 con 0x7f67940cef80 2023-07-09T21:38:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6799d37640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67940b7e80 con 0x7f67940b4340 2023-07-09T21:38:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f67937fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67940b7ab0 0x7f67940b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45760/0 (socket says 172.21.15.37:45760) 2023-07-09T21:38:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f67937fe640 1 -- 172.21.15.37:0/1730721817 learned_addr learned my addr 172.21.15.37:0/1730721817 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6792ffd640 1 --2- 172.21.15.37:0/1730721817 >> v2:172.21.15.37:3300/0 conn(0x7f67940b4340 0x7f679406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6792ffd640 1 -- 172.21.15.37:0/1730721817 >> v1:172.21.15.119:6789/0 conn(0x7f67940cef80 legacy=0x7f67940d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6792ffd640 1 -- 172.21.15.37:0/1730721817 >> v1:172.21.15.37:6789/0 conn(0x7f67940b7ab0 legacy=0x7f67940b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f6792ffd640 1 -- 172.21.15.37:0/1730721817 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67940ccb80 con 0x7f67940b4340 2023-07-09T21:38:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.767+0000 7f67927fc640 1 -- 172.21.15.37:0/1730721817 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765088161 0 0) 0x7f67940b49f0 con 0x7f67940b7ab0 2023-07-09T21:38:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6792ffd640 1 --2- 172.21.15.37:0/1730721817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f679406aa50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f67880097c0 tx=0x7f678801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827f68526b386f1a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f67927fc640 1 -- 172.21.15.37:0/1730721817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880ab650 con 0x7f67940b4340 2023-07-09T21:38:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f67927fc640 1 -- 172.21.15.37:0/1730721817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880ab7b0 con 0x7f67940b4340 2023-07-09T21:38:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f67927fc640 1 -- 172.21.15.37:0/1730721817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67880abb40 con 0x7f67940b4340 2023-07-09T21:38:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 -- 172.21.15.37:0/1730721817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 msgr2=0x7f679406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 --2- 172.21.15.37:0/1730721817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f679406aa50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f67880097c0 tx=0x7f678801c450 comp rx=0 tx=0).stop 2023-07-09T21:38:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 -- 172.21.15.37:0/1730721817 shutdown_connections 2023-07-09T21:38:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 --2- 172.21.15.37:0/1730721817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f679406aa50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 -- 172.21.15.37:0/1730721817 >> 172.21.15.37:0/1730721817 conn(0x7f6794073090 msgr2=0x7f6794069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 -- 172.21.15.37:0/1730721817 shutdown_connections 2023-07-09T21:38:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.771+0000 7f6799d37640 1 -- 172.21.15.37:0/1730721817 wait complete. 2023-07-09T21:38:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 Processor -- start 2023-07-09T21:38:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- start start 2023-07-09T21:38:09.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67940b7ab0 0x7f67940c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67940cef80 0x7f67940c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c7bf0 con 0x7f67940b4340 2023-07-09T21:38:09.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6794150020 con 0x7f67940cef80 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67940c8b40 con 0x7f67940b7ab0 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56278/0 (socket says 172.21.15.37:56278) 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 -- 172.21.15.37:0/3549892895 learned_addr learned my addr 172.21.15.37:0/3549892895 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 -- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67940b7ab0 msgr2=0x7f67940c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67940b7ab0 0x7f67940c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 -- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67940cef80 msgr2=0x7f67940c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67940cef80 0x7f67940c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 -- 172.21.15.37:0/3549892895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6788009420 con 0x7f67940b4340 2023-07-09T21:38:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f67937fe640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f678400c4a0 tx=0x7f678400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67840074e0 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6784007640 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6784004a30 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67940b3ac0 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67940b37e0 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.775+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679404d7d0 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.779+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6784004b90 con 0x7f67940b4340 2023-07-09T21:38:09.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.779+0000 7f677bfff640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 0x7f6780068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.779+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6864+0+0 (secure 0 0 0) 0x7f6784083300 con 0x7f67940b4340 2023-07-09T21:38:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.779+0000 7f6792ffd640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 0x7f6780068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:09.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.779+0000 7f6792ffd640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 0x7f6780068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67880af000 tx=0x7f6788008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:09.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.783+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6784053df0 con 0x7f67940b4340 2023-07-09T21:38:09.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.939+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f679406a830 con 0x7f67940b4340 2023-07-09T21:38:09.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.939+0000 7f677bfff640 1 -- 172.21.15.37:0/3549892895 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+19557 (secure 0 0 0) 0x7f6784053980 con 0x7f67940b4340 2023-07-09T21:38:09.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:09.943 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:06.874744+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:35:59.718392+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-07-09T21:36:00.596893+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":72,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.e","mappings":[{"from":0,"to":6}]},{"pgid":"8.28","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/2506503407":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/3135063437":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/4056762435":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2439510301":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2700601116":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/2232161020":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/2506503407":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/3086453693":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2377658735":"2023-07-10T21:38:06.874703+0000","172.21.15.119:6833/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:6832/1375084468":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/48663712":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/3666390931":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/730688049":"2023-07-10T21:38:06.874703+0000","172.21.15.119:0/609733224":"2023-07-10T21:36:19.799042+0000","172.21.15.119:0/2471493969":"2023-07-10T21:36:19.799042+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":8,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 msgr2=0x7f6780068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 0x7f6780068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f67880af000 tx=0x7f6788008040 comp rx=0 tx=0).stop 2023-07-09T21:38:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 msgr2=0x7f67940c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:09.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f678400c4a0 tx=0x7f678400c960 comp rx=0 tx=0).stop 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 shutdown_connections 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67800663d0 0x7f6780068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67940cef80 0x7f67940c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67940b7ab0 0x7f67940c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 --2- 172.21.15.37:0/3549892895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67940b4340 0x7f67940c8600 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 >> 172.21.15.37:0/3549892895 conn(0x7f6794073090 msgr2=0x7f6794069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 shutdown_connections 2023-07-09T21:38:09.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:09.943+0000 7f6799d37640 1 -- 172.21.15.37:0/3549892895 wait complete. 2023-07-09T21:38:09.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:38:10.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.111+0000 7fa13d2ec640 1 Processor -- start 2023-07-09T21:38:10.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.111+0000 7fa13d2ec640 1 -- start start 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa13d2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 0x7fa13815b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa13d2ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1380ca5d0 0x7fa13806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa13d2ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13806b280 con 0x7fa1380cf850 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa13d2ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa13806a670 con 0x7fa1380ca5d0 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa13d2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa13806a950 con 0x7fa13815b5c0 2023-07-09T21:38:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa1377fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa1380cf850 0x7fa1380b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:43302/0 (socket says 172.21.15.37:43302) 2023-07-09T21:38:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa1377fe640 1 -- 172.21.15.37:0/2199388638 learned_addr learned my addr 172.21.15.37:0/2199388638 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa136ffd640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 0x7fa13815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa12ffff640 1 --2- 172.21.15.37:0/2199388638 >> v2:172.21.15.119:3300/0 conn(0x7fa1380ca5d0 0x7fa13806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa1367fc640 1 -- 172.21.15.37:0/2199388638 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039670716 0 0) 0x7fa13806b280 con 0x7fa1380cf850 2023-07-09T21:38:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa1367fc640 1 -- 172.21.15.37:0/2199388638 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa124003530 con 0x7fa1380cf850 2023-07-09T21:38:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa12ffff640 1 -- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 msgr2=0x7fa13815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa12ffff640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 0x7fa13815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa12ffff640 1 -- 172.21.15.37:0/2199388638 >> v1:172.21.15.119:6789/0 conn(0x7fa1380cf850 legacy=0x7fa1380b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa12ffff640 1 -- 172.21.15.37:0/2199388638 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13806ac30 con 0x7fa1380ca5d0 2023-07-09T21:38:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.115+0000 7fa136ffd640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 0x7fa13815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa12ffff640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380ca5d0 0x7fa13806ecf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa1200097c0 tx=0x7fa12001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45893b90d3277731 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa1367fc640 1 -- 172.21.15.37:0/2199388638 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200ab670 con 0x7fa1380ca5d0 2023-07-09T21:38:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa1367fc640 1 -- 172.21.15.37:0/2199388638 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1200ab7d0 con 0x7fa1380ca5d0 2023-07-09T21:38:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa1367fc640 1 -- 172.21.15.37:0/2199388638 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1200abb60 con 0x7fa1380ca5d0 2023-07-09T21:38:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380ca5d0 msgr2=0x7fa13806ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380ca5d0 0x7fa13806ecf0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa1200097c0 tx=0x7fa12001c450 comp rx=0 tx=0).stop 2023-07-09T21:38:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2199388638 shutdown_connections 2023-07-09T21:38:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380ca5d0 0x7fa13806ecf0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2199388638 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa13815b5c0 0x7fa13815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2199388638 >> 172.21.15.37:0/2199388638 conn(0x7fa1380d0c10 msgr2=0x7fa138072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2199388638 shutdown_connections 2023-07-09T21:38:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2199388638 wait complete. 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 Processor -- start 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.119+0000 7fa13d2ec640 1 -- start start 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380cf850 0x7fa1380cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1381f71f0 con 0x7fa13815b5c0 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380c53c0 con 0x7fa1380cf850 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1380c5660 con 0x7fa1380ca5d0 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa12ffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380cf850 0x7fa1380cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56286/0 (socket says 172.21.15.37:56286) 2023-07-09T21:38:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa136ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:41356/0 (socket says 172.21.15.37:41356) 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 -- 172.21.15.37:0/2011923004 learned_addr learned my addr 172.21.15.37:0/2011923004 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 -- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 msgr2=0x7fa138158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 -- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380cf850 msgr2=0x7fa1380cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380cf850 0x7fa1380cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 -- 172.21.15.37:0/2011923004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128009420 con 0x7fa13815b5c0 2023-07-09T21:38:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa136ffd640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa1377fe640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa13000cb40 tx=0x7fa13000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13000aca0 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13000ae00 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130012620 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa120009420 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1380c5c20 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13804d7d0 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.123+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa130007070 con 0x7fa13815b5c0 2023-07-09T21:38:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.127+0000 7fa12f7fe640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 0x7fa118068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.127+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6836+0+0 (secure 0 0 0) 0x7fa130084100 con 0x7fa13815b5c0 2023-07-09T21:38:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.127+0000 7fa136ffd640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 0x7fa118068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.127+0000 7fa136ffd640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 0x7fa118068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa128011310 tx=0x7fa128009190 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.131+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa130051200 con 0x7fa13815b5c0 2023-07-09T21:38:10.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.319+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa1380b5f00 con 0x7fa13815b5c0 2023-07-09T21:38:10.323 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:38:10.319+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:38:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa12f7fe640 1 -- 172.21.15.37:0/2011923004 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa130017090 con 0x7fa13815b5c0 2023-07-09T21:38:10.328 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 msgr2=0x7fa118068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 0x7fa118068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa128011310 tx=0x7fa128009190 comp rx=0 tx=0).stop 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 msgr2=0x7fa1380cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fa13000cb40 tx=0x7fa13000a060 comp rx=0 tx=0).stop 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 shutdown_connections 2023-07-09T21:38:10.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fa1180663a0 0x7fa118068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13815b5c0 0x7fa1380cbee0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1380cf850 0x7fa1380cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 --2- 172.21.15.37:0/2011923004 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1380ca5d0 0x7fa138158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 >> 172.21.15.37:0/2011923004 conn(0x7fa1380d0c10 msgr2=0x7fa1380ca9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 shutdown_connections 2023-07-09T21:38:10.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.327+0000 7fa13d2ec640 1 -- 172.21.15.37:0/2011923004 wait complete. 2023-07-09T21:38:10.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:38:10.394 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:38:10.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.495+0000 7f1440cd8640 1 Processor -- start 2023-07-09T21:38:10.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.495+0000 7f1440cd8640 1 -- start start 2023-07-09T21:38:10.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1440cd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0cf290 0x7f143c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1440cd8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f143c0d0780 0x7f143c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1440cd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c15bf80 con 0x7f143c0b7980 2023-07-09T21:38:10.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1440cd8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c0cd070 con 0x7f143c0d0780 2023-07-09T21:38:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1440cd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0cfd70 con 0x7f143c0cf290 2023-07-09T21:38:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f143c0b7980 0x7f143c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45770/0 (socket says 172.21.15.37:45770) 2023-07-09T21:38:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143a59c640 1 -- 172.21.15.37:0/1309258426 learned_addr learned my addr 172.21.15.37:0/1309258426 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143ad9d640 1 --2- 172.21.15.37:0/1309258426 >> v2:172.21.15.37:3300/0 conn(0x7f143c0d0780 0x7f143c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1433fff640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0cf290 0x7f143c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143ad9d640 1 -- 172.21.15.37:0/1309258426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0cf290 msgr2=0x7f143c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:10.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143ad9d640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0cf290 0x7f143c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f1439d9b640 1 -- 172.21.15.37:0/1309258426 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630857701 0 0) 0x7f142c001120 con 0x7f143c0b7980 2023-07-09T21:38:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143ad9d640 1 -- 172.21.15.37:0/1309258426 >> v1:172.21.15.37:6789/0 conn(0x7f143c0b7980 legacy=0x7f143c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.499+0000 7f143ad9d640 1 -- 172.21.15.37:0/1309258426 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c160570 con 0x7f143c0d0780 2023-07-09T21:38:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f143ad9d640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0d0780 0x7f143c0d0c00 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1434009d90 tx=0x7f143401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aeec04235676111 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1439d9b640 1 -- 172.21.15.37:0/1309258426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340a5810 con 0x7f143c0d0780 2023-07-09T21:38:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1439d9b640 1 -- 172.21.15.37:0/1309258426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14340a5970 con 0x7f143c0d0780 2023-07-09T21:38:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1439d9b640 1 -- 172.21.15.37:0/1309258426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14340a5d00 con 0x7f143c0d0780 2023-07-09T21:38:10.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- 172.21.15.37:0/1309258426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0d0780 msgr2=0x7f143c0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0d0780 0x7f143c0d0c00 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1434009d90 tx=0x7f143401c950 comp rx=0 tx=0).stop 2023-07-09T21:38:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- 172.21.15.37:0/1309258426 shutdown_connections 2023-07-09T21:38:10.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0d0780 0x7f143c0d0c00 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 --2- 172.21.15.37:0/1309258426 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0cf290 0x7f143c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- 172.21.15.37:0/1309258426 >> 172.21.15.37:0/1309258426 conn(0x7f143c073090 msgr2=0x7f143c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- 172.21.15.37:0/1309258426 shutdown_connections 2023-07-09T21:38:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- 172.21.15.37:0/1309258426 wait complete. 2023-07-09T21:38:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 Processor -- start 2023-07-09T21:38:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.503+0000 7f1440cd8640 1 -- start start 2023-07-09T21:38:10.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 0x7f143c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f143c0d0780 0x7f143c15b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c15ad90 con 0x7f143c0cf290 2023-07-09T21:38:10.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c152360 con 0x7f143c0d0780 2023-07-09T21:38:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c15a180 con 0x7f143c0b7980 2023-07-09T21:38:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56316/0 (socket says 172.21.15.37:56316) 2023-07-09T21:38:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 -- 172.21.15.37:0/2702047348 learned_addr learned my addr 172.21.15.37:0/2702047348 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f143a59c640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 0x7f143c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f143ad9d640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f143c0d0780 0x7f143c15b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 -- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 msgr2=0x7f143c151e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 0x7f143c151e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 -- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f143c0d0780 msgr2=0x7f143c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f143c0d0780 0x7f143c15b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 -- 172.21.15.37:0/2702047348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434009a70 con 0x7f143c0cf290 2023-07-09T21:38:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f143a59c640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 0x7f143c151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:10.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1433fff640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f142400e960 tx=0x7f142400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424009690 con 0x7f143c0cf290 2023-07-09T21:38:10.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142400ca00 con 0x7f143c0cf290 2023-07-09T21:38:10.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142400cd70 con 0x7f143c0cf290 2023-07-09T21:38:10.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c15a460 con 0x7f143c0cf290 2023-07-09T21:38:10.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c15aa20 con 0x7f143c0cf290 2023-07-09T21:38:10.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.507+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c04d7d0 con 0x7f143c0cf290 2023-07-09T21:38:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.511+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1424013470 con 0x7f143c0cf290 2023-07-09T21:38:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.511+0000 7f1432ffd640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 0x7f141c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.511+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f14240843a0 con 0x7f143c0cf290 2023-07-09T21:38:10.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.511+0000 7f143a59c640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 0x7f141c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.511+0000 7f143a59c640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 0x7f141c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f142c000f70 tx=0x7f142c007df0 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:10.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.515+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1424051470 con 0x7f143c0cf290 2023-07-09T21:38:10.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:10.703+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f143c0b1600 con 0x7f143c0cf290 2023-07-09T21:38:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1432ffd640 1 -- 172.21.15.37:0/2702047348 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1424054a90 con 0x7f143c0cf290 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 msgr2=0x7f141c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 0x7f141c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f142c000f70 tx=0x7f142c007df0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 msgr2=0x7f143c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f142400e960 tx=0x7f142400ee20 comp rx=0 tx=0).stop 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 shutdown_connections 2023-07-09T21:38:11.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f141c0663a0 0x7f141c068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f143c0d0780 0x7f143c15b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f143c0cf290 0x7f143c0b44e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 --2- 172.21.15.37:0/2702047348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f143c0b7980 0x7f143c151e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 >> 172.21.15.37:0/2702047348 conn(0x7f143c073090 msgr2=0x7f143c15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 shutdown_connections 2023-07-09T21:38:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.335+0000 7f1440cd8640 1 -- 172.21.15.37:0/2702047348 wait complete. 2023-07-09T21:38:11.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:38:11.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 Processor -- start 2023-07-09T21:38:11.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 -- start start 2023-07-09T21:38:11.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e38160030 0x7f9e380d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3815bf80 con 0x7f9e380cf290 2023-07-09T21:38:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380d02f0 con 0x7f9e380b7980 2023-07-09T21:38:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3f619640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cd070 con 0x7f9e38160030 2023-07-09T21:38:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3cbb4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e380cf290 0x7f9e380d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45782/0 (socket says 172.21.15.37:45782) 2023-07-09T21:38:11.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3cbb4640 1 -- 172.21.15.37:0/2014525146 learned_addr learned my addr 172.21.15.37:0/2014525146 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3dbb6640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e38160030 0x7f9e380d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952591924 0 0) 0x7f9e28001120 con 0x7f9e380cf290 2023-07-09T21:38:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003530 con 0x7f9e380cf290 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3141167983 0 0) 0x7f9e380d02f0 con 0x7f9e380b7980 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e28001120 con 0x7f9e380b7980 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2975429776 0 0) 0x7f9e24003530 con 0x7f9e380cf290 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e38160030 msgr2=0x7f9e380d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e38160030 0x7f9e380d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 >> v1:172.21.15.119:6789/0 conn(0x7f9e380b7980 legacy=0x7f9e380ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cc7f0 con 0x7f9e380cf290 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f9e28001810 con 0x7f9e380cf290 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3dbb6640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e38160030 0x7f9e380d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 >> v1:172.21.15.37:6789/0 conn(0x7f9e380cf290 legacy=0x7f9e380d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24003b40 0x7f9e24003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e240047d0 0x7f9e24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e24005180 0x7f9e2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cd070 con 0x7f9e24003b40 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400bf50 con 0x7f9e24005180 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400c110 con 0x7f9e240047d0 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24003b40 0x7f9e24003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3cbb4640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e240047d0 0x7f9e24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3dbb6640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e24005180 0x7f9e2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 -- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e240047d0 msgr2=0x7f9e24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e240047d0 0x7f9e24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 -- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e24005180 msgr2=0x7f9e2400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e24005180 0x7f9e2400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3d3b5640 1 -- 172.21.15.37:0/2014525146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24003530 con 0x7f9e24003b40 2023-07-09T21:38:11.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.559+0000 7f9e3cbb4640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e240047d0 0x7f9e24004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24003b40 0x7f9e24003f30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9e340018d0 tx=0x7f9e3401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ec410a6f96ec91 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340052d0 con 0x7f9e24003b40 2023-07-09T21:38:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e340a7050 con 0x7f9e24003b40 2023-07-09T21:38:11.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e2ffff640 1 -- 172.21.15.37:0/2014525146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34003600 con 0x7f9e24003b40 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 -- 172.21.15.37:0/2014525146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24003b40 msgr2=0x7f9e24003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 --2- 172.21.15.37:0/2014525146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e24003b40 0x7f9e24003f30 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9e340018d0 tx=0x7f9e3401c4a0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3dbb6640 1 -- 172.21.15.37:0/2014525146 reap_dead start 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 -- 172.21.15.37:0/2014525146 shutdown_connections 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 -- 172.21.15.37:0/2014525146 >> 172.21.15.37:0/2014525146 conn(0x7f9e38073090 msgr2=0x7f9e38069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:11.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 -- 172.21.15.37:0/2014525146 shutdown_connections 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.563+0000 7f9e3f619640 1 -- 172.21.15.37:0/2014525146 wait complete. 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 Processor -- start 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- start start 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e24003b40 0x7f9e381653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 0x7f9e380b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380cb960 con 0x7f9e380cc3d0 2023-07-09T21:38:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38155700 con 0x7f9e38154ef0 2023-07-09T21:38:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c9380 con 0x7f9e24003b40 2023-07-09T21:38:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56332/0 (socket says 172.21.15.37:56332) 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 -- 172.21.15.37:0/3225768925 learned_addr learned my addr 172.21.15.37:0/3225768925 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e24003b40 0x7f9e381653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3dbb6640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 0x7f9e380b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 -- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e24003b40 msgr2=0x7f9e381653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e24003b40 0x7f9e381653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 -- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 msgr2=0x7f9e380b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 0x7f9e380b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 -- 172.21.15.37:0/3225768925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cbbd0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3dbb6640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 0x7f9e380b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3cbb4640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005fd0 tx=0x7f9e2800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800c8d0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800ca30 con 0x7f9e380cc3d0 2023-07-09T21:38:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800cde0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380cbeb0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.567+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38154c00 con 0x7f9e380cc3d0 2023-07-09T21:38:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e380cb7c0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e2801d460 con 0x7f9e380cc3d0 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e2dffb640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 0x7f9e1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6894+0+0 (secure 0 0 0) 0x7f9e28083fa0 con 0x7f9e380cc3d0 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 0x7f9e1c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.571+0000 7f9e3d3b5640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 0x7f9e1c068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ac000 tx=0x7f9e340a6000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:11.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.575+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e280b4700 con 0x7f9e380cc3d0 2023-07-09T21:38:11.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:11.727+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e3815bf80 con 0x7f9e380cc3d0 2023-07-09T21:38:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.335+0000 7f9e2dffb640 1 -- 172.21.15.37:0/3225768925 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9e3815bf80 con 0x7f9e380cc3d0 2023-07-09T21:38:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:38:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 msgr2=0x7f9e1c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 0x7f9e1c068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e340ac000 tx=0x7f9e340a6000 comp rx=0 tx=0).stop 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 msgr2=0x7f9e381546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9e28005fd0 tx=0x7f9e2800ec80 comp rx=0 tx=0).stop 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 shutdown_connections 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9e1c0663d0 0x7f9e1c068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e38154ef0 0x7f9e380b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e380cc3d0 0x7f9e381546c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 --2- 172.21.15.37:0/3225768925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e24003b40 0x7f9e381653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 >> 172.21.15.37:0/3225768925 conn(0x7f9e38073090 msgr2=0x7f9e380d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 shutdown_connections 2023-07-09T21:38:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.339+0000 7f9e3f619640 1 -- 172.21.15.37:0/3225768925 wait complete. 2023-07-09T21:38:12.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:38:12.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 Processor -- start 2023-07-09T21:38:12.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 -- start start 2023-07-09T21:38:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1780b7980 0x7fb178160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb1780ceb80 0x7fb1780cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb17815bf80 con 0x7fb1780b3c20 2023-07-09T21:38:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780cd070 con 0x7fb1780b7980 2023-07-09T21:38:12.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb18011e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780cfd70 con 0x7fb1780ceb80 2023-07-09T21:38:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1780b7980 0x7fb178160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1780b7980 0x7fb178160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56338/0 (socket says 172.21.15.37:56338) 2023-07-09T21:38:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 -- 172.21.15.37:0/1723832236 learned_addr learned my addr 172.21.15.37:0/1723832236 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17e6bb640 1 --1- 172.21.15.37:0/1723832236 >> v1:172.21.15.37:6789/0 conn(0x7fb1780b3c20 0x7fb1780b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45796/0 (socket says 172.21.15.37:45796) 2023-07-09T21:38:12.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17d6b9640 1 --2- 172.21.15.37:0/1723832236 >> v2:172.21.15.119:3300/0 conn(0x7fb1780ceb80 0x7fb1780cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 -- 172.21.15.37:0/1723832236 >> v2:172.21.15.119:3300/0 conn(0x7fb1780ceb80 msgr2=0x7fb1780cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 --2- 172.21.15.37:0/1723832236 >> v2:172.21.15.119:3300/0 conn(0x7fb1780ceb80 0x7fb1780cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 -- 172.21.15.37:0/1723832236 >> v1:172.21.15.37:6789/0 conn(0x7fb1780b3c20 legacy=0x7fb1780b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17ceb8640 1 -- 172.21.15.37:0/1723832236 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861541307 0 0) 0x7fb1700014a0 con 0x7fb1780b3c20 2023-07-09T21:38:12.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.523+0000 7fb17deba640 1 -- 172.21.15.37:0/1723832236 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178160570 con 0x7fb1780b7980 2023-07-09T21:38:12.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb17deba640 1 --2- 172.21.15.37:0/1723832236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb178160030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b4cd0 tx=0x7fb17401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cab291e3f869881 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb17ceb8640 1 -- 172.21.15.37:0/1723832236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740ab600 con 0x7fb1780b7980 2023-07-09T21:38:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb17ceb8640 1 -- 172.21.15.37:0/1723832236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740a7050 con 0x7fb1780b7980 2023-07-09T21:38:12.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb17ceb8640 1 -- 172.21.15.37:0/1723832236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740ab980 con 0x7fb1780b7980 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 -- 172.21.15.37:0/1723832236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 msgr2=0x7fb178160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 --2- 172.21.15.37:0/1723832236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb178160030 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b4cd0 tx=0x7fb17401c500 comp rx=0 tx=0).stop 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 -- 172.21.15.37:0/1723832236 shutdown_connections 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 --2- 172.21.15.37:0/1723832236 >> v2:172.21.15.119:3300/0 conn(0x7fb1780ceb80 0x7fb1780cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 --2- 172.21.15.37:0/1723832236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb178160030 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 -- 172.21.15.37:0/1723832236 >> 172.21.15.37:0/1723832236 conn(0x7fb178073090 msgr2=0x7fb178069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 -- 172.21.15.37:0/1723832236 shutdown_connections 2023-07-09T21:38:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.527+0000 7fb18011e640 1 -- 172.21.15.37:0/1723832236 wait complete. 2023-07-09T21:38:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 Processor -- start 2023-07-09T21:38:12.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- start start 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b3c20 0x7fb178154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780ceb80 0x7fb1780d2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c7990 con 0x7fb1780b7980 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c66b0 con 0x7fb1780ceb80 2023-07-09T21:38:12.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780cc030 con 0x7fb1780b3c20 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56350/0 (socket says 172.21.15.37:56350) 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 -- 172.21.15.37:0/1104858962 learned_addr learned my addr 172.21.15.37:0/1104858962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17deba640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b3c20 0x7fb178154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17e6bb640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780ceb80 0x7fb1780d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 -- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b3c20 msgr2=0x7fb178154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b3c20 0x7fb178154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 -- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780ceb80 msgr2=0x7fb1780d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780ceb80 0x7fb1780d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:12.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 -- 172.21.15.37:0/1104858962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740094d0 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb17d6b9640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb16800e870 tx=0x7fb16800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168009510 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb16800eec0 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb16800cb40 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780c5d70 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.531+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780c6050 con 0x7fb1780b7980 2023-07-09T21:38:12.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17804d7d0 con 0x7fb1780b7980 2023-07-09T21:38:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb16800cca0 con 0x7fb1780b7980 2023-07-09T21:38:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb16e7fc640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 0x7fb15c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6456+0+0 (secure 0 0 0) 0x7fb168084040 con 0x7fb1780b7980 2023-07-09T21:38:12.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb17deba640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 0x7fb15c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:12.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.535+0000 7fb17deba640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 0x7fb15c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1740ad000 tx=0x7fb174008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:12.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.539+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1680512b0 con 0x7fb1780b7980 2023-07-09T21:38:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:12.695+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1780b1600 con 0x7fb1780b7980 2023-07-09T21:38:13.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.347+0000 7fb16e7fc640 1 -- 172.21.15.37:0/1104858962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb1680548d0 con 0x7fb1780b7980 2023-07-09T21:38:13.350 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:38:13.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 msgr2=0x7fb15c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 0x7fb15c068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb1740ad000 tx=0x7fb174008040 comp rx=0 tx=0).stop 2023-07-09T21:38:13.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 msgr2=0x7fb1780d2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb16800e870 tx=0x7fb16800ec70 comp rx=0 tx=0).stop 2023-07-09T21:38:13.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 shutdown_connections 2023-07-09T21:38:13.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb15c0663a0 0x7fb15c068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780ceb80 0x7fb1780d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b7980 0x7fb1780d2310 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 --2- 172.21.15.37:0/1104858962 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b3c20 0x7fb178154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 >> 172.21.15.37:0/1104858962 conn(0x7fb178073090 msgr2=0x7fb1780b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 shutdown_connections 2023-07-09T21:38:13.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.351+0000 7fb18011e640 1 -- 172.21.15.37:0/1104858962 wait complete. 2023-07-09T21:38:13.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:38:13.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.523+0000 7f5dc1f3a640 1 Processor -- start 2023-07-09T21:38:13.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.523+0000 7f5dc1f3a640 1 -- start start 2023-07-09T21:38:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dc1f3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 0x7f5dbc0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dc1f3a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 0x7f5dbc0c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dc1f3a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dbc0c4c90 con 0x7f5dbc15dd10 2023-07-09T21:38:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dc1f3a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc0ca730 con 0x7f5dbc159990 2023-07-09T21:38:13.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dc1f3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0c9f20 con 0x7f5dbc1595c0 2023-07-09T21:38:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbb7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 0x7f5dbc0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5db3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 0x7f5dbc0c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbbfff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5dbc15dd10 0x7f5dbc0cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:43338/0 (socket says 172.21.15.37:43338) 2023-07-09T21:38:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbbfff640 1 -- 172.21.15.37:0/3319444769 learned_addr learned my addr 172.21.15.37:0/3319444769 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/3319444769 >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 msgr2=0x7f5dbc0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:13.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbb7fe640 1 --2- 172.21.15.37:0/3319444769 >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 0x7f5dbc0c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/3319444769 >> v1:172.21.15.119:6789/0 conn(0x7f5dbc15dd10 legacy=0x7f5dbc0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/3319444769 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0ca170 con 0x7f5dbc1595c0 2023-07-09T21:38:13.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.527+0000 7f5db3fff640 1 --2- 172.21.15.37:0/3319444769 >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 0x7f5dbc0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dbb7fe640 1 --2- 172.21.15.37:0/3319444769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 0x7f5dbc0c4750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097c0 tx=0x7f5dac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a78f42e33ea637ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dbaffd640 1 -- 172.21.15.37:0/3319444769 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0ab650 con 0x7f5dbc1595c0 2023-07-09T21:38:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dbaffd640 1 -- 172.21.15.37:0/3319444769 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac0ab7b0 con 0x7f5dbc1595c0 2023-07-09T21:38:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dbaffd640 1 -- 172.21.15.37:0/3319444769 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0abb40 con 0x7f5dbc1595c0 2023-07-09T21:38:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/3319444769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 msgr2=0x7f5dbc0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/3319444769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 0x7f5dbc0c4750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0097c0 tx=0x7f5dac01c450 comp rx=0 tx=0).stop 2023-07-09T21:38:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/3319444769 shutdown_connections 2023-07-09T21:38:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/3319444769 >> v2:172.21.15.119:3300/0 conn(0x7f5dbc159990 0x7f5dbc0c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/3319444769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc1595c0 0x7f5dbc0c4750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/3319444769 >> 172.21.15.37:0/3319444769 conn(0x7f5dbc0cde40 msgr2=0x7f5dbc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/3319444769 shutdown_connections 2023-07-09T21:38:13.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/3319444769 wait complete. 2023-07-09T21:38:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 Processor -- start 2023-07-09T21:38:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.531+0000 7f5dc1f3a640 1 -- start start 2023-07-09T21:38:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 0x7f5dbc0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 0x7f5dbc152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc1545a0 con 0x7f5dbc1595c0 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0b12d0 con 0x7f5dbc15dd10 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc0c5f30 con 0x7f5dbc159990 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56354/0 (socket says 172.21.15.37:56354) 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/1883781465 learned_addr learned my addr 172.21.15.37:0/1883781465 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbbfff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 0x7f5dbc152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db3fff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 0x7f5dbc0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 msgr2=0x7f5dbc0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 0x7f5dbc0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 msgr2=0x7f5dbc152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 0x7f5dbc152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 -- 172.21.15.37:0/1883781465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da4009420 con 0x7f5dbc1595c0 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbbfff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 0x7f5dbc152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db3fff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 0x7f5dbc0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dbb7fe640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ad040 tx=0x7f5dac01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0b5810 con 0x7f5dbc1595c0 2023-07-09T21:38:13.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac0b5990 con 0x7f5dbc1595c0 2023-07-09T21:38:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0b5d40 con 0x7f5dbc1595c0 2023-07-09T21:38:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac009420 con 0x7f5dbc1595c0 2023-07-09T21:38:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc153b20 con 0x7f5dbc1595c0 2023-07-09T21:38:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc04d7d0 con 0x7f5dbc1595c0 2023-07-09T21:38:13.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.535+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5dac0b4390 con 0x7f5dbc1595c0 2023-07-09T21:38:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.539+0000 7f5db8ff9640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 0x7f5d9c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.539+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f5dac11e750 con 0x7f5dbc1595c0 2023-07-09T21:38:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.539+0000 7f5db3fff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 0x7f5d9c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.539+0000 7f5db3fff640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 0x7f5d9c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc1f7910 tx=0x7f5da4008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.543+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5dac0ebbb0 con 0x7f5dbc1595c0 2023-07-09T21:38:13.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.703+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5dbc153b20 con 0x7f5dbc1595c0 2023-07-09T21:38:13.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.707+0000 7f5db8ff9640 1 -- 172.21.15.37:0/1883781465 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5dbc153b20 con 0x7f5dbc1595c0 2023-07-09T21:38:13.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 msgr2=0x7f5d9c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 0x7f5d9c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc1f7910 tx=0x7f5da4008040 comp rx=0 tx=0).stop 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 msgr2=0x7f5dbc0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ad040 tx=0x7f5dac01ac90 comp rx=0 tx=0).stop 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 shutdown_connections 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f5d9c0663a0 0x7f5d9c068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5dbc15dd10 0x7f5dbc152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5dbc159990 0x7f5dbc0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 --2- 172.21.15.37:0/1883781465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5dbc1595c0 0x7f5dbc0c8110 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 >> 172.21.15.37:0/1883781465 conn(0x7f5dbc0cde40 msgr2=0x7f5dbc0c3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 shutdown_connections 2023-07-09T21:38:13.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.711+0000 7f5dc1f3a640 1 -- 172.21.15.37:0/1883781465 wait complete. 2023-07-09T21:38:13.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:38:13.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 Processor -- start 2023-07-09T21:38:13.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 -- start start 2023-07-09T21:38:13.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24080b7980 0x7f2408160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24080ceb80 0x7f24080cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f240815bf80 con 0x7f24080b3c20 2023-07-09T21:38:13.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24080cd070 con 0x7f24080ceb80 2023-07-09T21:38:13.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f241040b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24080cfd70 con 0x7f24080b7980 2023-07-09T21:38:13.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24080ceb80 0x7f24080cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24080ceb80 0x7f24080cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56364/0 (socket says 172.21.15.37:56364) 2023-07-09T21:38:13.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 -- 172.21.15.37:0/3146027459 learned_addr learned my addr 172.21.15.37:0/3146027459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:13.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240e1a7640 1 --2- 172.21.15.37:0/3146027459 >> v2:172.21.15.119:3300/0 conn(0x7f24080b7980 0x7f2408160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 -- 172.21.15.37:0/3146027459 >> v2:172.21.15.119:3300/0 conn(0x7f24080b7980 msgr2=0x7f2408160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:13.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 --2- 172.21.15.37:0/3146027459 >> v2:172.21.15.119:3300/0 conn(0x7f24080b7980 0x7f2408160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 -- 172.21.15.37:0/3146027459 >> v1:172.21.15.37:6789/0 conn(0x7f24080b3c20 legacy=0x7f24080b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d9a6640 1 -- 172.21.15.37:0/3146027459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2408160570 con 0x7f24080ceb80 2023-07-09T21:38:13.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.875+0000 7f240d1a5640 1 -- 172.21.15.37:0/3146027459 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075229887 0 0) 0x7f24000014a0 con 0x7f24080b3c20 2023-07-09T21:38:13.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f240d9a6640 1 --2- 172.21.15.37:0/3146027459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f24080cefc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2408069aa0 tx=0x7f23f801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f081c3e5ecc51b52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f240d1a5640 1 -- 172.21.15.37:0/3146027459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80ab600 con 0x7f24080ceb80 2023-07-09T21:38:13.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f240d1a5640 1 -- 172.21.15.37:0/3146027459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f80a7050 con 0x7f24080ceb80 2023-07-09T21:38:13.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f240d1a5640 1 -- 172.21.15.37:0/3146027459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f80ab980 con 0x7f24080ceb80 2023-07-09T21:38:13.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 -- 172.21.15.37:0/3146027459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 msgr2=0x7f24080cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 --2- 172.21.15.37:0/3146027459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f24080cefc0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2408069aa0 tx=0x7f23f801c500 comp rx=0 tx=0).stop 2023-07-09T21:38:13.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 -- 172.21.15.37:0/3146027459 shutdown_connections 2023-07-09T21:38:13.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 --2- 172.21.15.37:0/3146027459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f24080cefc0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 --2- 172.21.15.37:0/3146027459 >> v2:172.21.15.119:3300/0 conn(0x7f24080b7980 0x7f2408160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 -- 172.21.15.37:0/3146027459 >> 172.21.15.37:0/3146027459 conn(0x7f2408073090 msgr2=0x7f2408069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 -- 172.21.15.37:0/3146027459 shutdown_connections 2023-07-09T21:38:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.879+0000 7f241040b640 1 -- 172.21.15.37:0/3146027459 wait complete. 2023-07-09T21:38:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 Processor -- start 2023-07-09T21:38:13.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- start start 2023-07-09T21:38:13.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24080b3c20 0x7f24081555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24080b7980 0x7f240815e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080c9310 con 0x7f24080ceb80 2023-07-09T21:38:13.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24080c95f0 con 0x7f24080b7980 2023-07-09T21:38:13.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24080c98d0 con 0x7f24080b3c20 2023-07-09T21:38:13.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56366/0 (socket says 172.21.15.37:56366) 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 -- 172.21.15.37:0/1508460228 learned_addr learned my addr 172.21.15.37:0/1508460228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e1a7640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24080b3c20 0x7f24081555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240d9a6640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24080b7980 0x7f240815e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 -- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24080b3c20 msgr2=0x7f24081555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24080b3c20 0x7f24081555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 -- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24080b7980 msgr2=0x7f240815e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24080b7980 0x7f240815e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 -- 172.21.15.37:0/1508460228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f80094d0 con 0x7f24080ceb80 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f240e9a8640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f240000c780 tx=0x7f240000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2400003db0 con 0x7f24080ceb80 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240000ce90 con 0x7f24080ceb80 2023-07-09T21:38:13.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24000052b0 con 0x7f24080ceb80 2023-07-09T21:38:13.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24080c9bb0 con 0x7f24080ceb80 2023-07-09T21:38:13.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24080b1f00 con 0x7f24080ceb80 2023-07-09T21:38:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.883+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f240804d7d0 con 0x7f24080ceb80 2023-07-09T21:38:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.887+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2400005410 con 0x7f24080ceb80 2023-07-09T21:38:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.887+0000 7f23feffd640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 0x7f23ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:13.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.887+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2400083bc0 con 0x7f24080ceb80 2023-07-09T21:38:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.887+0000 7f240e1a7640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 0x7f23ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.887+0000 7f240e1a7640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 0x7f23ec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f240400b9d0 tx=0x7f2404008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:13.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:13.891+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2400050f00 con 0x7f24080ceb80 2023-07-09T21:38:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.059+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f240815bf60 con 0x7f24080ceb80 2023-07-09T21:38:14.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f23feffd640 1 -- 172.21.15.37:0/1508460228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v20) v1 ==== 120+0+0 (secure 0 0 0) 0x7f2400054520 con 0x7f24080ceb80 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 msgr2=0x7f23ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 0x7f23ec068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f240400b9d0 tx=0x7f2404008040 comp rx=0 tx=0).stop 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 msgr2=0x7f240815ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f240000c780 tx=0x7f240000cc40 comp rx=0 tx=0).stop 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 shutdown_connections 2023-07-09T21:38:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f23ec0663a0 0x7f23ec068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24080ceb80 0x7f240815ec70 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24080b7980 0x7f240815e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 --2- 172.21.15.37:0/1508460228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24080b3c20 0x7f24081555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 >> 172.21.15.37:0/1508460228 conn(0x7f2408073090 msgr2=0x7f24080b3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 shutdown_connections 2023-07-09T21:38:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.067+0000 7f241040b640 1 -- 172.21.15.37:0/1508460228 wait complete. 2023-07-09T21:38:14.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:38:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.231+0000 7f28ee1ac640 1 Processor -- start 2023-07-09T21:38:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.231+0000 7f28ee1ac640 1 -- start start 2023-07-09T21:38:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28ee1ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80b7980 0x7f28e8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28ee1ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28e80ceb80 0x7f28e80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28ee1ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e815bf80 con 0x7f28e80b3c20 2023-07-09T21:38:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28ee1ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e80cd070 con 0x7f28e80ceb80 2023-07-09T21:38:14.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28ee1ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e80cfd70 con 0x7f28e80b7980 2023-07-09T21:38:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f28e80ceb80 0x7f28e80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28e80b3c20 0x7f28e80b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45818/0 (socket says 172.21.15.37:45818) 2023-07-09T21:38:14.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e7fff640 1 -- 172.21.15.37:0/1320774911 learned_addr learned my addr 172.21.15.37:0/1320774911 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e77fe640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80b7980 0x7f28e8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 -- 172.21.15.37:0/1320774911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80b7980 msgr2=0x7f28e8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80b7980 0x7f28e8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 -- 172.21.15.37:0/1320774911 >> v1:172.21.15.37:6789/0 conn(0x7f28e80b3c20 legacy=0x7f28e80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 -- 172.21.15.37:0/1320774911 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e8160570 con 0x7f28e80ceb80 2023-07-09T21:38:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.235+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80ceb80 0x7f28e80cef90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097c0 tx=0x7f28dc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd65e92de60538a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28e67fc640 1 -- 172.21.15.37:0/1320774911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0ab600 con 0x7f28e80ceb80 2023-07-09T21:38:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28e67fc640 1 -- 172.21.15.37:0/1320774911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc0a7050 con 0x7f28e80ceb80 2023-07-09T21:38:14.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28e67fc640 1 -- 172.21.15.37:0/1320774911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc0ab980 con 0x7f28e80ceb80 2023-07-09T21:38:14.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1320774911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80ceb80 msgr2=0x7f28e80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80ceb80 0x7f28e80cef90 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0097c0 tx=0x7f28dc01c480 comp rx=0 tx=0).stop 2023-07-09T21:38:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1320774911 shutdown_connections 2023-07-09T21:38:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80ceb80 0x7f28e80cef90 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1320774911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80b7980 0x7f28e8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1320774911 >> 172.21.15.37:0/1320774911 conn(0x7f28e8073090 msgr2=0x7f28e8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1320774911 shutdown_connections 2023-07-09T21:38:14.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1320774911 wait complete. 2023-07-09T21:38:14.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 Processor -- start 2023-07-09T21:38:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- start start 2023-07-09T21:38:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 0x7f28e815e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80ceb80 0x7f28e80b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815efe0 con 0x7f28e80b3c20 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815c250 con 0x7f28e80b7980 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28ee1ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e815c530 con 0x7f28e80ceb80 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.239+0000 7f28e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56388/0 (socket says 172.21.15.37:56388) 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 -- 172.21.15.37:0/1946598096 learned_addr learned my addr 172.21.15.37:0/1946598096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:14.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 0x7f28e815e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e7fff640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80ceb80 0x7f28e80b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 -- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80ceb80 msgr2=0x7f28e80b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80ceb80 0x7f28e80b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 -- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 msgr2=0x7f28e815e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 0x7f28e815e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 -- 172.21.15.37:0/1946598096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc009420 con 0x7f28e80b3c20 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 0x7f28e815e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:14.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28e77fe640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e930 tx=0x7f28d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d8009690 con 0x7f28e80b3c20 2023-07-09T21:38:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d800ca00 con 0x7f28e80b3c20 2023-07-09T21:38:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e815c810 con 0x7f28e80b3c20 2023-07-09T21:38:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d800cd70 con 0x7f28e80b3c20 2023-07-09T21:38:14.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e80d1df0 con 0x7f28e80b3c20 2023-07-09T21:38:14.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e804d7d0 con 0x7f28e80b3c20 2023-07-09T21:38:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f28d8013470 con 0x7f28e80b3c20 2023-07-09T21:38:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.243+0000 7f28cffff640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 0x7f28d4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.247+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f28d8084060 con 0x7f28e80b3c20 2023-07-09T21:38:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.247+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 0x7f28d4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.247+0000 7f28e6ffd640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 0x7f28d4068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0ad000 tx=0x7f28dc0a6000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.247+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28d8051570 con 0x7f28e80b3c20 2023-07-09T21:38:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.403+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f28e80b1600 con 0x7f28e80b3c20 2023-07-09T21:38:14.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28cffff640 1 -- 172.21.15.37:0/1946598096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v21) v1 ==== 115+0+0 (secure 0 0 0) 0x7f28d8054b90 con 0x7f28e80b3c20 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 msgr2=0x7f28d4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 0x7f28d4068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f28dc0ad000 tx=0x7f28dc0a6000 comp rx=0 tx=0).stop 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 msgr2=0x7f28e8154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f28d800e930 tx=0x7f28d800edf0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 shutdown_connections 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f28d40663a0 0x7f28d4068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28e80ceb80 0x7f28e80b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28e80b7980 0x7f28e815e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 --2- 172.21.15.37:0/1946598096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28e80b3c20 0x7f28e8154470 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 >> 172.21.15.37:0/1946598096 conn(0x7f28e8073090 msgr2=0x7f28e80b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 shutdown_connections 2023-07-09T21:38:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.411+0000 7f28ee1ac640 1 -- 172.21.15.37:0/1946598096 wait complete. 2023-07-09T21:38:14.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2023-07-09T21:38:14.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.571+0000 7f7519f9f640 1 Processor -- start 2023-07-09T21:38:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 -- start start 2023-07-09T21:38:14.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7514158670 0x7f75140ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75140aff40 0x7f751415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f751406efc0 con 0x7f751406b120 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751406d390 con 0x7f75140aff40 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7519f9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751406f4f0 con 0x7f7514158670 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7512ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f751406b120 0x7f75140af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45820/0 (socket says 172.21.15.37:45820) 2023-07-09T21:38:14.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7512ffd640 1 -- 172.21.15.37:0/4096767411 learned_addr learned my addr 172.21.15.37:0/4096767411 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:14.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7513fff640 1 --2- 172.21.15.37:0/4096767411 >> v2:172.21.15.37:3300/0 conn(0x7f75140aff40 0x7f751415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f75137fe640 1 --2- 172.21.15.37:0/4096767411 >> v2:172.21.15.119:3300/0 conn(0x7f7514158670 0x7f75140ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f75127fc640 1 -- 172.21.15.37:0/4096767411 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991133537 0 0) 0x7f751406efc0 con 0x7f751406b120 2023-07-09T21:38:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f75127fc640 1 -- 172.21.15.37:0/4096767411 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74fc003530 con 0x7f751406b120 2023-07-09T21:38:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7513fff640 1 -- 172.21.15.37:0/4096767411 >> v2:172.21.15.119:3300/0 conn(0x7f7514158670 msgr2=0x7f75140ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7513fff640 1 --2- 172.21.15.37:0/4096767411 >> v2:172.21.15.119:3300/0 conn(0x7f7514158670 0x7f75140ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7513fff640 1 -- 172.21.15.37:0/4096767411 >> v1:172.21.15.37:6789/0 conn(0x7f751406b120 legacy=0x7f75140af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.575+0000 7f7513fff640 1 -- 172.21.15.37:0/4096767411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751406fe90 con 0x7f75140aff40 2023-07-09T21:38:14.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7513fff640 1 --2- 172.21.15.37:0/4096767411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75140aff40 0x7f751415c1d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d90 tx=0x7f750c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fad8742d47ef6a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f75127fc640 1 -- 172.21.15.37:0/4096767411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0a5910 con 0x7f75140aff40 2023-07-09T21:38:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f75127fc640 1 -- 172.21.15.37:0/4096767411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0a5a70 con 0x7f75140aff40 2023-07-09T21:38:14.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f75127fc640 1 -- 172.21.15.37:0/4096767411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0a5e00 con 0x7f75140aff40 2023-07-09T21:38:14.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- 172.21.15.37:0/4096767411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75140aff40 msgr2=0x7f751415c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 --2- 172.21.15.37:0/4096767411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75140aff40 0x7f751415c1d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f750c009d90 tx=0x7f750c01c850 comp rx=0 tx=0).stop 2023-07-09T21:38:14.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- 172.21.15.37:0/4096767411 shutdown_connections 2023-07-09T21:38:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 --2- 172.21.15.37:0/4096767411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75140aff40 0x7f751415c1d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 --2- 172.21.15.37:0/4096767411 >> v2:172.21.15.119:3300/0 conn(0x7f7514158670 0x7f75140ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- 172.21.15.37:0/4096767411 >> 172.21.15.37:0/4096767411 conn(0x7f75140ca830 msgr2=0x7f75140cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- 172.21.15.37:0/4096767411 shutdown_connections 2023-07-09T21:38:14.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- 172.21.15.37:0/4096767411 wait complete. 2023-07-09T21:38:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 Processor -- start 2023-07-09T21:38:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.579+0000 7f7519f9f640 1 -- start start 2023-07-09T21:38:14.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f751406b120 0x7f751414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 0x7f751414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75140b0f10 con 0x7f7514158670 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75140b15f0 con 0x7f75140aff40 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75140b18d0 con 0x7f751406b120 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56416/0 (socket says 172.21.15.37:56416) 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 -- 172.21.15.37:0/3752955081 learned_addr learned my addr 172.21.15.37:0/3752955081 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f75137fe640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f751406b120 0x7f751414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7512ffd640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 0x7f751414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 -- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f751406b120 msgr2=0x7f751414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f751406b120 0x7f751414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 -- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 msgr2=0x7f751414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 0x7f751414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:14.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 -- 172.21.15.37:0/3752955081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c009a70 con 0x7f7514158670 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7512ffd640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 0x7f751414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7513fff640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f750c0b0040 tx=0x7f750c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0b9860 con 0x7f7514158670 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750c0b99c0 con 0x7f7514158670 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750c0b9d30 con 0x7f7514158670 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75140b1bb0 con 0x7f7514158670 2023-07-09T21:38:14.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7514159e00 con 0x7f7514158670 2023-07-09T21:38:14.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7514159ff0 con 0x7f7514158670 2023-07-09T21:38:14.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.583+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f750c0ad440 con 0x7f7514158670 2023-07-09T21:38:14.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.587+0000 7f74fbfff640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 0x7f7500068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:14.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.587+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f750c11ece0 con 0x7f7514158670 2023-07-09T21:38:14.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.587+0000 7f75137fe640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 0x7f7500068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:14.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.587+0000 7f75137fe640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 0x7f7500068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7504009cd0 tx=0x7f7504009460 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:14.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.591+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f750c0ec0a0 con 0x7f7514158670 2023-07-09T21:38:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:14.799+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) v1 -- 0x7f7514159ff0 con 0x7f7514158670 2023-07-09T21:38:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.347+0000 7f74fbfff640 1 -- 172.21.15.37:0/3752955081 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v572) v1 ==== 154+0+0 (secure 0 0 0) 0x7f750c0ef6c0 con 0x7f7514158670 2023-07-09T21:38:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 msgr2=0x7f7500068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 0x7f7500068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7504009cd0 tx=0x7f7504009460 comp rx=0 tx=0).stop 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 msgr2=0x7f751415a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f750c0b0040 tx=0x7f750c0195f0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 shutdown_connections 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f75000663d0 0x7f7500068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7514158670 0x7f751415a320 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75140aff40 0x7f751414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 --2- 172.21.15.37:0/3752955081 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f751406b120 0x7f751414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 >> 172.21.15.37:0/3752955081 conn(0x7f75140ca830 msgr2=0x7f75140cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 shutdown_connections 2023-07-09T21:38:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.351+0000 7f7519f9f640 1 -- 172.21.15.37:0/3752955081 wait complete. 2023-07-09T21:38:15.375 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ok 2023-07-09T21:38:15.375 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing non-existing snap schedules failure 2023-07-09T21:38:15.376 INFO:tasks.cephfs_test_runner:test_non_existent_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:38:15.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-09T21:38:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 Processor -- start 2023-07-09T21:38:15.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 -- start start 2023-07-09T21:38:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9bc80b7ab0 0x7f9bc806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9bc80b4340 0x7f9bc80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80b49f0 con 0x7f9bc80cef80 2023-07-09T21:38:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80b7e80 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bd032c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80cc8a0 con 0x7f9bc80b4340 2023-07-09T21:38:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bce0c8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9bc80b7ab0 0x7f9bc806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bcd8c7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9bc80cef80 0x7f9bc80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45826/0 (socket says 172.21.15.37:45826) 2023-07-09T21:38:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bcd8c7640 1 -- 172.21.15.37:0/1624568571 learned_addr learned my addr 172.21.15.37:0/1624568571 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bce0c8640 1 -- 172.21.15.37:0/1624568571 >> v2:172.21.15.119:3300/0 conn(0x7f9bc80b4340 msgr2=0x7f9bc80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bce0c8640 1 --2- 172.21.15.37:0/1624568571 >> v2:172.21.15.119:3300/0 conn(0x7f9bc80b4340 0x7f9bc80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bce0c8640 1 -- 172.21.15.37:0/1624568571 >> v1:172.21.15.37:6789/0 conn(0x7f9bc80cef80 legacy=0x7f9bc80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bce0c8640 1 -- 172.21.15.37:0/1624568571 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80ccb80 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.519+0000 7f9bcd0c6640 1 -- 172.21.15.37:0/1624568571 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947627535 0 0) 0x7f9bc80b49f0 con 0x7f9bc80cef80 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bce0c8640 1 --2- 172.21.15.37:0/1624568571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc806aa50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80b4710 tx=0x7f9bc401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802abc906ada80a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bcd0c6640 1 -- 172.21.15.37:0/1624568571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40ab650 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bcd0c6640 1 -- 172.21.15.37:0/1624568571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc40ab7b0 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bcd0c6640 1 -- 172.21.15.37:0/1624568571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40abb40 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 -- 172.21.15.37:0/1624568571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 msgr2=0x7f9bc806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 --2- 172.21.15.37:0/1624568571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc806aa50 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80b4710 tx=0x7f9bc401c450 comp rx=0 tx=0).stop 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 -- 172.21.15.37:0/1624568571 shutdown_connections 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 --2- 172.21.15.37:0/1624568571 >> v2:172.21.15.119:3300/0 conn(0x7f9bc80b4340 0x7f9bc80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 --2- 172.21.15.37:0/1624568571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc806aa50 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 -- 172.21.15.37:0/1624568571 >> 172.21.15.37:0/1624568571 conn(0x7f9bc8073090 msgr2=0x7f9bc8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 -- 172.21.15.37:0/1624568571 shutdown_connections 2023-07-09T21:38:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.523+0000 7f9bd032c640 1 -- 172.21.15.37:0/1624568571 wait complete. 2023-07-09T21:38:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 Processor -- start 2023-07-09T21:38:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- start start 2023-07-09T21:38:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bc80b4340 0x7f9bc814fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bc80cef80 0x7f9bc80d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc81537c0 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc8153aa0 con 0x7f9bc80b4340 2023-07-09T21:38:15.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc8153d80 con 0x7f9bc80cef80 2023-07-09T21:38:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56442/0 (socket says 172.21.15.37:56442) 2023-07-09T21:38:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 -- 172.21.15.37:0/443930331 learned_addr learned my addr 172.21.15.37:0/443930331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bce8c9640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bc80cef80 0x7f9bc80d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:15.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bce0c8640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bc80b4340 0x7f9bc814fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 -- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bc80cef80 msgr2=0x7f9bc80d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bc80cef80 0x7f9bc80d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 -- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bc80b4340 msgr2=0x7f9bc814fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bc80b4340 0x7f9bc814fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 -- 172.21.15.37:0/443930331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc4009420 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bcd8c7640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c450 tx=0x7f9bb800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80074e0 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb8007640 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc8154060 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80049f0 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.527+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc8153470 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bc80b5080 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9bb8004b50 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bbeffd640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 0x7f9bac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f9bb8082fe0 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bce0c8640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 0x7f9bac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.531+0000 7f9bce0c8640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 0x7f9bac068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40af000 tx=0x7f9bc40a7000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.535+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9bb8053e40 con 0x7f9bc80b7ab0 2023-07-09T21:38:15.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:15.747+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f9bc804d7d0 con 0x7f9bc80b7ab0 2023-07-09T21:38:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.351+0000 7f9bbeffd640 1 -- 172.21.15.37:0/443930331 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v573) v1 ==== 159+0+0 (secure 0 0 0) 0x7f9bb8018020 con 0x7f9bc80b7ab0 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 msgr2=0x7f9bac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 0x7f9bac068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9bc40af000 tx=0x7f9bc40a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 msgr2=0x7f9bc814d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800c450 tx=0x7f9bb800c910 comp rx=0 tx=0).stop 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 shutdown_connections 2023-07-09T21:38:16.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9bac0663a0 0x7f9bac068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9bc80cef80 0x7f9bc80d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9bc80b7ab0 0x7f9bc814d330 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 --2- 172.21.15.37:0/443930331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9bc80b4340 0x7f9bc814fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 >> 172.21.15.37:0/443930331 conn(0x7f9bc8073090 msgr2=0x7f9bc80b6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 shutdown_connections 2023-07-09T21:38:16.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.355+0000 7f9bd032c640 1 -- 172.21.15.37:0/443930331 wait complete. 2023-07-09T21:38:16.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:38:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.531+0000 7f20487db640 1 Processor -- start 2023-07-09T21:38:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.531+0000 7f20487db640 1 -- start start 2023-07-09T21:38:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.531+0000 7f20487db640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f204015bb90 0x7f20400ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f20487db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f204015f610 0x7f204015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f20487db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204015bf60 con 0x7f204006b9c0 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f20487db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400cc530 con 0x7f204015f610 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f20487db640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20401600d0 con 0x7f204015bb90 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f204015f610 0x7f204015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f204015f610 0x7f204015fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56444/0 (socket says 172.21.15.37:56444) 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 -- 172.21.15.37:0/560435745 learned_addr learned my addr 172.21.15.37:0/560435745 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2046577640 1 --2- 172.21.15.37:0/560435745 >> v2:172.21.15.119:3300/0 conn(0x7f204015bb90 0x7f20400ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 -- 172.21.15.37:0/560435745 >> v2:172.21.15.119:3300/0 conn(0x7f204015bb90 msgr2=0x7f20400ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 --2- 172.21.15.37:0/560435745 >> v2:172.21.15.119:3300/0 conn(0x7f204015bb90 0x7f20400ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 -- 172.21.15.37:0/560435745 >> v1:172.21.15.119:6789/0 conn(0x7f204006b9c0 legacy=0x7f204006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 -- 172.21.15.37:0/560435745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20401603b0 con 0x7f204015f610 2023-07-09T21:38:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045d76640 1 --2- 172.21.15.37:0/560435745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f204015fa60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f20400cd940 tx=0x7f203001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906ecb347204fa5f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045575640 1 -- 172.21.15.37:0/560435745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300ac640 con 0x7f204015f610 2023-07-09T21:38:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045575640 1 -- 172.21.15.37:0/560435745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300ac7a0 con 0x7f204015f610 2023-07-09T21:38:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.535+0000 7f2045575640 1 -- 172.21.15.37:0/560435745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300acb30 con 0x7f204015f610 2023-07-09T21:38:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- 172.21.15.37:0/560435745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 msgr2=0x7f204015fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- 172.21.15.37:0/560435745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f204015fa60 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f20400cd940 tx=0x7f203001c400 comp rx=0 tx=0).stop 2023-07-09T21:38:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- 172.21.15.37:0/560435745 shutdown_connections 2023-07-09T21:38:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- 172.21.15.37:0/560435745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f204015fa60 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- 172.21.15.37:0/560435745 >> v2:172.21.15.119:3300/0 conn(0x7f204015bb90 0x7f20400ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- 172.21.15.37:0/560435745 >> 172.21.15.37:0/560435745 conn(0x7f204006d230 msgr2=0x7f204006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- 172.21.15.37:0/560435745 shutdown_connections 2023-07-09T21:38:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- 172.21.15.37:0/560435745 wait complete. 2023-07-09T21:38:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 Processor -- start 2023-07-09T21:38:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- start start 2023-07-09T21:38:16.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f204006b9c0 0x7f204014bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f204015bb90 0x7f204014e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400c83c0 con 0x7f204015f610 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204014dd50 con 0x7f204006b9c0 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f20487db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204014e030 con 0x7f204015bb90 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f2046d78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f2046d78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56450/0 (socket says 172.21.15.37:56450) 2023-07-09T21:38:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f2046d78640 1 -- 172.21.15.37:0/3617880406 learned_addr learned my addr 172.21.15.37:0/3617880406 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f2046577640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f204006b9c0 0x7f204014bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.539+0000 7f2045d76640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f204015bb90 0x7f204014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 -- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f204015bb90 msgr2=0x7f204014e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f204015bb90 0x7f204014e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 -- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f204006b9c0 msgr2=0x7f204014bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f204006b9c0 0x7f204014bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 -- 172.21.15.37:0/3617880406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20300094d0 con 0x7f204015f610 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2046d78640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f203800c780 tx=0x7f203800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038004b70 con 0x7f204015f610 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203800ce90 con 0x7f204015f610 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203800a850 con 0x7f204015f610 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204014e310 con 0x7f204015f610 2023-07-09T21:38:16.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204014c780 con 0x7f204015f610 2023-07-09T21:38:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204004d7d0 con 0x7f204015f610 2023-07-09T21:38:16.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f203800a9b0 con 0x7f204015f610 2023-07-09T21:38:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 0x7f2024068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.543+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f2038083ea0 con 0x7f204015f610 2023-07-09T21:38:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.547+0000 7f2046577640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 0x7f2024068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:16.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.547+0000 7f2046577640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 0x7f2024068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f204015f110 tx=0x7f203c008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:16.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.547+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2038054d20 con 0x7f204015f610 2023-07-09T21:38:16.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.703+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f204006eb20 con 0x7f204015f610 2023-07-09T21:38:16.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.707+0000 7f2036ffd640 1 -- 172.21.15.37:0/3617880406 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20380548b0 con 0x7f204015f610 2023-07-09T21:38:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 msgr2=0x7f2024068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 0x7f2024068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f204015f110 tx=0x7f203c008040 comp rx=0 tx=0).stop 2023-07-09T21:38:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 msgr2=0x7f20400c7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:16.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f203800c780 tx=0x7f203800cc40 comp rx=0 tx=0).stop 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 shutdown_connections 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f20240663d0 0x7f2024068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f204015f610 0x7f20400c7900 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f204015bb90 0x7f204014e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 --2- 172.21.15.37:0/3617880406 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f204006b9c0 0x7f204014bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 >> 172.21.15.37:0/3617880406 conn(0x7f204006d230 msgr2=0x7f2040154140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:16.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 shutdown_connections 2023-07-09T21:38:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:16.711+0000 7f20487db640 1 -- 172.21.15.37:0/3617880406 wait complete. 2023-07-09T21:38:16.731 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:38:16.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:16.777 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:16.842 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:38:16.843 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:16.843 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:16.853 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:16.854 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:16.854 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:16.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:16.865 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:16.865 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:16.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:16.904 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:16.905 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:16.917 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:16.918 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:38:16.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:17.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 Processor -- start 2023-07-09T21:38:17.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 -- start start 2023-07-09T21:38:17.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e300b7ab0 0x7f8e3006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8e300b4340 0x7f8e300d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e300b49f0 con 0x7f8e300cef80 2023-07-09T21:38:17.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300b7e80 con 0x7f8e300b7ab0 2023-07-09T21:38:17.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e34ed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e300cc8a0 con 0x7f8e300b4340 2023-07-09T21:38:17.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e300b7ab0 0x7f8e3006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8e300b7ab0 0x7f8e3006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56462/0 (socket says 172.21.15.37:56462) 2023-07-09T21:38:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1445469930 learned_addr learned my addr 172.21.15.37:0/1445469930 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2ed9d640 1 --2- 172.21.15.37:0/1445469930 >> v2:172.21.15.119:3300/0 conn(0x7f8e300b4340 0x7f8e300d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1445469930 >> v2:172.21.15.119:3300/0 conn(0x7f8e300b4340 msgr2=0x7f8e300d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 --2- 172.21.15.37:0/1445469930 >> v2:172.21.15.119:3300/0 conn(0x7f8e300b4340 0x7f8e300d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1445469930 >> v1:172.21.15.119:6789/0 conn(0x7f8e300cef80 legacy=0x7f8e300b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:17.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.087+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1445469930 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e300ccb80 con 0x7f8e300b7ab0 2023-07-09T21:38:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e2e59c640 1 --2- 172.21.15.37:0/1445469930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b7ab0 0x7f8e3006aa50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e300b4710 tx=0x7f8e2001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deddf24c7f28a4b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e2dd9b640 1 -- 172.21.15.37:0/1445469930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200aa5f0 con 0x7f8e300b7ab0 2023-07-09T21:38:17.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e2dd9b640 1 -- 172.21.15.37:0/1445469930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e200aa750 con 0x7f8e300b7ab0 2023-07-09T21:38:17.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e2dd9b640 1 -- 172.21.15.37:0/1445469930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200aaae0 con 0x7f8e300b7ab0 2023-07-09T21:38:17.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1445469930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b7ab0 msgr2=0x7f8e3006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1445469930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b7ab0 0x7f8e3006aa50 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f8e300b4710 tx=0x7f8e2001c490 comp rx=0 tx=0).stop 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1445469930 shutdown_connections 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1445469930 >> v2:172.21.15.119:3300/0 conn(0x7f8e300b4340 0x7f8e300d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1445469930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b7ab0 0x7f8e3006aa50 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.091+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1445469930 >> 172.21.15.37:0/1445469930 conn(0x7f8e30073090 msgr2=0x7f8e30069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1445469930 shutdown_connections 2023-07-09T21:38:17.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1445469930 wait complete. 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 Processor -- start 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- start start 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 0x7f8e30158450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 0x7f8e300ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e30150160 con 0x7f8e300b4340 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3013f030 con 0x7f8e300b7ab0 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e34ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3015e900 con 0x7f8e300cef80 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1090968966 learned_addr learned my addr 172.21.15.37:0/1090968966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e27fff640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 0x7f8e30158450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2ed9d640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 0x7f8e300ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 msgr2=0x7f8e300ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 0x7f8e300ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 msgr2=0x7f8e30158450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 0x7f8e30158450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 -- 172.21.15.37:0/1090968966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200094d0 con 0x7f8e300b4340 2023-07-09T21:38:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e27fff640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 0x7f8e30158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2ed9d640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 0x7f8e300ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.095+0000 7f8e2e59c640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8e200ac040 tx=0x7f8e2001acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200aa5f0 con 0x7f8e300b4340 2023-07-09T21:38:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e200b3800 con 0x7f8e300b4340 2023-07-09T21:38:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e200b3b90 con 0x7f8e300b4340 2023-07-09T21:38:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e3015ebe0 con 0x7f8e300b4340 2023-07-09T21:38:17.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e30150690 con 0x7f8e300b4340 2023-07-09T21:38:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3004d7d0 con 0x7f8e300b4340 2023-07-09T21:38:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8e200b3cf0 con 0x7f8e300b4340 2023-07-09T21:38:17.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 0x7f8e10068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7f8e200a7070 con 0x7f8e300b4340 2023-07-09T21:38:17.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.099+0000 7f8e27fff640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 0x7f8e10068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.103+0000 7f8e27fff640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 0x7f8e10068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e30152110 tx=0x7f8e18008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.103+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8e200eb7f0 con 0x7f8e300b4340 2023-07-09T21:38:17.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.291+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e3006a830 con 0x7f8e300b4340 2023-07-09T21:38:17.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.291+0000 7f8e26ffd640 1 -- 172.21.15.37:0/1090968966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f8e200c3de0 con 0x7f8e300b4340 2023-07-09T21:38:17.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:17.296 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5552,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3974653610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3974653610},{"type":"v1","addr":"172.21.15.119:6836","nonce":3974653610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6031,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271451304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1271451304},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271451304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6264,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/1505204201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1505204201},{"type":"v1","addr":"172.21.15.37:6834","nonce":1505204201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2837710029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2837710029},{"type":"v1","addr":"172.21.15.37:6835","nonce":2837710029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2023-07-09T21:38:17.296 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 msgr2=0x7f8e10068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 0x7f8e10068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8e30152110 tx=0x7f8e18008040 comp rx=0 tx=0).stop 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 msgr2=0x7f8e3013eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f8e200ac040 tx=0x7f8e2001acd0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 shutdown_connections 2023-07-09T21:38:17.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f8e100663a0 0x7f8e10068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8e300cef80 0x7f8e300ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8e300b7ab0 0x7f8e30158450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 --2- 172.21.15.37:0/1090968966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e300b4340 0x7f8e3013eaf0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 >> 172.21.15.37:0/1090968966 conn(0x7f8e30073090 msgr2=0x7f8e300d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 shutdown_connections 2023-07-09T21:38:17.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.295+0000 7f8e34ed8640 1 -- 172.21.15.37:0/1090968966 wait complete. 2023-07-09T21:38:17.317 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:38:17.317 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:38:17.317 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:38:17.318 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:17.318 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:38:17.318 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:38:17.319 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:38:17.319 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:17.319 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:38:17.319 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:38:17.320 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:38:17.320 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:17.320 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:38:17.320 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:38:17.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:38:17.321 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:17.329 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:38:17.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:38:17.331 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:38:17.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:38:17.338 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:38:17.339 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:38:17.340 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:38:17.340 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:38:17.381 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:38:17.382 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:17.382 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:38:17.383 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:17.384 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:38:17.384 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:17.385 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:38:17.385 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:17.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:38:17.470 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:38:17.471 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:38:17.472 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:38:17.475 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:38:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 Processor -- start 2023-07-09T21:38:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 -- start start 2023-07-09T21:38:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c1668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0cef80 con 0x7feb2c0b7a60 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb2c0cf260 con 0x7feb2c0b47a0 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb30be9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0ccee0 con 0x7feb2c0b4310 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb2a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feb2c0b7a60 0x7feb2c0cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40922/0 (socket says 172.21.15.37:40922) 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb2a59c640 1 -- 172.21.15.37:0/599295835 learned_addr learned my addr 172.21.15.37:0/599295835 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb2ad9d640 1 --2- 172.21.15.37:0/599295835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c1668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.531+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266963132 0 0) 0x7feb2c0cef80 con 0x7feb2c0b7a60 2023-07-09T21:38:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb18003530 con 0x7feb2c0b7a60 2023-07-09T21:38:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318320629 0 0) 0x7feb2c0cf260 con 0x7feb2c0b47a0 2023-07-09T21:38:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb2c0cef80 con 0x7feb2c0b47a0 2023-07-09T21:38:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb2ad9d640 1 -- 172.21.15.37:0/599295835 >> v1:172.21.15.119:6789/0 conn(0x7feb2c0b47a0 legacy=0x7feb2c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb2ad9d640 1 -- 172.21.15.37:0/599295835 >> v1:172.21.15.37:6789/0 conn(0x7feb2c0b7a60 legacy=0x7feb2c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb2ad9d640 1 -- 172.21.15.37:0/599295835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb2c0cf540 con 0x7feb2c0b4310 2023-07-09T21:38:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb2ad9d640 1 --2- 172.21.15.37:0/599295835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c1668c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb24009dc0 tx=0x7feb2401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=937d210baa17560 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240a5920 con 0x7feb2c0b4310 2023-07-09T21:38:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb240a5a80 con 0x7feb2c0b4310 2023-07-09T21:38:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb29d9b640 1 -- 172.21.15.37:0/599295835 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb240a5e10 con 0x7feb2c0b4310 2023-07-09T21:38:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 -- 172.21.15.37:0/599295835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 msgr2=0x7feb2c1668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 --2- 172.21.15.37:0/599295835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c1668c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb24009dc0 tx=0x7feb2401c970 comp rx=0 tx=0).stop 2023-07-09T21:38:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 -- 172.21.15.37:0/599295835 shutdown_connections 2023-07-09T21:38:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 --2- 172.21.15.37:0/599295835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c1668c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 -- 172.21.15.37:0/599295835 >> 172.21.15.37:0/599295835 conn(0x7feb2c073050 msgr2=0x7feb2c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.535+0000 7feb30be9640 1 -- 172.21.15.37:0/599295835 shutdown_connections 2023-07-09T21:38:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 -- 172.21.15.37:0/599295835 wait complete. 2023-07-09T21:38:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 Processor -- start 2023-07-09T21:38:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 -- start start 2023-07-09T21:38:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c0c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb2c0b7a60 0x7feb2c15da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0c9380 con 0x7feb2c0b47a0 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0c9660 con 0x7feb2c0b7a60 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb30be9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb2c0c9940 con 0x7feb2c0b4310 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57688/0 (socket says 172.21.15.37:57688) 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 -- 172.21.15.37:0/2065201832 learned_addr learned my addr 172.21.15.37:0/2065201832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb2ad9d640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb2c0b7a60 0x7feb2c15da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb2a59c640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c0c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 -- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 msgr2=0x7feb2c0c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c0c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 -- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb2c0b7a60 msgr2=0x7feb2c15da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb2c0b7a60 0x7feb2c15da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 -- 172.21.15.37:0/2065201832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb24009a70 con 0x7feb2c0b47a0 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.539+0000 7feb23fff640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7feb1400c490 tx=0x7feb1400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb140052d0 con 0x7feb2c0b47a0 2023-07-09T21:38:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb14005430 con 0x7feb2c0b47a0 2023-07-09T21:38:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb14012870 con 0x7feb2c0b47a0 2023-07-09T21:38:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb2c0c9c20 con 0x7feb2c0b47a0 2023-07-09T21:38:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2c0c7c20 con 0x7feb2c0b47a0 2023-07-09T21:38:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb2c0cdaa0 con 0x7feb2c0b47a0 2023-07-09T21:38:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7feb140129d0 con 0x7feb2c0b47a0 2023-07-09T21:38:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 0x7feb0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5984+0+0 (secure 0 0 0) 0x7feb140838a0 con 0x7feb2c0b47a0 2023-07-09T21:38:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.543+0000 7feb2a59c640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 0x7feb0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.547+0000 7feb2a59c640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 0x7feb0c068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0011f0 tx=0x7feb1c007d40 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.547+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feb14050d20 con 0x7feb2c0b47a0 2023-07-09T21:38:17.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:17.715+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feb2c0b7f70 con 0x7feb2c0b47a0 2023-07-09T21:38:18.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb22ffd640 1 -- 172.21.15.37:0/2065201832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb14054340 con 0x7feb2c0b47a0 2023-07-09T21:38:18.736 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:38:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 msgr2=0x7feb0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 0x7feb0c068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0011f0 tx=0x7feb1c007d40 comp rx=0 tx=0).stop 2023-07-09T21:38:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 msgr2=0x7feb2c15d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7feb1400c490 tx=0x7feb1400c950 comp rx=0 tx=0).stop 2023-07-09T21:38:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 shutdown_connections 2023-07-09T21:38:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7feb0c0663a0 0x7feb0c068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feb2c0b7a60 0x7feb2c15da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb2c0b47a0 0x7feb2c15d4e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 --2- 172.21.15.37:0/2065201832 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feb2c0b4310 0x7feb2c0c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.735+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 >> 172.21.15.37:0/2065201832 conn(0x7feb2c073050 msgr2=0x7feb2c0b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.739+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 shutdown_connections 2023-07-09T21:38:18.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.739+0000 7feb30be9640 1 -- 172.21.15.37:0/2065201832 wait complete. 2023-07-09T21:38:18.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:38:18.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 Processor -- start 2023-07-09T21:38:18.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 -- start start 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2b8166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b80ccd40 con 0x7fe2b80b7810 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b80ce680 con 0x7fe2b80ce1a0 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be8af640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cc5a0 con 0x7fe2b806a450 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd8ad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2b80b7810 0x7fe2b815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40936/0 (socket says 172.21.15.37:40936) 2023-07-09T21:38:18.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd8ad640 1 -- 172.21.15.37:0/737628460 learned_addr learned my addr 172.21.15.37:0/737628460 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:18.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be0ae640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2b8166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3025905501 0 0) 0x7fe2b80ccd40 con 0x7fe2b80b7810 2023-07-09T21:38:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a4003530 con 0x7fe2b80b7810 2023-07-09T21:38:18.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3639750490 0 0) 0x7fe2a4003530 con 0x7fe2b80b7810 2023-07-09T21:38:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 msgr2=0x7fe2b8166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2b8166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 >> v1:172.21.15.119:6789/0 conn(0x7fe2b80ce1a0 legacy=0x7fe2b8069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80cc780 con 0x7fe2b80b7810 2023-07-09T21:38:18.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe2b4001680 con 0x7fe2b80b7810 2023-07-09T21:38:18.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 >> v1:172.21.15.37:6789/0 conn(0x7fe2b80b7810 legacy=0x7fe2b815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a40039b0 0x7fe2a4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a4004350 0x7fe2a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2a4005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cc5a0 con 0x7fe2a4004350 2023-07-09T21:38:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a400b990 con 0x7fe2a40039b0 2023-07-09T21:38:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a400bb20 con 0x7fe2b806a450 2023-07-09T21:38:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a4004350 0x7fe2a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd8ad640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a40039b0 0x7fe2a4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2be0ae640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2a4005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 -- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 msgr2=0x7fe2a4005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b806a450 0x7fe2a4005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 -- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a40039b0 msgr2=0x7fe2a4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a40039b0 0x7fe2a4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.911+0000 7fe2bd0ac640 1 -- 172.21.15.37:0/737628460 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a4003530 con 0x7fe2a4004350 2023-07-09T21:38:18.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2bd0ac640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a4004350 0x7fe2a4004810 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8001860 tx=0x7fe2a801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13663aaaebc6576 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:18.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a8870 con 0x7fe2a4004350 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a80a89d0 con 0x7fe2a4004350 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2bc8ab640 1 -- 172.21.15.37:0/737628460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80a8d80 con 0x7fe2a4004350 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 -- 172.21.15.37:0/737628460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a4004350 msgr2=0x7fe2a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 --2- 172.21.15.37:0/737628460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a4004350 0x7fe2a4004810 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8001860 tx=0x7fe2a801ec50 comp rx=0 tx=0).stop 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be0ae640 1 -- 172.21.15.37:0/737628460 reap_dead start 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 -- 172.21.15.37:0/737628460 shutdown_connections 2023-07-09T21:38:18.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 -- 172.21.15.37:0/737628460 >> 172.21.15.37:0/737628460 conn(0x7fe2b80cea60 msgr2=0x7fe2b80cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 -- 172.21.15.37:0/737628460 shutdown_connections 2023-07-09T21:38:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.915+0000 7fe2be8af640 1 -- 172.21.15.37:0/737628460 wait complete. 2023-07-09T21:38:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 Processor -- start 2023-07-09T21:38:18.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- start start 2023-07-09T21:38:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4004350 0x7fe2b80b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b8155390 0x7fe2b8148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81489a0 con 0x7fe2b80c5a80 2023-07-09T21:38:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80c6430 con 0x7fe2a4004350 2023-07-09T21:38:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8155c10 con 0x7fe2b8155390 2023-07-09T21:38:18.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57710/0 (socket says 172.21.15.37:57710) 2023-07-09T21:38:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 -- 172.21.15.37:0/763767585 learned_addr learned my addr 172.21.15.37:0/763767585 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2bd0ac640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b8155390 0x7fe2b8148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2bd8ad640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4004350 0x7fe2b80b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 -- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b8155390 msgr2=0x7fe2b8148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b8155390 0x7fe2b8148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 -- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4004350 msgr2=0x7fe2b80b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:18.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4004350 0x7fe2b80b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 -- 172.21.15.37:0/763767585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80b42b0 con 0x7fe2b80c5a80 2023-07-09T21:38:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be0ae640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80b0ec0 tx=0x7fe2b0011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000e040 con 0x7fe2b80c5a80 2023-07-09T21:38:18.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000f040 con 0x7fe2b80c5a80 2023-07-09T21:38:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0015aa0 con 0x7fe2b80c5a80 2023-07-09T21:38:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b80b3a10 con 0x7fe2b80c5a80 2023-07-09T21:38:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.919+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b80b3fd0 con 0x7fe2b80c5a80 2023-07-09T21:38:18.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b804e020 con 0x7fe2b80c5a80 2023-07-09T21:38:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe2b0015c00 con 0x7fe2b80c5a80 2023-07-09T21:38:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2ae7fc640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 0x7fe29c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:18.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe2b0083bd0 con 0x7fe2b80c5a80 2023-07-09T21:38:18.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2bd8ad640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 0x7fe29c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:18.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.923+0000 7fe2bd8ad640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 0x7fe29c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000c10 tx=0x7fe2b4001b50 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:18.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:18.927+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2b0051170 con 0x7fe2b80c5a80 2023-07-09T21:38:19.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.135+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe2b80c5820 con 0x7fe2b80c5a80 2023-07-09T21:38:19.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.135+0000 7fe2ae7fc640 1 -- 172.21.15.37:0/763767585 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe2b0054790 con 0x7fe2b80c5a80 2023-07-09T21:38:19.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:19.138 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:38:19.138 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:19.139 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:19.140 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:19.141 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.142 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.143 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:38:19.144 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:38:19.144 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.144 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.144 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:38:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:38:19.146 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.147 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.148 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.149 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:38:19.150 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:38:19.151 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.152 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.154 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:38:19.155 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:38:19.157 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.158 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:38:19.159 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:38:19.159 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.159 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:19.159 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:38:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:38:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:38:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 msgr2=0x7fe29c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 0x7fe29c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4000c10 tx=0x7fe2b4001b50 comp rx=0 tx=0).stop 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 msgr2=0x7fe2b80c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80b0ec0 tx=0x7fe2b0011c80 comp rx=0 tx=0).stop 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 shutdown_connections 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe29c0663a0 0x7fe29c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2b80c5a80 0x7fe2b80c5ef0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2b8155390 0x7fe2b8148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 --2- 172.21.15.37:0/763767585 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a4004350 0x7fe2b80b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 >> 172.21.15.37:0/763767585 conn(0x7fe2b80cea60 msgr2=0x7fe2b815be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 shutdown_connections 2023-07-09T21:38:19.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.139+0000 7fe2be8af640 1 -- 172.21.15.37:0/763767585 wait complete. 2023-07-09T21:38:19.167 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:19.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.307+0000 7f712f337640 1 Processor -- start 2023-07-09T21:38:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.307+0000 7f712f337640 1 -- start start 2023-07-09T21:38:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7128070700 0x7f712815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71280cb9f0 0x7f712815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f71280afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71280cdbd0 con 0x7f71280cb9f0 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712815bef0 con 0x7f7128070700 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712f337640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128160410 con 0x7f71280af830 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71280cb9f0 0x7f712815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71280cb9f0 0x7f712815c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2023-07-09T21:38:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 -- 172.21.15.37:0/3040485594 learned_addr learned my addr 172.21.15.37:0/3040485594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712d0d3640 1 --2- 172.21.15.37:0/3040485594 >> v2:172.21.15.119:3300/0 conn(0x7f7128070700 0x7f712815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712d8d4640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f71280afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 -- 172.21.15.37:0/3040485594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 msgr2=0x7f71280afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f71280afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 -- 172.21.15.37:0/3040485594 >> v2:172.21.15.119:3300/0 conn(0x7f7128070700 msgr2=0x7f712815fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 --2- 172.21.15.37:0/3040485594 >> v2:172.21.15.119:3300/0 conn(0x7f7128070700 0x7f712815fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712c8d2640 1 -- 172.21.15.37:0/3040485594 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712815ce20 con 0x7f71280cb9f0 2023-07-09T21:38:19.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.311+0000 7f712d8d4640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f71280afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:19.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712c8d2640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71280cb9f0 0x7f712815c8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7118009870 tx=0x7f711801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fada538e3be3f36 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f711ffff640 1 -- 172.21.15.37:0/3040485594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180ab600 con 0x7f71280cb9f0 2023-07-09T21:38:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f711ffff640 1 -- 172.21.15.37:0/3040485594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71180a7050 con 0x7f71280cb9f0 2023-07-09T21:38:19.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f711ffff640 1 -- 172.21.15.37:0/3040485594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71180ab980 con 0x7f71280cb9f0 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- 172.21.15.37:0/3040485594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71280cb9f0 msgr2=0x7f712815c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71280cb9f0 0x7f712815c8e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7118009870 tx=0x7f711801c470 comp rx=0 tx=0).stop 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- 172.21.15.37:0/3040485594 shutdown_connections 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71280cb9f0 0x7f712815c8e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 --2- 172.21.15.37:0/3040485594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f71280afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 --2- 172.21.15.37:0/3040485594 >> v2:172.21.15.119:3300/0 conn(0x7f7128070700 0x7f712815fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- 172.21.15.37:0/3040485594 >> 172.21.15.37:0/3040485594 conn(0x7f71280ca830 msgr2=0x7f71280cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- 172.21.15.37:0/3040485594 shutdown_connections 2023-07-09T21:38:19.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- 172.21.15.37:0/3040485594 wait complete. 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 Processor -- start 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.315+0000 7f712f337640 1 -- start start 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f7128149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 0x7f71280c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7128157c70 con 0x7f7128070700 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712815edc0 con 0x7f71280cb9f0 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7128157ea0 con 0x7f71280af830 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57726/0 (socket says 172.21.15.37:57726) 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 -- 172.21.15.37:0/1849639905 learned_addr learned my addr 172.21.15.37:0/1849639905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d8d4640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 0x7f71280c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712c8d2640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f7128149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 -- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 msgr2=0x7f7128149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f7128149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 -- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 msgr2=0x7f71280c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 0x7f71280c8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 -- 172.21.15.37:0/1849639905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180094d0 con 0x7f7128070700 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d8d4640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 0x7f71280c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:19.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712c8d2640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f7128149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712d0d3640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f712400e870 tx=0x7f712400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400ee60 con 0x7f7128070700 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712400c8e0 con 0x7f7128070700 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712400cc90 con 0x7f7128070700 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7128158180 con 0x7f7128070700 2023-07-09T21:38:19.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7128158740 con 0x7f7128070700 2023-07-09T21:38:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712804d7d0 con 0x7f7128070700 2023-07-09T21:38:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.319+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7124013470 con 0x7f7128070700 2023-07-09T21:38:19.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.323+0000 7f711dffb640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 0x7f710c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.323+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7124083bf0 con 0x7f7128070700 2023-07-09T21:38:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.323+0000 7f712c8d2640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 0x7f710c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.323+0000 7f712c8d2640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 0x7f710c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71180ad000 tx=0x7f71180a6000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.327+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7124051210 con 0x7f7128070700 2023-07-09T21:38:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.487+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7128159800 con 0x7f7128070700 2023-07-09T21:38:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.487+0000 7f711dffb640 1 -- 172.21.15.37:0/1849639905 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+14627 (secure 0 0 0) 0x7f7124017090 con 0x7f7128070700 2023-07-09T21:38:19.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:19.490 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":81,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:18.731994+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 msgr2=0x7f710c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 0x7f710c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f71180ad000 tx=0x7f71180a6000 comp rx=0 tx=0).stop 2023-07-09T21:38:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 msgr2=0x7f7128158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f712400e870 tx=0x7f712400ed30 comp rx=0 tx=0).stop 2023-07-09T21:38:19.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 shutdown_connections 2023-07-09T21:38:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f710c0663a0 0x7f710c068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71280cb9f0 0x7f71280c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71280af830 0x7f7128149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 --2- 172.21.15.37:0/1849639905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7128070700 0x7f7128158f40 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 >> 172.21.15.37:0/1849639905 conn(0x7f71280ca830 msgr2=0x7f71280c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 shutdown_connections 2023-07-09T21:38:19.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.491+0000 7f712f337640 1 -- 172.21.15.37:0/1849639905 wait complete. 2023-07-09T21:38:19.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:19.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.655+0000 7f18062ca640 1 Processor -- start 2023-07-09T21:38:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 -- start start 2023-07-09T21:38:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18000b7980 0x7f1800160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18000d0780 0x7f18000d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180015bf80 con 0x7f18000ceb80 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cd070 con 0x7f18000b7980 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f18062ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18000cfd70 con 0x7f18000d0780 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18000b7980 0x7f1800160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18000b7980 0x7f1800160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57734/0 (socket says 172.21.15.37:57734) 2023-07-09T21:38:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 -- 172.21.15.37:0/3456527788 learned_addr learned my addr 172.21.15.37:0/3456527788 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:19.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f1804867640 1 --2- 172.21.15.37:0/3456527788 >> v2:172.21.15.119:3300/0 conn(0x7f18000d0780 0x7f18000d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 -- 172.21.15.37:0/3456527788 >> v2:172.21.15.119:3300/0 conn(0x7f18000d0780 msgr2=0x7f18000d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:19.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 --2- 172.21.15.37:0/3456527788 >> v2:172.21.15.119:3300/0 conn(0x7f18000d0780 0x7f18000d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 -- 172.21.15.37:0/3456527788 >> v1:172.21.15.119:6789/0 conn(0x7f18000ceb80 legacy=0x7f18000cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.659+0000 7f17fffff640 1 -- 172.21.15.37:0/3456527788 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1800160570 con 0x7f18000b7980 2023-07-09T21:38:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f17fffff640 1 --2- 172.21.15.37:0/3456527788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f1800160030 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f18000b1240 tx=0x7f17f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e2c5d3c8ca1b6a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f17feffd640 1 -- 172.21.15.37:0/3456527788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab600 con 0x7f18000b7980 2023-07-09T21:38:19.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f17feffd640 1 -- 172.21.15.37:0/3456527788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00a7050 con 0x7f18000b7980 2023-07-09T21:38:19.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f17feffd640 1 -- 172.21.15.37:0/3456527788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00ab980 con 0x7f18000b7980 2023-07-09T21:38:19.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- 172.21.15.37:0/3456527788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 msgr2=0x7f1800160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 --2- 172.21.15.37:0/3456527788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f1800160030 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f18000b1240 tx=0x7f17f001c500 comp rx=0 tx=0).stop 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- 172.21.15.37:0/3456527788 shutdown_connections 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 --2- 172.21.15.37:0/3456527788 >> v2:172.21.15.119:3300/0 conn(0x7f18000d0780 0x7f18000d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 --2- 172.21.15.37:0/3456527788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f1800160030 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- 172.21.15.37:0/3456527788 >> 172.21.15.37:0/3456527788 conn(0x7f1800073090 msgr2=0x7f1800069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- 172.21.15.37:0/3456527788 shutdown_connections 2023-07-09T21:38:19.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- 172.21.15.37:0/3456527788 wait complete. 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 Processor -- start 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.663+0000 7f18062ca640 1 -- start start 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18000ceb80 0x7f18000b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18000d0780 0x7f18000b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180015aa00 con 0x7f18000b7980 2023-07-09T21:38:19.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18000b4910 con 0x7f18000d0780 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18000b1da0 con 0x7f18000ceb80 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57744/0 (socket says 172.21.15.37:57744) 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 -- 172.21.15.37:0/1799892698 learned_addr learned my addr 172.21.15.37:0/1799892698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17ff7fe640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18000ceb80 0x7f18000b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f1804867640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18000d0780 0x7f18000b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 -- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18000ceb80 msgr2=0x7f18000b25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18000ceb80 0x7f18000b25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 -- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18000d0780 msgr2=0x7f18000b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18000d0780 0x7f18000b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 -- 172.21.15.37:0/1799892698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f00094d0 con 0x7f18000b7980 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fffff640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f17f0019110 tx=0x7f17f00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00b37d0 con 0x7f18000b7980 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f00b3930 con 0x7f18000b7980 2023-07-09T21:38:19.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f00b3ca0 con 0x7f18000b7980 2023-07-09T21:38:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18000b2080 con 0x7f18000b7980 2023-07-09T21:38:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180015a690 con 0x7f18000b7980 2023-07-09T21:38:19.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.667+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180004d7d0 con 0x7f18000b7980 2023-07-09T21:38:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.671+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f17f00b2070 con 0x7f18000b7980 2023-07-09T21:38:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.671+0000 7f17fcff9640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 0x7f17ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.671+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f17f011dc70 con 0x7f18000b7980 2023-07-09T21:38:19.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.671+0000 7f17ff7fe640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 0x7f17ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:19.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.671+0000 7f17ff7fe640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 0x7f17ec068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18000b4360 tx=0x7f17f4009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:19.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.675+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17f00eb2d0 con 0x7f18000b7980 2023-07-09T21:38:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.831+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1800160570 con 0x7f18000b7980 2023-07-09T21:38:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f17fcff9640 1 -- 172.21.15.37:0/1799892698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1800160570 con 0x7f18000b7980 2023-07-09T21:38:19.835 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 msgr2=0x7f17ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 0x7f17ec068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f18000b4360 tx=0x7f17f4009040 comp rx=0 tx=0).stop 2023-07-09T21:38:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 msgr2=0x7f180015ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f17f0019110 tx=0x7f17f00192a0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 shutdown_connections 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f17ec0663a0 0x7f17ec068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18000d0780 0x7f18000b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18000ceb80 0x7f18000b25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 --2- 172.21.15.37:0/1799892698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18000b7980 0x7f180015ae90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 >> 172.21.15.37:0/1799892698 conn(0x7f1800073090 msgr2=0x7f18000cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 shutdown_connections 2023-07-09T21:38:19.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.835+0000 7f18062ca640 1 -- 172.21.15.37:0/1799892698 wait complete. 2023-07-09T21:38:19.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:20.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.999+0000 7f2522559640 1 Processor -- start 2023-07-09T21:38:20.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:19.999+0000 7f2522559640 1 -- start start 2023-07-09T21:38:20.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2522559640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f251c160030 0x7f251c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2522559640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c15bf80 con 0x7f251c0b7980 2023-07-09T21:38:20.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2522559640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f251c0d02f0 con 0x7f251c0cf290 2023-07-09T21:38:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2522559640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251c0cd070 con 0x7f251c160030 2023-07-09T21:38:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f251c0b7980 0x7f251c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40946/0 (socket says 172.21.15.37:40946) 2023-07-09T21:38:20.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251bfff640 1 -- 172.21.15.37:0/1184312262 learned_addr learned my addr 172.21.15.37:0/1184312262 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:20.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 --2- 172.21.15.37:0/1184312262 >> v2:172.21.15.119:3300/0 conn(0x7f251c160030 0x7f251c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3944566178 0 0) 0x7f250c001120 con 0x7f251c0b7980 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2504003530 con 0x7f251c0b7980 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485680378 0 0) 0x7f2504003530 con 0x7f251c0b7980 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 >> v2:172.21.15.119:3300/0 conn(0x7f251c160030 msgr2=0x7f251c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 --2- 172.21.15.37:0/1184312262 >> v2:172.21.15.119:3300/0 conn(0x7f251c160030 0x7f251c0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 >> v1:172.21.15.119:6789/0 conn(0x7f251c0cf290 legacy=0x7f251c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c0cc7f0 con 0x7f251c0b7980 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f250c001810 con 0x7f251c0b7980 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 >> v1:172.21.15.37:6789/0 conn(0x7f251c0b7980 legacy=0x7f251c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2504003980 0x7f2504003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25040047d0 0x7f2504004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f250400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0cd070 con 0x7f2504005180 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250400c000 con 0x7f25040047d0 2023-07-09T21:38:20.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250400c1c0 con 0x7f2504003980 2023-07-09T21:38:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f250400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251bfff640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2504003980 0x7f2504003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251b7fe640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25040047d0 0x7f2504004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 -- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2504003980 msgr2=0x7f2504003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:20.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2504003980 0x7f2504003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 -- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25040047d0 msgr2=0x7f2504004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:20.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25040047d0 0x7f2504004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f2520af6640 1 -- 172.21.15.37:0/1184312262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504003530 con 0x7f2504005180 2023-07-09T21:38:20.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.003+0000 7f251b7fe640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25040047d0 0x7f2504004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:20.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2520af6640 1 -- 172.21.15.37:0/1184312262 reap_dead start 2023-07-09T21:38:20.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2520af6640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f250400b990 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2514009fc0 tx=0x7f251401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c0d6afcb9ce88d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25140a5cb0 con 0x7f2504005180 2023-07-09T21:38:20.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251400f040 con 0x7f2504005180 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f251affd640 1 -- 172.21.15.37:0/1184312262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2514003be0 con 0x7f2504005180 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 msgr2=0x7f250400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f250400b990 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f2514009fc0 tx=0x7f251401cca0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- 172.21.15.37:0/1184312262 shutdown_connections 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 --2- 172.21.15.37:0/1184312262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f250400b990 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- 172.21.15.37:0/1184312262 >> 172.21.15.37:0/1184312262 conn(0x7f251c073090 msgr2=0x7f251c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:20.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- 172.21.15.37:0/1184312262 shutdown_connections 2023-07-09T21:38:20.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- 172.21.15.37:0/1184312262 wait complete. 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 Processor -- start 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.007+0000 7f2522559640 1 -- start start 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f251c0b33c0 0x7f251c0b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f251c15d850 0x7f251c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c0b3d70 con 0x7f2504005180 2023-07-09T21:38:20.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f251c153d10 con 0x7f251c0b33c0 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f251c15e580 con 0x7f251c15d850 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57754/0 (socket says 172.21.15.37:57754) 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 -- 172.21.15.37:0/3718206412 learned_addr learned my addr 172.21.15.37:0/3718206412 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2520af6640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f251c15d850 0x7f251c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251b7fe640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f251c0b33c0 0x7f251c0b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 -- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f251c15d850 msgr2=0x7f251c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f251c15d850 0x7f251c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 -- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f251c0b33c0 msgr2=0x7f251c0b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f251c0b33c0 0x7f251c0b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 -- 172.21.15.37:0/3718206412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c15e860 con 0x7f2504005180 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f251bfff640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f250c007340 tx=0x7f250c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c007e00 con 0x7f2504005180 2023-07-09T21:38:20.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c00f9c0 con 0x7f2504005180 2023-07-09T21:38:20.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c00fd70 con 0x7f2504005180 2023-07-09T21:38:20.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f251c15eb40 con 0x7f2504005180 2023-07-09T21:38:20.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251c0c5cb0 con 0x7f2504005180 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.011+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f251c04d7d0 con 0x7f2504005180 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.015+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f250c01c410 con 0x7f2504005180 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.015+0000 7f2518ff9640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 0x7f2508068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.015+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f250c083550 con 0x7f2504005180 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.015+0000 7f251b7fe640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 0x7f2508068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.015+0000 7f251b7fe640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 0x7f2508068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c10 tx=0x7f2510009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.019+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f250c050d30 con 0x7f2504005180 2023-07-09T21:38:20.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.171+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f251c0cff50 con 0x7f2504005180 2023-07-09T21:38:20.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.171+0000 7f2518ff9640 1 -- 172.21.15.37:0/3718206412 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v81) v1 ==== 92+0+10 (secure 0 0 0) 0x7f250c054350 con 0x7f2504005180 2023-07-09T21:38:20.175 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 msgr2=0x7f2508068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 0x7f2508068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2510000c10 tx=0x7f2510009040 comp rx=0 tx=0).stop 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 msgr2=0x7f251c1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f250c007340 tx=0x7f250c007800 comp rx=0 tx=0).stop 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 shutdown_connections 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f25080663d0 0x7f2508068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f251c15d850 0x7f251c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f251c0b33c0 0x7f251c0b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 --2- 172.21.15.37:0/3718206412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2504005180 0x7f251c1537d0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 >> 172.21.15.37:0/3718206412 conn(0x7f251c073090 msgr2=0x7f251c15a850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 shutdown_connections 2023-07-09T21:38:20.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.175+0000 7f2522559640 1 -- 172.21.15.37:0/3718206412 wait complete. 2023-07-09T21:38:20.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:38:20.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 Processor -- start 2023-07-09T21:38:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 -- start start 2023-07-09T21:38:20.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f71600b4340 0x7f716006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f71600cef80 0x7f71600d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600b49f0 con 0x7f71600b7ab0 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600b7e80 con 0x7f71600cef80 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7164848640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600cc8a0 con 0x7f71600b4340 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715e59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f71600b7ab0 0x7f71600b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40962/0 (socket says 172.21.15.37:40962) 2023-07-09T21:38:20.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715e59c640 1 -- 172.21.15.37:0/486684059 learned_addr learned my addr 172.21.15.37:0/486684059 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715ed9d640 1 --2- 172.21.15.37:0/486684059 >> v2:172.21.15.37:3300/0 conn(0x7f71600cef80 0x7f71600d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f7157fff640 1 --2- 172.21.15.37:0/486684059 >> v2:172.21.15.119:3300/0 conn(0x7f71600b4340 0x7f716006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715ed9d640 1 -- 172.21.15.37:0/486684059 >> v2:172.21.15.119:3300/0 conn(0x7f71600b4340 msgr2=0x7f716006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715ed9d640 1 --2- 172.21.15.37:0/486684059 >> v2:172.21.15.119:3300/0 conn(0x7f71600b4340 0x7f716006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715ed9d640 1 -- 172.21.15.37:0/486684059 >> v1:172.21.15.37:6789/0 conn(0x7f71600b7ab0 legacy=0x7f71600b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.339+0000 7f715ed9d640 1 -- 172.21.15.37:0/486684059 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600ccb80 con 0x7f71600cef80 2023-07-09T21:38:20.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f715ed9d640 1 --2- 172.21.15.37:0/486684059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600cef80 0x7f71600d02a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f71600b4d10 tx=0x7f715801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2089c4fbe9de8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f715dd9b640 1 -- 172.21.15.37:0/486684059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580a59a0 con 0x7f71600cef80 2023-07-09T21:38:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f715dd9b640 1 -- 172.21.15.37:0/486684059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71580a5b00 con 0x7f71600cef80 2023-07-09T21:38:20.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f715dd9b640 1 -- 172.21.15.37:0/486684059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580a5e90 con 0x7f71600cef80 2023-07-09T21:38:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 -- 172.21.15.37:0/486684059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600cef80 msgr2=0x7f71600d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 --2- 172.21.15.37:0/486684059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600cef80 0x7f71600d02a0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f71600b4d10 tx=0x7f715801c8e0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 -- 172.21.15.37:0/486684059 shutdown_connections 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 --2- 172.21.15.37:0/486684059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600cef80 0x7f71600d02a0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 --2- 172.21.15.37:0/486684059 >> v2:172.21.15.119:3300/0 conn(0x7f71600b4340 0x7f716006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 -- 172.21.15.37:0/486684059 >> 172.21.15.37:0/486684059 conn(0x7f7160073090 msgr2=0x7f7160069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 -- 172.21.15.37:0/486684059 shutdown_connections 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.343+0000 7f7164848640 1 -- 172.21.15.37:0/486684059 wait complete. 2023-07-09T21:38:20.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 Processor -- start 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- start start 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71600b4340 0x7f7160152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 0x7f71600c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c8000 con 0x7f71600b7ab0 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7160153500 con 0x7f71600cef80 2023-07-09T21:38:20.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600c73f0 con 0x7f71600b4340 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57770/0 (socket says 172.21.15.37:57770) 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 -- 172.21.15.37:0/3118739487 learned_addr learned my addr 172.21.15.37:0/3118739487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f715ed9d640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 0x7f71600c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f715e59c640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71600b4340 0x7f7160152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 -- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71600b4340 msgr2=0x7f7160152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71600b4340 0x7f7160152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 -- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 msgr2=0x7f71600c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 0x7f71600c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 -- 172.21.15.37:0/3118739487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7158009a70 con 0x7f71600b7ab0 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f715ed9d640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 0x7f71600c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7157fff640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f714800d830 tx=0x7f714800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148004030 con 0x7f71600b7ab0 2023-07-09T21:38:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7148004190 con 0x7f71600b7ab0 2023-07-09T21:38:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7148004520 con 0x7f71600b7ab0 2023-07-09T21:38:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600c76d0 con 0x7f71600b7ab0 2023-07-09T21:38:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600c7c90 con 0x7f71600b7ab0 2023-07-09T21:38:20.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.347+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716004d7d0 con 0x7f71600b7ab0 2023-07-09T21:38:20.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.351+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f714800b8d0 con 0x7f71600b7ab0 2023-07-09T21:38:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.351+0000 7f7156ffd640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 0x7f7140068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.351+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7148083f70 con 0x7f71600b7ab0 2023-07-09T21:38:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.351+0000 7f715e59c640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 0x7f7140068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.351+0000 7f715e59c640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 0x7f7140068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7150005890 tx=0x7f7150009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.355+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7148051620 con 0x7f71600b7ab0 2023-07-09T21:38:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.511+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f716006a830 con 0x7f71600b7ab0 2023-07-09T21:38:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.511+0000 7f7156ffd640 1 -- 172.21.15.37:0/3118739487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7148054c40 con 0x7f71600b7ab0 2023-07-09T21:38:20.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:20.516 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:20.517 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:38:20.517 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:38:20.517 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:20.517 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:38:20.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 msgr2=0x7f7140068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 0x7f7140068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7150005890 tx=0x7f7150009040 comp rx=0 tx=0).stop 2023-07-09T21:38:20.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 msgr2=0x7f71600cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f714800d830 tx=0x7f714800dcf0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 shutdown_connections 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f71400663a0 0x7f7140068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f71600cef80 0x7f71600c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71600b7ab0 0x7f71600cba90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 --2- 172.21.15.37:0/3118739487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f71600b4340 0x7f7160152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 >> 172.21.15.37:0/3118739487 conn(0x7f7160073090 msgr2=0x7f71600b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:20.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 shutdown_connections 2023-07-09T21:38:20.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.515+0000 7f7164848640 1 -- 172.21.15.37:0/3118739487 wait complete. 2023-07-09T21:38:20.536 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:38:20.537 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:38:20.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.679+0000 7f3ba3f59640 1 Processor -- start 2023-07-09T21:38:20.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 -- start start 2023-07-09T21:38:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b9c1585b0 0x7f3b9c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 0x7f3b9c0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c0c9090 con 0x7f3b9c0c4350 2023-07-09T21:38:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0c47f0 con 0x7f3b9c1585b0 2023-07-09T21:38:20.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba3f59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0cbf40 con 0x7f3b9c06b970 2023-07-09T21:38:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba24f6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b9c0c4350 0x7f3b9c15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40970/0 (socket says 172.21.15.37:40970) 2023-07-09T21:38:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba24f6640 1 -- 172.21.15.37:0/650811857 learned_addr learned my addr 172.21.15.37:0/650811857 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 0x7f3b9c0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/650811857 >> v2:172.21.15.119:3300/0 conn(0x7f3b9c1585b0 0x7f3b9c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba0cf3640 1 -- 172.21.15.37:0/650811857 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34665255 0 0) 0x7f3b9c0c9090 con 0x7f3b9c0c4350 2023-07-09T21:38:20.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba0cf3640 1 -- 172.21.15.37:0/650811857 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b88003530 con 0x7f3b9c0c4350 2023-07-09T21:38:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 msgr2=0x7f3b9c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:20.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 0x7f3b9c0c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/650811857 >> v1:172.21.15.37:6789/0 conn(0x7f3b9c0c4350 legacy=0x7f3b9c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/650811857 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0c8a60 con 0x7f3b9c1585b0 2023-07-09T21:38:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.683+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 0x7f3b9c0c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:20.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c1585b0 0x7f3b9c06b430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b980097f0 tx=0x7f3b9801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23bc975cd5f8be31 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba0cf3640 1 -- 172.21.15.37:0/650811857 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980ab650 con 0x7f3b9c1585b0 2023-07-09T21:38:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba0cf3640 1 -- 172.21.15.37:0/650811857 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980ab7b0 con 0x7f3b9c1585b0 2023-07-09T21:38:20.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba0cf3640 1 -- 172.21.15.37:0/650811857 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980abb40 con 0x7f3b9c1585b0 2023-07-09T21:38:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 -- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c1585b0 msgr2=0x7f3b9c06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c1585b0 0x7f3b9c06b430 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3b980097f0 tx=0x7f3b9801c450 comp rx=0 tx=0).stop 2023-07-09T21:38:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 -- 172.21.15.37:0/650811857 shutdown_connections 2023-07-09T21:38:20.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c06b970 0x7f3b9c0c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/650811857 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c1585b0 0x7f3b9c06b430 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 -- 172.21.15.37:0/650811857 >> 172.21.15.37:0/650811857 conn(0x7f3b9c0cde40 msgr2=0x7f3b9c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 -- 172.21.15.37:0/650811857 shutdown_connections 2023-07-09T21:38:20.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.687+0000 7f3ba3f59640 1 -- 172.21.15.37:0/650811857 wait complete. 2023-07-09T21:38:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 Processor -- start 2023-07-09T21:38:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- start start 2023-07-09T21:38:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 0x7f3b9c0acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 0x7f3b9c0ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0ab860 con 0x7f3b9c06b970 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0abb40 con 0x7f3b9c0c4350 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0abe20 con 0x7f3b9c1585b0 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57784/0 (socket says 172.21.15.37:57784) 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/828117482 learned_addr learned my addr 172.21.15.37:0/828117482 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba24f6640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 0x7f3b9c0ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 msgr2=0x7f3b9c0ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 0x7f3b9c0ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 msgr2=0x7f3b9c0acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 0x7f3b9c0acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 0x7f3b9c0acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 -- 172.21.15.37:0/828117482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8c009420 con 0x7f3b9c06b970 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba24f6640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 0x7f3b9c0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:20.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 0x7f3b9c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba1cf5640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3b9801a080 tx=0x7f3b9801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980bf610 con 0x7f3b9c06b970 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980bf770 con 0x7f3b9c06b970 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980bfb20 con 0x7f3b9c06b970 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b98009420 con 0x7f3b9c06b970 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.691+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c0ac3e0 con 0x7f3b9c06b970 2023-07-09T21:38:20.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c04d7d0 con 0x7f3b9c06b970 2023-07-09T21:38:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b980bfc80 con 0x7f3b9c06b970 2023-07-09T21:38:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3b927fc640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 0x7f3b80068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3b9811e4f0 con 0x7f3b9c06b970 2023-07-09T21:38:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 0x7f3b80068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:20.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.695+0000 7f3ba14f4640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 0x7f3b80068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0ad430 tx=0x7f3b8c008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:20.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.699+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b980ebb10 con 0x7f3b9c06b970 2023-07-09T21:38:20.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:20.855+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3b9c06b210 con 0x7f3b9c06b970 2023-07-09T21:38:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.375+0000 7f3b927fc640 1 -- 172.21.15.37:0/828117482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3b980ef130 con 0x7f3b9c06b970 2023-07-09T21:38:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:38:21.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 msgr2=0x7f3b80068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 0x7f3b80068880 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0ad430 tx=0x7f3b8c008040 comp rx=0 tx=0).stop 2023-07-09T21:38:21.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 msgr2=0x7f3b9c13c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f3b9801a080 tx=0x7f3b9801ac90 comp rx=0 tx=0).stop 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 shutdown_connections 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f3b800663d0 0x7f3b80068880 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0ad430 tx=0x7f3b8c008040 comp rx=0 tx=0).stop 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b9c1585b0 0x7f3b9c0ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b9c0c4350 0x7f3b9c0acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 --2- 172.21.15.37:0/828117482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c06b970 0x7f3b9c13c7d0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 >> 172.21.15.37:0/828117482 conn(0x7f3b9c0cde40 msgr2=0x7f3b9c06f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:21.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 shutdown_connections 2023-07-09T21:38:21.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.383+0000 7f3ba3f59640 1 -- 172.21.15.37:0/828117482 wait complete. 2023-07-09T21:38:21.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:38:21.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 Processor -- start 2023-07-09T21:38:21.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 -- start start 2023-07-09T21:38:21.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d40c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:21.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40c4c90 con 0x7f50d41595c0 2023-07-09T21:38:21.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40ca170 con 0x7f50d4159990 2023-07-09T21:38:21.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50db0bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40ca730 con 0x7f50d40cda10 2023-07-09T21:38:21.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d8e59640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50d41595c0 0x7f50d415dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40980/0 (socket says 172.21.15.37:40980) 2023-07-09T21:38:21.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d8e59640 1 -- 172.21.15.37:0/3964577227 learned_addr learned my addr 172.21.15.37:0/3964577227 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:21.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d965a640 1 --2- 172.21.15.37:0/3964577227 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d40c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:21.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065016317 0 0) 0x7f50c8001120 con 0x7f50d41595c0 2023-07-09T21:38:21.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c4003530 con 0x7f50d41595c0 2023-07-09T21:38:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078485014 0 0) 0x7f50d40ca170 con 0x7f50d4159990 2023-07-09T21:38:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50c8001120 con 0x7f50d4159990 2023-07-09T21:38:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d965a640 1 -- 172.21.15.37:0/3964577227 >> v1:172.21.15.119:6789/0 conn(0x7f50d4159990 legacy=0x7f50d40cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d965a640 1 -- 172.21.15.37:0/3964577227 >> v1:172.21.15.37:6789/0 conn(0x7f50d41595c0 legacy=0x7f50d415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.559+0000 7f50d965a640 1 -- 172.21.15.37:0/3964577227 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40ca450 con 0x7f50d40cda10 2023-07-09T21:38:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50d965a640 1 --2- 172.21.15.37:0/3964577227 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d40c4750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009dc0 tx=0x7f50cc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6f17cbbf4a611c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:21.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0a5a00 con 0x7f50d40cda10 2023-07-09T21:38:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0a5b60 con 0x7f50d40cda10 2023-07-09T21:38:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50d37fe640 1 -- 172.21.15.37:0/3964577227 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0ad440 con 0x7f50d40cda10 2023-07-09T21:38:21.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 -- 172.21.15.37:0/3964577227 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 msgr2=0x7f50d40c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 --2- 172.21.15.37:0/3964577227 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d40c4750 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009dc0 tx=0x7f50cc01c940 comp rx=0 tx=0).stop 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 -- 172.21.15.37:0/3964577227 shutdown_connections 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 --2- 172.21.15.37:0/3964577227 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d40c4750 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 -- 172.21.15.37:0/3964577227 >> 172.21.15.37:0/3964577227 conn(0x7f50d40cde40 msgr2=0x7f50d40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 -- 172.21.15.37:0/3964577227 shutdown_connections 2023-07-09T21:38:21.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.563+0000 7f50db0bd640 1 -- 172.21.15.37:0/3964577227 wait complete. 2023-07-09T21:38:21.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 Processor -- start 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- start start 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d41509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 0x7f50d4163010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d41655a0 con 0x7f50d4159990 2023-07-09T21:38:21.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d406bda0 con 0x7f50d41595c0 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d406c020 con 0x7f50d40cda10 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57790/0 (socket says 172.21.15.37:57790) 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 -- 172.21.15.37:0/1519581816 learned_addr learned my addr 172.21.15.37:0/1519581816 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d8e59640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d41509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:21.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d3fff640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 0x7f50d4163010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 -- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 msgr2=0x7f50d41509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d41509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 -- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 msgr2=0x7f50d4163010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 0x7f50d4163010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 -- 172.21.15.37:0/1519581816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009a70 con 0x7f50d4159990 2023-07-09T21:38:21.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d3fff640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 0x7f50d4163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d965a640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0b0040 tx=0x7f50cc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0adce0 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50cc0ade40 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d4150f30 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50cc0b9690 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.567+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d41652c0 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d404d7d0 con 0x7f50d4159990 2023-07-09T21:38:21.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50cc0b97f0 con 0x7f50d4159990 2023-07-09T21:38:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50d17fa640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 0x7f50b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f50cc11ff20 con 0x7f50d4159990 2023-07-09T21:38:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50d8e59640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 0x7f50b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.571+0000 7f50d8e59640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 0x7f50b8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000f70 tx=0x7f50c8009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:21.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.575+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50cc0ed3c0 con 0x7f50d4159990 2023-07-09T21:38:21.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:21.731+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f50d406c160 con 0x7f50d4159990 2023-07-09T21:38:22.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.379+0000 7f50d17fa640 1 -- 172.21.15.37:0/1519581816 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f50cc0b2020 con 0x7f50d4159990 2023-07-09T21:38:22.388 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:38:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 msgr2=0x7f50b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 0x7f50b8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f50c8000f70 tx=0x7f50c8009040 comp rx=0 tx=0).stop 2023-07-09T21:38:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 msgr2=0x7f50d4070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0b0040 tx=0x7f50cc0196e0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 shutdown_connections 2023-07-09T21:38:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f50b80663a0 0x7f50b8068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50d4159990 0x7f50d4070090 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50d41595c0 0x7f50d4163010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 --2- 172.21.15.37:0/1519581816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50d40cda10 0x7f50d41509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.387+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 >> 172.21.15.37:0/1519581816 conn(0x7f50d40cde40 msgr2=0x7f50d4159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:22.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.391+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 shutdown_connections 2023-07-09T21:38:22.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.391+0000 7f50db0bd640 1 -- 172.21.15.37:0/1519581816 wait complete. 2023-07-09T21:38:22.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:38:22.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 Processor -- start 2023-07-09T21:38:22.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 -- start start 2023-07-09T21:38:22.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7f2c159990 0x7f7f2c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:22.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0c4c90 con 0x7f7f2c1595c0 2023-07-09T21:38:22.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0ca170 con 0x7f7f2c0c99e0 2023-07-09T21:38:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f31a93640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0ca730 con 0x7f7f2c159990 2023-07-09T21:38:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f2c1595c0 0x7f7f2c15dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40990/0 (socket says 172.21.15.37:40990) 2023-07-09T21:38:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2b7fe640 1 -- 172.21.15.37:0/2680229214 learned_addr learned my addr 172.21.15.37:0/2680229214 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2affd640 1 --2- 172.21.15.37:0/2680229214 >> v2:172.21.15.37:3300/0 conn(0x7f7f2c159990 0x7f7f2c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:22.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2affd640 1 -- 172.21.15.37:0/2680229214 >> v1:172.21.15.119:6789/0 conn(0x7f7f2c0c99e0 legacy=0x7f7f2c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2affd640 1 -- 172.21.15.37:0/2680229214 >> v1:172.21.15.37:6789/0 conn(0x7f7f2c1595c0 legacy=0x7f7f2c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.575+0000 7f7f2affd640 1 -- 172.21.15.37:0/2680229214 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0ca450 con 0x7f7f2c159990 2023-07-09T21:38:22.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f2affd640 1 --2- 172.21.15.37:0/2680229214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c159990 0x7f7f2c0c4750 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097c0 tx=0x7f7f2001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6a8c31128de02 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:22.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f2a7fc640 1 -- 172.21.15.37:0/2680229214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200ab650 con 0x7f7f2c159990 2023-07-09T21:38:22.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f2a7fc640 1 -- 172.21.15.37:0/2680229214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f200ab7b0 con 0x7f7f2c159990 2023-07-09T21:38:22.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f2a7fc640 1 -- 172.21.15.37:0/2680229214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200abb40 con 0x7f7f2c159990 2023-07-09T21:38:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 -- 172.21.15.37:0/2680229214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c159990 msgr2=0x7f7f2c0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 --2- 172.21.15.37:0/2680229214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c159990 0x7f7f2c0c4750 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097c0 tx=0x7f7f2001c450 comp rx=0 tx=0).stop 2023-07-09T21:38:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 -- 172.21.15.37:0/2680229214 shutdown_connections 2023-07-09T21:38:22.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 --2- 172.21.15.37:0/2680229214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c159990 0x7f7f2c0c4750 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 -- 172.21.15.37:0/2680229214 >> 172.21.15.37:0/2680229214 conn(0x7f7f2c0cde40 msgr2=0x7f7f2c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 -- 172.21.15.37:0/2680229214 shutdown_connections 2023-07-09T21:38:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.579+0000 7f7f31a93640 1 -- 172.21.15.37:0/2680229214 wait complete. 2023-07-09T21:38:22.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 Processor -- start 2023-07-09T21:38:22.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 -- start start 2023-07-09T21:38:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f2c0c99e0 0x7f7f2c0701e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f2c159990 0x7f7f2c1f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:22.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c147c10 con 0x7f7f2c1595c0 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c06afc0 con 0x7f7f2c159990 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f31a93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c06b2a0 con 0x7f7f2c0c99e0 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57812/0 (socket says 172.21.15.37:57812) 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 -- 172.21.15.37:0/3198359331 learned_addr learned my addr 172.21.15.37:0/3198359331 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2b7fe640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f2c0c99e0 0x7f7f2c0701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:22.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2bfff640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f2c159990 0x7f7f2c1f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 -- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f2c0c99e0 msgr2=0x7f7f2c0701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f2c0c99e0 0x7f7f2c0701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 -- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f2c159990 msgr2=0x7f7f2c1f77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f2c159990 0x7f7f2c1f77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:22.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 -- 172.21.15.37:0/3198359331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009420 con 0x7f7f2c1595c0 2023-07-09T21:38:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f2affd640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7f2001a080 tx=0x7f7f200191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.583+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200abe30 con 0x7f7f2c1595c0 2023-07-09T21:38:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f200be3f0 con 0x7f7f2c1595c0 2023-07-09T21:38:22.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c06b580 con 0x7f7f2c1595c0 2023-07-09T21:38:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200be7a0 con 0x7f7f2c1595c0 2023-07-09T21:38:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c0708f0 con 0x7f7f2c1595c0 2023-07-09T21:38:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c06ae20 con 0x7f7f2c1595c0 2023-07-09T21:38:22.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f200bd3a0 con 0x7f7f2c1595c0 2023-07-09T21:38:22.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f13fff640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 0x7f7f18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:22.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7f2011ec50 con 0x7f7f2c1595c0 2023-07-09T21:38:22.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.587+0000 7f7f2b7fe640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 0x7f7f18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:22.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.591+0000 7f7f2b7fe640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 0x7f7f18068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005890 tx=0x7f7f1c009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:22.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.591+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f200ec1e0 con 0x7f7f2c1595c0 2023-07-09T21:38:22.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:22.779+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7f2c06ae20 con 0x7f7f2c1595c0 2023-07-09T21:38:23.431 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 9 and data pool 10 2023-07-09T21:38:23.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.427+0000 7f7f13fff640 1 -- 172.21.15.37:0/3198359331 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v28) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7f2c06ae20 con 0x7f7f2c1595c0 2023-07-09T21:38:23.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 msgr2=0x7f7f18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 0x7f7f18068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c005890 tx=0x7f7f1c009040 comp rx=0 tx=0).stop 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 msgr2=0x7f7f2c162940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f7f2001a080 tx=0x7f7f200191f0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 shutdown_connections 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f7f180663a0 0x7f7f18068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f2c159990 0x7f7f2c1f77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f2c1595c0 0x7f7f2c162940 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 --2- 172.21.15.37:0/3198359331 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f2c0c99e0 0x7f7f2c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 >> 172.21.15.37:0/3198359331 conn(0x7f7f2c0cde40 msgr2=0x7f7f2c159f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 shutdown_connections 2023-07-09T21:38:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.431+0000 7f7f31a93640 1 -- 172.21.15.37:0/3198359331 wait complete. 2023-07-09T21:38:23.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 Processor -- start 2023-07-09T21:38:23.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 -- start start 2023-07-09T21:38:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb60c0af830 0x7fb60c0afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0cbe90 con 0x7fb60c06f6d0 2023-07-09T21:38:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0b0140 con 0x7fb60c0cc320 2023-07-09T21:38:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb611ed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb60c06d370 con 0x7fb60c0af830 2023-07-09T21:38:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb60bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb60c06f6d0 0x7fb60c06c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40992/0 (socket says 172.21.15.37:40992) 2023-07-09T21:38:23.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.607+0000 7fb60bfff640 1 -- 172.21.15.37:0/3446554006 learned_addr learned my addr 172.21.15.37:0/3446554006 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/3446554006 >> v2:172.21.15.119:3300/0 conn(0x7fb60c0af830 0x7fb60c0afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3490247528 0 0) 0x7fb60c0cbe90 con 0x7fb60c06f6d0 2023-07-09T21:38:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f4003530 con 0x7fb60c06f6d0 2023-07-09T21:38:23.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2155546530 0 0) 0x7fb5f4003530 con 0x7fb60c06f6d0 2023-07-09T21:38:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 >> v2:172.21.15.119:3300/0 conn(0x7fb60c0af830 msgr2=0x7fb60c0afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 --2- 172.21.15.37:0/3446554006 >> v2:172.21.15.119:3300/0 conn(0x7fb60c0af830 0x7fb60c0afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 >> v1:172.21.15.119:6789/0 conn(0x7fb60c0cc320 legacy=0x7fb60c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c159bb0 con 0x7fb60c06f6d0 2023-07-09T21:38:23.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fb604001a50 con 0x7fb60c06f6d0 2023-07-09T21:38:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 >> v1:172.21.15.37:6789/0 conn(0x7fb60c06f6d0 legacy=0x7fb60c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 0x7fb5f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5f40047d0 0x7fb5f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4005180 0x7fb5f400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c06d370 con 0x7fb5f4005180 2023-07-09T21:38:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400c000 con 0x7fb5f4003980 2023-07-09T21:38:23.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f400c1c0 con 0x7fb5f40047d0 2023-07-09T21:38:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 0x7fb5f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60bfff640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4005180 0x7fb5f400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60affd640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5f40047d0 0x7fb5f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 -- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5f40047d0 msgr2=0x7fb5f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5f40047d0 0x7fb5f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 -- 172.21.15.37:0/3446554006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4005180 msgr2=0x7fb5f400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4005180 0x7fb5f400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60b7fe640 1 -- 172.21.15.37:0/3446554006 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f4003530 con 0x7fb5f4003980 2023-07-09T21:38:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60bfff640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4005180 0x7fb5f400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:23.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.611+0000 7fb60bfff640 1 -- 172.21.15.37:0/3446554006 reap_dead start 2023-07-09T21:38:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 0x7fb5f4003d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ae0 tx=0x7fb5fc01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13043f8d2bbfdaea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0a5560 con 0x7fb5f4003980 2023-07-09T21:38:23.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0a56c0 con 0x7fb5f4003980 2023-07-09T21:38:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb60a7fc640 1 -- 172.21.15.37:0/3446554006 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc0a5a70 con 0x7fb5f4003980 2023-07-09T21:38:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 msgr2=0x7fb5f4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 0x7fb5f4003d90 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc009ae0 tx=0x7fb5fc01ca50 comp rx=0 tx=0).stop 2023-07-09T21:38:23.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- 172.21.15.37:0/3446554006 shutdown_connections 2023-07-09T21:38:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 --2- 172.21.15.37:0/3446554006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5f4003980 0x7fb5f4003d90 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- 172.21.15.37:0/3446554006 >> 172.21.15.37:0/3446554006 conn(0x7fb60c0ca830 msgr2=0x7fb60c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- 172.21.15.37:0/3446554006 shutdown_connections 2023-07-09T21:38:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- 172.21.15.37:0/3446554006 wait complete. 2023-07-09T21:38:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 Processor -- start 2023-07-09T21:38:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.615+0000 7fb611ed8640 1 -- start start 2023-07-09T21:38:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb60c0c4410 0x7fb60c0c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 0x7fb60c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0ac730 con 0x7fb5f4003980 2023-07-09T21:38:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0c3930 con 0x7fb60c152fe0 2023-07-09T21:38:23.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0c3c10 con 0x7fb60c0c4410 2023-07-09T21:38:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57836/0 (socket says 172.21.15.37:57836) 2023-07-09T21:38:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 -- 172.21.15.37:0/1883289973 learned_addr learned my addr 172.21.15.37:0/1883289973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60affd640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb60c0c4410 0x7fb60c0c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60bfff640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 0x7fb60c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 -- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb60c0c4410 msgr2=0x7fb60c0c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb60c0c4410 0x7fb60c0c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 -- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 msgr2=0x7fb60c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 0x7fb60c153450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 -- 172.21.15.37:0/1883289973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0c3ef0 con 0x7fb5f4003980 2023-07-09T21:38:23.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60bfff640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 0x7fb60c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb60b7fe640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc01c880 tx=0x7fb5fc0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc004020 con 0x7fb5f4003980 2023-07-09T21:38:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc0041c0 con 0x7fb5f4003980 2023-07-09T21:38:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc003620 con 0x7fb5f4003980 2023-07-09T21:38:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0c35e0 con 0x7fb5f4003980 2023-07-09T21:38:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c158cb0 con 0x7fb5f4003980 2023-07-09T21:38:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c0c4080 con 0x7fb5f4003980 2023-07-09T21:38:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.619+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5fc0b4070 con 0x7fb5f4003980 2023-07-09T21:38:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.623+0000 7fb5f3fff640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 0x7fb5f8068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.623+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb5fc11e120 con 0x7fb5f4003980 2023-07-09T21:38:23.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.623+0000 7fb60affd640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 0x7fb5f8068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.623+0000 7fb60affd640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 0x7fb5f8068840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb600000c10 tx=0x7fb600009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.627+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5fc0eb4a0 con 0x7fb5f4003980 2023-07-09T21:38:23.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb60c04d7d0 con 0x7fb5f4003980 2023-07-09T21:38:23.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb5f3fff640 1 -- 172.21.15.37:0/1883289973 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18294 (secure 0 0 0) 0x7fb5fc0eeac0 con 0x7fb5f4003980 2023-07-09T21:38:23.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:23.785 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:22.782844+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:23.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 msgr2=0x7fb5f8068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 0x7fb5f8068840 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb600000c10 tx=0x7fb600009040 comp rx=0 tx=0).stop 2023-07-09T21:38:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 msgr2=0x7fb60c1585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc01c880 tx=0x7fb5fc0197f0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 shutdown_connections 2023-07-09T21:38:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5f8066390 0x7fb5f8068840 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb60c152fe0 0x7fb60c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb60c0c4410 0x7fb60c0c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 --2- 172.21.15.37:0/1883289973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5f4003980 0x7fb60c1585a0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 >> 172.21.15.37:0/1883289973 conn(0x7fb60c0ca830 msgr2=0x7fb60c0ae9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 shutdown_connections 2023-07-09T21:38:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.783+0000 7fb611ed8640 1 -- 172.21.15.37:0/1883289973 wait complete. 2023-07-09T21:38:23.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 Processor -- start 2023-07-09T21:38:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 -- start start 2023-07-09T21:38:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb1780b4340 0x7fb17806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1780cef80 0x7fb1780d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780b49f0 con 0x7fb1780b7ab0 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780b7e80 con 0x7fb1780cef80 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb17dfc5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780cc8a0 con 0x7fb1780b4340 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb1777fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb1780b7ab0 0x7fb1780b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41002/0 (socket says 172.21.15.37:41002) 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb1777fe640 1 -- 172.21.15.37:0/2868667912 learned_addr learned my addr 172.21.15.37:0/2868667912 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.947+0000 7fb177fff640 1 --2- 172.21.15.37:0/2868667912 >> v2:172.21.15.37:3300/0 conn(0x7fb1780cef80 0x7fb1780d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb176ffd640 1 --2- 172.21.15.37:0/2868667912 >> v2:172.21.15.119:3300/0 conn(0x7fb1780b4340 0x7fb17806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb177fff640 1 -- 172.21.15.37:0/2868667912 >> v2:172.21.15.119:3300/0 conn(0x7fb1780b4340 msgr2=0x7fb17806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb177fff640 1 --2- 172.21.15.37:0/2868667912 >> v2:172.21.15.119:3300/0 conn(0x7fb1780b4340 0x7fb17806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb177fff640 1 -- 172.21.15.37:0/2868667912 >> v1:172.21.15.37:6789/0 conn(0x7fb1780b7ab0 legacy=0x7fb1780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb177fff640 1 -- 172.21.15.37:0/2868667912 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780ccb80 con 0x7fb1780cef80 2023-07-09T21:38:23.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb177fff640 1 --2- 172.21.15.37:0/2868667912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780cef80 0x7fb1780d02a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b4d10 tx=0x7fb17001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93957d702868f54d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb1767fc640 1 -- 172.21.15.37:0/2868667912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700a59a0 con 0x7fb1780cef80 2023-07-09T21:38:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb1767fc640 1 -- 172.21.15.37:0/2868667912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700a5b00 con 0x7fb1780cef80 2023-07-09T21:38:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.951+0000 7fb1767fc640 1 -- 172.21.15.37:0/2868667912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700a5e90 con 0x7fb1780cef80 2023-07-09T21:38:23.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- 172.21.15.37:0/2868667912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780cef80 msgr2=0x7fb1780d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/2868667912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780cef80 0x7fb1780d02a0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fb1780b4d10 tx=0x7fb17001c8e0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- 172.21.15.37:0/2868667912 shutdown_connections 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/2868667912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780cef80 0x7fb1780d02a0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/2868667912 >> v2:172.21.15.119:3300/0 conn(0x7fb1780b4340 0x7fb17806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- 172.21.15.37:0/2868667912 >> 172.21.15.37:0/2868667912 conn(0x7fb178073090 msgr2=0x7fb178069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- 172.21.15.37:0/2868667912 shutdown_connections 2023-07-09T21:38:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- 172.21.15.37:0/2868667912 wait complete. 2023-07-09T21:38:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 Processor -- start 2023-07-09T21:38:23.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- start start 2023-07-09T21:38:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b7ab0 0x7fb1780c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780cef80 0x7fb17815a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c86b0 con 0x7fb1780b4340 2023-07-09T21:38:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780cbe40 con 0x7fb1780cef80 2023-07-09T21:38:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb17dfc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1780c70d0 con 0x7fb1780b7ab0 2023-07-09T21:38:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57856/0 (socket says 172.21.15.37:57856) 2023-07-09T21:38:23.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 -- 172.21.15.37:0/4069249461 learned_addr learned my addr 172.21.15.37:0/4069249461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb177fff640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780cef80 0x7fb17815a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb176ffd640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b7ab0 0x7fb1780c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 -- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b7ab0 msgr2=0x7fb1780c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b7ab0 0x7fb1780c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 -- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780cef80 msgr2=0x7fb17815a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780cef80 0x7fb17815a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.955+0000 7fb1777fe640 1 -- 172.21.15.37:0/4069249461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009a70 con 0x7fb1780b4340 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb1777fe640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c500 tx=0x7fb16800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb168005cf0 con 0x7fb1780b4340 2023-07-09T21:38:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb168005e50 con 0x7fb1780b4340 2023-07-09T21:38:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1680072f0 con 0x7fb1780b4340 2023-07-09T21:38:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1780c73b0 con 0x7fb1780b4340 2023-07-09T21:38:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780c7970 con 0x7fb1780b4340 2023-07-09T21:38:23.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17804d7d0 con 0x7fb1780b4340 2023-07-09T21:38:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb168007450 con 0x7fb1780b4340 2023-07-09T21:38:23.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 0x7fb164068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb168083320 con 0x7fb1780b4340 2023-07-09T21:38:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.959+0000 7fb176ffd640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 0x7fb164068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:23.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.963+0000 7fb176ffd640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 0x7fb164068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb178070bc0 tx=0x7fb16c008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:23.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:23.963+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1680507d0 con 0x7fb1780b4340 2023-07-09T21:38:24.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.119+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb17806a830 con 0x7fb1780b4340 2023-07-09T21:38:24.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.119+0000 7fb15ffff640 1 -- 172.21.15.37:0/4069249461 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+18294 (secure 0 0 0) 0x7fb168053df0 con 0x7fb1780b4340 2023-07-09T21:38:24.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:24.124 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:22.782844+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 msgr2=0x7fb164068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 0x7fb164068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb178070bc0 tx=0x7fb16c008040 comp rx=0 tx=0).stop 2023-07-09T21:38:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 msgr2=0x7fb1780c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb16800c500 tx=0x7fb16800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 shutdown_connections 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb1640663d0 0x7fb164068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1780cef80 0x7fb17815a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1780b7ab0 0x7fb1780c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 --2- 172.21.15.37:0/4069249461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1780b4340 0x7fb1780c8170 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 >> 172.21.15.37:0/4069249461 conn(0x7fb178073090 msgr2=0x7fb1780b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:24.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 shutdown_connections 2023-07-09T21:38:24.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.123+0000 7fb17dfc5640 1 -- 172.21.15.37:0/4069249461 wait complete. 2023-07-09T21:38:24.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:38:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 Processor -- start 2023-07-09T21:38:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 -- start start 2023-07-09T21:38:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 0x7fc044160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04415bf80 con 0x7fc0440b3c20 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440cd070 con 0x7fc0440b7980 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc04a5c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440cfd70 con 0x7fc0440ceb80 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc043fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 0x7fc044160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc043fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 0x7fc044160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:36424/0 (socket says 172.21.15.37:36424) 2023-07-09T21:38:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc043fff640 1 -- 172.21.15.37:0/769963062 learned_addr learned my addr 172.21.15.37:0/769963062 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:38296/0 (socket says 172.21.15.37:38296) 2023-07-09T21:38:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 -- 172.21.15.37:0/769963062 >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 msgr2=0x7fc044160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 --2- 172.21.15.37:0/769963062 >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 0x7fc044160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 -- 172.21.15.37:0/769963062 >> v1:172.21.15.119:6789/0 conn(0x7fc0440b3c20 legacy=0x7fc0440b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.291+0000 7fc0437fe640 1 -- 172.21.15.37:0/769963062 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc044160570 con 0x7fc0440ceb80 2023-07-09T21:38:24.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc0437fe640 1 --2- 172.21.15.37:0/769963062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0380097c0 tx=0x7fc03801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a56d5f36c95bf25 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:24.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc042ffd640 1 -- 172.21.15.37:0/769963062 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380ab600 con 0x7fc0440ceb80 2023-07-09T21:38:24.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc042ffd640 1 -- 172.21.15.37:0/769963062 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380a7050 con 0x7fc0440ceb80 2023-07-09T21:38:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc042ffd640 1 -- 172.21.15.37:0/769963062 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380ab980 con 0x7fc0440ceb80 2023-07-09T21:38:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 -- 172.21.15.37:0/769963062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 msgr2=0x7fc0440cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/769963062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0380097c0 tx=0x7fc03801c480 comp rx=0 tx=0).stop 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 -- 172.21.15.37:0/769963062 shutdown_connections 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/769963062 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc0440cef90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/769963062 >> v2:172.21.15.119:3300/0 conn(0x7fc0440b7980 0x7fc044160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 -- 172.21.15.37:0/769963062 >> 172.21.15.37:0/769963062 conn(0x7fc044073090 msgr2=0x7fc044069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 -- 172.21.15.37:0/769963062 shutdown_connections 2023-07-09T21:38:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.295+0000 7fc04a5c5640 1 -- 172.21.15.37:0/769963062 wait complete. 2023-07-09T21:38:24.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 Processor -- start 2023-07-09T21:38:24.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- start start 2023-07-09T21:38:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 0x7fc0441f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc04415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04415c250 con 0x7fc0440b3c20 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04415e7b0 con 0x7fc0440b7980 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04415c4f0 con 0x7fc0440ceb80 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57862/0 (socket says 172.21.15.37:57862) 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 -- 172.21.15.37:0/4262177634 learned_addr learned my addr 172.21.15.37:0/4262177634 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc0437fe640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 0x7fc0441f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc048b62640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc04415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 -- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 msgr2=0x7fc04415dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc04415dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 -- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 msgr2=0x7fc0441f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 0x7fc0441f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 -- 172.21.15.37:0/4262177634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc038009420 con 0x7fc0440b3c20 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc0437fe640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 0x7fc0441f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc048b62640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc04415dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc043fff640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc03400e890 tx=0x7fc03400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc034009620 con 0x7fc0440b3c20 2023-07-09T21:38:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400c940 con 0x7fc0440b3c20 2023-07-09T21:38:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04415c7d0 con 0x7fc0440b3c20 2023-07-09T21:38:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400ccf0 con 0x7fc0440b3c20 2023-07-09T21:38:24.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.299+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0441f8a80 con 0x7fc0440b3c20 2023-07-09T21:38:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc04404d7d0 con 0x7fc0440b3c20 2023-07-09T21:38:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc034013470 con 0x7fc0440b3c20 2023-07-09T21:38:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc040ff9640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 0x7fc030068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc034083f60 con 0x7fc0440b3c20 2023-07-09T21:38:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc0437fe640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 0x7fc030068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.303+0000 7fc0437fe640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 0x7fc030068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0380ad000 tx=0x7fc0380a6000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.307+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc034054df0 con 0x7fc0440b3c20 2023-07-09T21:38:24.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:24.495+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc04406a800 con 0x7fc0440b3c20 2023-07-09T21:38:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.447+0000 7fc040ff9640 1 -- 172.21.15.37:0/4262177634 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc0340170b0 con 0x7fc0440b3c20 2023-07-09T21:38:25.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 msgr2=0x7fc030068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 0x7fc030068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc0380ad000 tx=0x7fc0380a6000 comp rx=0 tx=0).stop 2023-07-09T21:38:25.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 msgr2=0x7fc04415ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc03400e890 tx=0x7fc03400ed50 comp rx=0 tx=0).stop 2023-07-09T21:38:25.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 shutdown_connections 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fc0300663a0 0x7fc030068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0440ceb80 0x7fc04415dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0440b7980 0x7fc0441f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 --2- 172.21.15.37:0/4262177634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0440b3c20 0x7fc04415ccf0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 >> 172.21.15.37:0/4262177634 conn(0x7fc044073090 msgr2=0x7fc0440b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 shutdown_connections 2023-07-09T21:38:25.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.451+0000 7fc04a5c5640 1 -- 172.21.15.37:0/4262177634 wait complete. 2023-07-09T21:38:25.475 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:38:25.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:38:25.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.623+0000 7fe94c7ac640 1 Processor -- start 2023-07-09T21:38:25.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.623+0000 7fe94c7ac640 1 -- start start 2023-07-09T21:38:25.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94c7ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 0x7fe9440c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94c7ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9440c34f0 con 0x7fe94406bd00 2023-07-09T21:38:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94c7ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe94406c250 con 0x7fe944141440 2023-07-09T21:38:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94c7ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94406c530 con 0x7fe9440cc090 2023-07-09T21:38:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94ad49640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe94406bd00 0x7fe9440c3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41008/0 (socket says 172.21.15.37:41008) 2023-07-09T21:38:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe94ad49640 1 -- 172.21.15.37:0/359731078 learned_addr learned my addr 172.21.15.37:0/359731078 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949d47640 1 --2- 172.21.15.37:0/359731078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 0x7fe9440c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278008 0 0) 0x7fe9440c34f0 con 0x7fe94406bd00 2023-07-09T21:38:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe930003450 con 0x7fe94406bd00 2023-07-09T21:38:25.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3545934987 0 0) 0x7fe94406c250 con 0x7fe944141440 2023-07-09T21:38:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9440c34f0 con 0x7fe944141440 2023-07-09T21:38:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949d47640 1 -- 172.21.15.37:0/359731078 >> v1:172.21.15.119:6789/0 conn(0x7fe944141440 legacy=0x7fe9440cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949d47640 1 -- 172.21.15.37:0/359731078 >> v1:172.21.15.37:6789/0 conn(0x7fe94406bd00 legacy=0x7fe9440c3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667789455 0 0) 0x7fe930003450 con 0x7fe94406bd00 2023-07-09T21:38:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.627+0000 7fe949d47640 1 -- 172.21.15.37:0/359731078 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440c2ea0 con 0x7fe9440cc090 2023-07-09T21:38:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe949d47640 1 --2- 172.21.15.37:0/359731078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 0x7fe9440c3980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9340097f0 tx=0x7fe93401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a26eaa35951947c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94406b110 con 0x7fe9440cc090 2023-07-09T21:38:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9340a7050 con 0x7fe9440cc090 2023-07-09T21:38:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe949546640 1 -- 172.21.15.37:0/359731078 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c001a00 con 0x7fe9440cc090 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 -- 172.21.15.37:0/359731078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 msgr2=0x7fe9440c3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/359731078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 0x7fe9440c3980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe9340097f0 tx=0x7fe93401c3e0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 -- 172.21.15.37:0/359731078 shutdown_connections 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/359731078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9440cc090 0x7fe9440c3980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 -- 172.21.15.37:0/359731078 >> 172.21.15.37:0/359731078 conn(0x7fe9440cde40 msgr2=0x7fe9440ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 -- 172.21.15.37:0/359731078 shutdown_connections 2023-07-09T21:38:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.631+0000 7fe94c7ac640 1 -- 172.21.15.37:0/359731078 wait complete. 2023-07-09T21:38:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 Processor -- start 2023-07-09T21:38:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- start start 2023-07-09T21:38:25.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe94406bd00 0x7fe9440b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 0x7fe9440c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b2280 con 0x7fe9440cc090 2023-07-09T21:38:25.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b1670 con 0x7fe944141440 2023-07-09T21:38:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9440b1950 con 0x7fe94406bd00 2023-07-09T21:38:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:25.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57872/0 (socket says 172.21.15.37:57872) 2023-07-09T21:38:25.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 -- 172.21.15.37:0/2829803676 learned_addr learned my addr 172.21.15.37:0/2829803676 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:25.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94a548640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe94406bd00 0x7fe9440b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:25.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94ad49640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 0x7fe9440c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 -- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe94406bd00 msgr2=0x7fe9440b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe94406bd00 0x7fe9440b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 -- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 msgr2=0x7fe9440c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:25.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 0x7fe9440c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 -- 172.21.15.37:0/2829803676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe934009420 con 0x7fe9440cc090 2023-07-09T21:38:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94ad49640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 0x7fe9440c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe949d47640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe93401a010 tx=0x7fe934019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934003a30 con 0x7fe9440cc090 2023-07-09T21:38:25.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe934003b90 con 0x7fe9440cc090 2023-07-09T21:38:25.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9340ab400 con 0x7fe9440cc090 2023-07-09T21:38:25.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9440b1c30 con 0x7fe9440cc090 2023-07-09T21:38:25.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9440b12d0 con 0x7fe9440cc090 2023-07-09T21:38:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.635+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9440c6350 con 0x7fe9440cc090 2023-07-09T21:38:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.639+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9340b2040 con 0x7fe9440cc090 2023-07-09T21:38:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.639+0000 7fe93affd640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 0x7fe928068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.639+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe93411dd70 con 0x7fe9440cc090 2023-07-09T21:38:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.639+0000 7fe94a548640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 0x7fe928068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:25.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.639+0000 7fe94a548640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 0x7fe928068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9400011f0 tx=0x7fe940009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:25.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.643+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9340eaea0 con 0x7fe9440cc090 2023-07-09T21:38:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:25.827+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe94404d7d0 con 0x7fe9440cc090 2023-07-09T21:38:26.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe93affd640 1 -- 172.21.15.37:0/2829803676 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe9340b0070 con 0x7fe9440cc090 2023-07-09T21:38:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 msgr2=0x7fe928068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 0x7fe928068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9400011f0 tx=0x7fe940009040 comp rx=0 tx=0).stop 2023-07-09T21:38:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 msgr2=0x7fe9440c8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe93401a010 tx=0x7fe934019180 comp rx=0 tx=0).stop 2023-07-09T21:38:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 shutdown_connections 2023-07-09T21:38:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe9280663a0 0x7fe928068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe944141440 0x7fe9440c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9440cc090 0x7fe9440c8e60 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 --2- 172.21.15.37:0/2829803676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe94406bd00 0x7fe9440b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 >> 172.21.15.37:0/2829803676 conn(0x7fe9440cde40 msgr2=0x7fe94406b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 shutdown_connections 2023-07-09T21:38:26.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.459+0000 7fe94c7ac640 1 -- 172.21.15.37:0/2829803676 wait complete. 2023-07-09T21:38:26.486 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:38:26.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 Processor -- start 2023-07-09T21:38:26.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 -- start start 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f042c15b860 0x7f042c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f042c15bc30 0x7f042c072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f042c0b0ad0 con 0x7f042c15fdb0 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c15f990 con 0x7f042c15bc30 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.631+0000 7f0432a7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f042c15f620 con 0x7f042c15b860 2023-07-09T21:38:26.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f042c15bc30 0x7f042c072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f042c15bc30 0x7f042c072400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57884/0 (socket says 172.21.15.37:57884) 2023-07-09T21:38:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 -- 172.21.15.37:0/2619032738 learned_addr learned my addr 172.21.15.37:0/2619032738 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f0430817640 1 --2- 172.21.15.37:0/2619032738 >> v2:172.21.15.119:3300/0 conn(0x7f042c15b860 0x7f042c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 -- 172.21.15.37:0/2619032738 >> v2:172.21.15.119:3300/0 conn(0x7f042c15b860 msgr2=0x7f042c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:26.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 --2- 172.21.15.37:0/2619032738 >> v2:172.21.15.119:3300/0 conn(0x7f042c15b860 0x7f042c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 -- 172.21.15.37:0/2619032738 >> v1:172.21.15.119:6789/0 conn(0x7f042c15fdb0 legacy=0x7f042c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 -- 172.21.15.37:0/2619032738 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0b0d20 con 0x7f042c15bc30 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042bfff640 1 --2- 172.21.15.37:0/2619032738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c072400 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f042c06a180 tx=0x7f041801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94feb2b167146a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042b7fe640 1 -- 172.21.15.37:0/2619032738 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180ac620 con 0x7f042c15bc30 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042b7fe640 1 -- 172.21.15.37:0/2619032738 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180ac780 con 0x7f042c15bc30 2023-07-09T21:38:26.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.635+0000 7f042b7fe640 1 -- 172.21.15.37:0/2619032738 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180acb10 con 0x7f042c15bc30 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- 172.21.15.37:0/2619032738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 msgr2=0x7f042c072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- 172.21.15.37:0/2619032738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c072400 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f042c06a180 tx=0x7f041801c3a0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- 172.21.15.37:0/2619032738 shutdown_connections 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- 172.21.15.37:0/2619032738 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c072400 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- 172.21.15.37:0/2619032738 >> v2:172.21.15.119:3300/0 conn(0x7f042c15b860 0x7f042c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- 172.21.15.37:0/2619032738 >> 172.21.15.37:0/2619032738 conn(0x7f042c0ce630 msgr2=0x7f042c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:26.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- 172.21.15.37:0/2619032738 shutdown_connections 2023-07-09T21:38:26.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- 172.21.15.37:0/2619032738 wait complete. 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 Processor -- start 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- start start 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042c15b860 0x7f042c153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 0x7f042c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c157080 con 0x7f042c15bc30 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042c156400 con 0x7f042c15fdb0 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0432a7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042c1566e0 con 0x7f042c15b860 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57894/0 (socket says 172.21.15.37:57894) 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 -- 172.21.15.37:0/1173799076 learned_addr learned my addr 172.21.15.37:0/1173799076 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:26.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0430817640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042c15b860 0x7f042c153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0431018640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 0x7f042c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 -- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042c15b860 msgr2=0x7f042c153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042c15b860 0x7f042c153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 -- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 msgr2=0x7f042c15e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 0x7f042c15e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f042bfff640 1 -- 172.21.15.37:0/1173799076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180094d0 con 0x7f042c15bc30 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.639+0000 7f0431018640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 0x7f042c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f042bfff640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0418019fd0 tx=0x7f0418019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180b5640 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180b57a0 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04180b5b30 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042c1569c0 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042c1560f0 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042c1571c0 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04180b3070 con 0x7f042c15bc30 2023-07-09T21:38:26.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 0x7f0410068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f041811e0b0 con 0x7f042c15bc30 2023-07-09T21:38:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.643+0000 7f0430817640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 0x7f0410068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.647+0000 7f0430817640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 0x7f0410068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0420007a60 tx=0x7f0420008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.647+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f042c1571c0 con 0x7f042c15bc30 2023-07-09T21:38:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.839+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f042c1571c0 con 0x7f042c15bc30 2023-07-09T21:38:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.839+0000 7f04297fa640 1 -- 172.21.15.37:0/1173799076 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f042c1571c0 con 0x7f042c15bc30 2023-07-09T21:38:26.846 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:26.846 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 msgr2=0x7f0410068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 0x7f0410068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0420007a60 tx=0x7f0420008040 comp rx=0 tx=0).stop 2023-07-09T21:38:26.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 msgr2=0x7f042c148180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f0418019fd0 tx=0x7f0418019140 comp rx=0 tx=0).stop 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 shutdown_connections 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f04100663a0 0x7f0410068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f042c15fdb0 0x7f042c15e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f042c15bc30 0x7f042c148180 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 --2- 172.21.15.37:0/1173799076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f042c15b860 0x7f042c153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 >> 172.21.15.37:0/1173799076 conn(0x7f042c0ce630 msgr2=0x7f042c153f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 shutdown_connections 2023-07-09T21:38:26.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:26.843+0000 7f0432a7b640 1 -- 172.21.15.37:0/1173799076 wait complete. 2023-07-09T21:38:26.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 Processor -- start 2023-07-09T21:38:27.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 -- start start 2023-07-09T21:38:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f673406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f67340b4340 0x7f67340d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67340b49f0 con 0x7f67340cef80 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67340b7e80 con 0x7f67340b4340 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673bd9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67340cc8a0 con 0x7f67340b7ab0 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673933a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f67340cef80 0x7f67340b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41016/0 (socket says 172.21.15.37:41016) 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673933a640 1 -- 172.21.15.37:0/4255282044 learned_addr learned my addr 172.21.15.37:0/4255282044 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f6739b3b640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f673406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673a33c640 1 --2- 172.21.15.37:0/4255282044 >> v2:172.21.15.119:3300/0 conn(0x7f67340b4340 0x7f67340d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f6738b39640 1 -- 172.21.15.37:0/4255282044 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228810640 0 0) 0x7f67340b49f0 con 0x7f67340cef80 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f6738b39640 1 -- 172.21.15.37:0/4255282044 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6720003530 con 0x7f67340cef80 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673a33c640 1 -- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 msgr2=0x7f673406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673a33c640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f673406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673a33c640 1 -- 172.21.15.37:0/4255282044 >> v1:172.21.15.37:6789/0 conn(0x7f67340cef80 legacy=0x7f67340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f673a33c640 1 -- 172.21.15.37:0/4255282044 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67340ccb80 con 0x7f67340b4340 2023-07-09T21:38:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.007+0000 7f6739b3b640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f673406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673a33c640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67340d02a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f672c009d90 tx=0x7f672c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5da3448f1d48a6a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f6738b39640 1 -- 172.21.15.37:0/4255282044 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a59e0 con 0x7f67340b4340 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f6738b39640 1 -- 172.21.15.37:0/4255282044 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0a5b40 con 0x7f67340b4340 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f6738b39640 1 -- 172.21.15.37:0/4255282044 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0ad440 con 0x7f67340b4340 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 -- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 msgr2=0x7f67340d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67340d02a0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f672c009d90 tx=0x7f672c01c920 comp rx=0 tx=0).stop 2023-07-09T21:38:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 -- 172.21.15.37:0/4255282044 shutdown_connections 2023-07-09T21:38:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67340d02a0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 --2- 172.21.15.37:0/4255282044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f673406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 -- 172.21.15.37:0/4255282044 >> 172.21.15.37:0/4255282044 conn(0x7f6734073090 msgr2=0x7f6734069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 -- 172.21.15.37:0/4255282044 shutdown_connections 2023-07-09T21:38:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.011+0000 7f673bd9f640 1 -- 172.21.15.37:0/4255282044 wait complete. 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 Processor -- start 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- start start 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67341501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f67341551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340ca5a0 con 0x7f67340cef80 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67340c7200 con 0x7f67340b4340 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67340c6960 con 0x7f67340b7ab0 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57908/0 (socket says 172.21.15.37:57908) 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 -- 172.21.15.37:0/3956775091 learned_addr learned my addr 172.21.15.37:0/3956775091 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f6739b3b640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67341501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673933a640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f67341551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 -- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 msgr2=0x7f67341551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f67341551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 -- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 msgr2=0x7f67341501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67341501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 -- 172.21.15.37:0/3956775091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6730009420 con 0x7f67340cef80 2023-07-09T21:38:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673a33c640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f672c0b0040 tx=0x7f672c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0adce0 con 0x7f67340cef80 2023-07-09T21:38:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c0ade40 con 0x7f67340cef80 2023-07-09T21:38:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c009a70 con 0x7f67340cef80 2023-07-09T21:38:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0b7650 con 0x7f67340cef80 2023-07-09T21:38:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.015+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67340c6f20 con 0x7f67340cef80 2023-07-09T21:38:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.019+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673404d7d0 con 0x7f67340cef80 2023-07-09T21:38:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.019+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f672c0b4050 con 0x7f67340cef80 2023-07-09T21:38:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.019+0000 7f672a7fc640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 0x7f6718068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.019+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f672c11ef00 con 0x7f67340cef80 2023-07-09T21:38:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.019+0000 7f6739b3b640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 0x7f6718068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.023+0000 7f6739b3b640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 0x7f6718068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6730009cf0 tx=0x7f6730009190 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.023+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f672c0ec3a0 con 0x7f67340cef80 2023-07-09T21:38:27.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.179+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f673415efa0 con 0x7f67340cef80 2023-07-09T21:38:27.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f672a7fc640 1 -- 172.21.15.37:0/3956775091 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+18281 (secure 0 0 0) 0x7f672c0b2020 con 0x7f67340cef80 2023-07-09T21:38:27.184 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:27.185 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":85,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:24.404085+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 msgr2=0x7f6718068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 0x7f6718068880 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6730009cf0 tx=0x7f6730009190 comp rx=0 tx=0).stop 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 msgr2=0x7f6734155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f672c0b0040 tx=0x7f672c0196c0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 shutdown_connections 2023-07-09T21:38:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f67180663d0 0x7f6718068880 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67340cef80 0x7f6734155720 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f67340b7ab0 0x7f67341551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 --2- 172.21.15.37:0/3956775091 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f67340b4340 0x7f67341501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 >> 172.21.15.37:0/3956775091 conn(0x7f6734073090 msgr2=0x7f67340b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 shutdown_connections 2023-07-09T21:38:27.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.183+0000 7f673bd9f640 1 -- 172.21.15.37:0/3956775091 wait complete. 2023-07-09T21:38:27.206 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:38:27.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:38:27.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.347+0000 7f15be382640 1 Processor -- start 2023-07-09T21:38:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.347+0000 7f15be382640 1 -- start start 2023-07-09T21:38:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15be382640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15b8158670 0x7f15b80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15be382640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b806efc0 con 0x7f15b806b120 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15be382640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b806f4f0 con 0x7f15b80aff40 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15be382640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b806d390 con 0x7f15b8158670 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15b806b120 0x7f15b80af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54974/0 (socket says 172.21.15.37:54974) 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b77fe640 1 -- 172.21.15.37:0/698700525 learned_addr learned my addr 172.21.15.37:0/698700525 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b7fff640 1 --2- 172.21.15.37:0/698700525 >> v2:172.21.15.119:3300/0 conn(0x7f15b8158670 0x7f15b80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938137558 0 0) 0x7f15b806efc0 con 0x7f15b806b120 2023-07-09T21:38:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a0003530 con 0x7f15b806b120 2023-07-09T21:38:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670439257 0 0) 0x7f15b806f4f0 con 0x7f15b80aff40 2023-07-09T21:38:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b806efc0 con 0x7f15b80aff40 2023-07-09T21:38:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b7fff640 1 -- 172.21.15.37:0/698700525 >> v1:172.21.15.119:6789/0 conn(0x7f15b80aff40 legacy=0x7f15b815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b7fff640 1 -- 172.21.15.37:0/698700525 >> v1:172.21.15.37:6789/0 conn(0x7f15b806b120 legacy=0x7f15b80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.351+0000 7f15b7fff640 1 -- 172.21.15.37:0/698700525 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b806fe90 con 0x7f15b8158670 2023-07-09T21:38:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15b7fff640 1 --2- 172.21.15.37:0/698700525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b8158670 0x7f15b80ca2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd653ae4cc69a8c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80ac620 con 0x7f15b8158670 2023-07-09T21:38:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a80ac780 con 0x7f15b8158670 2023-07-09T21:38:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15b6ffd640 1 -- 172.21.15.37:0/698700525 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a80acb10 con 0x7f15b8158670 2023-07-09T21:38:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- 172.21.15.37:0/698700525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b8158670 msgr2=0x7f15b80ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 --2- 172.21.15.37:0/698700525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b8158670 0x7f15b80ca2f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15a80097f0 tx=0x7f15a801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- 172.21.15.37:0/698700525 shutdown_connections 2023-07-09T21:38:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 --2- 172.21.15.37:0/698700525 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b8158670 0x7f15b80ca2f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- 172.21.15.37:0/698700525 >> 172.21.15.37:0/698700525 conn(0x7f15b80ca830 msgr2=0x7f15b80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- 172.21.15.37:0/698700525 shutdown_connections 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- 172.21.15.37:0/698700525 wait complete. 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 Processor -- start 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.355+0000 7f15be382640 1 -- start start 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b806b120 0x7f15b814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 0x7f15b80b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b814fbc0 con 0x7f15b8158670 2023-07-09T21:38:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80af360 con 0x7f15b806b120 2023-07-09T21:38:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b80af640 con 0x7f15b80aff40 2023-07-09T21:38:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b806b120 0x7f15b814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40804/0 (socket says 172.21.15.37:40804) 2023-07-09T21:38:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 -- 172.21.15.37:0/3194585263 learned_addr learned my addr 172.21.15.37:0/3194585263 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b77fe640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 0x7f15b80b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 -- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 msgr2=0x7f15b80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 0x7f15b80b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 -- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b806b120 msgr2=0x7f15b814a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b806b120 0x7f15b814a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 -- 172.21.15.37:0/3194585263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a8009420 con 0x7f15b8158670 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b77fe640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 0x7f15b80b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15bc91f640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c7a0 tx=0x7f15b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0003bd0 con 0x7f15b8158670 2023-07-09T21:38:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b0003d30 con 0x7f15b8158670 2023-07-09T21:38:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b80af920 con 0x7f15b8158670 2023-07-09T21:38:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b0003ea0 con 0x7f15b8158670 2023-07-09T21:38:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b814aec0 con 0x7f15b8158670 2023-07-09T21:38:27.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b814fd30 con 0x7f15b8158670 2023-07-09T21:38:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.359+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f15b000aa90 con 0x7f15b8158670 2023-07-09T21:38:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.363+0000 7f15b4ff9640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 0x7f15a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.363+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f15b0083d90 con 0x7f15b8158670 2023-07-09T21:38:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.363+0000 7f15b7fff640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 0x7f15a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.363+0000 7f15b7fff640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 0x7f15a4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ae000 tx=0x7f15a80a7000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.367+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f15b0051060 con 0x7f15b8158670 2023-07-09T21:38:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.519+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15b806f970 con 0x7f15a40663a0 2023-07-09T21:38:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15b4ff9640 1 -- 172.21.15.37:0/3194585263 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306259 (secure 0 0 0) 0x7f15a80ac5a0 con 0x7f15a40663a0 2023-07-09T21:38:27.535 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:38:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 msgr2=0x7f15a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 0x7f15a4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f15a80ae000 tx=0x7f15a80a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 msgr2=0x7f15b8166a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f15b000c7a0 tx=0x7f15b000cc60 comp rx=0 tx=0).stop 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 shutdown_connections 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f15a40663a0 0x7f15a4068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15b8158670 0x7f15b8166a00 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15b80aff40 0x7f15b80b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 --2- 172.21.15.37:0/3194585263 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15b806b120 0x7f15b814a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.531+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 >> 172.21.15.37:0/3194585263 conn(0x7f15b80ca830 msgr2=0x7f15b814e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.535+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 shutdown_connections 2023-07-09T21:38:27.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.535+0000 7f15be382640 1 -- 172.21.15.37:0/3194585263 wait complete. 2023-07-09T21:38:27.554 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:38:26.912552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327852,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754646868,"statfs":{"total":773094113280,"available":772758392832,"internally_reserved":0,"allocated":9154560,"data_stored":5161364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.530121"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397787+0000","last_change":"2023-07-09T21:38:22.397787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397787+0000","last_undegraded":"2023-07-09T21:38:22.397787+0000","last_fullsized":"2023-07-09T21:38:22.397787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396561+0000","last_change":"2023-07-09T21:38:22.396561+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396561+0000","last_undegraded":"2023-07-09T21:38:22.396561+0000","last_fullsized":"2023-07-09T21:38:22.396561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388683+0000","last_change":"2023-07-09T21:38:22.388683+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388683+0000","last_undegraded":"2023-07-09T21:38:22.388683+0000","last_fullsized":"2023-07-09T21:38:22.388683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395147+0000","last_change":"2023-07-09T21:38:22.395147+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395147+0000","last_undegraded":"2023-07-09T21:38:22.395147+0000","last_fullsized":"2023-07-09T21:38:22.395147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.401686+0000","last_change":"2023-07-09T21:38:22.401686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.401686+0000","last_undegraded":"2023-07-09T21:38:22.401686+0000","last_fullsized":"2023-07-09T21:38:22.401686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392721+0000","last_change":"2023-07-09T21:38:22.392721+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392721+0000","last_undegraded":"2023-07-09T21:38:22.392721+0000","last_fullsized":"2023-07-09T21:38:22.392721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388684+0000","last_change":"2023-07-09T21:38:22.388684+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388684+0000","last_undegraded":"2023-07-09T21:38:22.388684+0000","last_fullsized":"2023-07-09T21:38:22.388684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389338+0000","last_change":"2023-07-09T21:38:22.389338+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389338+0000","last_undegraded":"2023-07-09T21:38:22.389338+0000","last_fullsized":"2023-07-09T21:38:22.389338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389536+0000","last_change":"2023-07-09T21:38:22.389536+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389536+0000","last_undegraded":"2023-07-09T21:38:22.389536+0000","last_fullsized":"2023-07-09T21:38:22.389536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390467+0000","last_change":"2023-07-09T21:38:22.390467+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390467+0000","last_undegraded":"2023-07-09T21:38:22.390467+0000","last_fullsized":"2023-07-09T21:38:22.390467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397659+0000","last_change":"2023-07-09T21:38:22.397659+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397659+0000","last_undegraded":"2023-07-09T21:38:22.397659+0000","last_fullsized":"2023-07-09T21:38:22.397659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390662+0000","last_change":"2023-07-09T21:38:22.390662+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390662+0000","last_undegraded":"2023-07-09T21:38:22.390662+0000","last_fullsized":"2023-07-09T21:38:22.390662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390142+0000","last_change":"2023-07-09T21:38:22.390142+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390142+0000","last_undegraded":"2023-07-09T21:38:22.390142+0000","last_fullsized":"2023-07-09T21:38:22.390142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388496+0000","last_change":"2023-07-09T21:38:22.388496+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388496+0000","last_undegraded":"2023-07-09T21:38:22.388496+0000","last_fullsized":"2023-07-09T21:38:22.388496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388540+0000","last_change":"2023-07-09T21:38:22.388540+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388540+0000","last_undegraded":"2023-07-09T21:38:22.388540+0000","last_fullsized":"2023-07-09T21:38:22.388540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387903+0000","last_change":"2023-07-09T21:38:22.387903+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387903+0000","last_undegraded":"2023-07-09T21:38:22.387903+0000","last_fullsized":"2023-07-09T21:38:22.387903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397203+0000","last_change":"2023-07-09T21:38:22.397203+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397203+0000","last_undegraded":"2023-07-09T21:38:22.397203+0000","last_fullsized":"2023-07-09T21:38:22.397203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398248+0000","last_change":"2023-07-09T21:38:22.398248+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398248+0000","last_undegraded":"2023-07-09T21:38:22.398248+0000","last_fullsized":"2023-07-09T21:38:22.398248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398271+0000","last_change":"2023-07-09T21:38:22.398271+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398271+0000","last_undegraded":"2023-07-09T21:38:22.398271+0000","last_fullsized":"2023-07-09T21:38:22.398271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388071+0000","last_change":"2023-07-09T21:38:22.388071+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388071+0000","last_undegraded":"2023-07-09T21:38:22.388071+0000","last_fullsized":"2023-07-09T21:38:22.388071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389651+0000","last_change":"2023-07-09T21:38:22.389651+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389651+0000","last_undegraded":"2023-07-09T21:38:22.389651+0000","last_fullsized":"2023-07-09T21:38:22.389651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387987+0000","last_change":"2023-07-09T21:38:22.387987+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387987+0000","last_undegraded":"2023-07-09T21:38:22.387987+0000","last_fullsized":"2023-07-09T21:38:22.387987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390720+0000","last_change":"2023-07-09T21:38:22.390720+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390720+0000","last_undegraded":"2023-07-09T21:38:22.390720+0000","last_fullsized":"2023-07-09T21:38:22.390720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388497+0000","last_change":"2023-07-09T21:38:22.388497+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388497+0000","last_undegraded":"2023-07-09T21:38:22.388497+0000","last_fullsized":"2023-07-09T21:38:22.388497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391558+0000","last_change":"2023-07-09T21:38:22.391558+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391558+0000","last_undegraded":"2023-07-09T21:38:22.391558+0000","last_fullsized":"2023-07-09T21:38:22.391558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391791+0000","last_change":"2023-07-09T21:38:22.391791+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391791+0000","last_undegraded":"2023-07-09T21:38:22.391791+0000","last_fullsized":"2023-07-09T21:38:22.391791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394893+0000","last_change":"2023-07-09T21:38:22.394893+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394893+0000","last_undegraded":"2023-07-09T21:38:22.394893+0000","last_fullsized":"2023-07-09T21:38:22.394893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394871+0000","last_change":"2023-07-09T21:38:22.394871+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394871+0000","last_undegraded":"2023-07-09T21:38:22.394871+0000","last_fullsized":"2023-07-09T21:38:22.394871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388658+0000","last_change":"2023-07-09T21:38:22.388658+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388658+0000","last_undegraded":"2023-07-09T21:38:22.388658+0000","last_fullsized":"2023-07-09T21:38:22.388658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390509+0000","last_change":"2023-07-09T21:38:22.390509+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390509+0000","last_undegraded":"2023-07-09T21:38:22.390509+0000","last_fullsized":"2023-07-09T21:38:22.390509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398927+0000","last_change":"2023-07-09T21:38:22.398927+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398927+0000","last_undegraded":"2023-07-09T21:38:22.398927+0000","last_fullsized":"2023-07-09T21:38:22.398927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394525+0000","last_change":"2023-07-09T21:38:22.394525+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394525+0000","last_undegraded":"2023-07-09T21:38:22.394525+0000","last_fullsized":"2023-07-09T21:38:22.394525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397904+0000","last_change":"2023-07-09T21:38:22.397904+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397904+0000","last_undegraded":"2023-07-09T21:38:22.397904+0000","last_fullsized":"2023-07-09T21:38:22.397904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410166+0000","last_change":"2023-07-09T21:38:22.408788+0000","last_active":"2023-07-09T21:38:22.410166+0000","last_peered":"2023-07-09T21:38:22.410166+0000","last_clean":"2023-07-09T21:38:22.410166+0000","last_became_active":"2023-07-09T21:38:22.408319+0000","last_became_peered":"2023-07-09T21:38:22.408319+0000","last_unstale":"2023-07-09T21:38:22.410166+0000","last_undegraded":"2023-07-09T21:38:22.410166+0000","last_fullsized":"2023-07-09T21:38:22.410166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:43.225018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394276+0000","last_change":"2023-07-09T21:38:22.394276+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394276+0000","last_undegraded":"2023-07-09T21:38:22.394276+0000","last_fullsized":"2023-07-09T21:38:22.394276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409877+0000","last_change":"2023-07-09T21:38:22.408871+0000","last_active":"2023-07-09T21:38:22.409877+0000","last_peered":"2023-07-09T21:38:22.409877+0000","last_clean":"2023-07-09T21:38:22.409877+0000","last_became_active":"2023-07-09T21:38:22.408396+0000","last_became_peered":"2023-07-09T21:38:22.408396+0000","last_unstale":"2023-07-09T21:38:22.409877+0000","last_undegraded":"2023-07-09T21:38:22.409877+0000","last_fullsized":"2023-07-09T21:38:22.409877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393740+0000","last_change":"2023-07-09T21:38:22.393740+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393740+0000","last_undegraded":"2023-07-09T21:38:22.393740+0000","last_fullsized":"2023-07-09T21:38:22.393740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406420+0000","last_change":"2023-07-09T21:38:22.403317+0000","last_active":"2023-07-09T21:38:22.406420+0000","last_peered":"2023-07-09T21:38:22.406420+0000","last_clean":"2023-07-09T21:38:22.406420+0000","last_became_active":"2023-07-09T21:38:22.402972+0000","last_became_peered":"2023-07-09T21:38:22.402972+0000","last_unstale":"2023-07-09T21:38:22.406420+0000","last_undegraded":"2023-07-09T21:38:22.406420+0000","last_fullsized":"2023-07-09T21:38:22.406420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390036+0000","last_change":"2023-07-09T21:38:22.390036+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390036+0000","last_undegraded":"2023-07-09T21:38:22.390036+0000","last_fullsized":"2023-07-09T21:38:22.390036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401252+0000","last_change":"2023-07-09T21:38:22.398622+0000","last_active":"2023-07-09T21:38:22.401252+0000","last_peered":"2023-07-09T21:38:22.401252+0000","last_clean":"2023-07-09T21:38:22.401252+0000","last_became_active":"2023-07-09T21:38:22.398344+0000","last_became_peered":"2023-07-09T21:38:22.398344+0000","last_unstale":"2023-07-09T21:38:22.401252+0000","last_undegraded":"2023-07-09T21:38:22.401252+0000","last_fullsized":"2023-07-09T21:38:22.401252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387426+0000","last_change":"2023-07-09T21:38:22.387426+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387426+0000","last_undegraded":"2023-07-09T21:38:22.387426+0000","last_fullsized":"2023-07-09T21:38:22.387426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.398259+0000","last_change":"2023-07-09T21:38:22.396887+0000","last_active":"2023-07-09T21:38:22.398259+0000","last_peered":"2023-07-09T21:38:22.398259+0000","last_clean":"2023-07-09T21:38:22.398259+0000","last_became_active":"2023-07-09T21:38:22.396575+0000","last_became_peered":"2023-07-09T21:38:22.396575+0000","last_unstale":"2023-07-09T21:38:22.398259+0000","last_undegraded":"2023-07-09T21:38:22.398259+0000","last_fullsized":"2023-07-09T21:38:22.398259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393734+0000","last_change":"2023-07-09T21:38:22.393734+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393734+0000","last_undegraded":"2023-07-09T21:38:22.393734+0000","last_fullsized":"2023-07-09T21:38:22.393734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399038+0000","last_change":"2023-07-09T21:38:22.394044+0000","last_active":"2023-07-09T21:38:22.399038+0000","last_peered":"2023-07-09T21:38:22.399038+0000","last_clean":"2023-07-09T21:38:22.399038+0000","last_became_active":"2023-07-09T21:38:22.393668+0000","last_became_peered":"2023-07-09T21:38:22.393668+0000","last_unstale":"2023-07-09T21:38:22.399038+0000","last_undegraded":"2023-07-09T21:38:22.399038+0000","last_fullsized":"2023-07-09T21:38:22.399038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398078+0000","last_change":"2023-07-09T21:38:22.398078+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398078+0000","last_undegraded":"2023-07-09T21:38:22.398078+0000","last_fullsized":"2023-07-09T21:38:22.398078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403914+0000","last_change":"2023-07-09T21:38:22.399971+0000","last_active":"2023-07-09T21:38:22.403914+0000","last_peered":"2023-07-09T21:38:22.403914+0000","last_clean":"2023-07-09T21:38:22.403914+0000","last_became_active":"2023-07-09T21:38:22.396590+0000","last_became_peered":"2023-07-09T21:38:22.396590+0000","last_unstale":"2023-07-09T21:38:22.403914+0000","last_undegraded":"2023-07-09T21:38:22.403914+0000","last_fullsized":"2023-07-09T21:38:22.403914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:05.747200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388620+0000","last_change":"2023-07-09T21:38:22.388620+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388620+0000","last_undegraded":"2023-07-09T21:38:22.388620+0000","last_fullsized":"2023-07-09T21:38:22.388620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.412311+0000","last_change":"2023-07-09T21:38:22.411514+0000","last_active":"2023-07-09T21:38:22.412311+0000","last_peered":"2023-07-09T21:38:22.412311+0000","last_clean":"2023-07-09T21:38:22.412311+0000","last_became_active":"2023-07-09T21:38:22.411169+0000","last_became_peered":"2023-07-09T21:38:22.411169+0000","last_unstale":"2023-07-09T21:38:22.412311+0000","last_undegraded":"2023-07-09T21:38:22.412311+0000","last_fullsized":"2023-07-09T21:38:22.412311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:44:17.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394370+0000","last_change":"2023-07-09T21:38:22.394370+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394370+0000","last_undegraded":"2023-07-09T21:38:22.394370+0000","last_fullsized":"2023-07-09T21:38:22.394370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413951+0000","last_change":"2023-07-09T21:38:22.408707+0000","last_active":"2023-07-09T21:38:22.413951+0000","last_peered":"2023-07-09T21:38:22.413951+0000","last_clean":"2023-07-09T21:38:22.413951+0000","last_became_active":"2023-07-09T21:38:22.408415+0000","last_became_peered":"2023-07-09T21:38:22.408415+0000","last_unstale":"2023-07-09T21:38:22.413951+0000","last_undegraded":"2023-07-09T21:38:22.413951+0000","last_fullsized":"2023-07-09T21:38:22.413951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:04.167370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388830+0000","last_change":"2023-07-09T21:38:22.388830+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388830+0000","last_undegraded":"2023-07-09T21:38:22.388830+0000","last_fullsized":"2023-07-09T21:38:22.388830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.416353+0000","last_change":"2023-07-09T21:38:22.413038+0000","last_active":"2023-07-09T21:38:22.416353+0000","last_peered":"2023-07-09T21:38:22.416353+0000","last_clean":"2023-07-09T21:38:22.416353+0000","last_became_active":"2023-07-09T21:38:22.412805+0000","last_became_peered":"2023-07-09T21:38:22.412805+0000","last_unstale":"2023-07-09T21:38:22.416353+0000","last_undegraded":"2023-07-09T21:38:22.416353+0000","last_fullsized":"2023-07-09T21:38:22.416353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:24.308270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396646+0000","last_change":"2023-07-09T21:38:22.396646+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396646+0000","last_undegraded":"2023-07-09T21:38:22.396646+0000","last_fullsized":"2023-07-09T21:38:22.396646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413770+0000","last_change":"2023-07-09T21:38:22.403101+0000","last_active":"2023-07-09T21:38:22.413770+0000","last_peered":"2023-07-09T21:38:22.413770+0000","last_clean":"2023-07-09T21:38:22.413770+0000","last_became_active":"2023-07-09T21:38:22.402419+0000","last_became_peered":"2023-07-09T21:38:22.402419+0000","last_unstale":"2023-07-09T21:38:22.413770+0000","last_undegraded":"2023-07-09T21:38:22.413770+0000","last_fullsized":"2023-07-09T21:38:22.413770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:11.535383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394687+0000","last_change":"2023-07-09T21:38:22.394687+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394687+0000","last_undegraded":"2023-07-09T21:38:22.394687+0000","last_fullsized":"2023-07-09T21:38:22.394687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409463+0000","last_change":"2023-07-09T21:38:22.408024+0000","last_active":"2023-07-09T21:38:22.409463+0000","last_peered":"2023-07-09T21:38:22.409463+0000","last_clean":"2023-07-09T21:38:22.409463+0000","last_became_active":"2023-07-09T21:38:22.407723+0000","last_became_peered":"2023-07-09T21:38:22.407723+0000","last_unstale":"2023-07-09T21:38:22.409463+0000","last_undegraded":"2023-07-09T21:38:22.409463+0000","last_fullsized":"2023-07-09T21:38:22.409463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:45.158766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394528+0000","last_change":"2023-07-09T21:38:22.394528+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394528+0000","last_undegraded":"2023-07-09T21:38:22.394528+0000","last_fullsized":"2023-07-09T21:38:22.394528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413918+0000","last_change":"2023-07-09T21:38:22.404352+0000","last_active":"2023-07-09T21:38:22.413918+0000","last_peered":"2023-07-09T21:38:22.413918+0000","last_clean":"2023-07-09T21:38:22.413918+0000","last_became_active":"2023-07-09T21:38:22.404072+0000","last_became_peered":"2023-07-09T21:38:22.404072+0000","last_unstale":"2023-07-09T21:38:22.413918+0000","last_undegraded":"2023-07-09T21:38:22.413918+0000","last_fullsized":"2023-07-09T21:38:22.413918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:01:01.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392206+0000","last_change":"2023-07-09T21:38:22.392206+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392206+0000","last_undegraded":"2023-07-09T21:38:22.392206+0000","last_fullsized":"2023-07-09T21:38:22.392206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408861+0000","last_change":"2023-07-09T21:38:22.403402+0000","last_active":"2023-07-09T21:38:22.408861+0000","last_peered":"2023-07-09T21:38:22.408861+0000","last_clean":"2023-07-09T21:38:22.408861+0000","last_became_active":"2023-07-09T21:38:22.403067+0000","last_became_peered":"2023-07-09T21:38:22.403067+0000","last_unstale":"2023-07-09T21:38:22.408861+0000","last_undegraded":"2023-07-09T21:38:22.408861+0000","last_fullsized":"2023-07-09T21:38:22.408861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:25.021256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396618+0000","last_change":"2023-07-09T21:38:22.396618+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396618+0000","last_undegraded":"2023-07-09T21:38:22.396618+0000","last_fullsized":"2023-07-09T21:38:22.396618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413890+0000","last_change":"2023-07-09T21:38:22.407689+0000","last_active":"2023-07-09T21:38:22.413890+0000","last_peered":"2023-07-09T21:38:22.413890+0000","last_clean":"2023-07-09T21:38:22.413890+0000","last_became_active":"2023-07-09T21:38:22.407375+0000","last_became_peered":"2023-07-09T21:38:22.407375+0000","last_unstale":"2023-07-09T21:38:22.413890+0000","last_undegraded":"2023-07-09T21:38:22.413890+0000","last_fullsized":"2023-07-09T21:38:22.413890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:17:28.816419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393542+0000","last_change":"2023-07-09T21:38:22.393542+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393542+0000","last_undegraded":"2023-07-09T21:38:22.393542+0000","last_fullsized":"2023-07-09T21:38:22.393542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417377+0000","last_change":"2023-07-09T21:38:22.415040+0000","last_active":"2023-07-09T21:38:22.417377+0000","last_peered":"2023-07-09T21:38:22.417377+0000","last_clean":"2023-07-09T21:38:22.417377+0000","last_became_active":"2023-07-09T21:38:22.414497+0000","last_became_peered":"2023-07-09T21:38:22.414497+0000","last_unstale":"2023-07-09T21:38:22.417377+0000","last_undegraded":"2023-07-09T21:38:22.417377+0000","last_fullsized":"2023-07-09T21:38:22.417377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:24:00.884788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392686+0000","last_change":"2023-07-09T21:38:22.392686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392686+0000","last_undegraded":"2023-07-09T21:38:22.392686+0000","last_fullsized":"2023-07-09T21:38:22.392686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410743+0000","last_change":"2023-07-09T21:38:22.404010+0000","last_active":"2023-07-09T21:38:22.410743+0000","last_peered":"2023-07-09T21:38:22.410743+0000","last_clean":"2023-07-09T21:38:22.410743+0000","last_became_active":"2023-07-09T21:38:22.403441+0000","last_became_peered":"2023-07-09T21:38:22.403441+0000","last_unstale":"2023-07-09T21:38:22.410743+0000","last_undegraded":"2023-07-09T21:38:22.410743+0000","last_fullsized":"2023-07-09T21:38:22.410743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:10.361789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.386855+0000","last_change":"2023-07-09T21:38:22.386855+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.386855+0000","last_undegraded":"2023-07-09T21:38:22.386855+0000","last_fullsized":"2023-07-09T21:38:22.386855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408324+0000","last_change":"2023-07-09T21:38:22.401340+0000","last_active":"2023-07-09T21:38:22.408324+0000","last_peered":"2023-07-09T21:38:22.408324+0000","last_clean":"2023-07-09T21:38:22.408324+0000","last_became_active":"2023-07-09T21:38:22.401065+0000","last_became_peered":"2023-07-09T21:38:22.401065+0000","last_unstale":"2023-07-09T21:38:22.408324+0000","last_undegraded":"2023-07-09T21:38:22.408324+0000","last_fullsized":"2023-07-09T21:38:22.408324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:09.524276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391275+0000","last_change":"2023-07-09T21:38:22.391275+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391275+0000","last_undegraded":"2023-07-09T21:38:22.391275+0000","last_fullsized":"2023-07-09T21:38:22.391275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406399+0000","last_change":"2023-07-09T21:38:22.401562+0000","last_active":"2023-07-09T21:38:22.406399+0000","last_peered":"2023-07-09T21:38:22.406399+0000","last_clean":"2023-07-09T21:38:22.406399+0000","last_became_active":"2023-07-09T21:38:22.401259+0000","last_became_peered":"2023-07-09T21:38:22.401259+0000","last_unstale":"2023-07-09T21:38:22.406399+0000","last_undegraded":"2023-07-09T21:38:22.406399+0000","last_fullsized":"2023-07-09T21:38:22.406399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395616+0000","last_change":"2023-07-09T21:38:22.395616+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395616+0000","last_undegraded":"2023-07-09T21:38:22.395616+0000","last_fullsized":"2023-07-09T21:38:22.395616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410160+0000","last_change":"2023-07-09T21:38:22.408925+0000","last_active":"2023-07-09T21:38:22.410160+0000","last_peered":"2023-07-09T21:38:22.410160+0000","last_clean":"2023-07-09T21:38:22.410160+0000","last_became_active":"2023-07-09T21:38:22.407895+0000","last_became_peered":"2023-07-09T21:38:22.407895+0000","last_unstale":"2023-07-09T21:38:22.410160+0000","last_undegraded":"2023-07-09T21:38:22.410160+0000","last_fullsized":"2023-07-09T21:38:22.410160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:36.116432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397807+0000","last_change":"2023-07-09T21:38:22.397807+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397807+0000","last_undegraded":"2023-07-09T21:38:22.397807+0000","last_fullsized":"2023-07-09T21:38:22.397807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413894+0000","last_change":"2023-07-09T21:38:22.402885+0000","last_active":"2023-07-09T21:38:22.413894+0000","last_peered":"2023-07-09T21:38:22.413894+0000","last_clean":"2023-07-09T21:38:22.413894+0000","last_became_active":"2023-07-09T21:38:22.402582+0000","last_became_peered":"2023-07-09T21:38:22.402582+0000","last_unstale":"2023-07-09T21:38:22.413894+0000","last_undegraded":"2023-07-09T21:38:22.413894+0000","last_fullsized":"2023-07-09T21:38:22.413894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:48.963373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395095+0000","last_change":"2023-07-09T21:38:22.395095+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395095+0000","last_undegraded":"2023-07-09T21:38:22.395095+0000","last_fullsized":"2023-07-09T21:38:22.395095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403481+0000","last_change":"2023-07-09T21:38:22.399149+0000","last_active":"2023-07-09T21:38:22.403481+0000","last_peered":"2023-07-09T21:38:22.403481+0000","last_clean":"2023-07-09T21:38:22.403481+0000","last_became_active":"2023-07-09T21:38:22.398841+0000","last_became_peered":"2023-07-09T21:38:22.398841+0000","last_unstale":"2023-07-09T21:38:22.403481+0000","last_undegraded":"2023-07-09T21:38:22.403481+0000","last_fullsized":"2023-07-09T21:38:22.403481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395101+0000","last_change":"2023-07-09T21:38:22.395101+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395101+0000","last_undegraded":"2023-07-09T21:38:22.395101+0000","last_fullsized":"2023-07-09T21:38:22.395101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403896+0000","last_change":"2023-07-09T21:38:22.399727+0000","last_active":"2023-07-09T21:38:22.403896+0000","last_peered":"2023-07-09T21:38:22.403896+0000","last_clean":"2023-07-09T21:38:22.403896+0000","last_became_active":"2023-07-09T21:38:22.396239+0000","last_became_peered":"2023-07-09T21:38:22.396239+0000","last_unstale":"2023-07-09T21:38:22.403896+0000","last_undegraded":"2023-07-09T21:38:22.403896+0000","last_fullsized":"2023-07-09T21:38:22.403896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387305+0000","last_change":"2023-07-09T21:38:22.387305+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387305+0000","last_undegraded":"2023-07-09T21:38:22.387305+0000","last_fullsized":"2023-07-09T21:38:22.387305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401183+0000","last_change":"2023-07-09T21:38:22.396722+0000","last_active":"2023-07-09T21:38:22.401183+0000","last_peered":"2023-07-09T21:38:22.401183+0000","last_clean":"2023-07-09T21:38:22.401183+0000","last_became_active":"2023-07-09T21:38:22.396430+0000","last_became_peered":"2023-07-09T21:38:22.396430+0000","last_unstale":"2023-07-09T21:38:22.401183+0000","last_undegraded":"2023-07-09T21:38:22.401183+0000","last_fullsized":"2023-07-09T21:38:22.401183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:07.027092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395800+0000","last_change":"2023-07-09T21:38:22.395800+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395800+0000","last_undegraded":"2023-07-09T21:38:22.395800+0000","last_fullsized":"2023-07-09T21:38:22.395800+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403826+0000","last_change":"2023-07-09T21:38:22.400029+0000","last_active":"2023-07-09T21:38:22.403826+0000","last_peered":"2023-07-09T21:38:22.403826+0000","last_clean":"2023-07-09T21:38:22.403826+0000","last_became_active":"2023-07-09T21:38:22.399708+0000","last_became_peered":"2023-07-09T21:38:22.399708+0000","last_unstale":"2023-07-09T21:38:22.403826+0000","last_undegraded":"2023-07-09T21:38:22.403826+0000","last_fullsized":"2023-07-09T21:38:22.403826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":440,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391792+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:38:22.391792+0000","last_peered":"2023-07-09T21:38:22.391792+0000","last_clean":"2023-07-09T21:38:22.391792+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:38:22.391792+0000","last_undegraded":"2023-07-09T21:38:22.391792+0000","last_fullsized":"2023-07-09T21:38:22.391792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:42.492075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.392248+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:38:22.392248+0000","last_peered":"2023-07-09T21:38:22.392248+0000","last_clean":"2023-07-09T21:38:22.392248+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:38:22.392248+0000","last_undegraded":"2023-07-09T21:38:22.392248+0000","last_fullsized":"2023-07-09T21:38:22.392248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:03:14.190937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394033+0000","last_change":"2023-07-09T21:38:22.394033+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394033+0000","last_undegraded":"2023-07-09T21:38:22.394033+0000","last_fullsized":"2023-07-09T21:38:22.394033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404128+0000","last_change":"2023-07-09T21:38:22.400490+0000","last_active":"2023-07-09T21:38:22.404128+0000","last_peered":"2023-07-09T21:38:22.404128+0000","last_clean":"2023-07-09T21:38:22.404128+0000","last_became_active":"2023-07-09T21:38:22.400179+0000","last_became_peered":"2023-07-09T21:38:22.400179+0000","last_unstale":"2023-07-09T21:38:22.404128+0000","last_undegraded":"2023-07-09T21:38:22.404128+0000","last_fullsized":"2023-07-09T21:38:22.404128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391776+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:38:22.391776+0000","last_peered":"2023-07-09T21:38:22.391776+0000","last_clean":"2023-07-09T21:38:22.391776+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:38:22.391776+0000","last_undegraded":"2023-07-09T21:38:22.391776+0000","last_fullsized":"2023-07-09T21:38:22.391776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389315+0000","last_change":"2023-07-09T21:38:22.389315+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389315+0000","last_undegraded":"2023-07-09T21:38:22.389315+0000","last_fullsized":"2023-07-09T21:38:22.389315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399593+0000","last_change":"2023-07-09T21:38:22.398190+0000","last_active":"2023-07-09T21:38:22.399593+0000","last_peered":"2023-07-09T21:38:22.399593+0000","last_clean":"2023-07-09T21:38:22.399593+0000","last_became_active":"2023-07-09T21:38:22.397908+0000","last_became_peered":"2023-07-09T21:38:22.397908+0000","last_unstale":"2023-07-09T21:38:22.399593+0000","last_undegraded":"2023-07-09T21:38:22.399593+0000","last_fullsized":"2023-07-09T21:38:22.399593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:13.998771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388319+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:38:22.388319+0000","last_peered":"2023-07-09T21:38:22.388319+0000","last_clean":"2023-07-09T21:38:22.388319+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:38:22.388319+0000","last_undegraded":"2023-07-09T21:38:22.388319+0000","last_fullsized":"2023-07-09T21:38:22.388319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:50.823909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395920+0000","last_change":"2023-07-09T21:38:22.395920+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395920+0000","last_undegraded":"2023-07-09T21:38:22.395920+0000","last_fullsized":"2023-07-09T21:38:22.395920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409872+0000","last_change":"2023-07-09T21:38:22.408768+0000","last_active":"2023-07-09T21:38:22.409872+0000","last_peered":"2023-07-09T21:38:22.409872+0000","last_clean":"2023-07-09T21:38:22.409872+0000","last_became_active":"2023-07-09T21:38:22.408410+0000","last_became_peered":"2023-07-09T21:38:22.408410+0000","last_unstale":"2023-07-09T21:38:22.409872+0000","last_undegraded":"2023-07-09T21:38:22.409872+0000","last_fullsized":"2023-07-09T21:38:22.409872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.390884+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:38:22.390884+0000","last_peered":"2023-07-09T21:38:22.390884+0000","last_clean":"2023-07-09T21:38:22.390884+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:38:22.390884+0000","last_undegraded":"2023-07-09T21:38:22.390884+0000","last_fullsized":"2023-07-09T21:38:22.390884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:27.332952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389121+0000","last_change":"2023-07-09T21:38:22.389121+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389121+0000","last_undegraded":"2023-07-09T21:38:22.389121+0000","last_fullsized":"2023-07-09T21:38:22.389121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408888+0000","last_change":"2023-07-09T21:38:22.403699+0000","last_active":"2023-07-09T21:38:22.408888+0000","last_peered":"2023-07-09T21:38:22.408888+0000","last_clean":"2023-07-09T21:38:22.408888+0000","last_became_active":"2023-07-09T21:38:22.403088+0000","last_became_peered":"2023-07-09T21:38:22.403088+0000","last_unstale":"2023-07-09T21:38:22.408888+0000","last_undegraded":"2023-07-09T21:38:22.408888+0000","last_fullsized":"2023-07-09T21:38:22.408888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:47.236478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388044+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:38:22.388044+0000","last_peered":"2023-07-09T21:38:22.388044+0000","last_clean":"2023-07-09T21:38:22.388044+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:38:22.388044+0000","last_undegraded":"2023-07-09T21:38:22.388044+0000","last_fullsized":"2023-07-09T21:38:22.388044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:45.744824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395787+0000","last_change":"2023-07-09T21:38:22.395787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395787+0000","last_undegraded":"2023-07-09T21:38:22.395787+0000","last_fullsized":"2023-07-09T21:38:22.395787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417140+0000","last_change":"2023-07-09T21:38:22.414687+0000","last_active":"2023-07-09T21:38:22.417140+0000","last_peered":"2023-07-09T21:38:22.417140+0000","last_clean":"2023-07-09T21:38:22.417140+0000","last_became_active":"2023-07-09T21:38:22.414205+0000","last_became_peered":"2023-07-09T21:38:22.414205+0000","last_unstale":"2023-07-09T21:38:22.417140+0000","last_undegraded":"2023-07-09T21:38:22.417140+0000","last_fullsized":"2023-07-09T21:38:22.417140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:28.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393897+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:38:22.393897+0000","last_peered":"2023-07-09T21:38:22.393897+0000","last_clean":"2023-07-09T21:38:22.393897+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:38:22.393897+0000","last_undegraded":"2023-07-09T21:38:22.393897+0000","last_fullsized":"2023-07-09T21:38:22.393897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:06.526313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397768+0000","last_change":"2023-07-09T21:38:22.397768+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397768+0000","last_undegraded":"2023-07-09T21:38:22.397768+0000","last_fullsized":"2023-07-09T21:38:22.397768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413999+0000","last_change":"2023-07-09T21:38:22.408792+0000","last_active":"2023-07-09T21:38:22.413999+0000","last_peered":"2023-07-09T21:38:22.413999+0000","last_clean":"2023-07-09T21:38:22.413999+0000","last_became_active":"2023-07-09T21:38:22.408483+0000","last_became_peered":"2023-07-09T21:38:22.408483+0000","last_unstale":"2023-07-09T21:38:22.413999+0000","last_undegraded":"2023-07-09T21:38:22.413999+0000","last_fullsized":"2023-07-09T21:38:22.413999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:42.283021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.387296+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:38:22.387296+0000","last_peered":"2023-07-09T21:38:22.387296+0000","last_clean":"2023-07-09T21:38:22.387296+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:38:22.387296+0000","last_undegraded":"2023-07-09T21:38:22.387296+0000","last_fullsized":"2023-07-09T21:38:22.387296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:33.093816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396207+0000","last_change":"2023-07-09T21:38:22.396207+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396207+0000","last_undegraded":"2023-07-09T21:38:22.396207+0000","last_fullsized":"2023-07-09T21:38:22.396207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404649+0000","last_change":"2023-07-09T21:38:22.402484+0000","last_active":"2023-07-09T21:38:22.404649+0000","last_peered":"2023-07-09T21:38:22.404649+0000","last_clean":"2023-07-09T21:38:22.404649+0000","last_became_active":"2023-07-09T21:38:22.402194+0000","last_became_peered":"2023-07-09T21:38:22.402194+0000","last_unstale":"2023-07-09T21:38:22.404649+0000","last_undegraded":"2023-07-09T21:38:22.404649+0000","last_fullsized":"2023-07-09T21:38:22.404649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393124+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:38:22.393124+0000","last_peered":"2023-07-09T21:38:22.393124+0000","last_clean":"2023-07-09T21:38:22.393124+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:38:22.393124+0000","last_undegraded":"2023-07-09T21:38:22.393124+0000","last_fullsized":"2023-07-09T21:38:22.393124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:06:38.316535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0069999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.625,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":1.024,"15min":1.024},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.619},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.754},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.665},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.129,"15min":1.2629999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.002},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.375},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0569999999999999},"last":0.499},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":1.0569999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":1.9339999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95799999999999996,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":4.0979999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.96999999999999997,"15min":1.1519999999999999},"last":2.4020000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0589999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.58199999999999996,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":4.3019999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.165},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.99399999999999999,"5min":1.123,"15min":1.123},"last":1.9890000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56000000000000005,"15min":0.57499999999999996},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.628,"5min":0.90700000000000003,"15min":1.111},"last":6.101},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":7.2910000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":4.7450000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.84199999999999997,"5min":0.98999999999999999,"15min":1.1950000000000001},"last":1.7509999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.006},"last":3.4159999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.52300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82399999999999995,"5min":1.21,"15min":1.21},"last":4.3520000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50064,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321776,"statfs":{"total":96636764160,"available":96585498624,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70099999999999996,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.60799999999999998,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.92100000000000004,"5min":0.96199999999999997,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":1.01,"15min":1.01},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":0.98399999999999999,"15min":1.0169999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.98899999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.038},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":1.014},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.88900000000000001,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.63800000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.60099999999999998,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.58499999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.26,"15min":1.26},"last":0.629},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.165},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.92800000000000005,"15min":1.1859999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":0.82799999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98299999999999998,"5min":1.0049999999999999,"15min":1.107},"last":0.40899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.93600000000000005,"15min":0.997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":1.042},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.60699999999999998,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.495}]},{"osd":4,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.022,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.0760000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.127,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.208},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.67000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.51,"15min":1.51},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.52800000000000002,"15min":0.50600000000000001},"max":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.296},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1910000000000001,"15min":1.323},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317668,"statfs":{"total":96636764160,"available":96581292032,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.77200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":1.0409999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77700000000000002,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1659999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.62,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.149,"5min":1.377,"15min":1.3839999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.754}]},{"osd":6,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.69899999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":1.3100000000000001,"5min":1.423,"15min":1.423},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68799999999999994,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.63900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1140000000000001,"5min":1.496,"15min":1.496},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.45700000000000002},"min":{"1min":0.37,"5min":0.252,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.76800000000000002,"15min":0.871},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.378},"max":{"1min":1.0129999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.385},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.0660000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.212,"15min":1.419},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":1.087,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.149,"15min":1.242},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.018,"15min":1.335},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0329999999999999,"5min":1.258,"15min":1.3799999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.173,"15min":1.173},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47399999999999998},"min":{"1min":0.35399999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.66900000000000004,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":1.0489999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":1.018,"15min":1.018},"last":1.8560000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.47499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.625,"5min":1.038,"15min":1.038},"last":1.657}]},{"osd":3,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.63700000000000001,"5min":0.83999999999999997,"15min":1.143},"last":1.9399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":1.05,"15min":1.274},"last":1.8979999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.6559999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.66600000000000004,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":1.835}]},{"osd":5,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.67900000000000005,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4350000000000001},"last":1.726},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":1.615}]},{"osd":6,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.137,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":1.7569999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96399999999999997,"5min":1.236,"15min":1.3660000000000001},"last":1.8089999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.82399999999999995,"15min":0.82099999999999995},"min":{"1min":0.71999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.5980000000000001},"last":1.6970000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.2709999999999999,"5min":1.282,"15min":1.5740000000000001},"last":1.883}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:38:27.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:38:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.735+0000 7f9efdb40640 1 Processor -- start 2023-07-09T21:38:27.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.735+0000 7f9efdb40640 1 -- start start 2023-07-09T21:38:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9efdb40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ef80cef80 0x7f9ef806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9efdb40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80b49f0 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9efdb40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef80cc8a0 con 0x7f9ef80b4340 2023-07-09T21:38:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9efdb40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef80b7e80 con 0x7f9ef80cef80 2023-07-09T21:38:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ef80b7ab0 0x7f9ef80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54976/0 (socket says 172.21.15.37:54976) 2023-07-09T21:38:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef77fe640 1 -- 172.21.15.37:0/3629630343 learned_addr learned my addr 172.21.15.37:0/3629630343 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:27.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef7fff640 1 --2- 172.21.15.37:0/3629630343 >> v2:172.21.15.37:3300/0 conn(0x7f9ef80cef80 0x7f9ef806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef7fff640 1 -- 172.21.15.37:0/3629630343 >> v1:172.21.15.119:6789/0 conn(0x7f9ef80b4340 legacy=0x7f9ef80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef7fff640 1 -- 172.21.15.37:0/3629630343 >> v1:172.21.15.37:6789/0 conn(0x7f9ef80b7ab0 legacy=0x7f9ef80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef7fff640 1 -- 172.21.15.37:0/3629630343 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef80ccb80 con 0x7f9ef80cef80 2023-07-09T21:38:27.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef7fff640 1 --2- 172.21.15.37:0/3629630343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80cef80 0x7f9ef806aa50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009d90 tx=0x7f9ef001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4513449ad3ae319c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef67fc640 1 -- 172.21.15.37:0/3629630343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00a59e0 con 0x7f9ef80cef80 2023-07-09T21:38:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef67fc640 1 -- 172.21.15.37:0/3629630343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef00a5b40 con 0x7f9ef80cef80 2023-07-09T21:38:27.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.739+0000 7f9ef67fc640 1 -- 172.21.15.37:0/3629630343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00ad440 con 0x7f9ef80cef80 2023-07-09T21:38:27.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- 172.21.15.37:0/3629630343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80cef80 msgr2=0x7f9ef806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 --2- 172.21.15.37:0/3629630343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80cef80 0x7f9ef806aa50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0009d90 tx=0x7f9ef001c920 comp rx=0 tx=0).stop 2023-07-09T21:38:27.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- 172.21.15.37:0/3629630343 shutdown_connections 2023-07-09T21:38:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 --2- 172.21.15.37:0/3629630343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80cef80 0x7f9ef806aa50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- 172.21.15.37:0/3629630343 >> 172.21.15.37:0/3629630343 conn(0x7f9ef8073090 msgr2=0x7f9ef8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- 172.21.15.37:0/3629630343 shutdown_connections 2023-07-09T21:38:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- 172.21.15.37:0/3629630343 wait complete. 2023-07-09T21:38:27.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 Processor -- start 2023-07-09T21:38:27.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- start start 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ef80cef80 0x7f9ef8156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80ca9f0 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef8152570 con 0x7f9ef80b4340 2023-07-09T21:38:27.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9efdb40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef80cac90 con 0x7f9ef80cef80 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef6ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40826/0 (socket says 172.21.15.37:40826) 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef77fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40166/0 (socket says 172.21.15.37:40166) 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef6ffd640 1 -- 172.21.15.37:0/589027611 learned_addr learned my addr 172.21.15.37:0/589027611 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:27.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.743+0000 7f9ef7fff640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ef80cef80 0x7f9ef8156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 -- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ef80cef80 msgr2=0x7f9ef8156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ef80cef80 0x7f9ef8156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 -- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 msgr2=0x7f9ef81478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 -- 172.21.15.37:0/589027611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0009a70 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef77fe640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9ef6ffd640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c4d0 tx=0x7f9eec00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec0052d0 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eec005430 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eec012830 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef80caf70 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef8147df0 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef80cb490 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9eec012990 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 0x7f9ee4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.747+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9eec083880 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.751+0000 7f9ef77fe640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 0x7f9ee4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:27.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.751+0000 7f9ef77fe640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 0x7f9ee4068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8005890 tx=0x7f9ee8009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:27.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.751+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ef80cb490 con 0x7f9ef80b7ab0 2023-07-09T21:38:27.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.907+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9ef80cf4d0 con 0x7f9ee40663a0 2023-07-09T21:38:27.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.915+0000 7f9edffff640 1 -- 172.21.15.37:0/589027611 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306259 (secure 0 0 0) 0x7f9ee8001900 con 0x7f9ee40663a0 2023-07-09T21:38:27.920 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:27.921 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:38:27.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 msgr2=0x7f9ee4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 0x7f9ee4068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8005890 tx=0x7f9ee8009040 comp rx=0 tx=0).stop 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 msgr2=0x7f9ef81563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9eec00c4d0 tx=0x7f9eec00c990 comp rx=0 tx=0).stop 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 shutdown_connections 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f9ee40663a0 0x7f9ee4068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ef80cef80 0x7f9ef8156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ef80b7ab0 0x7f9ef81563f0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 --2- 172.21.15.37:0/589027611 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ef80b4340 0x7f9ef81478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 >> 172.21.15.37:0/589027611 conn(0x7f9ef8073090 msgr2=0x7f9ef80d18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 shutdown_connections 2023-07-09T21:38:27.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:27.919+0000 7f9efdb40640 1 -- 172.21.15.37:0/589027611 wait complete. 2023-07-09T21:38:27.941 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:38:26.912552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327852,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754646868,"statfs":{"total":773094113280,"available":772758392832,"internally_reserved":0,"allocated":9154560,"data_stored":5161364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.530121"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397787+0000","last_change":"2023-07-09T21:38:22.397787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397787+0000","last_undegraded":"2023-07-09T21:38:22.397787+0000","last_fullsized":"2023-07-09T21:38:22.397787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396561+0000","last_change":"2023-07-09T21:38:22.396561+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396561+0000","last_undegraded":"2023-07-09T21:38:22.396561+0000","last_fullsized":"2023-07-09T21:38:22.396561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388683+0000","last_change":"2023-07-09T21:38:22.388683+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388683+0000","last_undegraded":"2023-07-09T21:38:22.388683+0000","last_fullsized":"2023-07-09T21:38:22.388683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395147+0000","last_change":"2023-07-09T21:38:22.395147+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395147+0000","last_undegraded":"2023-07-09T21:38:22.395147+0000","last_fullsized":"2023-07-09T21:38:22.395147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.401686+0000","last_change":"2023-07-09T21:38:22.401686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.401686+0000","last_undegraded":"2023-07-09T21:38:22.401686+0000","last_fullsized":"2023-07-09T21:38:22.401686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392721+0000","last_change":"2023-07-09T21:38:22.392721+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392721+0000","last_undegraded":"2023-07-09T21:38:22.392721+0000","last_fullsized":"2023-07-09T21:38:22.392721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388684+0000","last_change":"2023-07-09T21:38:22.388684+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388684+0000","last_undegraded":"2023-07-09T21:38:22.388684+0000","last_fullsized":"2023-07-09T21:38:22.388684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389338+0000","last_change":"2023-07-09T21:38:22.389338+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389338+0000","last_undegraded":"2023-07-09T21:38:22.389338+0000","last_fullsized":"2023-07-09T21:38:22.389338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389536+0000","last_change":"2023-07-09T21:38:22.389536+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389536+0000","last_undegraded":"2023-07-09T21:38:22.389536+0000","last_fullsized":"2023-07-09T21:38:22.389536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390467+0000","last_change":"2023-07-09T21:38:22.390467+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390467+0000","last_undegraded":"2023-07-09T21:38:22.390467+0000","last_fullsized":"2023-07-09T21:38:22.390467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397659+0000","last_change":"2023-07-09T21:38:22.397659+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397659+0000","last_undegraded":"2023-07-09T21:38:22.397659+0000","last_fullsized":"2023-07-09T21:38:22.397659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390662+0000","last_change":"2023-07-09T21:38:22.390662+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390662+0000","last_undegraded":"2023-07-09T21:38:22.390662+0000","last_fullsized":"2023-07-09T21:38:22.390662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390142+0000","last_change":"2023-07-09T21:38:22.390142+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390142+0000","last_undegraded":"2023-07-09T21:38:22.390142+0000","last_fullsized":"2023-07-09T21:38:22.390142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388496+0000","last_change":"2023-07-09T21:38:22.388496+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388496+0000","last_undegraded":"2023-07-09T21:38:22.388496+0000","last_fullsized":"2023-07-09T21:38:22.388496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388540+0000","last_change":"2023-07-09T21:38:22.388540+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388540+0000","last_undegraded":"2023-07-09T21:38:22.388540+0000","last_fullsized":"2023-07-09T21:38:22.388540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387903+0000","last_change":"2023-07-09T21:38:22.387903+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387903+0000","last_undegraded":"2023-07-09T21:38:22.387903+0000","last_fullsized":"2023-07-09T21:38:22.387903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397203+0000","last_change":"2023-07-09T21:38:22.397203+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397203+0000","last_undegraded":"2023-07-09T21:38:22.397203+0000","last_fullsized":"2023-07-09T21:38:22.397203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398248+0000","last_change":"2023-07-09T21:38:22.398248+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398248+0000","last_undegraded":"2023-07-09T21:38:22.398248+0000","last_fullsized":"2023-07-09T21:38:22.398248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398271+0000","last_change":"2023-07-09T21:38:22.398271+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398271+0000","last_undegraded":"2023-07-09T21:38:22.398271+0000","last_fullsized":"2023-07-09T21:38:22.398271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388071+0000","last_change":"2023-07-09T21:38:22.388071+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388071+0000","last_undegraded":"2023-07-09T21:38:22.388071+0000","last_fullsized":"2023-07-09T21:38:22.388071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389651+0000","last_change":"2023-07-09T21:38:22.389651+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389651+0000","last_undegraded":"2023-07-09T21:38:22.389651+0000","last_fullsized":"2023-07-09T21:38:22.389651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387987+0000","last_change":"2023-07-09T21:38:22.387987+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387987+0000","last_undegraded":"2023-07-09T21:38:22.387987+0000","last_fullsized":"2023-07-09T21:38:22.387987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390720+0000","last_change":"2023-07-09T21:38:22.390720+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390720+0000","last_undegraded":"2023-07-09T21:38:22.390720+0000","last_fullsized":"2023-07-09T21:38:22.390720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388497+0000","last_change":"2023-07-09T21:38:22.388497+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388497+0000","last_undegraded":"2023-07-09T21:38:22.388497+0000","last_fullsized":"2023-07-09T21:38:22.388497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391558+0000","last_change":"2023-07-09T21:38:22.391558+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391558+0000","last_undegraded":"2023-07-09T21:38:22.391558+0000","last_fullsized":"2023-07-09T21:38:22.391558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391791+0000","last_change":"2023-07-09T21:38:22.391791+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391791+0000","last_undegraded":"2023-07-09T21:38:22.391791+0000","last_fullsized":"2023-07-09T21:38:22.391791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394893+0000","last_change":"2023-07-09T21:38:22.394893+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394893+0000","last_undegraded":"2023-07-09T21:38:22.394893+0000","last_fullsized":"2023-07-09T21:38:22.394893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394871+0000","last_change":"2023-07-09T21:38:22.394871+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394871+0000","last_undegraded":"2023-07-09T21:38:22.394871+0000","last_fullsized":"2023-07-09T21:38:22.394871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388658+0000","last_change":"2023-07-09T21:38:22.388658+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388658+0000","last_undegraded":"2023-07-09T21:38:22.388658+0000","last_fullsized":"2023-07-09T21:38:22.388658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390509+0000","last_change":"2023-07-09T21:38:22.390509+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390509+0000","last_undegraded":"2023-07-09T21:38:22.390509+0000","last_fullsized":"2023-07-09T21:38:22.390509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398927+0000","last_change":"2023-07-09T21:38:22.398927+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398927+0000","last_undegraded":"2023-07-09T21:38:22.398927+0000","last_fullsized":"2023-07-09T21:38:22.398927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394525+0000","last_change":"2023-07-09T21:38:22.394525+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394525+0000","last_undegraded":"2023-07-09T21:38:22.394525+0000","last_fullsized":"2023-07-09T21:38:22.394525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397904+0000","last_change":"2023-07-09T21:38:22.397904+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397904+0000","last_undegraded":"2023-07-09T21:38:22.397904+0000","last_fullsized":"2023-07-09T21:38:22.397904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410166+0000","last_change":"2023-07-09T21:38:22.408788+0000","last_active":"2023-07-09T21:38:22.410166+0000","last_peered":"2023-07-09T21:38:22.410166+0000","last_clean":"2023-07-09T21:38:22.410166+0000","last_became_active":"2023-07-09T21:38:22.408319+0000","last_became_peered":"2023-07-09T21:38:22.408319+0000","last_unstale":"2023-07-09T21:38:22.410166+0000","last_undegraded":"2023-07-09T21:38:22.410166+0000","last_fullsized":"2023-07-09T21:38:22.410166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:43.225018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394276+0000","last_change":"2023-07-09T21:38:22.394276+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394276+0000","last_undegraded":"2023-07-09T21:38:22.394276+0000","last_fullsized":"2023-07-09T21:38:22.394276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409877+0000","last_change":"2023-07-09T21:38:22.408871+0000","last_active":"2023-07-09T21:38:22.409877+0000","last_peered":"2023-07-09T21:38:22.409877+0000","last_clean":"2023-07-09T21:38:22.409877+0000","last_became_active":"2023-07-09T21:38:22.408396+0000","last_became_peered":"2023-07-09T21:38:22.408396+0000","last_unstale":"2023-07-09T21:38:22.409877+0000","last_undegraded":"2023-07-09T21:38:22.409877+0000","last_fullsized":"2023-07-09T21:38:22.409877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393740+0000","last_change":"2023-07-09T21:38:22.393740+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393740+0000","last_undegraded":"2023-07-09T21:38:22.393740+0000","last_fullsized":"2023-07-09T21:38:22.393740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406420+0000","last_change":"2023-07-09T21:38:22.403317+0000","last_active":"2023-07-09T21:38:22.406420+0000","last_peered":"2023-07-09T21:38:22.406420+0000","last_clean":"2023-07-09T21:38:22.406420+0000","last_became_active":"2023-07-09T21:38:22.402972+0000","last_became_peered":"2023-07-09T21:38:22.402972+0000","last_unstale":"2023-07-09T21:38:22.406420+0000","last_undegraded":"2023-07-09T21:38:22.406420+0000","last_fullsized":"2023-07-09T21:38:22.406420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390036+0000","last_change":"2023-07-09T21:38:22.390036+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390036+0000","last_undegraded":"2023-07-09T21:38:22.390036+0000","last_fullsized":"2023-07-09T21:38:22.390036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401252+0000","last_change":"2023-07-09T21:38:22.398622+0000","last_active":"2023-07-09T21:38:22.401252+0000","last_peered":"2023-07-09T21:38:22.401252+0000","last_clean":"2023-07-09T21:38:22.401252+0000","last_became_active":"2023-07-09T21:38:22.398344+0000","last_became_peered":"2023-07-09T21:38:22.398344+0000","last_unstale":"2023-07-09T21:38:22.401252+0000","last_undegraded":"2023-07-09T21:38:22.401252+0000","last_fullsized":"2023-07-09T21:38:22.401252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387426+0000","last_change":"2023-07-09T21:38:22.387426+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387426+0000","last_undegraded":"2023-07-09T21:38:22.387426+0000","last_fullsized":"2023-07-09T21:38:22.387426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.398259+0000","last_change":"2023-07-09T21:38:22.396887+0000","last_active":"2023-07-09T21:38:22.398259+0000","last_peered":"2023-07-09T21:38:22.398259+0000","last_clean":"2023-07-09T21:38:22.398259+0000","last_became_active":"2023-07-09T21:38:22.396575+0000","last_became_peered":"2023-07-09T21:38:22.396575+0000","last_unstale":"2023-07-09T21:38:22.398259+0000","last_undegraded":"2023-07-09T21:38:22.398259+0000","last_fullsized":"2023-07-09T21:38:22.398259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393734+0000","last_change":"2023-07-09T21:38:22.393734+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393734+0000","last_undegraded":"2023-07-09T21:38:22.393734+0000","last_fullsized":"2023-07-09T21:38:22.393734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399038+0000","last_change":"2023-07-09T21:38:22.394044+0000","last_active":"2023-07-09T21:38:22.399038+0000","last_peered":"2023-07-09T21:38:22.399038+0000","last_clean":"2023-07-09T21:38:22.399038+0000","last_became_active":"2023-07-09T21:38:22.393668+0000","last_became_peered":"2023-07-09T21:38:22.393668+0000","last_unstale":"2023-07-09T21:38:22.399038+0000","last_undegraded":"2023-07-09T21:38:22.399038+0000","last_fullsized":"2023-07-09T21:38:22.399038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398078+0000","last_change":"2023-07-09T21:38:22.398078+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398078+0000","last_undegraded":"2023-07-09T21:38:22.398078+0000","last_fullsized":"2023-07-09T21:38:22.398078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403914+0000","last_change":"2023-07-09T21:38:22.399971+0000","last_active":"2023-07-09T21:38:22.403914+0000","last_peered":"2023-07-09T21:38:22.403914+0000","last_clean":"2023-07-09T21:38:22.403914+0000","last_became_active":"2023-07-09T21:38:22.396590+0000","last_became_peered":"2023-07-09T21:38:22.396590+0000","last_unstale":"2023-07-09T21:38:22.403914+0000","last_undegraded":"2023-07-09T21:38:22.403914+0000","last_fullsized":"2023-07-09T21:38:22.403914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:05.747200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388620+0000","last_change":"2023-07-09T21:38:22.388620+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388620+0000","last_undegraded":"2023-07-09T21:38:22.388620+0000","last_fullsized":"2023-07-09T21:38:22.388620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.412311+0000","last_change":"2023-07-09T21:38:22.411514+0000","last_active":"2023-07-09T21:38:22.412311+0000","last_peered":"2023-07-09T21:38:22.412311+0000","last_clean":"2023-07-09T21:38:22.412311+0000","last_became_active":"2023-07-09T21:38:22.411169+0000","last_became_peered":"2023-07-09T21:38:22.411169+0000","last_unstale":"2023-07-09T21:38:22.412311+0000","last_undegraded":"2023-07-09T21:38:22.412311+0000","last_fullsized":"2023-07-09T21:38:22.412311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:44:17.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394370+0000","last_change":"2023-07-09T21:38:22.394370+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394370+0000","last_undegraded":"2023-07-09T21:38:22.394370+0000","last_fullsized":"2023-07-09T21:38:22.394370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413951+0000","last_change":"2023-07-09T21:38:22.408707+0000","last_active":"2023-07-09T21:38:22.413951+0000","last_peered":"2023-07-09T21:38:22.413951+0000","last_clean":"2023-07-09T21:38:22.413951+0000","last_became_active":"2023-07-09T21:38:22.408415+0000","last_became_peered":"2023-07-09T21:38:22.408415+0000","last_unstale":"2023-07-09T21:38:22.413951+0000","last_undegraded":"2023-07-09T21:38:22.413951+0000","last_fullsized":"2023-07-09T21:38:22.413951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:04.167370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388830+0000","last_change":"2023-07-09T21:38:22.388830+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388830+0000","last_undegraded":"2023-07-09T21:38:22.388830+0000","last_fullsized":"2023-07-09T21:38:22.388830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.416353+0000","last_change":"2023-07-09T21:38:22.413038+0000","last_active":"2023-07-09T21:38:22.416353+0000","last_peered":"2023-07-09T21:38:22.416353+0000","last_clean":"2023-07-09T21:38:22.416353+0000","last_became_active":"2023-07-09T21:38:22.412805+0000","last_became_peered":"2023-07-09T21:38:22.412805+0000","last_unstale":"2023-07-09T21:38:22.416353+0000","last_undegraded":"2023-07-09T21:38:22.416353+0000","last_fullsized":"2023-07-09T21:38:22.416353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:24.308270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396646+0000","last_change":"2023-07-09T21:38:22.396646+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396646+0000","last_undegraded":"2023-07-09T21:38:22.396646+0000","last_fullsized":"2023-07-09T21:38:22.396646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413770+0000","last_change":"2023-07-09T21:38:22.403101+0000","last_active":"2023-07-09T21:38:22.413770+0000","last_peered":"2023-07-09T21:38:22.413770+0000","last_clean":"2023-07-09T21:38:22.413770+0000","last_became_active":"2023-07-09T21:38:22.402419+0000","last_became_peered":"2023-07-09T21:38:22.402419+0000","last_unstale":"2023-07-09T21:38:22.413770+0000","last_undegraded":"2023-07-09T21:38:22.413770+0000","last_fullsized":"2023-07-09T21:38:22.413770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:11.535383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394687+0000","last_change":"2023-07-09T21:38:22.394687+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394687+0000","last_undegraded":"2023-07-09T21:38:22.394687+0000","last_fullsized":"2023-07-09T21:38:22.394687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409463+0000","last_change":"2023-07-09T21:38:22.408024+0000","last_active":"2023-07-09T21:38:22.409463+0000","last_peered":"2023-07-09T21:38:22.409463+0000","last_clean":"2023-07-09T21:38:22.409463+0000","last_became_active":"2023-07-09T21:38:22.407723+0000","last_became_peered":"2023-07-09T21:38:22.407723+0000","last_unstale":"2023-07-09T21:38:22.409463+0000","last_undegraded":"2023-07-09T21:38:22.409463+0000","last_fullsized":"2023-07-09T21:38:22.409463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:45.158766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394528+0000","last_change":"2023-07-09T21:38:22.394528+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394528+0000","last_undegraded":"2023-07-09T21:38:22.394528+0000","last_fullsized":"2023-07-09T21:38:22.394528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413918+0000","last_change":"2023-07-09T21:38:22.404352+0000","last_active":"2023-07-09T21:38:22.413918+0000","last_peered":"2023-07-09T21:38:22.413918+0000","last_clean":"2023-07-09T21:38:22.413918+0000","last_became_active":"2023-07-09T21:38:22.404072+0000","last_became_peered":"2023-07-09T21:38:22.404072+0000","last_unstale":"2023-07-09T21:38:22.413918+0000","last_undegraded":"2023-07-09T21:38:22.413918+0000","last_fullsized":"2023-07-09T21:38:22.413918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:01:01.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392206+0000","last_change":"2023-07-09T21:38:22.392206+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392206+0000","last_undegraded":"2023-07-09T21:38:22.392206+0000","last_fullsized":"2023-07-09T21:38:22.392206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408861+0000","last_change":"2023-07-09T21:38:22.403402+0000","last_active":"2023-07-09T21:38:22.408861+0000","last_peered":"2023-07-09T21:38:22.408861+0000","last_clean":"2023-07-09T21:38:22.408861+0000","last_became_active":"2023-07-09T21:38:22.403067+0000","last_became_peered":"2023-07-09T21:38:22.403067+0000","last_unstale":"2023-07-09T21:38:22.408861+0000","last_undegraded":"2023-07-09T21:38:22.408861+0000","last_fullsized":"2023-07-09T21:38:22.408861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:25.021256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396618+0000","last_change":"2023-07-09T21:38:22.396618+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396618+0000","last_undegraded":"2023-07-09T21:38:22.396618+0000","last_fullsized":"2023-07-09T21:38:22.396618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413890+0000","last_change":"2023-07-09T21:38:22.407689+0000","last_active":"2023-07-09T21:38:22.413890+0000","last_peered":"2023-07-09T21:38:22.413890+0000","last_clean":"2023-07-09T21:38:22.413890+0000","last_became_active":"2023-07-09T21:38:22.407375+0000","last_became_peered":"2023-07-09T21:38:22.407375+0000","last_unstale":"2023-07-09T21:38:22.413890+0000","last_undegraded":"2023-07-09T21:38:22.413890+0000","last_fullsized":"2023-07-09T21:38:22.413890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:17:28.816419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393542+0000","last_change":"2023-07-09T21:38:22.393542+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393542+0000","last_undegraded":"2023-07-09T21:38:22.393542+0000","last_fullsized":"2023-07-09T21:38:22.393542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417377+0000","last_change":"2023-07-09T21:38:22.415040+0000","last_active":"2023-07-09T21:38:22.417377+0000","last_peered":"2023-07-09T21:38:22.417377+0000","last_clean":"2023-07-09T21:38:22.417377+0000","last_became_active":"2023-07-09T21:38:22.414497+0000","last_became_peered":"2023-07-09T21:38:22.414497+0000","last_unstale":"2023-07-09T21:38:22.417377+0000","last_undegraded":"2023-07-09T21:38:22.417377+0000","last_fullsized":"2023-07-09T21:38:22.417377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:24:00.884788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392686+0000","last_change":"2023-07-09T21:38:22.392686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392686+0000","last_undegraded":"2023-07-09T21:38:22.392686+0000","last_fullsized":"2023-07-09T21:38:22.392686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410743+0000","last_change":"2023-07-09T21:38:22.404010+0000","last_active":"2023-07-09T21:38:22.410743+0000","last_peered":"2023-07-09T21:38:22.410743+0000","last_clean":"2023-07-09T21:38:22.410743+0000","last_became_active":"2023-07-09T21:38:22.403441+0000","last_became_peered":"2023-07-09T21:38:22.403441+0000","last_unstale":"2023-07-09T21:38:22.410743+0000","last_undegraded":"2023-07-09T21:38:22.410743+0000","last_fullsized":"2023-07-09T21:38:22.410743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:10.361789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.386855+0000","last_change":"2023-07-09T21:38:22.386855+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.386855+0000","last_undegraded":"2023-07-09T21:38:22.386855+0000","last_fullsized":"2023-07-09T21:38:22.386855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408324+0000","last_change":"2023-07-09T21:38:22.401340+0000","last_active":"2023-07-09T21:38:22.408324+0000","last_peered":"2023-07-09T21:38:22.408324+0000","last_clean":"2023-07-09T21:38:22.408324+0000","last_became_active":"2023-07-09T21:38:22.401065+0000","last_became_peered":"2023-07-09T21:38:22.401065+0000","last_unstale":"2023-07-09T21:38:22.408324+0000","last_undegraded":"2023-07-09T21:38:22.408324+0000","last_fullsized":"2023-07-09T21:38:22.408324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:09.524276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391275+0000","last_change":"2023-07-09T21:38:22.391275+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391275+0000","last_undegraded":"2023-07-09T21:38:22.391275+0000","last_fullsized":"2023-07-09T21:38:22.391275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406399+0000","last_change":"2023-07-09T21:38:22.401562+0000","last_active":"2023-07-09T21:38:22.406399+0000","last_peered":"2023-07-09T21:38:22.406399+0000","last_clean":"2023-07-09T21:38:22.406399+0000","last_became_active":"2023-07-09T21:38:22.401259+0000","last_became_peered":"2023-07-09T21:38:22.401259+0000","last_unstale":"2023-07-09T21:38:22.406399+0000","last_undegraded":"2023-07-09T21:38:22.406399+0000","last_fullsized":"2023-07-09T21:38:22.406399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395616+0000","last_change":"2023-07-09T21:38:22.395616+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395616+0000","last_undegraded":"2023-07-09T21:38:22.395616+0000","last_fullsized":"2023-07-09T21:38:22.395616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410160+0000","last_change":"2023-07-09T21:38:22.408925+0000","last_active":"2023-07-09T21:38:22.410160+0000","last_peered":"2023-07-09T21:38:22.410160+0000","last_clean":"2023-07-09T21:38:22.410160+0000","last_became_active":"2023-07-09T21:38:22.407895+0000","last_became_peered":"2023-07-09T21:38:22.407895+0000","last_unstale":"2023-07-09T21:38:22.410160+0000","last_undegraded":"2023-07-09T21:38:22.410160+0000","last_fullsized":"2023-07-09T21:38:22.410160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:36.116432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397807+0000","last_change":"2023-07-09T21:38:22.397807+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397807+0000","last_undegraded":"2023-07-09T21:38:22.397807+0000","last_fullsized":"2023-07-09T21:38:22.397807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413894+0000","last_change":"2023-07-09T21:38:22.402885+0000","last_active":"2023-07-09T21:38:22.413894+0000","last_peered":"2023-07-09T21:38:22.413894+0000","last_clean":"2023-07-09T21:38:22.413894+0000","last_became_active":"2023-07-09T21:38:22.402582+0000","last_became_peered":"2023-07-09T21:38:22.402582+0000","last_unstale":"2023-07-09T21:38:22.413894+0000","last_undegraded":"2023-07-09T21:38:22.413894+0000","last_fullsized":"2023-07-09T21:38:22.413894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:48.963373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395095+0000","last_change":"2023-07-09T21:38:22.395095+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395095+0000","last_undegraded":"2023-07-09T21:38:22.395095+0000","last_fullsized":"2023-07-09T21:38:22.395095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403481+0000","last_change":"2023-07-09T21:38:22.399149+0000","last_active":"2023-07-09T21:38:22.403481+0000","last_peered":"2023-07-09T21:38:22.403481+0000","last_clean":"2023-07-09T21:38:22.403481+0000","last_became_active":"2023-07-09T21:38:22.398841+0000","last_became_peered":"2023-07-09T21:38:22.398841+0000","last_unstale":"2023-07-09T21:38:22.403481+0000","last_undegraded":"2023-07-09T21:38:22.403481+0000","last_fullsized":"2023-07-09T21:38:22.403481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395101+0000","last_change":"2023-07-09T21:38:22.395101+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395101+0000","last_undegraded":"2023-07-09T21:38:22.395101+0000","last_fullsized":"2023-07-09T21:38:22.395101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403896+0000","last_change":"2023-07-09T21:38:22.399727+0000","last_active":"2023-07-09T21:38:22.403896+0000","last_peered":"2023-07-09T21:38:22.403896+0000","last_clean":"2023-07-09T21:38:22.403896+0000","last_became_active":"2023-07-09T21:38:22.396239+0000","last_became_peered":"2023-07-09T21:38:22.396239+0000","last_unstale":"2023-07-09T21:38:22.403896+0000","last_undegraded":"2023-07-09T21:38:22.403896+0000","last_fullsized":"2023-07-09T21:38:22.403896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387305+0000","last_change":"2023-07-09T21:38:22.387305+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387305+0000","last_undegraded":"2023-07-09T21:38:22.387305+0000","last_fullsized":"2023-07-09T21:38:22.387305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401183+0000","last_change":"2023-07-09T21:38:22.396722+0000","last_active":"2023-07-09T21:38:22.401183+0000","last_peered":"2023-07-09T21:38:22.401183+0000","last_clean":"2023-07-09T21:38:22.401183+0000","last_became_active":"2023-07-09T21:38:22.396430+0000","last_became_peered":"2023-07-09T21:38:22.396430+0000","last_unstale":"2023-07-09T21:38:22.401183+0000","last_undegraded":"2023-07-09T21:38:22.401183+0000","last_fullsized":"2023-07-09T21:38:22.401183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:07.027092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395800+0000","last_change":"2023-07-09T21:38:22.395800+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395800+0000","last_undegraded":"2023-07-09T21:38:22.395800+0000","last_fullsized":"2023-07-09T21:38:22.395800+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403826+0000","last_change":"2023-07-09T21:38:22.400029+0000","last_active":"2023-07-09T21:38:22.403826+0000","last_peered":"2023-07-09T21:38:22.403826+0000","last_clean":"2023-07-09T21:38:22.403826+0000","last_became_active":"2023-07-09T21:38:22.399708+0000","last_became_peered":"2023-07-09T21:38:22.399708+0000","last_unstale":"2023-07-09T21:38:22.403826+0000","last_undegraded":"2023-07-09T21:38:22.403826+0000","last_fullsized":"2023-07-09T21:38:22.403826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":440,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391792+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:38:22.391792+0000","last_peered":"2023-07-09T21:38:22.391792+0000","last_clean":"2023-07-09T21:38:22.391792+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:38:22.391792+0000","last_undegraded":"2023-07-09T21:38:22.391792+0000","last_fullsized":"2023-07-09T21:38:22.391792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:42.492075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.392248+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:38:22.392248+0000","last_peered":"2023-07-09T21:38:22.392248+0000","last_clean":"2023-07-09T21:38:22.392248+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:38:22.392248+0000","last_undegraded":"2023-07-09T21:38:22.392248+0000","last_fullsized":"2023-07-09T21:38:22.392248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:03:14.190937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394033+0000","last_change":"2023-07-09T21:38:22.394033+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394033+0000","last_undegraded":"2023-07-09T21:38:22.394033+0000","last_fullsized":"2023-07-09T21:38:22.394033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404128+0000","last_change":"2023-07-09T21:38:22.400490+0000","last_active":"2023-07-09T21:38:22.404128+0000","last_peered":"2023-07-09T21:38:22.404128+0000","last_clean":"2023-07-09T21:38:22.404128+0000","last_became_active":"2023-07-09T21:38:22.400179+0000","last_became_peered":"2023-07-09T21:38:22.400179+0000","last_unstale":"2023-07-09T21:38:22.404128+0000","last_undegraded":"2023-07-09T21:38:22.404128+0000","last_fullsized":"2023-07-09T21:38:22.404128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391776+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:38:22.391776+0000","last_peered":"2023-07-09T21:38:22.391776+0000","last_clean":"2023-07-09T21:38:22.391776+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:38:22.391776+0000","last_undegraded":"2023-07-09T21:38:22.391776+0000","last_fullsized":"2023-07-09T21:38:22.391776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389315+0000","last_change":"2023-07-09T21:38:22.389315+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389315+0000","last_undegraded":"2023-07-09T21:38:22.389315+0000","last_fullsized":"2023-07-09T21:38:22.389315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399593+0000","last_change":"2023-07-09T21:38:22.398190+0000","last_active":"2023-07-09T21:38:22.399593+0000","last_peered":"2023-07-09T21:38:22.399593+0000","last_clean":"2023-07-09T21:38:22.399593+0000","last_became_active":"2023-07-09T21:38:22.397908+0000","last_became_peered":"2023-07-09T21:38:22.397908+0000","last_unstale":"2023-07-09T21:38:22.399593+0000","last_undegraded":"2023-07-09T21:38:22.399593+0000","last_fullsized":"2023-07-09T21:38:22.399593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:13.998771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388319+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:38:22.388319+0000","last_peered":"2023-07-09T21:38:22.388319+0000","last_clean":"2023-07-09T21:38:22.388319+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:38:22.388319+0000","last_undegraded":"2023-07-09T21:38:22.388319+0000","last_fullsized":"2023-07-09T21:38:22.388319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:50.823909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395920+0000","last_change":"2023-07-09T21:38:22.395920+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395920+0000","last_undegraded":"2023-07-09T21:38:22.395920+0000","last_fullsized":"2023-07-09T21:38:22.395920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409872+0000","last_change":"2023-07-09T21:38:22.408768+0000","last_active":"2023-07-09T21:38:22.409872+0000","last_peered":"2023-07-09T21:38:22.409872+0000","last_clean":"2023-07-09T21:38:22.409872+0000","last_became_active":"2023-07-09T21:38:22.408410+0000","last_became_peered":"2023-07-09T21:38:22.408410+0000","last_unstale":"2023-07-09T21:38:22.409872+0000","last_undegraded":"2023-07-09T21:38:22.409872+0000","last_fullsized":"2023-07-09T21:38:22.409872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.390884+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:38:22.390884+0000","last_peered":"2023-07-09T21:38:22.390884+0000","last_clean":"2023-07-09T21:38:22.390884+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:38:22.390884+0000","last_undegraded":"2023-07-09T21:38:22.390884+0000","last_fullsized":"2023-07-09T21:38:22.390884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:27.332952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389121+0000","last_change":"2023-07-09T21:38:22.389121+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389121+0000","last_undegraded":"2023-07-09T21:38:22.389121+0000","last_fullsized":"2023-07-09T21:38:22.389121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408888+0000","last_change":"2023-07-09T21:38:22.403699+0000","last_active":"2023-07-09T21:38:22.408888+0000","last_peered":"2023-07-09T21:38:22.408888+0000","last_clean":"2023-07-09T21:38:22.408888+0000","last_became_active":"2023-07-09T21:38:22.403088+0000","last_became_peered":"2023-07-09T21:38:22.403088+0000","last_unstale":"2023-07-09T21:38:22.408888+0000","last_undegraded":"2023-07-09T21:38:22.408888+0000","last_fullsized":"2023-07-09T21:38:22.408888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:47.236478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388044+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:38:22.388044+0000","last_peered":"2023-07-09T21:38:22.388044+0000","last_clean":"2023-07-09T21:38:22.388044+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:38:22.388044+0000","last_undegraded":"2023-07-09T21:38:22.388044+0000","last_fullsized":"2023-07-09T21:38:22.388044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:45.744824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395787+0000","last_change":"2023-07-09T21:38:22.395787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395787+0000","last_undegraded":"2023-07-09T21:38:22.395787+0000","last_fullsized":"2023-07-09T21:38:22.395787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417140+0000","last_change":"2023-07-09T21:38:22.414687+0000","last_active":"2023-07-09T21:38:22.417140+0000","last_peered":"2023-07-09T21:38:22.417140+0000","last_clean":"2023-07-09T21:38:22.417140+0000","last_became_active":"2023-07-09T21:38:22.414205+0000","last_became_peered":"2023-07-09T21:38:22.414205+0000","last_unstale":"2023-07-09T21:38:22.417140+0000","last_undegraded":"2023-07-09T21:38:22.417140+0000","last_fullsized":"2023-07-09T21:38:22.417140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:28.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393897+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:38:22.393897+0000","last_peered":"2023-07-09T21:38:22.393897+0000","last_clean":"2023-07-09T21:38:22.393897+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:38:22.393897+0000","last_undegraded":"2023-07-09T21:38:22.393897+0000","last_fullsized":"2023-07-09T21:38:22.393897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:06.526313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397768+0000","last_change":"2023-07-09T21:38:22.397768+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397768+0000","last_undegraded":"2023-07-09T21:38:22.397768+0000","last_fullsized":"2023-07-09T21:38:22.397768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413999+0000","last_change":"2023-07-09T21:38:22.408792+0000","last_active":"2023-07-09T21:38:22.413999+0000","last_peered":"2023-07-09T21:38:22.413999+0000","last_clean":"2023-07-09T21:38:22.413999+0000","last_became_active":"2023-07-09T21:38:22.408483+0000","last_became_peered":"2023-07-09T21:38:22.408483+0000","last_unstale":"2023-07-09T21:38:22.413999+0000","last_undegraded":"2023-07-09T21:38:22.413999+0000","last_fullsized":"2023-07-09T21:38:22.413999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:42.283021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.387296+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:38:22.387296+0000","last_peered":"2023-07-09T21:38:22.387296+0000","last_clean":"2023-07-09T21:38:22.387296+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:38:22.387296+0000","last_undegraded":"2023-07-09T21:38:22.387296+0000","last_fullsized":"2023-07-09T21:38:22.387296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:33.093816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396207+0000","last_change":"2023-07-09T21:38:22.396207+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396207+0000","last_undegraded":"2023-07-09T21:38:22.396207+0000","last_fullsized":"2023-07-09T21:38:22.396207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404649+0000","last_change":"2023-07-09T21:38:22.402484+0000","last_active":"2023-07-09T21:38:22.404649+0000","last_peered":"2023-07-09T21:38:22.404649+0000","last_clean":"2023-07-09T21:38:22.404649+0000","last_became_active":"2023-07-09T21:38:22.402194+0000","last_became_peered":"2023-07-09T21:38:22.402194+0000","last_unstale":"2023-07-09T21:38:22.404649+0000","last_undegraded":"2023-07-09T21:38:22.404649+0000","last_fullsized":"2023-07-09T21:38:22.404649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393124+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:38:22.393124+0000","last_peered":"2023-07-09T21:38:22.393124+0000","last_clean":"2023-07-09T21:38:22.393124+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:38:22.393124+0000","last_undegraded":"2023-07-09T21:38:22.393124+0000","last_fullsized":"2023-07-09T21:38:22.393124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:06:38.316535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0069999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.625,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":1.024,"15min":1.024},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.619},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.754},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.665},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.129,"15min":1.2629999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.002},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.375},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0569999999999999},"last":0.499},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":1.0569999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":1.9339999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95799999999999996,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":4.0979999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.96999999999999997,"15min":1.1519999999999999},"last":2.4020000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0589999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.58199999999999996,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":4.3019999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.165},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.99399999999999999,"5min":1.123,"15min":1.123},"last":1.9890000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56000000000000005,"15min":0.57499999999999996},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.628,"5min":0.90700000000000003,"15min":1.111},"last":6.101},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":7.2910000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":4.7450000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.84199999999999997,"5min":0.98999999999999999,"15min":1.1950000000000001},"last":1.7509999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.006},"last":3.4159999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.52300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82399999999999995,"5min":1.21,"15min":1.21},"last":4.3520000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50064,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321776,"statfs":{"total":96636764160,"available":96585498624,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70099999999999996,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.60799999999999998,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.92100000000000004,"5min":0.96199999999999997,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":1.01,"15min":1.01},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":0.98399999999999999,"15min":1.0169999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.98899999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.038},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":1.014},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.88900000000000001,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.63800000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.60099999999999998,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.58499999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.26,"15min":1.26},"last":0.629},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.165},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.92800000000000005,"15min":1.1859999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":0.82799999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98299999999999998,"5min":1.0049999999999999,"15min":1.107},"last":0.40899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.93600000000000005,"15min":0.997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":1.042},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.60699999999999998,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.495}]},{"osd":4,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.022,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.0760000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.127,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.208},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.67000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.51,"15min":1.51},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.52800000000000002,"15min":0.50600000000000001},"max":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.296},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1910000000000001,"15min":1.323},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317668,"statfs":{"total":96636764160,"available":96581292032,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.77200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":1.0409999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77700000000000002,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1659999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.62,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.149,"5min":1.377,"15min":1.3839999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.754}]},{"osd":6,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.69899999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":1.3100000000000001,"5min":1.423,"15min":1.423},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68799999999999994,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.63900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1140000000000001,"5min":1.496,"15min":1.496},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.45700000000000002},"min":{"1min":0.37,"5min":0.252,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.76800000000000002,"15min":0.871},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.378},"max":{"1min":1.0129999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.385},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.0660000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.212,"15min":1.419},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":1.087,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.149,"15min":1.242},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.018,"15min":1.335},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0329999999999999,"5min":1.258,"15min":1.3799999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.173,"15min":1.173},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47399999999999998},"min":{"1min":0.35399999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.66900000000000004,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":1.0489999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":1.018,"15min":1.018},"last":1.8560000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.47499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.625,"5min":1.038,"15min":1.038},"last":1.657}]},{"osd":3,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.63700000000000001,"5min":0.83999999999999997,"15min":1.143},"last":1.9399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":1.05,"15min":1.274},"last":1.8979999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.6559999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.66600000000000004,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":1.835}]},{"osd":5,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.67900000000000005,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4350000000000001},"last":1.726},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":1.615}]},{"osd":6,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.137,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":1.7569999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96399999999999997,"5min":1.236,"15min":1.3660000000000001},"last":1.8089999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.82399999999999995,"15min":0.82099999999999995},"min":{"1min":0.71999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.5980000000000001},"last":1.6970000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.2709999999999999,"5min":1.282,"15min":1.5740000000000001},"last":1.883}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:38:27.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:38:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 Processor -- start 2023-07-09T21:38:28.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 -- start start 2023-07-09T21:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3015bac0 0x7f6e300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6e300cf550 0x7f6e300b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300b5510 0x7f6e300b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300d0760 con 0x7f6e3015bac0 2023-07-09T21:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e300ccdb0 con 0x7f6e300cf550 2023-07-09T21:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e34dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300d0a20 con 0x7f6e300b5510 2023-07-09T21:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3015bac0 0x7f6e300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e3015bac0 0x7f6e300cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40832/0 (socket says 172.21.15.37:40832) 2023-07-09T21:38:28.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 -- 172.21.15.37:0/1506968743 learned_addr learned my addr 172.21.15.37:0/1506968743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e27fff640 1 --2- 172.21.15.37:0/1506968743 >> v2:172.21.15.119:3300/0 conn(0x7f6e300cf550 0x7f6e300b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2ed9d640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300b5510 0x7f6e300b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 -- 172.21.15.37:0/1506968743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300b5510 msgr2=0x7f6e300b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300b5510 0x7f6e300b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 -- 172.21.15.37:0/1506968743 >> v2:172.21.15.119:3300/0 conn(0x7f6e300cf550 msgr2=0x7f6e300b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/1506968743 >> v2:172.21.15.119:3300/0 conn(0x7f6e300cf550 0x7f6e300b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.123+0000 7f6e2e59c640 1 -- 172.21.15.37:0/1506968743 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e300d0d00 con 0x7f6e3015bac0 2023-07-09T21:38:28.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300cc7d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6e300b4ce0 tx=0x7f6e2001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2226f78dd028c03 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e2dd9b640 1 -- 172.21.15.37:0/1506968743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e200ac630 con 0x7f6e3015bac0 2023-07-09T21:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e2dd9b640 1 -- 172.21.15.37:0/1506968743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e200ac790 con 0x7f6e3015bac0 2023-07-09T21:38:28.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e2dd9b640 1 -- 172.21.15.37:0/1506968743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e200acb20 con 0x7f6e3015bac0 2023-07-09T21:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 -- 172.21.15.37:0/1506968743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 msgr2=0x7f6e300cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300cc7d0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f6e300b4ce0 tx=0x7f6e2001c500 comp rx=0 tx=0).stop 2023-07-09T21:38:28.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 -- 172.21.15.37:0/1506968743 shutdown_connections 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300b5510 0x7f6e300b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/1506968743 >> v2:172.21.15.119:3300/0 conn(0x7f6e300cf550 0x7f6e300b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/1506968743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300cc7d0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 -- 172.21.15.37:0/1506968743 >> 172.21.15.37:0/1506968743 conn(0x7f6e30069f10 msgr2=0x7f6e3006a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 -- 172.21.15.37:0/1506968743 shutdown_connections 2023-07-09T21:38:28.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.127+0000 7f6e34dfa640 1 -- 172.21.15.37:0/1506968743 wait complete. 2023-07-09T21:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 Processor -- start 2023-07-09T21:38:28.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 -- start start 2023-07-09T21:38:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e300b5510 0x7f6e300cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300cf550 0x7f6e300b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300cabe0 con 0x7f6e3015bac0 2023-07-09T21:38:28.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300cbe50 con 0x7f6e300b5510 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e34dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e300c6e50 con 0x7f6e300cf550 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40840/0 (socket says 172.21.15.37:40840) 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 -- 172.21.15.37:0/2177300855 learned_addr learned my addr 172.21.15.37:0/2177300855 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e300b5510 0x7f6e300cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e27fff640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300cf550 0x7f6e300b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 -- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300cf550 msgr2=0x7f6e300b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300cf550 0x7f6e300b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 -- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e300b5510 msgr2=0x7f6e300cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e300b5510 0x7f6e300cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 -- 172.21.15.37:0/2177300855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e200094d0 con 0x7f6e3015bac0 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e2ed9d640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6e28007e30 tx=0x7f6e2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.131+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e28014620 con 0x7f6e3015bac0 2023-07-09T21:38:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e2800ee90 con 0x7f6e3015bac0 2023-07-09T21:38:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e280149c0 con 0x7f6e3015bac0 2023-07-09T21:38:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e300cae30 con 0x7f6e3015bac0 2023-07-09T21:38:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e300cb3f0 con 0x7f6e3015bac0 2023-07-09T21:38:28.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e300cfb30 con 0x7f6e3015bac0 2023-07-09T21:38:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6e28014b20 con 0x7f6e3015bac0 2023-07-09T21:38:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e26ffd640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 0x7f6e10068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6e28084670 con 0x7f6e3015bac0 2023-07-09T21:38:28.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.135+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 0x7f6e10068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.139+0000 7f6e2e59c640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 0x7f6e10068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e200ae000 tx=0x7f6e200a7000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.139+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e28051a80 con 0x7f6e3015bac0 2023-07-09T21:38:28.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.291+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e3004d7d0 con 0x7f6e100663d0 2023-07-09T21:38:28.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.299+0000 7f6e26ffd640 1 -- 172.21.15.37:0/2177300855 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306259 (secure 0 0 0) 0x7f6e3004d7d0 con 0x7f6e100663d0 2023-07-09T21:38:28.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:38:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 msgr2=0x7f6e10068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 0x7f6e10068880 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6e200ae000 tx=0x7f6e200a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 msgr2=0x7f6e300c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f6e28007e30 tx=0x7f6e2800e4b0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 shutdown_connections 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f6e100663d0 0x7f6e10068880 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e3015bac0 0x7f6e300c63d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e300cf550 0x7f6e300b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 --2- 172.21.15.37:0/2177300855 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e300b5510 0x7f6e300cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 >> 172.21.15.37:0/2177300855 conn(0x7f6e30069f10 msgr2=0x7f6e30152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 shutdown_connections 2023-07-09T21:38:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.303+0000 7f6e34dfa640 1 -- 172.21.15.37:0/2177300855 wait complete. 2023-07-09T21:38:28.326 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:38:26.912552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":327852,"kb_used_data":8940,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754646868,"statfs":{"total":773094113280,"available":772758392832,"internally_reserved":0,"allocated":9154560,"data_stored":5161364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.530121"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397787+0000","last_change":"2023-07-09T21:38:22.397787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397787+0000","last_undegraded":"2023-07-09T21:38:22.397787+0000","last_fullsized":"2023-07-09T21:38:22.397787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396561+0000","last_change":"2023-07-09T21:38:22.396561+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396561+0000","last_undegraded":"2023-07-09T21:38:22.396561+0000","last_fullsized":"2023-07-09T21:38:22.396561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388683+0000","last_change":"2023-07-09T21:38:22.388683+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388683+0000","last_undegraded":"2023-07-09T21:38:22.388683+0000","last_fullsized":"2023-07-09T21:38:22.388683+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395147+0000","last_change":"2023-07-09T21:38:22.395147+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395147+0000","last_undegraded":"2023-07-09T21:38:22.395147+0000","last_fullsized":"2023-07-09T21:38:22.395147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.401686+0000","last_change":"2023-07-09T21:38:22.401686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.401686+0000","last_undegraded":"2023-07-09T21:38:22.401686+0000","last_fullsized":"2023-07-09T21:38:22.401686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392721+0000","last_change":"2023-07-09T21:38:22.392721+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392721+0000","last_undegraded":"2023-07-09T21:38:22.392721+0000","last_fullsized":"2023-07-09T21:38:22.392721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388684+0000","last_change":"2023-07-09T21:38:22.388684+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388684+0000","last_undegraded":"2023-07-09T21:38:22.388684+0000","last_fullsized":"2023-07-09T21:38:22.388684+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389338+0000","last_change":"2023-07-09T21:38:22.389338+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389338+0000","last_undegraded":"2023-07-09T21:38:22.389338+0000","last_fullsized":"2023-07-09T21:38:22.389338+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389536+0000","last_change":"2023-07-09T21:38:22.389536+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389536+0000","last_undegraded":"2023-07-09T21:38:22.389536+0000","last_fullsized":"2023-07-09T21:38:22.389536+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390467+0000","last_change":"2023-07-09T21:38:22.390467+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390467+0000","last_undegraded":"2023-07-09T21:38:22.390467+0000","last_fullsized":"2023-07-09T21:38:22.390467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397659+0000","last_change":"2023-07-09T21:38:22.397659+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397659+0000","last_undegraded":"2023-07-09T21:38:22.397659+0000","last_fullsized":"2023-07-09T21:38:22.397659+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390662+0000","last_change":"2023-07-09T21:38:22.390662+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390662+0000","last_undegraded":"2023-07-09T21:38:22.390662+0000","last_fullsized":"2023-07-09T21:38:22.390662+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390142+0000","last_change":"2023-07-09T21:38:22.390142+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390142+0000","last_undegraded":"2023-07-09T21:38:22.390142+0000","last_fullsized":"2023-07-09T21:38:22.390142+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388496+0000","last_change":"2023-07-09T21:38:22.388496+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388496+0000","last_undegraded":"2023-07-09T21:38:22.388496+0000","last_fullsized":"2023-07-09T21:38:22.388496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388540+0000","last_change":"2023-07-09T21:38:22.388540+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388540+0000","last_undegraded":"2023-07-09T21:38:22.388540+0000","last_fullsized":"2023-07-09T21:38:22.388540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387903+0000","last_change":"2023-07-09T21:38:22.387903+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387903+0000","last_undegraded":"2023-07-09T21:38:22.387903+0000","last_fullsized":"2023-07-09T21:38:22.387903+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397203+0000","last_change":"2023-07-09T21:38:22.397203+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397203+0000","last_undegraded":"2023-07-09T21:38:22.397203+0000","last_fullsized":"2023-07-09T21:38:22.397203+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398248+0000","last_change":"2023-07-09T21:38:22.398248+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398248+0000","last_undegraded":"2023-07-09T21:38:22.398248+0000","last_fullsized":"2023-07-09T21:38:22.398248+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398271+0000","last_change":"2023-07-09T21:38:22.398271+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398271+0000","last_undegraded":"2023-07-09T21:38:22.398271+0000","last_fullsized":"2023-07-09T21:38:22.398271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388071+0000","last_change":"2023-07-09T21:38:22.388071+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388071+0000","last_undegraded":"2023-07-09T21:38:22.388071+0000","last_fullsized":"2023-07-09T21:38:22.388071+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389651+0000","last_change":"2023-07-09T21:38:22.389651+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389651+0000","last_undegraded":"2023-07-09T21:38:22.389651+0000","last_fullsized":"2023-07-09T21:38:22.389651+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387987+0000","last_change":"2023-07-09T21:38:22.387987+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387987+0000","last_undegraded":"2023-07-09T21:38:22.387987+0000","last_fullsized":"2023-07-09T21:38:22.387987+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390720+0000","last_change":"2023-07-09T21:38:22.390720+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390720+0000","last_undegraded":"2023-07-09T21:38:22.390720+0000","last_fullsized":"2023-07-09T21:38:22.390720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388497+0000","last_change":"2023-07-09T21:38:22.388497+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388497+0000","last_undegraded":"2023-07-09T21:38:22.388497+0000","last_fullsized":"2023-07-09T21:38:22.388497+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391558+0000","last_change":"2023-07-09T21:38:22.391558+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391558+0000","last_undegraded":"2023-07-09T21:38:22.391558+0000","last_fullsized":"2023-07-09T21:38:22.391558+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391791+0000","last_change":"2023-07-09T21:38:22.391791+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391791+0000","last_undegraded":"2023-07-09T21:38:22.391791+0000","last_fullsized":"2023-07-09T21:38:22.391791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394893+0000","last_change":"2023-07-09T21:38:22.394893+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394893+0000","last_undegraded":"2023-07-09T21:38:22.394893+0000","last_fullsized":"2023-07-09T21:38:22.394893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394871+0000","last_change":"2023-07-09T21:38:22.394871+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394871+0000","last_undegraded":"2023-07-09T21:38:22.394871+0000","last_fullsized":"2023-07-09T21:38:22.394871+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388658+0000","last_change":"2023-07-09T21:38:22.388658+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388658+0000","last_undegraded":"2023-07-09T21:38:22.388658+0000","last_fullsized":"2023-07-09T21:38:22.388658+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390509+0000","last_change":"2023-07-09T21:38:22.390509+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390509+0000","last_undegraded":"2023-07-09T21:38:22.390509+0000","last_fullsized":"2023-07-09T21:38:22.390509+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398927+0000","last_change":"2023-07-09T21:38:22.398927+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398927+0000","last_undegraded":"2023-07-09T21:38:22.398927+0000","last_fullsized":"2023-07-09T21:38:22.398927+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394525+0000","last_change":"2023-07-09T21:38:22.394525+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394525+0000","last_undegraded":"2023-07-09T21:38:22.394525+0000","last_fullsized":"2023-07-09T21:38:22.394525+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397904+0000","last_change":"2023-07-09T21:38:22.397904+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397904+0000","last_undegraded":"2023-07-09T21:38:22.397904+0000","last_fullsized":"2023-07-09T21:38:22.397904+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410166+0000","last_change":"2023-07-09T21:38:22.408788+0000","last_active":"2023-07-09T21:38:22.410166+0000","last_peered":"2023-07-09T21:38:22.410166+0000","last_clean":"2023-07-09T21:38:22.410166+0000","last_became_active":"2023-07-09T21:38:22.408319+0000","last_became_peered":"2023-07-09T21:38:22.408319+0000","last_unstale":"2023-07-09T21:38:22.410166+0000","last_undegraded":"2023-07-09T21:38:22.410166+0000","last_fullsized":"2023-07-09T21:38:22.410166+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:43.225018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394276+0000","last_change":"2023-07-09T21:38:22.394276+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394276+0000","last_undegraded":"2023-07-09T21:38:22.394276+0000","last_fullsized":"2023-07-09T21:38:22.394276+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409877+0000","last_change":"2023-07-09T21:38:22.408871+0000","last_active":"2023-07-09T21:38:22.409877+0000","last_peered":"2023-07-09T21:38:22.409877+0000","last_clean":"2023-07-09T21:38:22.409877+0000","last_became_active":"2023-07-09T21:38:22.408396+0000","last_became_peered":"2023-07-09T21:38:22.408396+0000","last_unstale":"2023-07-09T21:38:22.409877+0000","last_undegraded":"2023-07-09T21:38:22.409877+0000","last_fullsized":"2023-07-09T21:38:22.409877+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393740+0000","last_change":"2023-07-09T21:38:22.393740+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393740+0000","last_undegraded":"2023-07-09T21:38:22.393740+0000","last_fullsized":"2023-07-09T21:38:22.393740+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406420+0000","last_change":"2023-07-09T21:38:22.403317+0000","last_active":"2023-07-09T21:38:22.406420+0000","last_peered":"2023-07-09T21:38:22.406420+0000","last_clean":"2023-07-09T21:38:22.406420+0000","last_became_active":"2023-07-09T21:38:22.402972+0000","last_became_peered":"2023-07-09T21:38:22.402972+0000","last_unstale":"2023-07-09T21:38:22.406420+0000","last_undegraded":"2023-07-09T21:38:22.406420+0000","last_fullsized":"2023-07-09T21:38:22.406420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.390036+0000","last_change":"2023-07-09T21:38:22.390036+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.390036+0000","last_undegraded":"2023-07-09T21:38:22.390036+0000","last_fullsized":"2023-07-09T21:38:22.390036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401252+0000","last_change":"2023-07-09T21:38:22.398622+0000","last_active":"2023-07-09T21:38:22.401252+0000","last_peered":"2023-07-09T21:38:22.401252+0000","last_clean":"2023-07-09T21:38:22.401252+0000","last_became_active":"2023-07-09T21:38:22.398344+0000","last_became_peered":"2023-07-09T21:38:22.398344+0000","last_unstale":"2023-07-09T21:38:22.401252+0000","last_undegraded":"2023-07-09T21:38:22.401252+0000","last_fullsized":"2023-07-09T21:38:22.401252+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387426+0000","last_change":"2023-07-09T21:38:22.387426+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387426+0000","last_undegraded":"2023-07-09T21:38:22.387426+0000","last_fullsized":"2023-07-09T21:38:22.387426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.398259+0000","last_change":"2023-07-09T21:38:22.396887+0000","last_active":"2023-07-09T21:38:22.398259+0000","last_peered":"2023-07-09T21:38:22.398259+0000","last_clean":"2023-07-09T21:38:22.398259+0000","last_became_active":"2023-07-09T21:38:22.396575+0000","last_became_peered":"2023-07-09T21:38:22.396575+0000","last_unstale":"2023-07-09T21:38:22.398259+0000","last_undegraded":"2023-07-09T21:38:22.398259+0000","last_fullsized":"2023-07-09T21:38:22.398259+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393734+0000","last_change":"2023-07-09T21:38:22.393734+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393734+0000","last_undegraded":"2023-07-09T21:38:22.393734+0000","last_fullsized":"2023-07-09T21:38:22.393734+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399038+0000","last_change":"2023-07-09T21:38:22.394044+0000","last_active":"2023-07-09T21:38:22.399038+0000","last_peered":"2023-07-09T21:38:22.399038+0000","last_clean":"2023-07-09T21:38:22.399038+0000","last_became_active":"2023-07-09T21:38:22.393668+0000","last_became_peered":"2023-07-09T21:38:22.393668+0000","last_unstale":"2023-07-09T21:38:22.399038+0000","last_undegraded":"2023-07-09T21:38:22.399038+0000","last_fullsized":"2023-07-09T21:38:22.399038+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:44.125874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.398078+0000","last_change":"2023-07-09T21:38:22.398078+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.398078+0000","last_undegraded":"2023-07-09T21:38:22.398078+0000","last_fullsized":"2023-07-09T21:38:22.398078+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403914+0000","last_change":"2023-07-09T21:38:22.399971+0000","last_active":"2023-07-09T21:38:22.403914+0000","last_peered":"2023-07-09T21:38:22.403914+0000","last_clean":"2023-07-09T21:38:22.403914+0000","last_became_active":"2023-07-09T21:38:22.396590+0000","last_became_peered":"2023-07-09T21:38:22.396590+0000","last_unstale":"2023-07-09T21:38:22.403914+0000","last_undegraded":"2023-07-09T21:38:22.403914+0000","last_fullsized":"2023-07-09T21:38:22.403914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:28:05.747200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388620+0000","last_change":"2023-07-09T21:38:22.388620+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388620+0000","last_undegraded":"2023-07-09T21:38:22.388620+0000","last_fullsized":"2023-07-09T21:38:22.388620+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.412311+0000","last_change":"2023-07-09T21:38:22.411514+0000","last_active":"2023-07-09T21:38:22.412311+0000","last_peered":"2023-07-09T21:38:22.412311+0000","last_clean":"2023-07-09T21:38:22.412311+0000","last_became_active":"2023-07-09T21:38:22.411169+0000","last_became_peered":"2023-07-09T21:38:22.411169+0000","last_unstale":"2023-07-09T21:38:22.412311+0000","last_undegraded":"2023-07-09T21:38:22.412311+0000","last_fullsized":"2023-07-09T21:38:22.412311+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:44:17.555337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394370+0000","last_change":"2023-07-09T21:38:22.394370+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394370+0000","last_undegraded":"2023-07-09T21:38:22.394370+0000","last_fullsized":"2023-07-09T21:38:22.394370+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413951+0000","last_change":"2023-07-09T21:38:22.408707+0000","last_active":"2023-07-09T21:38:22.413951+0000","last_peered":"2023-07-09T21:38:22.413951+0000","last_clean":"2023-07-09T21:38:22.413951+0000","last_became_active":"2023-07-09T21:38:22.408415+0000","last_became_peered":"2023-07-09T21:38:22.408415+0000","last_unstale":"2023-07-09T21:38:22.413951+0000","last_undegraded":"2023-07-09T21:38:22.413951+0000","last_fullsized":"2023-07-09T21:38:22.413951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:04.167370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.388830+0000","last_change":"2023-07-09T21:38:22.388830+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.388830+0000","last_undegraded":"2023-07-09T21:38:22.388830+0000","last_fullsized":"2023-07-09T21:38:22.388830+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.416353+0000","last_change":"2023-07-09T21:38:22.413038+0000","last_active":"2023-07-09T21:38:22.416353+0000","last_peered":"2023-07-09T21:38:22.416353+0000","last_clean":"2023-07-09T21:38:22.416353+0000","last_became_active":"2023-07-09T21:38:22.412805+0000","last_became_peered":"2023-07-09T21:38:22.412805+0000","last_unstale":"2023-07-09T21:38:22.416353+0000","last_undegraded":"2023-07-09T21:38:22.416353+0000","last_fullsized":"2023-07-09T21:38:22.416353+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:24.308270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396646+0000","last_change":"2023-07-09T21:38:22.396646+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396646+0000","last_undegraded":"2023-07-09T21:38:22.396646+0000","last_fullsized":"2023-07-09T21:38:22.396646+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413770+0000","last_change":"2023-07-09T21:38:22.403101+0000","last_active":"2023-07-09T21:38:22.413770+0000","last_peered":"2023-07-09T21:38:22.413770+0000","last_clean":"2023-07-09T21:38:22.413770+0000","last_became_active":"2023-07-09T21:38:22.402419+0000","last_became_peered":"2023-07-09T21:38:22.402419+0000","last_unstale":"2023-07-09T21:38:22.413770+0000","last_undegraded":"2023-07-09T21:38:22.413770+0000","last_fullsized":"2023-07-09T21:38:22.413770+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:11.535383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394687+0000","last_change":"2023-07-09T21:38:22.394687+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394687+0000","last_undegraded":"2023-07-09T21:38:22.394687+0000","last_fullsized":"2023-07-09T21:38:22.394687+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409463+0000","last_change":"2023-07-09T21:38:22.408024+0000","last_active":"2023-07-09T21:38:22.409463+0000","last_peered":"2023-07-09T21:38:22.409463+0000","last_clean":"2023-07-09T21:38:22.409463+0000","last_became_active":"2023-07-09T21:38:22.407723+0000","last_became_peered":"2023-07-09T21:38:22.407723+0000","last_unstale":"2023-07-09T21:38:22.409463+0000","last_undegraded":"2023-07-09T21:38:22.409463+0000","last_fullsized":"2023-07-09T21:38:22.409463+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:45.158766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394528+0000","last_change":"2023-07-09T21:38:22.394528+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394528+0000","last_undegraded":"2023-07-09T21:38:22.394528+0000","last_fullsized":"2023-07-09T21:38:22.394528+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413918+0000","last_change":"2023-07-09T21:38:22.404352+0000","last_active":"2023-07-09T21:38:22.413918+0000","last_peered":"2023-07-09T21:38:22.413918+0000","last_clean":"2023-07-09T21:38:22.413918+0000","last_became_active":"2023-07-09T21:38:22.404072+0000","last_became_peered":"2023-07-09T21:38:22.404072+0000","last_unstale":"2023-07-09T21:38:22.413918+0000","last_undegraded":"2023-07-09T21:38:22.413918+0000","last_fullsized":"2023-07-09T21:38:22.413918+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:01:01.158270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392206+0000","last_change":"2023-07-09T21:38:22.392206+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392206+0000","last_undegraded":"2023-07-09T21:38:22.392206+0000","last_fullsized":"2023-07-09T21:38:22.392206+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408861+0000","last_change":"2023-07-09T21:38:22.403402+0000","last_active":"2023-07-09T21:38:22.408861+0000","last_peered":"2023-07-09T21:38:22.408861+0000","last_clean":"2023-07-09T21:38:22.408861+0000","last_became_active":"2023-07-09T21:38:22.403067+0000","last_became_peered":"2023-07-09T21:38:22.403067+0000","last_unstale":"2023-07-09T21:38:22.408861+0000","last_undegraded":"2023-07-09T21:38:22.408861+0000","last_fullsized":"2023-07-09T21:38:22.408861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:25.021256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396618+0000","last_change":"2023-07-09T21:38:22.396618+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396618+0000","last_undegraded":"2023-07-09T21:38:22.396618+0000","last_fullsized":"2023-07-09T21:38:22.396618+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413890+0000","last_change":"2023-07-09T21:38:22.407689+0000","last_active":"2023-07-09T21:38:22.413890+0000","last_peered":"2023-07-09T21:38:22.413890+0000","last_clean":"2023-07-09T21:38:22.413890+0000","last_became_active":"2023-07-09T21:38:22.407375+0000","last_became_peered":"2023-07-09T21:38:22.407375+0000","last_unstale":"2023-07-09T21:38:22.413890+0000","last_undegraded":"2023-07-09T21:38:22.413890+0000","last_fullsized":"2023-07-09T21:38:22.413890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:17:28.816419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.393542+0000","last_change":"2023-07-09T21:38:22.393542+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.393542+0000","last_undegraded":"2023-07-09T21:38:22.393542+0000","last_fullsized":"2023-07-09T21:38:22.393542+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417377+0000","last_change":"2023-07-09T21:38:22.415040+0000","last_active":"2023-07-09T21:38:22.417377+0000","last_peered":"2023-07-09T21:38:22.417377+0000","last_clean":"2023-07-09T21:38:22.417377+0000","last_became_active":"2023-07-09T21:38:22.414497+0000","last_became_peered":"2023-07-09T21:38:22.414497+0000","last_unstale":"2023-07-09T21:38:22.417377+0000","last_undegraded":"2023-07-09T21:38:22.417377+0000","last_fullsized":"2023-07-09T21:38:22.417377+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:24:00.884788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.392686+0000","last_change":"2023-07-09T21:38:22.392686+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.392686+0000","last_undegraded":"2023-07-09T21:38:22.392686+0000","last_fullsized":"2023-07-09T21:38:22.392686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410743+0000","last_change":"2023-07-09T21:38:22.404010+0000","last_active":"2023-07-09T21:38:22.410743+0000","last_peered":"2023-07-09T21:38:22.410743+0000","last_clean":"2023-07-09T21:38:22.410743+0000","last_became_active":"2023-07-09T21:38:22.403441+0000","last_became_peered":"2023-07-09T21:38:22.403441+0000","last_unstale":"2023-07-09T21:38:22.410743+0000","last_undegraded":"2023-07-09T21:38:22.410743+0000","last_fullsized":"2023-07-09T21:38:22.410743+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:10.361789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.386855+0000","last_change":"2023-07-09T21:38:22.386855+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.386855+0000","last_undegraded":"2023-07-09T21:38:22.386855+0000","last_fullsized":"2023-07-09T21:38:22.386855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408324+0000","last_change":"2023-07-09T21:38:22.401340+0000","last_active":"2023-07-09T21:38:22.408324+0000","last_peered":"2023-07-09T21:38:22.408324+0000","last_clean":"2023-07-09T21:38:22.408324+0000","last_became_active":"2023-07-09T21:38:22.401065+0000","last_became_peered":"2023-07-09T21:38:22.401065+0000","last_unstale":"2023-07-09T21:38:22.408324+0000","last_undegraded":"2023-07-09T21:38:22.408324+0000","last_fullsized":"2023-07-09T21:38:22.408324+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:09.524276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.391275+0000","last_change":"2023-07-09T21:38:22.391275+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.391275+0000","last_undegraded":"2023-07-09T21:38:22.391275+0000","last_fullsized":"2023-07-09T21:38:22.391275+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.406399+0000","last_change":"2023-07-09T21:38:22.401562+0000","last_active":"2023-07-09T21:38:22.406399+0000","last_peered":"2023-07-09T21:38:22.406399+0000","last_clean":"2023-07-09T21:38:22.406399+0000","last_became_active":"2023-07-09T21:38:22.401259+0000","last_became_peered":"2023-07-09T21:38:22.401259+0000","last_unstale":"2023-07-09T21:38:22.406399+0000","last_undegraded":"2023-07-09T21:38:22.406399+0000","last_fullsized":"2023-07-09T21:38:22.406399+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:15.525102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395616+0000","last_change":"2023-07-09T21:38:22.395616+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395616+0000","last_undegraded":"2023-07-09T21:38:22.395616+0000","last_fullsized":"2023-07-09T21:38:22.395616+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.410160+0000","last_change":"2023-07-09T21:38:22.408925+0000","last_active":"2023-07-09T21:38:22.410160+0000","last_peered":"2023-07-09T21:38:22.410160+0000","last_clean":"2023-07-09T21:38:22.410160+0000","last_became_active":"2023-07-09T21:38:22.407895+0000","last_became_peered":"2023-07-09T21:38:22.407895+0000","last_unstale":"2023-07-09T21:38:22.410160+0000","last_undegraded":"2023-07-09T21:38:22.410160+0000","last_fullsized":"2023-07-09T21:38:22.410160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:36.116432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397807+0000","last_change":"2023-07-09T21:38:22.397807+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397807+0000","last_undegraded":"2023-07-09T21:38:22.397807+0000","last_fullsized":"2023-07-09T21:38:22.397807+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413894+0000","last_change":"2023-07-09T21:38:22.402885+0000","last_active":"2023-07-09T21:38:22.413894+0000","last_peered":"2023-07-09T21:38:22.413894+0000","last_clean":"2023-07-09T21:38:22.413894+0000","last_became_active":"2023-07-09T21:38:22.402582+0000","last_became_peered":"2023-07-09T21:38:22.402582+0000","last_unstale":"2023-07-09T21:38:22.413894+0000","last_undegraded":"2023-07-09T21:38:22.413894+0000","last_fullsized":"2023-07-09T21:38:22.413894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:48.963373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395095+0000","last_change":"2023-07-09T21:38:22.395095+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395095+0000","last_undegraded":"2023-07-09T21:38:22.395095+0000","last_fullsized":"2023-07-09T21:38:22.395095+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403481+0000","last_change":"2023-07-09T21:38:22.399149+0000","last_active":"2023-07-09T21:38:22.403481+0000","last_peered":"2023-07-09T21:38:22.403481+0000","last_clean":"2023-07-09T21:38:22.403481+0000","last_became_active":"2023-07-09T21:38:22.398841+0000","last_became_peered":"2023-07-09T21:38:22.398841+0000","last_unstale":"2023-07-09T21:38:22.403481+0000","last_undegraded":"2023-07-09T21:38:22.403481+0000","last_fullsized":"2023-07-09T21:38:22.403481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:38.043757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395101+0000","last_change":"2023-07-09T21:38:22.395101+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395101+0000","last_undegraded":"2023-07-09T21:38:22.395101+0000","last_fullsized":"2023-07-09T21:38:22.395101+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403896+0000","last_change":"2023-07-09T21:38:22.399727+0000","last_active":"2023-07-09T21:38:22.403896+0000","last_peered":"2023-07-09T21:38:22.403896+0000","last_clean":"2023-07-09T21:38:22.403896+0000","last_became_active":"2023-07-09T21:38:22.396239+0000","last_became_peered":"2023-07-09T21:38:22.396239+0000","last_unstale":"2023-07-09T21:38:22.403896+0000","last_undegraded":"2023-07-09T21:38:22.403896+0000","last_fullsized":"2023-07-09T21:38:22.403896+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.387305+0000","last_change":"2023-07-09T21:38:22.387305+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.387305+0000","last_undegraded":"2023-07-09T21:38:22.387305+0000","last_fullsized":"2023-07-09T21:38:22.387305+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.401183+0000","last_change":"2023-07-09T21:38:22.396722+0000","last_active":"2023-07-09T21:38:22.401183+0000","last_peered":"2023-07-09T21:38:22.401183+0000","last_clean":"2023-07-09T21:38:22.401183+0000","last_became_active":"2023-07-09T21:38:22.396430+0000","last_became_peered":"2023-07-09T21:38:22.396430+0000","last_unstale":"2023-07-09T21:38:22.401183+0000","last_undegraded":"2023-07-09T21:38:22.401183+0000","last_fullsized":"2023-07-09T21:38:22.401183+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:07.027092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395800+0000","last_change":"2023-07-09T21:38:22.395800+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395800+0000","last_undegraded":"2023-07-09T21:38:22.395800+0000","last_fullsized":"2023-07-09T21:38:22.395800+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.403826+0000","last_change":"2023-07-09T21:38:22.400029+0000","last_active":"2023-07-09T21:38:22.403826+0000","last_peered":"2023-07-09T21:38:22.403826+0000","last_clean":"2023-07-09T21:38:22.403826+0000","last_became_active":"2023-07-09T21:38:22.399708+0000","last_became_peered":"2023-07-09T21:38:22.399708+0000","last_unstale":"2023-07-09T21:38:22.403826+0000","last_undegraded":"2023-07-09T21:38:22.403826+0000","last_fullsized":"2023-07-09T21:38:22.403826+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":440,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391792+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:38:22.391792+0000","last_peered":"2023-07-09T21:38:22.391792+0000","last_clean":"2023-07-09T21:38:22.391792+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:38:22.391792+0000","last_undegraded":"2023-07-09T21:38:22.391792+0000","last_fullsized":"2023-07-09T21:38:22.391792+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:42.492075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.392248+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:38:22.392248+0000","last_peered":"2023-07-09T21:38:22.392248+0000","last_clean":"2023-07-09T21:38:22.392248+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:38:22.392248+0000","last_undegraded":"2023-07-09T21:38:22.392248+0000","last_fullsized":"2023-07-09T21:38:22.392248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:03:14.190937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.394033+0000","last_change":"2023-07-09T21:38:22.394033+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.394033+0000","last_undegraded":"2023-07-09T21:38:22.394033+0000","last_fullsized":"2023-07-09T21:38:22.394033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404128+0000","last_change":"2023-07-09T21:38:22.400490+0000","last_active":"2023-07-09T21:38:22.404128+0000","last_peered":"2023-07-09T21:38:22.404128+0000","last_clean":"2023-07-09T21:38:22.404128+0000","last_became_active":"2023-07-09T21:38:22.400179+0000","last_became_peered":"2023-07-09T21:38:22.400179+0000","last_unstale":"2023-07-09T21:38:22.404128+0000","last_undegraded":"2023-07-09T21:38:22.404128+0000","last_fullsized":"2023-07-09T21:38:22.404128+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:46:40.409485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.391776+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:38:22.391776+0000","last_peered":"2023-07-09T21:38:22.391776+0000","last_clean":"2023-07-09T21:38:22.391776+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:38:22.391776+0000","last_undegraded":"2023-07-09T21:38:22.391776+0000","last_fullsized":"2023-07-09T21:38:22.391776+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389315+0000","last_change":"2023-07-09T21:38:22.389315+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389315+0000","last_undegraded":"2023-07-09T21:38:22.389315+0000","last_fullsized":"2023-07-09T21:38:22.389315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.399593+0000","last_change":"2023-07-09T21:38:22.398190+0000","last_active":"2023-07-09T21:38:22.399593+0000","last_peered":"2023-07-09T21:38:22.399593+0000","last_clean":"2023-07-09T21:38:22.399593+0000","last_became_active":"2023-07-09T21:38:22.397908+0000","last_became_peered":"2023-07-09T21:38:22.397908+0000","last_unstale":"2023-07-09T21:38:22.399593+0000","last_undegraded":"2023-07-09T21:38:22.399593+0000","last_fullsized":"2023-07-09T21:38:22.399593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:13.998771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388319+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:38:22.388319+0000","last_peered":"2023-07-09T21:38:22.388319+0000","last_clean":"2023-07-09T21:38:22.388319+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:38:22.388319+0000","last_undegraded":"2023-07-09T21:38:22.388319+0000","last_fullsized":"2023-07-09T21:38:22.388319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:50.823909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395920+0000","last_change":"2023-07-09T21:38:22.395920+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395920+0000","last_undegraded":"2023-07-09T21:38:22.395920+0000","last_fullsized":"2023-07-09T21:38:22.395920+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.409872+0000","last_change":"2023-07-09T21:38:22.408768+0000","last_active":"2023-07-09T21:38:22.409872+0000","last_peered":"2023-07-09T21:38:22.409872+0000","last_clean":"2023-07-09T21:38:22.409872+0000","last_became_active":"2023-07-09T21:38:22.408410+0000","last_became_peered":"2023-07-09T21:38:22.408410+0000","last_unstale":"2023-07-09T21:38:22.409872+0000","last_undegraded":"2023-07-09T21:38:22.409872+0000","last_fullsized":"2023-07-09T21:38:22.409872+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:46.832553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":146,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.390884+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:38:22.390884+0000","last_peered":"2023-07-09T21:38:22.390884+0000","last_clean":"2023-07-09T21:38:22.390884+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:38:22.390884+0000","last_undegraded":"2023-07-09T21:38:22.390884+0000","last_fullsized":"2023-07-09T21:38:22.390884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:27.332952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.389121+0000","last_change":"2023-07-09T21:38:22.389121+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.389121+0000","last_undegraded":"2023-07-09T21:38:22.389121+0000","last_fullsized":"2023-07-09T21:38:22.389121+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.408888+0000","last_change":"2023-07-09T21:38:22.403699+0000","last_active":"2023-07-09T21:38:22.408888+0000","last_peered":"2023-07-09T21:38:22.408888+0000","last_clean":"2023-07-09T21:38:22.408888+0000","last_became_active":"2023-07-09T21:38:22.403088+0000","last_became_peered":"2023-07-09T21:38:22.403088+0000","last_unstale":"2023-07-09T21:38:22.408888+0000","last_undegraded":"2023-07-09T21:38:22.408888+0000","last_fullsized":"2023-07-09T21:38:22.408888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:47.236478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.388044+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:38:22.388044+0000","last_peered":"2023-07-09T21:38:22.388044+0000","last_clean":"2023-07-09T21:38:22.388044+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:38:22.388044+0000","last_undegraded":"2023-07-09T21:38:22.388044+0000","last_fullsized":"2023-07-09T21:38:22.388044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:45.744824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.395787+0000","last_change":"2023-07-09T21:38:22.395787+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.395787+0000","last_undegraded":"2023-07-09T21:38:22.395787+0000","last_fullsized":"2023-07-09T21:38:22.395787+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.417140+0000","last_change":"2023-07-09T21:38:22.414687+0000","last_active":"2023-07-09T21:38:22.417140+0000","last_peered":"2023-07-09T21:38:22.417140+0000","last_clean":"2023-07-09T21:38:22.417140+0000","last_became_active":"2023-07-09T21:38:22.414205+0000","last_became_peered":"2023-07-09T21:38:22.414205+0000","last_unstale":"2023-07-09T21:38:22.417140+0000","last_undegraded":"2023-07-09T21:38:22.417140+0000","last_fullsized":"2023-07-09T21:38:22.417140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:28.275670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":128,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393897+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:38:22.393897+0000","last_peered":"2023-07-09T21:38:22.393897+0000","last_clean":"2023-07-09T21:38:22.393897+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:38:22.393897+0000","last_undegraded":"2023-07-09T21:38:22.393897+0000","last_fullsized":"2023-07-09T21:38:22.393897+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:06:06.526313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.397768+0000","last_change":"2023-07-09T21:38:22.397768+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.397768+0000","last_undegraded":"2023-07-09T21:38:22.397768+0000","last_fullsized":"2023-07-09T21:38:22.397768+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.413999+0000","last_change":"2023-07-09T21:38:22.408792+0000","last_active":"2023-07-09T21:38:22.413999+0000","last_peered":"2023-07-09T21:38:22.413999+0000","last_clean":"2023-07-09T21:38:22.413999+0000","last_became_active":"2023-07-09T21:38:22.408483+0000","last_became_peered":"2023-07-09T21:38:22.408483+0000","last_unstale":"2023-07-09T21:38:22.413999+0000","last_undegraded":"2023-07-09T21:38:22.413999+0000","last_fullsized":"2023-07-09T21:38:22.413999+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:42.283021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":126,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.387296+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:38:22.387296+0000","last_peered":"2023-07-09T21:38:22.387296+0000","last_clean":"2023-07-09T21:38:22.387296+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:38:22.387296+0000","last_undegraded":"2023-07-09T21:38:22.387296+0000","last_fullsized":"2023-07-09T21:38:22.387296+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:43:33.093816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":83,"state":"creating+peering","last_fresh":"2023-07-09T21:38:22.396207+0000","last_change":"2023-07-09T21:38:22.396207+0000","last_active":"2023-07-09T21:38:22.374951+0000","last_peered":"2023-07-09T21:38:22.374951+0000","last_clean":"2023-07-09T21:38:22.374951+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:38:22.396207+0000","last_undegraded":"2023-07-09T21:38:22.396207+0000","last_fullsized":"2023-07-09T21:38:22.396207+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.404649+0000","last_change":"2023-07-09T21:38:22.402484+0000","last_active":"2023-07-09T21:38:22.404649+0000","last_peered":"2023-07-09T21:38:22.404649+0000","last_clean":"2023-07-09T21:38:22.404649+0000","last_became_active":"2023-07-09T21:38:22.402194+0000","last_became_peered":"2023-07-09T21:38:22.402194+0000","last_unstale":"2023-07-09T21:38:22.404649+0000","last_undegraded":"2023-07-09T21:38:22.404649+0000","last_fullsized":"2023-07-09T21:38:22.404649+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:50:10.425883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":130,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-07-09T21:38:22.393124+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:38:22.393124+0000","last_peered":"2023-07-09T21:38:22.393124+0000","last_clean":"2023-07-09T21:38:22.393124+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:38:22.393124+0000","last_undegraded":"2023-07-09T21:38:22.393124+0000","last_fullsized":"2023-07-09T21:38:22.393124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:06:38.316535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58836,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94313004,"statfs":{"total":96636764160,"available":96576516096,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0069999999999999},"last":0.59999999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.625,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":1.024,"15min":1.024},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.63300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.619},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.754},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.665},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.129,"15min":1.2629999999999999},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.002},"last":0.51100000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.53500000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.375},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0569999999999999},"last":0.499},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575042,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":1.0569999999999999},"last":1.8080000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":1.9339999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95799999999999996,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":4.0979999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.96999999999999997,"15min":1.1519999999999999},"last":2.4020000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0589999999999999},"last":2.0430000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.58199999999999996,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":4.3019999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.165},"last":1.6499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.99399999999999999,"5min":1.123,"15min":1.123},"last":1.9890000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56000000000000005,"15min":0.57499999999999996},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.628,"5min":0.90700000000000003,"15min":1.111},"last":6.101},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":7.2910000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":4.7450000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.84199999999999997,"5min":0.98999999999999999,"15min":1.1950000000000001},"last":1.7509999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.006},"last":3.4159999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.52300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82399999999999995,"5min":1.21,"15min":1.21},"last":4.3520000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575041,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50064,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321776,"statfs":{"total":96636764160,"available":96585498624,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70099999999999996,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.39400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.55400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.60799999999999998,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.92100000000000004,"5min":0.96199999999999997,"15min":0.999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.48799999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":1.01,"15min":1.01},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61399999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":0.98399999999999999,"15min":1.0169999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.98899999999999999,"15min":0.99299999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.038},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":1.014},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575043,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":991232,"data_stored":495096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.88900000000000001,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.63800000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.60099999999999998,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.65000000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.58499999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.68200000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.26,"15min":1.26},"last":0.629},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.165},"last":0.66500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.92800000000000005,"15min":1.1859999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":0.82799999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.38500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98299999999999998,"5min":1.0049999999999999,"15min":1.107},"last":0.40899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.93600000000000005,"15min":0.997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":1.042},"last":0.749}]}]},{"osd":3,"up_from":13,"seq":55834575042,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.46999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.60699999999999998,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.443},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.495}]},{"osd":4,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.022,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.0760000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.83999999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.127,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.208},"last":0.82799999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.67000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.51,"15min":1.51},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.52800000000000002,"15min":0.50600000000000001},"max":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.296},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1910000000000001,"15min":1.323},"last":0.79300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575043,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54172,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317668,"statfs":{"total":96636764160,"available":96581292032,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.77200000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":1.0409999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77700000000000002,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1659999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.62,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.149,"5min":1.377,"15min":1.3839999999999999},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.754}]},{"osd":6,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.69899999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":1.3100000000000001,"5min":1.423,"15min":1.423},"last":0.71399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68799999999999994,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.63900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1140000000000001,"5min":1.496,"15min":1.496},"last":0.95899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32028,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339812,"statfs":{"total":96636764160,"available":96603967488,"internally_reserved":0,"allocated":1003520,"data_stored":501716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.45700000000000002},"min":{"1min":0.37,"5min":0.252,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.76800000000000002,"15min":0.871},"last":0.433},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.378},"max":{"1min":1.0129999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.385},"last":0.39100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.0660000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.212,"15min":1.419},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":1.087,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.149,"15min":1.242},"last":0.58799999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.018,"15min":1.335},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0329999999999999,"5min":1.258,"15min":1.3799999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.173,"15min":1.173},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.68799999999999994}]}]},{"osd":0,"up_from":13,"seq":55834575043,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36692,"kb_used_data":1548,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335148,"statfs":{"total":96636764160,"available":96599191552,"internally_reserved":0,"allocated":1585152,"data_stored":1085464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47399999999999998},"min":{"1min":0.35399999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.66900000000000004,"5min":0.753,"15min":0.753},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":1.0489999999999999},"last":1.1990000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":1.018,"15min":1.018},"last":1.8560000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.47499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.625,"5min":1.038,"15min":1.038},"last":1.657}]},{"osd":3,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.63700000000000001,"5min":0.83999999999999997,"15min":1.143},"last":1.9399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":1.05,"15min":1.274},"last":1.8979999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.6559999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.66600000000000004,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":1.835}]},{"osd":5,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.67900000000000005,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4350000000000001},"last":1.726},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":1.615}]},{"osd":6,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.137,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":1.7569999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96399999999999997,"5min":1.236,"15min":1.3660000000000001},"last":1.8089999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.82399999999999995,"15min":0.82099999999999995},"min":{"1min":0.71999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.5980000000000001},"last":1.6970000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.2709999999999999,"5min":1.282,"15min":1.5740000000000001},"last":1.883}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:38:28.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3f is not active+clean 2023-07-09T21:38:28.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397787+0000', 'last_change': '2023-07-09T21:38:22.397787+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397787+0000', 'last_undegraded': '2023-07-09T21:38:22.397787+0000', 'last_fullsized': '2023-07-09T21:38:22.397787+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3e is not active+clean 2023-07-09T21:38:28.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.396561+0000', 'last_change': '2023-07-09T21:38:22.396561+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.396561+0000', 'last_undegraded': '2023-07-09T21:38:22.396561+0000', 'last_fullsized': '2023-07-09T21:38:22.396561+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3d is not active+clean 2023-07-09T21:38:28.339 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388683+0000', 'last_change': '2023-07-09T21:38:22.388683+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388683+0000', 'last_undegraded': '2023-07-09T21:38:22.388683+0000', 'last_fullsized': '2023-07-09T21:38:22.388683+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.339 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3c is not active+clean 2023-07-09T21:38:28.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395147+0000', 'last_change': '2023-07-09T21:38:22.395147+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395147+0000', 'last_undegraded': '2023-07-09T21:38:22.395147+0000', 'last_fullsized': '2023-07-09T21:38:22.395147+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.340 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3b is not active+clean 2023-07-09T21:38:28.340 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.401686+0000', 'last_change': '2023-07-09T21:38:22.401686+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.401686+0000', 'last_undegraded': '2023-07-09T21:38:22.401686+0000', 'last_fullsized': '2023-07-09T21:38:22.401686+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3a is not active+clean 2023-07-09T21:38:28.341 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.392721+0000', 'last_change': '2023-07-09T21:38:22.392721+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.392721+0000', 'last_undegraded': '2023-07-09T21:38:22.392721+0000', 'last_fullsized': '2023-07-09T21:38:22.392721+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:38:28.341 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.39 is not active+clean 2023-07-09T21:38:28.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388684+0000', 'last_change': '2023-07-09T21:38:22.388684+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388684+0000', 'last_undegraded': '2023-07-09T21:38:22.388684+0000', 'last_fullsized': '2023-07-09T21:38:22.388684+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:38:28.342 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.38 is not active+clean 2023-07-09T21:38:28.342 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.389338+0000', 'last_change': '2023-07-09T21:38:22.389338+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.389338+0000', 'last_undegraded': '2023-07-09T21:38:22.389338+0000', 'last_fullsized': '2023-07-09T21:38:22.389338+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.37 is not active+clean 2023-07-09T21:38:28.343 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.389536+0000', 'last_change': '2023-07-09T21:38:22.389536+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.389536+0000', 'last_undegraded': '2023-07-09T21:38:22.389536+0000', 'last_fullsized': '2023-07-09T21:38:22.389536+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.343 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.36 is not active+clean 2023-07-09T21:38:28.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390467+0000', 'last_change': '2023-07-09T21:38:22.390467+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390467+0000', 'last_undegraded': '2023-07-09T21:38:22.390467+0000', 'last_fullsized': '2023-07-09T21:38:22.390467+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.344 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.35 is not active+clean 2023-07-09T21:38:28.344 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397659+0000', 'last_change': '2023-07-09T21:38:22.397659+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397659+0000', 'last_undegraded': '2023-07-09T21:38:22.397659+0000', 'last_fullsized': '2023-07-09T21:38:22.397659+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.345 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.34 is not active+clean 2023-07-09T21:38:28.345 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390662+0000', 'last_change': '2023-07-09T21:38:22.390662+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390662+0000', 'last_undegraded': '2023-07-09T21:38:22.390662+0000', 'last_fullsized': '2023-07-09T21:38:22.390662+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.346 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.33 is not active+clean 2023-07-09T21:38:28.348 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390142+0000', 'last_change': '2023-07-09T21:38:22.390142+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390142+0000', 'last_undegraded': '2023-07-09T21:38:22.390142+0000', 'last_fullsized': '2023-07-09T21:38:22.390142+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.348 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.32 is not active+clean 2023-07-09T21:38:28.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388496+0000', 'last_change': '2023-07-09T21:38:22.388496+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388496+0000', 'last_undegraded': '2023-07-09T21:38:22.388496+0000', 'last_fullsized': '2023-07-09T21:38:22.388496+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.349 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.31 is not active+clean 2023-07-09T21:38:28.349 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388540+0000', 'last_change': '2023-07-09T21:38:22.388540+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388540+0000', 'last_undegraded': '2023-07-09T21:38:22.388540+0000', 'last_fullsized': '2023-07-09T21:38:22.388540+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.30 is not active+clean 2023-07-09T21:38:28.350 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.387903+0000', 'last_change': '2023-07-09T21:38:22.387903+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.387903+0000', 'last_undegraded': '2023-07-09T21:38:22.387903+0000', 'last_fullsized': '2023-07-09T21:38:22.387903+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:38:28.350 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2f is not active+clean 2023-07-09T21:38:28.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397203+0000', 'last_change': '2023-07-09T21:38:22.397203+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397203+0000', 'last_undegraded': '2023-07-09T21:38:22.397203+0000', 'last_fullsized': '2023-07-09T21:38:22.397203+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.351 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2e is not active+clean 2023-07-09T21:38:28.351 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.398248+0000', 'last_change': '2023-07-09T21:38:22.398248+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.398248+0000', 'last_undegraded': '2023-07-09T21:38:22.398248+0000', 'last_fullsized': '2023-07-09T21:38:22.398248+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2d is not active+clean 2023-07-09T21:38:28.352 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.398271+0000', 'last_change': '2023-07-09T21:38:22.398271+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.398271+0000', 'last_undegraded': '2023-07-09T21:38:22.398271+0000', 'last_fullsized': '2023-07-09T21:38:22.398271+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.352 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2c is not active+clean 2023-07-09T21:38:28.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388071+0000', 'last_change': '2023-07-09T21:38:22.388071+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388071+0000', 'last_undegraded': '2023-07-09T21:38:22.388071+0000', 'last_fullsized': '2023-07-09T21:38:22.388071+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:38:28.353 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2b is not active+clean 2023-07-09T21:38:28.353 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.389651+0000', 'last_change': '2023-07-09T21:38:22.389651+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.389651+0000', 'last_undegraded': '2023-07-09T21:38:22.389651+0000', 'last_fullsized': '2023-07-09T21:38:22.389651+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.354 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2a is not active+clean 2023-07-09T21:38:28.354 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.387987+0000', 'last_change': '2023-07-09T21:38:22.387987+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.387987+0000', 'last_undegraded': '2023-07-09T21:38:22.387987+0000', 'last_fullsized': '2023-07-09T21:38:22.387987+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:38:28.355 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.29 is not active+clean 2023-07-09T21:38:28.355 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390720+0000', 'last_change': '2023-07-09T21:38:22.390720+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390720+0000', 'last_undegraded': '2023-07-09T21:38:22.390720+0000', 'last_fullsized': '2023-07-09T21:38:22.390720+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:38:28.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.28 is not active+clean 2023-07-09T21:38:28.356 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388497+0000', 'last_change': '2023-07-09T21:38:22.388497+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388497+0000', 'last_undegraded': '2023-07-09T21:38:22.388497+0000', 'last_fullsized': '2023-07-09T21:38:22.388497+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.356 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.27 is not active+clean 2023-07-09T21:38:28.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.391558+0000', 'last_change': '2023-07-09T21:38:22.391558+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.391558+0000', 'last_undegraded': '2023-07-09T21:38:22.391558+0000', 'last_fullsized': '2023-07-09T21:38:22.391558+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.357 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.26 is not active+clean 2023-07-09T21:38:28.357 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.391791+0000', 'last_change': '2023-07-09T21:38:22.391791+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.391791+0000', 'last_undegraded': '2023-07-09T21:38:22.391791+0000', 'last_fullsized': '2023-07-09T21:38:22.391791+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.25 is not active+clean 2023-07-09T21:38:28.358 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394893+0000', 'last_change': '2023-07-09T21:38:22.394893+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394893+0000', 'last_undegraded': '2023-07-09T21:38:22.394893+0000', 'last_fullsized': '2023-07-09T21:38:22.394893+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.358 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.24 is not active+clean 2023-07-09T21:38:28.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394871+0000', 'last_change': '2023-07-09T21:38:22.394871+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394871+0000', 'last_undegraded': '2023-07-09T21:38:22.394871+0000', 'last_fullsized': '2023-07-09T21:38:22.394871+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.23 is not active+clean 2023-07-09T21:38:28.359 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388658+0000', 'last_change': '2023-07-09T21:38:22.388658+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388658+0000', 'last_undegraded': '2023-07-09T21:38:22.388658+0000', 'last_fullsized': '2023-07-09T21:38:22.388658+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.22 is not active+clean 2023-07-09T21:38:28.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390509+0000', 'last_change': '2023-07-09T21:38:22.390509+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390509+0000', 'last_undegraded': '2023-07-09T21:38:22.390509+0000', 'last_fullsized': '2023-07-09T21:38:22.390509+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.21 is not active+clean 2023-07-09T21:38:28.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.398927+0000', 'last_change': '2023-07-09T21:38:22.398927+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.398927+0000', 'last_undegraded': '2023-07-09T21:38:22.398927+0000', 'last_fullsized': '2023-07-09T21:38:22.398927+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.20 is not active+clean 2023-07-09T21:38:28.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394525+0000', 'last_change': '2023-07-09T21:38:22.394525+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394525+0000', 'last_undegraded': '2023-07-09T21:38:22.394525+0000', 'last_fullsized': '2023-07-09T21:38:22.394525+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:38:28.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-07-09T21:38:28.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397904+0000', 'last_change': '2023-07-09T21:38:22.397904+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397904+0000', 'last_undegraded': '2023-07-09T21:38:22.397904+0000', 'last_fullsized': '2023-07-09T21:38:22.397904+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-07-09T21:38:28.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394276+0000', 'last_change': '2023-07-09T21:38:22.394276+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394276+0000', 'last_undegraded': '2023-07-09T21:38:22.394276+0000', 'last_fullsized': '2023-07-09T21:38:22.394276+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-07-09T21:38:28.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.393740+0000', 'last_change': '2023-07-09T21:38:22.393740+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.393740+0000', 'last_undegraded': '2023-07-09T21:38:22.393740+0000', 'last_fullsized': '2023-07-09T21:38:22.393740+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:38:28.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-07-09T21:38:28.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.390036+0000', 'last_change': '2023-07-09T21:38:22.390036+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.390036+0000', 'last_undegraded': '2023-07-09T21:38:22.390036+0000', 'last_fullsized': '2023-07-09T21:38:22.390036+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-07-09T21:38:28.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.387426+0000', 'last_change': '2023-07-09T21:38:22.387426+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.387426+0000', 'last_undegraded': '2023-07-09T21:38:22.387426+0000', 'last_fullsized': '2023-07-09T21:38:22.387426+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:38:28.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-07-09T21:38:28.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.393734+0000', 'last_change': '2023-07-09T21:38:22.393734+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.393734+0000', 'last_undegraded': '2023-07-09T21:38:22.393734+0000', 'last_fullsized': '2023-07-09T21:38:22.393734+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-07-09T21:38:28.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.398078+0000', 'last_change': '2023-07-09T21:38:22.398078+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.398078+0000', 'last_undegraded': '2023-07-09T21:38:22.398078+0000', 'last_fullsized': '2023-07-09T21:38:22.398078+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-07-09T21:38:28.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388620+0000', 'last_change': '2023-07-09T21:38:22.388620+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388620+0000', 'last_undegraded': '2023-07-09T21:38:22.388620+0000', 'last_fullsized': '2023-07-09T21:38:22.388620+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:38:28.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-07-09T21:38:28.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394370+0000', 'last_change': '2023-07-09T21:38:22.394370+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394370+0000', 'last_undegraded': '2023-07-09T21:38:22.394370+0000', 'last_fullsized': '2023-07-09T21:38:22.394370+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-07-09T21:38:28.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.388830+0000', 'last_change': '2023-07-09T21:38:22.388830+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.388830+0000', 'last_undegraded': '2023-07-09T21:38:22.388830+0000', 'last_fullsized': '2023-07-09T21:38:22.388830+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:38:28.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-07-09T21:38:28.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.396646+0000', 'last_change': '2023-07-09T21:38:22.396646+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.396646+0000', 'last_undegraded': '2023-07-09T21:38:22.396646+0000', 'last_fullsized': '2023-07-09T21:38:22.396646+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-07-09T21:38:28.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394687+0000', 'last_change': '2023-07-09T21:38:22.394687+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394687+0000', 'last_undegraded': '2023-07-09T21:38:22.394687+0000', 'last_fullsized': '2023-07-09T21:38:22.394687+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-07-09T21:38:28.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394528+0000', 'last_change': '2023-07-09T21:38:22.394528+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394528+0000', 'last_undegraded': '2023-07-09T21:38:22.394528+0000', 'last_fullsized': '2023-07-09T21:38:22.394528+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-07-09T21:38:28.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.392206+0000', 'last_change': '2023-07-09T21:38:22.392206+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.392206+0000', 'last_undegraded': '2023-07-09T21:38:22.392206+0000', 'last_fullsized': '2023-07-09T21:38:22.392206+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-07-09T21:38:28.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.396618+0000', 'last_change': '2023-07-09T21:38:22.396618+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.396618+0000', 'last_undegraded': '2023-07-09T21:38:22.396618+0000', 'last_fullsized': '2023-07-09T21:38:22.396618+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-07-09T21:38:28.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.393542+0000', 'last_change': '2023-07-09T21:38:22.393542+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.393542+0000', 'last_undegraded': '2023-07-09T21:38:22.393542+0000', 'last_fullsized': '2023-07-09T21:38:22.393542+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-07-09T21:38:28.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.392686+0000', 'last_change': '2023-07-09T21:38:22.392686+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.392686+0000', 'last_undegraded': '2023-07-09T21:38:22.392686+0000', 'last_fullsized': '2023-07-09T21:38:22.392686+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:38:28.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-07-09T21:38:28.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.386855+0000', 'last_change': '2023-07-09T21:38:22.386855+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.386855+0000', 'last_undegraded': '2023-07-09T21:38:22.386855+0000', 'last_fullsized': '2023-07-09T21:38:22.386855+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:38:28.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-07-09T21:38:28.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.391275+0000', 'last_change': '2023-07-09T21:38:22.391275+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.391275+0000', 'last_undegraded': '2023-07-09T21:38:22.391275+0000', 'last_fullsized': '2023-07-09T21:38:22.391275+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-07-09T21:38:28.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395616+0000', 'last_change': '2023-07-09T21:38:22.395616+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395616+0000', 'last_undegraded': '2023-07-09T21:38:22.395616+0000', 'last_fullsized': '2023-07-09T21:38:22.395616+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-07-09T21:38:28.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397807+0000', 'last_change': '2023-07-09T21:38:22.397807+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397807+0000', 'last_undegraded': '2023-07-09T21:38:22.397807+0000', 'last_fullsized': '2023-07-09T21:38:22.397807+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-07-09T21:38:28.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395095+0000', 'last_change': '2023-07-09T21:38:22.395095+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395095+0000', 'last_undegraded': '2023-07-09T21:38:22.395095+0000', 'last_fullsized': '2023-07-09T21:38:22.395095+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-07-09T21:38:28.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395101+0000', 'last_change': '2023-07-09T21:38:22.395101+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395101+0000', 'last_undegraded': '2023-07-09T21:38:22.395101+0000', 'last_fullsized': '2023-07-09T21:38:22.395101+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:38:28.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-07-09T21:38:28.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.387305+0000', 'last_change': '2023-07-09T21:38:22.387305+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.387305+0000', 'last_undegraded': '2023-07-09T21:38:22.387305+0000', 'last_fullsized': '2023-07-09T21:38:22.387305+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:38:28.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-07-09T21:38:28.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395800+0000', 'last_change': '2023-07-09T21:38:22.395800+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395800+0000', 'last_undegraded': '2023-07-09T21:38:22.395800+0000', 'last_fullsized': '2023-07-09T21:38:22.395800+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-07-09T21:38:28.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.394033+0000', 'last_change': '2023-07-09T21:38:22.394033+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.394033+0000', 'last_undegraded': '2023-07-09T21:38:22.394033+0000', 'last_fullsized': '2023-07-09T21:38:22.394033+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:38:28.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-07-09T21:38:28.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.389315+0000', 'last_change': '2023-07-09T21:38:22.389315+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.389315+0000', 'last_undegraded': '2023-07-09T21:38:22.389315+0000', 'last_fullsized': '2023-07-09T21:38:22.389315+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:38:28.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-07-09T21:38:28.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395920+0000', 'last_change': '2023-07-09T21:38:22.395920+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395920+0000', 'last_undegraded': '2023-07-09T21:38:22.395920+0000', 'last_fullsized': '2023-07-09T21:38:22.395920+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-07-09T21:38:28.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.389121+0000', 'last_change': '2023-07-09T21:38:22.389121+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.389121+0000', 'last_undegraded': '2023-07-09T21:38:22.389121+0000', 'last_fullsized': '2023-07-09T21:38:22.389121+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:38:28.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-07-09T21:38:28.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.395787+0000', 'last_change': '2023-07-09T21:38:22.395787+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.395787+0000', 'last_undegraded': '2023-07-09T21:38:22.395787+0000', 'last_fullsized': '2023-07-09T21:38:22.395787+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.382 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-07-09T21:38:28.382 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.397768+0000', 'last_change': '2023-07-09T21:38:22.397768+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.397768+0000', 'last_undegraded': '2023-07-09T21:38:22.397768+0000', 'last_fullsized': '2023-07-09T21:38:22.397768+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:38:28.383 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-07-09T21:38:28.383 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 83, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:38:22.396207+0000', 'last_change': '2023-07-09T21:38:22.396207+0000', 'last_active': '2023-07-09T21:38:22.374951+0000', 'last_peered': '2023-07-09T21:38:22.374951+0000', 'last_clean': '2023-07-09T21:38:22.374951+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:38:22.396207+0000', 'last_undegraded': '2023-07-09T21:38:22.396207+0000', 'last_fullsized': '2023-07-09T21:38:22.396207+0000', 'mapping_epoch': 83, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 83, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'last_clean_scrub_stamp': '2023-07-09T21:38:22.374951+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:38:28.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:38:28.385 INFO:tasks.ceph.mds.b.smithi119.stderr:2023-07-09T21:38:28.379+0000 7f4ac7a4b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:38:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.523+0000 7f85f01d5640 1 Processor -- start 2023-07-09T21:38:28.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 -- start start 2023-07-09T21:38:28.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 0x7f85e806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e80b49f0 con 0x7f85e80cef80 2023-07-09T21:38:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e80b7e80 con 0x7f85e80b7ab0 2023-07-09T21:38:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85f01d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80cc8a0 con 0x7f85e80b4340 2023-07-09T21:38:28.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85edf71640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 0x7f85e806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40920/0 (socket says 172.21.15.37:40920) 2023-07-09T21:38:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 -- 172.21.15.37:0/2402620220 learned_addr learned my addr 172.21.15.37:0/2402620220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 -- 172.21.15.37:0/2402620220 >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 msgr2=0x7f85e806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 --2- 172.21.15.37:0/2402620220 >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 0x7f85e806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 -- 172.21.15.37:0/2402620220 >> v1:172.21.15.119:6789/0 conn(0x7f85e80cef80 legacy=0x7f85e80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85ee772640 1 -- 172.21.15.37:0/2402620220 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80ccb80 con 0x7f85e80b4340 2023-07-09T21:38:28.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.527+0000 7f85edf71640 1 --2- 172.21.15.37:0/2402620220 >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 0x7f85e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:28.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85ee772640 1 --2- 172.21.15.37:0/2402620220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e50 tx=0x7f85e001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15b5c8054be6fa03 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85ecf6f640 1 -- 172.21.15.37:0/2402620220 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00a58a0 con 0x7f85e80b4340 2023-07-09T21:38:28.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85ecf6f640 1 -- 172.21.15.37:0/2402620220 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00a5a00 con 0x7f85e80b4340 2023-07-09T21:38:28.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85ecf6f640 1 -- 172.21.15.37:0/2402620220 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00a5d90 con 0x7f85e80b4340 2023-07-09T21:38:28.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 -- 172.21.15.37:0/2402620220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 msgr2=0x7f85e80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 --2- 172.21.15.37:0/2402620220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009e50 tx=0x7f85e001c9e0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 -- 172.21.15.37:0/2402620220 shutdown_connections 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 --2- 172.21.15.37:0/2402620220 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80d02a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 --2- 172.21.15.37:0/2402620220 >> v2:172.21.15.119:3300/0 conn(0x7f85e80b7ab0 0x7f85e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 -- 172.21.15.37:0/2402620220 >> 172.21.15.37:0/2402620220 conn(0x7f85e8073090 msgr2=0x7f85e8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 -- 172.21.15.37:0/2402620220 shutdown_connections 2023-07-09T21:38:28.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.531+0000 7f85f01d5640 1 -- 172.21.15.37:0/2402620220 wait complete. 2023-07-09T21:38:28.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 Processor -- start 2023-07-09T21:38:28.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- start start 2023-07-09T21:38:28.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e80b7ab0 0x7f85e8147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8157420 con 0x7f85e80cef80 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e80d2b70 con 0x7f85e80b7ab0 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e8157950 con 0x7f85e80b4340 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40850/0 (socket says 172.21.15.37:40850) 2023-07-09T21:38:28.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 -- 172.21.15.37:0/4009195439 learned_addr learned my addr 172.21.15.37:0/4009195439 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85edf71640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ed770640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e80b7ab0 0x7f85e8147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 -- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 msgr2=0x7f85e80c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 -- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e80b7ab0 msgr2=0x7f85e8147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e80b7ab0 0x7f85e8147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 -- 172.21.15.37:0/4009195439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4009420 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85ee772640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f85e00af040 tx=0x7f85e0019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00b8670 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e00b87d0 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e0009b30 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e00b8b60 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e8148180 con 0x7f85e80cef80 2023-07-09T21:38:28.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.535+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e80d2d00 con 0x7f85e80cef80 2023-07-09T21:38:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.539+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85e00b8cc0 con 0x7f85e80cef80 2023-07-09T21:38:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.539+0000 7f85de7fc640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 0x7f85cc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.539+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f85e011f880 con 0x7f85e80cef80 2023-07-09T21:38:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.539+0000 7f85edf71640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 0x7f85cc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.539+0000 7f85edf71640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 0x7f85cc068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b70f0 tx=0x7f85e4008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.543+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85e00ecd20 con 0x7f85e80cef80 2023-07-09T21:38:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f85e804d7d0 con 0x7f85e80cef80 2023-07-09T21:38:28.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85de7fc640 1 -- 172.21.15.37:0/4009195439 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3229 (secure 0 0 0) 0x7f85e00f0340 con 0x7f85e80cef80 2023-07-09T21:38:28.757 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:28.757 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":983,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":85,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":335720448,"bytes_avail":772758392832,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6556}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-07-09T21:38:10.908938+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:38:28.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 msgr2=0x7f85cc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 0x7f85cc068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85e80b70f0 tx=0x7f85e4008040 comp rx=0 tx=0).stop 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 msgr2=0x7f85e80cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f85e00af040 tx=0x7f85e0019780 comp rx=0 tx=0).stop 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 shutdown_connections 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f85cc0663d0 0x7f85cc068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e80cef80 0x7f85e80cb4a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e80b7ab0 0x7f85e8147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 --2- 172.21.15.37:0/4009195439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e80b4340 0x7f85e80c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 >> 172.21.15.37:0/4009195439 conn(0x7f85e8073090 msgr2=0x7f85e80b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 shutdown_connections 2023-07-09T21:38:28.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.755+0000 7f85f01d5640 1 -- 172.21.15.37:0/4009195439 wait complete. 2023-07-09T21:38:28.779 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:38:28.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:38:28.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.919+0000 7fb0c9456640 1 Processor -- start 2023-07-09T21:38:28.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.919+0000 7fb0c9456640 1 -- start start 2023-07-09T21:38:28.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c9456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c9456640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0c40b4340 0x7fb0c40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c9456640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c40b49f0 con 0x7fb0c40cef80 2023-07-09T21:38:28.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c9456640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40b7e80 con 0x7fb0c40b4340 2023-07-09T21:38:28.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c9456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40cc8a0 con 0x7fb0c40b7ab0 2023-07-09T21:38:28.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0c40b4340 0x7fb0c40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0c40b4340 0x7fb0c40d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40210/0 (socket says 172.21.15.37:40210) 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 -- 172.21.15.37:0/3048040479 learned_addr learned my addr 172.21.15.37:0/3048040479 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0bbfff640 1 --1- 172.21.15.37:0/3048040479 >> v1:172.21.15.119:6789/0 conn(0x7fb0c40cef80 0x7fb0c40b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:44650/0 (socket says 172.21.15.37:44650) 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 -- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 msgr2=0x7fb0c406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 --2- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 -- 172.21.15.37:0/3048040479 >> v1:172.21.15.119:6789/0 conn(0x7fb0c40cef80 legacy=0x7fb0c40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.923+0000 7fb0c37fe640 1 -- 172.21.15.37:0/3048040479 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c40ccb80 con 0x7fb0c40b4340 2023-07-09T21:38:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c37fe640 1 --2- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c40d02a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009e50 tx=0x7fb0bc01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba553f41fc05db66 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c27fc640 1 -- 172.21.15.37:0/3048040479 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0a58a0 con 0x7fb0c40b4340 2023-07-09T21:38:28.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c27fc640 1 -- 172.21.15.37:0/3048040479 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0a5a00 con 0x7fb0c40b4340 2023-07-09T21:38:28.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c27fc640 1 -- 172.21.15.37:0/3048040479 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0a5d90 con 0x7fb0c40b4340 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 -- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 msgr2=0x7fb0c40d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 --2- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c40d02a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009e50 tx=0x7fb0bc01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 -- 172.21.15.37:0/3048040479 shutdown_connections 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 --2- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c40d02a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 --2- 172.21.15.37:0/3048040479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 -- 172.21.15.37:0/3048040479 >> 172.21.15.37:0/3048040479 conn(0x7fb0c4073090 msgr2=0x7fb0c4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 -- 172.21.15.37:0/3048040479 shutdown_connections 2023-07-09T21:38:28.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 -- 172.21.15.37:0/3048040479 wait complete. 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.927+0000 7fb0c9456640 1 Processor -- start 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- start start 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c40b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c414f4d0 con 0x7fb0c40cef80 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c69b0 con 0x7fb0c40b4340 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40c6c90 con 0x7fb0c40b7ab0 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40864/0 (socket says 172.21.15.37:40864) 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 -- 172.21.15.37:0/4051528274 learned_addr learned my addr 172.21.15.37:0/4051528274 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:28.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c2ffd640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0bbfff640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c40b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 -- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 msgr2=0x7fb0c40b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c40b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 -- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 msgr2=0x7fb0c414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 -- 172.21.15.37:0/4051528274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc009b30 con 0x7fb0c40cef80 2023-07-09T21:38:28.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0bbfff640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c40b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:28.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c37fe640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0af040 tx=0x7fb0bc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0b8670 con 0x7fb0c40cef80 2023-07-09T21:38:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0b87d0 con 0x7fb0c40cef80 2023-07-09T21:38:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0b8b80 con 0x7fb0c40cef80 2023-07-09T21:38:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c40c6f70 con 0x7fb0c40cef80 2023-07-09T21:38:28.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c40c5f50 con 0x7fb0c40cef80 2023-07-09T21:38:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.931+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c404d7d0 con 0x7fb0c40cef80 2023-07-09T21:38:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.935+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb0bc0b8ce0 con 0x7fb0c40cef80 2023-07-09T21:38:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.935+0000 7fb0bb7fe640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 0x7fb0a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.935+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb0bc11f690 con 0x7fb0c40cef80 2023-07-09T21:38:28.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.935+0000 7fb0c2ffd640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 0x7fb0a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.935+0000 7fb0c2ffd640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 0x7fb0a4068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009af0 tx=0x7fb0b4008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:28.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:28.939+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0bc0eca80 con 0x7fb0c40cef80 2023-07-09T21:38:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.087+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0c40cf4d0 con 0x7fb0a40663a0 2023-07-09T21:38:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.099+0000 7fb0bb7fe640 1 -- 172.21.15.37:0/4051528274 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311649 (secure 0 0 0) 0x7fb0b40119b0 con 0x7fb0a40663a0 2023-07-09T21:38:29.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:29.104 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 msgr2=0x7fb0a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 0x7fb0a4068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009af0 tx=0x7fb0b4008040 comp rx=0 tx=0).stop 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 msgr2=0x7fb0c40b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc0af040 tx=0x7fb0bc019780 comp rx=0 tx=0).stop 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 shutdown_connections 2023-07-09T21:38:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb0a40663a0 0x7fb0a4068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0c40cef80 0x7fb0c40b3a30 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0c40b7ab0 0x7fb0c40b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 --2- 172.21.15.37:0/4051528274 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0c40b4340 0x7fb0c414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 >> 172.21.15.37:0/4051528274 conn(0x7fb0c4073090 msgr2=0x7fb0c4158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 shutdown_connections 2023-07-09T21:38:29.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:29.103+0000 7fb0c9456640 1 -- 172.21.15.37:0/4051528274 wait complete. 2023-07-09T21:38:29.123 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:38:28.913040+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328168,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754646552,"statfs":{"total":773094113280,"available":772758069248,"internally_reserved":0,"allocated":9478144,"data_stored":5309436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.526826"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002593+0000","last_change":"2023-07-09T21:38:23.431545+0000","last_active":"2023-07-09T21:38:25.002593+0000","last_peered":"2023-07-09T21:38:25.002593+0000","last_clean":"2023-07-09T21:38:25.002593+0000","last_became_active":"2023-07-09T21:38:23.431238+0000","last_became_peered":"2023-07-09T21:38:23.431238+0000","last_unstale":"2023-07-09T21:38:25.002593+0000","last_undegraded":"2023-07-09T21:38:25.002593+0000","last_fullsized":"2023-07-09T21:38:25.002593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:04:52.980358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002523+0000","last_change":"2023-07-09T21:38:23.425291+0000","last_active":"2023-07-09T21:38:25.002523+0000","last_peered":"2023-07-09T21:38:25.002523+0000","last_clean":"2023-07-09T21:38:25.002523+0000","last_became_active":"2023-07-09T21:38:23.424857+0000","last_became_peered":"2023-07-09T21:38:23.424857+0000","last_unstale":"2023-07-09T21:38:25.002523+0000","last_undegraded":"2023-07-09T21:38:25.002523+0000","last_fullsized":"2023-07-09T21:38:25.002523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:29.188355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509327+0000","last_change":"2023-07-09T21:38:23.430767+0000","last_active":"2023-07-09T21:38:25.509327+0000","last_peered":"2023-07-09T21:38:25.509327+0000","last_clean":"2023-07-09T21:38:25.509327+0000","last_became_active":"2023-07-09T21:38:23.429907+0000","last_became_peered":"2023-07-09T21:38:23.429907+0000","last_unstale":"2023-07-09T21:38:25.509327+0000","last_undegraded":"2023-07-09T21:38:25.509327+0000","last_fullsized":"2023-07-09T21:38:25.509327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:10.942736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418856+0000","last_change":"2023-07-09T21:38:23.440557+0000","last_active":"2023-07-09T21:38:24.418856+0000","last_peered":"2023-07-09T21:38:24.418856+0000","last_clean":"2023-07-09T21:38:24.418856+0000","last_became_active":"2023-07-09T21:38:23.440252+0000","last_became_peered":"2023-07-09T21:38:23.440252+0000","last_unstale":"2023-07-09T21:38:24.418856+0000","last_undegraded":"2023-07-09T21:38:24.418856+0000","last_fullsized":"2023-07-09T21:38:24.418856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:55.369040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703188+0000","last_change":"2023-07-09T21:38:23.448626+0000","last_active":"2023-07-09T21:38:24.703188+0000","last_peered":"2023-07-09T21:38:24.703188+0000","last_clean":"2023-07-09T21:38:24.703188+0000","last_became_active":"2023-07-09T21:38:23.446298+0000","last_became_peered":"2023-07-09T21:38:23.446298+0000","last_unstale":"2023-07-09T21:38:24.703188+0000","last_undegraded":"2023-07-09T21:38:24.703188+0000","last_fullsized":"2023-07-09T21:38:24.703188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:39.901592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503112+0000","last_change":"2023-07-09T21:38:23.428720+0000","last_active":"2023-07-09T21:38:25.503112+0000","last_peered":"2023-07-09T21:38:25.503112+0000","last_clean":"2023-07-09T21:38:25.503112+0000","last_became_active":"2023-07-09T21:38:23.428426+0000","last_became_peered":"2023-07-09T21:38:23.428426+0000","last_unstale":"2023-07-09T21:38:25.503112+0000","last_undegraded":"2023-07-09T21:38:25.503112+0000","last_fullsized":"2023-07-09T21:38:25.503112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:28.109202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503348+0000","last_change":"2023-07-09T21:38:23.420292+0000","last_active":"2023-07-09T21:38:25.503348+0000","last_peered":"2023-07-09T21:38:25.503348+0000","last_clean":"2023-07-09T21:38:25.503348+0000","last_became_active":"2023-07-09T21:38:23.419986+0000","last_became_peered":"2023-07-09T21:38:23.419986+0000","last_unstale":"2023-07-09T21:38:25.503348+0000","last_undegraded":"2023-07-09T21:38:25.503348+0000","last_fullsized":"2023-07-09T21:38:25.503348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:09:21.705736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417674+0000","last_change":"2023-07-09T21:38:23.430121+0000","last_active":"2023-07-09T21:38:24.417674+0000","last_peered":"2023-07-09T21:38:24.417674+0000","last_clean":"2023-07-09T21:38:24.417674+0000","last_became_active":"2023-07-09T21:38:23.429715+0000","last_became_peered":"2023-07-09T21:38:23.429715+0000","last_unstale":"2023-07-09T21:38:24.417674+0000","last_undegraded":"2023-07-09T21:38:24.417674+0000","last_fullsized":"2023-07-09T21:38:24.417674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:43.291189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509897+0000","last_change":"2023-07-09T21:38:23.444103+0000","last_active":"2023-07-09T21:38:25.509897+0000","last_peered":"2023-07-09T21:38:25.509897+0000","last_clean":"2023-07-09T21:38:25.509897+0000","last_became_active":"2023-07-09T21:38:23.443623+0000","last_became_peered":"2023-07-09T21:38:23.443623+0000","last_unstale":"2023-07-09T21:38:25.509897+0000","last_undegraded":"2023-07-09T21:38:25.509897+0000","last_fullsized":"2023-07-09T21:38:25.509897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:49.908589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509504+0000","last_change":"2023-07-09T21:38:23.429596+0000","last_active":"2023-07-09T21:38:25.509504+0000","last_peered":"2023-07-09T21:38:25.509504+0000","last_clean":"2023-07-09T21:38:25.509504+0000","last_became_active":"2023-07-09T21:38:23.429292+0000","last_became_peered":"2023-07-09T21:38:23.429292+0000","last_unstale":"2023-07-09T21:38:25.509504+0000","last_undegraded":"2023-07-09T21:38:25.509504+0000","last_fullsized":"2023-07-09T21:38:25.509504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:29:10.441269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418489+0000","last_change":"2023-07-09T21:38:23.443645+0000","last_active":"2023-07-09T21:38:24.418489+0000","last_peered":"2023-07-09T21:38:24.418489+0000","last_clean":"2023-07-09T21:38:24.418489+0000","last_became_active":"2023-07-09T21:38:23.443274+0000","last_became_peered":"2023-07-09T21:38:23.443274+0000","last_unstale":"2023-07-09T21:38:24.418489+0000","last_undegraded":"2023-07-09T21:38:24.418489+0000","last_fullsized":"2023-07-09T21:38:24.418489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:33:23.024101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418310+0000","last_change":"2023-07-09T21:38:23.428927+0000","last_active":"2023-07-09T21:38:24.418310+0000","last_peered":"2023-07-09T21:38:24.418310+0000","last_clean":"2023-07-09T21:38:24.418310+0000","last_became_active":"2023-07-09T21:38:23.428628+0000","last_became_peered":"2023-07-09T21:38:23.428628+0000","last_unstale":"2023-07-09T21:38:24.418310+0000","last_undegraded":"2023-07-09T21:38:24.418310+0000","last_fullsized":"2023-07-09T21:38:24.418310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:41:35.940667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417726+0000","last_change":"2023-07-09T21:38:23.444466+0000","last_active":"2023-07-09T21:38:24.417726+0000","last_peered":"2023-07-09T21:38:24.417726+0000","last_clean":"2023-07-09T21:38:24.417726+0000","last_became_active":"2023-07-09T21:38:23.444166+0000","last_became_peered":"2023-07-09T21:38:23.444166+0000","last_unstale":"2023-07-09T21:38:24.417726+0000","last_undegraded":"2023-07-09T21:38:24.417726+0000","last_fullsized":"2023-07-09T21:38:24.417726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:22:04.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509738+0000","last_change":"2023-07-09T21:38:23.431257+0000","last_active":"2023-07-09T21:38:25.509738+0000","last_peered":"2023-07-09T21:38:25.509738+0000","last_clean":"2023-07-09T21:38:25.509738+0000","last_became_active":"2023-07-09T21:38:23.430963+0000","last_became_peered":"2023-07-09T21:38:23.430963+0000","last_unstale":"2023-07-09T21:38:25.509738+0000","last_undegraded":"2023-07-09T21:38:25.509738+0000","last_fullsized":"2023-07-09T21:38:25.509738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:54.097641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509425+0000","last_change":"2023-07-09T21:38:23.436135+0000","last_active":"2023-07-09T21:38:25.509425+0000","last_peered":"2023-07-09T21:38:25.509425+0000","last_clean":"2023-07-09T21:38:25.509425+0000","last_became_active":"2023-07-09T21:38:23.435817+0000","last_became_peered":"2023-07-09T21:38:23.435817+0000","last_unstale":"2023-07-09T21:38:25.509425+0000","last_undegraded":"2023-07-09T21:38:25.509425+0000","last_fullsized":"2023-07-09T21:38:25.509425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:24.199914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502529+0000","last_change":"2023-07-09T21:38:23.430753+0000","last_active":"2023-07-09T21:38:25.502529+0000","last_peered":"2023-07-09T21:38:25.502529+0000","last_clean":"2023-07-09T21:38:25.502529+0000","last_became_active":"2023-07-09T21:38:23.430476+0000","last_became_peered":"2023-07-09T21:38:23.430476+0000","last_unstale":"2023-07-09T21:38:25.502529+0000","last_undegraded":"2023-07-09T21:38:25.502529+0000","last_fullsized":"2023-07-09T21:38:25.502529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:00.538245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002633+0000","last_change":"2023-07-09T21:38:23.437952+0000","last_active":"2023-07-09T21:38:25.002633+0000","last_peered":"2023-07-09T21:38:25.002633+0000","last_clean":"2023-07-09T21:38:25.002633+0000","last_became_active":"2023-07-09T21:38:23.437611+0000","last_became_peered":"2023-07-09T21:38:23.437611+0000","last_unstale":"2023-07-09T21:38:25.002633+0000","last_undegraded":"2023-07-09T21:38:25.002633+0000","last_fullsized":"2023-07-09T21:38:25.002633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:25.638838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418472+0000","last_change":"2023-07-09T21:38:23.441353+0000","last_active":"2023-07-09T21:38:24.418472+0000","last_peered":"2023-07-09T21:38:24.418472+0000","last_clean":"2023-07-09T21:38:24.418472+0000","last_became_active":"2023-07-09T21:38:23.441052+0000","last_became_peered":"2023-07-09T21:38:23.441052+0000","last_unstale":"2023-07-09T21:38:24.418472+0000","last_undegraded":"2023-07-09T21:38:24.418472+0000","last_fullsized":"2023-07-09T21:38:24.418472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:20.394214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703262+0000","last_change":"2023-07-09T21:38:23.428639+0000","last_active":"2023-07-09T21:38:24.703262+0000","last_peered":"2023-07-09T21:38:24.703262+0000","last_clean":"2023-07-09T21:38:24.703262+0000","last_became_active":"2023-07-09T21:38:23.428369+0000","last_became_peered":"2023-07-09T21:38:23.428369+0000","last_unstale":"2023-07-09T21:38:24.703262+0000","last_undegraded":"2023-07-09T21:38:24.703262+0000","last_fullsized":"2023-07-09T21:38:24.703262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:36.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408946+0000","last_change":"2023-07-09T21:38:23.428199+0000","last_active":"2023-07-09T21:38:24.408946+0000","last_peered":"2023-07-09T21:38:24.408946+0000","last_clean":"2023-07-09T21:38:24.408946+0000","last_became_active":"2023-07-09T21:38:23.427904+0000","last_became_peered":"2023-07-09T21:38:23.427904+0000","last_unstale":"2023-07-09T21:38:24.408946+0000","last_undegraded":"2023-07-09T21:38:24.408946+0000","last_fullsized":"2023-07-09T21:38:24.408946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:33.695766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418342+0000","last_change":"2023-07-09T21:38:23.429406+0000","last_active":"2023-07-09T21:38:24.418342+0000","last_peered":"2023-07-09T21:38:24.418342+0000","last_clean":"2023-07-09T21:38:24.418342+0000","last_became_active":"2023-07-09T21:38:23.429132+0000","last_became_peered":"2023-07-09T21:38:23.429132+0000","last_unstale":"2023-07-09T21:38:24.418342+0000","last_undegraded":"2023-07-09T21:38:24.418342+0000","last_fullsized":"2023-07-09T21:38:24.418342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:42.750239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408715+0000","last_change":"2023-07-09T21:38:23.428740+0000","last_active":"2023-07-09T21:38:24.408715+0000","last_peered":"2023-07-09T21:38:24.408715+0000","last_clean":"2023-07-09T21:38:24.408715+0000","last_became_active":"2023-07-09T21:38:23.428259+0000","last_became_peered":"2023-07-09T21:38:23.428259+0000","last_unstale":"2023-07-09T21:38:24.408715+0000","last_undegraded":"2023-07-09T21:38:24.408715+0000","last_fullsized":"2023-07-09T21:38:24.408715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:28.109202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408632+0000","last_change":"2023-07-09T21:38:23.426556+0000","last_active":"2023-07-09T21:38:24.408632+0000","last_peered":"2023-07-09T21:38:24.408632+0000","last_clean":"2023-07-09T21:38:24.408632+0000","last_became_active":"2023-07-09T21:38:23.426194+0000","last_became_peered":"2023-07-09T21:38:23.426194+0000","last_unstale":"2023-07-09T21:38:24.408632+0000","last_undegraded":"2023-07-09T21:38:24.408632+0000","last_fullsized":"2023-07-09T21:38:24.408632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.645581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509219+0000","last_change":"2023-07-09T21:38:23.432412+0000","last_active":"2023-07-09T21:38:25.509219+0000","last_peered":"2023-07-09T21:38:25.509219+0000","last_clean":"2023-07-09T21:38:25.509219+0000","last_became_active":"2023-07-09T21:38:23.432141+0000","last_became_peered":"2023-07-09T21:38:23.432141+0000","last_unstale":"2023-07-09T21:38:25.509219+0000","last_undegraded":"2023-07-09T21:38:25.509219+0000","last_fullsized":"2023-07-09T21:38:25.509219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:44.387469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418697+0000","last_change":"2023-07-09T21:38:23.436038+0000","last_active":"2023-07-09T21:38:24.418697+0000","last_peered":"2023-07-09T21:38:24.418697+0000","last_clean":"2023-07-09T21:38:24.418697+0000","last_became_active":"2023-07-09T21:38:23.435739+0000","last_became_peered":"2023-07-09T21:38:23.435739+0000","last_unstale":"2023-07-09T21:38:24.418697+0000","last_undegraded":"2023-07-09T21:38:24.418697+0000","last_fullsized":"2023-07-09T21:38:24.418697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418489+0000","last_change":"2023-07-09T21:38:23.435368+0000","last_active":"2023-07-09T21:38:24.418489+0000","last_peered":"2023-07-09T21:38:24.418489+0000","last_clean":"2023-07-09T21:38:24.418489+0000","last_became_active":"2023-07-09T21:38:23.435083+0000","last_became_peered":"2023-07-09T21:38:23.435083+0000","last_unstale":"2023-07-09T21:38:24.418489+0000","last_undegraded":"2023-07-09T21:38:24.418489+0000","last_fullsized":"2023-07-09T21:38:24.418489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:30:41.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418548+0000","last_change":"2023-07-09T21:38:23.443362+0000","last_active":"2023-07-09T21:38:24.418548+0000","last_peered":"2023-07-09T21:38:24.418548+0000","last_clean":"2023-07-09T21:38:24.418548+0000","last_became_active":"2023-07-09T21:38:23.442929+0000","last_became_peered":"2023-07-09T21:38:23.442929+0000","last_unstale":"2023-07-09T21:38:24.418548+0000","last_undegraded":"2023-07-09T21:38:24.418548+0000","last_fullsized":"2023-07-09T21:38:24.418548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:27:05.169840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002247+0000","last_change":"2023-07-09T21:38:23.419824+0000","last_active":"2023-07-09T21:38:25.002247+0000","last_peered":"2023-07-09T21:38:25.002247+0000","last_clean":"2023-07-09T21:38:25.002247+0000","last_became_active":"2023-07-09T21:38:23.419519+0000","last_became_peered":"2023-07-09T21:38:23.419519+0000","last_unstale":"2023-07-09T21:38:25.002247+0000","last_undegraded":"2023-07-09T21:38:25.002247+0000","last_fullsized":"2023-07-09T21:38:25.002247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:17.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509378+0000","last_change":"2023-07-09T21:38:23.437730+0000","last_active":"2023-07-09T21:38:25.509378+0000","last_peered":"2023-07-09T21:38:25.509378+0000","last_clean":"2023-07-09T21:38:25.509378+0000","last_became_active":"2023-07-09T21:38:23.437403+0000","last_became_peered":"2023-07-09T21:38:23.437403+0000","last_unstale":"2023-07-09T21:38:25.509378+0000","last_undegraded":"2023-07-09T21:38:25.509378+0000","last_fullsized":"2023-07-09T21:38:25.509378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:19:20.272670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417811+0000","last_change":"2023-07-09T21:38:23.434277+0000","last_active":"2023-07-09T21:38:24.417811+0000","last_peered":"2023-07-09T21:38:24.417811+0000","last_clean":"2023-07-09T21:38:24.417811+0000","last_became_active":"2023-07-09T21:38:23.433981+0000","last_became_peered":"2023-07-09T21:38:23.433981+0000","last_unstale":"2023-07-09T21:38:24.417811+0000","last_undegraded":"2023-07-09T21:38:24.417811+0000","last_fullsized":"2023-07-09T21:38:24.417811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:05.175538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417896+0000","last_change":"2023-07-09T21:38:23.434948+0000","last_active":"2023-07-09T21:38:24.417896+0000","last_peered":"2023-07-09T21:38:24.417896+0000","last_clean":"2023-07-09T21:38:24.417896+0000","last_became_active":"2023-07-09T21:38:23.434612+0000","last_became_peered":"2023-07-09T21:38:23.434612+0000","last_unstale":"2023-07-09T21:38:24.417896+0000","last_undegraded":"2023-07-09T21:38:24.417896+0000","last_fullsized":"2023-07-09T21:38:24.417896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:17:11.017658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502723+0000","last_change":"2023-07-09T21:38:23.428144+0000","last_active":"2023-07-09T21:38:25.502723+0000","last_peered":"2023-07-09T21:38:25.502723+0000","last_clean":"2023-07-09T21:38:25.502723+0000","last_became_active":"2023-07-09T21:38:23.427849+0000","last_became_peered":"2023-07-09T21:38:23.427849+0000","last_unstale":"2023-07-09T21:38:25.502723+0000","last_undegraded":"2023-07-09T21:38:25.502723+0000","last_fullsized":"2023-07-09T21:38:25.502723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.645581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703288+0000","last_change":"2023-07-09T21:38:23.428094+0000","last_active":"2023-07-09T21:38:24.703288+0000","last_peered":"2023-07-09T21:38:24.703288+0000","last_clean":"2023-07-09T21:38:24.703288+0000","last_became_active":"2023-07-09T21:38:23.427756+0000","last_became_peered":"2023-07-09T21:38:23.427756+0000","last_unstale":"2023-07-09T21:38:24.703288+0000","last_undegraded":"2023-07-09T21:38:24.703288+0000","last_fullsized":"2023-07-09T21:38:24.703288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:19.294360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"84'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002750+0000","last_change":"2023-07-09T21:38:22.408788+0000","last_active":"2023-07-09T21:38:25.002750+0000","last_peered":"2023-07-09T21:38:25.002750+0000","last_clean":"2023-07-09T21:38:25.002750+0000","last_became_active":"2023-07-09T21:38:22.408319+0000","last_became_peered":"2023-07-09T21:38:22.408319+0000","last_unstale":"2023-07-09T21:38:25.002750+0000","last_undegraded":"2023-07-09T21:38:25.002750+0000","last_fullsized":"2023-07-09T21:38:25.002750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:17.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418654+0000","last_change":"2023-07-09T21:38:23.450382+0000","last_active":"2023-07-09T21:38:24.418654+0000","last_peered":"2023-07-09T21:38:24.418654+0000","last_clean":"2023-07-09T21:38:24.418654+0000","last_became_active":"2023-07-09T21:38:23.449967+0000","last_became_peered":"2023-07-09T21:38:23.449967+0000","last_unstale":"2023-07-09T21:38:24.418654+0000","last_undegraded":"2023-07-09T21:38:24.418654+0000","last_fullsized":"2023-07-09T21:38:24.418654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:08.406933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503470+0000","last_change":"2023-07-09T21:38:22.408871+0000","last_active":"2023-07-09T21:38:25.503470+0000","last_peered":"2023-07-09T21:38:25.503470+0000","last_clean":"2023-07-09T21:38:25.503470+0000","last_became_active":"2023-07-09T21:38:22.408396+0000","last_became_peered":"2023-07-09T21:38:22.408396+0000","last_unstale":"2023-07-09T21:38:25.503470+0000","last_undegraded":"2023-07-09T21:38:25.503470+0000","last_fullsized":"2023-07-09T21:38:25.503470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:45.915299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503381+0000","last_change":"2023-07-09T21:38:23.423124+0000","last_active":"2023-07-09T21:38:25.503381+0000","last_peered":"2023-07-09T21:38:25.503381+0000","last_clean":"2023-07-09T21:38:25.503381+0000","last_became_active":"2023-07-09T21:38:23.422791+0000","last_became_peered":"2023-07-09T21:38:23.422791+0000","last_unstale":"2023-07-09T21:38:25.503381+0000","last_undegraded":"2023-07-09T21:38:25.503381+0000","last_fullsized":"2023-07-09T21:38:25.503381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:33.695766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503516+0000","last_change":"2023-07-09T21:38:22.403317+0000","last_active":"2023-07-09T21:38:25.503516+0000","last_peered":"2023-07-09T21:38:25.503516+0000","last_clean":"2023-07-09T21:38:25.503516+0000","last_became_active":"2023-07-09T21:38:22.402972+0000","last_became_peered":"2023-07-09T21:38:22.402972+0000","last_unstale":"2023-07-09T21:38:25.503516+0000","last_undegraded":"2023-07-09T21:38:25.503516+0000","last_fullsized":"2023-07-09T21:38:25.503516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:58.153388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509826+0000","last_change":"2023-07-09T21:38:23.430769+0000","last_active":"2023-07-09T21:38:25.509826+0000","last_peered":"2023-07-09T21:38:25.509826+0000","last_clean":"2023-07-09T21:38:25.509826+0000","last_became_active":"2023-07-09T21:38:23.429870+0000","last_became_peered":"2023-07-09T21:38:23.429870+0000","last_unstale":"2023-07-09T21:38:25.509826+0000","last_undegraded":"2023-07-09T21:38:25.509826+0000","last_fullsized":"2023-07-09T21:38:25.509826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:36.006742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503509+0000","last_change":"2023-07-09T21:38:22.398622+0000","last_active":"2023-07-09T21:38:25.503509+0000","last_peered":"2023-07-09T21:38:25.503509+0000","last_clean":"2023-07-09T21:38:25.503509+0000","last_became_active":"2023-07-09T21:38:22.398344+0000","last_became_peered":"2023-07-09T21:38:22.398344+0000","last_unstale":"2023-07-09T21:38:25.503509+0000","last_undegraded":"2023-07-09T21:38:25.503509+0000","last_fullsized":"2023-07-09T21:38:25.503509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:00.028333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502550+0000","last_change":"2023-07-09T21:38:23.416207+0000","last_active":"2023-07-09T21:38:25.502550+0000","last_peered":"2023-07-09T21:38:25.502550+0000","last_clean":"2023-07-09T21:38:25.502550+0000","last_became_active":"2023-07-09T21:38:23.415916+0000","last_became_peered":"2023-07-09T21:38:23.415916+0000","last_unstale":"2023-07-09T21:38:25.502550+0000","last_undegraded":"2023-07-09T21:38:25.502550+0000","last_fullsized":"2023-07-09T21:38:25.502550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:19.395352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408989+0000","last_change":"2023-07-09T21:38:22.396887+0000","last_active":"2023-07-09T21:38:24.408989+0000","last_peered":"2023-07-09T21:38:24.408989+0000","last_clean":"2023-07-09T21:38:24.408989+0000","last_became_active":"2023-07-09T21:38:22.396575+0000","last_became_peered":"2023-07-09T21:38:22.396575+0000","last_unstale":"2023-07-09T21:38:24.408989+0000","last_undegraded":"2023-07-09T21:38:24.408989+0000","last_fullsized":"2023-07-09T21:38:24.408989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:58.153388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002112+0000","last_change":"2023-07-09T21:38:23.438190+0000","last_active":"2023-07-09T21:38:25.002112+0000","last_peered":"2023-07-09T21:38:25.002112+0000","last_clean":"2023-07-09T21:38:25.002112+0000","last_became_active":"2023-07-09T21:38:23.437560+0000","last_became_peered":"2023-07-09T21:38:23.437560+0000","last_unstale":"2023-07-09T21:38:25.002112+0000","last_undegraded":"2023-07-09T21:38:25.002112+0000","last_fullsized":"2023-07-09T21:38:25.002112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:54:26.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408671+0000","last_change":"2023-07-09T21:38:22.394044+0000","last_active":"2023-07-09T21:38:24.408671+0000","last_peered":"2023-07-09T21:38:24.408671+0000","last_clean":"2023-07-09T21:38:24.408671+0000","last_became_active":"2023-07-09T21:38:22.393668+0000","last_became_peered":"2023-07-09T21:38:22.393668+0000","last_unstale":"2023-07-09T21:38:24.408671+0000","last_undegraded":"2023-07-09T21:38:24.408671+0000","last_fullsized":"2023-07-09T21:38:24.408671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:58:56.372513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703018+0000","last_change":"2023-07-09T21:38:23.441837+0000","last_active":"2023-07-09T21:38:24.703018+0000","last_peered":"2023-07-09T21:38:24.703018+0000","last_clean":"2023-07-09T21:38:24.703018+0000","last_became_active":"2023-07-09T21:38:23.433068+0000","last_became_peered":"2023-07-09T21:38:23.433068+0000","last_unstale":"2023-07-09T21:38:24.703018+0000","last_undegraded":"2023-07-09T21:38:24.703018+0000","last_fullsized":"2023-07-09T21:38:24.703018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:26.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408766+0000","last_change":"2023-07-09T21:38:22.399971+0000","last_active":"2023-07-09T21:38:24.408766+0000","last_peered":"2023-07-09T21:38:24.408766+0000","last_clean":"2023-07-09T21:38:24.408766+0000","last_became_active":"2023-07-09T21:38:22.396590+0000","last_became_peered":"2023-07-09T21:38:22.396590+0000","last_unstale":"2023-07-09T21:38:24.408766+0000","last_undegraded":"2023-07-09T21:38:24.408766+0000","last_fullsized":"2023-07-09T21:38:24.408766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:52.375061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408898+0000","last_change":"2023-07-09T21:38:23.431598+0000","last_active":"2023-07-09T21:38:24.408898+0000","last_peered":"2023-07-09T21:38:24.408898+0000","last_clean":"2023-07-09T21:38:24.408898+0000","last_became_active":"2023-07-09T21:38:23.431308+0000","last_became_peered":"2023-07-09T21:38:23.431308+0000","last_unstale":"2023-07-09T21:38:24.408898+0000","last_undegraded":"2023-07-09T21:38:24.408898+0000","last_fullsized":"2023-07-09T21:38:24.408898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:16.656065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703035+0000","last_change":"2023-07-09T21:38:22.411514+0000","last_active":"2023-07-09T21:38:24.703035+0000","last_peered":"2023-07-09T21:38:24.703035+0000","last_clean":"2023-07-09T21:38:24.703035+0000","last_became_active":"2023-07-09T21:38:22.411169+0000","last_became_peered":"2023-07-09T21:38:22.411169+0000","last_unstale":"2023-07-09T21:38:24.703035+0000","last_undegraded":"2023-07-09T21:38:24.703035+0000","last_fullsized":"2023-07-09T21:38:24.703035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:24:00.884788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002296+0000","last_change":"2023-07-09T21:38:23.415514+0000","last_active":"2023-07-09T21:38:25.002296+0000","last_peered":"2023-07-09T21:38:25.002296+0000","last_clean":"2023-07-09T21:38:25.002296+0000","last_became_active":"2023-07-09T21:38:23.415210+0000","last_became_peered":"2023-07-09T21:38:23.415210+0000","last_unstale":"2023-07-09T21:38:25.002296+0000","last_undegraded":"2023-07-09T21:38:25.002296+0000","last_fullsized":"2023-07-09T21:38:25.002296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:36.481451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509972+0000","last_change":"2023-07-09T21:38:22.408707+0000","last_active":"2023-07-09T21:38:25.509972+0000","last_peered":"2023-07-09T21:38:25.509972+0000","last_clean":"2023-07-09T21:38:25.509972+0000","last_became_active":"2023-07-09T21:38:22.408415+0000","last_became_peered":"2023-07-09T21:38:22.408415+0000","last_unstale":"2023-07-09T21:38:25.509972+0000","last_undegraded":"2023-07-09T21:38:25.509972+0000","last_fullsized":"2023-07-09T21:38:25.509972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:20.860977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408945+0000","last_change":"2023-07-09T21:38:23.424091+0000","last_active":"2023-07-09T21:38:24.408945+0000","last_peered":"2023-07-09T21:38:24.408945+0000","last_clean":"2023-07-09T21:38:24.408945+0000","last_became_active":"2023-07-09T21:38:23.423483+0000","last_became_peered":"2023-07-09T21:38:23.423483+0000","last_unstale":"2023-07-09T21:38:24.408945+0000","last_undegraded":"2023-07-09T21:38:24.408945+0000","last_fullsized":"2023-07-09T21:38:24.408945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:46.923467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418895+0000","last_change":"2023-07-09T21:38:22.413038+0000","last_active":"2023-07-09T21:38:24.418895+0000","last_peered":"2023-07-09T21:38:24.418895+0000","last_clean":"2023-07-09T21:38:24.418895+0000","last_became_active":"2023-07-09T21:38:22.412805+0000","last_became_peered":"2023-07-09T21:38:22.412805+0000","last_unstale":"2023-07-09T21:38:24.418895+0000","last_undegraded":"2023-07-09T21:38:24.418895+0000","last_fullsized":"2023-07-09T21:38:24.418895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:08.407797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703284+0000","last_change":"2023-07-09T21:38:23.441805+0000","last_active":"2023-07-09T21:38:24.703284+0000","last_peered":"2023-07-09T21:38:24.703284+0000","last_clean":"2023-07-09T21:38:24.703284+0000","last_became_active":"2023-07-09T21:38:23.441434+0000","last_became_peered":"2023-07-09T21:38:23.441434+0000","last_unstale":"2023-07-09T21:38:24.703284+0000","last_undegraded":"2023-07-09T21:38:24.703284+0000","last_fullsized":"2023-07-09T21:38:24.703284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:55.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"84'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509549+0000","last_change":"2023-07-09T21:38:22.403101+0000","last_active":"2023-07-09T21:38:25.509549+0000","last_peered":"2023-07-09T21:38:25.509549+0000","last_clean":"2023-07-09T21:38:25.509549+0000","last_became_active":"2023-07-09T21:38:22.402419+0000","last_became_peered":"2023-07-09T21:38:22.402419+0000","last_unstale":"2023-07-09T21:38:25.509549+0000","last_undegraded":"2023-07-09T21:38:25.509549+0000","last_fullsized":"2023-07-09T21:38:25.509549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:58.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418983+0000","last_change":"2023-07-09T21:38:23.443104+0000","last_active":"2023-07-09T21:38:24.418983+0000","last_peered":"2023-07-09T21:38:24.418983+0000","last_clean":"2023-07-09T21:38:24.418983+0000","last_became_active":"2023-07-09T21:38:23.442799+0000","last_became_peered":"2023-07-09T21:38:23.442799+0000","last_unstale":"2023-07-09T21:38:24.418983+0000","last_undegraded":"2023-07-09T21:38:24.418983+0000","last_fullsized":"2023-07-09T21:38:24.418983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:41:37.374157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002579+0000","last_change":"2023-07-09T21:38:22.408024+0000","last_active":"2023-07-09T21:38:25.002579+0000","last_peered":"2023-07-09T21:38:25.002579+0000","last_clean":"2023-07-09T21:38:25.002579+0000","last_became_active":"2023-07-09T21:38:22.407723+0000","last_became_peered":"2023-07-09T21:38:22.407723+0000","last_unstale":"2023-07-09T21:38:25.002579+0000","last_undegraded":"2023-07-09T21:38:25.002579+0000","last_fullsized":"2023-07-09T21:38:25.002579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:13:03.659554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417756+0000","last_change":"2023-07-09T21:38:23.435371+0000","last_active":"2023-07-09T21:38:24.417756+0000","last_peered":"2023-07-09T21:38:24.417756+0000","last_clean":"2023-07-09T21:38:24.417756+0000","last_became_active":"2023-07-09T21:38:23.435085+0000","last_became_peered":"2023-07-09T21:38:23.435085+0000","last_unstale":"2023-07-09T21:38:24.417756+0000","last_undegraded":"2023-07-09T21:38:24.417756+0000","last_fullsized":"2023-07-09T21:38:24.417756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:58.533786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509278+0000","last_change":"2023-07-09T21:38:22.404352+0000","last_active":"2023-07-09T21:38:25.509278+0000","last_peered":"2023-07-09T21:38:25.509278+0000","last_clean":"2023-07-09T21:38:25.509278+0000","last_became_active":"2023-07-09T21:38:22.404072+0000","last_became_peered":"2023-07-09T21:38:22.404072+0000","last_unstale":"2023-07-09T21:38:25.509278+0000","last_undegraded":"2023-07-09T21:38:25.509278+0000","last_fullsized":"2023-07-09T21:38:25.509278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:22:10.975891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417598+0000","last_change":"2023-07-09T21:38:23.429991+0000","last_active":"2023-07-09T21:38:24.417598+0000","last_peered":"2023-07-09T21:38:24.417598+0000","last_clean":"2023-07-09T21:38:24.417598+0000","last_became_active":"2023-07-09T21:38:23.429694+0000","last_became_peered":"2023-07-09T21:38:23.429694+0000","last_unstale":"2023-07-09T21:38:24.417598+0000","last_undegraded":"2023-07-09T21:38:24.417598+0000","last_fullsized":"2023-07-09T21:38:24.417598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:29.283838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417937+0000","last_change":"2023-07-09T21:38:22.403402+0000","last_active":"2023-07-09T21:38:24.417937+0000","last_peered":"2023-07-09T21:38:24.417937+0000","last_clean":"2023-07-09T21:38:24.417937+0000","last_became_active":"2023-07-09T21:38:22.403067+0000","last_became_peered":"2023-07-09T21:38:22.403067+0000","last_unstale":"2023-07-09T21:38:24.417937+0000","last_undegraded":"2023-07-09T21:38:24.417937+0000","last_fullsized":"2023-07-09T21:38:24.417937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:17:45.937494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703149+0000","last_change":"2023-07-09T21:38:23.431914+0000","last_active":"2023-07-09T21:38:24.703149+0000","last_peered":"2023-07-09T21:38:24.703149+0000","last_clean":"2023-07-09T21:38:24.703149+0000","last_became_active":"2023-07-09T21:38:23.431393+0000","last_became_peered":"2023-07-09T21:38:23.431393+0000","last_unstale":"2023-07-09T21:38:24.703149+0000","last_undegraded":"2023-07-09T21:38:24.703149+0000","last_fullsized":"2023-07-09T21:38:24.703149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:25.316438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509592+0000","last_change":"2023-07-09T21:38:22.407689+0000","last_active":"2023-07-09T21:38:25.509592+0000","last_peered":"2023-07-09T21:38:25.509592+0000","last_clean":"2023-07-09T21:38:25.509592+0000","last_became_active":"2023-07-09T21:38:22.407375+0000","last_became_peered":"2023-07-09T21:38:22.407375+0000","last_unstale":"2023-07-09T21:38:25.509592+0000","last_undegraded":"2023-07-09T21:38:25.509592+0000","last_fullsized":"2023-07-09T21:38:25.509592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:21:56.462838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002480+0000","last_change":"2023-07-09T21:38:23.418341+0000","last_active":"2023-07-09T21:38:25.002480+0000","last_peered":"2023-07-09T21:38:25.002480+0000","last_clean":"2023-07-09T21:38:25.002480+0000","last_became_active":"2023-07-09T21:38:23.418039+0000","last_became_peered":"2023-07-09T21:38:23.418039+0000","last_unstale":"2023-07-09T21:38:25.002480+0000","last_undegraded":"2023-07-09T21:38:25.002480+0000","last_fullsized":"2023-07-09T21:38:25.002480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:56.347634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417878+0000","last_change":"2023-07-09T21:38:22.415040+0000","last_active":"2023-07-09T21:38:24.417878+0000","last_peered":"2023-07-09T21:38:24.417878+0000","last_clean":"2023-07-09T21:38:24.417878+0000","last_became_active":"2023-07-09T21:38:22.414497+0000","last_became_peered":"2023-07-09T21:38:22.414497+0000","last_unstale":"2023-07-09T21:38:24.417878+0000","last_undegraded":"2023-07-09T21:38:24.417878+0000","last_fullsized":"2023-07-09T21:38:24.417878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:57.454298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503278+0000","last_change":"2023-07-09T21:38:23.438486+0000","last_active":"2023-07-09T21:38:25.503278+0000","last_peered":"2023-07-09T21:38:25.503278+0000","last_clean":"2023-07-09T21:38:25.503278+0000","last_became_active":"2023-07-09T21:38:23.438176+0000","last_became_peered":"2023-07-09T21:38:23.438176+0000","last_unstale":"2023-07-09T21:38:25.503278+0000","last_undegraded":"2023-07-09T21:38:25.503278+0000","last_fullsized":"2023-07-09T21:38:25.503278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:04.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418844+0000","last_change":"2023-07-09T21:38:22.404010+0000","last_active":"2023-07-09T21:38:24.418844+0000","last_peered":"2023-07-09T21:38:24.418844+0000","last_clean":"2023-07-09T21:38:24.418844+0000","last_became_active":"2023-07-09T21:38:22.403441+0000","last_became_peered":"2023-07-09T21:38:22.403441+0000","last_unstale":"2023-07-09T21:38:24.418844+0000","last_undegraded":"2023-07-09T21:38:24.418844+0000","last_fullsized":"2023-07-09T21:38:24.418844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:05.409760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502785+0000","last_change":"2023-07-09T21:38:23.422622+0000","last_active":"2023-07-09T21:38:25.502785+0000","last_peered":"2023-07-09T21:38:25.502785+0000","last_clean":"2023-07-09T21:38:25.502785+0000","last_became_active":"2023-07-09T21:38:23.422240+0000","last_became_peered":"2023-07-09T21:38:23.422240+0000","last_unstale":"2023-07-09T21:38:25.502785+0000","last_undegraded":"2023-07-09T21:38:25.502785+0000","last_fullsized":"2023-07-09T21:38:25.502785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:51.291587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418790+0000","last_change":"2023-07-09T21:38:22.401340+0000","last_active":"2023-07-09T21:38:24.418790+0000","last_peered":"2023-07-09T21:38:24.418790+0000","last_clean":"2023-07-09T21:38:24.418790+0000","last_became_active":"2023-07-09T21:38:22.401065+0000","last_became_peered":"2023-07-09T21:38:22.401065+0000","last_unstale":"2023-07-09T21:38:24.418790+0000","last_undegraded":"2023-07-09T21:38:24.418790+0000","last_fullsized":"2023-07-09T21:38:24.418790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:13.289736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418977+0000","last_change":"2023-07-09T21:38:23.434807+0000","last_active":"2023-07-09T21:38:24.418977+0000","last_peered":"2023-07-09T21:38:24.418977+0000","last_clean":"2023-07-09T21:38:24.418977+0000","last_became_active":"2023-07-09T21:38:23.433693+0000","last_became_peered":"2023-07-09T21:38:23.433693+0000","last_unstale":"2023-07-09T21:38:24.418977+0000","last_undegraded":"2023-07-09T21:38:24.418977+0000","last_fullsized":"2023-07-09T21:38:24.418977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:46.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503384+0000","last_change":"2023-07-09T21:38:22.401562+0000","last_active":"2023-07-09T21:38:25.503384+0000","last_peered":"2023-07-09T21:38:25.503384+0000","last_clean":"2023-07-09T21:38:25.503384+0000","last_became_active":"2023-07-09T21:38:22.401259+0000","last_became_peered":"2023-07-09T21:38:22.401259+0000","last_unstale":"2023-07-09T21:38:25.503384+0000","last_undegraded":"2023-07-09T21:38:25.503384+0000","last_fullsized":"2023-07-09T21:38:25.503384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:15.647897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703398+0000","last_change":"2023-07-09T21:38:23.431463+0000","last_active":"2023-07-09T21:38:24.703398+0000","last_peered":"2023-07-09T21:38:24.703398+0000","last_clean":"2023-07-09T21:38:24.703398+0000","last_became_active":"2023-07-09T21:38:23.430783+0000","last_became_peered":"2023-07-09T21:38:23.430783+0000","last_unstale":"2023-07-09T21:38:24.703398+0000","last_undegraded":"2023-07-09T21:38:24.703398+0000","last_fullsized":"2023-07-09T21:38:24.703398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:02.194992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002582+0000","last_change":"2023-07-09T21:38:22.408925+0000","last_active":"2023-07-09T21:38:25.002582+0000","last_peered":"2023-07-09T21:38:25.002582+0000","last_clean":"2023-07-09T21:38:25.002582+0000","last_became_active":"2023-07-09T21:38:22.407895+0000","last_became_peered":"2023-07-09T21:38:22.407895+0000","last_unstale":"2023-07-09T21:38:25.002582+0000","last_undegraded":"2023-07-09T21:38:25.002582+0000","last_fullsized":"2023-07-09T21:38:25.002582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:21.133612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703067+0000","last_change":"2023-07-09T21:38:23.425537+0000","last_active":"2023-07-09T21:38:24.703067+0000","last_peered":"2023-07-09T21:38:24.703067+0000","last_clean":"2023-07-09T21:38:24.703067+0000","last_became_active":"2023-07-09T21:38:23.425252+0000","last_became_peered":"2023-07-09T21:38:23.425252+0000","last_unstale":"2023-07-09T21:38:24.703067+0000","last_undegraded":"2023-07-09T21:38:24.703067+0000","last_fullsized":"2023-07-09T21:38:24.703067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:45.431588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509768+0000","last_change":"2023-07-09T21:38:22.402885+0000","last_active":"2023-07-09T21:38:25.509768+0000","last_peered":"2023-07-09T21:38:25.509768+0000","last_clean":"2023-07-09T21:38:25.509768+0000","last_became_active":"2023-07-09T21:38:22.402582+0000","last_became_peered":"2023-07-09T21:38:22.402582+0000","last_unstale":"2023-07-09T21:38:25.509768+0000","last_undegraded":"2023-07-09T21:38:25.509768+0000","last_fullsized":"2023-07-09T21:38:25.509768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:43.567035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418047+0000","last_change":"2023-07-09T21:38:23.439239+0000","last_active":"2023-07-09T21:38:24.418047+0000","last_peered":"2023-07-09T21:38:24.418047+0000","last_clean":"2023-07-09T21:38:24.418047+0000","last_became_active":"2023-07-09T21:38:23.438957+0000","last_became_peered":"2023-07-09T21:38:23.438957+0000","last_unstale":"2023-07-09T21:38:24.418047+0000","last_undegraded":"2023-07-09T21:38:24.418047+0000","last_fullsized":"2023-07-09T21:38:24.418047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:47.900157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408843+0000","last_change":"2023-07-09T21:38:22.399149+0000","last_active":"2023-07-09T21:38:24.408843+0000","last_peered":"2023-07-09T21:38:24.408843+0000","last_clean":"2023-07-09T21:38:24.408843+0000","last_became_active":"2023-07-09T21:38:22.398841+0000","last_became_peered":"2023-07-09T21:38:22.398841+0000","last_unstale":"2023-07-09T21:38:24.408843+0000","last_undegraded":"2023-07-09T21:38:24.408843+0000","last_fullsized":"2023-07-09T21:38:24.408843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002120+0000","last_change":"2023-07-09T21:38:23.433107+0000","last_active":"2023-07-09T21:38:25.002120+0000","last_peered":"2023-07-09T21:38:25.002120+0000","last_clean":"2023-07-09T21:38:25.002120+0000","last_became_active":"2023-07-09T21:38:23.432785+0000","last_became_peered":"2023-07-09T21:38:23.432785+0000","last_unstale":"2023-07-09T21:38:25.002120+0000","last_undegraded":"2023-07-09T21:38:25.002120+0000","last_fullsized":"2023-07-09T21:38:25.002120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:00.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408691+0000","last_change":"2023-07-09T21:38:22.399727+0000","last_active":"2023-07-09T21:38:24.408691+0000","last_peered":"2023-07-09T21:38:24.408691+0000","last_clean":"2023-07-09T21:38:24.408691+0000","last_became_active":"2023-07-09T21:38:22.396239+0000","last_became_peered":"2023-07-09T21:38:22.396239+0000","last_unstale":"2023-07-09T21:38:24.408691+0000","last_undegraded":"2023-07-09T21:38:24.408691+0000","last_fullsized":"2023-07-09T21:38:24.408691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:30:16.961728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502702+0000","last_change":"2023-07-09T21:38:23.423485+0000","last_active":"2023-07-09T21:38:25.502702+0000","last_peered":"2023-07-09T21:38:25.502702+0000","last_clean":"2023-07-09T21:38:25.502702+0000","last_became_active":"2023-07-09T21:38:23.422853+0000","last_became_peered":"2023-07-09T21:38:23.422853+0000","last_unstale":"2023-07-09T21:38:25.502702+0000","last_undegraded":"2023-07-09T21:38:25.502702+0000","last_fullsized":"2023-07-09T21:38:25.502702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:56.531125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002095+0000","last_change":"2023-07-09T21:38:22.396722+0000","last_active":"2023-07-09T21:38:25.002095+0000","last_peered":"2023-07-09T21:38:25.002095+0000","last_clean":"2023-07-09T21:38:25.002095+0000","last_became_active":"2023-07-09T21:38:22.396430+0000","last_became_peered":"2023-07-09T21:38:22.396430+0000","last_unstale":"2023-07-09T21:38:25.002095+0000","last_undegraded":"2023-07-09T21:38:25.002095+0000","last_fullsized":"2023-07-09T21:38:25.002095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:01:23.317396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703138+0000","last_change":"2023-07-09T21:38:23.427340+0000","last_active":"2023-07-09T21:38:24.703138+0000","last_peered":"2023-07-09T21:38:24.703138+0000","last_clean":"2023-07-09T21:38:24.703138+0000","last_became_active":"2023-07-09T21:38:23.427046+0000","last_became_peered":"2023-07-09T21:38:23.427046+0000","last_unstale":"2023-07-09T21:38:24.703138+0000","last_undegraded":"2023-07-09T21:38:24.703138+0000","last_fullsized":"2023-07-09T21:38:24.703138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:22.781756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408591+0000","last_change":"2023-07-09T21:38:22.400029+0000","last_active":"2023-07-09T21:38:24.408591+0000","last_peered":"2023-07-09T21:38:24.408591+0000","last_clean":"2023-07-09T21:38:24.408591+0000","last_became_active":"2023-07-09T21:38:22.399708+0000","last_became_peered":"2023-07-09T21:38:22.399708+0000","last_unstale":"2023-07-09T21:38:24.408591+0000","last_undegraded":"2023-07-09T21:38:24.408591+0000","last_fullsized":"2023-07-09T21:38:24.408591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:13.697822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":444,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509744+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:38:25.509744+0000","last_peered":"2023-07-09T21:38:25.509744+0000","last_clean":"2023-07-09T21:38:25.509744+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:38:25.509744+0000","last_undegraded":"2023-07-09T21:38:25.509744+0000","last_fullsized":"2023-07-09T21:38:25.509744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:25.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418330+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:38:24.418330+0000","last_peered":"2023-07-09T21:38:24.418330+0000","last_clean":"2023-07-09T21:38:24.418330+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:38:24.418330+0000","last_undegraded":"2023-07-09T21:38:24.418330+0000","last_fullsized":"2023-07-09T21:38:24.418330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:27:34.955272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502861+0000","last_change":"2023-07-09T21:38:23.425390+0000","last_active":"2023-07-09T21:38:25.502861+0000","last_peered":"2023-07-09T21:38:25.502861+0000","last_clean":"2023-07-09T21:38:25.502861+0000","last_became_active":"2023-07-09T21:38:23.425033+0000","last_became_peered":"2023-07-09T21:38:23.425033+0000","last_unstale":"2023-07-09T21:38:25.502861+0000","last_undegraded":"2023-07-09T21:38:25.502861+0000","last_fullsized":"2023-07-09T21:38:25.502861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:30:17.969896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503191+0000","last_change":"2023-07-09T21:38:22.400490+0000","last_active":"2023-07-09T21:38:25.503191+0000","last_peered":"2023-07-09T21:38:25.503191+0000","last_clean":"2023-07-09T21:38:25.503191+0000","last_became_active":"2023-07-09T21:38:22.400179+0000","last_became_peered":"2023-07-09T21:38:22.400179+0000","last_unstale":"2023-07-09T21:38:25.503191+0000","last_undegraded":"2023-07-09T21:38:25.503191+0000","last_fullsized":"2023-07-09T21:38:25.503191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:52.375061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509473+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:38:25.509473+0000","last_peered":"2023-07-09T21:38:25.509473+0000","last_clean":"2023-07-09T21:38:25.509473+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:38:25.509473+0000","last_undegraded":"2023-07-09T21:38:25.509473+0000","last_fullsized":"2023-07-09T21:38:25.509473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417633+0000","last_change":"2023-07-09T21:38:23.430495+0000","last_active":"2023-07-09T21:38:24.417633+0000","last_peered":"2023-07-09T21:38:24.417633+0000","last_clean":"2023-07-09T21:38:24.417633+0000","last_became_active":"2023-07-09T21:38:23.430220+0000","last_became_peered":"2023-07-09T21:38:23.430220+0000","last_unstale":"2023-07-09T21:38:24.417633+0000","last_undegraded":"2023-07-09T21:38:24.417633+0000","last_fullsized":"2023-07-09T21:38:24.417633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:12.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418058+0000","last_change":"2023-07-09T21:38:22.398190+0000","last_active":"2023-07-09T21:38:24.418058+0000","last_peered":"2023-07-09T21:38:24.418058+0000","last_clean":"2023-07-09T21:38:24.418058+0000","last_became_active":"2023-07-09T21:38:22.397908+0000","last_became_peered":"2023-07-09T21:38:22.397908+0000","last_unstale":"2023-07-09T21:38:24.418058+0000","last_undegraded":"2023-07-09T21:38:24.418058+0000","last_fullsized":"2023-07-09T21:38:24.418058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:05.678653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503530+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:38:25.503530+0000","last_peered":"2023-07-09T21:38:25.503530+0000","last_clean":"2023-07-09T21:38:25.503530+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:38:25.503530+0000","last_undegraded":"2023-07-09T21:38:25.503530+0000","last_fullsized":"2023-07-09T21:38:25.503530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:08.265025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703402+0000","last_change":"2023-07-09T21:38:23.442083+0000","last_active":"2023-07-09T21:38:24.703402+0000","last_peered":"2023-07-09T21:38:24.703402+0000","last_clean":"2023-07-09T21:38:24.703402+0000","last_became_active":"2023-07-09T21:38:23.433120+0000","last_became_peered":"2023-07-09T21:38:23.433120+0000","last_unstale":"2023-07-09T21:38:24.703402+0000","last_undegraded":"2023-07-09T21:38:24.703402+0000","last_fullsized":"2023-07-09T21:38:24.703402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:45:51.285417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502800+0000","last_change":"2023-07-09T21:38:22.408768+0000","last_active":"2023-07-09T21:38:25.502800+0000","last_peered":"2023-07-09T21:38:25.502800+0000","last_clean":"2023-07-09T21:38:25.502800+0000","last_became_active":"2023-07-09T21:38:22.408410+0000","last_became_peered":"2023-07-09T21:38:22.408410+0000","last_unstale":"2023-07-09T21:38:25.502800+0000","last_undegraded":"2023-07-09T21:38:25.502800+0000","last_fullsized":"2023-07-09T21:38:25.502800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:58:56.372513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418096+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:38:24.418096+0000","last_peered":"2023-07-09T21:38:24.418096+0000","last_clean":"2023-07-09T21:38:24.418096+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:38:24.418096+0000","last_undegraded":"2023-07-09T21:38:24.418096+0000","last_fullsized":"2023-07-09T21:38:24.418096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:55.731787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509392+0000","last_change":"2023-07-09T21:38:23.444054+0000","last_active":"2023-07-09T21:38:25.509392+0000","last_peered":"2023-07-09T21:38:25.509392+0000","last_clean":"2023-07-09T21:38:25.509392+0000","last_became_active":"2023-07-09T21:38:23.443655+0000","last_became_peered":"2023-07-09T21:38:23.443655+0000","last_unstale":"2023-07-09T21:38:25.509392+0000","last_undegraded":"2023-07-09T21:38:25.509392+0000","last_fullsized":"2023-07-09T21:38:25.509392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:32.900296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418664+0000","last_change":"2023-07-09T21:38:22.403699+0000","last_active":"2023-07-09T21:38:24.418664+0000","last_peered":"2023-07-09T21:38:24.418664+0000","last_clean":"2023-07-09T21:38:24.418664+0000","last_became_active":"2023-07-09T21:38:22.403088+0000","last_became_peered":"2023-07-09T21:38:22.403088+0000","last_unstale":"2023-07-09T21:38:24.418664+0000","last_undegraded":"2023-07-09T21:38:24.418664+0000","last_fullsized":"2023-07-09T21:38:24.418664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:03.275885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002676+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:38:25.002676+0000","last_peered":"2023-07-09T21:38:25.002676+0000","last_clean":"2023-07-09T21:38:25.002676+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:38:25.002676+0000","last_undegraded":"2023-07-09T21:38:25.002676+0000","last_fullsized":"2023-07-09T21:38:25.002676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:17.237329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703294+0000","last_change":"2023-07-09T21:38:23.448157+0000","last_active":"2023-07-09T21:38:24.703294+0000","last_peered":"2023-07-09T21:38:24.703294+0000","last_clean":"2023-07-09T21:38:24.703294+0000","last_became_active":"2023-07-09T21:38:23.446247+0000","last_became_peered":"2023-07-09T21:38:23.446247+0000","last_unstale":"2023-07-09T21:38:24.703294+0000","last_undegraded":"2023-07-09T21:38:24.703294+0000","last_fullsized":"2023-07-09T21:38:24.703294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:01.783976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509590+0000","last_change":"2023-07-09T21:38:22.414687+0000","last_active":"2023-07-09T21:38:25.509590+0000","last_peered":"2023-07-09T21:38:25.509590+0000","last_clean":"2023-07-09T21:38:25.509590+0000","last_became_active":"2023-07-09T21:38:22.414205+0000","last_became_peered":"2023-07-09T21:38:22.414205+0000","last_unstale":"2023-07-09T21:38:25.509590+0000","last_undegraded":"2023-07-09T21:38:25.509590+0000","last_fullsized":"2023-07-09T21:38:25.509590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:52.233687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509733+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:38:25.509733+0000","last_peered":"2023-07-09T21:38:25.509733+0000","last_clean":"2023-07-09T21:38:25.509733+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:38:25.509733+0000","last_undegraded":"2023-07-09T21:38:25.509733+0000","last_fullsized":"2023-07-09T21:38:25.509733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:09:13.435458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418625+0000","last_change":"2023-07-09T21:38:23.447474+0000","last_active":"2023-07-09T21:38:24.418625+0000","last_peered":"2023-07-09T21:38:24.418625+0000","last_clean":"2023-07-09T21:38:24.418625+0000","last_became_active":"2023-07-09T21:38:23.447083+0000","last_became_peered":"2023-07-09T21:38:23.447083+0000","last_unstale":"2023-07-09T21:38:24.418625+0000","last_undegraded":"2023-07-09T21:38:24.418625+0000","last_fullsized":"2023-07-09T21:38:24.418625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:29.955492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509593+0000","last_change":"2023-07-09T21:38:22.408792+0000","last_active":"2023-07-09T21:38:25.509593+0000","last_peered":"2023-07-09T21:38:25.509593+0000","last_clean":"2023-07-09T21:38:25.509593+0000","last_became_active":"2023-07-09T21:38:22.408483+0000","last_became_peered":"2023-07-09T21:38:22.408483+0000","last_unstale":"2023-07-09T21:38:25.509593+0000","last_undegraded":"2023-07-09T21:38:25.509593+0000","last_fullsized":"2023-07-09T21:38:25.509593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:42.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002637+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:38:25.002637+0000","last_peered":"2023-07-09T21:38:25.002637+0000","last_clean":"2023-07-09T21:38:25.002637+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:38:25.002637+0000","last_undegraded":"2023-07-09T21:38:25.002637+0000","last_fullsized":"2023-07-09T21:38:25.002637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:39.290164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703518+0000","last_change":"2023-07-09T21:38:23.431671+0000","last_active":"2023-07-09T21:38:24.703518+0000","last_peered":"2023-07-09T21:38:24.703518+0000","last_clean":"2023-07-09T21:38:24.703518+0000","last_became_active":"2023-07-09T21:38:23.431150+0000","last_became_peered":"2023-07-09T21:38:23.431150+0000","last_unstale":"2023-07-09T21:38:24.703518+0000","last_undegraded":"2023-07-09T21:38:24.703518+0000","last_fullsized":"2023-07-09T21:38:24.703518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:15.482933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408971+0000","last_change":"2023-07-09T21:38:22.402484+0000","last_active":"2023-07-09T21:38:24.408971+0000","last_peered":"2023-07-09T21:38:24.408971+0000","last_clean":"2023-07-09T21:38:24.408971+0000","last_became_active":"2023-07-09T21:38:22.402194+0000","last_became_peered":"2023-07-09T21:38:22.402194+0000","last_unstale":"2023-07-09T21:38:24.408971+0000","last_undegraded":"2023-07-09T21:38:24.408971+0000","last_fullsized":"2023-07-09T21:38:24.408971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:00.028333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703546+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:38:24.703546+0000","last_peered":"2023-07-09T21:38:24.703546+0000","last_clean":"2023-07-09T21:38:24.703546+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:38:24.703546+0000","last_undegraded":"2023-07-09T21:38:24.703546+0000","last_fullsized":"2023-07-09T21:38:24.703546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:10:18.136556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312952,"statfs":{"total":96636764160,"available":96576462848,"internally_reserved":0,"allocated":1638400,"data_stored":1106641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0069999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.625,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":1.024,"15min":1.024},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.619},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.754},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.665},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.129,"15min":1.2629999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.002},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.375},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":515531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":1.0569999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95799999999999996,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.96999999999999997,"15min":1.1519999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0589999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.58199999999999996,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.165},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.99399999999999999,"5min":1.123,"15min":1.123},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56000000000000005,"15min":0.57499999999999996},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.628,"5min":0.90700000000000003,"15min":1.111},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.84199999999999997,"5min":0.98999999999999999,"15min":1.1950000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.006},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.52300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82399999999999995,"5min":1.21,"15min":1.21},"last":0.76600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50104,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321736,"statfs":{"total":96636764160,"available":96585457664,"internally_reserved":0,"allocated":1032192,"data_stored":515519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70099999999999996,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.60799999999999998,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.92100000000000004,"5min":0.96199999999999997,"15min":0.999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80700000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":1.01,"15min":1.01},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":0.98399999999999999,"15min":1.0169999999999999},"last":0.874}]},{"osd":6,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.98899999999999999,"15min":0.99299999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.038},"last":0.85999999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":1.014},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":517061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.88900000000000001,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.63800000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.874}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.60099999999999998,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.58499999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.84699999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.26,"15min":1.26},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.165},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.92800000000000005,"15min":1.1859999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":0.82799999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98299999999999998,"5min":1.0049999999999999,"15min":1.107},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.93600000000000005,"15min":0.997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":1.042},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":1028096,"data_stored":515497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.60699999999999998,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.022,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.0760000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.127,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.208},"last":0.95899999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.67000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.51,"15min":1.51},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.52800000000000002,"15min":0.50600000000000001},"max":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.296},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1910000000000001,"15min":1.323},"last":0.90100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54196,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317644,"statfs":{"total":96636764160,"available":96581267456,"internally_reserved":0,"allocated":1028096,"data_stored":515497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.375},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.77200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":1.0409999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77700000000000002,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.503},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1659999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.62,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.149,"5min":1.377,"15min":1.3839999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.69899999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":1.3100000000000001,"5min":1.423,"15min":1.423},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68799999999999994,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.63900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1140000000000001,"5min":1.496,"15min":1.496},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":1056768,"data_stored":517825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.45700000000000002},"min":{"1min":0.37,"5min":0.252,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.76800000000000002,"15min":0.871},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.378},"max":{"1min":1.0129999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.385},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.0660000000000001,"5min":1.129,"15min":1.3069999999999999},"last":1.129},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.212,"15min":1.419},"last":0.98299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":1.087,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.149,"15min":1.242},"last":1.0149999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.018,"15min":1.335},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0329999999999999,"5min":1.258,"15min":1.3799999999999999},"last":1.1699999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.173,"15min":1.173},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":1105865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47399999999999998},"min":{"1min":0.35399999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.66900000000000004,"5min":0.753,"15min":0.753},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":1.0489999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":1.018,"15min":1.018},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.47499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.625,"5min":1.038,"15min":1.038},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.63700000000000001,"5min":0.83999999999999997,"15min":1.143},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":1.05,"15min":1.274},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.6559999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.66600000000000004,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.754}]},{"osd":5,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.67900000000000005,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4350000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.137,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96399999999999997,"5min":1.236,"15min":1.3660000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.82399999999999995,"15min":0.82099999999999995},"min":{"1min":0.71999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.5980000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.2709999999999999,"5min":1.282,"15min":1.5740000000000001},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:38:31.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:38:31.069 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:38:32.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:38:32.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 Processor -- start 2023-07-09T21:38:32.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 -- start start 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01e80cef80 0x7f01e80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e80b49f0 con 0x7f01e80b4170 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e80b7e80 con 0x7f01e80cef80 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01ed3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80b45f0 con 0x7f01e80b7ab0 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01e80cef80 0x7f01e80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01e80cef80 0x7f01e80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40868/0 (socket says 172.21.15.37:40868) 2023-07-09T21:38:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 -- 172.21.15.37:0/3505871998 learned_addr learned my addr 172.21.15.37:0/3505871998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 -- 172.21.15.37:0/3505871998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 msgr2=0x7f01e806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 -- 172.21.15.37:0/3505871998 >> v1:172.21.15.37:6789/0 conn(0x7f01e80b4170 legacy=0x7f01e815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01dffff640 1 -- 172.21.15.37:0/3505871998 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80cc8a0 con 0x7f01e80cef80 2023-07-09T21:38:32.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.287+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01dffff640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e80b3c30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009870 tx=0x7f01d001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9fe811a5fdcc5c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01e67fc640 1 -- 172.21.15.37:0/3505871998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00aa670 con 0x7f01e80cef80 2023-07-09T21:38:32.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01e67fc640 1 -- 172.21.15.37:0/3505871998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d00aa7d0 con 0x7f01e80cef80 2023-07-09T21:38:32.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01e67fc640 1 -- 172.21.15.37:0/3505871998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00aab60 con 0x7f01e80cef80 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3505871998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 msgr2=0x7f01e80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e80b3c30 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f01d0009870 tx=0x7f01d001c510 comp rx=0 tx=0).stop 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3505871998 shutdown_connections 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e80b3c30 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3505871998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3505871998 >> 172.21.15.37:0/3505871998 conn(0x7f01e8073090 msgr2=0x7f01e8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3505871998 shutdown_connections 2023-07-09T21:38:32.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3505871998 wait complete. 2023-07-09T21:38:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 Processor -- start 2023-07-09T21:38:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.291+0000 7f01ed3ac640 1 -- start start 2023-07-09T21:38:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 0x7f01e80cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e80c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8155a40 con 0x7f01e80cef80 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8155c90 con 0x7f01e80b4170 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8155f70 con 0x7f01e80b7ab0 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40878/0 (socket says 172.21.15.37:40878) 2023-07-09T21:38:32.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 -- 172.21.15.37:0/3936346453 learned_addr learned my addr 172.21.15.37:0/3936346453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01dffff640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e80c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 0x7f01e80cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 -- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 msgr2=0x7f01e80c5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e80c5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 -- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 msgr2=0x7f01e80cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 0x7f01e80cbc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 -- 172.21.15.37:0/3936346453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d00094d0 con 0x7f01e80cef80 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 0x7f01e80cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:32.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01e77fe640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c730 tx=0x7f01e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e0003b80 con 0x7f01e80cef80 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e0003ce0 con 0x7f01e80cef80 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e8156250 con 0x7f01e80cef80 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e000aa30 con 0x7f01e80cef80 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e80cc150 con 0x7f01e80cef80 2023-07-09T21:38:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.295+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e804d7d0 con 0x7f01e80cef80 2023-07-09T21:38:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.299+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01e000ab90 con 0x7f01e80cef80 2023-07-09T21:38:32.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.299+0000 7f01df7fe640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 0x7f01c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.299+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f01e0083d60 con 0x7f01e80cef80 2023-07-09T21:38:32.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.299+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 0x7f01c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.299+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 0x7f01c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009980 tx=0x7f01d8008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.303+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01e0050fa0 con 0x7f01e80cef80 2023-07-09T21:38:32.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.451+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01e80cf4d0 con 0x7f01c80663a0 2023-07-09T21:38:32.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.463+0000 7f01df7fe640 1 -- 172.21.15.37:0/3936346453 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311649 (secure 0 0 0) 0x7f01d800f860 con 0x7f01c80663a0 2023-07-09T21:38:32.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:32.467 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 msgr2=0x7f01c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 0x7f01c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009980 tx=0x7f01d8008040 comp rx=0 tx=0).stop 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 msgr2=0x7f01e8156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f01e000c730 tx=0x7f01e000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 shutdown_connections 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f01c80663a0 0x7f01c8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cef80 0x7f01e8156ef0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e80b7ab0 0x7f01e80c5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 --2- 172.21.15.37:0/3936346453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80b4170 0x7f01e80cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 >> 172.21.15.37:0/3936346453 conn(0x7f01e8073090 msgr2=0x7f01e80b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 shutdown_connections 2023-07-09T21:38:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.467+0000 7f01ed3ac640 1 -- 172.21.15.37:0/3936346453 wait complete. 2023-07-09T21:38:32.487 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:38:30.913802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":284,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":328168,"kb_used_data":9256,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754646552,"statfs":{"total":773094113280,"available":772758069248,"internally_reserved":0,"allocated":9478144,"data_stored":5309436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002198"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002593+0000","last_change":"2023-07-09T21:38:23.431545+0000","last_active":"2023-07-09T21:38:25.002593+0000","last_peered":"2023-07-09T21:38:25.002593+0000","last_clean":"2023-07-09T21:38:25.002593+0000","last_became_active":"2023-07-09T21:38:23.431238+0000","last_became_peered":"2023-07-09T21:38:23.431238+0000","last_unstale":"2023-07-09T21:38:25.002593+0000","last_undegraded":"2023-07-09T21:38:25.002593+0000","last_fullsized":"2023-07-09T21:38:25.002593+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:04:52.980358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002523+0000","last_change":"2023-07-09T21:38:23.425291+0000","last_active":"2023-07-09T21:38:25.002523+0000","last_peered":"2023-07-09T21:38:25.002523+0000","last_clean":"2023-07-09T21:38:25.002523+0000","last_became_active":"2023-07-09T21:38:23.424857+0000","last_became_peered":"2023-07-09T21:38:23.424857+0000","last_unstale":"2023-07-09T21:38:25.002523+0000","last_undegraded":"2023-07-09T21:38:25.002523+0000","last_fullsized":"2023-07-09T21:38:25.002523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:29.188355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509327+0000","last_change":"2023-07-09T21:38:23.430767+0000","last_active":"2023-07-09T21:38:25.509327+0000","last_peered":"2023-07-09T21:38:25.509327+0000","last_clean":"2023-07-09T21:38:25.509327+0000","last_became_active":"2023-07-09T21:38:23.429907+0000","last_became_peered":"2023-07-09T21:38:23.429907+0000","last_unstale":"2023-07-09T21:38:25.509327+0000","last_undegraded":"2023-07-09T21:38:25.509327+0000","last_fullsized":"2023-07-09T21:38:25.509327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:10.942736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418856+0000","last_change":"2023-07-09T21:38:23.440557+0000","last_active":"2023-07-09T21:38:24.418856+0000","last_peered":"2023-07-09T21:38:24.418856+0000","last_clean":"2023-07-09T21:38:24.418856+0000","last_became_active":"2023-07-09T21:38:23.440252+0000","last_became_peered":"2023-07-09T21:38:23.440252+0000","last_unstale":"2023-07-09T21:38:24.418856+0000","last_undegraded":"2023-07-09T21:38:24.418856+0000","last_fullsized":"2023-07-09T21:38:24.418856+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:55.369040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703188+0000","last_change":"2023-07-09T21:38:23.448626+0000","last_active":"2023-07-09T21:38:24.703188+0000","last_peered":"2023-07-09T21:38:24.703188+0000","last_clean":"2023-07-09T21:38:24.703188+0000","last_became_active":"2023-07-09T21:38:23.446298+0000","last_became_peered":"2023-07-09T21:38:23.446298+0000","last_unstale":"2023-07-09T21:38:24.703188+0000","last_undegraded":"2023-07-09T21:38:24.703188+0000","last_fullsized":"2023-07-09T21:38:24.703188+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:39.901592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503112+0000","last_change":"2023-07-09T21:38:23.428720+0000","last_active":"2023-07-09T21:38:25.503112+0000","last_peered":"2023-07-09T21:38:25.503112+0000","last_clean":"2023-07-09T21:38:25.503112+0000","last_became_active":"2023-07-09T21:38:23.428426+0000","last_became_peered":"2023-07-09T21:38:23.428426+0000","last_unstale":"2023-07-09T21:38:25.503112+0000","last_undegraded":"2023-07-09T21:38:25.503112+0000","last_fullsized":"2023-07-09T21:38:25.503112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:28.109202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503348+0000","last_change":"2023-07-09T21:38:23.420292+0000","last_active":"2023-07-09T21:38:25.503348+0000","last_peered":"2023-07-09T21:38:25.503348+0000","last_clean":"2023-07-09T21:38:25.503348+0000","last_became_active":"2023-07-09T21:38:23.419986+0000","last_became_peered":"2023-07-09T21:38:23.419986+0000","last_unstale":"2023-07-09T21:38:25.503348+0000","last_undegraded":"2023-07-09T21:38:25.503348+0000","last_fullsized":"2023-07-09T21:38:25.503348+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:09:21.705736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417674+0000","last_change":"2023-07-09T21:38:23.430121+0000","last_active":"2023-07-09T21:38:24.417674+0000","last_peered":"2023-07-09T21:38:24.417674+0000","last_clean":"2023-07-09T21:38:24.417674+0000","last_became_active":"2023-07-09T21:38:23.429715+0000","last_became_peered":"2023-07-09T21:38:23.429715+0000","last_unstale":"2023-07-09T21:38:24.417674+0000","last_undegraded":"2023-07-09T21:38:24.417674+0000","last_fullsized":"2023-07-09T21:38:24.417674+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:43.291189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509897+0000","last_change":"2023-07-09T21:38:23.444103+0000","last_active":"2023-07-09T21:38:25.509897+0000","last_peered":"2023-07-09T21:38:25.509897+0000","last_clean":"2023-07-09T21:38:25.509897+0000","last_became_active":"2023-07-09T21:38:23.443623+0000","last_became_peered":"2023-07-09T21:38:23.443623+0000","last_unstale":"2023-07-09T21:38:25.509897+0000","last_undegraded":"2023-07-09T21:38:25.509897+0000","last_fullsized":"2023-07-09T21:38:25.509897+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:49.908589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509504+0000","last_change":"2023-07-09T21:38:23.429596+0000","last_active":"2023-07-09T21:38:25.509504+0000","last_peered":"2023-07-09T21:38:25.509504+0000","last_clean":"2023-07-09T21:38:25.509504+0000","last_became_active":"2023-07-09T21:38:23.429292+0000","last_became_peered":"2023-07-09T21:38:23.429292+0000","last_unstale":"2023-07-09T21:38:25.509504+0000","last_undegraded":"2023-07-09T21:38:25.509504+0000","last_fullsized":"2023-07-09T21:38:25.509504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:29:10.441269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418489+0000","last_change":"2023-07-09T21:38:23.443645+0000","last_active":"2023-07-09T21:38:24.418489+0000","last_peered":"2023-07-09T21:38:24.418489+0000","last_clean":"2023-07-09T21:38:24.418489+0000","last_became_active":"2023-07-09T21:38:23.443274+0000","last_became_peered":"2023-07-09T21:38:23.443274+0000","last_unstale":"2023-07-09T21:38:24.418489+0000","last_undegraded":"2023-07-09T21:38:24.418489+0000","last_fullsized":"2023-07-09T21:38:24.418489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:33:23.024101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418310+0000","last_change":"2023-07-09T21:38:23.428927+0000","last_active":"2023-07-09T21:38:24.418310+0000","last_peered":"2023-07-09T21:38:24.418310+0000","last_clean":"2023-07-09T21:38:24.418310+0000","last_became_active":"2023-07-09T21:38:23.428628+0000","last_became_peered":"2023-07-09T21:38:23.428628+0000","last_unstale":"2023-07-09T21:38:24.418310+0000","last_undegraded":"2023-07-09T21:38:24.418310+0000","last_fullsized":"2023-07-09T21:38:24.418310+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:41:35.940667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417726+0000","last_change":"2023-07-09T21:38:23.444466+0000","last_active":"2023-07-09T21:38:24.417726+0000","last_peered":"2023-07-09T21:38:24.417726+0000","last_clean":"2023-07-09T21:38:24.417726+0000","last_became_active":"2023-07-09T21:38:23.444166+0000","last_became_peered":"2023-07-09T21:38:23.444166+0000","last_unstale":"2023-07-09T21:38:24.417726+0000","last_undegraded":"2023-07-09T21:38:24.417726+0000","last_fullsized":"2023-07-09T21:38:24.417726+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:22:04.127556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509738+0000","last_change":"2023-07-09T21:38:23.431257+0000","last_active":"2023-07-09T21:38:25.509738+0000","last_peered":"2023-07-09T21:38:25.509738+0000","last_clean":"2023-07-09T21:38:25.509738+0000","last_became_active":"2023-07-09T21:38:23.430963+0000","last_became_peered":"2023-07-09T21:38:23.430963+0000","last_unstale":"2023-07-09T21:38:25.509738+0000","last_undegraded":"2023-07-09T21:38:25.509738+0000","last_fullsized":"2023-07-09T21:38:25.509738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:54.097641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509425+0000","last_change":"2023-07-09T21:38:23.436135+0000","last_active":"2023-07-09T21:38:25.509425+0000","last_peered":"2023-07-09T21:38:25.509425+0000","last_clean":"2023-07-09T21:38:25.509425+0000","last_became_active":"2023-07-09T21:38:23.435817+0000","last_became_peered":"2023-07-09T21:38:23.435817+0000","last_unstale":"2023-07-09T21:38:25.509425+0000","last_undegraded":"2023-07-09T21:38:25.509425+0000","last_fullsized":"2023-07-09T21:38:25.509425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:24.199914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502529+0000","last_change":"2023-07-09T21:38:23.430753+0000","last_active":"2023-07-09T21:38:25.502529+0000","last_peered":"2023-07-09T21:38:25.502529+0000","last_clean":"2023-07-09T21:38:25.502529+0000","last_became_active":"2023-07-09T21:38:23.430476+0000","last_became_peered":"2023-07-09T21:38:23.430476+0000","last_unstale":"2023-07-09T21:38:25.502529+0000","last_undegraded":"2023-07-09T21:38:25.502529+0000","last_fullsized":"2023-07-09T21:38:25.502529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:00.538245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002633+0000","last_change":"2023-07-09T21:38:23.437952+0000","last_active":"2023-07-09T21:38:25.002633+0000","last_peered":"2023-07-09T21:38:25.002633+0000","last_clean":"2023-07-09T21:38:25.002633+0000","last_became_active":"2023-07-09T21:38:23.437611+0000","last_became_peered":"2023-07-09T21:38:23.437611+0000","last_unstale":"2023-07-09T21:38:25.002633+0000","last_undegraded":"2023-07-09T21:38:25.002633+0000","last_fullsized":"2023-07-09T21:38:25.002633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:25.638838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418472+0000","last_change":"2023-07-09T21:38:23.441353+0000","last_active":"2023-07-09T21:38:24.418472+0000","last_peered":"2023-07-09T21:38:24.418472+0000","last_clean":"2023-07-09T21:38:24.418472+0000","last_became_active":"2023-07-09T21:38:23.441052+0000","last_became_peered":"2023-07-09T21:38:23.441052+0000","last_unstale":"2023-07-09T21:38:24.418472+0000","last_undegraded":"2023-07-09T21:38:24.418472+0000","last_fullsized":"2023-07-09T21:38:24.418472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:20.394214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703262+0000","last_change":"2023-07-09T21:38:23.428639+0000","last_active":"2023-07-09T21:38:24.703262+0000","last_peered":"2023-07-09T21:38:24.703262+0000","last_clean":"2023-07-09T21:38:24.703262+0000","last_became_active":"2023-07-09T21:38:23.428369+0000","last_became_peered":"2023-07-09T21:38:23.428369+0000","last_unstale":"2023-07-09T21:38:24.703262+0000","last_undegraded":"2023-07-09T21:38:24.703262+0000","last_fullsized":"2023-07-09T21:38:24.703262+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:36.259605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408946+0000","last_change":"2023-07-09T21:38:23.428199+0000","last_active":"2023-07-09T21:38:24.408946+0000","last_peered":"2023-07-09T21:38:24.408946+0000","last_clean":"2023-07-09T21:38:24.408946+0000","last_became_active":"2023-07-09T21:38:23.427904+0000","last_became_peered":"2023-07-09T21:38:23.427904+0000","last_unstale":"2023-07-09T21:38:24.408946+0000","last_undegraded":"2023-07-09T21:38:24.408946+0000","last_fullsized":"2023-07-09T21:38:24.408946+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:33.695766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418342+0000","last_change":"2023-07-09T21:38:23.429406+0000","last_active":"2023-07-09T21:38:24.418342+0000","last_peered":"2023-07-09T21:38:24.418342+0000","last_clean":"2023-07-09T21:38:24.418342+0000","last_became_active":"2023-07-09T21:38:23.429132+0000","last_became_peered":"2023-07-09T21:38:23.429132+0000","last_unstale":"2023-07-09T21:38:24.418342+0000","last_undegraded":"2023-07-09T21:38:24.418342+0000","last_fullsized":"2023-07-09T21:38:24.418342+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:42.750239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408715+0000","last_change":"2023-07-09T21:38:23.428740+0000","last_active":"2023-07-09T21:38:24.408715+0000","last_peered":"2023-07-09T21:38:24.408715+0000","last_clean":"2023-07-09T21:38:24.408715+0000","last_became_active":"2023-07-09T21:38:23.428259+0000","last_became_peered":"2023-07-09T21:38:23.428259+0000","last_unstale":"2023-07-09T21:38:24.408715+0000","last_undegraded":"2023-07-09T21:38:24.408715+0000","last_fullsized":"2023-07-09T21:38:24.408715+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:28.109202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408632+0000","last_change":"2023-07-09T21:38:23.426556+0000","last_active":"2023-07-09T21:38:24.408632+0000","last_peered":"2023-07-09T21:38:24.408632+0000","last_clean":"2023-07-09T21:38:24.408632+0000","last_became_active":"2023-07-09T21:38:23.426194+0000","last_became_peered":"2023-07-09T21:38:23.426194+0000","last_unstale":"2023-07-09T21:38:24.408632+0000","last_undegraded":"2023-07-09T21:38:24.408632+0000","last_fullsized":"2023-07-09T21:38:24.408632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.645581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509219+0000","last_change":"2023-07-09T21:38:23.432412+0000","last_active":"2023-07-09T21:38:25.509219+0000","last_peered":"2023-07-09T21:38:25.509219+0000","last_clean":"2023-07-09T21:38:25.509219+0000","last_became_active":"2023-07-09T21:38:23.432141+0000","last_became_peered":"2023-07-09T21:38:23.432141+0000","last_unstale":"2023-07-09T21:38:25.509219+0000","last_undegraded":"2023-07-09T21:38:25.509219+0000","last_fullsized":"2023-07-09T21:38:25.509219+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:44.387469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418697+0000","last_change":"2023-07-09T21:38:23.436038+0000","last_active":"2023-07-09T21:38:24.418697+0000","last_peered":"2023-07-09T21:38:24.418697+0000","last_clean":"2023-07-09T21:38:24.418697+0000","last_became_active":"2023-07-09T21:38:23.435739+0000","last_became_peered":"2023-07-09T21:38:23.435739+0000","last_unstale":"2023-07-09T21:38:24.418697+0000","last_undegraded":"2023-07-09T21:38:24.418697+0000","last_fullsized":"2023-07-09T21:38:24.418697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:37:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418489+0000","last_change":"2023-07-09T21:38:23.435368+0000","last_active":"2023-07-09T21:38:24.418489+0000","last_peered":"2023-07-09T21:38:24.418489+0000","last_clean":"2023-07-09T21:38:24.418489+0000","last_became_active":"2023-07-09T21:38:23.435083+0000","last_became_peered":"2023-07-09T21:38:23.435083+0000","last_unstale":"2023-07-09T21:38:24.418489+0000","last_undegraded":"2023-07-09T21:38:24.418489+0000","last_fullsized":"2023-07-09T21:38:24.418489+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:30:41.284463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418548+0000","last_change":"2023-07-09T21:38:23.443362+0000","last_active":"2023-07-09T21:38:24.418548+0000","last_peered":"2023-07-09T21:38:24.418548+0000","last_clean":"2023-07-09T21:38:24.418548+0000","last_became_active":"2023-07-09T21:38:23.442929+0000","last_became_peered":"2023-07-09T21:38:23.442929+0000","last_unstale":"2023-07-09T21:38:24.418548+0000","last_undegraded":"2023-07-09T21:38:24.418548+0000","last_fullsized":"2023-07-09T21:38:24.418548+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:27:05.169840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002247+0000","last_change":"2023-07-09T21:38:23.419824+0000","last_active":"2023-07-09T21:38:25.002247+0000","last_peered":"2023-07-09T21:38:25.002247+0000","last_clean":"2023-07-09T21:38:25.002247+0000","last_became_active":"2023-07-09T21:38:23.419519+0000","last_became_peered":"2023-07-09T21:38:23.419519+0000","last_unstale":"2023-07-09T21:38:25.002247+0000","last_undegraded":"2023-07-09T21:38:25.002247+0000","last_fullsized":"2023-07-09T21:38:25.002247+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:17.339418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509378+0000","last_change":"2023-07-09T21:38:23.437730+0000","last_active":"2023-07-09T21:38:25.509378+0000","last_peered":"2023-07-09T21:38:25.509378+0000","last_clean":"2023-07-09T21:38:25.509378+0000","last_became_active":"2023-07-09T21:38:23.437403+0000","last_became_peered":"2023-07-09T21:38:23.437403+0000","last_unstale":"2023-07-09T21:38:25.509378+0000","last_undegraded":"2023-07-09T21:38:25.509378+0000","last_fullsized":"2023-07-09T21:38:25.509378+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:19:20.272670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417811+0000","last_change":"2023-07-09T21:38:23.434277+0000","last_active":"2023-07-09T21:38:24.417811+0000","last_peered":"2023-07-09T21:38:24.417811+0000","last_clean":"2023-07-09T21:38:24.417811+0000","last_became_active":"2023-07-09T21:38:23.433981+0000","last_became_peered":"2023-07-09T21:38:23.433981+0000","last_unstale":"2023-07-09T21:38:24.417811+0000","last_undegraded":"2023-07-09T21:38:24.417811+0000","last_fullsized":"2023-07-09T21:38:24.417811+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:05.175538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417896+0000","last_change":"2023-07-09T21:38:23.434948+0000","last_active":"2023-07-09T21:38:24.417896+0000","last_peered":"2023-07-09T21:38:24.417896+0000","last_clean":"2023-07-09T21:38:24.417896+0000","last_became_active":"2023-07-09T21:38:23.434612+0000","last_became_peered":"2023-07-09T21:38:23.434612+0000","last_unstale":"2023-07-09T21:38:24.417896+0000","last_undegraded":"2023-07-09T21:38:24.417896+0000","last_fullsized":"2023-07-09T21:38:24.417896+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:17:11.017658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502723+0000","last_change":"2023-07-09T21:38:23.428144+0000","last_active":"2023-07-09T21:38:25.502723+0000","last_peered":"2023-07-09T21:38:25.502723+0000","last_clean":"2023-07-09T21:38:25.502723+0000","last_became_active":"2023-07-09T21:38:23.427849+0000","last_became_peered":"2023-07-09T21:38:23.427849+0000","last_unstale":"2023-07-09T21:38:25.502723+0000","last_undegraded":"2023-07-09T21:38:25.502723+0000","last_fullsized":"2023-07-09T21:38:25.502723+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:35.645581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703288+0000","last_change":"2023-07-09T21:38:23.428094+0000","last_active":"2023-07-09T21:38:24.703288+0000","last_peered":"2023-07-09T21:38:24.703288+0000","last_clean":"2023-07-09T21:38:24.703288+0000","last_became_active":"2023-07-09T21:38:23.427756+0000","last_became_peered":"2023-07-09T21:38:23.427756+0000","last_unstale":"2023-07-09T21:38:24.703288+0000","last_undegraded":"2023-07-09T21:38:24.703288+0000","last_fullsized":"2023-07-09T21:38:24.703288+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:19.294360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"84'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002750+0000","last_change":"2023-07-09T21:38:22.408788+0000","last_active":"2023-07-09T21:38:25.002750+0000","last_peered":"2023-07-09T21:38:25.002750+0000","last_clean":"2023-07-09T21:38:25.002750+0000","last_became_active":"2023-07-09T21:38:22.408319+0000","last_became_peered":"2023-07-09T21:38:22.408319+0000","last_unstale":"2023-07-09T21:38:25.002750+0000","last_undegraded":"2023-07-09T21:38:25.002750+0000","last_fullsized":"2023-07-09T21:38:25.002750+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:17.369332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418654+0000","last_change":"2023-07-09T21:38:23.450382+0000","last_active":"2023-07-09T21:38:24.418654+0000","last_peered":"2023-07-09T21:38:24.418654+0000","last_clean":"2023-07-09T21:38:24.418654+0000","last_became_active":"2023-07-09T21:38:23.449967+0000","last_became_peered":"2023-07-09T21:38:23.449967+0000","last_unstale":"2023-07-09T21:38:24.418654+0000","last_undegraded":"2023-07-09T21:38:24.418654+0000","last_fullsized":"2023-07-09T21:38:24.418654+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:08.406933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503470+0000","last_change":"2023-07-09T21:38:22.408871+0000","last_active":"2023-07-09T21:38:25.503470+0000","last_peered":"2023-07-09T21:38:25.503470+0000","last_clean":"2023-07-09T21:38:25.503470+0000","last_became_active":"2023-07-09T21:38:22.408396+0000","last_became_peered":"2023-07-09T21:38:22.408396+0000","last_unstale":"2023-07-09T21:38:25.503470+0000","last_undegraded":"2023-07-09T21:38:25.503470+0000","last_fullsized":"2023-07-09T21:38:25.503470+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:45.915299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503381+0000","last_change":"2023-07-09T21:38:23.423124+0000","last_active":"2023-07-09T21:38:25.503381+0000","last_peered":"2023-07-09T21:38:25.503381+0000","last_clean":"2023-07-09T21:38:25.503381+0000","last_became_active":"2023-07-09T21:38:23.422791+0000","last_became_peered":"2023-07-09T21:38:23.422791+0000","last_unstale":"2023-07-09T21:38:25.503381+0000","last_undegraded":"2023-07-09T21:38:25.503381+0000","last_fullsized":"2023-07-09T21:38:25.503381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:02:33.695766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503516+0000","last_change":"2023-07-09T21:38:22.403317+0000","last_active":"2023-07-09T21:38:25.503516+0000","last_peered":"2023-07-09T21:38:25.503516+0000","last_clean":"2023-07-09T21:38:25.503516+0000","last_became_active":"2023-07-09T21:38:22.402972+0000","last_became_peered":"2023-07-09T21:38:22.402972+0000","last_unstale":"2023-07-09T21:38:25.503516+0000","last_undegraded":"2023-07-09T21:38:25.503516+0000","last_fullsized":"2023-07-09T21:38:25.503516+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:58.153388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509826+0000","last_change":"2023-07-09T21:38:23.430769+0000","last_active":"2023-07-09T21:38:25.509826+0000","last_peered":"2023-07-09T21:38:25.509826+0000","last_clean":"2023-07-09T21:38:25.509826+0000","last_became_active":"2023-07-09T21:38:23.429870+0000","last_became_peered":"2023-07-09T21:38:23.429870+0000","last_unstale":"2023-07-09T21:38:25.509826+0000","last_undegraded":"2023-07-09T21:38:25.509826+0000","last_fullsized":"2023-07-09T21:38:25.509826+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:36.006742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503509+0000","last_change":"2023-07-09T21:38:22.398622+0000","last_active":"2023-07-09T21:38:25.503509+0000","last_peered":"2023-07-09T21:38:25.503509+0000","last_clean":"2023-07-09T21:38:25.503509+0000","last_became_active":"2023-07-09T21:38:22.398344+0000","last_became_peered":"2023-07-09T21:38:22.398344+0000","last_unstale":"2023-07-09T21:38:25.503509+0000","last_undegraded":"2023-07-09T21:38:25.503509+0000","last_fullsized":"2023-07-09T21:38:25.503509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:00.028333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502550+0000","last_change":"2023-07-09T21:38:23.416207+0000","last_active":"2023-07-09T21:38:25.502550+0000","last_peered":"2023-07-09T21:38:25.502550+0000","last_clean":"2023-07-09T21:38:25.502550+0000","last_became_active":"2023-07-09T21:38:23.415916+0000","last_became_peered":"2023-07-09T21:38:23.415916+0000","last_unstale":"2023-07-09T21:38:25.502550+0000","last_undegraded":"2023-07-09T21:38:25.502550+0000","last_fullsized":"2023-07-09T21:38:25.502550+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:19.395352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408989+0000","last_change":"2023-07-09T21:38:22.396887+0000","last_active":"2023-07-09T21:38:24.408989+0000","last_peered":"2023-07-09T21:38:24.408989+0000","last_clean":"2023-07-09T21:38:24.408989+0000","last_became_active":"2023-07-09T21:38:22.396575+0000","last_became_peered":"2023-07-09T21:38:22.396575+0000","last_unstale":"2023-07-09T21:38:24.408989+0000","last_undegraded":"2023-07-09T21:38:24.408989+0000","last_fullsized":"2023-07-09T21:38:24.408989+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:58.153388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002112+0000","last_change":"2023-07-09T21:38:23.438190+0000","last_active":"2023-07-09T21:38:25.002112+0000","last_peered":"2023-07-09T21:38:25.002112+0000","last_clean":"2023-07-09T21:38:25.002112+0000","last_became_active":"2023-07-09T21:38:23.437560+0000","last_became_peered":"2023-07-09T21:38:23.437560+0000","last_unstale":"2023-07-09T21:38:25.002112+0000","last_undegraded":"2023-07-09T21:38:25.002112+0000","last_fullsized":"2023-07-09T21:38:25.002112+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:54:26.547614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408671+0000","last_change":"2023-07-09T21:38:22.394044+0000","last_active":"2023-07-09T21:38:24.408671+0000","last_peered":"2023-07-09T21:38:24.408671+0000","last_clean":"2023-07-09T21:38:24.408671+0000","last_became_active":"2023-07-09T21:38:22.393668+0000","last_became_peered":"2023-07-09T21:38:22.393668+0000","last_unstale":"2023-07-09T21:38:24.408671+0000","last_undegraded":"2023-07-09T21:38:24.408671+0000","last_fullsized":"2023-07-09T21:38:24.408671+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:58:56.372513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703018+0000","last_change":"2023-07-09T21:38:23.441837+0000","last_active":"2023-07-09T21:38:24.703018+0000","last_peered":"2023-07-09T21:38:24.703018+0000","last_clean":"2023-07-09T21:38:24.703018+0000","last_became_active":"2023-07-09T21:38:23.433068+0000","last_became_peered":"2023-07-09T21:38:23.433068+0000","last_unstale":"2023-07-09T21:38:24.703018+0000","last_undegraded":"2023-07-09T21:38:24.703018+0000","last_fullsized":"2023-07-09T21:38:24.703018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:26.340926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408766+0000","last_change":"2023-07-09T21:38:22.399971+0000","last_active":"2023-07-09T21:38:24.408766+0000","last_peered":"2023-07-09T21:38:24.408766+0000","last_clean":"2023-07-09T21:38:24.408766+0000","last_became_active":"2023-07-09T21:38:22.396590+0000","last_became_peered":"2023-07-09T21:38:22.396590+0000","last_unstale":"2023-07-09T21:38:24.408766+0000","last_undegraded":"2023-07-09T21:38:24.408766+0000","last_fullsized":"2023-07-09T21:38:24.408766+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:52.375061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408898+0000","last_change":"2023-07-09T21:38:23.431598+0000","last_active":"2023-07-09T21:38:24.408898+0000","last_peered":"2023-07-09T21:38:24.408898+0000","last_clean":"2023-07-09T21:38:24.408898+0000","last_became_active":"2023-07-09T21:38:23.431308+0000","last_became_peered":"2023-07-09T21:38:23.431308+0000","last_unstale":"2023-07-09T21:38:24.408898+0000","last_undegraded":"2023-07-09T21:38:24.408898+0000","last_fullsized":"2023-07-09T21:38:24.408898+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:16.656065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703035+0000","last_change":"2023-07-09T21:38:22.411514+0000","last_active":"2023-07-09T21:38:24.703035+0000","last_peered":"2023-07-09T21:38:24.703035+0000","last_clean":"2023-07-09T21:38:24.703035+0000","last_became_active":"2023-07-09T21:38:22.411169+0000","last_became_peered":"2023-07-09T21:38:22.411169+0000","last_unstale":"2023-07-09T21:38:24.703035+0000","last_undegraded":"2023-07-09T21:38:24.703035+0000","last_fullsized":"2023-07-09T21:38:24.703035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:24:00.884788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002296+0000","last_change":"2023-07-09T21:38:23.415514+0000","last_active":"2023-07-09T21:38:25.002296+0000","last_peered":"2023-07-09T21:38:25.002296+0000","last_clean":"2023-07-09T21:38:25.002296+0000","last_became_active":"2023-07-09T21:38:23.415210+0000","last_became_peered":"2023-07-09T21:38:23.415210+0000","last_unstale":"2023-07-09T21:38:25.002296+0000","last_undegraded":"2023-07-09T21:38:25.002296+0000","last_fullsized":"2023-07-09T21:38:25.002296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:36.481451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509972+0000","last_change":"2023-07-09T21:38:22.408707+0000","last_active":"2023-07-09T21:38:25.509972+0000","last_peered":"2023-07-09T21:38:25.509972+0000","last_clean":"2023-07-09T21:38:25.509972+0000","last_became_active":"2023-07-09T21:38:22.408415+0000","last_became_peered":"2023-07-09T21:38:22.408415+0000","last_unstale":"2023-07-09T21:38:25.509972+0000","last_undegraded":"2023-07-09T21:38:25.509972+0000","last_fullsized":"2023-07-09T21:38:25.509972+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:20.860977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408945+0000","last_change":"2023-07-09T21:38:23.424091+0000","last_active":"2023-07-09T21:38:24.408945+0000","last_peered":"2023-07-09T21:38:24.408945+0000","last_clean":"2023-07-09T21:38:24.408945+0000","last_became_active":"2023-07-09T21:38:23.423483+0000","last_became_peered":"2023-07-09T21:38:23.423483+0000","last_unstale":"2023-07-09T21:38:24.408945+0000","last_undegraded":"2023-07-09T21:38:24.408945+0000","last_fullsized":"2023-07-09T21:38:24.408945+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:29:46.923467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418895+0000","last_change":"2023-07-09T21:38:22.413038+0000","last_active":"2023-07-09T21:38:24.418895+0000","last_peered":"2023-07-09T21:38:24.418895+0000","last_clean":"2023-07-09T21:38:24.418895+0000","last_became_active":"2023-07-09T21:38:22.412805+0000","last_became_peered":"2023-07-09T21:38:22.412805+0000","last_unstale":"2023-07-09T21:38:24.418895+0000","last_undegraded":"2023-07-09T21:38:24.418895+0000","last_fullsized":"2023-07-09T21:38:24.418895+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:08.407797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703284+0000","last_change":"2023-07-09T21:38:23.441805+0000","last_active":"2023-07-09T21:38:24.703284+0000","last_peered":"2023-07-09T21:38:24.703284+0000","last_clean":"2023-07-09T21:38:24.703284+0000","last_became_active":"2023-07-09T21:38:23.441434+0000","last_became_peered":"2023-07-09T21:38:23.441434+0000","last_unstale":"2023-07-09T21:38:24.703284+0000","last_undegraded":"2023-07-09T21:38:24.703284+0000","last_fullsized":"2023-07-09T21:38:24.703284+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:55.003151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"84'3","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509549+0000","last_change":"2023-07-09T21:38:22.403101+0000","last_active":"2023-07-09T21:38:25.509549+0000","last_peered":"2023-07-09T21:38:25.509549+0000","last_clean":"2023-07-09T21:38:25.509549+0000","last_became_active":"2023-07-09T21:38:22.402419+0000","last_became_peered":"2023-07-09T21:38:22.402419+0000","last_unstale":"2023-07-09T21:38:25.509549+0000","last_undegraded":"2023-07-09T21:38:25.509549+0000","last_fullsized":"2023-07-09T21:38:25.509549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:58.596080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418983+0000","last_change":"2023-07-09T21:38:23.443104+0000","last_active":"2023-07-09T21:38:24.418983+0000","last_peered":"2023-07-09T21:38:24.418983+0000","last_clean":"2023-07-09T21:38:24.418983+0000","last_became_active":"2023-07-09T21:38:23.442799+0000","last_became_peered":"2023-07-09T21:38:23.442799+0000","last_unstale":"2023-07-09T21:38:24.418983+0000","last_undegraded":"2023-07-09T21:38:24.418983+0000","last_fullsized":"2023-07-09T21:38:24.418983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:41:37.374157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"84'6","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002579+0000","last_change":"2023-07-09T21:38:22.408024+0000","last_active":"2023-07-09T21:38:25.002579+0000","last_peered":"2023-07-09T21:38:25.002579+0000","last_clean":"2023-07-09T21:38:25.002579+0000","last_became_active":"2023-07-09T21:38:22.407723+0000","last_became_peered":"2023-07-09T21:38:22.407723+0000","last_unstale":"2023-07-09T21:38:25.002579+0000","last_undegraded":"2023-07-09T21:38:25.002579+0000","last_fullsized":"2023-07-09T21:38:25.002579+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:13:03.659554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417756+0000","last_change":"2023-07-09T21:38:23.435371+0000","last_active":"2023-07-09T21:38:24.417756+0000","last_peered":"2023-07-09T21:38:24.417756+0000","last_clean":"2023-07-09T21:38:24.417756+0000","last_became_active":"2023-07-09T21:38:23.435085+0000","last_became_peered":"2023-07-09T21:38:23.435085+0000","last_unstale":"2023-07-09T21:38:24.417756+0000","last_undegraded":"2023-07-09T21:38:24.417756+0000","last_fullsized":"2023-07-09T21:38:24.417756+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:58.533786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509278+0000","last_change":"2023-07-09T21:38:22.404352+0000","last_active":"2023-07-09T21:38:25.509278+0000","last_peered":"2023-07-09T21:38:25.509278+0000","last_clean":"2023-07-09T21:38:25.509278+0000","last_became_active":"2023-07-09T21:38:22.404072+0000","last_became_peered":"2023-07-09T21:38:22.404072+0000","last_unstale":"2023-07-09T21:38:25.509278+0000","last_undegraded":"2023-07-09T21:38:25.509278+0000","last_fullsized":"2023-07-09T21:38:25.509278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:22:10.975891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417598+0000","last_change":"2023-07-09T21:38:23.429991+0000","last_active":"2023-07-09T21:38:24.417598+0000","last_peered":"2023-07-09T21:38:24.417598+0000","last_clean":"2023-07-09T21:38:24.417598+0000","last_became_active":"2023-07-09T21:38:23.429694+0000","last_became_peered":"2023-07-09T21:38:23.429694+0000","last_unstale":"2023-07-09T21:38:24.417598+0000","last_undegraded":"2023-07-09T21:38:24.417598+0000","last_fullsized":"2023-07-09T21:38:24.417598+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:29.283838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417937+0000","last_change":"2023-07-09T21:38:22.403402+0000","last_active":"2023-07-09T21:38:24.417937+0000","last_peered":"2023-07-09T21:38:24.417937+0000","last_clean":"2023-07-09T21:38:24.417937+0000","last_became_active":"2023-07-09T21:38:22.403067+0000","last_became_peered":"2023-07-09T21:38:22.403067+0000","last_unstale":"2023-07-09T21:38:24.417937+0000","last_undegraded":"2023-07-09T21:38:24.417937+0000","last_fullsized":"2023-07-09T21:38:24.417937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:17:45.937494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703149+0000","last_change":"2023-07-09T21:38:23.431914+0000","last_active":"2023-07-09T21:38:24.703149+0000","last_peered":"2023-07-09T21:38:24.703149+0000","last_clean":"2023-07-09T21:38:24.703149+0000","last_became_active":"2023-07-09T21:38:23.431393+0000","last_became_peered":"2023-07-09T21:38:23.431393+0000","last_unstale":"2023-07-09T21:38:24.703149+0000","last_undegraded":"2023-07-09T21:38:24.703149+0000","last_fullsized":"2023-07-09T21:38:24.703149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:25.316438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509592+0000","last_change":"2023-07-09T21:38:22.407689+0000","last_active":"2023-07-09T21:38:25.509592+0000","last_peered":"2023-07-09T21:38:25.509592+0000","last_clean":"2023-07-09T21:38:25.509592+0000","last_became_active":"2023-07-09T21:38:22.407375+0000","last_became_peered":"2023-07-09T21:38:22.407375+0000","last_unstale":"2023-07-09T21:38:25.509592+0000","last_undegraded":"2023-07-09T21:38:25.509592+0000","last_fullsized":"2023-07-09T21:38:25.509592+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:21:56.462838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002480+0000","last_change":"2023-07-09T21:38:23.418341+0000","last_active":"2023-07-09T21:38:25.002480+0000","last_peered":"2023-07-09T21:38:25.002480+0000","last_clean":"2023-07-09T21:38:25.002480+0000","last_became_active":"2023-07-09T21:38:23.418039+0000","last_became_peered":"2023-07-09T21:38:23.418039+0000","last_unstale":"2023-07-09T21:38:25.002480+0000","last_undegraded":"2023-07-09T21:38:25.002480+0000","last_fullsized":"2023-07-09T21:38:25.002480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:56.347634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"84'8","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417878+0000","last_change":"2023-07-09T21:38:22.415040+0000","last_active":"2023-07-09T21:38:24.417878+0000","last_peered":"2023-07-09T21:38:24.417878+0000","last_clean":"2023-07-09T21:38:24.417878+0000","last_became_active":"2023-07-09T21:38:22.414497+0000","last_became_peered":"2023-07-09T21:38:22.414497+0000","last_unstale":"2023-07-09T21:38:24.417878+0000","last_undegraded":"2023-07-09T21:38:24.417878+0000","last_fullsized":"2023-07-09T21:38:24.417878+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:57.454298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503278+0000","last_change":"2023-07-09T21:38:23.438486+0000","last_active":"2023-07-09T21:38:25.503278+0000","last_peered":"2023-07-09T21:38:25.503278+0000","last_clean":"2023-07-09T21:38:25.503278+0000","last_became_active":"2023-07-09T21:38:23.438176+0000","last_became_peered":"2023-07-09T21:38:23.438176+0000","last_unstale":"2023-07-09T21:38:25.503278+0000","last_undegraded":"2023-07-09T21:38:25.503278+0000","last_fullsized":"2023-07-09T21:38:25.503278+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:04.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418844+0000","last_change":"2023-07-09T21:38:22.404010+0000","last_active":"2023-07-09T21:38:24.418844+0000","last_peered":"2023-07-09T21:38:24.418844+0000","last_clean":"2023-07-09T21:38:24.418844+0000","last_became_active":"2023-07-09T21:38:22.403441+0000","last_became_peered":"2023-07-09T21:38:22.403441+0000","last_unstale":"2023-07-09T21:38:24.418844+0000","last_undegraded":"2023-07-09T21:38:24.418844+0000","last_fullsized":"2023-07-09T21:38:24.418844+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:05.409760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502785+0000","last_change":"2023-07-09T21:38:23.422622+0000","last_active":"2023-07-09T21:38:25.502785+0000","last_peered":"2023-07-09T21:38:25.502785+0000","last_clean":"2023-07-09T21:38:25.502785+0000","last_became_active":"2023-07-09T21:38:23.422240+0000","last_became_peered":"2023-07-09T21:38:23.422240+0000","last_unstale":"2023-07-09T21:38:25.502785+0000","last_undegraded":"2023-07-09T21:38:25.502785+0000","last_fullsized":"2023-07-09T21:38:25.502785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:51.291587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"85'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418790+0000","last_change":"2023-07-09T21:38:22.401340+0000","last_active":"2023-07-09T21:38:24.418790+0000","last_peered":"2023-07-09T21:38:24.418790+0000","last_clean":"2023-07-09T21:38:24.418790+0000","last_became_active":"2023-07-09T21:38:22.401065+0000","last_became_peered":"2023-07-09T21:38:22.401065+0000","last_unstale":"2023-07-09T21:38:24.418790+0000","last_undegraded":"2023-07-09T21:38:24.418790+0000","last_fullsized":"2023-07-09T21:38:24.418790+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:13.289736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418977+0000","last_change":"2023-07-09T21:38:23.434807+0000","last_active":"2023-07-09T21:38:24.418977+0000","last_peered":"2023-07-09T21:38:24.418977+0000","last_clean":"2023-07-09T21:38:24.418977+0000","last_became_active":"2023-07-09T21:38:23.433693+0000","last_became_peered":"2023-07-09T21:38:23.433693+0000","last_unstale":"2023-07-09T21:38:24.418977+0000","last_undegraded":"2023-07-09T21:38:24.418977+0000","last_fullsized":"2023-07-09T21:38:24.418977+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:46.868836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503384+0000","last_change":"2023-07-09T21:38:22.401562+0000","last_active":"2023-07-09T21:38:25.503384+0000","last_peered":"2023-07-09T21:38:25.503384+0000","last_clean":"2023-07-09T21:38:25.503384+0000","last_became_active":"2023-07-09T21:38:22.401259+0000","last_became_peered":"2023-07-09T21:38:22.401259+0000","last_unstale":"2023-07-09T21:38:25.503384+0000","last_undegraded":"2023-07-09T21:38:25.503384+0000","last_fullsized":"2023-07-09T21:38:25.503384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:15.647897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703398+0000","last_change":"2023-07-09T21:38:23.431463+0000","last_active":"2023-07-09T21:38:24.703398+0000","last_peered":"2023-07-09T21:38:24.703398+0000","last_clean":"2023-07-09T21:38:24.703398+0000","last_became_active":"2023-07-09T21:38:23.430783+0000","last_became_peered":"2023-07-09T21:38:23.430783+0000","last_unstale":"2023-07-09T21:38:24.703398+0000","last_undegraded":"2023-07-09T21:38:24.703398+0000","last_fullsized":"2023-07-09T21:38:24.703398+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:02.194992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002582+0000","last_change":"2023-07-09T21:38:22.408925+0000","last_active":"2023-07-09T21:38:25.002582+0000","last_peered":"2023-07-09T21:38:25.002582+0000","last_clean":"2023-07-09T21:38:25.002582+0000","last_became_active":"2023-07-09T21:38:22.407895+0000","last_became_peered":"2023-07-09T21:38:22.407895+0000","last_unstale":"2023-07-09T21:38:25.002582+0000","last_undegraded":"2023-07-09T21:38:25.002582+0000","last_fullsized":"2023-07-09T21:38:25.002582+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:21.133612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703067+0000","last_change":"2023-07-09T21:38:23.425537+0000","last_active":"2023-07-09T21:38:24.703067+0000","last_peered":"2023-07-09T21:38:24.703067+0000","last_clean":"2023-07-09T21:38:24.703067+0000","last_became_active":"2023-07-09T21:38:23.425252+0000","last_became_peered":"2023-07-09T21:38:23.425252+0000","last_unstale":"2023-07-09T21:38:24.703067+0000","last_undegraded":"2023-07-09T21:38:24.703067+0000","last_fullsized":"2023-07-09T21:38:24.703067+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:58:45.431588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509768+0000","last_change":"2023-07-09T21:38:22.402885+0000","last_active":"2023-07-09T21:38:25.509768+0000","last_peered":"2023-07-09T21:38:25.509768+0000","last_clean":"2023-07-09T21:38:25.509768+0000","last_became_active":"2023-07-09T21:38:22.402582+0000","last_became_peered":"2023-07-09T21:38:22.402582+0000","last_unstale":"2023-07-09T21:38:25.509768+0000","last_undegraded":"2023-07-09T21:38:25.509768+0000","last_fullsized":"2023-07-09T21:38:25.509768+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:43.567035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418047+0000","last_change":"2023-07-09T21:38:23.439239+0000","last_active":"2023-07-09T21:38:24.418047+0000","last_peered":"2023-07-09T21:38:24.418047+0000","last_clean":"2023-07-09T21:38:24.418047+0000","last_became_active":"2023-07-09T21:38:23.438957+0000","last_became_peered":"2023-07-09T21:38:23.438957+0000","last_unstale":"2023-07-09T21:38:24.418047+0000","last_undegraded":"2023-07-09T21:38:24.418047+0000","last_fullsized":"2023-07-09T21:38:24.418047+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:47.900157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408843+0000","last_change":"2023-07-09T21:38:22.399149+0000","last_active":"2023-07-09T21:38:24.408843+0000","last_peered":"2023-07-09T21:38:24.408843+0000","last_clean":"2023-07-09T21:38:24.408843+0000","last_became_active":"2023-07-09T21:38:22.398841+0000","last_became_peered":"2023-07-09T21:38:22.398841+0000","last_unstale":"2023-07-09T21:38:24.408843+0000","last_undegraded":"2023-07-09T21:38:24.408843+0000","last_fullsized":"2023-07-09T21:38:24.408843+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002120+0000","last_change":"2023-07-09T21:38:23.433107+0000","last_active":"2023-07-09T21:38:25.002120+0000","last_peered":"2023-07-09T21:38:25.002120+0000","last_clean":"2023-07-09T21:38:25.002120+0000","last_became_active":"2023-07-09T21:38:23.432785+0000","last_became_peered":"2023-07-09T21:38:23.432785+0000","last_unstale":"2023-07-09T21:38:25.002120+0000","last_undegraded":"2023-07-09T21:38:25.002120+0000","last_fullsized":"2023-07-09T21:38:25.002120+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:00.271730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408691+0000","last_change":"2023-07-09T21:38:22.399727+0000","last_active":"2023-07-09T21:38:24.408691+0000","last_peered":"2023-07-09T21:38:24.408691+0000","last_clean":"2023-07-09T21:38:24.408691+0000","last_became_active":"2023-07-09T21:38:22.396239+0000","last_became_peered":"2023-07-09T21:38:22.396239+0000","last_unstale":"2023-07-09T21:38:24.408691+0000","last_undegraded":"2023-07-09T21:38:24.408691+0000","last_fullsized":"2023-07-09T21:38:24.408691+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:30:16.961728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502702+0000","last_change":"2023-07-09T21:38:23.423485+0000","last_active":"2023-07-09T21:38:25.502702+0000","last_peered":"2023-07-09T21:38:25.502702+0000","last_clean":"2023-07-09T21:38:25.502702+0000","last_became_active":"2023-07-09T21:38:23.422853+0000","last_became_peered":"2023-07-09T21:38:23.422853+0000","last_unstale":"2023-07-09T21:38:25.502702+0000","last_undegraded":"2023-07-09T21:38:25.502702+0000","last_fullsized":"2023-07-09T21:38:25.502702+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:56.531125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002095+0000","last_change":"2023-07-09T21:38:22.396722+0000","last_active":"2023-07-09T21:38:25.002095+0000","last_peered":"2023-07-09T21:38:25.002095+0000","last_clean":"2023-07-09T21:38:25.002095+0000","last_became_active":"2023-07-09T21:38:22.396430+0000","last_became_peered":"2023-07-09T21:38:22.396430+0000","last_unstale":"2023-07-09T21:38:25.002095+0000","last_undegraded":"2023-07-09T21:38:25.002095+0000","last_fullsized":"2023-07-09T21:38:25.002095+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:01:23.317396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703138+0000","last_change":"2023-07-09T21:38:23.427340+0000","last_active":"2023-07-09T21:38:24.703138+0000","last_peered":"2023-07-09T21:38:24.703138+0000","last_clean":"2023-07-09T21:38:24.703138+0000","last_became_active":"2023-07-09T21:38:23.427046+0000","last_became_peered":"2023-07-09T21:38:23.427046+0000","last_unstale":"2023-07-09T21:38:24.703138+0000","last_undegraded":"2023-07-09T21:38:24.703138+0000","last_fullsized":"2023-07-09T21:38:24.703138+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:22.781756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408591+0000","last_change":"2023-07-09T21:38:22.400029+0000","last_active":"2023-07-09T21:38:24.408591+0000","last_peered":"2023-07-09T21:38:24.408591+0000","last_clean":"2023-07-09T21:38:24.408591+0000","last_became_active":"2023-07-09T21:38:22.399708+0000","last_became_peered":"2023-07-09T21:38:22.399708+0000","last_unstale":"2023-07-09T21:38:24.408591+0000","last_undegraded":"2023-07-09T21:38:24.408591+0000","last_fullsized":"2023-07-09T21:38:24.408591+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:13.697822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"72'161","reported_seq":444,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509744+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:38:25.509744+0000","last_peered":"2023-07-09T21:38:25.509744+0000","last_clean":"2023-07-09T21:38:25.509744+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:38:25.509744+0000","last_undegraded":"2023-07-09T21:38:25.509744+0000","last_fullsized":"2023-07-09T21:38:25.509744+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:25.940843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418330+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:38:24.418330+0000","last_peered":"2023-07-09T21:38:24.418330+0000","last_clean":"2023-07-09T21:38:24.418330+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:38:24.418330+0000","last_undegraded":"2023-07-09T21:38:24.418330+0000","last_fullsized":"2023-07-09T21:38:24.418330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:27:34.955272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502861+0000","last_change":"2023-07-09T21:38:23.425390+0000","last_active":"2023-07-09T21:38:25.502861+0000","last_peered":"2023-07-09T21:38:25.502861+0000","last_clean":"2023-07-09T21:38:25.502861+0000","last_became_active":"2023-07-09T21:38:23.425033+0000","last_became_peered":"2023-07-09T21:38:23.425033+0000","last_unstale":"2023-07-09T21:38:25.502861+0000","last_undegraded":"2023-07-09T21:38:25.502861+0000","last_fullsized":"2023-07-09T21:38:25.502861+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:30:17.969896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503191+0000","last_change":"2023-07-09T21:38:22.400490+0000","last_active":"2023-07-09T21:38:25.503191+0000","last_peered":"2023-07-09T21:38:25.503191+0000","last_clean":"2023-07-09T21:38:25.503191+0000","last_became_active":"2023-07-09T21:38:22.400179+0000","last_became_peered":"2023-07-09T21:38:22.400179+0000","last_unstale":"2023-07-09T21:38:25.503191+0000","last_undegraded":"2023-07-09T21:38:25.503191+0000","last_fullsized":"2023-07-09T21:38:25.503191+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:52.375061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509473+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:38:25.509473+0000","last_peered":"2023-07-09T21:38:25.509473+0000","last_clean":"2023-07-09T21:38:25.509473+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:38:25.509473+0000","last_undegraded":"2023-07-09T21:38:25.509473+0000","last_fullsized":"2023-07-09T21:38:25.509473+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.250379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.417633+0000","last_change":"2023-07-09T21:38:23.430495+0000","last_active":"2023-07-09T21:38:24.417633+0000","last_peered":"2023-07-09T21:38:24.417633+0000","last_clean":"2023-07-09T21:38:24.417633+0000","last_became_active":"2023-07-09T21:38:23.430220+0000","last_became_peered":"2023-07-09T21:38:23.430220+0000","last_unstale":"2023-07-09T21:38:24.417633+0000","last_undegraded":"2023-07-09T21:38:24.417633+0000","last_fullsized":"2023-07-09T21:38:24.417633+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:12.543550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418058+0000","last_change":"2023-07-09T21:38:22.398190+0000","last_active":"2023-07-09T21:38:24.418058+0000","last_peered":"2023-07-09T21:38:24.418058+0000","last_clean":"2023-07-09T21:38:24.418058+0000","last_became_active":"2023-07-09T21:38:22.397908+0000","last_became_peered":"2023-07-09T21:38:22.397908+0000","last_unstale":"2023-07-09T21:38:24.418058+0000","last_undegraded":"2023-07-09T21:38:24.418058+0000","last_fullsized":"2023-07-09T21:38:24.418058+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:05.678653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.503530+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:38:25.503530+0000","last_peered":"2023-07-09T21:38:25.503530+0000","last_clean":"2023-07-09T21:38:25.503530+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:38:25.503530+0000","last_undegraded":"2023-07-09T21:38:25.503530+0000","last_fullsized":"2023-07-09T21:38:25.503530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:08.265025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703402+0000","last_change":"2023-07-09T21:38:23.442083+0000","last_active":"2023-07-09T21:38:24.703402+0000","last_peered":"2023-07-09T21:38:24.703402+0000","last_clean":"2023-07-09T21:38:24.703402+0000","last_became_active":"2023-07-09T21:38:23.433120+0000","last_became_peered":"2023-07-09T21:38:23.433120+0000","last_unstale":"2023-07-09T21:38:24.703402+0000","last_undegraded":"2023-07-09T21:38:24.703402+0000","last_fullsized":"2023-07-09T21:38:24.703402+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:45:51.285417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.502800+0000","last_change":"2023-07-09T21:38:22.408768+0000","last_active":"2023-07-09T21:38:25.502800+0000","last_peered":"2023-07-09T21:38:25.502800+0000","last_clean":"2023-07-09T21:38:25.502800+0000","last_became_active":"2023-07-09T21:38:22.408410+0000","last_became_peered":"2023-07-09T21:38:22.408410+0000","last_unstale":"2023-07-09T21:38:25.502800+0000","last_undegraded":"2023-07-09T21:38:25.502800+0000","last_fullsized":"2023-07-09T21:38:25.502800+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:58:56.372513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418096+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:38:24.418096+0000","last_peered":"2023-07-09T21:38:24.418096+0000","last_clean":"2023-07-09T21:38:24.418096+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:38:24.418096+0000","last_undegraded":"2023-07-09T21:38:24.418096+0000","last_fullsized":"2023-07-09T21:38:24.418096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:55.731787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509392+0000","last_change":"2023-07-09T21:38:23.444054+0000","last_active":"2023-07-09T21:38:25.509392+0000","last_peered":"2023-07-09T21:38:25.509392+0000","last_clean":"2023-07-09T21:38:25.509392+0000","last_became_active":"2023-07-09T21:38:23.443655+0000","last_became_peered":"2023-07-09T21:38:23.443655+0000","last_unstale":"2023-07-09T21:38:25.509392+0000","last_undegraded":"2023-07-09T21:38:25.509392+0000","last_fullsized":"2023-07-09T21:38:25.509392+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:32.900296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418664+0000","last_change":"2023-07-09T21:38:22.403699+0000","last_active":"2023-07-09T21:38:24.418664+0000","last_peered":"2023-07-09T21:38:24.418664+0000","last_clean":"2023-07-09T21:38:24.418664+0000","last_became_active":"2023-07-09T21:38:22.403088+0000","last_became_peered":"2023-07-09T21:38:22.403088+0000","last_unstale":"2023-07-09T21:38:24.418664+0000","last_undegraded":"2023-07-09T21:38:24.418664+0000","last_fullsized":"2023-07-09T21:38:24.418664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:03.275885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002676+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:38:25.002676+0000","last_peered":"2023-07-09T21:38:25.002676+0000","last_clean":"2023-07-09T21:38:25.002676+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:38:25.002676+0000","last_undegraded":"2023-07-09T21:38:25.002676+0000","last_fullsized":"2023-07-09T21:38:25.002676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:58:17.237329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703294+0000","last_change":"2023-07-09T21:38:23.448157+0000","last_active":"2023-07-09T21:38:24.703294+0000","last_peered":"2023-07-09T21:38:24.703294+0000","last_clean":"2023-07-09T21:38:24.703294+0000","last_became_active":"2023-07-09T21:38:23.446247+0000","last_became_peered":"2023-07-09T21:38:23.446247+0000","last_unstale":"2023-07-09T21:38:24.703294+0000","last_undegraded":"2023-07-09T21:38:24.703294+0000","last_fullsized":"2023-07-09T21:38:24.703294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:01.783976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"84'2","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509590+0000","last_change":"2023-07-09T21:38:22.414687+0000","last_active":"2023-07-09T21:38:25.509590+0000","last_peered":"2023-07-09T21:38:25.509590+0000","last_clean":"2023-07-09T21:38:25.509590+0000","last_became_active":"2023-07-09T21:38:22.414205+0000","last_became_peered":"2023-07-09T21:38:22.414205+0000","last_unstale":"2023-07-09T21:38:25.509590+0000","last_undegraded":"2023-07-09T21:38:25.509590+0000","last_fullsized":"2023-07-09T21:38:25.509590+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:52.233687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509733+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:38:25.509733+0000","last_peered":"2023-07-09T21:38:25.509733+0000","last_clean":"2023-07-09T21:38:25.509733+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:38:25.509733+0000","last_undegraded":"2023-07-09T21:38:25.509733+0000","last_fullsized":"2023-07-09T21:38:25.509733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:09:13.435458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.418625+0000","last_change":"2023-07-09T21:38:23.447474+0000","last_active":"2023-07-09T21:38:24.418625+0000","last_peered":"2023-07-09T21:38:24.418625+0000","last_clean":"2023-07-09T21:38:24.418625+0000","last_became_active":"2023-07-09T21:38:23.447083+0000","last_became_peered":"2023-07-09T21:38:23.447083+0000","last_unstale":"2023-07-09T21:38:24.418625+0000","last_undegraded":"2023-07-09T21:38:24.418625+0000","last_fullsized":"2023-07-09T21:38:24.418625+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:29.955492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"84'1","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.509593+0000","last_change":"2023-07-09T21:38:22.408792+0000","last_active":"2023-07-09T21:38:25.509593+0000","last_peered":"2023-07-09T21:38:25.509593+0000","last_clean":"2023-07-09T21:38:25.509593+0000","last_became_active":"2023-07-09T21:38:22.408483+0000","last_became_peered":"2023-07-09T21:38:22.408483+0000","last_unstale":"2023-07-09T21:38:25.509593+0000","last_undegraded":"2023-07-09T21:38:25.509593+0000","last_fullsized":"2023-07-09T21:38:25.509593+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:42.907929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":130,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:25.002637+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:38:25.002637+0000","last_peered":"2023-07-09T21:38:25.002637+0000","last_clean":"2023-07-09T21:38:25.002637+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:38:25.002637+0000","last_undegraded":"2023-07-09T21:38:25.002637+0000","last_fullsized":"2023-07-09T21:38:25.002637+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:39.290164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":11,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703518+0000","last_change":"2023-07-09T21:38:23.431671+0000","last_active":"2023-07-09T21:38:24.703518+0000","last_peered":"2023-07-09T21:38:24.703518+0000","last_clean":"2023-07-09T21:38:24.703518+0000","last_became_active":"2023-07-09T21:38:23.431150+0000","last_became_peered":"2023-07-09T21:38:23.431150+0000","last_unstale":"2023-07-09T21:38:24.703518+0000","last_undegraded":"2023-07-09T21:38:24.703518+0000","last_fullsized":"2023-07-09T21:38:24.703518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:22.374951+0000","last_clean_scrub_stamp":"2023-07-09T21:38:22.374951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:15.482933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.408971+0000","last_change":"2023-07-09T21:38:22.402484+0000","last_active":"2023-07-09T21:38:24.408971+0000","last_peered":"2023-07-09T21:38:24.408971+0000","last_clean":"2023-07-09T21:38:24.408971+0000","last_became_active":"2023-07-09T21:38:22.402194+0000","last_became_peered":"2023-07-09T21:38:22.402194+0000","last_unstale":"2023-07-09T21:38:24.408971+0000","last_undegraded":"2023-07-09T21:38:24.408971+0000","last_fullsized":"2023-07-09T21:38:24.408971+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:38:21.366784+0000","last_clean_scrub_stamp":"2023-07-09T21:38:21.366784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:00.028333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-09T21:38:24.703546+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:38:24.703546+0000","last_peered":"2023-07-09T21:38:24.703546+0000","last_clean":"2023-07-09T21:38:24.703546+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:38:24.703546+0000","last_undegraded":"2023-07-09T21:38:24.703546+0000","last_fullsized":"2023-07-09T21:38:24.703546+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:10:18.136556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":924,"num_write":239,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":58888,"kb_used_data":1600,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312952,"statfs":{"total":96636764160,"available":96576462848,"internally_reserved":0,"allocated":1638400,"data_stored":1106641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70099999999999996,"15min":0.70499999999999996},"min":{"1min":0.48999999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89800000000000002,"5min":0.99099999999999999,"15min":1.1180000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.71699999999999997,"15min":0.71999999999999997},"min":{"1min":0.53300000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.0069999999999999},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72799999999999998,"15min":0.72099999999999997},"min":{"1min":0.625,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93899999999999995,"5min":1.024,"15min":1.024},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.72399999999999998,"15min":0.72299999999999998},"min":{"1min":0.46899999999999997,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.76200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.71499999999999997,"15min":0.71899999999999997},"min":{"1min":0.55500000000000005,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":1.619},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73799999999999999,"15min":0.73199999999999998},"min":{"1min":0.52300000000000002,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97899999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.751,"15min":0.754},"min":{"1min":0.59199999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.665},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.61699999999999999,"5min":0.52100000000000002,"15min":0.48199999999999998},"max":{"1min":0.98599999999999999,"5min":1.129,"15min":1.2629999999999999},"last":0.74399999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.62,"15min":0.58899999999999997},"min":{"1min":0.41399999999999998,"5min":0.38600000000000001,"15min":0.33600000000000002},"max":{"1min":0.83099999999999996,"5min":1.012,"15min":1.0249999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.60699999999999998},"min":{"1min":0.44500000000000001,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":1.002},"last":0.62}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.63100000000000001,"15min":0.62},"min":{"1min":0.45400000000000001,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.93200000000000005,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66700000000000004,"15min":0.66000000000000003},"min":{"1min":0.499,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":0.84199999999999997,"5min":0.97799999999999998,"15min":1.0569999999999999},"last":0.71399999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72099999999999997,"15min":0.70899999999999996},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.375},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0569999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.67700000000000005,"15min":0.67200000000000004},"min":{"1min":0.50700000000000001,"5min":0.47699999999999998,"15min":0.39600000000000002},"max":{"1min":0.85599999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.73099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575043,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":515531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.67800000000000005,"15min":0.70199999999999996},"min":{"1min":0.502,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.871,"5min":0.97299999999999998,"15min":1.0569999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71399999999999997,"15min":0.72999999999999998},"min":{"1min":0.54800000000000004,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.98199999999999998,"5min":1.0820000000000001,"15min":1.2929999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74299999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.95799999999999996,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70099999999999996,"15min":0.72999999999999998},"min":{"1min":0.54100000000000004,"5min":0.379,"15min":0.379},"max":{"1min":0.91600000000000004,"5min":0.96999999999999997,"15min":1.1519999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.71599999999999997,"15min":0.73999999999999999},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":1.03,"5min":1.03,"15min":1.0589999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74099999999999999,"15min":0.75700000000000001},"min":{"1min":0.58199999999999996,"5min":0.375,"15min":0.375},"max":{"1min":0.93500000000000005,"5min":2.3730000000000002,"15min":2.3730000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.73699999999999999,"15min":0.76000000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.165},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.73799999999999999,"15min":0.754},"min":{"1min":0.502,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":0.99399999999999999,"5min":1.123,"15min":1.123},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56000000000000005,"15min":0.57499999999999996},"min":{"1min":0.442,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":0.628,"5min":0.90700000000000003,"15min":1.111},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.59099999999999997,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.94399999999999995,"15min":0.94599999999999995},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.61299999999999999,"15min":0.62},"min":{"1min":0.47199999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83599999999999997,"5min":1.075,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.627,"15min":0.64100000000000001},"min":{"1min":0.46100000000000002,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":0.84199999999999997,"5min":0.98999999999999999,"15min":1.1950000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.65200000000000002,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.95599999999999996,"5min":0.97399999999999998,"15min":1.006},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67400000000000004,"15min":0.68899999999999995},"min":{"1min":0.52300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.82399999999999995,"5min":1.21,"15min":1.21},"last":0.76600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575042,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50104,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321736,"statfs":{"total":96636764160,"available":96585457664,"internally_reserved":0,"allocated":1032192,"data_stored":515519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.70499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.86199999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70099999999999996,"15min":0.71599999999999997},"min":{"1min":0.504,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83399999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.70499999999999996,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92000000000000004,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.72399999999999998,"15min":0.73399999999999999},"min":{"1min":0.60799999999999998,"5min":0.51100000000000001,"15min":0.45200000000000001},"max":{"1min":0.92100000000000004,"5min":0.96199999999999997,"15min":0.999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.80700000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.73899999999999999},"min":{"1min":0.63100000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.93600000000000005,"5min":1.01,"15min":1.01},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.745,"15min":0.745},"min":{"1min":0.58499999999999996,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.71999999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60799999999999998,"15min":0.61099999999999999},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":0.76300000000000001,"5min":0.98399999999999999,"15min":1.0169999999999999},"last":0.874}]},{"osd":6,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.443,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.84999999999999998,"5min":0.98899999999999999,"15min":0.99299999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.64300000000000002,"15min":0.63800000000000001},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.038},"last":0.85999999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82699999999999996,"5min":0.97599999999999998,"15min":1.014},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69599999999999995,"15min":0.68799999999999994},"min":{"1min":0.51300000000000001,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":0.89300000000000002,"5min":0.98799999999999999,"15min":1.0389999999999999},"last":0.78700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":517061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70999999999999996,"15min":0.71799999999999997},"min":{"1min":0.44400000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.88900000000000001,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.70099999999999996},"min":{"1min":0.63800000000000001,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.90900000000000003,"15min":0.94699999999999995},"last":0.874}]},{"osd":1,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73499999999999999,"15min":0.72599999999999998},"min":{"1min":0.60099999999999998,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72399999999999998,"15min":0.72499999999999998},"min":{"1min":0.58899999999999997,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.89200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.73899999999999999,"15min":0.73799999999999999},"min":{"1min":0.54800000000000004,"5min":0.46700000000000003,"15min":0.45800000000000002},"max":{"1min":0.95999999999999996,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.75900000000000001,"15min":0.75},"min":{"1min":0.58499999999999996,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94799999999999995,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.84699999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.73599999999999999,"15min":0.72499999999999998},"min":{"1min":0.65400000000000003,"5min":0.51300000000000001,"15min":0.47099999999999997},"max":{"1min":0.93300000000000005,"5min":1.26,"15min":1.26},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76100000000000001,"15min":0.76000000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.165},"last":0.90800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59599999999999997,"15min":0.59899999999999998},"min":{"1min":0.41499999999999998,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":0.78800000000000003,"5min":0.92800000000000005,"15min":1.1859999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":0.82799999999999996,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.56200000000000006}]},{"osd":6,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61499999999999999,"15min":0.61899999999999999},"min":{"1min":0.433,"5min":0.377,"15min":0.377},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.97099999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.66400000000000003},"min":{"1min":0.48999999999999999,"5min":0.46200000000000002,"15min":0.39300000000000002},"max":{"1min":0.98299999999999998,"5min":1.0049999999999999,"15min":1.107},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65500000000000003,"15min":0.66300000000000003},"min":{"1min":0.45900000000000002,"5min":0.45200000000000001,"15min":0.376},"max":{"1min":0.91600000000000004,"5min":0.93600000000000005,"15min":0.997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.70599999999999996,"15min":0.69999999999999996},"min":{"1min":0.49399999999999999,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.999,"5min":0.999,"15min":1.042},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575043,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32052,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339788,"statfs":{"total":96636764160,"available":96603942912,"internally_reserved":0,"allocated":1028096,"data_stored":515497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.33900000000000002,"5min":0.317,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53700000000000003,"15min":0.53200000000000003},"min":{"1min":0.42899999999999999,"5min":0.38300000000000001,"15min":0.34699999999999998},"max":{"1min":0.68200000000000005,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.48399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46700000000000003,"15min":0.46400000000000002},"min":{"1min":0.34799999999999998,"5min":0.29399999999999998,"15min":0.26800000000000002},"max":{"1min":0.60699999999999998,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.40300000000000002,"5min":0.35799999999999998,"15min":0.312},"max":{"1min":0.69599999999999995,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.39300000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.47099999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85099999999999998,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.503,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.91300000000000003,"5min":0.91900000000000004,"15min":0.93799999999999994},"last":0.55200000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.64700000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.022,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.80900000000000005,"15min":0.81599999999999995},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":1.0760000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.82299999999999995},"min":{"1min":0.59499999999999997,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.127,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.80400000000000005},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0349999999999999,"5min":1.1799999999999999,"15min":1.208},"last":0.95899999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.78700000000000003,"15min":0.78000000000000003},"min":{"1min":0.67000000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.51,"15min":1.51},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.76600000000000001},"min":{"1min":0.63300000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.94899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:37:44 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.79100000000000004},"min":{"1min":0.60999999999999999,"5min":0.52800000000000002,"15min":0.50600000000000001},"max":{"1min":0.98599999999999999,"5min":1.1100000000000001,"15min":1.296},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77300000000000002,"15min":0.78900000000000003},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.48599999999999999},"max":{"1min":0.99399999999999999,"5min":1.1910000000000001,"15min":1.323},"last":0.90100000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575044,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54196,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317644,"statfs":{"total":96636764160,"available":96581267456,"internally_reserved":0,"allocated":1028096,"data_stored":515497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48799999999999999,"15min":0.46100000000000002},"min":{"1min":0.35099999999999998,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.375},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53500000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.95699999999999996},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47199999999999998,"15min":0.46899999999999997},"min":{"1min":0.32600000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.77200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.438,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":1.0409999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57599999999999996},"min":{"1min":0.41899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.80200000000000005,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.40699999999999997,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77700000000000002,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.70899999999999996,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":1.21,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.503},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.80600000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1659999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.72999999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.80300000000000005,"15min":0.82499999999999996},"min":{"1min":0.62,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.149,"5min":1.377,"15min":1.3839999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.82499999999999996,"15min":0.82099999999999995},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":1.353,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.84099999999999997,"15min":0.84399999999999997},"min":{"1min":0.69899999999999995,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":1.2829999999999999,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.79800000000000004,"15min":0.81200000000000006},"min":{"1min":0.625,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":1.3100000000000001,"5min":1.423,"15min":1.423},"last":0.56699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:37:53 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.84399999999999997,"15min":0.84099999999999997},"min":{"1min":0.68799999999999994,"5min":0.56699999999999995,"15min":0.56599999999999995},"max":{"1min":1.252,"5min":1.48,"15min":1.48},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82799999999999996,"15min":0.85199999999999998},"min":{"1min":0.63900000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1140000000000001,"5min":1.496,"15min":1.496},"last":0.61099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575044,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":1032,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":1056768,"data_stored":517825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.46700000000000003,"15min":0.45700000000000002},"min":{"1min":0.37,"5min":0.252,"15min":0.23899999999999999},"max":{"1min":0.67800000000000005,"5min":0.76800000000000002,"15min":0.871},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.51400000000000001,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.32000000000000001,"15min":0.27200000000000002},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.35999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.51700000000000002,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.67100000000000004,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56299999999999994,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.81899999999999995,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.39000000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.61499999999999999,"15min":0.59699999999999998},"min":{"1min":0.48199999999999998,"5min":0.40300000000000002,"15min":0.378},"max":{"1min":1.0129999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.42499999999999999,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":1.385},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.67400000000000004,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.0660000000000001,"5min":1.129,"15min":1.3069999999999999},"last":1.129},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.82099999999999995},"min":{"1min":0.61699999999999999,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.0169999999999999,"5min":1.212,"15min":1.419},"last":0.98299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.51900000000000002,"15min":0.51800000000000002},"max":{"1min":1.087,"5min":1.1839999999999999,"15min":1.4630000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78700000000000003,"15min":0.79800000000000004},"min":{"1min":0.64300000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96199999999999997,"5min":1.149,"15min":1.242},"last":1.0149999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76400000000000001,"15min":0.77500000000000002},"min":{"1min":0.56699999999999995,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":0.98499999999999999,"5min":1.018,"15min":1.335},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.82499999999999996,"15min":0.81899999999999995},"min":{"1min":0.53400000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0329999999999999,"5min":1.258,"15min":1.3799999999999999},"last":1.1699999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:37:46 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.626,"5min":0.54300000000000004,"15min":0.53600000000000003},"max":{"1min":0.996,"5min":1.173,"15min":1.173},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.59699999999999998,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":0.98399999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":1.1899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575044,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36728,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94335112,"statfs":{"total":96636764160,"available":96599154688,"internally_reserved":0,"allocated":1622016,"data_stored":1105865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.47299999999999998,"15min":0.47399999999999998},"min":{"1min":0.35399999999999998,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.66900000000000004,"5min":0.753,"15min":0.753},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.47299999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":0.71299999999999997,"5min":0.77400000000000002,"15min":1.0489999999999999},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.52300000000000002},"min":{"1min":0.372,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":0.74099999999999999,"5min":1.018,"15min":1.018},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53600000000000003},"min":{"1min":0.47499999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.625,"5min":1.038,"15min":1.038},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.50900000000000001,"15min":0.501},"min":{"1min":0.38300000000000001,"5min":0.315,"15min":0.29899999999999999},"max":{"1min":0.63700000000000001,"5min":0.83999999999999997,"15min":1.143},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58099999999999996,"15min":0.58399999999999996},"min":{"1min":0.46000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79300000000000004,"5min":1.05,"15min":1.274},"last":0.438}]},{"osd":4,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80400000000000005,"15min":0.80800000000000005},"min":{"1min":0.60699999999999998,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.6559999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.80100000000000005,"15min":0.79400000000000004},"min":{"1min":0.66600000000000004,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.319},"last":0.754}]},{"osd":5,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81399999999999995,"15min":0.80800000000000005},"min":{"1min":0.67900000000000005,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.095,"5min":1.1890000000000001,"15min":1.4350000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.80300000000000005,"15min":0.80500000000000005},"min":{"1min":0.65000000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0960000000000001,"5min":1.2090000000000001,"15min":1.5269999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81599999999999995,"15min":0.80500000000000005},"min":{"1min":0.56399999999999995,"5min":0.51000000000000001,"15min":0.5},"max":{"1min":1.137,"5min":1.1719999999999999,"15min":1.3959999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.628,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96399999999999997,"5min":1.236,"15min":1.3660000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.82399999999999995,"15min":0.82099999999999995},"min":{"1min":0.71999999999999997,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.5980000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.2709999999999999,"5min":1.282,"15min":1.5740000000000001},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:38:32.495 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:38:32.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:38:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 Processor -- start 2023-07-09T21:38:32.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 -- start start 2023-07-09T21:38:32.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 0x7f916c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f916c0d0780 0x7f916c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c15bf80 con 0x7f916c0ceb80 2023-07-09T21:38:32.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c0cd070 con 0x7f916c0d0780 2023-07-09T21:38:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9173819640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f916c0cfd70 con 0x7f916c0b7980 2023-07-09T21:38:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9170db4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f916c0ceb80 0x7f916c0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55008/0 (socket says 172.21.15.37:55008) 2023-07-09T21:38:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9170db4640 1 -- 172.21.15.37:0/2833649170 learned_addr learned my addr 172.21.15.37:0/2833649170 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:32.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9171db6640 1 --2- 172.21.15.37:0/2833649170 >> v2:172.21.15.37:3300/0 conn(0x7f916c0d0780 0x7f916c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f91715b5640 1 --2- 172.21.15.37:0/2833649170 >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 0x7f916c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9171db6640 1 -- 172.21.15.37:0/2833649170 >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 msgr2=0x7f916c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9171db6640 1 --2- 172.21.15.37:0/2833649170 >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 0x7f916c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9171db6640 1 -- 172.21.15.37:0/2833649170 >> v1:172.21.15.37:6789/0 conn(0x7f916c0ceb80 legacy=0x7f916c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f9171db6640 1 -- 172.21.15.37:0/2833649170 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c160570 con 0x7f916c0d0780 2023-07-09T21:38:32.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.679+0000 7f91715b5640 1 --2- 172.21.15.37:0/2833649170 >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 0x7f916c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9171db6640 1 --2- 172.21.15.37:0/2833649170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0d0b80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f916c069aa0 tx=0x7f916401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e37c9c26899810 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9163fff640 1 -- 172.21.15.37:0/2833649170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a57d0 con 0x7f916c0d0780 2023-07-09T21:38:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9163fff640 1 -- 172.21.15.37:0/2833649170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640a5930 con 0x7f916c0d0780 2023-07-09T21:38:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9163fff640 1 -- 172.21.15.37:0/2833649170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640a5cc0 con 0x7f916c0d0780 2023-07-09T21:38:32.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 -- 172.21.15.37:0/2833649170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 msgr2=0x7f916c0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 --2- 172.21.15.37:0/2833649170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0d0b80 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f916c069aa0 tx=0x7f916401c910 comp rx=0 tx=0).stop 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 -- 172.21.15.37:0/2833649170 shutdown_connections 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 --2- 172.21.15.37:0/2833649170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0d0b80 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 --2- 172.21.15.37:0/2833649170 >> v2:172.21.15.119:3300/0 conn(0x7f916c0b7980 0x7f916c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 -- 172.21.15.37:0/2833649170 >> 172.21.15.37:0/2833649170 conn(0x7f916c073090 msgr2=0x7f916c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 -- 172.21.15.37:0/2833649170 shutdown_connections 2023-07-09T21:38:32.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.683+0000 7f9173819640 1 -- 172.21.15.37:0/2833649170 wait complete. 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 Processor -- start 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- start start 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 0x7f916c14d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 0x7f916c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c15a770 con 0x7f916c0d0780 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1598a0 con 0x7f916c0b7980 2023-07-09T21:38:32.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c159af0 con 0x7f916c0ceb80 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40904/0 (socket says 172.21.15.37:40904) 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 -- 172.21.15.37:0/39244448 learned_addr learned my addr 172.21.15.37:0/39244448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f91715b5640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 0x7f916c14d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9170db4640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 0x7f916c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 -- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 msgr2=0x7f916c15ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 0x7f916c15ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 -- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 msgr2=0x7f916c14d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 0x7f916c14d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 -- 172.21.15.37:0/39244448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009a70 con 0x7f916c0d0780 2023-07-09T21:38:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f91715b5640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 0x7f916c14d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9170db4640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 0x7f916c15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:32.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9171db6640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f91640b0040 tx=0x7f91640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640b9860 con 0x7f916c0d0780 2023-07-09T21:38:32.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640b99c0 con 0x7f916c0d0780 2023-07-09T21:38:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c159dd0 con 0x7f916c0d0780 2023-07-09T21:38:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91640b9d70 con 0x7f916c0d0780 2023-07-09T21:38:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c15a390 con 0x7f916c0d0780 2023-07-09T21:38:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.687+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c15a8b0 con 0x7f916c0d0780 2023-07-09T21:38:32.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.691+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f91640c4460 con 0x7f916c0d0780 2023-07-09T21:38:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.691+0000 7f9161ffb640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 0x7f9150068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.691+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f916411f240 con 0x7f916c0d0780 2023-07-09T21:38:32.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.691+0000 7f91715b5640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 0x7f9150068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.691+0000 7f91715b5640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 0x7f9150068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9168009970 tx=0x7f9168008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:32.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.695+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f916c15a8b0 con 0x7f916c0d0780 2023-07-09T21:38:32.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.907+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f916c160570 con 0x7f916c0d0780 2023-07-09T21:38:32.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.911+0000 7f9161ffb640 1 -- 172.21.15.37:0/39244448 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f916c160570 con 0x7f916c0d0780 2023-07-09T21:38:32.913 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:38:32.914 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:38:32.914 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:38:32.914 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:38:32.914 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:38:32.914 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:38:32.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 msgr2=0x7f9150068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 0x7f9150068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9168009970 tx=0x7f9168008040 comp rx=0 tx=0).stop 2023-07-09T21:38:32.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 msgr2=0x7f916c0c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:32.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f91640b0040 tx=0x7f91640196b0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 shutdown_connections 2023-07-09T21:38:32.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91500663a0 0x7f9150068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f916c0d0780 0x7f916c0c8200 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f916c0ceb80 0x7f916c15ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 --2- 172.21.15.37:0/39244448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f916c0b7980 0x7f916c14d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:32.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 >> 172.21.15.37:0/39244448 conn(0x7f916c073090 msgr2=0x7f916c0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:32.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 shutdown_connections 2023-07-09T21:38:32.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:32.915+0000 7f9173819640 1 -- 172.21.15.37:0/39244448 wait complete. 2023-07-09T21:38:32.935 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 Processor -- start 2023-07-09T21:38:33.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 -- start start 2023-07-09T21:38:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51e40cef80 0x7f51e40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40b49f0 con 0x7f51e40b7ab0 2023-07-09T21:38:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40b7e80 con 0x7f51e40cef80 2023-07-09T21:38:33.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51ea056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40cc8a0 con 0x7f51e40b4340 2023-07-09T21:38:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f51e40cef80 0x7f51e40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40992/0 (socket says 172.21.15.37:40992) 2023-07-09T21:38:33.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 -- 172.21.15.37:0/3129948281 learned_addr learned my addr 172.21.15.37:0/3129948281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 -- 172.21.15.37:0/3129948281 >> v2:172.21.15.119:3300/0 conn(0x7f51e40cef80 msgr2=0x7f51e40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 --2- 172.21.15.37:0/3129948281 >> v2:172.21.15.119:3300/0 conn(0x7f51e40cef80 0x7f51e40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 -- 172.21.15.37:0/3129948281 >> v1:172.21.15.119:6789/0 conn(0x7f51e40b7ab0 legacy=0x7f51e40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.075+0000 7f51e2ffd640 1 -- 172.21.15.37:0/3129948281 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40ccb80 con 0x7f51e40b4340 2023-07-09T21:38:33.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51e2ffd640 1 --2- 172.21.15.37:0/3129948281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009870 tx=0x7f51d801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299823bae043b305 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51e27fc640 1 -- 172.21.15.37:0/3129948281 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80aa670 con 0x7f51e40b4340 2023-07-09T21:38:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51e27fc640 1 -- 172.21.15.37:0/3129948281 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d80aa7d0 con 0x7f51e40b4340 2023-07-09T21:38:33.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51e27fc640 1 -- 172.21.15.37:0/3129948281 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d80aab60 con 0x7f51e40b4340 2023-07-09T21:38:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 -- 172.21.15.37:0/3129948281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 msgr2=0x7f51e406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 --2- 172.21.15.37:0/3129948281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009870 tx=0x7f51d801c510 comp rx=0 tx=0).stop 2023-07-09T21:38:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 -- 172.21.15.37:0/3129948281 shutdown_connections 2023-07-09T21:38:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 --2- 172.21.15.37:0/3129948281 >> v2:172.21.15.119:3300/0 conn(0x7f51e40cef80 0x7f51e40d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 --2- 172.21.15.37:0/3129948281 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40b4340 0x7f51e406aa50 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 -- 172.21.15.37:0/3129948281 >> 172.21.15.37:0/3129948281 conn(0x7f51e4073090 msgr2=0x7f51e4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 -- 172.21.15.37:0/3129948281 shutdown_connections 2023-07-09T21:38:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.079+0000 7f51ea056640 1 -- 172.21.15.37:0/3129948281 wait complete. 2023-07-09T21:38:33.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 Processor -- start 2023-07-09T21:38:33.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- start start 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51e40b7ab0 0x7f51e40b6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40cef80 0x7f51e414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40c5f10 con 0x7f51e40b4340 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40c8910 con 0x7f51e40b7ab0 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40c8070 con 0x7f51e40cef80 2023-07-09T21:38:33.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40916/0 (socket says 172.21.15.37:40916) 2023-07-09T21:38:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 -- 172.21.15.37:0/4262144228 learned_addr learned my addr 172.21.15.37:0/4262144228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e3fff640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40cef80 0x7f51e414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e2ffd640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51e40b7ab0 0x7f51e40b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 -- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40cef80 msgr2=0x7f51e414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40cef80 0x7f51e414e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 -- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51e40b7ab0 msgr2=0x7f51e40b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51e40b7ab0 0x7f51e40b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 -- 172.21.15.37:0/4262144228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80094d0 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51e37fe640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c500 tx=0x7f51d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4005220 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40c8350 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d4005380 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d4007270 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.083+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e41547a0 con 0x7f51e40b4340 2023-07-09T21:38:33.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e40c5ce0 con 0x7f51e40b4340 2023-07-09T21:38:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51d40073d0 con 0x7f51e40b4340 2023-07-09T21:38:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51cbfff640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 0x7f51d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f51d4083260 con 0x7f51e40b4340 2023-07-09T21:38:33.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51e2ffd640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 0x7f51d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.087+0000 7f51e2ffd640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 0x7f51d0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51d80ae000 tx=0x7f51d80b5040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.091+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51d40505f0 con 0x7f51e40b4340 2023-07-09T21:38:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.279+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e404d7d0 con 0x7f51e40b4340 2023-07-09T21:38:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.279+0000 7f51cbfff640 1 -- 172.21.15.37:0/4262144228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f51d4053c10 con 0x7f51e40b4340 2023-07-09T21:38:33.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:33.282 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 msgr2=0x7f51d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 0x7f51d0068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51d80ae000 tx=0x7f51d80b5040 comp rx=0 tx=0).stop 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 msgr2=0x7f51e40ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f51d400c500 tx=0x7f51d400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 shutdown_connections 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f51d00663a0 0x7f51d0068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f51e40cef80 0x7f51e414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f51e40b7ab0 0x7f51e40b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 --2- 172.21.15.37:0/4262144228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51e40b4340 0x7f51e40ca350 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 >> 172.21.15.37:0/4262144228 conn(0x7f51e4073090 msgr2=0x7f51e40d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 shutdown_connections 2023-07-09T21:38:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.283+0000 7f51ea056640 1 -- 172.21.15.37:0/4262144228 wait complete. 2023-07-09T21:38:33.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:38:22.783167+0000', 'modified': '2023-07-09T21:38:26.449890+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6556}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6556': {'gid': 6556, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6837/1629652523', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6835', 'nonce': 1629652523}, {'type': 'v1', 'addr': '172.21.15.119:6837', 'nonce': 1629652523}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:38:33.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:38:33.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-09T21:38:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.847+0000 7f9147a34640 1 Processor -- start 2023-07-09T21:38:33.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.847+0000 7f9147a34640 1 -- start start 2023-07-09T21:38:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f9147a34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91400b7a60 0x7f91400cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f9147a34640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f91400b47a0 0x7f91400b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f9147a34640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91400cef80 con 0x7f91400b4140 2023-07-09T21:38:33.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f9147a34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400b45e0 con 0x7f91400b7a60 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f9147a34640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91400cf260 con 0x7f91400b47a0 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91400b7a60 0x7f91400cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91400b7a60 0x7f91400cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40928/0 (socket says 172.21.15.37:40928) 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 -- 172.21.15.37:0/2588237834 learned_addr learned my addr 172.21.15.37:0/2588237834 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 -- 172.21.15.37:0/2588237834 >> v2:172.21.15.119:3300/0 conn(0x7f91400b47a0 msgr2=0x7f91400b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 --2- 172.21.15.37:0/2588237834 >> v2:172.21.15.119:3300/0 conn(0x7f91400b47a0 0x7f91400b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 -- 172.21.15.37:0/2588237834 >> v1:172.21.15.37:6789/0 conn(0x7f91400b4140 legacy=0x7f914015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.851+0000 7f91457d0640 1 -- 172.21.15.37:0/2588237834 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91400cf540 con 0x7f91400b7a60 2023-07-09T21:38:33.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f91457d0640 1 --2- 172.21.15.37:0/2588237834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91400cc7d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f91400c91b0 tx=0x7f913c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f0de56836940ef server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9137fff640 1 -- 172.21.15.37:0/2588237834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ab5f0 con 0x7f91400b7a60 2023-07-09T21:38:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9137fff640 1 -- 172.21.15.37:0/2588237834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0ab750 con 0x7f91400b7a60 2023-07-09T21:38:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9137fff640 1 -- 172.21.15.37:0/2588237834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0abae0 con 0x7f91400b7a60 2023-07-09T21:38:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- 172.21.15.37:0/2588237834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 msgr2=0x7f91400cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 --2- 172.21.15.37:0/2588237834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91400cc7d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f91400c91b0 tx=0x7f913c01c500 comp rx=0 tx=0).stop 2023-07-09T21:38:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- 172.21.15.37:0/2588237834 shutdown_connections 2023-07-09T21:38:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 --2- 172.21.15.37:0/2588237834 >> v2:172.21.15.119:3300/0 conn(0x7f91400b47a0 0x7f91400b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 --2- 172.21.15.37:0/2588237834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91400cc7d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- 172.21.15.37:0/2588237834 >> 172.21.15.37:0/2588237834 conn(0x7f9140073050 msgr2=0x7f9140069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- 172.21.15.37:0/2588237834 shutdown_connections 2023-07-09T21:38:33.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- 172.21.15.37:0/2588237834 wait complete. 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 Processor -- start 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.855+0000 7f9147a34640 1 -- start start 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91400b4140 0x7f9140150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91400b47a0 0x7f91401542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9140152390 con 0x7f91400b7a60 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9140150ff0 con 0x7f91400b47a0 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9140151780 con 0x7f91400b4140 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40944/0 (socket says 172.21.15.37:40944) 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 -- 172.21.15.37:0/451248505 learned_addr learned my addr 172.21.15.37:0/451248505 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9144fcf640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91400b47a0 0x7f91401542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f91457d0640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91400b4140 0x7f9140150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 -- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91400b4140 msgr2=0x7f9140150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91400b4140 0x7f9140150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 -- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91400b47a0 msgr2=0x7f91401542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91400b47a0 0x7f91401542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 -- 172.21.15.37:0/451248505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0094d0 con 0x7f91400b7a60 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9145fd1640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f913800c730 tx=0x7f913800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9135ffb640 1 -- 172.21.15.37:0/451248505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9138003b80 con 0x7f91400b7a60 2023-07-09T21:38:33.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9135ffb640 1 -- 172.21.15.37:0/451248505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9138003ce0 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9135ffb640 1 -- 172.21.15.37:0/451248505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913800aa30 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9140151a60 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9140152020 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.859+0000 7f9135ffb640 1 -- 172.21.15.37:0/451248505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f913800ab90 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9135ffb640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 0x7f9124068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9135ffb640 1 -- 172.21.15.37:0/451248505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9138083c40 con 0x7f91400b7a60 2023-07-09T21:38:33.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f91457d0640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 0x7f9124068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 Processor -- start 2023-07-09T21:38:33.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 -- start start 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f91457d0640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 0x7f9124068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f913c0af000 tx=0x7f913c0a7000 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 0x55d586d3dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586cf3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586cf4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586bbaf80 con 0x55d586cf3f90 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586af4c60 con 0x55d586d3d800 2023-07-09T21:38:33.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d586b48700 con 0x55d586d3e110 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f91457d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 0x55d586d3dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586cf4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f91457d0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 0x55d586d3dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40328/0 (socket says 172.21.15.37:40328) 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9144fcf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586cf3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f91457d0640 1 -- 172.21.15.37:0/1582510912 learned_addr learned my addr 172.21.15.37:0/1582510912 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 -- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 msgr2=0x55d586cf3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586cf3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 -- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 msgr2=0x55d586d3dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 0x55d586d3dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.863+0000 7f9145fd1640 1 -- 172.21.15.37:0/1582510912 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d58683d890 con 0x55d586cf3f90 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9145fd1640 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586cf4360 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9138081e80 tx=0x7f913800af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2af337e4e026923 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9122ffd640 1 -- 172.21.15.37:0/1582510912 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913807f020 con 0x55d586cf3f90 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9122ffd640 1 -- 172.21.15.37:0/1582510912 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9138081f60 con 0x55d586cf3f90 2023-07-09T21:38:33.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9122ffd640 1 -- 172.21.15.37:0/1582510912 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91380820d0 con 0x55d586cf3f90 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- 172.21.15.37:0/1582510912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 msgr2=0x55d586cf4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586cf4360 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9138081e80 tx=0x7f913800af60 comp rx=0 tx=0).stop 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- 172.21.15.37:0/1582510912 shutdown_connections 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586cf4360 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586cf3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- 172.21.15.37:0/1582510912 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3d800 0x55d586d3dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- 172.21.15.37:0/1582510912 >> 172.21.15.37:0/1582510912 conn(0x55d586bb6a70 msgr2=0x55d586cf2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- 172.21.15.37:0/1582510912 shutdown_connections 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- 172.21.15.37:0/1582510912 wait complete. 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- start start 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 Processor -- start 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586cf3f90 0x55d586cfefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586cffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586b417a0 con 0x55d586d3d800 2023-07-09T21:38:33.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586afdf00 con 0x55d586d3e110 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d586afdba0 con 0x55d586cf3f90 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f914adb4000 10 client.0 _ll_register_callbacks cb 0x55d586cdf930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40966/0 (socket says 172.21.15.37:40966) 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 -- 172.21.15.37:0/584330112 learned_addr learned my addr 172.21.15.37:0/584330112 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9145fd1640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586cffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f91457d0640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586cf3f90 0x55d586cfefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 -- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586cf3f90 msgr2=0x55d586cfefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586cf3f90 0x55d586cfefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 -- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 msgr2=0x55d586cffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586cffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 -- 172.21.15.37:0/584330112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9140152020 con 0x55d586d3d800 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9145fd1640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586cffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f9144fcf640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f91401f7ca0 tx=0x7f9130010960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8554e4697b6e574e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.867+0000 7f911bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9130016750 con 0x55d586d3d800 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f91300168b0 con 0x55d586d3d800 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d586b400f0 con 0x55d586d3d800 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9130016a70 con 0x55d586d3d800 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 10 client.6990 fetch_fsmap learned FSMap version 32 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55d586b06130 con 0x55d586d3d800 2023-07-09T21:38:33.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d586b400f0 con 0x55d586d3d800 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9130016bd0 con 0x55d586d3d800 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 10 client.6990 fetch_fsmap finished waiting for FSMap version 32 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 10 client.6990 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 20 client.6990 populate_metadata read hostname 'smithi037' 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586d00320 0x55d586d4ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 4 client.6990 mds_command: new command op to 6556 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 --> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d586b08e40 con 0x55d586d00320 2023-07-09T21:38:33.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f91457d0640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586d00320 0x55d586d4ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 10 client.6990 ms_handle_connect on v2:172.21.15.119:6835/1629652523 2023-07-09T21:38:33.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f91457d0640 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586d00320 0x55d586d4ed50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca3368f341940f23 server_cookie=8100910a14645ac2 in_seq=0 out_seq=0 2023-07-09T21:38:33.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 1 -- 172.21.15.37:0/584330112 <== mds.0 v2:172.21.15.119:6835/1629652523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d586b08e40 con 0x55d586d00320 2023-07-09T21:38:33.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 10 client.6990 handle_command_reply: tid=0 2023-07-09T21:38:33.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 client.6990 shutdown 2023-07-09T21:38:33.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 msgr2=0x55d586cff510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f91401f7ca0 tx=0x7f9130010960 comp rx=0 tx=0).stop 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 shutdown_connections 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586d00320 0x55d586d4ed50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586cffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586cff510 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 --2- 172.21.15.37:0/584330112 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586cf3f90 0x55d586cfefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f911bfff640 0 client.6990 ms_handle_reset on v2:172.21.15.119:6835/1629652523 2023-07-09T21:38:33.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 >> 172.21.15.37:0/584330112 conn(0x55d586bb6a70 msgr2=0x55d586cf2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 shutdown_connections 2023-07-09T21:38:33.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.871+0000 7f914adb4000 1 -- 172.21.15.37:0/584330112 wait complete. 2023-07-09T21:38:33.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.875+0000 7f914adb4000 20 client.6990 trim_cache size 0 max 16384 2023-07-09T21:38:33.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.887+0000 7f914adb4000 1 Processor -- start 2023-07-09T21:38:33.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.887+0000 7f914adb4000 1 -- start start 2023-07-09T21:38:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3d800 0x55d586d509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586d388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5867fe940 con 0x55d586cf3f90 2023-07-09T21:38:33.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586cff8d0 con 0x55d586d3e110 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d586cf8490 con 0x55d586d3d800 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40972/0 (socket says 172.21.15.37:40972) 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 -- 172.21.15.37:0/2125937155 learned_addr learned my addr 172.21.15.37:0/2125937155 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f9144fcf640 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3d800 0x55d586d509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f9145fd1640 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586d388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 -- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3d800 msgr2=0x55d586d509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3d800 0x55d586d509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 -- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 msgr2=0x55d586d388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586d388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 -- 172.21.15.37:0/2125937155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d586aec3c0 con 0x55d586cf3f90 2023-07-09T21:38:33.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91457d0640 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f913c01c540 tx=0x7f913c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a344b8855d90c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91237fe640 1 -- 172.21.15.37:0/2125937155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0abc90 con 0x55d586cf3f90 2023-07-09T21:38:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91237fe640 1 -- 172.21.15.37:0/2125937155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0c6040 con 0x55d586cf3f90 2023-07-09T21:38:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f91237fe640 1 -- 172.21.15.37:0/2125937155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0cc9d0 con 0x55d586cf3f90 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- 172.21.15.37:0/2125937155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 msgr2=0x55d586d50470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f913c01c540 tx=0x7f913c004740 comp rx=0 tx=0).stop 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- 172.21.15.37:0/2125937155 shutdown_connections 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586d3e110 0x55d586d388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3d800 0x55d586d509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- 172.21.15.37:0/2125937155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586cf3f90 0x55d586d50470 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- 172.21.15.37:0/2125937155 >> 172.21.15.37:0/2125937155 conn(0x55d586bb6a70 msgr2=0x55d586d4ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- 172.21.15.37:0/2125937155 shutdown_connections 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- 172.21.15.37:0/2125937155 wait complete. 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- start start 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 Processor -- start 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586cf3f90 0x55d586d9aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586d3b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586cf3ab0 con 0x55d586d3d800 2023-07-09T21:38:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d586b9a230 con 0x55d586cf3f90 2023-07-09T21:38:33.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d586b02d60 con 0x55d586d3e110 2023-07-09T21:38:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.891+0000 7f914adb4000 10 client.0 _ll_register_callbacks cb 0x55d586cc04d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:38:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40988/0 (socket says 172.21.15.37:40988) 2023-07-09T21:38:33.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 -- 172.21.15.37:0/3609769778 learned_addr learned my addr 172.21.15.37:0/3609769778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f91457d0640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586cf3f90 0x55d586d9aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9145fd1640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586d3b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 -- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 msgr2=0x55d586d3b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586d3b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 -- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586cf3f90 msgr2=0x55d586d9aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586cf3f90 0x55d586d9aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 -- 172.21.15.37:0/3609769778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0ba070 con 0x55d586d3d800 2023-07-09T21:38:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f9144fcf640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f91300144b0 tx=0x7f91300047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5896fcfcdf1bf99a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:38:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913000be00 con 0x55d586d3d800 2023-07-09T21:38:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d586cf7920 con 0x55d586d3d800 2023-07-09T21:38:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9130014550 con 0x55d586d3d800 2023-07-09T21:38:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9130014710 con 0x55d586d3d800 2023-07-09T21:38:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 10 client.6996 fetch_fsmap learned FSMap version 32 2023-07-09T21:38:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55d58683dcc0 con 0x55d586d3d800 2023-07-09T21:38:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d586cf7920 con 0x55d586d3d800 2023-07-09T21:38:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f913002e070 con 0x55d586d3d800 2023-07-09T21:38:33.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 10 client.6996 fetch_fsmap finished waiting for FSMap version 32 2023-07-09T21:38:33.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 10 client.6996 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:38:33.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 20 client.6996 populate_metadata read hostname 'smithi037' 2023-07-09T21:38:33.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586da1e50 0x55d586da4230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:33.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 4 client.6996 mds_command: new command op to 6556 tid=0[{"prefix": "status"}] 2023-07-09T21:38:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 --> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d586afa6f0 con 0x55d586da1e50 2023-07-09T21:38:33.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f91457d0640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586da1e50 0x55d586da4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:33.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f91457d0640 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586da1e50 0x55d586da4230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0d2bd8fd3edec22 server_cookie=84a37935fe4d54b in_seq=0 out_seq=0 2023-07-09T21:38:33.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 10 client.6996 ms_handle_connect on v2:172.21.15.119:6835/1629652523 2023-07-09T21:38:33.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 1 -- 172.21.15.37:0/3609769778 <== mds.0 v2:172.21.15.119:6835/1629652523 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d586afa6f0 con 0x55d586da1e50 2023-07-09T21:38:33.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 10 client.6996 handle_command_reply: tid=0 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 client.6996 shutdown 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 msgr2=0x55d586d9b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f91300144b0 tx=0x7f91300047e0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 shutdown_connections 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:6835/1629652523,v1:172.21.15.119:6837/1629652523] conn(0x55d586da1e50 0x55d586da4230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d586d3e110 0x55d586d3b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d586d3d800 0x55d586d9b530 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f911bfff640 0 client.6996 ms_handle_reset on v2:172.21.15.119:6835/1629652523 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 --2- 172.21.15.37:0/3609769778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d586cf3f90 0x55d586d9aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 >> 172.21.15.37:0/3609769778 conn(0x55d586bb6a70 msgr2=0x55d586d4ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 shutdown_connections 2023-07-09T21:38:33.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 1 -- 172.21.15.37:0/3609769778 wait complete. 2023-07-09T21:38:33.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.895+0000 7f914adb4000 20 client.6996 trim_cache size 0 max 16384 2023-07-09T21:38:33.912 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:38:33.912 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:38:33.913 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:38:33.914 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 6556, 2023-07-09T21:38:33.914 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:38:33.914 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:38:33.914 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:38:33.915 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.469825566000001, 2023-07-09T21:38:33.915 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 32, 2023-07-09T21:38:33.915 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 85, 2023-07-09T21:38:33.915 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 85, 2023-07-09T21:38:33.916 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.421086418000002 2023-07-09T21:38:33.916 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:38:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 msgr2=0x7f9124068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 0x7f9124068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f913c0af000 tx=0x7f913c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 msgr2=0x7f91401547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:33.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f913800c730 tx=0x7f913800cbf0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 shutdown_connections 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91240663a0 0x7f9124068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91400b7a60 0x7f91401547e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f91400b47a0 0x7f91401542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 --2- 172.21.15.37:0/451248505 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91400b4140 0x7f9140150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 >> 172.21.15.37:0/451248505 conn(0x7f9140073050 msgr2=0x7f91400b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 shutdown_connections 2023-07-09T21:38:33.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:33.899+0000 7f9147a34640 1 -- 172.21.15.37:0/451248505 wait complete. 2023-07-09T21:38:33.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:38:34.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 Processor -- start 2023-07-09T21:38:34.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 -- start start 2023-07-09T21:38:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb59c0cef80 0x7fb59c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0b49f0 con 0x7fb59c0b7ab0 2023-07-09T21:38:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59c0cc8a0 con 0x7fb59c0b4340 2023-07-09T21:38:34.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a3937640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59c0b7e80 con 0x7fb59c0cef80 2023-07-09T21:38:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a16d3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb59c0b7ab0 0x7fb59c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55026/0 (socket says 172.21.15.37:55026) 2023-07-09T21:38:34.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a16d3640 1 -- 172.21.15.37:0/2122848279 learned_addr learned my addr 172.21.15.37:0/2122848279 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a1ed4640 1 --2- 172.21.15.37:0/2122848279 >> v2:172.21.15.119:3300/0 conn(0x7fb59c0cef80 0x7fb59c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:34.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb593fff640 1 -- 172.21.15.37:0/2122848279 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10841447 0 0) 0x7fb59c0b49f0 con 0x7fb59c0b7ab0 2023-07-09T21:38:34.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb593fff640 1 -- 172.21.15.37:0/2122848279 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb588003530 con 0x7fb59c0b7ab0 2023-07-09T21:38:34.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/2122848279 >> v1:172.21.15.119:6789/0 conn(0x7fb59c0b4340 legacy=0x7fb59c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/2122848279 >> v1:172.21.15.37:6789/0 conn(0x7fb59c0b7ab0 legacy=0x7fb59c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.063+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/2122848279 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59c0ccb80 con 0x7fb59c0cef80 2023-07-09T21:38:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a1ed4640 1 --2- 172.21.15.37:0/2122848279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0cef80 0x7fb59c06aa50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc9878adc9f080a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb593fff640 1 -- 172.21.15.37:0/2122848279 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940a59e0 con 0x7fb59c0cef80 2023-07-09T21:38:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb593fff640 1 -- 172.21.15.37:0/2122848279 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5940a5b40 con 0x7fb59c0cef80 2023-07-09T21:38:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb593fff640 1 -- 172.21.15.37:0/2122848279 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940ad440 con 0x7fb59c0cef80 2023-07-09T21:38:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 -- 172.21.15.37:0/2122848279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0cef80 msgr2=0x7fb59c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 --2- 172.21.15.37:0/2122848279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0cef80 0x7fb59c06aa50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb594009d90 tx=0x7fb59401c920 comp rx=0 tx=0).stop 2023-07-09T21:38:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 -- 172.21.15.37:0/2122848279 shutdown_connections 2023-07-09T21:38:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 --2- 172.21.15.37:0/2122848279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0cef80 0x7fb59c06aa50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 -- 172.21.15.37:0/2122848279 >> 172.21.15.37:0/2122848279 conn(0x7fb59c073090 msgr2=0x7fb59c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 -- 172.21.15.37:0/2122848279 shutdown_connections 2023-07-09T21:38:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.067+0000 7fb5a3937640 1 -- 172.21.15.37:0/2122848279 wait complete. 2023-07-09T21:38:34.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 Processor -- start 2023-07-09T21:38:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- start start 2023-07-09T21:38:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0b4340 0x7fb59c1549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb59c0b7ab0 0x7fb59c14c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c14ef60 con 0x7fb59c0cef80 2023-07-09T21:38:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c14f240 con 0x7fb59c0b4340 2023-07-09T21:38:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59c14f520 con 0x7fb59c0b7ab0 2023-07-09T21:38:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a16d3640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0b4340 0x7fb59c1549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40998/0 (socket says 172.21.15.37:40998) 2023-07-09T21:38:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/625636848 learned_addr learned my addr 172.21.15.37:0/625636848 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a0ed2640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb59c0b7ab0 0x7fb59c14c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb59c0b7ab0 msgr2=0x7fb59c14c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb59c0b7ab0 0x7fb59c14c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0b4340 msgr2=0x7fb59c1549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0b4340 0x7fb59c1549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 -- 172.21.15.37:0/625636848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594009a70 con 0x7fb59c0cef80 2023-07-09T21:38:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a1ed4640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb5940b0040 tx=0x7fb5940196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940add90 con 0x7fb59c0cef80 2023-07-09T21:38:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb594009450 con 0x7fb59c0cef80 2023-07-09T21:38:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5940b9690 con 0x7fb59c0cef80 2023-07-09T21:38:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59c0c79e0 con 0x7fb59c0cef80 2023-07-09T21:38:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.071+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59c154ef0 con 0x7fb59c0cef80 2023-07-09T21:38:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb59c04d7d0 con 0x7fb59c0cef80 2023-07-09T21:38:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5940b97f0 con 0x7fb59c0cef80 2023-07-09T21:38:34.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb591ffb640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 0x7fb580068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:34.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb59411f440 con 0x7fb59c0cef80 2023-07-09T21:38:34.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb5a16d3640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 0x7fb580068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:34.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.075+0000 7fb5a16d3640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 0x7fb580068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5980011f0 tx=0x7fb598007d40 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:34.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.079+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5940ec7c0 con 0x7fb59c0cef80 2023-07-09T21:38:34.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb59c0b49d0 con 0x7fb59c0cef80 2023-07-09T21:38:34.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb591ffb640 1 -- 172.21.15.37:0/625636848 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb5940efde0 con 0x7fb59c0cef80 2023-07-09T21:38:34.269 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 msgr2=0x7fb580068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 0x7fb580068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb5980011f0 tx=0x7fb598007d40 comp rx=0 tx=0).stop 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 msgr2=0x7fb59c14cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb5940b0040 tx=0x7fb5940196c0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 shutdown_connections 2023-07-09T21:38:34.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fb5800663a0 0x7fb580068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb59c0cef80 0x7fb59c14cb30 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb59c0b7ab0 0x7fb59c14c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 --2- 172.21.15.37:0/625636848 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb59c0b4340 0x7fb59c1549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 >> 172.21.15.37:0/625636848 conn(0x7fb59c073090 msgr2=0x7fb59c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 shutdown_connections 2023-07-09T21:38:34.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:34.267+0000 7fb5a3937640 1 -- 172.21.15.37:0/625636848 wait complete. 2023-07-09T21:38:34.291 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:38:34.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:38:34.817 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:38:34.817 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:38:34.818 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:34.818 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:38:34.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:38:34.819 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:38:34.819 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:38:34.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:34.820 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:38:34.830 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:38:34.831 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:38:34.831 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:38:34.831 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.831 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:38:34.831 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.832 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:38:34.832 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.832 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:38:34.832 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:38:34.832 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.833 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:38:34.833 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:38:34.833 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.833 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:38:34.833 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41488sec preferred_lft 41488sec 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.834 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:38:34.835 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:38:34.836 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.836 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:38:34.836 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:38:34.837 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:38:34.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:34.839 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:38:34.905 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:38:34.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:34.908 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:38:34.962 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:38:34.962 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:38:34.962 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:38:34.962 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:38:34.963 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:38:34.963 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:38:34.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:34.963 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:38:34.964 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:38:34.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:38:34.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:38:34.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:38:34.967 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:38:35.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:35.066 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:38:35.076 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:38:35.077 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:38:35.081 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:38:35.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:35.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:38:35.149 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:38:35.150 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:38:35.150 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:38:35.201 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:38:35.201 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:35.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:38:35.322 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:38:35.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:38:35.383 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:38:35.385 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:38:35.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:35.386 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:38:35.439 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:38:35.440 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:38:35.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:38:35.510 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:38:35.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:38:35.575 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:38:35.576 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:38:35.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:35.577 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:38:35.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:38:35.583+0000 7f06a6a2b580 -1 init, newargv = 0x555e922021e0 newargc=15 2023-07-09T21:38:35.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[53904]: starting ceph client 2023-07-09T21:38:35.595 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[53904]: starting fuse 2023-07-09T21:38:35.597 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:38:35.597 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:38:35.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:38:35.598 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:38:35.598 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:38:35.598 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:38:35.599 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:38:35.599 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:38:35.600 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:38:35.601 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:38:35.602 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:38:35.602 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:38:35.603 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:38:35.604 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:38:35.604 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:38:35.605 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:38:35.606 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:38:35.607 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:38:35.607 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:38:35.608 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:38:35.608 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:38:35.609 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:38:35.609 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:38:35.609 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:38:35.610 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:38:35.610 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:38:35.610 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:38:35.611 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:38:35.611 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:38:35.721 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.53904.asok 2023-07-09T21:38:35.905 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53904.asok 2023-07-09T21:38:35.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:35.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53904.asok status 2023-07-09T21:38:36.084 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:38:36.084 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "53904", 2023-07-09T21:38:36.085 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7008, 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:38:36.086 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 7008 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1659359381 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:36.087 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:38:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:38:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:38:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 1659359381 2023-07-09T21:38:36.088 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.7008 192.168.0.1:0/1659359381", 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/1659359381", 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 32, 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 85, 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:38:36.089 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:38:36.090 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:38:36.090 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:38:36.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:36.101 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:38:36.101 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:36.111 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:38:36.111 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:36.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:36.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:36.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:38:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 Processor -- start 2023-07-09T21:38:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 -- start start 2023-07-09T21:38:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 0x7f47d006fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47d006d010 0x7f47d00cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d006afa0 con 0x7f47d0070bb0 2023-07-09T21:38:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d0070000 con 0x7f47d006d010 2023-07-09T21:38:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d6ad8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d006b280 con 0x7f47d0159830 2023-07-09T21:38:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d5075640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47d006d010 0x7f47d00cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d5075640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f47d006d010 0x7f47d00cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41000/0 (socket says 172.21.15.37:41000) 2023-07-09T21:38:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d5075640 1 -- 172.21.15.37:0/3141113831 learned_addr learned my addr 172.21.15.37:0/3141113831 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.363+0000 7f47d4874640 1 --2- 172.21.15.37:0/3141113831 >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 0x7f47d006fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d5075640 1 -- 172.21.15.37:0/3141113831 >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 msgr2=0x7f47d006fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d5075640 1 --2- 172.21.15.37:0/3141113831 >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 0x7f47d006fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d5075640 1 -- 172.21.15.37:0/3141113831 >> v1:172.21.15.119:6789/0 conn(0x7f47d0070bb0 legacy=0x7f47d006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d5075640 1 -- 172.21.15.37:0/3141113831 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d006b560 con 0x7f47d006d010 2023-07-09T21:38:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d4874640 1 --2- 172.21.15.37:0/3141113831 >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 0x7f47d006fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d5075640 1 --2- 172.21.15.37:0/3141113831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d00cbde0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f47d00b33c0 tx=0x7f47c801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f5c3a8442dbba server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47cf7fe640 1 -- 172.21.15.37:0/3141113831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80a57f0 con 0x7f47d006d010 2023-07-09T21:38:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47cf7fe640 1 -- 172.21.15.37:0/3141113831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80a5950 con 0x7f47d006d010 2023-07-09T21:38:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47cf7fe640 1 -- 172.21.15.37:0/3141113831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80a5ce0 con 0x7f47d006d010 2023-07-09T21:38:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d6ad8640 1 -- 172.21.15.37:0/3141113831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 msgr2=0x7f47d00cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.367+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/3141113831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d00cbde0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f47d00b33c0 tx=0x7f47c801c910 comp rx=0 tx=0).stop 2023-07-09T21:38:36.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- 172.21.15.37:0/3141113831 shutdown_connections 2023-07-09T21:38:36.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/3141113831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d00cbde0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/3141113831 >> v2:172.21.15.119:3300/0 conn(0x7f47d0159830 0x7f47d006fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- 172.21.15.37:0/3141113831 >> 172.21.15.37:0/3141113831 conn(0x7f47d00694c0 msgr2=0x7f47d00698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:36.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- 172.21.15.37:0/3141113831 shutdown_connections 2023-07-09T21:38:36.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- 172.21.15.37:0/3141113831 wait complete. 2023-07-09T21:38:36.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 Processor -- start 2023-07-09T21:38:36.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- start start 2023-07-09T21:38:36.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 0x7f47d0149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0159830 0x7f47d01f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b13b0 con 0x7f47d006d010 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b1690 con 0x7f47d0159830 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d6ad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d00b1970 con 0x7f47d0070bb0 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41016/0 (socket says 172.21.15.37:41016) 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 -- 172.21.15.37:0/4030585189 learned_addr learned my addr 172.21.15.37:0/4030585189 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:36.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d5075640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0159830 0x7f47d01f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47cffff640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 0x7f47d0149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 -- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 msgr2=0x7f47d0149b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 0x7f47d0149b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 -- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0159830 msgr2=0x7f47d01f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0159830 0x7f47d01f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 -- 172.21.15.37:0/4030585189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8009b30 con 0x7f47d006d010 2023-07-09T21:38:36.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47cffff640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 0x7f47d0149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:36.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.371+0000 7f47d4874640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d7d0 tx=0x7f47c400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40059a0 con 0x7f47d006d010 2023-07-09T21:38:36.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c4005b00 con 0x7f47d006d010 2023-07-09T21:38:36.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4005e90 con 0x7f47d006d010 2023-07-09T21:38:36.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d00b1c50 con 0x7f47d006d010 2023-07-09T21:38:36.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d014a090 con 0x7f47d006d010 2023-07-09T21:38:36.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d004d7d0 con 0x7f47d006d010 2023-07-09T21:38:36.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f47c4004030 con 0x7f47d006d010 2023-07-09T21:38:36.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 0x7f47b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.375+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f47c4083da0 con 0x7f47d006d010 2023-07-09T21:38:36.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.379+0000 7f47cffff640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 0x7f47b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.379+0000 7f47cffff640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 0x7f47b4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47d0156a30 tx=0x7f47bc009040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.379+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47c4054b90 con 0x7f47d006d010 2023-07-09T21:38:36.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.555+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f47d006c3b0 con 0x7f47b40663a0 2023-07-09T21:38:36.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.555+0000 7f47cd7fa640 1 -- 172.21.15.37:0/4030585189 <== mgr.6331 v2:172.21.15.119:6832/2674309351 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f47bc0013f0 con 0x7f47b40663a0 2023-07-09T21:38:36.558 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:38:36.558 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:38:36.559 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:36.559 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 msgr2=0x7f47b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 0x7f47b4068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f47d0156a30 tx=0x7f47bc009040 comp rx=0 tx=0).stop 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 msgr2=0x7f47d0135200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f47c400d7d0 tx=0x7f47c400dc90 comp rx=0 tx=0).stop 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 shutdown_connections 2023-07-09T21:38:36.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f47b40663a0 0x7f47b4068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f47d0159830 0x7f47d01f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f47d0070bb0 0x7f47d0149b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 --2- 172.21.15.37:0/4030585189 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47d006d010 0x7f47d0135200 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 >> 172.21.15.37:0/4030585189 conn(0x7f47d00694c0 msgr2=0x7f47d0151980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 shutdown_connections 2023-07-09T21:38:36.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.559+0000 7f47d6ad8640 1 -- 172.21.15.37:0/4030585189 wait complete. 2023-07-09T21:38:36.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:38:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 Processor -- start 2023-07-09T21:38:36.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 -- start start 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a80b7980 0x7fe2a8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80ceb80 0x7fe2a80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a815bf80 con 0x7fe2a80b3c20 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a80cd070 con 0x7fe2a80b7980 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2ae634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80cfd70 con 0x7fe2a80ceb80 2023-07-09T21:38:36.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a80b7980 0x7fe2a8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2a80b7980 0x7fe2a8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41024/0 (socket says 172.21.15.37:41024) 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 -- 172.21.15.37:0/1164583391 learned_addr learned my addr 172.21.15.37:0/1164583391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a77fe640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80ceb80 0x7fe2a80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 -- 172.21.15.37:0/1164583391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80ceb80 msgr2=0x7fe2a80cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80ceb80 0x7fe2a80cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 -- 172.21.15.37:0/1164583391 >> v1:172.21.15.119:6789/0 conn(0x7fe2a80b3c20 legacy=0x7fe2a80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.723+0000 7fe2a7fff640 1 -- 172.21.15.37:0/1164583391 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8160570 con 0x7fe2a80b7980 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2a7fff640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80b7980 0x7fe2a8160030 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe298009870 tx=0x7fe29801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f9f7ec64211f10 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2a6ffd640 1 -- 172.21.15.37:0/1164583391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980ab600 con 0x7fe2a80b7980 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2a6ffd640 1 -- 172.21.15.37:0/1164583391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2980a7050 con 0x7fe2a80b7980 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2a6ffd640 1 -- 172.21.15.37:0/1164583391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980ab980 con 0x7fe2a80b7980 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 -- 172.21.15.37:0/1164583391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80b7980 msgr2=0x7fe2a8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80b7980 0x7fe2a8160030 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fe298009870 tx=0x7fe29801c540 comp rx=0 tx=0).stop 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 -- 172.21.15.37:0/1164583391 shutdown_connections 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80ceb80 0x7fe2a80cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1164583391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80b7980 0x7fe2a8160030 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 -- 172.21.15.37:0/1164583391 >> 172.21.15.37:0/1164583391 conn(0x7fe2a8073090 msgr2=0x7fe2a8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 -- 172.21.15.37:0/1164583391 shutdown_connections 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.727+0000 7fe2ae634640 1 -- 172.21.15.37:0/1164583391 wait complete. 2023-07-09T21:38:36.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 Processor -- start 2023-07-09T21:38:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- start start 2023-07-09T21:38:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a80b3c20 0x7fe2a80cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80b7980 0x7fe2a815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a80cc150 con 0x7fe2a80ceb80 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a81545f0 con 0x7fe2a80b3c20 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a815f090 con 0x7fe2a80b7980 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41030/0 (socket says 172.21.15.37:41030) 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 -- 172.21.15.37:0/1291738791 learned_addr learned my addr 172.21.15.37:0/1291738791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2a7fff640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a80b3c20 0x7fe2a80cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2a77fe640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80b7980 0x7fe2a815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 -- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80b7980 msgr2=0x7fe2a815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80b7980 0x7fe2a815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 -- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a80b3c20 msgr2=0x7fe2a80cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a80b3c20 0x7fe2a80cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 -- 172.21.15.37:0/1291738791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980094d0 con 0x7fe2a80ceb80 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2acbd1640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c730 tx=0x7fe2a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003b80 con 0x7fe2a80ceb80 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a0003ce0 con 0x7fe2a80ceb80 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000aa30 con 0x7fe2a80ceb80 2023-07-09T21:38:36.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a80cbe70 con 0x7fe2a80ceb80 2023-07-09T21:38:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a80c96f0 con 0x7fe2a80ceb80 2023-07-09T21:38:36.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.731+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a80c9270 con 0x7fe2a80ceb80 2023-07-09T21:38:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.735+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 26) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe2a000ab90 con 0x7fe2a80ceb80 2023-07-09T21:38:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.735+0000 7fe2a4ff9640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 0x7fe294068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.735+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2a0083990 con 0x7fe2a80ceb80 2023-07-09T21:38:36.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.735+0000 7fe2a7fff640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 0x7fe294068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.735+0000 7fe2a7fff640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 0x7fe294068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2a808ad30 tx=0x7fe298008040 comp rx=0 tx=0).ready entity=mgr.6331 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:36.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.739+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2a80c9270 con 0x7fe2a80ceb80 2023-07-09T21:38:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:36.927+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe2a80c9270 con 0x7fe2a80ceb80 2023-07-09T21:38:37.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.123+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe2a0051170 con 0x7fe2a80ceb80 2023-07-09T21:38:37.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.123+0000 7fe2a4ff9640 1 -- 172.21.15.37:0/1291738791 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v27) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe2a0054830 con 0x7fe2a80ceb80 2023-07-09T21:38:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 msgr2=0x7fe294068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 0x7fe294068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2a808ad30 tx=0x7fe298008040 comp rx=0 tx=0).stop 2023-07-09T21:38:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 msgr2=0x7fe2a8152500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000c730 tx=0x7fe2a000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 shutdown_connections 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7fe2940663a0 0x7fe294068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2a80ceb80 0x7fe2a8152500 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2a80b7980 0x7fe2a815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 --2- 172.21.15.37:0/1291738791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2a80b3c20 0x7fe2a80cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 >> 172.21.15.37:0/1291738791 conn(0x7fe2a8073090 msgr2=0x7fe2a815b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:37.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 shutdown_connections 2023-07-09T21:38:37.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.127+0000 7fe2ae634640 1 -- 172.21.15.37:0/1291738791 wait complete. 2023-07-09T21:38:37.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:38:37.298 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:37.303+0000 7fc66842f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:37.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 Processor -- start 2023-07-09T21:38:37.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 -- start start 2023-07-09T21:38:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 0x7f13b4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f13b40d0780 0x7f13b40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b415bf80 con 0x7f13b40b7980 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b40cd070 con 0x7f13b40d0780 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13bb40b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40cfd70 con 0x7f13b40cf290 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b91a7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13b40b7980 0x7f13b40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55040/0 (socket says 172.21.15.37:55040) 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b91a7640 1 -- 172.21.15.37:0/929244024 learned_addr learned my addr 172.21.15.37:0/929244024 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:37.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b89a6640 1 --2- 172.21.15.37:0/929244024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 0x7f13b4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b99a8640 1 --2- 172.21.15.37:0/929244024 >> v2:172.21.15.119:3300/0 conn(0x7f13b40d0780 0x7f13b40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13abfff640 1 -- 172.21.15.37:0/929244024 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957176833 0 0) 0x7f13b0001120 con 0x7f13b40b7980 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13abfff640 1 -- 172.21.15.37:0/929244024 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a0003530 con 0x7f13b40b7980 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b89a6640 1 -- 172.21.15.37:0/929244024 >> v2:172.21.15.119:3300/0 conn(0x7f13b40d0780 msgr2=0x7f13b40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b89a6640 1 --2- 172.21.15.37:0/929244024 >> v2:172.21.15.119:3300/0 conn(0x7f13b40d0780 0x7f13b40d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b89a6640 1 -- 172.21.15.37:0/929244024 >> v1:172.21.15.37:6789/0 conn(0x7f13b40b7980 legacy=0x7f13b40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.307+0000 7f13b89a6640 1 -- 172.21.15.37:0/929244024 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4160570 con 0x7f13b40cf290 2023-07-09T21:38:37.313 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:37.311+0000 7fac3be55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:37.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13b89a6640 1 --2- 172.21.15.37:0/929244024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 0x7f13b4160030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f5d0d98eee017f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:37.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13abfff640 1 -- 172.21.15.37:0/929244024 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40ab600 con 0x7f13b40cf290 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13abfff640 1 -- 172.21.15.37:0/929244024 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40a7050 con 0x7f13b40cf290 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13abfff640 1 -- 172.21.15.37:0/929244024 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40ab980 con 0x7f13b40cf290 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 -- 172.21.15.37:0/929244024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 msgr2=0x7f13b4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 --2- 172.21.15.37:0/929244024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 0x7f13b4160030 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c480 comp rx=0 tx=0).stop 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 -- 172.21.15.37:0/929244024 shutdown_connections 2023-07-09T21:38:37.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 --2- 172.21.15.37:0/929244024 >> v2:172.21.15.119:3300/0 conn(0x7f13b40d0780 0x7f13b40d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 --2- 172.21.15.37:0/929244024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40cf290 0x7f13b4160030 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 -- 172.21.15.37:0/929244024 >> 172.21.15.37:0/929244024 conn(0x7f13b4073090 msgr2=0x7f13b4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 -- 172.21.15.37:0/929244024 shutdown_connections 2023-07-09T21:38:37.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.311+0000 7f13bb40b640 1 -- 172.21.15.37:0/929244024 wait complete. 2023-07-09T21:38:37.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 Processor -- start 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- start start 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13b40cf290 0x7f13b40c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40d0780 0x7f13b41542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4152730 con 0x7f13b40b7980 2023-07-09T21:38:37.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b4152b50 con 0x7f13b40cf290 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41556f0 con 0x7f13b40d0780 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50884/0 (socket says 172.21.15.37:50884) 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 -- 172.21.15.37:0/1376791597 learned_addr learned my addr 172.21.15.37:0/1376791597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b89a6640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13b40cf290 0x7f13b40c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b99a8640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40d0780 0x7f13b41542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 -- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40d0780 msgr2=0x7f13b41542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40d0780 0x7f13b41542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 -- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13b40cf290 msgr2=0x7f13b40c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13b40cf290 0x7f13b40c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 -- 172.21.15.37:0/1376791597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009420 con 0x7f13b40b7980 2023-07-09T21:38:37.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13b91a7640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c420 tx=0x7f13b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:37.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0005cf0 con 0x7f13b40b7980 2023-07-09T21:38:37.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b0005e50 con 0x7f13b40b7980 2023-07-09T21:38:37.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b41517d0 con 0x7f13b40b7980 2023-07-09T21:38:37.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b00072f0 con 0x7f13b40b7980 2023-07-09T21:38:37.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.315+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b4151d90 con 0x7f13b40b7980 2023-07-09T21:38:37.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.319+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b404d7d0 con 0x7f13b40b7980 2023-07-09T21:38:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.319+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f13b0007450 con 0x7f13b40b7980 2023-07-09T21:38:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.319+0000 7f13a9ffb640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 0x7f13980688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.319+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f13b0083300 con 0x7f13b40b7980 2023-07-09T21:38:37.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.323+0000 7f13b89a6640 1 -- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 msgr2=0x7f13980688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:37.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.323+0000 7f13b89a6640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 0x7f13980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:37.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.327+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13b0050710 con 0x7f13b40b7980 2023-07-09T21:38:37.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.483+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f13b415bf80 con 0x7f13b40b7980 2023-07-09T21:38:37.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.487+0000 7f13a9ffb640 1 -- 172.21.15.37:0/1376791597 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f13b415bf80 con 0x7f13b40b7980 2023-07-09T21:38:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 msgr2=0x7f13980688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 0x7f13980688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 msgr2=0x7f13b41551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c420 tx=0x7f13b000c8e0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 shutdown_connections 2023-07-09T21:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f13980663f0 0x7f13980688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13b40d0780 0x7f13b41542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13b40cf290 0x7f13b40c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 --2- 172.21.15.37:0/1376791597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13b40b7980 0x7f13b41551b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 >> 172.21.15.37:0/1376791597 conn(0x7f13b4073090 msgr2=0x7f13b415cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 shutdown_connections 2023-07-09T21:38:37.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.491+0000 7f13bb40b640 1 -- 172.21.15.37:0/1376791597 wait complete. 2023-07-09T21:38:37.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:38:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 Processor -- start 2023-07-09T21:38:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 -- start start 2023-07-09T21:38:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 0x7f911c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0d0780 0x7f911c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f911c15bf80 con 0x7f911c0b7980 2023-07-09T21:38:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0cd070 con 0x7f911c0d0780 2023-07-09T21:38:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f9124382640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cfd70 con 0x7f911c0cf290 2023-07-09T21:38:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0d0780 0x7f911c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0d0780 0x7f911c0d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50892/0 (socket says 172.21.15.37:50892) 2023-07-09T21:38:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 -- 172.21.15.37:0/2973475605 learned_addr learned my addr 172.21.15.37:0/2973475605 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912191d640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 0x7f911c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 -- 172.21.15.37:0/2973475605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 msgr2=0x7f911c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 0x7f911c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912111c640 1 -- 172.21.15.37:0/2973475605 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 457384926 0 0) 0x7f9118001120 con 0x7f911c0b7980 2023-07-09T21:38:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 -- 172.21.15.37:0/2973475605 >> v1:172.21.15.119:6789/0 conn(0x7f911c0b7980 legacy=0x7f911c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912291f640 1 -- 172.21.15.37:0/2973475605 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c160570 con 0x7f911c0d0780 2023-07-09T21:38:37.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.659+0000 7f912191d640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 0x7f911c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:37.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f912291f640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0d0780 0x7f911c0d0c00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9114009e50 tx=0x7f911401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a7f72ade0be32e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:37.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f912111c640 1 -- 172.21.15.37:0/2973475605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a56e0 con 0x7f911c0d0780 2023-07-09T21:38:37.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f912111c640 1 -- 172.21.15.37:0/2973475605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91140a5840 con 0x7f911c0d0780 2023-07-09T21:38:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f912111c640 1 -- 172.21.15.37:0/2973475605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a5bd0 con 0x7f911c0d0780 2023-07-09T21:38:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 -- 172.21.15.37:0/2973475605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0d0780 msgr2=0x7f911c0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0d0780 0x7f911c0d0c00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f9114009e50 tx=0x7f911401ca10 comp rx=0 tx=0).stop 2023-07-09T21:38:37.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 -- 172.21.15.37:0/2973475605 shutdown_connections 2023-07-09T21:38:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0cf290 0x7f911c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 --2- 172.21.15.37:0/2973475605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0d0780 0x7f911c0d0c00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 -- 172.21.15.37:0/2973475605 >> 172.21.15.37:0/2973475605 conn(0x7f911c073090 msgr2=0x7f911c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 -- 172.21.15.37:0/2973475605 shutdown_connections 2023-07-09T21:38:37.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.663+0000 7f9124382640 1 -- 172.21.15.37:0/2973475605 wait complete. 2023-07-09T21:38:37.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 Processor -- start 2023-07-09T21:38:37.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- start start 2023-07-09T21:38:37.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 0x7f911c0c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cf290 0x7f911c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 0x7f911c1412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0ca9a0 con 0x7f911c0cf290 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0c8610 con 0x7f911c0d0780 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c154400 con 0x7f911c0b7980 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912211e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 0x7f911c0c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912191d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cf290 0x7f911c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 0x7f911c1412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912211e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 0x7f911c0c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:57428/0 (socket says 172.21.15.37:57428) 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912211e640 1 -- 172.21.15.37:0/559754787 learned_addr learned my addr 172.21.15.37:0/559754787 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:37.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 -- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 msgr2=0x7f911c0c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 0x7f911c0c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 -- 172.21.15.37:0/559754787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cf290 msgr2=0x7f911c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cf290 0x7f911c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 -- 172.21.15.37:0/559754787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c009420 con 0x7f911c0d0780 2023-07-09T21:38:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f912291f640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 0x7f911c1412d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f91140ab000 tx=0x7f91140197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140bd070 con 0x7f911c0d0780 2023-07-09T21:38:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9114009510 con 0x7f911c0d0780 2023-07-09T21:38:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9114009b30 con 0x7f911c0d0780 2023-07-09T21:38:37.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91140a56e0 con 0x7f911c0d0780 2023-07-09T21:38:37.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.667+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0ca000 con 0x7f911c0d0780 2023-07-09T21:38:37.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0737d0 con 0x7f911c0d0780 2023-07-09T21:38:37.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f91140b88c0 con 0x7f911c0d0780 2023-07-09T21:38:37.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f9112ffd640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 0x7f91000688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:37.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f911411ebc0 con 0x7f911c0d0780 2023-07-09T21:38:37.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f912211e640 1 -- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 msgr2=0x7f91000688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:37.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.671+0000 7f912211e640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 0x7f91000688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:37.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.675+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f911c0737d0 con 0x7f911c0d0780 2023-07-09T21:38:37.716 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:37.723+0000 7fc66842f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:37.763 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:37.763+0000 7fac3be55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:37.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.835+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f911c0caae0 con 0x7f911c0d0780 2023-07-09T21:38:37.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.843+0000 7f9112ffd640 1 -- 172.21.15.37:0/559754787 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f911c0caae0 con 0x7f911c0d0780 2023-07-09T21:38:37.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 msgr2=0x7f91000688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 0x7f91000688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 msgr2=0x7f911c1412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:37.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 0x7f911c1412d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f91140ab000 tx=0x7f91140197b0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 shutdown_connections 2023-07-09T21:38:37.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f91000663f0 0x7f91000688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0d0780 0x7f911c1412d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cf290 0x7f911c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 --2- 172.21.15.37:0/559754787 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b7980 0x7f911c0c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 >> 172.21.15.37:0/559754787 conn(0x7f911c073090 msgr2=0x7f911c15db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:37.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 shutdown_connections 2023-07-09T21:38:37.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:37.847+0000 7f9124382640 1 -- 172.21.15.37:0/559754787 wait complete. 2023-07-09T21:38:37.866 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:37.871+0000 7fc66842f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:37.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:37.877 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:38:37.893 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-09T21:38:37.938 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:37.935+0000 7fac3be55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:38.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.079+0000 7f1bd3d40640 1 Processor -- start 2023-07-09T21:38:38.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 -- start start 2023-07-09T21:38:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bcc0b7980 0x7f1bcc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bcc0b3c20 0x7f1bcc0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cd070 con 0x7f1bcc0b7980 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bcc0cfd70 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd3d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15bf80 con 0x7f1bcc0ceb80 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bcc0b7980 0x7f1bcc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bcc0b7980 0x7f1bcc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50914/0 (socket says 172.21.15.37:50914) 2023-07-09T21:38:38.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1606771268 learned_addr learned my addr 172.21.15.37:0/1606771268 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd22dd640 1 --2- 172.21.15.37:0/1606771268 >> v2:172.21.15.119:3300/0 conn(0x7f1bcc0b3c20 0x7f1bcc0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1606771268 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 msgr2=0x7f1bcc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1606771268 >> v2:172.21.15.119:3300/0 conn(0x7f1bcc0b3c20 msgr2=0x7f1bcc0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1606771268 >> v2:172.21.15.119:3300/0 conn(0x7f1bcc0b3c20 0x7f1bcc0b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.083+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1606771268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bcc160570 con 0x7f1bcc0b7980 2023-07-09T21:38:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc160030 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc08ad30 tx=0x7f1bc801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b53855ec3a09a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd0ada640 1 -- 172.21.15.37:0/1606771268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80ab600 con 0x7f1bcc0b7980 2023-07-09T21:38:38.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd0ada640 1 -- 172.21.15.37:0/1606771268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80a7050 con 0x7f1bcc0b7980 2023-07-09T21:38:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd0ada640 1 -- 172.21.15.37:0/1606771268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80ab980 con 0x7f1bcc0b7980 2023-07-09T21:38:38.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1606771268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 msgr2=0x7f1bcc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc160030 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc08ad30 tx=0x7f1bc801c500 comp rx=0 tx=0).stop 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1606771268 shutdown_connections 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 --2- 172.21.15.37:0/1606771268 >> v2:172.21.15.119:3300/0 conn(0x7f1bcc0b3c20 0x7f1bcc0b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 --2- 172.21.15.37:0/1606771268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc160030 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1606771268 >> 172.21.15.37:0/1606771268 conn(0x7f1bcc073090 msgr2=0x7f1bcc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1606771268 shutdown_connections 2023-07-09T21:38:38.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.087+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1606771268 wait complete. 2023-07-09T21:38:38.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 Processor -- start 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- start start 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc0b3c20 0x7f1bcc151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc0d11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc154960 con 0x7f1bcc0b7980 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc15a1e0 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bcc154680 con 0x7f1bcc0ceb80 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc0b3c20 0x7f1bcc151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc0b3c20 0x7f1bcc151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:59760/0 (socket says 172.21.15.37:59760) 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1922549254 learned_addr learned my addr 172.21.15.37:0/1922549254 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc0d11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd22dd640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 msgr2=0x7f1bcc14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:38.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bcc0ceb80 0x7f1bcc14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 msgr2=0x7f1bcc0d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bcc0b7980 0x7f1bcc0d11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc80094d0 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd1adc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bcc0b3c20 0x7f1bcc151470 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f1bc801abb0 tx=0x7f1bc80192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:38.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80b3890 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80b39f0 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc80b3da0 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc159b90 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bcc15ae80 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.091+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bcc15b070 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.095+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 27) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f1bc80b2070 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.095+0000 7f1bc27fc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.095+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1bc811e1e0 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.095+0000 7f1bd12db640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 msgr2=0x7f1bb00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.095+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:38.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.099+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bcc15b070 con 0x7f1bcc0b3c20 2023-07-09T21:38:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.271+0000 7f1bd3d40640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bcc0ccd90 con 0x7f1bb00663f0 2023-07-09T21:38:38.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.299+0000 7f1bd12db640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 msgr2=0x7f1bb00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:38.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.299+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:38:38.349 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.351+0000 7fc66842f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:38.409 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.411+0000 7fc66842f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:38.453 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.451+0000 7fac3be55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:38.461 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.467+0000 7fc66842f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:38.515 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.515+0000 7fac3be55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:38.547 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.551+0000 7fc66842f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:38.575 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.571+0000 7fac3be55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:38.603 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.611+0000 7fc66842f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:38.666 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.663+0000 7fac3be55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:38.687 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.691+0000 7fc66842f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.703+0000 7f1bd12db640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 msgr2=0x7f1bb00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:38.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:38.703+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:38:38.726 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.723+0000 7fac3be55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:38.742 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.747+0000 7fc66842f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:38.814 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.811+0000 7fac3be55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:38.885 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:38.871+0000 7fac3be55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:38.890 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.887+0000 7fc66842f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:38.939 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:38.943+0000 7fc66842f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:39.024 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.023+0000 7fac3be55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:39.085 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.083+0000 7fac3be55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:39.177 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:39.178 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:39.178 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:39.185 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:39.191+0000 7fc66842f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:39.319 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:39.323+0000 7fc66842f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:39.336 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:39.336 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:39.336 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:39.344 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.343+0000 7fac3be55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:39.446 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:39.451+0000 7fc66842f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:39.489 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.487+0000 7fac3be55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:39.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:39.507+0000 7f1bd12db640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 msgr2=0x7f1bb00688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2674309351 2023-07-09T21:38:39.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:39.507+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:38:39.518 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:39.523+0000 7fc66842f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:39.625 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.619+0000 7fac3be55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:39.651 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:39.655+0000 7fc66842f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:39.697 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.695+0000 7fac3be55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:39.838 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:39.835+0000 7fac3be55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:40.186 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.191+0000 7fc66842f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:40.271 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.275+0000 7fc66842f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:40.412 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:40.411+0000 7fac3be55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:40.420 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.423+0000 7fc66842f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:40.501 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:40.499+0000 7fac3be55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:40.502 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.507+0000 7fc66842f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:40.657 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:40.655+0000 7fac3be55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:40.745 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:40.743+0000 7fac3be55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:40.771 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.775+0000 7fc66842f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:40.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.835+0000 7fc66842f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:40.843+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 28) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f1bc80eb820 con 0x7f1bcc0b3c20 2023-07-09T21:38:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:40.843+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 msgr2=0x7f1bb00688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:40.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:40.843+0000 7f1bc27fc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/2674309351,v1:172.21.15.119:6833/2674309351] conn(0x7f1bb00663f0 0x7f1bb00688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:40.967 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e91f7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.967 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e91f7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.968 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e91f7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.968 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e91f7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.968 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e91f7640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.968 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e61f1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.969 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e61f1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.969 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e61f1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.969 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e61f1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:40.969 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:40.971+0000 7fc5e61f1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:41.050 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:41.047+0000 7fac3be55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:41.115 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:41.111+0000 7fac3be55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:41.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.851+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mon.1 v2:172.21.15.119:3300/0 8 ==== mgrmap(e 29) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f1bc811c500 con 0x7f1bcc0b3c20 2023-07-09T21:38:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.851+0000 7f1bc27fc640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1bb0034090 0x7f1bb00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:41.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.851+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 --> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bb0070e00 con 0x7f1bb0034090 2023-07-09T21:38:41.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.855+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1bb0034090 0x7f1bb00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:41.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.855+0000 7f1bd12db640 1 --2- 172.21.15.37:0/1922549254 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1bb0034090 0x7f1bb00708c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc1f7bb0 tx=0x7f1bbc009190 comp rx=0 tx=0).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:41.867 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:41.871+0000 7fc5f0205640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-09T21:38:41.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:41.867+0000 7f1bc27fc640 1 -- 172.21.15.37:0/1922549254 <== mgr.6107 v2:172.21.15.119:6832/1727026005 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7f1bb0070e00 con 0x7f1bb0034090 2023-07-09T21:38:41.868 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-09T21:38:41.877 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-09T21:38:41.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:41.879 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T21:38:41.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:38:42.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 Processor -- start 2023-07-09T21:38:42.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 -- start start 2023-07-09T21:38:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 0x7f5cd40c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5cd40c99e0 0x7f5cd40cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40c4c90 con 0x7f5cd41595c0 2023-07-09T21:38:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd40ca730 con 0x7f5cd40c99e0 2023-07-09T21:38:42.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cdc38f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40ca170 con 0x7f5cd4159990 2023-07-09T21:38:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5cd40c99e0 0x7f5cd40cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cd992a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 0x7f5cd40c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5cd40c99e0 0x7f5cd40cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:59774/0 (socket says 172.21.15.37:59774) 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 -- 172.21.15.37:0/2258421047 learned_addr learned my addr 172.21.15.37:0/2258421047 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 -- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 msgr2=0x7f5cd40c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 0x7f5cd40c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 -- 172.21.15.37:0/2258421047 >> v1:172.21.15.119:6789/0 conn(0x7f5cd41595c0 legacy=0x7f5cd415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cda92c640 1 -- 172.21.15.37:0/2258421047 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40ca450 con 0x7f5cd40c99e0 2023-07-09T21:38:42.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.083+0000 7f5cd992a640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 0x7f5cd40c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cda92c640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd40c99e0 0x7f5cd40cd300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009e50 tx=0x7f5ccc01c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=706c2cfdda4cb6fc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cd9129640 1 -- 172.21.15.37:0/2258421047 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a57c0 con 0x7f5cd40c99e0 2023-07-09T21:38:42.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cd9129640 1 -- 172.21.15.37:0/2258421047 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0a5920 con 0x7f5cd40c99e0 2023-07-09T21:38:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cd9129640 1 -- 172.21.15.37:0/2258421047 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a5cb0 con 0x7f5cd40c99e0 2023-07-09T21:38:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 -- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd40c99e0 msgr2=0x7f5cd40cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd40c99e0 0x7f5cd40cd300 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009e50 tx=0x7f5ccc01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 -- 172.21.15.37:0/2258421047 shutdown_connections 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd40c99e0 0x7f5cd40cd300 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/2258421047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd4159990 0x7f5cd40c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 -- 172.21.15.37:0/2258421047 >> 172.21.15.37:0/2258421047 conn(0x7f5cd40cde40 msgr2=0x7f5cd40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 -- 172.21.15.37:0/2258421047 shutdown_connections 2023-07-09T21:38:42.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.087+0000 7f5cdc38f640 1 -- 172.21.15.37:0/2258421047 wait complete. 2023-07-09T21:38:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 Processor -- start 2023-07-09T21:38:42.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- start start 2023-07-09T21:38:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd41595c0 0x7f5cd4156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd4159990 0x7f5cd414fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd406c140 con 0x7f5cd40c99e0 2023-07-09T21:38:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41573a0 con 0x7f5cd4159990 2023-07-09T21:38:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd406b830 con 0x7f5cd41595c0 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50922/0 (socket says 172.21.15.37:50922) 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 -- 172.21.15.37:0/1296357106 learned_addr learned my addr 172.21.15.37:0/1296357106 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cd992a640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd41595c0 0x7f5cd4156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda92c640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd4159990 0x7f5cd414fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 -- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd41595c0 msgr2=0x7f5cd4156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd41595c0 0x7f5cd4156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 -- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd4159990 msgr2=0x7f5cd414fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd4159990 0x7f5cd414fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 -- 172.21.15.37:0/1296357106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009420 con 0x7f5cd40c99e0 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cda12b640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c3f0 tx=0x7f5cd000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd00052d0 con 0x7f5cd40c99e0 2023-07-09T21:38:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0005430 con 0x7f5cd40c99e0 2023-07-09T21:38:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc009b30 con 0x7f5cd40c99e0 2023-07-09T21:38:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0003840 con 0x7f5cd40c99e0 2023-07-09T21:38:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.091+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd4157d00 con 0x7f5cd40c99e0 2023-07-09T21:38:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.095+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd404d7d0 con 0x7f5cd40c99e0 2023-07-09T21:38:42.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.099+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 29) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f5cd00039a0 con 0x7f5cd40c99e0 2023-07-09T21:38:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.099+0000 7f5ccaffd640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 0x7f5cb80685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:42.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.099+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f5cd0083070 con 0x7f5cd40c99e0 2023-07-09T21:38:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.099+0000 7f5cd992a640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 0x7f5cb80685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:42.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.099+0000 7f5cd992a640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 0x7f5cb80685d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40c7aa0 tx=0x7f5cc4009190 comp rx=0 tx=0).ready entity=mgr.6107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:42.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.103+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cd0050780 con 0x7f5cd40c99e0 2023-07-09T21:38:42.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:42.291+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5cd40c4c70 con 0x7f5cd40c99e0 2023-07-09T21:38:43.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.103+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5cd005a0f0 con 0x7f5cd40c99e0 2023-07-09T21:38:43.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.103+0000 7f5ccaffd640 1 -- 172.21.15.37:0/1296357106 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v30) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5cd0075ea0 con 0x7f5cd40c99e0 2023-07-09T21:38:43.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 msgr2=0x7f5cb80685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 0x7f5cb80685d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40c7aa0 tx=0x7f5cc4009190 comp rx=0 tx=0).stop 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 msgr2=0x7f5cd41576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f5cd000c3f0 tx=0x7f5cd000c8b0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 shutdown_connections 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f5cb8066120 0x7f5cb80685d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cd4159990 0x7f5cd414fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cd41595c0 0x7f5cd4156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 --2- 172.21.15.37:0/1296357106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cd40c99e0 0x7f5cd41576b0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 >> 172.21.15.37:0/1296357106 conn(0x7f5cd40cde40 msgr2=0x7f5cd4156400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 shutdown_connections 2023-07-09T21:38:43.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.107+0000 7f5cdc38f640 1 -- 172.21.15.37:0/1296357106 wait complete. 2023-07-09T21:38:43.134 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:38:43.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:43.194 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:43.254 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:38:43.254 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:43.255 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:43.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:43.280 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:43.287+0000 7fd776a46180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:43.286 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:43.283+0000 7ff982bd9180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:38:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.427+0000 7f1228034640 1 Processor -- start 2023-07-09T21:38:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 -- start start 2023-07-09T21:38:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b4340 0x7f122006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f12200cef80 0x7f12200d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12200b49f0 con 0x7f12200b7ab0 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200b7e80 con 0x7f12200cef80 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1228034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12200cc8a0 con 0x7f12200b4340 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1225dd0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12200b7ab0 0x7f12200b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56656/0 (socket says 172.21.15.37:56656) 2023-07-09T21:38:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1225dd0640 1 -- 172.21.15.37:0/2178237125 learned_addr learned my addr 172.21.15.37:0/2178237125 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12265d1640 1 --2- 172.21.15.37:0/2178237125 >> v2:172.21.15.37:3300/0 conn(0x7f12200cef80 0x7f12200d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12255cf640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b4340 0x7f122006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12265d1640 1 -- 172.21.15.37:0/2178237125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b4340 msgr2=0x7f122006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12265d1640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b4340 0x7f122006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12265d1640 1 -- 172.21.15.37:0/2178237125 >> v1:172.21.15.37:6789/0 conn(0x7f12200b7ab0 legacy=0x7f12200b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f12265d1640 1 -- 172.21.15.37:0/2178237125 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200ccb80 con 0x7f12200cef80 2023-07-09T21:38:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.431+0000 7f1224dce640 1 -- 172.21.15.37:0/2178237125 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967222286 0 0) 0x7f12200b49f0 con 0x7f12200b7ab0 2023-07-09T21:38:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f12265d1640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f12200d02a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1218009d90 tx=0x7f121801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396609cbce82f725 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1224dce640 1 -- 172.21.15.37:0/2178237125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180a59e0 con 0x7f12200cef80 2023-07-09T21:38:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1224dce640 1 -- 172.21.15.37:0/2178237125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12180a5b40 con 0x7f12200cef80 2023-07-09T21:38:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1224dce640 1 -- 172.21.15.37:0/2178237125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12180ad440 con 0x7f12200cef80 2023-07-09T21:38:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 -- 172.21.15.37:0/2178237125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 msgr2=0x7f12200d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f12200d02a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1218009d90 tx=0x7f121801c920 comp rx=0 tx=0).stop 2023-07-09T21:38:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 -- 172.21.15.37:0/2178237125 shutdown_connections 2023-07-09T21:38:43.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f12200d02a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 --2- 172.21.15.37:0/2178237125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b4340 0x7f122006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 -- 172.21.15.37:0/2178237125 >> 172.21.15.37:0/2178237125 conn(0x7f1220073090 msgr2=0x7f1220069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 -- 172.21.15.37:0/2178237125 shutdown_connections 2023-07-09T21:38:43.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.435+0000 7f1228034640 1 -- 172.21.15.37:0/2178237125 wait complete. 2023-07-09T21:38:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 Processor -- start 2023-07-09T21:38:43.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- start start 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b7ab0 0x7f122015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f122015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122015e080 con 0x7f12200cef80 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122015dda0 con 0x7f12200b4340 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1220159120 con 0x7f12200b7ab0 2023-07-09T21:38:43.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12255cf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b7ab0 0x7f122015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12265d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f122015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:59792/0 (socket says 172.21.15.37:59792) 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 -- 172.21.15.37:0/2831946889 learned_addr learned my addr 172.21.15.37:0/2831946889 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b7ab0 msgr2=0x7f122015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b7ab0 0x7f122015d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 msgr2=0x7f122015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f122015d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 -- 172.21.15.37:0/2831946889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218009a70 con 0x7f12200b4340 2023-07-09T21:38:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12265d1640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f122015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1225dd0640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f121c0011f0 tx=0x7f121c00c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:43.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0074e0 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c007640 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c004a10 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1220159400 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.439+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1220157c60 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1220159920 con 0x7f12200b4340 2023-07-09T21:38:43.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f121c004b70 con 0x7f12200b4340 2023-07-09T21:38:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f12167fc640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 0x7f12040688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f121c083310 con 0x7f12200b4340 2023-07-09T21:38:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f12255cf640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 msgr2=0x7f12040688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:43.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.443+0000 7f12255cf640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 0x7f12040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:43.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.447+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f121c050500 con 0x7f12200b4340 2023-07-09T21:38:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.647+0000 7f12255cf640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 msgr2=0x7f12040688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.647+0000 7f12255cf640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 0x7f12040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:38:43.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.671+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f122004d7d0 con 0x7f12200b4340 2023-07-09T21:38:43.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.671+0000 7f12167fc640 1 -- 172.21.15.37:0/2831946889 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18787 (secure 0 0 0) 0x7f121c018090 con 0x7f12200b4340 2023-07-09T21:38:43.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:43.676 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:40.835372+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/558266346":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2741372906":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6833/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6832/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2816906929":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/937586606":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3373188161":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/786069025":"2023-07-10T21:38:40.835324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:43.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 msgr2=0x7f12040688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 0x7f12040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 msgr2=0x7f12201570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f121c0011f0 tx=0x7f121c00c9b0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 shutdown_connections 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f1204066430 0x7f12040688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12200cef80 0x7f122015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12200b7ab0 0x7f122015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 --2- 172.21.15.37:0/2831946889 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12200b4340 0x7f12201570f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 >> 172.21.15.37:0/2831946889 conn(0x7f1220073090 msgr2=0x7f122006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 shutdown_connections 2023-07-09T21:38:43.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.675+0000 7f1228034640 1 -- 172.21.15.37:0/2831946889 wait complete. 2023-07-09T21:38:43.693 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:43.699+0000 7fd776a46180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:43.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:38:20.905098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:38:21.780980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:43.699 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:43.792 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:43.791+0000 7ff982bd9180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:38:43.842 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:43.847+0000 7fd776a46180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 Processor -- start 2023-07-09T21:38:43.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 -- start start 2023-07-09T21:38:43.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7240cf290 0x7fa724160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa72415bf80 con 0x7fa7240d0780 2023-07-09T21:38:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa724160570 con 0x7fa7240b7980 2023-07-09T21:38:43.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa72a939640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7240cd070 con 0x7fa7240cf290 2023-07-09T21:38:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa728ed6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa7240d0780 0x7fa7240d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2023-07-09T21:38:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa728ed6640 1 -- 172.21.15.37:0/4151298918 learned_addr learned my addr 172.21.15.37:0/4151298918 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:43.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa7237fe640 1 --2- 172.21.15.37:0/4151298918 >> v2:172.21.15.119:3300/0 conn(0x7fa7240cf290 0x7fa724160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760158753 0 0) 0x7fa714001120 con 0x7fa7240b7980 2023-07-09T21:38:43.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa70c003530 con 0x7fa7240b7980 2023-07-09T21:38:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148988460 0 0) 0x7fa71c0014a0 con 0x7fa7240d0780 2023-07-09T21:38:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa7237fe640 1 -- 172.21.15.37:0/4151298918 >> v1:172.21.15.119:6789/0 conn(0x7fa7240b7980 legacy=0x7fa7240ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa7237fe640 1 -- 172.21.15.37:0/4151298918 >> v1:172.21.15.37:6789/0 conn(0x7fa7240d0780 legacy=0x7fa7240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.851+0000 7fa7237fe640 1 -- 172.21.15.37:0/4151298918 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7240d02f0 con 0x7fa7240cf290 2023-07-09T21:38:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa7237fe640 1 --2- 172.21.15.37:0/4151298918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240cf290 0x7fa724160030 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097c0 tx=0x7fa71801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60833a2b0cdcbf8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7180ab600 con 0x7fa7240cf290 2023-07-09T21:38:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7180a7050 con 0x7fa7240cf290 2023-07-09T21:38:43.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa722ffd640 1 -- 172.21.15.37:0/4151298918 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7180ab980 con 0x7fa7240cf290 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 -- 172.21.15.37:0/4151298918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240cf290 msgr2=0x7fa724160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 --2- 172.21.15.37:0/4151298918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240cf290 0x7fa724160030 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097c0 tx=0x7fa71801c480 comp rx=0 tx=0).stop 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 -- 172.21.15.37:0/4151298918 shutdown_connections 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 --2- 172.21.15.37:0/4151298918 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240cf290 0x7fa724160030 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 -- 172.21.15.37:0/4151298918 >> 172.21.15.37:0/4151298918 conn(0x7fa724073090 msgr2=0x7fa724069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 -- 172.21.15.37:0/4151298918 shutdown_connections 2023-07-09T21:38:43.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.855+0000 7fa72a939640 1 -- 172.21.15.37:0/4151298918 wait complete. 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 Processor -- start 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- start start 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7240b7980 0x7fa724150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240d0780 0x7fa724153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa724152df0 con 0x7fa7240cf290 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7240b4b40 con 0x7fa7240d0780 2023-07-09T21:38:43.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7241521b0 con 0x7fa7240b7980 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50962/0 (socket says 172.21.15.37:50962) 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 -- 172.21.15.37:0/1042853593 learned_addr learned my addr 172.21.15.37:0/1042853593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa723fff640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7240b7980 0x7fa724150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa728ed6640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240d0780 0x7fa724153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 -- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7240b7980 msgr2=0x7fa724150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7240b7980 0x7fa724150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 -- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240d0780 msgr2=0x7fa724153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240d0780 0x7fa724153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 -- 172.21.15.37:0/1042853593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa718009420 con 0x7fa7240cf290 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa7237fe640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097c0 tx=0x7fa718019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718004220 con 0x7fa7240cf290 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa718004380 con 0x7fa7240cf290 2023-07-09T21:38:43.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa718003840 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa724152450 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.859+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa724152a10 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72404d7d0 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa7180b2040 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa720ff9640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 0x7fa7100688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa71811e310 con 0x7fa7240cf290 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa723fff640 1 -- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 msgr2=0x7fa7100688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:43.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.863+0000 7fa723fff640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 0x7fa7100688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:43.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:43.867+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7180eb3f0 con 0x7fa7240cf290 2023-07-09T21:38:43.954 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:43.951+0000 7ff982bd9180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:38:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.023+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa7240c9010 con 0x7fa7240cf290 2023-07-09T21:38:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.023+0000 7fa720ff9640 1 -- 172.21.15.37:0/1042853593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa7180044f0 con 0x7fa7240cf290 2023-07-09T21:38:44.027 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 msgr2=0x7fa7100688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 0x7fa7100688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 msgr2=0x7fa7241531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa7180097c0 tx=0x7fa718019220 comp rx=0 tx=0).stop 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 shutdown_connections 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa710066430 0x7fa7100688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7240d0780 0x7fa724153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7240cf290 0x7fa7241531d0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 --2- 172.21.15.37:0/1042853593 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7240b7980 0x7fa724150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 >> 172.21.15.37:0/1042853593 conn(0x7fa724073090 msgr2=0x7fa7240b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 shutdown_connections 2023-07-09T21:38:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.027+0000 7fa72a939640 1 -- 172.21.15.37:0/1042853593 wait complete. 2023-07-09T21:38:44.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:44.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 Processor -- start 2023-07-09T21:38:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 -- start start 2023-07-09T21:38:44.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb01c160030 0x7fb01c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c15bf80 con 0x7fb01c0b7980 2023-07-09T21:38:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c0d02f0 con 0x7fb01c0cf290 2023-07-09T21:38:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb02118f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0cd070 con 0x7fb01c160030 2023-07-09T21:38:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb01c0b7980 0x7fb01c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56668/0 (socket says 172.21.15.37:56668) 2023-07-09T21:38:44.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01ad9d640 1 -- 172.21.15.37:0/3598529548 learned_addr learned my addr 172.21.15.37:0/3598529548 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:44.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01b59e640 1 --2- 172.21.15.37:0/3598529548 >> v2:172.21.15.119:3300/0 conn(0x7fb01c160030 0x7fb01c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716724390 0 0) 0x7fb00c001120 con 0x7fb01c0b7980 2023-07-09T21:38:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb004003530 con 0x7fb01c0b7980 2023-07-09T21:38:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472446713 0 0) 0x7fb01c0d02f0 con 0x7fb01c0cf290 2023-07-09T21:38:44.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb00c001120 con 0x7fb01c0cf290 2023-07-09T21:38:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01b59e640 1 -- 172.21.15.37:0/3598529548 >> v1:172.21.15.119:6789/0 conn(0x7fb01c0cf290 legacy=0x7fb01c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01b59e640 1 -- 172.21.15.37:0/3598529548 >> v1:172.21.15.37:6789/0 conn(0x7fb01c0b7980 legacy=0x7fb01c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.195+0000 7fb01b59e640 1 -- 172.21.15.37:0/3598529548 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0cc7f0 con 0x7fb01c160030 2023-07-09T21:38:44.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb01b59e640 1 --2- 172.21.15.37:0/3598529548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c160030 0x7fb01c0d0e90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb014009d90 tx=0x7fb01401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36496bf1c376c4f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140a5810 con 0x7fb01c160030 2023-07-09T21:38:44.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0140a5970 con 0x7fb01c160030 2023-07-09T21:38:44.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb019d9b640 1 -- 172.21.15.37:0/3598529548 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0140a5d00 con 0x7fb01c160030 2023-07-09T21:38:44.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 -- 172.21.15.37:0/3598529548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c160030 msgr2=0x7fb01c0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 --2- 172.21.15.37:0/3598529548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c160030 0x7fb01c0d0e90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fb014009d90 tx=0x7fb01401c950 comp rx=0 tx=0).stop 2023-07-09T21:38:44.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 -- 172.21.15.37:0/3598529548 shutdown_connections 2023-07-09T21:38:44.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 --2- 172.21.15.37:0/3598529548 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c160030 0x7fb01c0d0e90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 -- 172.21.15.37:0/3598529548 >> 172.21.15.37:0/3598529548 conn(0x7fb01c073090 msgr2=0x7fb01c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 -- 172.21.15.37:0/3598529548 shutdown_connections 2023-07-09T21:38:44.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.199+0000 7fb02118f640 1 -- 172.21.15.37:0/3598529548 wait complete. 2023-07-09T21:38:44.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 Processor -- start 2023-07-09T21:38:44.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- start start 2023-07-09T21:38:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 0x7fb01c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0cf290 0x7fb01c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 0x7fb01c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c6760 con 0x7fb01c160030 2023-07-09T21:38:44.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c5e30 con 0x7fb01c0cf290 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c6110 con 0x7fb01c0b7980 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 0x7fb01c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 0x7fb01c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 0x7fb01c15a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50972/0 (socket says 172.21.15.37:50972) 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01b59e640 1 -- 172.21.15.37:0/597153619 learned_addr learned my addr 172.21.15.37:0/597153619 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:44.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01a59c640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0cf290 0x7fb01c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 -- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0cf290 msgr2=0x7fb01c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0cf290 0x7fb01c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 -- 172.21.15.37:0/597153619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 msgr2=0x7fb01c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 0x7fb01c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 -- 172.21.15.37:0/597153619 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009a70 con 0x7fb01c0b7980 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb01ad9d640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 0x7fb01c150fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c700 tx=0x7fb00c00cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c005a60 con 0x7fb01c0b7980 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c005bc0 con 0x7fb01c0b7980 2023-07-09T21:38:44.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c007070 con 0x7fb01c0b7980 2023-07-09T21:38:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c0c63f0 con 0x7fb01c0b7980 2023-07-09T21:38:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.203+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c0c8960 con 0x7fb01c0b7980 2023-07-09T21:38:44.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c04d7d0 con 0x7fb01c0b7980 2023-07-09T21:38:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fb00c0071d0 con 0x7fb01c0b7980 2023-07-09T21:38:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb0037fe640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 0x7fb0080688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fb00c083640 con 0x7fb01c0b7980 2023-07-09T21:38:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb01a59c640 1 -- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 msgr2=0x7fb0080688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:44.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.207+0000 7fb01a59c640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 0x7fb0080688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:44.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.211+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb00c050860 con 0x7fb01c0b7980 2023-07-09T21:38:44.345 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.351+0000 7fd776a46180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb01c15bf80 con 0x7fb01c0b7980 2023-07-09T21:38:44.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb0037fe640 1 -- 172.21.15.37:0/597153619 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v86) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb01c15bf80 con 0x7fb01c0b7980 2023-07-09T21:38:44.369 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 msgr2=0x7fb0080688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 0x7fb0080688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 msgr2=0x7fb01c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 0x7fb01c150fa0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00c700 tx=0x7fb00c00cbc0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 shutdown_connections 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fb008066430 0x7fb0080688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb01c160030 0x7fb01c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb01c0cf290 0x7fb01c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 --2- 172.21.15.37:0/597153619 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb01c0b7980 0x7fb01c150fa0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 >> 172.21.15.37:0/597153619 conn(0x7fb01c073090 msgr2=0x7fb01c154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 shutdown_connections 2023-07-09T21:38:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.367+0000 7fb02118f640 1 -- 172.21.15.37:0/597153619 wait complete. 2023-07-09T21:38:44.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:38:44.403 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.407+0000 7fd776a46180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:44.459 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.467+0000 7fd776a46180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:44.476 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.475+0000 7ff982bd9180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:44.539 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.535+0000 7ff982bd9180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:38:44.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 Processor -- start 2023-07-09T21:38:44.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 -- start start 2023-07-09T21:38:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3415bf80 con 0x7f0b340cf290 2023-07-09T21:38:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b340d02f0 con 0x7f0b340b7980 2023-07-09T21:38:44.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b398bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340cd070 con 0x7f0b34160030 2023-07-09T21:38:44.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b2bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b340cf290 0x7f0b340d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56682/0 (socket says 172.21.15.37:56682) 2023-07-09T21:38:44.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b2bfff640 1 -- 172.21.15.37:0/28668998 learned_addr learned my addr 172.21.15.37:0/28668998 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b337fe640 1 --2- 172.21.15.37:0/28668998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825219050 0 0) 0x7f0b1c001120 con 0x7f0b340cf290 2023-07-09T21:38:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b20003530 con 0x7f0b340cf290 2023-07-09T21:38:44.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915717975 0 0) 0x7f0b340d02f0 con 0x7f0b340b7980 2023-07-09T21:38:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1c001120 con 0x7f0b340b7980 2023-07-09T21:38:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b337fe640 1 -- 172.21.15.37:0/28668998 >> v1:172.21.15.119:6789/0 conn(0x7f0b340b7980 legacy=0x7f0b340ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b337fe640 1 -- 172.21.15.37:0/28668998 >> v1:172.21.15.37:6789/0 conn(0x7f0b340cf290 legacy=0x7f0b340d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.539+0000 7f0b337fe640 1 -- 172.21.15.37:0/28668998 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b340cc7f0 con 0x7f0b34160030 2023-07-09T21:38:44.545 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.551+0000 7fd776a46180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:44.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.543+0000 7f0b337fe640 1 --2- 172.21.15.37:0/28668998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340d0e90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009dc0 tx=0x7f0b2c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=278e60804a8a10df server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5830 con 0x7f0b34160030 2023-07-09T21:38:44.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b2c0a5990 con 0x7f0b34160030 2023-07-09T21:38:44.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b327fc640 1 -- 172.21.15.37:0/28668998 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b2c0a5d20 con 0x7f0b34160030 2023-07-09T21:38:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- 172.21.15.37:0/28668998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 msgr2=0x7f0b340d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 --2- 172.21.15.37:0/28668998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340d0e90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c009dc0 tx=0x7f0b2c01c970 comp rx=0 tx=0).stop 2023-07-09T21:38:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- 172.21.15.37:0/28668998 shutdown_connections 2023-07-09T21:38:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 --2- 172.21.15.37:0/28668998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340d0e90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- 172.21.15.37:0/28668998 >> 172.21.15.37:0/28668998 conn(0x7f0b34073090 msgr2=0x7f0b34069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- 172.21.15.37:0/28668998 shutdown_connections 2023-07-09T21:38:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- 172.21.15.37:0/28668998 wait complete. 2023-07-09T21:38:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 Processor -- start 2023-07-09T21:38:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 -- start start 2023-07-09T21:38:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b340b7980 0x7f0b34151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.547+0000 7f0b398bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340b4b50 con 0x7f0b340cf290 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340cc180 con 0x7f0b340b7980 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340c9e20 con 0x7f0b34160030 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50988/0 (socket says 172.21.15.37:50988) 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 -- 172.21.15.37:0/1535866222 learned_addr learned my addr 172.21.15.37:0/1535866222 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:44.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b337fe640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b32ffd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b340b7980 0x7f0b34151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 -- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 msgr2=0x7f0b340cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 -- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b340b7980 msgr2=0x7f0b34151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b340b7980 0x7f0b34151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 -- 172.21.15.37:0/1535866222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009a70 con 0x7f0b340cf290 2023-07-09T21:38:44.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b2bfff640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c005890 tx=0x7f0b1c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c005cf0 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c005e50 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c007270 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b340ca100 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b340b29b0 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.551+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b340b2bd0 con 0x7f0b340cf290 2023-07-09T21:38:44.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.555+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f0b1c0073d0 con 0x7f0b340cf290 2023-07-09T21:38:44.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.555+0000 7f0b30ff9640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 0x7f0b140688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.555+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0b1c0835f0 con 0x7f0b340cf290 2023-07-09T21:38:44.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.555+0000 7f0b32ffd640 1 -- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 msgr2=0x7f0b140688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:44.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.555+0000 7f0b32ffd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 0x7f0b140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:44.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.559+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b1c0507e0 con 0x7f0b340cf290 2023-07-09T21:38:44.603 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.607+0000 7fd776a46180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:44.605 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.603+0000 7ff982bd9180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:38:44.686 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.691+0000 7fd776a46180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:44.695 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.695+0000 7ff982bd9180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:38:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.715+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b3415bf80 con 0x7f0b340cf290 2023-07-09T21:38:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.715+0000 7f0b30ff9640 1 -- 172.21.15.37:0/1535866222 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b3415bf80 con 0x7f0b340cf290 2023-07-09T21:38:44.718 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:38:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 msgr2=0x7f0b140688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 0x7f0b140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 msgr2=0x7f0b340cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c005890 tx=0x7f0b1c00cae0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 shutdown_connections 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f0b14066430 0x7f0b140688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b34160030 0x7f0b340cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b340cf290 0x7f0b340cb700 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 --2- 172.21.15.37:0/1535866222 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b340b7980 0x7f0b34151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 >> 172.21.15.37:0/1535866222 conn(0x7f0b34073090 msgr2=0x7f0b340b5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 shutdown_connections 2023-07-09T21:38:44.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.719+0000 7f0b398bd640 1 -- 172.21.15.37:0/1535866222 wait complete. 2023-07-09T21:38:44.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:38:44.743 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.747+0000 7fd776a46180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:44.758 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.755+0000 7ff982bd9180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:38:44.849 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.847+0000 7ff982bd9180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:38:44.884 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.891+0000 7fd776a46180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:44.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 Processor -- start 2023-07-09T21:38:44.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 -- start start 2023-07-09T21:38:44.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09f80b7980 0x7f09f8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f09f80d0780 0x7f09f80d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f815bf80 con 0x7f09f80ceb80 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f80cd070 con 0x7f09f80b7980 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.887+0000 7f09fef2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f80cfd70 con 0x7f09f80d0780 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09f80b7980 0x7f09f8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09f80ceb80 0x7f09f80cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56692/0 (socket says 172.21.15.37:56692) 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f7fff640 1 -- 172.21.15.37:0/1565846750 learned_addr learned my addr 172.21.15.37:0/1565846750 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:44.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fd4c9640 1 --2- 172.21.15.37:0/1565846750 >> v2:172.21.15.119:3300/0 conn(0x7f09f80d0780 0x7f09f80d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 -- 172.21.15.37:0/1565846750 >> v2:172.21.15.119:3300/0 conn(0x7f09f80d0780 msgr2=0x7f09f80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:44.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 --2- 172.21.15.37:0/1565846750 >> v2:172.21.15.119:3300/0 conn(0x7f09f80d0780 0x7f09f80d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 -- 172.21.15.37:0/1565846750 >> v1:172.21.15.37:6789/0 conn(0x7f09f80ceb80 legacy=0x7f09f80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 -- 172.21.15.37:0/1565846750 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f8160570 con 0x7f09f80b7980 2023-07-09T21:38:44.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f77fe640 1 -- 172.21.15.37:0/1565846750 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835551223 0 0) 0x7f09e4001120 con 0x7f09f80ceb80 2023-07-09T21:38:44.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09fccc8640 1 --2- 172.21.15.37:0/1565846750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80b7980 0x7f09f8160030 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f09f80b1240 tx=0x7f09ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab61a10e8051c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f77fe640 1 -- 172.21.15.37:0/1565846750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0ab600 con 0x7f09f80b7980 2023-07-09T21:38:44.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f77fe640 1 -- 172.21.15.37:0/1565846750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec0a7050 con 0x7f09f80b7980 2023-07-09T21:38:44.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.891+0000 7f09f77fe640 1 -- 172.21.15.37:0/1565846750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0ab980 con 0x7f09f80b7980 2023-07-09T21:38:44.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- 172.21.15.37:0/1565846750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80b7980 msgr2=0x7f09f8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- 172.21.15.37:0/1565846750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80b7980 0x7f09f8160030 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f09f80b1240 tx=0x7f09ec01c460 comp rx=0 tx=0).stop 2023-07-09T21:38:44.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- 172.21.15.37:0/1565846750 shutdown_connections 2023-07-09T21:38:44.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- 172.21.15.37:0/1565846750 >> v2:172.21.15.119:3300/0 conn(0x7f09f80d0780 0x7f09f80d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- 172.21.15.37:0/1565846750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80b7980 0x7f09f8160030 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- 172.21.15.37:0/1565846750 >> 172.21.15.37:0/1565846750 conn(0x7f09f8073090 msgr2=0x7f09f8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:44.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- 172.21.15.37:0/1565846750 shutdown_connections 2023-07-09T21:38:44.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- 172.21.15.37:0/1565846750 wait complete. 2023-07-09T21:38:44.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 Processor -- start 2023-07-09T21:38:44.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- start start 2023-07-09T21:38:44.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 0x7f09f814e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f80d0780 0x7f09f814d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f814f530 con 0x7f09f80ceb80 2023-07-09T21:38:44.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f80b4b70 con 0x7f09f80b7980 2023-07-09T21:38:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fef2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f814e8b0 con 0x7f09f80d0780 2023-07-09T21:38:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51002/0 (socket says 172.21.15.37:51002) 2023-07-09T21:38:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09fccc8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 0x7f09f814e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.895+0000 7f09f7fff640 1 -- 172.21.15.37:0/2617624648 learned_addr learned my addr 172.21.15.37:0/2617624648 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09fd4c9640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f80d0780 0x7f09f814d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 -- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f80d0780 msgr2=0x7f09f814d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f80d0780 0x7f09f814d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 -- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 msgr2=0x7f09f814e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:44.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 0x7f09f814e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 -- 172.21.15.37:0/2617624648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec009420 con 0x7f09f80ceb80 2023-07-09T21:38:44.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09fccc8640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 0x7f09f814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f7fff640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f09e400c780 tx=0x7f09e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40072d0 con 0x7f09f80ceb80 2023-07-09T21:38:44.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4007450 con 0x7f09f80ceb80 2023-07-09T21:38:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f814eb90 con 0x7f09f80ceb80 2023-07-09T21:38:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40047f0 con 0x7f09f80ceb80 2023-07-09T21:38:44.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f814f150 con 0x7f09f80ceb80 2023-07-09T21:38:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.899+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f804d7d0 con 0x7f09f80ceb80 2023-07-09T21:38:44.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.903+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f09e4004950 con 0x7f09f80ceb80 2023-07-09T21:38:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.903+0000 7f09f57fa640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 0x7f09dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.903+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f09e40833e0 con 0x7f09f80ceb80 2023-07-09T21:38:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.903+0000 7f09fccc8640 1 -- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 msgr2=0x7f09dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.903+0000 7f09fccc8640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 0x7f09dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:44.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:44.907+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f09e4050670 con 0x7f09f80ceb80 2023-07-09T21:38:44.912 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:44.911+0000 7ff982bd9180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:38:44.942 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:44.947+0000 7fd776a46180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:45.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.059+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09f815bf80 con 0x7f09f80ceb80 2023-07-09T21:38:45.063 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.059+0000 7ff982bd9180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:38:45.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09f57fa640 1 -- 172.21.15.37:0/2617624648 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09f815bf80 con 0x7f09f80ceb80 2023-07-09T21:38:45.064 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:38:45.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 msgr2=0x7f09dc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:45.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 0x7f09dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 msgr2=0x7f09f815aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f09e400c780 tx=0x7f09e400cc40 comp rx=0 tx=0).stop 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 shutdown_connections 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f09dc066430 0x7f09dc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09f80d0780 0x7f09f814d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09f80ceb80 0x7f09f815aba0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 --2- 172.21.15.37:0/2617624648 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09f80b7980 0x7f09f814e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 >> 172.21.15.37:0/2617624648 conn(0x7f09f8073090 msgr2=0x7f09f81587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 shutdown_connections 2023-07-09T21:38:45.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.063+0000 7f09fef2c640 1 -- 172.21.15.37:0/2617624648 wait complete. 2023-07-09T21:38:45.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:38:45.127 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.123+0000 7ff982bd9180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:38:45.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:45.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:45.182 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:45.190 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:45.195+0000 7fd776a46180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:45.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.271+0000 7ff2100d8640 1 Processor -- start 2023-07-09T21:38:45.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.271+0000 7ff2100d8640 1 -- start start 2023-07-09T21:38:45.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff2100d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff2100d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080cef80 con 0x7ff2080b7a60 2023-07-09T21:38:45.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff2100d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2080cf260 con 0x7ff2080b4140 2023-07-09T21:38:45.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff2100d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080ccee0 con 0x7ff2080b47a0 2023-07-09T21:38:45.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:57572/0 (socket says 172.21.15.37:57572) 2023-07-09T21:38:45.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 -- 172.21.15.37:0/1225355042 learned_addr learned my addr 172.21.15.37:0/1225355042 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:45.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 -- 172.21.15.37:0/1225355042 >> v1:172.21.15.119:6789/0 conn(0x7ff2080b4140 legacy=0x7ff2080d05f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:38:45.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 -- 172.21.15.37:0/1225355042 >> v1:172.21.15.37:6789/0 conn(0x7ff2080b7a60 legacy=0x7ff2080cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.275+0000 7ff20d673640 1 -- 172.21.15.37:0/1225355042 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2080cf540 con 0x7ff2080b47a0 2023-07-09T21:38:45.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff20d673640 1 --2- 172.21.15.37:0/1225355042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff200009e80 tx=0x7ff20001ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed7030a70b7af02 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:45.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff20ce72640 1 -- 172.21.15.37:0/1225355042 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2000a56e0 con 0x7ff2080b47a0 2023-07-09T21:38:45.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff20ce72640 1 -- 172.21.15.37:0/1225355042 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2000a5840 con 0x7ff2080b47a0 2023-07-09T21:38:45.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 -- 172.21.15.37:0/1225355042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 msgr2=0x7ff2080b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 --2- 172.21.15.37:0/1225355042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff200009e80 tx=0x7ff20001ca10 comp rx=0 tx=0).stop 2023-07-09T21:38:45.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 -- 172.21.15.37:0/1225355042 shutdown_connections 2023-07-09T21:38:45.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 --2- 172.21.15.37:0/1225355042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff2080b3c00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 -- 172.21.15.37:0/1225355042 >> 172.21.15.37:0/1225355042 conn(0x7ff208073050 msgr2=0x7ff208069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:45.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 -- 172.21.15.37:0/1225355042 shutdown_connections 2023-07-09T21:38:45.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.283+0000 7ff2100d8640 1 -- 172.21.15.37:0/1225355042 wait complete. 2023-07-09T21:38:45.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 Processor -- start 2023-07-09T21:38:45.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 -- start start 2023-07-09T21:38:45.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff208151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2080b7a60 0x7ff2081554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2081520b0 con 0x7ff2080b4140 2023-07-09T21:38:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080cb5d0 con 0x7ff2080b7a60 2023-07-09T21:38:45.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.287+0000 7ff2100d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2080ca9c0 con 0x7ff2080b47a0 2023-07-09T21:38:45.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51016/0 (socket says 172.21.15.37:51016) 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 -- 172.21.15.37:0/3401408000 learned_addr learned my addr 172.21.15.37:0/3401408000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20e675640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2080b7a60 0x7ff2081554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 -- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 msgr2=0x7ff208151b70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff208151b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 -- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2080b7a60 msgr2=0x7ff2081554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2080b7a60 0x7ff2081554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 -- 172.21.15.37:0/3401408000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009b30 con 0x7ff2080b4140 2023-07-09T21:38:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff20de74640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c3c0 tx=0x7ff20400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:45.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040052d0 con 0x7ff2080b4140 2023-07-09T21:38:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2080caca0 con 0x7ff2080b4140 2023-07-09T21:38:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2080cb260 con 0x7ff2080b4140 2023-07-09T21:38:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff204005430 con 0x7ff2080b4140 2023-07-09T21:38:45.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.291+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff204003800 con 0x7ff2080b4140 2023-07-09T21:38:45.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.295+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff204003960 con 0x7ff2080b4140 2023-07-09T21:38:45.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.299+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f0005260 con 0x7ff2080b4140 2023-07-09T21:38:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.299+0000 7ff1fe7fc640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 0x7ff1ec068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.299+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff204083410 con 0x7ff2080b4140 2023-07-09T21:38:45.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.299+0000 7ff20d673640 1 -- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 msgr2=0x7ff1ec068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:45.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.299+0000 7ff20d673640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 0x7ff1ec068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:45.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.307+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2040506a0 con 0x7ff2080b4140 2023-07-09T21:38:45.325 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:45.331+0000 7fd776a46180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:45.386 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:38:45.386 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:38:45.386 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:38:45.395 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.395+0000 7ff982bd9180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:38:45.449 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:45.455+0000 7fd776a46180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:45.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1f0005510 con 0x7ff2080b4140 2023-07-09T21:38:45.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff1fe7fc640 1 -- 172.21.15.37:0/3401408000 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v86) v1 ==== 80+0+475 (secure 0 0 0) 0x7ff204053cc0 con 0x7ff2080b4140 2023-07-09T21:38:45.501 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/558266346 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.501 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2741372906 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/2674309351 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/2674309351 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2816906929 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/937586606 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3373188161 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.502 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/786069025 2023-07-10T21:38:40.835324+0000 2023-07-09T21:38:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:38:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 msgr2=0x7ff1ec068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 0x7ff1ec068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 msgr2=0x7ff208151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff20400c3c0 tx=0x7ff20400c880 comp rx=0 tx=0).stop 2023-07-09T21:38:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 shutdown_connections 2023-07-09T21:38:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7ff1ec066460 0x7ff1ec068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2080b7a60 0x7ff2081554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2080b47a0 0x7ff208151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 --2- 172.21.15.37:0/3401408000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2080b4140 0x7ff208151630 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 >> 172.21.15.37:0/3401408000 conn(0x7ff208073050 msgr2=0x7ff2080b6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:45.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 shutdown_connections 2023-07-09T21:38:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.499+0000 7ff2100d8640 1 -- 172.21.15.37:0/3401408000 wait complete. 2023-07-09T21:38:45.520 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:45.527+0000 7fd776a46180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:45.522 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:38:45.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:45.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:38:45.539 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.535+0000 7ff982bd9180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:45.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[53904]: fuse finished with error 0 and tester_r 0 2023-07-09T21:38:45.545 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:38:45.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:45.546 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:38:45.631 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:45.632 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:45.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:45.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:38:45.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:45.646 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:38:45.654 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:45.659+0000 7fd776a46180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:45.661 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:38:45.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:45.663 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:45.663 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:45.678 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.675+0000 7ff982bd9180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:38:45.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:45.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:38:45.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:45.684 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:38:45.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:45.737 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:38:45.737 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:45.738 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:45.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:45.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:38:45.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:38:45.752 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:38:45.753 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.747+0000 7ff982bd9180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:38:45.800 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:38:45.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:38:45.801 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:45.894 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:45.891+0000 7ff982bd9180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:38:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.943+0000 7f6cc94d8640 1 Processor -- start 2023-07-09T21:38:45.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.943+0000 7f6cc94d8640 1 -- start start 2023-07-09T21:38:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc94d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6cc40b4340 0x7f6cc406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc94d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40cef80 0x7f6cc40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc94d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc40b49f0 con 0x7f6cc40b7ab0 2023-07-09T21:38:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc94d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc40b7e80 con 0x7f6cc40b4340 2023-07-09T21:38:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc94d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40cc8a0 con 0x7f6cc40cef80 2023-07-09T21:38:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6cc40b4340 0x7f6cc406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6cc40b4340 0x7f6cc406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51030/0 (socket says 172.21.15.37:51030) 2023-07-09T21:38:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 -- 172.21.15.37:0/3640089859 learned_addr learned my addr 172.21.15.37:0/3640089859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40cef80 0x7f6cc40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 -- 172.21.15.37:0/3640089859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40cef80 msgr2=0x7f6cc40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40cef80 0x7f6cc40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 -- 172.21.15.37:0/3640089859 >> v1:172.21.15.119:6789/0 conn(0x7f6cc40b7ab0 legacy=0x7f6cc40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.947+0000 7f6cbbfff640 1 -- 172.21.15.37:0/3640089859 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc40ccb80 con 0x7f6cc40b4340 2023-07-09T21:38:45.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cbbfff640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40b4340 0x7f6cc406aa50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009870 tx=0x7f6cac01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20b5abd66ba4929 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc27fc640 1 -- 172.21.15.37:0/3640089859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0aa670 con 0x7f6cc40b4340 2023-07-09T21:38:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc27fc640 1 -- 172.21.15.37:0/3640089859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac0aa7d0 con 0x7f6cc40b4340 2023-07-09T21:38:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc27fc640 1 -- 172.21.15.37:0/3640089859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0aab60 con 0x7f6cc40b4340 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3640089859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40b4340 msgr2=0x7f6cc406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40b4340 0x7f6cc406aa50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009870 tx=0x7f6cac01c510 comp rx=0 tx=0).stop 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3640089859 shutdown_connections 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40cef80 0x7f6cc40d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3640089859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40b4340 0x7f6cc406aa50 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3640089859 >> 172.21.15.37:0/3640089859 conn(0x7f6cc4073090 msgr2=0x7f6cc4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3640089859 shutdown_connections 2023-07-09T21:38:45.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.951+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3640089859 wait complete. 2023-07-09T21:38:45.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 Processor -- start 2023-07-09T21:38:45.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 -- start start 2023-07-09T21:38:45.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 0x7f6cc41536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40b7ab0 0x7f6cc4141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40c7380 con 0x7f6cc40cef80 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40c75f0 con 0x7f6cc40b7ab0 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc94d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc40c78d0 con 0x7f6cc40b4340 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51040/0 (socket says 172.21.15.37:51040) 2023-07-09T21:38:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc37fe640 1 -- 172.21.15.37:0/3139088754 learned_addr learned my addr 172.21.15.37:0/3139088754 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cc2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 0x7f6cc41536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.955+0000 7f6cbbfff640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40b7ab0 0x7f6cc4141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 -- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 msgr2=0x7f6cc41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 0x7f6cc41536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 -- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40b7ab0 msgr2=0x7f6cc4141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40b7ab0 0x7f6cc4141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:45.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 -- 172.21.15.37:0/3139088754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac0094d0 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc2ffd640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 0x7f6cc41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc37fe640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00efc0 tx=0x7f6cbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc009b20 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cbc00f040 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc40c7bb0 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc0146c0 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc4153be0 con 0x7f6cc40cef80 2023-07-09T21:38:45.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc40c7dd0 con 0x7f6cc40cef80 2023-07-09T21:38:45.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.959+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f6cbc014820 con 0x7f6cc40cef80 2023-07-09T21:38:45.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.963+0000 7f6cbb7fe640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 0x7f6ca40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:45.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.963+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6cbc084ff0 con 0x7f6cc40cef80 2023-07-09T21:38:45.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.963+0000 7f6cc2ffd640 1 -- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 msgr2=0x7f6ca40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:45.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.963+0000 7f6cc2ffd640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 0x7f6ca40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:45.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:45.963+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6cbc0b5700 con 0x7f6cc40cef80 2023-07-09T21:38:46.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.155+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cc404d7d0 con 0x7f6cc40cef80 2023-07-09T21:38:46.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.155+0000 7f6cbb7fe640 1 -- 172.21.15.37:0/3139088754 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f6cbc018090 con 0x7f6cc40cef80 2023-07-09T21:38:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:46.158 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:46.159 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 msgr2=0x7f6ca40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 0x7f6ca40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 msgr2=0x7f6cc40ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00efc0 tx=0x7f6cbc00c490 comp rx=0 tx=0).stop 2023-07-09T21:38:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 shutdown_connections 2023-07-09T21:38:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f6ca4066430 0x7f6ca40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6cc40cef80 0x7f6cc40ca200 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6cc40b7ab0 0x7f6cc4141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 --2- 172.21.15.37:0/3139088754 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6cc40b4340 0x7f6cc41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 >> 172.21.15.37:0/3139088754 conn(0x7f6cc4073090 msgr2=0x7f6cc415ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 shutdown_connections 2023-07-09T21:38:46.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.159+0000 7f6cc94d8640 1 -- 172.21.15.37:0/3139088754 wait complete. 2023-07-09T21:38:46.180 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:46.194 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.199+0000 7fd776a46180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:46.279 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.283+0000 7fd776a46180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 Processor -- start 2023-07-09T21:38:46.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 -- start start 2023-07-09T21:38:46.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b4340 0x7fa76406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7640cef80 0x7fa7640d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7640b49f0 con 0x7fa7640b7ab0 2023-07-09T21:38:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7640b7e80 con 0x7fa7640cef80 2023-07-09T21:38:46.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76c2c4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7640cc8a0 con 0x7fa7640b4340 2023-07-09T21:38:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.323+0000 7fa76a861640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7640cef80 0x7fa7640d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a060640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa7640b7ab0 0x7fa7640b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:42994/0 (socket says 172.21.15.37:42994) 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76985f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b4340 0x7fa76406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a060640 1 -- 172.21.15.37:0/2979342830 learned_addr learned my addr 172.21.15.37:0/2979342830 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a861640 1 -- 172.21.15.37:0/2979342830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b4340 msgr2=0x7fa76406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a861640 1 --2- 172.21.15.37:0/2979342830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b4340 0x7fa76406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a861640 1 -- 172.21.15.37:0/2979342830 >> v1:172.21.15.119:6789/0 conn(0x7fa7640b7ab0 legacy=0x7fa7640b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a861640 1 -- 172.21.15.37:0/2979342830 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7640ccb80 con 0x7fa7640cef80 2023-07-09T21:38:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76905e640 1 -- 172.21.15.37:0/2979342830 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742981173 0 0) 0x7fa7640b49f0 con 0x7fa7640b7ab0 2023-07-09T21:38:46.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76a861640 1 --2- 172.21.15.37:0/2979342830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa7640d02a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c583994c6f7fd0b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76905e640 1 -- 172.21.15.37:0/2979342830 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0a59e0 con 0x7fa7640cef80 2023-07-09T21:38:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76905e640 1 -- 172.21.15.37:0/2979342830 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c0a5b40 con 0x7fa7640cef80 2023-07-09T21:38:46.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.327+0000 7fa76905e640 1 -- 172.21.15.37:0/2979342830 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0ad440 con 0x7fa7640cef80 2023-07-09T21:38:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- 172.21.15.37:0/2979342830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 msgr2=0x7fa7640d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/2979342830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa7640d02a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009d90 tx=0x7fa75c01c920 comp rx=0 tx=0).stop 2023-07-09T21:38:46.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- 172.21.15.37:0/2979342830 shutdown_connections 2023-07-09T21:38:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/2979342830 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b4340 0x7fa76406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/2979342830 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa7640d02a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- 172.21.15.37:0/2979342830 >> 172.21.15.37:0/2979342830 conn(0x7fa764073090 msgr2=0x7fa764069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- 172.21.15.37:0/2979342830 shutdown_connections 2023-07-09T21:38:46.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- 172.21.15.37:0/2979342830 wait complete. 2023-07-09T21:38:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 Processor -- start 2023-07-09T21:38:46.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- start start 2023-07-09T21:38:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7640b4340 0x7fa7641574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 0x7fa764151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641506a0 con 0x7fa7640cef80 2023-07-09T21:38:46.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa764157a80 con 0x7fa7640b4340 2023-07-09T21:38:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76c2c4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641508f0 con 0x7fa7640b7ab0 2023-07-09T21:38:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76a861640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76a861640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51068/0 (socket says 172.21.15.37:51068) 2023-07-09T21:38:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76a861640 1 -- 172.21.15.37:0/3559523463 learned_addr learned my addr 172.21.15.37:0/3559523463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76985f640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 0x7fa764151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.331+0000 7fa76a060640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7640b4340 0x7fa7641574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 -- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 msgr2=0x7fa764151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 0x7fa764151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 -- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7640b4340 msgr2=0x7fa7641574a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7640b4340 0x7fa7641574a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 -- 172.21.15.37:0/3559523463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75c009a70 con 0x7fa7640cef80 2023-07-09T21:38:46.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76985f640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 0x7fa764151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76a861640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa75c01a550 tx=0x7fa75c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0aee00 con 0x7fa7640cef80 2023-07-09T21:38:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c009450 con 0x7fa7640cef80 2023-07-09T21:38:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75c003ba0 con 0x7fa7640cef80 2023-07-09T21:38:46.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa764150bd0 con 0x7fa7640cef80 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764151820 con 0x7fa7640cef80 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.335+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76404d7d0 con 0x7fa7640cef80 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.339+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa75c0b4050 con 0x7fa7640cef80 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.339+0000 7fa75affd640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 0x7fa748068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.339+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa75c11e660 con 0x7fa7640cef80 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.339+0000 7fa76a060640 1 -- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 msgr2=0x7fa748068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:46.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.339+0000 7fa76a060640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 0x7fa748068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:46.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.343+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa75c0eb7b0 con 0x7fa7640cef80 2023-07-09T21:38:46.428 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.435+0000 7fd776a46180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:46.486 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:46.483+0000 7ff982bd9180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:38:46.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.503+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa76406a830 con 0x7fa7640cef80 2023-07-09T21:38:46.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.503+0000 7fa75affd640 1 -- 172.21.15.37:0/3559523463 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+18787 (secure 0 0 0) 0x7fa75c0eedd0 con 0x7fa7640cef80 2023-07-09T21:38:46.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:46.506 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:40.835372+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/558266346":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2741372906":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6833/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6832/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2816906929":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/937586606":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3373188161":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/786069025":"2023-07-10T21:38:40.835324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:46.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 msgr2=0x7fa748068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 0x7fa748068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 msgr2=0x7fa76414f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa75c01a550 tx=0x7fa75c0196c0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 shutdown_connections 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7fa748066460 0x7fa748068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7640cef80 0x7fa76414f3e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7640b7ab0 0x7fa764151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 --2- 172.21.15.37:0/3559523463 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7640b4340 0x7fa7641574a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 >> 172.21.15.37:0/3559523463 conn(0x7fa764073090 msgr2=0x7fa764157ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:46.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 shutdown_connections 2023-07-09T21:38:46.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.507+0000 7fa76c2c4640 1 -- 172.21.15.37:0/3559523463 wait complete. 2023-07-09T21:38:46.511 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.515+0000 7fd776a46180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:46.527 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:38:20.905098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:38:21.780980+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:46.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:46.576 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:46.575+0000 7ff982bd9180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:38:46.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 Processor -- start 2023-07-09T21:38:46.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 -- start start 2023-07-09T21:38:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78180b7980 0x7f7818160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 0x7f78180cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78180b3c20 0x7f78180b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78180cd070 con 0x7f78180b7980 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78180cfd70 con 0x7f78180b3c20 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781fad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781815bf80 con 0x7f78180ceb80 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78180b7980 0x7f7818160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78180b7980 0x7f7818160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51076/0 (socket says 172.21.15.37:51076) 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 -- 172.21.15.37:0/1477329646 learned_addr learned my addr 172.21.15.37:0/1477329646 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781e075640 1 --2- 172.21.15.37:0/1477329646 >> v2:172.21.15.119:3300/0 conn(0x7f78180b3c20 0x7f78180b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d073640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 0x7f78180cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 -- 172.21.15.37:0/1477329646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 msgr2=0x7f78180cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:46.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 0x7f78180cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 -- 172.21.15.37:0/1477329646 >> v2:172.21.15.119:3300/0 conn(0x7f78180b3c20 msgr2=0x7f78180b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:46.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 --2- 172.21.15.37:0/1477329646 >> v2:172.21.15.119:3300/0 conn(0x7f78180b3c20 0x7f78180b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d874640 1 -- 172.21.15.37:0/1477329646 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818160570 con 0x7f78180b7980 2023-07-09T21:38:46.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.675+0000 7f781d073640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 0x7f78180cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:46.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781d874640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f7818160030 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f781808ad30 tx=0x7f781401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5fe810d37c4238 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:46.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781c872640 1 -- 172.21.15.37:0/1477329646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140ab600 con 0x7f78180b7980 2023-07-09T21:38:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781c872640 1 -- 172.21.15.37:0/1477329646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140a7050 con 0x7f78180b7980 2023-07-09T21:38:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781c872640 1 -- 172.21.15.37:0/1477329646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140ab980 con 0x7f78180b7980 2023-07-09T21:38:46.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 -- 172.21.15.37:0/1477329646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 msgr2=0x7f7818160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f7818160030 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f781808ad30 tx=0x7f781401c500 comp rx=0 tx=0).stop 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 -- 172.21.15.37:0/1477329646 shutdown_connections 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 --2- 172.21.15.37:0/1477329646 >> v2:172.21.15.119:3300/0 conn(0x7f78180b3c20 0x7f78180b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180ceb80 0x7f78180cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 --2- 172.21.15.37:0/1477329646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f7818160030 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 -- 172.21.15.37:0/1477329646 >> 172.21.15.37:0/1477329646 conn(0x7f7818073090 msgr2=0x7f7818069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:46.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 -- 172.21.15.37:0/1477329646 shutdown_connections 2023-07-09T21:38:46.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.679+0000 7f781fad8640 1 -- 172.21.15.37:0/1477329646 wait complete. 2023-07-09T21:38:46.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 Processor -- start 2023-07-09T21:38:46.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- start start 2023-07-09T21:38:46.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180b3c20 0x7f781815ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78180ceb80 0x7f781815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78181540f0 con 0x7f78180b7980 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781815aac0 con 0x7f78180ceb80 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781815a7e0 con 0x7f78180b3c20 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51088/0 (socket says 172.21.15.37:51088) 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 -- 172.21.15.37:0/1110565273 learned_addr learned my addr 172.21.15.37:0/1110565273 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:46.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d874640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180b3c20 0x7f781815ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781e075640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78180ceb80 0x7f781815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:46.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 -- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180b3c20 msgr2=0x7f781815ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180b3c20 0x7f781815ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 -- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78180ceb80 msgr2=0x7f781815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78180ceb80 0x7f781815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 -- 172.21.15.37:0/1110565273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78140094d0 con 0x7f78180b7980 2023-07-09T21:38:46.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781d073640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f780800e840 tx=0x7f780800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800c870 con 0x7f78180b7980 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800c9d0 con 0x7f78180b7980 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7818153aa0 con 0x7f78180b7980 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800cd80 con 0x7f78180b7980 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f781815ef50 con 0x7f78180b7980 2023-07-09T21:38:46.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.683+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7818153900 con 0x7f78180b7980 2023-07-09T21:38:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.687+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f7808026480 con 0x7f78180b7980 2023-07-09T21:38:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.687+0000 7f780e7fc640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 0x7f77fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:46.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.687+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f78080842f0 con 0x7f78180b7980 2023-07-09T21:38:46.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.687+0000 7f781d874640 1 -- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 msgr2=0x7f77fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1727026005 2023-07-09T21:38:46.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.687+0000 7f781d874640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 0x7f77fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:38:46.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.691+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7808051330 con 0x7f78180b7980 2023-07-09T21:38:46.736 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:46.735+0000 7ff982bd9180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:38:46.779 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.783+0000 7fd776a46180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:46.824 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:46.823+0000 7ff982bd9180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:38:46.838 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.843+0000 7fd776a46180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:46.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.851+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7808051700 con 0x7f78180b7980 2023-07-09T21:38:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.851+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 msgr2=0x7f77fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:38:46.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.851+0000 7f780e7fc640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 0x7f77fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.851+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7818153900 con 0x7f78180b7980 2023-07-09T21:38:46.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.851+0000 7f780e7fc640 1 -- 172.21.15.37:0/1110565273 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7818153900 con 0x7f78180b7980 2023-07-09T21:38:46.853 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 msgr2=0x7f781814f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:46.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f780800e840 tx=0x7f780800ed00 comp rx=0 tx=0).stop 2023-07-09T21:38:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 shutdown_connections 2023-07-09T21:38:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:6832/1727026005,v1:172.21.15.119:6833/1727026005] conn(0x7f77fc066430 0x7f77fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78180ceb80 0x7f781815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78180b7980 0x7f781814f920 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 --2- 172.21.15.37:0/1110565273 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78180b3c20 0x7f781815ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 >> 172.21.15.37:0/1110565273 conn(0x7f7818073090 msgr2=0x7f781815f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 shutdown_connections 2023-07-09T21:38:46.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:46.855+0000 7f781fad8640 1 -- 172.21.15.37:0/1110565273 wait complete. 2023-07-09T21:38:46.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:46.921 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd701871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.921 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd701871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.921 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd701871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd701871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd701871640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd6fd068640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd6fd068640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.923 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd6fd068640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.923 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd6fd068640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:46.923 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:38:46.927+0000 7fd6fd068640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:38:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 Processor -- start 2023-07-09T21:38:47.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 -- start start 2023-07-09T21:38:47.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 0x7fac40160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 0x7fac400cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4015bf80 con 0x7fac400b3c20 2023-07-09T21:38:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac400cd070 con 0x7fac400b7980 2023-07-09T21:38:47.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac44848640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac400cfd70 con 0x7fac400ceb80 2023-07-09T21:38:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac37fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 0x7fac400cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac3e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 0x7fac40160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac3ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fac400b3c20 0x7fac400b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:43000/0 (socket says 172.21.15.37:43000) 2023-07-09T21:38:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac3ed9d640 1 -- 172.21.15.37:0/359739396 learned_addr learned my addr 172.21.15.37:0/359739396 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:47.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac37fff640 1 -- 172.21.15.37:0/359739396 >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 msgr2=0x7fac40160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac37fff640 1 --2- 172.21.15.37:0/359739396 >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 0x7fac40160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac37fff640 1 -- 172.21.15.37:0/359739396 >> v1:172.21.15.119:6789/0 conn(0x7fac400b3c20 legacy=0x7fac400b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac37fff640 1 -- 172.21.15.37:0/359739396 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac40160570 con 0x7fac400ceb80 2023-07-09T21:38:47.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.031+0000 7fac3e59c640 1 --2- 172.21.15.37:0/359739396 >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 0x7fac40160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:47.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac37fff640 1 --2- 172.21.15.37:0/359739396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 0x7fac400cef90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac280097c0 tx=0x7fac2801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9c37da5fbf5176 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac3dd9b640 1 -- 172.21.15.37:0/359739396 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280ab600 con 0x7fac400ceb80 2023-07-09T21:38:47.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac3dd9b640 1 -- 172.21.15.37:0/359739396 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac280a7050 con 0x7fac400ceb80 2023-07-09T21:38:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac3dd9b640 1 -- 172.21.15.37:0/359739396 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280ab980 con 0x7fac400ceb80 2023-07-09T21:38:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 -- 172.21.15.37:0/359739396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 msgr2=0x7fac400cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 --2- 172.21.15.37:0/359739396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 0x7fac400cef90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fac280097c0 tx=0x7fac2801c480 comp rx=0 tx=0).stop 2023-07-09T21:38:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 -- 172.21.15.37:0/359739396 shutdown_connections 2023-07-09T21:38:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 --2- 172.21.15.37:0/359739396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400ceb80 0x7fac400cef90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 --2- 172.21.15.37:0/359739396 >> v2:172.21.15.119:3300/0 conn(0x7fac400b7980 0x7fac40160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 -- 172.21.15.37:0/359739396 >> 172.21.15.37:0/359739396 conn(0x7fac40073090 msgr2=0x7fac40069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 -- 172.21.15.37:0/359739396 shutdown_connections 2023-07-09T21:38:47.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.035+0000 7fac44848640 1 -- 172.21.15.37:0/359739396 wait complete. 2023-07-09T21:38:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 Processor -- start 2023-07-09T21:38:47.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 -- start start 2023-07-09T21:38:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 0x7fac400c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac400b7980 0x7fac40153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 0x7fac400b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac40153970 con 0x7fac400ceb80 2023-07-09T21:38:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac400c8560 con 0x7fac400b7980 2023-07-09T21:38:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4015e110 con 0x7fac400b3c20 2023-07-09T21:38:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 0x7fac400b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 0x7fac400c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac37fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac400b7980 0x7fac40153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 0x7fac400b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51102/0 (socket says 172.21.15.37:51102) 2023-07-09T21:38:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3ed9d640 1 -- 172.21.15.37:0/3575073723 learned_addr learned my addr 172.21.15.37:0/3575073723 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:47.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 -- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac400b7980 msgr2=0x7fac40153e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac400b7980 0x7fac40153e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 -- 172.21.15.37:0/3575073723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 msgr2=0x7fac400b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 0x7fac400b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 -- 172.21.15.37:0/3575073723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30009420 con 0x7fac400b3c20 2023-07-09T21:38:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac3e59c640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 0x7fac400c8020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fac3000e9b0 tx=0x7fac3000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3000c9a0 con 0x7fac400b3c20 2023-07-09T21:38:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3000cb00 con 0x7fac400b3c20 2023-07-09T21:38:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac30013470 con 0x7fac400b3c20 2023-07-09T21:38:47.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.039+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac28009420 con 0x7fac400b3c20 2023-07-09T21:38:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.043+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac40153600 con 0x7fac400b3c20 2023-07-09T21:38:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.043+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40153180 con 0x7fac400b3c20 2023-07-09T21:38:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.043+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fac300135d0 con 0x7fac400b3c20 2023-07-09T21:38:47.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.043+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fac30084310 con 0x7fac400b3c20 2023-07-09T21:38:47.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.047+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac30051940 con 0x7fac400b3c20 2023-07-09T21:38:47.129 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:47.127+0000 7ff982bd9180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:38:47.192 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:38:47.191+0000 7ff982bd9180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:38:47.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.211+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fac40153180 con 0x7fac400b3c20 2023-07-09T21:38:47.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.211+0000 7fac36ffd640 1 -- 172.21.15.37:0/3575073723 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v87) v1 ==== 92+0+10 (secure 0 0 0) 0x7fac40153180 con 0x7fac400b3c20 2023-07-09T21:38:47.215 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 msgr2=0x7fac400c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 0x7fac400c8020 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fac3000e9b0 tx=0x7fac3000ee70 comp rx=0 tx=0).stop 2023-07-09T21:38:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 shutdown_connections 2023-07-09T21:38:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac400ceb80 0x7fac400b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac400b7980 0x7fac40153e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 --2- 172.21.15.37:0/3575073723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac400b3c20 0x7fac400c8020 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 >> 172.21.15.37:0/3575073723 conn(0x7fac40073090 msgr2=0x7fac4015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 shutdown_connections 2023-07-09T21:38:47.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.215+0000 7fac44848640 1 -- 172.21.15.37:0/3575073723 wait complete. 2023-07-09T21:38:47.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:38:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.379+0000 7f700f59e640 1 Processor -- start 2023-07-09T21:38:47.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.379+0000 7f700f59e640 1 -- start start 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70100b0ed0 0x7f70100afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700f59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70100ce080 con 0x7f70100b1420 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700f59e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70100ce360 con 0x7f70100cfb40 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700f59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70100ce640 con 0x7f70100b0ed0 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70100b0ed0 0x7f70100afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70100b0ed0 0x7f70100afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60286/0 (socket says 172.21.15.37:60286) 2023-07-09T21:38:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 -- 172.21.15.37:0/1641169874 learned_addr learned my addr 172.21.15.37:0/1641169874 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 -- 172.21.15.37:0/1641169874 >> v1:172.21.15.119:6789/0 conn(0x7f70100cfb40 legacy=0x7f70100cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 -- 172.21.15.37:0/1641169874 >> v1:172.21.15.37:6789/0 conn(0x7f70100b1420 legacy=0x7f70100af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.383+0000 7f700ed9d640 1 -- 172.21.15.37:0/1641169874 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70100aed30 con 0x7f70100b0ed0 2023-07-09T21:38:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700ed9d640 1 --2- 172.21.15.37:0/1641169874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100b0ed0 0x7f70100afc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7662e99ed625a6a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700dd9b640 1 -- 172.21.15.37:0/1641169874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080a5870 con 0x7f70100b0ed0 2023-07-09T21:38:47.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700dd9b640 1 -- 172.21.15.37:0/1641169874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080a59d0 con 0x7f70100b0ed0 2023-07-09T21:38:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700dd9b640 1 -- 172.21.15.37:0/1641169874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080a5d60 con 0x7f70100b0ed0 2023-07-09T21:38:47.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- 172.21.15.37:0/1641169874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100b0ed0 msgr2=0x7f70100afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 --2- 172.21.15.37:0/1641169874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100b0ed0 0x7f70100afc40 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700801c9e0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- 172.21.15.37:0/1641169874 shutdown_connections 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 --2- 172.21.15.37:0/1641169874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100b0ed0 0x7f70100afc40 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- 172.21.15.37:0/1641169874 >> 172.21.15.37:0/1641169874 conn(0x7f7010072d20 msgr2=0x7f70100d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- 172.21.15.37:0/1641169874 shutdown_connections 2023-07-09T21:38:47.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- 172.21.15.37:0/1641169874 wait complete. 2023-07-09T21:38:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 Processor -- start 2023-07-09T21:38:47.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- start start 2023-07-09T21:38:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70100b1420 0x7f70100b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701015c130 con 0x7f70100cfb40 2023-07-09T21:38:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701014e310 con 0x7f70100b1420 2023-07-09T21:38:47.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.387+0000 7f700f59e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701015b540 con 0x7f70100b0ed0 2023-07-09T21:38:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700e59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f7007fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70100b1420 0x7f70100b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60288/0 (socket says 172.21.15.37:60288) 2023-07-09T21:38:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700e59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51210/0 (socket says 172.21.15.37:51210) 2023-07-09T21:38:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 -- 172.21.15.37:0/1952795884 learned_addr learned my addr 172.21.15.37:0/1952795884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:47.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 -- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 msgr2=0x7f701014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 -- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70100b1420 msgr2=0x7f70100b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70100b1420 0x7f70100b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 -- 172.21.15.37:0/1952795884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7008009b30 con 0x7f70100cfb40 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700e59c640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700ed9d640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f70100b0990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080b8670 con 0x7f70100cfb40 2023-07-09T21:38:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080b87f0 con 0x7f70100cfb40 2023-07-09T21:38:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701015b800 con 0x7f70100cfb40 2023-07-09T21:38:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080b8ba0 con 0x7f70100cfb40 2023-07-09T21:38:47.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701015bdc0 con 0x7f70100cfb40 2023-07-09T21:38:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701015c2e0 con 0x7f70100cfb40 2023-07-09T21:38:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.391+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f70080b8d00 con 0x7f70100cfb40 2023-07-09T21:38:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.395+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f700811ead0 con 0x7f70100cfb40 2023-07-09T21:38:47.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.399+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f701015c2e0 con 0x7f70100cfb40 2023-07-09T21:38:47.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.551+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f701015c2e0 con 0x7f70100cfb40 2023-07-09T21:38:47.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f7006ffd640 1 -- 172.21.15.37:0/1952795884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f701015c2e0 con 0x7f70100cfb40 2023-07-09T21:38:47.556 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:38:47.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 msgr2=0x7f701015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f70100b0990 comp rx=0 tx=0).stop 2023-07-09T21:38:47.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 shutdown_connections 2023-07-09T21:38:47.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100cfb40 0x7f701015c5c0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70100b1420 0x7f70100b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 --2- 172.21.15.37:0/1952795884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70100b0ed0 0x7f701014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 >> 172.21.15.37:0/1952795884 conn(0x7f7010072d20 msgr2=0x7f70100af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 shutdown_connections 2023-07-09T21:38:47.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.555+0000 7f700f59e640 1 -- 172.21.15.37:0/1952795884 wait complete. 2023-07-09T21:38:47.576 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:38:47.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.719+0000 7f5d83f59640 1 Processor -- start 2023-07-09T21:38:47.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.719+0000 7f5d83f59640 1 -- start start 2023-07-09T21:38:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d83f59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c06e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d83f59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c06c690 con 0x7f5d7c0694c0 2023-07-09T21:38:47.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d83f59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0b1e80 con 0x7f5d7c070370 2023-07-09T21:38:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d83f59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c06ebd0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d81cf5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5d7c0694c0 0x7f5d7c069890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34886/0 (socket says 172.21.15.37:34886) 2023-07-09T21:38:47.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d81cf5640 1 -- 172.21.15.37:0/448042935 learned_addr learned my addr 172.21.15.37:0/448042935 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:47.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d814f4640 1 --2- 172.21.15.37:0/448042935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c06e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874043416 0 0) 0x7f5d7c06c690 con 0x7f5d7c0694c0 2023-07-09T21:38:47.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d68003530 con 0x7f5d7c0694c0 2023-07-09T21:38:47.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828921172 0 0) 0x7f5d7c0b1e80 con 0x7f5d7c070370 2023-07-09T21:38:47.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d7c06c690 con 0x7f5d7c070370 2023-07-09T21:38:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d814f4640 1 -- 172.21.15.37:0/448042935 >> v1:172.21.15.119:6789/0 conn(0x7f5d7c070370 legacy=0x7f5d7c15c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d814f4640 1 -- 172.21.15.37:0/448042935 >> v1:172.21.15.37:6789/0 conn(0x7f5d7c0694c0 legacy=0x7f5d7c069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.723+0000 7f5d814f4640 1 -- 172.21.15.37:0/448042935 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c0b2160 con 0x7f5d7c06cb20 2023-07-09T21:38:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d814f4640 1 --2- 172.21.15.37:0/448042935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c06e690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097f0 tx=0x7f5d6c01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d8e45bdd8d1c97c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0aa3f0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0aa550 con 0x7f5d7c06cb20 2023-07-09T21:38:47.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d80cf3640 1 -- 172.21.15.37:0/448042935 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0aa8e0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- 172.21.15.37:0/448042935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 msgr2=0x7f5d7c06e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 --2- 172.21.15.37:0/448042935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c06e690 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0097f0 tx=0x7f5d6c01c490 comp rx=0 tx=0).stop 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- 172.21.15.37:0/448042935 shutdown_connections 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 --2- 172.21.15.37:0/448042935 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c06e690 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- 172.21.15.37:0/448042935 >> 172.21.15.37:0/448042935 conn(0x7f5d7c06b250 msgr2=0x7f5d7c0cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- 172.21.15.37:0/448042935 shutdown_connections 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- 172.21.15.37:0/448042935 wait complete. 2023-07-09T21:38:47.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 Processor -- start 2023-07-09T21:38:47.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.727+0000 7f5d83f59640 1 -- start start 2023-07-09T21:38:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d7c0694c0 0x7f5d7c140550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d7c070370 0x7f5d7c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c140a90 con 0x7f5d7c070370 2023-07-09T21:38:47.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c1f4a90 con 0x7f5d7c0694c0 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c1f39f0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d81cf5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d7c0694c0 0x7f5d7c140550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d824f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d7c070370 0x7f5d7c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51234/0 (socket says 172.21.15.37:51234) 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 -- 172.21.15.37:0/1507168684 learned_addr learned my addr 172.21.15.37:0/1507168684 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:47.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 -- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d7c0694c0 msgr2=0x7f5d7c140550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d7c0694c0 0x7f5d7c140550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 -- 172.21.15.37:0/1507168684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d7c070370 msgr2=0x7f5d7c0cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d7c070370 0x7f5d7c0cbec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 -- 172.21.15.37:0/1507168684 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d6c009420 con 0x7f5d7c06cb20 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d814f4640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0ac040 tx=0x7f5d6c01acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0b4810 con 0x7f5d7c06cb20 2023-07-09T21:38:47.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6c0aae90 con 0x7f5d7c06cb20 2023-07-09T21:38:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c0b4bd0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c1f3cd0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c1f4290 con 0x7f5d7c06cb20 2023-07-09T21:38:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.731+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c04d7d0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.735+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 31) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f5d6c0b4d30 con 0x7f5d7c06cb20 2023-07-09T21:38:47.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.735+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5d6c0a7070 con 0x7f5d7c06cb20 2023-07-09T21:38:47.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.739+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5d6c0eb760 con 0x7f5d7c06cb20 2023-07-09T21:38:47.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.855+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5d6c0eb210 con 0x7f5d7c06cb20 2023-07-09T21:38:47.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.855+0000 7f5d727fc640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 0x7f5d6006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:47.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.859+0000 7f5d81cf5640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 0x7f5d6006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:47.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.859+0000 7f5d81cf5640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 0x7f5d6006e4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007fd0 tx=0x7f5d78007d80 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:47.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.895+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d7c14bec0 con 0x7f5d7c06cb20 2023-07-09T21:38:47.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.895+0000 7f5d727fc640 1 -- 172.21.15.37:0/1507168684 <== mon.2 v2:172.21.15.119:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d6c106580 con 0x7f5d7c06cb20 2023-07-09T21:38:47.899 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:38:47.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 msgr2=0x7f5d6006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 0x7f5d6006e4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5d78007fd0 tx=0x7f5d78007d80 comp rx=0 tx=0).stop 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 msgr2=0x7f5d7c0cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c0ac040 tx=0x7f5d6c01acd0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 shutdown_connections 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5d6006c0c0 0x7f5d6006e4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d7c070370 0x7f5d7c0cbec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5d7c06cb20 0x7f5d7c0cb980 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 --2- 172.21.15.37:0/1507168684 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5d7c0694c0 0x7f5d7c140550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:47.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 >> 172.21.15.37:0/1507168684 conn(0x7f5d7c06b250 msgr2=0x7f5d7c0b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:47.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 shutdown_connections 2023-07-09T21:38:47.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:47.899+0000 7f5d83f59640 1 -- 172.21.15.37:0/1507168684 wait complete. 2023-07-09T21:38:47.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.059+0000 7fab246bd640 1 Processor -- start 2023-07-09T21:38:48.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.059+0000 7fab246bd640 1 -- start start 2023-07-09T21:38:48.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab246bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fab1c0aff40 0x7fab1c0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab246bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c06efc0 con 0x7fab1c06b120 2023-07-09T21:38:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab246bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c06f4f0 con 0x7fab1c158670 2023-07-09T21:38:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab246bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c06d390 con 0x7fab1c0aff40 2023-07-09T21:38:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab22c5a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fab1c06b120 0x7fab1c15c1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34900/0 (socket says 172.21.15.37:34900) 2023-07-09T21:38:48.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab22c5a640 1 -- 172.21.15.37:0/745565424 learned_addr learned my addr 172.21.15.37:0/745565424 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:48.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21c58640 1 --2- 172.21.15.37:0/745565424 >> v2:172.21.15.119:3300/0 conn(0x7fab1c0aff40 0x7fab1c0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21457640 1 -- 172.21.15.37:0/745565424 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54135272 0 0) 0x7fab1c06efc0 con 0x7fab1c06b120 2023-07-09T21:38:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21457640 1 -- 172.21.15.37:0/745565424 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab08003530 con 0x7fab1c06b120 2023-07-09T21:38:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21c58640 1 -- 172.21.15.37:0/745565424 >> v1:172.21.15.119:6789/0 conn(0x7fab1c158670 legacy=0x7fab1c0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21c58640 1 -- 172.21.15.37:0/745565424 >> v1:172.21.15.37:6789/0 conn(0x7fab1c06b120 legacy=0x7fab1c15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.063+0000 7fab21c58640 1 -- 172.21.15.37:0/745565424 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c06fe90 con 0x7fab1c0aff40 2023-07-09T21:38:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab21c58640 1 --2- 172.21.15.37:0/745565424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c0ca2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0097f0 tx=0x7fab0c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a11457d5f8eb1c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab21457640 1 -- 172.21.15.37:0/745565424 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0ac620 con 0x7fab1c0aff40 2023-07-09T21:38:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab21457640 1 -- 172.21.15.37:0/745565424 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c0ac780 con 0x7fab1c0aff40 2023-07-09T21:38:48.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab21457640 1 -- 172.21.15.37:0/745565424 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0acb10 con 0x7fab1c0aff40 2023-07-09T21:38:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- 172.21.15.37:0/745565424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 msgr2=0x7fab1c0ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 --2- 172.21.15.37:0/745565424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c0ca2f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0097f0 tx=0x7fab0c01c3c0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- 172.21.15.37:0/745565424 shutdown_connections 2023-07-09T21:38:48.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 --2- 172.21.15.37:0/745565424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c0ca2f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- 172.21.15.37:0/745565424 >> 172.21.15.37:0/745565424 conn(0x7fab1c0ca830 msgr2=0x7fab1c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- 172.21.15.37:0/745565424 shutdown_connections 2023-07-09T21:38:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- 172.21.15.37:0/745565424 wait complete. 2023-07-09T21:38:48.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 Processor -- start 2023-07-09T21:38:48.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- start start 2023-07-09T21:38:48.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c156820 con 0x7fab1c158670 2023-07-09T21:38:48.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c156a90 con 0x7fab1c0aff40 2023-07-09T21:38:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.067+0000 7fab246bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c156d70 con 0x7fab1c06b120 2023-07-09T21:38:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab21c58640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22c5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60314/0 (socket says 172.21.15.37:60314) 2023-07-09T21:38:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51236/0 (socket says 172.21.15.37:51236) 2023-07-09T21:38:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22c5a640 1 -- 172.21.15.37:0/1424621835 learned_addr learned my addr 172.21.15.37:0/1424621835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 -- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 msgr2=0x7fab1c152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 -- 172.21.15.37:0/1424621835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 msgr2=0x7fab1c0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 -- 172.21.15.37:0/1424621835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab0c009420 con 0x7fab1c06b120 2023-07-09T21:38:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22c5a640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab22459640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab18000f70 tx=0x7fab1800c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab180052d0 con 0x7fab1c06b120 2023-07-09T21:38:48.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab18005430 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c157050 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab18003840 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c152540 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c04d7d0 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.071+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fab180039a0 con 0x7fab1c06b120 2023-07-09T21:38:48.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.075+0000 7fab12ffd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 0x7fab00068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.075+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fab18083210 con 0x7fab1c06b120 2023-07-09T21:38:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.075+0000 7fab21c58640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 0x7fab00068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.075+0000 7fab21c58640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 0x7fab00068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ae000 tx=0x7fab0c0a7000 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.079+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab180506d0 con 0x7fab1c06b120 2023-07-09T21:38:48.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.263+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab1c156eb0 con 0x7fab1c06b120 2023-07-09T21:38:48.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab12ffd640 1 -- 172.21.15.37:0/1424621835 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7fab1c156eb0 con 0x7fab1c06b120 2023-07-09T21:38:48.267 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:48.268 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:48.268 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 msgr2=0x7fab00068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 0x7fab00068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ae000 tx=0x7fab0c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 msgr2=0x7fab1c0b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab18000f70 tx=0x7fab1800c820 comp rx=0 tx=0).stop 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 shutdown_connections 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fab000660d0 0x7fab00068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab1c158670 0x7fab1c0b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab1c0aff40 0x7fab1c152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 --2- 172.21.15.37:0/1424621835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab1c06b120 0x7fab1c0b35a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 >> 172.21.15.37:0/1424621835 conn(0x7fab1c0ca830 msgr2=0x7fab1c0ccdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 shutdown_connections 2023-07-09T21:38:48.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.267+0000 7fab246bd640 1 -- 172.21.15.37:0/1424621835 wait complete. 2023-07-09T21:38:48.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.427+0000 7fa7e3f1f640 1 Processor -- start 2023-07-09T21:38:48.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 -- start start 2023-07-09T21:38:48.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc0b2140 0x7fa7dc0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7dc15bdf0 con 0x7fa7dc06c330 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7dc06b650 con 0x7fa7dc15ba20 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e3f1f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0b2720 con 0x7fa7dc0b2140 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60330/0 (socket says 172.21.15.37:60330) 2023-07-09T21:38:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/3789396324 learned_addr learned my addr 172.21.15.37:0/3789396324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e24bc640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc0b2140 0x7fa7dc0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/3789396324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc0b2140 msgr2=0x7fa7dc0ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:48.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc0b2140 0x7fa7dc0ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/3789396324 >> v1:172.21.15.119:6789/0 conn(0x7fa7dc06c330 legacy=0x7fa7dc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.431+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/3789396324 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc06b850 con 0x7fa7dc15ba20 2023-07-09T21:38:48.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e1cbb640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009870 tx=0x7fa7d801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757f2af909c197be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e0cb9640 1 -- 172.21.15.37:0/3789396324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80ab600 con 0x7fa7dc15ba20 2023-07-09T21:38:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e0cb9640 1 -- 172.21.15.37:0/3789396324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80a7050 con 0x7fa7dc15ba20 2023-07-09T21:38:48.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e0cb9640 1 -- 172.21.15.37:0/3789396324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80ab980 con 0x7fa7dc15ba20 2023-07-09T21:38:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/3789396324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc15ba20 msgr2=0x7fa7dc0cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009870 tx=0x7fa7d801c510 comp rx=0 tx=0).stop 2023-07-09T21:38:48.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/3789396324 shutdown_connections 2023-07-09T21:38:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc0b2140 0x7fa7dc0ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/3789396324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc15ba20 0x7fa7dc0cc9c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/3789396324 >> 172.21.15.37:0/3789396324 conn(0x7fa7dc072400 msgr2=0x7fa7dc072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/3789396324 shutdown_connections 2023-07-09T21:38:48.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/3789396324 wait complete. 2023-07-09T21:38:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 Processor -- start 2023-07-09T21:38:48.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.435+0000 7fa7e3f1f640 1 -- start start 2023-07-09T21:38:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 0x7fa7dc14d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc15ba20 0x7fa7dc0c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0c4870 con 0x7fa7dc06c330 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc14f110 con 0x7fa7dc0b2140 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0c3c60 con 0x7fa7dc15ba20 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60338/0 (socket says 172.21.15.37:60338) 2023-07-09T21:38:48.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/2788020553 learned_addr learned my addr 172.21.15.37:0/2788020553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc15ba20 msgr2=0x7fa7dc0c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc15ba20 0x7fa7dc0c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e14ba640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 0x7fa7dc14d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 msgr2=0x7fa7dc14d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 0x7fa7dc14d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 -- 172.21.15.37:0/2788020553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d80094d0 con 0x7fa7dc06c330 2023-07-09T21:38:48.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e14ba640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 0x7fa7dc14d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:48.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e1cbb640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa7d801a140 tx=0x7fa7d80192b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b4440 con 0x7fa7dc06c330 2023-07-09T21:38:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d80b45a0 con 0x7fa7dc06c330 2023-07-09T21:38:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80b4930 con 0x7fa7dc06c330 2023-07-09T21:38:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc0c3f40 con 0x7fa7dc06c330 2023-07-09T21:38:48.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc0c4500 con 0x7fa7dc06c330 2023-07-09T21:38:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7dc04d7d0 con 0x7fa7dc06c330 2023-07-09T21:38:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.439+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa7d80b2070 con 0x7fa7dc06c330 2023-07-09T21:38:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.443+0000 7fa7d27fc640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 0x7fa7c00685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.443+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa7d811da30 con 0x7fa7dc06c330 2023-07-09T21:38:48.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.443+0000 7fa7e14ba640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 0x7fa7c00685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.443+0000 7fa7e14ba640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 0x7fa7c00685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc15dd20 tx=0x7fa7cc009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.447+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7d80eae40 con 0x7fa7dc06c330 2023-07-09T21:38:48.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.603+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7dc0b0da0 con 0x7fa7dc06c330 2023-07-09T21:38:48.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.603+0000 7fa7d27fc640 1 -- 172.21.15.37:0/2788020553 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+19359 (secure 0 0 0) 0x7fa7d80b0090 con 0x7fa7dc06c330 2023-07-09T21:38:48.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:48.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:46.843403+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1828061615":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/3874302833":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/2769262186":"2023-07-10T21:38:46.843353+0000","172.21.15.119:6833/1727026005":"2023-07-10T21:38:46.843353+0000","172.21.15.119:6832/1727026005":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/1020707395":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/747750713":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/4216697108":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/558266346":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3227059239":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/2741372906":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6833/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6832/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2816906929":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/937586606":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3373188161":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/786069025":"2023-07-10T21:38:40.835324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:48.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 msgr2=0x7fa7c00685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 0x7fa7c00685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc15dd20 tx=0x7fa7cc009040 comp rx=0 tx=0).stop 2023-07-09T21:38:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 msgr2=0x7fa7dc0c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fa7d801a140 tx=0x7fa7d80192b0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 shutdown_connections 2023-07-09T21:38:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fa7c0066100 0x7fa7c00685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7dc15ba20 0x7fa7dc0c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7dc0b2140 0x7fa7dc14d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 --2- 172.21.15.37:0/2788020553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7dc06c330 0x7fa7dc0c4d00 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 >> 172.21.15.37:0/2788020553 conn(0x7fa7dc072400 msgr2=0x7fa7dc0ca5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 shutdown_connections 2023-07-09T21:38:48.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.607+0000 7fa7e3f1f640 1 -- 172.21.15.37:0/2788020553 wait complete. 2023-07-09T21:38:48.627 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:38:48.628 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:48.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.767+0000 7f8bf1559640 1 Processor -- start 2023-07-09T21:38:48.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 -- start start 2023-07-09T21:38:48.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bec0b7ab0 0x7f8bec06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0b49f0 con 0x7f8bec0cef80 2023-07-09T21:38:48.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0b7e80 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8bf1559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0cc8a0 con 0x7f8bec0b4340 2023-07-09T21:38:48.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bec0b7ab0 0x7f8bec06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bec0b7ab0 0x7f8bec06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60346/0 (socket says 172.21.15.37:60346) 2023-07-09T21:38:48.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 -- 172.21.15.37:0/1447316769 learned_addr learned my addr 172.21.15.37:0/1447316769 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beb7fe640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 -- 172.21.15.37:0/1447316769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 msgr2=0x7f8bec0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 -- 172.21.15.37:0/1447316769 >> v1:172.21.15.119:6789/0 conn(0x7f8bec0cef80 legacy=0x7f8bec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beaffd640 1 -- 172.21.15.37:0/1447316769 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0ccb80 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.771+0000 7f8beb7fe640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:48.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8beaffd640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec06aa50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009870 tx=0x7f8bdc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd934c07cca2d93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bea7fc640 1 -- 172.21.15.37:0/1447316769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0aa5f0 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bea7fc640 1 -- 172.21.15.37:0/1447316769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0aa750 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bea7fc640 1 -- 172.21.15.37:0/1447316769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0aaae0 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- 172.21.15.37:0/1447316769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0b7ab0 msgr2=0x7f8bec06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec06aa50 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009870 tx=0x7f8bdc01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- 172.21.15.37:0/1447316769 shutdown_connections 2023-07-09T21:38:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 --2- 172.21.15.37:0/1447316769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec06aa50 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- 172.21.15.37:0/1447316769 >> 172.21.15.37:0/1447316769 conn(0x7f8bec073090 msgr2=0x7f8bec069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- 172.21.15.37:0/1447316769 shutdown_connections 2023-07-09T21:38:48.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- 172.21.15.37:0/1447316769 wait complete. 2023-07-09T21:38:48.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 Processor -- start 2023-07-09T21:38:48.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.775+0000 7f8bf1559640 1 -- start start 2023-07-09T21:38:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0ca670 con 0x7f8bec0cef80 2023-07-09T21:38:48.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec0ca950 con 0x7f8bec0b7ab0 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec15c840 con 0x7f8bec0b4340 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60354/0 (socket says 172.21.15.37:60354) 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 -- 172.21.15.37:0/481980470 learned_addr learned my addr 172.21.15.37:0/481980470 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8be3fff640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beaffd640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 -- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 msgr2=0x7f8bec155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 -- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bec0b7ab0 msgr2=0x7f8bec0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 -- 172.21.15.37:0/481980470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0094d0 con 0x7f8bec0cef80 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8beb7fe640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8be400cea0 tx=0x7f8be400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be4003ba0 con 0x7f8bec0cef80 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be4003d20 con 0x7f8bec0cef80 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be400d880 con 0x7f8bec0cef80 2023-07-09T21:38:48.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec15cb20 con 0x7f8bec0cef80 2023-07-09T21:38:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec0cac30 con 0x7f8bec0cef80 2023-07-09T21:38:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.779+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec15c6a0 con 0x7f8bec0cef80 2023-07-09T21:38:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.783+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 32) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8be400d9e0 con 0x7f8bec0cef80 2023-07-09T21:38:48.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.783+0000 7f8be37fe640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 0x7f8bcc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.783+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f8be40844b0 con 0x7f8bec0cef80 2023-07-09T21:38:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.783+0000 7f8beaffd640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 0x7f8bcc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:48.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.783+0000 7f8beaffd640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 0x7f8bcc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0ae000 tx=0x7f8bdc0b5040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:48.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.787+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8bec15c6a0 con 0x7f8bec0cef80 2023-07-09T21:38:48.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bec15c6a0 con 0x7f8bec0cef80 2023-07-09T21:38:48.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8be37fe640 1 -- 172.21.15.37:0/481980470 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f8bec15c6a0 con 0x7f8bec0cef80 2023-07-09T21:38:48.978 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:48.978 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:48.979 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 msgr2=0x7f8bcc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 0x7f8bcc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0ae000 tx=0x7f8bdc0b5040 comp rx=0 tx=0).stop 2023-07-09T21:38:48.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 msgr2=0x7f8bec0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8be400cea0 tx=0x7f8be400cf90 comp rx=0 tx=0).stop 2023-07-09T21:38:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 shutdown_connections 2023-07-09T21:38:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8bcc0660d0 0x7f8bcc068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bec0cef80 0x7f8bec0cb0b0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8bec0b7ab0 0x7f8bec0c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 --2- 172.21.15.37:0/481980470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8bec0b4340 0x7f8bec155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 >> 172.21.15.37:0/481980470 conn(0x7f8bec073090 msgr2=0x7f8bec0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 shutdown_connections 2023-07-09T21:38:48.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:48.975+0000 7f8bf1559640 1 -- 172.21.15.37:0/481980470 wait complete. 2023-07-09T21:38:48.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.138+0000 7f879d3e9640 1 Processor -- start 2023-07-09T21:38:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 -- start start 2023-07-09T21:38:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87980b7ab0 0x7f879806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f87980cef80 0x7f87980b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87980b49f0 con 0x7f87980b4170 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980b7e80 con 0x7f87980b7ab0 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f879d3e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87980b4610 con 0x7f87980cef80 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87980b7ab0 0x7f879806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87980b7ab0 0x7f879806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60358/0 (socket says 172.21.15.37:60358) 2023-07-09T21:38:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 -- 172.21.15.37:0/758210082 learned_addr learned my addr 172.21.15.37:0/758210082 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f87967fc640 1 --2- 172.21.15.37:0/758210082 >> v2:172.21.15.119:3300/0 conn(0x7f87980cef80 0x7f87980b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 -- 172.21.15.37:0/758210082 >> v2:172.21.15.119:3300/0 conn(0x7f87980cef80 msgr2=0x7f87980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:49.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 --2- 172.21.15.37:0/758210082 >> v2:172.21.15.119:3300/0 conn(0x7f87980cef80 0x7f87980b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 -- 172.21.15.37:0/758210082 >> v1:172.21.15.119:6789/0 conn(0x7f87980b4170 legacy=0x7f879815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.142+0000 7f8796ffd640 1 -- 172.21.15.37:0/758210082 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87980cc8a0 con 0x7f87980b7ab0 2023-07-09T21:38:49.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f8796ffd640 1 --2- 172.21.15.37:0/758210082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980b7ab0 0x7f879806aa50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f87980b4d10 tx=0x7f878801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7e01b0234a2b59 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f8795ffb640 1 -- 172.21.15.37:0/758210082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880aa430 con 0x7f87980b7ab0 2023-07-09T21:38:49.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f8795ffb640 1 -- 172.21.15.37:0/758210082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87880aa590 con 0x7f87980b7ab0 2023-07-09T21:38:49.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f8795ffb640 1 -- 172.21.15.37:0/758210082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87880aa920 con 0x7f87980b7ab0 2023-07-09T21:38:49.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 -- 172.21.15.37:0/758210082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980b7ab0 msgr2=0x7f879806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 --2- 172.21.15.37:0/758210082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980b7ab0 0x7f879806aa50 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f87980b4d10 tx=0x7f878801c4d0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 -- 172.21.15.37:0/758210082 shutdown_connections 2023-07-09T21:38:49.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 --2- 172.21.15.37:0/758210082 >> v2:172.21.15.119:3300/0 conn(0x7f87980cef80 0x7f87980b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 --2- 172.21.15.37:0/758210082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980b7ab0 0x7f879806aa50 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 -- 172.21.15.37:0/758210082 >> 172.21.15.37:0/758210082 conn(0x7f8798073090 msgr2=0x7f8798069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 -- 172.21.15.37:0/758210082 shutdown_connections 2023-07-09T21:38:49.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 -- 172.21.15.37:0/758210082 wait complete. 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.146+0000 7f879d3e9640 1 Processor -- start 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- start start 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 0x7f87981f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 0x7f87981f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f879815e410 con 0x7f87980cef80 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8798159640 con 0x7f87980b4170 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f879815e610 con 0x7f87980b7ab0 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87977fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 0x7f87981f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f8796ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 0x7f87981f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f8796ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40582/0 (socket says 172.21.15.37:40582) 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f8796ffd640 1 -- 172.21.15.37:0/1696344410 learned_addr learned my addr 172.21.15.37:0/1696344410 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:49.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 -- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 msgr2=0x7f87980c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 -- 172.21.15.37:0/1696344410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 msgr2=0x7f87981f81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 0x7f87981f81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 -- 172.21.15.37:0/1696344410 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880094d0 con 0x7f87980b7ab0 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f8796ffd640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87977fe640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 0x7f87981f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:49.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f87967fc640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 0x7f87981f7ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d5a0 tx=0x7f878c00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c004240 con 0x7f87980b7ab0 2023-07-09T21:38:49.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878c0043a0 con 0x7f87980b7ab0 2023-07-09T21:38:49.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f879815e8f0 con 0x7f87980b7ab0 2023-07-09T21:38:49.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f878c003860 con 0x7f87980b7ab0 2023-07-09T21:38:49.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f879815eeb0 con 0x7f87980b7ab0 2023-07-09T21:38:49.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.150+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8798159860 con 0x7f87980b7ab0 2023-07-09T21:38:49.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.154+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f878c0039c0 con 0x7f87980b7ab0 2023-07-09T21:38:49.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.154+0000 7f877f7fe640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 0x7f8784068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.154+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f878c083c00 con 0x7f87980b7ab0 2023-07-09T21:38:49.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.154+0000 7f8796ffd640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 0x7f8784068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.154+0000 7f8796ffd640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 0x7f8784068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f878801c510 tx=0x7f87880b5040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.158+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8798159860 con 0x7f87980b7ab0 2023-07-09T21:38:49.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.346+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8798159800 con 0x7f87980b7ab0 2023-07-09T21:38:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.346+0000 7f877f7fe640 1 -- 172.21.15.37:0/1696344410 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4678 (secure 0 0 0) 0x7f878c019090 con 0x7f87980b7ab0 2023-07-09T21:38:49.350 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:38:22.783167+0000","modified":"2023-07-09T21:38:26.449890+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6556},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6556":{"gid":6556,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6837/1629652523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1629652523},{"type":"v1","addr":"172.21.15.119:6837","nonce":1629652523}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-07-09T21:38:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2023-07-09T21:38:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 msgr2=0x7f8784068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 0x7f8784068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f878801c510 tx=0x7f87880b5040 comp rx=0 tx=0).stop 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 msgr2=0x7f87981f7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 0x7f87981f7ca0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f878c00d5a0 tx=0x7f878c00da60 comp rx=0 tx=0).stop 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 shutdown_connections 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f87840663a0 0x7f8784068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87980cef80 0x7f87981f81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f87980b7ab0 0x7f87981f7ca0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 --2- 172.21.15.37:0/1696344410 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f87980b4170 0x7f87980c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 >> 172.21.15.37:0/1696344410 conn(0x7f8798073090 msgr2=0x7f87980ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 shutdown_connections 2023-07-09T21:38:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.350+0000 7f879d3e9640 1 -- 172.21.15.37:0/1696344410 wait complete. 2023-07-09T21:38:49.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:49.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.510+0000 7f211fa7b640 1 Processor -- start 2023-07-09T21:38:49.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.510+0000 7f211fa7b640 1 -- start start 2023-07-09T21:38:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.510+0000 7f211fa7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f21180cc320 0x7f211806efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.510+0000 7f211fa7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21180cbe90 con 0x7f21180af830 2023-07-09T21:38:49.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.510+0000 7f211fa7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2118159bb0 con 0x7f21180cc770 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211fa7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211806d370 con 0x7f21180cc320 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d817640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21180af830 0x7f21180afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34904/0 (socket says 172.21.15.37:34904) 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d817640 1 -- 172.21.15.37:0/1271325175 learned_addr learned my addr 172.21.15.37:0/1271325175 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d016640 1 --2- 172.21.15.37:0/1271325175 >> v2:172.21.15.119:3300/0 conn(0x7f21180cc320 0x7f211806efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386458934 0 0) 0x7f21180cbe90 con 0x7f21180af830 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2104003530 con 0x7f21180af830 2023-07-09T21:38:49.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d016640 1 -- 172.21.15.37:0/1271325175 >> v1:172.21.15.119:6789/0 conn(0x7f21180cc770 legacy=0x7f211806c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 167525015 0 0) 0x7f2118159bb0 con 0x7f21180cc770 2023-07-09T21:38:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d016640 1 -- 172.21.15.37:0/1271325175 >> v1:172.21.15.37:6789/0 conn(0x7f21180af830 legacy=0x7f21180afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d016640 1 -- 172.21.15.37:0/1271325175 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21180b38b0 con 0x7f21180cc320 2023-07-09T21:38:49.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.514+0000 7f211d016640 1 --2- 172.21.15.37:0/1271325175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f211806efc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21080097c0 tx=0x7f210801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3162dcffe018b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080ab650 con 0x7f21180cc320 2023-07-09T21:38:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21080ab7b0 con 0x7f21180cc320 2023-07-09T21:38:49.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211c815640 1 -- 172.21.15.37:0/1271325175 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080abb40 con 0x7f21180cc320 2023-07-09T21:38:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- 172.21.15.37:0/1271325175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 msgr2=0x7f211806efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 --2- 172.21.15.37:0/1271325175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f211806efc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f21080097c0 tx=0x7f210801c450 comp rx=0 tx=0).stop 2023-07-09T21:38:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- 172.21.15.37:0/1271325175 shutdown_connections 2023-07-09T21:38:49.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 --2- 172.21.15.37:0/1271325175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f211806efc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- 172.21.15.37:0/1271325175 >> 172.21.15.37:0/1271325175 conn(0x7f21180ca830 msgr2=0x7f21180cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- 172.21.15.37:0/1271325175 shutdown_connections 2023-07-09T21:38:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- 172.21.15.37:0/1271325175 wait complete. 2023-07-09T21:38:49.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 Processor -- start 2023-07-09T21:38:49.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- start start 2023-07-09T21:38:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 0x7f2118156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f21180cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21181584c0 con 0x7f21180cc770 2023-07-09T21:38:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2118155dc0 con 0x7f21180cc320 2023-07-09T21:38:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211fa7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21181572d0 con 0x7f21180af830 2023-07-09T21:38:49.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211e018640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211e018640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60366/0 (socket says 172.21.15.37:60366) 2023-07-09T21:38:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.518+0000 7f211e018640 1 -- 172.21.15.37:0/341178154 learned_addr learned my addr 172.21.15.37:0/341178154 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211d016640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f21180cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211d817640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 0x7f2118156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 -- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 msgr2=0x7f2118156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 0x7f2118156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 -- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 msgr2=0x7f21180cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f21180cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 -- 172.21.15.37:0/341178154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2108009420 con 0x7f21180cc770 2023-07-09T21:38:49.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211d817640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 0x7f2118156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211e018640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f211000c7b0 tx=0x7f211000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110003e00 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211000ce60 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118155ff0 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2110005290 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21181565b0 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211804d7d0 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f21100053f0 con 0x7f21180cc770 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 0x7f20fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.522+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2110083920 con 0x7f21180cc770 2023-07-09T21:38:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.526+0000 7f211d817640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 0x7f20fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.526+0000 7f211d817640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 0x7f20fc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2114005890 tx=0x7f2114009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.526+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2110050a50 con 0x7f21180cc770 2023-07-09T21:38:49.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.682+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21180cd820 con 0x7f21180cc770 2023-07-09T21:38:49.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f210e7fc640 1 -- 172.21.15.37:0/341178154 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+19359 (secure 0 0 0) 0x7f2110017090 con 0x7f21180cc770 2023-07-09T21:38:49.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:49.688 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":87,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:46.843403+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:38:20.905098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-07-09T21:38:21.780980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1828061615":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/3874302833":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/2769262186":"2023-07-10T21:38:46.843353+0000","172.21.15.119:6833/1727026005":"2023-07-10T21:38:46.843353+0000","172.21.15.119:6832/1727026005":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/1020707395":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/747750713":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/4216697108":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/558266346":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3227059239":"2023-07-10T21:38:46.843353+0000","172.21.15.119:0/2741372906":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6833/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:6832/2674309351":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/2816906929":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/937586606":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/3373188161":"2023-07-10T21:38:40.835324+0000","172.21.15.119:0/786069025":"2023-07-10T21:38:40.835324+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:49.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 msgr2=0x7f20fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 0x7f20fc068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2114005890 tx=0x7f2114009040 comp rx=0 tx=0).stop 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 msgr2=0x7f21180cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f211000c7b0 tx=0x7f211000cc70 comp rx=0 tx=0).stop 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 shutdown_connections 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f20fc0663a0 0x7f20fc068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f21180cc770 0x7f21180cb140 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21180cc320 0x7f21180cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 --2- 172.21.15.37:0/341178154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21180af830 0x7f2118156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 >> 172.21.15.37:0/341178154 conn(0x7f21180ca830 msgr2=0x7f21180af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:49.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 shutdown_connections 2023-07-09T21:38:49.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.686+0000 7f211fa7b640 1 -- 172.21.15.37:0/341178154 wait complete. 2023-07-09T21:38:49.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:38:49.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 Processor -- start 2023-07-09T21:38:49.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 -- start start 2023-07-09T21:38:49.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 0x7fb7e80b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7e80cc770 0x7fb7e80b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e80ccbb0 con 0x7fb7e80d1a60 2023-07-09T21:38:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e80ce300 con 0x7fb7e80cc770 2023-07-09T21:38:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ee120640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e80ce5a0 con 0x7fb7e80ce9c0 2023-07-09T21:38:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed11e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 0x7fb7e80b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed91f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7e80cc770 0x7fb7e80b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed11e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 0x7fb7e80b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40592/0 (socket says 172.21.15.37:40592) 2023-07-09T21:38:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed11e640 1 -- 172.21.15.37:0/1604205596 learned_addr learned my addr 172.21.15.37:0/1604205596 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:49.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed91f640 1 -- 172.21.15.37:0/1604205596 >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 msgr2=0x7fb7e80b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed91f640 1 --2- 172.21.15.37:0/1604205596 >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 0x7fb7e80b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed91f640 1 -- 172.21.15.37:0/1604205596 >> v1:172.21.15.119:6789/0 conn(0x7fb7e80d1a60 legacy=0x7fb7e80ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.850+0000 7fb7ed91f640 1 -- 172.21.15.37:0/1604205596 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80d0730 con 0x7fb7e80cc770 2023-07-09T21:38:49.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ed91f640 1 --2- 172.21.15.37:0/1604205596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e80b4e00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80cf900 tx=0x7fb7e001d1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b820ee30936a7594 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7dffff640 1 -- 172.21.15.37:0/1604205596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00a5870 con 0x7fb7e80cc770 2023-07-09T21:38:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7dffff640 1 -- 172.21.15.37:0/1604205596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e00a59d0 con 0x7fb7e80cc770 2023-07-09T21:38:49.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7dffff640 1 -- 172.21.15.37:0/1604205596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00a5d60 con 0x7fb7e80cc770 2023-07-09T21:38:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 -- 172.21.15.37:0/1604205596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 msgr2=0x7fb7e80b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 --2- 172.21.15.37:0/1604205596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e80b4e00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fb7e80cf900 tx=0x7fb7e001d1f0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 -- 172.21.15.37:0/1604205596 shutdown_connections 2023-07-09T21:38:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 --2- 172.21.15.37:0/1604205596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e80b4e00 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 --2- 172.21.15.37:0/1604205596 >> v2:172.21.15.119:3300/0 conn(0x7fb7e80ce9c0 0x7fb7e80b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 -- 172.21.15.37:0/1604205596 >> 172.21.15.37:0/1604205596 conn(0x7fb7e80d1fb0 msgr2=0x7fb7e80d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:49.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 -- 172.21.15.37:0/1604205596 shutdown_connections 2023-07-09T21:38:49.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.854+0000 7fb7ee120640 1 -- 172.21.15.37:0/1604205596 wait complete. 2023-07-09T21:38:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 Processor -- start 2023-07-09T21:38:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 -- start start 2023-07-09T21:38:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7e80ce9c0 0x7fb7e814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7e80d1a60 0x7fb7e80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80c5f10 con 0x7fb7e80cc770 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e81511a0 con 0x7fb7e80d1a60 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e8151480 con 0x7fb7e80ce9c0 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60388/0 (socket says 172.21.15.37:60388) 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 -- 172.21.15.37:0/3552326216 learned_addr learned my addr 172.21.15.37:0/3552326216 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed91f640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7e80d1a60 0x7fb7e80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ec91d640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7e80ce9c0 0x7fb7e814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 -- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7e80ce9c0 msgr2=0x7fb7e814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7e80ce9c0 0x7fb7e814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 -- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7e80d1a60 msgr2=0x7fb7e80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:49.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7e80d1a60 0x7fb7e80c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:49.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 -- 172.21.15.37:0/3552326216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e0009a70 con 0x7fb7e80cc770 2023-07-09T21:38:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ed11e640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400e7f0 tx=0x7fb7e400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4009580 con 0x7fb7e80cc770 2023-07-09T21:38:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400c940 con 0x7fb7e80cc770 2023-07-09T21:38:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400ccf0 con 0x7fb7e80cc770 2023-07-09T21:38:49.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.858+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e8151760 con 0x7fb7e80cc770 2023-07-09T21:38:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e814fd70 con 0x7fb7e80cc770 2023-07-09T21:38:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e80c6180 con 0x7fb7e80cc770 2023-07-09T21:38:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb7e4013470 con 0x7fb7e80cc770 2023-07-09T21:38:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ddffb640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 0x7fb7cc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:49.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb7e4084190 con 0x7fb7e80cc770 2023-07-09T21:38:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.862+0000 7fb7ec91d640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 0x7fb7cc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:49.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.866+0000 7fb7ec91d640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 0x7fb7cc068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7e815b6d0 tx=0x7fb7d8009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:49.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:49.866+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb7e40512c0 con 0x7fb7e80cc770 2023-07-09T21:38:50.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.054+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb7e804e020 con 0x7fb7e80cc770 2023-07-09T21:38:50.057 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:38:50.054+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:38:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ddffb640 1 -- 172.21.15.37:0/3552326216 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb7e40548e0 con 0x7fb7e80cc770 2023-07-09T21:38:50.064 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 msgr2=0x7fb7cc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 0x7fb7cc068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb7e815b6d0 tx=0x7fb7d8009040 comp rx=0 tx=0).stop 2023-07-09T21:38:50.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 msgr2=0x7fb7e8150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400e7f0 tx=0x7fb7e400ecb0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 shutdown_connections 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fb7cc0663d0 0x7fb7cc068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7e80d1a60 0x7fb7e80c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7e80ce9c0 0x7fb7e814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 --2- 172.21.15.37:0/3552326216 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7e80cc770 0x7fb7e8150b50 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 >> 172.21.15.37:0/3552326216 conn(0x7fb7e80d1fb0 msgr2=0x7fb7e8158810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 shutdown_connections 2023-07-09T21:38:50.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.062+0000 7fb7ee120640 1 -- 172.21.15.37:0/3552326216 wait complete. 2023-07-09T21:38:50.071 INFO:tasks.ceph.mds.b.smithi119.stderr: -2893> 2023-07-09T21:38:28.379+0000 7f4ac7a4b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:38:50.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:38:50.120 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:38:50.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.226+0000 7f0e06434640 1 Processor -- start 2023-07-09T21:38:50.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.226+0000 7f0e06434640 1 -- start start 2023-07-09T21:38:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e06434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0006e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e06434640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e06434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0006c690 con 0x7f0e0006cb20 2023-07-09T21:38:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e06434640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0006ebd0 con 0x7f0e00070370 2023-07-09T21:38:50.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e06434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000b1e80 con 0x7f0e000694c0 2023-07-09T21:38:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e049d1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0006e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e049d1640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40612/0 (socket says 172.21.15.37:40612) 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e049d1640 1 -- 172.21.15.37:0/3234785126 learned_addr learned my addr 172.21.15.37:0/3234785126 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0dfffff640 1 -- 172.21.15.37:0/3234785126 >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 msgr2=0x7f0e0015c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0dfffff640 1 --2- 172.21.15.37:0/3234785126 >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0dfffff640 1 -- 172.21.15.37:0/3234785126 >> v1:172.21.15.119:6789/0 conn(0x7f0e0006cb20 legacy=0x7f0e00069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0dfffff640 1 -- 172.21.15.37:0/3234785126 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000b2160 con 0x7f0e000694c0 2023-07-09T21:38:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.230+0000 7f0e049d1640 1 --2- 172.21.15.37:0/3234785126 >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0dfffff640 1 --2- 172.21.15.37:0/3234785126 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0006e690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0df00097c0 tx=0x7f0df001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b73410309b925a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0dfeffd640 1 -- 172.21.15.37:0/3234785126 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00ab600 con 0x7f0e000694c0 2023-07-09T21:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0dfeffd640 1 -- 172.21.15.37:0/3234785126 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df00a7050 con 0x7f0e000694c0 2023-07-09T21:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0dfeffd640 1 -- 172.21.15.37:0/3234785126 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00ab980 con 0x7f0e000694c0 2023-07-09T21:38:50.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- 172.21.15.37:0/3234785126 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 msgr2=0x7f0e0006e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 --2- 172.21.15.37:0/3234785126 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0006e690 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0df00097c0 tx=0x7f0df001c450 comp rx=0 tx=0).stop 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- 172.21.15.37:0/3234785126 shutdown_connections 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 --2- 172.21.15.37:0/3234785126 >> v2:172.21.15.119:3300/0 conn(0x7f0e00070370 0x7f0e0015c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 --2- 172.21.15.37:0/3234785126 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0006e690 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- 172.21.15.37:0/3234785126 >> 172.21.15.37:0/3234785126 conn(0x7f0e0006b250 msgr2=0x7f0e000cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- 172.21.15.37:0/3234785126 shutdown_connections 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- 172.21.15.37:0/3234785126 wait complete. 2023-07-09T21:38:50.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 Processor -- start 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.234+0000 7f0e06434640 1 -- start start 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e0006cb20 0x7f0e0015b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00070370 0x7f0e0014c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00153b30 con 0x7f0e00070370 2023-07-09T21:38:50.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015bad0 con 0x7f0e0006cb20 2023-07-09T21:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e00153240 con 0x7f0e000694c0 2023-07-09T21:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e049d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00070370 0x7f0e0014c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51328/0 (socket says 172.21.15.37:51328) 2023-07-09T21:38:50.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 -- 172.21.15.37:0/158256448 learned_addr learned my addr 172.21.15.37:0/158256448 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dff7fe640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e0006cb20 0x7f0e0015b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 -- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e0006cb20 msgr2=0x7f0e0015b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e0006cb20 0x7f0e0015b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 -- 172.21.15.37:0/158256448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00070370 msgr2=0x7f0e0014c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00070370 0x7f0e0014c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 -- 172.21.15.37:0/158256448 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8009b30 con 0x7f0e000694c0 2023-07-09T21:38:50.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfffff640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0df00ae040 tx=0x7f0df00191f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00b4430 con 0x7f0e000694c0 2023-07-09T21:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df00b4590 con 0x7f0e000694c0 2023-07-09T21:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df00b4940 con 0x7f0e000694c0 2023-07-09T21:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df0009420 con 0x7f0e000694c0 2023-07-09T21:38:50.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e001537c0 con 0x7f0e000694c0 2023-07-09T21:38:50.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0004d7d0 con 0x7f0e000694c0 2023-07-09T21:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.238+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0df00b2040 con 0x7f0e000694c0 2023-07-09T21:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.242+0000 7f0dfcff9640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 0x7f0dec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.242+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f0df011e170 con 0x7f0e000694c0 2023-07-09T21:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.242+0000 7f0dff7fe640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 0x7f0dec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:50.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.242+0000 7f0dff7fe640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 0x7f0dec068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e0014c430 tx=0x7f0df4009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:50.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.246+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0df00eb140 con 0x7f0e000694c0 2023-07-09T21:38:50.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:50.434+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0e0015a6c0 con 0x7f0e000694c0 2023-07-09T21:38:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.098+0000 7f0dfcff9640 1 -- 172.21.15.37:0/158256448 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0df00ee760 con 0x7f0e000694c0 2023-07-09T21:38:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 msgr2=0x7f0dec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 0x7f0dec068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0e0014c430 tx=0x7f0df4009040 comp rx=0 tx=0).stop 2023-07-09T21:38:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 msgr2=0x7f0e0014bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0df00ae040 tx=0x7f0df00191f0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 shutdown_connections 2023-07-09T21:38:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0dec0663a0 0x7f0dec068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e00070370 0x7f0e0014c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0e0006cb20 0x7f0e0015b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 --2- 172.21.15.37:0/158256448 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0e000694c0 0x7f0e0014bef0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 >> 172.21.15.37:0/158256448 conn(0x7f0e0006b250 msgr2=0x7f0e00069890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 shutdown_connections 2023-07-09T21:38:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.102+0000 7f0e06434640 1 -- 172.21.15.37:0/158256448 wait complete. 2023-07-09T21:38:51.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:38:51.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 Processor -- start 2023-07-09T21:38:51.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 -- start start 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05c80b7980 0x7f05c8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 0x7f05c80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c815bf80 con 0x7f05c80b3c20 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80cd070 con 0x7f05c80b7980 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05d00bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80cfd70 con 0x7f05c80ceb80 2023-07-09T21:38:51.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05c80b7980 0x7f05c8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05c80b7980 0x7f05c8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60420/0 (socket says 172.21.15.37:60420) 2023-07-09T21:38:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 -- 172.21.15.37:0/1842371806 learned_addr learned my addr 172.21.15.37:0/1842371806 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05ce65a640 1 --1- 172.21.15.37:0/1842371806 >> v1:172.21.15.37:6789/0 conn(0x7f05c80b3c20 0x7f05c80b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34920/0 (socket says 172.21.15.37:34920) 2023-07-09T21:38:51.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cd658640 1 --2- 172.21.15.37:0/1842371806 >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 0x7f05c80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 -- 172.21.15.37:0/1842371806 >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 msgr2=0x7f05c80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 --2- 172.21.15.37:0/1842371806 >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 0x7f05c80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 -- 172.21.15.37:0/1842371806 >> v1:172.21.15.37:6789/0 conn(0x7f05c80b3c20 legacy=0x7f05c80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cde59640 1 -- 172.21.15.37:0/1842371806 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c8160570 con 0x7f05c80b7980 2023-07-09T21:38:51.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.274+0000 7f05cd658640 1 --2- 172.21.15.37:0/1842371806 >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 0x7f05c80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:51.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05cde59640 1 --2- 172.21.15.37:0/1842371806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c8160030 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f05c80b4cd0 tx=0x7f05c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c46c0aa612fb99 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:51.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05cce57640 1 -- 172.21.15.37:0/1842371806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40ab600 con 0x7f05c80b7980 2023-07-09T21:38:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05cce57640 1 -- 172.21.15.37:0/1842371806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c40a7050 con 0x7f05c80b7980 2023-07-09T21:38:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05cce57640 1 -- 172.21.15.37:0/1842371806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c40ab980 con 0x7f05c80b7980 2023-07-09T21:38:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 -- 172.21.15.37:0/1842371806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 msgr2=0x7f05c8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1842371806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c8160030 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f05c80b4cd0 tx=0x7f05c401c500 comp rx=0 tx=0).stop 2023-07-09T21:38:51.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 -- 172.21.15.37:0/1842371806 shutdown_connections 2023-07-09T21:38:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1842371806 >> v2:172.21.15.119:3300/0 conn(0x7f05c80ceb80 0x7f05c80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1842371806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c8160030 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 -- 172.21.15.37:0/1842371806 >> 172.21.15.37:0/1842371806 conn(0x7f05c8073090 msgr2=0x7f05c8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 -- 172.21.15.37:0/1842371806 shutdown_connections 2023-07-09T21:38:51.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.278+0000 7f05d00bd640 1 -- 172.21.15.37:0/1842371806 wait complete. 2023-07-09T21:38:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 Processor -- start 2023-07-09T21:38:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- start start 2023-07-09T21:38:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05c80b3c20 0x7f05c80cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05c80ceb80 0x7f05c80c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80c70d0 con 0x7f05c80b7980 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80ca700 con 0x7f05c80b3c20 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80c9dd0 con 0x7f05c80ceb80 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 -- 172.21.15.37:0/1795128265 learned_addr learned my addr 172.21.15.37:0/1795128265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cde59640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05c80b3c20 0x7f05c80cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05ce65a640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05c80ceb80 0x7f05c80c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 -- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05c80ceb80 msgr2=0x7f05c80c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05c80ceb80 0x7f05c80c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 -- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05c80b3c20 msgr2=0x7f05c80cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05c80b3c20 0x7f05c80cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 -- 172.21.15.37:0/1795128265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c40094d0 con 0x7f05c80b7980 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05cd658640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d800 tx=0x7f05b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800b6c0 con 0x7f05c80b7980 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b800b820 con 0x7f05c80b7980 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b800bbd0 con 0x7f05c80b7980 2023-07-09T21:38:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80ca0b0 con 0x7f05c80b7980 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.282+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c80c5cb0 con 0x7f05c80b7980 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c804d7d0 con 0x7f05c80b7980 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05b800bd30 con 0x7f05c80b7980 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05be7fc640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 0x7f05ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f05b80846b0 con 0x7f05c80b7980 2023-07-09T21:38:51.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05cde59640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 0x7f05ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.286+0000 7f05cde59640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 0x7f05ac068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ad000 tx=0x7f05c4008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:51.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.290+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05b80550e0 con 0x7f05c80b7980 2023-07-09T21:38:51.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:51.446+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f05c80ca840 con 0x7f05c80b7980 2023-07-09T21:38:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.150+0000 7f05be7fc640 1 -- 172.21.15.37:0/1795128265 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v89) v1 ==== 181+0+0 (secure 0 0 0) 0x7f05b8054c70 con 0x7f05c80b7980 2023-07-09T21:38:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:38:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 msgr2=0x7f05ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 0x7f05ac068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f05c40ad000 tx=0x7f05c4008040 comp rx=0 tx=0).stop 2023-07-09T21:38:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 msgr2=0x7f05c80c75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f05b800d800 tx=0x7f05b800dcc0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 shutdown_connections 2023-07-09T21:38:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f05ac0663a0 0x7f05ac068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05c80ceb80 0x7f05c80c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05c80b7980 0x7f05c80c75d0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 --2- 172.21.15.37:0/1795128265 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05c80b3c20 0x7f05c80cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 >> 172.21.15.37:0/1795128265 conn(0x7f05c8073090 msgr2=0x7f05c80d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 shutdown_connections 2023-07-09T21:38:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.154+0000 7f05d00bd640 1 -- 172.21.15.37:0/1795128265 wait complete. 2023-07-09T21:38:52.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:38:52.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 Processor -- start 2023-07-09T21:38:52.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 -- start start 2023-07-09T21:38:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 0x7f62400c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400c47a0 con 0x7f624015c200 2023-07-09T21:38:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62400c9090 con 0x7f62401585b0 2023-07-09T21:38:52.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f6246f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62400cbf40 con 0x7f62400c3e10 2023-07-09T21:38:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f62454dd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f624015c200 0x7f62400c9520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34932/0 (socket says 172.21.15.37:34932) 2023-07-09T21:38:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f62454dd640 1 -- 172.21.15.37:0/3227757020 learned_addr learned my addr 172.21.15.37:0/3227757020 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:52.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623ffff640 1 --2- 172.21.15.37:0/3227757020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 0x7f62400c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214077004 0 0) 0x7f62380014a0 con 0x7f624015c200 2023-07-09T21:38:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6230003530 con 0x7f624015c200 2023-07-09T21:38:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853998226 0 0) 0x7f62400c9090 con 0x7f62401585b0 2023-07-09T21:38:52.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62380014a0 con 0x7f62401585b0 2023-07-09T21:38:52.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623ffff640 1 -- 172.21.15.37:0/3227757020 >> v1:172.21.15.119:6789/0 conn(0x7f62401585b0 legacy=0x7f624006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623ffff640 1 -- 172.21.15.37:0/3227757020 >> v1:172.21.15.37:6789/0 conn(0x7f624015c200 legacy=0x7f62400c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.334+0000 7f623ffff640 1 -- 172.21.15.37:0/3227757020 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62400c8a60 con 0x7f62400c3e10 2023-07-09T21:38:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f623ffff640 1 --2- 172.21.15.37:0/3227757020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 0x7f62400c4260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097f0 tx=0x7f622c01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd4f73e0e158a68 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:52.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0aa620 con 0x7f62400c3e10 2023-07-09T21:38:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0aa780 con 0x7f62400c3e10 2023-07-09T21:38:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f623f7fe640 1 -- 172.21.15.37:0/3227757020 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c0aab10 con 0x7f62400c3e10 2023-07-09T21:38:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 -- 172.21.15.37:0/3227757020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 msgr2=0x7f62400c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 --2- 172.21.15.37:0/3227757020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 0x7f62400c4260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097f0 tx=0x7f622c01c4c0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 -- 172.21.15.37:0/3227757020 shutdown_connections 2023-07-09T21:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 --2- 172.21.15.37:0/3227757020 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62400c3e10 0x7f62400c4260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 -- 172.21.15.37:0/3227757020 >> 172.21.15.37:0/3227757020 conn(0x7f62400cde40 msgr2=0x7f62400ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 -- 172.21.15.37:0/3227757020 shutdown_connections 2023-07-09T21:38:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.338+0000 7f6246f40640 1 -- 172.21.15.37:0/3227757020 wait complete. 2023-07-09T21:38:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 Processor -- start 2023-07-09T21:38:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- start start 2023-07-09T21:38:52.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62400c3e10 0x7f62400ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:52.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62401585b0 0x7f62400ae610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:52.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62401f8b90 con 0x7f624015c200 2023-07-09T21:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62400aeb50 con 0x7f62400c3e10 2023-07-09T21:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62401f7c30 con 0x7f62401585b0 2023-07-09T21:38:52.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60436/0 (socket says 172.21.15.37:60436) 2023-07-09T21:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 -- 172.21.15.37:0/90106310 learned_addr learned my addr 172.21.15.37:0/90106310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f623ffff640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62401585b0 0x7f62400ae610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:52.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6244cdc640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62400c3e10 0x7f62400ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 -- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62401585b0 msgr2=0x7f62400ae610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62401585b0 0x7f62400ae610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 -- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62400c3e10 msgr2=0x7f62400ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62400c3e10 0x7f62400ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:52.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 -- 172.21.15.37:0/90106310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009420 con 0x7f624015c200 2023-07-09T21:38:52.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f62454dd640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f623800cc30 tx=0x7f623800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:52.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f623800ce40 con 0x7f624015c200 2023-07-09T21:38:52.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238012400 con 0x7f624015c200 2023-07-09T21:38:52.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238012790 con 0x7f624015c200 2023-07-09T21:38:52.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62401f7f10 con 0x7f624015c200 2023-07-09T21:38:52.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.342+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62401f84d0 con 0x7f624015c200 2023-07-09T21:38:52.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62400c4e80 con 0x7f624015c200 2023-07-09T21:38:52.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6238007070 con 0x7f624015c200 2023-07-09T21:38:52.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f623d7fa640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 0x7f6224068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:52.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f6238083fc0 con 0x7f624015c200 2023-07-09T21:38:52.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f6244cdc640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 0x7f6224068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:52.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.346+0000 7f6244cdc640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 0x7f6224068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62340011f0 tx=0x7f6234009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:52.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.350+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62400c4e80 con 0x7f624015c200 2023-07-09T21:38:52.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:52.506+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62400c47a0 con 0x7f624015c200 2023-07-09T21:38:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.166+0000 7f623d7fa640 1 -- 172.21.15.37:0/90106310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v90) v1 ==== 169+0+0 (secure 0 0 0) 0x7f62400c47a0 con 0x7f624015c200 2023-07-09T21:38:53.170 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:38:53.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 msgr2=0x7f6224068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 0x7f6224068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62340011f0 tx=0x7f6234009040 comp rx=0 tx=0).stop 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 msgr2=0x7f62400aef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f623800cc30 tx=0x7f623800a430 comp rx=0 tx=0).stop 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 shutdown_connections 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f62240663a0 0x7f6224068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f624015c200 0x7f62400aef80 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62401585b0 0x7f62400ae610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 --2- 172.21.15.37:0/90106310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62400c3e10 0x7f62400ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 >> 172.21.15.37:0/90106310 conn(0x7f62400cde40 msgr2=0x7f62400cc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 shutdown_connections 2023-07-09T21:38:53.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.170+0000 7f6246f40640 1 -- 172.21.15.37:0/90106310 wait complete. 2023-07-09T21:38:53.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:38:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 Processor -- start 2023-07-09T21:38:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 -- start start 2023-07-09T21:38:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540cf290 0x7fdb54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb540d0780 0x7fdb540d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb5415bf80 con 0x7fdb540b7980 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb540cd070 con 0x7fdb540d0780 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5c234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb540cfd70 con 0x7fdb540cf290 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb59fd0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb540b7980 0x7fdb540ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34946/0 (socket says 172.21.15.37:34946) 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb59fd0640 1 -- 172.21.15.37:0/157414615 learned_addr learned my addr 172.21.15.37:0/157414615 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5a7d1640 1 --2- 172.21.15.37:0/157414615 >> v2:172.21.15.37:3300/0 conn(0x7fdb540d0780 0x7fdb540d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb597cf640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540cf290 0x7fdb54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb58fce640 1 -- 172.21.15.37:0/157414615 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776030628 0 0) 0x7fdb50001120 con 0x7fdb540b7980 2023-07-09T21:38:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb58fce640 1 -- 172.21.15.37:0/157414615 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb40003530 con 0x7fdb540b7980 2023-07-09T21:38:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5a7d1640 1 -- 172.21.15.37:0/157414615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540cf290 msgr2=0x7fdb54160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5a7d1640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540cf290 0x7fdb54160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5a7d1640 1 -- 172.21.15.37:0/157414615 >> v1:172.21.15.37:6789/0 conn(0x7fdb540b7980 legacy=0x7fdb540ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.346+0000 7fdb5a7d1640 1 -- 172.21.15.37:0/157414615 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb54160570 con 0x7fdb540d0780 2023-07-09T21:38:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5a7d1640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540d0780 0x7fdb540d0c00 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009d90 tx=0x7fdb4c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4064c79baf478e19 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb58fce640 1 -- 172.21.15.37:0/157414615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0a5810 con 0x7fdb540d0780 2023-07-09T21:38:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb58fce640 1 -- 172.21.15.37:0/157414615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c0a5970 con 0x7fdb540d0780 2023-07-09T21:38:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb58fce640 1 -- 172.21.15.37:0/157414615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c0a5d00 con 0x7fdb540d0780 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 -- 172.21.15.37:0/157414615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540d0780 msgr2=0x7fdb540d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540d0780 0x7fdb540d0c00 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009d90 tx=0x7fdb4c01c950 comp rx=0 tx=0).stop 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 -- 172.21.15.37:0/157414615 shutdown_connections 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540d0780 0x7fdb540d0c00 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 --2- 172.21.15.37:0/157414615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540cf290 0x7fdb54160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 -- 172.21.15.37:0/157414615 >> 172.21.15.37:0/157414615 conn(0x7fdb54073090 msgr2=0x7fdb54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 -- 172.21.15.37:0/157414615 shutdown_connections 2023-07-09T21:38:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.350+0000 7fdb5c234640 1 -- 172.21.15.37:0/157414615 wait complete. 2023-07-09T21:38:53.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 Processor -- start 2023-07-09T21:38:53.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- start start 2023-07-09T21:38:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540b7980 0x7fdb5415e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb540d0780 0x7fdb541506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54150c30 con 0x7fdb540cf290 2023-07-09T21:38:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5415eb80 con 0x7fdb540d0780 2023-07-09T21:38:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54151810 con 0x7fdb540b7980 2023-07-09T21:38:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60468/0 (socket says 172.21.15.37:60468) 2023-07-09T21:38:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 -- 172.21.15.37:0/278478791 learned_addr learned my addr 172.21.15.37:0/278478791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb59fd0640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540b7980 0x7fdb5415e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5a7d1640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb540d0780 0x7fdb541506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 -- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540b7980 msgr2=0x7fdb5415e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540b7980 0x7fdb5415e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 -- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb540d0780 msgr2=0x7fdb541506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb540d0780 0x7fdb541506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 -- 172.21.15.37:0/278478791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009a70 con 0x7fdb540cf290 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb597cf640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e960 tx=0x7fdb4400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44009690 con 0x7fdb540cf290 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4400c9a0 con 0x7fdb540cf290 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4400cd10 con 0x7fdb540cf290 2023-07-09T21:38:53.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb54150ee0 con 0x7fdb540cf290 2023-07-09T21:38:53.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.354+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb541514a0 con 0x7fdb540cf290 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5404d7d0 con 0x7fdb540cf290 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdb44013470 con 0x7fdb540cf290 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb4a7fc640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 0x7fdb38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fdb44083fd0 con 0x7fdb540cf290 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb59fd0640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 0x7fdb38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.358+0000 7fdb59fd0640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 0x7fdb38068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001280 tx=0x7fdb50007bc0 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.362+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb44051400 con 0x7fdb540cf290 2023-07-09T21:38:53.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.526+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdb540b1600 con 0x7fdb540cf290 2023-07-09T21:38:53.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.530+0000 7fdb4a7fc640 1 -- 172.21.15.37:0/278478791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb44054a20 con 0x7fdb540cf290 2023-07-09T21:38:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 msgr2=0x7fdb38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 0x7fdb38068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdb50001280 tx=0x7fdb50007bc0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 msgr2=0x7fdb54151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400e960 tx=0x7fdb4400ee20 comp rx=0 tx=0).stop 2023-07-09T21:38:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 shutdown_connections 2023-07-09T21:38:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb380663a0 0x7fdb38068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb540d0780 0x7fdb541506f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb540cf290 0x7fdb54151ca0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 --2- 172.21.15.37:0/278478791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb540b7980 0x7fdb5415e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 >> 172.21.15.37:0/278478791 conn(0x7fdb54073090 msgr2=0x7fdb540ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:53.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 shutdown_connections 2023-07-09T21:38:53.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.534+0000 7fdb5c234640 1 -- 172.21.15.37:0/278478791 wait complete. 2023-07-09T21:38:53.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:38:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 Processor -- start 2023-07-09T21:38:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 -- start start 2023-07-09T21:38:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 0x7f14dc15c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14dc0c47a0 con 0x7f14dc1585b0 2023-07-09T21:38:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0cbf40 con 0x7f14dc15c200 2023-07-09T21:38:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14e1f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0c9090 con 0x7f14dc0c3e10 2023-07-09T21:38:53.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14dbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 0x7f14dc15c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51390/0 (socket says 172.21.15.37:51390) 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14dbfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 0x7f14dc15c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40668/0 (socket says 172.21.15.37:40668) 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 -- 172.21.15.37:0/185600032 learned_addr learned my addr 172.21.15.37:0/185600032 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 -- 172.21.15.37:0/185600032 >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 msgr2=0x7f14dc15c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 --2- 172.21.15.37:0/185600032 >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 0x7f14dc15c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 -- 172.21.15.37:0/185600032 >> v1:172.21.15.119:6789/0 conn(0x7f14dc1585b0 legacy=0x7f14dc06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.698+0000 7f14daffd640 1 -- 172.21.15.37:0/185600032 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc15cbc0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14daffd640 1 --2- 172.21.15.37:0/185600032 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009870 tx=0x7f14d001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1a8b780b0f82a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14da7fc640 1 -- 172.21.15.37:0/185600032 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00a9620 con 0x7f14dc0c3e10 2023-07-09T21:38:53.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14da7fc640 1 -- 172.21.15.37:0/185600032 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d00a9780 con 0x7f14dc0c3e10 2023-07-09T21:38:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14da7fc640 1 -- 172.21.15.37:0/185600032 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d00a9b10 con 0x7f14dc0c3e10 2023-07-09T21:38:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 -- 172.21.15.37:0/185600032 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 msgr2=0x7f14dc0c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/185600032 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f14d0009870 tx=0x7f14d001c540 comp rx=0 tx=0).stop 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 -- 172.21.15.37:0/185600032 shutdown_connections 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/185600032 >> v2:172.21.15.119:3300/0 conn(0x7f14dc15c200 0x7f14dc15c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/185600032 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc0c3e10 0x7f14dc0c4260 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 -- 172.21.15.37:0/185600032 >> 172.21.15.37:0/185600032 conn(0x7f14dc0cde40 msgr2=0x7f14dc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 -- 172.21.15.37:0/185600032 shutdown_connections 2023-07-09T21:38:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.702+0000 7f14e1f8f640 1 -- 172.21.15.37:0/185600032 wait complete. 2023-07-09T21:38:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 Processor -- start 2023-07-09T21:38:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- start start 2023-07-09T21:38:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 0x7f14dc1475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc15c200 0x7f14dc15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc147b00 con 0x7f14dc1585b0 2023-07-09T21:38:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc158af0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc158dd0 con 0x7f14dc15c200 2023-07-09T21:38:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14daffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 0x7f14dc1475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14daffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60476/0 (socket says 172.21.15.37:60476) 2023-07-09T21:38:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14daffd640 1 -- 172.21.15.37:0/2530424174 learned_addr learned my addr 172.21.15.37:0/2530424174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14dbfff640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc15c200 0x7f14dc15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 -- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc15c200 msgr2=0x7f14dc15a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc15c200 0x7f14dc15a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 -- 172.21.15.37:0/2530424174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 msgr2=0x7f14dc159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 -- 172.21.15.37:0/2530424174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d00094d0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14daffd640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14db7fe640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 0x7f14dc1475c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f70 tx=0x7f14cc00c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc0052d0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc005430 con 0x7f14dc0c3e10 2023-07-09T21:38:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc003840 con 0x7f14dc0c3e10 2023-07-09T21:38:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc1590b0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.706+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc159670 con 0x7f14dc0c3e10 2023-07-09T21:38:53.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc159860 con 0x7f14dc0c3e10 2023-07-09T21:38:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14cc0039a0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14c3fff640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 0x7f14c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f14cc0831b0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14daffd640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 0x7f14c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:53.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.710+0000 7f14daffd640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 0x7f14c8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d001c580 tx=0x7f14d00b3040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:53.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.714+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14cc0505e0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.870+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f14dc0c47a0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.878+0000 7f14c3fff640 1 -- 172.21.15.37:0/2530424174 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v26) v1 ==== 120+0+0 (secure 0 0 0) 0x7f14dc0c47a0 con 0x7f14dc0c3e10 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 msgr2=0x7f14c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 0x7f14c8068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f14d001c580 tx=0x7f14d00b3040 comp rx=0 tx=0).stop 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 msgr2=0x7f14dc1475c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 0x7f14dc1475c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f14cc000f70 tx=0x7f14cc00c890 comp rx=0 tx=0).stop 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 shutdown_connections 2023-07-09T21:38:53.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f14c80663a0 0x7f14c8068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14dc15c200 0x7f14dc15a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14dc1585b0 0x7f14dc159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 --2- 172.21.15.37:0/2530424174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14dc0c3e10 0x7f14dc1475c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 >> 172.21.15.37:0/2530424174 conn(0x7f14dc0cde40 msgr2=0x7f14dc06c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 shutdown_connections 2023-07-09T21:38:53.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:53.882+0000 7f14e1f8f640 1 -- 172.21.15.37:0/2530424174 wait complete. 2023-07-09T21:38:53.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:38:54.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 Processor -- start 2023-07-09T21:38:54.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 -- start start 2023-07-09T21:38:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16600b7980 0x7f1660160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16600ceb80 0x7f16600cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f16600b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600cd070 con 0x7f16600b7980 2023-07-09T21:38:54.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16600cfd70 con 0x7f16600ceb80 2023-07-09T21:38:54.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1664bfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166015bf80 con 0x7f16600b3c20 2023-07-09T21:38:54.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16600b7980 0x7f1660160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16600b7980 0x7f1660160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60490/0 (socket says 172.21.15.37:60490) 2023-07-09T21:38:54.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 -- 172.21.15.37:0/643282272 learned_addr learned my addr 172.21.15.37:0/643282272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f1657fff640 1 --2- 172.21.15.37:0/643282272 >> v2:172.21.15.119:3300/0 conn(0x7f16600ceb80 0x7f16600cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165ed9d640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f16600b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 -- 172.21.15.37:0/643282272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 msgr2=0x7f16600b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f16600b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 -- 172.21.15.37:0/643282272 >> v2:172.21.15.119:3300/0 conn(0x7f16600ceb80 msgr2=0x7f16600cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 --2- 172.21.15.37:0/643282272 >> v2:172.21.15.119:3300/0 conn(0x7f16600ceb80 0x7f16600cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.046+0000 7f165e59c640 1 -- 172.21.15.37:0/643282272 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660160570 con 0x7f16600b7980 2023-07-09T21:38:54.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f165e59c640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f1660160030 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f16600b4cd0 tx=0x7f165001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33751ab6cc8615fb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f165dd9b640 1 -- 172.21.15.37:0/643282272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500ab600 con 0x7f16600b7980 2023-07-09T21:38:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f165dd9b640 1 -- 172.21.15.37:0/643282272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16500a7050 con 0x7f16600b7980 2023-07-09T21:38:54.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f165dd9b640 1 -- 172.21.15.37:0/643282272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16500ab980 con 0x7f16600b7980 2023-07-09T21:38:54.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 -- 172.21.15.37:0/643282272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 msgr2=0x7f1660160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f1660160030 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f16600b4cd0 tx=0x7f165001c500 comp rx=0 tx=0).stop 2023-07-09T21:38:54.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 -- 172.21.15.37:0/643282272 shutdown_connections 2023-07-09T21:38:54.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f16600b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 --2- 172.21.15.37:0/643282272 >> v2:172.21.15.119:3300/0 conn(0x7f16600ceb80 0x7f16600cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 --2- 172.21.15.37:0/643282272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f1660160030 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 -- 172.21.15.37:0/643282272 >> 172.21.15.37:0/643282272 conn(0x7f1660073090 msgr2=0x7f1660069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 -- 172.21.15.37:0/643282272 shutdown_connections 2023-07-09T21:38:54.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.050+0000 7f1664bfa640 1 -- 172.21.15.37:0/643282272 wait complete. 2023-07-09T21:38:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 Processor -- start 2023-07-09T21:38:54.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- start start 2023-07-09T21:38:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f1660154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16600ceb80 0x7f16600d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660156980 con 0x7f16600b7980 2023-07-09T21:38:54.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660156c60 con 0x7f16600ceb80 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1660156f40 con 0x7f16600b3c20 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60492/0 (socket says 172.21.15.37:60492) 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 -- 172.21.15.37:0/1902031335 learned_addr learned my addr 172.21.15.37:0/1902031335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f165e59c640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f1660154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f165ed9d640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16600ceb80 0x7f16600d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 -- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 msgr2=0x7f1660154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f1660154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 -- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16600ceb80 msgr2=0x7f16600d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16600ceb80 0x7f16600d14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 -- 172.21.15.37:0/1902031335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500094d0 con 0x7f16600b7980 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1657fff640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f164800d800 tx=0x7f164800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800b6c0 con 0x7f16600b7980 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164800b820 con 0x7f16600b7980 2023-07-09T21:38:54.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164800bb90 con 0x7f16600b7980 2023-07-09T21:38:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1660157220 con 0x7f16600b7980 2023-07-09T21:38:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.054+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f166014bae0 con 0x7f16600b7980 2023-07-09T21:38:54.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.058+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1660157460 con 0x7f16600b7980 2023-07-09T21:38:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.058+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f164800bcf0 con 0x7f16600b7980 2023-07-09T21:38:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.058+0000 7f1656ffd640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 0x7f1640068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.058+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f1648084360 con 0x7f16600b7980 2023-07-09T21:38:54.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.058+0000 7f165e59c640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 0x7f1640068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.062+0000 7f165e59c640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 0x7f1640068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16500ad000 tx=0x7f1650008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.062+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f16480550e0 con 0x7f16600b7980 2023-07-09T21:38:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.218+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f166004d7d0 con 0x7f16600b7980 2023-07-09T21:38:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.222+0000 7f1656ffd640 1 -- 172.21.15.37:0/1902031335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v27) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1648054c70 con 0x7f16600b7980 2023-07-09T21:38:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 msgr2=0x7f1640068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 0x7f1640068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f16500ad000 tx=0x7f1650008040 comp rx=0 tx=0).stop 2023-07-09T21:38:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 msgr2=0x7f166014b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f164800d800 tx=0x7f164800dcc0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 shutdown_connections 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f16400663a0 0x7f1640068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16600ceb80 0x7f16600d14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16600b7980 0x7f166014b5a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 --2- 172.21.15.37:0/1902031335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16600b3c20 0x7f1660154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 >> 172.21.15.37:0/1902031335 conn(0x7f1660073090 msgr2=0x7f16600d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:54.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 shutdown_connections 2023-07-09T21:38:54.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.226+0000 7f1664bfa640 1 -- 172.21.15.37:0/1902031335 wait complete. 2023-07-09T21:38:54.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule' 2023-07-09T21:38:54.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.386+0000 7f5f01dad640 1 Processor -- start 2023-07-09T21:38:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.386+0000 7f5f01dad640 1 -- start start 2023-07-09T21:38:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5f01dad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 0x7f5efc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5f01dad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0b49f0 con 0x7f5efc0cef80 2023-07-09T21:38:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5f01dad640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5efc0cc8a0 con 0x7f5efc0b7ab0 2023-07-09T21:38:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5f01dad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0b7e80 con 0x7f5efc0b4340 2023-07-09T21:38:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5efc0cef80 0x7f5efc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34954/0 (socket says 172.21.15.37:34954) 2023-07-09T21:38:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efbfff640 1 -- 172.21.15.37:0/538654529 learned_addr learned my addr 172.21.15.37:0/538654529 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:54.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efaffd640 1 --2- 172.21.15.37:0/538654529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 0x7f5efc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3900823406 0 0) 0x7f5efc0b49f0 con 0x7f5efc0cef80 2023-07-09T21:38:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee4003530 con 0x7f5efc0cef80 2023-07-09T21:38:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170298684 0 0) 0x7f5efc0cc8a0 con 0x7f5efc0b7ab0 2023-07-09T21:38:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5efc0b49f0 con 0x7f5efc0b7ab0 2023-07-09T21:38:54.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efaffd640 1 -- 172.21.15.37:0/538654529 >> v1:172.21.15.119:6789/0 conn(0x7f5efc0b7ab0 legacy=0x7f5efc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efaffd640 1 -- 172.21.15.37:0/538654529 >> v1:172.21.15.37:6789/0 conn(0x7f5efc0cef80 legacy=0x7f5efc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.390+0000 7f5efaffd640 1 -- 172.21.15.37:0/538654529 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5efc0ccb80 con 0x7f5efc0b4340 2023-07-09T21:38:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5efaffd640 1 --2- 172.21.15.37:0/538654529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 0x7f5efc06aa50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00097f0 tx=0x7f5ef001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16121860a3b4c5af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00aa5f0 con 0x7f5efc0b4340 2023-07-09T21:38:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef00aa750 con 0x7f5efc0b4340 2023-07-09T21:38:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5efa7fc640 1 -- 172.21.15.37:0/538654529 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef00aaae0 con 0x7f5efc0b4340 2023-07-09T21:38:54.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- 172.21.15.37:0/538654529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 msgr2=0x7f5efc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 --2- 172.21.15.37:0/538654529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 0x7f5efc06aa50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00097f0 tx=0x7f5ef001c490 comp rx=0 tx=0).stop 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- 172.21.15.37:0/538654529 shutdown_connections 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 --2- 172.21.15.37:0/538654529 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0b4340 0x7f5efc06aa50 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- 172.21.15.37:0/538654529 >> 172.21.15.37:0/538654529 conn(0x7f5efc073090 msgr2=0x7f5efc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- 172.21.15.37:0/538654529 shutdown_connections 2023-07-09T21:38:54.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- 172.21.15.37:0/538654529 wait complete. 2023-07-09T21:38:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 Processor -- start 2023-07-09T21:38:54.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.394+0000 7f5f01dad640 1 -- start start 2023-07-09T21:38:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc0b7ab0 0x7f5efc0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0cef80 0x7f5efc0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc0d31a0 con 0x7f5efc0b4340 2023-07-09T21:38:54.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc1581e0 con 0x7f5efc0b7ab0 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5efc156040 con 0x7f5efc0cef80 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60502/0 (socket says 172.21.15.37:60502) 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 -- 172.21.15.37:0/769624551 learned_addr learned my addr 172.21.15.37:0/769624551 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efbfff640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0cef80 0x7f5efc0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efaffd640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc0b7ab0 0x7f5efc0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 -- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0cef80 msgr2=0x7f5efc0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0cef80 0x7f5efc0cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 -- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc0b7ab0 msgr2=0x7f5efc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc0b7ab0 0x7f5efc0cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 -- 172.21.15.37:0/769624551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef0009420 con 0x7f5efc0b4340 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5efb7fe640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c490 tx=0x7f5eec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0052d0 con 0x7f5efc0b4340 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec005430 con 0x7f5efc0b4340 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec012870 con 0x7f5efc0b4340 2023-07-09T21:38:54.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5efc0b3460 con 0x7f5efc0b4340 2023-07-09T21:38:54.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5efc0d27e0 con 0x7f5efc0b4340 2023-07-09T21:38:54.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5efc04d7d0 con 0x7f5efc0b4340 2023-07-09T21:38:54.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.398+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5eec0129d0 con 0x7f5efc0b4340 2023-07-09T21:38:54.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.402+0000 7f5ee3fff640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 0x7f5ee8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.402+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f5eec083820 con 0x7f5efc0b4340 2023-07-09T21:38:54.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.402+0000 7f5efaffd640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 0x7f5ee8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:54.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.402+0000 7f5efaffd640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 0x7f5ee8068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ae000 tx=0x7f5ef00a7000 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:54.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.406+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5eec050cf0 con 0x7f5efc0b4340 2023-07-09T21:38:54.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:54.618+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]} v 0) v1 -- 0x7f5efc06a830 con 0x7f5efc0b4340 2023-07-09T21:38:55.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5ee3fff640 1 -- 172.21.15.37:0/769624551 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_schedule"]}]=0 v608) v1 ==== 156+0+0 (secure 0 0 0) 0x7f5eec054310 con 0x7f5efc0b4340 2023-07-09T21:38:55.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 msgr2=0x7f5ee8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 0x7f5ee8068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5ef00ae000 tx=0x7f5ef00a7000 comp rx=0 tx=0).stop 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 msgr2=0x7f5efc0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c490 tx=0x7f5eec00c950 comp rx=0 tx=0).stop 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 shutdown_connections 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f5ee80663a0 0x7f5ee8068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5efc0cef80 0x7f5efc0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5efc0b7ab0 0x7f5efc0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 --2- 172.21.15.37:0/769624551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5efc0b4340 0x7f5efc0c8110 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 >> 172.21.15.37:0/769624551 conn(0x7f5efc073090 msgr2=0x7f5efc0b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 shutdown_connections 2023-07-09T21:38:55.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.170+0000 7f5f01dad640 1 -- 172.21.15.37:0/769624551 wait complete. 2023-07-09T21:38:55.197 INFO:tasks.cephfs_test_runner:Test listing non-existing snap schedules failure ... ok 2023-07-09T21:38:55.197 INFO:tasks.cephfs_test_runner:Starting test: test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules on a non-existing filesystem path failure 2023-07-09T21:38:55.198 INFO:tasks.cephfs_test_runner:test_non_existent_snap_schedule_list (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:38:55.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-09T21:38:55.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 Processor -- start 2023-07-09T21:38:55.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 -- start start 2023-07-09T21:38:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0b7ab0 0x7ff67c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff67c0b4340 0x7ff67c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c0b49f0 con 0x7ff67c0cef80 2023-07-09T21:38:55.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0b7e80 con 0x7ff67c0b4340 2023-07-09T21:38:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff683f11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0cc8a0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff6824ae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff67c0b4340 0x7ff67c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff6814ac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff67c0cef80 0x7ff67c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34962/0 (socket says 172.21.15.37:34962) 2023-07-09T21:38:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff6814ac640 1 -- 172.21.15.37:0/1730081218 learned_addr learned my addr 172.21.15.37:0/1730081218 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:55.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.342+0000 7ff681cad640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0b7ab0 0x7ff67c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff6824ae640 1 -- 172.21.15.37:0/1730081218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0b7ab0 msgr2=0x7ff67c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:55.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff6824ae640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0b7ab0 0x7ff67c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff6824ae640 1 -- 172.21.15.37:0/1730081218 >> v1:172.21.15.37:6789/0 conn(0x7ff67c0cef80 legacy=0x7ff67c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff6824ae640 1 -- 172.21.15.37:0/1730081218 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c0ccb80 con 0x7ff67c0b4340 2023-07-09T21:38:55.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff680cab640 1 -- 172.21.15.37:0/1730081218 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272745085 0 0) 0x7ff67c0b49f0 con 0x7ff67c0cef80 2023-07-09T21:38:55.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff6824ae640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b4340 0x7ff67c0d02a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff674009d90 tx=0x7ff67401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4320d9da36fad278 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:55.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff680cab640 1 -- 172.21.15.37:0/1730081218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740a59e0 con 0x7ff67c0b4340 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff680cab640 1 -- 172.21.15.37:0/1730081218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6740a5b40 con 0x7ff67c0b4340 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff680cab640 1 -- 172.21.15.37:0/1730081218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6740ad440 con 0x7ff67c0b4340 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 -- 172.21.15.37:0/1730081218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b4340 msgr2=0x7ff67c0d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b4340 0x7ff67c0d02a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7ff674009d90 tx=0x7ff67401c920 comp rx=0 tx=0).stop 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 -- 172.21.15.37:0/1730081218 shutdown_connections 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b4340 0x7ff67c0d02a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 --2- 172.21.15.37:0/1730081218 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0b7ab0 0x7ff67c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.346+0000 7ff683f11640 1 -- 172.21.15.37:0/1730081218 >> 172.21.15.37:0/1730081218 conn(0x7ff67c073090 msgr2=0x7ff67c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- 172.21.15.37:0/1730081218 shutdown_connections 2023-07-09T21:38:55.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- 172.21.15.37:0/1730081218 wait complete. 2023-07-09T21:38:55.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 Processor -- start 2023-07-09T21:38:55.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- start start 2023-07-09T21:38:55.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 0x7ff67c0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 0x7ff67c154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c86e0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c9af0 con 0x7ff67c0b4340 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff683f11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c9dd0 con 0x7ff67c0cef80 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60518/0 (socket says 172.21.15.37:60518) 2023-07-09T21:38:55.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 -- 172.21.15.37:0/1228341351 learned_addr learned my addr 172.21.15.37:0/1228341351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff681cad640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 0x7ff67c0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6824ae640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 0x7ff67c154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 -- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 msgr2=0x7ff67c154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 0x7ff67c154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 -- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 msgr2=0x7ff67c0c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:55.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 0x7ff67c0c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:55.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 -- 172.21.15.37:0/1228341351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009a70 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff681cad640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 0x7ff67c0c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6824ae640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 0x7ff67c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:55.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.350+0000 7ff6814ac640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c480 tx=0x7ff66c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c0074e0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c007660 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c004a30 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0ca0b0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c0c82e0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c04d7d0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff66c004b90 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 0x7ff660068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:55.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7ff66c082ff0 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.354+0000 7ff681cad640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 0x7ff660068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:55.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.358+0000 7ff681cad640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 0x7ff660068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff67c154940 tx=0x7ff678008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.358+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff66c0b3700 con 0x7ff67c0b7ab0 2023-07-09T21:38:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:55.574+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7ff67c0ca560 con 0x7ff67c0b7ab0 2023-07-09T21:38:56.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.170+0000 7ff6727fc640 1 -- 172.21.15.37:0/1228341351 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v609) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff66c018020 con 0x7ff67c0b7ab0 2023-07-09T21:38:56.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 msgr2=0x7ff660068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 0x7ff660068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff67c154940 tx=0x7ff678008040 comp rx=0 tx=0).stop 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 msgr2=0x7ff67c0c7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00c480 tx=0x7ff66c00c940 comp rx=0 tx=0).stop 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 shutdown_connections 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff6600663a0 0x7ff660068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff67c0cef80 0x7ff67c154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff67c0b7ab0 0x7ff67c0c7da0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 --2- 172.21.15.37:0/1228341351 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff67c0b4340 0x7ff67c0c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 >> 172.21.15.37:0/1228341351 conn(0x7ff67c073090 msgr2=0x7ff67c0d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 shutdown_connections 2023-07-09T21:38:56.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.174+0000 7ff683f11640 1 -- 172.21.15.37:0/1228341351 wait complete. 2023-07-09T21:38:56.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:38:56.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.346+0000 7fac3ac56640 1 Processor -- start 2023-07-09T21:38:56.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.346+0000 7fac3ac56640 1 -- start start 2023-07-09T21:38:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac3ac56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 0x7fac340c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac3ac56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac3ac56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac340c4c90 con 0x7fac34159990 2023-07-09T21:38:56.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac3ac56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac340ca730 con 0x7fac341595c0 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac3ac56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac340ca170 con 0x7fac340c99e0 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac389f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 0x7fac340c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51476/0 (socket says 172.21.15.37:51476) 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac33fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fac34159990 0x7fac3415dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:34428/0 (socket says 172.21.15.37:34428) 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac389f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 0x7fac340c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:40728/0 (socket says 172.21.15.37:40728) 2023-07-09T21:38:56.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 -- 172.21.15.37:0/2642857244 learned_addr learned my addr 172.21.15.37:0/2642857244 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 -- 172.21.15.37:0/2642857244 >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 msgr2=0x7fac340c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac337fe640 1 -- 172.21.15.37:0/2642857244 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955488449 0 0) 0x7fac20001120 con 0x7fac34159990 2023-07-09T21:38:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 --2- 172.21.15.37:0/2642857244 >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 0x7fac340c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 -- 172.21.15.37:0/2642857244 >> v1:172.21.15.119:6789/0 conn(0x7fac34159990 legacy=0x7fac3415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.350+0000 7fac391f3640 1 -- 172.21.15.37:0/2642857244 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340ca450 con 0x7fac340c99e0 2023-07-09T21:38:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac391f3640 1 --2- 172.21.15.37:0/2642857244 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009e50 tx=0x7fac2c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e79d4017eb448ea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac337fe640 1 -- 172.21.15.37:0/2642857244 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0a57c0 con 0x7fac340c99e0 2023-07-09T21:38:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac337fe640 1 -- 172.21.15.37:0/2642857244 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c0a5920 con 0x7fac340c99e0 2023-07-09T21:38:56.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac337fe640 1 -- 172.21.15.37:0/2642857244 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c0a5cb0 con 0x7fac340c99e0 2023-07-09T21:38:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- 172.21.15.37:0/2642857244 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 msgr2=0x7fac340cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2642857244 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009e50 tx=0x7fac2c01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- 172.21.15.37:0/2642857244 shutdown_connections 2023-07-09T21:38:56.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2642857244 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac340cd300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2642857244 >> v2:172.21.15.119:3300/0 conn(0x7fac341595c0 0x7fac340c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- 172.21.15.37:0/2642857244 >> 172.21.15.37:0/2642857244 conn(0x7fac340cde40 msgr2=0x7fac340ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- 172.21.15.37:0/2642857244 shutdown_connections 2023-07-09T21:38:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- 172.21.15.37:0/2642857244 wait complete. 2023-07-09T21:38:56.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 Processor -- start 2023-07-09T21:38:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.354+0000 7fac3ac56640 1 -- start start 2023-07-09T21:38:56.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac3413ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34159990 0x7fac34070610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac340b2f60 con 0x7fac341595c0 2023-07-09T21:38:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac34151c60 con 0x7fac34159990 2023-07-09T21:38:56.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3413f220 con 0x7fac340c99e0 2023-07-09T21:38:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60520/0 (socket says 172.21.15.37:60520) 2023-07-09T21:38:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 -- 172.21.15.37:0/2220536135 learned_addr learned my addr 172.21.15.37:0/2220536135 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:56.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac389f2640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac3413ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac391f3640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34159990 0x7fac34070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 -- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 msgr2=0x7fac3413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac3413ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 -- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34159990 msgr2=0x7fac34070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34159990 0x7fac34070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 -- 172.21.15.37:0/2220536135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c009b30 con 0x7fac341595c0 2023-07-09T21:38:56.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac33fff640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c780 tx=0x7fac2000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200072d0 con 0x7fac341595c0 2023-07-09T21:38:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20007430 con 0x7fac341595c0 2023-07-09T21:38:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200047f0 con 0x7fac341595c0 2023-07-09T21:38:56.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac340b22e0 con 0x7fac341595c0 2023-07-09T21:38:56.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac340b28a0 con 0x7fac341595c0 2023-07-09T21:38:56.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3404d7d0 con 0x7fac341595c0 2023-07-09T21:38:56.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.358+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac20004950 con 0x7fac341595c0 2023-07-09T21:38:56.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.362+0000 7fac317fa640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 0x7fac18068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.362+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fac20082dc0 con 0x7fac341595c0 2023-07-09T21:38:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.362+0000 7fac389f2640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 0x7fac18068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.362+0000 7fac389f2640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 0x7fac18068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac28009ac0 tx=0x7fac28009190 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.366+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac200501f0 con 0x7fac341595c0 2023-07-09T21:38:56.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.518+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fac340c4c90 con 0x7fac341595c0 2023-07-09T21:38:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.526+0000 7fac317fa640 1 -- 172.21.15.37:0/2220536135 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac340c4c90 con 0x7fac341595c0 2023-07-09T21:38:56.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 msgr2=0x7fac18068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 0x7fac18068880 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fac28009ac0 tx=0x7fac28009190 comp rx=0 tx=0).stop 2023-07-09T21:38:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 msgr2=0x7fac340700d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c780 tx=0x7fac2000cc40 comp rx=0 tx=0).stop 2023-07-09T21:38:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 shutdown_connections 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fac180663d0 0x7fac18068880 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac34159990 0x7fac34070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac341595c0 0x7fac340700d0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 --2- 172.21.15.37:0/2220536135 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac340c99e0 0x7fac3413ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 >> 172.21.15.37:0/2220536135 conn(0x7fac340cde40 msgr2=0x7fac34158ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:56.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 shutdown_connections 2023-07-09T21:38:56.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.530+0000 7fac3ac56640 1 -- 172.21.15.37:0/2220536135 wait complete. 2023-07-09T21:38:56.551 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:38:56.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:56.594 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:38:56.658 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:38:56.659 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:56.659 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:56.670 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:56.670 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:56.671 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:56.680 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:56.681 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:38:56.681 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:56.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:38:56.719 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:38:56.720 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:38:56.735 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:38:56.736 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:38:56.736 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:38:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 Processor -- start 2023-07-09T21:38:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 -- start start 2023-07-09T21:38:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d7806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d780cef80 0x7f6d780b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d780b49f0 con 0x7f6d780b4170 2023-07-09T21:38:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d780b7e80 con 0x7f6d780cef80 2023-07-09T21:38:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.902+0000 7f6d7f856640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780b45f0 con 0x7f6d780b7ab0 2023-07-09T21:38:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d780cef80 0x7f6d780b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d780cef80 0x7f6d780b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60522/0 (socket says 172.21.15.37:60522) 2023-07-09T21:38:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 -- 172.21.15.37:0/2929533174 learned_addr learned my addr 172.21.15.37:0/2929533174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7d5f2640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d7806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 -- 172.21.15.37:0/2929533174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 msgr2=0x7f6d7806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:56.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d7806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 -- 172.21.15.37:0/2929533174 >> v1:172.21.15.119:6789/0 conn(0x7f6d780b4170 legacy=0x7f6d7815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 -- 172.21.15.37:0/2929533174 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780cc8a0 con 0x7f6d780cef80 2023-07-09T21:38:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d7cdf1640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d780b3c30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009870 tx=0x7f6d6801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2d24bbb2dbf4ac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d6ffff640 1 -- 172.21.15.37:0/2929533174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680aa670 con 0x7f6d780cef80 2023-07-09T21:38:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d6ffff640 1 -- 172.21.15.37:0/2929533174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d680aa7d0 con 0x7f6d780cef80 2023-07-09T21:38:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.906+0000 7f6d6ffff640 1 -- 172.21.15.37:0/2929533174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d680aab60 con 0x7f6d780cef80 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- 172.21.15.37:0/2929533174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 msgr2=0x7f6d780b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d780b3c30 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009870 tx=0x7f6d6801c510 comp rx=0 tx=0).stop 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- 172.21.15.37:0/2929533174 shutdown_connections 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d780b3c30 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- 172.21.15.37:0/2929533174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d7806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- 172.21.15.37:0/2929533174 >> 172.21.15.37:0/2929533174 conn(0x7f6d78073090 msgr2=0x7f6d78069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- 172.21.15.37:0/2929533174 shutdown_connections 2023-07-09T21:38:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- 172.21.15.37:0/2929533174 wait complete. 2023-07-09T21:38:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 Processor -- start 2023-07-09T21:38:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- start start 2023-07-09T21:38:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d780b4170 0x7f6d780c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d78147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c6330 con 0x7f6d780cef80 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78149870 con 0x7f6d780b4170 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7f856640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78157fb0 con 0x7f6d780b7ab0 2023-07-09T21:38:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60536/0 (socket says 172.21.15.37:60536) 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 -- 172.21.15.37:0/1046315256 learned_addr learned my addr 172.21.15.37:0/1046315256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7d5f2640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d780b4170 0x7f6d780c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7cdf1640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d78147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 -- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 msgr2=0x7f6d78147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d78147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 -- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d780b4170 msgr2=0x7f6d780c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d780b4170 0x7f6d780c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.910+0000 7f6d7ddf3640 1 -- 172.21.15.37:0/1046315256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d680094d0 con 0x7f6d780cef80 2023-07-09T21:38:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d7ddf3640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c730 tx=0x7f6d7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d70003b80 con 0x7f6d780cef80 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d70003ce0 con 0x7f6d780cef80 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7000aa30 con 0x7f6d780cef80 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d78158290 con 0x7f6d780cef80 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780c5fc0 con 0x7f6d780cef80 2023-07-09T21:38:56.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d780c64a0 con 0x7f6d780cef80 2023-07-09T21:38:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6d7000ab90 con 0x7f6d780cef80 2023-07-09T21:38:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 0x7f6d5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f6d70083b00 con 0x7f6d780cef80 2023-07-09T21:38:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.914+0000 7f6d7d5f2640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 0x7f6d5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.918+0000 7f6d7d5f2640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 0x7f6d5c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d74007a60 tx=0x7f6d74008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:56.918+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d70050f30 con 0x7f6d780cef80 2023-07-09T21:38:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.110+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d7804d7d0 con 0x7f6d780cef80 2023-07-09T21:38:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.110+0000 7f6d6dffb640 1 -- 172.21.15.37:0/1046315256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f6d70054550 con 0x7f6d780cef80 2023-07-09T21:38:57.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:57.114 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5963,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3550010967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3550010967},{"type":"v1","addr":"172.21.15.37:6835","nonce":3550010967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6550,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2166715294","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2166715294},{"type":"v1","addr":"172.21.15.37:6833","nonce":2166715294}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6553,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3461899395","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3461899395},{"type":"v1","addr":"172.21.15.119:6836","nonce":3461899395}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":7009,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/2481728304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":2481728304},{"type":"v1","addr":"172.21.15.119:6837","nonce":2481728304}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2023-07-09T21:38:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2023-07-09T21:38:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 msgr2=0x7f6d5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 0x7f6d5c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d74007a60 tx=0x7f6d74008040 comp rx=0 tx=0).stop 2023-07-09T21:38:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 msgr2=0x7f6d7814ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000c730 tx=0x7f6d7000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 shutdown_connections 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6d5c0663a0 0x7f6d5c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d780cef80 0x7f6d7814ae80 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d780b7ab0 0x7f6d78147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 --2- 172.21.15.37:0/1046315256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d780b4170 0x7f6d780c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 >> 172.21.15.37:0/1046315256 conn(0x7f6d78073090 msgr2=0x7f6d780b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 shutdown_connections 2023-07-09T21:38:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.114+0000 7f6d7f856640 1 -- 172.21.15.37:0/1046315256 wait complete. 2023-07-09T21:38:57.135 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:38:57.135 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:38:57.135 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:38:57.136 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:57.136 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:38:57.136 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:38:57.136 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:38:57.137 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:57.138 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:38:57.138 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:38:57.138 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:38:57.140 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:57.140 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:38:57.140 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:38:57.141 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:38:57.141 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:38:57.152 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:38:57.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:38:57.154 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:38:57.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:38:57.155 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:38:57.156 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:38:57.157 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:38:57.157 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:38:57.198 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:38:57.198 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:57.199 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:38:57.200 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:57.206 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:38:57.207 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:57.208 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:38:57.209 DEBUG:teuthology.parallel:result is None 2023-07-09T21:38:57.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:38:57.288 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:38:57.289 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:38:57.298 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:38:57.299 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:38:57.300 INFO:tasks.ceph.mds.d.smithi119.stderr:2023-07-09T21:38:57.306+0000 7f6ec00c9640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-07-09T21:38:57.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-09T21:38:57.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-09T21:38:57.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-09T21:38:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 Processor -- start 2023-07-09T21:38:57.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 -- start start 2023-07-09T21:38:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f914c159830 0x7f914c06fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c06afa0 con 0x7f914c070bb0 2023-07-09T21:38:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c06b280 con 0x7f914c06d010 2023-07-09T21:38:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9150d9f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c070000 con 0x7f914c159830 2023-07-09T21:38:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f914a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f914c159830 0x7f914c06fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9143fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f914c070bb0 0x7f914c06c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35240/0 (socket says 172.21.15.37:35240) 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.358+0000 7f9143fff640 1 -- 172.21.15.37:0/2326730974 learned_addr learned my addr 172.21.15.37:0/2326730974 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f914a59c640 1 -- 172.21.15.37:0/2326730974 >> v1:172.21.15.119:6789/0 conn(0x7f914c06d010 legacy=0x7f914c0cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f914a59c640 1 -- 172.21.15.37:0/2326730974 >> v1:172.21.15.37:6789/0 conn(0x7f914c070bb0 legacy=0x7f914c06c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f914a59c640 1 -- 172.21.15.37:0/2326730974 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c06b560 con 0x7f914c159830 2023-07-09T21:38:57.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9149d9b640 1 -- 172.21.15.37:0/2326730974 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952502845 0 0) 0x7f914c06afa0 con 0x7f914c070bb0 2023-07-09T21:38:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f914a59c640 1 --2- 172.21.15.37:0/2326730974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c159830 0x7f914c06fa20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f913c0097a0 tx=0x7f913c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b80bb2192fa44c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9149d9b640 1 -- 172.21.15.37:0/2326730974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0ac620 con 0x7f914c159830 2023-07-09T21:38:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9149d9b640 1 -- 172.21.15.37:0/2326730974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c0ac780 con 0x7f914c159830 2023-07-09T21:38:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9149d9b640 1 -- 172.21.15.37:0/2326730974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c0acb10 con 0x7f914c159830 2023-07-09T21:38:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9150d9f640 1 -- 172.21.15.37:0/2326730974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c159830 msgr2=0x7f914c06fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.362+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2326730974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c159830 0x7f914c06fa20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f913c0097a0 tx=0x7f913c01c3a0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- 172.21.15.37:0/2326730974 shutdown_connections 2023-07-09T21:38:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2326730974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c159830 0x7f914c06fa20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- 172.21.15.37:0/2326730974 >> 172.21.15.37:0/2326730974 conn(0x7f914c0694c0 msgr2=0x7f914c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- 172.21.15.37:0/2326730974 shutdown_connections 2023-07-09T21:38:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- 172.21.15.37:0/2326730974 wait complete. 2023-07-09T21:38:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 Processor -- start 2023-07-09T21:38:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- start start 2023-07-09T21:38:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 0x7f914c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f914c159830 0x7f914c0af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c14d450 con 0x7f914c070bb0 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c14caf0 con 0x7f914c06d010 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9150d9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c14cd90 con 0x7f914c159830 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52402/0 (socket says 172.21.15.37:52402) 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 -- 172.21.15.37:0/2477704913 learned_addr learned my addr 172.21.15.37:0/2477704913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:57.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f914a59c640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 0x7f914c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f914ad9d640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f914c159830 0x7f914c0af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 -- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f914c159830 msgr2=0x7f914c0af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f914c159830 0x7f914c0af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 -- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 msgr2=0x7f914c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 0x7f914c0b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f9143fff640 1 -- 172.21.15.37:0/2477704913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c0093b0 con 0x7f914c070bb0 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.366+0000 7f914a59c640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 0x7f914c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:57.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9143fff640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f913400c4a0 tx=0x7f913400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340074e0 con 0x7f914c070bb0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134007640 con 0x7f914c070bb0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134004a30 con 0x7f914c070bb0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c14d070 con 0x7f914c070bb0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c155490 con 0x7f914c070bb0 2023-07-09T21:38:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c06c390 con 0x7f914c070bb0 2023-07-09T21:38:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9134004b90 con 0x7f914c070bb0 2023-07-09T21:38:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 0x7f912c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f9134082ff0 con 0x7f914c070bb0 2023-07-09T21:38:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.370+0000 7f914a59c640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 0x7f912c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.374+0000 7f914a59c640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 0x7f912c068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ae000 tx=0x7f913c008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.374+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f914c06c390 con 0x7f914c070bb0 2023-07-09T21:38:57.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:57.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f914c14d590 con 0x7f914c070bb0 2023-07-09T21:38:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9142ffd640 1 -- 172.21.15.37:0/2477704913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) v1 ==== 97+0+0 (secure 0 0 0) 0x7f914c14d590 con 0x7f914c070bb0 2023-07-09T21:38:58.557 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:38:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 msgr2=0x7f912c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 0x7f912c068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f913c0ae000 tx=0x7f913c008040 comp rx=0 tx=0).stop 2023-07-09T21:38:58.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 msgr2=0x7f914c146f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f913400c4a0 tx=0x7f913400c960 comp rx=0 tx=0).stop 2023-07-09T21:38:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 shutdown_connections 2023-07-09T21:38:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f912c0663a0 0x7f912c068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f914c159830 0x7f914c0af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f914c070bb0 0x7f914c146f80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 --2- 172.21.15.37:0/2477704913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f914c06d010 0x7f914c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 >> 172.21.15.37:0/2477704913 conn(0x7f914c0694c0 msgr2=0x7f914c06f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 shutdown_connections 2023-07-09T21:38:58.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.550+0000 7f9150d9f640 1 -- 172.21.15.37:0/2477704913 wait complete. 2023-07-09T21:38:58.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:38:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.722+0000 7f94bf48a640 1 Processor -- start 2023-07-09T21:38:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.722+0000 7f94bf48a640 1 -- start start 2023-07-09T21:38:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bf48a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 0x7f94b80ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bf48a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94b80b1650 0x7f94b80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bf48a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80d1380 con 0x7f94b815bbf0 2023-07-09T21:38:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bf48a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80d1f20 con 0x7f94b80b1650 2023-07-09T21:38:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bf48a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80b13e0 con 0x7f94b806bc30 2023-07-09T21:38:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94b80b1650 0x7f94b80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94b80b1650 0x7f94b80cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52404/0 (socket says 172.21.15.37:52404) 2023-07-09T21:38:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 -- 172.21.15.37:0/1081297739 learned_addr learned my addr 172.21.15.37:0/1081297739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bdc87640 1 --2- 172.21.15.37:0/1081297739 >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 0x7f94b80ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 -- 172.21.15.37:0/1081297739 >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 msgr2=0x7f94b80ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 --2- 172.21.15.37:0/1081297739 >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 0x7f94b80ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 -- 172.21.15.37:0/1081297739 >> v1:172.21.15.119:6789/0 conn(0x7f94b815bbf0 legacy=0x7f94b80d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bec89640 1 -- 172.21.15.37:0/1081297739 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b802bbe0 con 0x7f94b80b1650 2023-07-09T21:38:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.726+0000 7f94bdc87640 1 --2- 172.21.15.37:0/1081297739 >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 0x7f94b80ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bec89640 1 --2- 172.21.15.37:0/1081297739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b1650 0x7f94b80cef30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f94b806b6c0 tx=0x7f94b001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a337b08cad73612 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bd486640 1 -- 172.21.15.37:0/1081297739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5820 con 0x7f94b80b1650 2023-07-09T21:38:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bd486640 1 -- 172.21.15.37:0/1081297739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b00a5980 con 0x7f94b80b1650 2023-07-09T21:38:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bd486640 1 -- 172.21.15.37:0/1081297739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5d10 con 0x7f94b80b1650 2023-07-09T21:38:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- 172.21.15.37:0/1081297739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b1650 msgr2=0x7f94b80cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 --2- 172.21.15.37:0/1081297739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b1650 0x7f94b80cef30 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f94b806b6c0 tx=0x7f94b001c960 comp rx=0 tx=0).stop 2023-07-09T21:38:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- 172.21.15.37:0/1081297739 shutdown_connections 2023-07-09T21:38:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 --2- 172.21.15.37:0/1081297739 >> v2:172.21.15.119:3300/0 conn(0x7f94b806bc30 0x7f94b80ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 --2- 172.21.15.37:0/1081297739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b1650 0x7f94b80cef30 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- 172.21.15.37:0/1081297739 >> 172.21.15.37:0/1081297739 conn(0x7f94b802b640 msgr2=0x7f94b80d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- 172.21.15.37:0/1081297739 shutdown_connections 2023-07-09T21:38:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- 172.21.15.37:0/1081297739 wait complete. 2023-07-09T21:38:58.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 Processor -- start 2023-07-09T21:38:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.730+0000 7f94bf48a640 1 -- start start 2023-07-09T21:38:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1650 0x7f94b80b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b815bbf0 0x7f94b80c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8148d10 con 0x7f94b806bc30 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80b22c0 con 0x7f94b815bbf0 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b814bd10 con 0x7f94b80b1650 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:58.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52406/0 (socket says 172.21.15.37:52406) 2023-07-09T21:38:58.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 -- 172.21.15.37:0/2574918755 learned_addr learned my addr 172.21.15.37:0/2574918755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 -- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1650 msgr2=0x7f94b80b4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1650 0x7f94b80b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 -- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b815bbf0 msgr2=0x7f94b80c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b815bbf0 0x7f94b80c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 -- 172.21.15.37:0/2574918755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0009b30 con 0x7f94b806bc30 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94be488640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f94b400b410 tx=0x7f94b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4004020 con 0x7f94b806bc30 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b4004180 con 0x7f94b806bc30 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b4011630 con 0x7f94b806bc30 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80b4880 con 0x7f94b806bc30 2023-07-09T21:38:58.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80b1d00 con 0x7f94b806bc30 2023-07-09T21:38:58.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b806b020 con 0x7f94b806bc30 2023-07-09T21:38:58.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.734+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f94b4011790 con 0x7f94b806bc30 2023-07-09T21:38:58.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.738+0000 7f94aeffd640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 0x7f949c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:58.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.738+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f94b4083930 con 0x7f94b806bc30 2023-07-09T21:38:58.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.738+0000 7f94bdc87640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 0x7f949c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:58.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.738+0000 7f94bdc87640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 0x7f949c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c64f0 tx=0x7f94a8008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:58.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.742+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94b4050f50 con 0x7f94b806bc30 2023-07-09T21:38:58.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f94b804e020 con 0x7f94b806bc30 2023-07-09T21:38:58.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94aeffd640 1 -- 172.21.15.37:0/2574918755 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f94b4054570 con 0x7f94b806bc30 2023-07-09T21:38:58.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:58.949 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:38:58.949 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:58.950 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.951 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.952 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.953 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:58.954 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.955 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.956 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.956 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.956 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.956 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.957 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.958 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.959 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.960 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:38:58.961 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:38:58.962 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.963 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.964 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:58.966 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:38:58.968 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.969 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.970 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:38:58.971 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:38:58.972 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:38:58.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:38:58.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:38:58.973 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:38:58.973 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:38:58.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 msgr2=0x7f949c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 0x7f949c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f94b80c64f0 tx=0x7f94a8008040 comp rx=0 tx=0).stop 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 msgr2=0x7f94b814b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f94b400b410 tx=0x7f94b400b8d0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 shutdown_connections 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f949c0663a0 0x7f949c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b815bbf0 0x7f94b80c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1650 0x7f94b80b4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 --2- 172.21.15.37:0/2574918755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b806bc30 0x7f94b814b7d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 >> 172.21.15.37:0/2574918755 conn(0x7f94b802b640 msgr2=0x7f94b80d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 shutdown_connections 2023-07-09T21:38:58.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:58.946+0000 7f94bf48a640 1 -- 172.21.15.37:0/2574918755 wait complete. 2023-07-09T21:38:58.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:38:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 Processor -- start 2023-07-09T21:38:59.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 -- start start 2023-07-09T21:38:59.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 0x7f7c4c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4c0b49f0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b7e80 con 0x7f7c4c0b7ab0 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c52dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c0b4610 con 0x7f7c4c0cef80 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c5136f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7c4c0b4170 0x7f7c4c15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35252/0 (socket says 172.21.15.37:35252) 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c5136f640 1 -- 172.21.15.37:0/585515895 learned_addr learned my addr 172.21.15.37:0/585515895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:38:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/585515895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c50b6e640 1 --2- 172.21.15.37:0/585515895 >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 0x7f7c4c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/585515895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962348832 0 0) 0x7f7c4c0b49f0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4bfff640 1 -- 172.21.15.37:0/585515895 >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 msgr2=0x7f7c4c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:59.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/585515895 >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 0x7f7c4c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4bfff640 1 -- 172.21.15.37:0/585515895 >> v1:172.21.15.37:6789/0 conn(0x7f7c4c0b4170 legacy=0x7f7c4c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c4bfff640 1 -- 172.21.15.37:0/585515895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4c0cc8a0 con 0x7f7c4c0cef80 2023-07-09T21:38:59.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.118+0000 7f7c50b6e640 1 --2- 172.21.15.37:0/585515895 >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 0x7f7c4c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:38:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/585515895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c0b3c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c380097c0 tx=0x7f7c3801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f10ff5fedbd1fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/585515895 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380ab650 con 0x7f7c4c0cef80 2023-07-09T21:38:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/585515895 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c380ab7b0 con 0x7f7c4c0cef80 2023-07-09T21:38:59.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c4b7fe640 1 -- 172.21.15.37:0/585515895 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380abb40 con 0x7f7c4c0cef80 2023-07-09T21:38:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 -- 172.21.15.37:0/585515895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 msgr2=0x7f7c4c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/585515895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c0b3c30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7c380097c0 tx=0x7f7c3801c450 comp rx=0 tx=0).stop 2023-07-09T21:38:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 -- 172.21.15.37:0/585515895 shutdown_connections 2023-07-09T21:38:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/585515895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c0b3c30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/585515895 >> v2:172.21.15.119:3300/0 conn(0x7f7c4c0b7ab0 0x7f7c4c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.122+0000 7f7c52dd2640 1 -- 172.21.15.37:0/585515895 >> 172.21.15.37:0/585515895 conn(0x7f7c4c073090 msgr2=0x7f7c4c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- 172.21.15.37:0/585515895 shutdown_connections 2023-07-09T21:38:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- 172.21.15.37:0/585515895 wait complete. 2023-07-09T21:38:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 Processor -- start 2023-07-09T21:38:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- start start 2023-07-09T21:38:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4c0b7ab0 0x7f7c4c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c1584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c14f270 con 0x7f7c4c0b4170 2023-07-09T21:38:59.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c15d490 con 0x7f7c4c0b7ab0 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c52dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4c15d770 con 0x7f7c4c0cef80 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52420/0 (socket says 172.21.15.37:52420) 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 -- 172.21.15.37:0/1381820522 learned_addr learned my addr 172.21.15.37:0/1381820522 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4c0b7ab0 0x7f7c4c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c5136f640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c1584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 -- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 msgr2=0x7f7c4c1584f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c1584f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 -- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4c0b7ab0 msgr2=0x7f7c4c0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4c0b7ab0 0x7f7c4c0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 -- 172.21.15.37:0/1381820522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009420 con 0x7f7c4c0b4170 2023-07-09T21:38:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.126+0000 7f7c50b6e640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ebe0 tx=0x7f7c4000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000eee0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000cc30 con 0x7f7c4c0b4170 2023-07-09T21:38:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c38009420 con 0x7f7c4c0b4170 2023-07-09T21:38:59.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c40013470 con 0x7f7c4c0b4170 2023-07-09T21:38:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c4c15dd30 con 0x7f7c4c0b4170 2023-07-09T21:38:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c4c04d7d0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c400135d0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 0x7f7c30068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7c40083eb0 con 0x7f7c4c0b4170 2023-07-09T21:38:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.130+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 0x7f7c30068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.134+0000 7f7c4bfff640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 0x7f7c30068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380b6040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.134+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c40051450 con 0x7f7c4c0b4170 2023-07-09T21:38:59.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.294+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c4c06a830 con 0x7f7c4c0b4170 2023-07-09T21:38:59.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.294+0000 7f7c497fa640 1 -- 172.21.15.37:0/1381820522 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+14628 (secure 0 0 0) 0x7f7c40054a70 con 0x7f7c4c0b4170 2023-07-09T21:38:59.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:38:59.298 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":95,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:38:58.547550+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:38:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 msgr2=0x7f7c30068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 0x7f7c30068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c380af000 tx=0x7f7c380b6040 comp rx=0 tx=0).stop 2023-07-09T21:38:59.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 msgr2=0x7f7c4c14ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f7c4000ebe0 tx=0x7f7c4000c520 comp rx=0 tx=0).stop 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 shutdown_connections 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7c300663d0 0x7f7c30068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c4c0cef80 0x7f7c4c1584f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c4c0b7ab0 0x7f7c4c0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 --2- 172.21.15.37:0/1381820522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c4c0b4170 0x7f7c4c14ed30 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 >> 172.21.15.37:0/1381820522 conn(0x7f7c4c073090 msgr2=0x7f7c4c15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 shutdown_connections 2023-07-09T21:38:59.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.298+0000 7f7c52dd2640 1 -- 172.21.15.37:0/1381820522 wait complete. 2023-07-09T21:38:59.320 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:38:59.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:38:59.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.462+0000 7fbb7ceca640 1 Processor -- start 2023-07-09T21:38:59.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.462+0000 7fbb7ceca640 1 -- start start 2023-07-09T21:38:59.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 0x7fbb78160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 0x7fbb780cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb780b3c20 0x7fbb780b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780cd070 con 0x7fbb780b3c20 2023-07-09T21:38:59.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb780cfd70 con 0x7fbb780b7980 2023-07-09T21:38:59.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7ceca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7815bf80 con 0x7fbb780ceb80 2023-07-09T21:38:59.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb780b3c20 0x7fbb780b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb780b3c20 0x7fbb780b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52428/0 (socket says 172.21.15.37:52428) 2023-07-09T21:38:59.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 -- 172.21.15.37:0/1699395544 learned_addr learned my addr 172.21.15.37:0/1699395544 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb6ffff640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 0x7fbb780cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 -- 172.21.15.37:0/1699395544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 msgr2=0x7fbb780cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7659c640 1 --2- 172.21.15.37:0/1699395544 >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 0x7fbb78160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 0x7fbb780cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 -- 172.21.15.37:0/1699395544 >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 msgr2=0x7fbb78160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:59.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 --2- 172.21.15.37:0/1699395544 >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 0x7fbb78160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb76d9d640 1 -- 172.21.15.37:0/1699395544 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78160570 con 0x7fbb780b3c20 2023-07-09T21:38:59.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb6ffff640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 0x7fbb780cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:59.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.466+0000 7fbb7659c640 1 --2- 172.21.15.37:0/1699395544 >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 0x7fbb78160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:38:59.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb76d9d640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780b4080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbb78069aa0 tx=0x7fbb7001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb552788b9e40e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb75d9b640 1 -- 172.21.15.37:0/1699395544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5650 con 0x7fbb780b3c20 2023-07-09T21:38:59.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb75d9b640 1 -- 172.21.15.37:0/1699395544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700a57b0 con 0x7fbb780b3c20 2023-07-09T21:38:59.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb75d9b640 1 -- 172.21.15.37:0/1699395544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700a5b40 con 0x7fbb780b3c20 2023-07-09T21:38:59.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- 172.21.15.37:0/1699395544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 msgr2=0x7fbb780b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780b4080 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fbb78069aa0 tx=0x7fbb7001c9d0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- 172.21.15.37:0/1699395544 shutdown_connections 2023-07-09T21:38:59.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780b4080 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/1699395544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780ceb80 0x7fbb780cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/1699395544 >> v2:172.21.15.119:3300/0 conn(0x7fbb780b7980 0x7fbb78160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- 172.21.15.37:0/1699395544 >> 172.21.15.37:0/1699395544 conn(0x7fbb78073090 msgr2=0x7fbb78069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- 172.21.15.37:0/1699395544 shutdown_connections 2023-07-09T21:38:59.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- 172.21.15.37:0/1699395544 wait complete. 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 Processor -- start 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 -- start start 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.470+0000 7fbb7ceca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780b7980 0x7fbb78151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 0x7fbb7815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78159ce0 con 0x7fbb780b3c20 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78152e40 con 0x7fbb780ceb80 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb78153120 con 0x7fbb780b7980 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52430/0 (socket says 172.21.15.37:52430) 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 -- 172.21.15.37:0/535293001 learned_addr learned my addr 172.21.15.37:0/535293001 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb76d9d640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 0x7fbb7815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb6ffff640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780b7980 0x7fbb78151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 -- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780b7980 msgr2=0x7fbb78151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780b7980 0x7fbb78151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 -- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 msgr2=0x7fbb7815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 0x7fbb7815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 -- 172.21.15.37:0/535293001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb70009b30 con 0x7fbb780b3c20 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb76d9d640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 0x7fbb7815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:38:59.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7659c640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c7f0 tx=0x7fbb6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007820 con 0x7fbb780b3c20 2023-07-09T21:38:59.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68007980 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68007d30 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb78153400 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb78152af0 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb7804d7d0 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.474+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbb680113f0 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.478+0000 7fbb6effd640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 0x7fbb58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.478+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbb68083ff0 con 0x7fbb780b3c20 2023-07-09T21:38:59.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.478+0000 7fbb6ffff640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 0x7fbb58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.478+0000 7fbb6ffff640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 0x7fbb58068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb60006fd0 tx=0x7fbb60008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.478+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb680b4700 con 0x7fbb780b3c20 2023-07-09T21:38:59.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.634+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb780b1600 con 0x7fbb780b3c20 2023-07-09T21:38:59.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb6effd640 1 -- 172.21.15.37:0/535293001 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb68051540 con 0x7fbb780b3c20 2023-07-09T21:38:59.639 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:38:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 msgr2=0x7fbb58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 0x7fbb58068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb60006fd0 tx=0x7fbb60008040 comp rx=0 tx=0).stop 2023-07-09T21:38:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 msgr2=0x7fbb780d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800c7f0 tx=0x7fbb6800ccb0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 shutdown_connections 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbb580663a0 0x7fbb58068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb780ceb80 0x7fbb7815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb780b7980 0x7fbb78151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 --2- 172.21.15.37:0/535293001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb780b3c20 0x7fbb780d1d30 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 >> 172.21.15.37:0/535293001 conn(0x7fbb78073090 msgr2=0x7fbb7815f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 shutdown_connections 2023-07-09T21:38:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.638+0000 7fbb7ceca640 1 -- 172.21.15.37:0/535293001 wait complete. 2023-07-09T21:38:59.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:38:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.802+0000 7f0ae5dad640 1 Processor -- start 2023-07-09T21:38:59.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.802+0000 7f0ae5dad640 1 -- start start 2023-07-09T21:38:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0ae5dad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ae00b7980 0x7f0ae0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0ae5dad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae015bf80 con 0x7f0ae00ceb80 2023-07-09T21:38:59.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0ae5dad640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae0160570 con 0x7f0ae00d0780 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0ae5dad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae00cd070 con 0x7f0ae00b7980 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ae00b7980 0x7f0ae0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ae00b7980 0x7f0ae0160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52432/0 (socket says 172.21.15.37:52432) 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adeffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0ae00ceb80 0x7f0ae00cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35264/0 (socket says 172.21.15.37:35264) 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 -- 172.21.15.37:0/1011212354 learned_addr learned my addr 172.21.15.37:0/1011212354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 -- 172.21.15.37:0/1011212354 >> v1:172.21.15.119:6789/0 conn(0x7f0ae00d0780 legacy=0x7f0ae00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:38:59.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 -- 172.21.15.37:0/1011212354 >> v1:172.21.15.37:6789/0 conn(0x7f0ae00ceb80 legacy=0x7f0ae00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 -- 172.21.15.37:0/1011212354 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae00d02f0 con 0x7f0ae00b7980 2023-07-09T21:38:59.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0ade7fc640 1 -- 172.21.15.37:0/1011212354 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3906455919 0 0) 0x7f0ad4001120 con 0x7f0ae00ceb80 2023-07-09T21:38:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.806+0000 7f0adf7fe640 1 --2- 172.21.15.37:0/1011212354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00b7980 0x7f0ae0160030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cc99463398ed6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ade7fc640 1 -- 172.21.15.37:0/1011212354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00ab600 con 0x7f0ae00b7980 2023-07-09T21:38:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ade7fc640 1 -- 172.21.15.37:0/1011212354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad00a7050 con 0x7f0ae00b7980 2023-07-09T21:38:59.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ade7fc640 1 -- 172.21.15.37:0/1011212354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00ab980 con 0x7f0ae00b7980 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- 172.21.15.37:0/1011212354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00b7980 msgr2=0x7f0ae0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/1011212354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00b7980 0x7f0ae0160030 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad001c500 comp rx=0 tx=0).stop 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- 172.21.15.37:0/1011212354 shutdown_connections 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/1011212354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00b7980 0x7f0ae0160030 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- 172.21.15.37:0/1011212354 >> 172.21.15.37:0/1011212354 conn(0x7f0ae0073090 msgr2=0x7f0ae0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- 172.21.15.37:0/1011212354 shutdown_connections 2023-07-09T21:38:59.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- 172.21.15.37:0/1011212354 wait complete. 2023-07-09T21:38:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 Processor -- start 2023-07-09T21:38:59.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- start start 2023-07-09T21:38:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00b7980 0x7f0ae00b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00d0780 0x7f0ae0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae014df30 con 0x7f0ae00ceb80 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00b4ac0 con 0x7f0ae00b7980 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.810+0000 7f0ae5dad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae00b3de0 con 0x7f0ae00d0780 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52444/0 (socket says 172.21.15.37:52444) 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 -- 172.21.15.37:0/563780479 learned_addr learned my addr 172.21.15.37:0/563780479 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 -- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00d0780 msgr2=0x7f0ae0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00d0780 0x7f0ae0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 -- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00b7980 msgr2=0x7f0ae00b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00b7980 0x7f0ae00b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 -- 172.21.15.37:0/563780479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ad00094d0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0adeffd640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c7b0 tx=0x7f0ad400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40072d0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad4007450 con 0x7f0ae00ceb80 2023-07-09T21:38:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40047f0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae00b2fa0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae00b3540 con 0x7f0ae00ceb80 2023-07-09T21:38:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae014e0d0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ad4004950 con 0x7f0ae00ceb80 2023-07-09T21:38:59.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.814+0000 7f0ac7fff640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 0x7f0acc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:38:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.818+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0ad4082c70 con 0x7f0ae00ceb80 2023-07-09T21:38:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.818+0000 7f0adf7fe640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 0x7f0acc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:38:59.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.818+0000 7f0adf7fe640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 0x7f0acc068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ad000 tx=0x7f0ad0008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:38:59.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.818+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ae014e0d0 con 0x7f0ae00ceb80 2023-07-09T21:38:59.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ae015bf80 con 0x7f0ae00ceb80 2023-07-09T21:38:59.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ac7fff640 1 -- 172.21.15.37:0/563780479 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v95) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ae015bf80 con 0x7f0ae00ceb80 2023-07-09T21:38:59.977 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:38:59.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 msgr2=0x7f0acc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 0x7f0acc068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ad000 tx=0x7f0ad0008040 comp rx=0 tx=0).stop 2023-07-09T21:38:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 msgr2=0x7f0ae0150040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:38:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400c7b0 tx=0x7f0ad400cc70 comp rx=0 tx=0).stop 2023-07-09T21:38:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 shutdown_connections 2023-07-09T21:38:59.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0acc0663a0 0x7f0acc068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ae00d0780 0x7f0ae0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ae00ceb80 0x7f0ae0150040 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 --2- 172.21.15.37:0/563780479 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ae00b7980 0x7f0ae00b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:38:59.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 >> 172.21.15.37:0/563780479 conn(0x7f0ae0073090 msgr2=0x7f0ae015cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:38:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 shutdown_connections 2023-07-09T21:38:59.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:38:59.974+0000 7f0ae5dad640 1 -- 172.21.15.37:0/563780479 wait complete. 2023-07-09T21:38:59.998 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:39:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 Processor -- start 2023-07-09T21:39:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 -- start start 2023-07-09T21:39:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ca00c94a0 0x7f0ca006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca00cbb20 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca0071330 con 0x7f0ca00c94a0 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.138+0000 7f0ca869c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca00cbe00 con 0x7f0ca0157e90 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ca00c94a0 0x7f0ca006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ca00c94a0 0x7f0ca006afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:43906/0 (socket says 172.21.15.37:43906) 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 -- 172.21.15.37:0/105480006 learned_addr learned my addr 172.21.15.37:0/105480006 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca6438640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 -- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 msgr2=0x7f0ca0070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 -- 172.21.15.37:0/105480006 >> v1:172.21.15.119:6789/0 conn(0x7f0ca00cc8e0 legacy=0x7f0ca00ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 -- 172.21.15.37:0/105480006 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca00cc0e0 con 0x7f0ca00c94a0 2023-07-09T21:39:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.142+0000 7f0ca5c37640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca006afe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f0b5c3b8984147 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5436640 1 -- 172.21.15.37:0/105480006 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900ab620 con 0x7f0ca00c94a0 2023-07-09T21:39:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5436640 1 -- 172.21.15.37:0/105480006 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900ab780 con 0x7f0ca00c94a0 2023-07-09T21:39:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5436640 1 -- 172.21.15.37:0/105480006 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900abb10 con 0x7f0ca00c94a0 2023-07-09T21:39:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 msgr2=0x7f0ca006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca006afe0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0c90009870 tx=0x7f0c9001c480 comp rx=0 tx=0).stop 2023-07-09T21:39:00.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- 172.21.15.37:0/105480006 shutdown_connections 2023-07-09T21:39:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca006afe0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- 172.21.15.37:0/105480006 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- 172.21.15.37:0/105480006 >> 172.21.15.37:0/105480006 conn(0x7f0ca00ca830 msgr2=0x7f0ca00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- 172.21.15.37:0/105480006 shutdown_connections 2023-07-09T21:39:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- 172.21.15.37:0/105480006 wait complete. 2023-07-09T21:39:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 Processor -- start 2023-07-09T21:39:00.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- start start 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca0152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0152930 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0153e30 con 0x7f0ca00c94a0 2023-07-09T21:39:00.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca869c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca0153b50 con 0x7f0ca0157e90 2023-07-09T21:39:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5c37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5c37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52454/0 (socket says 172.21.15.37:52454) 2023-07-09T21:39:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.146+0000 7f0ca5c37640 1 -- 172.21.15.37:0/2863249739 learned_addr learned my addr 172.21.15.37:0/2863249739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca6438640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca0152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca6c39640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 -- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 msgr2=0x7f0ca0154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 -- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 msgr2=0x7f0ca0152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca0152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 -- 172.21.15.37:0/2863249739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c900094d0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca6c39640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca5c37640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad040 tx=0x7f0c9001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900abe80 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c900be3f0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c900be780 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca01522e0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca01537e0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca004d7d0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0c900b43f0 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 0x7f0c84068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.150+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0c9011e350 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.154+0000 7f0ca6438640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 0x7f0c84068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.154+0000 7f0ca6438640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 0x7f0c84068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009ac0 tx=0x7f0c9c009190 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.154+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c900eb910 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.314+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0ca00b0350 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.314+0000 7f0c96ffd640 1 -- 172.21.15.37:0/2863249739 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v95) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0c900eef30 con 0x7f0ca00cc8e0 2023-07-09T21:39:00.319 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:00.319 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:39:00.320 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:39:00.321 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:00.321 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 msgr2=0x7f0c84068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 0x7f0c84068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009ac0 tx=0x7f0c9c009190 comp rx=0 tx=0).stop 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 msgr2=0x7f0ca014d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f0c900ad040 tx=0x7f0c9001acc0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 shutdown_connections 2023-07-09T21:39:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0c840663d0 0x7f0c84068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ca0157e90 0x7f0ca0154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ca00cc8e0 0x7f0ca014d680 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 --2- 172.21.15.37:0/2863249739 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ca00c94a0 0x7f0ca0152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 >> 172.21.15.37:0/2863249739 conn(0x7f0ca00ca830 msgr2=0x7f0ca00c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 shutdown_connections 2023-07-09T21:39:00.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.318+0000 7f0ca869c640 1 -- 172.21.15.37:0/2863249739 wait complete. 2023-07-09T21:39:00.340 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:39:00.341 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:39:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 Processor -- start 2023-07-09T21:39:00.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 -- start start 2023-07-09T21:39:00.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a9815f610 0x7f2a9815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a9815bf60 con 0x7f2a9806b9c0 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a981600d0 con 0x7f2a9815bb90 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9e7ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a980cc530 con 0x7f2a9815f610 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2a9815f610 0x7f2a9815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9cd49640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a9806b9c0 0x7f2a9806a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35272/0 (socket says 172.21.15.37:35272) 2023-07-09T21:39:00.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a9cd49640 1 -- 172.21.15.37:0/3074841315 learned_addr learned my addr 172.21.15.37:0/3074841315 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a977fe640 1 -- 172.21.15.37:0/3074841315 >> v1:172.21.15.119:6789/0 conn(0x7f2a9815bb90 legacy=0x7f2a980ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a977fe640 1 -- 172.21.15.37:0/3074841315 >> v1:172.21.15.37:6789/0 conn(0x7f2a9806b9c0 legacy=0x7f2a9806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a977fe640 1 -- 172.21.15.37:0/3074841315 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a981603b0 con 0x7f2a9815f610 2023-07-09T21:39:00.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.486+0000 7f2a96ffd640 1 -- 172.21.15.37:0/3074841315 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576152033 0 0) 0x7f2a9815bf60 con 0x7f2a9806b9c0 2023-07-09T21:39:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a977fe640 1 --2- 172.21.15.37:0/3074841315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815fa60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0097c0 tx=0x7f2a8c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f8892b200a6494 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a96ffd640 1 -- 172.21.15.37:0/3074841315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0ab600 con 0x7f2a9815f610 2023-07-09T21:39:00.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a96ffd640 1 -- 172.21.15.37:0/3074841315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8c0a7050 con 0x7f2a9815f610 2023-07-09T21:39:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a96ffd640 1 -- 172.21.15.37:0/3074841315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0ab980 con 0x7f2a9815f610 2023-07-09T21:39:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/3074841315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 msgr2=0x7f2a9815fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/3074841315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815fa60 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0097c0 tx=0x7f2a8c01c380 comp rx=0 tx=0).stop 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/3074841315 shutdown_connections 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/3074841315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815fa60 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/3074841315 >> 172.21.15.37:0/3074841315 conn(0x7f2a9806d230 msgr2=0x7f2a9806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/3074841315 shutdown_connections 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.490+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/3074841315 wait complete. 2023-07-09T21:39:00.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 Processor -- start 2023-07-09T21:39:00.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- start start 2023-07-09T21:39:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a9806b9c0 0x7f2a980b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a9815bb90 0x7f2a980b57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980afe00 con 0x7f2a9815f610 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9815de40 con 0x7f2a9806b9c0 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a980b5ce0 con 0x7f2a9815bb90 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52470/0 (socket says 172.21.15.37:52470) 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 -- 172.21.15.37:0/2068287534 learned_addr learned my addr 172.21.15.37:0/2068287534 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:00.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a97fff640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a9806b9c0 0x7f2a980b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a977fe640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a9815bb90 0x7f2a980b57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 -- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a9815bb90 msgr2=0x7f2a980b57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a9815bb90 0x7f2a980b57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 -- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a9806b9c0 msgr2=0x7f2a980b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a9806b9c0 0x7f2a980b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 -- 172.21.15.37:0/2068287534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a8c009420 con 0x7f2a9815f610 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9cd49640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2a90001570 tx=0x7f2a9000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000a640 con 0x7f2a9815f610 2023-07-09T21:39:00.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9000a7c0 con 0x7f2a9815f610 2023-07-09T21:39:00.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9000ab70 con 0x7f2a9815f610 2023-07-09T21:39:00.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9815d1c0 con 0x7f2a9815f610 2023-07-09T21:39:00.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.494+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9815d780 con 0x7f2a9815f610 2023-07-09T21:39:00.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9815df80 con 0x7f2a9815f610 2023-07-09T21:39:00.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a9000acd0 con 0x7f2a9815f610 2023-07-09T21:39:00.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a94ff9640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 0x7f2a84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:00.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2a90082fd0 con 0x7f2a9815f610 2023-07-09T21:39:00.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a97fff640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 0x7f2a84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:00.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.498+0000 7f2a97fff640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 0x7f2a84068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a88004e30 tx=0x7f2a88009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.502+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a9815df80 con 0x7f2a9815f610 2023-07-09T21:39:00.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:00.658+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2a9815df80 con 0x7f2a9815f610 2023-07-09T21:39:01.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:39:01.198 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:39:01.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.194+0000 7f2a94ff9640 1 -- 172.21.15.37:0/2068287534 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v96) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2a9815df80 con 0x7f2a9815f610 2023-07-09T21:39:01.199 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.194+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 msgr2=0x7f2a84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.194+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 0x7f2a84068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2a88004e30 tx=0x7f2a88009040 comp rx=0 tx=0).stop 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.194+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 msgr2=0x7f2a9815e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.194+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2a90001570 tx=0x7f2a9000cca0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 shutdown_connections 2023-07-09T21:39:01.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2a840663a0 0x7f2a84068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a9815f610 0x7f2a9815e460 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a9815bb90 0x7f2a980b57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 --2- 172.21.15.37:0/2068287534 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a9806b9c0 0x7f2a980b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 >> 172.21.15.37:0/2068287534 conn(0x7f2a9806d230 msgr2=0x7f2a98152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 shutdown_connections 2023-07-09T21:39:01.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.198+0000 7f2a9e7ac640 1 -- 172.21.15.37:0/2068287534 wait complete. 2023-07-09T21:39:01.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:39:01.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 Processor -- start 2023-07-09T21:39:01.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 -- start start 2023-07-09T21:39:01.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d180b7980 0x7f2d18160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d180d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d1815bf80 con 0x7f2d180ceb80 2023-07-09T21:39:01.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180cd070 con 0x7f2d180b7980 2023-07-09T21:39:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1f256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180cfd70 con 0x7f2d180d0780 2023-07-09T21:39:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d17fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d180ceb80 0x7f2d180cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35284/0 (socket says 172.21.15.37:35284) 2023-07-09T21:39:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d17fff640 1 -- 172.21.15.37:0/3110511404 learned_addr learned my addr 172.21.15.37:0/3110511404 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1d7f3640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d180d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/3110511404 >> v2:172.21.15.119:3300/0 conn(0x7f2d180b7980 0x7f2d18160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454609136 0 0) 0x7f2d04001120 con 0x7f2d180ceb80 2023-07-09T21:39:01.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d08003530 con 0x7f2d180ceb80 2023-07-09T21:39:01.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3450305299 0 0) 0x7f2d08003530 con 0x7f2d180ceb80 2023-07-09T21:39:01.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 msgr2=0x7f2d180d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d180d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 >> v2:172.21.15.119:3300/0 conn(0x7f2d180b7980 msgr2=0x7f2d18160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:01.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 --2- 172.21.15.37:0/3110511404 >> v2:172.21.15.119:3300/0 conn(0x7f2d180b7980 0x7f2d18160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d18160570 con 0x7f2d180ceb80 2023-07-09T21:39:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2d04001810 con 0x7f2d180ceb80 2023-07-09T21:39:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 >> v1:172.21.15.37:6789/0 conn(0x7f2d180ceb80 legacy=0x7f2d180cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d08003980 0x7f2d08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080043b0 0x7f2d08004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d08004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180cd070 con 0x7f2d08003980 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180cfd70 con 0x7f2d080043b0 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0800b990 con 0x7f2d180d0780 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.442+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d08003980 0x7f2d08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d17fff640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080043b0 0x7f2d08004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1d7f3640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d08004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 -- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 msgr2=0x7f2d08004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d180d0780 0x7f2d08004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 -- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080043b0 msgr2=0x7f2d08004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d080043b0 0x7f2d08004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 -- 172.21.15.37:0/3110511404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d08003530 con 0x7f2d08003980 2023-07-09T21:39:01.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d08003980 0x7f2d08003d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ae0 tx=0x7f2d0c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d6512fc982d10d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:01.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0a8410 con 0x7f2d08003980 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0c0a8570 con 0x7f2d08003980 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d177fe640 1 -- 172.21.15.37:0/3110511404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0c0a8920 con 0x7f2d08003980 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1f256640 1 -- 172.21.15.37:0/3110511404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d08003980 msgr2=0x7f2d08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1f256640 1 --2- 172.21.15.37:0/3110511404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d08003980 0x7f2d08003d90 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ae0 tx=0x7f2d0c01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.446+0000 7f2d1d7f3640 1 -- 172.21.15.37:0/3110511404 reap_dead start 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- 172.21.15.37:0/3110511404 shutdown_connections 2023-07-09T21:39:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- 172.21.15.37:0/3110511404 >> 172.21.15.37:0/3110511404 conn(0x7f2d18073090 msgr2=0x7f2d18069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- 172.21.15.37:0/3110511404 shutdown_connections 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- 172.21.15.37:0/3110511404 wait complete. 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 Processor -- start 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- start start 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d08003980 0x7f2d180b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d18155610 0x7f2d18155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180b3260 con 0x7f2d18152dc0 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18155fd0 con 0x7f2d18155610 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1f256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d180b3440 con 0x7f2d08003980 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52482/0 (socket says 172.21.15.37:52482) 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 -- 172.21.15.37:0/1167117204 learned_addr learned my addr 172.21.15.37:0/1167117204 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d08003980 0x7f2d180b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d1d7f3640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d18155610 0x7f2d18155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 -- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d08003980 msgr2=0x7f2d180b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d08003980 0x7f2d180b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 -- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d18155610 msgr2=0x7f2d18155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d18155610 0x7f2d18155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.450+0000 7f2d17fff640 1 -- 172.21.15.37:0/1167117204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b3720 con 0x7f2d18152dc0 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d17fff640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e690 tx=0x7f2d0400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:01.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400c660 con 0x7f2d18152dc0 2023-07-09T21:39:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d0400c7c0 con 0x7f2d18152dc0 2023-07-09T21:39:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0400cb30 con 0x7f2d18152dc0 2023-07-09T21:39:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d180b3a00 con 0x7f2d18152dc0 2023-07-09T21:39:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d18153230 con 0x7f2d18152dc0 2023-07-09T21:39:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d180c5a30 con 0x7f2d18152dc0 2023-07-09T21:39:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.454+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d0400cc90 con 0x7f2d18152dc0 2023-07-09T21:39:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.458+0000 7f2d157fa640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 0x7f2cfc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.458+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f2d04083fe0 con 0x7f2d18152dc0 2023-07-09T21:39:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.458+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 0x7f2cfc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.458+0000 7f2d1cff2640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 0x7f2cfc068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0af000 tx=0x7f2d0c0b3040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:01.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.458+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d04051620 con 0x7f2d18152dc0 2023-07-09T21:39:01.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:01.614+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2d18160570 con 0x7f2d18152dc0 2023-07-09T21:39:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.202+0000 7f2d157fa640 1 -- 172.21.15.37:0/1167117204 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v97) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2d18160570 con 0x7f2d18152dc0 2023-07-09T21:39:02.206 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:39:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 msgr2=0x7f2cfc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:02.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 0x7f2cfc068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c0af000 tx=0x7f2d0c0b3040 comp rx=0 tx=0).stop 2023-07-09T21:39:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 msgr2=0x7f2d181507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:02.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400e690 tx=0x7f2d0400eb50 comp rx=0 tx=0).stop 2023-07-09T21:39:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 shutdown_connections 2023-07-09T21:39:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f2cfc0663d0 0x7f2cfc068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d18155610 0x7f2d18155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d18152dc0 0x7f2d181507a0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 --2- 172.21.15.37:0/1167117204 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d08003980 0x7f2d180b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.210+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 >> 172.21.15.37:0/1167117204 conn(0x7f2d18073090 msgr2=0x7f2d1815da00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:02.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.218+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 shutdown_connections 2023-07-09T21:39:02.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.218+0000 7f2d1f256640 1 -- 172.21.15.37:0/1167117204 wait complete. 2023-07-09T21:39:02.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:39:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.390+0000 7fcbc598f640 1 Processor -- start 2023-07-09T21:39:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 -- start start 2023-07-09T21:39:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 0x7fcbc0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbc00b3c20 0x7fcbc00b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00cd070 con 0x7fcbc00b3c20 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc00cfd70 con 0x7fcbc00b7980 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbc598f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc015bf80 con 0x7fcbc00ceb80 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbc00b3c20 0x7fcbc00b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbc00b3c20 0x7fcbc00b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52496/0 (socket says 172.21.15.37:52496) 2023-07-09T21:39:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 -- 172.21.15.37:0/2536596528 learned_addr learned my addr 172.21.15.37:0/2536596528 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2536596528 >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 0x7fcbc0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbe7fc640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 -- 172.21.15.37:0/2536596528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 msgr2=0x7fcbc00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc00cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 -- 172.21.15.37:0/2536596528 >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 msgr2=0x7fcbc0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 --2- 172.21.15.37:0/2536596528 >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 0x7fcbc0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbf7fe640 1 -- 172.21.15.37:0/2536596528 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc0160570 con 0x7fcbc00b3c20 2023-07-09T21:39:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2536596528 >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 0x7fcbc0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.394+0000 7fcbbe7fc640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbbf7fe640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b3c20 0x7fcbc00b4080 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0069aa0 tx=0x7fcbb801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39bce0b1d794c7fa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbbdffb640 1 -- 172.21.15.37:0/2536596528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80a5650 con 0x7fcbc00b3c20 2023-07-09T21:39:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbbdffb640 1 -- 172.21.15.37:0/2536596528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80a57b0 con 0x7fcbc00b3c20 2023-07-09T21:39:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbbdffb640 1 -- 172.21.15.37:0/2536596528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80a5b40 con 0x7fcbc00b3c20 2023-07-09T21:39:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- 172.21.15.37:0/2536596528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b3c20 msgr2=0x7fcbc00b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b3c20 0x7fcbc00b4080 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0069aa0 tx=0x7fcbb801c9d0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- 172.21.15.37:0/2536596528 shutdown_connections 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b3c20 0x7fcbc00b4080 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2536596528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2536596528 >> v2:172.21.15.119:3300/0 conn(0x7fcbc00b7980 0x7fcbc0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- 172.21.15.37:0/2536596528 >> 172.21.15.37:0/2536596528 conn(0x7fcbc0073090 msgr2=0x7fcbc0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- 172.21.15.37:0/2536596528 shutdown_connections 2023-07-09T21:39:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- 172.21.15.37:0/2536596528 wait complete. 2023-07-09T21:39:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 Processor -- start 2023-07-09T21:39:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.398+0000 7fcbc598f640 1 -- start start 2023-07-09T21:39:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 0x7fcbc015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc015c3b0 con 0x7fcbc00b7980 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc015d020 con 0x7fcbc00b3c20 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0159d20 con 0x7fcbc00ceb80 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52510/0 (socket says 172.21.15.37:52510) 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 -- 172.21.15.37:0/2710531101 learned_addr learned my addr 172.21.15.37:0/2710531101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 0x7fcbc015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbf7fe640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 -- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 msgr2=0x7fcbc015eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc015eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 -- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 msgr2=0x7fcbc015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 0x7fcbc015cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 -- 172.21.15.37:0/2710531101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8009b30 con 0x7fcbc00b7980 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 0x7fcbc015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbbe7fc640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400e840 tx=0x7fcbb400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400c8d0 con 0x7fcbc00b7980 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400ca30 con 0x7fcbc00b7980 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400cde0 con 0x7fcbc00b7980 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc015eff0 con 0x7fcbc00b7980 2023-07-09T21:39:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc00cc2f0 con 0x7fcbc00b7980 2023-07-09T21:39:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.402+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc00cff60 con 0x7fcbc00b7980 2023-07-09T21:39:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.406+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcbb4026430 con 0x7fcbc00b7980 2023-07-09T21:39:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.406+0000 7fcba7fff640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.406+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fcbb4083fe0 con 0x7fcbc00b7980 2023-07-09T21:39:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.406+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.406+0000 7fcbbeffd640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 0x7fcbac068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0153fd0 tx=0x7fcbb0008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.410+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbb4051280 con 0x7fcbc00b7980 2023-07-09T21:39:02.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:02.598+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcbc00cff60 con 0x7fcbc00b7980 2023-07-09T21:39:03.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.242+0000 7fcba7fff640 1 -- 172.21.15.37:0/2710531101 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7fcbc00cff60 con 0x7fcbc00b7980 2023-07-09T21:39:03.246 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 11 and data pool 12 2023-07-09T21:39:03.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.246+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 msgr2=0x7fcbac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.246+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 0x7fcbac068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0153fd0 tx=0x7fcbb0008040 comp rx=0 tx=0).stop 2023-07-09T21:39:03.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.246+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 msgr2=0x7fcbc015e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.246+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fcbb400e840 tx=0x7fcbb400ed00 comp rx=0 tx=0).stop 2023-07-09T21:39:03.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 shutdown_connections 2023-07-09T21:39:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbac0663a0 0x7fcbac068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc00ceb80 0x7fcbc015eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc00b7980 0x7fcbc015e570 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 --2- 172.21.15.37:0/2710531101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc00b3c20 0x7fcbc015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 >> 172.21.15.37:0/2710531101 conn(0x7fcbc0073090 msgr2=0x7fcbc00b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:03.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 shutdown_connections 2023-07-09T21:39:03.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.250+0000 7fcbc598f640 1 -- 172.21.15.37:0/2710531101 wait complete. 2023-07-09T21:39:03.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:03.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 Processor -- start 2023-07-09T21:39:03.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 -- start start 2023-07-09T21:39:03.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbf80b7ab0 0x7fbbf806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 0x7fbbf80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf80b49f0 con 0x7fbbf80b4170 2023-07-09T21:39:03.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80b7e80 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbc0007b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80b4610 con 0x7fbbf80cef80 2023-07-09T21:39:03.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfde17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbf80b7ab0 0x7fbbf806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfe618640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbbf80b4170 0x7fbbf815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35296/0 (socket says 172.21.15.37:35296) 2023-07-09T21:39:03.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfe618640 1 -- 172.21.15.37:0/1565569761 learned_addr learned my addr 172.21.15.37:0/1565569761 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfd616640 1 --2- 172.21.15.37:0/1565569761 >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 0x7fbbf80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfde17640 1 -- 172.21.15.37:0/1565569761 >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 msgr2=0x7fbbf80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfde17640 1 --2- 172.21.15.37:0/1565569761 >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 0x7fbbf80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfde17640 1 -- 172.21.15.37:0/1565569761 >> v1:172.21.15.37:6789/0 conn(0x7fbbf80b4170 legacy=0x7fbbf815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfde17640 1 -- 172.21.15.37:0/1565569761 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80cc8a0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfd616640 1 --2- 172.21.15.37:0/1565569761 >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 0x7fbbf80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:03.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.422+0000 7fbbfce15640 1 -- 172.21.15.37:0/1565569761 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884315849 0 0) 0x7fbbf80b49f0 con 0x7fbbf80b4170 2023-07-09T21:39:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbbfde17640 1 --2- 172.21.15.37:0/1565569761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf806aa50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80b4d10 tx=0x7fbbf401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162e3d7912d30861 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbbfce15640 1 -- 172.21.15.37:0/1565569761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40a7070 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbbfce15640 1 -- 172.21.15.37:0/1565569761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40ab430 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbbfce15640 1 -- 172.21.15.37:0/1565569761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab7c0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 -- 172.21.15.37:0/1565569761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 msgr2=0x7fbbf806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 --2- 172.21.15.37:0/1565569761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf806aa50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fbbf80b4d10 tx=0x7fbbf401c430 comp rx=0 tx=0).stop 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 -- 172.21.15.37:0/1565569761 shutdown_connections 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 --2- 172.21.15.37:0/1565569761 >> v2:172.21.15.119:3300/0 conn(0x7fbbf80cef80 0x7fbbf80b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 --2- 172.21.15.37:0/1565569761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf806aa50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 -- 172.21.15.37:0/1565569761 >> 172.21.15.37:0/1565569761 conn(0x7fbbf8073090 msgr2=0x7fbbf8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:03.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 -- 172.21.15.37:0/1565569761 shutdown_connections 2023-07-09T21:39:03.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.426+0000 7fbc0007b640 1 -- 172.21.15.37:0/1565569761 wait complete. 2023-07-09T21:39:03.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 Processor -- start 2023-07-09T21:39:03.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- start start 2023-07-09T21:39:03.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf80b4170 0x7fbbf80caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbf80cef80 0x7fbbf80b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80cbf10 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80cb300 con 0x7fbbf80b4170 2023-07-09T21:39:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80cb5e0 con 0x7fbbf80cef80 2023-07-09T21:39:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52524/0 (socket says 172.21.15.37:52524) 2023-07-09T21:39:03.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 -- 172.21.15.37:0/885601221 learned_addr learned my addr 172.21.15.37:0/885601221 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:03.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfde17640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf80b4170 0x7fbbf80caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfe618640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbf80cef80 0x7fbbf80b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 -- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbf80cef80 msgr2=0x7fbbf80b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbf80cef80 0x7fbbf80b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 -- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf80b4170 msgr2=0x7fbbf80caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf80b4170 0x7fbbf80caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 -- 172.21.15.37:0/885601221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4009420 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbfd616640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c7f0 tx=0x7fbbe800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007820 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8007980 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8007cf0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80cb8c0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.430+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80cafa0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf804d7d0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbbe80113f0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbbee7fc640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 0x7fbbdc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbbe8084280 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbbfde17640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 0x7fbbdc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.434+0000 7fbbfde17640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 0x7fbbdc068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40af000 tx=0x7fbbf40a7000 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.438+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbe80514d0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.594+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbf806a830 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.594+0000 7fbbee7fc640 1 -- 172.21.15.37:0/885601221 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18355 (secure 0 0 0) 0x7fbbe8054af0 con 0x7fbbf80b7ab0 2023-07-09T21:39:03.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:03.598 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":98,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:02.601812+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:03.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 msgr2=0x7fbbdc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 0x7fbbdc068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40af000 tx=0x7fbbf40a7000 comp rx=0 tx=0).stop 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 msgr2=0x7fbbf80b1c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fbbe800c7f0 tx=0x7fbbe800ccb0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 shutdown_connections 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fbbdc0663a0 0x7fbbdc068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbf80cef80 0x7fbbf80b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbf80b7ab0 0x7fbbf80b1c10 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 --2- 172.21.15.37:0/885601221 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbf80b4170 0x7fbbf80caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 >> 172.21.15.37:0/885601221 conn(0x7fbbf8073090 msgr2=0x7fbbf80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:03.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 shutdown_connections 2023-07-09T21:39:03.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.598+0000 7fbc0007b640 1 -- 172.21.15.37:0/885601221 wait complete. 2023-07-09T21:39:03.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:03.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.758+0000 7feda5b2c640 1 Processor -- start 2023-07-09T21:39:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.758+0000 7feda5b2c640 1 -- start start 2023-07-09T21:39:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.758+0000 7feda5b2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7feda00b7ab0 0x7feda006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.758+0000 7feda5b2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00b49f0 con 0x7feda00b4340 2023-07-09T21:39:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7feda5b2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda00cc8a0 con 0x7feda00cef80 2023-07-09T21:39:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7feda5b2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda00b7e80 con 0x7feda00b7ab0 2023-07-09T21:39:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feda00b4340 0x7feda00d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35310/0 (socket says 172.21.15.37:35310) 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9ffff640 1 -- 172.21.15.37:0/1824296792 learned_addr learned my addr 172.21.15.37:0/1824296792 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1824296792 >> v2:172.21.15.119:3300/0 conn(0x7feda00b7ab0 0x7feda006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9e7fc640 1 -- 172.21.15.37:0/1824296792 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2956519657 0 0) 0x7feda00b49f0 con 0x7feda00b4340 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9e7fc640 1 -- 172.21.15.37:0/1824296792 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed88003530 con 0x7feda00b4340 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1824296792 >> v1:172.21.15.119:6789/0 conn(0x7feda00cef80 legacy=0x7feda00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1824296792 >> v1:172.21.15.37:6789/0 conn(0x7feda00b4340 legacy=0x7feda00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1824296792 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda00ccb80 con 0x7feda00b7ab0 2023-07-09T21:39:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.762+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1824296792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda006aa50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fed900097c0 tx=0x7fed9001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=131a208e6436a9f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7fed9e7fc640 1 -- 172.21.15.37:0/1824296792 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900ab650 con 0x7feda00b7ab0 2023-07-09T21:39:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7fed9e7fc640 1 -- 172.21.15.37:0/1824296792 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900ab7b0 con 0x7feda00b7ab0 2023-07-09T21:39:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7fed9e7fc640 1 -- 172.21.15.37:0/1824296792 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900abb20 con 0x7feda00b7ab0 2023-07-09T21:39:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- 172.21.15.37:0/1824296792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 msgr2=0x7feda006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1824296792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda006aa50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fed900097c0 tx=0x7fed9001c450 comp rx=0 tx=0).stop 2023-07-09T21:39:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- 172.21.15.37:0/1824296792 shutdown_connections 2023-07-09T21:39:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1824296792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda006aa50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- 172.21.15.37:0/1824296792 >> 172.21.15.37:0/1824296792 conn(0x7feda0073090 msgr2=0x7feda0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- 172.21.15.37:0/1824296792 shutdown_connections 2023-07-09T21:39:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- 172.21.15.37:0/1824296792 wait complete. 2023-07-09T21:39:03.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 Processor -- start 2023-07-09T21:39:03.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.766+0000 7feda5b2c640 1 -- start start 2023-07-09T21:39:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda0155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda00cef80 0x7feda0155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda014f380 con 0x7feda00b4340 2023-07-09T21:39:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda014e4d0 con 0x7feda00b7ab0 2023-07-09T21:39:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda014e700 con 0x7feda00cef80 2023-07-09T21:39:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52526/0 (socket says 172.21.15.37:52526) 2023-07-09T21:39:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1690745824 learned_addr learned my addr 172.21.15.37:0/1690745824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda00cef80 msgr2=0x7feda0155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda00cef80 0x7feda0155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 msgr2=0x7feda0155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9effd640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda0155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda0155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 -- 172.21.15.37:0/1690745824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009420 con 0x7feda00b4340 2023-07-09T21:39:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9effd640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed9f7fe640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fed90000c10 tx=0x7fed900191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900ab920 con 0x7feda00b4340 2023-07-09T21:39:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900aba80 con 0x7feda00b4340 2023-07-09T21:39:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900abe10 con 0x7feda00b4340 2023-07-09T21:39:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda014e9e0 con 0x7feda00b4340 2023-07-09T21:39:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda014efa0 con 0x7feda00b4340 2023-07-09T21:39:03.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda014f4c0 con 0x7feda00b4340 2023-07-09T21:39:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.770+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed90003620 con 0x7feda00b4340 2023-07-09T21:39:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.774+0000 7fed87fff640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 0x7fed8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.774+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed9011e2a0 con 0x7feda00b4340 2023-07-09T21:39:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.774+0000 7fed9effd640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 0x7fed8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:03.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.774+0000 7fed9effd640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 0x7fed8c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feda00cc460 tx=0x7fed94009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:03.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.778+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feda014f4c0 con 0x7feda00b4340 2023-07-09T21:39:03.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feda014f4c0 con 0x7feda00b4340 2023-07-09T21:39:03.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7fed87fff640 1 -- 172.21.15.37:0/1690745824 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+18355 (secure 0 0 0) 0x7feda014f4c0 con 0x7feda00b4340 2023-07-09T21:39:03.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:03.937 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":98,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:02.601812+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:03.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 msgr2=0x7fed8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 0x7fed8c068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feda00cc460 tx=0x7fed94009040 comp rx=0 tx=0).stop 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 msgr2=0x7feda014df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fed90000c10 tx=0x7fed900191f0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 shutdown_connections 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed8c0663a0 0x7fed8c068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7feda00cef80 0x7feda0155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7feda00b7ab0 0x7feda0155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 --2- 172.21.15.37:0/1690745824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feda00b4340 0x7feda014df90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:03.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 >> 172.21.15.37:0/1690745824 conn(0x7feda0073090 msgr2=0x7feda00b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:03.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 shutdown_connections 2023-07-09T21:39:03.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:03.934+0000 7feda5b2c640 1 -- 172.21.15.37:0/1690745824 wait complete. 2023-07-09T21:39:03.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:39:04.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-07-09T21:39:04.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-09T21:39:04.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-09T21:39:04.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 Processor -- start 2023-07-09T21:39:04.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 -- start start 2023-07-09T21:39:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0b180cf290 0x7f0b18160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1815bf80 con 0x7f0b180d0780 2023-07-09T21:39:04.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b18160570 con 0x7f0b180b7980 2023-07-09T21:39:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1ea7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b180cd070 con 0x7f0b180cf290 2023-07-09T21:39:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1d018640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0b180d0780 0x7f0b180d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35316/0 (socket says 172.21.15.37:35316) 2023-07-09T21:39:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b1d018640 1 -- 172.21.15.37:0/2420094874 learned_addr learned my addr 172.21.15.37:0/2420094874 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b17fff640 1 --2- 172.21.15.37:0/2420094874 >> v2:172.21.15.119:3300/0 conn(0x7f0b180cf290 0x7f0b18160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b177fe640 1 -- 172.21.15.37:0/2420094874 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115745017 0 0) 0x7f0b100014a0 con 0x7f0b180d0780 2023-07-09T21:39:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b177fe640 1 -- 172.21.15.37:0/2420094874 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b08003530 con 0x7f0b180d0780 2023-07-09T21:39:04.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b17fff640 1 -- 172.21.15.37:0/2420094874 >> v1:172.21.15.119:6789/0 conn(0x7f0b180b7980 legacy=0x7f0b180ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b17fff640 1 -- 172.21.15.37:0/2420094874 >> v1:172.21.15.37:6789/0 conn(0x7f0b180d0780 legacy=0x7f0b180d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:04.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.102+0000 7f0b17fff640 1 -- 172.21.15.37:0/2420094874 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b180d02f0 con 0x7f0b180cf290 2023-07-09T21:39:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b17fff640 1 --2- 172.21.15.37:0/2420094874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180cf290 0x7f0b18160030 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df2b0133040f28cb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b177fe640 1 -- 172.21.15.37:0/2420094874 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ab600 con 0x7f0b180cf290 2023-07-09T21:39:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b177fe640 1 -- 172.21.15.37:0/2420094874 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040a7050 con 0x7f0b180cf290 2023-07-09T21:39:04.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b177fe640 1 -- 172.21.15.37:0/2420094874 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040ab980 con 0x7f0b180cf290 2023-07-09T21:39:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/2420094874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180cf290 msgr2=0x7f0b18160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/2420094874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180cf290 0x7f0b18160030 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0b040097c0 tx=0x7f0b0401c480 comp rx=0 tx=0).stop 2023-07-09T21:39:04.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/2420094874 shutdown_connections 2023-07-09T21:39:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/2420094874 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180cf290 0x7f0b18160030 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/2420094874 >> 172.21.15.37:0/2420094874 conn(0x7f0b18073090 msgr2=0x7f0b18069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/2420094874 shutdown_connections 2023-07-09T21:39:04.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.106+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/2420094874 wait complete. 2023-07-09T21:39:04.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 Processor -- start 2023-07-09T21:39:04.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- start start 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 0x7f0b180b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 0x7f0b181f7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181f8120 con 0x7f0b180cf290 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b18151f70 con 0x7f0b180d0780 2023-07-09T21:39:04.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b181f8350 con 0x7f0b180b7980 2023-07-09T21:39:04.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:04.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52528/0 (socket says 172.21.15.37:52528) 2023-07-09T21:39:04.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 -- 172.21.15.37:0/977674409 learned_addr learned my addr 172.21.15.37:0/977674409 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1c817640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 0x7f0b180b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1d018640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 0x7f0b181f7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:04.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 -- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 msgr2=0x7f0b180b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 0x7f0b180b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 -- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 msgr2=0x7f0b181f7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 0x7f0b181f7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:04.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 -- 172.21.15.37:0/977674409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b04009420 con 0x7f0b180cf290 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1d018640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 0x7f0b181f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1c817640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 0x7f0b180b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b17fff640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ae040 tx=0x7f0b04019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040b4840 con 0x7f0b180cf290 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040b49c0 con 0x7f0b180cf290 2023-07-09T21:39:04.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040b4d70 con 0x7f0b180cf290 2023-07-09T21:39:04.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b181f8630 con 0x7f0b180cf290 2023-07-09T21:39:04.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.110+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b181521c0 con 0x7f0b180cf290 2023-07-09T21:39:04.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1804d7d0 con 0x7f0b180cf290 2023-07-09T21:39:04.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0b040b2040 con 0x7f0b180cf290 2023-07-09T21:39:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b157fa640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 0x7f0afc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0b0411e250 con 0x7f0b180cf290 2023-07-09T21:39:04.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b1c817640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 0x7f0afc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:04.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.114+0000 7f0b1c817640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 0x7f0afc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b1815c190 tx=0x7f0b0c009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:04.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.118+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0b040eb540 con 0x7f0b180cf290 2023-07-09T21:39:04.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:04.306+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0b1815bc40 con 0x7f0b180cf290 2023-07-09T21:39:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.254+0000 7f0b157fa640 1 -- 172.21.15.37:0/977674409 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0b040eeb60 con 0x7f0b180cf290 2023-07-09T21:39:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 msgr2=0x7f0afc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 0x7f0afc068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0b1815c190 tx=0x7f0b0c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 msgr2=0x7f0b1814d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f0b040ae040 tx=0x7f0b04019220 comp rx=0 tx=0).stop 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 shutdown_connections 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f0afc0663a0 0x7f0afc068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0b180d0780 0x7f0b181f7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b180cf290 0x7f0b1814d870 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 --2- 172.21.15.37:0/977674409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0b180b7980 0x7f0b180b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 >> 172.21.15.37:0/977674409 conn(0x7f0b18073090 msgr2=0x7f0b180b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 shutdown_connections 2023-07-09T21:39:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.258+0000 7f0b1ea7b640 1 -- 172.21.15.37:0/977674409 wait complete. 2023-07-09T21:39:05.284 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:39:05.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:39:05.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 Processor -- start 2023-07-09T21:39:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 -- start start 2023-07-09T21:39:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b7980 0x7fdb98160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb9815bf80 con 0x7fdb980d0780 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb98160570 con 0x7fdb980ceb80 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9f759640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb980cd070 con 0x7fdb980b7980 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b7980 0x7fdb98160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb980b7980 0x7fdb98160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52540/0 (socket says 172.21.15.37:52540) 2023-07-09T21:39:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/915237419 learned_addr learned my addr 172.21.15.37:0/915237419 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9dcf6640 1 --1- 172.21.15.37:0/915237419 >> v1:172.21.15.37:6789/0 conn(0x7fdb980d0780 0x7fdb980d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35322/0 (socket says 172.21.15.37:35322) 2023-07-09T21:39:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/915237419 >> v1:172.21.15.119:6789/0 conn(0x7fdb980ceb80 legacy=0x7fdb980cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/915237419 >> v1:172.21.15.37:6789/0 conn(0x7fdb980d0780 legacy=0x7fdb980d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb8ffff640 1 -- 172.21.15.37:0/915237419 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121698357 0 0) 0x7fdb900014a0 con 0x7fdb980d0780 2023-07-09T21:39:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.434+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/915237419 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980d02f0 con 0x7fdb980b7980 2023-07-09T21:39:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9d4f5640 1 --2- 172.21.15.37:0/915237419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb98160030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009870 tx=0x7fdb9401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9adba06d26ccacc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb8ffff640 1 -- 172.21.15.37:0/915237419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940ab600 con 0x7fdb980b7980 2023-07-09T21:39:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb8ffff640 1 -- 172.21.15.37:0/915237419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb940a7050 con 0x7fdb980b7980 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb8ffff640 1 -- 172.21.15.37:0/915237419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940ab980 con 0x7fdb980b7980 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 -- 172.21.15.37:0/915237419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 msgr2=0x7fdb98160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 --2- 172.21.15.37:0/915237419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb98160030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdb94009870 tx=0x7fdb9401c540 comp rx=0 tx=0).stop 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 -- 172.21.15.37:0/915237419 shutdown_connections 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 --2- 172.21.15.37:0/915237419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb98160030 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 -- 172.21.15.37:0/915237419 >> 172.21.15.37:0/915237419 conn(0x7fdb98073090 msgr2=0x7fdb98069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 -- 172.21.15.37:0/915237419 shutdown_connections 2023-07-09T21:39:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.438+0000 7fdb9f759640 1 -- 172.21.15.37:0/915237419 wait complete. 2023-07-09T21:39:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 Processor -- start 2023-07-09T21:39:05.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- start start 2023-07-09T21:39:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb980ceb80 0x7fdb980c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:05.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 0x7fdb981533a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980b3260 con 0x7fdb980b7980 2023-07-09T21:39:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980c7fe0 con 0x7fdb980d0780 2023-07-09T21:39:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980c82b0 con 0x7fdb980ceb80 2023-07-09T21:39:05.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:05.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52544/0 (socket says 172.21.15.37:52544) 2023-07-09T21:39:05.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/622708228 learned_addr learned my addr 172.21.15.37:0/622708228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:05.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb980ceb80 msgr2=0x7fdb980c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb980ceb80 0x7fdb980c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9dcf6640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 0x7fdb981533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:05.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 msgr2=0x7fdb981533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:05.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 0x7fdb981533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:05.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 -- 172.21.15.37:0/622708228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940094d0 con 0x7fdb980b7980 2023-07-09T21:39:05.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9dcf6640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 0x7fdb981533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9d4f5640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdb9401a170 tx=0x7fdb940192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94004220 con 0x7fdb980b7980 2023-07-09T21:39:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb94004380 con 0x7fdb980b7980 2023-07-09T21:39:05.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94003820 con 0x7fdb980b7980 2023-07-09T21:39:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb980c8590 con 0x7fdb980b7980 2023-07-09T21:39:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.442+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb980b2b10 con 0x7fdb980b7980 2023-07-09T21:39:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb980b2d60 con 0x7fdb980b7980 2023-07-09T21:39:05.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdb94003980 con 0x7fdb980b7980 2023-07-09T21:39:05.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb8dffb640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 0x7fdb7c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:05.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdb9411dc80 con 0x7fdb980b7980 2023-07-09T21:39:05.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb9ccf4640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 0x7fdb7c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.446+0000 7fdb9ccf4640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 0x7fdb7c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb88000f70 tx=0x7fdb880079c0 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:05.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.450+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdb940eadb0 con 0x7fdb980b7980 2023-07-09T21:39:05.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:05.638+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdb9804d7d0 con 0x7fdb980b7980 2023-07-09T21:39:06.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.266+0000 7fdb8dffb640 1 -- 172.21.15.37:0/622708228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdb940b00c0 con 0x7fdb980b7980 2023-07-09T21:39:06.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 msgr2=0x7fdb7c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 0x7fdb7c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdb88000f70 tx=0x7fdb880079c0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 msgr2=0x7fdb980b4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdb9401a170 tx=0x7fdb940192e0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 shutdown_connections 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fdb7c0663d0 0x7fdb7c068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdb980d0780 0x7fdb981533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdb980ceb80 0x7fdb980c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 --2- 172.21.15.37:0/622708228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb980b7980 0x7fdb980b4710 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 >> 172.21.15.37:0/622708228 conn(0x7fdb98073090 msgr2=0x7fdb980d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 shutdown_connections 2023-07-09T21:39:06.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.270+0000 7fdb9f759640 1 -- 172.21.15.37:0/622708228 wait complete. 2023-07-09T21:39:06.295 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:39:06.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 Processor -- start 2023-07-09T21:39:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 -- start start 2023-07-09T21:39:06.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f80b7ab0 0x7f50f806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f80b49f0 con 0x7f50f80cef80 2023-07-09T21:39:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f80b7e80 con 0x7f50f80b7ab0 2023-07-09T21:39:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fe656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80cc8a0 con 0x7f50f80b4340 2023-07-09T21:39:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f80b7ab0 0x7f50f806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50fcbf3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50f80b7ab0 0x7f50f806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:44018/0 (socket says 172.21.15.37:44018) 2023-07-09T21:39:06.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 -- 172.21.15.37:0/3529124450 learned_addr learned my addr 172.21.15.37:0/3529124450 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:06.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 -- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 msgr2=0x7f50f80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:06.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 --2- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 -- 172.21.15.37:0/3529124450 >> v1:172.21.15.119:6789/0 conn(0x7f50f80cef80 legacy=0x7f50f80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.442+0000 7f50f7fff640 1 -- 172.21.15.37:0/3529124450 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f80ccb80 con 0x7f50f80b7ab0 2023-07-09T21:39:06.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50f7fff640 1 --2- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f806aa50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=791e9030a6a085a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50f6ffd640 1 -- 172.21.15.37:0/3529124450 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80aa670 con 0x7f50f80b7ab0 2023-07-09T21:39:06.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50f6ffd640 1 -- 172.21.15.37:0/3529124450 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e80aa7d0 con 0x7f50f80b7ab0 2023-07-09T21:39:06.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50f6ffd640 1 -- 172.21.15.37:0/3529124450 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e80aab60 con 0x7f50f80b7ab0 2023-07-09T21:39:06.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 -- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 msgr2=0x7f50f806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 --2- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f806aa50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009870 tx=0x7f50e801c510 comp rx=0 tx=0).stop 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 -- 172.21.15.37:0/3529124450 shutdown_connections 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 --2- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 --2- 172.21.15.37:0/3529124450 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f806aa50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 -- 172.21.15.37:0/3529124450 >> 172.21.15.37:0/3529124450 conn(0x7f50f8073090 msgr2=0x7f50f8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 -- 172.21.15.37:0/3529124450 shutdown_connections 2023-07-09T21:39:06.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.446+0000 7f50fe656640 1 -- 172.21.15.37:0/3529124450 wait complete. 2023-07-09T21:39:06.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 Processor -- start 2023-07-09T21:39:06.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- start start 2023-07-09T21:39:06.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80c62b0 con 0x7f50f80cef80 2023-07-09T21:39:06.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80b64b0 con 0x7f50f80b7ab0 2023-07-09T21:39:06.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f80b6790 con 0x7f50f80b4340 2023-07-09T21:39:06.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52560/0 (socket says 172.21.15.37:52560) 2023-07-09T21:39:06.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 -- 172.21.15.37:0/1824934854 learned_addr learned my addr 172.21.15.37:0/1824934854 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:06.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50f7fff640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50f77fe640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 -- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 msgr2=0x7f50f80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 -- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 msgr2=0x7f50f80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 -- 172.21.15.37:0/1824934854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80094d0 con 0x7f50f80cef80 2023-07-09T21:39:06.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fcbf3640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f50f000efc0 tx=0x7f50f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0009ca0 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f000f040 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00146c0 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f80c64c0 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.450+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f8151ff0 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f80b6950 con 0x7f50f80cef80 2023-07-09T21:39:06.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f50f0014820 con 0x7f50f80cef80 2023-07-09T21:39:06.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50f4ff9640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 0x7f50e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f50f0084e30 con 0x7f50f80cef80 2023-07-09T21:39:06.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50f7fff640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 0x7f50e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.454+0000 7f50f7fff640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 0x7f50e4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ae000 tx=0x7f50e80b5040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.458+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f50f00520a0 con 0x7f50f80cef80 2023-07-09T21:39:06.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.642+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50f804d7d0 con 0x7f50f80cef80 2023-07-09T21:39:06.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50f4ff9640 1 -- 172.21.15.37:0/1824934854 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f50f00556c0 con 0x7f50f80cef80 2023-07-09T21:39:06.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:06.648 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:06.648 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:06.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 msgr2=0x7f50e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 0x7f50e4068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f50e80ae000 tx=0x7f50e80b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 msgr2=0x7f50f80b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f50f000efc0 tx=0x7f50f000c490 comp rx=0 tx=0).stop 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 shutdown_connections 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f50e40663a0 0x7f50e4068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f80cef80 0x7f50f80b5ed0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50f80b7ab0 0x7f50f80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 --2- 172.21.15.37:0/1824934854 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50f80b4340 0x7f50f80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 >> 172.21.15.37:0/1824934854 conn(0x7f50f8073090 msgr2=0x7f50f80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:06.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 shutdown_connections 2023-07-09T21:39:06.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.646+0000 7f50fe656640 1 -- 172.21.15.37:0/1824934854 wait complete. 2023-07-09T21:39:06.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 Processor -- start 2023-07-09T21:39:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 -- start start 2023-07-09T21:39:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0b49f0 con 0x7f7d0c0b4340 2023-07-09T21:39:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0c0cc8a0 con 0x7f7d0c0cef80 2023-07-09T21:39:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d11434640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0c0b7e80 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52566/0 (socket says 172.21.15.37:52566) 2023-07-09T21:39:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d0c0b4340 0x7f7d0c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35328/0 (socket says 172.21.15.37:35328) 2023-07-09T21:39:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 -- 172.21.15.37:0/3046990497 learned_addr learned my addr 172.21.15.37:0/3046990497 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 -- 172.21.15.37:0/3046990497 >> v1:172.21.15.119:6789/0 conn(0x7f7d0c0cef80 legacy=0x7f7d0c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 -- 172.21.15.37:0/3046990497 >> v1:172.21.15.37:6789/0 conn(0x7f7d0c0b4340 legacy=0x7f7d0c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0affd640 1 -- 172.21.15.37:0/3046990497 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0c0ccb80 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.810+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/3046990497 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745305616 0 0) 0x7f7d0c0b49f0 con 0x7f7d0c0b4340 2023-07-09T21:39:06.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d0affd640 1 --2- 172.21.15.37:0/3046990497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009870 tx=0x7f7cfc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ec64968fce3ad39 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/3046990497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0aa650 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/3046990497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc0aa7b0 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d0a7fc640 1 -- 172.21.15.37:0/3046990497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0aab40 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 -- 172.21.15.37:0/3046990497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 msgr2=0x7f7d0c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 --2- 172.21.15.37:0/3046990497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009870 tx=0x7f7cfc01c4f0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 -- 172.21.15.37:0/3046990497 shutdown_connections 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 --2- 172.21.15.37:0/3046990497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c06aa50 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 -- 172.21.15.37:0/3046990497 >> 172.21.15.37:0/3046990497 conn(0x7f7d0c073090 msgr2=0x7f7d0c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 -- 172.21.15.37:0/3046990497 shutdown_connections 2023-07-09T21:39:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.814+0000 7f7d11434640 1 -- 172.21.15.37:0/3046990497 wait complete. 2023-07-09T21:39:06.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 Processor -- start 2023-07-09T21:39:06.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- start start 2023-07-09T21:39:06.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d0c0b4340 0x7f7d0c0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 0x7f7d0c1f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c7c10 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c63a0 con 0x7f7d0c0cef80 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0c0c6680 con 0x7f7d0c0b4340 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52580/0 (socket says 172.21.15.37:52580) 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 -- 172.21.15.37:0/4078567259 learned_addr learned my addr 172.21.15.37:0/4078567259 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:06.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d0affd640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d0c0b4340 0x7f7d0c0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 0x7f7d0c1f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 -- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d0c0b4340 msgr2=0x7f7d0c0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d0c0b4340 0x7f7d0c0c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 -- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 msgr2=0x7f7d0c1f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 0x7f7d0c1f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 -- 172.21.15.37:0/4078567259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc0094d0 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d0b7fe640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 0x7f7d0c1f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d03fff640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400b3e0 tx=0x7f7cf400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011830 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf4011990 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4011d60 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0c0c6960 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.818+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0c0c9d70 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0c0c7d50 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7cf401a400 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d037fe640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 0x7f7cec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7cf4083ed0 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d0affd640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 0x7f7cec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:06.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.822+0000 7f7d0affd640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 0x7f7cec068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0ae000 tx=0x7f7cfc0b5040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:06.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.826+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d0c0c7d50 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.982+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d0c0c7d50 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.982+0000 7f7d037fe640 1 -- 172.21.15.37:0/4078567259 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+18342 (secure 0 0 0) 0x7f7d0c0c7d50 con 0x7f7d0c0b7ab0 2023-07-09T21:39:06.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:06.987 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":99,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:04.208885+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 msgr2=0x7f7cec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 0x7f7cec068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc0ae000 tx=0x7f7cfc0b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 msgr2=0x7f7d0c0c9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400b3e0 tx=0x7f7cf400b8a0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 shutdown_connections 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f7cec0663a0 0x7f7cec068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d0c0cef80 0x7f7d0c1f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d0c0b7ab0 0x7f7d0c0c9830 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 --2- 172.21.15.37:0/4078567259 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d0c0b4340 0x7f7d0c0c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 >> 172.21.15.37:0/4078567259 conn(0x7f7d0c073090 msgr2=0x7f7d0c1570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 shutdown_connections 2023-07-09T21:39:06.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:06.986+0000 7f7d11434640 1 -- 172.21.15.37:0/4078567259 wait complete. 2023-07-09T21:39:07.008 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:39:07.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.146+0000 7f75115db640 1 Processor -- start 2023-07-09T21:39:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 -- start start 2023-07-09T21:39:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f750c0b4340 0x7f750c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0cef80 0x7f750c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f750c0b49f0 con 0x7f750c0b7ab0 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f750c0b7e80 con 0x7f750c0b4340 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f75115db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0cc8a0 con 0x7f750c0cef80 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f750c0b4340 0x7f750c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f750c0b4340 0x7f750c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52584/0 (socket says 172.21.15.37:52584) 2023-07-09T21:39:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 -- 172.21.15.37:0/946714575 learned_addr learned my addr 172.21.15.37:0/946714575 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f750b7fe640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0cef80 0x7f750c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 -- 172.21.15.37:0/946714575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0cef80 msgr2=0x7f750c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0cef80 0x7f750c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 -- 172.21.15.37:0/946714575 >> v1:172.21.15.119:6789/0 conn(0x7f750c0b7ab0 legacy=0x7f750c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.150+0000 7f7503fff640 1 -- 172.21.15.37:0/946714575 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f750c0ccb80 con 0x7f750c0b4340 2023-07-09T21:39:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f7503fff640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0b4340 0x7f750c06aa50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009870 tx=0x7f74f401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495073cddc853559 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f750a7fc640 1 -- 172.21.15.37:0/946714575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40aa5f0 con 0x7f750c0b4340 2023-07-09T21:39:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f750a7fc640 1 -- 172.21.15.37:0/946714575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f40aa750 con 0x7f750c0b4340 2023-07-09T21:39:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f750a7fc640 1 -- 172.21.15.37:0/946714575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40aaae0 con 0x7f750c0b4340 2023-07-09T21:39:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- 172.21.15.37:0/946714575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0b4340 msgr2=0x7f750c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0b4340 0x7f750c06aa50 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009870 tx=0x7f74f401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- 172.21.15.37:0/946714575 shutdown_connections 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0cef80 0x7f750c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 --2- 172.21.15.37:0/946714575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0b4340 0x7f750c06aa50 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- 172.21.15.37:0/946714575 >> 172.21.15.37:0/946714575 conn(0x7f750c073090 msgr2=0x7f750c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- 172.21.15.37:0/946714575 shutdown_connections 2023-07-09T21:39:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- 172.21.15.37:0/946714575 wait complete. 2023-07-09T21:39:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 Processor -- start 2023-07-09T21:39:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.154+0000 7f75115db640 1 -- start start 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0b4340 0x7f750c15e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f750c0b7ab0 0x7f750c150220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c0b2540 con 0x7f750c0cef80 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f750c150760 con 0x7f750c0b7ab0 2023-07-09T21:39:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750c14dbc0 con 0x7f750c0b4340 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52600/0 (socket says 172.21.15.37:52600) 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 -- 172.21.15.37:0/4205628348 learned_addr learned my addr 172.21.15.37:0/4205628348 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f7503fff640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f750c0b7ab0 0x7f750c150220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750affd640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0b4340 0x7f750c15e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 -- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0b4340 msgr2=0x7f750c15e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0b4340 0x7f750c15e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 -- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f750c0b7ab0 msgr2=0x7f750c150220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f750c0b7ab0 0x7f750c150220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 -- 172.21.15.37:0/4205628348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f40094d0 con 0x7f750c0cef80 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f750b7fe640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7504009fd0 tx=0x7f750400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504014420 con 0x7f750c0cef80 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7504014580 con 0x7f750c0cef80 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504014930 con 0x7f750c0cef80 2023-07-09T21:39:07.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f750c150950 con 0x7f750c0cef80 2023-07-09T21:39:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f750c150f10 con 0x7f750c0cef80 2023-07-09T21:39:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750c04d7d0 con 0x7f750c0cef80 2023-07-09T21:39:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.158+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7504014a90 con 0x7f750c0cef80 2023-07-09T21:39:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.162+0000 7f75037fe640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.162+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7504084670 con 0x7f750c0cef80 2023-07-09T21:39:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.162+0000 7f750affd640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.162+0000 7f750affd640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 0x7f74ec068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007fd0 tx=0x7f74fc007e40 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.166+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7504055510 con 0x7f750c0cef80 2023-07-09T21:39:07.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.318+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f750c0cf4d0 con 0x7f74ec0663a0 2023-07-09T21:39:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.326+0000 7f75037fe640 1 -- 172.21.15.37:0/4205628348 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306256 (secure 0 0 0) 0x7f74fc004c00 con 0x7f74ec0663a0 2023-07-09T21:39:07.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 msgr2=0x7f74ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 0x7f74ec068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f74fc007fd0 tx=0x7f74fc007e40 comp rx=0 tx=0).stop 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 msgr2=0x7f750c14d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f7504009fd0 tx=0x7f750400e4b0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 shutdown_connections 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f74ec0663a0 0x7f74ec068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f750c0cef80 0x7f750c14d680 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f750c0b7ab0 0x7f750c150220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 --2- 172.21.15.37:0/4205628348 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f750c0b4340 0x7f750c15e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 >> 172.21.15.37:0/4205628348 conn(0x7f750c073090 msgr2=0x7f750c158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 shutdown_connections 2023-07-09T21:39:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.330+0000 7f75115db640 1 -- 172.21.15.37:0/4205628348 wait complete. 2023-07-09T21:39:07.354 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:06.878578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329272,"kb_used_data":10360,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754645448,"statfs":{"total":773094113280,"available":772756938752,"internally_reserved":0,"allocated":10608640,"data_stored":5910296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673293"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225355+0000","last_change":"2023-07-09T21:39:02.225355+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225355+0000","last_undegraded":"2023-07-09T21:39:02.225355+0000","last_fullsized":"2023-07-09T21:39:02.225355+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222371+0000","last_change":"2023-07-09T21:39:02.222371+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222371+0000","last_undegraded":"2023-07-09T21:39:02.222371+0000","last_fullsized":"2023-07-09T21:39:02.222371+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211006+0000","last_change":"2023-07-09T21:39:02.211006+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211006+0000","last_undegraded":"2023-07-09T21:39:02.211006+0000","last_fullsized":"2023-07-09T21:39:02.211006+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223256+0000","last_change":"2023-07-09T21:39:02.223256+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223256+0000","last_undegraded":"2023-07-09T21:39:02.223256+0000","last_fullsized":"2023-07-09T21:39:02.223256+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213869+0000","last_change":"2023-07-09T21:39:02.213869+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213869+0000","last_undegraded":"2023-07-09T21:39:02.213869+0000","last_fullsized":"2023-07-09T21:39:02.213869+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215142+0000","last_change":"2023-07-09T21:39:02.215142+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215142+0000","last_undegraded":"2023-07-09T21:39:02.215142+0000","last_fullsized":"2023-07-09T21:39:02.215142+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219594+0000","last_change":"2023-07-09T21:39:02.219594+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219594+0000","last_undegraded":"2023-07-09T21:39:02.219594+0000","last_fullsized":"2023-07-09T21:39:02.219594+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213557+0000","last_change":"2023-07-09T21:39:02.213557+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213557+0000","last_undegraded":"2023-07-09T21:39:02.213557+0000","last_fullsized":"2023-07-09T21:39:02.213557+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219650+0000","last_change":"2023-07-09T21:39:02.219650+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219650+0000","last_undegraded":"2023-07-09T21:39:02.219650+0000","last_fullsized":"2023-07-09T21:39:02.219650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223620+0000","last_change":"2023-07-09T21:39:02.223620+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223620+0000","last_undegraded":"2023-07-09T21:39:02.223620+0000","last_fullsized":"2023-07-09T21:39:02.223620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221732+0000","last_change":"2023-07-09T21:39:02.221732+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221732+0000","last_undegraded":"2023-07-09T21:39:02.221732+0000","last_fullsized":"2023-07-09T21:39:02.221732+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222788+0000","last_change":"2023-07-09T21:39:02.222788+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222788+0000","last_undegraded":"2023-07-09T21:39:02.222788+0000","last_fullsized":"2023-07-09T21:39:02.222788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213354+0000","last_change":"2023-07-09T21:39:02.213354+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213354+0000","last_undegraded":"2023-07-09T21:39:02.213354+0000","last_fullsized":"2023-07-09T21:39:02.213354+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214696+0000","last_change":"2023-07-09T21:39:02.214696+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214696+0000","last_undegraded":"2023-07-09T21:39:02.214696+0000","last_fullsized":"2023-07-09T21:39:02.214696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221615+0000","last_change":"2023-07-09T21:39:02.221615+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221615+0000","last_undegraded":"2023-07-09T21:39:02.221615+0000","last_fullsized":"2023-07-09T21:39:02.221615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.227141+0000","last_change":"2023-07-09T21:39:02.227141+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.227141+0000","last_undegraded":"2023-07-09T21:39:02.227141+0000","last_fullsized":"2023-07-09T21:39:02.227141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215426+0000","last_change":"2023-07-09T21:39:02.215426+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215426+0000","last_undegraded":"2023-07-09T21:39:02.215426+0000","last_fullsized":"2023-07-09T21:39:02.215426+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211335+0000","last_change":"2023-07-09T21:39:02.211335+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211335+0000","last_undegraded":"2023-07-09T21:39:02.211335+0000","last_fullsized":"2023-07-09T21:39:02.211335+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213617+0000","last_change":"2023-07-09T21:39:02.213617+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213617+0000","last_undegraded":"2023-07-09T21:39:02.213617+0000","last_fullsized":"2023-07-09T21:39:02.213617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213931+0000","last_change":"2023-07-09T21:39:02.213931+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213931+0000","last_undegraded":"2023-07-09T21:39:02.213931+0000","last_fullsized":"2023-07-09T21:39:02.213931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222060+0000","last_change":"2023-07-09T21:39:02.222060+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222060+0000","last_undegraded":"2023-07-09T21:39:02.222060+0000","last_fullsized":"2023-07-09T21:39:02.222060+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217408+0000","last_change":"2023-07-09T21:39:02.217408+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217408+0000","last_undegraded":"2023-07-09T21:39:02.217408+0000","last_fullsized":"2023-07-09T21:39:02.217408+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218958+0000","last_change":"2023-07-09T21:39:02.218958+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218958+0000","last_undegraded":"2023-07-09T21:39:02.218958+0000","last_fullsized":"2023-07-09T21:39:02.218958+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221232+0000","last_change":"2023-07-09T21:39:02.221232+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221232+0000","last_undegraded":"2023-07-09T21:39:02.221232+0000","last_fullsized":"2023-07-09T21:39:02.221232+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221130+0000","last_change":"2023-07-09T21:39:02.221130+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221130+0000","last_undegraded":"2023-07-09T21:39:02.221130+0000","last_fullsized":"2023-07-09T21:39:02.221130+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223054+0000","last_change":"2023-07-09T21:39:02.223054+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223054+0000","last_undegraded":"2023-07-09T21:39:02.223054+0000","last_fullsized":"2023-07-09T21:39:02.223054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.228433+0000","last_change":"2023-07-09T21:39:02.228433+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.228433+0000","last_undegraded":"2023-07-09T21:39:02.228433+0000","last_fullsized":"2023-07-09T21:39:02.228433+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213388+0000","last_change":"2023-07-09T21:39:02.213388+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213388+0000","last_undegraded":"2023-07-09T21:39:02.213388+0000","last_fullsized":"2023-07-09T21:39:02.213388+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221220+0000","last_change":"2023-07-09T21:39:02.221220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221220+0000","last_undegraded":"2023-07-09T21:39:02.221220+0000","last_fullsized":"2023-07-09T21:39:02.221220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223021+0000","last_change":"2023-07-09T21:39:02.223021+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223021+0000","last_undegraded":"2023-07-09T21:39:02.223021+0000","last_fullsized":"2023-07-09T21:39:02.223021+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210665+0000","last_change":"2023-07-09T21:39:02.210665+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210665+0000","last_undegraded":"2023-07-09T21:39:02.210665+0000","last_fullsized":"2023-07-09T21:39:02.210665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.224303+0000","last_change":"2023-07-09T21:39:02.224303+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.224303+0000","last_undegraded":"2023-07-09T21:39:02.224303+0000","last_fullsized":"2023-07-09T21:39:02.224303+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210483+0000","last_change":"2023-07-09T21:39:02.210483+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210483+0000","last_undegraded":"2023-07-09T21:39:02.210483+0000","last_fullsized":"2023-07-09T21:39:02.210483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230805+0000","last_change":"2023-07-09T21:39:02.227658+0000","last_active":"2023-07-09T21:39:02.230805+0000","last_peered":"2023-07-09T21:39:02.230805+0000","last_clean":"2023-07-09T21:39:02.230805+0000","last_became_active":"2023-07-09T21:39:02.227277+0000","last_became_peered":"2023-07-09T21:39:02.227277+0000","last_unstale":"2023-07-09T21:39:02.230805+0000","last_undegraded":"2023-07-09T21:39:02.230805+0000","last_fullsized":"2023-07-09T21:39:02.230805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:47.586765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214334+0000","last_change":"2023-07-09T21:39:02.214334+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214334+0000","last_undegraded":"2023-07-09T21:39:02.214334+0000","last_fullsized":"2023-07-09T21:39:02.214334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.241026+0000","last_change":"2023-07-09T21:39:02.237998+0000","last_active":"2023-07-09T21:39:02.241026+0000","last_peered":"2023-07-09T21:39:02.241026+0000","last_clean":"2023-07-09T21:39:02.241026+0000","last_became_active":"2023-07-09T21:39:02.237705+0000","last_became_peered":"2023-07-09T21:39:02.237705+0000","last_unstale":"2023-07-09T21:39:02.241026+0000","last_undegraded":"2023-07-09T21:39:02.241026+0000","last_fullsized":"2023-07-09T21:39:02.241026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:18.622881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217981+0000","last_change":"2023-07-09T21:39:02.217981+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217981+0000","last_undegraded":"2023-07-09T21:39:02.217981+0000","last_fullsized":"2023-07-09T21:39:02.217981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240562+0000","last_change":"2023-07-09T21:39:02.236776+0000","last_active":"2023-07-09T21:39:02.240562+0000","last_peered":"2023-07-09T21:39:02.240562+0000","last_clean":"2023-07-09T21:39:02.240562+0000","last_became_active":"2023-07-09T21:39:02.236505+0000","last_became_peered":"2023-07-09T21:39:02.236505+0000","last_unstale":"2023-07-09T21:39:02.240562+0000","last_undegraded":"2023-07-09T21:39:02.240562+0000","last_fullsized":"2023-07-09T21:39:02.240562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:27.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221562+0000","last_change":"2023-07-09T21:39:02.221562+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221562+0000","last_undegraded":"2023-07-09T21:39:02.221562+0000","last_fullsized":"2023-07-09T21:39:02.221562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237176+0000","last_change":"2023-07-09T21:39:02.235294+0000","last_active":"2023-07-09T21:39:02.237176+0000","last_peered":"2023-07-09T21:39:02.237176+0000","last_clean":"2023-07-09T21:39:02.237176+0000","last_became_active":"2023-07-09T21:39:02.234886+0000","last_became_peered":"2023-07-09T21:39:02.234886+0000","last_unstale":"2023-07-09T21:39:02.237176+0000","last_undegraded":"2023-07-09T21:39:02.237176+0000","last_fullsized":"2023-07-09T21:39:02.237176+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214704+0000","last_change":"2023-07-09T21:39:02.214704+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214704+0000","last_undegraded":"2023-07-09T21:39:02.214704+0000","last_fullsized":"2023-07-09T21:39:02.214704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236705+0000","last_change":"2023-07-09T21:39:02.232585+0000","last_active":"2023-07-09T21:39:02.236705+0000","last_peered":"2023-07-09T21:39:02.236705+0000","last_clean":"2023-07-09T21:39:02.236705+0000","last_became_active":"2023-07-09T21:39:02.232315+0000","last_became_peered":"2023-07-09T21:39:02.232315+0000","last_unstale":"2023-07-09T21:39:02.236705+0000","last_undegraded":"2023-07-09T21:39:02.236705+0000","last_fullsized":"2023-07-09T21:39:02.236705+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219127+0000","last_change":"2023-07-09T21:39:02.219127+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219127+0000","last_undegraded":"2023-07-09T21:39:02.219127+0000","last_fullsized":"2023-07-09T21:39:02.219127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235874+0000","last_change":"2023-07-09T21:39:02.235039+0000","last_active":"2023-07-09T21:39:02.235874+0000","last_peered":"2023-07-09T21:39:02.235874+0000","last_clean":"2023-07-09T21:39:02.235874+0000","last_became_active":"2023-07-09T21:39:02.234707+0000","last_became_peered":"2023-07-09T21:39:02.234707+0000","last_unstale":"2023-07-09T21:39:02.235874+0000","last_undegraded":"2023-07-09T21:39:02.235874+0000","last_fullsized":"2023-07-09T21:39:02.235874+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:12.185073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218267+0000","last_change":"2023-07-09T21:39:02.218267+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218267+0000","last_undegraded":"2023-07-09T21:39:02.218267+0000","last_fullsized":"2023-07-09T21:39:02.218267+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229966+0000","last_change":"2023-07-09T21:39:02.228791+0000","last_active":"2023-07-09T21:39:02.229966+0000","last_peered":"2023-07-09T21:39:02.229966+0000","last_clean":"2023-07-09T21:39:02.229966+0000","last_became_active":"2023-07-09T21:39:02.228459+0000","last_became_peered":"2023-07-09T21:39:02.228459+0000","last_unstale":"2023-07-09T21:39:02.229966+0000","last_undegraded":"2023-07-09T21:39:02.229966+0000","last_fullsized":"2023-07-09T21:39:02.229966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:43.097772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218261+0000","last_change":"2023-07-09T21:39:02.218261+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218261+0000","last_undegraded":"2023-07-09T21:39:02.218261+0000","last_fullsized":"2023-07-09T21:39:02.218261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224698+0000","last_change":"2023-07-09T21:39:02.222966+0000","last_active":"2023-07-09T21:39:02.224698+0000","last_peered":"2023-07-09T21:39:02.224698+0000","last_clean":"2023-07-09T21:39:02.224698+0000","last_became_active":"2023-07-09T21:39:02.222697+0000","last_became_peered":"2023-07-09T21:39:02.222697+0000","last_unstale":"2023-07-09T21:39:02.224698+0000","last_undegraded":"2023-07-09T21:39:02.224698+0000","last_fullsized":"2023-07-09T21:39:02.224698+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:55:47.534660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216008+0000","last_change":"2023-07-09T21:39:02.216008+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216008+0000","last_undegraded":"2023-07-09T21:39:02.216008+0000","last_fullsized":"2023-07-09T21:39:02.216008+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236603+0000","last_change":"2023-07-09T21:39:02.233072+0000","last_active":"2023-07-09T21:39:02.236603+0000","last_peered":"2023-07-09T21:39:02.236603+0000","last_clean":"2023-07-09T21:39:02.236603+0000","last_became_active":"2023-07-09T21:39:02.232634+0000","last_became_peered":"2023-07-09T21:39:02.232634+0000","last_unstale":"2023-07-09T21:39:02.236603+0000","last_undegraded":"2023-07-09T21:39:02.236603+0000","last_fullsized":"2023-07-09T21:39:02.236603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:49:21.955063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221923+0000","last_change":"2023-07-09T21:39:02.221923+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221923+0000","last_undegraded":"2023-07-09T21:39:02.221923+0000","last_fullsized":"2023-07-09T21:39:02.221923+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.233430+0000","last_change":"2023-07-09T21:39:02.231456+0000","last_active":"2023-07-09T21:39:02.233430+0000","last_peered":"2023-07-09T21:39:02.233430+0000","last_clean":"2023-07-09T21:39:02.233430+0000","last_became_active":"2023-07-09T21:39:02.231159+0000","last_became_peered":"2023-07-09T21:39:02.231159+0000","last_unstale":"2023-07-09T21:39:02.233430+0000","last_undegraded":"2023-07-09T21:39:02.233430+0000","last_fullsized":"2023-07-09T21:39:02.233430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:37.647171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214233+0000","last_change":"2023-07-09T21:39:02.214233+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214233+0000","last_undegraded":"2023-07-09T21:39:02.214233+0000","last_fullsized":"2023-07-09T21:39:02.214233+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.225404+0000","last_change":"2023-07-09T21:39:02.222461+0000","last_active":"2023-07-09T21:39:02.225404+0000","last_peered":"2023-07-09T21:39:02.225404+0000","last_clean":"2023-07-09T21:39:02.225404+0000","last_became_active":"2023-07-09T21:39:02.222198+0000","last_became_peered":"2023-07-09T21:39:02.222198+0000","last_unstale":"2023-07-09T21:39:02.225404+0000","last_undegraded":"2023-07-09T21:39:02.225404+0000","last_fullsized":"2023-07-09T21:39:02.225404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:20.153832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211800+0000","last_change":"2023-07-09T21:39:02.211800+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211800+0000","last_undegraded":"2023-07-09T21:39:02.211800+0000","last_fullsized":"2023-07-09T21:39:02.211800+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231766+0000","last_change":"2023-07-09T21:39:02.228316+0000","last_active":"2023-07-09T21:39:02.231766+0000","last_peered":"2023-07-09T21:39:02.231766+0000","last_clean":"2023-07-09T21:39:02.231766+0000","last_became_active":"2023-07-09T21:39:02.226731+0000","last_became_peered":"2023-07-09T21:39:02.226731+0000","last_unstale":"2023-07-09T21:39:02.231766+0000","last_undegraded":"2023-07-09T21:39:02.231766+0000","last_fullsized":"2023-07-09T21:39:02.231766+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:40.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222234+0000","last_change":"2023-07-09T21:39:02.222234+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222234+0000","last_undegraded":"2023-07-09T21:39:02.222234+0000","last_fullsized":"2023-07-09T21:39:02.222234+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.232021+0000","last_change":"2023-07-09T21:39:02.228630+0000","last_active":"2023-07-09T21:39:02.232021+0000","last_peered":"2023-07-09T21:39:02.232021+0000","last_clean":"2023-07-09T21:39:02.232021+0000","last_became_active":"2023-07-09T21:39:02.228368+0000","last_became_peered":"2023-07-09T21:39:02.228368+0000","last_unstale":"2023-07-09T21:39:02.232021+0000","last_undegraded":"2023-07-09T21:39:02.232021+0000","last_fullsized":"2023-07-09T21:39:02.232021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:09.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216779+0000","last_change":"2023-07-09T21:39:02.216779+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216779+0000","last_undegraded":"2023-07-09T21:39:02.216779+0000","last_fullsized":"2023-07-09T21:39:02.216779+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234860+0000","last_change":"2023-07-09T21:39:02.230899+0000","last_active":"2023-07-09T21:39:02.234860+0000","last_peered":"2023-07-09T21:39:02.234860+0000","last_clean":"2023-07-09T21:39:02.234860+0000","last_became_active":"2023-07-09T21:39:02.230633+0000","last_became_peered":"2023-07-09T21:39:02.230633+0000","last_unstale":"2023-07-09T21:39:02.234860+0000","last_undegraded":"2023-07-09T21:39:02.234860+0000","last_fullsized":"2023-07-09T21:39:02.234860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:45.796213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216717+0000","last_change":"2023-07-09T21:39:02.216717+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216717+0000","last_undegraded":"2023-07-09T21:39:02.216717+0000","last_fullsized":"2023-07-09T21:39:02.216717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230794+0000","last_change":"2023-07-09T21:39:02.227440+0000","last_active":"2023-07-09T21:39:02.230794+0000","last_peered":"2023-07-09T21:39:02.230794+0000","last_clean":"2023-07-09T21:39:02.230794+0000","last_became_active":"2023-07-09T21:39:02.226934+0000","last_became_peered":"2023-07-09T21:39:02.226934+0000","last_unstale":"2023-07-09T21:39:02.230794+0000","last_undegraded":"2023-07-09T21:39:02.230794+0000","last_fullsized":"2023-07-09T21:39:02.230794+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:05.113406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217839+0000","last_change":"2023-07-09T21:39:02.217839+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217839+0000","last_undegraded":"2023-07-09T21:39:02.217839+0000","last_fullsized":"2023-07-09T21:39:02.217839+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227247+0000","last_change":"2023-07-09T21:39:02.224832+0000","last_active":"2023-07-09T21:39:02.227247+0000","last_peered":"2023-07-09T21:39:02.227247+0000","last_clean":"2023-07-09T21:39:02.227247+0000","last_became_active":"2023-07-09T21:39:02.224573+0000","last_became_peered":"2023-07-09T21:39:02.224573+0000","last_unstale":"2023-07-09T21:39:02.227247+0000","last_undegraded":"2023-07-09T21:39:02.227247+0000","last_fullsized":"2023-07-09T21:39:02.227247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:20.098183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218499+0000","last_change":"2023-07-09T21:39:02.218499+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218499+0000","last_undegraded":"2023-07-09T21:39:02.218499+0000","last_fullsized":"2023-07-09T21:39:02.218499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230618+0000","last_change":"2023-07-09T21:39:02.227857+0000","last_active":"2023-07-09T21:39:02.230618+0000","last_peered":"2023-07-09T21:39:02.230618+0000","last_clean":"2023-07-09T21:39:02.230618+0000","last_became_active":"2023-07-09T21:39:02.227555+0000","last_became_peered":"2023-07-09T21:39:02.227555+0000","last_unstale":"2023-07-09T21:39:02.230618+0000","last_undegraded":"2023-07-09T21:39:02.230618+0000","last_fullsized":"2023-07-09T21:39:02.230618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:31.134106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219059+0000","last_change":"2023-07-09T21:39:02.219059+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219059+0000","last_undegraded":"2023-07-09T21:39:02.219059+0000","last_fullsized":"2023-07-09T21:39:02.219059+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229624+0000","last_change":"2023-07-09T21:39:02.226076+0000","last_active":"2023-07-09T21:39:02.229624+0000","last_peered":"2023-07-09T21:39:02.229624+0000","last_clean":"2023-07-09T21:39:02.229624+0000","last_became_active":"2023-07-09T21:39:02.225796+0000","last_became_peered":"2023-07-09T21:39:02.225796+0000","last_unstale":"2023-07-09T21:39:02.229624+0000","last_undegraded":"2023-07-09T21:39:02.229624+0000","last_fullsized":"2023-07-09T21:39:02.229624+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:06.522078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217413+0000","last_change":"2023-07-09T21:39:02.217413+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217413+0000","last_undegraded":"2023-07-09T21:39:02.217413+0000","last_fullsized":"2023-07-09T21:39:02.217413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237956+0000","last_change":"2023-07-09T21:39:02.235989+0000","last_active":"2023-07-09T21:39:02.237956+0000","last_peered":"2023-07-09T21:39:02.237956+0000","last_clean":"2023-07-09T21:39:02.237956+0000","last_became_active":"2023-07-09T21:39:02.235703+0000","last_became_peered":"2023-07-09T21:39:02.235703+0000","last_unstale":"2023-07-09T21:39:02.237956+0000","last_undegraded":"2023-07-09T21:39:02.237956+0000","last_fullsized":"2023-07-09T21:39:02.237956+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:12.356937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215180+0000","last_change":"2023-07-09T21:39:02.215180+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215180+0000","last_undegraded":"2023-07-09T21:39:02.215180+0000","last_fullsized":"2023-07-09T21:39:02.215180+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236636+0000","last_change":"2023-07-09T21:39:02.232727+0000","last_active":"2023-07-09T21:39:02.236636+0000","last_peered":"2023-07-09T21:39:02.236636+0000","last_clean":"2023-07-09T21:39:02.236636+0000","last_became_active":"2023-07-09T21:39:02.232459+0000","last_became_peered":"2023-07-09T21:39:02.232459+0000","last_unstale":"2023-07-09T21:39:02.236636+0000","last_undegraded":"2023-07-09T21:39:02.236636+0000","last_fullsized":"2023-07-09T21:39:02.236636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:15.384722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218064+0000","last_change":"2023-07-09T21:39:02.218064+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218064+0000","last_undegraded":"2023-07-09T21:39:02.218064+0000","last_fullsized":"2023-07-09T21:39:02.218064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235815+0000","last_change":"2023-07-09T21:39:02.233872+0000","last_active":"2023-07-09T21:39:02.235815+0000","last_peered":"2023-07-09T21:39:02.235815+0000","last_clean":"2023-07-09T21:39:02.235815+0000","last_became_active":"2023-07-09T21:39:02.233572+0000","last_became_peered":"2023-07-09T21:39:02.233572+0000","last_unstale":"2023-07-09T21:39:02.235815+0000","last_undegraded":"2023-07-09T21:39:02.235815+0000","last_fullsized":"2023-07-09T21:39:02.235815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:34.202866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216197+0000","last_change":"2023-07-09T21:39:02.216197+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216197+0000","last_undegraded":"2023-07-09T21:39:02.216197+0000","last_fullsized":"2023-07-09T21:39:02.216197+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230774+0000","last_change":"2023-07-09T21:39:02.227372+0000","last_active":"2023-07-09T21:39:02.230774+0000","last_peered":"2023-07-09T21:39:02.230774+0000","last_clean":"2023-07-09T21:39:02.230774+0000","last_became_active":"2023-07-09T21:39:02.226984+0000","last_became_peered":"2023-07-09T21:39:02.226984+0000","last_unstale":"2023-07-09T21:39:02.230774+0000","last_undegraded":"2023-07-09T21:39:02.230774+0000","last_fullsized":"2023-07-09T21:39:02.230774+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:43.210469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210842+0000","last_change":"2023-07-09T21:39:02.210842+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210842+0000","last_undegraded":"2023-07-09T21:39:02.210842+0000","last_fullsized":"2023-07-09T21:39:02.210842+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234068+0000","last_change":"2023-07-09T21:39:02.231774+0000","last_active":"2023-07-09T21:39:02.234068+0000","last_peered":"2023-07-09T21:39:02.234068+0000","last_clean":"2023-07-09T21:39:02.234068+0000","last_became_active":"2023-07-09T21:39:02.231437+0000","last_became_peered":"2023-07-09T21:39:02.231437+0000","last_unstale":"2023-07-09T21:39:02.234068+0000","last_undegraded":"2023-07-09T21:39:02.234068+0000","last_fullsized":"2023-07-09T21:39:02.234068+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:13.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210300+0000","last_change":"2023-07-09T21:39:02.210300+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210300+0000","last_undegraded":"2023-07-09T21:39:02.210300+0000","last_fullsized":"2023-07-09T21:39:02.210300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.222092+0000","last_change":"2023-07-09T21:39:02.220149+0000","last_active":"2023-07-09T21:39:02.222092+0000","last_peered":"2023-07-09T21:39:02.222092+0000","last_clean":"2023-07-09T21:39:02.222092+0000","last_became_active":"2023-07-09T21:39:02.219868+0000","last_became_peered":"2023-07-09T21:39:02.219868+0000","last_unstale":"2023-07-09T21:39:02.222092+0000","last_undegraded":"2023-07-09T21:39:02.222092+0000","last_fullsized":"2023-07-09T21:39:02.222092+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:50.960195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225043+0000","last_change":"2023-07-09T21:39:02.225043+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225043+0000","last_undegraded":"2023-07-09T21:39:02.225043+0000","last_fullsized":"2023-07-09T21:39:02.225043+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227953+0000","last_change":"2023-07-09T21:39:02.225583+0000","last_active":"2023-07-09T21:39:02.227953+0000","last_peered":"2023-07-09T21:39:02.227953+0000","last_clean":"2023-07-09T21:39:02.227953+0000","last_became_active":"2023-07-09T21:39:02.225277+0000","last_became_peered":"2023-07-09T21:39:02.225277+0000","last_unstale":"2023-07-09T21:39:02.227953+0000","last_undegraded":"2023-07-09T21:39:02.227953+0000","last_fullsized":"2023-07-09T21:39:02.227953+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:08.336460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"87'183","reported_seq":545,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227613+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:02.227613+0000","last_peered":"2023-07-09T21:39:02.227613+0000","last_clean":"2023-07-09T21:39:02.227613+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:02.227613+0000","last_undegraded":"2023-07-09T21:39:02.227613+0000","last_fullsized":"2023-07-09T21:39:02.227613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:23:25.605320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224490+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:02.224490+0000","last_peered":"2023-07-09T21:39:02.224490+0000","last_clean":"2023-07-09T21:39:02.224490+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:02.224490+0000","last_undegraded":"2023-07-09T21:39:02.224490+0000","last_fullsized":"2023-07-09T21:39:02.224490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:09.851052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216086+0000","last_change":"2023-07-09T21:39:02.216086+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216086+0000","last_undegraded":"2023-07-09T21:39:02.216086+0000","last_fullsized":"2023-07-09T21:39:02.216086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229663+0000","last_change":"2023-07-09T21:39:02.226362+0000","last_active":"2023-07-09T21:39:02.229663+0000","last_peered":"2023-07-09T21:39:02.229663+0000","last_clean":"2023-07-09T21:39:02.229663+0000","last_became_active":"2023-07-09T21:39:02.225863+0000","last_became_peered":"2023-07-09T21:39:02.225863+0000","last_unstale":"2023-07-09T21:39:02.229663+0000","last_undegraded":"2023-07-09T21:39:02.229663+0000","last_fullsized":"2023-07-09T21:39:02.229663+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:30.581274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227483+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:02.227483+0000","last_peered":"2023-07-09T21:39:02.227483+0000","last_clean":"2023-07-09T21:39:02.227483+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:02.227483+0000","last_undegraded":"2023-07-09T21:39:02.227483+0000","last_fullsized":"2023-07-09T21:39:02.227483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:19.445522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217305+0000","last_change":"2023-07-09T21:39:02.217305+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217305+0000","last_undegraded":"2023-07-09T21:39:02.217305+0000","last_fullsized":"2023-07-09T21:39:02.217305+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228135+0000","last_change":"2023-07-09T21:39:02.225573+0000","last_active":"2023-07-09T21:39:02.228135+0000","last_peered":"2023-07-09T21:39:02.228135+0000","last_clean":"2023-07-09T21:39:02.228135+0000","last_became_active":"2023-07-09T21:39:02.225239+0000","last_became_peered":"2023-07-09T21:39:02.225239+0000","last_unstale":"2023-07-09T21:39:02.228135+0000","last_undegraded":"2023-07-09T21:39:02.228135+0000","last_fullsized":"2023-07-09T21:39:02.228135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:20.466091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.209801+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:02.209801+0000","last_peered":"2023-07-09T21:39:02.209801+0000","last_clean":"2023-07-09T21:39:02.209801+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:02.209801+0000","last_undegraded":"2023-07-09T21:39:02.209801+0000","last_fullsized":"2023-07-09T21:39:02.209801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:31.653817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214220+0000","last_change":"2023-07-09T21:39:02.214220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214220+0000","last_undegraded":"2023-07-09T21:39:02.214220+0000","last_fullsized":"2023-07-09T21:39:02.214220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228100+0000","last_change":"2023-07-09T21:39:02.218979+0000","last_active":"2023-07-09T21:39:02.228100+0000","last_peered":"2023-07-09T21:39:02.228100+0000","last_clean":"2023-07-09T21:39:02.228100+0000","last_became_active":"2023-07-09T21:39:02.218641+0000","last_became_peered":"2023-07-09T21:39:02.218641+0000","last_unstale":"2023-07-09T21:39:02.228100+0000","last_undegraded":"2023-07-09T21:39:02.228100+0000","last_fullsized":"2023-07-09T21:39:02.228100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:31.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224665+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:02.224665+0000","last_peered":"2023-07-09T21:39:02.224665+0000","last_clean":"2023-07-09T21:39:02.224665+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:02.224665+0000","last_undegraded":"2023-07-09T21:39:02.224665+0000","last_fullsized":"2023-07-09T21:39:02.224665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.581480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216864+0000","last_change":"2023-07-09T21:39:02.216864+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216864+0000","last_undegraded":"2023-07-09T21:39:02.216864+0000","last_fullsized":"2023-07-09T21:39:02.216864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227285+0000","last_change":"2023-07-09T21:39:02.226536+0000","last_active":"2023-07-09T21:39:02.227285+0000","last_peered":"2023-07-09T21:39:02.227285+0000","last_clean":"2023-07-09T21:39:02.227285+0000","last_became_active":"2023-07-09T21:39:02.226268+0000","last_became_peered":"2023-07-09T21:39:02.226268+0000","last_unstale":"2023-07-09T21:39:02.227285+0000","last_undegraded":"2023-07-09T21:39:02.227285+0000","last_fullsized":"2023-07-09T21:39:02.227285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:50.476167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211482+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:02.211482+0000","last_peered":"2023-07-09T21:39:02.211482+0000","last_clean":"2023-07-09T21:39:02.211482+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:02.211482+0000","last_undegraded":"2023-07-09T21:39:02.211482+0000","last_fullsized":"2023-07-09T21:39:02.211482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213902+0000","last_change":"2023-07-09T21:39:02.213902+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213902+0000","last_undegraded":"2023-07-09T21:39:02.213902+0000","last_fullsized":"2023-07-09T21:39:02.213902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.226660+0000","last_change":"2023-07-09T21:39:02.224587+0000","last_active":"2023-07-09T21:39:02.226660+0000","last_peered":"2023-07-09T21:39:02.226660+0000","last_clean":"2023-07-09T21:39:02.226660+0000","last_became_active":"2023-07-09T21:39:02.224283+0000","last_became_peered":"2023-07-09T21:39:02.224283+0000","last_unstale":"2023-07-09T21:39:02.226660+0000","last_undegraded":"2023-07-09T21:39:02.226660+0000","last_fullsized":"2023-07-09T21:39:02.226660+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:16:34.525255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230529+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:02.230529+0000","last_peered":"2023-07-09T21:39:02.230529+0000","last_clean":"2023-07-09T21:39:02.230529+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:02.230529+0000","last_undegraded":"2023-07-09T21:39:02.230529+0000","last_fullsized":"2023-07-09T21:39:02.230529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:44.509992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216570+0000","last_change":"2023-07-09T21:39:02.216570+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216570+0000","last_undegraded":"2023-07-09T21:39:02.216570+0000","last_fullsized":"2023-07-09T21:39:02.216570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240541+0000","last_change":"2023-07-09T21:39:02.236493+0000","last_active":"2023-07-09T21:39:02.240541+0000","last_peered":"2023-07-09T21:39:02.240541+0000","last_clean":"2023-07-09T21:39:02.240541+0000","last_became_active":"2023-07-09T21:39:02.236157+0000","last_became_peered":"2023-07-09T21:39:02.236157+0000","last_unstale":"2023-07-09T21:39:02.240541+0000","last_undegraded":"2023-07-09T21:39:02.240541+0000","last_fullsized":"2023-07-09T21:39:02.240541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:50.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211581+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:02.211581+0000","last_peered":"2023-07-09T21:39:02.211581+0000","last_clean":"2023-07-09T21:39:02.211581+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:02.211581+0000","last_undegraded":"2023-07-09T21:39:02.211581+0000","last_fullsized":"2023-07-09T21:39:02.211581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:48.896201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215876+0000","last_change":"2023-07-09T21:39:02.215876+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215876+0000","last_undegraded":"2023-07-09T21:39:02.215876+0000","last_fullsized":"2023-07-09T21:39:02.215876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231908+0000","last_change":"2023-07-09T21:39:02.228812+0000","last_active":"2023-07-09T21:39:02.231908+0000","last_peered":"2023-07-09T21:39:02.231908+0000","last_clean":"2023-07-09T21:39:02.231908+0000","last_became_active":"2023-07-09T21:39:02.228542+0000","last_became_peered":"2023-07-09T21:39:02.228542+0000","last_unstale":"2023-07-09T21:39:02.231908+0000","last_undegraded":"2023-07-09T21:39:02.231908+0000","last_fullsized":"2023-07-09T21:39:02.231908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:58:03.631954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.217087+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:02.217087+0000","last_peered":"2023-07-09T21:39:02.217087+0000","last_clean":"2023-07-09T21:39:02.217087+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:02.217087+0000","last_undegraded":"2023-07-09T21:39:02.217087+0000","last_fullsized":"2023-07-09T21:39:02.217087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:27.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59024,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312816,"statfs":{"total":96636764160,"available":96576323584,"internally_reserved":0,"allocated":1777664,"data_stored":1184877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.93400000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.75}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.876},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.86599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.751},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.502}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.81200000000000006}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.503}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.748}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54336,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317504,"statfs":{"total":96636764160,"available":96581124096,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.442},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":1178249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.87}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.90500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.089},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.92700000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.115},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.81799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:07.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:07.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 Processor -- start 2023-07-09T21:39:07.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 -- start start 2023-07-09T21:39:07.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300b4340 0x7f433006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43300cef80 0x7f43300d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43300b49f0 con 0x7f43300b7ab0 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43300b7e80 con 0x7f43300cef80 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f4335f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300cc8a0 con 0x7f43300b4340 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43300b7ab0 0x7f43300b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39032/0 (socket says 172.21.15.37:39032) 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432f7fe640 1 -- 172.21.15.37:0/1595428055 learned_addr learned my addr 172.21.15.37:0/1595428055 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:07.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432ffff640 1 --2- 172.21.15.37:0/1595428055 >> v2:172.21.15.37:3300/0 conn(0x7f43300cef80 0x7f43300d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432effd640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300b4340 0x7f433006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432e7fc640 1 -- 172.21.15.37:0/1595428055 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172443250 0 0) 0x7f43300b49f0 con 0x7f43300b7ab0 2023-07-09T21:39:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432e7fc640 1 -- 172.21.15.37:0/1595428055 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4318003530 con 0x7f43300b7ab0 2023-07-09T21:39:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432ffff640 1 -- 172.21.15.37:0/1595428055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300b4340 msgr2=0x7f433006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:07.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432ffff640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300b4340 0x7f433006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432ffff640 1 -- 172.21.15.37:0/1595428055 >> v1:172.21.15.37:6789/0 conn(0x7f43300b7ab0 legacy=0x7f43300b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.534+0000 7f432ffff640 1 -- 172.21.15.37:0/1595428055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43300ccb80 con 0x7f43300cef80 2023-07-09T21:39:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f432ffff640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300cef80 0x7f43300d02a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4328009d90 tx=0x7f432801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985d9ffd73f15f9c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f432e7fc640 1 -- 172.21.15.37:0/1595428055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280a59e0 con 0x7f43300cef80 2023-07-09T21:39:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f432e7fc640 1 -- 172.21.15.37:0/1595428055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43280a5b40 con 0x7f43300cef80 2023-07-09T21:39:07.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f432e7fc640 1 -- 172.21.15.37:0/1595428055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43280ad440 con 0x7f43300cef80 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 -- 172.21.15.37:0/1595428055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300cef80 msgr2=0x7f43300d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300cef80 0x7f43300d02a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f4328009d90 tx=0x7f432801c920 comp rx=0 tx=0).stop 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 -- 172.21.15.37:0/1595428055 shutdown_connections 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300cef80 0x7f43300d02a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 --2- 172.21.15.37:0/1595428055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300b4340 0x7f433006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 -- 172.21.15.37:0/1595428055 >> 172.21.15.37:0/1595428055 conn(0x7f4330073090 msgr2=0x7f4330069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:07.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 -- 172.21.15.37:0/1595428055 shutdown_connections 2023-07-09T21:39:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.538+0000 7f4335f40640 1 -- 172.21.15.37:0/1595428055 wait complete. 2023-07-09T21:39:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 Processor -- start 2023-07-09T21:39:07.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- start start 2023-07-09T21:39:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43300b7ab0 0x7f43300c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 0x7f43300b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c8ba0 con 0x7f43300b4340 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c7bf0 con 0x7f43300b7ab0 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43300c8340 con 0x7f43300cef80 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59492/0 (socket says 172.21.15.37:59492) 2023-07-09T21:39:07.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 -- 172.21.15.37:0/2728279681 learned_addr learned my addr 172.21.15.37:0/2728279681 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432ffff640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 0x7f43300b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432effd640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43300b7ab0 0x7f43300c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 -- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 msgr2=0x7f43300b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 0x7f43300b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 -- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43300b7ab0 msgr2=0x7f43300c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43300b7ab0 0x7f43300c76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 -- 172.21.15.37:0/2728279681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4328009a70 con 0x7f43300b4340 2023-07-09T21:39:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432ffff640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 0x7f43300b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:07.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f432f7fe640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f432000c4d0 tx=0x7f432000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320005cf0 con 0x7f43300b4340 2023-07-09T21:39:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4320005e50 con 0x7f43300b4340 2023-07-09T21:39:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43300cad70 con 0x7f43300b4340 2023-07-09T21:39:07.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320007270 con 0x7f43300b4340 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.542+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43300c88c0 con 0x7f43300b4340 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f433004d7d0 con 0x7f43300b4340 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43200073d0 con 0x7f43300b4340 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f4317fff640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 0x7f431c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f43200832b0 con 0x7f43300b4340 2023-07-09T21:39:07.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f432effd640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 0x7f431c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.546+0000 7f432effd640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 0x7f431c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43301fb4c0 tx=0x7f4324008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.550+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4320050760 con 0x7f43300b4340 2023-07-09T21:39:07.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.698+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f43300cf4d0 con 0x7f431c0663a0 2023-07-09T21:39:07.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.706+0000 7f4317fff640 1 -- 172.21.15.37:0/2728279681 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306256 (secure 0 0 0) 0x7f432400b670 con 0x7f431c0663a0 2023-07-09T21:39:07.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:07.714 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 msgr2=0x7f431c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 0x7f431c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43301fb4c0 tx=0x7f4324008040 comp rx=0 tx=0).stop 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 msgr2=0x7f433015b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f432000c4d0 tx=0x7f432000c990 comp rx=0 tx=0).stop 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 shutdown_connections 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f431c0663a0 0x7f431c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43300cef80 0x7f43300b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43300b7ab0 0x7f43300c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 --2- 172.21.15.37:0/2728279681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43300b4340 0x7f433015b030 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 >> 172.21.15.37:0/2728279681 conn(0x7f4330073090 msgr2=0x7f43300b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 shutdown_connections 2023-07-09T21:39:07.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.710+0000 7f4335f40640 1 -- 172.21.15.37:0/2728279681 wait complete. 2023-07-09T21:39:07.734 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:06.878578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329272,"kb_used_data":10360,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754645448,"statfs":{"total":773094113280,"available":772756938752,"internally_reserved":0,"allocated":10608640,"data_stored":5910296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673293"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225355+0000","last_change":"2023-07-09T21:39:02.225355+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225355+0000","last_undegraded":"2023-07-09T21:39:02.225355+0000","last_fullsized":"2023-07-09T21:39:02.225355+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222371+0000","last_change":"2023-07-09T21:39:02.222371+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222371+0000","last_undegraded":"2023-07-09T21:39:02.222371+0000","last_fullsized":"2023-07-09T21:39:02.222371+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211006+0000","last_change":"2023-07-09T21:39:02.211006+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211006+0000","last_undegraded":"2023-07-09T21:39:02.211006+0000","last_fullsized":"2023-07-09T21:39:02.211006+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223256+0000","last_change":"2023-07-09T21:39:02.223256+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223256+0000","last_undegraded":"2023-07-09T21:39:02.223256+0000","last_fullsized":"2023-07-09T21:39:02.223256+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213869+0000","last_change":"2023-07-09T21:39:02.213869+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213869+0000","last_undegraded":"2023-07-09T21:39:02.213869+0000","last_fullsized":"2023-07-09T21:39:02.213869+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215142+0000","last_change":"2023-07-09T21:39:02.215142+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215142+0000","last_undegraded":"2023-07-09T21:39:02.215142+0000","last_fullsized":"2023-07-09T21:39:02.215142+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219594+0000","last_change":"2023-07-09T21:39:02.219594+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219594+0000","last_undegraded":"2023-07-09T21:39:02.219594+0000","last_fullsized":"2023-07-09T21:39:02.219594+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213557+0000","last_change":"2023-07-09T21:39:02.213557+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213557+0000","last_undegraded":"2023-07-09T21:39:02.213557+0000","last_fullsized":"2023-07-09T21:39:02.213557+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219650+0000","last_change":"2023-07-09T21:39:02.219650+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219650+0000","last_undegraded":"2023-07-09T21:39:02.219650+0000","last_fullsized":"2023-07-09T21:39:02.219650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223620+0000","last_change":"2023-07-09T21:39:02.223620+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223620+0000","last_undegraded":"2023-07-09T21:39:02.223620+0000","last_fullsized":"2023-07-09T21:39:02.223620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221732+0000","last_change":"2023-07-09T21:39:02.221732+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221732+0000","last_undegraded":"2023-07-09T21:39:02.221732+0000","last_fullsized":"2023-07-09T21:39:02.221732+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222788+0000","last_change":"2023-07-09T21:39:02.222788+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222788+0000","last_undegraded":"2023-07-09T21:39:02.222788+0000","last_fullsized":"2023-07-09T21:39:02.222788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213354+0000","last_change":"2023-07-09T21:39:02.213354+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213354+0000","last_undegraded":"2023-07-09T21:39:02.213354+0000","last_fullsized":"2023-07-09T21:39:02.213354+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214696+0000","last_change":"2023-07-09T21:39:02.214696+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214696+0000","last_undegraded":"2023-07-09T21:39:02.214696+0000","last_fullsized":"2023-07-09T21:39:02.214696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221615+0000","last_change":"2023-07-09T21:39:02.221615+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221615+0000","last_undegraded":"2023-07-09T21:39:02.221615+0000","last_fullsized":"2023-07-09T21:39:02.221615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.227141+0000","last_change":"2023-07-09T21:39:02.227141+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.227141+0000","last_undegraded":"2023-07-09T21:39:02.227141+0000","last_fullsized":"2023-07-09T21:39:02.227141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215426+0000","last_change":"2023-07-09T21:39:02.215426+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215426+0000","last_undegraded":"2023-07-09T21:39:02.215426+0000","last_fullsized":"2023-07-09T21:39:02.215426+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211335+0000","last_change":"2023-07-09T21:39:02.211335+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211335+0000","last_undegraded":"2023-07-09T21:39:02.211335+0000","last_fullsized":"2023-07-09T21:39:02.211335+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213617+0000","last_change":"2023-07-09T21:39:02.213617+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213617+0000","last_undegraded":"2023-07-09T21:39:02.213617+0000","last_fullsized":"2023-07-09T21:39:02.213617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213931+0000","last_change":"2023-07-09T21:39:02.213931+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213931+0000","last_undegraded":"2023-07-09T21:39:02.213931+0000","last_fullsized":"2023-07-09T21:39:02.213931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222060+0000","last_change":"2023-07-09T21:39:02.222060+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222060+0000","last_undegraded":"2023-07-09T21:39:02.222060+0000","last_fullsized":"2023-07-09T21:39:02.222060+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217408+0000","last_change":"2023-07-09T21:39:02.217408+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217408+0000","last_undegraded":"2023-07-09T21:39:02.217408+0000","last_fullsized":"2023-07-09T21:39:02.217408+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218958+0000","last_change":"2023-07-09T21:39:02.218958+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218958+0000","last_undegraded":"2023-07-09T21:39:02.218958+0000","last_fullsized":"2023-07-09T21:39:02.218958+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221232+0000","last_change":"2023-07-09T21:39:02.221232+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221232+0000","last_undegraded":"2023-07-09T21:39:02.221232+0000","last_fullsized":"2023-07-09T21:39:02.221232+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221130+0000","last_change":"2023-07-09T21:39:02.221130+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221130+0000","last_undegraded":"2023-07-09T21:39:02.221130+0000","last_fullsized":"2023-07-09T21:39:02.221130+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223054+0000","last_change":"2023-07-09T21:39:02.223054+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223054+0000","last_undegraded":"2023-07-09T21:39:02.223054+0000","last_fullsized":"2023-07-09T21:39:02.223054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.228433+0000","last_change":"2023-07-09T21:39:02.228433+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.228433+0000","last_undegraded":"2023-07-09T21:39:02.228433+0000","last_fullsized":"2023-07-09T21:39:02.228433+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213388+0000","last_change":"2023-07-09T21:39:02.213388+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213388+0000","last_undegraded":"2023-07-09T21:39:02.213388+0000","last_fullsized":"2023-07-09T21:39:02.213388+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221220+0000","last_change":"2023-07-09T21:39:02.221220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221220+0000","last_undegraded":"2023-07-09T21:39:02.221220+0000","last_fullsized":"2023-07-09T21:39:02.221220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223021+0000","last_change":"2023-07-09T21:39:02.223021+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223021+0000","last_undegraded":"2023-07-09T21:39:02.223021+0000","last_fullsized":"2023-07-09T21:39:02.223021+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210665+0000","last_change":"2023-07-09T21:39:02.210665+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210665+0000","last_undegraded":"2023-07-09T21:39:02.210665+0000","last_fullsized":"2023-07-09T21:39:02.210665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.224303+0000","last_change":"2023-07-09T21:39:02.224303+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.224303+0000","last_undegraded":"2023-07-09T21:39:02.224303+0000","last_fullsized":"2023-07-09T21:39:02.224303+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210483+0000","last_change":"2023-07-09T21:39:02.210483+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210483+0000","last_undegraded":"2023-07-09T21:39:02.210483+0000","last_fullsized":"2023-07-09T21:39:02.210483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230805+0000","last_change":"2023-07-09T21:39:02.227658+0000","last_active":"2023-07-09T21:39:02.230805+0000","last_peered":"2023-07-09T21:39:02.230805+0000","last_clean":"2023-07-09T21:39:02.230805+0000","last_became_active":"2023-07-09T21:39:02.227277+0000","last_became_peered":"2023-07-09T21:39:02.227277+0000","last_unstale":"2023-07-09T21:39:02.230805+0000","last_undegraded":"2023-07-09T21:39:02.230805+0000","last_fullsized":"2023-07-09T21:39:02.230805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:47.586765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214334+0000","last_change":"2023-07-09T21:39:02.214334+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214334+0000","last_undegraded":"2023-07-09T21:39:02.214334+0000","last_fullsized":"2023-07-09T21:39:02.214334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.241026+0000","last_change":"2023-07-09T21:39:02.237998+0000","last_active":"2023-07-09T21:39:02.241026+0000","last_peered":"2023-07-09T21:39:02.241026+0000","last_clean":"2023-07-09T21:39:02.241026+0000","last_became_active":"2023-07-09T21:39:02.237705+0000","last_became_peered":"2023-07-09T21:39:02.237705+0000","last_unstale":"2023-07-09T21:39:02.241026+0000","last_undegraded":"2023-07-09T21:39:02.241026+0000","last_fullsized":"2023-07-09T21:39:02.241026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:18.622881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217981+0000","last_change":"2023-07-09T21:39:02.217981+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217981+0000","last_undegraded":"2023-07-09T21:39:02.217981+0000","last_fullsized":"2023-07-09T21:39:02.217981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240562+0000","last_change":"2023-07-09T21:39:02.236776+0000","last_active":"2023-07-09T21:39:02.240562+0000","last_peered":"2023-07-09T21:39:02.240562+0000","last_clean":"2023-07-09T21:39:02.240562+0000","last_became_active":"2023-07-09T21:39:02.236505+0000","last_became_peered":"2023-07-09T21:39:02.236505+0000","last_unstale":"2023-07-09T21:39:02.240562+0000","last_undegraded":"2023-07-09T21:39:02.240562+0000","last_fullsized":"2023-07-09T21:39:02.240562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:27.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221562+0000","last_change":"2023-07-09T21:39:02.221562+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221562+0000","last_undegraded":"2023-07-09T21:39:02.221562+0000","last_fullsized":"2023-07-09T21:39:02.221562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237176+0000","last_change":"2023-07-09T21:39:02.235294+0000","last_active":"2023-07-09T21:39:02.237176+0000","last_peered":"2023-07-09T21:39:02.237176+0000","last_clean":"2023-07-09T21:39:02.237176+0000","last_became_active":"2023-07-09T21:39:02.234886+0000","last_became_peered":"2023-07-09T21:39:02.234886+0000","last_unstale":"2023-07-09T21:39:02.237176+0000","last_undegraded":"2023-07-09T21:39:02.237176+0000","last_fullsized":"2023-07-09T21:39:02.237176+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214704+0000","last_change":"2023-07-09T21:39:02.214704+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214704+0000","last_undegraded":"2023-07-09T21:39:02.214704+0000","last_fullsized":"2023-07-09T21:39:02.214704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236705+0000","last_change":"2023-07-09T21:39:02.232585+0000","last_active":"2023-07-09T21:39:02.236705+0000","last_peered":"2023-07-09T21:39:02.236705+0000","last_clean":"2023-07-09T21:39:02.236705+0000","last_became_active":"2023-07-09T21:39:02.232315+0000","last_became_peered":"2023-07-09T21:39:02.232315+0000","last_unstale":"2023-07-09T21:39:02.236705+0000","last_undegraded":"2023-07-09T21:39:02.236705+0000","last_fullsized":"2023-07-09T21:39:02.236705+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219127+0000","last_change":"2023-07-09T21:39:02.219127+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219127+0000","last_undegraded":"2023-07-09T21:39:02.219127+0000","last_fullsized":"2023-07-09T21:39:02.219127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235874+0000","last_change":"2023-07-09T21:39:02.235039+0000","last_active":"2023-07-09T21:39:02.235874+0000","last_peered":"2023-07-09T21:39:02.235874+0000","last_clean":"2023-07-09T21:39:02.235874+0000","last_became_active":"2023-07-09T21:39:02.234707+0000","last_became_peered":"2023-07-09T21:39:02.234707+0000","last_unstale":"2023-07-09T21:39:02.235874+0000","last_undegraded":"2023-07-09T21:39:02.235874+0000","last_fullsized":"2023-07-09T21:39:02.235874+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:12.185073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218267+0000","last_change":"2023-07-09T21:39:02.218267+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218267+0000","last_undegraded":"2023-07-09T21:39:02.218267+0000","last_fullsized":"2023-07-09T21:39:02.218267+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229966+0000","last_change":"2023-07-09T21:39:02.228791+0000","last_active":"2023-07-09T21:39:02.229966+0000","last_peered":"2023-07-09T21:39:02.229966+0000","last_clean":"2023-07-09T21:39:02.229966+0000","last_became_active":"2023-07-09T21:39:02.228459+0000","last_became_peered":"2023-07-09T21:39:02.228459+0000","last_unstale":"2023-07-09T21:39:02.229966+0000","last_undegraded":"2023-07-09T21:39:02.229966+0000","last_fullsized":"2023-07-09T21:39:02.229966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:43.097772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218261+0000","last_change":"2023-07-09T21:39:02.218261+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218261+0000","last_undegraded":"2023-07-09T21:39:02.218261+0000","last_fullsized":"2023-07-09T21:39:02.218261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224698+0000","last_change":"2023-07-09T21:39:02.222966+0000","last_active":"2023-07-09T21:39:02.224698+0000","last_peered":"2023-07-09T21:39:02.224698+0000","last_clean":"2023-07-09T21:39:02.224698+0000","last_became_active":"2023-07-09T21:39:02.222697+0000","last_became_peered":"2023-07-09T21:39:02.222697+0000","last_unstale":"2023-07-09T21:39:02.224698+0000","last_undegraded":"2023-07-09T21:39:02.224698+0000","last_fullsized":"2023-07-09T21:39:02.224698+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:55:47.534660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216008+0000","last_change":"2023-07-09T21:39:02.216008+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216008+0000","last_undegraded":"2023-07-09T21:39:02.216008+0000","last_fullsized":"2023-07-09T21:39:02.216008+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236603+0000","last_change":"2023-07-09T21:39:02.233072+0000","last_active":"2023-07-09T21:39:02.236603+0000","last_peered":"2023-07-09T21:39:02.236603+0000","last_clean":"2023-07-09T21:39:02.236603+0000","last_became_active":"2023-07-09T21:39:02.232634+0000","last_became_peered":"2023-07-09T21:39:02.232634+0000","last_unstale":"2023-07-09T21:39:02.236603+0000","last_undegraded":"2023-07-09T21:39:02.236603+0000","last_fullsized":"2023-07-09T21:39:02.236603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:49:21.955063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221923+0000","last_change":"2023-07-09T21:39:02.221923+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221923+0000","last_undegraded":"2023-07-09T21:39:02.221923+0000","last_fullsized":"2023-07-09T21:39:02.221923+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.233430+0000","last_change":"2023-07-09T21:39:02.231456+0000","last_active":"2023-07-09T21:39:02.233430+0000","last_peered":"2023-07-09T21:39:02.233430+0000","last_clean":"2023-07-09T21:39:02.233430+0000","last_became_active":"2023-07-09T21:39:02.231159+0000","last_became_peered":"2023-07-09T21:39:02.231159+0000","last_unstale":"2023-07-09T21:39:02.233430+0000","last_undegraded":"2023-07-09T21:39:02.233430+0000","last_fullsized":"2023-07-09T21:39:02.233430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:37.647171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214233+0000","last_change":"2023-07-09T21:39:02.214233+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214233+0000","last_undegraded":"2023-07-09T21:39:02.214233+0000","last_fullsized":"2023-07-09T21:39:02.214233+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.225404+0000","last_change":"2023-07-09T21:39:02.222461+0000","last_active":"2023-07-09T21:39:02.225404+0000","last_peered":"2023-07-09T21:39:02.225404+0000","last_clean":"2023-07-09T21:39:02.225404+0000","last_became_active":"2023-07-09T21:39:02.222198+0000","last_became_peered":"2023-07-09T21:39:02.222198+0000","last_unstale":"2023-07-09T21:39:02.225404+0000","last_undegraded":"2023-07-09T21:39:02.225404+0000","last_fullsized":"2023-07-09T21:39:02.225404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:20.153832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211800+0000","last_change":"2023-07-09T21:39:02.211800+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211800+0000","last_undegraded":"2023-07-09T21:39:02.211800+0000","last_fullsized":"2023-07-09T21:39:02.211800+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231766+0000","last_change":"2023-07-09T21:39:02.228316+0000","last_active":"2023-07-09T21:39:02.231766+0000","last_peered":"2023-07-09T21:39:02.231766+0000","last_clean":"2023-07-09T21:39:02.231766+0000","last_became_active":"2023-07-09T21:39:02.226731+0000","last_became_peered":"2023-07-09T21:39:02.226731+0000","last_unstale":"2023-07-09T21:39:02.231766+0000","last_undegraded":"2023-07-09T21:39:02.231766+0000","last_fullsized":"2023-07-09T21:39:02.231766+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:40.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222234+0000","last_change":"2023-07-09T21:39:02.222234+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222234+0000","last_undegraded":"2023-07-09T21:39:02.222234+0000","last_fullsized":"2023-07-09T21:39:02.222234+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.232021+0000","last_change":"2023-07-09T21:39:02.228630+0000","last_active":"2023-07-09T21:39:02.232021+0000","last_peered":"2023-07-09T21:39:02.232021+0000","last_clean":"2023-07-09T21:39:02.232021+0000","last_became_active":"2023-07-09T21:39:02.228368+0000","last_became_peered":"2023-07-09T21:39:02.228368+0000","last_unstale":"2023-07-09T21:39:02.232021+0000","last_undegraded":"2023-07-09T21:39:02.232021+0000","last_fullsized":"2023-07-09T21:39:02.232021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:09.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216779+0000","last_change":"2023-07-09T21:39:02.216779+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216779+0000","last_undegraded":"2023-07-09T21:39:02.216779+0000","last_fullsized":"2023-07-09T21:39:02.216779+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234860+0000","last_change":"2023-07-09T21:39:02.230899+0000","last_active":"2023-07-09T21:39:02.234860+0000","last_peered":"2023-07-09T21:39:02.234860+0000","last_clean":"2023-07-09T21:39:02.234860+0000","last_became_active":"2023-07-09T21:39:02.230633+0000","last_became_peered":"2023-07-09T21:39:02.230633+0000","last_unstale":"2023-07-09T21:39:02.234860+0000","last_undegraded":"2023-07-09T21:39:02.234860+0000","last_fullsized":"2023-07-09T21:39:02.234860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:45.796213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216717+0000","last_change":"2023-07-09T21:39:02.216717+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216717+0000","last_undegraded":"2023-07-09T21:39:02.216717+0000","last_fullsized":"2023-07-09T21:39:02.216717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230794+0000","last_change":"2023-07-09T21:39:02.227440+0000","last_active":"2023-07-09T21:39:02.230794+0000","last_peered":"2023-07-09T21:39:02.230794+0000","last_clean":"2023-07-09T21:39:02.230794+0000","last_became_active":"2023-07-09T21:39:02.226934+0000","last_became_peered":"2023-07-09T21:39:02.226934+0000","last_unstale":"2023-07-09T21:39:02.230794+0000","last_undegraded":"2023-07-09T21:39:02.230794+0000","last_fullsized":"2023-07-09T21:39:02.230794+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:05.113406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217839+0000","last_change":"2023-07-09T21:39:02.217839+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217839+0000","last_undegraded":"2023-07-09T21:39:02.217839+0000","last_fullsized":"2023-07-09T21:39:02.217839+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227247+0000","last_change":"2023-07-09T21:39:02.224832+0000","last_active":"2023-07-09T21:39:02.227247+0000","last_peered":"2023-07-09T21:39:02.227247+0000","last_clean":"2023-07-09T21:39:02.227247+0000","last_became_active":"2023-07-09T21:39:02.224573+0000","last_became_peered":"2023-07-09T21:39:02.224573+0000","last_unstale":"2023-07-09T21:39:02.227247+0000","last_undegraded":"2023-07-09T21:39:02.227247+0000","last_fullsized":"2023-07-09T21:39:02.227247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:20.098183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218499+0000","last_change":"2023-07-09T21:39:02.218499+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218499+0000","last_undegraded":"2023-07-09T21:39:02.218499+0000","last_fullsized":"2023-07-09T21:39:02.218499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230618+0000","last_change":"2023-07-09T21:39:02.227857+0000","last_active":"2023-07-09T21:39:02.230618+0000","last_peered":"2023-07-09T21:39:02.230618+0000","last_clean":"2023-07-09T21:39:02.230618+0000","last_became_active":"2023-07-09T21:39:02.227555+0000","last_became_peered":"2023-07-09T21:39:02.227555+0000","last_unstale":"2023-07-09T21:39:02.230618+0000","last_undegraded":"2023-07-09T21:39:02.230618+0000","last_fullsized":"2023-07-09T21:39:02.230618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:31.134106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219059+0000","last_change":"2023-07-09T21:39:02.219059+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219059+0000","last_undegraded":"2023-07-09T21:39:02.219059+0000","last_fullsized":"2023-07-09T21:39:02.219059+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229624+0000","last_change":"2023-07-09T21:39:02.226076+0000","last_active":"2023-07-09T21:39:02.229624+0000","last_peered":"2023-07-09T21:39:02.229624+0000","last_clean":"2023-07-09T21:39:02.229624+0000","last_became_active":"2023-07-09T21:39:02.225796+0000","last_became_peered":"2023-07-09T21:39:02.225796+0000","last_unstale":"2023-07-09T21:39:02.229624+0000","last_undegraded":"2023-07-09T21:39:02.229624+0000","last_fullsized":"2023-07-09T21:39:02.229624+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:06.522078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217413+0000","last_change":"2023-07-09T21:39:02.217413+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217413+0000","last_undegraded":"2023-07-09T21:39:02.217413+0000","last_fullsized":"2023-07-09T21:39:02.217413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237956+0000","last_change":"2023-07-09T21:39:02.235989+0000","last_active":"2023-07-09T21:39:02.237956+0000","last_peered":"2023-07-09T21:39:02.237956+0000","last_clean":"2023-07-09T21:39:02.237956+0000","last_became_active":"2023-07-09T21:39:02.235703+0000","last_became_peered":"2023-07-09T21:39:02.235703+0000","last_unstale":"2023-07-09T21:39:02.237956+0000","last_undegraded":"2023-07-09T21:39:02.237956+0000","last_fullsized":"2023-07-09T21:39:02.237956+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:12.356937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215180+0000","last_change":"2023-07-09T21:39:02.215180+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215180+0000","last_undegraded":"2023-07-09T21:39:02.215180+0000","last_fullsized":"2023-07-09T21:39:02.215180+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236636+0000","last_change":"2023-07-09T21:39:02.232727+0000","last_active":"2023-07-09T21:39:02.236636+0000","last_peered":"2023-07-09T21:39:02.236636+0000","last_clean":"2023-07-09T21:39:02.236636+0000","last_became_active":"2023-07-09T21:39:02.232459+0000","last_became_peered":"2023-07-09T21:39:02.232459+0000","last_unstale":"2023-07-09T21:39:02.236636+0000","last_undegraded":"2023-07-09T21:39:02.236636+0000","last_fullsized":"2023-07-09T21:39:02.236636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:15.384722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218064+0000","last_change":"2023-07-09T21:39:02.218064+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218064+0000","last_undegraded":"2023-07-09T21:39:02.218064+0000","last_fullsized":"2023-07-09T21:39:02.218064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235815+0000","last_change":"2023-07-09T21:39:02.233872+0000","last_active":"2023-07-09T21:39:02.235815+0000","last_peered":"2023-07-09T21:39:02.235815+0000","last_clean":"2023-07-09T21:39:02.235815+0000","last_became_active":"2023-07-09T21:39:02.233572+0000","last_became_peered":"2023-07-09T21:39:02.233572+0000","last_unstale":"2023-07-09T21:39:02.235815+0000","last_undegraded":"2023-07-09T21:39:02.235815+0000","last_fullsized":"2023-07-09T21:39:02.235815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:34.202866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216197+0000","last_change":"2023-07-09T21:39:02.216197+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216197+0000","last_undegraded":"2023-07-09T21:39:02.216197+0000","last_fullsized":"2023-07-09T21:39:02.216197+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230774+0000","last_change":"2023-07-09T21:39:02.227372+0000","last_active":"2023-07-09T21:39:02.230774+0000","last_peered":"2023-07-09T21:39:02.230774+0000","last_clean":"2023-07-09T21:39:02.230774+0000","last_became_active":"2023-07-09T21:39:02.226984+0000","last_became_peered":"2023-07-09T21:39:02.226984+0000","last_unstale":"2023-07-09T21:39:02.230774+0000","last_undegraded":"2023-07-09T21:39:02.230774+0000","last_fullsized":"2023-07-09T21:39:02.230774+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:43.210469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210842+0000","last_change":"2023-07-09T21:39:02.210842+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210842+0000","last_undegraded":"2023-07-09T21:39:02.210842+0000","last_fullsized":"2023-07-09T21:39:02.210842+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234068+0000","last_change":"2023-07-09T21:39:02.231774+0000","last_active":"2023-07-09T21:39:02.234068+0000","last_peered":"2023-07-09T21:39:02.234068+0000","last_clean":"2023-07-09T21:39:02.234068+0000","last_became_active":"2023-07-09T21:39:02.231437+0000","last_became_peered":"2023-07-09T21:39:02.231437+0000","last_unstale":"2023-07-09T21:39:02.234068+0000","last_undegraded":"2023-07-09T21:39:02.234068+0000","last_fullsized":"2023-07-09T21:39:02.234068+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:13.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210300+0000","last_change":"2023-07-09T21:39:02.210300+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210300+0000","last_undegraded":"2023-07-09T21:39:02.210300+0000","last_fullsized":"2023-07-09T21:39:02.210300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.222092+0000","last_change":"2023-07-09T21:39:02.220149+0000","last_active":"2023-07-09T21:39:02.222092+0000","last_peered":"2023-07-09T21:39:02.222092+0000","last_clean":"2023-07-09T21:39:02.222092+0000","last_became_active":"2023-07-09T21:39:02.219868+0000","last_became_peered":"2023-07-09T21:39:02.219868+0000","last_unstale":"2023-07-09T21:39:02.222092+0000","last_undegraded":"2023-07-09T21:39:02.222092+0000","last_fullsized":"2023-07-09T21:39:02.222092+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:50.960195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225043+0000","last_change":"2023-07-09T21:39:02.225043+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225043+0000","last_undegraded":"2023-07-09T21:39:02.225043+0000","last_fullsized":"2023-07-09T21:39:02.225043+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227953+0000","last_change":"2023-07-09T21:39:02.225583+0000","last_active":"2023-07-09T21:39:02.227953+0000","last_peered":"2023-07-09T21:39:02.227953+0000","last_clean":"2023-07-09T21:39:02.227953+0000","last_became_active":"2023-07-09T21:39:02.225277+0000","last_became_peered":"2023-07-09T21:39:02.225277+0000","last_unstale":"2023-07-09T21:39:02.227953+0000","last_undegraded":"2023-07-09T21:39:02.227953+0000","last_fullsized":"2023-07-09T21:39:02.227953+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:08.336460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"87'183","reported_seq":545,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227613+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:02.227613+0000","last_peered":"2023-07-09T21:39:02.227613+0000","last_clean":"2023-07-09T21:39:02.227613+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:02.227613+0000","last_undegraded":"2023-07-09T21:39:02.227613+0000","last_fullsized":"2023-07-09T21:39:02.227613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:23:25.605320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224490+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:02.224490+0000","last_peered":"2023-07-09T21:39:02.224490+0000","last_clean":"2023-07-09T21:39:02.224490+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:02.224490+0000","last_undegraded":"2023-07-09T21:39:02.224490+0000","last_fullsized":"2023-07-09T21:39:02.224490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:09.851052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216086+0000","last_change":"2023-07-09T21:39:02.216086+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216086+0000","last_undegraded":"2023-07-09T21:39:02.216086+0000","last_fullsized":"2023-07-09T21:39:02.216086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229663+0000","last_change":"2023-07-09T21:39:02.226362+0000","last_active":"2023-07-09T21:39:02.229663+0000","last_peered":"2023-07-09T21:39:02.229663+0000","last_clean":"2023-07-09T21:39:02.229663+0000","last_became_active":"2023-07-09T21:39:02.225863+0000","last_became_peered":"2023-07-09T21:39:02.225863+0000","last_unstale":"2023-07-09T21:39:02.229663+0000","last_undegraded":"2023-07-09T21:39:02.229663+0000","last_fullsized":"2023-07-09T21:39:02.229663+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:30.581274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227483+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:02.227483+0000","last_peered":"2023-07-09T21:39:02.227483+0000","last_clean":"2023-07-09T21:39:02.227483+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:02.227483+0000","last_undegraded":"2023-07-09T21:39:02.227483+0000","last_fullsized":"2023-07-09T21:39:02.227483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:19.445522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217305+0000","last_change":"2023-07-09T21:39:02.217305+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217305+0000","last_undegraded":"2023-07-09T21:39:02.217305+0000","last_fullsized":"2023-07-09T21:39:02.217305+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228135+0000","last_change":"2023-07-09T21:39:02.225573+0000","last_active":"2023-07-09T21:39:02.228135+0000","last_peered":"2023-07-09T21:39:02.228135+0000","last_clean":"2023-07-09T21:39:02.228135+0000","last_became_active":"2023-07-09T21:39:02.225239+0000","last_became_peered":"2023-07-09T21:39:02.225239+0000","last_unstale":"2023-07-09T21:39:02.228135+0000","last_undegraded":"2023-07-09T21:39:02.228135+0000","last_fullsized":"2023-07-09T21:39:02.228135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:20.466091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.209801+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:02.209801+0000","last_peered":"2023-07-09T21:39:02.209801+0000","last_clean":"2023-07-09T21:39:02.209801+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:02.209801+0000","last_undegraded":"2023-07-09T21:39:02.209801+0000","last_fullsized":"2023-07-09T21:39:02.209801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:31.653817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214220+0000","last_change":"2023-07-09T21:39:02.214220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214220+0000","last_undegraded":"2023-07-09T21:39:02.214220+0000","last_fullsized":"2023-07-09T21:39:02.214220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228100+0000","last_change":"2023-07-09T21:39:02.218979+0000","last_active":"2023-07-09T21:39:02.228100+0000","last_peered":"2023-07-09T21:39:02.228100+0000","last_clean":"2023-07-09T21:39:02.228100+0000","last_became_active":"2023-07-09T21:39:02.218641+0000","last_became_peered":"2023-07-09T21:39:02.218641+0000","last_unstale":"2023-07-09T21:39:02.228100+0000","last_undegraded":"2023-07-09T21:39:02.228100+0000","last_fullsized":"2023-07-09T21:39:02.228100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:31.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224665+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:02.224665+0000","last_peered":"2023-07-09T21:39:02.224665+0000","last_clean":"2023-07-09T21:39:02.224665+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:02.224665+0000","last_undegraded":"2023-07-09T21:39:02.224665+0000","last_fullsized":"2023-07-09T21:39:02.224665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.581480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216864+0000","last_change":"2023-07-09T21:39:02.216864+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216864+0000","last_undegraded":"2023-07-09T21:39:02.216864+0000","last_fullsized":"2023-07-09T21:39:02.216864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227285+0000","last_change":"2023-07-09T21:39:02.226536+0000","last_active":"2023-07-09T21:39:02.227285+0000","last_peered":"2023-07-09T21:39:02.227285+0000","last_clean":"2023-07-09T21:39:02.227285+0000","last_became_active":"2023-07-09T21:39:02.226268+0000","last_became_peered":"2023-07-09T21:39:02.226268+0000","last_unstale":"2023-07-09T21:39:02.227285+0000","last_undegraded":"2023-07-09T21:39:02.227285+0000","last_fullsized":"2023-07-09T21:39:02.227285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:50.476167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211482+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:02.211482+0000","last_peered":"2023-07-09T21:39:02.211482+0000","last_clean":"2023-07-09T21:39:02.211482+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:02.211482+0000","last_undegraded":"2023-07-09T21:39:02.211482+0000","last_fullsized":"2023-07-09T21:39:02.211482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213902+0000","last_change":"2023-07-09T21:39:02.213902+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213902+0000","last_undegraded":"2023-07-09T21:39:02.213902+0000","last_fullsized":"2023-07-09T21:39:02.213902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.226660+0000","last_change":"2023-07-09T21:39:02.224587+0000","last_active":"2023-07-09T21:39:02.226660+0000","last_peered":"2023-07-09T21:39:02.226660+0000","last_clean":"2023-07-09T21:39:02.226660+0000","last_became_active":"2023-07-09T21:39:02.224283+0000","last_became_peered":"2023-07-09T21:39:02.224283+0000","last_unstale":"2023-07-09T21:39:02.226660+0000","last_undegraded":"2023-07-09T21:39:02.226660+0000","last_fullsized":"2023-07-09T21:39:02.226660+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:16:34.525255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230529+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:02.230529+0000","last_peered":"2023-07-09T21:39:02.230529+0000","last_clean":"2023-07-09T21:39:02.230529+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:02.230529+0000","last_undegraded":"2023-07-09T21:39:02.230529+0000","last_fullsized":"2023-07-09T21:39:02.230529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:44.509992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216570+0000","last_change":"2023-07-09T21:39:02.216570+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216570+0000","last_undegraded":"2023-07-09T21:39:02.216570+0000","last_fullsized":"2023-07-09T21:39:02.216570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240541+0000","last_change":"2023-07-09T21:39:02.236493+0000","last_active":"2023-07-09T21:39:02.240541+0000","last_peered":"2023-07-09T21:39:02.240541+0000","last_clean":"2023-07-09T21:39:02.240541+0000","last_became_active":"2023-07-09T21:39:02.236157+0000","last_became_peered":"2023-07-09T21:39:02.236157+0000","last_unstale":"2023-07-09T21:39:02.240541+0000","last_undegraded":"2023-07-09T21:39:02.240541+0000","last_fullsized":"2023-07-09T21:39:02.240541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:50.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211581+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:02.211581+0000","last_peered":"2023-07-09T21:39:02.211581+0000","last_clean":"2023-07-09T21:39:02.211581+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:02.211581+0000","last_undegraded":"2023-07-09T21:39:02.211581+0000","last_fullsized":"2023-07-09T21:39:02.211581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:48.896201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215876+0000","last_change":"2023-07-09T21:39:02.215876+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215876+0000","last_undegraded":"2023-07-09T21:39:02.215876+0000","last_fullsized":"2023-07-09T21:39:02.215876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231908+0000","last_change":"2023-07-09T21:39:02.228812+0000","last_active":"2023-07-09T21:39:02.231908+0000","last_peered":"2023-07-09T21:39:02.231908+0000","last_clean":"2023-07-09T21:39:02.231908+0000","last_became_active":"2023-07-09T21:39:02.228542+0000","last_became_peered":"2023-07-09T21:39:02.228542+0000","last_unstale":"2023-07-09T21:39:02.231908+0000","last_undegraded":"2023-07-09T21:39:02.231908+0000","last_fullsized":"2023-07-09T21:39:02.231908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:58:03.631954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.217087+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:02.217087+0000","last_peered":"2023-07-09T21:39:02.217087+0000","last_clean":"2023-07-09T21:39:02.217087+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:02.217087+0000","last_undegraded":"2023-07-09T21:39:02.217087+0000","last_fullsized":"2023-07-09T21:39:02.217087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:27.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59024,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312816,"statfs":{"total":96636764160,"available":96576323584,"internally_reserved":0,"allocated":1777664,"data_stored":1184877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.93400000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.75}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.876},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.86599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.751},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.502}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.81200000000000006}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.503}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.748}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54336,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317504,"statfs":{"total":96636764160,"available":96581124096,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.442},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":1178249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.87}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.90500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.089},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.92700000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.115},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.81799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:07.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 Processor -- start 2023-07-09T21:39:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 -- start start 2023-07-09T21:39:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec15ba60 0x7f29ec1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29ec0cf260 0x7f29ec0d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ec06acb0 con 0x7f29ec0cc800 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ec1605f0 con 0x7f29ec0cf260 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f3eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0ccc90 con 0x7f29ec15ba60 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29ec0cf260 0x7f29ec0d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29ec0cf260 0x7f29ec0d0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59508/0 (socket says 172.21.15.37:59508) 2023-07-09T21:39:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 -- 172.21.15.37:0/3713844107 learned_addr learned my addr 172.21.15.37:0/3713844107 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f1487640 1 --1- 172.21.15.37:0/3713844107 >> v1:172.21.15.37:6789/0 conn(0x7f29ec0cc800 0x7f29ec0ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39036/0 (socket says 172.21.15.37:39036) 2023-07-09T21:39:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f1c88640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec15ba60 0x7f29ec1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 -- 172.21.15.37:0/3713844107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec15ba60 msgr2=0x7f29ec1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:07.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec15ba60 0x7f29ec1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 -- 172.21.15.37:0/3713844107 >> v1:172.21.15.37:6789/0 conn(0x7f29ec0cc800 legacy=0x7f29ec0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.918+0000 7f29f2489640 1 -- 172.21.15.37:0/3713844107 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ec0cfe20 con 0x7f29ec0cf260 2023-07-09T21:39:07.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f2489640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec0cf260 0x7f29ec0d0900 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009e50 tx=0x7f29e401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5388eb4735faf574 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f0c86640 1 -- 172.21.15.37:0/3713844107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40a58a0 con 0x7f29ec0cf260 2023-07-09T21:39:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f0c86640 1 -- 172.21.15.37:0/3713844107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e40a5a00 con 0x7f29ec0cf260 2023-07-09T21:39:07.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f0c86640 1 -- 172.21.15.37:0/3713844107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40a5d90 con 0x7f29ec0cf260 2023-07-09T21:39:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 -- 172.21.15.37:0/3713844107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec0cf260 msgr2=0x7f29ec0d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec0cf260 0x7f29ec0d0900 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f29e4009e50 tx=0x7f29e401c9e0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 -- 172.21.15.37:0/3713844107 shutdown_connections 2023-07-09T21:39:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec0cf260 0x7f29ec0d0900 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3713844107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec15ba60 0x7f29ec1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 -- 172.21.15.37:0/3713844107 >> 172.21.15.37:0/3713844107 conn(0x7f29ec073090 msgr2=0x7f29ec069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 -- 172.21.15.37:0/3713844107 shutdown_connections 2023-07-09T21:39:07.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.922+0000 7f29f3eec640 1 -- 172.21.15.37:0/3713844107 wait complete. 2023-07-09T21:39:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 Processor -- start 2023-07-09T21:39:07.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- start start 2023-07-09T21:39:07.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec0cc800 0x7f29ec0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 0x7f29ec15c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0ca230 con 0x7f29ec15ba60 2023-07-09T21:39:07.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec0c61e0 con 0x7f29ec0cf260 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ec15c700 con 0x7f29ec0cc800 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59524/0 (socket says 172.21.15.37:59524) 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 -- 172.21.15.37:0/3308520290 learned_addr learned my addr 172.21.15.37:0/3308520290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f1c88640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec0cc800 0x7f29ec0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f1487640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 0x7f29ec15c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 -- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec0cc800 msgr2=0x7f29ec0c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec0cc800 0x7f29ec0c5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 -- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 msgr2=0x7f29ec15c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 0x7f29ec15c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 -- 172.21.15.37:0/3308520290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e4009b30 con 0x7f29ec15ba60 2023-07-09T21:39:07.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f1487640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 0x7f29ec15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f2489640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f29e401a610 tx=0x7f29e4019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40b8670 con 0x7f29ec15ba60 2023-07-09T21:39:07.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e40b87d0 con 0x7f29ec15ba60 2023-07-09T21:39:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e40b8b80 con 0x7f29ec15ba60 2023-07-09T21:39:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ec0c9620 con 0x7f29ec15ba60 2023-07-09T21:39:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.926+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ec0c9be0 con 0x7f29ec15ba60 2023-07-09T21:39:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ec0ca3a0 con 0x7f29ec15ba60 2023-07-09T21:39:07.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f29e40b8ce0 con 0x7f29ec15ba60 2023-07-09T21:39:07.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29e27fc640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 0x7f29d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:07.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29e411f470 con 0x7f29ec15ba60 2023-07-09T21:39:07.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29f1c88640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 0x7f29d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:07.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.930+0000 7f29f1c88640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 0x7f29d0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009af0 tx=0x7f29e8008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:07.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:07.934+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29e40ec8a0 con 0x7f29ec15ba60 2023-07-09T21:39:08.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.082+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f29ec0ccf70 con 0x7f29d00663a0 2023-07-09T21:39:08.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.090+0000 7f29e27fc640 1 -- 172.21.15.37:0/3308520290 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306256 (secure 0 0 0) 0x7f29e80119b0 con 0x7f29d00663a0 2023-07-09T21:39:08.099 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:08.101 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:08.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 msgr2=0x7f29d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 0x7f29d0068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29e8009af0 tx=0x7f29e8008040 comp rx=0 tx=0).stop 2023-07-09T21:39:08.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 msgr2=0x7f29ec1499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f29e401a610 tx=0x7f29e4019780 comp rx=0 tx=0).stop 2023-07-09T21:39:08.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 shutdown_connections 2023-07-09T21:39:08.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f29d00663a0 0x7f29d0068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29ec15ba60 0x7f29ec1499d0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29ec0cf260 0x7f29ec15c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 --2- 172.21.15.37:0/3308520290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29ec0cc800 0x7f29ec0c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 >> 172.21.15.37:0/3308520290 conn(0x7f29ec073090 msgr2=0x7f29ec15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:08.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 shutdown_connections 2023-07-09T21:39:08.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.094+0000 7f29f3eec640 1 -- 172.21.15.37:0/3308520290 wait complete. 2023-07-09T21:39:08.117 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:06.878578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329272,"kb_used_data":10360,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754645448,"statfs":{"total":773094113280,"available":772756938752,"internally_reserved":0,"allocated":10608640,"data_stored":5910296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.673293"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225355+0000","last_change":"2023-07-09T21:39:02.225355+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225355+0000","last_undegraded":"2023-07-09T21:39:02.225355+0000","last_fullsized":"2023-07-09T21:39:02.225355+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222371+0000","last_change":"2023-07-09T21:39:02.222371+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222371+0000","last_undegraded":"2023-07-09T21:39:02.222371+0000","last_fullsized":"2023-07-09T21:39:02.222371+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211006+0000","last_change":"2023-07-09T21:39:02.211006+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211006+0000","last_undegraded":"2023-07-09T21:39:02.211006+0000","last_fullsized":"2023-07-09T21:39:02.211006+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223256+0000","last_change":"2023-07-09T21:39:02.223256+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223256+0000","last_undegraded":"2023-07-09T21:39:02.223256+0000","last_fullsized":"2023-07-09T21:39:02.223256+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213869+0000","last_change":"2023-07-09T21:39:02.213869+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213869+0000","last_undegraded":"2023-07-09T21:39:02.213869+0000","last_fullsized":"2023-07-09T21:39:02.213869+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215142+0000","last_change":"2023-07-09T21:39:02.215142+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215142+0000","last_undegraded":"2023-07-09T21:39:02.215142+0000","last_fullsized":"2023-07-09T21:39:02.215142+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219594+0000","last_change":"2023-07-09T21:39:02.219594+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219594+0000","last_undegraded":"2023-07-09T21:39:02.219594+0000","last_fullsized":"2023-07-09T21:39:02.219594+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213557+0000","last_change":"2023-07-09T21:39:02.213557+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213557+0000","last_undegraded":"2023-07-09T21:39:02.213557+0000","last_fullsized":"2023-07-09T21:39:02.213557+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219650+0000","last_change":"2023-07-09T21:39:02.219650+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219650+0000","last_undegraded":"2023-07-09T21:39:02.219650+0000","last_fullsized":"2023-07-09T21:39:02.219650+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223620+0000","last_change":"2023-07-09T21:39:02.223620+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223620+0000","last_undegraded":"2023-07-09T21:39:02.223620+0000","last_fullsized":"2023-07-09T21:39:02.223620+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221732+0000","last_change":"2023-07-09T21:39:02.221732+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221732+0000","last_undegraded":"2023-07-09T21:39:02.221732+0000","last_fullsized":"2023-07-09T21:39:02.221732+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222788+0000","last_change":"2023-07-09T21:39:02.222788+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222788+0000","last_undegraded":"2023-07-09T21:39:02.222788+0000","last_fullsized":"2023-07-09T21:39:02.222788+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213354+0000","last_change":"2023-07-09T21:39:02.213354+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213354+0000","last_undegraded":"2023-07-09T21:39:02.213354+0000","last_fullsized":"2023-07-09T21:39:02.213354+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214696+0000","last_change":"2023-07-09T21:39:02.214696+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214696+0000","last_undegraded":"2023-07-09T21:39:02.214696+0000","last_fullsized":"2023-07-09T21:39:02.214696+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221615+0000","last_change":"2023-07-09T21:39:02.221615+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221615+0000","last_undegraded":"2023-07-09T21:39:02.221615+0000","last_fullsized":"2023-07-09T21:39:02.221615+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.227141+0000","last_change":"2023-07-09T21:39:02.227141+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.227141+0000","last_undegraded":"2023-07-09T21:39:02.227141+0000","last_fullsized":"2023-07-09T21:39:02.227141+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215426+0000","last_change":"2023-07-09T21:39:02.215426+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215426+0000","last_undegraded":"2023-07-09T21:39:02.215426+0000","last_fullsized":"2023-07-09T21:39:02.215426+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211335+0000","last_change":"2023-07-09T21:39:02.211335+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211335+0000","last_undegraded":"2023-07-09T21:39:02.211335+0000","last_fullsized":"2023-07-09T21:39:02.211335+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213617+0000","last_change":"2023-07-09T21:39:02.213617+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213617+0000","last_undegraded":"2023-07-09T21:39:02.213617+0000","last_fullsized":"2023-07-09T21:39:02.213617+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213931+0000","last_change":"2023-07-09T21:39:02.213931+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213931+0000","last_undegraded":"2023-07-09T21:39:02.213931+0000","last_fullsized":"2023-07-09T21:39:02.213931+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222060+0000","last_change":"2023-07-09T21:39:02.222060+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222060+0000","last_undegraded":"2023-07-09T21:39:02.222060+0000","last_fullsized":"2023-07-09T21:39:02.222060+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217408+0000","last_change":"2023-07-09T21:39:02.217408+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217408+0000","last_undegraded":"2023-07-09T21:39:02.217408+0000","last_fullsized":"2023-07-09T21:39:02.217408+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218958+0000","last_change":"2023-07-09T21:39:02.218958+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218958+0000","last_undegraded":"2023-07-09T21:39:02.218958+0000","last_fullsized":"2023-07-09T21:39:02.218958+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221232+0000","last_change":"2023-07-09T21:39:02.221232+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221232+0000","last_undegraded":"2023-07-09T21:39:02.221232+0000","last_fullsized":"2023-07-09T21:39:02.221232+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221130+0000","last_change":"2023-07-09T21:39:02.221130+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221130+0000","last_undegraded":"2023-07-09T21:39:02.221130+0000","last_fullsized":"2023-07-09T21:39:02.221130+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223054+0000","last_change":"2023-07-09T21:39:02.223054+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223054+0000","last_undegraded":"2023-07-09T21:39:02.223054+0000","last_fullsized":"2023-07-09T21:39:02.223054+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.228433+0000","last_change":"2023-07-09T21:39:02.228433+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.228433+0000","last_undegraded":"2023-07-09T21:39:02.228433+0000","last_fullsized":"2023-07-09T21:39:02.228433+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213388+0000","last_change":"2023-07-09T21:39:02.213388+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213388+0000","last_undegraded":"2023-07-09T21:39:02.213388+0000","last_fullsized":"2023-07-09T21:39:02.213388+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221220+0000","last_change":"2023-07-09T21:39:02.221220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221220+0000","last_undegraded":"2023-07-09T21:39:02.221220+0000","last_fullsized":"2023-07-09T21:39:02.221220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.223021+0000","last_change":"2023-07-09T21:39:02.223021+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.223021+0000","last_undegraded":"2023-07-09T21:39:02.223021+0000","last_fullsized":"2023-07-09T21:39:02.223021+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210665+0000","last_change":"2023-07-09T21:39:02.210665+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210665+0000","last_undegraded":"2023-07-09T21:39:02.210665+0000","last_fullsized":"2023-07-09T21:39:02.210665+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.224303+0000","last_change":"2023-07-09T21:39:02.224303+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.224303+0000","last_undegraded":"2023-07-09T21:39:02.224303+0000","last_fullsized":"2023-07-09T21:39:02.224303+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210483+0000","last_change":"2023-07-09T21:39:02.210483+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210483+0000","last_undegraded":"2023-07-09T21:39:02.210483+0000","last_fullsized":"2023-07-09T21:39:02.210483+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230805+0000","last_change":"2023-07-09T21:39:02.227658+0000","last_active":"2023-07-09T21:39:02.230805+0000","last_peered":"2023-07-09T21:39:02.230805+0000","last_clean":"2023-07-09T21:39:02.230805+0000","last_became_active":"2023-07-09T21:39:02.227277+0000","last_became_peered":"2023-07-09T21:39:02.227277+0000","last_unstale":"2023-07-09T21:39:02.230805+0000","last_undegraded":"2023-07-09T21:39:02.230805+0000","last_fullsized":"2023-07-09T21:39:02.230805+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:47.586765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214334+0000","last_change":"2023-07-09T21:39:02.214334+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214334+0000","last_undegraded":"2023-07-09T21:39:02.214334+0000","last_fullsized":"2023-07-09T21:39:02.214334+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.241026+0000","last_change":"2023-07-09T21:39:02.237998+0000","last_active":"2023-07-09T21:39:02.241026+0000","last_peered":"2023-07-09T21:39:02.241026+0000","last_clean":"2023-07-09T21:39:02.241026+0000","last_became_active":"2023-07-09T21:39:02.237705+0000","last_became_peered":"2023-07-09T21:39:02.237705+0000","last_unstale":"2023-07-09T21:39:02.241026+0000","last_undegraded":"2023-07-09T21:39:02.241026+0000","last_fullsized":"2023-07-09T21:39:02.241026+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:18.622881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217981+0000","last_change":"2023-07-09T21:39:02.217981+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217981+0000","last_undegraded":"2023-07-09T21:39:02.217981+0000","last_fullsized":"2023-07-09T21:39:02.217981+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240562+0000","last_change":"2023-07-09T21:39:02.236776+0000","last_active":"2023-07-09T21:39:02.240562+0000","last_peered":"2023-07-09T21:39:02.240562+0000","last_clean":"2023-07-09T21:39:02.240562+0000","last_became_active":"2023-07-09T21:39:02.236505+0000","last_became_peered":"2023-07-09T21:39:02.236505+0000","last_unstale":"2023-07-09T21:39:02.240562+0000","last_undegraded":"2023-07-09T21:39:02.240562+0000","last_fullsized":"2023-07-09T21:39:02.240562+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:35:27.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221562+0000","last_change":"2023-07-09T21:39:02.221562+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221562+0000","last_undegraded":"2023-07-09T21:39:02.221562+0000","last_fullsized":"2023-07-09T21:39:02.221562+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237176+0000","last_change":"2023-07-09T21:39:02.235294+0000","last_active":"2023-07-09T21:39:02.237176+0000","last_peered":"2023-07-09T21:39:02.237176+0000","last_clean":"2023-07-09T21:39:02.237176+0000","last_became_active":"2023-07-09T21:39:02.234886+0000","last_became_peered":"2023-07-09T21:39:02.234886+0000","last_unstale":"2023-07-09T21:39:02.237176+0000","last_undegraded":"2023-07-09T21:39:02.237176+0000","last_fullsized":"2023-07-09T21:39:02.237176+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214704+0000","last_change":"2023-07-09T21:39:02.214704+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214704+0000","last_undegraded":"2023-07-09T21:39:02.214704+0000","last_fullsized":"2023-07-09T21:39:02.214704+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236705+0000","last_change":"2023-07-09T21:39:02.232585+0000","last_active":"2023-07-09T21:39:02.236705+0000","last_peered":"2023-07-09T21:39:02.236705+0000","last_clean":"2023-07-09T21:39:02.236705+0000","last_became_active":"2023-07-09T21:39:02.232315+0000","last_became_peered":"2023-07-09T21:39:02.232315+0000","last_unstale":"2023-07-09T21:39:02.236705+0000","last_undegraded":"2023-07-09T21:39:02.236705+0000","last_fullsized":"2023-07-09T21:39:02.236705+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:56:59.357499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219127+0000","last_change":"2023-07-09T21:39:02.219127+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219127+0000","last_undegraded":"2023-07-09T21:39:02.219127+0000","last_fullsized":"2023-07-09T21:39:02.219127+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235874+0000","last_change":"2023-07-09T21:39:02.235039+0000","last_active":"2023-07-09T21:39:02.235874+0000","last_peered":"2023-07-09T21:39:02.235874+0000","last_clean":"2023-07-09T21:39:02.235874+0000","last_became_active":"2023-07-09T21:39:02.234707+0000","last_became_peered":"2023-07-09T21:39:02.234707+0000","last_unstale":"2023-07-09T21:39:02.235874+0000","last_undegraded":"2023-07-09T21:39:02.235874+0000","last_fullsized":"2023-07-09T21:39:02.235874+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:12.185073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218267+0000","last_change":"2023-07-09T21:39:02.218267+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218267+0000","last_undegraded":"2023-07-09T21:39:02.218267+0000","last_fullsized":"2023-07-09T21:39:02.218267+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229966+0000","last_change":"2023-07-09T21:39:02.228791+0000","last_active":"2023-07-09T21:39:02.229966+0000","last_peered":"2023-07-09T21:39:02.229966+0000","last_clean":"2023-07-09T21:39:02.229966+0000","last_became_active":"2023-07-09T21:39:02.228459+0000","last_became_peered":"2023-07-09T21:39:02.228459+0000","last_unstale":"2023-07-09T21:39:02.229966+0000","last_undegraded":"2023-07-09T21:39:02.229966+0000","last_fullsized":"2023-07-09T21:39:02.229966+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:43.097772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218261+0000","last_change":"2023-07-09T21:39:02.218261+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218261+0000","last_undegraded":"2023-07-09T21:39:02.218261+0000","last_fullsized":"2023-07-09T21:39:02.218261+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224698+0000","last_change":"2023-07-09T21:39:02.222966+0000","last_active":"2023-07-09T21:39:02.224698+0000","last_peered":"2023-07-09T21:39:02.224698+0000","last_clean":"2023-07-09T21:39:02.224698+0000","last_became_active":"2023-07-09T21:39:02.222697+0000","last_became_peered":"2023-07-09T21:39:02.222697+0000","last_unstale":"2023-07-09T21:39:02.224698+0000","last_undegraded":"2023-07-09T21:39:02.224698+0000","last_fullsized":"2023-07-09T21:39:02.224698+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:55:47.534660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216008+0000","last_change":"2023-07-09T21:39:02.216008+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216008+0000","last_undegraded":"2023-07-09T21:39:02.216008+0000","last_fullsized":"2023-07-09T21:39:02.216008+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236603+0000","last_change":"2023-07-09T21:39:02.233072+0000","last_active":"2023-07-09T21:39:02.236603+0000","last_peered":"2023-07-09T21:39:02.236603+0000","last_clean":"2023-07-09T21:39:02.236603+0000","last_became_active":"2023-07-09T21:39:02.232634+0000","last_became_peered":"2023-07-09T21:39:02.232634+0000","last_unstale":"2023-07-09T21:39:02.236603+0000","last_undegraded":"2023-07-09T21:39:02.236603+0000","last_fullsized":"2023-07-09T21:39:02.236603+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:49:21.955063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.221923+0000","last_change":"2023-07-09T21:39:02.221923+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.221923+0000","last_undegraded":"2023-07-09T21:39:02.221923+0000","last_fullsized":"2023-07-09T21:39:02.221923+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.233430+0000","last_change":"2023-07-09T21:39:02.231456+0000","last_active":"2023-07-09T21:39:02.233430+0000","last_peered":"2023-07-09T21:39:02.233430+0000","last_clean":"2023-07-09T21:39:02.233430+0000","last_became_active":"2023-07-09T21:39:02.231159+0000","last_became_peered":"2023-07-09T21:39:02.231159+0000","last_unstale":"2023-07-09T21:39:02.233430+0000","last_undegraded":"2023-07-09T21:39:02.233430+0000","last_fullsized":"2023-07-09T21:39:02.233430+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:37.647171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214233+0000","last_change":"2023-07-09T21:39:02.214233+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214233+0000","last_undegraded":"2023-07-09T21:39:02.214233+0000","last_fullsized":"2023-07-09T21:39:02.214233+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.225404+0000","last_change":"2023-07-09T21:39:02.222461+0000","last_active":"2023-07-09T21:39:02.225404+0000","last_peered":"2023-07-09T21:39:02.225404+0000","last_clean":"2023-07-09T21:39:02.225404+0000","last_became_active":"2023-07-09T21:39:02.222198+0000","last_became_peered":"2023-07-09T21:39:02.222198+0000","last_unstale":"2023-07-09T21:39:02.225404+0000","last_undegraded":"2023-07-09T21:39:02.225404+0000","last_fullsized":"2023-07-09T21:39:02.225404+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:20.153832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.211800+0000","last_change":"2023-07-09T21:39:02.211800+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.211800+0000","last_undegraded":"2023-07-09T21:39:02.211800+0000","last_fullsized":"2023-07-09T21:39:02.211800+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231766+0000","last_change":"2023-07-09T21:39:02.228316+0000","last_active":"2023-07-09T21:39:02.231766+0000","last_peered":"2023-07-09T21:39:02.231766+0000","last_clean":"2023-07-09T21:39:02.231766+0000","last_became_active":"2023-07-09T21:39:02.226731+0000","last_became_peered":"2023-07-09T21:39:02.226731+0000","last_unstale":"2023-07-09T21:39:02.231766+0000","last_undegraded":"2023-07-09T21:39:02.231766+0000","last_fullsized":"2023-07-09T21:39:02.231766+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:40.125453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.222234+0000","last_change":"2023-07-09T21:39:02.222234+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.222234+0000","last_undegraded":"2023-07-09T21:39:02.222234+0000","last_fullsized":"2023-07-09T21:39:02.222234+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.232021+0000","last_change":"2023-07-09T21:39:02.228630+0000","last_active":"2023-07-09T21:39:02.232021+0000","last_peered":"2023-07-09T21:39:02.232021+0000","last_clean":"2023-07-09T21:39:02.232021+0000","last_became_active":"2023-07-09T21:39:02.228368+0000","last_became_peered":"2023-07-09T21:39:02.228368+0000","last_unstale":"2023-07-09T21:39:02.232021+0000","last_undegraded":"2023-07-09T21:39:02.232021+0000","last_fullsized":"2023-07-09T21:39:02.232021+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:09.120871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216779+0000","last_change":"2023-07-09T21:39:02.216779+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216779+0000","last_undegraded":"2023-07-09T21:39:02.216779+0000","last_fullsized":"2023-07-09T21:39:02.216779+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234860+0000","last_change":"2023-07-09T21:39:02.230899+0000","last_active":"2023-07-09T21:39:02.234860+0000","last_peered":"2023-07-09T21:39:02.234860+0000","last_clean":"2023-07-09T21:39:02.234860+0000","last_became_active":"2023-07-09T21:39:02.230633+0000","last_became_peered":"2023-07-09T21:39:02.230633+0000","last_unstale":"2023-07-09T21:39:02.234860+0000","last_undegraded":"2023-07-09T21:39:02.234860+0000","last_fullsized":"2023-07-09T21:39:02.234860+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:45.796213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216717+0000","last_change":"2023-07-09T21:39:02.216717+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216717+0000","last_undegraded":"2023-07-09T21:39:02.216717+0000","last_fullsized":"2023-07-09T21:39:02.216717+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230794+0000","last_change":"2023-07-09T21:39:02.227440+0000","last_active":"2023-07-09T21:39:02.230794+0000","last_peered":"2023-07-09T21:39:02.230794+0000","last_clean":"2023-07-09T21:39:02.230794+0000","last_became_active":"2023-07-09T21:39:02.226934+0000","last_became_peered":"2023-07-09T21:39:02.226934+0000","last_unstale":"2023-07-09T21:39:02.230794+0000","last_undegraded":"2023-07-09T21:39:02.230794+0000","last_fullsized":"2023-07-09T21:39:02.230794+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:05.113406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217839+0000","last_change":"2023-07-09T21:39:02.217839+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217839+0000","last_undegraded":"2023-07-09T21:39:02.217839+0000","last_fullsized":"2023-07-09T21:39:02.217839+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227247+0000","last_change":"2023-07-09T21:39:02.224832+0000","last_active":"2023-07-09T21:39:02.227247+0000","last_peered":"2023-07-09T21:39:02.227247+0000","last_clean":"2023-07-09T21:39:02.227247+0000","last_became_active":"2023-07-09T21:39:02.224573+0000","last_became_peered":"2023-07-09T21:39:02.224573+0000","last_unstale":"2023-07-09T21:39:02.227247+0000","last_undegraded":"2023-07-09T21:39:02.227247+0000","last_fullsized":"2023-07-09T21:39:02.227247+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:20.098183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218499+0000","last_change":"2023-07-09T21:39:02.218499+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218499+0000","last_undegraded":"2023-07-09T21:39:02.218499+0000","last_fullsized":"2023-07-09T21:39:02.218499+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230618+0000","last_change":"2023-07-09T21:39:02.227857+0000","last_active":"2023-07-09T21:39:02.230618+0000","last_peered":"2023-07-09T21:39:02.230618+0000","last_clean":"2023-07-09T21:39:02.230618+0000","last_became_active":"2023-07-09T21:39:02.227555+0000","last_became_peered":"2023-07-09T21:39:02.227555+0000","last_unstale":"2023-07-09T21:39:02.230618+0000","last_undegraded":"2023-07-09T21:39:02.230618+0000","last_fullsized":"2023-07-09T21:39:02.230618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:31.134106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.219059+0000","last_change":"2023-07-09T21:39:02.219059+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.219059+0000","last_undegraded":"2023-07-09T21:39:02.219059+0000","last_fullsized":"2023-07-09T21:39:02.219059+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229624+0000","last_change":"2023-07-09T21:39:02.226076+0000","last_active":"2023-07-09T21:39:02.229624+0000","last_peered":"2023-07-09T21:39:02.229624+0000","last_clean":"2023-07-09T21:39:02.229624+0000","last_became_active":"2023-07-09T21:39:02.225796+0000","last_became_peered":"2023-07-09T21:39:02.225796+0000","last_unstale":"2023-07-09T21:39:02.229624+0000","last_undegraded":"2023-07-09T21:39:02.229624+0000","last_fullsized":"2023-07-09T21:39:02.229624+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:06.522078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217413+0000","last_change":"2023-07-09T21:39:02.217413+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217413+0000","last_undegraded":"2023-07-09T21:39:02.217413+0000","last_fullsized":"2023-07-09T21:39:02.217413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.237956+0000","last_change":"2023-07-09T21:39:02.235989+0000","last_active":"2023-07-09T21:39:02.237956+0000","last_peered":"2023-07-09T21:39:02.237956+0000","last_clean":"2023-07-09T21:39:02.237956+0000","last_became_active":"2023-07-09T21:39:02.235703+0000","last_became_peered":"2023-07-09T21:39:02.235703+0000","last_unstale":"2023-07-09T21:39:02.237956+0000","last_undegraded":"2023-07-09T21:39:02.237956+0000","last_fullsized":"2023-07-09T21:39:02.237956+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:12.356937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215180+0000","last_change":"2023-07-09T21:39:02.215180+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215180+0000","last_undegraded":"2023-07-09T21:39:02.215180+0000","last_fullsized":"2023-07-09T21:39:02.215180+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.236636+0000","last_change":"2023-07-09T21:39:02.232727+0000","last_active":"2023-07-09T21:39:02.236636+0000","last_peered":"2023-07-09T21:39:02.236636+0000","last_clean":"2023-07-09T21:39:02.236636+0000","last_became_active":"2023-07-09T21:39:02.232459+0000","last_became_peered":"2023-07-09T21:39:02.232459+0000","last_unstale":"2023-07-09T21:39:02.236636+0000","last_undegraded":"2023-07-09T21:39:02.236636+0000","last_fullsized":"2023-07-09T21:39:02.236636+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:15.384722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.218064+0000","last_change":"2023-07-09T21:39:02.218064+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.218064+0000","last_undegraded":"2023-07-09T21:39:02.218064+0000","last_fullsized":"2023-07-09T21:39:02.218064+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.235815+0000","last_change":"2023-07-09T21:39:02.233872+0000","last_active":"2023-07-09T21:39:02.235815+0000","last_peered":"2023-07-09T21:39:02.235815+0000","last_clean":"2023-07-09T21:39:02.235815+0000","last_became_active":"2023-07-09T21:39:02.233572+0000","last_became_peered":"2023-07-09T21:39:02.233572+0000","last_unstale":"2023-07-09T21:39:02.235815+0000","last_undegraded":"2023-07-09T21:39:02.235815+0000","last_fullsized":"2023-07-09T21:39:02.235815+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:34.202866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216197+0000","last_change":"2023-07-09T21:39:02.216197+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216197+0000","last_undegraded":"2023-07-09T21:39:02.216197+0000","last_fullsized":"2023-07-09T21:39:02.216197+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230774+0000","last_change":"2023-07-09T21:39:02.227372+0000","last_active":"2023-07-09T21:39:02.230774+0000","last_peered":"2023-07-09T21:39:02.230774+0000","last_clean":"2023-07-09T21:39:02.230774+0000","last_became_active":"2023-07-09T21:39:02.226984+0000","last_became_peered":"2023-07-09T21:39:02.226984+0000","last_unstale":"2023-07-09T21:39:02.230774+0000","last_undegraded":"2023-07-09T21:39:02.230774+0000","last_fullsized":"2023-07-09T21:39:02.230774+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:43.210469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210842+0000","last_change":"2023-07-09T21:39:02.210842+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210842+0000","last_undegraded":"2023-07-09T21:39:02.210842+0000","last_fullsized":"2023-07-09T21:39:02.210842+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.234068+0000","last_change":"2023-07-09T21:39:02.231774+0000","last_active":"2023-07-09T21:39:02.234068+0000","last_peered":"2023-07-09T21:39:02.234068+0000","last_clean":"2023-07-09T21:39:02.234068+0000","last_became_active":"2023-07-09T21:39:02.231437+0000","last_became_peered":"2023-07-09T21:39:02.231437+0000","last_unstale":"2023-07-09T21:39:02.234068+0000","last_undegraded":"2023-07-09T21:39:02.234068+0000","last_fullsized":"2023-07-09T21:39:02.234068+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:13.486658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.210300+0000","last_change":"2023-07-09T21:39:02.210300+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.210300+0000","last_undegraded":"2023-07-09T21:39:02.210300+0000","last_fullsized":"2023-07-09T21:39:02.210300+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.222092+0000","last_change":"2023-07-09T21:39:02.220149+0000","last_active":"2023-07-09T21:39:02.222092+0000","last_peered":"2023-07-09T21:39:02.222092+0000","last_clean":"2023-07-09T21:39:02.222092+0000","last_became_active":"2023-07-09T21:39:02.219868+0000","last_became_peered":"2023-07-09T21:39:02.219868+0000","last_unstale":"2023-07-09T21:39:02.222092+0000","last_undegraded":"2023-07-09T21:39:02.222092+0000","last_fullsized":"2023-07-09T21:39:02.222092+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:50.960195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.225043+0000","last_change":"2023-07-09T21:39:02.225043+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.225043+0000","last_undegraded":"2023-07-09T21:39:02.225043+0000","last_fullsized":"2023-07-09T21:39:02.225043+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227953+0000","last_change":"2023-07-09T21:39:02.225583+0000","last_active":"2023-07-09T21:39:02.227953+0000","last_peered":"2023-07-09T21:39:02.227953+0000","last_clean":"2023-07-09T21:39:02.227953+0000","last_became_active":"2023-07-09T21:39:02.225277+0000","last_became_peered":"2023-07-09T21:39:02.225277+0000","last_unstale":"2023-07-09T21:39:02.227953+0000","last_undegraded":"2023-07-09T21:39:02.227953+0000","last_fullsized":"2023-07-09T21:39:02.227953+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:08.336460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"87'183","reported_seq":545,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227613+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:02.227613+0000","last_peered":"2023-07-09T21:39:02.227613+0000","last_clean":"2023-07-09T21:39:02.227613+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:02.227613+0000","last_undegraded":"2023-07-09T21:39:02.227613+0000","last_fullsized":"2023-07-09T21:39:02.227613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:23:25.605320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":174,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224490+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:02.224490+0000","last_peered":"2023-07-09T21:39:02.224490+0000","last_clean":"2023-07-09T21:39:02.224490+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:02.224490+0000","last_undegraded":"2023-07-09T21:39:02.224490+0000","last_fullsized":"2023-07-09T21:39:02.224490+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:09.851052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216086+0000","last_change":"2023-07-09T21:39:02.216086+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216086+0000","last_undegraded":"2023-07-09T21:39:02.216086+0000","last_fullsized":"2023-07-09T21:39:02.216086+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.229663+0000","last_change":"2023-07-09T21:39:02.226362+0000","last_active":"2023-07-09T21:39:02.229663+0000","last_peered":"2023-07-09T21:39:02.229663+0000","last_clean":"2023-07-09T21:39:02.229663+0000","last_became_active":"2023-07-09T21:39:02.225863+0000","last_became_peered":"2023-07-09T21:39:02.225863+0000","last_unstale":"2023-07-09T21:39:02.229663+0000","last_undegraded":"2023-07-09T21:39:02.229663+0000","last_fullsized":"2023-07-09T21:39:02.229663+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:30.581274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":155,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227483+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:02.227483+0000","last_peered":"2023-07-09T21:39:02.227483+0000","last_clean":"2023-07-09T21:39:02.227483+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:02.227483+0000","last_undegraded":"2023-07-09T21:39:02.227483+0000","last_fullsized":"2023-07-09T21:39:02.227483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:19.445522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.217305+0000","last_change":"2023-07-09T21:39:02.217305+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.217305+0000","last_undegraded":"2023-07-09T21:39:02.217305+0000","last_fullsized":"2023-07-09T21:39:02.217305+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228135+0000","last_change":"2023-07-09T21:39:02.225573+0000","last_active":"2023-07-09T21:39:02.228135+0000","last_peered":"2023-07-09T21:39:02.228135+0000","last_clean":"2023-07-09T21:39:02.228135+0000","last_became_active":"2023-07-09T21:39:02.225239+0000","last_became_peered":"2023-07-09T21:39:02.225239+0000","last_unstale":"2023-07-09T21:39:02.228135+0000","last_undegraded":"2023-07-09T21:39:02.228135+0000","last_fullsized":"2023-07-09T21:39:02.228135+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:20.466091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":151,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.209801+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:02.209801+0000","last_peered":"2023-07-09T21:39:02.209801+0000","last_clean":"2023-07-09T21:39:02.209801+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:02.209801+0000","last_undegraded":"2023-07-09T21:39:02.209801+0000","last_fullsized":"2023-07-09T21:39:02.209801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:31.653817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.214220+0000","last_change":"2023-07-09T21:39:02.214220+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.214220+0000","last_undegraded":"2023-07-09T21:39:02.214220+0000","last_fullsized":"2023-07-09T21:39:02.214220+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.228100+0000","last_change":"2023-07-09T21:39:02.218979+0000","last_active":"2023-07-09T21:39:02.228100+0000","last_peered":"2023-07-09T21:39:02.228100+0000","last_clean":"2023-07-09T21:39:02.228100+0000","last_became_active":"2023-07-09T21:39:02.218641+0000","last_became_peered":"2023-07-09T21:39:02.218641+0000","last_unstale":"2023-07-09T21:39:02.228100+0000","last_undegraded":"2023-07-09T21:39:02.228100+0000","last_fullsized":"2023-07-09T21:39:02.228100+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:31.379477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":175,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.224665+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:02.224665+0000","last_peered":"2023-07-09T21:39:02.224665+0000","last_clean":"2023-07-09T21:39:02.224665+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:02.224665+0000","last_undegraded":"2023-07-09T21:39:02.224665+0000","last_fullsized":"2023-07-09T21:39:02.224665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.581480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216864+0000","last_change":"2023-07-09T21:39:02.216864+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216864+0000","last_undegraded":"2023-07-09T21:39:02.216864+0000","last_fullsized":"2023-07-09T21:39:02.216864+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.227285+0000","last_change":"2023-07-09T21:39:02.226536+0000","last_active":"2023-07-09T21:39:02.227285+0000","last_peered":"2023-07-09T21:39:02.227285+0000","last_clean":"2023-07-09T21:39:02.227285+0000","last_became_active":"2023-07-09T21:39:02.226268+0000","last_became_peered":"2023-07-09T21:39:02.226268+0000","last_unstale":"2023-07-09T21:39:02.227285+0000","last_undegraded":"2023-07-09T21:39:02.227285+0000","last_fullsized":"2023-07-09T21:39:02.227285+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:50.476167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211482+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:02.211482+0000","last_peered":"2023-07-09T21:39:02.211482+0000","last_clean":"2023-07-09T21:39:02.211482+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:02.211482+0000","last_undegraded":"2023-07-09T21:39:02.211482+0000","last_fullsized":"2023-07-09T21:39:02.211482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:53.777754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.213902+0000","last_change":"2023-07-09T21:39:02.213902+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.213902+0000","last_undegraded":"2023-07-09T21:39:02.213902+0000","last_fullsized":"2023-07-09T21:39:02.213902+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.226660+0000","last_change":"2023-07-09T21:39:02.224587+0000","last_active":"2023-07-09T21:39:02.226660+0000","last_peered":"2023-07-09T21:39:02.226660+0000","last_clean":"2023-07-09T21:39:02.226660+0000","last_became_active":"2023-07-09T21:39:02.224283+0000","last_became_peered":"2023-07-09T21:39:02.224283+0000","last_unstale":"2023-07-09T21:39:02.226660+0000","last_undegraded":"2023-07-09T21:39:02.226660+0000","last_fullsized":"2023-07-09T21:39:02.226660+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:16:34.525255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":154,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.230529+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:02.230529+0000","last_peered":"2023-07-09T21:39:02.230529+0000","last_clean":"2023-07-09T21:39:02.230529+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:02.230529+0000","last_undegraded":"2023-07-09T21:39:02.230529+0000","last_fullsized":"2023-07-09T21:39:02.230529+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:44.509992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.216570+0000","last_change":"2023-07-09T21:39:02.216570+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.216570+0000","last_undegraded":"2023-07-09T21:39:02.216570+0000","last_fullsized":"2023-07-09T21:39:02.216570+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.240541+0000","last_change":"2023-07-09T21:39:02.236493+0000","last_active":"2023-07-09T21:39:02.240541+0000","last_peered":"2023-07-09T21:39:02.240541+0000","last_clean":"2023-07-09T21:39:02.240541+0000","last_became_active":"2023-07-09T21:39:02.236157+0000","last_became_peered":"2023-07-09T21:39:02.236157+0000","last_unstale":"2023-07-09T21:39:02.240541+0000","last_undegraded":"2023-07-09T21:39:02.240541+0000","last_fullsized":"2023-07-09T21:39:02.240541+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:50.440172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":146,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.211581+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:02.211581+0000","last_peered":"2023-07-09T21:39:02.211581+0000","last_clean":"2023-07-09T21:39:02.211581+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:02.211581+0000","last_undegraded":"2023-07-09T21:39:02.211581+0000","last_fullsized":"2023-07-09T21:39:02.211581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:48.896201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":97,"state":"creating+peering","last_fresh":"2023-07-09T21:39:02.215876+0000","last_change":"2023-07-09T21:39:02.215876+0000","last_active":"2023-07-09T21:39:02.196558+0000","last_peered":"2023-07-09T21:39:02.196558+0000","last_clean":"2023-07-09T21:39:02.196558+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:02.215876+0000","last_undegraded":"2023-07-09T21:39:02.215876+0000","last_fullsized":"2023-07-09T21:39:02.215876+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.231908+0000","last_change":"2023-07-09T21:39:02.228812+0000","last_active":"2023-07-09T21:39:02.231908+0000","last_peered":"2023-07-09T21:39:02.231908+0000","last_clean":"2023-07-09T21:39:02.231908+0000","last_became_active":"2023-07-09T21:39:02.228542+0000","last_became_peered":"2023-07-09T21:39:02.228542+0000","last_unstale":"2023-07-09T21:39:02.231908+0000","last_undegraded":"2023-07-09T21:39:02.231908+0000","last_fullsized":"2023-07-09T21:39:02.231908+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:58:03.631954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":152,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-07-09T21:39:02.217087+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:02.217087+0000","last_peered":"2023-07-09T21:39:02.217087+0000","last_clean":"2023-07-09T21:39:02.217087+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:02.217087+0000","last_undegraded":"2023-07-09T21:39:02.217087+0000","last_fullsized":"2023-07-09T21:39:02.217087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:27.216990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575050,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59024,"kb_used_data":1736,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312816,"statfs":{"total":96636764160,"available":96576323584,"internally_reserved":0,"allocated":1777664,"data_stored":1184877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.72499999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.65100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.93400000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.75}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.876},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.85799999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575049,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.90600000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.89100000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.875},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.96499999999999997}]}]},{"osd":5,"up_from":13,"seq":55834575048,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50240,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321600,"statfs":{"total":96636764160,"available":96585318400,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.86599999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.70299999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.751},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.77100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78500000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.502}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.71299999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.81200000000000006}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.42699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575049,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.503}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.748}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.65300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834575050,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54336,"kb_used_data":1144,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317504,"statfs":{"total":96636764160,"available":96581124096,"internally_reserved":0,"allocated":1171456,"data_stored":587881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.501},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.625},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.75800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.77700000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.65600000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32204,"kb_used_data":1156,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1183744,"data_stored":594509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.442},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38300000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.45800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.64700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.59199999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575050,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36868,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334972,"statfs":{"total":96636764160,"available":96599011328,"internally_reserved":0,"allocated":1765376,"data_stored":1178249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.503},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.87}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.73899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.90500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.089},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.0009999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.92700000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.115},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.81799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:08.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-07-09T21:39:08.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.225355+0000', 'last_change': '2023-07-09T21:39:02.225355+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.225355+0000', 'last_undegraded': '2023-07-09T21:39:02.225355+0000', 'last_fullsized': '2023-07-09T21:39:02.225355+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-07-09T21:39:08.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.222371+0000', 'last_change': '2023-07-09T21:39:02.222371+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.222371+0000', 'last_undegraded': '2023-07-09T21:39:02.222371+0000', 'last_fullsized': '2023-07-09T21:39:02.222371+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3d is not active+clean 2023-07-09T21:39:08.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.211006+0000', 'last_change': '2023-07-09T21:39:02.211006+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.211006+0000', 'last_undegraded': '2023-07-09T21:39:02.211006+0000', 'last_fullsized': '2023-07-09T21:39:02.211006+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-07-09T21:39:08.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.223256+0000', 'last_change': '2023-07-09T21:39:02.223256+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.223256+0000', 'last_undegraded': '2023-07-09T21:39:02.223256+0000', 'last_fullsized': '2023-07-09T21:39:02.223256+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-07-09T21:39:08.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213869+0000', 'last_change': '2023-07-09T21:39:02.213869+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213869+0000', 'last_undegraded': '2023-07-09T21:39:02.213869+0000', 'last_fullsized': '2023-07-09T21:39:02.213869+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-07-09T21:39:08.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.215142+0000', 'last_change': '2023-07-09T21:39:02.215142+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.215142+0000', 'last_undegraded': '2023-07-09T21:39:02.215142+0000', 'last_fullsized': '2023-07-09T21:39:02.215142+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.39 is not active+clean 2023-07-09T21:39:08.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.219594+0000', 'last_change': '2023-07-09T21:39:02.219594+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.219594+0000', 'last_undegraded': '2023-07-09T21:39:02.219594+0000', 'last_fullsized': '2023-07-09T21:39:02.219594+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-07-09T21:39:08.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213557+0000', 'last_change': '2023-07-09T21:39:02.213557+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213557+0000', 'last_undegraded': '2023-07-09T21:39:02.213557+0000', 'last_fullsized': '2023-07-09T21:39:02.213557+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.37 is not active+clean 2023-07-09T21:39:08.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.219650+0000', 'last_change': '2023-07-09T21:39:02.219650+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.219650+0000', 'last_undegraded': '2023-07-09T21:39:02.219650+0000', 'last_fullsized': '2023-07-09T21:39:02.219650+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-07-09T21:39:08.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.223620+0000', 'last_change': '2023-07-09T21:39:02.223620+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.223620+0000', 'last_undegraded': '2023-07-09T21:39:02.223620+0000', 'last_fullsized': '2023-07-09T21:39:02.223620+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-07-09T21:39:08.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221732+0000', 'last_change': '2023-07-09T21:39:02.221732+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221732+0000', 'last_undegraded': '2023-07-09T21:39:02.221732+0000', 'last_fullsized': '2023-07-09T21:39:02.221732+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-07-09T21:39:08.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.222788+0000', 'last_change': '2023-07-09T21:39:02.222788+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.222788+0000', 'last_undegraded': '2023-07-09T21:39:02.222788+0000', 'last_fullsized': '2023-07-09T21:39:02.222788+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-07-09T21:39:08.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213354+0000', 'last_change': '2023-07-09T21:39:02.213354+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213354+0000', 'last_undegraded': '2023-07-09T21:39:02.213354+0000', 'last_fullsized': '2023-07-09T21:39:02.213354+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-07-09T21:39:08.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.214696+0000', 'last_change': '2023-07-09T21:39:02.214696+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.214696+0000', 'last_undegraded': '2023-07-09T21:39:02.214696+0000', 'last_fullsized': '2023-07-09T21:39:02.214696+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-07-09T21:39:08.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221615+0000', 'last_change': '2023-07-09T21:39:02.221615+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221615+0000', 'last_undegraded': '2023-07-09T21:39:02.221615+0000', 'last_fullsized': '2023-07-09T21:39:02.221615+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-07-09T21:39:08.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.227141+0000', 'last_change': '2023-07-09T21:39:02.227141+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.227141+0000', 'last_undegraded': '2023-07-09T21:39:02.227141+0000', 'last_fullsized': '2023-07-09T21:39:02.227141+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-07-09T21:39:08.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.215426+0000', 'last_change': '2023-07-09T21:39:02.215426+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.215426+0000', 'last_undegraded': '2023-07-09T21:39:02.215426+0000', 'last_fullsized': '2023-07-09T21:39:02.215426+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2e is not active+clean 2023-07-09T21:39:08.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.211335+0000', 'last_change': '2023-07-09T21:39:02.211335+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.211335+0000', 'last_undegraded': '2023-07-09T21:39:02.211335+0000', 'last_fullsized': '2023-07-09T21:39:02.211335+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-07-09T21:39:08.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213617+0000', 'last_change': '2023-07-09T21:39:02.213617+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213617+0000', 'last_undegraded': '2023-07-09T21:39:02.213617+0000', 'last_fullsized': '2023-07-09T21:39:02.213617+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-07-09T21:39:08.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213931+0000', 'last_change': '2023-07-09T21:39:02.213931+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213931+0000', 'last_undegraded': '2023-07-09T21:39:02.213931+0000', 'last_fullsized': '2023-07-09T21:39:02.213931+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2b is not active+clean 2023-07-09T21:39:08.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.222060+0000', 'last_change': '2023-07-09T21:39:02.222060+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.222060+0000', 'last_undegraded': '2023-07-09T21:39:02.222060+0000', 'last_fullsized': '2023-07-09T21:39:02.222060+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-07-09T21:39:08.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.217408+0000', 'last_change': '2023-07-09T21:39:02.217408+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.217408+0000', 'last_undegraded': '2023-07-09T21:39:02.217408+0000', 'last_fullsized': '2023-07-09T21:39:02.217408+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.29 is not active+clean 2023-07-09T21:39:08.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.218958+0000', 'last_change': '2023-07-09T21:39:02.218958+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.218958+0000', 'last_undegraded': '2023-07-09T21:39:02.218958+0000', 'last_fullsized': '2023-07-09T21:39:02.218958+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-07-09T21:39:08.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221232+0000', 'last_change': '2023-07-09T21:39:02.221232+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221232+0000', 'last_undegraded': '2023-07-09T21:39:02.221232+0000', 'last_fullsized': '2023-07-09T21:39:02.221232+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-07-09T21:39:08.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221130+0000', 'last_change': '2023-07-09T21:39:02.221130+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221130+0000', 'last_undegraded': '2023-07-09T21:39:02.221130+0000', 'last_fullsized': '2023-07-09T21:39:02.221130+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-07-09T21:39:08.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.223054+0000', 'last_change': '2023-07-09T21:39:02.223054+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.223054+0000', 'last_undegraded': '2023-07-09T21:39:02.223054+0000', 'last_fullsized': '2023-07-09T21:39:02.223054+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-07-09T21:39:08.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.228433+0000', 'last_change': '2023-07-09T21:39:02.228433+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.228433+0000', 'last_undegraded': '2023-07-09T21:39:02.228433+0000', 'last_fullsized': '2023-07-09T21:39:02.228433+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-07-09T21:39:08.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213388+0000', 'last_change': '2023-07-09T21:39:02.213388+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213388+0000', 'last_undegraded': '2023-07-09T21:39:02.213388+0000', 'last_fullsized': '2023-07-09T21:39:02.213388+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-07-09T21:39:08.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221220+0000', 'last_change': '2023-07-09T21:39:02.221220+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221220+0000', 'last_undegraded': '2023-07-09T21:39:02.221220+0000', 'last_fullsized': '2023-07-09T21:39:02.221220+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-07-09T21:39:08.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.223021+0000', 'last_change': '2023-07-09T21:39:02.223021+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.223021+0000', 'last_undegraded': '2023-07-09T21:39:02.223021+0000', 'last_fullsized': '2023-07-09T21:39:02.223021+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.21 is not active+clean 2023-07-09T21:39:08.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.210665+0000', 'last_change': '2023-07-09T21:39:02.210665+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.210665+0000', 'last_undegraded': '2023-07-09T21:39:02.210665+0000', 'last_fullsized': '2023-07-09T21:39:02.210665+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-07-09T21:39:08.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.224303+0000', 'last_change': '2023-07-09T21:39:02.224303+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.224303+0000', 'last_undegraded': '2023-07-09T21:39:02.224303+0000', 'last_fullsized': '2023-07-09T21:39:02.224303+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-07-09T21:39:08.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.210483+0000', 'last_change': '2023-07-09T21:39:02.210483+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.210483+0000', 'last_undegraded': '2023-07-09T21:39:02.210483+0000', 'last_fullsized': '2023-07-09T21:39:02.210483+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-07-09T21:39:08.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.214334+0000', 'last_change': '2023-07-09T21:39:02.214334+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.214334+0000', 'last_undegraded': '2023-07-09T21:39:02.214334+0000', 'last_fullsized': '2023-07-09T21:39:02.214334+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-07-09T21:39:08.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.217981+0000', 'last_change': '2023-07-09T21:39:02.217981+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.217981+0000', 'last_undegraded': '2023-07-09T21:39:02.217981+0000', 'last_fullsized': '2023-07-09T21:39:02.217981+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-07-09T21:39:08.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221562+0000', 'last_change': '2023-07-09T21:39:02.221562+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221562+0000', 'last_undegraded': '2023-07-09T21:39:02.221562+0000', 'last_fullsized': '2023-07-09T21:39:02.221562+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-07-09T21:39:08.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.214704+0000', 'last_change': '2023-07-09T21:39:02.214704+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.214704+0000', 'last_undegraded': '2023-07-09T21:39:02.214704+0000', 'last_fullsized': '2023-07-09T21:39:02.214704+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-07-09T21:39:08.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.219127+0000', 'last_change': '2023-07-09T21:39:02.219127+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.219127+0000', 'last_undegraded': '2023-07-09T21:39:02.219127+0000', 'last_fullsized': '2023-07-09T21:39:02.219127+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-07-09T21:39:08.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.218267+0000', 'last_change': '2023-07-09T21:39:02.218267+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.218267+0000', 'last_undegraded': '2023-07-09T21:39:02.218267+0000', 'last_fullsized': '2023-07-09T21:39:02.218267+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-07-09T21:39:08.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.218261+0000', 'last_change': '2023-07-09T21:39:02.218261+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.218261+0000', 'last_undegraded': '2023-07-09T21:39:02.218261+0000', 'last_fullsized': '2023-07-09T21:39:02.218261+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-07-09T21:39:08.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216008+0000', 'last_change': '2023-07-09T21:39:02.216008+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216008+0000', 'last_undegraded': '2023-07-09T21:39:02.216008+0000', 'last_fullsized': '2023-07-09T21:39:02.216008+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-07-09T21:39:08.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.221923+0000', 'last_change': '2023-07-09T21:39:02.221923+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.221923+0000', 'last_undegraded': '2023-07-09T21:39:02.221923+0000', 'last_fullsized': '2023-07-09T21:39:02.221923+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-07-09T21:39:08.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.214233+0000', 'last_change': '2023-07-09T21:39:02.214233+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.214233+0000', 'last_undegraded': '2023-07-09T21:39:02.214233+0000', 'last_fullsized': '2023-07-09T21:39:02.214233+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-07-09T21:39:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.211800+0000', 'last_change': '2023-07-09T21:39:02.211800+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.211800+0000', 'last_undegraded': '2023-07-09T21:39:02.211800+0000', 'last_fullsized': '2023-07-09T21:39:02.211800+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-07-09T21:39:08.165 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.222234+0000', 'last_change': '2023-07-09T21:39:02.222234+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.222234+0000', 'last_undegraded': '2023-07-09T21:39:02.222234+0000', 'last_fullsized': '2023-07-09T21:39:02.222234+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:08.166 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-07-09T21:39:08.166 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216779+0000', 'last_change': '2023-07-09T21:39:02.216779+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216779+0000', 'last_undegraded': '2023-07-09T21:39:02.216779+0000', 'last_fullsized': '2023-07-09T21:39:02.216779+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-07-09T21:39:08.167 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216717+0000', 'last_change': '2023-07-09T21:39:02.216717+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216717+0000', 'last_undegraded': '2023-07-09T21:39:02.216717+0000', 'last_fullsized': '2023-07-09T21:39:02.216717+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.167 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-07-09T21:39:08.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.217839+0000', 'last_change': '2023-07-09T21:39:02.217839+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.217839+0000', 'last_undegraded': '2023-07-09T21:39:02.217839+0000', 'last_fullsized': '2023-07-09T21:39:02.217839+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.168 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-07-09T21:39:08.168 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.218499+0000', 'last_change': '2023-07-09T21:39:02.218499+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.218499+0000', 'last_undegraded': '2023-07-09T21:39:02.218499+0000', 'last_fullsized': '2023-07-09T21:39:02.218499+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-07-09T21:39:08.169 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.219059+0000', 'last_change': '2023-07-09T21:39:02.219059+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.219059+0000', 'last_undegraded': '2023-07-09T21:39:02.219059+0000', 'last_fullsized': '2023-07-09T21:39:02.219059+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.169 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-07-09T21:39:08.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.217413+0000', 'last_change': '2023-07-09T21:39:02.217413+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.217413+0000', 'last_undegraded': '2023-07-09T21:39:02.217413+0000', 'last_fullsized': '2023-07-09T21:39:02.217413+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:08.170 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-07-09T21:39:08.170 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.215180+0000', 'last_change': '2023-07-09T21:39:02.215180+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.215180+0000', 'last_undegraded': '2023-07-09T21:39:02.215180+0000', 'last_fullsized': '2023-07-09T21:39:02.215180+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-07-09T21:39:08.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.218064+0000', 'last_change': '2023-07-09T21:39:02.218064+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.218064+0000', 'last_undegraded': '2023-07-09T21:39:02.218064+0000', 'last_fullsized': '2023-07-09T21:39:02.218064+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-07-09T21:39:08.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216197+0000', 'last_change': '2023-07-09T21:39:02.216197+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216197+0000', 'last_undegraded': '2023-07-09T21:39:02.216197+0000', 'last_fullsized': '2023-07-09T21:39:02.216197+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-07-09T21:39:08.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.210842+0000', 'last_change': '2023-07-09T21:39:02.210842+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.210842+0000', 'last_undegraded': '2023-07-09T21:39:02.210842+0000', 'last_fullsized': '2023-07-09T21:39:02.210842+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-07-09T21:39:08.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.210300+0000', 'last_change': '2023-07-09T21:39:02.210300+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.210300+0000', 'last_undegraded': '2023-07-09T21:39:02.210300+0000', 'last_fullsized': '2023-07-09T21:39:02.210300+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:08.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-07-09T21:39:08.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.225043+0000', 'last_change': '2023-07-09T21:39:02.225043+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.225043+0000', 'last_undegraded': '2023-07-09T21:39:02.225043+0000', 'last_fullsized': '2023-07-09T21:39:02.225043+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:08.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-07-09T21:39:08.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216086+0000', 'last_change': '2023-07-09T21:39:02.216086+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216086+0000', 'last_undegraded': '2023-07-09T21:39:02.216086+0000', 'last_fullsized': '2023-07-09T21:39:02.216086+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-07-09T21:39:08.175 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.217305+0000', 'last_change': '2023-07-09T21:39:02.217305+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.217305+0000', 'last_undegraded': '2023-07-09T21:39:02.217305+0000', 'last_fullsized': '2023-07-09T21:39:02.217305+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:08.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-07-09T21:39:08.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.214220+0000', 'last_change': '2023-07-09T21:39:02.214220+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.214220+0000', 'last_undegraded': '2023-07-09T21:39:02.214220+0000', 'last_fullsized': '2023-07-09T21:39:02.214220+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:08.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-07-09T21:39:08.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216864+0000', 'last_change': '2023-07-09T21:39:02.216864+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216864+0000', 'last_undegraded': '2023-07-09T21:39:02.216864+0000', 'last_fullsized': '2023-07-09T21:39:02.216864+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-07-09T21:39:08.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.213902+0000', 'last_change': '2023-07-09T21:39:02.213902+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.213902+0000', 'last_undegraded': '2023-07-09T21:39:02.213902+0000', 'last_fullsized': '2023-07-09T21:39:02.213902+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-07-09T21:39:08.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.216570+0000', 'last_change': '2023-07-09T21:39:02.216570+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.216570+0000', 'last_undegraded': '2023-07-09T21:39:02.216570+0000', 'last_fullsized': '2023-07-09T21:39:02.216570+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:08.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-07-09T21:39:08.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 97, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:02.215876+0000', 'last_change': '2023-07-09T21:39:02.215876+0000', 'last_active': '2023-07-09T21:39:02.196558+0000', 'last_peered': '2023-07-09T21:39:02.196558+0000', 'last_clean': '2023-07-09T21:39:02.196558+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:02.215876+0000', 'last_undegraded': '2023-07-09T21:39:02.215876+0000', 'last_fullsized': '2023-07-09T21:39:02.215876+0000', 'mapping_epoch': 97, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 97, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:02.196558+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:08.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:39:08.190 INFO:tasks.ceph.mds.b.smithi119.stderr:2023-07-09T21:39:08.194+0000 7fd1b1f3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:39:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 Processor -- start 2023-07-09T21:39:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 -- start start 2023-07-09T21:39:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f7c0b4340 0x7f6f7c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c0b49f0 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f7c0cc8a0 con 0x7f6f7c0cef80 2023-07-09T21:39:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f81982640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7c0b7e80 con 0x7f6f7c0b4340 2023-07-09T21:39:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f7affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f7c0b7ab0 0x7f6f7c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39050/0 (socket says 172.21.15.37:39050) 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.322+0000 7f6f7affd640 1 -- 172.21.15.37:0/2748134559 learned_addr learned my addr 172.21.15.37:0/2748134559 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f7a7fc640 1 --2- 172.21.15.37:0/2748134559 >> v2:172.21.15.37:3300/0 conn(0x7f6f7c0b4340 0x7f6f7c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f79ffb640 1 -- 172.21.15.37:0/2748134559 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227734029 0 0) 0x7f6f7c0b49f0 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/2748134559 >> v1:172.21.15.119:6789/0 conn(0x7f6f7c0cef80 legacy=0x7f6f7c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/2748134559 >> v1:172.21.15.37:6789/0 conn(0x7f6f7c0b7ab0 legacy=0x7f6f7c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/2748134559 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c0ccb80 con 0x7f6f7c0b4340 2023-07-09T21:39:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f7a7fc640 1 --2- 172.21.15.37:0/2748134559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b4340 0x7f6f7c06aa50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d74acfa5841726 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f79ffb640 1 -- 172.21.15.37:0/2748134559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700ab610 con 0x7f6f7c0b4340 2023-07-09T21:39:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f79ffb640 1 -- 172.21.15.37:0/2748134559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700ab770 con 0x7f6f7c0b4340 2023-07-09T21:39:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f79ffb640 1 -- 172.21.15.37:0/2748134559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f700abb00 con 0x7f6f7c0b4340 2023-07-09T21:39:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f81982640 1 -- 172.21.15.37:0/2748134559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b4340 msgr2=0x7f6f7c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.326+0000 7f6f81982640 1 --2- 172.21.15.37:0/2748134559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b4340 0x7f6f7c06aa50 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001c410 comp rx=0 tx=0).stop 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- 172.21.15.37:0/2748134559 shutdown_connections 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 --2- 172.21.15.37:0/2748134559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b4340 0x7f6f7c06aa50 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- 172.21.15.37:0/2748134559 >> 172.21.15.37:0/2748134559 conn(0x7f6f7c073090 msgr2=0x7f6f7c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- 172.21.15.37:0/2748134559 shutdown_connections 2023-07-09T21:39:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- 172.21.15.37:0/2748134559 wait complete. 2023-07-09T21:39:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 Processor -- start 2023-07-09T21:39:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- start start 2023-07-09T21:39:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 0x7f6f7c1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 0x7f6f7c150980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c155540 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c1557e0 con 0x7f6f7c0cef80 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f81982640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7c155ac0 con 0x7f6f7c0b4340 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59544/0 (socket says 172.21.15.37:59544) 2023-07-09T21:39:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/1811741709 learned_addr learned my addr 172.21.15.37:0/1811741709 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7affd640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 0x7f6f7c1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 msgr2=0x7f6f7c1562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7b7fe640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 0x7f6f7c150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 0x7f6f7c1562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 msgr2=0x7f6f7c150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 0x7f6f7c150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7a7fc640 1 -- 172.21.15.37:0/1811741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f70009420 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7affd640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 0x7f6f7c1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.330+0000 7f6f7b7fe640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 0x7f6f7c150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f7a7fc640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70004220 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f700b9070 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f7c155da0 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70003620 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7c147040 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f7c04d7d0 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6f70003990 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 0x7f6f68068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6f700bb070 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.334+0000 7f6f7affd640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 0x7f6f68068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.338+0000 7f6f7affd640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 0x7f6f68068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000f70 tx=0x7f6f6c009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.338+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f700ebea0 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.546+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6f7c06a830 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.546+0000 7f6f63fff640 1 -- 172.21.15.37:0/1811741709 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3231 (secure 0 0 0) 0x7f6f700c4080 con 0x7f6f7c0b7ab0 2023-07-09T21:39:08.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:08.552 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1023,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":99,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":337174528,"bytes_avail":772756938752,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":40,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":7341}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":10,"modified":"2023-07-09T21:38:50.874408+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:39:08.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 msgr2=0x7f6f68068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 0x7f6f68068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c000f70 tx=0x7f6f6c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:08.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 msgr2=0x7f6f7c0c4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f6f700097c0 tx=0x7f6f7001ac50 comp rx=0 tx=0).stop 2023-07-09T21:39:08.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 shutdown_connections 2023-07-09T21:39:08.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f6f680663d0 0x7f6f68068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f7c0cef80 0x7f6f7c150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f7c0b7ab0 0x7f6f7c0c4dd0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 --2- 172.21.15.37:0/1811741709 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f7c0b4340 0x7f6f7c1562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 >> 172.21.15.37:0/1811741709 conn(0x7f6f7c073090 msgr2=0x7f6f7c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 shutdown_connections 2023-07-09T21:39:08.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.550+0000 7f6f81982640 1 -- 172.21.15.37:0/1811741709 wait complete. 2023-07-09T21:39:08.572 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:39:08.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.710+0000 7f8d2bb82640 1 Processor -- start 2023-07-09T21:39:08.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.710+0000 7f8d2bb82640 1 -- start start 2023-07-09T21:39:08.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d24158670 0x7f8d240ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 0x7f8d240af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2406d390 con 0x7f8d24158670 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d2406efc0 con 0x7f8d2406b120 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2bb82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2406f4f0 con 0x7f8d2406caa0 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d24158670 0x7f8d240ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8d24158670 0x7f8d240ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59554/0 (socket says 172.21.15.37:59554) 2023-07-09T21:39:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 -- 172.21.15.37:0/2694075287 learned_addr learned my addr 172.21.15.37:0/2694075287 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 -- 172.21.15.37:0/2694075287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 msgr2=0x7f8d240afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:08.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 --2- 172.21.15.37:0/2694075287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 -- 172.21.15.37:0/2694075287 >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 msgr2=0x7f8d240af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2911d640 1 --2- 172.21.15.37:0/2694075287 >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 0x7f8d240af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 --2- 172.21.15.37:0/2694075287 >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 0x7f8d240af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 -- 172.21.15.37:0/2694075287 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2406fe90 con 0x7f8d24158670 2023-07-09T21:39:08.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2911d640 1 --2- 172.21.15.37:0/2694075287 >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 0x7f8d240af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.714+0000 7f8d2991e640 1 --2- 172.21.15.37:0/2694075287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d24158670 0x7f8d240ca2f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8d2406aeb0 tx=0x7f8d2001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ed88fe57c4e3cc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2891c640 1 -- 172.21.15.37:0/2694075287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200ac640 con 0x7f8d24158670 2023-07-09T21:39:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2891c640 1 -- 172.21.15.37:0/2694075287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200ac7a0 con 0x7f8d24158670 2023-07-09T21:39:08.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2891c640 1 -- 172.21.15.37:0/2694075287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200acb30 con 0x7f8d24158670 2023-07-09T21:39:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- 172.21.15.37:0/2694075287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d24158670 msgr2=0x7f8d240ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/2694075287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d24158670 0x7f8d240ca2f0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8d2406aeb0 tx=0x7f8d2001c440 comp rx=0 tx=0).stop 2023-07-09T21:39:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- 172.21.15.37:0/2694075287 shutdown_connections 2023-07-09T21:39:08.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/2694075287 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/2694075287 >> v2:172.21.15.119:3300/0 conn(0x7f8d2406b120 0x7f8d240af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/2694075287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d24158670 0x7f8d240ca2f0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- 172.21.15.37:0/2694075287 >> 172.21.15.37:0/2694075287 conn(0x7f8d240ca830 msgr2=0x7f8d240cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- 172.21.15.37:0/2694075287 shutdown_connections 2023-07-09T21:39:08.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- 172.21.15.37:0/2694075287 wait complete. 2023-07-09T21:39:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 Processor -- start 2023-07-09T21:39:08.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- start start 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24158670 0x7f8d24156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d240ad410 con 0x7f8d2406b120 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24155580 con 0x7f8d24158670 2023-07-09T21:39:08.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2bb82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d24155860 con 0x7f8d2406caa0 2023-07-09T21:39:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2991e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59564/0 (socket says 172.21.15.37:59564) 2023-07-09T21:39:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.718+0000 7f8d2991e640 1 -- 172.21.15.37:0/3592390324 learned_addr learned my addr 172.21.15.37:0/3592390324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2a11f640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24158670 0x7f8d24156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2911d640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 -- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 msgr2=0x7f8d240acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 -- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24158670 msgr2=0x7f8d24156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24158670 0x7f8d24156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 -- 172.21.15.37:0/3592390324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200094d0 con 0x7f8d2406b120 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2991e640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8d200af040 tx=0x7f8d2001ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200b7830 con 0x7f8d2406b120 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d200b79b0 con 0x7f8d2406b120 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d200b7d60 con 0x7f8d2406b120 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d24155b40 con 0x7f8d2406b120 2023-07-09T21:39:08.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d240ad050 con 0x7f8d2406b120 2023-07-09T21:39:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2404d7d0 con 0x7f8d2406b120 2023-07-09T21:39:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.722+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8d200b3040 con 0x7f8d2406b120 2023-07-09T21:39:08.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.726+0000 7f8d1a7fc640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 0x7f8d08068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.726+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8d2011e760 con 0x7f8d2406b120 2023-07-09T21:39:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.726+0000 7f8d2911d640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 0x7f8d08068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:08.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.726+0000 7f8d2911d640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 0x7f8d08068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d240af670 tx=0x7f8d14008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:08.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.730+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d200ebb70 con 0x7f8d2406b120 2023-07-09T21:39:08.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.878+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d241556f0 con 0x7f8d080663d0 2023-07-09T21:39:08.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.886+0000 7f8d1a7fc640 1 -- 172.21.15.37:0/3592390324 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311720 (secure 0 0 0) 0x7f8d241556f0 con 0x7f8d080663d0 2023-07-09T21:39:08.894 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:08.895 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:08.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 msgr2=0x7f8d08068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 0x7f8d08068880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d240af670 tx=0x7f8d14008040 comp rx=0 tx=0).stop 2023-07-09T21:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 msgr2=0x7f8d24152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f8d200af040 tx=0x7f8d2001ac80 comp rx=0 tx=0).stop 2023-07-09T21:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 shutdown_connections 2023-07-09T21:39:08.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f8d080663d0 0x7f8d08068880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8d24158670 0x7f8d24156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8d2406caa0 0x7f8d240acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 --2- 172.21.15.37:0/3592390324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d2406b120 0x7f8d24152280 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 >> 172.21.15.37:0/3592390324 conn(0x7f8d240ca830 msgr2=0x7f8d24154230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 shutdown_connections 2023-07-09T21:39:08.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:08.890+0000 7f8d2bb82640 1 -- 172.21.15.37:0/3592390324 wait complete. 2023-07-09T21:39:08.914 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:39:08.879069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329576,"kb_used_data":10664,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754645144,"statfs":{"total":773094113280,"available":772756627456,"internally_reserved":0,"allocated":10919936,"data_stored":6051780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.664436"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462508+0000","last_change":"2023-07-09T21:39:03.244617+0000","last_active":"2023-07-09T21:39:04.462508+0000","last_peered":"2023-07-09T21:39:04.462508+0000","last_clean":"2023-07-09T21:39:04.462508+0000","last_became_active":"2023-07-09T21:39:03.244334+0000","last_became_peered":"2023-07-09T21:39:03.244334+0000","last_unstale":"2023-07-09T21:39:04.462508+0000","last_undegraded":"2023-07-09T21:39:04.462508+0000","last_fullsized":"2023-07-09T21:39:04.462508+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:56.308404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478636+0000","last_change":"2023-07-09T21:39:03.237636+0000","last_active":"2023-07-09T21:39:04.478636+0000","last_peered":"2023-07-09T21:39:04.478636+0000","last_clean":"2023-07-09T21:39:04.478636+0000","last_became_active":"2023-07-09T21:39:03.227146+0000","last_became_peered":"2023-07-09T21:39:03.227146+0000","last_unstale":"2023-07-09T21:39:04.478636+0000","last_undegraded":"2023-07-09T21:39:04.478636+0000","last_fullsized":"2023-07-09T21:39:04.478636+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:59.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478079+0000","last_change":"2023-07-09T21:39:03.231388+0000","last_active":"2023-07-09T21:39:04.478079+0000","last_peered":"2023-07-09T21:39:04.478079+0000","last_clean":"2023-07-09T21:39:04.478079+0000","last_became_active":"2023-07-09T21:39:03.231116+0000","last_became_peered":"2023-07-09T21:39:03.231116+0000","last_unstale":"2023-07-09T21:39:04.478079+0000","last_undegraded":"2023-07-09T21:39:04.478079+0000","last_fullsized":"2023-07-09T21:39:04.478079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:07.529964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221544+0000","last_change":"2023-07-09T21:39:03.233561+0000","last_active":"2023-07-09T21:39:04.221544+0000","last_peered":"2023-07-09T21:39:04.221544+0000","last_clean":"2023-07-09T21:39:04.221544+0000","last_became_active":"2023-07-09T21:39:03.233051+0000","last_became_peered":"2023-07-09T21:39:03.233051+0000","last_unstale":"2023-07-09T21:39:04.221544+0000","last_undegraded":"2023-07-09T21:39:04.221544+0000","last_fullsized":"2023-07-09T21:39:04.221544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:10:01.369849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214731+0000","last_change":"2023-07-09T21:39:03.235865+0000","last_active":"2023-07-09T21:39:04.214731+0000","last_peered":"2023-07-09T21:39:04.214731+0000","last_clean":"2023-07-09T21:39:04.214731+0000","last_became_active":"2023-07-09T21:39:03.235576+0000","last_became_peered":"2023-07-09T21:39:03.235576+0000","last_unstale":"2023-07-09T21:39:04.214731+0000","last_undegraded":"2023-07-09T21:39:04.214731+0000","last_fullsized":"2023-07-09T21:39:04.214731+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:14:55.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477574+0000","last_change":"2023-07-09T21:39:03.235545+0000","last_active":"2023-07-09T21:39:04.477574+0000","last_peered":"2023-07-09T21:39:04.477574+0000","last_clean":"2023-07-09T21:39:04.477574+0000","last_became_active":"2023-07-09T21:39:03.234889+0000","last_became_peered":"2023-07-09T21:39:03.234889+0000","last_unstale":"2023-07-09T21:39:04.477574+0000","last_undegraded":"2023-07-09T21:39:04.477574+0000","last_fullsized":"2023-07-09T21:39:04.477574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:04.021520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483927+0000","last_change":"2023-07-09T21:39:03.235120+0000","last_active":"2023-07-09T21:39:04.483927+0000","last_peered":"2023-07-09T21:39:04.483927+0000","last_clean":"2023-07-09T21:39:04.483927+0000","last_became_active":"2023-07-09T21:39:03.234231+0000","last_became_peered":"2023-07-09T21:39:03.234231+0000","last_unstale":"2023-07-09T21:39:04.483927+0000","last_undegraded":"2023-07-09T21:39:04.483927+0000","last_fullsized":"2023-07-09T21:39:04.483927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:38.983162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214094+0000","last_change":"2023-07-09T21:39:03.234801+0000","last_active":"2023-07-09T21:39:04.214094+0000","last_peered":"2023-07-09T21:39:04.214094+0000","last_clean":"2023-07-09T21:39:04.214094+0000","last_became_active":"2023-07-09T21:39:03.234441+0000","last_became_peered":"2023-07-09T21:39:03.234441+0000","last_unstale":"2023-07-09T21:39:04.214094+0000","last_undegraded":"2023-07-09T21:39:04.214094+0000","last_fullsized":"2023-07-09T21:39:04.214094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:44.741718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222807+0000","last_change":"2023-07-09T21:39:03.241221+0000","last_active":"2023-07-09T21:39:04.222807+0000","last_peered":"2023-07-09T21:39:04.222807+0000","last_clean":"2023-07-09T21:39:04.222807+0000","last_became_active":"2023-07-09T21:39:03.240942+0000","last_became_peered":"2023-07-09T21:39:03.240942+0000","last_unstale":"2023-07-09T21:39:04.222807+0000","last_undegraded":"2023-07-09T21:39:04.222807+0000","last_fullsized":"2023-07-09T21:39:04.222807+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:15.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221293+0000","last_change":"2023-07-09T21:39:03.235682+0000","last_active":"2023-07-09T21:39:04.221293+0000","last_peered":"2023-07-09T21:39:04.221293+0000","last_clean":"2023-07-09T21:39:04.221293+0000","last_became_active":"2023-07-09T21:39:03.235411+0000","last_became_peered":"2023-07-09T21:39:03.235411+0000","last_unstale":"2023-07-09T21:39:04.221293+0000","last_undegraded":"2023-07-09T21:39:04.221293+0000","last_fullsized":"2023-07-09T21:39:04.221293+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:08:19.235018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478279+0000","last_change":"2023-07-09T21:39:03.237372+0000","last_active":"2023-07-09T21:39:04.478279+0000","last_peered":"2023-07-09T21:39:04.478279+0000","last_clean":"2023-07-09T21:39:04.478279+0000","last_became_active":"2023-07-09T21:39:03.237079+0000","last_became_peered":"2023-07-09T21:39:03.237079+0000","last_unstale":"2023-07-09T21:39:04.478279+0000","last_undegraded":"2023-07-09T21:39:04.478279+0000","last_fullsized":"2023-07-09T21:39:04.478279+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:09.767819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221694+0000","last_change":"2023-07-09T21:39:03.237307+0000","last_active":"2023-07-09T21:39:04.221694+0000","last_peered":"2023-07-09T21:39:04.221694+0000","last_clean":"2023-07-09T21:39:04.221694+0000","last_became_active":"2023-07-09T21:39:03.236959+0000","last_became_peered":"2023-07-09T21:39:03.236959+0000","last_unstale":"2023-07-09T21:39:04.221694+0000","last_undegraded":"2023-07-09T21:39:04.221694+0000","last_fullsized":"2023-07-09T21:39:04.221694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:02:30.158775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214394+0000","last_change":"2023-07-09T21:39:03.238163+0000","last_active":"2023-07-09T21:39:04.214394+0000","last_peered":"2023-07-09T21:39:04.214394+0000","last_clean":"2023-07-09T21:39:04.214394+0000","last_became_active":"2023-07-09T21:39:03.237877+0000","last_became_peered":"2023-07-09T21:39:03.237877+0000","last_unstale":"2023-07-09T21:39:04.214394+0000","last_undegraded":"2023-07-09T21:39:04.214394+0000","last_fullsized":"2023-07-09T21:39:04.214394+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:01:44.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477703+0000","last_change":"2023-07-09T21:39:03.235357+0000","last_active":"2023-07-09T21:39:04.477703+0000","last_peered":"2023-07-09T21:39:04.477703+0000","last_clean":"2023-07-09T21:39:04.477703+0000","last_became_active":"2023-07-09T21:39:03.234537+0000","last_became_peered":"2023-07-09T21:39:03.234537+0000","last_unstale":"2023-07-09T21:39:04.477703+0000","last_undegraded":"2023-07-09T21:39:04.477703+0000","last_fullsized":"2023-07-09T21:39:04.477703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:50.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477670+0000","last_change":"2023-07-09T21:39:03.221896+0000","last_active":"2023-07-09T21:39:04.477670+0000","last_peered":"2023-07-09T21:39:04.477670+0000","last_clean":"2023-07-09T21:39:04.477670+0000","last_became_active":"2023-07-09T21:39:03.221547+0000","last_became_peered":"2023-07-09T21:39:03.221547+0000","last_unstale":"2023-07-09T21:39:04.477670+0000","last_undegraded":"2023-07-09T21:39:04.477670+0000","last_fullsized":"2023-07-09T21:39:04.477670+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:02:33.063461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.461967+0000","last_change":"2023-07-09T21:39:03.240444+0000","last_active":"2023-07-09T21:39:04.461967+0000","last_peered":"2023-07-09T21:39:04.461967+0000","last_clean":"2023-07-09T21:39:04.461967+0000","last_became_active":"2023-07-09T21:39:03.239831+0000","last_became_peered":"2023-07-09T21:39:03.239831+0000","last_unstale":"2023-07-09T21:39:04.461967+0000","last_undegraded":"2023-07-09T21:39:04.461967+0000","last_fullsized":"2023-07-09T21:39:04.461967+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:11.545231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214746+0000","last_change":"2023-07-09T21:39:03.230687+0000","last_active":"2023-07-09T21:39:04.214746+0000","last_peered":"2023-07-09T21:39:04.214746+0000","last_clean":"2023-07-09T21:39:04.214746+0000","last_became_active":"2023-07-09T21:39:03.230382+0000","last_became_peered":"2023-07-09T21:39:03.230382+0000","last_unstale":"2023-07-09T21:39:04.214746+0000","last_undegraded":"2023-07-09T21:39:04.214746+0000","last_fullsized":"2023-07-09T21:39:04.214746+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:34:12.130395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478271+0000","last_change":"2023-07-09T21:39:03.232581+0000","last_active":"2023-07-09T21:39:04.478271+0000","last_peered":"2023-07-09T21:39:04.478271+0000","last_clean":"2023-07-09T21:39:04.478271+0000","last_became_active":"2023-07-09T21:39:03.232254+0000","last_became_peered":"2023-07-09T21:39:03.232254+0000","last_unstale":"2023-07-09T21:39:04.478271+0000","last_undegraded":"2023-07-09T21:39:04.478271+0000","last_fullsized":"2023-07-09T21:39:04.478271+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:46.239534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478115+0000","last_change":"2023-07-09T21:39:03.233878+0000","last_active":"2023-07-09T21:39:04.478115+0000","last_peered":"2023-07-09T21:39:04.478115+0000","last_clean":"2023-07-09T21:39:04.478115+0000","last_became_active":"2023-07-09T21:39:03.233483+0000","last_became_peered":"2023-07-09T21:39:03.233483+0000","last_unstale":"2023-07-09T21:39:04.478115+0000","last_undegraded":"2023-07-09T21:39:04.478115+0000","last_fullsized":"2023-07-09T21:39:04.478115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:29.730195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214669+0000","last_change":"2023-07-09T21:39:03.224486+0000","last_active":"2023-07-09T21:39:04.214669+0000","last_peered":"2023-07-09T21:39:04.214669+0000","last_clean":"2023-07-09T21:39:04.214669+0000","last_became_active":"2023-07-09T21:39:03.224098+0000","last_became_peered":"2023-07-09T21:39:03.224098+0000","last_unstale":"2023-07-09T21:39:04.214669+0000","last_undegraded":"2023-07-09T21:39:04.214669+0000","last_fullsized":"2023-07-09T21:39:04.214669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:16.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222463+0000","last_change":"2023-07-09T21:39:03.243143+0000","last_active":"2023-07-09T21:39:04.222463+0000","last_peered":"2023-07-09T21:39:04.222463+0000","last_clean":"2023-07-09T21:39:04.222463+0000","last_became_active":"2023-07-09T21:39:03.242877+0000","last_became_peered":"2023-07-09T21:39:03.242877+0000","last_unstale":"2023-07-09T21:39:04.222463+0000","last_undegraded":"2023-07-09T21:39:04.222463+0000","last_fullsized":"2023-07-09T21:39:04.222463+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:26.745073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214201+0000","last_change":"2023-07-09T21:39:03.238103+0000","last_active":"2023-07-09T21:39:04.214201+0000","last_peered":"2023-07-09T21:39:04.214201+0000","last_clean":"2023-07-09T21:39:04.214201+0000","last_became_active":"2023-07-09T21:39:03.237800+0000","last_became_peered":"2023-07-09T21:39:03.237800+0000","last_unstale":"2023-07-09T21:39:04.214201+0000","last_undegraded":"2023-07-09T21:39:04.214201+0000","last_fullsized":"2023-07-09T21:39:04.214201+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:17.735787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222192+0000","last_change":"2023-07-09T21:39:03.238255+0000","last_active":"2023-07-09T21:39:04.222192+0000","last_peered":"2023-07-09T21:39:04.222192+0000","last_clean":"2023-07-09T21:39:04.222192+0000","last_became_active":"2023-07-09T21:39:03.237742+0000","last_became_peered":"2023-07-09T21:39:03.237742+0000","last_unstale":"2023-07-09T21:39:04.222192+0000","last_undegraded":"2023-07-09T21:39:04.222192+0000","last_fullsized":"2023-07-09T21:39:04.222192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:33.204834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477510+0000","last_change":"2023-07-09T21:39:03.228184+0000","last_active":"2023-07-09T21:39:04.477510+0000","last_peered":"2023-07-09T21:39:04.477510+0000","last_clean":"2023-07-09T21:39:04.477510+0000","last_became_active":"2023-07-09T21:39:03.227865+0000","last_became_peered":"2023-07-09T21:39:03.227865+0000","last_unstale":"2023-07-09T21:39:04.477510+0000","last_undegraded":"2023-07-09T21:39:04.477510+0000","last_fullsized":"2023-07-09T21:39:04.477510+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:43:12.721902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478224+0000","last_change":"2023-07-09T21:39:03.236456+0000","last_active":"2023-07-09T21:39:04.478224+0000","last_peered":"2023-07-09T21:39:04.478224+0000","last_clean":"2023-07-09T21:39:04.478224+0000","last_became_active":"2023-07-09T21:39:03.230013+0000","last_became_peered":"2023-07-09T21:39:03.230013+0000","last_unstale":"2023-07-09T21:39:04.478224+0000","last_undegraded":"2023-07-09T21:39:04.478224+0000","last_fullsized":"2023-07-09T21:39:04.478224+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:24.396808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221296+0000","last_change":"2023-07-09T21:39:03.245208+0000","last_active":"2023-07-09T21:39:04.221296+0000","last_peered":"2023-07-09T21:39:04.221296+0000","last_clean":"2023-07-09T21:39:04.221296+0000","last_became_active":"2023-07-09T21:39:03.244927+0000","last_became_peered":"2023-07-09T21:39:03.244927+0000","last_unstale":"2023-07-09T21:39:04.221296+0000","last_undegraded":"2023-07-09T21:39:04.221296+0000","last_fullsized":"2023-07-09T21:39:04.221296+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:32.299841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462268+0000","last_change":"2023-07-09T21:39:03.243939+0000","last_active":"2023-07-09T21:39:04.462268+0000","last_peered":"2023-07-09T21:39:04.462268+0000","last_clean":"2023-07-09T21:39:04.462268+0000","last_became_active":"2023-07-09T21:39:03.243635+0000","last_became_peered":"2023-07-09T21:39:03.243635+0000","last_unstale":"2023-07-09T21:39:04.462268+0000","last_undegraded":"2023-07-09T21:39:04.462268+0000","last_fullsized":"2023-07-09T21:39:04.462268+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:59.761651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214611+0000","last_change":"2023-07-09T21:39:03.226420+0000","last_active":"2023-07-09T21:39:04.214611+0000","last_peered":"2023-07-09T21:39:04.214611+0000","last_clean":"2023-07-09T21:39:04.214611+0000","last_became_active":"2023-07-09T21:39:03.226103+0000","last_became_peered":"2023-07-09T21:39:03.226103+0000","last_unstale":"2023-07-09T21:39:04.214611+0000","last_undegraded":"2023-07-09T21:39:04.214611+0000","last_fullsized":"2023-07-09T21:39:04.214611+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:59:33.294757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477918+0000","last_change":"2023-07-09T21:39:03.224911+0000","last_active":"2023-07-09T21:39:04.477918+0000","last_peered":"2023-07-09T21:39:04.477918+0000","last_clean":"2023-07-09T21:39:04.477918+0000","last_became_active":"2023-07-09T21:39:03.224204+0000","last_became_peered":"2023-07-09T21:39:03.224204+0000","last_unstale":"2023-07-09T21:39:04.477918+0000","last_undegraded":"2023-07-09T21:39:04.477918+0000","last_fullsized":"2023-07-09T21:39:04.477918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:04.021520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462031+0000","last_change":"2023-07-09T21:39:03.246056+0000","last_active":"2023-07-09T21:39:04.462031+0000","last_peered":"2023-07-09T21:39:04.462031+0000","last_clean":"2023-07-09T21:39:04.462031+0000","last_became_active":"2023-07-09T21:39:03.245746+0000","last_became_peered":"2023-07-09T21:39:03.245746+0000","last_unstale":"2023-07-09T21:39:04.462031+0000","last_undegraded":"2023-07-09T21:39:04.462031+0000","last_fullsized":"2023-07-09T21:39:04.462031+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:08:40.084902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478260+0000","last_change":"2023-07-09T21:39:03.229581+0000","last_active":"2023-07-09T21:39:04.478260+0000","last_peered":"2023-07-09T21:39:04.478260+0000","last_clean":"2023-07-09T21:39:04.478260+0000","last_became_active":"2023-07-09T21:39:03.229267+0000","last_became_peered":"2023-07-09T21:39:03.229267+0000","last_unstale":"2023-07-09T21:39:04.478260+0000","last_undegraded":"2023-07-09T21:39:04.478260+0000","last_fullsized":"2023-07-09T21:39:04.478260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:54.119510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462096+0000","last_change":"2023-07-09T21:39:03.240647+0000","last_active":"2023-07-09T21:39:04.462096+0000","last_peered":"2023-07-09T21:39:04.462096+0000","last_clean":"2023-07-09T21:39:04.462096+0000","last_became_active":"2023-07-09T21:39:03.240176+0000","last_became_peered":"2023-07-09T21:39:03.240176+0000","last_unstale":"2023-07-09T21:39:04.462096+0000","last_undegraded":"2023-07-09T21:39:04.462096+0000","last_fullsized":"2023-07-09T21:39:04.462096+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:32.311622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477406+0000","last_change":"2023-07-09T21:39:03.227143+0000","last_active":"2023-07-09T21:39:04.477406+0000","last_peered":"2023-07-09T21:39:04.477406+0000","last_clean":"2023-07-09T21:39:04.477406+0000","last_became_active":"2023-07-09T21:39:03.226869+0000","last_became_peered":"2023-07-09T21:39:03.226869+0000","last_unstale":"2023-07-09T21:39:04.477406+0000","last_undegraded":"2023-07-09T21:39:04.477406+0000","last_fullsized":"2023-07-09T21:39:04.477406+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:21.106069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"98'4","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214792+0000","last_change":"2023-07-09T21:39:02.227658+0000","last_active":"2023-07-09T21:39:04.214792+0000","last_peered":"2023-07-09T21:39:04.214792+0000","last_clean":"2023-07-09T21:39:04.214792+0000","last_became_active":"2023-07-09T21:39:02.227277+0000","last_became_peered":"2023-07-09T21:39:02.227277+0000","last_unstale":"2023-07-09T21:39:04.214792+0000","last_undegraded":"2023-07-09T21:39:04.214792+0000","last_fullsized":"2023-07-09T21:39:04.214792+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:57.264576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477814+0000","last_change":"2023-07-09T21:39:03.228671+0000","last_active":"2023-07-09T21:39:04.477814+0000","last_peered":"2023-07-09T21:39:04.477814+0000","last_clean":"2023-07-09T21:39:04.477814+0000","last_became_active":"2023-07-09T21:39:03.228339+0000","last_became_peered":"2023-07-09T21:39:03.228339+0000","last_unstale":"2023-07-09T21:39:04.477814+0000","last_undegraded":"2023-07-09T21:39:04.477814+0000","last_fullsized":"2023-07-09T21:39:04.477814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:23.737703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462420+0000","last_change":"2023-07-09T21:39:02.237998+0000","last_active":"2023-07-09T21:39:04.462420+0000","last_peered":"2023-07-09T21:39:04.462420+0000","last_clean":"2023-07-09T21:39:04.462420+0000","last_became_active":"2023-07-09T21:39:02.237705+0000","last_became_peered":"2023-07-09T21:39:02.237705+0000","last_unstale":"2023-07-09T21:39:04.462420+0000","last_undegraded":"2023-07-09T21:39:04.462420+0000","last_fullsized":"2023-07-09T21:39:04.462420+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:08:37.143795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222364+0000","last_change":"2023-07-09T21:39:03.239518+0000","last_active":"2023-07-09T21:39:04.222364+0000","last_peered":"2023-07-09T21:39:04.222364+0000","last_clean":"2023-07-09T21:39:04.222364+0000","last_became_active":"2023-07-09T21:39:03.238840+0000","last_became_peered":"2023-07-09T21:39:03.238840+0000","last_unstale":"2023-07-09T21:39:04.222364+0000","last_undegraded":"2023-07-09T21:39:04.222364+0000","last_fullsized":"2023-07-09T21:39:04.222364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:56.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462290+0000","last_change":"2023-07-09T21:39:02.236776+0000","last_active":"2023-07-09T21:39:04.462290+0000","last_peered":"2023-07-09T21:39:04.462290+0000","last_clean":"2023-07-09T21:39:04.462290+0000","last_became_active":"2023-07-09T21:39:02.236505+0000","last_became_peered":"2023-07-09T21:39:02.236505+0000","last_unstale":"2023-07-09T21:39:04.462290+0000","last_undegraded":"2023-07-09T21:39:04.462290+0000","last_fullsized":"2023-07-09T21:39:04.462290+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:00:32.642485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222604+0000","last_change":"2023-07-09T21:39:03.239737+0000","last_active":"2023-07-09T21:39:04.222604+0000","last_peered":"2023-07-09T21:39:04.222604+0000","last_clean":"2023-07-09T21:39:04.222604+0000","last_became_active":"2023-07-09T21:39:03.239455+0000","last_became_peered":"2023-07-09T21:39:03.239455+0000","last_unstale":"2023-07-09T21:39:04.222604+0000","last_undegraded":"2023-07-09T21:39:04.222604+0000","last_fullsized":"2023-07-09T21:39:04.222604+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:40.858107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484015+0000","last_change":"2023-07-09T21:39:02.235294+0000","last_active":"2023-07-09T21:39:04.484015+0000","last_peered":"2023-07-09T21:39:04.484015+0000","last_clean":"2023-07-09T21:39:04.484015+0000","last_became_active":"2023-07-09T21:39:02.234886+0000","last_became_peered":"2023-07-09T21:39:02.234886+0000","last_unstale":"2023-07-09T21:39:04.484015+0000","last_undegraded":"2023-07-09T21:39:04.484015+0000","last_fullsized":"2023-07-09T21:39:04.484015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:08.954605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478342+0000","last_change":"2023-07-09T21:39:03.225166+0000","last_active":"2023-07-09T21:39:04.478342+0000","last_peered":"2023-07-09T21:39:04.478342+0000","last_clean":"2023-07-09T21:39:04.478342+0000","last_became_active":"2023-07-09T21:39:03.224875+0000","last_became_peered":"2023-07-09T21:39:03.224875+0000","last_unstale":"2023-07-09T21:39:04.478342+0000","last_undegraded":"2023-07-09T21:39:04.478342+0000","last_fullsized":"2023-07-09T21:39:04.478342+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:15.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222618+0000","last_change":"2023-07-09T21:39:02.232585+0000","last_active":"2023-07-09T21:39:04.222618+0000","last_peered":"2023-07-09T21:39:04.222618+0000","last_clean":"2023-07-09T21:39:04.222618+0000","last_became_active":"2023-07-09T21:39:02.232315+0000","last_became_peered":"2023-07-09T21:39:02.232315+0000","last_unstale":"2023-07-09T21:39:04.222618+0000","last_undegraded":"2023-07-09T21:39:04.222618+0000","last_fullsized":"2023-07-09T21:39:04.222618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:37.975276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478412+0000","last_change":"2023-07-09T21:39:03.227507+0000","last_active":"2023-07-09T21:39:04.478412+0000","last_peered":"2023-07-09T21:39:04.478412+0000","last_clean":"2023-07-09T21:39:04.478412+0000","last_became_active":"2023-07-09T21:39:03.227168+0000","last_became_peered":"2023-07-09T21:39:03.227168+0000","last_unstale":"2023-07-09T21:39:04.478412+0000","last_undegraded":"2023-07-09T21:39:04.478412+0000","last_fullsized":"2023-07-09T21:39:04.478412+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:29.730195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220917+0000","last_change":"2023-07-09T21:39:02.235039+0000","last_active":"2023-07-09T21:39:04.220917+0000","last_peered":"2023-07-09T21:39:04.220917+0000","last_clean":"2023-07-09T21:39:04.220917+0000","last_became_active":"2023-07-09T21:39:02.234707+0000","last_became_peered":"2023-07-09T21:39:02.234707+0000","last_unstale":"2023-07-09T21:39:04.220917+0000","last_undegraded":"2023-07-09T21:39:04.220917+0000","last_fullsized":"2023-07-09T21:39:04.220917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:50:58.657750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222915+0000","last_change":"2023-07-09T21:39:03.237791+0000","last_active":"2023-07-09T21:39:04.222915+0000","last_peered":"2023-07-09T21:39:04.222915+0000","last_clean":"2023-07-09T21:39:04.222915+0000","last_became_active":"2023-07-09T21:39:03.237482+0000","last_became_peered":"2023-07-09T21:39:03.237482+0000","last_unstale":"2023-07-09T21:39:04.222915+0000","last_undegraded":"2023-07-09T21:39:04.222915+0000","last_fullsized":"2023-07-09T21:39:04.222915+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.617177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477938+0000","last_change":"2023-07-09T21:39:02.228791+0000","last_active":"2023-07-09T21:39:04.477938+0000","last_peered":"2023-07-09T21:39:04.477938+0000","last_clean":"2023-07-09T21:39:04.477938+0000","last_became_active":"2023-07-09T21:39:02.228459+0000","last_became_peered":"2023-07-09T21:39:02.228459+0000","last_unstale":"2023-07-09T21:39:04.477938+0000","last_undegraded":"2023-07-09T21:39:04.477938+0000","last_fullsized":"2023-07-09T21:39:04.477938+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:49.850422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484413+0000","last_change":"2023-07-09T21:39:03.236571+0000","last_active":"2023-07-09T21:39:04.484413+0000","last_peered":"2023-07-09T21:39:04.484413+0000","last_clean":"2023-07-09T21:39:04.484413+0000","last_became_active":"2023-07-09T21:39:03.236293+0000","last_became_peered":"2023-07-09T21:39:03.236293+0000","last_unstale":"2023-07-09T21:39:04.484413+0000","last_undegraded":"2023-07-09T21:39:04.484413+0000","last_fullsized":"2023-07-09T21:39:04.484413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:53.308364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214231+0000","last_change":"2023-07-09T21:39:02.222966+0000","last_active":"2023-07-09T21:39:04.214231+0000","last_peered":"2023-07-09T21:39:04.214231+0000","last_clean":"2023-07-09T21:39:04.214231+0000","last_became_active":"2023-07-09T21:39:02.222697+0000","last_became_peered":"2023-07-09T21:39:02.222697+0000","last_unstale":"2023-07-09T21:39:04.214231+0000","last_undegraded":"2023-07-09T21:39:04.214231+0000","last_fullsized":"2023-07-09T21:39:04.214231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:23.608010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477644+0000","last_change":"2023-07-09T21:39:03.237831+0000","last_active":"2023-07-09T21:39:04.477644+0000","last_peered":"2023-07-09T21:39:04.477644+0000","last_clean":"2023-07-09T21:39:04.477644+0000","last_became_active":"2023-07-09T21:39:03.237529+0000","last_became_peered":"2023-07-09T21:39:03.237529+0000","last_unstale":"2023-07-09T21:39:04.477644+0000","last_undegraded":"2023-07-09T21:39:04.477644+0000","last_fullsized":"2023-07-09T21:39:04.477644+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:55:39.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462544+0000","last_change":"2023-07-09T21:39:02.233072+0000","last_active":"2023-07-09T21:39:04.462544+0000","last_peered":"2023-07-09T21:39:04.462544+0000","last_clean":"2023-07-09T21:39:04.462544+0000","last_became_active":"2023-07-09T21:39:02.232634+0000","last_became_peered":"2023-07-09T21:39:02.232634+0000","last_unstale":"2023-07-09T21:39:04.462544+0000","last_undegraded":"2023-07-09T21:39:04.462544+0000","last_fullsized":"2023-07-09T21:39:04.462544+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:47.737457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220995+0000","last_change":"2023-07-09T21:39:03.234625+0000","last_active":"2023-07-09T21:39:04.220995+0000","last_peered":"2023-07-09T21:39:04.220995+0000","last_clean":"2023-07-09T21:39:04.220995+0000","last_became_active":"2023-07-09T21:39:03.233322+0000","last_became_peered":"2023-07-09T21:39:03.233322+0000","last_unstale":"2023-07-09T21:39:04.220995+0000","last_undegraded":"2023-07-09T21:39:04.220995+0000","last_fullsized":"2023-07-09T21:39:04.220995+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:09:38.691112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221429+0000","last_change":"2023-07-09T21:39:02.231456+0000","last_active":"2023-07-09T21:39:04.221429+0000","last_peered":"2023-07-09T21:39:04.221429+0000","last_clean":"2023-07-09T21:39:04.221429+0000","last_became_active":"2023-07-09T21:39:02.231159+0000","last_became_peered":"2023-07-09T21:39:02.231159+0000","last_unstale":"2023-07-09T21:39:04.221429+0000","last_undegraded":"2023-07-09T21:39:04.221429+0000","last_fullsized":"2023-07-09T21:39:04.221429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:34:01.405514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477829+0000","last_change":"2023-07-09T21:39:03.236590+0000","last_active":"2023-07-09T21:39:04.477829+0000","last_peered":"2023-07-09T21:39:04.477829+0000","last_clean":"2023-07-09T21:39:04.477829+0000","last_became_active":"2023-07-09T21:39:03.236330+0000","last_became_peered":"2023-07-09T21:39:03.236330+0000","last_unstale":"2023-07-09T21:39:04.477829+0000","last_undegraded":"2023-07-09T21:39:04.477829+0000","last_fullsized":"2023-07-09T21:39:04.477829+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:24.396808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"98'3","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214542+0000","last_change":"2023-07-09T21:39:02.222461+0000","last_active":"2023-07-09T21:39:04.214542+0000","last_peered":"2023-07-09T21:39:04.214542+0000","last_clean":"2023-07-09T21:39:04.214542+0000","last_became_active":"2023-07-09T21:39:02.222198+0000","last_became_peered":"2023-07-09T21:39:02.222198+0000","last_unstale":"2023-07-09T21:39:04.214542+0000","last_undegraded":"2023-07-09T21:39:04.214542+0000","last_fullsized":"2023-07-09T21:39:04.214542+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:33.194280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478368+0000","last_change":"2023-07-09T21:39:03.230757+0000","last_active":"2023-07-09T21:39:04.478368+0000","last_peered":"2023-07-09T21:39:04.478368+0000","last_clean":"2023-07-09T21:39:04.478368+0000","last_became_active":"2023-07-09T21:39:03.230435+0000","last_became_peered":"2023-07-09T21:39:03.230435+0000","last_unstale":"2023-07-09T21:39:04.478368+0000","last_undegraded":"2023-07-09T21:39:04.478368+0000","last_fullsized":"2023-07-09T21:39:04.478368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:04:26.690442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"98'6","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484180+0000","last_change":"2023-07-09T21:39:02.228316+0000","last_active":"2023-07-09T21:39:04.484180+0000","last_peered":"2023-07-09T21:39:04.484180+0000","last_clean":"2023-07-09T21:39:04.484180+0000","last_became_active":"2023-07-09T21:39:02.226731+0000","last_became_peered":"2023-07-09T21:39:02.226731+0000","last_unstale":"2023-07-09T21:39:04.484180+0000","last_undegraded":"2023-07-09T21:39:04.484180+0000","last_fullsized":"2023-07-09T21:39:04.484180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:21.252591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221698+0000","last_change":"2023-07-09T21:39:03.237951+0000","last_active":"2023-07-09T21:39:04.221698+0000","last_peered":"2023-07-09T21:39:04.221698+0000","last_clean":"2023-07-09T21:39:04.221698+0000","last_became_active":"2023-07-09T21:39:03.237612+0000","last_became_peered":"2023-07-09T21:39:03.237612+0000","last_unstale":"2023-07-09T21:39:04.221698+0000","last_undegraded":"2023-07-09T21:39:04.221698+0000","last_fullsized":"2023-07-09T21:39:04.221698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:10.345599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221101+0000","last_change":"2023-07-09T21:39:02.228630+0000","last_active":"2023-07-09T21:39:04.221101+0000","last_peered":"2023-07-09T21:39:04.221101+0000","last_clean":"2023-07-09T21:39:04.221101+0000","last_became_active":"2023-07-09T21:39:02.228368+0000","last_became_peered":"2023-07-09T21:39:02.228368+0000","last_unstale":"2023-07-09T21:39:04.221101+0000","last_undegraded":"2023-07-09T21:39:04.221101+0000","last_fullsized":"2023-07-09T21:39:04.221101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:51:49.045650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483887+0000","last_change":"2023-07-09T21:39:03.242500+0000","last_active":"2023-07-09T21:39:04.483887+0000","last_peered":"2023-07-09T21:39:04.483887+0000","last_clean":"2023-07-09T21:39:04.483887+0000","last_became_active":"2023-07-09T21:39:03.242199+0000","last_became_peered":"2023-07-09T21:39:03.242199+0000","last_unstale":"2023-07-09T21:39:04.483887+0000","last_undegraded":"2023-07-09T21:39:04.483887+0000","last_fullsized":"2023-07-09T21:39:04.483887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:40.858107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462041+0000","last_change":"2023-07-09T21:39:02.230899+0000","last_active":"2023-07-09T21:39:04.462041+0000","last_peered":"2023-07-09T21:39:04.462041+0000","last_clean":"2023-07-09T21:39:04.462041+0000","last_became_active":"2023-07-09T21:39:02.230633+0000","last_became_peered":"2023-07-09T21:39:02.230633+0000","last_unstale":"2023-07-09T21:39:04.462041+0000","last_undegraded":"2023-07-09T21:39:04.462041+0000","last_fullsized":"2023-07-09T21:39:04.462041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:15.208275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484023+0000","last_change":"2023-07-09T21:39:03.235313+0000","last_active":"2023-07-09T21:39:04.484023+0000","last_peered":"2023-07-09T21:39:04.484023+0000","last_clean":"2023-07-09T21:39:04.484023+0000","last_became_active":"2023-07-09T21:39:03.234624+0000","last_became_peered":"2023-07-09T21:39:03.234624+0000","last_unstale":"2023-07-09T21:39:04.484023+0000","last_undegraded":"2023-07-09T21:39:04.484023+0000","last_fullsized":"2023-07-09T21:39:04.484023+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:45:58.025864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214173+0000","last_change":"2023-07-09T21:39:02.227440+0000","last_active":"2023-07-09T21:39:04.214173+0000","last_peered":"2023-07-09T21:39:04.214173+0000","last_clean":"2023-07-09T21:39:04.214173+0000","last_became_active":"2023-07-09T21:39:02.226934+0000","last_became_peered":"2023-07-09T21:39:02.226934+0000","last_unstale":"2023-07-09T21:39:04.214173+0000","last_undegraded":"2023-07-09T21:39:04.214173+0000","last_fullsized":"2023-07-09T21:39:04.214173+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:59.229914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484418+0000","last_change":"2023-07-09T21:39:03.240125+0000","last_active":"2023-07-09T21:39:04.484418+0000","last_peered":"2023-07-09T21:39:04.484418+0000","last_clean":"2023-07-09T21:39:04.484418+0000","last_became_active":"2023-07-09T21:39:03.239754+0000","last_became_peered":"2023-07-09T21:39:03.239754+0000","last_unstale":"2023-07-09T21:39:04.484418+0000","last_undegraded":"2023-07-09T21:39:04.484418+0000","last_fullsized":"2023-07-09T21:39:04.484418+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:24:45.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"98'8","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477779+0000","last_change":"2023-07-09T21:39:02.224832+0000","last_active":"2023-07-09T21:39:04.477779+0000","last_peered":"2023-07-09T21:39:04.477779+0000","last_clean":"2023-07-09T21:39:04.477779+0000","last_became_active":"2023-07-09T21:39:02.224573+0000","last_became_peered":"2023-07-09T21:39:02.224573+0000","last_unstale":"2023-07-09T21:39:04.477779+0000","last_undegraded":"2023-07-09T21:39:04.477779+0000","last_fullsized":"2023-07-09T21:39:04.477779+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:36.284726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222233+0000","last_change":"2023-07-09T21:39:03.234768+0000","last_active":"2023-07-09T21:39:04.222233+0000","last_peered":"2023-07-09T21:39:04.222233+0000","last_clean":"2023-07-09T21:39:04.222233+0000","last_became_active":"2023-07-09T21:39:03.234494+0000","last_became_peered":"2023-07-09T21:39:03.234494+0000","last_unstale":"2023-07-09T21:39:04.222233+0000","last_undegraded":"2023-07-09T21:39:04.222233+0000","last_fullsized":"2023-07-09T21:39:04.222233+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:44.743930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221355+0000","last_change":"2023-07-09T21:39:02.227857+0000","last_active":"2023-07-09T21:39:04.221355+0000","last_peered":"2023-07-09T21:39:04.221355+0000","last_clean":"2023-07-09T21:39:04.221355+0000","last_became_active":"2023-07-09T21:39:02.227555+0000","last_became_peered":"2023-07-09T21:39:02.227555+0000","last_unstale":"2023-07-09T21:39:04.221355+0000","last_undegraded":"2023-07-09T21:39:04.221355+0000","last_fullsized":"2023-07-09T21:39:04.221355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:44:08.820298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484113+0000","last_change":"2023-07-09T21:39:03.231465+0000","last_active":"2023-07-09T21:39:04.484113+0000","last_peered":"2023-07-09T21:39:04.484113+0000","last_clean":"2023-07-09T21:39:04.484113+0000","last_became_active":"2023-07-09T21:39:03.231198+0000","last_became_peered":"2023-07-09T21:39:03.231198+0000","last_unstale":"2023-07-09T21:39:04.484113+0000","last_undegraded":"2023-07-09T21:39:04.484113+0000","last_fullsized":"2023-07-09T21:39:04.484113+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:19:20.294170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478799+0000","last_change":"2023-07-09T21:39:02.226076+0000","last_active":"2023-07-09T21:39:04.478799+0000","last_peered":"2023-07-09T21:39:04.478799+0000","last_clean":"2023-07-09T21:39:04.478799+0000","last_became_active":"2023-07-09T21:39:02.225796+0000","last_became_peered":"2023-07-09T21:39:02.225796+0000","last_unstale":"2023-07-09T21:39:04.478799+0000","last_undegraded":"2023-07-09T21:39:04.478799+0000","last_fullsized":"2023-07-09T21:39:04.478799+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:30.075488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222428+0000","last_change":"2023-07-09T21:39:03.235249+0000","last_active":"2023-07-09T21:39:04.222428+0000","last_peered":"2023-07-09T21:39:04.222428+0000","last_clean":"2023-07-09T21:39:04.222428+0000","last_became_active":"2023-07-09T21:39:03.234968+0000","last_became_peered":"2023-07-09T21:39:03.234968+0000","last_unstale":"2023-07-09T21:39:04.222428+0000","last_undegraded":"2023-07-09T21:39:04.222428+0000","last_fullsized":"2023-07-09T21:39:04.222428+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:13.517373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462557+0000","last_change":"2023-07-09T21:39:02.235989+0000","last_active":"2023-07-09T21:39:04.462557+0000","last_peered":"2023-07-09T21:39:04.462557+0000","last_clean":"2023-07-09T21:39:04.462557+0000","last_became_active":"2023-07-09T21:39:02.235703+0000","last_became_peered":"2023-07-09T21:39:02.235703+0000","last_unstale":"2023-07-09T21:39:04.462557+0000","last_undegraded":"2023-07-09T21:39:04.462557+0000","last_fullsized":"2023-07-09T21:39:04.462557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:07:37.966839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478020+0000","last_change":"2023-07-09T21:39:03.237922+0000","last_active":"2023-07-09T21:39:04.478020+0000","last_peered":"2023-07-09T21:39:04.478020+0000","last_clean":"2023-07-09T21:39:04.478020+0000","last_became_active":"2023-07-09T21:39:03.237623+0000","last_became_peered":"2023-07-09T21:39:03.237623+0000","last_unstale":"2023-07-09T21:39:04.478020+0000","last_undegraded":"2023-07-09T21:39:04.478020+0000","last_fullsized":"2023-07-09T21:39:04.478020+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:33.919247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462258+0000","last_change":"2023-07-09T21:39:02.232727+0000","last_active":"2023-07-09T21:39:04.462258+0000","last_peered":"2023-07-09T21:39:04.462258+0000","last_clean":"2023-07-09T21:39:04.462258+0000","last_became_active":"2023-07-09T21:39:02.232459+0000","last_became_peered":"2023-07-09T21:39:02.232459+0000","last_unstale":"2023-07-09T21:39:04.462258+0000","last_undegraded":"2023-07-09T21:39:04.462258+0000","last_fullsized":"2023-07-09T21:39:04.462258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:16:28.328496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483999+0000","last_change":"2023-07-09T21:39:03.235961+0000","last_active":"2023-07-09T21:39:04.483999+0000","last_peered":"2023-07-09T21:39:04.483999+0000","last_clean":"2023-07-09T21:39:04.483999+0000","last_became_active":"2023-07-09T21:39:03.235551+0000","last_became_peered":"2023-07-09T21:39:03.235551+0000","last_unstale":"2023-07-09T21:39:04.483999+0000","last_undegraded":"2023-07-09T21:39:04.483999+0000","last_fullsized":"2023-07-09T21:39:04.483999+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:15.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483808+0000","last_change":"2023-07-09T21:39:02.233872+0000","last_active":"2023-07-09T21:39:04.483808+0000","last_peered":"2023-07-09T21:39:04.483808+0000","last_clean":"2023-07-09T21:39:04.483808+0000","last_became_active":"2023-07-09T21:39:02.233572+0000","last_became_peered":"2023-07-09T21:39:02.233572+0000","last_unstale":"2023-07-09T21:39:04.483808+0000","last_undegraded":"2023-07-09T21:39:04.483808+0000","last_fullsized":"2023-07-09T21:39:04.483808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:25.737187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484022+0000","last_change":"2023-07-09T21:39:03.236547+0000","last_active":"2023-07-09T21:39:04.484022+0000","last_peered":"2023-07-09T21:39:04.484022+0000","last_clean":"2023-07-09T21:39:04.484022+0000","last_became_active":"2023-07-09T21:39:03.236248+0000","last_became_peered":"2023-07-09T21:39:03.236248+0000","last_unstale":"2023-07-09T21:39:04.484022+0000","last_undegraded":"2023-07-09T21:39:04.484022+0000","last_fullsized":"2023-07-09T21:39:04.484022+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.617177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214347+0000","last_change":"2023-07-09T21:39:02.227372+0000","last_active":"2023-07-09T21:39:04.214347+0000","last_peered":"2023-07-09T21:39:04.214347+0000","last_clean":"2023-07-09T21:39:04.214347+0000","last_became_active":"2023-07-09T21:39:02.226984+0000","last_became_peered":"2023-07-09T21:39:02.226984+0000","last_unstale":"2023-07-09T21:39:04.214347+0000","last_undegraded":"2023-07-09T21:39:04.214347+0000","last_fullsized":"2023-07-09T21:39:04.214347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:14.229120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478413+0000","last_change":"2023-07-09T21:39:03.240394+0000","last_active":"2023-07-09T21:39:04.478413+0000","last_peered":"2023-07-09T21:39:04.478413+0000","last_clean":"2023-07-09T21:39:04.478413+0000","last_became_active":"2023-07-09T21:39:03.240094+0000","last_became_peered":"2023-07-09T21:39:03.240094+0000","last_unstale":"2023-07-09T21:39:04.478413+0000","last_undegraded":"2023-07-09T21:39:04.478413+0000","last_fullsized":"2023-07-09T21:39:04.478413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:32.387363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484126+0000","last_change":"2023-07-09T21:39:02.231774+0000","last_active":"2023-07-09T21:39:04.484126+0000","last_peered":"2023-07-09T21:39:04.484126+0000","last_clean":"2023-07-09T21:39:04.484126+0000","last_became_active":"2023-07-09T21:39:02.231437+0000","last_became_peered":"2023-07-09T21:39:02.231437+0000","last_unstale":"2023-07-09T21:39:04.484126+0000","last_undegraded":"2023-07-09T21:39:04.484126+0000","last_fullsized":"2023-07-09T21:39:04.484126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:05.102367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478532+0000","last_change":"2023-07-09T21:39:03.235159+0000","last_active":"2023-07-09T21:39:04.478532+0000","last_peered":"2023-07-09T21:39:04.478532+0000","last_clean":"2023-07-09T21:39:04.478532+0000","last_became_active":"2023-07-09T21:39:03.234874+0000","last_became_peered":"2023-07-09T21:39:03.234874+0000","last_unstale":"2023-07-09T21:39:04.478532+0000","last_undegraded":"2023-07-09T21:39:04.478532+0000","last_fullsized":"2023-07-09T21:39:04.478532+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:21.473977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477543+0000","last_change":"2023-07-09T21:39:02.220149+0000","last_active":"2023-07-09T21:39:04.477543+0000","last_peered":"2023-07-09T21:39:04.477543+0000","last_clean":"2023-07-09T21:39:04.477543+0000","last_became_active":"2023-07-09T21:39:02.219868+0000","last_became_peered":"2023-07-09T21:39:02.219868+0000","last_unstale":"2023-07-09T21:39:04.477543+0000","last_undegraded":"2023-07-09T21:39:04.477543+0000","last_fullsized":"2023-07-09T21:39:04.477543+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:43.097772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462752+0000","last_change":"2023-07-09T21:39:03.242302+0000","last_active":"2023-07-09T21:39:04.462752+0000","last_peered":"2023-07-09T21:39:04.462752+0000","last_clean":"2023-07-09T21:39:04.462752+0000","last_became_active":"2023-07-09T21:39:03.242012+0000","last_became_peered":"2023-07-09T21:39:03.242012+0000","last_unstale":"2023-07-09T21:39:04.462752+0000","last_undegraded":"2023-07-09T21:39:04.462752+0000","last_fullsized":"2023-07-09T21:39:04.462752+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:55.076979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477911+0000","last_change":"2023-07-09T21:39:02.225583+0000","last_active":"2023-07-09T21:39:04.477911+0000","last_peered":"2023-07-09T21:39:04.477911+0000","last_clean":"2023-07-09T21:39:04.477911+0000","last_became_active":"2023-07-09T21:39:02.225277+0000","last_became_peered":"2023-07-09T21:39:02.225277+0000","last_unstale":"2023-07-09T21:39:04.477911+0000","last_undegraded":"2023-07-09T21:39:04.477911+0000","last_fullsized":"2023-07-09T21:39:04.477911+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:08.759933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"87'183","reported_seq":549,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462306+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:04.462306+0000","last_peered":"2023-07-09T21:39:04.462306+0000","last_clean":"2023-07-09T21:39:04.462306+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:04.462306+0000","last_undegraded":"2023-07-09T21:39:04.462306+0000","last_fullsized":"2023-07-09T21:39:04.462306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:15:43.156460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221179+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:04.221179+0000","last_peered":"2023-07-09T21:39:04.221179+0000","last_clean":"2023-07-09T21:39:04.221179+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:04.221179+0000","last_undegraded":"2023-07-09T21:39:04.221179+0000","last_fullsized":"2023-07-09T21:39:04.221179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:05.838036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478689+0000","last_change":"2023-07-09T21:39:03.226788+0000","last_active":"2023-07-09T21:39:04.478689+0000","last_peered":"2023-07-09T21:39:04.478689+0000","last_clean":"2023-07-09T21:39:04.478689+0000","last_became_active":"2023-07-09T21:39:03.226406+0000","last_became_peered":"2023-07-09T21:39:03.226406+0000","last_unstale":"2023-07-09T21:39:04.478689+0000","last_undegraded":"2023-07-09T21:39:04.478689+0000","last_fullsized":"2023-07-09T21:39:04.478689+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:54.224100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477510+0000","last_change":"2023-07-09T21:39:02.226362+0000","last_active":"2023-07-09T21:39:04.477510+0000","last_peered":"2023-07-09T21:39:04.477510+0000","last_clean":"2023-07-09T21:39:04.477510+0000","last_became_active":"2023-07-09T21:39:02.225863+0000","last_became_peered":"2023-07-09T21:39:02.225863+0000","last_unstale":"2023-07-09T21:39:04.477510+0000","last_undegraded":"2023-07-09T21:39:04.477510+0000","last_fullsized":"2023-07-09T21:39:04.477510+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:22.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462343+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:04.462343+0000","last_peered":"2023-07-09T21:39:04.462343+0000","last_clean":"2023-07-09T21:39:04.462343+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:04.462343+0000","last_undegraded":"2023-07-09T21:39:04.462343+0000","last_fullsized":"2023-07-09T21:39:04.462343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:59.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484518+0000","last_change":"2023-07-09T21:39:03.232306+0000","last_active":"2023-07-09T21:39:04.484518+0000","last_peered":"2023-07-09T21:39:04.484518+0000","last_clean":"2023-07-09T21:39:04.484518+0000","last_became_active":"2023-07-09T21:39:03.232037+0000","last_became_peered":"2023-07-09T21:39:03.232037+0000","last_unstale":"2023-07-09T21:39:04.484518+0000","last_undegraded":"2023-07-09T21:39:04.484518+0000","last_fullsized":"2023-07-09T21:39:04.484518+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:51.477172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477333+0000","last_change":"2023-07-09T21:39:02.225573+0000","last_active":"2023-07-09T21:39:04.477333+0000","last_peered":"2023-07-09T21:39:04.477333+0000","last_clean":"2023-07-09T21:39:04.477333+0000","last_became_active":"2023-07-09T21:39:02.225239+0000","last_became_peered":"2023-07-09T21:39:02.225239+0000","last_unstale":"2023-07-09T21:39:04.477333+0000","last_undegraded":"2023-07-09T21:39:04.477333+0000","last_fullsized":"2023-07-09T21:39:04.477333+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:36.284726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214235+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:04.214235+0000","last_peered":"2023-07-09T21:39:04.214235+0000","last_clean":"2023-07-09T21:39:04.214235+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:04.214235+0000","last_undegraded":"2023-07-09T21:39:04.214235+0000","last_fullsized":"2023-07-09T21:39:04.214235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:20.238443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478439+0000","last_change":"2023-07-09T21:39:03.229516+0000","last_active":"2023-07-09T21:39:04.478439+0000","last_peered":"2023-07-09T21:39:04.478439+0000","last_clean":"2023-07-09T21:39:04.478439+0000","last_became_active":"2023-07-09T21:39:03.229057+0000","last_became_peered":"2023-07-09T21:39:03.229057+0000","last_unstale":"2023-07-09T21:39:04.478439+0000","last_undegraded":"2023-07-09T21:39:04.478439+0000","last_fullsized":"2023-07-09T21:39:04.478439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:01.690751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477941+0000","last_change":"2023-07-09T21:39:02.218979+0000","last_active":"2023-07-09T21:39:04.477941+0000","last_peered":"2023-07-09T21:39:04.477941+0000","last_clean":"2023-07-09T21:39:04.477941+0000","last_became_active":"2023-07-09T21:39:02.218641+0000","last_became_peered":"2023-07-09T21:39:02.218641+0000","last_unstale":"2023-07-09T21:39:04.477941+0000","last_undegraded":"2023-07-09T21:39:04.477941+0000","last_fullsized":"2023-07-09T21:39:04.477941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:14.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220988+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:04.220988+0000","last_peered":"2023-07-09T21:39:04.220988+0000","last_clean":"2023-07-09T21:39:04.220988+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:04.220988+0000","last_undegraded":"2023-07-09T21:39:04.220988+0000","last_fullsized":"2023-07-09T21:39:04.220988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:53.489159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214569+0000","last_change":"2023-07-09T21:39:03.231080+0000","last_active":"2023-07-09T21:39:04.214569+0000","last_peered":"2023-07-09T21:39:04.214569+0000","last_clean":"2023-07-09T21:39:04.214569+0000","last_became_active":"2023-07-09T21:39:03.230697+0000","last_became_peered":"2023-07-09T21:39:03.230697+0000","last_unstale":"2023-07-09T21:39:04.214569+0000","last_undegraded":"2023-07-09T21:39:04.214569+0000","last_fullsized":"2023-07-09T21:39:04.214569+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:11.013969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214679+0000","last_change":"2023-07-09T21:39:02.226536+0000","last_active":"2023-07-09T21:39:04.214679+0000","last_peered":"2023-07-09T21:39:04.214679+0000","last_clean":"2023-07-09T21:39:04.214679+0000","last_became_active":"2023-07-09T21:39:02.226268+0000","last_became_peered":"2023-07-09T21:39:02.226268+0000","last_unstale":"2023-07-09T21:39:04.214679+0000","last_undegraded":"2023-07-09T21:39:04.214679+0000","last_fullsized":"2023-07-09T21:39:04.214679+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:13.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478571+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:04.478571+0000","last_peered":"2023-07-09T21:39:04.478571+0000","last_clean":"2023-07-09T21:39:04.478571+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:04.478571+0000","last_undegraded":"2023-07-09T21:39:04.478571+0000","last_fullsized":"2023-07-09T21:39:04.478571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:32.892229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477821+0000","last_change":"2023-07-09T21:39:03.233861+0000","last_active":"2023-07-09T21:39:04.477821+0000","last_peered":"2023-07-09T21:39:04.477821+0000","last_clean":"2023-07-09T21:39:04.477821+0000","last_became_active":"2023-07-09T21:39:03.233535+0000","last_became_peered":"2023-07-09T21:39:03.233535+0000","last_unstale":"2023-07-09T21:39:04.477821+0000","last_undegraded":"2023-07-09T21:39:04.477821+0000","last_fullsized":"2023-07-09T21:39:04.477821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:33.919247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478383+0000","last_change":"2023-07-09T21:39:02.224587+0000","last_active":"2023-07-09T21:39:04.478383+0000","last_peered":"2023-07-09T21:39:04.478383+0000","last_clean":"2023-07-09T21:39:04.478383+0000","last_became_active":"2023-07-09T21:39:02.224283+0000","last_became_peered":"2023-07-09T21:39:02.224283+0000","last_unstale":"2023-07-09T21:39:04.478383+0000","last_undegraded":"2023-07-09T21:39:04.478383+0000","last_fullsized":"2023-07-09T21:39:04.478383+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:30.581274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462682+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:04.462682+0000","last_peered":"2023-07-09T21:39:04.462682+0000","last_clean":"2023-07-09T21:39:04.462682+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:04.462682+0000","last_undegraded":"2023-07-09T21:39:04.462682+0000","last_fullsized":"2023-07-09T21:39:04.462682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:29.150038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477259+0000","last_change":"2023-07-09T21:39:03.229188+0000","last_active":"2023-07-09T21:39:04.477259+0000","last_peered":"2023-07-09T21:39:04.477259+0000","last_clean":"2023-07-09T21:39:04.477259+0000","last_became_active":"2023-07-09T21:39:03.228667+0000","last_became_peered":"2023-07-09T21:39:03.228667+0000","last_unstale":"2023-07-09T21:39:04.477259+0000","last_undegraded":"2023-07-09T21:39:04.477259+0000","last_fullsized":"2023-07-09T21:39:04.477259+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:02:33.063461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462598+0000","last_change":"2023-07-09T21:39:02.236493+0000","last_active":"2023-07-09T21:39:04.462598+0000","last_peered":"2023-07-09T21:39:04.462598+0000","last_clean":"2023-07-09T21:39:04.462598+0000","last_became_active":"2023-07-09T21:39:02.236157+0000","last_became_peered":"2023-07-09T21:39:02.236157+0000","last_unstale":"2023-07-09T21:39:04.462598+0000","last_undegraded":"2023-07-09T21:39:04.462598+0000","last_fullsized":"2023-07-09T21:39:04.462598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:34.346665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478530+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:04.478530+0000","last_peered":"2023-07-09T21:39:04.478530+0000","last_clean":"2023-07-09T21:39:04.478530+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:04.478530+0000","last_undegraded":"2023-07-09T21:39:04.478530+0000","last_fullsized":"2023-07-09T21:39:04.478530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:31.921496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214110+0000","last_change":"2023-07-09T21:39:03.231311+0000","last_active":"2023-07-09T21:39:04.214110+0000","last_peered":"2023-07-09T21:39:04.214110+0000","last_clean":"2023-07-09T21:39:04.214110+0000","last_became_active":"2023-07-09T21:39:03.230032+0000","last_became_peered":"2023-07-09T21:39:03.230032+0000","last_unstale":"2023-07-09T21:39:04.214110+0000","last_undegraded":"2023-07-09T21:39:04.214110+0000","last_fullsized":"2023-07-09T21:39:04.214110+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:10.620279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222999+0000","last_change":"2023-07-09T21:39:02.228812+0000","last_active":"2023-07-09T21:39:04.222999+0000","last_peered":"2023-07-09T21:39:04.222999+0000","last_clean":"2023-07-09T21:39:04.222999+0000","last_became_active":"2023-07-09T21:39:02.228542+0000","last_became_peered":"2023-07-09T21:39:02.228542+0000","last_unstale":"2023-07-09T21:39:04.222999+0000","last_undegraded":"2023-07-09T21:39:04.222999+0000","last_fullsized":"2023-07-09T21:39:04.222999+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:45:57.017978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484508+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:04.484508+0000","last_peered":"2023-07-09T21:39:04.484508+0000","last_clean":"2023-07-09T21:39:04.484508+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:04.484508+0000","last_undegraded":"2023-07-09T21:39:04.484508+0000","last_fullsized":"2023-07-09T21:39:04.484508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:12:47.280890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312788,"statfs":{"total":96636764160,"available":96576294912,"internally_reserved":0,"allocated":1806336,"data_stored":1198680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.70199999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82999999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1220608,"data_stored":609854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.747},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.51700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575049,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50280,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321560,"statfs":{"total":96636764160,"available":96585277440,"internally_reserved":0,"allocated":1212416,"data_stored":608324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70299999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.87}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.91000000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.92900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575051,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1228800,"data_stored":609958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.82799999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.84499999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.86899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":608872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56200000000000006}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.754},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54384,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317456,"statfs":{"total":96636764160,"available":96581074944,"internally_reserved":0,"allocated":1220608,"data_stored":609032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.27100000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":608402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.753},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.78900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1802240,"data_stored":1198658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.89700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:11.922 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:12.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 Processor -- start 2023-07-09T21:39:12.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 -- start start 2023-07-09T21:39:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f75d00af830 0x7f75d00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75d006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d00cbe90 con 0x7f75d00cc770 2023-07-09T21:39:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d006d370 con 0x7f75d00af830 2023-07-09T21:39:12.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.074+0000 7f75d525c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00b0140 con 0x7f75d00cc320 2023-07-09T21:39:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75cf59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75d00cc770 0x7f75d006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39062/0 (socket says 172.21.15.37:39062) 2023-07-09T21:39:12.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75cf59e640 1 -- 172.21.15.37:0/1140428283 learned_addr learned my addr 172.21.15.37:0/1140428283 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:12.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ced9d640 1 --2- 172.21.15.37:0/1140428283 >> v2:172.21.15.119:3300/0 conn(0x7f75d00af830 0x7f75d00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75d006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532046108 0 0) 0x7f75d00cbe90 con 0x7f75d00cc770 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75bc003530 con 0x7f75d00cc770 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3549863001 0 0) 0x7f75bc003530 con 0x7f75d00cc770 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 msgr2=0x7f75d006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75d006efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 >> v2:172.21.15.119:3300/0 conn(0x7f75d00af830 msgr2=0x7f75d00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 --2- 172.21.15.37:0/1140428283 >> v2:172.21.15.119:3300/0 conn(0x7f75d00af830 0x7f75d00afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d0159bb0 con 0x7f75d00cc770 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f75c8001a50 con 0x7f75d00cc770 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 >> v1:172.21.15.37:6789/0 conn(0x7f75d00cc770 legacy=0x7f75d006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75bc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75bc003f00 0x7f75bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75bc004d10 0x7f75bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d006d370 con 0x7f75bc003f00 2023-07-09T21:39:12.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00b0140 con 0x7f75bc004d10 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc00b990 con 0x7f75d00cc320 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75bc003f00 0x7f75bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75ced9d640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75bc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75cf59e640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75bc004d10 0x7f75bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 -- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 msgr2=0x7f75bc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75d00cc320 0x7f75bc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 -- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75bc004d10 msgr2=0x7f75bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:12.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75bc004d10 0x7f75bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75c7fff640 1 -- 172.21.15.37:0/1140428283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc003530 con 0x7f75bc003f00 2023-07-09T21:39:12.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.078+0000 7f75cf59e640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75bc004d10 0x7f75bc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75c7fff640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75bc003f00 0x7f75bc0047d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009ae0 tx=0x7f75b801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc019ad32ad4de6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80a5640 con 0x7f75bc003f00 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80a57a0 con 0x7f75bc003f00 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75ce59c640 1 -- 172.21.15.37:0/1140428283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80a5b50 con 0x7f75bc003f00 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- 172.21.15.37:0/1140428283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75bc003f00 msgr2=0x7f75bc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 --2- 172.21.15.37:0/1140428283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75bc003f00 0x7f75bc0047d0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f75b8009ae0 tx=0x7f75b801ca50 comp rx=0 tx=0).stop 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75cf59e640 1 -- 172.21.15.37:0/1140428283 reap_dead start 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- 172.21.15.37:0/1140428283 shutdown_connections 2023-07-09T21:39:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- 172.21.15.37:0/1140428283 >> 172.21.15.37:0/1140428283 conn(0x7f75d00ca830 msgr2=0x7f75d00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- 172.21.15.37:0/1140428283 shutdown_connections 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- 172.21.15.37:0/1140428283 wait complete. 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 Processor -- start 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.082+0000 7f75d525c640 1 -- start start 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75bc003f00 0x7f75d0155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00c16a0 0x7f75d00c30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d00c40c0 con 0x7f75d015bc10 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d015ce00 con 0x7f75d00c16a0 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d015c180 con 0x7f75bc003f00 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59584/0 (socket says 172.21.15.37:59584) 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 -- 172.21.15.37:0/3163117012 learned_addr learned my addr 172.21.15.37:0/3163117012 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75ced9d640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75bc003f00 0x7f75d0155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75cf59e640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00c16a0 0x7f75d00c30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 -- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75bc003f00 msgr2=0x7f75d0155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75bc003f00 0x7f75d0155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 -- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00c16a0 msgr2=0x7f75d00c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00c16a0 0x7f75d00c30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 -- 172.21.15.37:0/3163117012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d015c460 con 0x7f75d015bc10 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c7fff640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b0040 tx=0x7f75bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b80be070 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b80a5990 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b8004240 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d015c740 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d0159de0 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.086+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d0156250 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.090+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f75b80b4040 con 0x7f75d015bc10 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.090+0000 7f75c77fe640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 0x7f75b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.090+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75b811db90 con 0x7f75d015bc10 2023-07-09T21:39:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.090+0000 7f75ced9d640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 0x7f75b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.090+0000 7f75ced9d640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 0x7f75b0068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009c60 tx=0x7f75c0009190 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.094+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75d0156250 con 0x7f75d015bc10 2023-07-09T21:39:12.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.246+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75d006cdb0 con 0x7f75b00663a0 2023-07-09T21:39:12.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.254+0000 7f75c77fe640 1 -- 172.21.15.37:0/3163117012 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311720 (secure 0 0 0) 0x7f75c0019070 con 0x7f75b00663a0 2023-07-09T21:39:12.264 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:12.266 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:12.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 msgr2=0x7f75b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 0x7f75b0068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009c60 tx=0x7f75c0009190 comp rx=0 tx=0).stop 2023-07-09T21:39:12.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 msgr2=0x7f75d00c2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f75b80b0040 tx=0x7f75bc005800 comp rx=0 tx=0).stop 2023-07-09T21:39:12.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 shutdown_connections 2023-07-09T21:39:12.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f75b00663a0 0x7f75b0068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75d00c16a0 0x7f75d00c30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75d015bc10 0x7f75d00c2b80 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 --2- 172.21.15.37:0/3163117012 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75bc003f00 0x7f75d0155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 >> 172.21.15.37:0/3163117012 conn(0x7f75d00ca830 msgr2=0x7f75d00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:12.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 shutdown_connections 2023-07-09T21:39:12.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.258+0000 7f75d525c640 1 -- 172.21.15.37:0/3163117012 wait complete. 2023-07-09T21:39:12.280 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:39:10.879688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":324,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":222,"ondisk_log_size":222,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":329576,"kb_used_data":10664,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754645144,"statfs":{"total":773094113280,"available":772756627456,"internally_reserved":0,"allocated":10919936,"data_stored":6051780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002441"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462508+0000","last_change":"2023-07-09T21:39:03.244617+0000","last_active":"2023-07-09T21:39:04.462508+0000","last_peered":"2023-07-09T21:39:04.462508+0000","last_clean":"2023-07-09T21:39:04.462508+0000","last_became_active":"2023-07-09T21:39:03.244334+0000","last_became_peered":"2023-07-09T21:39:03.244334+0000","last_unstale":"2023-07-09T21:39:04.462508+0000","last_undegraded":"2023-07-09T21:39:04.462508+0000","last_fullsized":"2023-07-09T21:39:04.462508+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:56.308404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478636+0000","last_change":"2023-07-09T21:39:03.237636+0000","last_active":"2023-07-09T21:39:04.478636+0000","last_peered":"2023-07-09T21:39:04.478636+0000","last_clean":"2023-07-09T21:39:04.478636+0000","last_became_active":"2023-07-09T21:39:03.227146+0000","last_became_peered":"2023-07-09T21:39:03.227146+0000","last_unstale":"2023-07-09T21:39:04.478636+0000","last_undegraded":"2023-07-09T21:39:04.478636+0000","last_fullsized":"2023-07-09T21:39:04.478636+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:59.871304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478079+0000","last_change":"2023-07-09T21:39:03.231388+0000","last_active":"2023-07-09T21:39:04.478079+0000","last_peered":"2023-07-09T21:39:04.478079+0000","last_clean":"2023-07-09T21:39:04.478079+0000","last_became_active":"2023-07-09T21:39:03.231116+0000","last_became_peered":"2023-07-09T21:39:03.231116+0000","last_unstale":"2023-07-09T21:39:04.478079+0000","last_undegraded":"2023-07-09T21:39:04.478079+0000","last_fullsized":"2023-07-09T21:39:04.478079+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:07.529964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221544+0000","last_change":"2023-07-09T21:39:03.233561+0000","last_active":"2023-07-09T21:39:04.221544+0000","last_peered":"2023-07-09T21:39:04.221544+0000","last_clean":"2023-07-09T21:39:04.221544+0000","last_became_active":"2023-07-09T21:39:03.233051+0000","last_became_peered":"2023-07-09T21:39:03.233051+0000","last_unstale":"2023-07-09T21:39:04.221544+0000","last_undegraded":"2023-07-09T21:39:04.221544+0000","last_fullsized":"2023-07-09T21:39:04.221544+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:10:01.369849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214731+0000","last_change":"2023-07-09T21:39:03.235865+0000","last_active":"2023-07-09T21:39:04.214731+0000","last_peered":"2023-07-09T21:39:04.214731+0000","last_clean":"2023-07-09T21:39:04.214731+0000","last_became_active":"2023-07-09T21:39:03.235576+0000","last_became_peered":"2023-07-09T21:39:03.235576+0000","last_unstale":"2023-07-09T21:39:04.214731+0000","last_undegraded":"2023-07-09T21:39:04.214731+0000","last_fullsized":"2023-07-09T21:39:04.214731+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:14:55.210432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477574+0000","last_change":"2023-07-09T21:39:03.235545+0000","last_active":"2023-07-09T21:39:04.477574+0000","last_peered":"2023-07-09T21:39:04.477574+0000","last_clean":"2023-07-09T21:39:04.477574+0000","last_became_active":"2023-07-09T21:39:03.234889+0000","last_became_peered":"2023-07-09T21:39:03.234889+0000","last_unstale":"2023-07-09T21:39:04.477574+0000","last_undegraded":"2023-07-09T21:39:04.477574+0000","last_fullsized":"2023-07-09T21:39:04.477574+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:04.021520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483927+0000","last_change":"2023-07-09T21:39:03.235120+0000","last_active":"2023-07-09T21:39:04.483927+0000","last_peered":"2023-07-09T21:39:04.483927+0000","last_clean":"2023-07-09T21:39:04.483927+0000","last_became_active":"2023-07-09T21:39:03.234231+0000","last_became_peered":"2023-07-09T21:39:03.234231+0000","last_unstale":"2023-07-09T21:39:04.483927+0000","last_undegraded":"2023-07-09T21:39:04.483927+0000","last_fullsized":"2023-07-09T21:39:04.483927+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:38.983162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214094+0000","last_change":"2023-07-09T21:39:03.234801+0000","last_active":"2023-07-09T21:39:04.214094+0000","last_peered":"2023-07-09T21:39:04.214094+0000","last_clean":"2023-07-09T21:39:04.214094+0000","last_became_active":"2023-07-09T21:39:03.234441+0000","last_became_peered":"2023-07-09T21:39:03.234441+0000","last_unstale":"2023-07-09T21:39:04.214094+0000","last_undegraded":"2023-07-09T21:39:04.214094+0000","last_fullsized":"2023-07-09T21:39:04.214094+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:44.741718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222807+0000","last_change":"2023-07-09T21:39:03.241221+0000","last_active":"2023-07-09T21:39:04.222807+0000","last_peered":"2023-07-09T21:39:04.222807+0000","last_clean":"2023-07-09T21:39:04.222807+0000","last_became_active":"2023-07-09T21:39:03.240942+0000","last_became_peered":"2023-07-09T21:39:03.240942+0000","last_unstale":"2023-07-09T21:39:04.222807+0000","last_undegraded":"2023-07-09T21:39:04.222807+0000","last_fullsized":"2023-07-09T21:39:04.222807+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:15.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221293+0000","last_change":"2023-07-09T21:39:03.235682+0000","last_active":"2023-07-09T21:39:04.221293+0000","last_peered":"2023-07-09T21:39:04.221293+0000","last_clean":"2023-07-09T21:39:04.221293+0000","last_became_active":"2023-07-09T21:39:03.235411+0000","last_became_peered":"2023-07-09T21:39:03.235411+0000","last_unstale":"2023-07-09T21:39:04.221293+0000","last_undegraded":"2023-07-09T21:39:04.221293+0000","last_fullsized":"2023-07-09T21:39:04.221293+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:08:19.235018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478279+0000","last_change":"2023-07-09T21:39:03.237372+0000","last_active":"2023-07-09T21:39:04.478279+0000","last_peered":"2023-07-09T21:39:04.478279+0000","last_clean":"2023-07-09T21:39:04.478279+0000","last_became_active":"2023-07-09T21:39:03.237079+0000","last_became_peered":"2023-07-09T21:39:03.237079+0000","last_unstale":"2023-07-09T21:39:04.478279+0000","last_undegraded":"2023-07-09T21:39:04.478279+0000","last_fullsized":"2023-07-09T21:39:04.478279+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:09.767819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221694+0000","last_change":"2023-07-09T21:39:03.237307+0000","last_active":"2023-07-09T21:39:04.221694+0000","last_peered":"2023-07-09T21:39:04.221694+0000","last_clean":"2023-07-09T21:39:04.221694+0000","last_became_active":"2023-07-09T21:39:03.236959+0000","last_became_peered":"2023-07-09T21:39:03.236959+0000","last_unstale":"2023-07-09T21:39:04.221694+0000","last_undegraded":"2023-07-09T21:39:04.221694+0000","last_fullsized":"2023-07-09T21:39:04.221694+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:02:30.158775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214394+0000","last_change":"2023-07-09T21:39:03.238163+0000","last_active":"2023-07-09T21:39:04.214394+0000","last_peered":"2023-07-09T21:39:04.214394+0000","last_clean":"2023-07-09T21:39:04.214394+0000","last_became_active":"2023-07-09T21:39:03.237877+0000","last_became_peered":"2023-07-09T21:39:03.237877+0000","last_unstale":"2023-07-09T21:39:04.214394+0000","last_undegraded":"2023-07-09T21:39:04.214394+0000","last_fullsized":"2023-07-09T21:39:04.214394+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:01:44.007282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477703+0000","last_change":"2023-07-09T21:39:03.235357+0000","last_active":"2023-07-09T21:39:04.477703+0000","last_peered":"2023-07-09T21:39:04.477703+0000","last_clean":"2023-07-09T21:39:04.477703+0000","last_became_active":"2023-07-09T21:39:03.234537+0000","last_became_peered":"2023-07-09T21:39:03.234537+0000","last_unstale":"2023-07-09T21:39:04.477703+0000","last_undegraded":"2023-07-09T21:39:04.477703+0000","last_fullsized":"2023-07-09T21:39:04.477703+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:50.858308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477670+0000","last_change":"2023-07-09T21:39:03.221896+0000","last_active":"2023-07-09T21:39:04.477670+0000","last_peered":"2023-07-09T21:39:04.477670+0000","last_clean":"2023-07-09T21:39:04.477670+0000","last_became_active":"2023-07-09T21:39:03.221547+0000","last_became_peered":"2023-07-09T21:39:03.221547+0000","last_unstale":"2023-07-09T21:39:04.477670+0000","last_undegraded":"2023-07-09T21:39:04.477670+0000","last_fullsized":"2023-07-09T21:39:04.477670+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:02:33.063461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.461967+0000","last_change":"2023-07-09T21:39:03.240444+0000","last_active":"2023-07-09T21:39:04.461967+0000","last_peered":"2023-07-09T21:39:04.461967+0000","last_clean":"2023-07-09T21:39:04.461967+0000","last_became_active":"2023-07-09T21:39:03.239831+0000","last_became_peered":"2023-07-09T21:39:03.239831+0000","last_unstale":"2023-07-09T21:39:04.461967+0000","last_undegraded":"2023-07-09T21:39:04.461967+0000","last_fullsized":"2023-07-09T21:39:04.461967+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:11.545231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214746+0000","last_change":"2023-07-09T21:39:03.230687+0000","last_active":"2023-07-09T21:39:04.214746+0000","last_peered":"2023-07-09T21:39:04.214746+0000","last_clean":"2023-07-09T21:39:04.214746+0000","last_became_active":"2023-07-09T21:39:03.230382+0000","last_became_peered":"2023-07-09T21:39:03.230382+0000","last_unstale":"2023-07-09T21:39:04.214746+0000","last_undegraded":"2023-07-09T21:39:04.214746+0000","last_fullsized":"2023-07-09T21:39:04.214746+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:34:12.130395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478271+0000","last_change":"2023-07-09T21:39:03.232581+0000","last_active":"2023-07-09T21:39:04.478271+0000","last_peered":"2023-07-09T21:39:04.478271+0000","last_clean":"2023-07-09T21:39:04.478271+0000","last_became_active":"2023-07-09T21:39:03.232254+0000","last_became_peered":"2023-07-09T21:39:03.232254+0000","last_unstale":"2023-07-09T21:39:04.478271+0000","last_undegraded":"2023-07-09T21:39:04.478271+0000","last_fullsized":"2023-07-09T21:39:04.478271+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:46.239534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478115+0000","last_change":"2023-07-09T21:39:03.233878+0000","last_active":"2023-07-09T21:39:04.478115+0000","last_peered":"2023-07-09T21:39:04.478115+0000","last_clean":"2023-07-09T21:39:04.478115+0000","last_became_active":"2023-07-09T21:39:03.233483+0000","last_became_peered":"2023-07-09T21:39:03.233483+0000","last_unstale":"2023-07-09T21:39:04.478115+0000","last_undegraded":"2023-07-09T21:39:04.478115+0000","last_fullsized":"2023-07-09T21:39:04.478115+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:29.730195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214669+0000","last_change":"2023-07-09T21:39:03.224486+0000","last_active":"2023-07-09T21:39:04.214669+0000","last_peered":"2023-07-09T21:39:04.214669+0000","last_clean":"2023-07-09T21:39:04.214669+0000","last_became_active":"2023-07-09T21:39:03.224098+0000","last_became_peered":"2023-07-09T21:39:03.224098+0000","last_unstale":"2023-07-09T21:39:04.214669+0000","last_undegraded":"2023-07-09T21:39:04.214669+0000","last_fullsized":"2023-07-09T21:39:04.214669+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:16.223964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222463+0000","last_change":"2023-07-09T21:39:03.243143+0000","last_active":"2023-07-09T21:39:04.222463+0000","last_peered":"2023-07-09T21:39:04.222463+0000","last_clean":"2023-07-09T21:39:04.222463+0000","last_became_active":"2023-07-09T21:39:03.242877+0000","last_became_peered":"2023-07-09T21:39:03.242877+0000","last_unstale":"2023-07-09T21:39:04.222463+0000","last_undegraded":"2023-07-09T21:39:04.222463+0000","last_fullsized":"2023-07-09T21:39:04.222463+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:26.745073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214201+0000","last_change":"2023-07-09T21:39:03.238103+0000","last_active":"2023-07-09T21:39:04.214201+0000","last_peered":"2023-07-09T21:39:04.214201+0000","last_clean":"2023-07-09T21:39:04.214201+0000","last_became_active":"2023-07-09T21:39:03.237800+0000","last_became_peered":"2023-07-09T21:39:03.237800+0000","last_unstale":"2023-07-09T21:39:04.214201+0000","last_undegraded":"2023-07-09T21:39:04.214201+0000","last_fullsized":"2023-07-09T21:39:04.214201+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:17.735787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222192+0000","last_change":"2023-07-09T21:39:03.238255+0000","last_active":"2023-07-09T21:39:04.222192+0000","last_peered":"2023-07-09T21:39:04.222192+0000","last_clean":"2023-07-09T21:39:04.222192+0000","last_became_active":"2023-07-09T21:39:03.237742+0000","last_became_peered":"2023-07-09T21:39:03.237742+0000","last_unstale":"2023-07-09T21:39:04.222192+0000","last_undegraded":"2023-07-09T21:39:04.222192+0000","last_fullsized":"2023-07-09T21:39:04.222192+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:33.204834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477510+0000","last_change":"2023-07-09T21:39:03.228184+0000","last_active":"2023-07-09T21:39:04.477510+0000","last_peered":"2023-07-09T21:39:04.477510+0000","last_clean":"2023-07-09T21:39:04.477510+0000","last_became_active":"2023-07-09T21:39:03.227865+0000","last_became_peered":"2023-07-09T21:39:03.227865+0000","last_unstale":"2023-07-09T21:39:04.477510+0000","last_undegraded":"2023-07-09T21:39:04.477510+0000","last_fullsized":"2023-07-09T21:39:04.477510+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:43:12.721902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478224+0000","last_change":"2023-07-09T21:39:03.236456+0000","last_active":"2023-07-09T21:39:04.478224+0000","last_peered":"2023-07-09T21:39:04.478224+0000","last_clean":"2023-07-09T21:39:04.478224+0000","last_became_active":"2023-07-09T21:39:03.230013+0000","last_became_peered":"2023-07-09T21:39:03.230013+0000","last_unstale":"2023-07-09T21:39:04.478224+0000","last_undegraded":"2023-07-09T21:39:04.478224+0000","last_fullsized":"2023-07-09T21:39:04.478224+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:24.396808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221296+0000","last_change":"2023-07-09T21:39:03.245208+0000","last_active":"2023-07-09T21:39:04.221296+0000","last_peered":"2023-07-09T21:39:04.221296+0000","last_clean":"2023-07-09T21:39:04.221296+0000","last_became_active":"2023-07-09T21:39:03.244927+0000","last_became_peered":"2023-07-09T21:39:03.244927+0000","last_unstale":"2023-07-09T21:39:04.221296+0000","last_undegraded":"2023-07-09T21:39:04.221296+0000","last_fullsized":"2023-07-09T21:39:04.221296+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:32.299841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462268+0000","last_change":"2023-07-09T21:39:03.243939+0000","last_active":"2023-07-09T21:39:04.462268+0000","last_peered":"2023-07-09T21:39:04.462268+0000","last_clean":"2023-07-09T21:39:04.462268+0000","last_became_active":"2023-07-09T21:39:03.243635+0000","last_became_peered":"2023-07-09T21:39:03.243635+0000","last_unstale":"2023-07-09T21:39:04.462268+0000","last_undegraded":"2023-07-09T21:39:04.462268+0000","last_fullsized":"2023-07-09T21:39:04.462268+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:59.761651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214611+0000","last_change":"2023-07-09T21:39:03.226420+0000","last_active":"2023-07-09T21:39:04.214611+0000","last_peered":"2023-07-09T21:39:04.214611+0000","last_clean":"2023-07-09T21:39:04.214611+0000","last_became_active":"2023-07-09T21:39:03.226103+0000","last_became_peered":"2023-07-09T21:39:03.226103+0000","last_unstale":"2023-07-09T21:39:04.214611+0000","last_undegraded":"2023-07-09T21:39:04.214611+0000","last_fullsized":"2023-07-09T21:39:04.214611+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:59:33.294757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477918+0000","last_change":"2023-07-09T21:39:03.224911+0000","last_active":"2023-07-09T21:39:04.477918+0000","last_peered":"2023-07-09T21:39:04.477918+0000","last_clean":"2023-07-09T21:39:04.477918+0000","last_became_active":"2023-07-09T21:39:03.224204+0000","last_became_peered":"2023-07-09T21:39:03.224204+0000","last_unstale":"2023-07-09T21:39:04.477918+0000","last_undegraded":"2023-07-09T21:39:04.477918+0000","last_fullsized":"2023-07-09T21:39:04.477918+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:04.021520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462031+0000","last_change":"2023-07-09T21:39:03.246056+0000","last_active":"2023-07-09T21:39:04.462031+0000","last_peered":"2023-07-09T21:39:04.462031+0000","last_clean":"2023-07-09T21:39:04.462031+0000","last_became_active":"2023-07-09T21:39:03.245746+0000","last_became_peered":"2023-07-09T21:39:03.245746+0000","last_unstale":"2023-07-09T21:39:04.462031+0000","last_undegraded":"2023-07-09T21:39:04.462031+0000","last_fullsized":"2023-07-09T21:39:04.462031+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:08:40.084902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478260+0000","last_change":"2023-07-09T21:39:03.229581+0000","last_active":"2023-07-09T21:39:04.478260+0000","last_peered":"2023-07-09T21:39:04.478260+0000","last_clean":"2023-07-09T21:39:04.478260+0000","last_became_active":"2023-07-09T21:39:03.229267+0000","last_became_peered":"2023-07-09T21:39:03.229267+0000","last_unstale":"2023-07-09T21:39:04.478260+0000","last_undegraded":"2023-07-09T21:39:04.478260+0000","last_fullsized":"2023-07-09T21:39:04.478260+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:54.119510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462096+0000","last_change":"2023-07-09T21:39:03.240647+0000","last_active":"2023-07-09T21:39:04.462096+0000","last_peered":"2023-07-09T21:39:04.462096+0000","last_clean":"2023-07-09T21:39:04.462096+0000","last_became_active":"2023-07-09T21:39:03.240176+0000","last_became_peered":"2023-07-09T21:39:03.240176+0000","last_unstale":"2023-07-09T21:39:04.462096+0000","last_undegraded":"2023-07-09T21:39:04.462096+0000","last_fullsized":"2023-07-09T21:39:04.462096+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:32.311622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477406+0000","last_change":"2023-07-09T21:39:03.227143+0000","last_active":"2023-07-09T21:39:04.477406+0000","last_peered":"2023-07-09T21:39:04.477406+0000","last_clean":"2023-07-09T21:39:04.477406+0000","last_became_active":"2023-07-09T21:39:03.226869+0000","last_became_peered":"2023-07-09T21:39:03.226869+0000","last_unstale":"2023-07-09T21:39:04.477406+0000","last_undegraded":"2023-07-09T21:39:04.477406+0000","last_fullsized":"2023-07-09T21:39:04.477406+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:21.106069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"98'4","reported_seq":17,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214792+0000","last_change":"2023-07-09T21:39:02.227658+0000","last_active":"2023-07-09T21:39:04.214792+0000","last_peered":"2023-07-09T21:39:04.214792+0000","last_clean":"2023-07-09T21:39:04.214792+0000","last_became_active":"2023-07-09T21:39:02.227277+0000","last_became_peered":"2023-07-09T21:39:02.227277+0000","last_unstale":"2023-07-09T21:39:04.214792+0000","last_undegraded":"2023-07-09T21:39:04.214792+0000","last_fullsized":"2023-07-09T21:39:04.214792+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:57.264576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477814+0000","last_change":"2023-07-09T21:39:03.228671+0000","last_active":"2023-07-09T21:39:04.477814+0000","last_peered":"2023-07-09T21:39:04.477814+0000","last_clean":"2023-07-09T21:39:04.477814+0000","last_became_active":"2023-07-09T21:39:03.228339+0000","last_became_peered":"2023-07-09T21:39:03.228339+0000","last_unstale":"2023-07-09T21:39:04.477814+0000","last_undegraded":"2023-07-09T21:39:04.477814+0000","last_fullsized":"2023-07-09T21:39:04.477814+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:23.737703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462420+0000","last_change":"2023-07-09T21:39:02.237998+0000","last_active":"2023-07-09T21:39:04.462420+0000","last_peered":"2023-07-09T21:39:04.462420+0000","last_clean":"2023-07-09T21:39:04.462420+0000","last_became_active":"2023-07-09T21:39:02.237705+0000","last_became_peered":"2023-07-09T21:39:02.237705+0000","last_unstale":"2023-07-09T21:39:04.462420+0000","last_undegraded":"2023-07-09T21:39:04.462420+0000","last_fullsized":"2023-07-09T21:39:04.462420+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:08:37.143795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222364+0000","last_change":"2023-07-09T21:39:03.239518+0000","last_active":"2023-07-09T21:39:04.222364+0000","last_peered":"2023-07-09T21:39:04.222364+0000","last_clean":"2023-07-09T21:39:04.222364+0000","last_became_active":"2023-07-09T21:39:03.238840+0000","last_became_peered":"2023-07-09T21:39:03.238840+0000","last_unstale":"2023-07-09T21:39:04.222364+0000","last_undegraded":"2023-07-09T21:39:04.222364+0000","last_fullsized":"2023-07-09T21:39:04.222364+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:02:56.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462290+0000","last_change":"2023-07-09T21:39:02.236776+0000","last_active":"2023-07-09T21:39:04.462290+0000","last_peered":"2023-07-09T21:39:04.462290+0000","last_clean":"2023-07-09T21:39:04.462290+0000","last_became_active":"2023-07-09T21:39:02.236505+0000","last_became_peered":"2023-07-09T21:39:02.236505+0000","last_unstale":"2023-07-09T21:39:04.462290+0000","last_undegraded":"2023-07-09T21:39:04.462290+0000","last_fullsized":"2023-07-09T21:39:04.462290+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:00:32.642485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222604+0000","last_change":"2023-07-09T21:39:03.239737+0000","last_active":"2023-07-09T21:39:04.222604+0000","last_peered":"2023-07-09T21:39:04.222604+0000","last_clean":"2023-07-09T21:39:04.222604+0000","last_became_active":"2023-07-09T21:39:03.239455+0000","last_became_peered":"2023-07-09T21:39:03.239455+0000","last_unstale":"2023-07-09T21:39:04.222604+0000","last_undegraded":"2023-07-09T21:39:04.222604+0000","last_fullsized":"2023-07-09T21:39:04.222604+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:40.858107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484015+0000","last_change":"2023-07-09T21:39:02.235294+0000","last_active":"2023-07-09T21:39:04.484015+0000","last_peered":"2023-07-09T21:39:04.484015+0000","last_clean":"2023-07-09T21:39:04.484015+0000","last_became_active":"2023-07-09T21:39:02.234886+0000","last_became_peered":"2023-07-09T21:39:02.234886+0000","last_unstale":"2023-07-09T21:39:04.484015+0000","last_undegraded":"2023-07-09T21:39:04.484015+0000","last_fullsized":"2023-07-09T21:39:04.484015+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:08.954605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478342+0000","last_change":"2023-07-09T21:39:03.225166+0000","last_active":"2023-07-09T21:39:04.478342+0000","last_peered":"2023-07-09T21:39:04.478342+0000","last_clean":"2023-07-09T21:39:04.478342+0000","last_became_active":"2023-07-09T21:39:03.224875+0000","last_became_peered":"2023-07-09T21:39:03.224875+0000","last_unstale":"2023-07-09T21:39:04.478342+0000","last_undegraded":"2023-07-09T21:39:04.478342+0000","last_fullsized":"2023-07-09T21:39:04.478342+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:15.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222618+0000","last_change":"2023-07-09T21:39:02.232585+0000","last_active":"2023-07-09T21:39:04.222618+0000","last_peered":"2023-07-09T21:39:04.222618+0000","last_clean":"2023-07-09T21:39:04.222618+0000","last_became_active":"2023-07-09T21:39:02.232315+0000","last_became_peered":"2023-07-09T21:39:02.232315+0000","last_unstale":"2023-07-09T21:39:04.222618+0000","last_undegraded":"2023-07-09T21:39:04.222618+0000","last_fullsized":"2023-07-09T21:39:04.222618+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:37.975276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478412+0000","last_change":"2023-07-09T21:39:03.227507+0000","last_active":"2023-07-09T21:39:04.478412+0000","last_peered":"2023-07-09T21:39:04.478412+0000","last_clean":"2023-07-09T21:39:04.478412+0000","last_became_active":"2023-07-09T21:39:03.227168+0000","last_became_peered":"2023-07-09T21:39:03.227168+0000","last_unstale":"2023-07-09T21:39:04.478412+0000","last_undegraded":"2023-07-09T21:39:04.478412+0000","last_fullsized":"2023-07-09T21:39:04.478412+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:29.730195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220917+0000","last_change":"2023-07-09T21:39:02.235039+0000","last_active":"2023-07-09T21:39:04.220917+0000","last_peered":"2023-07-09T21:39:04.220917+0000","last_clean":"2023-07-09T21:39:04.220917+0000","last_became_active":"2023-07-09T21:39:02.234707+0000","last_became_peered":"2023-07-09T21:39:02.234707+0000","last_unstale":"2023-07-09T21:39:04.220917+0000","last_undegraded":"2023-07-09T21:39:04.220917+0000","last_fullsized":"2023-07-09T21:39:04.220917+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:50:58.657750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222915+0000","last_change":"2023-07-09T21:39:03.237791+0000","last_active":"2023-07-09T21:39:04.222915+0000","last_peered":"2023-07-09T21:39:04.222915+0000","last_clean":"2023-07-09T21:39:04.222915+0000","last_became_active":"2023-07-09T21:39:03.237482+0000","last_became_peered":"2023-07-09T21:39:03.237482+0000","last_unstale":"2023-07-09T21:39:04.222915+0000","last_undegraded":"2023-07-09T21:39:04.222915+0000","last_fullsized":"2023-07-09T21:39:04.222915+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.617177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477938+0000","last_change":"2023-07-09T21:39:02.228791+0000","last_active":"2023-07-09T21:39:04.477938+0000","last_peered":"2023-07-09T21:39:04.477938+0000","last_clean":"2023-07-09T21:39:04.477938+0000","last_became_active":"2023-07-09T21:39:02.228459+0000","last_became_peered":"2023-07-09T21:39:02.228459+0000","last_unstale":"2023-07-09T21:39:04.477938+0000","last_undegraded":"2023-07-09T21:39:04.477938+0000","last_fullsized":"2023-07-09T21:39:04.477938+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:49.850422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484413+0000","last_change":"2023-07-09T21:39:03.236571+0000","last_active":"2023-07-09T21:39:04.484413+0000","last_peered":"2023-07-09T21:39:04.484413+0000","last_clean":"2023-07-09T21:39:04.484413+0000","last_became_active":"2023-07-09T21:39:03.236293+0000","last_became_peered":"2023-07-09T21:39:03.236293+0000","last_unstale":"2023-07-09T21:39:04.484413+0000","last_undegraded":"2023-07-09T21:39:04.484413+0000","last_fullsized":"2023-07-09T21:39:04.484413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:53.308364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214231+0000","last_change":"2023-07-09T21:39:02.222966+0000","last_active":"2023-07-09T21:39:04.214231+0000","last_peered":"2023-07-09T21:39:04.214231+0000","last_clean":"2023-07-09T21:39:04.214231+0000","last_became_active":"2023-07-09T21:39:02.222697+0000","last_became_peered":"2023-07-09T21:39:02.222697+0000","last_unstale":"2023-07-09T21:39:04.214231+0000","last_undegraded":"2023-07-09T21:39:04.214231+0000","last_fullsized":"2023-07-09T21:39:04.214231+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:23.608010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477644+0000","last_change":"2023-07-09T21:39:03.237831+0000","last_active":"2023-07-09T21:39:04.477644+0000","last_peered":"2023-07-09T21:39:04.477644+0000","last_clean":"2023-07-09T21:39:04.477644+0000","last_became_active":"2023-07-09T21:39:03.237529+0000","last_became_peered":"2023-07-09T21:39:03.237529+0000","last_unstale":"2023-07-09T21:39:04.477644+0000","last_undegraded":"2023-07-09T21:39:04.477644+0000","last_fullsized":"2023-07-09T21:39:04.477644+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:55:39.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462544+0000","last_change":"2023-07-09T21:39:02.233072+0000","last_active":"2023-07-09T21:39:04.462544+0000","last_peered":"2023-07-09T21:39:04.462544+0000","last_clean":"2023-07-09T21:39:04.462544+0000","last_became_active":"2023-07-09T21:39:02.232634+0000","last_became_peered":"2023-07-09T21:39:02.232634+0000","last_unstale":"2023-07-09T21:39:04.462544+0000","last_undegraded":"2023-07-09T21:39:04.462544+0000","last_fullsized":"2023-07-09T21:39:04.462544+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:23:47.737457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220995+0000","last_change":"2023-07-09T21:39:03.234625+0000","last_active":"2023-07-09T21:39:04.220995+0000","last_peered":"2023-07-09T21:39:04.220995+0000","last_clean":"2023-07-09T21:39:04.220995+0000","last_became_active":"2023-07-09T21:39:03.233322+0000","last_became_peered":"2023-07-09T21:39:03.233322+0000","last_unstale":"2023-07-09T21:39:04.220995+0000","last_undegraded":"2023-07-09T21:39:04.220995+0000","last_fullsized":"2023-07-09T21:39:04.220995+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:09:38.691112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221429+0000","last_change":"2023-07-09T21:39:02.231456+0000","last_active":"2023-07-09T21:39:04.221429+0000","last_peered":"2023-07-09T21:39:04.221429+0000","last_clean":"2023-07-09T21:39:04.221429+0000","last_became_active":"2023-07-09T21:39:02.231159+0000","last_became_peered":"2023-07-09T21:39:02.231159+0000","last_unstale":"2023-07-09T21:39:04.221429+0000","last_undegraded":"2023-07-09T21:39:04.221429+0000","last_fullsized":"2023-07-09T21:39:04.221429+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:34:01.405514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477829+0000","last_change":"2023-07-09T21:39:03.236590+0000","last_active":"2023-07-09T21:39:04.477829+0000","last_peered":"2023-07-09T21:39:04.477829+0000","last_clean":"2023-07-09T21:39:04.477829+0000","last_became_active":"2023-07-09T21:39:03.236330+0000","last_became_peered":"2023-07-09T21:39:03.236330+0000","last_unstale":"2023-07-09T21:39:04.477829+0000","last_undegraded":"2023-07-09T21:39:04.477829+0000","last_fullsized":"2023-07-09T21:39:04.477829+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:24.396808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"98'3","reported_seq":16,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214542+0000","last_change":"2023-07-09T21:39:02.222461+0000","last_active":"2023-07-09T21:39:04.214542+0000","last_peered":"2023-07-09T21:39:04.214542+0000","last_clean":"2023-07-09T21:39:04.214542+0000","last_became_active":"2023-07-09T21:39:02.222198+0000","last_became_peered":"2023-07-09T21:39:02.222198+0000","last_unstale":"2023-07-09T21:39:04.214542+0000","last_undegraded":"2023-07-09T21:39:04.214542+0000","last_fullsized":"2023-07-09T21:39:04.214542+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:33.194280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478368+0000","last_change":"2023-07-09T21:39:03.230757+0000","last_active":"2023-07-09T21:39:04.478368+0000","last_peered":"2023-07-09T21:39:04.478368+0000","last_clean":"2023-07-09T21:39:04.478368+0000","last_became_active":"2023-07-09T21:39:03.230435+0000","last_became_peered":"2023-07-09T21:39:03.230435+0000","last_unstale":"2023-07-09T21:39:04.478368+0000","last_undegraded":"2023-07-09T21:39:04.478368+0000","last_fullsized":"2023-07-09T21:39:04.478368+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:04:26.690442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"98'6","reported_seq":19,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484180+0000","last_change":"2023-07-09T21:39:02.228316+0000","last_active":"2023-07-09T21:39:04.484180+0000","last_peered":"2023-07-09T21:39:04.484180+0000","last_clean":"2023-07-09T21:39:04.484180+0000","last_became_active":"2023-07-09T21:39:02.226731+0000","last_became_peered":"2023-07-09T21:39:02.226731+0000","last_unstale":"2023-07-09T21:39:04.484180+0000","last_undegraded":"2023-07-09T21:39:04.484180+0000","last_fullsized":"2023-07-09T21:39:04.484180+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:21.252591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221698+0000","last_change":"2023-07-09T21:39:03.237951+0000","last_active":"2023-07-09T21:39:04.221698+0000","last_peered":"2023-07-09T21:39:04.221698+0000","last_clean":"2023-07-09T21:39:04.221698+0000","last_became_active":"2023-07-09T21:39:03.237612+0000","last_became_peered":"2023-07-09T21:39:03.237612+0000","last_unstale":"2023-07-09T21:39:04.221698+0000","last_undegraded":"2023-07-09T21:39:04.221698+0000","last_fullsized":"2023-07-09T21:39:04.221698+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:10.345599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221101+0000","last_change":"2023-07-09T21:39:02.228630+0000","last_active":"2023-07-09T21:39:04.221101+0000","last_peered":"2023-07-09T21:39:04.221101+0000","last_clean":"2023-07-09T21:39:04.221101+0000","last_became_active":"2023-07-09T21:39:02.228368+0000","last_became_peered":"2023-07-09T21:39:02.228368+0000","last_unstale":"2023-07-09T21:39:04.221101+0000","last_undegraded":"2023-07-09T21:39:04.221101+0000","last_fullsized":"2023-07-09T21:39:04.221101+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:51:49.045650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483887+0000","last_change":"2023-07-09T21:39:03.242500+0000","last_active":"2023-07-09T21:39:04.483887+0000","last_peered":"2023-07-09T21:39:04.483887+0000","last_clean":"2023-07-09T21:39:04.483887+0000","last_became_active":"2023-07-09T21:39:03.242199+0000","last_became_peered":"2023-07-09T21:39:03.242199+0000","last_unstale":"2023-07-09T21:39:04.483887+0000","last_undegraded":"2023-07-09T21:39:04.483887+0000","last_fullsized":"2023-07-09T21:39:04.483887+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:40.858107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462041+0000","last_change":"2023-07-09T21:39:02.230899+0000","last_active":"2023-07-09T21:39:04.462041+0000","last_peered":"2023-07-09T21:39:04.462041+0000","last_clean":"2023-07-09T21:39:04.462041+0000","last_became_active":"2023-07-09T21:39:02.230633+0000","last_became_peered":"2023-07-09T21:39:02.230633+0000","last_unstale":"2023-07-09T21:39:04.462041+0000","last_undegraded":"2023-07-09T21:39:04.462041+0000","last_fullsized":"2023-07-09T21:39:04.462041+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:15.208275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484023+0000","last_change":"2023-07-09T21:39:03.235313+0000","last_active":"2023-07-09T21:39:04.484023+0000","last_peered":"2023-07-09T21:39:04.484023+0000","last_clean":"2023-07-09T21:39:04.484023+0000","last_became_active":"2023-07-09T21:39:03.234624+0000","last_became_peered":"2023-07-09T21:39:03.234624+0000","last_unstale":"2023-07-09T21:39:04.484023+0000","last_undegraded":"2023-07-09T21:39:04.484023+0000","last_fullsized":"2023-07-09T21:39:04.484023+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:45:58.025864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214173+0000","last_change":"2023-07-09T21:39:02.227440+0000","last_active":"2023-07-09T21:39:04.214173+0000","last_peered":"2023-07-09T21:39:04.214173+0000","last_clean":"2023-07-09T21:39:04.214173+0000","last_became_active":"2023-07-09T21:39:02.226934+0000","last_became_peered":"2023-07-09T21:39:02.226934+0000","last_unstale":"2023-07-09T21:39:04.214173+0000","last_undegraded":"2023-07-09T21:39:04.214173+0000","last_fullsized":"2023-07-09T21:39:04.214173+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:59.229914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484418+0000","last_change":"2023-07-09T21:39:03.240125+0000","last_active":"2023-07-09T21:39:04.484418+0000","last_peered":"2023-07-09T21:39:04.484418+0000","last_clean":"2023-07-09T21:39:04.484418+0000","last_became_active":"2023-07-09T21:39:03.239754+0000","last_became_peered":"2023-07-09T21:39:03.239754+0000","last_unstale":"2023-07-09T21:39:04.484418+0000","last_undegraded":"2023-07-09T21:39:04.484418+0000","last_fullsized":"2023-07-09T21:39:04.484418+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:24:45.047015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"98'8","reported_seq":21,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477779+0000","last_change":"2023-07-09T21:39:02.224832+0000","last_active":"2023-07-09T21:39:04.477779+0000","last_peered":"2023-07-09T21:39:04.477779+0000","last_clean":"2023-07-09T21:39:04.477779+0000","last_became_active":"2023-07-09T21:39:02.224573+0000","last_became_peered":"2023-07-09T21:39:02.224573+0000","last_unstale":"2023-07-09T21:39:04.477779+0000","last_undegraded":"2023-07-09T21:39:04.477779+0000","last_fullsized":"2023-07-09T21:39:04.477779+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:36.284726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222233+0000","last_change":"2023-07-09T21:39:03.234768+0000","last_active":"2023-07-09T21:39:04.222233+0000","last_peered":"2023-07-09T21:39:04.222233+0000","last_clean":"2023-07-09T21:39:04.222233+0000","last_became_active":"2023-07-09T21:39:03.234494+0000","last_became_peered":"2023-07-09T21:39:03.234494+0000","last_unstale":"2023-07-09T21:39:04.222233+0000","last_undegraded":"2023-07-09T21:39:04.222233+0000","last_fullsized":"2023-07-09T21:39:04.222233+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:44.743930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221355+0000","last_change":"2023-07-09T21:39:02.227857+0000","last_active":"2023-07-09T21:39:04.221355+0000","last_peered":"2023-07-09T21:39:04.221355+0000","last_clean":"2023-07-09T21:39:04.221355+0000","last_became_active":"2023-07-09T21:39:02.227555+0000","last_became_peered":"2023-07-09T21:39:02.227555+0000","last_unstale":"2023-07-09T21:39:04.221355+0000","last_undegraded":"2023-07-09T21:39:04.221355+0000","last_fullsized":"2023-07-09T21:39:04.221355+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:44:08.820298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484113+0000","last_change":"2023-07-09T21:39:03.231465+0000","last_active":"2023-07-09T21:39:04.484113+0000","last_peered":"2023-07-09T21:39:04.484113+0000","last_clean":"2023-07-09T21:39:04.484113+0000","last_became_active":"2023-07-09T21:39:03.231198+0000","last_became_peered":"2023-07-09T21:39:03.231198+0000","last_unstale":"2023-07-09T21:39:04.484113+0000","last_undegraded":"2023-07-09T21:39:04.484113+0000","last_fullsized":"2023-07-09T21:39:04.484113+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:19:20.294170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"99'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478799+0000","last_change":"2023-07-09T21:39:02.226076+0000","last_active":"2023-07-09T21:39:04.478799+0000","last_peered":"2023-07-09T21:39:04.478799+0000","last_clean":"2023-07-09T21:39:04.478799+0000","last_became_active":"2023-07-09T21:39:02.225796+0000","last_became_peered":"2023-07-09T21:39:02.225796+0000","last_unstale":"2023-07-09T21:39:04.478799+0000","last_undegraded":"2023-07-09T21:39:04.478799+0000","last_fullsized":"2023-07-09T21:39:04.478799+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:30.075488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222428+0000","last_change":"2023-07-09T21:39:03.235249+0000","last_active":"2023-07-09T21:39:04.222428+0000","last_peered":"2023-07-09T21:39:04.222428+0000","last_clean":"2023-07-09T21:39:04.222428+0000","last_became_active":"2023-07-09T21:39:03.234968+0000","last_became_peered":"2023-07-09T21:39:03.234968+0000","last_unstale":"2023-07-09T21:39:04.222428+0000","last_undegraded":"2023-07-09T21:39:04.222428+0000","last_fullsized":"2023-07-09T21:39:04.222428+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:13.517373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462557+0000","last_change":"2023-07-09T21:39:02.235989+0000","last_active":"2023-07-09T21:39:04.462557+0000","last_peered":"2023-07-09T21:39:04.462557+0000","last_clean":"2023-07-09T21:39:04.462557+0000","last_became_active":"2023-07-09T21:39:02.235703+0000","last_became_peered":"2023-07-09T21:39:02.235703+0000","last_unstale":"2023-07-09T21:39:04.462557+0000","last_undegraded":"2023-07-09T21:39:04.462557+0000","last_fullsized":"2023-07-09T21:39:04.462557+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:07:37.966839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478020+0000","last_change":"2023-07-09T21:39:03.237922+0000","last_active":"2023-07-09T21:39:04.478020+0000","last_peered":"2023-07-09T21:39:04.478020+0000","last_clean":"2023-07-09T21:39:04.478020+0000","last_became_active":"2023-07-09T21:39:03.237623+0000","last_became_peered":"2023-07-09T21:39:03.237623+0000","last_unstale":"2023-07-09T21:39:04.478020+0000","last_undegraded":"2023-07-09T21:39:04.478020+0000","last_fullsized":"2023-07-09T21:39:04.478020+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:33.919247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462258+0000","last_change":"2023-07-09T21:39:02.232727+0000","last_active":"2023-07-09T21:39:04.462258+0000","last_peered":"2023-07-09T21:39:04.462258+0000","last_clean":"2023-07-09T21:39:04.462258+0000","last_became_active":"2023-07-09T21:39:02.232459+0000","last_became_peered":"2023-07-09T21:39:02.232459+0000","last_unstale":"2023-07-09T21:39:04.462258+0000","last_undegraded":"2023-07-09T21:39:04.462258+0000","last_fullsized":"2023-07-09T21:39:04.462258+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:16:28.328496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483999+0000","last_change":"2023-07-09T21:39:03.235961+0000","last_active":"2023-07-09T21:39:04.483999+0000","last_peered":"2023-07-09T21:39:04.483999+0000","last_clean":"2023-07-09T21:39:04.483999+0000","last_became_active":"2023-07-09T21:39:03.235551+0000","last_became_peered":"2023-07-09T21:39:03.235551+0000","last_unstale":"2023-07-09T21:39:04.483999+0000","last_undegraded":"2023-07-09T21:39:04.483999+0000","last_fullsized":"2023-07-09T21:39:04.483999+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:15.804173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.483808+0000","last_change":"2023-07-09T21:39:02.233872+0000","last_active":"2023-07-09T21:39:04.483808+0000","last_peered":"2023-07-09T21:39:04.483808+0000","last_clean":"2023-07-09T21:39:04.483808+0000","last_became_active":"2023-07-09T21:39:02.233572+0000","last_became_peered":"2023-07-09T21:39:02.233572+0000","last_unstale":"2023-07-09T21:39:04.483808+0000","last_undegraded":"2023-07-09T21:39:04.483808+0000","last_fullsized":"2023-07-09T21:39:04.483808+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:30:25.737187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484022+0000","last_change":"2023-07-09T21:39:03.236547+0000","last_active":"2023-07-09T21:39:04.484022+0000","last_peered":"2023-07-09T21:39:04.484022+0000","last_clean":"2023-07-09T21:39:04.484022+0000","last_became_active":"2023-07-09T21:39:03.236248+0000","last_became_peered":"2023-07-09T21:39:03.236248+0000","last_unstale":"2023-07-09T21:39:04.484022+0000","last_undegraded":"2023-07-09T21:39:04.484022+0000","last_fullsized":"2023-07-09T21:39:04.484022+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:03.617177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214347+0000","last_change":"2023-07-09T21:39:02.227372+0000","last_active":"2023-07-09T21:39:04.214347+0000","last_peered":"2023-07-09T21:39:04.214347+0000","last_clean":"2023-07-09T21:39:04.214347+0000","last_became_active":"2023-07-09T21:39:02.226984+0000","last_became_peered":"2023-07-09T21:39:02.226984+0000","last_unstale":"2023-07-09T21:39:04.214347+0000","last_undegraded":"2023-07-09T21:39:04.214347+0000","last_fullsized":"2023-07-09T21:39:04.214347+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:14.229120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478413+0000","last_change":"2023-07-09T21:39:03.240394+0000","last_active":"2023-07-09T21:39:04.478413+0000","last_peered":"2023-07-09T21:39:04.478413+0000","last_clean":"2023-07-09T21:39:04.478413+0000","last_became_active":"2023-07-09T21:39:03.240094+0000","last_became_peered":"2023-07-09T21:39:03.240094+0000","last_unstale":"2023-07-09T21:39:04.478413+0000","last_undegraded":"2023-07-09T21:39:04.478413+0000","last_fullsized":"2023-07-09T21:39:04.478413+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:32.387363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484126+0000","last_change":"2023-07-09T21:39:02.231774+0000","last_active":"2023-07-09T21:39:04.484126+0000","last_peered":"2023-07-09T21:39:04.484126+0000","last_clean":"2023-07-09T21:39:04.484126+0000","last_became_active":"2023-07-09T21:39:02.231437+0000","last_became_peered":"2023-07-09T21:39:02.231437+0000","last_unstale":"2023-07-09T21:39:04.484126+0000","last_undegraded":"2023-07-09T21:39:04.484126+0000","last_fullsized":"2023-07-09T21:39:04.484126+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:34:05.102367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478532+0000","last_change":"2023-07-09T21:39:03.235159+0000","last_active":"2023-07-09T21:39:04.478532+0000","last_peered":"2023-07-09T21:39:04.478532+0000","last_clean":"2023-07-09T21:39:04.478532+0000","last_became_active":"2023-07-09T21:39:03.234874+0000","last_became_peered":"2023-07-09T21:39:03.234874+0000","last_unstale":"2023-07-09T21:39:04.478532+0000","last_undegraded":"2023-07-09T21:39:04.478532+0000","last_fullsized":"2023-07-09T21:39:04.478532+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:21.473977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477543+0000","last_change":"2023-07-09T21:39:02.220149+0000","last_active":"2023-07-09T21:39:04.477543+0000","last_peered":"2023-07-09T21:39:04.477543+0000","last_clean":"2023-07-09T21:39:04.477543+0000","last_became_active":"2023-07-09T21:39:02.219868+0000","last_became_peered":"2023-07-09T21:39:02.219868+0000","last_unstale":"2023-07-09T21:39:04.477543+0000","last_undegraded":"2023-07-09T21:39:04.477543+0000","last_fullsized":"2023-07-09T21:39:04.477543+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:35:43.097772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462752+0000","last_change":"2023-07-09T21:39:03.242302+0000","last_active":"2023-07-09T21:39:04.462752+0000","last_peered":"2023-07-09T21:39:04.462752+0000","last_clean":"2023-07-09T21:39:04.462752+0000","last_became_active":"2023-07-09T21:39:03.242012+0000","last_became_peered":"2023-07-09T21:39:03.242012+0000","last_unstale":"2023-07-09T21:39:04.462752+0000","last_undegraded":"2023-07-09T21:39:04.462752+0000","last_fullsized":"2023-07-09T21:39:04.462752+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:55.076979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477911+0000","last_change":"2023-07-09T21:39:02.225583+0000","last_active":"2023-07-09T21:39:04.477911+0000","last_peered":"2023-07-09T21:39:04.477911+0000","last_clean":"2023-07-09T21:39:04.477911+0000","last_became_active":"2023-07-09T21:39:02.225277+0000","last_became_peered":"2023-07-09T21:39:02.225277+0000","last_unstale":"2023-07-09T21:39:04.477911+0000","last_undegraded":"2023-07-09T21:39:04.477911+0000","last_fullsized":"2023-07-09T21:39:04.477911+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:08.759933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"87'183","reported_seq":549,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462306+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:04.462306+0000","last_peered":"2023-07-09T21:39:04.462306+0000","last_clean":"2023-07-09T21:39:04.462306+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:04.462306+0000","last_undegraded":"2023-07-09T21:39:04.462306+0000","last_fullsized":"2023-07-09T21:39:04.462306+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:15:43.156460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":179,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.221179+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:04.221179+0000","last_peered":"2023-07-09T21:39:04.221179+0000","last_clean":"2023-07-09T21:39:04.221179+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:04.221179+0000","last_undegraded":"2023-07-09T21:39:04.221179+0000","last_fullsized":"2023-07-09T21:39:04.221179+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:42:05.838036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478689+0000","last_change":"2023-07-09T21:39:03.226788+0000","last_active":"2023-07-09T21:39:04.478689+0000","last_peered":"2023-07-09T21:39:04.478689+0000","last_clean":"2023-07-09T21:39:04.478689+0000","last_became_active":"2023-07-09T21:39:03.226406+0000","last_became_peered":"2023-07-09T21:39:03.226406+0000","last_unstale":"2023-07-09T21:39:04.478689+0000","last_undegraded":"2023-07-09T21:39:04.478689+0000","last_fullsized":"2023-07-09T21:39:04.478689+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:54.224100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477510+0000","last_change":"2023-07-09T21:39:02.226362+0000","last_active":"2023-07-09T21:39:04.477510+0000","last_peered":"2023-07-09T21:39:04.477510+0000","last_clean":"2023-07-09T21:39:04.477510+0000","last_became_active":"2023-07-09T21:39:02.225863+0000","last_became_peered":"2023-07-09T21:39:02.225863+0000","last_unstale":"2023-07-09T21:39:04.477510+0000","last_undegraded":"2023-07-09T21:39:04.477510+0000","last_fullsized":"2023-07-09T21:39:04.477510+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:41:22.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":159,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462343+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:04.462343+0000","last_peered":"2023-07-09T21:39:04.462343+0000","last_clean":"2023-07-09T21:39:04.462343+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:04.462343+0000","last_undegraded":"2023-07-09T21:39:04.462343+0000","last_fullsized":"2023-07-09T21:39:04.462343+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:59.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484518+0000","last_change":"2023-07-09T21:39:03.232306+0000","last_active":"2023-07-09T21:39:04.484518+0000","last_peered":"2023-07-09T21:39:04.484518+0000","last_clean":"2023-07-09T21:39:04.484518+0000","last_became_active":"2023-07-09T21:39:03.232037+0000","last_became_peered":"2023-07-09T21:39:03.232037+0000","last_unstale":"2023-07-09T21:39:04.484518+0000","last_undegraded":"2023-07-09T21:39:04.484518+0000","last_fullsized":"2023-07-09T21:39:04.484518+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:51.477172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477333+0000","last_change":"2023-07-09T21:39:02.225573+0000","last_active":"2023-07-09T21:39:04.477333+0000","last_peered":"2023-07-09T21:39:04.477333+0000","last_clean":"2023-07-09T21:39:04.477333+0000","last_became_active":"2023-07-09T21:39:02.225239+0000","last_became_peered":"2023-07-09T21:39:02.225239+0000","last_unstale":"2023-07-09T21:39:04.477333+0000","last_undegraded":"2023-07-09T21:39:04.477333+0000","last_fullsized":"2023-07-09T21:39:04.477333+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:22:36.284726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":155,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214235+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:04.214235+0000","last_peered":"2023-07-09T21:39:04.214235+0000","last_clean":"2023-07-09T21:39:04.214235+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:04.214235+0000","last_undegraded":"2023-07-09T21:39:04.214235+0000","last_fullsized":"2023-07-09T21:39:04.214235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:20.238443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478439+0000","last_change":"2023-07-09T21:39:03.229516+0000","last_active":"2023-07-09T21:39:04.478439+0000","last_peered":"2023-07-09T21:39:04.478439+0000","last_clean":"2023-07-09T21:39:04.478439+0000","last_became_active":"2023-07-09T21:39:03.229057+0000","last_became_peered":"2023-07-09T21:39:03.229057+0000","last_unstale":"2023-07-09T21:39:04.478439+0000","last_undegraded":"2023-07-09T21:39:04.478439+0000","last_fullsized":"2023-07-09T21:39:04.478439+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:01.690751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477941+0000","last_change":"2023-07-09T21:39:02.218979+0000","last_active":"2023-07-09T21:39:04.477941+0000","last_peered":"2023-07-09T21:39:04.477941+0000","last_clean":"2023-07-09T21:39:04.477941+0000","last_became_active":"2023-07-09T21:39:02.218641+0000","last_became_peered":"2023-07-09T21:39:02.218641+0000","last_unstale":"2023-07-09T21:39:04.477941+0000","last_undegraded":"2023-07-09T21:39:04.477941+0000","last_fullsized":"2023-07-09T21:39:04.477941+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:14.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":179,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.220988+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:04.220988+0000","last_peered":"2023-07-09T21:39:04.220988+0000","last_clean":"2023-07-09T21:39:04.220988+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:04.220988+0000","last_undegraded":"2023-07-09T21:39:04.220988+0000","last_fullsized":"2023-07-09T21:39:04.220988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:50:53.489159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214569+0000","last_change":"2023-07-09T21:39:03.231080+0000","last_active":"2023-07-09T21:39:04.214569+0000","last_peered":"2023-07-09T21:39:04.214569+0000","last_clean":"2023-07-09T21:39:04.214569+0000","last_became_active":"2023-07-09T21:39:03.230697+0000","last_became_peered":"2023-07-09T21:39:03.230697+0000","last_unstale":"2023-07-09T21:39:04.214569+0000","last_undegraded":"2023-07-09T21:39:04.214569+0000","last_fullsized":"2023-07-09T21:39:04.214569+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:11.013969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214679+0000","last_change":"2023-07-09T21:39:02.226536+0000","last_active":"2023-07-09T21:39:04.214679+0000","last_peered":"2023-07-09T21:39:04.214679+0000","last_clean":"2023-07-09T21:39:04.214679+0000","last_became_active":"2023-07-09T21:39:02.226268+0000","last_became_peered":"2023-07-09T21:39:02.226268+0000","last_unstale":"2023-07-09T21:39:04.214679+0000","last_undegraded":"2023-07-09T21:39:04.214679+0000","last_fullsized":"2023-07-09T21:39:04.214679+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:13.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":148,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478571+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:04.478571+0000","last_peered":"2023-07-09T21:39:04.478571+0000","last_clean":"2023-07-09T21:39:04.478571+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:04.478571+0000","last_undegraded":"2023-07-09T21:39:04.478571+0000","last_fullsized":"2023-07-09T21:39:04.478571+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:32.892229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477821+0000","last_change":"2023-07-09T21:39:03.233861+0000","last_active":"2023-07-09T21:39:04.477821+0000","last_peered":"2023-07-09T21:39:04.477821+0000","last_clean":"2023-07-09T21:39:04.477821+0000","last_became_active":"2023-07-09T21:39:03.233535+0000","last_became_peered":"2023-07-09T21:39:03.233535+0000","last_unstale":"2023-07-09T21:39:04.477821+0000","last_undegraded":"2023-07-09T21:39:04.477821+0000","last_fullsized":"2023-07-09T21:39:04.477821+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:33.919247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478383+0000","last_change":"2023-07-09T21:39:02.224587+0000","last_active":"2023-07-09T21:39:04.478383+0000","last_peered":"2023-07-09T21:39:04.478383+0000","last_clean":"2023-07-09T21:39:04.478383+0000","last_became_active":"2023-07-09T21:39:02.224283+0000","last_became_peered":"2023-07-09T21:39:02.224283+0000","last_unstale":"2023-07-09T21:39:04.478383+0000","last_undegraded":"2023-07-09T21:39:04.478383+0000","last_fullsized":"2023-07-09T21:39:04.478383+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:30.581274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":158,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462682+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:04.462682+0000","last_peered":"2023-07-09T21:39:04.462682+0000","last_clean":"2023-07-09T21:39:04.462682+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:04.462682+0000","last_undegraded":"2023-07-09T21:39:04.462682+0000","last_fullsized":"2023-07-09T21:39:04.462682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:53:29.150038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.477259+0000","last_change":"2023-07-09T21:39:03.229188+0000","last_active":"2023-07-09T21:39:04.477259+0000","last_peered":"2023-07-09T21:39:04.477259+0000","last_clean":"2023-07-09T21:39:04.477259+0000","last_became_active":"2023-07-09T21:39:03.228667+0000","last_became_peered":"2023-07-09T21:39:03.228667+0000","last_unstale":"2023-07-09T21:39:04.477259+0000","last_undegraded":"2023-07-09T21:39:04.477259+0000","last_fullsized":"2023-07-09T21:39:04.477259+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:02:33.063461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"98'1","reported_seq":14,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.462598+0000","last_change":"2023-07-09T21:39:02.236493+0000","last_active":"2023-07-09T21:39:04.462598+0000","last_peered":"2023-07-09T21:39:04.462598+0000","last_clean":"2023-07-09T21:39:04.462598+0000","last_became_active":"2023-07-09T21:39:02.236157+0000","last_became_peered":"2023-07-09T21:39:02.236157+0000","last_unstale":"2023-07-09T21:39:04.462598+0000","last_undegraded":"2023-07-09T21:39:04.462598+0000","last_fullsized":"2023-07-09T21:39:04.462598+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:34.346665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":150,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.478530+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:04.478530+0000","last_peered":"2023-07-09T21:39:04.478530+0000","last_clean":"2023-07-09T21:39:04.478530+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:04.478530+0000","last_undegraded":"2023-07-09T21:39:04.478530+0000","last_fullsized":"2023-07-09T21:39:04.478530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:31.921496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.214110+0000","last_change":"2023-07-09T21:39:03.231311+0000","last_active":"2023-07-09T21:39:04.214110+0000","last_peered":"2023-07-09T21:39:04.214110+0000","last_clean":"2023-07-09T21:39:04.214110+0000","last_became_active":"2023-07-09T21:39:03.230032+0000","last_became_peered":"2023-07-09T21:39:03.230032+0000","last_unstale":"2023-07-09T21:39:04.214110+0000","last_undegraded":"2023-07-09T21:39:04.214110+0000","last_fullsized":"2023-07-09T21:39:04.214110+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":97,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:02.196558+0000","last_clean_scrub_stamp":"2023-07-09T21:39:02.196558+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:10.620279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"98'2","reported_seq":15,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.222999+0000","last_change":"2023-07-09T21:39:02.228812+0000","last_active":"2023-07-09T21:39:04.222999+0000","last_peered":"2023-07-09T21:39:04.222999+0000","last_clean":"2023-07-09T21:39:04.222999+0000","last_became_active":"2023-07-09T21:39:02.228542+0000","last_became_peered":"2023-07-09T21:39:02.228542+0000","last_unstale":"2023-07-09T21:39:04.222999+0000","last_undegraded":"2023-07-09T21:39:04.222999+0000","last_fullsized":"2023-07-09T21:39:04.222999+0000","mapping_epoch":96,"log_start":"0'0","ondisk_log_start":"0'0","created":96,"last_epoch_clean":97,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:01.188671+0000","last_clean_scrub_stamp":"2023-07-09T21:39:01.188671+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:45:57.017978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":156,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-07-09T21:39:04.484508+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:04.484508+0000","last_peered":"2023-07-09T21:39:04.484508+0000","last_clean":"2023-07-09T21:39:04.484508+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:04.484508+0000","last_undegraded":"2023-07-09T21:39:04.484508+0000","last_fullsized":"2023-07-09T21:39:04.484508+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:12:47.280890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":1336,"num_write":279,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59052,"kb_used_data":1764,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312788,"statfs":{"total":96636764160,"available":96576294912,"internally_reserved":0,"allocated":1806336,"data_stored":1198680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.70199999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.48599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78300000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.66900000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.80900000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.82999999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.74199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575050,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1220608,"data_stored":609854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.69899999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.747},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.57199999999999995},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.51700000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575049,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50280,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321560,"statfs":{"total":96636764160,"available":96585277440,"internally_reserved":0,"allocated":1212416,"data_stored":608324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.68100000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.73499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.70299999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.87}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.94899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.91000000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.92900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575051,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1228800,"data_stored":609958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.53700000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.60899999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.77700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.82799999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.84499999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.86899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575050,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1184,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1212416,"data_stored":608872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.71499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.56200000000000006}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.754},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.79900000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.66600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575051,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54384,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317456,"statfs":{"total":96636764160,"available":96581074944,"internally_reserved":0,"allocated":1220608,"data_stored":609032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.432},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.27100000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.40200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.76500000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.81699999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.73899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575051,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1188,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1216512,"data_stored":608402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.51700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.65200000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.753},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.78900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834575051,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1802240,"data_stored":1198658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.75700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.79900000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.60099999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.89700000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:12.291 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:39:12.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:39:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 Processor -- start 2023-07-09T21:39:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 -- start start 2023-07-09T21:39:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5fc1585b0 0x7ff5fc06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0c9090 con 0x7ff5fc0c4520 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0c8a60 con 0x7ff5fc06b970 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff600e56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0cbf40 con 0x7ff5fc1585b0 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5fc1585b0 0x7ff5fc06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5fc0c4520 0x7ff5fc15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39064/0 (socket says 172.21.15.37:39064) 2023-07-09T21:39:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fad9d640 1 -- 172.21.15.37:0/2907520977 learned_addr learned my addr 172.21.15.37:0/2907520977 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fa59c640 1 -- 172.21.15.37:0/2907520977 >> v1:172.21.15.119:6789/0 conn(0x7ff5fc06b970 legacy=0x7ff5fc0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fa59c640 1 -- 172.21.15.37:0/2907520977 >> v1:172.21.15.37:6789/0 conn(0x7ff5fc0c4520 legacy=0x7ff5fc15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.470+0000 7ff5fa59c640 1 -- 172.21.15.37:0/2907520977 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc15ce10 con 0x7ff5fc1585b0 2023-07-09T21:39:12.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff5fa59c640 1 --2- 172.21.15.37:0/2907520977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc06b430 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01e660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1376480b271118b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff5f9d9b640 1 -- 172.21.15.37:0/2907520977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0a8650 con 0x7ff5fc1585b0 2023-07-09T21:39:12.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff5f9d9b640 1 -- 172.21.15.37:0/2907520977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ec0a87b0 con 0x7ff5fc1585b0 2023-07-09T21:39:12.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff5f9d9b640 1 -- 172.21.15.37:0/2907520977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ec0a8b40 con 0x7ff5fc1585b0 2023-07-09T21:39:12.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 -- 172.21.15.37:0/2907520977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc1585b0 msgr2=0x7ff5fc06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 --2- 172.21.15.37:0/2907520977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc06b430 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0097c0 tx=0x7ff5ec01e660 comp rx=0 tx=0).stop 2023-07-09T21:39:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 -- 172.21.15.37:0/2907520977 shutdown_connections 2023-07-09T21:39:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 --2- 172.21.15.37:0/2907520977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc06b430 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 -- 172.21.15.37:0/2907520977 >> 172.21.15.37:0/2907520977 conn(0x7ff5fc0cde40 msgr2=0x7ff5fc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 -- 172.21.15.37:0/2907520977 shutdown_connections 2023-07-09T21:39:12.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 -- 172.21.15.37:0/2907520977 wait complete. 2023-07-09T21:39:12.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.474+0000 7ff600e56640 1 Processor -- start 2023-07-09T21:39:12.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- start start 2023-07-09T21:39:12.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5fc06b970 0x7ff5fc0aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc142410 con 0x7ff5fc0c4520 2023-07-09T21:39:12.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc0afe70 con 0x7ff5fc1585b0 2023-07-09T21:39:12.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc159370 con 0x7ff5fc06b970 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59594/0 (socket says 172.21.15.37:59594) 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 -- 172.21.15.37:0/2225712791 learned_addr learned my addr 172.21.15.37:0/2225712791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5fad9d640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5fa59c640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5fc06b970 0x7ff5fc0aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 -- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5fc06b970 msgr2=0x7ff5fc0aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5fc06b970 0x7ff5fc0aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 -- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5fc1585b0 msgr2=0x7ff5fc14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 -- 172.21.15.37:0/2225712791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec009420 con 0x7ff5fc0c4520 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f3fff640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c530 tx=0x7ff5e400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4005220 con 0x7ff5fc0c4520 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4005380 con 0x7ff5fc0c4520 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4007270 con 0x7ff5fc0c4520 2023-07-09T21:39:12.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc0b00a0 con 0x7ff5fc0c4520 2023-07-09T21:39:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc159000 con 0x7ff5fc0c4520 2023-07-09T21:39:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.478+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc159520 con 0x7ff5fc0c4520 2023-07-09T21:39:12.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.482+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5e40073d0 con 0x7ff5fc0c4520 2023-07-09T21:39:12.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.482+0000 7ff5f2ffd640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 0x7ff5dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.482+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff5e40835d0 con 0x7ff5fc0c4520 2023-07-09T21:39:12.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.482+0000 7ff5fa59c640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 0x7ff5dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.482+0000 7ff5fa59c640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 0x7ff5dc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0b1000 tx=0x7ff5ec0a9000 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.486+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5fc159520 con 0x7ff5fc0c4520 2023-07-09T21:39:12.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.690+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff5fc1594e0 con 0x7ff5fc0c4520 2023-07-09T21:39:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff5f2ffd640 1 -- 172.21.15.37:0/2225712791 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff5e4050a80 con 0x7ff5fc0c4520 2023-07-09T21:39:12.700 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:39:12.700 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:39:12.701 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:39:12.701 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:39:12.701 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:39:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:39:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 msgr2=0x7ff5dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 0x7ff5dc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0b1000 tx=0x7ff5ec0a9000 comp rx=0 tx=0).stop 2023-07-09T21:39:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 msgr2=0x7ff5fc0af930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ff5e400c530 tx=0x7ff5e400c9f0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 shutdown_connections 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7ff5dc0663a0 0x7ff5dc068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5fc1585b0 0x7ff5fc14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5fc0c4520 0x7ff5fc0af930 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 --2- 172.21.15.37:0/2225712791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5fc06b970 0x7ff5fc0aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 >> 172.21.15.37:0/2225712791 conn(0x7ff5fc0cde40 msgr2=0x7ff5fc14c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 shutdown_connections 2023-07-09T21:39:12.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.698+0000 7ff600e56640 1 -- 172.21.15.37:0/2225712791 wait complete. 2023-07-09T21:39:12.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 Processor -- start 2023-07-09T21:39:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 -- start start 2023-07-09T21:39:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80b7ab0 0x7f3cd806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b4340 0x7f3cd80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80b49f0 con 0x7f3cd80cef80 2023-07-09T21:39:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd80b7e80 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.862+0000 7f3cddb37640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80cc8a0 con 0x7f3cd80b4340 2023-07-09T21:39:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80b7ab0 0x7f3cd806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd80b7ab0 0x7f3cd806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59598/0 (socket says 172.21.15.37:59598) 2023-07-09T21:39:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 -- 172.21.15.37:0/2531614104 learned_addr learned my addr 172.21.15.37:0/2531614104 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd7fff640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b4340 0x7f3cd80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 -- 172.21.15.37:0/2531614104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b4340 msgr2=0x7f3cd80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b4340 0x7f3cd80d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 -- 172.21.15.37:0/2531614104 >> v1:172.21.15.37:6789/0 conn(0x7f3cd80cef80 legacy=0x7f3cd80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 -- 172.21.15.37:0/2531614104 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80ccb80 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd77fe640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80b7ab0 0x7f3cd806aa50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40386e08f09f706d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd67fc640 1 -- 172.21.15.37:0/2531614104 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80aa670 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd67fc640 1 -- 172.21.15.37:0/2531614104 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc80aa7d0 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.866+0000 7f3cd67fc640 1 -- 172.21.15.37:0/2531614104 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80aab60 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- 172.21.15.37:0/2531614104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80b7ab0 msgr2=0x7f3cd806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80b7ab0 0x7f3cd806aa50 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009870 tx=0x7f3cc801c510 comp rx=0 tx=0).stop 2023-07-09T21:39:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- 172.21.15.37:0/2531614104 shutdown_connections 2023-07-09T21:39:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b4340 0x7f3cd80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- 172.21.15.37:0/2531614104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80b7ab0 0x7f3cd806aa50 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- 172.21.15.37:0/2531614104 >> 172.21.15.37:0/2531614104 conn(0x7f3cd8073090 msgr2=0x7f3cd8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- 172.21.15.37:0/2531614104 shutdown_connections 2023-07-09T21:39:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- 172.21.15.37:0/2531614104 wait complete. 2023-07-09T21:39:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 Processor -- start 2023-07-09T21:39:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- start start 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd80b4340 0x7f3cd814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b7ab0 0x7f3cd80c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c8350 con 0x7f3cd80cef80 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c8630 con 0x7f3cd80b4340 2023-07-09T21:39:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cddb37640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80b51a0 con 0x7f3cd80b7ab0 2023-07-09T21:39:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59610/0 (socket says 172.21.15.37:59610) 2023-07-09T21:39:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cd7fff640 1 -- 172.21.15.37:0/1682472590 learned_addr learned my addr 172.21.15.37:0/1682472590 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cd77fe640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd80b4340 0x7f3cd814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.870+0000 7f3cd6ffd640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b7ab0 0x7f3cd80c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 -- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b7ab0 msgr2=0x7f3cd80c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b7ab0 0x7f3cd80c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 -- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd80b4340 msgr2=0x7f3cd814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd80b4340 0x7f3cd814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 -- 172.21.15.37:0/1682472590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80094d0 con 0x7f3cd80cef80 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cd7fff640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0007e30 tx=0x7f3cd000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0014620 con 0x7f3cd80cef80 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000ee90 con 0x7f3cd80cef80 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd80b5480 con 0x7f3cd80cef80 2023-07-09T21:39:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00149c0 con 0x7f3cd80cef80 2023-07-09T21:39:12.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd80c7f90 con 0x7f3cd80cef80 2023-07-09T21:39:12.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80b56c0 con 0x7f3cd80cef80 2023-07-09T21:39:12.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.874+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3cd0014b20 con 0x7f3cd80cef80 2023-07-09T21:39:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.878+0000 7f3cbffff640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 0x7f3cc4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.878+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3cd0084650 con 0x7f3cd80cef80 2023-07-09T21:39:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.878+0000 7f3cd77fe640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 0x7f3cc4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:12.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.878+0000 7f3cd77fe640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 0x7f3cc4068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80ae000 tx=0x7f3cc80b5040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:12.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:12.882+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cd80b56c0 con 0x7f3cd80cef80 2023-07-09T21:39:13.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.070+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3cd80b56c0 con 0x7f3cd80cef80 2023-07-09T21:39:13.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.070+0000 7f3cbffff640 1 -- 172.21.15.37:0/1682472590 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f3cd80b56c0 con 0x7f3cd80cef80 2023-07-09T21:39:13.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:13.076 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:13.077 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:13.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 msgr2=0x7f3cc4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 0x7f3cc4068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3cc80ae000 tx=0x7f3cc80b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 msgr2=0x7f3cd80b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0007e30 tx=0x7f3cd000e4b0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 shutdown_connections 2023-07-09T21:39:13.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f3cc40663d0 0x7f3cc4068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd80cef80 0x7f3cd80b24b0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd80b7ab0 0x7f3cd80c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 --2- 172.21.15.37:0/1682472590 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd80b4340 0x7f3cd814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 >> 172.21.15.37:0/1682472590 conn(0x7f3cd8073090 msgr2=0x7f3cd80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 shutdown_connections 2023-07-09T21:39:13.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.074+0000 7f3cddb37640 1 -- 172.21.15.37:0/1682472590 wait complete. 2023-07-09T21:39:13.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:39:02.602126+0000', 'modified': '2023-07-09T21:39:06.265870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7341}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7341': {'gid': 7341, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.119:6836/1186396367', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.119:6834', 'nonce': 1186396367}, {'type': 'v1', 'addr': '172.21.15.119:6836', 'nonce': 1186396367}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:39:13.499 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:39:13.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-09T21:39:13.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.642+0000 7f58b5c9c640 1 Processor -- start 2023-07-09T21:39:13.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.642+0000 7f58b5c9c640 1 -- start start 2023-07-09T21:39:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58b5c9c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58b0156320 0x7f58b0159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58b5c9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58b0070120 0x7f58b0070550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58b5c9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58b01592f0 con 0x7f58b006b810 2023-07-09T21:39:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58b5c9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b01566f0 con 0x7f58b0070120 2023-07-09T21:39:13.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58b5c9c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58b0070b50 con 0x7f58b0156320 2023-07-09T21:39:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58b0070120 0x7f58b0070550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58b0070120 0x7f58b0070550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59616/0 (socket says 172.21.15.37:59616) 2023-07-09T21:39:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58affff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58b006b810 0x7f58b00cd620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39090/0 (socket says 172.21.15.37:39090) 2023-07-09T21:39:13.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 -- 172.21.15.37:0/1528640690 learned_addr learned my addr 172.21.15.37:0/1528640690 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58af7fe640 1 --2- 172.21.15.37:0/1528640690 >> v2:172.21.15.119:3300/0 conn(0x7f58b0156320 0x7f58b0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 -- 172.21.15.37:0/1528640690 >> v2:172.21.15.119:3300/0 conn(0x7f58b0156320 msgr2=0x7f58b0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1528640690 >> v2:172.21.15.119:3300/0 conn(0x7f58b0156320 0x7f58b0159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 -- 172.21.15.37:0/1528640690 >> v1:172.21.15.37:6789/0 conn(0x7f58b006b810 legacy=0x7f58b00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.646+0000 7f58aeffd640 1 -- 172.21.15.37:0/1528640690 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b0070e30 con 0x7f58b0070120 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1528640690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b0070120 0x7f58b0070550 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f58b0071330 tx=0x7f58a401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ad1ed45cd3b6dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58ae7fc640 1 -- 172.21.15.37:0/1528640690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40ab670 con 0x7f58b0070120 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58ae7fc640 1 -- 172.21.15.37:0/1528640690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40ab7d0 con 0x7f58b0070120 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58ae7fc640 1 -- 172.21.15.37:0/1528640690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40abb60 con 0x7f58b0070120 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- 172.21.15.37:0/1528640690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b0070120 msgr2=0x7f58b0070550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/1528640690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b0070120 0x7f58b0070550 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f58b0071330 tx=0x7f58a401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- 172.21.15.37:0/1528640690 shutdown_connections 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/1528640690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b0070120 0x7f58b0070550 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/1528640690 >> v2:172.21.15.119:3300/0 conn(0x7f58b0156320 0x7f58b0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- 172.21.15.37:0/1528640690 >> 172.21.15.37:0/1528640690 conn(0x7f58b00694c0 msgr2=0x7f58b00698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- 172.21.15.37:0/1528640690 shutdown_connections 2023-07-09T21:39:13.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- 172.21.15.37:0/1528640690 wait complete. 2023-07-09T21:39:13.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 Processor -- start 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.650+0000 7f58b5c9c640 1 -- start start 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58b0070120 0x7f58b00abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 0x7f58b00ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b01f87e0 con 0x7f58b006b810 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b01f8500 con 0x7f58b0070120 2023-07-09T21:39:13.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b00cad90 con 0x7f58b0156320 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59630/0 (socket says 172.21.15.37:59630) 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 -- 172.21.15.37:0/3766274167 learned_addr learned my addr 172.21.15.37:0/3766274167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58aeffd640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58b0070120 0x7f58b00abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58affff640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 0x7f58b00ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 -- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 msgr2=0x7f58b00ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 0x7f58b00ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 -- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58b0070120 msgr2=0x7f58b00abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58b0070120 0x7f58b00abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 -- 172.21.15.37:0/3766274167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a40094d0 con 0x7f58b006b810 2023-07-09T21:39:13.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58affff640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 0x7f58b00ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d800 tx=0x7f58a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f5897fff640 1 -- 172.21.15.37:0/3766274167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0018070 con 0x7f58b006b810 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f5897fff640 1 -- 172.21.15.37:0/3766274167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a00059a0 con 0x7f58b006b810 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f5897fff640 1 -- 172.21.15.37:0/3766274167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0005b50 con 0x7f58b006b810 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b00cb070 con 0x7f58b006b810 2023-07-09T21:39:13.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b00cd030 con 0x7f58b006b810 2023-07-09T21:39:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.654+0000 7f5897fff640 1 -- 172.21.15.37:0/3766274167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f58a0005cb0 con 0x7f58b006b810 2023-07-09T21:39:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f5897fff640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 0x7f589c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f5897fff640 1 -- 172.21.15.37:0/3766274167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58a0083cc0 con 0x7f58b006b810 2023-07-09T21:39:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 0x7f589c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 Processor -- start 2023-07-09T21:39:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 -- start start 2023-07-09T21:39:13.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 0x7f589c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58a40af000 tx=0x7f58a40b6040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb912bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb8c9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb78ff80 con 0x5604fb913110 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb6c9c60 con 0x5604fb912800 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604fb71d700 con 0x5604fb8c8f90 2023-07-09T21:39:13.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59642/0 (socket says 172.21.15.37:59642) 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 -- 172.21.15.37:0/1324282306 learned_addr learned my addr 172.21.15.37:0/1324282306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58af7fe640 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb912bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58affff640 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb8c9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 -- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 msgr2=0x5604fb8c9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb8c9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 -- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 msgr2=0x5604fb912bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb912bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 -- 172.21.15.37:0/1324282306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604fb412890 con 0x5604fb913110 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000c10 tx=0x7f58a4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404bb88655513148 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58957fa640 1 -- 172.21.15.37:0/1324282306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40c0a20 con 0x5604fb913110 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58957fa640 1 -- 172.21.15.37:0/1324282306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a40c0b80 con 0x5604fb913110 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.658+0000 7f58957fa640 1 -- 172.21.15.37:0/1324282306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a40be400 con 0x5604fb913110 2023-07-09T21:39:13.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1324282306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 msgr2=0x5604fb8c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f58a4000c10 tx=0x7f58a4004740 comp rx=0 tx=0).stop 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1324282306 shutdown_connections 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb8c9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb8c8a50 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- 172.21.15.37:0/1324282306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb912bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1324282306 >> 172.21.15.37:0/1324282306 conn(0x5604fb78ba70 msgr2=0x5604fb8c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1324282306 shutdown_connections 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1324282306 wait complete. 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- start start 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 Processor -- start 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb8d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb913110 0x5604fb8d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb7167a0 con 0x5604fb8c8f90 2023-07-09T21:39:13.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb6d2f00 con 0x5604fb912800 2023-07-09T21:39:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604fb6d2ba0 con 0x5604fb913110 2023-07-09T21:39:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 10 client.0 _ll_register_callbacks cb 0x5604fb8b4930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:39:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59650/0 (socket says 172.21.15.37:59650) 2023-07-09T21:39:13.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 -- 172.21.15.37:0/1555390138 learned_addr learned my addr 172.21.15.37:0/1555390138 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 -- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb913110 msgr2=0x5604fb8d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb913110 0x5604fb8d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 -- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 msgr2=0x5604fb8d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb8d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 -- 172.21.15.37:0/1555390138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b0070e30 con 0x5604fb8c8f90 2023-07-09T21:39:13.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58af7fe640 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f58a00549e0 tx=0x7f58a005d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9819a31e15e3e83b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:39:13.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0050cd0 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58a0050e30 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604fb7150f0 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a006c100 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 10 client.7524 fetch_fsmap learned FSMap version 40 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5604fb6db130 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a0076020 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58a006c260 con 0x5604fb8c8f90 2023-07-09T21:39:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.662+0000 7f58b9016000 10 client.7524 fetch_fsmap finished waiting for FSMap version 40 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 10 client.7524 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 20 client.7524 populate_metadata read hostname 'smithi037' 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb921870 0x5604fb923c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 4 client.7524 mds_command: new command op to 7341 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 --> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604fb6dde40 con 0x5604fb921870 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb921870 0x5604fb923c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58aeffd640 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb921870 0x5604fb923c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf774b0be3e5a70e server_cookie=56ff871de802c89 in_seq=0 out_seq=0 2023-07-09T21:39:13.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f588e7fc640 10 client.7524 ms_handle_connect on v2:172.21.15.119:6834/1186396367 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f588e7fc640 1 -- 172.21.15.37:0/1555390138 <== mds.0 v2:172.21.15.119:6834/1186396367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5604fb6dde40 con 0x5604fb921870 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f588e7fc640 10 client.7524 handle_command_reply: tid=0 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 client.7524 shutdown 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 msgr2=0x5604fb8d3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f58a00549e0 tx=0x7f58a005d170 comp rx=0 tx=0).stop 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 shutdown_connections 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb921870 0x5604fb923c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb913110 0x5604fb8d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb8d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 --2- 172.21.15.37:0/1555390138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb8c8f90 0x5604fb8d3be0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f588e7fc640 0 client.7524 ms_handle_reset on v2:172.21.15.119:6834/1186396367 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 >> 172.21.15.37:0/1555390138 conn(0x5604fb78ba70 msgr2=0x5604fb8c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 shutdown_connections 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 1 -- 172.21.15.37:0/1555390138 wait complete. 2023-07-09T21:39:13.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.666+0000 7f58b9016000 20 client.7524 trim_cache size 0 max 16384 2023-07-09T21:39:13.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 Processor -- start 2023-07-09T21:39:13.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 -- start start 2023-07-09T21:39:13.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb925370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb9258b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb8cc190 con 0x5604fb913110 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb3d3940 con 0x5604fb912800 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604fb8c8ab0 con 0x5604fb8c8f90 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59664/0 (socket says 172.21.15.37:59664) 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 -- 172.21.15.37:0/691685030 learned_addr learned my addr 172.21.15.37:0/691685030 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58af7fe640 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb925370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58aeffd640 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb9258b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 -- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 msgr2=0x5604fb925370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb925370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 -- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 msgr2=0x5604fb9258b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb9258b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.682+0000 7f58affff640 1 -- 172.21.15.37:0/691685030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604fb6c13c0 con 0x5604fb913110 2023-07-09T21:39:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f58a80075b0 tx=0x7f58a8007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0754b4be7731eb2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f5895ffb640 1 -- 172.21.15.37:0/691685030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011a80 con 0x5604fb913110 2023-07-09T21:39:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f5895ffb640 1 -- 172.21.15.37:0/691685030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a8011be0 con 0x5604fb913110 2023-07-09T21:39:13.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f5895ffb640 1 -- 172.21.15.37:0/691685030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8015470 con 0x5604fb913110 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- 172.21.15.37:0/691685030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 msgr2=0x5604fb90d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f58a80075b0 tx=0x7f58a8007a70 comp rx=0 tx=0).stop 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- 172.21.15.37:0/691685030 shutdown_connections 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb90d5c0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb9258b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- 172.21.15.37:0/691685030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb925370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- 172.21.15.37:0/691685030 >> 172.21.15.37:0/691685030 conn(0x5604fb78ba70 msgr2=0x5604fb923c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- 172.21.15.37:0/691685030 shutdown_connections 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- 172.21.15.37:0/691685030 wait complete. 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- start start 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 Processor -- start 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb970040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb970580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb8c07a0 con 0x5604fb913110 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604fb6b3ea0 con 0x5604fb912800 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604fb6dda50 con 0x5604fb8c8f90 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58b9016000 10 client.0 _ll_register_callbacks cb 0x5604fb8954d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59676/0 (socket says 172.21.15.37:59676) 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 -- 172.21.15.37:0/3471517691 learned_addr learned my addr 172.21.15.37:0/3471517691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb970040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58aeffd640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb970580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 -- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 msgr2=0x5604fb970040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb970040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 -- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 msgr2=0x5604fb970580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb970580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58affff640 1 -- 172.21.15.37:0/3471517691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a800f040 con 0x5604fb913110 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.686+0000 7f58aeffd640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb970580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:13.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58affff640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f58a80012f0 tx=0x7f58a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dc0553a0559562 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8011a80 con 0x5604fb913110 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58a8015a10 con 0x5604fb913110 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604fb8cc8c0 con 0x5604fb913110 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a8015bd0 con 0x5604fb913110 2023-07-09T21:39:13.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 10 client.7530 fetch_fsmap learned FSMap version 40 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5604fb412cc0 con 0x5604fb913110 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604fb8cc8c0 con 0x5604fb913110 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58a801e450 con 0x5604fb913110 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 10 client.7530 fetch_fsmap finished waiting for FSMap version 40 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 10 client.7530 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 20 client.7530 populate_metadata read hostname 'smithi037' 2023-07-09T21:39:13.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb976f10 0x5604fb9792f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 4 client.7530 mds_command: new command op to 7341 tid=0[{"prefix": "status"}] 2023-07-09T21:39:13.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 --> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5604fb6cf6f0 con 0x5604fb976f10 2023-07-09T21:39:13.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb976f10 0x5604fb9792f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58af7fe640 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb976f10 0x5604fb9792f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84c78aaffda87a9e server_cookie=346ff862f4792eb4 in_seq=0 out_seq=0 2023-07-09T21:39:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 10 client.7530 ms_handle_connect on v2:172.21.15.119:6834/1186396367 2023-07-09T21:39:13.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 1 -- 172.21.15.37:0/3471517691 <== mds.0 v2:172.21.15.119:6834/1186396367 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5604fb6cf6f0 con 0x5604fb976f10 2023-07-09T21:39:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 10 client.7530 handle_command_reply: tid=0 2023-07-09T21:39:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 client.7530 shutdown 2023-07-09T21:39:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 msgr2=0x5604fb910220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f58a80012f0 tx=0x7f58a8014000 comp rx=0 tx=0).stop 2023-07-09T21:39:13.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 shutdown_connections 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:6834/1186396367,v1:172.21.15.119:6836/1186396367] conn(0x5604fb976f10 0x5604fb9792f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5604fb913110 0x5604fb910220 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5604fb912800 0x5604fb970580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f588e7fc640 0 client.7530 ms_handle_reset on v2:172.21.15.119:6834/1186396367 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 --2- 172.21.15.37:0/3471517691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5604fb8c8f90 0x5604fb970040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 >> 172.21.15.37:0/3471517691 conn(0x5604fb78ba70 msgr2=0x5604fb8ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 shutdown_connections 2023-07-09T21:39:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 1 -- 172.21.15.37:0/3471517691 wait complete. 2023-07-09T21:39:13.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b9016000 20 client.7530 trim_cache size 0 max 16384 2023-07-09T21:39:13.703 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:39:13.703 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:39:13.703 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7341, 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.452136404000001, 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 40, 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 99, 2023-07-09T21:39:13.704 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 99, 2023-07-09T21:39:13.705 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.391273052999999 2023-07-09T21:39:13.705 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:39:13.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 msgr2=0x7f589c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 0x7f589c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f58a40af000 tx=0x7f58a40b6040 comp rx=0 tx=0).stop 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 msgr2=0x7f58b00ccaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f58a000d800 tx=0x7f58a000dcc0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 shutdown_connections 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f589c0663a0 0x7f589c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58b0156320 0x7f58b00ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58b0070120 0x7f58b00abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 --2- 172.21.15.37:0/3766274167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b006b810 0x7f58b00ccaf0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 >> 172.21.15.37:0/3766274167 conn(0x7f58b00694c0 msgr2=0x7f58b006f010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 shutdown_connections 2023-07-09T21:39:13.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.690+0000 7f58b5c9c640 1 -- 172.21.15.37:0/3766274167 wait complete. 2023-07-09T21:39:13.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:39:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 Processor -- start 2023-07-09T21:39:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 -- start start 2023-07-09T21:39:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe48015bbf0 0x7fe4800d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4800cf100 0x7fe4800cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4800d1380 con 0x7fe48006bc30 2023-07-09T21:39:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800b13e0 con 0x7fe48015bbf0 2023-07-09T21:39:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe486aaf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48002bbe0 con 0x7fe4800cf100 2023-07-09T21:39:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe48015bbf0 0x7fe4800d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe48015bbf0 0x7fe4800d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59686/0 (socket says 172.21.15.37:59686) 2023-07-09T21:39:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 -- 172.21.15.37:0/3334938438 learned_addr learned my addr 172.21.15.37:0/3334938438 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe4862ae640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4800cf100 0x7fe4800cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 -- 172.21.15.37:0/3334938438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4800cf100 msgr2=0x7fe4800cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4800cf100 0x7fe4800cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 -- 172.21.15.37:0/3334938438 >> v1:172.21.15.119:6789/0 conn(0x7fe48006bc30 legacy=0x7fe4800ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.854+0000 7fe485aad640 1 -- 172.21.15.37:0/3334938438 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800b1100 con 0x7fe48015bbf0 2023-07-09T21:39:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe485aad640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48015bbf0 0x7fe4800d1810 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009870 tx=0x7fe47c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2d815eec6053e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe484aab640 1 -- 172.21.15.37:0/3334938438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0a7070 con 0x7fe48015bbf0 2023-07-09T21:39:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe484aab640 1 -- 172.21.15.37:0/3334938438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47c0ab430 con 0x7fe48015bbf0 2023-07-09T21:39:13.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe484aab640 1 -- 172.21.15.37:0/3334938438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe47c0ab7c0 con 0x7fe48015bbf0 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 -- 172.21.15.37:0/3334938438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48015bbf0 msgr2=0x7fe4800d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48015bbf0 0x7fe4800d1810 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fe47c009870 tx=0x7fe47c01c510 comp rx=0 tx=0).stop 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 -- 172.21.15.37:0/3334938438 shutdown_connections 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4800cf100 0x7fe4800cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 --2- 172.21.15.37:0/3334938438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe48015bbf0 0x7fe4800d1810 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 -- 172.21.15.37:0/3334938438 >> 172.21.15.37:0/3334938438 conn(0x7fe48002b640 msgr2=0x7fe4800d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 -- 172.21.15.37:0/3334938438 shutdown_connections 2023-07-09T21:39:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.858+0000 7fe486aaf640 1 -- 172.21.15.37:0/3334938438 wait complete. 2023-07-09T21:39:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 Processor -- start 2023-07-09T21:39:13.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- start start 2023-07-09T21:39:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 0x7fe4800b1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 0x7fe480152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800b27a0 con 0x7fe4800cf100 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480147570 con 0x7fe48015bbf0 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801599f0 con 0x7fe48006bc30 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59688/0 (socket says 172.21.15.37:59688) 2023-07-09T21:39:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 -- 172.21.15.37:0/788376321 learned_addr learned my addr 172.21.15.37:0/788376321 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:13.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe485aad640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 0x7fe4800b1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4862ae640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 0x7fe480152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 -- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 msgr2=0x7fe4800b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 0x7fe4800b1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 -- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 msgr2=0x7fe480152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 0x7fe480152fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 -- 172.21.15.37:0/788376321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0094d0 con 0x7fe4800cf100 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4862ae640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 0x7fe480152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:13.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe485aad640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 0x7fe4800b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4852ac640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c3c0 tx=0x7fe47000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700052d0 con 0x7fe4800cf100 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe470005430 con 0x7fe4800cf100 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe470003840 con 0x7fe4800cf100 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480146f20 con 0x7fe4800cf100 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480158800 con 0x7fe4800cf100 2023-07-09T21:39:13.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.862+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48006b020 con 0x7fe4800cf100 2023-07-09T21:39:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.866+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe4700039a0 con 0x7fe4800cf100 2023-07-09T21:39:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.866+0000 7fe4767fc640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 0x7fe464068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.866+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe470083330 con 0x7fe4800cf100 2023-07-09T21:39:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.866+0000 7fe485aad640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 0x7fe464068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:13.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.866+0000 7fe485aad640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 0x7fe464068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0af000 tx=0x7fe47c008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:13.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:13.870+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe470050730 con 0x7fe4800cf100 2023-07-09T21:39:14.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.054+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe480146d80 con 0x7fe4800cf100 2023-07-09T21:39:14.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe4767fc640 1 -- 172.21.15.37:0/788376321 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe480146d80 con 0x7fe4800cf100 2023-07-09T21:39:14.060 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:39:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 msgr2=0x7fe464068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 0x7fe464068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe47c0af000 tx=0x7fe47c008040 comp rx=0 tx=0).stop 2023-07-09T21:39:14.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 msgr2=0x7fe4800b2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fe47000c3c0 tx=0x7fe47000c880 comp rx=0 tx=0).stop 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 shutdown_connections 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fe4640663a0 0x7fe464068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe48015bbf0 0x7fe480152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4800cf100 0x7fe4800b2000 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 --2- 172.21.15.37:0/788376321 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe48006bc30 0x7fe4800b1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 >> 172.21.15.37:0/788376321 conn(0x7fe48002b640 msgr2=0x7fe480155410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:14.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 shutdown_connections 2023-07-09T21:39:14.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:14.058+0000 7fe486aaf640 1 -- 172.21.15.37:0/788376321 wait complete. 2023-07-09T21:39:14.080 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:39:14.080 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:39:14.081 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:39:14.081 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:39:14.081 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:14.082 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:39:14.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:39:14.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:39:14.082 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:14.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.083 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:39:14.093 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:39:14.093 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:39:14.093 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:39:14.093 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.093 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:39:14.094 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41449sec preferred_lft 41449sec 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:14.095 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:39:14.096 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:39:14.097 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.098 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:39:14.098 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:39:14.098 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:39:14.098 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:14.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.099 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:39:14.166 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:39:14.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.169 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:39:14.220 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:39:14.220 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:39:14.220 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:39:14.220 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:39:14.221 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:39:14.221 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:39:14.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.221 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:39:14.222 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:39:14.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:39:14.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:39:14.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:39:14.223 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:39:14.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.316 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:39:14.326 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:39:14.326 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:39:14.326 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:14.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.327 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:39:14.387 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:39:14.388 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:39:14.388 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:14.439 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:14.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:39:14.440 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:14.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:39:14.552 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:39:14.553 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:39:14.614 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:39:14.615 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:39:14.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.617 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:39:14.667 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:39:14.667 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:39:14.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:39:14.737 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:39:14.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:39:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:39:14.801 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:39:14.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:14.803 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:39:14.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:39:14.810+0000 7f590803a580 -1 init, newargv = 0x55568f362230 newargc=15 2023-07-09T21:39:14.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[55679]: starting ceph client 2023-07-09T21:39:14.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[55679]: starting fuse 2023-07-09T21:39:14.822 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:39:14.822 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:39:14.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:39:14.823 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:39:14.824 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:39:14.824 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:39:14.825 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:39:14.825 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:14.825 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:39:14.825 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:39:14.826 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:39:14.826 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:39:14.826 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:14.827 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:39:14.827 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:39:14.827 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:39:14.827 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:39:14.828 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:14.828 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:39:14.828 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:39:14.829 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:39:14.829 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:39:14.829 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:39:14.830 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:39:14.830 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:39:14.830 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:39:14.830 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:14.831 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:39:14.831 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:39:14.948 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.55679.asok 2023-07-09T21:39:15.132 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55679.asok 2023-07-09T21:39:15.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:15.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55679.asok status 2023-07-09T21:39:15.310 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:39:15.310 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:39:15.310 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:39:15.310 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:39:15.310 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "55679", 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:39:15.311 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7542, 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 7542 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:15.312 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 960814033 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:39:15.313 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 960814033 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.7542 192.168.0.1:0/960814033", 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/960814033", 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 40, 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 99, 2023-07-09T21:39:15.314 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:39:15.315 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:39:15.315 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:39:15.315 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:39:15.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:15.326 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:39:15.326 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:15.336 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:39:15.336 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:15.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:15.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:15.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:39:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.594+0000 7fcb6d0d8640 1 Processor -- start 2023-07-09T21:39:15.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.594+0000 7fcb6d0d8640 1 -- start start 2023-07-09T21:39:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.594+0000 7fcb6d0d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 0x7fcb680b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.594+0000 7fcb6d0d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680cef80 con 0x7fcb680b4140 2023-07-09T21:39:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6d0d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb680cf260 con 0x7fcb680b7a60 2023-07-09T21:39:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6d0d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680ccee0 con 0x7fcb680b47a0 2023-07-09T21:39:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6759e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcb680b4140 0x7fcb680d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39094/0 (socket says 172.21.15.37:39094) 2023-07-09T21:39:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6759e640 1 -- 172.21.15.37:0/4218542826 learned_addr learned my addr 172.21.15.37:0/4218542826 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb5ffff640 1 --2- 172.21.15.37:0/4218542826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 0x7fcb680b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524205435 0 0) 0x7fcb680cef80 con 0x7fcb680b4140 2023-07-09T21:39:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb54003530 con 0x7fcb680b4140 2023-07-09T21:39:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb5ffff640 1 -- 172.21.15.37:0/4218542826 >> v1:172.21.15.119:6789/0 conn(0x7fcb680b7a60 legacy=0x7fcb680cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619139510 0 0) 0x7fcb680cf260 con 0x7fcb680b7a60 2023-07-09T21:39:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb5ffff640 1 -- 172.21.15.37:0/4218542826 >> v1:172.21.15.37:6789/0 conn(0x7fcb680b4140 legacy=0x7fcb680d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.598+0000 7fcb5ffff640 1 -- 172.21.15.37:0/4218542826 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb680cf540 con 0x7fcb680b47a0 2023-07-09T21:39:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb5ffff640 1 --2- 172.21.15.37:0/4218542826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 0x7fcb680b3c00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097f0 tx=0x7fcb5001c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9c478751c716c26 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb60001a00 con 0x7fcb680b47a0 2023-07-09T21:39:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb500a7050 con 0x7fcb680b47a0 2023-07-09T21:39:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6659c640 1 -- 172.21.15.37:0/4218542826 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb500ab600 con 0x7fcb680b47a0 2023-07-09T21:39:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/4218542826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 msgr2=0x7fcb680b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/4218542826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 0x7fcb680b3c00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcb500097f0 tx=0x7fcb5001c300 comp rx=0 tx=0).stop 2023-07-09T21:39:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/4218542826 shutdown_connections 2023-07-09T21:39:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/4218542826 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b47a0 0x7fcb680b3c00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/4218542826 >> 172.21.15.37:0/4218542826 conn(0x7fcb68073050 msgr2=0x7fcb68069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/4218542826 shutdown_connections 2023-07-09T21:39:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/4218542826 wait complete. 2023-07-09T21:39:15.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 Processor -- start 2023-07-09T21:39:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- start start 2023-07-09T21:39:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b4140 0x7fcb6815f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb680b47a0 0x7fcb681f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6815eb50 con 0x7fcb680b7a60 2023-07-09T21:39:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68147480 con 0x7fcb680b47a0 2023-07-09T21:39:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.602+0000 7fcb6d0d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6815dc10 con 0x7fcb680b4140 2023-07-09T21:39:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59696/0 (socket says 172.21.15.37:59696) 2023-07-09T21:39:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 -- 172.21.15.37:0/2075457110 learned_addr learned my addr 172.21.15.37:0/2075457110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb66d9d640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b4140 0x7fcb6815f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb5ffff640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb680b47a0 0x7fcb681f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 -- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b4140 msgr2=0x7fcb6815f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b4140 0x7fcb6815f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 -- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb680b47a0 msgr2=0x7fcb681f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb680b47a0 0x7fcb681f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 -- 172.21.15.37:0/2075457110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb50009420 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6759e640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000ca10 tx=0x7fcb6000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000a760 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6000a8c0 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000ac50 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6815ded0 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6815e490 con 0x7fcb680b7a60 2023-07-09T21:39:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb680cdaa0 con 0x7fcb680b7a60 2023-07-09T21:39:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.606+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcb600070d0 con 0x7fcb680b7a60 2023-07-09T21:39:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.610+0000 7fcb5f7fe640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 0x7fcb48068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.610+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcb60083550 con 0x7fcb680b7a60 2023-07-09T21:39:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.610+0000 7fcb66d9d640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 0x7fcb48068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.610+0000 7fcb66d9d640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 0x7fcb48068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000f70 tx=0x7fcb58009040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.614+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb60050960 con 0x7fcb680b7a60 2023-07-09T21:39:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.790+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb6804d7d0 con 0x7fcb480663a0 2023-07-09T21:39:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.790+0000 7fcb5f7fe640 1 -- 172.21.15.37:0/2075457110 <== mgr.6179 v2:172.21.15.119:6832/2063381883 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fcb6804d7d0 con 0x7fcb480663a0 2023-07-09T21:39:15.795 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:39:15.795 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:15.795 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:39:15.796 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:15.796 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:39:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 msgr2=0x7fcb48068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 0x7fcb48068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb58000f70 tx=0x7fcb58009040 comp rx=0 tx=0).stop 2023-07-09T21:39:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 msgr2=0x7fcb681f79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000ca10 tx=0x7fcb6000ced0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 shutdown_connections 2023-07-09T21:39:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcb480663a0 0x7fcb48068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb680b7a60 0x7fcb681f79b0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcb680b47a0 0x7fcb681f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 --2- 172.21.15.37:0/2075457110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcb680b4140 0x7fcb6815f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 >> 172.21.15.37:0/2075457110 conn(0x7fcb68073050 msgr2=0x7fcb680b63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 shutdown_connections 2023-07-09T21:39:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.794+0000 7fcb6d0d8640 1 -- 172.21.15.37:0/2075457110 wait complete. 2023-07-09T21:39:15.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:39:15.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 Processor -- start 2023-07-09T21:39:15.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 -- start start 2023-07-09T21:39:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed540d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415bf80 con 0x7fed540ceb80 2023-07-09T21:39:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed540cd070 con 0x7fed540b7980 2023-07-09T21:39:15.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed5bdc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cfd70 con 0x7fed540d0780 2023-07-09T21:39:15.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed59360640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed540ceb80 0x7fed540cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39100/0 (socket says 172.21.15.37:39100) 2023-07-09T21:39:15.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.958+0000 7fed59360640 1 -- 172.21.15.37:0/1359539987 learned_addr learned my addr 172.21.15.37:0/1359539987 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:15.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 --2- 172.21.15.37:0/1359539987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed540d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed59b61640 1 --2- 172.21.15.37:0/1359539987 >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed58b5f640 1 -- 172.21.15.37:0/1359539987 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990547620 0 0) 0x7fed44001120 con 0x7fed540ceb80 2023-07-09T21:39:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed58b5f640 1 -- 172.21.15.37:0/1359539987 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed40003530 con 0x7fed540ceb80 2023-07-09T21:39:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 -- 172.21.15.37:0/1359539987 >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 msgr2=0x7fed54160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 --2- 172.21.15.37:0/1359539987 >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 -- 172.21.15.37:0/1359539987 >> v1:172.21.15.37:6789/0 conn(0x7fed540ceb80 legacy=0x7fed540cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 -- 172.21.15.37:0/1359539987 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed54160570 con 0x7fed540d0780 2023-07-09T21:39:15.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed5a362640 1 --2- 172.21.15.37:0/1359539987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed540d0bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009d90 tx=0x7fed4c01c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=725590dc55de72c3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed58b5f640 1 -- 172.21.15.37:0/1359539987 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0a5810 con 0x7fed540d0780 2023-07-09T21:39:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed58b5f640 1 -- 172.21.15.37:0/1359539987 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4c0a5970 con 0x7fed540d0780 2023-07-09T21:39:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.962+0000 7fed58b5f640 1 -- 172.21.15.37:0/1359539987 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0a5d00 con 0x7fed540d0780 2023-07-09T21:39:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- 172.21.15.37:0/1359539987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 msgr2=0x7fed540d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/1359539987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed540d0bc0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fed4c009d90 tx=0x7fed4c01c950 comp rx=0 tx=0).stop 2023-07-09T21:39:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- 172.21.15.37:0/1359539987 shutdown_connections 2023-07-09T21:39:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/1359539987 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540d0780 0x7fed540d0bc0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/1359539987 >> v2:172.21.15.119:3300/0 conn(0x7fed540b7980 0x7fed54160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- 172.21.15.37:0/1359539987 >> 172.21.15.37:0/1359539987 conn(0x7fed54073090 msgr2=0x7fed54069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:15.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- 172.21.15.37:0/1359539987 shutdown_connections 2023-07-09T21:39:15.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- 172.21.15.37:0/1359539987 wait complete. 2023-07-09T21:39:15.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 Processor -- start 2023-07-09T21:39:15.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- start start 2023-07-09T21:39:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 0x7fed540cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 0x7fed540ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cb8e0 con 0x7fed540ceb80 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540b4500 con 0x7fed540d0780 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5bdc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540cac60 con 0x7fed540b7980 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59708/0 (socket says 172.21.15.37:59708) 2023-07-09T21:39:15.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 -- 172.21.15.37:0/3537657877 learned_addr learned my addr 172.21.15.37:0/3537657877 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59b61640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 0x7fed540cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5a362640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 0x7fed540ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 -- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 msgr2=0x7fed540cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 0x7fed540cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 -- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 msgr2=0x7fed540ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:15.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 0x7fed540ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59360640 1 -- 172.21.15.37:0/3537657877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c009a70 con 0x7fed540ceb80 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed59b61640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 0x7fed540cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.966+0000 7fed5a362640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 0x7fed540ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed59360640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c4d0 tx=0x7fed4400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44005cf0 con 0x7fed540ceb80 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44005e50 con 0x7fed540ceb80 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed44007290 con 0x7fed540ceb80 2023-07-09T21:39:15.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540caf40 con 0x7fed540ceb80 2023-07-09T21:39:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed540cb500 con 0x7fed540ceb80 2023-07-09T21:39:15.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5404d7d0 con 0x7fed540ceb80 2023-07-09T21:39:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 33) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed440073f0 con 0x7fed540ceb80 2023-07-09T21:39:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fed44083410 con 0x7fed540ceb80 2023-07-09T21:39:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.970+0000 7fed59b61640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.974+0000 7fed59b61640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed50009ae0 tx=0x7fed50008040 comp rx=0 tx=0).ready entity=mgr.6179 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:15.974+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed44050660 con 0x7fed540ceb80 2023-07-09T21:39:16.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:16.166+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fed5415bf80 con 0x7fed540ceb80 2023-07-09T21:39:17.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.126+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fed440076a0 con 0x7fed540ceb80 2023-07-09T21:39:17.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.126+0000 7fed4a7fc640 1 -- 172.21.15.37:0/3537657877 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v34) v1 ==== 92+0+0 (secure 0 0 0) 0x7fed4407ea30 con 0x7fed540ceb80 2023-07-09T21:39:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 msgr2=0x7fed38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 0x7fed38068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed50009ae0 tx=0x7fed50008040 comp rx=0 tx=0).stop 2023-07-09T21:39:17.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 msgr2=0x7fed541527c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fed4400c4d0 tx=0x7fed4400c990 comp rx=0 tx=0).stop 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 shutdown_connections 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fed380663a0 0x7fed38068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed540d0780 0x7fed540ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed540ceb80 0x7fed541527c0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 --2- 172.21.15.37:0/3537657877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed540b7980 0x7fed540cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 >> 172.21.15.37:0/3537657877 conn(0x7fed54073090 msgr2=0x7fed540cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:17.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 shutdown_connections 2023-07-09T21:39:17.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.130+0000 7fed5bdc5640 1 -- 172.21.15.37:0/3537657877 wait complete. 2023-07-09T21:39:17.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:39:17.301 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:17.306+0000 7f79b4b7e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:17.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.314+0000 7f843bc7b640 1 Processor -- start 2023-07-09T21:39:17.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.314+0000 7f843bc7b640 1 -- start start 2023-07-09T21:39:17.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843bc7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84340b7980 0x7f8434160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843bc7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843415bf80 con 0x7f84340d0780 2023-07-09T21:39:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843bc7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8434160570 con 0x7f84340ceb80 2023-07-09T21:39:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843bc7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84340cd070 con 0x7f84340b7980 2023-07-09T21:39:17.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843a218640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84340d0780 0x7f84340d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54500/0 (socket says 172.21.15.37:54500) 2023-07-09T21:39:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f843a218640 1 -- 172.21.15.37:0/3360661279 learned_addr learned my addr 172.21.15.37:0/3360661279 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8439a17640 1 --2- 172.21.15.37:0/3360661279 >> v2:172.21.15.119:3300/0 conn(0x7f84340b7980 0x7f8434160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 990037289 0 0) 0x7f842c0014a0 con 0x7f84340d0780 2023-07-09T21:39:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8420003530 con 0x7f84340d0780 2023-07-09T21:39:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360657896 0 0) 0x7f8424001120 con 0x7f84340ceb80 2023-07-09T21:39:17.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c0014a0 con 0x7f84340ceb80 2023-07-09T21:39:17.324 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f0298c2c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:17.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8439a17640 1 -- 172.21.15.37:0/3360661279 >> v1:172.21.15.119:6789/0 conn(0x7f84340ceb80 legacy=0x7f84340cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8439a17640 1 -- 172.21.15.37:0/3360661279 >> v1:172.21.15.37:6789/0 conn(0x7f84340d0780 legacy=0x7f84340d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.318+0000 7f8439a17640 1 -- 172.21.15.37:0/3360661279 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84340d02f0 con 0x7f84340b7980 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f8439a17640 1 --2- 172.21.15.37:0/3360661279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434160030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f84300097c0 tx=0x7f843001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f863306d8e77d912 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300ab600 con 0x7f84340b7980 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300a7050 con 0x7f84340b7980 2023-07-09T21:39:17.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f8438a15640 1 -- 172.21.15.37:0/3360661279 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300ab980 con 0x7f84340b7980 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- 172.21.15.37:0/3360661279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 msgr2=0x7f8434160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 --2- 172.21.15.37:0/3360661279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434160030 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f84300097c0 tx=0x7f843001c480 comp rx=0 tx=0).stop 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- 172.21.15.37:0/3360661279 shutdown_connections 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 --2- 172.21.15.37:0/3360661279 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434160030 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- 172.21.15.37:0/3360661279 >> 172.21.15.37:0/3360661279 conn(0x7f8434073090 msgr2=0x7f8434069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- 172.21.15.37:0/3360661279 shutdown_connections 2023-07-09T21:39:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- 172.21.15.37:0/3360661279 wait complete. 2023-07-09T21:39:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 Processor -- start 2023-07-09T21:39:17.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.322+0000 7f843bc7b640 1 -- start start 2023-07-09T21:39:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84340ceb80 0x7f84340b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 0x7f8434150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340ca6d0 con 0x7f84340d0780 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340b1d30 con 0x7f84340b7980 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340b2010 con 0x7f84340ceb80 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 0x7f8434150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f8439a17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f8439a17640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35212/0 (socket says 172.21.15.37:35212) 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f8439a17640 1 -- 172.21.15.37:0/2357229270 learned_addr learned my addr 172.21.15.37:0/2357229270 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f8439216640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84340ceb80 0x7f84340b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 -- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84340ceb80 msgr2=0x7f84340b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84340ceb80 0x7f84340b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 -- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 msgr2=0x7f8434139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 -- 172.21.15.37:0/2357229270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009420 con 0x7f84340d0780 2023-07-09T21:39:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f8439a17640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843a218640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 0x7f8434150720 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f842c00cc00 tx=0x7f842c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00ce10 con 0x7f84340d0780 2023-07-09T21:39:17.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c012400 con 0x7f84340d0780 2023-07-09T21:39:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c012790 con 0x7f84340d0780 2023-07-09T21:39:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340b22f0 con 0x7f84340d0780 2023-07-09T21:39:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843413ace0 con 0x7f84340d0780 2023-07-09T21:39:17.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84340ca880 con 0x7f84340d0780 2023-07-09T21:39:17.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.326+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f842c007070 con 0x7f84340d0780 2023-07-09T21:39:17.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.330+0000 7f842a7fc640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 0x7f84180688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.330+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f842c083eb0 con 0x7f84340d0780 2023-07-09T21:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.330+0000 7f8439a17640 1 -- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 msgr2=0x7f84180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:17.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.330+0000 7f8439a17640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 0x7f84180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:17.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.334+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84340ca880 con 0x7f84340d0780 2023-07-09T21:39:17.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.490+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f843415bf80 con 0x7f84340d0780 2023-07-09T21:39:17.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f842a7fc640 1 -- 172.21.15.37:0/2357229270 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f843415bf80 con 0x7f84340d0780 2023-07-09T21:39:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 msgr2=0x7f84180688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 0x7f84180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 msgr2=0x7f8434150720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 0x7f8434150720 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f842c00cc00 tx=0x7f842c00a430 comp rx=0 tx=0).stop 2023-07-09T21:39:17.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 shutdown_connections 2023-07-09T21:39:17.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f84180663f0 0x7f84180688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84340d0780 0x7f8434150720 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84340ceb80 0x7f84340b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 --2- 172.21.15.37:0/2357229270 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84340b7980 0x7f8434139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 >> 172.21.15.37:0/2357229270 conn(0x7f8434073090 msgr2=0x7f84340d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:17.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 shutdown_connections 2023-07-09T21:39:17.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.498+0000 7f843bc7b640 1 -- 172.21.15.37:0/2357229270 wait complete. 2023-07-09T21:39:17.522 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:39:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 Processor -- start 2023-07-09T21:39:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 -- start start 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f77740b7980 0x7f7774160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77740ceb80 0x7f77740cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777415bf80 con 0x7f77740b3c20 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740cd070 con 0x7f77740ceb80 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f777c740640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77740cfd70 con 0x7f77740b7980 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f7779cdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77740ceb80 0x7f77740cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f7779cdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77740ceb80 0x7f77740cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41178/0 (socket says 172.21.15.37:41178) 2023-07-09T21:39:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.666+0000 7f7779cdb640 1 -- 172.21.15.37:0/3619913335 learned_addr learned my addr 172.21.15.37:0/3619913335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f777a4dc640 1 --2- 172.21.15.37:0/3619913335 >> v2:172.21.15.119:3300/0 conn(0x7f77740b7980 0x7f7774160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f7779cdb640 1 -- 172.21.15.37:0/3619913335 >> v2:172.21.15.119:3300/0 conn(0x7f77740b7980 msgr2=0x7f7774160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f7779cdb640 1 --2- 172.21.15.37:0/3619913335 >> v2:172.21.15.119:3300/0 conn(0x7f77740b7980 0x7f7774160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f7779cdb640 1 -- 172.21.15.37:0/3619913335 >> v1:172.21.15.119:6789/0 conn(0x7f77740b3c20 legacy=0x7f77740b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f7779cdb640 1 -- 172.21.15.37:0/3619913335 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7774160570 con 0x7f77740ceb80 2023-07-09T21:39:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f7779cdb640 1 --2- 172.21.15.37:0/3619913335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f77740cefc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7774069aa0 tx=0x7f776401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519a6ee59d64d924 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f77794da640 1 -- 172.21.15.37:0/3619913335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640ab600 con 0x7f77740ceb80 2023-07-09T21:39:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f77794da640 1 -- 172.21.15.37:0/3619913335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77640a7050 con 0x7f77740ceb80 2023-07-09T21:39:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.670+0000 7f77794da640 1 -- 172.21.15.37:0/3619913335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77640ab980 con 0x7f77740ceb80 2023-07-09T21:39:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- 172.21.15.37:0/3619913335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 msgr2=0x7f77740cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- 172.21.15.37:0/3619913335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f77740cefc0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f7774069aa0 tx=0x7f776401c500 comp rx=0 tx=0).stop 2023-07-09T21:39:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- 172.21.15.37:0/3619913335 shutdown_connections 2023-07-09T21:39:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- 172.21.15.37:0/3619913335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f77740cefc0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- 172.21.15.37:0/3619913335 >> v2:172.21.15.119:3300/0 conn(0x7f77740b7980 0x7f7774160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- 172.21.15.37:0/3619913335 >> 172.21.15.37:0/3619913335 conn(0x7f7774073090 msgr2=0x7f7774069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- 172.21.15.37:0/3619913335 shutdown_connections 2023-07-09T21:39:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- 172.21.15.37:0/3619913335 wait complete. 2023-07-09T21:39:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 Processor -- start 2023-07-09T21:39:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- start start 2023-07-09T21:39:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740b3c20 0x7f77740c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77740b7980 0x7f77741538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774155490 con 0x7f77740ceb80 2023-07-09T21:39:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7774157e40 con 0x7f77740b3c20 2023-07-09T21:39:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777c740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7774157880 con 0x7f77740b7980 2023-07-09T21:39:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777acdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777acdd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41180/0 (socket says 172.21.15.37:41180) 2023-07-09T21:39:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777acdd640 1 -- 172.21.15.37:0/3219322180 learned_addr learned my addr 172.21.15.37:0/3219322180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f777a4dc640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740b3c20 0x7f77740c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.674+0000 7f7779cdb640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77740b7980 0x7f77741538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 -- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77740b7980 msgr2=0x7f77741538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77740b7980 0x7f77741538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 -- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740b3c20 msgr2=0x7f77740c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740b3c20 0x7f77740c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 -- 172.21.15.37:0/3219322180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77640094d0 con 0x7f77740ceb80 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777acdd640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c770 tx=0x7f776c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c003b80 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c003ce0 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c00aa90 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7774157b60 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7774157480 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77741555d0 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.678+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f776c00abf0 con 0x7f77740ceb80 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.682+0000 7f776affd640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 0x7f77580688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.682+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f776c083ae0 con 0x7f77740ceb80 2023-07-09T21:39:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.682+0000 7f777a4dc640 1 -- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 msgr2=0x7f77580688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.682+0000 7f777a4dc640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 0x7f77580688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.682+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77741555d0 con 0x7f77740ceb80 2023-07-09T21:39:17.718 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:17.722+0000 7f79b4b7e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:17.772 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:17.770+0000 7f0298c2c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:17.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.842+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f77741555d0 con 0x7f77740ceb80 2023-07-09T21:39:17.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f776affd640 1 -- 172.21.15.37:0/3219322180 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f77741555d0 con 0x7f77740ceb80 2023-07-09T21:39:17.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 msgr2=0x7f77580688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 0x7f77580688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 msgr2=0x7f777415d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c770 tx=0x7f776c00cc30 comp rx=0 tx=0).stop 2023-07-09T21:39:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 shutdown_connections 2023-07-09T21:39:17.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7f77580663f0 0x7f77580688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77740ceb80 0x7f777415d440 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77740b7980 0x7f77741538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 --2- 172.21.15.37:0/3219322180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77740b3c20 0x7f77740c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 >> 172.21.15.37:0/3219322180 conn(0x7f7774073090 msgr2=0x7f777415b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 shutdown_connections 2023-07-09T21:39:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:17.850+0000 7f777c740640 1 -- 172.21.15.37:0/3219322180 wait complete. 2023-07-09T21:39:17.869 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:17.874+0000 7f79b4b7e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:17.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-09T21:39:17.934 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:17.930+0000 7f0298c2c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.018+0000 7fcbce7ac640 1 Processor -- start 2023-07-09T21:39:18.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.018+0000 7fcbce7ac640 1 -- start start 2023-07-09T21:39:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbce7ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 0x7fcbc8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbce7ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 0x7fcbc80d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbce7ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc815bf80 con 0x7fcbc80ceb80 2023-07-09T21:39:18.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbce7ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc80cd070 con 0x7fcbc80d0780 2023-07-09T21:39:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbce7ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80cfd70 con 0x7fcbc80b7980 2023-07-09T21:39:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbccd49640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 0x7fcbc80d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbc7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 0x7fcbc8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbccd49640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 0x7fcbc80d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35248/0 (socket says 172.21.15.37:35248) 2023-07-09T21:39:18.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbccd49640 1 -- 172.21.15.37:0/2577961864 learned_addr learned my addr 172.21.15.37:0/2577961864 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbc7fff640 1 -- 172.21.15.37:0/2577961864 >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 msgr2=0x7fcbc80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/2577961864 >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 0x7fcbc80d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbc7fff640 1 -- 172.21.15.37:0/2577961864 >> v1:172.21.15.119:6789/0 conn(0x7fcbc80ceb80 legacy=0x7fcbc80cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:18.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.022+0000 7fcbc7fff640 1 -- 172.21.15.37:0/2577961864 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc8160570 con 0x7fcbc80b7980 2023-07-09T21:39:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/2577961864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 0x7fcbc8160030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097c0 tx=0x7fcbb801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72014db79f5b6b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/2577961864 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80ab600 con 0x7fcbc80b7980 2023-07-09T21:39:18.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/2577961864 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb80a7050 con 0x7fcbc80b7980 2023-07-09T21:39:18.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbc6ffd640 1 -- 172.21.15.37:0/2577961864 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb80ab980 con 0x7fcbc80b7980 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- 172.21.15.37:0/2577961864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 msgr2=0x7fcbc8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 --2- 172.21.15.37:0/2577961864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 0x7fcbc8160030 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80097c0 tx=0x7fcbb801c480 comp rx=0 tx=0).stop 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- 172.21.15.37:0/2577961864 shutdown_connections 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 --2- 172.21.15.37:0/2577961864 >> v2:172.21.15.119:3300/0 conn(0x7fcbc80d0780 0x7fcbc80d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 --2- 172.21.15.37:0/2577961864 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80b7980 0x7fcbc8160030 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:18.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- 172.21.15.37:0/2577961864 >> 172.21.15.37:0/2577961864 conn(0x7fcbc8073090 msgr2=0x7fcbc8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:18.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- 172.21.15.37:0/2577961864 shutdown_connections 2023-07-09T21:39:18.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- 172.21.15.37:0/2577961864 wait complete. 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 Processor -- start 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.026+0000 7fcbce7ac640 1 -- start start 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc80b7980 0x7fcbc8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80ceb80 0x7fcbc815c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc80d0780 0x7fcbc815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8154380 con 0x7fcbc80d0780 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8154810 con 0x7fcbc80b7980 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc815efd0 con 0x7fcbc80ceb80 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc80d0780 0x7fcbc815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80ceb80 0x7fcbc815c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc7fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc80b7980 0x7fcbc8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc80d0780 0x7fcbc815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41188/0 (socket says 172.21.15.37:41188) 2023-07-09T21:39:18.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 -- 172.21.15.37:0/592177035 learned_addr learned my addr 172.21.15.37:0/592177035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80ceb80 msgr2=0x7fcbc815c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcbc80ceb80 0x7fcbc815c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc80b7980 msgr2=0x7fcbc8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:18.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc80b7980 0x7fcbc8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8009420 con 0x7fcbc80d0780 2023-07-09T21:39:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcbc80b7980 0x7fcbc8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbccd49640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbc80d0780 0x7fcbc815ccc0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fcbc000efc0 tx=0x7fcbc000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc000cd20 con 0x7fcbc80d0780 2023-07-09T21:39:18.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc000f040 con 0x7fcbc80d0780 2023-07-09T21:39:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc8153a50 con 0x7fcbc80d0780 2023-07-09T21:39:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc0003be0 con 0x7fcbc80d0780 2023-07-09T21:39:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8154010 con 0x7fcbc80d0780 2023-07-09T21:39:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbce7ac640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc81544f0 con 0x7fcbc80d0780 2023-07-09T21:39:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.030+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 34) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fcbc0003d40 con 0x7fcbc80d0780 2023-07-09T21:39:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.034+0000 7fcbc4ff9640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.034+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbc0084560 con 0x7fcbc80d0780 2023-07-09T21:39:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.034+0000 7fcbc7fff640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 msgr2=0x7fcbb40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:18.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.034+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.042+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcbc0051860 con 0x7fcbc80d0780 2023-07-09T21:39:18.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.214+0000 7fcbce7ac640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbc80cff80 con 0x7fcbb40663f0 2023-07-09T21:39:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.238+0000 7fcbc7fff640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 msgr2=0x7fcbb40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:18.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.238+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:39:18.350 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.354+0000 7f79b4b7e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:18.408 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.414+0000 7f79b4b7e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:18.452 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.450+0000 7f0298c2c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:18.463 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.470+0000 7f79b4b7e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:18.513 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.510+0000 7f0298c2c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:18.548 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.554+0000 7f79b4b7e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:18.572 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.570+0000 7f0298c2c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:18.605 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.610+0000 7f79b4b7e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:18.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.642+0000 7fcbc7fff640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 msgr2=0x7fcbb40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:18.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:18.642+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:39:18.663 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.662+0000 7f0298c2c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:18.689 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.694+0000 7f79b4b7e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:18.723 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.722+0000 7f0298c2c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:18.745 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.750+0000 7f79b4b7e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:18.812 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.810+0000 7f0298c2c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:18.871 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:18.870+0000 7f0298c2c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:18.887 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.890+0000 7f79b4b7e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:18.944 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:18.950+0000 7f79b4b7e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:19.020 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.018+0000 7f0298c2c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:19.081 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.078+0000 7f0298c2c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:19.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:19.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:19.183 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:19.191 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:19.194+0000 7f79b4b7e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:19.327 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:19.330+0000 7f79b4b7e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:19.330 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:19.330 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:19.330 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:19.339 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.334+0000 7f0298c2c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:19.446+0000 7fcbc7fff640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 msgr2=0x7fcbb40688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2063381883 2023-07-09T21:39:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:19.446+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:39:19.450 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:19.454+0000 7f79b4b7e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:19.480 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.478+0000 7f0298c2c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:19.523 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:19.526+0000 7f79b4b7e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:19.611 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.610+0000 7f0298c2c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:19.653 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:19.658+0000 7f79b4b7e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:19.685 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.682+0000 7f0298c2c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:19.826 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:19.822+0000 7f0298c2c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:20.187 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.190+0000 7f79b4b7e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:39:20.273 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.278+0000 7f79b4b7e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:39:20.397 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:20.394+0000 7f0298c2c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:39:20.420 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.426+0000 7f79b4b7e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:39:20.488 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:20.482+0000 7f0298c2c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:39:20.503 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.506+0000 7f79b4b7e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:39:20.642 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:20.638+0000 7f0298c2c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:39:20.730 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:20.726+0000 7f0298c2c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:39:20.770 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.774+0000 7f79b4b7e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:39:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.834+0000 7f79b4b7e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:39:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:20.838+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 35) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fcbc0051c30 con 0x7fcbc80d0780 2023-07-09T21:39:20.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:20.838+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 msgr2=0x7fcbb40688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:20.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:20.838+0000 7fcbc4ff9640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/2063381883,v1:172.21.15.119:6833/2063381883] conn(0x7fcbb40663f0 0x7fcbb40688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:20.961 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7933ce5640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.961 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7933ce5640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7933ce5640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7933ce5640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7933ce5640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7936ceb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7936ceb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7936ceb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.962 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7936ceb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:20.963 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:20.966+0000 7f7936ceb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:21.037 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:21.034+0000 7f0298c2c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:39:21.101 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:21.098+0000 7f0298c2c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:39:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.846+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 36) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fcbc0082410 con 0x7fcbc80d0780 2023-07-09T21:39:21.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.846+0000 7fcbc4ff9640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fcbb4033e90 0x7fcbb40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:21.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.846+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 --> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbb4034260 con 0x7fcbb4033e90 2023-07-09T21:39:21.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.850+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fcbb4033e90 0x7fcbb40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:21.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.854+0000 7fcbc7fff640 1 --2- 172.21.15.37:0/592177035 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fcbb4033e90 0x7fcbb40708c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcbb80ad000 tx=0x7fcbb80a6000 comp rx=0 tx=0).ready entity=mgr.7234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:21.865 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:21.870+0000 7f793dcf9640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-09T21:39:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:21.862+0000 7fcbc4ff9640 1 -- 172.21.15.37:0/592177035 <== mgr.7234 v2:172.21.15.119:6832/1820997415 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fcbb4034260 con 0x7fcbb4033e90 2023-07-09T21:39:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-09T21:39:21.874 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-09T21:39:21.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:39:22.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 Processor -- start 2023-07-09T21:39:22.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 -- start start 2023-07-09T21:39:22.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9edc0b7980 0x7f9edc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 0x7f9edc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9edc15bf80 con 0x7f9edc0ceb80 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9edc0cd070 con 0x7f9edc0b7980 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee4111640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0cfd70 con 0x7f9edc0d0780 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9edc0b7980 0x7f9edc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9edc0b7980 0x7f9edc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41204/0 (socket says 172.21.15.37:41204) 2023-07-09T21:39:22.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 -- 172.21.15.37:0/1005521122 learned_addr learned my addr 172.21.15.37:0/1005521122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 -- 172.21.15.37:0/1005521122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 msgr2=0x7f9edc0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee26ae640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 0x7f9edc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 0x7f9edc0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:22.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 -- 172.21.15.37:0/1005521122 >> v1:172.21.15.119:6789/0 conn(0x7f9edc0ceb80 legacy=0x7f9edc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:22.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee1ead640 1 -- 172.21.15.37:0/1005521122 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc160570 con 0x7f9edc0b7980 2023-07-09T21:39:22.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.022+0000 7f9ee26ae640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 0x7f9edc0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee1ead640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0b7980 0x7f9edc160030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009870 tx=0x7f9ed801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad194d577be6e08a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee0eab640 1 -- 172.21.15.37:0/1005521122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80ab600 con 0x7f9edc0b7980 2023-07-09T21:39:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee0eab640 1 -- 172.21.15.37:0/1005521122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed80a7050 con 0x7f9edc0b7980 2023-07-09T21:39:22.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee0eab640 1 -- 172.21.15.37:0/1005521122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed80ab980 con 0x7f9edc0b7980 2023-07-09T21:39:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 -- 172.21.15.37:0/1005521122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0b7980 msgr2=0x7f9edc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0b7980 0x7f9edc160030 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009870 tx=0x7f9ed801c500 comp rx=0 tx=0).stop 2023-07-09T21:39:22.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 -- 172.21.15.37:0/1005521122 shutdown_connections 2023-07-09T21:39:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0d0780 0x7f9edc0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 --2- 172.21.15.37:0/1005521122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0b7980 0x7f9edc160030 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 -- 172.21.15.37:0/1005521122 >> 172.21.15.37:0/1005521122 conn(0x7f9edc073090 msgr2=0x7f9edc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 -- 172.21.15.37:0/1005521122 shutdown_connections 2023-07-09T21:39:22.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.026+0000 7f9ee4111640 1 -- 172.21.15.37:0/1005521122 wait complete. 2023-07-09T21:39:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 Processor -- start 2023-07-09T21:39:22.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- start start 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc0b7980 0x7f9edc0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0ceb80 0x7f9edc0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0c9630 con 0x7f9edc0d0780 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b4210 con 0x7f9edc0b7980 2023-07-09T21:39:22.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9edc0b44b0 con 0x7f9edc0ceb80 2023-07-09T21:39:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee1ead640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc0b7980 0x7f9edc0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41220/0 (socket says 172.21.15.37:41220) 2023-07-09T21:39:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 -- 172.21.15.37:0/399346601 learned_addr learned my addr 172.21.15.37:0/399346601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:22.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee16ac640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0ceb80 0x7f9edc0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 -- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0ceb80 msgr2=0x7f9edc0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0ceb80 0x7f9edc0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:22.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 -- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc0b7980 msgr2=0x7f9edc0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc0b7980 0x7f9edc0b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 -- 172.21.15.37:0/399346601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80094d0 con 0x7f9edc0d0780 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee26ae640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400cd50 tx=0x7f9ed400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400f680 con 0x7f9edc0d0780 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed400f800 con 0x7f9edc0d0780 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed400fbb0 con 0x7f9edc0d0780 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc0b4750 con 0x7f9edc0d0780 2023-07-09T21:39:22.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.030+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9edc0b4a30 con 0x7f9edc0d0780 2023-07-09T21:39:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc0b5cc0 con 0x7f9edc0d0780 2023-07-09T21:39:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f9ed400b040 con 0x7f9edc0d0780 2023-07-09T21:39:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ed27fc640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 0x7f9ec00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f9ed4084440 con 0x7f9edc0d0780 2023-07-09T21:39:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ee1ead640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 0x7f9ec00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:22.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.034+0000 7f9ee1ead640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 0x7f9ec00685d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80ad000 tx=0x7f9ed8008040 comp rx=0 tx=0).ready entity=mgr.7234 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:22.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.038+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ed4051b00 con 0x7f9edc0d0780 2023-07-09T21:39:22.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:22.230+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f9edc0b5cc0 con 0x7f9edc0d0780 2023-07-09T21:39:23.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.114+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f9ed4051ed0 con 0x7f9edc0d0780 2023-07-09T21:39:23.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.114+0000 7f9ed27fc640 1 -- 172.21.15.37:0/399346601 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v37) v1 ==== 93+0+0 (secure 0 0 0) 0x7f9ed4055590 con 0x7f9edc0d0780 2023-07-09T21:39:23.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 msgr2=0x7f9ec00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 0x7f9ec00685d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9ed80ad000 tx=0x7f9ed8008040 comp rx=0 tx=0).stop 2023-07-09T21:39:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 msgr2=0x7f9edc151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400cd50 tx=0x7f9ed400a650 comp rx=0 tx=0).stop 2023-07-09T21:39:23.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 shutdown_connections 2023-07-09T21:39:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9edc0d0780 0x7f9edc151e30 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9edc0ceb80 0x7f9edc0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f9ec0066120 0x7f9ec00685d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 --2- 172.21.15.37:0/399346601 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9edc0b7980 0x7f9edc0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 >> 172.21.15.37:0/399346601 conn(0x7f9edc073090 msgr2=0x7f9edc0cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 shutdown_connections 2023-07-09T21:39:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.118+0000 7f9ee4111640 1 -- 172.21.15.37:0/399346601 wait complete. 2023-07-09T21:39:23.145 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:39:23.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:39:23.198 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:39:23.247 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:39:23.248 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:39:23.248 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:23.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:23.292 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:23.298+0000 7f5851a2f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:23.297 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:23.294+0000 7ffa6f336180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:23.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.438+0000 7fedfb8ec640 1 Processor -- start 2023-07-09T21:39:23.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.438+0000 7fedfb8ec640 1 -- start start 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedf40b7ab0 0x7fedf406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fedf40cef80 0x7fedf40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b4170 0x7fedf415f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf40b7e80 con 0x7fedf40b7ab0 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf40b4610 con 0x7fedf40cef80 2023-07-09T21:39:23.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedfb8ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40b49f0 con 0x7fedf40b4170 2023-07-09T21:39:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedf40b7ab0 0x7fedf406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fedf40b7ab0 0x7fedf406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41230/0 (socket says 172.21.15.37:41230) 2023-07-09T21:39:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 -- 172.21.15.37:0/2298843175 learned_addr learned my addr 172.21.15.37:0/2298843175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9e89640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b4170 0x7fedf415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf8e87640 1 --2- 172.21.15.37:0/2298843175 >> v2:172.21.15.119:3300/0 conn(0x7fedf40cef80 0x7fedf40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 -- 172.21.15.37:0/2298843175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b4170 msgr2=0x7fedf415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b4170 0x7fedf415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 -- 172.21.15.37:0/2298843175 >> v2:172.21.15.119:3300/0 conn(0x7fedf40cef80 msgr2=0x7fedf40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 --2- 172.21.15.37:0/2298843175 >> v2:172.21.15.119:3300/0 conn(0x7fedf40cef80 0x7fedf40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.442+0000 7fedf9688640 1 -- 172.21.15.37:0/2298843175 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf40cc8a0 con 0x7fedf40b7ab0 2023-07-09T21:39:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedf9688640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b7ab0 0x7fedf406aa50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fedf40b4d10 tx=0x7fedf001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff93109c223c11f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:23.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedebfff640 1 -- 172.21.15.37:0/2298843175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00ab600 con 0x7fedf40b7ab0 2023-07-09T21:39:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedebfff640 1 -- 172.21.15.37:0/2298843175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a7050 con 0x7fedf40b7ab0 2023-07-09T21:39:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedebfff640 1 -- 172.21.15.37:0/2298843175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00ab980 con 0x7fedf40b7ab0 2023-07-09T21:39:23.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 -- 172.21.15.37:0/2298843175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b7ab0 msgr2=0x7fedf406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b7ab0 0x7fedf406aa50 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fedf40b4d10 tx=0x7fedf001c210 comp rx=0 tx=0).stop 2023-07-09T21:39:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 -- 172.21.15.37:0/2298843175 shutdown_connections 2023-07-09T21:39:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b4170 0x7fedf415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/2298843175 >> v2:172.21.15.119:3300/0 conn(0x7fedf40cef80 0x7fedf40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/2298843175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b7ab0 0x7fedf406aa50 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 -- 172.21.15.37:0/2298843175 >> 172.21.15.37:0/2298843175 conn(0x7fedf4073090 msgr2=0x7fedf4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 -- 172.21.15.37:0/2298843175 shutdown_connections 2023-07-09T21:39:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.446+0000 7fedfb8ec640 1 -- 172.21.15.37:0/2298843175 wait complete. 2023-07-09T21:39:23.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 Processor -- start 2023-07-09T21:39:23.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- start start 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b7ab0 0x7fedf414f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedf40cef80 0x7fedf414ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf414f130 con 0x7fedf40b4170 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40b1ea0 con 0x7fedf40cef80 2023-07-09T21:39:23.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40b2740 con 0x7fedf40b7ab0 2023-07-09T21:39:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41236/0 (socket says 172.21.15.37:41236) 2023-07-09T21:39:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 -- 172.21.15.37:0/3409448816 learned_addr learned my addr 172.21.15.37:0/3409448816 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf8e87640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b7ab0 0x7fedf414f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9e89640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedf40cef80 0x7fedf414ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 -- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b7ab0 msgr2=0x7fedf414f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b7ab0 0x7fedf414f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 -- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedf40cef80 msgr2=0x7fedf414ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedf40cef80 0x7fedf414ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 -- 172.21.15.37:0/3409448816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00094d0 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedf9688640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf00ae040 tx=0x7fedf001aa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b6420 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00b6580 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf414f360 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b6910 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.450+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf40b23d0 con 0x7fedf40b4170 2023-07-09T21:39:23.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf40b0f40 con 0x7fedf40b4170 2023-07-09T21:39:23.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fedf00b2040 con 0x7fedf40b4170 2023-07-09T21:39:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fede9ffb640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 0x7fedd80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fedf011e250 con 0x7fedf40b4170 2023-07-09T21:39:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fedf8e87640 1 -- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 msgr2=0x7fedd80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:23.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.454+0000 7fedf8e87640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 0x7fedd80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:23.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.458+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fedf00eb1f0 con 0x7fedf40b4170 2023-07-09T21:39:23.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.614+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedf404d7d0 con 0x7fedf40b4170 2023-07-09T21:39:23.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.614+0000 7fede9ffb640 1 -- 172.21.15.37:0/3409448816 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+18850 (secure 0 0 0) 0x7fedf00ee810 con 0x7fedf40b4170 2023-07-09T21:39:23.619 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:23.619 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":100,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:20.834525+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/4250279670":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2514649320":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6833/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2044940131":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/3365981794":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/68715102":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1987789388":"2023-07-10T21:39:20.834480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:23.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 msgr2=0x7fedd80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 0x7fedd80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 msgr2=0x7fedf40c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf00ae040 tx=0x7fedf001aa50 comp rx=0 tx=0).stop 2023-07-09T21:39:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 shutdown_connections 2023-07-09T21:39:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fedd8066430 0x7fedd80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fedf40cef80 0x7fedf414ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fedf40b7ab0 0x7fedf414f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 --2- 172.21.15.37:0/3409448816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fedf40b4170 0x7fedf40c6900 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 >> 172.21.15.37:0/3409448816 conn(0x7fedf4073090 msgr2=0x7fedf40b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 shutdown_connections 2023-07-09T21:39:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.618+0000 7fedfb8ec640 1 -- 172.21.15.37:0/3409448816 wait complete. 2023-07-09T21:39:23.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:39:00.709802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:39:01.666752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:39:23.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:39:23.704 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:23.710+0000 7f5851a2f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:23.745 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:23.742+0000 7ffa6f336180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 Processor -- start 2023-07-09T21:39:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 -- start start 2023-07-09T21:39:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbdc160030 0x7fdbdc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc15bf80 con 0x7fdbdc0cf290 2023-07-09T21:39:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbdc0d02f0 con 0x7fdbdc0b7980 2023-07-09T21:39:23.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe3856640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbdc0cd070 con 0x7fdbdc160030 2023-07-09T21:39:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe1df3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdbdc160030 0x7fdbdc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe0df1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdbdc0cf290 0x7fdbdc0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54504/0 (socket says 172.21.15.37:54504) 2023-07-09T21:39:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe0df1640 1 -- 172.21.15.37:0/1770107333 learned_addr learned my addr 172.21.15.37:0/1770107333 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:23.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe1df3640 1 -- 172.21.15.37:0/1770107333 >> v1:172.21.15.119:6789/0 conn(0x7fdbdc0b7980 legacy=0x7fdbdc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe1df3640 1 -- 172.21.15.37:0/1770107333 >> v1:172.21.15.37:6789/0 conn(0x7fdbdc0cf290 legacy=0x7fdbdc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbd3fff640 1 -- 172.21.15.37:0/1770107333 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1420053143 0 0) 0x7fdbcc001120 con 0x7fdbdc0cf290 2023-07-09T21:39:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.790+0000 7fdbe1df3640 1 -- 172.21.15.37:0/1770107333 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbdc0cc7f0 con 0x7fdbdc160030 2023-07-09T21:39:23.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.794+0000 7fdbe1df3640 1 --2- 172.21.15.37:0/1770107333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc160030 0x7fdbdc0d0e90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009d90 tx=0x7fdbd401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a455bec7628d78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:23.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.794+0000 7fdbd3fff640 1 -- 172.21.15.37:0/1770107333 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40a5810 con 0x7fdbdc160030 2023-07-09T21:39:23.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.794+0000 7fdbd3fff640 1 -- 172.21.15.37:0/1770107333 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd40a5970 con 0x7fdbdc160030 2023-07-09T21:39:23.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.794+0000 7fdbd3fff640 1 -- 172.21.15.37:0/1770107333 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd40a5d00 con 0x7fdbdc160030 2023-07-09T21:39:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- 172.21.15.37:0/1770107333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc160030 msgr2=0x7fdbdc0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 --2- 172.21.15.37:0/1770107333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc160030 0x7fdbdc0d0e90 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fdbd4009d90 tx=0x7fdbd401c950 comp rx=0 tx=0).stop 2023-07-09T21:39:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- 172.21.15.37:0/1770107333 shutdown_connections 2023-07-09T21:39:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 --2- 172.21.15.37:0/1770107333 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc160030 0x7fdbdc0d0e90 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- 172.21.15.37:0/1770107333 >> 172.21.15.37:0/1770107333 conn(0x7fdbdc073090 msgr2=0x7fdbdc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:23.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- 172.21.15.37:0/1770107333 shutdown_connections 2023-07-09T21:39:23.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- 172.21.15.37:0/1770107333 wait complete. 2023-07-09T21:39:23.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 Processor -- start 2023-07-09T21:39:23.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.798+0000 7fdbe3856640 1 -- start start 2023-07-09T21:39:23.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 0x7fdbdc0c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 0x7fdbdc0c6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0c7fe0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc0c82c0 con 0x7fdbdc160030 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbdc150ed0 con 0x7fdbdc0b7980 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41258/0 (socket says 172.21.15.37:41258) 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 -- 172.21.15.37:0/247396022 learned_addr learned my addr 172.21.15.37:0/247396022 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe1df3640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 0x7fdbdc0c6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe15f2640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 0x7fdbdc0c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 -- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 msgr2=0x7fdbdc0c8c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 0x7fdbdc0c8c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 -- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 msgr2=0x7fdbdc0c6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 0x7fdbdc0c6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 -- 172.21.15.37:0/247396022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd4009a70 con 0x7fdbdc0cf290 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe15f2640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 0x7fdbdc0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe1df3640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 0x7fdbdc0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe0df1640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c750 tx=0x7fdbcc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0072d0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbcc007470 con 0x7fdbdc0cf290 2023-07-09T21:39:23.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbdc1511b0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc001d40 con 0x7fdbdc0cf290 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.802+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbdc150c50 con 0x7fdbdc0cf290 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbdc1516d0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fdbcc0047f0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbd1ffb640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 0x7fdbc00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fdbcc083280 con 0x7fdbdc0cf290 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbe15f2640 1 -- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 msgr2=0x7fdbc00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:23.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.806+0000 7fdbe15f2640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 0x7fdbc00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:23.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.810+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbdc1516d0 con 0x7fdbdc0cf290 2023-07-09T21:39:23.855 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:23.858+0000 7f5851a2f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:23.912 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:23.910+0000 7ffa6f336180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.966+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdbdc15bf80 con 0x7fdbdc0cf290 2023-07-09T21:39:23.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.966+0000 7fdbd1ffb640 1 -- 172.21.15.37:0/247396022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdbdc15bf80 con 0x7fdbdc0cf290 2023-07-09T21:39:23.970 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:39:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 msgr2=0x7fdbc00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:23.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 0x7fdbc00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 msgr2=0x7fdbdc150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00c750 tx=0x7fdbcc00cc10 comp rx=0 tx=0).stop 2023-07-09T21:39:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 shutdown_connections 2023-07-09T21:39:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fdbc0066430 0x7fdbc00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdbdc160030 0x7fdbdc0c6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdbdc0cf290 0x7fdbdc150710 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 --2- 172.21.15.37:0/247396022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdbdc0b7980 0x7fdbdc0c8c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 >> 172.21.15.37:0/247396022 conn(0x7fdbdc073090 msgr2=0x7fdbdc15cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 shutdown_connections 2023-07-09T21:39:23.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:23.970+0000 7fdbe3856640 1 -- 172.21.15.37:0/247396022 wait complete. 2023-07-09T21:39:23.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:39:24.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.134+0000 7f33fa31f640 1 Processor -- start 2023-07-09T21:39:24.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.134+0000 7f33fa31f640 1 -- start start 2023-07-09T21:39:24.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33fa31f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 0x7f33f4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33fa31f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f33f40ceb80 0x7f33f40cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33fa31f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f415bf80 con 0x7f33f40b3c20 2023-07-09T21:39:24.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33fa31f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40cd070 con 0x7f33f40ceb80 2023-07-09T21:39:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33fa31f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40cfd70 con 0x7f33f40b7980 2023-07-09T21:39:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f88bc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f33f40b3c20 0x7f33f40b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54520/0 (socket says 172.21.15.37:54520) 2023-07-09T21:39:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f88bc640 1 -- 172.21.15.37:0/2097782560 learned_addr learned my addr 172.21.15.37:0/2097782560 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:24.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f3fff640 1 --2- 172.21.15.37:0/2097782560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 0x7f33f4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f37fe640 1 --2- 172.21.15.37:0/2097782560 >> v2:172.21.15.119:3300/0 conn(0x7f33f40ceb80 0x7f33f40cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f3fff640 1 -- 172.21.15.37:0/2097782560 >> v2:172.21.15.119:3300/0 conn(0x7f33f40ceb80 msgr2=0x7f33f40cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:24.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f3fff640 1 --2- 172.21.15.37:0/2097782560 >> v2:172.21.15.119:3300/0 conn(0x7f33f40ceb80 0x7f33f40cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f3fff640 1 -- 172.21.15.37:0/2097782560 >> v1:172.21.15.37:6789/0 conn(0x7f33f40b3c20 legacy=0x7f33f40b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f2ffd640 1 -- 172.21.15.37:0/2097782560 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403186251 0 0) 0x7f33ec0014a0 con 0x7f33f40b3c20 2023-07-09T21:39:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.138+0000 7f33f3fff640 1 -- 172.21.15.37:0/2097782560 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4160570 con 0x7f33f40b7980 2023-07-09T21:39:24.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33f3fff640 1 --2- 172.21.15.37:0/2097782560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 0x7f33f4160030 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097c0 tx=0x7f33e401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29dfd7b626172adc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33f2ffd640 1 -- 172.21.15.37:0/2097782560 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40ab600 con 0x7f33f40b7980 2023-07-09T21:39:24.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33f2ffd640 1 -- 172.21.15.37:0/2097782560 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40a7050 con 0x7f33f40b7980 2023-07-09T21:39:24.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33f2ffd640 1 -- 172.21.15.37:0/2097782560 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40ab980 con 0x7f33f40b7980 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- 172.21.15.37:0/2097782560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 msgr2=0x7f33f4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 --2- 172.21.15.37:0/2097782560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 0x7f33f4160030 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f33e40097c0 tx=0x7f33e401c480 comp rx=0 tx=0).stop 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- 172.21.15.37:0/2097782560 shutdown_connections 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 --2- 172.21.15.37:0/2097782560 >> v2:172.21.15.119:3300/0 conn(0x7f33f40ceb80 0x7f33f40cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 --2- 172.21.15.37:0/2097782560 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b7980 0x7f33f4160030 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- 172.21.15.37:0/2097782560 >> 172.21.15.37:0/2097782560 conn(0x7f33f4073090 msgr2=0x7f33f4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:24.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- 172.21.15.37:0/2097782560 shutdown_connections 2023-07-09T21:39:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- 172.21.15.37:0/2097782560 wait complete. 2023-07-09T21:39:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 Processor -- start 2023-07-09T21:39:24.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.142+0000 7f33fa31f640 1 -- start start 2023-07-09T21:39:24.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33f40b7980 0x7f33f41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 0x7f33f40c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40c9960 con 0x7f33f40ceb80 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40cc070 con 0x7f33f40b7980 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40cbd90 con 0x7f33f40b3c20 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f88bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 0x7f33f40c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40968/0 (socket says 172.21.15.37:40968) 2023-07-09T21:39:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f37fe640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33f40b7980 0x7f33f41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 -- 172.21.15.37:0/1835420708 learned_addr learned my addr 172.21.15.37:0/1835420708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 -- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33f40b7980 msgr2=0x7f33f41542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33f40b7980 0x7f33f41542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 -- 172.21.15.37:0/1835420708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 msgr2=0x7f33f40c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 0x7f33f40c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 -- 172.21.15.37:0/1835420708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4009420 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f88bc640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 0x7f33f40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f3fff640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33e401a0b0 tx=0x7f33e4019220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b4610 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e40b4790 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40b4b40 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f40c9310 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f4153f30 con 0x7f33f40b3c20 2023-07-09T21:39:24.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f40737d0 con 0x7f33f40b3c20 2023-07-09T21:39:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.146+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f33e40b2040 con 0x7f33f40b3c20 2023-07-09T21:39:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.150+0000 7f33f0ff9640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 0x7f33e00688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.150+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f33e411e130 con 0x7f33f40b3c20 2023-07-09T21:39:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.150+0000 7f33f37fe640 1 -- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 msgr2=0x7f33e00688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:24.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.150+0000 7f33f37fe640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 0x7f33e00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:24.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.154+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33f40737d0 con 0x7f33f40b3c20 2023-07-09T21:39:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.306+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f33f4160570 con 0x7f33f40b3c20 2023-07-09T21:39:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.306+0000 7f33f0ff9640 1 -- 172.21.15.37:0/1835420708 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v100) v1 ==== 92+0+10 (secure 0 0 0) 0x7f33f4160570 con 0x7f33f40b3c20 2023-07-09T21:39:24.312 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:39:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 msgr2=0x7f33e00688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 0x7f33e00688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 msgr2=0x7f33f41539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f33e401a0b0 tx=0x7f33e4019220 comp rx=0 tx=0).stop 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 shutdown_connections 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f40ceb80 0x7f33f40c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f33e0066430 0x7f33e00688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f33f40b7980 0x7f33f41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 --2- 172.21.15.37:0/1835420708 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f33f40b3c20 0x7f33f41539f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 >> 172.21.15.37:0/1835420708 conn(0x7f33f4073090 msgr2=0x7f33f41585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 shutdown_connections 2023-07-09T21:39:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.310+0000 7f33fa31f640 1 -- 172.21.15.37:0/1835420708 wait complete. 2023-07-09T21:39:24.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:39:24.334 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.338+0000 7f5851a2f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:24.392 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.398+0000 7f5851a2f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:24.429 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.426+0000 7ffa6f336180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:24.446 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.450+0000 7f5851a2f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 Processor -- start 2023-07-09T21:39:24.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 -- start start 2023-07-09T21:39:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2780b7980 0x7fa278160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 0x7fa2780cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27815bf80 con 0x7fa2780b3c20 2023-07-09T21:39:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780cd070 con 0x7fa2780b7980 2023-07-09T21:39:24.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27ff8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780cfd70 con 0x7fa2780ceb80 2023-07-09T21:39:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27dd2b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2780b7980 0x7fa278160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27d52a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 0x7fa2780cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27e52c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa2780b3c20 0x7fa2780b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:36372/0 (socket says 172.21.15.37:36372) 2023-07-09T21:39:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27e52c640 1 -- 172.21.15.37:0/3910222282 learned_addr learned my addr 172.21.15.37:0/3910222282 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27dd2b640 1 -- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 msgr2=0x7fa2780cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27dd2b640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 0x7fa2780cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27dd2b640 1 -- 172.21.15.37:0/3910222282 >> v1:172.21.15.119:6789/0 conn(0x7fa2780b3c20 legacy=0x7fa2780b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27dd2b640 1 -- 172.21.15.37:0/3910222282 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa278160570 con 0x7fa2780b7980 2023-07-09T21:39:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27d52a640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 0x7fa2780cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:24.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.478+0000 7fa27cd29640 1 -- 172.21.15.37:0/3910222282 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441436704 0 0) 0x7fa2700014a0 con 0x7fa2780b3c20 2023-07-09T21:39:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27dd2b640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278160030 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097c0 tx=0x7fa27401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c015e4beba7dd00 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27cd29640 1 -- 172.21.15.37:0/3910222282 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740ab600 con 0x7fa2780b7980 2023-07-09T21:39:24.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27cd29640 1 -- 172.21.15.37:0/3910222282 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2740a7050 con 0x7fa2780b7980 2023-07-09T21:39:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27cd29640 1 -- 172.21.15.37:0/3910222282 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2740ab980 con 0x7fa2780b7980 2023-07-09T21:39:24.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 -- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 msgr2=0x7fa278160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278160030 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa2740097c0 tx=0x7fa27401c480 comp rx=0 tx=0).stop 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 -- 172.21.15.37:0/3910222282 shutdown_connections 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780ceb80 0x7fa2780cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/3910222282 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278160030 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 -- 172.21.15.37:0/3910222282 >> 172.21.15.37:0/3910222282 conn(0x7fa278073090 msgr2=0x7fa278069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 -- 172.21.15.37:0/3910222282 shutdown_connections 2023-07-09T21:39:24.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.482+0000 7fa27ff8f640 1 -- 172.21.15.37:0/3910222282 wait complete. 2023-07-09T21:39:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 Processor -- start 2023-07-09T21:39:24.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- start start 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 0x7fa2781f7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27815ecf0 con 0x7fa2780ceb80 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2780ca730 con 0x7fa2780b7980 2023-07-09T21:39:24.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2781561e0 con 0x7fa2780b3c20 2023-07-09T21:39:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27dd2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27e52c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 0x7fa2781f7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35358/0 (socket says 172.21.15.37:35358) 2023-07-09T21:39:24.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 -- 172.21.15.37:0/4103257656 learned_addr learned my addr 172.21.15.37:0/4103257656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27dd2b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40974/0 (socket says 172.21.15.37:40974) 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 -- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 msgr2=0x7fa27815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 -- 172.21.15.37:0/4103257656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 msgr2=0x7fa2781f7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 0x7fa2781f7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 -- 172.21.15.37:0/4103257656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa268009420 con 0x7fa2780b7980 2023-07-09T21:39:24.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27dd2b640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27e52c640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 0x7fa2781f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27d52a640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa26800ec10 tx=0x7fa26800c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26800cc30 con 0x7fa2780b7980 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26800cd90 con 0x7fa2780b7980 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa274009420 con 0x7fa2780b7980 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa268013690 con 0x7fa2780b7980 2023-07-09T21:39:24.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.486+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2780cacb0 con 0x7fa2780b7980 2023-07-09T21:39:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2780ca590 con 0x7fa2780b7980 2023-07-09T21:39:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fa2680137f0 con 0x7fa2780b7980 2023-07-09T21:39:24.494 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.490+0000 7ffa6f336180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa26e7fc640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 0x7fa25c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fa2680843e0 con 0x7fa2780b7980 2023-07-09T21:39:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa27dd2b640 1 -- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 msgr2=0x7fa25c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:24.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.490+0000 7fa27dd2b640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 0x7fa25c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:24.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.494+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2780ca590 con 0x7fa2780b7980 2023-07-09T21:39:24.533 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.538+0000 7f5851a2f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:24.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.550+0000 7ffa6f336180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:24.590 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.594+0000 7f5851a2f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:24.643 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.642+0000 7ffa6f336180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:24.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.650+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2780ca590 con 0x7fa2780b7980 2023-07-09T21:39:24.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.650+0000 7fa26e7fc640 1 -- 172.21.15.37:0/4103257656 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v100) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2780ca590 con 0x7fa2780b7980 2023-07-09T21:39:24.654 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:39:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 msgr2=0x7fa25c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 0x7fa25c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 msgr2=0x7fa278155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fa26800ec10 tx=0x7fa26800c520 comp rx=0 tx=0).stop 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 shutdown_connections 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2780ceb80 0x7fa2781f7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7fa25c066430 0x7fa25c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2780b7980 0x7fa278155800 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 --2- 172.21.15.37:0/4103257656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2780b3c20 0x7fa27815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 >> 172.21.15.37:0/4103257656 conn(0x7fa278073090 msgr2=0x7fa2780b3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 shutdown_connections 2023-07-09T21:39:24.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.654+0000 7fa27ff8f640 1 -- 172.21.15.37:0/4103257656 wait complete. 2023-07-09T21:39:24.674 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.678+0000 7f5851a2f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:24.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:39:24.704 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.702+0000 7ffa6f336180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:24.730 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.734+0000 7f5851a2f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:24.795 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.790+0000 7ffa6f336180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.818+0000 7f28d1f82640 1 Processor -- start 2023-07-09T21:39:24.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.818+0000 7f28d1f82640 1 -- start start 2023-07-09T21:39:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28d1f82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28cc0cf290 0x7f28cc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28d1f82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc15bf80 con 0x7f28cc0d0780 2023-07-09T21:39:24.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28d1f82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc160570 con 0x7f28cc0b7980 2023-07-09T21:39:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28d1f82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc0cd070 con 0x7f28cc0cf290 2023-07-09T21:39:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28cbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28cc0d0780 0x7f28cc0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54528/0 (socket says 172.21.15.37:54528) 2023-07-09T21:39:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28cbfff640 1 -- 172.21.15.37:0/1864428007 learned_addr learned my addr 172.21.15.37:0/1864428007 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28caffd640 1 --2- 172.21.15.37:0/1864428007 >> v2:172.21.15.119:3300/0 conn(0x7f28cc0cf290 0x7f28cc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28caffd640 1 -- 172.21.15.37:0/1864428007 >> v1:172.21.15.119:6789/0 conn(0x7f28cc0b7980 legacy=0x7f28cc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28ca7fc640 1 -- 172.21.15.37:0/1864428007 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850382292 0 0) 0x7f28c40014a0 con 0x7f28cc0d0780 2023-07-09T21:39:24.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28caffd640 1 -- 172.21.15.37:0/1864428007 >> v1:172.21.15.37:6789/0 conn(0x7f28cc0d0780 legacy=0x7f28cc0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.822+0000 7f28caffd640 1 -- 172.21.15.37:0/1864428007 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc0d02f0 con 0x7f28cc0cf290 2023-07-09T21:39:24.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28caffd640 1 --2- 172.21.15.37:0/1864428007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0cf290 0x7f28cc160030 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f28c00097c0 tx=0x7f28c001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d556dedf9f2c366d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28ca7fc640 1 -- 172.21.15.37:0/1864428007 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00ab600 con 0x7f28cc0cf290 2023-07-09T21:39:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28ca7fc640 1 -- 172.21.15.37:0/1864428007 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00a7050 con 0x7f28cc0cf290 2023-07-09T21:39:24.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28ca7fc640 1 -- 172.21.15.37:0/1864428007 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00ab980 con 0x7f28cc0cf290 2023-07-09T21:39:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- 172.21.15.37:0/1864428007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0cf290 msgr2=0x7f28cc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 --2- 172.21.15.37:0/1864428007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0cf290 0x7f28cc160030 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f28c00097c0 tx=0x7f28c001c480 comp rx=0 tx=0).stop 2023-07-09T21:39:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- 172.21.15.37:0/1864428007 shutdown_connections 2023-07-09T21:39:24.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 --2- 172.21.15.37:0/1864428007 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0cf290 0x7f28cc160030 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- 172.21.15.37:0/1864428007 >> 172.21.15.37:0/1864428007 conn(0x7f28cc073090 msgr2=0x7f28cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- 172.21.15.37:0/1864428007 shutdown_connections 2023-07-09T21:39:24.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- 172.21.15.37:0/1864428007 wait complete. 2023-07-09T21:39:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 Processor -- start 2023-07-09T21:39:24.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.826+0000 7f28d1f82640 1 -- start start 2023-07-09T21:39:24.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0b7980 0x7f28cc14c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28cc0d0780 0x7f28cc151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0ca9e0 con 0x7f28cc0cf290 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1f86e0 con 0x7f28cc0b7980 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0ca320 con 0x7f28cc0d0780 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41268/0 (socket says 172.21.15.37:41268) 2023-07-09T21:39:24.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 -- 172.21.15.37:0/2921016185 learned_addr learned my addr 172.21.15.37:0/2921016185 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28cbfff640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28cc0d0780 0x7f28cc151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28cb7fe640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0b7980 0x7f28cc14c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 -- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28cc0d0780 msgr2=0x7f28cc151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28cc0d0780 0x7f28cc151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 -- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0b7980 msgr2=0x7f28cc14c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0b7980 0x7f28cc14c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 -- 172.21.15.37:0/2921016185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0009420 con 0x7f28cc0cf290 2023-07-09T21:39:24.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28caffd640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f28c00ae040 tx=0x7f28c0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:24.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00b4840 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c00b49a0 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c00b4d50 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc0ca600 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc1f82d0 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.830+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc0cab20 con 0x7f28cc0cf290 2023-07-09T21:39:24.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.834+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f28c00b2040 con 0x7f28cc0cf290 2023-07-09T21:39:24.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.834+0000 7f28b3fff640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 0x7f28b80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:24.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.834+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f28c011e5d0 con 0x7f28cc0cf290 2023-07-09T21:39:24.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.834+0000 7f28cb7fe640 1 -- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 msgr2=0x7f28b80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:24.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.834+0000 7f28cb7fe640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 0x7f28b80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:24.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.838+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28c00eb600 con 0x7f28cc0cf290 2023-07-09T21:39:24.857 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:24.854+0000 7ffa6f336180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:24.874 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.878+0000 7f5851a2f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:24.930 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:24.934+0000 7f5851a2f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28cc0cff80 con 0x7f28cc0cf290 2023-07-09T21:39:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28b3fff640 1 -- 172.21.15.37:0/2921016185 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v100) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28c00eec20 con 0x7f28cc0cf290 2023-07-09T21:39:24.997 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:39:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 msgr2=0x7f28b80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 0x7f28b80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 msgr2=0x7f28cc14cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f28c00ae040 tx=0x7f28c0019220 comp rx=0 tx=0).stop 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 shutdown_connections 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28cc0d0780 0x7f28cc151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28cc0cf290 0x7f28cc14cb10 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f28b8066430 0x7f28b80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 --2- 172.21.15.37:0/2921016185 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28cc0b7980 0x7f28cc14c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.994+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 >> 172.21.15.37:0/2921016185 conn(0x7f28cc073090 msgr2=0x7f28cc15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.998+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 shutdown_connections 2023-07-09T21:39:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:24.998+0000 7f28d1f82640 1 -- 172.21.15.37:0/2921016185 wait complete. 2023-07-09T21:39:25.008 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.006+0000 7ffa6f336180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:25.019 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:39:25.069 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.066+0000 7ffa6f336180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:25.170 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:25.170 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:25.170 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:25.178 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:25.182+0000 7f5851a2f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 Processor -- start 2023-07-09T21:39:25.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 -- start start 2023-07-09T21:39:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 0x7f6d4c0d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4c0cef80 con 0x7f6d4c0b47a0 2023-07-09T21:39:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d4c0cf260 con 0x7f6d4c0b4310 2023-07-09T21:39:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.206+0000 7f6d51782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0cf540 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d43fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6d4c0b47a0 0x7f6d4c0b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54532/0 (socket says 172.21.15.37:54532) 2023-07-09T21:39:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d43fff640 1 -- 172.21.15.37:0/2742768532 learned_addr learned my addr 172.21.15.37:0/2742768532 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4affd640 1 --2- 172.21.15.37:0/2742768532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4b7fe640 1 --2- 172.21.15.37:0/2742768532 >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 0x7f6d4c0d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4a7fc640 1 -- 172.21.15.37:0/2742768532 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867538803 0 0) 0x7f6d4c0cef80 con 0x7f6d4c0b47a0 2023-07-09T21:39:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4a7fc640 1 -- 172.21.15.37:0/2742768532 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d38003530 con 0x7f6d4c0b47a0 2023-07-09T21:39:25.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4affd640 1 -- 172.21.15.37:0/2742768532 >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 msgr2=0x7f6d4c0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4affd640 1 --2- 172.21.15.37:0/2742768532 >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 0x7f6d4c0d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4affd640 1 -- 172.21.15.37:0/2742768532 >> v1:172.21.15.37:6789/0 conn(0x7f6d4c0b47a0 legacy=0x7f6d4c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4affd640 1 -- 172.21.15.37:0/2742768532 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c0cfdf0 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.210+0000 7f6d4b7fe640 1 --2- 172.21.15.37:0/2742768532 >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 0x7f6d4c0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:25.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d4affd640 1 --2- 172.21.15.37:0/2742768532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c0cc7d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24577300c1212838 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d4a7fc640 1 -- 172.21.15.37:0/2742768532 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0ab600 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d4a7fc640 1 -- 172.21.15.37:0/2742768532 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0a7050 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d4a7fc640 1 -- 172.21.15.37:0/2742768532 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0ab980 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 -- 172.21.15.37:0/2742768532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 msgr2=0x7f6d4c0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 --2- 172.21.15.37:0/2742768532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c0cc7d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0097c0 tx=0x7f6d3c01c480 comp rx=0 tx=0).stop 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 -- 172.21.15.37:0/2742768532 shutdown_connections 2023-07-09T21:39:25.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 --2- 172.21.15.37:0/2742768532 >> v2:172.21.15.37:3300/0 conn(0x7f6d4c0b4310 0x7f6d4c0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 --2- 172.21.15.37:0/2742768532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c0cc7d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 -- 172.21.15.37:0/2742768532 >> 172.21.15.37:0/2742768532 conn(0x7f6d4c073050 msgr2=0x7f6d4c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 -- 172.21.15.37:0/2742768532 shutdown_connections 2023-07-09T21:39:25.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.214+0000 7f6d51782640 1 -- 172.21.15.37:0/2742768532 wait complete. 2023-07-09T21:39:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 Processor -- start 2023-07-09T21:39:25.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 -- start start 2023-07-09T21:39:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d4c0b47a0 0x7f6d4c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c0b1d10 con 0x7f6d4c0b47a0 2023-07-09T21:39:25.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c1539d0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d51782640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c15d300 con 0x7f6d4c0b7a60 2023-07-09T21:39:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35386/0 (socket says 172.21.15.37:35386) 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d43fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d4c0b47a0 0x7f6d4c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:41006/0 (socket says 172.21.15.37:41006) 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 -- 172.21.15.37:0/121051819 learned_addr learned my addr 172.21.15.37:0/121051819 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 msgr2=0x7f6d4c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d4c0b47a0 msgr2=0x7f6d4c152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d4c0b47a0 0x7f6d4c152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4affd640 1 -- 172.21.15.37:0/121051819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44009a70 con 0x7f6d4c0b4310 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.218+0000 7f6d4b7fe640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d4affd640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c01a0b0 tx=0x7f6d3c01acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c006e20 con 0x7f6d4c0b4310 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c0b7450 con 0x7f6d4c0b4310 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c0b77e0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d3c009420 con 0x7f6d4c0b4310 2023-07-09T21:39:25.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.222+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c15d8c0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f6d3c0b7940 con 0x7f6d4c0b4310 2023-07-09T21:39:25.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d437fe640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 0x7f6d2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6d3c11e6d0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d43fff640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 msgr2=0x7f6d2c068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:25.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d43fff640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 0x7f6d2c068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:25.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.226+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4c0cdaa0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.234+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6d3c0eb740 con 0x7f6d4c0b4310 2023-07-09T21:39:25.314 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:25.318+0000 7f5851a2f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:25.324 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:25.324 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:25.324 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:25.333 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.330+0000 7ffa6f336180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:25.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.430+0000 7f6d43fff640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 msgr2=0x7f6d2c068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:25.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.430+0000 7f6d43fff640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 0x7f6d2c068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:39:25.438 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:25.442+0000 7f5851a2f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:25.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.442+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d4c0b1ae0 con 0x7f6d4c0b4310 2023-07-09T21:39:25.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.442+0000 7f6d437fe640 1 -- 172.21.15.37:0/121051819 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v100) v1 ==== 80+0+476 (secure 0 0 0) 0x7f6d3c0eed60 con 0x7f6d4c0b4310 2023-07-09T21:39:25.446 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4250279670 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2514649320 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/2063381883 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/2063381883 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2044940131 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3365981794 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/68715102 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.448 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1987789388 2023-07-10T21:39:20.834480+0000 2023-07-09T21:39:25.448 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 msgr2=0x7f6d2c068930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 0x7f6d2c068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 msgr2=0x7f6d4c1551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c01a0b0 tx=0x7f6d3c01acc0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 shutdown_connections 2023-07-09T21:39:25.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6d4c0b7a60 0x7f6d4c153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d4c0b47a0 0x7f6d4c152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f6d2c066480 0x7f6d2c068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 --2- 172.21.15.37:0/121051819 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6d4c0b4310 0x7f6d4c1551a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 >> 172.21.15.37:0/121051819 conn(0x7f6d4c073050 msgr2=0x7f6d4c159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 shutdown_connections 2023-07-09T21:39:25.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.446+0000 7f6d51782640 1 -- 172.21.15.37:0/121051819 wait complete. 2023-07-09T21:39:25.468 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:39:25.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:25.469 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:25.477 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.474+0000 7ffa6f336180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:25.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[55679]: fuse finished with error 0 and tester_r 0 2023-07-09T21:39:25.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:39:25.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:25.503 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:39:25.510 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:25.514+0000 7f5851a2f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:25.608 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:39:25.608 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:25.613 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.610+0000 7ffa6f336180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:25.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:39:25.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:39:25.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:25.620 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:39:25.645 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:25.650+0000 7f5851a2f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:25.653 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:39:25.654 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:39:25.655 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:39:25.655 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:25.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:39:25.665 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:39:25.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:25.666 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:39:25.687 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.686+0000 7ffa6f336180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:39:25.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:39:25.705 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:39:25.706 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:25.715 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:39:25.716 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:39:25.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:25.717 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:39:25.767 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:39:25.768 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:39:25.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:25.828 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:25.826+0000 7ffa6f336180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.910+0000 7f0729a7b640 1 Processor -- start 2023-07-09T21:39:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.910+0000 7f0729a7b640 1 -- start start 2023-07-09T21:39:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0729a7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07240cef80 0x7f072406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0729a7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240b49f0 con 0x7f07240b4340 2023-07-09T21:39:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0729a7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07240cc8a0 con 0x7f07240b7ab0 2023-07-09T21:39:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0729a7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07240b7e80 con 0x7f07240cef80 2023-07-09T21:39:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f071bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07240b4340 0x7f07240d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54542/0 (socket says 172.21.15.37:54542) 2023-07-09T21:39:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f071bfff640 1 -- 172.21.15.37:0/586881862 learned_addr learned my addr 172.21.15.37:0/586881862 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0723fff640 1 --2- 172.21.15.37:0/586881862 >> v2:172.21.15.119:3300/0 conn(0x7f07240cef80 0x7f072406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0722ffd640 1 -- 172.21.15.37:0/586881862 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911186411 0 0) 0x7f07240b49f0 con 0x7f07240b4340 2023-07-09T21:39:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0722ffd640 1 -- 172.21.15.37:0/586881862 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0710003530 con 0x7f07240b4340 2023-07-09T21:39:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0723fff640 1 -- 172.21.15.37:0/586881862 >> v1:172.21.15.119:6789/0 conn(0x7f07240b7ab0 legacy=0x7f07240b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0723fff640 1 -- 172.21.15.37:0/586881862 >> v1:172.21.15.37:6789/0 conn(0x7f07240b4340 legacy=0x7f07240d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.914+0000 7f0723fff640 1 -- 172.21.15.37:0/586881862 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07240ccb80 con 0x7f07240cef80 2023-07-09T21:39:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0723fff640 1 --2- 172.21.15.37:0/586881862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240cef80 0x7f072406aa50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f071c009d90 tx=0x7f071c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5aacc2811d79e18b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0722ffd640 1 -- 172.21.15.37:0/586881862 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0a59e0 con 0x7f07240cef80 2023-07-09T21:39:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0722ffd640 1 -- 172.21.15.37:0/586881862 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0a5b40 con 0x7f07240cef80 2023-07-09T21:39:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0722ffd640 1 -- 172.21.15.37:0/586881862 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ad440 con 0x7f07240cef80 2023-07-09T21:39:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- 172.21.15.37:0/586881862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240cef80 msgr2=0x7f072406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 --2- 172.21.15.37:0/586881862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240cef80 0x7f072406aa50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f071c009d90 tx=0x7f071c01c920 comp rx=0 tx=0).stop 2023-07-09T21:39:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- 172.21.15.37:0/586881862 shutdown_connections 2023-07-09T21:39:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 --2- 172.21.15.37:0/586881862 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240cef80 0x7f072406aa50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- 172.21.15.37:0/586881862 >> 172.21.15.37:0/586881862 conn(0x7f0724073090 msgr2=0x7f0724069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- 172.21.15.37:0/586881862 shutdown_connections 2023-07-09T21:39:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- 172.21.15.37:0/586881862 wait complete. 2023-07-09T21:39:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 Processor -- start 2023-07-09T21:39:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.918+0000 7f0729a7b640 1 -- start start 2023-07-09T21:39:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240b7ab0 0x7f07240c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 0x7f072414c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c64a0 con 0x7f07240b4340 2023-07-09T21:39:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07240c6220 con 0x7f07240b7ab0 2023-07-09T21:39:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07240ca550 con 0x7f07240cef80 2023-07-09T21:39:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41298/0 (socket says 172.21.15.37:41298) 2023-07-09T21:39:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 -- 172.21.15.37:0/4065828860 learned_addr learned my addr 172.21.15.37:0/4065828860 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0723fff640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 0x7f072414c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f071bfff640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240b7ab0 0x7f07240c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 msgr2=0x7f072414c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 0x7f072414c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240b7ab0 msgr2=0x7f07240c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240b7ab0 0x7f07240c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 -- 172.21.15.37:0/4065828860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c009a70 con 0x7f07240b4340 2023-07-09T21:39:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0723fff640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 0x7f072414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f07237fe640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f071400c500 tx=0x7f071400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714005220 con 0x7f07240b4340 2023-07-09T21:39:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0714005380 con 0x7f07240b4340 2023-07-09T21:39:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07240ca830 con 0x7f07240b4340 2023-07-09T21:39:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714007270 con 0x7f07240b4340 2023-07-09T21:39:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07240cadf0 con 0x7f07240b4340 2023-07-09T21:39:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07240cb010 con 0x7f07240b4340 2023-07-09T21:39:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.922+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f07140073d0 con 0x7f07240b4340 2023-07-09T21:39:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.926+0000 7f0720ff9640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 0x7f07040688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:25.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.926+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f0714083a00 con 0x7f07240b4340 2023-07-09T21:39:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.926+0000 7f071bfff640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 msgr2=0x7f07040688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.926+0000 7f071bfff640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 0x7f07040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:25.934+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0714050b40 con 0x7f07240b4340 2023-07-09T21:39:26.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.126+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f072404d7d0 con 0x7f07240b4340 2023-07-09T21:39:26.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.126+0000 7f0720ff9640 1 -- 172.21.15.37:0/4065828860 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f0714054160 con 0x7f07240b4340 2023-07-09T21:39:26.131 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:26.131 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f071bfff640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 msgr2=0x7f07040688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f071bfff640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 0x7f07040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:39:26.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 msgr2=0x7f07040688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 0x7f07040688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 msgr2=0x7f07240c86a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f071400c500 tx=0x7f071400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 shutdown_connections 2023-07-09T21:39:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07240cef80 0x7f072414c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f0704066430 0x7f07040688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f07240b7ab0 0x7f07240c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 --2- 172.21.15.37:0/4065828860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07240b4340 0x7f07240c86a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 >> 172.21.15.37:0/4065828860 conn(0x7f0724073090 msgr2=0x7f07240d17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 shutdown_connections 2023-07-09T21:39:26.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.130+0000 7f0729a7b640 1 -- 172.21.15.37:0/4065828860 wait complete. 2023-07-09T21:39:26.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:26.186 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.190+0000 7f5851a2f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:39:26.273 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.278+0000 7f5851a2f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:39:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.298+0000 7f091debd640 1 Processor -- start 2023-07-09T21:39:26.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.298+0000 7f091debd640 1 -- start start 2023-07-09T21:39:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091debd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 0x7f0918069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091debd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180ccd40 con 0x7f09180b7810 2023-07-09T21:39:26.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091debd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09180ce680 con 0x7f091806a280 2023-07-09T21:39:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091debd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09180cc5a0 con 0x7f09180ce1a0 2023-07-09T21:39:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091cebb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f09180b7810 0x7f091815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54550/0 (socket says 172.21.15.37:54550) 2023-07-09T21:39:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f091cebb640 1 -- 172.21.15.37:0/2691565977 learned_addr learned my addr 172.21.15.37:0/2691565977 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:26.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f0917fff640 1 --2- 172.21.15.37:0/2691565977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 0x7f0918069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656130319 0 0) 0x7f09180ccd40 con 0x7f09180b7810 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0908003530 con 0x7f09180b7810 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846089322 0 0) 0x7f09180ce680 con 0x7f091806a280 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f0917fff640 1 -- 172.21.15.37:0/2691565977 >> v1:172.21.15.119:6789/0 conn(0x7f091806a280 legacy=0x7f09180cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f0917fff640 1 -- 172.21.15.37:0/2691565977 >> v1:172.21.15.37:6789/0 conn(0x7f09180b7810 legacy=0x7f091815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.302+0000 7f0917fff640 1 -- 172.21.15.37:0/2691565977 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09180cc780 con 0x7f09180ce1a0 2023-07-09T21:39:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f0917fff640 1 --2- 172.21.15.37:0/2691565977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 0x7f0918069d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11003f680a84df27 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040ac630 con 0x7f09180ce1a0 2023-07-09T21:39:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09040ac790 con 0x7f09180ce1a0 2023-07-09T21:39:26.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f09177fe640 1 -- 172.21.15.37:0/2691565977 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09040acb20 con 0x7f09180ce1a0 2023-07-09T21:39:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 -- 172.21.15.37:0/2691565977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 msgr2=0x7f0918069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 --2- 172.21.15.37:0/2691565977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 0x7f0918069d40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f09040097f0 tx=0x7f090401cf20 comp rx=0 tx=0).stop 2023-07-09T21:39:26.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 -- 172.21.15.37:0/2691565977 shutdown_connections 2023-07-09T21:39:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 --2- 172.21.15.37:0/2691565977 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09180ce1a0 0x7f0918069d40 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 -- 172.21.15.37:0/2691565977 >> 172.21.15.37:0/2691565977 conn(0x7f09180cea60 msgr2=0x7f09180cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 -- 172.21.15.37:0/2691565977 shutdown_connections 2023-07-09T21:39:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 -- 172.21.15.37:0/2691565977 wait complete. 2023-07-09T21:39:26.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.306+0000 7f091debd640 1 Processor -- start 2023-07-09T21:39:26.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- start start 2023-07-09T21:39:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09180b7810 0x7f0918153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181675b0 con 0x7f09180ce1a0 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0918158b60 con 0x7f09180b7810 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0918158e40 con 0x7f091806a280 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091d6bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f0917fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09180b7810 0x7f0918153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091d6bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41310/0 (socket says 172.21.15.37:41310) 2023-07-09T21:39:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:41040/0 (socket says 172.21.15.37:41040) 2023-07-09T21:39:26.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091d6bc640 1 -- 172.21.15.37:0/4280919375 learned_addr learned my addr 172.21.15.37:0/4280919375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 -- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09180b7810 msgr2=0x7f0918153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09180b7810 0x7f0918153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 -- 172.21.15.37:0/4280919375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 msgr2=0x7f09181596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 -- 172.21.15.37:0/4280919375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0904009420 con 0x7f091806a280 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091d6bc640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091cebb640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f090c007fd0 tx=0x7f090c001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c005cf0 con 0x7f091806a280 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c005e50 con 0x7f091806a280 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c007310 con 0x7f091806a280 2023-07-09T21:39:26.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0918159120 con 0x7f091806a280 2023-07-09T21:39:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0918153770 con 0x7f091806a280 2023-07-09T21:39:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.310+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f091815bad0 con 0x7f091806a280 2023-07-09T21:39:26.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.314+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f090c007470 con 0x7f091806a280 2023-07-09T21:39:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.314+0000 7f09157fa640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 0x7f08fc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.314+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f090c083590 con 0x7f091806a280 2023-07-09T21:39:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.314+0000 7f0917fff640 1 -- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 msgr2=0x7f08fc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:26.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.314+0000 7f0917fff640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 0x7f08fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:26.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.318+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f090c050780 con 0x7f091806a280 2023-07-09T21:39:26.411 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:26.410+0000 7ffa6f336180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:39:26.421 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.426+0000 7f5851a2f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:39:26.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.474+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0918158f80 con 0x7f091806a280 2023-07-09T21:39:26.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f09157fa640 1 -- 172.21.15.37:0/4280919375 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+18850 (secure 0 0 0) 0x7f0918158f80 con 0x7f091806a280 2023-07-09T21:39:26.480 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:26.480 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":100,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:20.834525+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/4250279670":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2514649320":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6833/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2044940131":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/3365981794":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/68715102":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1987789388":"2023-07-10T21:39:20.834480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:26.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 msgr2=0x7f08fc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:26.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 0x7f08fc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 msgr2=0x7f0918166f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f090c007fd0 tx=0x7f090c001e80 comp rx=0 tx=0).stop 2023-07-09T21:39:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 shutdown_connections 2023-07-09T21:39:26.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09180ce1a0 0x7f09181596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7f08fc066430 0x7f08fc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09180b7810 0x7f0918153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 --2- 172.21.15.37:0/4280919375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f091806a280 0x7f0918166f40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 >> 172.21.15.37:0/4280919375 conn(0x7f09180cea60 msgr2=0x7f09180cff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 shutdown_connections 2023-07-09T21:39:26.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.478+0000 7f091debd640 1 -- 172.21.15.37:0/4280919375 wait complete. 2023-07-09T21:39:26.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:39:00.709802+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:39:01.666752+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:39:26.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:39:26.504 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:26.498+0000 7ffa6f336180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:39:26.505 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.510+0000 7f5851a2f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:39:26.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.646+0000 7efe21219640 1 Processor -- start 2023-07-09T21:39:26.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe21219640 1 -- start start 2023-07-09T21:39:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe21219640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe1c0cf290 0x7efe1c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe21219640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c15bf80 con 0x7efe1c0d0780 2023-07-09T21:39:26.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe21219640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe1c160570 con 0x7efe1c0b7980 2023-07-09T21:39:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe21219640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0cd070 con 0x7efe1c0cf290 2023-07-09T21:39:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe13fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe1c0cf290 0x7efe1c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe1b59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efe1c0d0780 0x7efe1c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54552/0 (socket says 172.21.15.37:54552) 2023-07-09T21:39:26.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe13fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe1c0cf290 0x7efe1c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41318/0 (socket says 172.21.15.37:41318) 2023-07-09T21:39:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe1b59e640 1 -- 172.21.15.37:0/1698899078 learned_addr learned my addr 172.21.15.37:0/1698899078 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe13fff640 1 -- 172.21.15.37:0/1698899078 >> v1:172.21.15.119:6789/0 conn(0x7efe1c0b7980 legacy=0x7efe1c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe1a59c640 1 -- 172.21.15.37:0/1698899078 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353623583 0 0) 0x7efe0c001120 con 0x7efe1c0b7980 2023-07-09T21:39:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe13fff640 1 -- 172.21.15.37:0/1698899078 >> v1:172.21.15.37:6789/0 conn(0x7efe1c0d0780 legacy=0x7efe1c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.650+0000 7efe13fff640 1 -- 172.21.15.37:0/1698899078 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0d02f0 con 0x7efe1c0cf290 2023-07-09T21:39:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe13fff640 1 --2- 172.21.15.37:0/1698899078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c160030 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7efe040097c0 tx=0x7efe0401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b6943ce8a5d073 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe1a59c640 1 -- 172.21.15.37:0/1698899078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040ab600 con 0x7efe1c0cf290 2023-07-09T21:39:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe1a59c640 1 -- 172.21.15.37:0/1698899078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe040a7050 con 0x7efe1c0cf290 2023-07-09T21:39:26.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe1a59c640 1 -- 172.21.15.37:0/1698899078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040ab980 con 0x7efe1c0cf290 2023-07-09T21:39:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe21219640 1 -- 172.21.15.37:0/1698899078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 msgr2=0x7efe1c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.654+0000 7efe21219640 1 --2- 172.21.15.37:0/1698899078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c160030 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7efe040097c0 tx=0x7efe0401c310 comp rx=0 tx=0).stop 2023-07-09T21:39:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 -- 172.21.15.37:0/1698899078 shutdown_connections 2023-07-09T21:39:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 --2- 172.21.15.37:0/1698899078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c160030 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 -- 172.21.15.37:0/1698899078 >> 172.21.15.37:0/1698899078 conn(0x7efe1c073090 msgr2=0x7efe1c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 -- 172.21.15.37:0/1698899078 shutdown_connections 2023-07-09T21:39:26.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 -- 172.21.15.37:0/1698899078 wait complete. 2023-07-09T21:39:26.661 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:26.658+0000 7ffa6f336180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:39:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 Processor -- start 2023-07-09T21:39:26.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.658+0000 7efe21219640 1 -- start start 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe1c0b7980 0x7efe1c1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 0x7efe1c1e5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c1e79b0 con 0x7efe1c0cf290 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0ca810 con 0x7efe1c0d0780 2023-07-09T21:39:26.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0caaf0 con 0x7efe1c0b7980 2023-07-09T21:39:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41324/0 (socket says 172.21.15.37:41324) 2023-07-09T21:39:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 -- 172.21.15.37:0/829284522 learned_addr learned my addr 172.21.15.37:0/829284522 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:26.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe1ad9d640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe1c0b7980 0x7efe1c1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe1b59e640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 0x7efe1c1e5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 -- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe1c0b7980 msgr2=0x7efe1c1501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe1c0b7980 0x7efe1c1501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 -- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 msgr2=0x7efe1c1e5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 0x7efe1c1e5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 -- 172.21.15.37:0/829284522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe04009420 con 0x7efe1c0cf290 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe1b59e640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 0x7efe1c1e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:26.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe13fff640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7efe04018f20 tx=0x7efe0401ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040b7920 con 0x7efe1c0cf290 2023-07-09T21:39:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe040b7a80 con 0x7efe1c0cf290 2023-07-09T21:39:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe040b7e10 con 0x7efe1c0cf290 2023-07-09T21:39:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c0cadd0 con 0x7efe1c0cf290 2023-07-09T21:39:26.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c0cb390 con 0x7efe1c0cf290 2023-07-09T21:39:26.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.662+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c04d7d0 con 0x7efe1c0cf290 2023-07-09T21:39:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.666+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 85817+0+0 (secure 0 0 0) 0x7efe040c2460 con 0x7efe1c0cf290 2023-07-09T21:39:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.666+0000 7efe137fe640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 0x7efdfc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:26.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.666+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6406+0+0 (secure 0 0 0) 0x7efe0411eeb0 con 0x7efe1c0cf290 2023-07-09T21:39:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.666+0000 7efe1ad9d640 1 -- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 msgr2=0x7efdfc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/1820997415 2023-07-09T21:39:26.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.666+0000 7efe1ad9d640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 0x7efdfc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:26.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.670+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe040ebe50 con 0x7efe1c0cf290 2023-07-09T21:39:26.753 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:26.750+0000 7ffa6f336180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:39:26.774 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.778+0000 7f5851a2f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:39:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe1c0b1600 con 0x7efe1c0cf290 2023-07-09T21:39:26.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe137fe640 1 -- 172.21.15.37:0/829284522 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v100) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe040ef470 con 0x7efe1c0cf290 2023-07-09T21:39:26.829 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:39:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 msgr2=0x7efdfc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 0x7efdfc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 msgr2=0x7efe1c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7efe04018f20 tx=0x7efe0401ab50 comp rx=0 tx=0).stop 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 shutdown_connections 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:6832/1820997415,v1:172.21.15.119:6833/1820997415] conn(0x7efdfc066430 0x7efdfc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efe1c0d0780 0x7efe1c1e5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe1c0cf290 0x7efe1c0cb8b0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 --2- 172.21.15.37:0/829284522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efe1c0b7980 0x7efe1c1501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 >> 172.21.15.37:0/829284522 conn(0x7efe1c073090 msgr2=0x7efe1c0ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 shutdown_connections 2023-07-09T21:39:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:26.826+0000 7efe21219640 1 -- 172.21.15.37:0/829284522 wait complete. 2023-07-09T21:39:26.834 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.838+0000 7f5851a2f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:39:26.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:39:26.915 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.918+0000 7f57dc00a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.916 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.918+0000 7f57dc00a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.916 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.918+0000 7f57dc00a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.916 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.918+0000 7f57dc00a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.917 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.918+0000 7f57dc00a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.917 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.922+0000 7f57d8803640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.918 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.922+0000 7f57d8803640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.918 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.922+0000 7f57d8803640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.918 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.922+0000 7f57d8803640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:26.919 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:26.922+0000 7f57d8803640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:39:27.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.002+0000 7f64dc0ec640 1 Processor -- start 2023-07-09T21:39:27.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.002+0000 7f64dc0ec640 1 -- start start 2023-07-09T21:39:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64dc0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 0x7f64d4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64dc0ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64d40d0780 0x7f64d40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64dc0ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64d415bf80 con 0x7f64d40ceb80 2023-07-09T21:39:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64dc0ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64d40cd070 con 0x7f64d40d0780 2023-07-09T21:39:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64dc0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d40cfd70 con 0x7f64d40b7980 2023-07-09T21:39:27.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64d40d0780 0x7f64d40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64d40d0780 0x7f64d40d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41334/0 (socket says 172.21.15.37:41334) 2023-07-09T21:39:27.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 -- 172.21.15.37:0/3826945133 learned_addr learned my addr 172.21.15.37:0/3826945133 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64d9e88640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 0x7f64d4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64d8e86640 1 -- 172.21.15.37:0/3826945133 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60839678 0 0) 0x7f64c4001120 con 0x7f64d40ceb80 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 -- 172.21.15.37:0/3826945133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 msgr2=0x7f64d4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 0x7f64d4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 -- 172.21.15.37:0/3826945133 >> v1:172.21.15.119:6789/0 conn(0x7f64d40ceb80 legacy=0x7f64d40cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64da689640 1 -- 172.21.15.37:0/3826945133 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4160570 con 0x7f64d40d0780 2023-07-09T21:39:27.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.006+0000 7f64d9e88640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 0x7f64d4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64da689640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40d0780 0x7f64d40d0c00 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821cd6fa5e5bab9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64d8e86640 1 -- 172.21.15.37:0/3826945133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0a56e0 con 0x7f64d40d0780 2023-07-09T21:39:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64d8e86640 1 -- 172.21.15.37:0/3826945133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc0a5840 con 0x7f64d40d0780 2023-07-09T21:39:27.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64d8e86640 1 -- 172.21.15.37:0/3826945133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc0a5bd0 con 0x7f64d40d0780 2023-07-09T21:39:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- 172.21.15.37:0/3826945133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40d0780 msgr2=0x7f64d40d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40d0780 0x7f64d40d0c00 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009e50 tx=0x7f64cc01ca10 comp rx=0 tx=0).stop 2023-07-09T21:39:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- 172.21.15.37:0/3826945133 shutdown_connections 2023-07-09T21:39:27.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40d0780 0x7f64d40d0c00 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/3826945133 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40b7980 0x7f64d4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- 172.21.15.37:0/3826945133 >> 172.21.15.37:0/3826945133 conn(0x7f64d4073090 msgr2=0x7f64d4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- 172.21.15.37:0/3826945133 shutdown_connections 2023-07-09T21:39:27.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- 172.21.15.37:0/3826945133 wait complete. 2023-07-09T21:39:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 Processor -- start 2023-07-09T21:39:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.010+0000 7f64dc0ec640 1 -- start start 2023-07-09T21:39:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40ceb80 0x7f64d40b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 0x7f64d4151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4157180 con 0x7f64d40b7980 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4157460 con 0x7f64d40d0780 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64d4159ab0 con 0x7f64d40ceb80 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41348/0 (socket says 172.21.15.37:41348) 2023-07-09T21:39:27.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 -- 172.21.15.37:0/2096724264 learned_addr learned my addr 172.21.15.37:0/2096724264 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64da689640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 0x7f64d4151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9687640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40ceb80 0x7f64d40b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 -- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40ceb80 msgr2=0x7f64d40b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40ceb80 0x7f64d40b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 -- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 msgr2=0x7f64d4151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 0x7f64d4151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 -- 172.21.15.37:0/2096724264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d0009420 con 0x7f64d40b7980 2023-07-09T21:39:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64da689640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 0x7f64d4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64d9e88640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f64d000e980 tx=0x7f64d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d000ca00 con 0x7f64d40b7980 2023-07-09T21:39:27.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d000cb60 con 0x7f64d40b7980 2023-07-09T21:39:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0013470 con 0x7f64d40b7980 2023-07-09T21:39:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64cc009b30 con 0x7f64d40b7980 2023-07-09T21:39:27.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d415a070 con 0x7f64d40b7980 2023-07-09T21:39:27.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.014+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d404d7d0 con 0x7f64d40b7980 2023-07-09T21:39:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.018+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f64d00135d0 con 0x7f64d40b7980 2023-07-09T21:39:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.018+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f64d0083c60 con 0x7f64d40b7980 2023-07-09T21:39:27.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.022+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f64d0051300 con 0x7f64d40b7980 2023-07-09T21:39:27.057 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:27.054+0000 7ffa6f336180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:39:27.120 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:27.118+0000 7ffa6f336180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:39:27.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f64d40b1600 con 0x7f64d40b7980 2023-07-09T21:39:27.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64ca7fc640 1 -- 172.21.15.37:0/2096724264 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7f64d0083020 con 0x7f64d40b7980 2023-07-09T21:39:27.184 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:39:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 msgr2=0x7f64d41f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f64d000e980 tx=0x7f64d000ee40 comp rx=0 tx=0).stop 2023-07-09T21:39:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 shutdown_connections 2023-07-09T21:39:27.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f64d40d0780 0x7f64d4151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f64d40ceb80 0x7f64d40b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 --2- 172.21.15.37:0/2096724264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64d40b7980 0x7f64d41f4850 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 >> 172.21.15.37:0/2096724264 conn(0x7f64d4073090 msgr2=0x7f64d40b22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 shutdown_connections 2023-07-09T21:39:27.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.182+0000 7f64dc0ec640 1 -- 172.21.15.37:0/2096724264 wait complete. 2023-07-09T21:39:27.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:39:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.350+0000 7fc0e34d8640 1 Processor -- start 2023-07-09T21:39:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.350+0000 7fc0e34d8640 1 -- start start 2023-07-09T21:39:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.350+0000 7fc0e34d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0cf290 0x7fc0dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.350+0000 7fc0e34d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0dc0d0780 0x7fc0dc0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.350+0000 7fc0e34d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0dc15bf80 con 0x7fc0dc0b7980 2023-07-09T21:39:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e34d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0dc0cd070 con 0x7fc0dc0d0780 2023-07-09T21:39:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e34d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0cfd70 con 0x7fc0dc0cf290 2023-07-09T21:39:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1274640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc0dc0b7980 0x7fc0dc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46898/0 (socket says 172.21.15.37:46898) 2023-07-09T21:39:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1274640 1 -- 172.21.15.37:0/4037351343 learned_addr learned my addr 172.21.15.37:0/4037351343 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 --2- 172.21.15.37:0/4037351343 >> v2:172.21.15.37:3300/0 conn(0x7fc0dc0d0780 0x7fc0dc0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e0a73640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0cf290 0x7fc0dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 -- 172.21.15.37:0/4037351343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0cf290 msgr2=0x7fc0dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0cf290 0x7fc0dc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 -- 172.21.15.37:0/4037351343 >> v1:172.21.15.37:6789/0 conn(0x7fc0dc0b7980 legacy=0x7fc0dc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0d3fff640 1 -- 172.21.15.37:0/4037351343 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402301386 0 0) 0x7fc0d8001120 con 0x7fc0dc0b7980 2023-07-09T21:39:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 -- 172.21.15.37:0/4037351343 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0dc160570 con 0x7fc0dc0d0780 2023-07-09T21:39:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0e1a75640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0d0780 0x7fc0dc0d0c00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009d90 tx=0x7fc0d401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d0f8c371b49f27 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0d3fff640 1 -- 172.21.15.37:0/4037351343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40a5810 con 0x7fc0dc0d0780 2023-07-09T21:39:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0d3fff640 1 -- 172.21.15.37:0/4037351343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d40a5970 con 0x7fc0dc0d0780 2023-07-09T21:39:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.354+0000 7fc0d3fff640 1 -- 172.21.15.37:0/4037351343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40a5d00 con 0x7fc0dc0d0780 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- 172.21.15.37:0/4037351343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0d0780 msgr2=0x7fc0dc0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0d0780 0x7fc0dc0d0c00 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fc0d4009d90 tx=0x7fc0d401c950 comp rx=0 tx=0).stop 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- 172.21.15.37:0/4037351343 shutdown_connections 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0d0780 0x7fc0dc0d0c00 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/4037351343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0cf290 0x7fc0dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- 172.21.15.37:0/4037351343 >> 172.21.15.37:0/4037351343 conn(0x7fc0dc073090 msgr2=0x7fc0dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- 172.21.15.37:0/4037351343 shutdown_connections 2023-07-09T21:39:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- 172.21.15.37:0/4037351343 wait complete. 2023-07-09T21:39:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 Processor -- start 2023-07-09T21:39:27.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- start start 2023-07-09T21:39:27.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0dc0cf290 0x7fc0dc156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 0x7fc0dc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b35f0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc156ba0 con 0x7fc0dc0cf290 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e34d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0dc0b38a0 con 0x7fc0dc0d0780 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e1274640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e1274640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47086/0 (socket says 172.21.15.37:47086) 2023-07-09T21:39:27.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.358+0000 7fc0e1274640 1 -- 172.21.15.37:0/17148260 learned_addr learned my addr 172.21.15.37:0/17148260 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1a75640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 0x7fc0dc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e0a73640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0dc0cf290 0x7fc0dc156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 -- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 msgr2=0x7fc0dc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 0x7fc0dc1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 -- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0dc0cf290 msgr2=0x7fc0dc156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0dc0cf290 0x7fc0dc156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 -- 172.21.15.37:0/17148260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d4009a70 con 0x7fc0dc0b7980 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1a75640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 0x7fc0dc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e1274640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c780 tx=0x7fc0d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80072d0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d8007450 con 0x7fc0dc0b7980 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d80047f0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0dc0b3af0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0dc0b40b0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0dc04d7d0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fc0d8004950 con 0x7fc0dc0b7980 2023-07-09T21:39:27.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.362+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fc0d8082cc0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.366+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc0d8089080 con 0x7fc0dc0b7980 2023-07-09T21:39:27.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.522+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc0dc15bf60 con 0x7fc0dc0b7980 2023-07-09T21:39:27.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.522+0000 7fc0d1ffb640 1 -- 172.21.15.37:0/17148260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0d80501c0 con 0x7fc0dc0b7980 2023-07-09T21:39:27.526 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:39:27.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 msgr2=0x7fc0dc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fc0d800c780 tx=0x7fc0d800cc40 comp rx=0 tx=0).stop 2023-07-09T21:39:27.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 shutdown_connections 2023-07-09T21:39:27.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0dc0d0780 0x7fc0dc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0dc0cf290 0x7fc0dc156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 --2- 172.21.15.37:0/17148260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0dc0b7980 0x7fc0dc0b30b0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 >> 172.21.15.37:0/17148260 conn(0x7fc0dc073090 msgr2=0x7fc0dc15c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 shutdown_connections 2023-07-09T21:39:27.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.526+0000 7fc0e34d8640 1 -- 172.21.15.37:0/17148260 wait complete. 2023-07-09T21:39:27.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:39:27.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 Processor -- start 2023-07-09T21:39:27.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 -- start start 2023-07-09T21:39:27.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe488159990 0x7fe4880c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe4880cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4880c4c90 con 0x7fe4881595c0 2023-07-09T21:39:27.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4880ca730 con 0x7fe488159990 2023-07-09T21:39:27.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48f311640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4880ca170 con 0x7fe4880c99e0 2023-07-09T21:39:27.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48d0ad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4881595c0 0x7fe48815dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46900/0 (socket says 172.21.15.37:46900) 2023-07-09T21:39:27.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48d0ad640 1 -- 172.21.15.37:0/2907833175 learned_addr learned my addr 172.21.15.37:0/2907833175 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48c8ac640 1 --2- 172.21.15.37:0/2907833175 >> v2:172.21.15.119:3300/0 conn(0x7fe488159990 0x7fe4880c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48d8ae640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe4880cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe47ffff640 1 -- 172.21.15.37:0/2907833175 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096875861 0 0) 0x7fe484001120 con 0x7fe4881595c0 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe47ffff640 1 -- 172.21.15.37:0/2907833175 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe474003530 con 0x7fe4881595c0 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48c8ac640 1 -- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 msgr2=0x7fe4880cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:27.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48c8ac640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe4880cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48c8ac640 1 -- 172.21.15.37:0/2907833175 >> v1:172.21.15.37:6789/0 conn(0x7fe4881595c0 legacy=0x7fe48815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.690+0000 7fe48c8ac640 1 -- 172.21.15.37:0/2907833175 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880ca450 con 0x7fe488159990 2023-07-09T21:39:27.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48c8ac640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488159990 0x7fe4880c4750 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe4780097c0 tx=0x7fe47801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c617b59f657465 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe47ffff640 1 -- 172.21.15.37:0/2907833175 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780ad660 con 0x7fe488159990 2023-07-09T21:39:27.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe47ffff640 1 -- 172.21.15.37:0/2907833175 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4780ad7c0 con 0x7fe488159990 2023-07-09T21:39:27.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe47ffff640 1 -- 172.21.15.37:0/2907833175 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780adb50 con 0x7fe488159990 2023-07-09T21:39:27.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 -- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488159990 msgr2=0x7fe4880c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488159990 0x7fe4880c4750 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe4780097c0 tx=0x7fe47801c450 comp rx=0 tx=0).stop 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 -- 172.21.15.37:0/2907833175 shutdown_connections 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe4880cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 --2- 172.21.15.37:0/2907833175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe488159990 0x7fe4880c4750 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 -- 172.21.15.37:0/2907833175 >> 172.21.15.37:0/2907833175 conn(0x7fe4880cde40 msgr2=0x7fe4880ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 -- 172.21.15.37:0/2907833175 shutdown_connections 2023-07-09T21:39:27.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.694+0000 7fe48f311640 1 -- 172.21.15.37:0/2907833175 wait complete. 2023-07-09T21:39:27.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 Processor -- start 2023-07-09T21:39:27.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- start start 2023-07-09T21:39:27.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe488151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4881595c0 0x7fe48814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48806c140 con 0x7fe488159990 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48806b830 con 0x7fe4881595c0 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48814bf00 con 0x7fe4880c99e0 2023-07-09T21:39:27.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47090/0 (socket says 172.21.15.37:47090) 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 -- 172.21.15.37:0/565173698 learned_addr learned my addr 172.21.15.37:0/565173698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48c8ac640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4881595c0 0x7fe48814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d0ad640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe488151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 -- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 msgr2=0x7fe488151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe488151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 -- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4881595c0 msgr2=0x7fe48814b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4881595c0 0x7fe48814b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 -- 172.21.15.37:0/565173698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478009420 con 0x7fe488159990 2023-07-09T21:39:27.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d0ad640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe488151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:27.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48d8ae640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe480009d30 tx=0x7fe48000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480009ba0 con 0x7fe488159990 2023-07-09T21:39:27.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48000f040 con 0x7fe488159990 2023-07-09T21:39:27.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4800146c0 con 0x7fe488159990 2023-07-09T21:39:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe488151a30 con 0x7fe488159990 2023-07-09T21:39:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.698+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48806bd60 con 0x7fe488159990 2023-07-09T21:39:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.702+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe48806c280 con 0x7fe488159990 2023-07-09T21:39:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.702+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fe480014820 con 0x7fe488159990 2023-07-09T21:39:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.702+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fe480084910 con 0x7fe488159990 2023-07-09T21:39:27.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.706+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe48806c280 con 0x7fe488159990 2023-07-09T21:39:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.850+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe4800518c0 con 0x7fe488159990 2023-07-09T21:39:27.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.850+0000 7fe47dffb640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 0x7fe46c06e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:27.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.854+0000 7fe48d0ad640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 0x7fe46c06e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:27.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.854+0000 7fe48d0ad640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 0x7fe46c06e470 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe484001280 tx=0x7fe484009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:27.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.866+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe48806c280 con 0x7fe488159990 2023-07-09T21:39:27.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.866+0000 7fe47dffb640 1 -- 172.21.15.37:0/565173698 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe48806c280 con 0x7fe488159990 2023-07-09T21:39:27.869 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:39:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 msgr2=0x7fe46c06e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 0x7fe46c06e470 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe484001280 tx=0x7fe484009040 comp rx=0 tx=0).stop 2023-07-09T21:39:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 msgr2=0x7fe488157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe480009d30 tx=0x7fe48000c490 comp rx=0 tx=0).stop 2023-07-09T21:39:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 shutdown_connections 2023-07-09T21:39:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe46c06c090 0x7fe46c06e470 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe488159990 0x7fe488157710 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4881595c0 0x7fe48814b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 --2- 172.21.15.37:0/565173698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4880c99e0 0x7fe488151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 >> 172.21.15.37:0/565173698 conn(0x7fe4880cde40 msgr2=0x7fe48806f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 shutdown_connections 2023-07-09T21:39:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:27.870+0000 7fe48f311640 1 -- 172.21.15.37:0/565173698 wait complete. 2023-07-09T21:39:27.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 Processor -- start 2023-07-09T21:39:28.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 -- start start 2023-07-09T21:39:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f98ac15ba20 0x7f98ac0cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98ac06c330 0x7f98ac0ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac15bdf0 con 0x7f98ac0b1a30 2023-07-09T21:39:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac06b650 con 0x7f98ac06c330 2023-07-09T21:39:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98b0c56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0b2720 con 0x7f98ac15ba20 2023-07-09T21:39:28.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98ac06c330 0x7f98ac0ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98a3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f98ac06c330 0x7f98ac0ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47102/0 (socket says 172.21.15.37:47102) 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.030+0000 7f98a3fff640 1 -- 172.21.15.37:0/759846481 learned_addr learned my addr 172.21.15.37:0/759846481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98aa59c640 1 --2- 172.21.15.37:0/759846481 >> v2:172.21.15.119:3300/0 conn(0x7f98ac15ba20 0x7f98ac0cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a3fff640 1 -- 172.21.15.37:0/759846481 >> v2:172.21.15.119:3300/0 conn(0x7f98ac15ba20 msgr2=0x7f98ac0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a3fff640 1 --2- 172.21.15.37:0/759846481 >> v2:172.21.15.119:3300/0 conn(0x7f98ac15ba20 0x7f98ac0cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a3fff640 1 -- 172.21.15.37:0/759846481 >> v1:172.21.15.119:6789/0 conn(0x7f98ac0b1a30 legacy=0x7f98ac0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:28.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a3fff640 1 -- 172.21.15.37:0/759846481 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac06b850 con 0x7f98ac06c330 2023-07-09T21:39:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a3fff640 1 --2- 172.21.15.37:0/759846481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac06c330 0x7f98ac0ccf00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06d0b0 tx=0x7f989401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5e29d84ca4a11b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a9d9b640 1 -- 172.21.15.37:0/759846481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940ad640 con 0x7f98ac06c330 2023-07-09T21:39:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a9d9b640 1 -- 172.21.15.37:0/759846481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940ad7a0 con 0x7f98ac06c330 2023-07-09T21:39:28.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98a9d9b640 1 -- 172.21.15.37:0/759846481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98940adb30 con 0x7f98ac06c330 2023-07-09T21:39:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 -- 172.21.15.37:0/759846481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac06c330 msgr2=0x7f98ac0ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 --2- 172.21.15.37:0/759846481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac06c330 0x7f98ac0ccf00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f98ac06d0b0 tx=0x7f989401c490 comp rx=0 tx=0).stop 2023-07-09T21:39:28.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 -- 172.21.15.37:0/759846481 shutdown_connections 2023-07-09T21:39:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 --2- 172.21.15.37:0/759846481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac06c330 0x7f98ac0ccf00 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 --2- 172.21.15.37:0/759846481 >> v2:172.21.15.119:3300/0 conn(0x7f98ac15ba20 0x7f98ac0cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 -- 172.21.15.37:0/759846481 >> 172.21.15.37:0/759846481 conn(0x7f98ac072400 msgr2=0x7f98ac072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.034+0000 7f98b0c56640 1 -- 172.21.15.37:0/759846481 shutdown_connections 2023-07-09T21:39:28.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 -- 172.21.15.37:0/759846481 wait complete. 2023-07-09T21:39:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 Processor -- start 2023-07-09T21:39:28.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 -- start start 2023-07-09T21:39:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98ac0b1a30 0x7f98ac14d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 0x7f98ac06a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac14aee0 con 0x7f98ac15ba20 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac149ed0 con 0x7f98ac06c330 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98b0c56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac14a6e0 con 0x7f98ac0b1a30 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 0x7f98ac06a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aa59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:53412/0 (socket says 172.21.15.37:53412) 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aa59c640 1 -- 172.21.15.37:0/2321401931 learned_addr learned my addr 172.21.15.37:0/2321401931 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98a3fff640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98ac0b1a30 0x7f98ac14d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 -- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98ac0b1a30 msgr2=0x7f98ac14d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98ac0b1a30 0x7f98ac14d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 -- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 msgr2=0x7f98ac14a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aad9d640 1 -- 172.21.15.37:0/2321401931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940094d0 con 0x7f98ac15ba20 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.038+0000 7f98aa59c640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98aad9d640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 0x7f98ac06a570 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c780 tx=0x7f98a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400aa50 con 0x7f98ac15ba20 2023-07-09T21:39:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400abb0 con 0x7f98ac15ba20 2023-07-09T21:39:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400ce30 con 0x7f98ac15ba20 2023-07-09T21:39:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac14a120 con 0x7f98ac15ba20 2023-07-09T21:39:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac159150 con 0x7f98ac15ba20 2023-07-09T21:39:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac06ed10 con 0x7f98ac15ba20 2023-07-09T21:39:28.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f98a4012420 con 0x7f98ac15ba20 2023-07-09T21:39:28.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.042+0000 7f98a2ffd640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 0x7f988c0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.046+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f98a4083cb0 con 0x7f98ac15ba20 2023-07-09T21:39:28.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.046+0000 7f98aa59c640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 0x7f988c0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.046+0000 7f98aa59c640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 0x7f988c0685d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0b6060 tx=0x7f989c008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.050+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f98a40511f0 con 0x7f98ac15ba20 2023-07-09T21:39:28.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98ac159340 con 0x7f98ac15ba20 2023-07-09T21:39:28.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98a2ffd640 1 -- 172.21.15.37:0/2321401931 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f98a4016020 con 0x7f98ac15ba20 2023-07-09T21:39:28.240 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:28.240 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:28.241 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 msgr2=0x7f988c0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 0x7f988c0685d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f98ac0b6060 tx=0x7f989c008040 comp rx=0 tx=0).stop 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 msgr2=0x7f98ac06a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 0x7f98ac06a570 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f98a400c780 tx=0x7f98a400cc40 comp rx=0 tx=0).stop 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 shutdown_connections 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f988c066120 0x7f988c0685d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98ac15ba20 0x7f98ac06a570 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f98ac0b1a30 0x7f98ac14d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 --2- 172.21.15.37:0/2321401931 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f98ac06c330 0x7f98ac14a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 >> 172.21.15.37:0/2321401931 conn(0x7f98ac072400 msgr2=0x7f98ac147ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 shutdown_connections 2023-07-09T21:39:28.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.238+0000 7f98b0c56640 1 -- 172.21.15.37:0/2321401931 wait complete. 2023-07-09T21:39:28.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 Processor -- start 2023-07-09T21:39:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 -- start start 2023-07-09T21:39:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e480b7ab0 0x7f6e4806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b4340 0x7f6e480d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480b49f0 con 0x7f6e480cef80 2023-07-09T21:39:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480b7e80 con 0x7f6e480b7ab0 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4fc7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480cc8a0 con 0x7f6e480b4340 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e480b7ab0 0x7f6e4806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e480b7ab0 0x7f6e4806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47128/0 (socket says 172.21.15.37:47128) 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 -- 172.21.15.37:0/2769971265 learned_addr learned my addr 172.21.15.37:0/2769971265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4d216640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6e480cef80 0x7f6e480b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46910/0 (socket says 172.21.15.37:46910) 2023-07-09T21:39:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4e218640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b4340 0x7f6e480d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 -- 172.21.15.37:0/2769971265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b4340 msgr2=0x7f6e480d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b4340 0x7f6e480d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 -- 172.21.15.37:0/2769971265 >> v1:172.21.15.37:6789/0 conn(0x7f6e480cef80 legacy=0x7f6e480b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.402+0000 7f6e4da17640 1 -- 172.21.15.37:0/2769971265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480ccb80 con 0x7f6e480b7ab0 2023-07-09T21:39:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4da17640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b7ab0 0x7f6e4806aa50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009870 tx=0x7f6e4401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bb2e7ffeea472f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4ca15640 1 -- 172.21.15.37:0/2769971265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440aa670 con 0x7f6e480b7ab0 2023-07-09T21:39:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4ca15640 1 -- 172.21.15.37:0/2769971265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440aa7d0 con 0x7f6e480b7ab0 2023-07-09T21:39:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4ca15640 1 -- 172.21.15.37:0/2769971265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440aab60 con 0x7f6e480b7ab0 2023-07-09T21:39:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2769971265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b7ab0 msgr2=0x7f6e4806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b7ab0 0x7f6e4806aa50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009870 tx=0x7f6e4401c510 comp rx=0 tx=0).stop 2023-07-09T21:39:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2769971265 shutdown_connections 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b4340 0x7f6e480d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2769971265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b7ab0 0x7f6e4806aa50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2769971265 >> 172.21.15.37:0/2769971265 conn(0x7f6e48073090 msgr2=0x7f6e48069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2769971265 shutdown_connections 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.406+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2769971265 wait complete. 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 Processor -- start 2023-07-09T21:39:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- start start 2023-07-09T21:39:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 0x7f6e480c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 0x7f6e480b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480c8350 con 0x7f6e480b4340 2023-07-09T21:39:28.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480c8630 con 0x7f6e480cef80 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480b51a0 con 0x7f6e480b7ab0 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47136/0 (socket says 172.21.15.37:47136) 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 -- 172.21.15.37:0/2397592883 learned_addr learned my addr 172.21.15.37:0/2397592883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4d216640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 0x7f6e480c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4e218640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 0x7f6e480b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 -- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 msgr2=0x7f6e480c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 0x7f6e480c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 -- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 msgr2=0x7f6e480b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 0x7f6e480b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 -- 172.21.15.37:0/2397592883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e440094d0 con 0x7f6e480b4340 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4d216640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 0x7f6e480c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4e218640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 0x7f6e480b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4da17640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ac040 tx=0x7f6e4401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440b3800 con 0x7f6e480b4340 2023-07-09T21:39:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e440b3980 con 0x7f6e480b4340 2023-07-09T21:39:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e480b5480 con 0x7f6e480b4340 2023-07-09T21:39:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440b3d30 con 0x7f6e480b4340 2023-07-09T21:39:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e480c7f90 con 0x7f6e480b4340 2023-07-09T21:39:28.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.410+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e480b56c0 con 0x7f6e480b4340 2023-07-09T21:39:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.414+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f6e440b2380 con 0x7f6e480b4340 2023-07-09T21:39:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.414+0000 7f6e3e7fc640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 0x7f6e2c0685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.414+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6e4411e620 con 0x7f6e480b4340 2023-07-09T21:39:28.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.414+0000 7f6e4d216640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 0x7f6e2c0685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.414+0000 7f6e4d216640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 0x7f6e2c0685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e481f7410 tx=0x7f6e38009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.418+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6e480b56c0 con 0x7f6e480b4340 2023-07-09T21:39:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e480b56c0 con 0x7f6e480b4340 2023-07-09T21:39:28.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e3e7fc640 1 -- 172.21.15.37:0/2397592883 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+19423 (secure 0 0 0) 0x7f6e480b56c0 con 0x7f6e480b4340 2023-07-09T21:39:28.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:28.578 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":101,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:26.839194+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/4254694356":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2296636262":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2391665975":"2023-07-10T21:39:26.839158+0000","172.21.15.119:6833/1820997415":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/3132223250":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/1297590279":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/4250279670":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1396422176":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2514649320":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6833/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/1820997415":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2044940131":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/3365981794":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2371603648":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/68715102":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1987789388":"2023-07-10T21:39:20.834480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 msgr2=0x7f6e2c0685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 0x7f6e2c0685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f6e481f7410 tx=0x7f6e38009040 comp rx=0 tx=0).stop 2023-07-09T21:39:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 msgr2=0x7f6e4814d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f6e440ac040 tx=0x7f6e4401ad50 comp rx=0 tx=0).stop 2023-07-09T21:39:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 shutdown_connections 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f6e2c066100 0x7f6e2c0685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6e480cef80 0x7f6e480b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6e480b7ab0 0x7f6e480c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 --2- 172.21.15.37:0/2397592883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e480b4340 0x7f6e4814d430 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.574+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 >> 172.21.15.37:0/2397592883 conn(0x7f6e48073090 msgr2=0x7f6e480d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.578+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 shutdown_connections 2023-07-09T21:39:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.578+0000 7f6e4fc7b640 1 -- 172.21.15.37:0/2397592883 wait complete. 2023-07-09T21:39:28.598 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:39:28.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 Processor -- start 2023-07-09T21:39:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 -- start start 2023-07-09T21:39:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7100b7ab0 0x7fa71006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa7100cef80 0x7fa7100b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa71015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100b7e80 con 0x7fa7100b7ab0 2023-07-09T21:39:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7100b4610 con 0x7fa7100cef80 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa71660b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b49f0 con 0x7fa7100b4170 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa70ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7100b7ab0 0x7fa71006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa70ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa7100b7ab0 0x7fa71006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47138/0 (socket says 172.21.15.37:47138) 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa70ffff640 1 -- 172.21.15.37:0/1877924883 learned_addr learned my addr 172.21.15.37:0/1877924883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.738+0000 7fa714ba8640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa71015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70f7fe640 1 --2- 172.21.15.37:0/1877924883 >> v2:172.21.15.119:3300/0 conn(0x7fa7100cef80 0x7fa7100b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 -- 172.21.15.37:0/1877924883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 msgr2=0x7fa71015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa71015f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 -- 172.21.15.37:0/1877924883 >> v2:172.21.15.119:3300/0 conn(0x7fa7100cef80 msgr2=0x7fa7100b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1877924883 >> v2:172.21.15.119:3300/0 conn(0x7fa7100cef80 0x7fa7100b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 -- 172.21.15.37:0/1877924883 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7100cc8a0 con 0x7fa7100b7ab0 2023-07-09T21:39:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100b7ab0 0x7fa71006aa50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa7100b4d10 tx=0x7fa70001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a88472ca7d25ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70effd640 1 -- 172.21.15.37:0/1877924883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000ab600 con 0x7fa7100b7ab0 2023-07-09T21:39:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70effd640 1 -- 172.21.15.37:0/1877924883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7000a7050 con 0x7fa7100b7ab0 2023-07-09T21:39:28.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa70effd640 1 -- 172.21.15.37:0/1877924883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7000ab980 con 0x7fa7100b7ab0 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 -- 172.21.15.37:0/1877924883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100b7ab0 msgr2=0x7fa71006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100b7ab0 0x7fa71006aa50 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fa7100b4d10 tx=0x7fa70001c210 comp rx=0 tx=0).stop 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 -- 172.21.15.37:0/1877924883 shutdown_connections 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa71015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 --2- 172.21.15.37:0/1877924883 >> v2:172.21.15.119:3300/0 conn(0x7fa7100cef80 0x7fa7100b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.742+0000 7fa71660b640 1 --2- 172.21.15.37:0/1877924883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100b7ab0 0x7fa71006aa50 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- 172.21.15.37:0/1877924883 >> 172.21.15.37:0/1877924883 conn(0x7fa710073090 msgr2=0x7fa710069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- 172.21.15.37:0/1877924883 shutdown_connections 2023-07-09T21:39:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- 172.21.15.37:0/1877924883 wait complete. 2023-07-09T21:39:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 Processor -- start 2023-07-09T21:39:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- start start 2023-07-09T21:39:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa7100c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7100b7ab0 0x7fa71014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71014f130 con 0x7fa7100cef80 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b1ea0 con 0x7fa7100b7ab0 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa71660b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7100b2740 con 0x7fa7100b4170 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47154/0 (socket says 172.21.15.37:47154) 2023-07-09T21:39:28.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 -- 172.21.15.37:0/1072149391 learned_addr learned my addr 172.21.15.37:0/1072149391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa7100c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa70f7fe640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7100b7ab0 0x7fa71014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 -- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 msgr2=0x7fa7100c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa7100c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 -- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7100b7ab0 msgr2=0x7fa71014f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7100b7ab0 0x7fa71014f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 -- 172.21.15.37:0/1072149391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7000094d0 con 0x7fa7100cef80 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.746+0000 7fa714ba8640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa708007e70 tx=0x7fa70800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708014620 con 0x7fa7100cef80 2023-07-09T21:39:28.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7080147a0 con 0x7fa7100cef80 2023-07-09T21:39:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa708014b50 con 0x7fa7100cef80 2023-07-09T21:39:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71014f360 con 0x7fa7100cef80 2023-07-09T21:39:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7100b23d0 con 0x7fa7100cef80 2023-07-09T21:39:28.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7100b0f40 con 0x7fa7100cef80 2023-07-09T21:39:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fa708014cb0 con 0x7fa7100cef80 2023-07-09T21:39:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 0x7fa6fc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa7080846b0 con 0x7fa7100cef80 2023-07-09T21:39:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.750+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 0x7fa6fc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:28.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.754+0000 7fa70ffff640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 0x7fa6fc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa7000ad000 tx=0x7fa7000a6000 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:28.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.754+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa708055550 con 0x7fa7100cef80 2023-07-09T21:39:28.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.942+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa71004d7d0 con 0x7fa7100cef80 2023-07-09T21:39:28.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.942+0000 7fa70cff9640 1 -- 172.21.15.37:0/1072149391 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7fa7080550e0 con 0x7fa7100cef80 2023-07-09T21:39:28.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:28.946 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:28.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 msgr2=0x7fa6fc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 0x7fa6fc068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa7000ad000 tx=0x7fa7000a6000 comp rx=0 tx=0).stop 2023-07-09T21:39:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 msgr2=0x7fa71014ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:28.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fa708007e70 tx=0x7fa70800e4b0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 shutdown_connections 2023-07-09T21:39:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa6fc0660d0 0x7fa6fc068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa7100cef80 0x7fa71014ebf0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa7100b7ab0 0x7fa71014f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 --2- 172.21.15.37:0/1072149391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa7100b4170 0x7fa7100c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 >> 172.21.15.37:0/1072149391 conn(0x7fa710073090 msgr2=0x7fa7100b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 shutdown_connections 2023-07-09T21:39:28.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:28.946+0000 7fa71660b640 1 -- 172.21.15.37:0/1072149391 wait complete. 2023-07-09T21:39:28.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:29.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.106+0000 7f5cf7256640 1 Processor -- start 2023-07-09T21:39:29.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.106+0000 7f5cf7256640 1 -- start start 2023-07-09T21:39:29.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf7256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf7256640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 0x7f5cf00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf7256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf00b49f0 con 0x7f5cf00cef80 2023-07-09T21:39:29.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf7256640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00b7e80 con 0x7f5cf00b4340 2023-07-09T21:39:29.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf7256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00cc8a0 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5ceffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cf00cef80 0x7f5cf00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46914/0 (socket says 172.21.15.37:46914) 2023-07-09T21:39:29.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5ceffff640 1 -- 172.21.15.37:0/1304634019 learned_addr learned my addr 172.21.15.37:0/1304634019 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:29.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/1304634019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf57f3640 1 --2- 172.21.15.37:0/1304634019 >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 0x7f5cf00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cef7fe640 1 -- 172.21.15.37:0/1304634019 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562301732 0 0) 0x7f5cf00b49f0 con 0x7f5cf00cef80 2023-07-09T21:39:29.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cef7fe640 1 -- 172.21.15.37:0/1304634019 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ce0003530 con 0x7f5cf00cef80 2023-07-09T21:39:29.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/1304634019 >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 msgr2=0x7f5cf00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:29.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/1304634019 >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 0x7f5cf00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/1304634019 >> v1:172.21.15.37:6789/0 conn(0x7f5cf00cef80 legacy=0x7f5cf00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/1304634019 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00ccb80 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.110+0000 7f5cf57f3640 1 --2- 172.21.15.37:0/1304634019 >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 0x7f5cf00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:29.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/1304634019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf006aa50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40097c0 tx=0x7f5ce401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc478bab292a4275 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cef7fe640 1 -- 172.21.15.37:0/1304634019 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40ab650 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cef7fe640 1 -- 172.21.15.37:0/1304634019 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40ab7b0 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cef7fe640 1 -- 172.21.15.37:0/1304634019 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40abb40 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- 172.21.15.37:0/1304634019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 msgr2=0x7f5cf006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 --2- 172.21.15.37:0/1304634019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf006aa50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40097c0 tx=0x7f5ce401c450 comp rx=0 tx=0).stop 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- 172.21.15.37:0/1304634019 shutdown_connections 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 --2- 172.21.15.37:0/1304634019 >> v2:172.21.15.119:3300/0 conn(0x7f5cf00b4340 0x7f5cf00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 --2- 172.21.15.37:0/1304634019 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf006aa50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- 172.21.15.37:0/1304634019 >> 172.21.15.37:0/1304634019 conn(0x7f5cf0073090 msgr2=0x7f5cf0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- 172.21.15.37:0/1304634019 shutdown_connections 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- 172.21.15.37:0/1304634019 wait complete. 2023-07-09T21:39:29.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 Processor -- start 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.114+0000 7f5cf7256640 1 -- start start 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf00cef80 0x7f5cf00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00b5db0 con 0x7f5cf00b4340 2023-07-09T21:39:29.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00c9f30 con 0x7f5cf00cef80 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00ca210 con 0x7f5cf00b7ab0 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47158/0 (socket says 172.21.15.37:47158) 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/3639172164 learned_addr learned my addr 172.21.15.37:0/3639172164 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 msgr2=0x7f5cf015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf00cef80 msgr2=0x7f5cf00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf00cef80 0x7f5cf00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 -- 172.21.15.37:0/3639172164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009a70 con 0x7f5cf00b4340 2023-07-09T21:39:29.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf4ff2640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40ad040 tx=0x7f5ce401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40bf610 con 0x7f5cf00b4340 2023-07-09T21:39:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce40bf7b0 con 0x7f5cf00b4340 2023-07-09T21:39:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce4009420 con 0x7f5cf00b4340 2023-07-09T21:39:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce40bfb60 con 0x7f5cf00b4340 2023-07-09T21:39:29.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf00ca7d0 con 0x7f5cf00b4340 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf004d7d0 con 0x7f5cf00b4340 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.118+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5ce40b5400 con 0x7f5cf00b4340 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.122+0000 7f5ced7fa640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 0x7f5cd4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.122+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5ce411ec40 con 0x7f5cf00b4340 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.122+0000 7f5ceffff640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 0x7f5cd4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.122+0000 7f5ceffff640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 0x7f5cd4068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc007fd0 tx=0x7f5cdc007940 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.126+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ce40ec170 con 0x7f5cf00b4340 2023-07-09T21:39:29.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.138+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5ce40ec540 con 0x7f5cf00b4340 2023-07-09T21:39:29.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.314+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cf006a830 con 0x7f5cf00b4340 2023-07-09T21:39:29.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.314+0000 7f5ced7fa640 1 -- 172.21.15.37:0/3639172164 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4673 (secure 0 0 0) 0x7f5ce4105d30 con 0x7f5cf00b4340 2023-07-09T21:39:29.318 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:29.318 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:02.602126+0000","modified":"2023-07-09T21:39:06.265870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7341},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7341":{"gid":7341,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.119:6836/1186396367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1186396367},{"type":"v1","addr":"172.21.15.119:6836","nonce":1186396367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-07-09T21:39:29.319 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 40 2023-07-09T21:39:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 msgr2=0x7f5cd4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 0x7f5cd4068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc007fd0 tx=0x7f5cdc007940 comp rx=0 tx=0).stop 2023-07-09T21:39:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 msgr2=0x7f5cf01517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40ad040 tx=0x7f5ce401ac90 comp rx=0 tx=0).stop 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 shutdown_connections 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5cd40660d0 0x7f5cd4068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cf00cef80 0x7f5cf00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cf00b7ab0 0x7f5cf015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 --2- 172.21.15.37:0/3639172164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cf00b4340 0x7f5cf01517d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 >> 172.21.15.37:0/3639172164 conn(0x7f5cf0073090 msgr2=0x7f5cf00d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:29.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 shutdown_connections 2023-07-09T21:39:29.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.318+0000 7f5cf7256640 1 -- 172.21.15.37:0/3639172164 wait complete. 2023-07-09T21:39:29.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 Processor -- start 2023-07-09T21:39:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 -- start start 2023-07-09T21:39:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27880b7ab0 0x7f278806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 0x7f27880b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27880b49f0 con 0x7f27880b4170 2023-07-09T21:39:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27880b7e80 con 0x7f27880b7ab0 2023-07-09T21:39:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278fe7b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27880b4610 con 0x7f27880cef80 2023-07-09T21:39:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27880b7ab0 0x7f278806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27880b7ab0 0x7f278806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47162/0 (socket says 172.21.15.37:47162) 2023-07-09T21:39:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 -- 172.21.15.37:0/484664229 learned_addr learned my addr 172.21.15.37:0/484664229 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278e418640 1 --1- 172.21.15.37:0/484664229 >> v1:172.21.15.37:6789/0 conn(0x7f27880b4170 0x7f278815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46922/0 (socket says 172.21.15.37:46922) 2023-07-09T21:39:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278d416640 1 --2- 172.21.15.37:0/484664229 >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 0x7f27880b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 -- 172.21.15.37:0/484664229 >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 msgr2=0x7f27880b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 --2- 172.21.15.37:0/484664229 >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 0x7f27880b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 -- 172.21.15.37:0/484664229 >> v1:172.21.15.37:6789/0 conn(0x7f27880b4170 legacy=0x7f278815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278dc17640 1 -- 172.21.15.37:0/484664229 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27880cc8a0 con 0x7f27880b7ab0 2023-07-09T21:39:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.482+0000 7f278d416640 1 --2- 172.21.15.37:0/484664229 >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 0x7f27880b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278dc17640 1 --2- 172.21.15.37:0/484664229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880b7ab0 0x7f278806aa50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f27880b4d10 tx=0x7f278401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e67faeb077508f17 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278cc15640 1 -- 172.21.15.37:0/484664229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840aa430 con 0x7f27880b7ab0 2023-07-09T21:39:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278cc15640 1 -- 172.21.15.37:0/484664229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27840aa590 con 0x7f27880b7ab0 2023-07-09T21:39:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278cc15640 1 -- 172.21.15.37:0/484664229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27840aa920 con 0x7f27880b7ab0 2023-07-09T21:39:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 -- 172.21.15.37:0/484664229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880b7ab0 msgr2=0x7f278806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 --2- 172.21.15.37:0/484664229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880b7ab0 0x7f278806aa50 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f27880b4d10 tx=0x7f278401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 -- 172.21.15.37:0/484664229 shutdown_connections 2023-07-09T21:39:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 --2- 172.21.15.37:0/484664229 >> v2:172.21.15.119:3300/0 conn(0x7f27880cef80 0x7f27880b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 --2- 172.21.15.37:0/484664229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880b7ab0 0x7f278806aa50 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 -- 172.21.15.37:0/484664229 >> 172.21.15.37:0/484664229 conn(0x7f2788073090 msgr2=0x7f2788069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 -- 172.21.15.37:0/484664229 shutdown_connections 2023-07-09T21:39:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.486+0000 7f278fe7b640 1 -- 172.21.15.37:0/484664229 wait complete. 2023-07-09T21:39:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 Processor -- start 2023-07-09T21:39:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- start start 2023-07-09T21:39:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27880b4170 0x7f2788152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27880b7ab0 0x7f278815bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788159700 con 0x7f27880cef80 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2788159cc0 con 0x7f27880b4170 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278815ed90 con 0x7f27880b7ab0 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47166/0 (socket says 172.21.15.37:47166) 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 -- 172.21.15.37:0/283308409 learned_addr learned my addr 172.21.15.37:0/283308409 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278dc17640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27880b4170 0x7f2788152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278d416640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27880b7ab0 0x7f278815bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 -- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27880b7ab0 msgr2=0x7f278815bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27880b7ab0 0x7f278815bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 -- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27880b4170 msgr2=0x7f2788152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27880b4170 0x7f2788152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 -- 172.21.15.37:0/283308409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27840094d0 con 0x7f27880cef80 2023-07-09T21:39:29.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278e418640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f278000c730 tx=0x7f278000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000ce40 con 0x7f27880cef80 2023-07-09T21:39:29.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278000a640 con 0x7f27880cef80 2023-07-09T21:39:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278815f070 con 0x7f27880cef80 2023-07-09T21:39:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278000a9b0 con 0x7f27880cef80 2023-07-09T21:39:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.490+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27880c5ef0 con 0x7f27880cef80 2023-07-09T21:39:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278804d7d0 con 0x7f27880cef80 2023-07-09T21:39:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f278000ab10 con 0x7f27880cef80 2023-07-09T21:39:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f277e7fc640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 0x7f276c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2780083840 con 0x7f27880cef80 2023-07-09T21:39:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f278dc17640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 0x7f276c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.494+0000 7f278dc17640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 0x7f276c068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27840ae000 tx=0x7f27840b5040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.498+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2780050980 con 0x7f27880cef80 2023-07-09T21:39:29.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.654+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f278806a830 con 0x7f27880cef80 2023-07-09T21:39:29.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f277e7fc640 1 -- 172.21.15.37:0/283308409 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+19423 (secure 0 0 0) 0x7f2780053fa0 con 0x7f27880cef80 2023-07-09T21:39:29.659 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:29.660 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":101,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:26.839194+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:00.709802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:01.666752+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/4254694356":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2296636262":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2391665975":"2023-07-10T21:39:26.839158+0000","172.21.15.119:6833/1820997415":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/3132223250":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/1297590279":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/4250279670":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1396422176":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2514649320":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6833/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/2063381883":"2023-07-10T21:39:20.834480+0000","172.21.15.119:6832/1820997415":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/2044940131":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/3365981794":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/2371603648":"2023-07-10T21:39:26.839158+0000","172.21.15.119:0/68715102":"2023-07-10T21:39:20.834480+0000","172.21.15.119:0/1987789388":"2023-07-10T21:39:20.834480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 msgr2=0x7f276c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 0x7f276c068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f27840ae000 tx=0x7f27840b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 msgr2=0x7f2788153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f278000c730 tx=0x7f278000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 shutdown_connections 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f276c0663d0 0x7f276c068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27880cef80 0x7f2788153200 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27880b7ab0 0x7f278815bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 --2- 172.21.15.37:0/283308409 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27880b4170 0x7f2788152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 >> 172.21.15.37:0/283308409 conn(0x7f2788073090 msgr2=0x7f27880ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 shutdown_connections 2023-07-09T21:39:29.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.658+0000 7f278fe7b640 1 -- 172.21.15.37:0/283308409 wait complete. 2023-07-09T21:39:29.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 Processor -- start 2023-07-09T21:39:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 -- start start 2023-07-09T21:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa86406d010 0x7fa86406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa864070bb0 0x7fa8640cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86406afa0 con 0x7fa864159830 2023-07-09T21:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa864070000 con 0x7fa864070bb0 2023-07-09T21:39:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.822+0000 7fa869b74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86406b280 con 0x7fa86406d010 2023-07-09T21:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8637fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa864159830 0x7fa86406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46926/0 (socket says 172.21.15.37:46926) 2023-07-09T21:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8637fe640 1 -- 172.21.15.37:0/1448602427 learned_addr learned my addr 172.21.15.37:0/1448602427 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 --2- 172.21.15.37:0/1448602427 >> v2:172.21.15.119:3300/0 conn(0x7fa864070bb0 0x7fa8640cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa862ffd640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa86406d010 0x7fa86406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8627fc640 1 -- 172.21.15.37:0/1448602427 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2036236757 0 0) 0x7fa86406afa0 con 0x7fa864159830 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8627fc640 1 -- 172.21.15.37:0/1448602427 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c003530 con 0x7fa864159830 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 -- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa86406d010 msgr2=0x7fa86406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa86406d010 0x7fa86406fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 -- 172.21.15.37:0/1448602427 >> v1:172.21.15.37:6789/0 conn(0x7fa864159830 legacy=0x7fa86406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 -- 172.21.15.37:0/1448602427 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86406b560 con 0x7fa864070bb0 2023-07-09T21:39:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa863fff640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa864070bb0 0x7fa8640cbde0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009d90 tx=0x7fa85c01c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db828f4c43150344 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8627fc640 1 -- 172.21.15.37:0/1448602427 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0a5970 con 0x7fa864070bb0 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8627fc640 1 -- 172.21.15.37:0/1448602427 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85c0a5ad0 con 0x7fa864070bb0 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.826+0000 7fa8627fc640 1 -- 172.21.15.37:0/1448602427 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0a5e60 con 0x7fa864070bb0 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa864070bb0 msgr2=0x7fa8640cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa864070bb0 0x7fa8640cbde0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fa85c009d90 tx=0x7fa85c01c890 comp rx=0 tx=0).stop 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- 172.21.15.37:0/1448602427 shutdown_connections 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa864070bb0 0x7fa8640cbde0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- 172.21.15.37:0/1448602427 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa86406d010 0x7fa86406fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- 172.21.15.37:0/1448602427 >> 172.21.15.37:0/1448602427 conn(0x7fa8640694c0 msgr2=0x7fa8640698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- 172.21.15.37:0/1448602427 shutdown_connections 2023-07-09T21:39:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- 172.21.15.37:0/1448602427 wait complete. 2023-07-09T21:39:29.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 Processor -- start 2023-07-09T21:39:29.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- start start 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86406d010 0x7fa86414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 0x7fa86414ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8641517b0 con 0x7fa864070bb0 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640b2810 con 0x7fa86406d010 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa869b74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8640b2530 con 0x7fa864159830 2023-07-09T21:39:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.830+0000 7fa862ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47170/0 (socket says 172.21.15.37:47170) 2023-07-09T21:39:29.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 -- 172.21.15.37:0/2211454790 learned_addr learned my addr 172.21.15.37:0/2211454790 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa863fff640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 0x7fa86414ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa8637fe640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86406d010 0x7fa86414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 -- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 msgr2=0x7fa86414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 0x7fa86414ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 -- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86406d010 msgr2=0x7fa86414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86406d010 0x7fa86414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 -- 172.21.15.37:0/2211454790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c009a70 con 0x7fa864070bb0 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa863fff640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 0x7fa86414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa862ffd640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa85800e900 tx=0x7fa85800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa858009690 con 0x7fa864070bb0 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85800ca00 con 0x7fa864070bb0 2023-07-09T21:39:29.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85800cdb0 con 0x7fa864070bb0 2023-07-09T21:39:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa864151160 con 0x7fa864070bb0 2023-07-09T21:39:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86414d7a0 con 0x7fa864070bb0 2023-07-09T21:39:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa864151920 con 0x7fa864070bb0 2023-07-09T21:39:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.834+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa858013470 con 0x7fa864070bb0 2023-07-09T21:39:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.838+0000 7fa84bfff640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 0x7fa850068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.838+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa858084390 con 0x7fa864070bb0 2023-07-09T21:39:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.838+0000 7fa8637fe640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 0x7fa850068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:29.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.838+0000 7fa8637fe640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 0x7fa850068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa854007fd0 tx=0x7fa854009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:29.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:29.838+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa858051410 con 0x7fa864070bb0 2023-07-09T21:39:30.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.030+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa86404d7d0 con 0x7fa864070bb0 2023-07-09T21:39:30.035 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:39:30.034+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:39:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa84bfff640 1 -- 172.21.15.37:0/2211454790 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa858054a30 con 0x7fa864070bb0 2023-07-09T21:39:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:39:30.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 msgr2=0x7fa850068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 0x7fa850068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa854007fd0 tx=0x7fa854009040 comp rx=0 tx=0).stop 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 msgr2=0x7fa86413bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa85800e900 tx=0x7fa85800edc0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 shutdown_connections 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa8500663a0 0x7fa850068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa864159830 0x7fa86414ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa864070bb0 0x7fa86413bf30 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 --2- 172.21.15.37:0/2211454790 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa86406d010 0x7fa86414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 >> 172.21.15.37:0/2211454790 conn(0x7fa8640694c0 msgr2=0x7fa8640650b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 shutdown_connections 2023-07-09T21:39:30.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.038+0000 7fa869b74640 1 -- 172.21.15.37:0/2211454790 wait complete. 2023-07-09T21:39:30.047 INFO:tasks.ceph.mds.b.smithi119.stderr: -1656> 2023-07-09T21:39:08.194+0000 7fd1b1f3a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:39:30.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:39:30.091 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:39:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.206+0000 7f0a56759640 1 Processor -- start 2023-07-09T21:39:30.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.206+0000 7f0a56759640 1 -- start start 2023-07-09T21:39:30.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a56759640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a500b7980 0x7f0a50160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a56759640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a500ceb80 0x7f0a500cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a56759640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5015bf80 con 0x7f0a500b3c20 2023-07-09T21:39:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a56759640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500cd070 con 0x7f0a500b7980 2023-07-09T21:39:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a56759640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500cfd70 con 0x7f0a500ceb80 2023-07-09T21:39:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a500b7980 0x7f0a50160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0a500b7980 0x7f0a50160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47182/0 (socket says 172.21.15.37:47182) 2023-07-09T21:39:30.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 -- 172.21.15.37:0/354278150 learned_addr learned my addr 172.21.15.37:0/354278150 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:30.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4f7fe640 1 --2- 172.21.15.37:0/354278150 >> v2:172.21.15.119:3300/0 conn(0x7f0a500ceb80 0x7f0a500cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 -- 172.21.15.37:0/354278150 >> v2:172.21.15.119:3300/0 conn(0x7f0a500ceb80 msgr2=0x7f0a500cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:30.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 --2- 172.21.15.37:0/354278150 >> v2:172.21.15.119:3300/0 conn(0x7f0a500ceb80 0x7f0a500cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 -- 172.21.15.37:0/354278150 >> v1:172.21.15.119:6789/0 conn(0x7f0a500b3c20 legacy=0x7f0a500b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.210+0000 7f0a4ffff640 1 -- 172.21.15.37:0/354278150 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a50160570 con 0x7f0a500b7980 2023-07-09T21:39:30.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a4ffff640 1 --2- 172.21.15.37:0/354278150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a50160030 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b4cd0 tx=0x7f0a4001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcd2c794f11bbf4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:30.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a4effd640 1 -- 172.21.15.37:0/354278150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400ab600 con 0x7f0a500b7980 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a4effd640 1 -- 172.21.15.37:0/354278150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a400a7050 con 0x7f0a500b7980 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a4effd640 1 -- 172.21.15.37:0/354278150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400ab980 con 0x7f0a500b7980 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- 172.21.15.37:0/354278150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 msgr2=0x7f0a50160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 --2- 172.21.15.37:0/354278150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a50160030 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f0a500b4cd0 tx=0x7f0a4001c500 comp rx=0 tx=0).stop 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- 172.21.15.37:0/354278150 shutdown_connections 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 --2- 172.21.15.37:0/354278150 >> v2:172.21.15.119:3300/0 conn(0x7f0a500ceb80 0x7f0a500cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 --2- 172.21.15.37:0/354278150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a50160030 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- 172.21.15.37:0/354278150 >> 172.21.15.37:0/354278150 conn(0x7f0a50073090 msgr2=0x7f0a50069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- 172.21.15.37:0/354278150 shutdown_connections 2023-07-09T21:39:30.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- 172.21.15.37:0/354278150 wait complete. 2023-07-09T21:39:30.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 Processor -- start 2023-07-09T21:39:30.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.214+0000 7f0a56759640 1 -- start start 2023-07-09T21:39:30.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a500b3c20 0x7f0a500ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a500ceb80 0x7f0a5015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5015e530 con 0x7f0a500b7980 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5015da30 con 0x7f0a500ceb80 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5015d500 con 0x7f0a500b3c20 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4ffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a500b3c20 0x7f0a500ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47188/0 (socket says 172.21.15.37:47188) 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 -- 172.21.15.37:0/1979561153 learned_addr learned my addr 172.21.15.37:0/1979561153 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a54cf6640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a500ceb80 0x7f0a5015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 -- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a500b3c20 msgr2=0x7f0a500ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a500b3c20 0x7f0a500ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 -- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a500ceb80 msgr2=0x7f0a5015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a500ceb80 0x7f0a5015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:30.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 -- 172.21.15.37:0/1979561153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a400094d0 con 0x7f0a500b7980 2023-07-09T21:39:30.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4f7fe640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e8a0 tx=0x7f0a4400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:30.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44009530 con 0x7f0a500b7980 2023-07-09T21:39:30.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4400c940 con 0x7f0a500b7980 2023-07-09T21:39:30.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400ccd0 con 0x7f0a500b7980 2023-07-09T21:39:30.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a5015d750 con 0x7f0a500b7980 2023-07-09T21:39:30.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a5015e150 con 0x7f0a500b7980 2023-07-09T21:39:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a5015e670 con 0x7f0a500b7980 2023-07-09T21:39:30.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.218+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0a44013470 con 0x7f0a500b7980 2023-07-09T21:39:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.222+0000 7f0a4cff9640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 0x7f0a3c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.222+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f0a440842c0 con 0x7f0a500b7980 2023-07-09T21:39:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.222+0000 7f0a4ffff640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 0x7f0a3c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:30.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.222+0000 7f0a4ffff640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 0x7f0a3c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a400ad000 tx=0x7f0a40008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:30.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.226+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a5015e670 con 0x7f0a500b7980 2023-07-09T21:39:30.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:30.414+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0a5015e670 con 0x7f0a500b7980 2023-07-09T21:39:31.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a4cff9640 1 -- 172.21.15.37:0/1979561153 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0a5015e670 con 0x7f0a500b7980 2023-07-09T21:39:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 msgr2=0x7f0a3c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 0x7f0a3c068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0a400ad000 tx=0x7f0a40008040 comp rx=0 tx=0).stop 2023-07-09T21:39:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 msgr2=0x7f0a5015e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400e8a0 tx=0x7f0a4400ed60 comp rx=0 tx=0).stop 2023-07-09T21:39:31.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 shutdown_connections 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f0a3c0663a0 0x7f0a3c068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a500ceb80 0x7f0a5015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a500b7980 0x7f0a5015e950 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 --2- 172.21.15.37:0/1979561153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a500b3c20 0x7f0a500ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 >> 172.21.15.37:0/1979561153 conn(0x7f0a50073090 msgr2=0x7f0a500b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 shutdown_connections 2023-07-09T21:39:31.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.042+0000 7f0a56759640 1 -- 172.21.15.37:0/1979561153 wait complete. 2023-07-09T21:39:31.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:39:31.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 Processor -- start 2023-07-09T21:39:31.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 -- start start 2023-07-09T21:39:31.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc83c0b0ed0 0x7fc83c0afc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:31.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0ce080 con 0x7fc83c0b1420 2023-07-09T21:39:31.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0ce360 con 0x7fc83c0cfb40 2023-07-09T21:39:31.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc841abc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c0ce640 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc83c0b0ed0 0x7fc83c0afc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:31.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc83c0b0ed0 0x7fc83c0afc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47196/0 (socket says 172.21.15.37:47196) 2023-07-09T21:39:31.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 -- 172.21.15.37:0/3689224841 learned_addr learned my addr 172.21.15.37:0/3689224841 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:31.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 -- 172.21.15.37:0/3689224841 >> v1:172.21.15.119:6789/0 conn(0x7fc83c0cfb40 legacy=0x7fc83c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:31.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 -- 172.21.15.37:0/3689224841 >> v1:172.21.15.37:6789/0 conn(0x7fc83c0b1420 legacy=0x7fc83c0af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.214+0000 7fc8412bb640 1 -- 172.21.15.37:0/3689224841 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0aed30 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc8412bb640 1 --2- 172.21.15.37:0/3689224841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c0afc40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc834009e50 tx=0x7fc83401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e837ea4abd11995e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:31.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc83b7fe640 1 -- 172.21.15.37:0/3689224841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a5820 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc83b7fe640 1 -- 172.21.15.37:0/3689224841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8340a5980 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc83b7fe640 1 -- 172.21.15.37:0/3689224841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8340a5d10 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- 172.21.15.37:0/3689224841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 msgr2=0x7fc83c0afc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 --2- 172.21.15.37:0/3689224841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c0afc40 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fc834009e50 tx=0x7fc83401c9a0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- 172.21.15.37:0/3689224841 shutdown_connections 2023-07-09T21:39:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 --2- 172.21.15.37:0/3689224841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c0afc40 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- 172.21.15.37:0/3689224841 >> 172.21.15.37:0/3689224841 conn(0x7fc83c072d20 msgr2=0x7fc83c0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:31.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- 172.21.15.37:0/3689224841 shutdown_connections 2023-07-09T21:39:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- 172.21.15.37:0/3689224841 wait complete. 2023-07-09T21:39:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 Processor -- start 2023-07-09T21:39:31.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.218+0000 7fc841abc640 1 -- start start 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc83c0b1420 0x7fc83c15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc83c0cfb40 0x7fc83c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15b790 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15ab80 con 0x7fc83c0cfb40 2023-07-09T21:39:31.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c15ae60 con 0x7fc83c0b1420 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47204/0 (socket says 172.21.15.37:47204) 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 -- 172.21.15.37:0/2935415294 learned_addr learned my addr 172.21.15.37:0/2935415294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 -- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc83c0b1420 msgr2=0x7fc83c15a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc83c0b1420 0x7fc83c15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 -- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc83c0cfb40 msgr2=0x7fc83c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc83c0cfb40 0x7fc83c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 -- 172.21.15.37:0/2935415294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc834009b30 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc840aba640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c450 tx=0x7fc83000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830012830 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8300129b0 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830012d60 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c15b140 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c152850 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.222+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c04e020 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.226+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc83001c460 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.226+0000 7fc8397fa640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.226+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6879+0+0 (secure 0 0 0) 0x7fc830083fe0 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.226+0000 7fc83bfff640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.226+0000 7fc83bfff640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 0x7fc820068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc828000f70 tx=0x7fc8280079c0 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:31.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.230+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc830051050 con 0x7fc83c0b0ed0 2023-07-09T21:39:31.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:39:31.303 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:39:31.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:31.386+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc83c0cd8f0 con 0x7fc83c0b0ed0 2023-07-09T21:39:32.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc8397fa640 1 -- 172.21.15.37:0/2935415294 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc830054670 con 0x7fc83c0b0ed0 2023-07-09T21:39:32.157 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:39:32.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 msgr2=0x7fc820068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 0x7fc820068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc828000f70 tx=0x7fc8280079c0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 msgr2=0x7fc83c15c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fc83000c450 tx=0x7fc83000c910 comp rx=0 tx=0).stop 2023-07-09T21:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 shutdown_connections 2023-07-09T21:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fc8200663a0 0x7fc820068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc83c0cfb40 0x7fc83c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc83c0b1420 0x7fc83c15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 --2- 172.21.15.37:0/2935415294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc83c0b0ed0 0x7fc83c15c3b0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 >> 172.21.15.37:0/2935415294 conn(0x7fc83c072d20 msgr2=0x7fc83c152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 shutdown_connections 2023-07-09T21:39:32.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.154+0000 7fc841abc640 1 -- 172.21.15.37:0/2935415294 wait complete. 2023-07-09T21:39:32.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:39:32.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 Processor -- start 2023-07-09T21:39:32.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 -- start start 2023-07-09T21:39:32.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d240cf290 0x7f2d24160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d2415bf80 con 0x7f2d240d0780 2023-07-09T21:39:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d24160570 con 0x7f2d240b7980 2023-07-09T21:39:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2bd9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d240cd070 con 0x7f2d240cf290 2023-07-09T21:39:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2a33c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d240d0780 0x7f2d240d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46944/0 (socket says 172.21.15.37:46944) 2023-07-09T21:39:32.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2a33c640 1 -- 172.21.15.37:0/3547260055 learned_addr learned my addr 172.21.15.37:0/3547260055 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d2933a640 1 --2- 172.21.15.37:0/3547260055 >> v2:172.21.15.119:3300/0 conn(0x7f2d240cf290 0x7f2d24160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798381786 0 0) 0x7f2d1c0014a0 con 0x7f2d240d0780 2023-07-09T21:39:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.330+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d10003530 con 0x7f2d240d0780 2023-07-09T21:39:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720381527 0 0) 0x7f2d10003530 con 0x7f2d240d0780 2023-07-09T21:39:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 >> v2:172.21.15.119:3300/0 conn(0x7f2d240cf290 msgr2=0x7f2d24160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 --2- 172.21.15.37:0/3547260055 >> v2:172.21.15.119:3300/0 conn(0x7f2d240cf290 0x7f2d24160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 >> v1:172.21.15.119:6789/0 conn(0x7f2d240b7980 legacy=0x7f2d240ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d240d02f0 con 0x7f2d240d0780 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2d1c001b90 con 0x7f2d240d0780 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 >> v1:172.21.15.37:6789/0 conn(0x7f2d240d0780 legacy=0x7f2d240d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10003980 0x7f2d10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d100047d0 0x7f2d10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 0x7f2d1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d240cd070 con 0x7f2d10005180 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1000c000 con 0x7f2d10003980 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1000c1c0 con 0x7f2d100047d0 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 0x7f2d1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d29b3b640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10003980 0x7f2d10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2933a640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d100047d0 0x7f2d10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 -- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d100047d0 msgr2=0x7f2d10004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d100047d0 0x7f2d10004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 -- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10003980 msgr2=0x7f2d10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10003980 0x7f2d10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 -- 172.21.15.37:0/3547260055 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d10003530 con 0x7f2d10005180 2023-07-09T21:39:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 -- 172.21.15.37:0/3547260055 reap_dead start 2023-07-09T21:39:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.334+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 0x7f2d1000b990 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00a830 tx=0x7f2d1c01d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8e3563da6e5e5f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ad630 con 0x7f2d10005180 2023-07-09T21:39:32.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0a8070 con 0x7f2d10005180 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d28b39640 1 -- 172.21.15.37:0/3547260055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ad9f0 con 0x7f2d10005180 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 msgr2=0x7f2d1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 0x7f2d1000b990 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c00a830 tx=0x7f2d1c01d340 comp rx=0 tx=0).stop 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/3547260055 shutdown_connections 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/3547260055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d10005180 0x7f2d1000b990 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/3547260055 >> 172.21.15.37:0/3547260055 conn(0x7f2d24073090 msgr2=0x7f2d24069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/3547260055 shutdown_connections 2023-07-09T21:39:32.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/3547260055 wait complete. 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 Processor -- start 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- start start 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10005180 0x7f2d2414ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 0x7f2d2415c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d241504b0 con 0x7f2d240c9270 2023-07-09T21:39:32.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415cec0 con 0x7f2d10005180 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.338+0000 7f2d2bd9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d2415c660 con 0x7f2d240b4310 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47214/0 (socket says 172.21.15.37:47214) 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 -- 172.21.15.37:0/2481457702 learned_addr learned my addr 172.21.15.37:0/2481457702 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d29b3b640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10005180 0x7f2d2414ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2933a640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 0x7f2d2415c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 -- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 msgr2=0x7f2d2415c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 0x7f2d2415c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 -- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10005180 msgr2=0x7f2d2414ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10005180 0x7f2d2414ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 -- 172.21.15.37:0/2481457702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2415c900 con 0x7f2d240c9270 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2933a640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 0x7f2d2415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2a33c640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c01dbe0 tx=0x7f2d10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ad430 con 0x7f2d240c9270 2023-07-09T21:39:32.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0ad590 con 0x7f2d240c9270 2023-07-09T21:39:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d1c0ad900 con 0x7f2d240c9270 2023-07-09T21:39:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d241504b0 con 0x7f2d240c9270 2023-07-09T21:39:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d240c6e80 con 0x7f2d240c9270 2023-07-09T21:39:32.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d2404d7d0 con 0x7f2d240c9270 2023-07-09T21:39:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d1c0aa030 con 0x7f2d240c9270 2023-07-09T21:39:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.342+0000 7f2d1a7fc640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 0x7f2d08068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.346+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f2d1c11e150 con 0x7f2d240c9270 2023-07-09T21:39:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.346+0000 7f2d29b3b640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 0x7f2d08068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:32.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.346+0000 7f2d29b3b640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 0x7f2d08068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c10 tx=0x7f2d20009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:32.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.346+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d1c0eb220 con 0x7f2d240c9270 2023-07-09T21:39:32.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:32.498+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d2415bf80 con 0x7f2d240c9270 2023-07-09T21:39:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.170+0000 7f2d1a7fc640 1 -- 172.21.15.37:0/2481457702 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d2415bf80 con 0x7f2d240c9270 2023-07-09T21:39:33.174 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:39:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 msgr2=0x7f2d08068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 0x7f2d08068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d20000c10 tx=0x7f2d20009040 comp rx=0 tx=0).stop 2023-07-09T21:39:33.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 msgr2=0x7f2d240b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c01dbe0 tx=0x7f2d10005800 comp rx=0 tx=0).stop 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 shutdown_connections 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f2d080663a0 0x7f2d08068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d240c9270 0x7f2d240b3310 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d240b4310 0x7f2d2415c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 --2- 172.21.15.37:0/2481457702 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d10005180 0x7f2d2414ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 >> 172.21.15.37:0/2481457702 conn(0x7f2d24073090 msgr2=0x7f2d240ce650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:33.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 shutdown_connections 2023-07-09T21:39:33.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.174+0000 7f2d2bd9f640 1 -- 172.21.15.37:0/2481457702 wait complete. 2023-07-09T21:39:33.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:39:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 Processor -- start 2023-07-09T21:39:33.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 -- start start 2023-07-09T21:39:33.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52040cfb40 0x7f52040cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52040b0540 0x7f52040cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040d0450 con 0x7f52040b1420 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040ce640 con 0x7f52040cfb40 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5209e76640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040ce080 con 0x7f52040b0540 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5208e74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52040cfb40 0x7f52040cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5208e74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52040cfb40 0x7f52040cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47224/0 (socket says 172.21.15.37:47224) 2023-07-09T21:39:33.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.342+0000 7f5208e74640 1 -- 172.21.15.37:0/1491582290 learned_addr learned my addr 172.21.15.37:0/1491582290 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:33.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5209675640 1 --2- 172.21.15.37:0/1491582290 >> v2:172.21.15.119:3300/0 conn(0x7f52040b0540 0x7f52040cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5208e74640 1 -- 172.21.15.37:0/1491582290 >> v2:172.21.15.119:3300/0 conn(0x7f52040b0540 msgr2=0x7f52040cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5208e74640 1 --2- 172.21.15.37:0/1491582290 >> v2:172.21.15.119:3300/0 conn(0x7f52040b0540 0x7f52040cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5208e74640 1 -- 172.21.15.37:0/1491582290 >> v1:172.21.15.119:6789/0 conn(0x7f52040b1420 legacy=0x7f52040cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:33.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5208e74640 1 -- 172.21.15.37:0/1491582290 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040ce360 con 0x7f52040cfb40 2023-07-09T21:39:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5208e74640 1 --2- 172.21.15.37:0/1491582290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040cfb40 0x7f52040cff10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f520408b4d0 tx=0x7f51f801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceed4efcc0076f3b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f52037fe640 1 -- 172.21.15.37:0/1491582290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80aa5f0 con 0x7f52040cfb40 2023-07-09T21:39:33.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f52037fe640 1 -- 172.21.15.37:0/1491582290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80aa750 con 0x7f52040cfb40 2023-07-09T21:39:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f52037fe640 1 -- 172.21.15.37:0/1491582290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80aaae0 con 0x7f52040cfb40 2023-07-09T21:39:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5209e76640 1 -- 172.21.15.37:0/1491582290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040cfb40 msgr2=0x7f52040cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.346+0000 7f5209e76640 1 --2- 172.21.15.37:0/1491582290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040cfb40 0x7f52040cff10 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f520408b4d0 tx=0x7f51f801c490 comp rx=0 tx=0).stop 2023-07-09T21:39:33.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- 172.21.15.37:0/1491582290 shutdown_connections 2023-07-09T21:39:33.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 --2- 172.21.15.37:0/1491582290 >> v2:172.21.15.119:3300/0 conn(0x7f52040b0540 0x7f52040cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 --2- 172.21.15.37:0/1491582290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040cfb40 0x7f52040cff10 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- 172.21.15.37:0/1491582290 >> 172.21.15.37:0/1491582290 conn(0x7f5204072d20 msgr2=0x7f52040d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- 172.21.15.37:0/1491582290 shutdown_connections 2023-07-09T21:39:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- 172.21.15.37:0/1491582290 wait complete. 2023-07-09T21:39:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 Processor -- start 2023-07-09T21:39:33.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- start start 2023-07-09T21:39:33.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 0x7f52040b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 0x7f52040c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040c6f20 con 0x7f52040b0540 2023-07-09T21:39:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b7340 con 0x7f52040b1420 2023-07-09T21:39:33.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209e76640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040b6a50 con 0x7f52040cfb40 2023-07-09T21:39:33.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47226/0 (socket says 172.21.15.37:47226) 2023-07-09T21:39:33.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 -- 172.21.15.37:0/81236908 learned_addr learned my addr 172.21.15.37:0/81236908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5203fff640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 0x7f52040b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209675640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 0x7f52040c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 -- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 msgr2=0x7f52040c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 0x7f52040c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 -- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 msgr2=0x7f52040b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 0x7f52040b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 -- 172.21.15.37:0/81236908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f80094d0 con 0x7f52040b0540 2023-07-09T21:39:33.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5203fff640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 0x7f52040b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5209675640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 0x7f52040c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:33.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.350+0000 7f5208e74640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f51f801a0c0 tx=0x7f51f801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b3800 con 0x7f52040b0540 2023-07-09T21:39:33.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80b3980 con 0x7f52040b0540 2023-07-09T21:39:33.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b3d30 con 0x7f52040b0540 2023-07-09T21:39:33.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040b62e0 con 0x7f52040b0540 2023-07-09T21:39:33.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040b6fd0 con 0x7f52040b0540 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520404e020 con 0x7f52040b0540 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f51f80b2380 con 0x7f52040b0540 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 0x7f51e8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f51f80a7070 con 0x7f52040b0540 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.354+0000 7f5203fff640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 0x7f51e8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.358+0000 7f5203fff640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 0x7f51e8068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f52040b2fc0 tx=0x7f51f0008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.358+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f51f80eb6b0 con 0x7f52040b0540 2023-07-09T21:39:33.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.510+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f52040cf890 con 0x7f52040b0540 2023-07-09T21:39:33.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f52017fa640 1 -- 172.21.15.37:0/81236908 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f51f80eecd0 con 0x7f52040b0540 2023-07-09T21:39:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 msgr2=0x7f51e8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 0x7f51e8068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f52040b2fc0 tx=0x7f51f0008040 comp rx=0 tx=0).stop 2023-07-09T21:39:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 msgr2=0x7f520415c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f51f801a0c0 tx=0x7f51f801acd0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 shutdown_connections 2023-07-09T21:39:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f51e80663a0 0x7f51e8068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52040cfb40 0x7f52040c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52040b1420 0x7f52040b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 --2- 172.21.15.37:0/81236908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52040b0540 0x7f520415c910 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 >> 172.21.15.37:0/81236908 conn(0x7f5204072d20 msgr2=0x7f52040cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 shutdown_connections 2023-07-09T21:39:33.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.518+0000 7f5209e76640 1 -- 172.21.15.37:0/81236908 wait complete. 2023-07-09T21:39:33.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:39:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 Processor -- start 2023-07-09T21:39:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 -- start start 2023-07-09T21:39:33.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f94b80b1420 0x7f94b80af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f94b80b0ed0 0x7f94b80afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94b80ce080 con 0x7f94b80cfb40 2023-07-09T21:39:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80ce640 con 0x7f94b80b0ed0 2023-07-09T21:39:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bec47640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b80ce360 con 0x7f94b80b1420 2023-07-09T21:39:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bdc45640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f94b80cfb40 0x7f94b80cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46960/0 (socket says 172.21.15.37:46960) 2023-07-09T21:39:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94bdc45640 1 -- 172.21.15.37:0/2632030888 learned_addr learned my addr 172.21.15.37:0/2632030888 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:33.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.682+0000 7f94be446640 1 --2- 172.21.15.37:0/2632030888 >> v2:172.21.15.37:3300/0 conn(0x7f94b80b0ed0 0x7f94b80afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bd444640 1 --2- 172.21.15.37:0/2632030888 >> v2:172.21.15.119:3300/0 conn(0x7f94b80b1420 0x7f94b80af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94be446640 1 -- 172.21.15.37:0/2632030888 >> v2:172.21.15.119:3300/0 conn(0x7f94b80b1420 msgr2=0x7f94b80af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:33.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94be446640 1 --2- 172.21.15.37:0/2632030888 >> v2:172.21.15.119:3300/0 conn(0x7f94b80b1420 0x7f94b80af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94be446640 1 -- 172.21.15.37:0/2632030888 >> v1:172.21.15.37:6789/0 conn(0x7f94b80cfb40 legacy=0x7f94b80cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94be446640 1 -- 172.21.15.37:0/2632030888 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b80aed30 con 0x7f94b80b0ed0 2023-07-09T21:39:33.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94be446640 1 --2- 172.21.15.37:0/2632030888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b0ed0 0x7f94b80afa70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f94b80716f0 tx=0x7f94b001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1c5e25c261f06 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bcc43640 1 -- 172.21.15.37:0/2632030888 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5960 con 0x7f94b80b0ed0 2023-07-09T21:39:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bcc43640 1 -- 172.21.15.37:0/2632030888 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b00a5ac0 con 0x7f94b80b0ed0 2023-07-09T21:39:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bcc43640 1 -- 172.21.15.37:0/2632030888 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00a5e50 con 0x7f94b80b0ed0 2023-07-09T21:39:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 -- 172.21.15.37:0/2632030888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b0ed0 msgr2=0x7f94b80afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 --2- 172.21.15.37:0/2632030888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b0ed0 0x7f94b80afa70 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f94b80716f0 tx=0x7f94b001c8e0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 -- 172.21.15.37:0/2632030888 shutdown_connections 2023-07-09T21:39:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 --2- 172.21.15.37:0/2632030888 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80b0ed0 0x7f94b80afa70 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 --2- 172.21.15.37:0/2632030888 >> v2:172.21.15.119:3300/0 conn(0x7f94b80b1420 0x7f94b80af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.686+0000 7f94bec47640 1 -- 172.21.15.37:0/2632030888 >> 172.21.15.37:0/2632030888 conn(0x7f94b8072d20 msgr2=0x7f94b80d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- 172.21.15.37:0/2632030888 shutdown_connections 2023-07-09T21:39:33.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- 172.21.15.37:0/2632030888 wait complete. 2023-07-09T21:39:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 Processor -- start 2023-07-09T21:39:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- start start 2023-07-09T21:39:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b80b0ed0 0x7f94b81519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1420 0x7f94b8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80b50c0 con 0x7f94b80cfb40 2023-07-09T21:39:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8151f10 con 0x7f94b80b0ed0 2023-07-09T21:39:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bec47640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b80c6550 con 0x7f94b80b1420 2023-07-09T21:39:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47244/0 (socket says 172.21.15.37:47244) 2023-07-09T21:39:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 -- 172.21.15.37:0/1126392231 learned_addr learned my addr 172.21.15.37:0/1126392231 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bd444640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1420 0x7f94b8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94bdc45640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b80b0ed0 0x7f94b81519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 -- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1420 msgr2=0x7f94b8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1420 0x7f94b8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 -- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b80b0ed0 msgr2=0x7f94b81519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b80b0ed0 0x7f94b81519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 -- 172.21.15.37:0/1126392231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b0009a70 con 0x7f94b80cfb40 2023-07-09T21:39:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.690+0000 7f94be446640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f94b001a510 tx=0x7f94b0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00aee10 con 0x7f94b80cfb40 2023-07-09T21:39:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94b0009450 con 0x7f94b80cfb40 2023-07-09T21:39:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b00b7650 con 0x7f94b80cfb40 2023-07-09T21:39:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b80c67f0 con 0x7f94b80cfb40 2023-07-09T21:39:33.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b80c6db0 con 0x7f94b80cfb40 2023-07-09T21:39:33.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b804e020 con 0x7f94b80cfb40 2023-07-09T21:39:33.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f94b00b4050 con 0x7f94b80cfb40 2023-07-09T21:39:33.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 0x7f949c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:33.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.694+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f94b011e980 con 0x7f94b80cfb40 2023-07-09T21:39:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.698+0000 7f94bdc45640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 0x7f949c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.698+0000 7f94bdc45640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 0x7f949c068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f70 tx=0x7f94b4007e90 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:33.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.698+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94b00ebd20 con 0x7f94b80cfb40 2023-07-09T21:39:33.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.854+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f94b80cd9b0 con 0x7f94b80cfb40 2023-07-09T21:39:33.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.858+0000 7f94ae7fc640 1 -- 172.21.15.37:0/1126392231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v32) v1 ==== 120+0+0 (secure 0 0 0) 0x7f94b00ef340 con 0x7f94b80cfb40 2023-07-09T21:39:33.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.858+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 msgr2=0x7f949c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.858+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 0x7f949c068880 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94b4000f70 tx=0x7f94b4007e90 comp rx=0 tx=0).stop 2023-07-09T21:39:33.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.858+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 msgr2=0x7f94b8159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.858+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f94b001a510 tx=0x7f94b0019680 comp rx=0 tx=0).stop 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 shutdown_connections 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f949c0663d0 0x7f949c068880 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f94b80cfb40 0x7f94b8159120 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94b80b1420 0x7f94b8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 --2- 172.21.15.37:0/1126392231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f94b80b0ed0 0x7f94b81519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:33.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 >> 172.21.15.37:0/1126392231 conn(0x7f94b8072d20 msgr2=0x7f94b806ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 shutdown_connections 2023-07-09T21:39:33.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:33.862+0000 7f94bec47640 1 -- 172.21.15.37:0/1126392231 wait complete. 2023-07-09T21:39:33.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.022+0000 7fe64818f640 1 Processor -- start 2023-07-09T21:39:34.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.022+0000 7fe64818f640 1 -- start start 2023-07-09T21:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64818f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6400cf290 0x7fe640160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64818f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400d0780 0x7fe6400d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64818f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe64015bf80 con 0x7fe6400b7980 2023-07-09T21:39:34.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64818f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400cd070 con 0x7fe6400cf290 2023-07-09T21:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64818f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400cfd70 con 0x7fe6400d0780 2023-07-09T21:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6400cf290 0x7fe640160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe6400cf290 0x7fe640160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47250/0 (socket says 172.21.15.37:47250) 2023-07-09T21:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 -- 172.21.15.37:0/2956895543 learned_addr learned my addr 172.21.15.37:0/2956895543 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:34.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 -- 172.21.15.37:0/2956895543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400d0780 msgr2=0x7fe6400d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 --2- 172.21.15.37:0/2956895543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400d0780 0x7fe6400d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 -- 172.21.15.37:0/2956895543 >> v1:172.21.15.119:6789/0 conn(0x7fe6400b7980 legacy=0x7fe6400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 -- 172.21.15.37:0/2956895543 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640160570 con 0x7fe6400cf290 2023-07-09T21:39:34.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe64572a640 1 --2- 172.21.15.37:0/2956895543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400cf290 0x7fe640160030 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe630009870 tx=0x7fe63001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5357b41ff91769 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.026+0000 7fe644f29640 1 -- 172.21.15.37:0/2956895543 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300ab600 con 0x7fe6400cf290 2023-07-09T21:39:34.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe644f29640 1 -- 172.21.15.37:0/2956895543 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6300a7050 con 0x7fe6400cf290 2023-07-09T21:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe644f29640 1 -- 172.21.15.37:0/2956895543 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6300ab980 con 0x7fe6400cf290 2023-07-09T21:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- 172.21.15.37:0/2956895543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400cf290 msgr2=0x7fe640160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- 172.21.15.37:0/2956895543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400cf290 0x7fe640160030 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe630009870 tx=0x7fe63001c540 comp rx=0 tx=0).stop 2023-07-09T21:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- 172.21.15.37:0/2956895543 shutdown_connections 2023-07-09T21:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- 172.21.15.37:0/2956895543 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400d0780 0x7fe6400d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- 172.21.15.37:0/2956895543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400cf290 0x7fe640160030 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- 172.21.15.37:0/2956895543 >> 172.21.15.37:0/2956895543 conn(0x7fe640073090 msgr2=0x7fe640069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- 172.21.15.37:0/2956895543 shutdown_connections 2023-07-09T21:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- 172.21.15.37:0/2956895543 wait complete. 2023-07-09T21:39:34.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 Processor -- start 2023-07-09T21:39:34.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- start start 2023-07-09T21:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 0x7fe6400b2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 0x7fe6401520c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400c7ac0 con 0x7fe6400d0780 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400c8be0 con 0x7fe6400cf290 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64818f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400b3600 con 0x7fe6400b7980 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64672c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64672c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47254/0 (socket says 172.21.15.37:47254) 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64672c640 1 -- 172.21.15.37:0/1905028922 learned_addr learned my addr 172.21.15.37:0/1905028922 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:34.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe64572a640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 0x7fe6401520c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.030+0000 7fe645f2b640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 0x7fe6400b2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 -- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 msgr2=0x7fe6400b2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 0x7fe6400b2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 -- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 msgr2=0x7fe6401520c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 0x7fe6401520c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 -- 172.21.15.37:0/1905028922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300094d0 con 0x7fe6400d0780 2023-07-09T21:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe645f2b640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 0x7fe6400b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64572a640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 0x7fe6401520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64672c640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b970 tx=0x7fe63800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63800cb40 con 0x7fe6400d0780 2023-07-09T21:39:34.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63800ccc0 con 0x7fe6400d0780 2023-07-09T21:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe638014680 con 0x7fe6400d0780 2023-07-09T21:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6400b38e0 con 0x7fe6400d0780 2023-07-09T21:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6400b3ea0 con 0x7fe6400d0780 2023-07-09T21:39:34.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe64004d7d0 con 0x7fe6400d0780 2023-07-09T21:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe63801d3b0 con 0x7fe6400d0780 2023-07-09T21:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 0x7fe624068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.034+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fe638083f10 con 0x7fe6400d0780 2023-07-09T21:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.038+0000 7fe645f2b640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 0x7fe624068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.038+0000 7fe645f2b640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 0x7fe624068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe63c000f70 tx=0x7fe63c009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.038+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe638051180 con 0x7fe6400d0780 2023-07-09T21:39:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.210+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fe6400b1600 con 0x7fe6400d0780 2023-07-09T21:39:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe6367fc640 1 -- 172.21.15.37:0/1905028922 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v33) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe6380190b0 con 0x7fe6400d0780 2023-07-09T21:39:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 msgr2=0x7fe624068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 0x7fe624068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe63c000f70 tx=0x7fe63c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 msgr2=0x7fe6400b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fe63800b970 tx=0x7fe63800be30 comp rx=0 tx=0).stop 2023-07-09T21:39:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 shutdown_connections 2023-07-09T21:39:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe6240663a0 0x7fe624068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6400d0780 0x7fe6400b5240 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6400cf290 0x7fe6401520c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 --2- 172.21.15.37:0/1905028922 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6400b7980 0x7fe6400b2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 >> 172.21.15.37:0/1905028922 conn(0x7fe640073090 msgr2=0x7fe6400ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 shutdown_connections 2023-07-09T21:39:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.218+0000 7fe64818f640 1 -- 172.21.15.37:0/1905028922 wait complete. 2023-07-09T21:39:34.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list' 2023-07-09T21:39:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.382+0000 7fecd4a6d640 1 Processor -- start 2023-07-09T21:39:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.382+0000 7fecd4a6d640 1 -- start start 2023-07-09T21:39:34.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecd4a6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 0x7fecd006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecd4a6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecd00cef80 0x7fecd00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecd4a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd00b49f0 con 0x7fecd00b4170 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecd4a6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd00b7e80 con 0x7fecd00cef80 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecd4a6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd00b45f0 con 0x7fecd00b7ab0 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecd00cef80 0x7fecd00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fecd00cef80 0x7fecd00b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47258/0 (socket says 172.21.15.37:47258) 2023-07-09T21:39:34.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 -- 172.21.15.37:0/1929934323 learned_addr learned my addr 172.21.15.37:0/1929934323 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:34.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecce59c640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 0x7fecd006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 -- 172.21.15.37:0/1929934323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 msgr2=0x7fecd006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:34.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 0x7fecd006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 -- 172.21.15.37:0/1929934323 >> v1:172.21.15.37:6789/0 conn(0x7fecd00b4170 legacy=0x7fecd015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7feccdd9b640 1 -- 172.21.15.37:0/1929934323 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00cc8a0 con 0x7fecd00cef80 2023-07-09T21:39:34.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.386+0000 7fecce59c640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 0x7fecd006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:34.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7feccdd9b640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00cef80 0x7fecd00b3c30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e81dfcfdf124dba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7feccd59a640 1 -- 172.21.15.37:0/1929934323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40aa670 con 0x7fecd00cef80 2023-07-09T21:39:34.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7feccd59a640 1 -- 172.21.15.37:0/1929934323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40aa7d0 con 0x7fecd00cef80 2023-07-09T21:39:34.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7feccd59a640 1 -- 172.21.15.37:0/1929934323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40aab60 con 0x7fecd00cef80 2023-07-09T21:39:34.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- 172.21.15.37:0/1929934323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00cef80 msgr2=0x7fecd00b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00cef80 0x7fecd00b3c30 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009870 tx=0x7fecc401c510 comp rx=0 tx=0).stop 2023-07-09T21:39:34.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- 172.21.15.37:0/1929934323 shutdown_connections 2023-07-09T21:39:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00cef80 0x7fecd00b3c30 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/1929934323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b7ab0 0x7fecd006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- 172.21.15.37:0/1929934323 >> 172.21.15.37:0/1929934323 conn(0x7fecd0073090 msgr2=0x7fecd0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- 172.21.15.37:0/1929934323 shutdown_connections 2023-07-09T21:39:34.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- 172.21.15.37:0/1929934323 wait complete. 2023-07-09T21:39:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 Processor -- start 2023-07-09T21:39:34.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.390+0000 7fecd4a6d640 1 -- start start 2023-07-09T21:39:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b4170 0x7fecd00cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd00cef80 0x7fecd0156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0155a40 con 0x7fecd00b7ab0 2023-07-09T21:39:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0155c90 con 0x7fecd00cef80 2023-07-09T21:39:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd0155f70 con 0x7fecd00b4170 2023-07-09T21:39:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47270/0 (socket says 172.21.15.37:47270) 2023-07-09T21:39:34.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 -- 172.21.15.37:0/3605307998 learned_addr learned my addr 172.21.15.37:0/3605307998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 -- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b4170 msgr2=0x7fecd00cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b4170 0x7fecd00cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 -- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd00cef80 msgr2=0x7fecd0156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd00cef80 0x7fecd0156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 -- 172.21.15.37:0/3605307998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc40094d0 con 0x7fecd00b7ab0 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7feccdd9b640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fecc401a140 tx=0x7fecc401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b3800 con 0x7fecd00b7ab0 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40b3960 con 0x7fecd00b7ab0 2023-07-09T21:39:34.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd0156250 con 0x7fecd00b7ab0 2023-07-09T21:39:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40b3d10 con 0x7fecd00b7ab0 2023-07-09T21:39:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd00cc150 con 0x7fecd00b7ab0 2023-07-09T21:39:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.394+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd004d7d0 con 0x7fecd00b7ab0 2023-07-09T21:39:34.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.398+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fecc40c6390 con 0x7fecd00b7ab0 2023-07-09T21:39:34.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.398+0000 7fecbeffd640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 0x7fecb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:34.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.398+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fecc411eca0 con 0x7fecd00b7ab0 2023-07-09T21:39:34.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.398+0000 7fecce59c640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 0x7fecb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:34.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.398+0000 7fecce59c640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 0x7fecb0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006e90 tx=0x7fecc0008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:34.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.402+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecc40ebdf0 con 0x7fecd00b7ab0 2023-07-09T21:39:34.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:34.610+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]} v 0) v1 -- 0x7fecd00d2d70 con 0x7fecd00b7ab0 2023-07-09T21:39:35.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.174+0000 7fecbeffd640 1 -- 172.21.15.37:0/3605307998 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_non_existent_snap_schedule_list"]}]=0 v643) v1 ==== 166+0+0 (secure 0 0 0) 0x7fecc40ef410 con 0x7fecd00b7ab0 2023-07-09T21:39:35.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 msgr2=0x7fecb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 0x7fecb0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecc0006e90 tx=0x7fecc0008040 comp rx=0 tx=0).stop 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 msgr2=0x7fecd00c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fecc401a140 tx=0x7fecc401ad50 comp rx=0 tx=0).stop 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 shutdown_connections 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fecb00663a0 0x7fecb0068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd00cef80 0x7fecd0156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd00b7ab0 0x7fecd00c5450 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 --2- 172.21.15.37:0/3605307998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd00b4170 0x7fecd00cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 >> 172.21.15.37:0/3605307998 conn(0x7fecd0073090 msgr2=0x7fecd00b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:35.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 shutdown_connections 2023-07-09T21:39:35.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.178+0000 7fecd4a6d640 1 -- 172.21.15.37:0/3605307998 wait complete. 2023-07-09T21:39:35.203 INFO:tasks.cephfs_test_runner:Test listing snap schedules on a non-existing filesystem path failure ... ok 2023-07-09T21:39:35.203 INFO:tasks.cephfs_test_runner:Starting test: test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:39:35.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-09T21:39:35.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 Processor -- start 2023-07-09T21:39:35.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 -- start start 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 0x7ff52c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c0b0ad0 con 0x7ff52c15bc30 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52c15f620 con 0x7ff52c15b860 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff532e18640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c15f990 con 0x7ff52c069bd0 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff52bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff52c15bc30 0x7ff52c0694c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46980/0 (socket says 172.21.15.37:46980) 2023-07-09T21:39:35.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff52bfff640 1 -- 172.21.15.37:0/1912482770 learned_addr learned my addr 172.21.15.37:0/1912482770 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:35.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff5313b5640 1 --2- 172.21.15.37:0/1912482770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 0x7ff52c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 69872833 0 0) 0x7ff52c0b0ad0 con 0x7ff52c15bc30 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff51c003530 con 0x7ff52c15bc30 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.350+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226616520 0 0) 0x7ff52c15f620 con 0x7ff52c15b860 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff52c0b0ad0 con 0x7ff52c15b860 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff5313b5640 1 -- 172.21.15.37:0/1912482770 >> v1:172.21.15.119:6789/0 conn(0x7ff52c15b860 legacy=0x7ff52c15fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 124467155 0 0) 0x7ff51c003530 con 0x7ff52c15bc30 2023-07-09T21:39:35.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff5313b5640 1 -- 172.21.15.37:0/1912482770 >> v1:172.21.15.37:6789/0 conn(0x7ff52c15bc30 legacy=0x7ff52c0694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff5313b5640 1 -- 172.21.15.37:0/1912482770 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c1604c0 con 0x7ff52c069bd0 2023-07-09T21:39:35.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff5313b5640 1 --2- 172.21.15.37:0/1912482770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 0x7ff52c0b4270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff524009dc0 tx=0x7ff52401c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a558626205f39c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:35.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518001680 con 0x7ff52c069bd0 2023-07-09T21:39:35.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5240a5590 con 0x7ff52c069bd0 2023-07-09T21:39:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff52b7fe640 1 -- 172.21.15.37:0/1912482770 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5240a5920 con 0x7ff52c069bd0 2023-07-09T21:39:35.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 -- 172.21.15.37:0/1912482770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 msgr2=0x7ff52c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 --2- 172.21.15.37:0/1912482770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 0x7ff52c0b4270 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff524009dc0 tx=0x7ff52401c770 comp rx=0 tx=0).stop 2023-07-09T21:39:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 -- 172.21.15.37:0/1912482770 shutdown_connections 2023-07-09T21:39:35.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 --2- 172.21.15.37:0/1912482770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c069bd0 0x7ff52c0b4270 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 -- 172.21.15.37:0/1912482770 >> 172.21.15.37:0/1912482770 conn(0x7ff52c0ce630 msgr2=0x7ff52c0cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:35.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 -- 172.21.15.37:0/1912482770 shutdown_connections 2023-07-09T21:39:35.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.354+0000 7ff532e18640 1 -- 172.21.15.37:0/1912482770 wait complete. 2023-07-09T21:39:35.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 Processor -- start 2023-07-09T21:39:35.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 -- start start 2023-07-09T21:39:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c15b860 0x7ff52c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:35.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52c15bc30 0x7ff52c14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c15c9a0 con 0x7ff52c069bd0 2023-07-09T21:39:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c153ca0 con 0x7ff52c15bc30 2023-07-09T21:39:35.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff532e18640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52c153090 con 0x7ff52c15b860 2023-07-09T21:39:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:35.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47272/0 (socket says 172.21.15.37:47272) 2023-07-09T21:39:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 -- 172.21.15.37:0/610357361 learned_addr learned my addr 172.21.15.37:0/610357361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff52bfff640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c15b860 0x7ff52c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff5313b5640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52c15bc30 0x7ff52c14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:35.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 -- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c15b860 msgr2=0x7ff52c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c15b860 0x7ff52c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 -- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52c15bc30 msgr2=0x7ff52c14aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52c15bc30 0x7ff52c14aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 -- 172.21.15.37:0/610357361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524009a70 con 0x7ff52c069bd0 2023-07-09T21:39:35.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.358+0000 7ff530bb4640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c490 tx=0x7ff52000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200052d0 con 0x7ff52c069bd0 2023-07-09T21:39:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520005430 con 0x7ff52c069bd0 2023-07-09T21:39:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff52c153370 con 0x7ff52c069bd0 2023-07-09T21:39:35.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff520003840 con 0x7ff52c069bd0 2023-07-09T21:39:35.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52c153930 con 0x7ff52c069bd0 2023-07-09T21:39:35.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52c04d7d0 con 0x7ff52c069bd0 2023-07-09T21:39:35.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5200039a0 con 0x7ff52c069bd0 2023-07-09T21:39:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 0x7ff510068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7ff520083570 con 0x7ff52c069bd0 2023-07-09T21:39:35.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.362+0000 7ff52bfff640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 0x7ff510068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:35.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.366+0000 7ff52bfff640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 0x7ff510068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff52c15a190 tx=0x7ff518009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:35.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.366+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff520050860 con 0x7ff52c069bd0 2023-07-09T21:39:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:35.578+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7ff52c154670 con 0x7ff52c069bd0 2023-07-09T21:39:36.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.178+0000 7ff5297fa640 1 -- 172.21.15.37:0/610357361 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v644) v1 ==== 186+0+0 (secure 0 0 0) 0x7ff520053e80 con 0x7ff52c069bd0 2023-07-09T21:39:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 msgr2=0x7ff510068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 0x7ff510068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff52c15a190 tx=0x7ff518009040 comp rx=0 tx=0).stop 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 msgr2=0x7ff52c154130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c490 tx=0x7ff52000c950 comp rx=0 tx=0).stop 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 shutdown_connections 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff5100663a0 0x7ff510068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff52c15bc30 0x7ff52c14aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff52c15b860 0x7ff52c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 --2- 172.21.15.37:0/610357361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff52c069bd0 0x7ff52c154130 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 >> 172.21.15.37:0/610357361 conn(0x7ff52c0ce630 msgr2=0x7ff52c0b2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 shutdown_connections 2023-07-09T21:39:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.182+0000 7ff532e18640 1 -- 172.21.15.37:0/610357361 wait complete. 2023-07-09T21:39:36.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:39:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.354+0000 7fe068b3a640 1 Processor -- start 2023-07-09T21:39:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.354+0000 7fe068b3a640 1 -- start start 2023-07-09T21:39:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.354+0000 7fe068b3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe068b3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe06415bf80 con 0x7fe0640b7980 2023-07-09T21:39:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe068b3a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe064160570 con 0x7fe0640d0780 2023-07-09T21:39:36.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe068b3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640cd070 con 0x7fe0640cf290 2023-07-09T21:39:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe06259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0640b7980 0x7fe0640ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46988/0 (socket says 172.21.15.37:46988) 2023-07-09T21:39:36.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe06259c640 1 -- 172.21.15.37:0/3605070799 learned_addr learned my addr 172.21.15.37:0/3605070799 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035023057 0 0) 0x7fe054001120 con 0x7fe0640b7980 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe050003530 con 0x7fe0640b7980 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4085413922 0 0) 0x7fe050003530 con 0x7fe0640b7980 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 msgr2=0x7fe064160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe064160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 >> v1:172.21.15.119:6789/0 conn(0x7fe0640d0780 legacy=0x7fe0640d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640d02f0 con 0x7fe0640b7980 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe054001810 con 0x7fe0640b7980 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 >> v1:172.21.15.37:6789/0 conn(0x7fe0640b7980 legacy=0x7fe0640ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0500039b0 0x7fe050003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe050004350 0x7fe050004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe050005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640cd070 con 0x7fe050004350 2023-07-09T21:39:36.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05000b990 con 0x7fe0500039b0 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05000bb50 con 0x7fe0640cf290 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe050004350 0x7fe050004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe06259c640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0500039b0 0x7fe050003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe062d9d640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe050005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 -- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 msgr2=0x7fe050005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0640cf290 0x7fe050005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 -- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0500039b0 msgr2=0x7fe050003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0500039b0 0x7fe050003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe05bfff640 1 -- 172.21.15.37:0/3605070799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050003530 con 0x7fe050004350 2023-07-09T21:39:36.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.358+0000 7fe06259c640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0500039b0 0x7fe050003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe050004350 0x7fe050004810 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ae0 tx=0x7fe04c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a44be2a05303bcd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0a5640 con 0x7fe050004350 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c0a57a0 con 0x7fe050004350 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe061d9b640 1 -- 172.21.15.37:0/3605070799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0a5b50 con 0x7fe050004350 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- 172.21.15.37:0/3605070799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe050004350 msgr2=0x7fe050004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3605070799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe050004350 0x7fe050004810 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ae0 tx=0x7fe04c01ca50 comp rx=0 tx=0).stop 2023-07-09T21:39:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe062d9d640 1 -- 172.21.15.37:0/3605070799 reap_dead start 2023-07-09T21:39:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- 172.21.15.37:0/3605070799 shutdown_connections 2023-07-09T21:39:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- 172.21.15.37:0/3605070799 >> 172.21.15.37:0/3605070799 conn(0x7fe064073090 msgr2=0x7fe064069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- 172.21.15.37:0/3605070799 shutdown_connections 2023-07-09T21:39:36.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- 172.21.15.37:0/3605070799 wait complete. 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 Processor -- start 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.362+0000 7fe068b3a640 1 -- start start 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe050004350 0x7fe0641507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 0x7fe0640b6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c9ca0 con 0x7fe0640cad40 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640c9f80 con 0x7fe0640c97b0 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0640ca260 con 0x7fe050004350 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47288/0 (socket says 172.21.15.37:47288) 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 -- 172.21.15.37:0/3848610413 learned_addr learned my addr 172.21.15.37:0/3848610413 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe062d9d640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 0x7fe0640b6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe06259c640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe050004350 0x7fe0641507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 -- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe050004350 msgr2=0x7fe0641507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe050004350 0x7fe0641507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 -- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 msgr2=0x7fe0640b6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 0x7fe0640b6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 -- 172.21.15.37:0/3848610413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0640ca540 con 0x7fe0640cad40 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe062d9d640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 0x7fe0640b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05bfff640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ae0 tx=0x7fe050005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c004230 con 0x7fe0640cad40 2023-07-09T21:39:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04c004390 con 0x7fe0640cad40 2023-07-09T21:39:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0640ca820 con 0x7fe0640cad40 2023-07-09T21:39:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04c0ad850 con 0x7fe0640cad40 2023-07-09T21:39:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0640c8ba0 con 0x7fe0640cad40 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06404d7d0 con 0x7fe0640cad40 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.366+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe04c0b4040 con 0x7fe0640cad40 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.370+0000 7fe05affd640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 0x7fe044068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.370+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7fe04c11e6d0 con 0x7fe0640cad40 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.370+0000 7fe06259c640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 0x7fe044068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.370+0000 7fe06259c640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 0x7fe044068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe0540013a0 tx=0x7fe054009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.374+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe04c0ebb00 con 0x7fe0640cad40 2023-07-09T21:39:36.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.526+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe0640b1600 con 0x7fe0640cad40 2023-07-09T21:39:36.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.530+0000 7fe05affd640 1 -- 172.21.15.37:0/3848610413 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe04c0ef120 con 0x7fe0640cad40 2023-07-09T21:39:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 msgr2=0x7fe044068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 0x7fe044068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe0540013a0 tx=0x7fe054009040 comp rx=0 tx=0).stop 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 msgr2=0x7fe0640c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009ae0 tx=0x7fe050005800 comp rx=0 tx=0).stop 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 shutdown_connections 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe0440663a0 0x7fe044068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0640c97b0 0x7fe0640b6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0640cad40 0x7fe0640c9270 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 --2- 172.21.15.37:0/3848610413 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe050004350 0x7fe0641507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 >> 172.21.15.37:0/3848610413 conn(0x7fe064073090 msgr2=0x7fe0640d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 shutdown_connections 2023-07-09T21:39:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.534+0000 7fe068b3a640 1 -- 172.21.15.37:0/3848610413 wait complete. 2023-07-09T21:39:36.555 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:39:36.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:39:36.602 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:39:36.663 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:39:36.663 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:39:36.664 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:36.674 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:39:36.674 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:39:36.675 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:36.684 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:39:36.685 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:39:36.686 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:36.723 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:39:36.724 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:39:36.724 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:39:36.736 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:39:36.737 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:39:36.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:36.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 Processor -- start 2023-07-09T21:39:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 -- start start 2023-07-09T21:39:36.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d4c166710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0ccd40 con 0x7f7d4c0b7810 2023-07-09T21:39:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0ce680 con 0x7f7d4c0ce1a0 2023-07-09T21:39:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d50d70640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cc5a0 con 0x7f7d4c06a450 2023-07-09T21:39:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d4c0b7810 0x7f7d4c15fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47000/0 (socket says 172.21.15.37:47000) 2023-07-09T21:39:36.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4b7fe640 1 -- 172.21.15.37:0/2436581895 learned_addr learned my addr 172.21.15.37:0/2436581895 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4bfff640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d4c166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213466111 0 0) 0x7f7d4c0ccd40 con 0x7f7d4c0b7810 2023-07-09T21:39:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d34003530 con 0x7f7d4c0b7810 2023-07-09T21:39:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511088148 0 0) 0x7f7d4c0ce680 con 0x7f7d4c0ce1a0 2023-07-09T21:39:36.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d4c0ccd40 con 0x7f7d4c0ce1a0 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602477481 0 0) 0x7f7d34003530 con 0x7f7d4c0b7810 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 msgr2=0x7f7d4c166710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d4c166710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 >> v1:172.21.15.119:6789/0 conn(0x7f7d4c0ce1a0 legacy=0x7f7d4c069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cc780 con 0x7f7d4c0b7810 2023-07-09T21:39:36.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7d3c001680 con 0x7f7d4c0b7810 2023-07-09T21:39:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 >> v1:172.21.15.37:6789/0 conn(0x7f7d4c0b7810 legacy=0x7f7d4c15fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d34003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d340040a0 0x7f7d340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d34004d10 0x7f7d34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cc5a0 con 0x7f7d34004d10 2023-07-09T21:39:36.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3400ba40 con 0x7f7d340040a0 2023-07-09T21:39:36.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.906+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3400bc00 con 0x7f7d4c06a450 2023-07-09T21:39:36.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d34004d10 0x7f7d34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4b7fe640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d34003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4affd640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d340040a0 0x7f7d340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 -- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 msgr2=0x7f7d34003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d4c06a450 0x7f7d34003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 -- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d340040a0 msgr2=0x7f7d340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d340040a0 0x7f7d340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 -- 172.21.15.37:0/2436581895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34003530 con 0x7f7d34004d10 2023-07-09T21:39:36.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d34004d10 0x7f7d34005180 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f90 tx=0x7f7d4401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b983815feb3a513b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c007ea0 con 0x7f7d34004d10 2023-07-09T21:39:36.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4400f040 con 0x7f7d34004d10 2023-07-09T21:39:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4a7fc640 1 -- 172.21.15.37:0/2436581895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d440a5d60 con 0x7f7d34004d10 2023-07-09T21:39:36.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d50d70640 1 -- 172.21.15.37:0/2436581895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d34004d10 msgr2=0x7f7d34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d50d70640 1 --2- 172.21.15.37:0/2436581895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d34004d10 0x7f7d34005180 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f7d44009f90 tx=0x7f7d4401cc20 comp rx=0 tx=0).stop 2023-07-09T21:39:36.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.910+0000 7f7d4bfff640 1 -- 172.21.15.37:0/2436581895 reap_dead start 2023-07-09T21:39:36.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- 172.21.15.37:0/2436581895 shutdown_connections 2023-07-09T21:39:36.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- 172.21.15.37:0/2436581895 >> 172.21.15.37:0/2436581895 conn(0x7f7d4c0cea60 msgr2=0x7f7d4c0cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:36.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- 172.21.15.37:0/2436581895 shutdown_connections 2023-07-09T21:39:36.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- 172.21.15.37:0/2436581895 wait complete. 2023-07-09T21:39:36.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 Processor -- start 2023-07-09T21:39:36.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- start start 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d34004d10 0x7f7d4c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c1e6a40 0x7f7d4c15adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1e6050 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1e53d0 con 0x7f7d4c1e6a40 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d50d70640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1e56b0 con 0x7f7d34004d10 2023-07-09T21:39:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47296/0 (socket says 172.21.15.37:47296) 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 -- 172.21.15.37:0/3348450252 learned_addr learned my addr 172.21.15.37:0/3348450252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 -- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d34004d10 msgr2=0x7f7d4c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d34004d10 0x7f7d4c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 -- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c1e6a40 msgr2=0x7f7d4c15adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c1e6a40 0x7f7d4c15adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 -- 172.21.15.37:0/3348450252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c1e5990 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.914+0000 7f7d4affd640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000f770 tx=0x7f7d4000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d400014b0 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4000fe80 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4000d6b0 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1e5c70 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0b4460 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c04e020 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7d4000d810 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 0x7f7d38068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f7d40083f30 con 0x7f7d4c1e4ed0 2023-07-09T21:39:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.918+0000 7f7d4b7fe640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 0x7f7d38068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:36.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.922+0000 7f7d4b7fe640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 0x7f7d38068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c004880 tx=0x7f7d3c0047f0 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:36.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:36.922+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d400512a0 con 0x7f7d4c1e4ed0 2023-07-09T21:39:37.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7d4c06bfa0 con 0x7f7d4c1e4ed0 2023-07-09T21:39:37.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d33fff640 1 -- 172.21.15.37:0/3348450252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f7d400548c0 con 0x7f7d4c1e4ed0 2023-07-09T21:39:37.113 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:37.113 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1417197074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1417197074},{"type":"v1","addr":"172.21.15.119:6837","nonce":1417197074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6689,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/2764879759","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2764879759},{"type":"v1","addr":"172.21.15.119:6836","nonce":2764879759}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42},{"gid":7326,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/277724522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":277724522},{"type":"v1","addr":"172.21.15.37:6833","nonce":277724522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":7338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/597608215","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":597608215},{"type":"v1","addr":"172.21.15.37:6835","nonce":597608215}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-07-09T21:39:37.113 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 42 2023-07-09T21:39:37.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 msgr2=0x7f7d38068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 0x7f7d38068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c004880 tx=0x7f7d3c0047f0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 msgr2=0x7f7d4c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f7d4000f770 tx=0x7f7d4000fc30 comp rx=0 tx=0).stop 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 shutdown_connections 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7d380663a0 0x7f7d38068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d4c1e6a40 0x7f7d4c15adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d4c1e4ed0 0x7f7d4c15a870 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 --2- 172.21.15.37:0/3348450252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d34004d10 0x7f7d4c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 >> 172.21.15.37:0/3348450252 conn(0x7f7d4c0cea60 msgr2=0x7f7d4c0b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 shutdown_connections 2023-07-09T21:39:37.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.110+0000 7f7d50d70640 1 -- 172.21.15.37:0/3348450252 wait complete. 2023-07-09T21:39:37.134 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:39:37.135 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:39:37.135 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:39:37.135 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:39:37.136 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:39:37.136 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:39:37.136 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:39:37.136 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:39:37.137 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:39:37.137 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:39:37.137 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:39:37.137 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:39:37.139 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:39:37.139 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:39:37.139 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:39:37.139 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:39:37.148 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:39:37.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:39:37.149 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:39:37.150 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:39:37.153 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:39:37.153 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:39:37.154 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:39:37.155 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:39:37.194 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:39:37.194 DEBUG:teuthology.parallel:result is None 2023-07-09T21:39:37.196 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:39:37.196 DEBUG:teuthology.parallel:result is None 2023-07-09T21:39:37.202 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:39:37.202 DEBUG:teuthology.parallel:result is None 2023-07-09T21:39:37.204 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:39:37.205 DEBUG:teuthology.parallel:result is None 2023-07-09T21:39:37.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:39:37.283 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:39:37.284 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:39:37.297 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:39:37.298 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:39:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.350+0000 7f3c37f82640 1 Processor -- start 2023-07-09T21:39:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 -- start start 2023-07-09T21:39:37.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-07-09T21:39:37.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-07-09T21:39:37.357 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-07-09T21:39:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 0x7f3c3006b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3c3006bd50 0x7f3c300cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c301592f0 con 0x7f3c30156320 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c301566f0 con 0x7f3c3006bd50 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c37f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3006c1d0 con 0x7f3c30159780 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3551d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 0x7f3c3006b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3c3006bd50 0x7f3c300cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3c3006bd50 0x7f3c300cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:38254/0 (socket says 172.21.15.37:38254) 2023-07-09T21:39:37.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 -- 172.21.15.37:0/1275185177 learned_addr learned my addr 172.21.15.37:0/1275185177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3551d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 0x7f3c3006b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:49732/0 (socket says 172.21.15.37:49732) 2023-07-09T21:39:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 -- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 msgr2=0x7f3c3006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 --2- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 0x7f3c3006b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 -- 172.21.15.37:0/1275185177 >> v1:172.21.15.119:6789/0 conn(0x7f3c30156320 legacy=0x7f3c30070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.354+0000 7f3c3651f640 1 -- 172.21.15.37:0/1275185177 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c30159bb0 con 0x7f3c3006bd50 2023-07-09T21:39:37.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c3651f640 1 --2- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c3006bd50 0x7f3c300cd620 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800d150 tx=0x7f3c2801ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3849b867fee31d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c34d1c640 1 -- 172.21.15.37:0/1275185177 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c300ce370 con 0x7f3c3006bd50 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c34d1c640 1 -- 172.21.15.37:0/1275185177 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2800b2d0 con 0x7f3c3006bd50 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c34d1c640 1 -- 172.21.15.37:0/1275185177 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280a7cd0 con 0x7f3c3006bd50 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 -- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c3006bd50 msgr2=0x7f3c300cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 --2- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c3006bd50 0x7f3c300cd620 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800d150 tx=0x7f3c2801ebe0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 -- 172.21.15.37:0/1275185177 shutdown_connections 2023-07-09T21:39:37.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 --2- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c3006bd50 0x7f3c300cd620 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 --2- 172.21.15.37:0/1275185177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c30159780 0x7f3c3006b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 -- 172.21.15.37:0/1275185177 >> 172.21.15.37:0/1275185177 conn(0x7f3c300694c0 msgr2=0x7f3c300698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 -- 172.21.15.37:0/1275185177 shutdown_connections 2023-07-09T21:39:37.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.358+0000 7f3c37f82640 1 -- 172.21.15.37:0/1275185177 wait complete. 2023-07-09T21:39:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 Processor -- start 2023-07-09T21:39:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- start start 2023-07-09T21:39:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 0x7f3c30157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c30156320 0x7f3c30157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c300af7f0 con 0x7f3c30159780 2023-07-09T21:39:37.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301f71e0 con 0x7f3c30156320 2023-07-09T21:39:37.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c301f74c0 con 0x7f3c3006bd50 2023-07-09T21:39:37.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56926/0 (socket says 172.21.15.37:56926) 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 -- 172.21.15.37:0/3704339669 learned_addr learned my addr 172.21.15.37:0/3704339669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c35d1e640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 0x7f3c30157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3551d640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c30156320 0x7f3c30157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 -- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 msgr2=0x7f3c30157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 0x7f3c30157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 -- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c30156320 msgr2=0x7f3c30157750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c30156320 0x7f3c30157750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 -- 172.21.15.37:0/3704339669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2800bd40 con 0x7f3c30159780 2023-07-09T21:39:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c35d1e640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 0x7f3c30157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:37.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c3651f640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3c280b1040 tx=0x7f3c2801b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2800b4c0 con 0x7f3c30159780 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28009810 con 0x7f3c30159780 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28009bc0 con 0x7f3c30159780 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c301f77a0 con 0x7f3c30159780 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c301f7d60 con 0x7f3c30159780 2023-07-09T21:39:37.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.362+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004d7d0 con 0x7f3c30159780 2023-07-09T21:39:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.366+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3c28009d20 con 0x7f3c30159780 2023-07-09T21:39:37.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.366+0000 7f3c267fc640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 0x7f3c14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.366+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 6027+0+0 (secure 0 0 0) 0x7f3c2811f670 con 0x7f3c30159780 2023-07-09T21:39:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.366+0000 7f3c35d1e640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 0x7f3c14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:37.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.366+0000 7f3c35d1e640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 0x7f3c14068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c007fd0 tx=0x7f3c2c009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:37.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.370+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c280eca30 con 0x7f3c30159780 2023-07-09T21:39:37.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:37.534+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3c30155ae0 con 0x7f3c30159780 2023-07-09T21:39:38.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c267fc640 1 -- 172.21.15.37:0/3704339669 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3c280f0050 con 0x7f3c30159780 2023-07-09T21:39:38.560 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:39:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 msgr2=0x7f3c14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 0x7f3c14068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c007fd0 tx=0x7f3c2c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 msgr2=0x7f3c300cac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3c280b1040 tx=0x7f3c2801b980 comp rx=0 tx=0).stop 2023-07-09T21:39:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 shutdown_connections 2023-07-09T21:39:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f3c140663a0 0x7f3c14068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c30159780 0x7f3c300cac30 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c30156320 0x7f3c30157750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 --2- 172.21.15.37:0/3704339669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c3006bd50 0x7f3c30157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 >> 172.21.15.37:0/3704339669 conn(0x7f3c300694c0 msgr2=0x7f3c3006f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 shutdown_connections 2023-07-09T21:39:38.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.558+0000 7f3c37f82640 1 -- 172.21.15.37:0/3704339669 wait complete. 2023-07-09T21:39:38.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:39:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.730+0000 7f7defdad640 1 Processor -- start 2023-07-09T21:39:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.730+0000 7f7defdad640 1 -- start start 2023-07-09T21:39:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7defdad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7de80b4340 0x7f7de806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7defdad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80cef80 0x7f7de80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7defdad640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de80b49f0 con 0x7f7de80b7ab0 2023-07-09T21:39:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7defdad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de80b7e80 con 0x7f7de80b4340 2023-07-09T21:39:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7defdad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80cc8a0 con 0x7f7de80cef80 2023-07-09T21:39:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7dedb49640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7de80b7ab0 0x7f7de80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44488/0 (socket says 172.21.15.37:44488) 2023-07-09T21:39:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7dedb49640 1 -- 172.21.15.37:0/2430698588 learned_addr learned my addr 172.21.15.37:0/2430698588 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7ded348640 1 --2- 172.21.15.37:0/2430698588 >> v2:172.21.15.37:3300/0 conn(0x7f7de80b4340 0x7f7de806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7dee34a640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80cef80 0x7f7de80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7decb47640 1 -- 172.21.15.37:0/2430698588 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 466314496 0 0) 0x7f7de80b49f0 con 0x7f7de80b7ab0 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7decb47640 1 -- 172.21.15.37:0/2430698588 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd4003530 con 0x7f7de80b7ab0 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7ded348640 1 -- 172.21.15.37:0/2430698588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80cef80 msgr2=0x7f7de80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7ded348640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80cef80 0x7f7de80d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7ded348640 1 -- 172.21.15.37:0/2430698588 >> v1:172.21.15.37:6789/0 conn(0x7f7de80b7ab0 legacy=0x7f7de80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.734+0000 7f7ded348640 1 -- 172.21.15.37:0/2430698588 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80ccb80 con 0x7f7de80b4340 2023-07-09T21:39:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7ded348640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80b4340 0x7f7de806aa50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80097c0 tx=0x7f7dd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375a2a3a23ace07d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:38.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7decb47640 1 -- 172.21.15.37:0/2430698588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80ab650 con 0x7f7de80b4340 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7decb47640 1 -- 172.21.15.37:0/2430698588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd80ab7b0 con 0x7f7de80b4340 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7decb47640 1 -- 172.21.15.37:0/2430698588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80abb20 con 0x7f7de80b4340 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- 172.21.15.37:0/2430698588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80b4340 msgr2=0x7f7de806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80b4340 0x7f7de806aa50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80097c0 tx=0x7f7dd801c450 comp rx=0 tx=0).stop 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- 172.21.15.37:0/2430698588 shutdown_connections 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80cef80 0x7f7de80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 --2- 172.21.15.37:0/2430698588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80b4340 0x7f7de806aa50 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- 172.21.15.37:0/2430698588 >> 172.21.15.37:0/2430698588 conn(0x7f7de8073090 msgr2=0x7f7de8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- 172.21.15.37:0/2430698588 shutdown_connections 2023-07-09T21:39:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- 172.21.15.37:0/2430698588 wait complete. 2023-07-09T21:39:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 Processor -- start 2023-07-09T21:39:38.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.738+0000 7f7defdad640 1 -- start start 2023-07-09T21:39:38.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80b4340 0x7f7de815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7de80b7ab0 0x7f7de80c74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de815a910 con 0x7f7de80cef80 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de815bd20 con 0x7f7de80b7ab0 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de815bfc0 con 0x7f7de80b4340 2023-07-09T21:39:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56934/0 (socket says 172.21.15.37:56934) 2023-07-09T21:39:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 -- 172.21.15.37:0/405228255 learned_addr learned my addr 172.21.15.37:0/405228255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dedb49640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80b4340 0x7f7de815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7ded348640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7de80b7ab0 0x7f7de80c74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 -- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80b4340 msgr2=0x7f7de815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80b4340 0x7f7de815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 -- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7de80b7ab0 msgr2=0x7f7de80c74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7de80b7ab0 0x7f7de80c74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 -- 172.21.15.37:0/405228255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd8009420 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dee34a640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009fd0 tx=0x7f7de000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0014420 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de0014580 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de815c2a0 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0014930 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de815c860 con 0x7f7de80cef80 2023-07-09T21:39:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de804d7d0 con 0x7f7de80cef80 2023-07-09T21:39:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.742+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7de0014a90 con 0x7f7de80cef80 2023-07-09T21:39:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.746+0000 7f7dde7fc640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.746+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7de0084380 con 0x7f7de80cef80 2023-07-09T21:39:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.746+0000 7f7dedb49640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.746+0000 7f7dedb49640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 0x7f7dcc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7de4007fd0 tx=0x7f7de4009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.750+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7de00554e0 con 0x7f7de80cef80 2023-07-09T21:39:38.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.954+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7de80d30c0 con 0x7f7de80cef80 2023-07-09T21:39:38.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7dde7fc640 1 -- 172.21.15.37:0/405228255 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7de0055070 con 0x7f7de80cef80 2023-07-09T21:39:38.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:38.961 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:39:38.961 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:39:38.961 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.961 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:39:38.961 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:39:38.962 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:39:38.962 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:39:38.963 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.963 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.963 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.963 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.964 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:39:38.964 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:39:38.964 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:39:38.965 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:39:38.965 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.966 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.966 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.966 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.966 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:39:38.967 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:39:38.967 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.967 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:39:38.968 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:39:38.968 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.968 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.968 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.969 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.969 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:39:38.969 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:39:38.970 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:39:38.970 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:39:38.971 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.971 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.971 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.971 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.972 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:39:38.972 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:39:38.972 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.972 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.973 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.973 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.973 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.973 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.974 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.974 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:39:38.974 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:39:38.974 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.975 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.975 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.975 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.975 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.976 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:39:38.977 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:39:38.978 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:39:38.979 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.979 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.979 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.979 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.980 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.980 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.981 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.982 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.983 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:39:38.984 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.985 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.987 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.987 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:39:38.987 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:39:38.987 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.988 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:39:38.989 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:39:38.990 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.991 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:39:38.992 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:39:38.993 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:39:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 msgr2=0x7f7dcc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 0x7f7dcc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7de4007fd0 tx=0x7f7de4009040 comp rx=0 tx=0).stop 2023-07-09T21:39:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 msgr2=0x7f7de80c7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:38.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009fd0 tx=0x7f7de000e4b0 comp rx=0 tx=0).stop 2023-07-09T21:39:38.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 shutdown_connections 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7dcc0663a0 0x7f7dcc068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7de80cef80 0x7f7de80c7a10 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7de80b7ab0 0x7f7de80c74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 --2- 172.21.15.37:0/405228255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7de80b4340 0x7f7de815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 >> 172.21.15.37:0/405228255 conn(0x7f7de8073090 msgr2=0x7f7de815e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 shutdown_connections 2023-07-09T21:39:39.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:38.958+0000 7f7defdad640 1 -- 172.21.15.37:0/405228255 wait complete. 2023-07-09T21:39:39.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 Processor -- start 2023-07-09T21:39:39.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 -- start start 2023-07-09T21:39:39.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85400aff40 0x7f85400ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854006b120 0x7f854015c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854006efc0 con 0x7f8540158670 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854006d390 con 0x7f85400aff40 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f8546340640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854006f4f0 con 0x7f854006b120 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f853ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8540158670 0x7f85400af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44504/0 (socket says 172.21.15.37:44504) 2023-07-09T21:39:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.142+0000 7f853ffff640 1 -- 172.21.15.37:0/890153676 learned_addr learned my addr 172.21.15.37:0/890153676 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f85448dd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854006b120 0x7f854015c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853f7fe640 1 --2- 172.21.15.37:0/890153676 >> v2:172.21.15.119:3300/0 conn(0x7f85400aff40 0x7f85400ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539723659 0 0) 0x7f854006efc0 con 0x7f8540158670 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8528003530 con 0x7f8540158670 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084434387 0 0) 0x7f8528003530 con 0x7f8540158670 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854006b120 msgr2=0x7f854015c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854006b120 0x7f854015c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 >> v2:172.21.15.119:3300/0 conn(0x7f85400aff40 msgr2=0x7f85400ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 --2- 172.21.15.37:0/890153676 >> v2:172.21.15.119:3300/0 conn(0x7f85400aff40 0x7f85400ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854006fe90 con 0x7f8540158670 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f8530001680 con 0x7f8540158670 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 >> v1:172.21.15.37:6789/0 conn(0x7f8540158670 legacy=0x7f85400af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528003980 0x7f8528003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85280043b0 0x7f8528004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8528004f30 0x7f852800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854006d390 con 0x7f8528003980 2023-07-09T21:39:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854006f4f0 con 0x7f8528004f30 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852800e0e0 con 0x7f85280043b0 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f85448dd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f854006b120 0x7f854015c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528003980 0x7f8528003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853f7fe640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85280043b0 0x7f8528004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f85448dd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8528004f30 0x7f852800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 -- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85280043b0 msgr2=0x7f8528004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85280043b0 0x7f8528004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 -- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8528004f30 msgr2=0x7f852800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8528004f30 0x7f852800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f853ffff640 1 -- 172.21.15.37:0/890153676 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8528003530 con 0x7f8528003980 2023-07-09T21:39:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.146+0000 7f85448dd640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8528004f30 0x7f852800dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f853ffff640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528003980 0x7f8528003d90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f853000c1c0 tx=0x7f853001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f800126fb9e051 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a58f0 con 0x7f8528003980 2023-07-09T21:39:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85300a5a70 con 0x7f8528003980 2023-07-09T21:39:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f853effd640 1 -- 172.21.15.37:0/890153676 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85300a5e20 con 0x7f8528003980 2023-07-09T21:39:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- 172.21.15.37:0/890153676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528003980 msgr2=0x7f8528003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 --2- 172.21.15.37:0/890153676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8528003980 0x7f8528003d90 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f853000c1c0 tx=0x7f853001cc10 comp rx=0 tx=0).stop 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f85448dd640 1 -- 172.21.15.37:0/890153676 reap_dead start 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- 172.21.15.37:0/890153676 shutdown_connections 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- 172.21.15.37:0/890153676 >> 172.21.15.37:0/890153676 conn(0x7f85400ca830 msgr2=0x7f85400cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- 172.21.15.37:0/890153676 shutdown_connections 2023-07-09T21:39:39.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- 172.21.15.37:0/890153676 wait complete. 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 Processor -- start 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.150+0000 7f8546340640 1 -- start start 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8528003980 0x7f8540159660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854015afd0 0x7f85400abd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85400b0be0 con 0x7f85401e8480 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8540159ba0 con 0x7f854015afd0 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85400b0e30 con 0x7f8528003980 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56956/0 (socket says 172.21.15.37:56956) 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 -- 172.21.15.37:0/2796109453 learned_addr learned my addr 172.21.15.37:0/2796109453 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853ffff640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8528003980 0x7f8540159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f85448dd640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854015afd0 0x7f85400abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 -- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8528003980 msgr2=0x7f8540159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8528003980 0x7f8540159660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 -- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854015afd0 msgr2=0x7f85400abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854015afd0 0x7f85400abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 -- 172.21.15.37:0/2796109453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85400b1110 con 0x7f85401e8480 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853f7fe640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8534011940 tx=0x7f8534011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8534004240 con 0x7f85401e8480 2023-07-09T21:39:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85340043a0 con 0x7f85401e8480 2023-07-09T21:39:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853400fb00 con 0x7f85401e8480 2023-07-09T21:39:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85400b13f0 con 0x7f85401e8480 2023-07-09T21:39:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85401547e0 con 0x7f85401e8480 2023-07-09T21:39:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.154+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85400c91c0 con 0x7f85401e8480 2023-07-09T21:39:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.158+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f853400fc60 con 0x7f85401e8480 2023-07-09T21:39:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.158+0000 7f853cff9640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 0x7f852c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.158+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8534083ff0 con 0x7f85401e8480 2023-07-09T21:39:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.158+0000 7f853ffff640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 0x7f852c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.158+0000 7f853ffff640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 0x7f852c068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85300aa000 tx=0x7f854006f630 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.162+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85340517b0 con 0x7f85401e8480 2023-07-09T21:39:39.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.318+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f854004d7d0 con 0x7f85401e8480 2023-07-09T21:39:39.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f853cff9640 1 -- 172.21.15.37:0/2796109453 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+14629 (secure 0 0 0) 0x7f8534054dd0 con 0x7f85401e8480 2023-07-09T21:39:39.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:39.323 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":109,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:38.552956+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 msgr2=0x7f852c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 0x7f852c068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f85300aa000 tx=0x7f854006f630 comp rx=0 tx=0).stop 2023-07-09T21:39:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 msgr2=0x7f85401542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f8534011940 tx=0x7f8534011e00 comp rx=0 tx=0).stop 2023-07-09T21:39:39.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 shutdown_connections 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f852c0663d0 0x7f852c068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f854015afd0 0x7f85400abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85401e8480 0x7f85401542a0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 --2- 172.21.15.37:0/2796109453 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8528003980 0x7f8540159660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 >> 172.21.15.37:0/2796109453 conn(0x7f85400ca830 msgr2=0x7f85400c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 shutdown_connections 2023-07-09T21:39:39.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.322+0000 7f8546340640 1 -- 172.21.15.37:0/2796109453 wait complete. 2023-07-09T21:39:39.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:39:39.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:39:39.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.486+0000 7ffade9ac640 1 Processor -- start 2023-07-09T21:39:39.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.486+0000 7ffade9ac640 1 -- start start 2023-07-09T21:39:39.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffade9ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffad815f610 0x7ffad815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffade9ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad815bf60 con 0x7ffad815bb90 2023-07-09T21:39:39.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffade9ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad81600d0 con 0x7ffad806b9c0 2023-07-09T21:39:39.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffade9ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad80cc530 con 0x7ffad815f610 2023-07-09T21:39:39.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffad815bb90 0x7ffad80ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44518/0 (socket says 172.21.15.37:44518) 2023-07-09T21:39:39.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 -- 172.21.15.37:0/8493272 learned_addr learned my addr 172.21.15.37:0/8493272 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:39.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad77fe640 1 --2- 172.21.15.37:0/8493272 >> v2:172.21.15.119:3300/0 conn(0x7ffad815f610 0x7ffad815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111943345 0 0) 0x7ffad815bf60 con 0x7ffad815bb90 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffac0003530 con 0x7ffad815bb90 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2792750953 0 0) 0x7ffac0003530 con 0x7ffad815bb90 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 >> v2:172.21.15.119:3300/0 conn(0x7ffad815f610 msgr2=0x7ffad815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 --2- 172.21.15.37:0/8493272 >> v2:172.21.15.119:3300/0 conn(0x7ffad815f610 0x7ffad815fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 >> v1:172.21.15.119:6789/0 conn(0x7ffad806b9c0 legacy=0x7ffad806a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad81603b0 con 0x7ffad815bb90 2023-07-09T21:39:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ffac8001680 con 0x7ffad815bb90 2023-07-09T21:39:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 >> v1:172.21.15.37:6789/0 conn(0x7ffad815bb90 legacy=0x7ffad80ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 0x7ffac0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0004370 0x7ffac0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac00050d0 0x7ffac000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80cc530 con 0x7ffac0003980 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac000c000 con 0x7ffac00050d0 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac000c1c0 con 0x7ffac0004370 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 0x7ffac0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad77fe640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0004370 0x7ffac0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffadcf49640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac00050d0 0x7ffac000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 -- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0004370 msgr2=0x7ffac0004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0004370 0x7ffac0004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 -- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac00050d0 msgr2=0x7ffac000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffac00050d0 0x7ffac000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffadcf49640 1 -- 172.21.15.37:0/8493272 reap_dead start 2023-07-09T21:39:39.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.490+0000 7ffad7fff640 1 -- 172.21.15.37:0/8493272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac0003530 con 0x7ffac0003980 2023-07-09T21:39:39.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffad7fff640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 0x7ffac0003d50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c210 tx=0x7ffac801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b4940199f2f694 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac8005ae0 con 0x7ffac0003980 2023-07-09T21:39:39.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffac8005c60 con 0x7ffac0003980 2023-07-09T21:39:39.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffad6ffd640 1 -- 172.21.15.37:0/8493272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac80a5a30 con 0x7ffac0003980 2023-07-09T21:39:39.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 -- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 msgr2=0x7ffac0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 0x7ffac0003d50 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7ffac800c210 tx=0x7ffac801cc30 comp rx=0 tx=0).stop 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 -- 172.21.15.37:0/8493272 shutdown_connections 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 --2- 172.21.15.37:0/8493272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffac0003980 0x7ffac0003d50 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 -- 172.21.15.37:0/8493272 >> 172.21.15.37:0/8493272 conn(0x7ffad806d230 msgr2=0x7ffad806d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 -- 172.21.15.37:0/8493272 shutdown_connections 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.494+0000 7ffade9ac640 1 -- 172.21.15.37:0/8493272 wait complete. 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 Processor -- start 2023-07-09T21:39:39.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- start start 2023-07-09T21:39:39.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 0x7ffad80b2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffad80afce0 0x7ffad80b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80b0690 con 0x7ffad80c4a30 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c5db0 con 0x7ffad80afce0 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad80c51a0 con 0x7ffac0003980 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56968/0 (socket says 172.21.15.37:56968) 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 -- 172.21.15.37:0/1606368123 learned_addr learned my addr 172.21.15.37:0/1606368123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:39.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad7fff640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 0x7ffad80b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffadcf49640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffad80afce0 0x7ffad80b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 -- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 msgr2=0x7ffad80b2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 0x7ffad80b2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 -- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffad80afce0 msgr2=0x7ffad80b0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffad80afce0 0x7ffad80b0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 -- 172.21.15.37:0/1606368123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad80c5480 con 0x7ffad80c4a30 2023-07-09T21:39:39.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad7fff640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 0x7ffad80b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:39.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad77fe640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffacc011a00 tx=0x7ffacc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00fb50 con 0x7ffad80c4a30 2023-07-09T21:39:39.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc00fcb0 con 0x7ffad80c4a30 2023-07-09T21:39:39.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc014440 con 0x7ffad80c4a30 2023-07-09T21:39:39.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad80c5760 con 0x7ffad80c4a30 2023-07-09T21:39:39.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad80c4ea0 con 0x7ffad80c4a30 2023-07-09T21:39:39.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.498+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad804d7d0 con 0x7ffad80c4a30 2023-07-09T21:39:39.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.502+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffacc0145a0 con 0x7ffad80c4a30 2023-07-09T21:39:39.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.502+0000 7ffad4ff9640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 0x7ffac4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.502+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ffacc084400 con 0x7ffad80c4a30 2023-07-09T21:39:39.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.502+0000 7ffad7fff640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 0x7ffac4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.502+0000 7ffad7fff640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 0x7ffac4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffac80ab000 tx=0x7ffac80b1040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.506+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffacc051ae0 con 0x7ffad80c4a30 2023-07-09T21:39:39.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffad80c5ef0 con 0x7ffad80c4a30 2023-07-09T21:39:39.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffad4ff9640 1 -- 172.21.15.37:0/1606368123 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffacc055100 con 0x7ffad80c4a30 2023-07-09T21:39:39.665 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:39:39.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 msgr2=0x7ffac4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 0x7ffac4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ffac80ab000 tx=0x7ffac80b1040 comp rx=0 tx=0).stop 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 msgr2=0x7ffad815e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ffacc011a00 tx=0x7ffacc011ec0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 shutdown_connections 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ffac40663a0 0x7ffac4068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffad80afce0 0x7ffad80b0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffad80c4a30 0x7ffad815e850 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 --2- 172.21.15.37:0/1606368123 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffac0003980 0x7ffad80b2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 >> 172.21.15.37:0/1606368123 conn(0x7ffad806d230 msgr2=0x7ffad80c70d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 shutdown_connections 2023-07-09T21:39:39.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.662+0000 7ffade9ac640 1 -- 172.21.15.37:0/1606368123 wait complete. 2023-07-09T21:39:39.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:39:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 Processor -- start 2023-07-09T21:39:39.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 -- start start 2023-07-09T21:39:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 0x7f7b9c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9c0c4c90 con 0x7f7b9c1595c0 2023-07-09T21:39:39.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9c0ca730 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7ba200b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c0ca170 con 0x7f7b9c159990 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56970/0 (socket says 172.21.15.37:56970) 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 -- 172.21.15.37:0/2288903224 learned_addr learned my addr 172.21.15.37:0/2288903224 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9affd640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 0x7f7b9c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 -- 172.21.15.37:0/2288903224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 msgr2=0x7f7b9c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 0x7f7b9c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 -- 172.21.15.37:0/2288903224 >> v1:172.21.15.119:6789/0 conn(0x7f7b9c1595c0 legacy=0x7f7b9c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9bfff640 1 -- 172.21.15.37:0/2288903224 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9c0ca450 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.830+0000 7f7b9affd640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 0x7f7b9c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7b9bfff640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009e50 tx=0x7f7b9401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2129d643fef5486 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7b9a7fc640 1 -- 172.21.15.37:0/2288903224 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a57c0 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7b9a7fc640 1 -- 172.21.15.37:0/2288903224 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940a5920 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7b9a7fc640 1 -- 172.21.15.37:0/2288903224 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940a5cb0 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 -- 172.21.15.37:0/2288903224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0c99e0 msgr2=0x7f7b9c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f7b94009e50 tx=0x7f7b9401c9e0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 -- 172.21.15.37:0/2288903224 shutdown_connections 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c159990 0x7f7b9c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 --2- 172.21.15.37:0/2288903224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c0cd300 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 -- 172.21.15.37:0/2288903224 >> 172.21.15.37:0/2288903224 conn(0x7f7b9c0cde40 msgr2=0x7f7b9c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:39.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 -- 172.21.15.37:0/2288903224 shutdown_connections 2023-07-09T21:39:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.834+0000 7f7ba200b640 1 -- 172.21.15.37:0/2288903224 wait complete. 2023-07-09T21:39:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 Processor -- start 2023-07-09T21:39:39.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- start start 2023-07-09T21:39:39.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c1628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c1595c0 0x7f7b9c06be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c163b30 con 0x7f7b9c159990 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c06c3d0 con 0x7f7b9c0c99e0 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9c162eb0 con 0x7f7b9c1595c0 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56976/0 (socket says 172.21.15.37:56976) 2023-07-09T21:39:39.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 -- 172.21.15.37:0/3242997474 learned_addr learned my addr 172.21.15.37:0/3242997474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9affd640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c1595c0 0x7f7b9c06be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9b7fe640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c1628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 -- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c1595c0 msgr2=0x7f7b9c06be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c1595c0 0x7f7b9c06be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 -- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b9c0c99e0 msgr2=0x7f7b9c1628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c1628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:39.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 -- 172.21.15.37:0/3242997474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94009b30 con 0x7f7b9c159990 2023-07-09T21:39:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b9bfff640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7b9401a610 tx=0x7f7b94019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b8670 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b940b87d0 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b940b8b60 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b9c163190 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.838+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9c163750 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b9c163c70 con 0x7f7b9c159990 2023-07-09T21:39:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7b940b8cc0 con 0x7f7b9c159990 2023-07-09T21:39:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7b83fff640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 0x7f7b88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7b9411eff0 con 0x7f7b9c159990 2023-07-09T21:39:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7b9b7fe640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 0x7f7b88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.842+0000 7f7b9b7fe640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 0x7f7b88068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c159310 tx=0x7f7b8c009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:39.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:39.846+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7b9c163c70 con 0x7f7b9c159990 2023-07-09T21:39:40.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7b9c163c70 con 0x7f7b9c159990 2023-07-09T21:39:40.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7b83fff640 1 -- 172.21.15.37:0/3242997474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7b9c163c70 con 0x7f7b9c159990 2023-07-09T21:39:40.005 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:39:40.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 msgr2=0x7f7b88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 0x7f7b88068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c159310 tx=0x7f7b8c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:40.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 msgr2=0x7f7b9c14ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.002+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f7b9401a610 tx=0x7f7b94019780 comp rx=0 tx=0).stop 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 shutdown_connections 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f7b880663a0 0x7f7b88068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b9c159990 0x7f7b9c14ef40 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7b9c1595c0 0x7f7b9c06be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 --2- 172.21.15.37:0/3242997474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7b9c0c99e0 0x7f7b9c1628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 >> 172.21.15.37:0/3242997474 conn(0x7f7b9c0cde40 msgr2=0x7f7b9c06ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 shutdown_connections 2023-07-09T21:39:40.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.006+0000 7f7ba200b640 1 -- 172.21.15.37:0/3242997474 wait complete. 2023-07-09T21:39:40.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:39:40.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.166+0000 7fa0d489c640 1 Processor -- start 2023-07-09T21:39:40.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.166+0000 7fa0d489c640 1 -- start start 2023-07-09T21:39:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0d489c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0d00b7ab0 0x7fa0d006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0d489c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0d00b4340 0x7fa0d00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0d489c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d00b49f0 con 0x7fa0d00cef80 2023-07-09T21:39:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0d489c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00b7e80 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0d489c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00cc8a0 con 0x7fa0d00b4340 2023-07-09T21:39:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0d00b7ab0 0x7fa0d006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0d00b7ab0 0x7fa0d006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56992/0 (socket says 172.21.15.37:56992) 2023-07-09T21:39:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0c7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0d00cef80 0x7fa0d00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44520/0 (socket says 172.21.15.37:44520) 2023-07-09T21:39:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 -- 172.21.15.37:0/144258324 learned_addr learned my addr 172.21.15.37:0/144258324 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:40.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ced9d640 1 --2- 172.21.15.37:0/144258324 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00b4340 0x7fa0d00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 -- 172.21.15.37:0/144258324 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00b4340 msgr2=0x7fa0d00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/144258324 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00b4340 0x7fa0d00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 -- 172.21.15.37:0/144258324 >> v1:172.21.15.37:6789/0 conn(0x7fa0d00cef80 legacy=0x7fa0d00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.170+0000 7fa0ce59c640 1 -- 172.21.15.37:0/144258324 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d00ccb80 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/144258324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d006aa50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00b4710 tx=0x7fa0c001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9980ad5f3816f6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0cdd9b640 1 -- 172.21.15.37:0/144258324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00aa430 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0cdd9b640 1 -- 172.21.15.37:0/144258324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c00aa590 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0cdd9b640 1 -- 172.21.15.37:0/144258324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c00aa920 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- 172.21.15.37:0/144258324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 msgr2=0x7fa0d006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- 172.21.15.37:0/144258324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d006aa50 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00b4710 tx=0x7fa0c001c4d0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- 172.21.15.37:0/144258324 shutdown_connections 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- 172.21.15.37:0/144258324 >> v2:172.21.15.119:3300/0 conn(0x7fa0d00b4340 0x7fa0d00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- 172.21.15.37:0/144258324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d006aa50 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- 172.21.15.37:0/144258324 >> 172.21.15.37:0/144258324 conn(0x7fa0d0073090 msgr2=0x7fa0d0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- 172.21.15.37:0/144258324 shutdown_connections 2023-07-09T21:39:40.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- 172.21.15.37:0/144258324 wait complete. 2023-07-09T21:39:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 Processor -- start 2023-07-09T21:39:40.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- start start 2023-07-09T21:39:40.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 0x7fa0d00c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00cef80 0x7fa0d0156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d0154720 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00c8470 con 0x7fa0d00cef80 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.174+0000 7fa0d489c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01425f0 con 0x7fa0d00b4340 2023-07-09T21:39:40.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56998/0 (socket says 172.21.15.37:56998) 2023-07-09T21:39:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 -- 172.21.15.37:0/3056980037 learned_addr learned my addr 172.21.15.37:0/3056980037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 0x7fa0d00c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 -- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 msgr2=0x7fa0d00c7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 0x7fa0d00c7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 -- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00cef80 msgr2=0x7fa0d0156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00cef80 0x7fa0d0156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 -- 172.21.15.37:0/3056980037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c00094d0 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 0x7fa0d00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:40.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c7fff640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800c430 tx=0x7fa0b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b80074e0 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0b8007640 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d0153b10 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0b8004a10 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d01540d0 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d0154890 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.178+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0b8004b70 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.182+0000 7fa0c6ffd640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 0x7fa0b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.182+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa0b8083610 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.182+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 0x7fa0b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.182+0000 7fa0ce59c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 0x7fa0b0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00ae000 tx=0x7fa0c0008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.186+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0b8050c30 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa0d004d7d0 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0c6ffd640 1 -- 172.21.15.37:0/3056980037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa0b8054250 con 0x7fa0d00b7ab0 2023-07-09T21:39:40.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:40.345 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:39:40.345 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:40.345 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:39:40.346 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:40.347 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:39:40.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 msgr2=0x7fa0b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 0x7fa0b0068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00ae000 tx=0x7fa0c0008040 comp rx=0 tx=0).stop 2023-07-09T21:39:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 msgr2=0x7fa0d01420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fa0b800c430 tx=0x7fa0b800c8f0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 shutdown_connections 2023-07-09T21:39:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fa0b00663a0 0x7fa0b0068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0d00cef80 0x7fa0d0156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0d00b7ab0 0x7fa0d01420b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 --2- 172.21.15.37:0/3056980037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0d00b4340 0x7fa0d00c7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 >> 172.21.15.37:0/3056980037 conn(0x7fa0d0073090 msgr2=0x7fa0d00b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 shutdown_connections 2023-07-09T21:39:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.342+0000 7fa0d489c640 1 -- 172.21.15.37:0/3056980037 wait complete. 2023-07-09T21:39:40.365 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:39:40.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:39:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 Processor -- start 2023-07-09T21:39:40.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 -- start start 2023-07-09T21:39:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe89c159990 0x7fe89c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0c4c90 con 0x7fe89c1595c0 2023-07-09T21:39:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0ca170 con 0x7fe89c0c99e0 2023-07-09T21:39:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe8a2634640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0ca730 con 0x7fe89c159990 2023-07-09T21:39:40.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe89c1595c0 0x7fe89c15dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44532/0 (socket says 172.21.15.37:44532) 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89bfff640 1 -- 172.21.15.37:0/1119352024 learned_addr learned my addr 172.21.15.37:0/1119352024 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89b7fe640 1 --2- 172.21.15.37:0/1119352024 >> v2:172.21.15.37:3300/0 conn(0x7fe89c159990 0x7fe89c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89b7fe640 1 -- 172.21.15.37:0/1119352024 >> v1:172.21.15.119:6789/0 conn(0x7fe89c0c99e0 legacy=0x7fe89c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89b7fe640 1 -- 172.21.15.37:0/1119352024 >> v1:172.21.15.37:6789/0 conn(0x7fe89c1595c0 legacy=0x7fe89c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89b7fe640 1 -- 172.21.15.37:0/1119352024 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c0ca450 con 0x7fe89c159990 2023-07-09T21:39:40.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.510+0000 7fe89affd640 1 -- 172.21.15.37:0/1119352024 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593608154 0 0) 0x7fe88c001120 con 0x7fe89c1595c0 2023-07-09T21:39:40.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe89b7fe640 1 --2- 172.21.15.37:0/1119352024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c159990 0x7fe89c0c4750 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8209275e472ff8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe89affd640 1 -- 172.21.15.37:0/1119352024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900ab650 con 0x7fe89c159990 2023-07-09T21:39:40.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe89affd640 1 -- 172.21.15.37:0/1119352024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900ab7b0 con 0x7fe89c159990 2023-07-09T21:39:40.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe89affd640 1 -- 172.21.15.37:0/1119352024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900abb40 con 0x7fe89c159990 2023-07-09T21:39:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 -- 172.21.15.37:0/1119352024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c159990 msgr2=0x7fe89c0c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 --2- 172.21.15.37:0/1119352024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c159990 0x7fe89c0c4750 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe8900097c0 tx=0x7fe89001c450 comp rx=0 tx=0).stop 2023-07-09T21:39:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 -- 172.21.15.37:0/1119352024 shutdown_connections 2023-07-09T21:39:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 --2- 172.21.15.37:0/1119352024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c159990 0x7fe89c0c4750 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 -- 172.21.15.37:0/1119352024 >> 172.21.15.37:0/1119352024 conn(0x7fe89c0cde40 msgr2=0x7fe89c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:40.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 -- 172.21.15.37:0/1119352024 shutdown_connections 2023-07-09T21:39:40.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.514+0000 7fe8a2634640 1 -- 172.21.15.37:0/1119352024 wait complete. 2023-07-09T21:39:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 Processor -- start 2023-07-09T21:39:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- start start 2023-07-09T21:39:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 0x7fe89c15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe89c159990 0x7fe89c0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15b260 con 0x7fe89c1595c0 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15b540 con 0x7fe89c0c99e0 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15b820 con 0x7fe89c159990 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57026/0 (socket says 172.21.15.37:57026) 2023-07-09T21:39:40.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 -- 172.21.15.37:0/2757152175 learned_addr learned my addr 172.21.15.37:0/2757152175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:40.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89bfff640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 0x7fe89c15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a0bd1640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe89c159990 0x7fe89c0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 -- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe89c159990 msgr2=0x7fe89c0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe89c159990 0x7fe89c0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 -- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 msgr2=0x7fe89c15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:40.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 0x7fe89c15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 -- 172.21.15.37:0/2757152175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890009420 con 0x7fe89c1595c0 2023-07-09T21:39:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89bfff640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 0x7fe89c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:40.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe89b7fe640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe890019060 tx=0x7fe8900191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900bf450 con 0x7fe89c1595c0 2023-07-09T21:39:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900bf5b0 con 0x7fe89c1595c0 2023-07-09T21:39:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900bf940 con 0x7fe89c1595c0 2023-07-09T21:39:40.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c15bb00 con 0x7fe89c1595c0 2023-07-09T21:39:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.518+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c15aea0 con 0x7fe89c1595c0 2023-07-09T21:39:40.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c04d7d0 con 0x7fe89c1595c0 2023-07-09T21:39:40.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe8900c93f0 con 0x7fe89c1595c0 2023-07-09T21:39:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe898ff9640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 0x7fe888068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe89011e8f0 con 0x7fe89c1595c0 2023-07-09T21:39:40.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe89bfff640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 0x7fe888068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.522+0000 7fe89bfff640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 0x7fe888068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe88c000f70 tx=0x7fe88c007b00 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:40.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.526+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe8900ebfa0 con 0x7fe89c1595c0 2023-07-09T21:39:40.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:40.682+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe89c15bfb0 con 0x7fe89c1595c0 2023-07-09T21:39:41.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.198+0000 7fe898ff9640 1 -- 172.21.15.37:0/2757152175 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe8900ef5c0 con 0x7fe89c1595c0 2023-07-09T21:39:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:39:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 msgr2=0x7fe888068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 0x7fe888068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe88c000f70 tx=0x7fe88c007b00 comp rx=0 tx=0).stop 2023-07-09T21:39:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 msgr2=0x7fe89c148a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe890019060 tx=0x7fe8900191f0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 shutdown_connections 2023-07-09T21:39:41.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe8880663a0 0x7fe888068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe89c159990 0x7fe89c0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe89c1595c0 0x7fe89c148a90 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 --2- 172.21.15.37:0/2757152175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe89c0c99e0 0x7fe89c15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.202+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 >> 172.21.15.37:0/2757152175 conn(0x7fe89c0cde40 msgr2=0x7fe89c153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:41.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.206+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 shutdown_connections 2023-07-09T21:39:41.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.206+0000 7fe8a2634640 1 -- 172.21.15.37:0/2757152175 wait complete. 2023-07-09T21:39:41.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:39:41.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 Processor -- start 2023-07-09T21:39:41.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 -- start start 2023-07-09T21:39:41.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f76341585b0 0x7f763406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76340c4520 0x7f763415c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76340c9090 con 0x7f763406b970 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340cbf40 con 0x7f76340c4520 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763c1fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76340c8a60 con 0x7f76341585b0 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76340c4520 0x7f763415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76340c4520 0x7f763415c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57042/0 (socket says 172.21.15.37:57042) 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 -- 172.21.15.37:0/2124692769 learned_addr learned my addr 172.21.15.37:0/2124692769 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f7639f96640 1 --2- 172.21.15.37:0/2124692769 >> v2:172.21.15.119:3300/0 conn(0x7f76341585b0 0x7f763406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 -- 172.21.15.37:0/2124692769 >> v2:172.21.15.119:3300/0 conn(0x7f76341585b0 msgr2=0x7f763406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 --2- 172.21.15.37:0/2124692769 >> v2:172.21.15.119:3300/0 conn(0x7f76341585b0 0x7f763406b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 -- 172.21.15.37:0/2124692769 >> v1:172.21.15.119:6789/0 conn(0x7f763406b970 legacy=0x7f76340c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.382+0000 7f763a797640 1 -- 172.21.15.37:0/2124692769 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763415ce10 con 0x7f76340c4520 2023-07-09T21:39:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763a797640 1 --2- 172.21.15.37:0/2124692769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76340c4520 0x7f763415c200 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f76340c4ce0 tx=0x7f762c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b503a3f330a155 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f7638f94640 1 -- 172.21.15.37:0/2124692769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0a5880 con 0x7f76340c4520 2023-07-09T21:39:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f7638f94640 1 -- 172.21.15.37:0/2124692769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c0a59e0 con 0x7f76340c4520 2023-07-09T21:39:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f7638f94640 1 -- 172.21.15.37:0/2124692769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0a5d70 con 0x7f76340c4520 2023-07-09T21:39:41.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 -- 172.21.15.37:0/2124692769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76340c4520 msgr2=0x7f763415c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 --2- 172.21.15.37:0/2124692769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76340c4520 0x7f763415c200 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f76340c4ce0 tx=0x7f762c01c9a0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 -- 172.21.15.37:0/2124692769 shutdown_connections 2023-07-09T21:39:41.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 --2- 172.21.15.37:0/2124692769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76340c4520 0x7f763415c200 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 --2- 172.21.15.37:0/2124692769 >> v2:172.21.15.119:3300/0 conn(0x7f76341585b0 0x7f763406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 -- 172.21.15.37:0/2124692769 >> 172.21.15.37:0/2124692769 conn(0x7f76340cde40 msgr2=0x7f76340ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:41.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 -- 172.21.15.37:0/2124692769 shutdown_connections 2023-07-09T21:39:41.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.386+0000 7f763c1fa640 1 -- 172.21.15.37:0/2124692769 wait complete. 2023-07-09T21:39:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 Processor -- start 2023-07-09T21:39:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- start start 2023-07-09T21:39:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763406b970 0x7f7634147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76340c4520 0x7f7634150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76341597d0 con 0x7f76341585b0 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7634159a70 con 0x7f76340c4520 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7634159d50 con 0x7f763406b970 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57054/0 (socket says 172.21.15.37:57054) 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 -- 172.21.15.37:0/1207035802 learned_addr learned my addr 172.21.15.37:0/1207035802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f7639795640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76340c4520 0x7f7634150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f7639f96640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763406b970 0x7f7634147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 -- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763406b970 msgr2=0x7f7634147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763406b970 0x7f7634147860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 -- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76340c4520 msgr2=0x7f7634150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:41.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76340c4520 0x7f7634150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 -- 172.21.15.37:0/1207035802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c009b30 con 0x7f76341585b0 2023-07-09T21:39:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763a797640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f762c0af040 tx=0x7f762c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0b8470 con 0x7f76341585b0 2023-07-09T21:39:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c0b85d0 con 0x7f76341585b0 2023-07-09T21:39:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0b8980 con 0x7f76341585b0 2023-07-09T21:39:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763415a030 con 0x7f76341585b0 2023-07-09T21:39:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.390+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7634147da0 con 0x7f76341585b0 2023-07-09T21:39:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763404d7d0 con 0x7f76341585b0 2023-07-09T21:39:41.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f762c0b8ae0 con 0x7f76341585b0 2023-07-09T21:39:41.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f762a7fc640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 0x7f7618068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:41.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f762c11fb40 con 0x7f76341585b0 2023-07-09T21:39:41.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f7639f96640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 0x7f7618068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.394+0000 7f7639f96640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 0x7f7618068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76300079c0 tx=0x7f7630008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:41.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.398+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f762c0ed310 con 0x7f76341585b0 2023-07-09T21:39:41.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:41.554+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f763415a4e0 con 0x7f76341585b0 2023-07-09T21:39:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.210+0000 7f762a7fc640 1 -- 172.21.15.37:0/1207035802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7f762c0f0930 con 0x7f76341585b0 2023-07-09T21:39:42.213 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:39:42.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 msgr2=0x7f7618068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 0x7f7618068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f76300079c0 tx=0x7f7630008040 comp rx=0 tx=0).stop 2023-07-09T21:39:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 msgr2=0x7f7634150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f762c0af040 tx=0x7f762c019740 comp rx=0 tx=0).stop 2023-07-09T21:39:42.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 shutdown_connections 2023-07-09T21:39:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f76180663a0 0x7f7618068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76341585b0 0x7f7634150880 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76340c4520 0x7f7634150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 --2- 172.21.15.37:0/1207035802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763406b970 0x7f7634147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.222+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 >> 172.21.15.37:0/1207035802 conn(0x7f76340cde40 msgr2=0x7f76340cc0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:42.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.226+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 shutdown_connections 2023-07-09T21:39:42.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.226+0000 7f763c1fa640 1 -- 172.21.15.37:0/1207035802 wait complete. 2023-07-09T21:39:42.258 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:39:42.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.402+0000 7f4557e56640 1 Processor -- start 2023-07-09T21:39:42.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.402+0000 7f4557e56640 1 -- start start 2023-07-09T21:39:42.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4557e56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:42.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4557e56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500c47a0 con 0x7f455015c200 2023-07-09T21:39:42.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4557e56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45500c9090 con 0x7f45501585b0 2023-07-09T21:39:42.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4557e56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500cbf40 con 0x7f45500c3e10 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45563f3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f455015c200 0x7f45500c9520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44536/0 (socket says 172.21.15.37:44536) 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45563f3640 1 -- 172.21.15.37:0/82013431 learned_addr learned my addr 172.21.15.37:0/82013431 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45553f1640 1 --2- 172.21.15.37:0/82013431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792784275 0 0) 0x7f45480014a0 con 0x7f455015c200 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f453c003530 con 0x7f455015c200 2023-07-09T21:39:42.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251761882 0 0) 0x7f45500c9090 con 0x7f45501585b0 2023-07-09T21:39:42.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45480014a0 con 0x7f45501585b0 2023-07-09T21:39:42.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45553f1640 1 -- 172.21.15.37:0/82013431 >> v1:172.21.15.119:6789/0 conn(0x7f45501585b0 legacy=0x7f455006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45553f1640 1 -- 172.21.15.37:0/82013431 >> v1:172.21.15.37:6789/0 conn(0x7f455015c200 legacy=0x7f45500c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.406+0000 7f45553f1640 1 -- 172.21.15.37:0/82013431 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500c8a60 con 0x7f45500c3e10 2023-07-09T21:39:42.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f45553f1640 1 --2- 172.21.15.37:0/82013431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c4260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45400097f0 tx=0x7f454001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700cc0a26a4491a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45400ac620 con 0x7f45500c3e10 2023-07-09T21:39:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45400ac780 con 0x7f45500c3e10 2023-07-09T21:39:42.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4554bf0640 1 -- 172.21.15.37:0/82013431 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45400acaf0 con 0x7f45500c3e10 2023-07-09T21:39:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- 172.21.15.37:0/82013431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 msgr2=0x7f45500c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 --2- 172.21.15.37:0/82013431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c4260 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f45400097f0 tx=0x7f454001c4c0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- 172.21.15.37:0/82013431 shutdown_connections 2023-07-09T21:39:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 --2- 172.21.15.37:0/82013431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c4260 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- 172.21.15.37:0/82013431 >> 172.21.15.37:0/82013431 conn(0x7f45500cde40 msgr2=0x7f45500ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:42.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- 172.21.15.37:0/82013431 shutdown_connections 2023-07-09T21:39:42.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- 172.21.15.37:0/82013431 wait complete. 2023-07-09T21:39:42.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 Processor -- start 2023-07-09T21:39:42.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.410+0000 7f4557e56640 1 -- start start 2023-07-09T21:39:42.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 0x7f4550146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c7110 con 0x7f455015c200 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c73f0 con 0x7f45501585b0 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45500c76d0 con 0x7f45500c3e10 2023-07-09T21:39:42.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57070/0 (socket says 172.21.15.37:57070) 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 -- 172.21.15.37:0/2527692449 learned_addr learned my addr 172.21.15.37:0/2527692449 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45553f1640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 0x7f4550146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4555bf2640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 -- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 msgr2=0x7f45500c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 -- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 msgr2=0x7f4550146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:42.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 0x7f4550146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 -- 172.21.15.37:0/2527692449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009420 con 0x7f455015c200 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45553f1640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 0x7f4550146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4555bf2640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45563f3640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f454800cc30 tx=0x7f454800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454800ce40 con 0x7f455015c200 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548012400 con 0x7f455015c200 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45500c79b0 con 0x7f455015c200 2023-07-09T21:39:42.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012790 con 0x7f455015c200 2023-07-09T21:39:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45500c6d70 con 0x7f455015c200 2023-07-09T21:39:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.414+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455004d7d0 con 0x7f455015c200 2023-07-09T21:39:42.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.418+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4548007070 con 0x7f455015c200 2023-07-09T21:39:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.418+0000 7f45467fc640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 0x7f4534068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.418+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f4548084260 con 0x7f455015c200 2023-07-09T21:39:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.418+0000 7f4555bf2640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 0x7f4534068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:42.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.418+0000 7f4555bf2640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 0x7f4534068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f455014f420 tx=0x7f454c009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:42.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.422+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4548051610 con 0x7f455015c200 2023-07-09T21:39:42.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:42.614+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45500c47a0 con 0x7f455015c200 2023-07-09T21:39:43.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.230+0000 7f45467fc640 1 -- 172.21.15.37:0/2527692449 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f45500c47a0 con 0x7f455015c200 2023-07-09T21:39:43.241 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 13 and data pool 14 2023-07-09T21:39:43.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.242+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 msgr2=0x7f4534068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.242+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 0x7f4534068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f455014f420 tx=0x7f454c009040 comp rx=0 tx=0).stop 2023-07-09T21:39:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 msgr2=0x7f455014acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f454800cc30 tx=0x7f454800a430 comp rx=0 tx=0).stop 2023-07-09T21:39:43.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 shutdown_connections 2023-07-09T21:39:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45340663a0 0x7f4534068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f455015c200 0x7f455014acf0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45501585b0 0x7f4550146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 --2- 172.21.15.37:0/2527692449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45500c3e10 0x7f45500c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.246+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 >> 172.21.15.37:0/2527692449 conn(0x7f45500cde40 msgr2=0x7f455006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.250+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 shutdown_connections 2023-07-09T21:39:43.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.250+0000 7f4557e56640 1 -- 172.21.15.37:0/2527692449 wait complete. 2023-07-09T21:39:43.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 Processor -- start 2023-07-09T21:39:43.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 -- start start 2023-07-09T21:39:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fceac0b7ab0 0x7fceac06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceac0cef80 0x7fceac0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac0b49f0 con 0x7fceac0b4170 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0b7e80 con 0x7fceac0cef80 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceb0b3a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceac0b4610 con 0x7fceac0b7ab0 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceac0cef80 0x7fceac0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceaad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fceac0b4170 0x7fceac15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44544/0 (socket says 172.21.15.37:44544) 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceaad9d640 1 -- 172.21.15.37:0/690874781 learned_addr learned my addr 172.21.15.37:0/690874781 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fceac0cef80 0x7fceac0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57084/0 (socket says 172.21.15.37:57084) 2023-07-09T21:39:43.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fceaa59c640 1 --2- 172.21.15.37:0/690874781 >> v2:172.21.15.119:3300/0 conn(0x7fceac0b7ab0 0x7fceac06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 -- 172.21.15.37:0/690874781 >> v2:172.21.15.119:3300/0 conn(0x7fceac0b7ab0 msgr2=0x7fceac06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 --2- 172.21.15.37:0/690874781 >> v2:172.21.15.119:3300/0 conn(0x7fceac0b7ab0 0x7fceac06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 -- 172.21.15.37:0/690874781 >> v1:172.21.15.37:6789/0 conn(0x7fceac0b4170 legacy=0x7fceac15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea9d9b640 1 -- 172.21.15.37:0/690874781 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342624769 0 0) 0x7fceac0b49f0 con 0x7fceac0b4170 2023-07-09T21:39:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.422+0000 7fcea1d9b640 1 -- 172.21.15.37:0/690874781 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac0cc8a0 con 0x7fceac0cef80 2023-07-09T21:39:43.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fcea1d9b640 1 --2- 172.21.15.37:0/690874781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0cef80 0x7fceac0b3c30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fceac06b360 tx=0x7fce9c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca41dfb0ac855a79 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fcea9d9b640 1 -- 172.21.15.37:0/690874781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0a7070 con 0x7fceac0cef80 2023-07-09T21:39:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fcea9d9b640 1 -- 172.21.15.37:0/690874781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c0ab430 con 0x7fceac0cef80 2023-07-09T21:39:43.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fcea9d9b640 1 -- 172.21.15.37:0/690874781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0ab7c0 con 0x7fceac0cef80 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 -- 172.21.15.37:0/690874781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0cef80 msgr2=0x7fceac0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/690874781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0cef80 0x7fceac0b3c30 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fceac06b360 tx=0x7fce9c01c430 comp rx=0 tx=0).stop 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 -- 172.21.15.37:0/690874781 shutdown_connections 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/690874781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0cef80 0x7fceac0b3c30 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/690874781 >> v2:172.21.15.119:3300/0 conn(0x7fceac0b7ab0 0x7fceac06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 -- 172.21.15.37:0/690874781 >> 172.21.15.37:0/690874781 conn(0x7fceac073090 msgr2=0x7fceac069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 -- 172.21.15.37:0/690874781 shutdown_connections 2023-07-09T21:39:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.426+0000 7fceb0b3a640 1 -- 172.21.15.37:0/690874781 wait complete. 2023-07-09T21:39:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 Processor -- start 2023-07-09T21:39:43.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- start start 2023-07-09T21:39:43.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceac0b4170 0x7fceac15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceac0cef80 0x7fceac0cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b5a80 con 0x7fceac0b7ab0 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b68a0 con 0x7fceac0cef80 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac0b5c90 con 0x7fceac0b4170 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57086/0 (socket says 172.21.15.37:57086) 2023-07-09T21:39:43.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 -- 172.21.15.37:0/3684870231 learned_addr learned my addr 172.21.15.37:0/3684870231 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceaad9d640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceac0cef80 0x7fceac0cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceaa59c640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceac0b4170 0x7fceac15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 -- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceac0b4170 msgr2=0x7fceac15b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceac0b4170 0x7fceac15b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 -- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceac0cef80 msgr2=0x7fceac0cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceac0cef80 0x7fceac0cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 -- 172.21.15.37:0/3684870231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c009420 con 0x7fceac0b7ab0 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea1d9b640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0ad040 tx=0x7fce9c0191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c004220 con 0x7fceac0b7ab0 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce9c004380 con 0x7fceac0b7ab0 2023-07-09T21:39:43.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac0b5f70 con 0x7fceac0b7ab0 2023-07-09T21:39:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce9c0aba00 con 0x7fceac0b7ab0 2023-07-09T21:39:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.430+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac0b6530 con 0x7fceac0b7ab0 2023-07-09T21:39:43.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac04d7d0 con 0x7fceac0b7ab0 2023-07-09T21:39:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fce9c0bc070 con 0x7fceac0b7ab0 2023-07-09T21:39:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fcea37fe640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 0x7fce8c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fce9c11db20 con 0x7fceac0b7ab0 2023-07-09T21:39:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fceaa59c640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 0x7fce8c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.434+0000 7fceaa59c640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 0x7fce8c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fceac156530 tx=0x7fce94009190 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.438+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fce9c0ead90 con 0x7fceac0b7ab0 2023-07-09T21:39:43.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.594+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fceac06a830 con 0x7fceac0b7ab0 2023-07-09T21:39:43.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.594+0000 7fcea37fe640 1 -- 172.21.15.37:0/3684870231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18306 (secure 0 0 0) 0x7fce9c0044f0 con 0x7fceac0b7ab0 2023-07-09T21:39:43.599 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:43.599 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":112,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:42.620536+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:43.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 msgr2=0x7fce8c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 0x7fce8c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fceac156530 tx=0x7fce94009190 comp rx=0 tx=0).stop 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 msgr2=0x7fceac0b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fce9c0ad040 tx=0x7fce9c0191d0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 shutdown_connections 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fce8c0663a0 0x7fce8c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fceac0cef80 0x7fceac0cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fceac0b7ab0 0x7fceac0b6d30 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 --2- 172.21.15.37:0/3684870231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fceac0b4170 0x7fceac15b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 >> 172.21.15.37:0/3684870231 conn(0x7fceac073090 msgr2=0x7fceac0d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:43.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 shutdown_connections 2023-07-09T21:39:43.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.598+0000 7fceb0b3a640 1 -- 172.21.15.37:0/3684870231 wait complete. 2023-07-09T21:39:43.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:43.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 Processor -- start 2023-07-09T21:39:43.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 -- start start 2023-07-09T21:39:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 0x7fe1c80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80cd080 con 0x7fe1c81600b0 2023-07-09T21:39:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c80cd920 con 0x7fe1c80aff40 2023-07-09T21:39:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cf66d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c80ca2f0 con 0x7fe1c815fce0 2023-07-09T21:39:43.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1ccc08640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe1c81600b0 0x7fe1c80af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44560/0 (socket says 172.21.15.37:44560) 2023-07-09T21:39:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1ccc08640 1 -- 172.21.15.37:0/3294509689 learned_addr learned my addr 172.21.15.37:0/3294509689 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:43.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cd409640 1 --2- 172.21.15.37:0/3294509689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 0x7fe1c80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1bffff640 1 -- 172.21.15.37:0/3294509689 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265893650 0 0) 0x7fe1c80cd080 con 0x7fe1c81600b0 2023-07-09T21:39:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1bffff640 1 -- 172.21.15.37:0/3294509689 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b4003530 con 0x7fe1c81600b0 2023-07-09T21:39:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cd409640 1 -- 172.21.15.37:0/3294509689 >> v1:172.21.15.119:6789/0 conn(0x7fe1c80aff40 legacy=0x7fe1c8070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cd409640 1 -- 172.21.15.37:0/3294509689 >> v1:172.21.15.37:6789/0 conn(0x7fe1c81600b0 legacy=0x7fe1c80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.762+0000 7fe1cd409640 1 -- 172.21.15.37:0/3294509689 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c80cd2d0 con 0x7fe1c815fce0 2023-07-09T21:39:43.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cd409640 1 --2- 172.21.15.37:0/3294509689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 0x7fe1c80c9620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097f0 tx=0x7fe1c401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f862599220687fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1bffff640 1 -- 172.21.15.37:0/3294509689 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40ab620 con 0x7fe1c815fce0 2023-07-09T21:39:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1bffff640 1 -- 172.21.15.37:0/3294509689 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c40ab780 con 0x7fe1c815fce0 2023-07-09T21:39:43.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1bffff640 1 -- 172.21.15.37:0/3294509689 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40abb10 con 0x7fe1c815fce0 2023-07-09T21:39:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3294509689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 msgr2=0x7fe1c80c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3294509689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 0x7fe1c80c9620 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40097f0 tx=0x7fe1c401c400 comp rx=0 tx=0).stop 2023-07-09T21:39:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3294509689 shutdown_connections 2023-07-09T21:39:43.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3294509689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c815fce0 0x7fe1c80c9620 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3294509689 >> 172.21.15.37:0/3294509689 conn(0x7fe1c80ca830 msgr2=0x7fe1c80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3294509689 shutdown_connections 2023-07-09T21:39:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.766+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3294509689 wait complete. 2023-07-09T21:39:43.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 Processor -- start 2023-07-09T21:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- start start 2023-07-09T21:39:43.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c815fce0 0x7fe1c8153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 0x7fe1c81619e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8160f40 con 0x7fe1c80aff40 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c815adf0 con 0x7fe1c815fce0 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c8154190 con 0x7fe1c8159910 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57090/0 (socket says 172.21.15.37:57090) 2023-07-09T21:39:43.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 -- 172.21.15.37:0/3264804522 learned_addr learned my addr 172.21.15.37:0/3264804522 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1ccc08640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c815fce0 0x7fe1c8153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cdc0a640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 0x7fe1c81619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 -- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 msgr2=0x7fe1c81619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 0x7fe1c81619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 -- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c815fce0 msgr2=0x7fe1c8153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c815fce0 0x7fe1c8153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 -- 172.21.15.37:0/3264804522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c4009420 con 0x7fe1c80aff40 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cdc0a640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 0x7fe1c81619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cd409640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4019010 tx=0x7fe1c401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40abdc0 con 0x7fe1c80aff40 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c40bf410 con 0x7fe1c80aff40 2023-07-09T21:39:43.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c40bf7c0 con 0x7fe1c80aff40 2023-07-09T21:39:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c8159d80 con 0x7fe1c80aff40 2023-07-09T21:39:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c81614c0 con 0x7fe1c80aff40 2023-07-09T21:39:43.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.770+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c804d7d0 con 0x7fe1c80aff40 2023-07-09T21:39:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.774+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe1c40bf920 con 0x7fe1c80aff40 2023-07-09T21:39:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.774+0000 7fe1bdffb640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 0x7fe1ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.774+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe1c411e900 con 0x7fe1c80aff40 2023-07-09T21:39:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.774+0000 7fe1ccc08640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 0x7fe1ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:43.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.774+0000 7fe1ccc08640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 0x7fe1ac068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815fa50 tx=0x7fe1b8009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:43.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.778+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1c40ebad0 con 0x7fe1c80aff40 2023-07-09T21:39:43.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.934+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1c80c8140 con 0x7fe1c80aff40 2023-07-09T21:39:43.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.934+0000 7fe1bdffb640 1 -- 172.21.15.37:0/3264804522 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+18306 (secure 0 0 0) 0x7fe1c40ef0f0 con 0x7fe1c80aff40 2023-07-09T21:39:43.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:43.938 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":112,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:42.620536+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:43.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 msgr2=0x7fe1ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 0x7fe1ac068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe1c815fa50 tx=0x7fe1b8009040 comp rx=0 tx=0).stop 2023-07-09T21:39:43.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 msgr2=0x7fe1c815a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:43.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4019010 tx=0x7fe1c401ac40 comp rx=0 tx=0).stop 2023-07-09T21:39:43.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 shutdown_connections 2023-07-09T21:39:43.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe1ac0663a0 0x7fe1ac068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1c8159910 0x7fe1c81619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1c815fce0 0x7fe1c8153640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 --2- 172.21.15.37:0/3264804522 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1c80aff40 0x7fe1c815a8b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:43.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 >> 172.21.15.37:0/3264804522 conn(0x7fe1c80ca830 msgr2=0x7fe1c80cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:43.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 shutdown_connections 2023-07-09T21:39:43.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:43.938+0000 7fe1cf66d640 1 -- 172.21.15.37:0/3264804522 wait complete. 2023-07-09T21:39:43.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:39:44.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-07-09T21:39:44.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-07-09T21:39:44.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-07-09T21:39:44.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 Processor -- start 2023-07-09T21:39:44.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 -- start start 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 0x7fcfc4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfc40ceb80 0x7fcfc40cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b3c20 0x7fcfc40b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc40cd070 con 0x7fcfc40ceb80 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc40cfd70 con 0x7fcfc40b7980 2023-07-09T21:39:44.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.102+0000 7fcfc9d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc415bf80 con 0x7fcfc40b3c20 2023-07-09T21:39:44.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfc40ceb80 0x7fcfc40cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfc40ceb80 0x7fcfc40cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57102/0 (socket says 172.21.15.37:57102) 2023-07-09T21:39:44.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 -- 172.21.15.37:0/2710812707 learned_addr learned my addr 172.21.15.37:0/2710812707 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 -- 172.21.15.37:0/2710812707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b3c20 msgr2=0x7fcfc40b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 --2- 172.21.15.37:0/2710812707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b3c20 0x7fcfc40b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 -- 172.21.15.37:0/2710812707 >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 msgr2=0x7fcfc4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc37fe640 1 --2- 172.21.15.37:0/2710812707 >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 0x7fcfc4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 --2- 172.21.15.37:0/2710812707 >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 0x7fcfc4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 -- 172.21.15.37:0/2710812707 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4160570 con 0x7fcfc40ceb80 2023-07-09T21:39:44.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc37fe640 1 --2- 172.21.15.37:0/2710812707 >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 0x7fcfc4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:44.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc2ffd640 1 --2- 172.21.15.37:0/2710812707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc40cefc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4069aa0 tx=0x7fcfb801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36b152a28cb615e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:44.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc27fc640 1 -- 172.21.15.37:0/2710812707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80ab600 con 0x7fcfc40ceb80 2023-07-09T21:39:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc27fc640 1 -- 172.21.15.37:0/2710812707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb80a7050 con 0x7fcfc40ceb80 2023-07-09T21:39:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.106+0000 7fcfc27fc640 1 -- 172.21.15.37:0/2710812707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb80ab980 con 0x7fcfc40ceb80 2023-07-09T21:39:44.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- 172.21.15.37:0/2710812707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 msgr2=0x7fcfc40cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/2710812707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc40cefc0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fcfc4069aa0 tx=0x7fcfb801c500 comp rx=0 tx=0).stop 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- 172.21.15.37:0/2710812707 shutdown_connections 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/2710812707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc40cefc0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/2710812707 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b3c20 0x7fcfc40b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/2710812707 >> v2:172.21.15.119:3300/0 conn(0x7fcfc40b7980 0x7fcfc4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- 172.21.15.37:0/2710812707 >> 172.21.15.37:0/2710812707 conn(0x7fcfc4073090 msgr2=0x7fcfc4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:44.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- 172.21.15.37:0/2710812707 shutdown_connections 2023-07-09T21:39:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- 172.21.15.37:0/2710812707 wait complete. 2023-07-09T21:39:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 Processor -- start 2023-07-09T21:39:44.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- start start 2023-07-09T21:39:44.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfc40b3c20 0x7fcfc41543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b7980 0x7fcfc414ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40d0f70 con 0x7fcfc40ceb80 2023-07-09T21:39:44.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc415a640 con 0x7fcfc40b3c20 2023-07-09T21:39:44.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc9d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c8340 con 0x7fcfc40b7980 2023-07-09T21:39:44.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57118/0 (socket says 172.21.15.37:57118) 2023-07-09T21:39:44.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 -- 172.21.15.37:0/3326549610 learned_addr learned my addr 172.21.15.37:0/3326549610 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:44.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc2ffd640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b7980 0x7fcfc414ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc37fe640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfc40b3c20 0x7fcfc41543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 -- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b7980 msgr2=0x7fcfc414ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b7980 0x7fcfc414ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 -- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfc40b3c20 msgr2=0x7fcfc41543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfc40b3c20 0x7fcfc41543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.110+0000 7fcfc3fff640 1 -- 172.21.15.37:0/3326549610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80094d0 con 0x7fcfc40ceb80 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfc3fff640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b970 tx=0x7fcfbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc00cb40 con 0x7fcfc40ceb80 2023-07-09T21:39:44.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc00ccc0 con 0x7fcfc40ceb80 2023-07-09T21:39:44.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc014680 con 0x7fcfc40ceb80 2023-07-09T21:39:44.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc40c7aa0 con 0x7fcfc40ceb80 2023-07-09T21:39:44.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc40c8060 con 0x7fcfc40ceb80 2023-07-09T21:39:44.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc415a7b0 con 0x7fcfc40ceb80 2023-07-09T21:39:44.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcfbc01d3b0 con 0x7fcfc40ceb80 2023-07-09T21:39:44.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:44.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfbc083e00 con 0x7fcfc40ceb80 2023-07-09T21:39:44.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.114+0000 7fcfc37fe640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:44.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.118+0000 7fcfc37fe640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400ab60 tx=0x7fcfb4008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:44.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.118+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfbc051180 con 0x7fcfc40ceb80 2023-07-09T21:39:44.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:44.314+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcfc404d7d0 con 0x7fcfc40ceb80 2023-07-09T21:39:45.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfabfff640 1 -- 172.21.15.37:0/3326549610 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcfbc0190b0 con 0x7fcfc40ceb80 2023-07-09T21:39:45.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 msgr2=0x7fcfb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 0x7fcfb0068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400ab60 tx=0x7fcfb4008040 comp rx=0 tx=0).stop 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 msgr2=0x7fcfc4150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00b970 tx=0x7fcfbc00be30 comp rx=0 tx=0).stop 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 shutdown_connections 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fcfb00663a0 0x7fcfb0068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfc40ceb80 0x7fcfc4150480 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfc40b7980 0x7fcfc414ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 --2- 172.21.15.37:0/3326549610 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfc40b3c20 0x7fcfc41543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 >> 172.21.15.37:0/3326549610 conn(0x7fcfc4073090 msgr2=0x7fcfc40b64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 shutdown_connections 2023-07-09T21:39:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.246+0000 7fcfc9d11640 1 -- 172.21.15.37:0/3326549610 wait complete. 2023-07-09T21:39:45.274 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:39:45.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:39:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 Processor -- start 2023-07-09T21:39:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 -- start start 2023-07-09T21:39:45.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7faba00b7980 0x7faba0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba015bf80 con 0x7faba00ceb80 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba0160570 con 0x7faba00d0780 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7faba6093640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba00cd070 con 0x7faba00b7980 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faba00ceb80 0x7faba00cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44566/0 (socket says 172.21.15.37:44566) 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9effd640 1 -- 172.21.15.37:0/3217288345 learned_addr learned my addr 172.21.15.37:0/3217288345 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9f7fe640 1 --2- 172.21.15.37:0/3217288345 >> v2:172.21.15.119:3300/0 conn(0x7faba00b7980 0x7faba0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237698256 0 0) 0x7fab94001120 con 0x7faba00ceb80 2023-07-09T21:39:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab88003530 con 0x7faba00ceb80 2023-07-09T21:39:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9f7fe640 1 -- 172.21.15.37:0/3217288345 >> v1:172.21.15.119:6789/0 conn(0x7faba00d0780 legacy=0x7faba00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197979705 0 0) 0x7fab980014a0 con 0x7faba00d0780 2023-07-09T21:39:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9f7fe640 1 -- 172.21.15.37:0/3217288345 >> v1:172.21.15.37:6789/0 conn(0x7faba00ceb80 legacy=0x7faba00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.422+0000 7fab9f7fe640 1 -- 172.21.15.37:0/3217288345 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00d02f0 con 0x7faba00b7980 2023-07-09T21:39:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7fab9f7fe640 1 --2- 172.21.15.37:0/3217288345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba0160030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fab900097c0 tx=0x7fab9001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df002c998ce327c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900ab600 con 0x7faba00b7980 2023-07-09T21:39:45.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900a7050 con 0x7faba00b7980 2023-07-09T21:39:45.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7fab9e7fc640 1 -- 172.21.15.37:0/3217288345 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab900ab980 con 0x7faba00b7980 2023-07-09T21:39:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 -- 172.21.15.37:0/3217288345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 msgr2=0x7faba0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 --2- 172.21.15.37:0/3217288345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba0160030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fab900097c0 tx=0x7fab9001c480 comp rx=0 tx=0).stop 2023-07-09T21:39:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 -- 172.21.15.37:0/3217288345 shutdown_connections 2023-07-09T21:39:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 --2- 172.21.15.37:0/3217288345 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba0160030 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 -- 172.21.15.37:0/3217288345 >> 172.21.15.37:0/3217288345 conn(0x7faba0073090 msgr2=0x7faba0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:45.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 -- 172.21.15.37:0/3217288345 shutdown_connections 2023-07-09T21:39:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.426+0000 7faba6093640 1 -- 172.21.15.37:0/3217288345 wait complete. 2023-07-09T21:39:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 Processor -- start 2023-07-09T21:39:45.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- start start 2023-07-09T21:39:45.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faba00ceb80 0x7faba014f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba0152d60 con 0x7faba00d0780 2023-07-09T21:39:45.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba014fbf0 con 0x7faba00b7980 2023-07-09T21:39:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba0152150 con 0x7faba00ceb80 2023-07-09T21:39:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:45.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57128/0 (socket says 172.21.15.37:57128) 2023-07-09T21:39:45.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 -- 172.21.15.37:0/3163689322 learned_addr learned my addr 172.21.15.37:0/3163689322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:45.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9f7fe640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:45.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9effd640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faba00ceb80 0x7faba014f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 -- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faba00ceb80 msgr2=0x7faba014f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faba00ceb80 0x7faba014f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 -- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 msgr2=0x7faba00b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba00b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 -- 172.21.15.37:0/3163689322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab90009420 con 0x7faba00d0780 2023-07-09T21:39:45.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab9ffff640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fab98002240 tx=0x7fab9800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98003db0 con 0x7faba00d0780 2023-07-09T21:39:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9800ce30 con 0x7faba00d0780 2023-07-09T21:39:45.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab98005270 con 0x7faba00d0780 2023-07-09T21:39:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba0152430 con 0x7faba00d0780 2023-07-09T21:39:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.430+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba01529f0 con 0x7faba00d0780 2023-07-09T21:39:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0152f10 con 0x7faba00d0780 2023-07-09T21:39:45.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fab980053d0 con 0x7faba00d0780 2023-07-09T21:39:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7fab87fff640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 0x7fab8c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fab98083380 con 0x7faba00d0780 2023-07-09T21:39:45.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7fab9f7fe640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 0x7fab8c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.434+0000 7fab9f7fe640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 0x7fab8c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab900ad000 tx=0x7fab90008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:45.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.438+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faba0152f10 con 0x7faba00d0780 2023-07-09T21:39:45.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:45.626+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faba0160570 con 0x7faba00d0780 2023-07-09T21:39:46.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.246+0000 7fab87fff640 1 -- 172.21.15.37:0/3163689322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7faba0160570 con 0x7faba00d0780 2023-07-09T21:39:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 msgr2=0x7fab8c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 0x7fab8c068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fab900ad000 tx=0x7fab90008040 comp rx=0 tx=0).stop 2023-07-09T21:39:46.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 msgr2=0x7faba0150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fab98002240 tx=0x7fab9800cbe0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 shutdown_connections 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fab8c0663d0 0x7fab8c068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faba00d0780 0x7faba0150ea0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faba00ceb80 0x7faba014f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 --2- 172.21.15.37:0/3163689322 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faba00b7980 0x7faba00b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 >> 172.21.15.37:0/3163689322 conn(0x7faba0073090 msgr2=0x7faba00b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:46.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 shutdown_connections 2023-07-09T21:39:46.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.250+0000 7faba6093640 1 -- 172.21.15.37:0/3163689322 wait complete. 2023-07-09T21:39:46.277 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:39:46.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:46.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 Processor -- start 2023-07-09T21:39:46.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 -- start start 2023-07-09T21:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f44340b7ab0 0x7f443406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340b49f0 con 0x7f44340b4340 2023-07-09T21:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44340cc8a0 con 0x7f44340cef80 2023-07-09T21:39:46.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443c79f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44340b7e80 con 0x7f44340b7ab0 2023-07-09T21:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443ad3c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f44340b4340 0x7f44340d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44576/0 (socket says 172.21.15.37:44576) 2023-07-09T21:39:46.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443ad3c640 1 -- 172.21.15.37:0/1224785483 learned_addr learned my addr 172.21.15.37:0/1224785483 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:46.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f443a53b640 1 --2- 172.21.15.37:0/1224785483 >> v2:172.21.15.119:3300/0 conn(0x7f44340b7ab0 0x7f443406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870426885 0 0) 0x7f44340b49f0 con 0x7f44340b4340 2023-07-09T21:39:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.422+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4420003530 con 0x7f44340b4340 2023-07-09T21:39:46.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553842614 0 0) 0x7f44340cc8a0 con 0x7f44340cef80 2023-07-09T21:39:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44340b49f0 con 0x7f44340cef80 2023-07-09T21:39:46.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 582818660 0 0) 0x7f4420003530 con 0x7f44340b4340 2023-07-09T21:39:46.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 >> v2:172.21.15.119:3300/0 conn(0x7f44340b7ab0 msgr2=0x7f443406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:46.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 --2- 172.21.15.37:0/1224785483 >> v2:172.21.15.119:3300/0 conn(0x7f44340b7ab0 0x7f443406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 >> v1:172.21.15.119:6789/0 conn(0x7f44340cef80 legacy=0x7f44340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340ccb80 con 0x7f44340b4340 2023-07-09T21:39:46.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f442c001a00 con 0x7f44340b4340 2023-07-09T21:39:46.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 >> v1:172.21.15.37:6789/0 conn(0x7f44340b4340 legacy=0x7f44340d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4420003b10 0x7f4420003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442000bfb0 con 0x7f44200047d0 2023-07-09T21:39:46.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442000c120 con 0x7f4420003b10 2023-07-09T21:39:46.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442000c2e0 con 0x7f4420005180 2023-07-09T21:39:46.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f443a53b640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4420003b10 0x7f4420003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f443ad3c640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 -- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4420005180 msgr2=0x7f442000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:46.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4420005180 0x7f442000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 -- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4420003b10 msgr2=0x7f4420003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:46.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4420003b10 0x7f4420003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 -- 172.21.15.37:0/1224785483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420003530 con 0x7f44200047d0 2023-07-09T21:39:46.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f443ad3c640 1 -- 172.21.15.37:0/1224785483 reap_dead start 2023-07-09T21:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.426+0000 7f4439d3a640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 0x7f4420004c40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f443406af90 tx=0x7f442401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8e4ac73d698750 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240052d0 con 0x7f44200047d0 2023-07-09T21:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424005450 con 0x7f44200047d0 2023-07-09T21:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439539640 1 -- 172.21.15.37:0/1224785483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424003840 con 0x7f44200047d0 2023-07-09T21:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 msgr2=0x7f4420004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 0x7f4420004c40 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f443406af90 tx=0x7f442401ecb0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- 172.21.15.37:0/1224785483 shutdown_connections 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 --2- 172.21.15.37:0/1224785483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44200047d0 0x7f4420004c40 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- 172.21.15.37:0/1224785483 >> 172.21.15.37:0/1224785483 conn(0x7f4434073090 msgr2=0x7f4434069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- 172.21.15.37:0/1224785483 shutdown_connections 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- 172.21.15.37:0/1224785483 wait complete. 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 Processor -- start 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- start start 2023-07-09T21:39:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44200047d0 0x7f443415e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44340a8b70 0x7f44340a8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44340a9e80 con 0x7f44340aa510 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443415bc60 con 0x7f44340a8b70 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f443c79f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44340aaec0 con 0x7f44200047d0 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439d3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439d3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57140/0 (socket says 172.21.15.37:57140) 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.430+0000 7f4439d3a640 1 -- 172.21.15.37:0/4130770445 learned_addr learned my addr 172.21.15.37:0/4130770445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f443a53b640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44200047d0 0x7f443415e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f443ad3c640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44340a8b70 0x7f44340a8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 -- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44200047d0 msgr2=0x7f443415e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44200047d0 0x7f443415e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 -- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44340a8b70 msgr2=0x7f44340a8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44340a8b70 0x7f44340a8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 -- 172.21.15.37:0/4130770445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340a98c0 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f4439d3a640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4424000c10 tx=0x7f4420005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44240050d0 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4424005250 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424003e60 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44340a9ba0 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443414de20 con 0x7f44340aa510 2023-07-09T21:39:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443415b6e0 con 0x7f44340aa510 2023-07-09T21:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f44240067e0 con 0x7f44340aa510 2023-07-09T21:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.434+0000 7f442affd640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 0x7f4418068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.438+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f44241202c0 con 0x7f44340aa510 2023-07-09T21:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.438+0000 7f443a53b640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 0x7f4418068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.438+0000 7f443a53b640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 0x7f4418068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4430009b80 tx=0x7f4430009190 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.438+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f443415b6e0 con 0x7f44340aa510 2023-07-09T21:39:46.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f443415b6e0 con 0x7f44340aa510 2023-07-09T21:39:46.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f442affd640 1 -- 172.21.15.37:0/4130770445 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f443415b6e0 con 0x7f44340aa510 2023-07-09T21:39:46.629 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:46.629 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:39:46.630 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:39:46.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 msgr2=0x7f4418068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 0x7f4418068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4430009b80 tx=0x7f4430009190 comp rx=0 tx=0).stop 2023-07-09T21:39:46.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 msgr2=0x7f44340aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4424000c10 tx=0x7f4420005800 comp rx=0 tx=0).stop 2023-07-09T21:39:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 shutdown_connections 2023-07-09T21:39:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f44180663a0 0x7f4418068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f44340a8b70 0x7f44340a8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44340aa510 0x7f44340aa980 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 --2- 172.21.15.37:0/4130770445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f44200047d0 0x7f443415e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 >> 172.21.15.37:0/4130770445 conn(0x7f4434073090 msgr2=0x7f44340b6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:46.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 shutdown_connections 2023-07-09T21:39:46.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.626+0000 7f443c79f640 1 -- 172.21.15.37:0/4130770445 wait complete. 2023-07-09T21:39:46.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:39:46.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 Processor -- start 2023-07-09T21:39:46.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 -- start start 2023-07-09T21:39:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 0x7f969006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900cef80 0x7f96900b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96900b4170 0x7f969015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900b7e80 con 0x7f96900b4170 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96900b4610 con 0x7f96900b7ab0 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9697f9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900b49f0 con 0x7f96900cef80 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96900b4170 0x7f969015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96900b4170 0x7f969015f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57148/0 (socket says 172.21.15.37:57148) 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 -- 172.21.15.37:0/1529159896 learned_addr learned my addr 172.21.15.37:0/1529159896 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9695d3b640 1 --2- 172.21.15.37:0/1529159896 >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 0x7f969006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969553a640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900cef80 0x7f96900b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 -- 172.21.15.37:0/1529159896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900cef80 msgr2=0x7f96900b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900cef80 0x7f96900b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 -- 172.21.15.37:0/1529159896 >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 msgr2=0x7f969006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 --2- 172.21.15.37:0/1529159896 >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 0x7f969006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f969653c640 1 -- 172.21.15.37:0/1529159896 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96900cc8a0 con 0x7f96900b4170 2023-07-09T21:39:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.790+0000 7f9695d3b640 1 --2- 172.21.15.37:0/1529159896 >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 0x7f969006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:46.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f969653c640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f969015f490 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f969006b360 tx=0x7f968801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adbd9ec8411c389 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9694d39640 1 -- 172.21.15.37:0/1529159896 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880a5560 con 0x7f96900b4170 2023-07-09T21:39:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9694d39640 1 -- 172.21.15.37:0/1529159896 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96880a56c0 con 0x7f96900b4170 2023-07-09T21:39:46.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9694d39640 1 -- 172.21.15.37:0/1529159896 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96880a5a50 con 0x7f96900b4170 2023-07-09T21:39:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 -- 172.21.15.37:0/1529159896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 msgr2=0x7f969015f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f969015f490 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f969006b360 tx=0x7f968801c6e0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 -- 172.21.15.37:0/1529159896 shutdown_connections 2023-07-09T21:39:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f969015f490 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 --2- 172.21.15.37:0/1529159896 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900cef80 0x7f96900b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 --2- 172.21.15.37:0/1529159896 >> v2:172.21.15.119:3300/0 conn(0x7f96900b7ab0 0x7f969006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 -- 172.21.15.37:0/1529159896 >> 172.21.15.37:0/1529159896 conn(0x7f9690073090 msgr2=0x7f9690069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 -- 172.21.15.37:0/1529159896 shutdown_connections 2023-07-09T21:39:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.794+0000 7f9697f9f640 1 -- 172.21.15.37:0/1529159896 wait complete. 2023-07-09T21:39:46.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 Processor -- start 2023-07-09T21:39:46.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- start start 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900b7ab0 0x7f96900c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96900cef80 0x7f9690156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900ca260 con 0x7f96900b4170 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96900cb190 con 0x7f96900cef80 2023-07-09T21:39:46.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96900cb470 con 0x7f96900b7ab0 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57160/0 (socket says 172.21.15.37:57160) 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 -- 172.21.15.37:0/700786173 learned_addr learned my addr 172.21.15.37:0/700786173 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f969653c640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96900cef80 0x7f9690156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f969553a640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900b7ab0 0x7f96900c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 -- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900b7ab0 msgr2=0x7f96900c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900b7ab0 0x7f96900c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 -- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96900cef80 msgr2=0x7f9690156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96900cef80 0x7f9690156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 -- 172.21.15.37:0/700786173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9688009b30 con 0x7f96900b4170 2023-07-09T21:39:46.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9695d3b640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f968c00e810 tx=0x7f968c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00c8d0 con 0x7f96900b4170 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c00ca30 con 0x7f96900b4170 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c00cdc0 con 0x7f96900b4170 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96900cb750 con 0x7f96900b4170 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.798+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96900cbd10 con 0x7f96900b4170 2023-07-09T21:39:46.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969004d7d0 con 0x7f96900b4170 2023-07-09T21:39:46.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f968c013410 con 0x7f96900b4170 2023-07-09T21:39:46.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f96867fc640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 0x7f9674068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:46.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f968c083da0 con 0x7f96900b4170 2023-07-09T21:39:46.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f969553a640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 0x7f9674068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:46.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.802+0000 7f969553a640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 0x7f9674068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f969015c370 tx=0x7f9680008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:46.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.806+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f968c050ff0 con 0x7f96900b4170 2023-07-09T21:39:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.962+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96900ce810 con 0x7f96900b4170 2023-07-09T21:39:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.962+0000 7f96867fc640 1 -- 172.21.15.37:0/700786173 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+18293 (secure 0 0 0) 0x7f968c009480 con 0x7f96900b4170 2023-07-09T21:39:46.966 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:46.967 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":113,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:39:44.214311+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:39:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 msgr2=0x7f9674068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 0x7f9674068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f969015c370 tx=0x7f9680008040 comp rx=0 tx=0).stop 2023-07-09T21:39:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 msgr2=0x7f96900cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f968c00e810 tx=0x7f968c00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 shutdown_connections 2023-07-09T21:39:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f96740663a0 0x7f9674068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96900cef80 0x7f9690156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96900b7ab0 0x7f96900c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 --2- 172.21.15.37:0/700786173 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96900b4170 0x7f96900cab00 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 >> 172.21.15.37:0/700786173 conn(0x7f9690073090 msgr2=0x7f96900b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 shutdown_connections 2023-07-09T21:39:46.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:46.966+0000 7f9697f9f640 1 -- 172.21.15.37:0/700786173 wait complete. 2023-07-09T21:39:46.988 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:39:46.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 Processor -- start 2023-07-09T21:39:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 -- start start 2023-07-09T21:39:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 0x7f652c0d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c0d1380 con 0x7f652c0cf100 2023-07-09T21:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c0b13e0 con 0x7f652c06bc30 2023-07-09T21:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65331b6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c02bbe0 con 0x7f652c15bbf0 2023-07-09T21:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65329b5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f652c0cf100 0x7f652c0cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:44578/0 (socket says 172.21.15.37:44578) 2023-07-09T21:39:47.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65329b5640 1 -- 172.21.15.37:0/2476711352 learned_addr learned my addr 172.21.15.37:0/2476711352 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65321b4640 1 --2- 172.21.15.37:0/2476711352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 0x7f652c0d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1122684601 0 0) 0x7f652c0d1380 con 0x7f652c0cf100 2023-07-09T21:39:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6518003530 con 0x7f652c0cf100 2023-07-09T21:39:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104052167 0 0) 0x7f652c0b13e0 con 0x7f652c06bc30 2023-07-09T21:39:47.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c0d1380 con 0x7f652c06bc30 2023-07-09T21:39:47.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65321b4640 1 -- 172.21.15.37:0/2476711352 >> v1:172.21.15.119:6789/0 conn(0x7f652c06bc30 legacy=0x7f652c0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65321b4640 1 -- 172.21.15.37:0/2476711352 >> v1:172.21.15.37:6789/0 conn(0x7f652c0cf100 legacy=0x7f652c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.130+0000 7f65321b4640 1 -- 172.21.15.37:0/2476711352 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0b1100 con 0x7f652c15bbf0 2023-07-09T21:39:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65321b4640 1 --2- 172.21.15.37:0/2476711352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 0x7f652c0d1810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65280097f0 tx=0x7f652801c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9664ce8f118c63 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280ac410 con 0x7f652c15bbf0 2023-07-09T21:39:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65280ac570 con 0x7f652c15bbf0 2023-07-09T21:39:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65311b2640 1 -- 172.21.15.37:0/2476711352 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280ac900 con 0x7f652c15bbf0 2023-07-09T21:39:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 -- 172.21.15.37:0/2476711352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 msgr2=0x7f652c0d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 --2- 172.21.15.37:0/2476711352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 0x7f652c0d1810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f65280097f0 tx=0x7f652801c490 comp rx=0 tx=0).stop 2023-07-09T21:39:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 -- 172.21.15.37:0/2476711352 shutdown_connections 2023-07-09T21:39:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 --2- 172.21.15.37:0/2476711352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c15bbf0 0x7f652c0d1810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 -- 172.21.15.37:0/2476711352 >> 172.21.15.37:0/2476711352 conn(0x7f652c02b640 msgr2=0x7f652c0d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 -- 172.21.15.37:0/2476711352 shutdown_connections 2023-07-09T21:39:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.134+0000 7f65331b6640 1 -- 172.21.15.37:0/2476711352 wait complete. 2023-07-09T21:39:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 Processor -- start 2023-07-09T21:39:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- start start 2023-07-09T21:39:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 0x7f652c0b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c0cf100 0x7f652c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0b6bb0 con 0x7f652c15bbf0 2023-07-09T21:39:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0c8400 con 0x7f652c06bc30 2023-07-09T21:39:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0ca1f0 con 0x7f652c0cf100 2023-07-09T21:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57164/0 (socket says 172.21.15.37:57164) 2023-07-09T21:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 -- 172.21.15.37:0/3293341932 learned_addr learned my addr 172.21.15.37:0/3293341932 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65319b3640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c0cf100 0x7f652c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65321b4640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 0x7f652c0b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 -- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c0cf100 msgr2=0x7f652c0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c0cf100 0x7f652c0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 -- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 msgr2=0x7f652c0b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 0x7f652c0b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 -- 172.21.15.37:0/3293341932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6528009420 con 0x7f652c15bbf0 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65321b4640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 0x7f652c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65329b5640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb40 tx=0x7f652400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652400aca0 con 0x7f652c15bbf0 2023-07-09T21:39:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652400ae00 con 0x7f652c15bbf0 2023-07-09T21:39:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652c0b5fa0 con 0x7f652c15bbf0 2023-07-09T21:39:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6524012600 con 0x7f652c15bbf0 2023-07-09T21:39:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c0b6560 con 0x7f652c15bbf0 2023-07-09T21:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.138+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c0b6d20 con 0x7f652c15bbf0 2023-07-09T21:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.142+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6524007070 con 0x7f652c15bbf0 2023-07-09T21:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.142+0000 7f6522ffd640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 0x7f6510068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.142+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6524083e00 con 0x7f652c15bbf0 2023-07-09T21:39:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.142+0000 7f65321b4640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 0x7f6510068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.142+0000 7f65321b4640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 0x7f6510068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65280ae000 tx=0x7f65280a6040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.146+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6524051180 con 0x7f652c15bbf0 2023-07-09T21:39:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.298+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f652c169e30 con 0x7f65100663a0 2023-07-09T21:39:47.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.310+0000 7f6522ffd640 1 -- 172.21.15.37:0/3293341932 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306560 (secure 0 0 0) 0x7f65280ac8a0 con 0x7f65100663a0 2023-07-09T21:39:47.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:47.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 msgr2=0x7f6510068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 0x7f6510068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f65280ae000 tx=0x7f65280a6040 comp rx=0 tx=0).stop 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 msgr2=0x7f652c0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f652400cb40 tx=0x7f652400a060 comp rx=0 tx=0).stop 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 shutdown_connections 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f65100663a0 0x7f6510068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f652c15bbf0 0x7f652c0c9cb0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f652c0cf100 0x7f652c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 --2- 172.21.15.37:0/3293341932 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f652c06bc30 0x7f652c0b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 >> 172.21.15.37:0/3293341932 conn(0x7f652c02b640 msgr2=0x7f652c0afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 shutdown_connections 2023-07-09T21:39:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.314+0000 7f65331b6640 1 -- 172.21.15.37:0/3293341932 wait complete. 2023-07-09T21:39:47.337 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:46.874221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330704,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754644016,"statfs":{"total":773094113280,"available":772755472384,"internally_reserved":0,"allocated":12075008,"data_stored":6665896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.664798"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222829+0000","last_change":"2023-07-09T21:39:42.222829+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222829+0000","last_undegraded":"2023-07-09T21:39:42.222829+0000","last_fullsized":"2023-07-09T21:39:42.222829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222406+0000","last_change":"2023-07-09T21:39:42.222406+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222406+0000","last_undegraded":"2023-07-09T21:39:42.222406+0000","last_fullsized":"2023-07-09T21:39:42.222406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223788+0000","last_change":"2023-07-09T21:39:42.223788+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223788+0000","last_undegraded":"2023-07-09T21:39:42.223788+0000","last_fullsized":"2023-07-09T21:39:42.223788+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221904+0000","last_change":"2023-07-09T21:39:42.221904+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221904+0000","last_undegraded":"2023-07-09T21:39:42.221904+0000","last_fullsized":"2023-07-09T21:39:42.221904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224747+0000","last_change":"2023-07-09T21:39:42.224747+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224747+0000","last_undegraded":"2023-07-09T21:39:42.224747+0000","last_fullsized":"2023-07-09T21:39:42.224747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225310+0000","last_change":"2023-07-09T21:39:42.225310+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225310+0000","last_undegraded":"2023-07-09T21:39:42.225310+0000","last_fullsized":"2023-07-09T21:39:42.225310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230574+0000","last_change":"2023-07-09T21:39:42.230574+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230574+0000","last_undegraded":"2023-07-09T21:39:42.230574+0000","last_fullsized":"2023-07-09T21:39:42.230574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220602+0000","last_change":"2023-07-09T21:39:42.220602+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220602+0000","last_undegraded":"2023-07-09T21:39:42.220602+0000","last_fullsized":"2023-07-09T21:39:42.220602+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225568+0000","last_change":"2023-07-09T21:39:42.225568+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225568+0000","last_undegraded":"2023-07-09T21:39:42.225568+0000","last_fullsized":"2023-07-09T21:39:42.225568+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219622+0000","last_change":"2023-07-09T21:39:42.219622+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219622+0000","last_undegraded":"2023-07-09T21:39:42.219622+0000","last_fullsized":"2023-07-09T21:39:42.219622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227858+0000","last_change":"2023-07-09T21:39:42.227858+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227858+0000","last_undegraded":"2023-07-09T21:39:42.227858+0000","last_fullsized":"2023-07-09T21:39:42.227858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218223+0000","last_change":"2023-07-09T21:39:42.218223+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218223+0000","last_undegraded":"2023-07-09T21:39:42.218223+0000","last_fullsized":"2023-07-09T21:39:42.218223+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219045+0000","last_change":"2023-07-09T21:39:42.219045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219045+0000","last_undegraded":"2023-07-09T21:39:42.219045+0000","last_fullsized":"2023-07-09T21:39:42.219045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224804+0000","last_change":"2023-07-09T21:39:42.224804+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224804+0000","last_undegraded":"2023-07-09T21:39:42.224804+0000","last_fullsized":"2023-07-09T21:39:42.224804+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219081+0000","last_change":"2023-07-09T21:39:42.219081+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219081+0000","last_undegraded":"2023-07-09T21:39:42.219081+0000","last_fullsized":"2023-07-09T21:39:42.219081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220157+0000","last_change":"2023-07-09T21:39:42.220157+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220157+0000","last_undegraded":"2023-07-09T21:39:42.220157+0000","last_fullsized":"2023-07-09T21:39:42.220157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219451+0000","last_change":"2023-07-09T21:39:42.219451+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219451+0000","last_undegraded":"2023-07-09T21:39:42.219451+0000","last_fullsized":"2023-07-09T21:39:42.219451+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226271+0000","last_change":"2023-07-09T21:39:42.226271+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226271+0000","last_undegraded":"2023-07-09T21:39:42.226271+0000","last_fullsized":"2023-07-09T21:39:42.226271+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225545+0000","last_change":"2023-07-09T21:39:42.225545+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225545+0000","last_undegraded":"2023-07-09T21:39:42.225545+0000","last_fullsized":"2023-07-09T21:39:42.225545+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221425+0000","last_change":"2023-07-09T21:39:42.221425+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221425+0000","last_undegraded":"2023-07-09T21:39:42.221425+0000","last_fullsized":"2023-07-09T21:39:42.221425+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225272+0000","last_change":"2023-07-09T21:39:42.225272+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225272+0000","last_undegraded":"2023-07-09T21:39:42.225272+0000","last_fullsized":"2023-07-09T21:39:42.225272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224252+0000","last_change":"2023-07-09T21:39:42.224252+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224252+0000","last_undegraded":"2023-07-09T21:39:42.224252+0000","last_fullsized":"2023-07-09T21:39:42.224252+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.228334+0000","last_change":"2023-07-09T21:39:42.228334+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.228334+0000","last_undegraded":"2023-07-09T21:39:42.228334+0000","last_fullsized":"2023-07-09T21:39:42.228334+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224147+0000","last_change":"2023-07-09T21:39:42.224147+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224147+0000","last_undegraded":"2023-07-09T21:39:42.224147+0000","last_fullsized":"2023-07-09T21:39:42.224147+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223216+0000","last_change":"2023-07-09T21:39:42.223216+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223216+0000","last_undegraded":"2023-07-09T21:39:42.223216+0000","last_fullsized":"2023-07-09T21:39:42.223216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227051+0000","last_change":"2023-07-09T21:39:42.227051+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227051+0000","last_undegraded":"2023-07-09T21:39:42.227051+0000","last_fullsized":"2023-07-09T21:39:42.227051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219552+0000","last_change":"2023-07-09T21:39:42.219552+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219552+0000","last_undegraded":"2023-07-09T21:39:42.219552+0000","last_fullsized":"2023-07-09T21:39:42.219552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220974+0000","last_change":"2023-07-09T21:39:42.220974+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220974+0000","last_undegraded":"2023-07-09T21:39:42.220974+0000","last_fullsized":"2023-07-09T21:39:42.220974+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229053+0000","last_change":"2023-07-09T21:39:42.229053+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229053+0000","last_undegraded":"2023-07-09T21:39:42.229053+0000","last_fullsized":"2023-07-09T21:39:42.229053+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223724+0000","last_change":"2023-07-09T21:39:42.223724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223724+0000","last_undegraded":"2023-07-09T21:39:42.223724+0000","last_fullsized":"2023-07-09T21:39:42.223724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223278+0000","last_change":"2023-07-09T21:39:42.223278+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223278+0000","last_undegraded":"2023-07-09T21:39:42.223278+0000","last_fullsized":"2023-07-09T21:39:42.223278+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219716+0000","last_change":"2023-07-09T21:39:42.219716+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219716+0000","last_undegraded":"2023-07-09T21:39:42.219716+0000","last_fullsized":"2023-07-09T21:39:42.219716+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219003+0000","last_change":"2023-07-09T21:39:42.219003+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219003+0000","last_undegraded":"2023-07-09T21:39:42.219003+0000","last_fullsized":"2023-07-09T21:39:42.219003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245608+0000","last_change":"2023-07-09T21:39:42.244780+0000","last_active":"2023-07-09T21:39:42.245608+0000","last_peered":"2023-07-09T21:39:42.245608+0000","last_clean":"2023-07-09T21:39:42.245608+0000","last_became_active":"2023-07-09T21:39:42.244462+0000","last_became_peered":"2023-07-09T21:39:42.244462+0000","last_unstale":"2023-07-09T21:39:42.245608+0000","last_undegraded":"2023-07-09T21:39:42.245608+0000","last_fullsized":"2023-07-09T21:39:42.245608+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:54.826324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219926+0000","last_change":"2023-07-09T21:39:42.219926+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219926+0000","last_undegraded":"2023-07-09T21:39:42.219926+0000","last_fullsized":"2023-07-09T21:39:42.219926+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238132+0000","last_change":"2023-07-09T21:39:42.236524+0000","last_active":"2023-07-09T21:39:42.238132+0000","last_peered":"2023-07-09T21:39:42.238132+0000","last_clean":"2023-07-09T21:39:42.238132+0000","last_became_active":"2023-07-09T21:39:42.236106+0000","last_became_peered":"2023-07-09T21:39:42.236106+0000","last_unstale":"2023-07-09T21:39:42.238132+0000","last_undegraded":"2023-07-09T21:39:42.238132+0000","last_fullsized":"2023-07-09T21:39:42.238132+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:05.688418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230211+0000","last_change":"2023-07-09T21:39:42.230211+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230211+0000","last_undegraded":"2023-07-09T21:39:42.230211+0000","last_fullsized":"2023-07-09T21:39:42.230211+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242793+0000","last_change":"2023-07-09T21:39:42.240015+0000","last_active":"2023-07-09T21:39:42.242793+0000","last_peered":"2023-07-09T21:39:42.242793+0000","last_clean":"2023-07-09T21:39:42.242793+0000","last_became_active":"2023-07-09T21:39:42.239692+0000","last_became_peered":"2023-07-09T21:39:42.239692+0000","last_unstale":"2023-07-09T21:39:42.242793+0000","last_undegraded":"2023-07-09T21:39:42.242793+0000","last_fullsized":"2023-07-09T21:39:42.242793+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:11.352927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218929+0000","last_change":"2023-07-09T21:39:42.218929+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218929+0000","last_undegraded":"2023-07-09T21:39:42.218929+0000","last_fullsized":"2023-07-09T21:39:42.218929+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241279+0000","last_change":"2023-07-09T21:39:42.240133+0000","last_active":"2023-07-09T21:39:42.241279+0000","last_peered":"2023-07-09T21:39:42.241279+0000","last_clean":"2023-07-09T21:39:42.241279+0000","last_became_active":"2023-07-09T21:39:42.239809+0000","last_became_peered":"2023-07-09T21:39:42.239809+0000","last_unstale":"2023-07-09T21:39:42.241279+0000","last_undegraded":"2023-07-09T21:39:42.241279+0000","last_fullsized":"2023-07-09T21:39:42.241279+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:08.728171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221816+0000","last_change":"2023-07-09T21:39:42.221816+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221816+0000","last_undegraded":"2023-07-09T21:39:42.221816+0000","last_fullsized":"2023-07-09T21:39:42.221816+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234237+0000","last_change":"2023-07-09T21:39:42.232268+0000","last_active":"2023-07-09T21:39:42.234237+0000","last_peered":"2023-07-09T21:39:42.234237+0000","last_clean":"2023-07-09T21:39:42.234237+0000","last_became_active":"2023-07-09T21:39:42.231985+0000","last_became_peered":"2023-07-09T21:39:42.231985+0000","last_unstale":"2023-07-09T21:39:42.234237+0000","last_undegraded":"2023-07-09T21:39:42.234237+0000","last_fullsized":"2023-07-09T21:39:42.234237+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:23.103634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226576+0000","last_change":"2023-07-09T21:39:42.226576+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226576+0000","last_undegraded":"2023-07-09T21:39:42.226576+0000","last_fullsized":"2023-07-09T21:39:42.226576+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236966+0000","last_change":"2023-07-09T21:39:42.229864+0000","last_active":"2023-07-09T21:39:42.236966+0000","last_peered":"2023-07-09T21:39:42.236966+0000","last_clean":"2023-07-09T21:39:42.236966+0000","last_became_active":"2023-07-09T21:39:42.229579+0000","last_became_peered":"2023-07-09T21:39:42.229579+0000","last_unstale":"2023-07-09T21:39:42.236966+0000","last_undegraded":"2023-07-09T21:39:42.236966+0000","last_fullsized":"2023-07-09T21:39:42.236966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:46.633446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218724+0000","last_change":"2023-07-09T21:39:42.218724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218724+0000","last_undegraded":"2023-07-09T21:39:42.218724+0000","last_fullsized":"2023-07-09T21:39:42.218724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234419+0000","last_change":"2023-07-09T21:39:42.230843+0000","last_active":"2023-07-09T21:39:42.234419+0000","last_peered":"2023-07-09T21:39:42.234419+0000","last_clean":"2023-07-09T21:39:42.234419+0000","last_became_active":"2023-07-09T21:39:42.230544+0000","last_became_peered":"2023-07-09T21:39:42.230544+0000","last_unstale":"2023-07-09T21:39:42.234419+0000","last_undegraded":"2023-07-09T21:39:42.234419+0000","last_fullsized":"2023-07-09T21:39:42.234419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:14.352861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218489+0000","last_change":"2023-07-09T21:39:42.218489+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218489+0000","last_undegraded":"2023-07-09T21:39:42.218489+0000","last_fullsized":"2023-07-09T21:39:42.218489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245686+0000","last_change":"2023-07-09T21:39:42.244876+0000","last_active":"2023-07-09T21:39:42.245686+0000","last_peered":"2023-07-09T21:39:42.245686+0000","last_clean":"2023-07-09T21:39:42.245686+0000","last_became_active":"2023-07-09T21:39:42.244551+0000","last_became_peered":"2023-07-09T21:39:42.244551+0000","last_unstale":"2023-07-09T21:39:42.245686+0000","last_undegraded":"2023-07-09T21:39:42.245686+0000","last_fullsized":"2023-07-09T21:39:42.245686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:10.799330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225366+0000","last_change":"2023-07-09T21:39:42.225366+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225366+0000","last_undegraded":"2023-07-09T21:39:42.225366+0000","last_fullsized":"2023-07-09T21:39:42.225366+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241088+0000","last_change":"2023-07-09T21:39:42.233682+0000","last_active":"2023-07-09T21:39:42.241088+0000","last_peered":"2023-07-09T21:39:42.241088+0000","last_clean":"2023-07-09T21:39:42.241088+0000","last_became_active":"2023-07-09T21:39:42.233399+0000","last_became_peered":"2023-07-09T21:39:42.233399+0000","last_unstale":"2023-07-09T21:39:42.241088+0000","last_undegraded":"2023-07-09T21:39:42.241088+0000","last_fullsized":"2023-07-09T21:39:42.241088+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:32.383104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.231792+0000","last_change":"2023-07-09T21:39:42.231792+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.231792+0000","last_undegraded":"2023-07-09T21:39:42.231792+0000","last_fullsized":"2023-07-09T21:39:42.231792+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238527+0000","last_change":"2023-07-09T21:39:42.237809+0000","last_active":"2023-07-09T21:39:42.238527+0000","last_peered":"2023-07-09T21:39:42.238527+0000","last_clean":"2023-07-09T21:39:42.238527+0000","last_became_active":"2023-07-09T21:39:42.237410+0000","last_became_peered":"2023-07-09T21:39:42.237410+0000","last_unstale":"2023-07-09T21:39:42.238527+0000","last_undegraded":"2023-07-09T21:39:42.238527+0000","last_fullsized":"2023-07-09T21:39:42.238527+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:48.003891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225822+0000","last_change":"2023-07-09T21:39:42.225822+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225822+0000","last_undegraded":"2023-07-09T21:39:42.225822+0000","last_fullsized":"2023-07-09T21:39:42.225822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246127+0000","last_change":"2023-07-09T21:39:42.244755+0000","last_active":"2023-07-09T21:39:42.246127+0000","last_peered":"2023-07-09T21:39:42.246127+0000","last_clean":"2023-07-09T21:39:42.246127+0000","last_became_active":"2023-07-09T21:39:42.244416+0000","last_became_peered":"2023-07-09T21:39:42.244416+0000","last_unstale":"2023-07-09T21:39:42.246127+0000","last_undegraded":"2023-07-09T21:39:42.246127+0000","last_fullsized":"2023-07-09T21:39:42.246127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:25.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218727+0000","last_change":"2023-07-09T21:39:42.218727+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218727+0000","last_undegraded":"2023-07-09T21:39:42.218727+0000","last_fullsized":"2023-07-09T21:39:42.218727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238304+0000","last_change":"2023-07-09T21:39:42.227954+0000","last_active":"2023-07-09T21:39:42.238304+0000","last_peered":"2023-07-09T21:39:42.238304+0000","last_clean":"2023-07-09T21:39:42.238304+0000","last_became_active":"2023-07-09T21:39:42.227639+0000","last_became_peered":"2023-07-09T21:39:42.227639+0000","last_unstale":"2023-07-09T21:39:42.238304+0000","last_undegraded":"2023-07-09T21:39:42.238304+0000","last_fullsized":"2023-07-09T21:39:42.238304+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:56.473783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221264+0000","last_change":"2023-07-09T21:39:42.221264+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221264+0000","last_undegraded":"2023-07-09T21:39:42.221264+0000","last_fullsized":"2023-07-09T21:39:42.221264+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246177+0000","last_change":"2023-07-09T21:39:42.245324+0000","last_active":"2023-07-09T21:39:42.246177+0000","last_peered":"2023-07-09T21:39:42.246177+0000","last_clean":"2023-07-09T21:39:42.246177+0000","last_became_active":"2023-07-09T21:39:42.244983+0000","last_became_peered":"2023-07-09T21:39:42.244983+0000","last_unstale":"2023-07-09T21:39:42.246177+0000","last_undegraded":"2023-07-09T21:39:42.246177+0000","last_fullsized":"2023-07-09T21:39:42.246177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:50.112136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223016+0000","last_change":"2023-07-09T21:39:42.223016+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223016+0000","last_undegraded":"2023-07-09T21:39:42.223016+0000","last_fullsized":"2023-07-09T21:39:42.223016+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238087+0000","last_change":"2023-07-09T21:39:42.230619+0000","last_active":"2023-07-09T21:39:42.238087+0000","last_peered":"2023-07-09T21:39:42.238087+0000","last_clean":"2023-07-09T21:39:42.238087+0000","last_became_active":"2023-07-09T21:39:42.228042+0000","last_became_peered":"2023-07-09T21:39:42.228042+0000","last_unstale":"2023-07-09T21:39:42.238087+0000","last_undegraded":"2023-07-09T21:39:42.238087+0000","last_fullsized":"2023-07-09T21:39:42.238087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:00.504417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218044+0000","last_change":"2023-07-09T21:39:42.218044+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218044+0000","last_undegraded":"2023-07-09T21:39:42.218044+0000","last_fullsized":"2023-07-09T21:39:42.218044+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237017+0000","last_change":"2023-07-09T21:39:42.231175+0000","last_active":"2023-07-09T21:39:42.237017+0000","last_peered":"2023-07-09T21:39:42.237017+0000","last_clean":"2023-07-09T21:39:42.237017+0000","last_became_active":"2023-07-09T21:39:42.230911+0000","last_became_peered":"2023-07-09T21:39:42.230911+0000","last_unstale":"2023-07-09T21:39:42.237017+0000","last_undegraded":"2023-07-09T21:39:42.237017+0000","last_fullsized":"2023-07-09T21:39:42.237017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:54.534853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217840+0000","last_change":"2023-07-09T21:39:42.217840+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217840+0000","last_undegraded":"2023-07-09T21:39:42.217840+0000","last_fullsized":"2023-07-09T21:39:42.217840+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238639+0000","last_change":"2023-07-09T21:39:42.233317+0000","last_active":"2023-07-09T21:39:42.238639+0000","last_peered":"2023-07-09T21:39:42.238639+0000","last_clean":"2023-07-09T21:39:42.238639+0000","last_became_active":"2023-07-09T21:39:42.233048+0000","last_became_peered":"2023-07-09T21:39:42.233048+0000","last_unstale":"2023-07-09T21:39:42.238639+0000","last_undegraded":"2023-07-09T21:39:42.238639+0000","last_fullsized":"2023-07-09T21:39:42.238639+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:28:35.710801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227056+0000","last_change":"2023-07-09T21:39:42.227056+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227056+0000","last_undegraded":"2023-07-09T21:39:42.227056+0000","last_fullsized":"2023-07-09T21:39:42.227056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242704+0000","last_change":"2023-07-09T21:39:42.238834+0000","last_active":"2023-07-09T21:39:42.242704+0000","last_peered":"2023-07-09T21:39:42.242704+0000","last_clean":"2023-07-09T21:39:42.242704+0000","last_became_active":"2023-07-09T21:39:42.238523+0000","last_became_peered":"2023-07-09T21:39:42.238523+0000","last_unstale":"2023-07-09T21:39:42.242704+0000","last_undegraded":"2023-07-09T21:39:42.242704+0000","last_fullsized":"2023-07-09T21:39:42.242704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:40:05.335063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217235+0000","last_change":"2023-07-09T21:39:42.217235+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217235+0000","last_undegraded":"2023-07-09T21:39:42.217235+0000","last_fullsized":"2023-07-09T21:39:42.217235+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238113+0000","last_change":"2023-07-09T21:39:42.235742+0000","last_active":"2023-07-09T21:39:42.238113+0000","last_peered":"2023-07-09T21:39:42.238113+0000","last_clean":"2023-07-09T21:39:42.238113+0000","last_became_active":"2023-07-09T21:39:42.235449+0000","last_became_peered":"2023-07-09T21:39:42.235449+0000","last_unstale":"2023-07-09T21:39:42.238113+0000","last_undegraded":"2023-07-09T21:39:42.238113+0000","last_fullsized":"2023-07-09T21:39:42.238113+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217234+0000","last_change":"2023-07-09T21:39:42.217234+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217234+0000","last_undegraded":"2023-07-09T21:39:42.217234+0000","last_fullsized":"2023-07-09T21:39:42.217234+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245763+0000","last_change":"2023-07-09T21:39:42.244672+0000","last_active":"2023-07-09T21:39:42.245763+0000","last_peered":"2023-07-09T21:39:42.245763+0000","last_clean":"2023-07-09T21:39:42.245763+0000","last_became_active":"2023-07-09T21:39:42.244373+0000","last_became_peered":"2023-07-09T21:39:42.244373+0000","last_unstale":"2023-07-09T21:39:42.245763+0000","last_undegraded":"2023-07-09T21:39:42.245763+0000","last_fullsized":"2023-07-09T21:39:42.245763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:46.527940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222693+0000","last_change":"2023-07-09T21:39:42.222693+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222693+0000","last_undegraded":"2023-07-09T21:39:42.222693+0000","last_fullsized":"2023-07-09T21:39:42.222693+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237360+0000","last_change":"2023-07-09T21:39:42.234762+0000","last_active":"2023-07-09T21:39:42.237360+0000","last_peered":"2023-07-09T21:39:42.237360+0000","last_clean":"2023-07-09T21:39:42.237360+0000","last_became_active":"2023-07-09T21:39:42.234479+0000","last_became_peered":"2023-07-09T21:39:42.234479+0000","last_unstale":"2023-07-09T21:39:42.237360+0000","last_undegraded":"2023-07-09T21:39:42.237360+0000","last_fullsized":"2023-07-09T21:39:42.237360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:48.765795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217610+0000","last_change":"2023-07-09T21:39:42.217610+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217610+0000","last_undegraded":"2023-07-09T21:39:42.217610+0000","last_fullsized":"2023-07-09T21:39:42.217610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238242+0000","last_change":"2023-07-09T21:39:42.232385+0000","last_active":"2023-07-09T21:39:42.238242+0000","last_peered":"2023-07-09T21:39:42.238242+0000","last_clean":"2023-07-09T21:39:42.238242+0000","last_became_active":"2023-07-09T21:39:42.231546+0000","last_became_peered":"2023-07-09T21:39:42.231546+0000","last_unstale":"2023-07-09T21:39:42.238242+0000","last_undegraded":"2023-07-09T21:39:42.238242+0000","last_fullsized":"2023-07-09T21:39:42.238242+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:10.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225714+0000","last_change":"2023-07-09T21:39:42.225714+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225714+0000","last_undegraded":"2023-07-09T21:39:42.225714+0000","last_fullsized":"2023-07-09T21:39:42.225714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241802+0000","last_change":"2023-07-09T21:39:42.236910+0000","last_active":"2023-07-09T21:39:42.241802+0000","last_peered":"2023-07-09T21:39:42.241802+0000","last_clean":"2023-07-09T21:39:42.241802+0000","last_became_active":"2023-07-09T21:39:42.236606+0000","last_became_peered":"2023-07-09T21:39:42.236606+0000","last_unstale":"2023-07-09T21:39:42.241802+0000","last_undegraded":"2023-07-09T21:39:42.241802+0000","last_fullsized":"2023-07-09T21:39:42.241802+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:59.712895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224626+0000","last_change":"2023-07-09T21:39:42.224626+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224626+0000","last_undegraded":"2023-07-09T21:39:42.224626+0000","last_fullsized":"2023-07-09T21:39:42.224626+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240357+0000","last_change":"2023-07-09T21:39:42.238711+0000","last_active":"2023-07-09T21:39:42.240357+0000","last_peered":"2023-07-09T21:39:42.240357+0000","last_clean":"2023-07-09T21:39:42.240357+0000","last_became_active":"2023-07-09T21:39:42.238400+0000","last_became_peered":"2023-07-09T21:39:42.238400+0000","last_unstale":"2023-07-09T21:39:42.240357+0000","last_undegraded":"2023-07-09T21:39:42.240357+0000","last_fullsized":"2023-07-09T21:39:42.240357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:33.222075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217418+0000","last_change":"2023-07-09T21:39:42.217418+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217418+0000","last_undegraded":"2023-07-09T21:39:42.217418+0000","last_fullsized":"2023-07-09T21:39:42.217418+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242746+0000","last_change":"2023-07-09T21:39:42.239328+0000","last_active":"2023-07-09T21:39:42.242746+0000","last_peered":"2023-07-09T21:39:42.242746+0000","last_clean":"2023-07-09T21:39:42.242746+0000","last_became_active":"2023-07-09T21:39:42.239048+0000","last_became_peered":"2023-07-09T21:39:42.239048+0000","last_unstale":"2023-07-09T21:39:42.242746+0000","last_undegraded":"2023-07-09T21:39:42.242746+0000","last_fullsized":"2023-07-09T21:39:42.242746+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:31.191652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229459+0000","last_change":"2023-07-09T21:39:42.229459+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229459+0000","last_undegraded":"2023-07-09T21:39:42.229459+0000","last_fullsized":"2023-07-09T21:39:42.229459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238725+0000","last_change":"2023-07-09T21:39:42.235946+0000","last_active":"2023-07-09T21:39:42.238725+0000","last_peered":"2023-07-09T21:39:42.238725+0000","last_clean":"2023-07-09T21:39:42.238725+0000","last_became_active":"2023-07-09T21:39:42.235643+0000","last_became_peered":"2023-07-09T21:39:42.235643+0000","last_unstale":"2023-07-09T21:39:42.238725+0000","last_undegraded":"2023-07-09T21:39:42.238725+0000","last_fullsized":"2023-07-09T21:39:42.238725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:23.785562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"101'205","reported_seq":649,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229771+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:42.229771+0000","last_peered":"2023-07-09T21:39:42.229771+0000","last_clean":"2023-07-09T21:39:42.229771+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:42.229771+0000","last_undegraded":"2023-07-09T21:39:42.229771+0000","last_fullsized":"2023-07-09T21:39:42.229771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:03.342507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222569+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:42.222569+0000","last_peered":"2023-07-09T21:39:42.222569+0000","last_clean":"2023-07-09T21:39:42.222569+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:42.222569+0000","last_undegraded":"2023-07-09T21:39:42.222569+0000","last_fullsized":"2023-07-09T21:39:42.222569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:44.185194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218336+0000","last_change":"2023-07-09T21:39:42.218336+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218336+0000","last_undegraded":"2023-07-09T21:39:42.218336+0000","last_fullsized":"2023-07-09T21:39:42.218336+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240651+0000","last_change":"2023-07-09T21:39:42.238970+0000","last_active":"2023-07-09T21:39:42.240651+0000","last_peered":"2023-07-09T21:39:42.240651+0000","last_clean":"2023-07-09T21:39:42.240651+0000","last_became_active":"2023-07-09T21:39:42.237884+0000","last_became_peered":"2023-07-09T21:39:42.237884+0000","last_unstale":"2023-07-09T21:39:42.240651+0000","last_undegraded":"2023-07-09T21:39:42.240651+0000","last_fullsized":"2023-07-09T21:39:42.240651+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:40.688727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229599+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:42.229599+0000","last_peered":"2023-07-09T21:39:42.229599+0000","last_clean":"2023-07-09T21:39:42.229599+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:42.229599+0000","last_undegraded":"2023-07-09T21:39:42.229599+0000","last_fullsized":"2023-07-09T21:39:42.229599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:44.480339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227045+0000","last_change":"2023-07-09T21:39:42.227045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227045+0000","last_undegraded":"2023-07-09T21:39:42.227045+0000","last_fullsized":"2023-07-09T21:39:42.227045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.243159+0000","last_change":"2023-07-09T21:39:42.241874+0000","last_active":"2023-07-09T21:39:42.243159+0000","last_peered":"2023-07-09T21:39:42.243159+0000","last_clean":"2023-07-09T21:39:42.243159+0000","last_became_active":"2023-07-09T21:39:42.241590+0000","last_became_peered":"2023-07-09T21:39:42.241590+0000","last_unstale":"2023-07-09T21:39:42.243159+0000","last_undegraded":"2023-07-09T21:39:42.243159+0000","last_fullsized":"2023-07-09T21:39:42.243159+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:33.516145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218745+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:42.218745+0000","last_peered":"2023-07-09T21:39:42.218745+0000","last_clean":"2023-07-09T21:39:42.218745+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:42.218745+0000","last_undegraded":"2023-07-09T21:39:42.218745+0000","last_fullsized":"2023-07-09T21:39:42.218745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:29:36.617515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226601+0000","last_change":"2023-07-09T21:39:42.226601+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226601+0000","last_undegraded":"2023-07-09T21:39:42.226601+0000","last_fullsized":"2023-07-09T21:39:42.226601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240989+0000","last_change":"2023-07-09T21:39:42.240044+0000","last_active":"2023-07-09T21:39:42.240989+0000","last_peered":"2023-07-09T21:39:42.240989+0000","last_clean":"2023-07-09T21:39:42.240989+0000","last_became_active":"2023-07-09T21:39:42.239664+0000","last_became_peered":"2023-07-09T21:39:42.239664+0000","last_unstale":"2023-07-09T21:39:42.240989+0000","last_undegraded":"2023-07-09T21:39:42.240989+0000","last_fullsized":"2023-07-09T21:39:42.240989+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:33.117486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.226075+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:42.226075+0000","last_peered":"2023-07-09T21:39:42.226075+0000","last_clean":"2023-07-09T21:39:42.226075+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:42.226075+0000","last_undegraded":"2023-07-09T21:39:42.226075+0000","last_fullsized":"2023-07-09T21:39:42.226075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:05:51.349439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217257+0000","last_change":"2023-07-09T21:39:42.217257+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217257+0000","last_undegraded":"2023-07-09T21:39:42.217257+0000","last_fullsized":"2023-07-09T21:39:42.217257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241771+0000","last_change":"2023-07-09T21:39:42.237844+0000","last_active":"2023-07-09T21:39:42.241771+0000","last_peered":"2023-07-09T21:39:42.241771+0000","last_clean":"2023-07-09T21:39:42.241771+0000","last_became_active":"2023-07-09T21:39:42.237413+0000","last_became_peered":"2023-07-09T21:39:42.237413+0000","last_unstale":"2023-07-09T21:39:42.241771+0000","last_undegraded":"2023-07-09T21:39:42.241771+0000","last_fullsized":"2023-07-09T21:39:42.241771+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:48.795873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222216+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:42.222216+0000","last_peered":"2023-07-09T21:39:42.222216+0000","last_clean":"2023-07-09T21:39:42.222216+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:42.222216+0000","last_undegraded":"2023-07-09T21:39:42.222216+0000","last_fullsized":"2023-07-09T21:39:42.222216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:38.969088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222781+0000","last_change":"2023-07-09T21:39:42.222781+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222781+0000","last_undegraded":"2023-07-09T21:39:42.222781+0000","last_fullsized":"2023-07-09T21:39:42.222781+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236142+0000","last_change":"2023-07-09T21:39:42.233837+0000","last_active":"2023-07-09T21:39:42.236142+0000","last_peered":"2023-07-09T21:39:42.236142+0000","last_clean":"2023-07-09T21:39:42.236142+0000","last_became_active":"2023-07-09T21:39:42.233428+0000","last_became_peered":"2023-07-09T21:39:42.233428+0000","last_unstale":"2023-07-09T21:39:42.236142+0000","last_undegraded":"2023-07-09T21:39:42.236142+0000","last_fullsized":"2023-07-09T21:39:42.236142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:45.393745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.233824+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:42.233824+0000","last_peered":"2023-07-09T21:39:42.233824+0000","last_clean":"2023-07-09T21:39:42.233824+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:42.233824+0000","last_undegraded":"2023-07-09T21:39:42.233824+0000","last_fullsized":"2023-07-09T21:39:42.233824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.805502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222414+0000","last_change":"2023-07-09T21:39:42.222414+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222414+0000","last_undegraded":"2023-07-09T21:39:42.222414+0000","last_fullsized":"2023-07-09T21:39:42.222414+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242834+0000","last_change":"2023-07-09T21:39:42.241936+0000","last_active":"2023-07-09T21:39:42.242834+0000","last_peered":"2023-07-09T21:39:42.242834+0000","last_clean":"2023-07-09T21:39:42.242834+0000","last_became_active":"2023-07-09T21:39:42.241566+0000","last_became_peered":"2023-07-09T21:39:42.241566+0000","last_unstale":"2023-07-09T21:39:42.242834+0000","last_undegraded":"2023-07-09T21:39:42.242834+0000","last_fullsized":"2023-07-09T21:39:42.242834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218183+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:42.218183+0000","last_peered":"2023-07-09T21:39:42.218183+0000","last_clean":"2023-07-09T21:39:42.218183+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:42.218183+0000","last_undegraded":"2023-07-09T21:39:42.218183+0000","last_fullsized":"2023-07-09T21:39:42.218183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:16.871379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218131+0000","last_change":"2023-07-09T21:39:42.218131+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218131+0000","last_undegraded":"2023-07-09T21:39:42.218131+0000","last_fullsized":"2023-07-09T21:39:42.218131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.231571+0000","last_change":"2023-07-09T21:39:42.228204+0000","last_active":"2023-07-09T21:39:42.231571+0000","last_peered":"2023-07-09T21:39:42.231571+0000","last_clean":"2023-07-09T21:39:42.231571+0000","last_became_active":"2023-07-09T21:39:42.227935+0000","last_became_peered":"2023-07-09T21:39:42.227935+0000","last_unstale":"2023-07-09T21:39:42.231571+0000","last_undegraded":"2023-07-09T21:39:42.231571+0000","last_fullsized":"2023-07-09T21:39:42.231571+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:34.915164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.225425+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:42.225425+0000","last_peered":"2023-07-09T21:39:42.225425+0000","last_clean":"2023-07-09T21:39:42.225425+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:42.225425+0000","last_undegraded":"2023-07-09T21:39:42.225425+0000","last_fullsized":"2023-07-09T21:39:42.225425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:22.448454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1945600,"data_stored":1271042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.77200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.502}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.89600000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":1.01}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.92200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.034}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.083},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":680674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.36199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575056,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.628},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54524,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317316,"statfs":{"total":96636764160,"available":96580931584,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.437}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.496}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.70599999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.311},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.434},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.83399999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.81899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.872},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.747}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1957888,"data_stored":1277670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.441},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.755},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.86099999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:47.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 Processor -- start 2023-07-09T21:39:47.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 -- start start 2023-07-09T21:39:47.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 0x7ff96806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 0x7ff9680b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9680b49f0 con 0x7ff9680b4170 2023-07-09T21:39:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9680b7e80 con 0x7ff9680b7ab0 2023-07-09T21:39:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96f911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680b4610 con 0x7ff9680cef80 2023-07-09T21:39:47.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96deae640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff9680b4170 0x7ff96815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40456/0 (socket says 172.21.15.37:40456) 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96deae640 1 -- 172.21.15.37:0/1511692286 learned_addr learned my addr 172.21.15.37:0/1511692286 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1511692286 >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 0x7ff96806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96ceac640 1 --2- 172.21.15.37:0/1511692286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 0x7ff9680b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff95ffff640 1 -- 172.21.15.37:0/1511692286 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992029998 0 0) 0x7ff9680b49f0 con 0x7ff9680b4170 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff95ffff640 1 -- 172.21.15.37:0/1511692286 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff954003530 con 0x7ff9680b4170 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96ceac640 1 -- 172.21.15.37:0/1511692286 >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 msgr2=0x7ff96806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:47.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96ceac640 1 --2- 172.21.15.37:0/1511692286 >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 0x7ff96806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96ceac640 1 -- 172.21.15.37:0/1511692286 >> v1:172.21.15.37:6789/0 conn(0x7ff9680b4170 legacy=0x7ff96815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96ceac640 1 -- 172.21.15.37:0/1511692286 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680cc8a0 con 0x7ff9680cef80 2023-07-09T21:39:47.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.522+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1511692286 >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 0x7ff96806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96ceac640 1 --2- 172.21.15.37:0/1511692286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 0x7ff9680b3c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff95801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1e29544dde53f32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff95ffff640 1 -- 172.21.15.37:0/1511692286 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580ab650 con 0x7ff9680cef80 2023-07-09T21:39:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff95ffff640 1 -- 172.21.15.37:0/1511692286 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9580ab7b0 con 0x7ff9680cef80 2023-07-09T21:39:47.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff95ffff640 1 -- 172.21.15.37:0/1511692286 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580abb40 con 0x7ff9680cef80 2023-07-09T21:39:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 -- 172.21.15.37:0/1511692286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 msgr2=0x7ff9680b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 --2- 172.21.15.37:0/1511692286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 0x7ff9680b3c30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ff9580097c0 tx=0x7ff95801c450 comp rx=0 tx=0).stop 2023-07-09T21:39:47.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 -- 172.21.15.37:0/1511692286 shutdown_connections 2023-07-09T21:39:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 --2- 172.21.15.37:0/1511692286 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680cef80 0x7ff9680b3c30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 --2- 172.21.15.37:0/1511692286 >> v2:172.21.15.119:3300/0 conn(0x7ff9680b7ab0 0x7ff96806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.526+0000 7ff96f911640 1 -- 172.21.15.37:0/1511692286 >> 172.21.15.37:0/1511692286 conn(0x7ff968073090 msgr2=0x7ff968069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- 172.21.15.37:0/1511692286 shutdown_connections 2023-07-09T21:39:47.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- 172.21.15.37:0/1511692286 wait complete. 2023-07-09T21:39:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 Processor -- start 2023-07-09T21:39:47.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- start start 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 0x7ff9680cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680b7ab0 0x7ff9680c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c6d30 con 0x7ff9680cef80 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680c72f0 con 0x7ff9680b4170 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680ca6e0 con 0x7ff9680b7ab0 2023-07-09T21:39:47.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54060/0 (socket says 172.21.15.37:54060) 2023-07-09T21:39:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 -- 172.21.15.37:0/1145766423 learned_addr learned my addr 172.21.15.37:0/1145766423 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 0x7ff9680cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96ceac640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680b7ab0 0x7ff9680c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 -- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680b7ab0 msgr2=0x7ff9680c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680b7ab0 0x7ff9680c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 -- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 msgr2=0x7ff9680cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 0x7ff9680cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 -- 172.21.15.37:0/1145766423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff964009420 con 0x7ff9680cef80 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 0x7ff9680cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96deae640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff96000cad0 tx=0x7ff96000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000ac30 con 0x7ff9680cef80 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000ad90 con 0x7ff9680cef80 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff960012620 con 0x7ff9680cef80 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.530+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff958009420 con 0x7ff9680cef80 2023-07-09T21:39:47.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9680c6f80 con 0x7ff9680cef80 2023-07-09T21:39:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96804d7d0 con 0x7ff9680cef80 2023-07-09T21:39:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff960007070 con 0x7ff9680cef80 2023-07-09T21:39:47.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff95dffb640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 0x7ff94c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff960083e30 con 0x7ff9680cef80 2023-07-09T21:39:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.534+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 0x7ff94c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.538+0000 7ff96d6ad640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 0x7ff94c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff964009d40 tx=0x7ff964008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.538+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9600511b0 con 0x7ff9680cef80 2023-07-09T21:39:47.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.690+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9680cf4d0 con 0x7ff94c0663a0 2023-07-09T21:39:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.698+0000 7ff95dffb640 1 -- 172.21.15.37:0/1145766423 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306560 (secure 0 0 0) 0x7ff964009990 con 0x7ff94c0663a0 2023-07-09T21:39:47.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 msgr2=0x7ff94c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 0x7ff94c068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ff964009d40 tx=0x7ff964008040 comp rx=0 tx=0).stop 2023-07-09T21:39:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 msgr2=0x7ff9681552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7ff96000cad0 tx=0x7ff96000cf90 comp rx=0 tx=0).stop 2023-07-09T21:39:47.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 shutdown_connections 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7ff94c0663a0 0x7ff94c068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9680cef80 0x7ff9681552e0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9680b7ab0 0x7ff9680c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 --2- 172.21.15.37:0/1145766423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9680b4170 0x7ff9680cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 >> 172.21.15.37:0/1145766423 conn(0x7ff968073090 msgr2=0x7ff968158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 shutdown_connections 2023-07-09T21:39:47.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.702+0000 7ff96f911640 1 -- 172.21.15.37:0/1145766423 wait complete. 2023-07-09T21:39:47.724 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:46.874221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330704,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754644016,"statfs":{"total":773094113280,"available":772755472384,"internally_reserved":0,"allocated":12075008,"data_stored":6665896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.664798"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222829+0000","last_change":"2023-07-09T21:39:42.222829+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222829+0000","last_undegraded":"2023-07-09T21:39:42.222829+0000","last_fullsized":"2023-07-09T21:39:42.222829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222406+0000","last_change":"2023-07-09T21:39:42.222406+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222406+0000","last_undegraded":"2023-07-09T21:39:42.222406+0000","last_fullsized":"2023-07-09T21:39:42.222406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223788+0000","last_change":"2023-07-09T21:39:42.223788+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223788+0000","last_undegraded":"2023-07-09T21:39:42.223788+0000","last_fullsized":"2023-07-09T21:39:42.223788+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221904+0000","last_change":"2023-07-09T21:39:42.221904+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221904+0000","last_undegraded":"2023-07-09T21:39:42.221904+0000","last_fullsized":"2023-07-09T21:39:42.221904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224747+0000","last_change":"2023-07-09T21:39:42.224747+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224747+0000","last_undegraded":"2023-07-09T21:39:42.224747+0000","last_fullsized":"2023-07-09T21:39:42.224747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225310+0000","last_change":"2023-07-09T21:39:42.225310+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225310+0000","last_undegraded":"2023-07-09T21:39:42.225310+0000","last_fullsized":"2023-07-09T21:39:42.225310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230574+0000","last_change":"2023-07-09T21:39:42.230574+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230574+0000","last_undegraded":"2023-07-09T21:39:42.230574+0000","last_fullsized":"2023-07-09T21:39:42.230574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220602+0000","last_change":"2023-07-09T21:39:42.220602+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220602+0000","last_undegraded":"2023-07-09T21:39:42.220602+0000","last_fullsized":"2023-07-09T21:39:42.220602+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225568+0000","last_change":"2023-07-09T21:39:42.225568+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225568+0000","last_undegraded":"2023-07-09T21:39:42.225568+0000","last_fullsized":"2023-07-09T21:39:42.225568+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219622+0000","last_change":"2023-07-09T21:39:42.219622+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219622+0000","last_undegraded":"2023-07-09T21:39:42.219622+0000","last_fullsized":"2023-07-09T21:39:42.219622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227858+0000","last_change":"2023-07-09T21:39:42.227858+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227858+0000","last_undegraded":"2023-07-09T21:39:42.227858+0000","last_fullsized":"2023-07-09T21:39:42.227858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218223+0000","last_change":"2023-07-09T21:39:42.218223+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218223+0000","last_undegraded":"2023-07-09T21:39:42.218223+0000","last_fullsized":"2023-07-09T21:39:42.218223+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219045+0000","last_change":"2023-07-09T21:39:42.219045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219045+0000","last_undegraded":"2023-07-09T21:39:42.219045+0000","last_fullsized":"2023-07-09T21:39:42.219045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224804+0000","last_change":"2023-07-09T21:39:42.224804+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224804+0000","last_undegraded":"2023-07-09T21:39:42.224804+0000","last_fullsized":"2023-07-09T21:39:42.224804+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219081+0000","last_change":"2023-07-09T21:39:42.219081+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219081+0000","last_undegraded":"2023-07-09T21:39:42.219081+0000","last_fullsized":"2023-07-09T21:39:42.219081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220157+0000","last_change":"2023-07-09T21:39:42.220157+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220157+0000","last_undegraded":"2023-07-09T21:39:42.220157+0000","last_fullsized":"2023-07-09T21:39:42.220157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219451+0000","last_change":"2023-07-09T21:39:42.219451+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219451+0000","last_undegraded":"2023-07-09T21:39:42.219451+0000","last_fullsized":"2023-07-09T21:39:42.219451+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226271+0000","last_change":"2023-07-09T21:39:42.226271+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226271+0000","last_undegraded":"2023-07-09T21:39:42.226271+0000","last_fullsized":"2023-07-09T21:39:42.226271+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225545+0000","last_change":"2023-07-09T21:39:42.225545+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225545+0000","last_undegraded":"2023-07-09T21:39:42.225545+0000","last_fullsized":"2023-07-09T21:39:42.225545+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221425+0000","last_change":"2023-07-09T21:39:42.221425+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221425+0000","last_undegraded":"2023-07-09T21:39:42.221425+0000","last_fullsized":"2023-07-09T21:39:42.221425+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225272+0000","last_change":"2023-07-09T21:39:42.225272+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225272+0000","last_undegraded":"2023-07-09T21:39:42.225272+0000","last_fullsized":"2023-07-09T21:39:42.225272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224252+0000","last_change":"2023-07-09T21:39:42.224252+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224252+0000","last_undegraded":"2023-07-09T21:39:42.224252+0000","last_fullsized":"2023-07-09T21:39:42.224252+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.228334+0000","last_change":"2023-07-09T21:39:42.228334+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.228334+0000","last_undegraded":"2023-07-09T21:39:42.228334+0000","last_fullsized":"2023-07-09T21:39:42.228334+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224147+0000","last_change":"2023-07-09T21:39:42.224147+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224147+0000","last_undegraded":"2023-07-09T21:39:42.224147+0000","last_fullsized":"2023-07-09T21:39:42.224147+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223216+0000","last_change":"2023-07-09T21:39:42.223216+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223216+0000","last_undegraded":"2023-07-09T21:39:42.223216+0000","last_fullsized":"2023-07-09T21:39:42.223216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227051+0000","last_change":"2023-07-09T21:39:42.227051+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227051+0000","last_undegraded":"2023-07-09T21:39:42.227051+0000","last_fullsized":"2023-07-09T21:39:42.227051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219552+0000","last_change":"2023-07-09T21:39:42.219552+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219552+0000","last_undegraded":"2023-07-09T21:39:42.219552+0000","last_fullsized":"2023-07-09T21:39:42.219552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220974+0000","last_change":"2023-07-09T21:39:42.220974+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220974+0000","last_undegraded":"2023-07-09T21:39:42.220974+0000","last_fullsized":"2023-07-09T21:39:42.220974+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229053+0000","last_change":"2023-07-09T21:39:42.229053+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229053+0000","last_undegraded":"2023-07-09T21:39:42.229053+0000","last_fullsized":"2023-07-09T21:39:42.229053+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223724+0000","last_change":"2023-07-09T21:39:42.223724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223724+0000","last_undegraded":"2023-07-09T21:39:42.223724+0000","last_fullsized":"2023-07-09T21:39:42.223724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223278+0000","last_change":"2023-07-09T21:39:42.223278+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223278+0000","last_undegraded":"2023-07-09T21:39:42.223278+0000","last_fullsized":"2023-07-09T21:39:42.223278+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219716+0000","last_change":"2023-07-09T21:39:42.219716+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219716+0000","last_undegraded":"2023-07-09T21:39:42.219716+0000","last_fullsized":"2023-07-09T21:39:42.219716+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219003+0000","last_change":"2023-07-09T21:39:42.219003+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219003+0000","last_undegraded":"2023-07-09T21:39:42.219003+0000","last_fullsized":"2023-07-09T21:39:42.219003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245608+0000","last_change":"2023-07-09T21:39:42.244780+0000","last_active":"2023-07-09T21:39:42.245608+0000","last_peered":"2023-07-09T21:39:42.245608+0000","last_clean":"2023-07-09T21:39:42.245608+0000","last_became_active":"2023-07-09T21:39:42.244462+0000","last_became_peered":"2023-07-09T21:39:42.244462+0000","last_unstale":"2023-07-09T21:39:42.245608+0000","last_undegraded":"2023-07-09T21:39:42.245608+0000","last_fullsized":"2023-07-09T21:39:42.245608+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:54.826324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219926+0000","last_change":"2023-07-09T21:39:42.219926+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219926+0000","last_undegraded":"2023-07-09T21:39:42.219926+0000","last_fullsized":"2023-07-09T21:39:42.219926+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238132+0000","last_change":"2023-07-09T21:39:42.236524+0000","last_active":"2023-07-09T21:39:42.238132+0000","last_peered":"2023-07-09T21:39:42.238132+0000","last_clean":"2023-07-09T21:39:42.238132+0000","last_became_active":"2023-07-09T21:39:42.236106+0000","last_became_peered":"2023-07-09T21:39:42.236106+0000","last_unstale":"2023-07-09T21:39:42.238132+0000","last_undegraded":"2023-07-09T21:39:42.238132+0000","last_fullsized":"2023-07-09T21:39:42.238132+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:05.688418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230211+0000","last_change":"2023-07-09T21:39:42.230211+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230211+0000","last_undegraded":"2023-07-09T21:39:42.230211+0000","last_fullsized":"2023-07-09T21:39:42.230211+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242793+0000","last_change":"2023-07-09T21:39:42.240015+0000","last_active":"2023-07-09T21:39:42.242793+0000","last_peered":"2023-07-09T21:39:42.242793+0000","last_clean":"2023-07-09T21:39:42.242793+0000","last_became_active":"2023-07-09T21:39:42.239692+0000","last_became_peered":"2023-07-09T21:39:42.239692+0000","last_unstale":"2023-07-09T21:39:42.242793+0000","last_undegraded":"2023-07-09T21:39:42.242793+0000","last_fullsized":"2023-07-09T21:39:42.242793+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:11.352927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218929+0000","last_change":"2023-07-09T21:39:42.218929+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218929+0000","last_undegraded":"2023-07-09T21:39:42.218929+0000","last_fullsized":"2023-07-09T21:39:42.218929+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241279+0000","last_change":"2023-07-09T21:39:42.240133+0000","last_active":"2023-07-09T21:39:42.241279+0000","last_peered":"2023-07-09T21:39:42.241279+0000","last_clean":"2023-07-09T21:39:42.241279+0000","last_became_active":"2023-07-09T21:39:42.239809+0000","last_became_peered":"2023-07-09T21:39:42.239809+0000","last_unstale":"2023-07-09T21:39:42.241279+0000","last_undegraded":"2023-07-09T21:39:42.241279+0000","last_fullsized":"2023-07-09T21:39:42.241279+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:08.728171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221816+0000","last_change":"2023-07-09T21:39:42.221816+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221816+0000","last_undegraded":"2023-07-09T21:39:42.221816+0000","last_fullsized":"2023-07-09T21:39:42.221816+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234237+0000","last_change":"2023-07-09T21:39:42.232268+0000","last_active":"2023-07-09T21:39:42.234237+0000","last_peered":"2023-07-09T21:39:42.234237+0000","last_clean":"2023-07-09T21:39:42.234237+0000","last_became_active":"2023-07-09T21:39:42.231985+0000","last_became_peered":"2023-07-09T21:39:42.231985+0000","last_unstale":"2023-07-09T21:39:42.234237+0000","last_undegraded":"2023-07-09T21:39:42.234237+0000","last_fullsized":"2023-07-09T21:39:42.234237+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:23.103634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226576+0000","last_change":"2023-07-09T21:39:42.226576+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226576+0000","last_undegraded":"2023-07-09T21:39:42.226576+0000","last_fullsized":"2023-07-09T21:39:42.226576+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236966+0000","last_change":"2023-07-09T21:39:42.229864+0000","last_active":"2023-07-09T21:39:42.236966+0000","last_peered":"2023-07-09T21:39:42.236966+0000","last_clean":"2023-07-09T21:39:42.236966+0000","last_became_active":"2023-07-09T21:39:42.229579+0000","last_became_peered":"2023-07-09T21:39:42.229579+0000","last_unstale":"2023-07-09T21:39:42.236966+0000","last_undegraded":"2023-07-09T21:39:42.236966+0000","last_fullsized":"2023-07-09T21:39:42.236966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:46.633446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218724+0000","last_change":"2023-07-09T21:39:42.218724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218724+0000","last_undegraded":"2023-07-09T21:39:42.218724+0000","last_fullsized":"2023-07-09T21:39:42.218724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234419+0000","last_change":"2023-07-09T21:39:42.230843+0000","last_active":"2023-07-09T21:39:42.234419+0000","last_peered":"2023-07-09T21:39:42.234419+0000","last_clean":"2023-07-09T21:39:42.234419+0000","last_became_active":"2023-07-09T21:39:42.230544+0000","last_became_peered":"2023-07-09T21:39:42.230544+0000","last_unstale":"2023-07-09T21:39:42.234419+0000","last_undegraded":"2023-07-09T21:39:42.234419+0000","last_fullsized":"2023-07-09T21:39:42.234419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:14.352861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218489+0000","last_change":"2023-07-09T21:39:42.218489+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218489+0000","last_undegraded":"2023-07-09T21:39:42.218489+0000","last_fullsized":"2023-07-09T21:39:42.218489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245686+0000","last_change":"2023-07-09T21:39:42.244876+0000","last_active":"2023-07-09T21:39:42.245686+0000","last_peered":"2023-07-09T21:39:42.245686+0000","last_clean":"2023-07-09T21:39:42.245686+0000","last_became_active":"2023-07-09T21:39:42.244551+0000","last_became_peered":"2023-07-09T21:39:42.244551+0000","last_unstale":"2023-07-09T21:39:42.245686+0000","last_undegraded":"2023-07-09T21:39:42.245686+0000","last_fullsized":"2023-07-09T21:39:42.245686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:10.799330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225366+0000","last_change":"2023-07-09T21:39:42.225366+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225366+0000","last_undegraded":"2023-07-09T21:39:42.225366+0000","last_fullsized":"2023-07-09T21:39:42.225366+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241088+0000","last_change":"2023-07-09T21:39:42.233682+0000","last_active":"2023-07-09T21:39:42.241088+0000","last_peered":"2023-07-09T21:39:42.241088+0000","last_clean":"2023-07-09T21:39:42.241088+0000","last_became_active":"2023-07-09T21:39:42.233399+0000","last_became_peered":"2023-07-09T21:39:42.233399+0000","last_unstale":"2023-07-09T21:39:42.241088+0000","last_undegraded":"2023-07-09T21:39:42.241088+0000","last_fullsized":"2023-07-09T21:39:42.241088+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:32.383104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.231792+0000","last_change":"2023-07-09T21:39:42.231792+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.231792+0000","last_undegraded":"2023-07-09T21:39:42.231792+0000","last_fullsized":"2023-07-09T21:39:42.231792+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238527+0000","last_change":"2023-07-09T21:39:42.237809+0000","last_active":"2023-07-09T21:39:42.238527+0000","last_peered":"2023-07-09T21:39:42.238527+0000","last_clean":"2023-07-09T21:39:42.238527+0000","last_became_active":"2023-07-09T21:39:42.237410+0000","last_became_peered":"2023-07-09T21:39:42.237410+0000","last_unstale":"2023-07-09T21:39:42.238527+0000","last_undegraded":"2023-07-09T21:39:42.238527+0000","last_fullsized":"2023-07-09T21:39:42.238527+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:48.003891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225822+0000","last_change":"2023-07-09T21:39:42.225822+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225822+0000","last_undegraded":"2023-07-09T21:39:42.225822+0000","last_fullsized":"2023-07-09T21:39:42.225822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246127+0000","last_change":"2023-07-09T21:39:42.244755+0000","last_active":"2023-07-09T21:39:42.246127+0000","last_peered":"2023-07-09T21:39:42.246127+0000","last_clean":"2023-07-09T21:39:42.246127+0000","last_became_active":"2023-07-09T21:39:42.244416+0000","last_became_peered":"2023-07-09T21:39:42.244416+0000","last_unstale":"2023-07-09T21:39:42.246127+0000","last_undegraded":"2023-07-09T21:39:42.246127+0000","last_fullsized":"2023-07-09T21:39:42.246127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:25.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218727+0000","last_change":"2023-07-09T21:39:42.218727+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218727+0000","last_undegraded":"2023-07-09T21:39:42.218727+0000","last_fullsized":"2023-07-09T21:39:42.218727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238304+0000","last_change":"2023-07-09T21:39:42.227954+0000","last_active":"2023-07-09T21:39:42.238304+0000","last_peered":"2023-07-09T21:39:42.238304+0000","last_clean":"2023-07-09T21:39:42.238304+0000","last_became_active":"2023-07-09T21:39:42.227639+0000","last_became_peered":"2023-07-09T21:39:42.227639+0000","last_unstale":"2023-07-09T21:39:42.238304+0000","last_undegraded":"2023-07-09T21:39:42.238304+0000","last_fullsized":"2023-07-09T21:39:42.238304+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:56.473783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221264+0000","last_change":"2023-07-09T21:39:42.221264+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221264+0000","last_undegraded":"2023-07-09T21:39:42.221264+0000","last_fullsized":"2023-07-09T21:39:42.221264+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246177+0000","last_change":"2023-07-09T21:39:42.245324+0000","last_active":"2023-07-09T21:39:42.246177+0000","last_peered":"2023-07-09T21:39:42.246177+0000","last_clean":"2023-07-09T21:39:42.246177+0000","last_became_active":"2023-07-09T21:39:42.244983+0000","last_became_peered":"2023-07-09T21:39:42.244983+0000","last_unstale":"2023-07-09T21:39:42.246177+0000","last_undegraded":"2023-07-09T21:39:42.246177+0000","last_fullsized":"2023-07-09T21:39:42.246177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:50.112136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223016+0000","last_change":"2023-07-09T21:39:42.223016+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223016+0000","last_undegraded":"2023-07-09T21:39:42.223016+0000","last_fullsized":"2023-07-09T21:39:42.223016+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238087+0000","last_change":"2023-07-09T21:39:42.230619+0000","last_active":"2023-07-09T21:39:42.238087+0000","last_peered":"2023-07-09T21:39:42.238087+0000","last_clean":"2023-07-09T21:39:42.238087+0000","last_became_active":"2023-07-09T21:39:42.228042+0000","last_became_peered":"2023-07-09T21:39:42.228042+0000","last_unstale":"2023-07-09T21:39:42.238087+0000","last_undegraded":"2023-07-09T21:39:42.238087+0000","last_fullsized":"2023-07-09T21:39:42.238087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:00.504417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218044+0000","last_change":"2023-07-09T21:39:42.218044+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218044+0000","last_undegraded":"2023-07-09T21:39:42.218044+0000","last_fullsized":"2023-07-09T21:39:42.218044+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237017+0000","last_change":"2023-07-09T21:39:42.231175+0000","last_active":"2023-07-09T21:39:42.237017+0000","last_peered":"2023-07-09T21:39:42.237017+0000","last_clean":"2023-07-09T21:39:42.237017+0000","last_became_active":"2023-07-09T21:39:42.230911+0000","last_became_peered":"2023-07-09T21:39:42.230911+0000","last_unstale":"2023-07-09T21:39:42.237017+0000","last_undegraded":"2023-07-09T21:39:42.237017+0000","last_fullsized":"2023-07-09T21:39:42.237017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:54.534853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217840+0000","last_change":"2023-07-09T21:39:42.217840+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217840+0000","last_undegraded":"2023-07-09T21:39:42.217840+0000","last_fullsized":"2023-07-09T21:39:42.217840+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238639+0000","last_change":"2023-07-09T21:39:42.233317+0000","last_active":"2023-07-09T21:39:42.238639+0000","last_peered":"2023-07-09T21:39:42.238639+0000","last_clean":"2023-07-09T21:39:42.238639+0000","last_became_active":"2023-07-09T21:39:42.233048+0000","last_became_peered":"2023-07-09T21:39:42.233048+0000","last_unstale":"2023-07-09T21:39:42.238639+0000","last_undegraded":"2023-07-09T21:39:42.238639+0000","last_fullsized":"2023-07-09T21:39:42.238639+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:28:35.710801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227056+0000","last_change":"2023-07-09T21:39:42.227056+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227056+0000","last_undegraded":"2023-07-09T21:39:42.227056+0000","last_fullsized":"2023-07-09T21:39:42.227056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242704+0000","last_change":"2023-07-09T21:39:42.238834+0000","last_active":"2023-07-09T21:39:42.242704+0000","last_peered":"2023-07-09T21:39:42.242704+0000","last_clean":"2023-07-09T21:39:42.242704+0000","last_became_active":"2023-07-09T21:39:42.238523+0000","last_became_peered":"2023-07-09T21:39:42.238523+0000","last_unstale":"2023-07-09T21:39:42.242704+0000","last_undegraded":"2023-07-09T21:39:42.242704+0000","last_fullsized":"2023-07-09T21:39:42.242704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:40:05.335063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217235+0000","last_change":"2023-07-09T21:39:42.217235+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217235+0000","last_undegraded":"2023-07-09T21:39:42.217235+0000","last_fullsized":"2023-07-09T21:39:42.217235+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238113+0000","last_change":"2023-07-09T21:39:42.235742+0000","last_active":"2023-07-09T21:39:42.238113+0000","last_peered":"2023-07-09T21:39:42.238113+0000","last_clean":"2023-07-09T21:39:42.238113+0000","last_became_active":"2023-07-09T21:39:42.235449+0000","last_became_peered":"2023-07-09T21:39:42.235449+0000","last_unstale":"2023-07-09T21:39:42.238113+0000","last_undegraded":"2023-07-09T21:39:42.238113+0000","last_fullsized":"2023-07-09T21:39:42.238113+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217234+0000","last_change":"2023-07-09T21:39:42.217234+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217234+0000","last_undegraded":"2023-07-09T21:39:42.217234+0000","last_fullsized":"2023-07-09T21:39:42.217234+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245763+0000","last_change":"2023-07-09T21:39:42.244672+0000","last_active":"2023-07-09T21:39:42.245763+0000","last_peered":"2023-07-09T21:39:42.245763+0000","last_clean":"2023-07-09T21:39:42.245763+0000","last_became_active":"2023-07-09T21:39:42.244373+0000","last_became_peered":"2023-07-09T21:39:42.244373+0000","last_unstale":"2023-07-09T21:39:42.245763+0000","last_undegraded":"2023-07-09T21:39:42.245763+0000","last_fullsized":"2023-07-09T21:39:42.245763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:46.527940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222693+0000","last_change":"2023-07-09T21:39:42.222693+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222693+0000","last_undegraded":"2023-07-09T21:39:42.222693+0000","last_fullsized":"2023-07-09T21:39:42.222693+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237360+0000","last_change":"2023-07-09T21:39:42.234762+0000","last_active":"2023-07-09T21:39:42.237360+0000","last_peered":"2023-07-09T21:39:42.237360+0000","last_clean":"2023-07-09T21:39:42.237360+0000","last_became_active":"2023-07-09T21:39:42.234479+0000","last_became_peered":"2023-07-09T21:39:42.234479+0000","last_unstale":"2023-07-09T21:39:42.237360+0000","last_undegraded":"2023-07-09T21:39:42.237360+0000","last_fullsized":"2023-07-09T21:39:42.237360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:48.765795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217610+0000","last_change":"2023-07-09T21:39:42.217610+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217610+0000","last_undegraded":"2023-07-09T21:39:42.217610+0000","last_fullsized":"2023-07-09T21:39:42.217610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238242+0000","last_change":"2023-07-09T21:39:42.232385+0000","last_active":"2023-07-09T21:39:42.238242+0000","last_peered":"2023-07-09T21:39:42.238242+0000","last_clean":"2023-07-09T21:39:42.238242+0000","last_became_active":"2023-07-09T21:39:42.231546+0000","last_became_peered":"2023-07-09T21:39:42.231546+0000","last_unstale":"2023-07-09T21:39:42.238242+0000","last_undegraded":"2023-07-09T21:39:42.238242+0000","last_fullsized":"2023-07-09T21:39:42.238242+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:10.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225714+0000","last_change":"2023-07-09T21:39:42.225714+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225714+0000","last_undegraded":"2023-07-09T21:39:42.225714+0000","last_fullsized":"2023-07-09T21:39:42.225714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241802+0000","last_change":"2023-07-09T21:39:42.236910+0000","last_active":"2023-07-09T21:39:42.241802+0000","last_peered":"2023-07-09T21:39:42.241802+0000","last_clean":"2023-07-09T21:39:42.241802+0000","last_became_active":"2023-07-09T21:39:42.236606+0000","last_became_peered":"2023-07-09T21:39:42.236606+0000","last_unstale":"2023-07-09T21:39:42.241802+0000","last_undegraded":"2023-07-09T21:39:42.241802+0000","last_fullsized":"2023-07-09T21:39:42.241802+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:59.712895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224626+0000","last_change":"2023-07-09T21:39:42.224626+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224626+0000","last_undegraded":"2023-07-09T21:39:42.224626+0000","last_fullsized":"2023-07-09T21:39:42.224626+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240357+0000","last_change":"2023-07-09T21:39:42.238711+0000","last_active":"2023-07-09T21:39:42.240357+0000","last_peered":"2023-07-09T21:39:42.240357+0000","last_clean":"2023-07-09T21:39:42.240357+0000","last_became_active":"2023-07-09T21:39:42.238400+0000","last_became_peered":"2023-07-09T21:39:42.238400+0000","last_unstale":"2023-07-09T21:39:42.240357+0000","last_undegraded":"2023-07-09T21:39:42.240357+0000","last_fullsized":"2023-07-09T21:39:42.240357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:33.222075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217418+0000","last_change":"2023-07-09T21:39:42.217418+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217418+0000","last_undegraded":"2023-07-09T21:39:42.217418+0000","last_fullsized":"2023-07-09T21:39:42.217418+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242746+0000","last_change":"2023-07-09T21:39:42.239328+0000","last_active":"2023-07-09T21:39:42.242746+0000","last_peered":"2023-07-09T21:39:42.242746+0000","last_clean":"2023-07-09T21:39:42.242746+0000","last_became_active":"2023-07-09T21:39:42.239048+0000","last_became_peered":"2023-07-09T21:39:42.239048+0000","last_unstale":"2023-07-09T21:39:42.242746+0000","last_undegraded":"2023-07-09T21:39:42.242746+0000","last_fullsized":"2023-07-09T21:39:42.242746+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:31.191652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229459+0000","last_change":"2023-07-09T21:39:42.229459+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229459+0000","last_undegraded":"2023-07-09T21:39:42.229459+0000","last_fullsized":"2023-07-09T21:39:42.229459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238725+0000","last_change":"2023-07-09T21:39:42.235946+0000","last_active":"2023-07-09T21:39:42.238725+0000","last_peered":"2023-07-09T21:39:42.238725+0000","last_clean":"2023-07-09T21:39:42.238725+0000","last_became_active":"2023-07-09T21:39:42.235643+0000","last_became_peered":"2023-07-09T21:39:42.235643+0000","last_unstale":"2023-07-09T21:39:42.238725+0000","last_undegraded":"2023-07-09T21:39:42.238725+0000","last_fullsized":"2023-07-09T21:39:42.238725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:23.785562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"101'205","reported_seq":649,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229771+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:42.229771+0000","last_peered":"2023-07-09T21:39:42.229771+0000","last_clean":"2023-07-09T21:39:42.229771+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:42.229771+0000","last_undegraded":"2023-07-09T21:39:42.229771+0000","last_fullsized":"2023-07-09T21:39:42.229771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:03.342507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222569+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:42.222569+0000","last_peered":"2023-07-09T21:39:42.222569+0000","last_clean":"2023-07-09T21:39:42.222569+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:42.222569+0000","last_undegraded":"2023-07-09T21:39:42.222569+0000","last_fullsized":"2023-07-09T21:39:42.222569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:44.185194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218336+0000","last_change":"2023-07-09T21:39:42.218336+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218336+0000","last_undegraded":"2023-07-09T21:39:42.218336+0000","last_fullsized":"2023-07-09T21:39:42.218336+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240651+0000","last_change":"2023-07-09T21:39:42.238970+0000","last_active":"2023-07-09T21:39:42.240651+0000","last_peered":"2023-07-09T21:39:42.240651+0000","last_clean":"2023-07-09T21:39:42.240651+0000","last_became_active":"2023-07-09T21:39:42.237884+0000","last_became_peered":"2023-07-09T21:39:42.237884+0000","last_unstale":"2023-07-09T21:39:42.240651+0000","last_undegraded":"2023-07-09T21:39:42.240651+0000","last_fullsized":"2023-07-09T21:39:42.240651+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:40.688727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229599+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:42.229599+0000","last_peered":"2023-07-09T21:39:42.229599+0000","last_clean":"2023-07-09T21:39:42.229599+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:42.229599+0000","last_undegraded":"2023-07-09T21:39:42.229599+0000","last_fullsized":"2023-07-09T21:39:42.229599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:44.480339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227045+0000","last_change":"2023-07-09T21:39:42.227045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227045+0000","last_undegraded":"2023-07-09T21:39:42.227045+0000","last_fullsized":"2023-07-09T21:39:42.227045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.243159+0000","last_change":"2023-07-09T21:39:42.241874+0000","last_active":"2023-07-09T21:39:42.243159+0000","last_peered":"2023-07-09T21:39:42.243159+0000","last_clean":"2023-07-09T21:39:42.243159+0000","last_became_active":"2023-07-09T21:39:42.241590+0000","last_became_peered":"2023-07-09T21:39:42.241590+0000","last_unstale":"2023-07-09T21:39:42.243159+0000","last_undegraded":"2023-07-09T21:39:42.243159+0000","last_fullsized":"2023-07-09T21:39:42.243159+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:33.516145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218745+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:42.218745+0000","last_peered":"2023-07-09T21:39:42.218745+0000","last_clean":"2023-07-09T21:39:42.218745+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:42.218745+0000","last_undegraded":"2023-07-09T21:39:42.218745+0000","last_fullsized":"2023-07-09T21:39:42.218745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:29:36.617515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226601+0000","last_change":"2023-07-09T21:39:42.226601+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226601+0000","last_undegraded":"2023-07-09T21:39:42.226601+0000","last_fullsized":"2023-07-09T21:39:42.226601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240989+0000","last_change":"2023-07-09T21:39:42.240044+0000","last_active":"2023-07-09T21:39:42.240989+0000","last_peered":"2023-07-09T21:39:42.240989+0000","last_clean":"2023-07-09T21:39:42.240989+0000","last_became_active":"2023-07-09T21:39:42.239664+0000","last_became_peered":"2023-07-09T21:39:42.239664+0000","last_unstale":"2023-07-09T21:39:42.240989+0000","last_undegraded":"2023-07-09T21:39:42.240989+0000","last_fullsized":"2023-07-09T21:39:42.240989+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:33.117486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.226075+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:42.226075+0000","last_peered":"2023-07-09T21:39:42.226075+0000","last_clean":"2023-07-09T21:39:42.226075+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:42.226075+0000","last_undegraded":"2023-07-09T21:39:42.226075+0000","last_fullsized":"2023-07-09T21:39:42.226075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:05:51.349439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217257+0000","last_change":"2023-07-09T21:39:42.217257+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217257+0000","last_undegraded":"2023-07-09T21:39:42.217257+0000","last_fullsized":"2023-07-09T21:39:42.217257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241771+0000","last_change":"2023-07-09T21:39:42.237844+0000","last_active":"2023-07-09T21:39:42.241771+0000","last_peered":"2023-07-09T21:39:42.241771+0000","last_clean":"2023-07-09T21:39:42.241771+0000","last_became_active":"2023-07-09T21:39:42.237413+0000","last_became_peered":"2023-07-09T21:39:42.237413+0000","last_unstale":"2023-07-09T21:39:42.241771+0000","last_undegraded":"2023-07-09T21:39:42.241771+0000","last_fullsized":"2023-07-09T21:39:42.241771+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:48.795873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222216+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:42.222216+0000","last_peered":"2023-07-09T21:39:42.222216+0000","last_clean":"2023-07-09T21:39:42.222216+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:42.222216+0000","last_undegraded":"2023-07-09T21:39:42.222216+0000","last_fullsized":"2023-07-09T21:39:42.222216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:38.969088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222781+0000","last_change":"2023-07-09T21:39:42.222781+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222781+0000","last_undegraded":"2023-07-09T21:39:42.222781+0000","last_fullsized":"2023-07-09T21:39:42.222781+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236142+0000","last_change":"2023-07-09T21:39:42.233837+0000","last_active":"2023-07-09T21:39:42.236142+0000","last_peered":"2023-07-09T21:39:42.236142+0000","last_clean":"2023-07-09T21:39:42.236142+0000","last_became_active":"2023-07-09T21:39:42.233428+0000","last_became_peered":"2023-07-09T21:39:42.233428+0000","last_unstale":"2023-07-09T21:39:42.236142+0000","last_undegraded":"2023-07-09T21:39:42.236142+0000","last_fullsized":"2023-07-09T21:39:42.236142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:45.393745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.233824+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:42.233824+0000","last_peered":"2023-07-09T21:39:42.233824+0000","last_clean":"2023-07-09T21:39:42.233824+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:42.233824+0000","last_undegraded":"2023-07-09T21:39:42.233824+0000","last_fullsized":"2023-07-09T21:39:42.233824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.805502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222414+0000","last_change":"2023-07-09T21:39:42.222414+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222414+0000","last_undegraded":"2023-07-09T21:39:42.222414+0000","last_fullsized":"2023-07-09T21:39:42.222414+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242834+0000","last_change":"2023-07-09T21:39:42.241936+0000","last_active":"2023-07-09T21:39:42.242834+0000","last_peered":"2023-07-09T21:39:42.242834+0000","last_clean":"2023-07-09T21:39:42.242834+0000","last_became_active":"2023-07-09T21:39:42.241566+0000","last_became_peered":"2023-07-09T21:39:42.241566+0000","last_unstale":"2023-07-09T21:39:42.242834+0000","last_undegraded":"2023-07-09T21:39:42.242834+0000","last_fullsized":"2023-07-09T21:39:42.242834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218183+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:42.218183+0000","last_peered":"2023-07-09T21:39:42.218183+0000","last_clean":"2023-07-09T21:39:42.218183+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:42.218183+0000","last_undegraded":"2023-07-09T21:39:42.218183+0000","last_fullsized":"2023-07-09T21:39:42.218183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:16.871379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218131+0000","last_change":"2023-07-09T21:39:42.218131+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218131+0000","last_undegraded":"2023-07-09T21:39:42.218131+0000","last_fullsized":"2023-07-09T21:39:42.218131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.231571+0000","last_change":"2023-07-09T21:39:42.228204+0000","last_active":"2023-07-09T21:39:42.231571+0000","last_peered":"2023-07-09T21:39:42.231571+0000","last_clean":"2023-07-09T21:39:42.231571+0000","last_became_active":"2023-07-09T21:39:42.227935+0000","last_became_peered":"2023-07-09T21:39:42.227935+0000","last_unstale":"2023-07-09T21:39:42.231571+0000","last_undegraded":"2023-07-09T21:39:42.231571+0000","last_fullsized":"2023-07-09T21:39:42.231571+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:34.915164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.225425+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:42.225425+0000","last_peered":"2023-07-09T21:39:42.225425+0000","last_clean":"2023-07-09T21:39:42.225425+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:42.225425+0000","last_undegraded":"2023-07-09T21:39:42.225425+0000","last_fullsized":"2023-07-09T21:39:42.225425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:22.448454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1945600,"data_stored":1271042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.77200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.502}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.89600000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":1.01}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.92200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.034}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.083},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":680674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.36199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575056,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.628},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54524,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317316,"statfs":{"total":96636764160,"available":96580931584,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.437}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.496}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.70599999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.311},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.434},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.83399999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.81899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.872},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.747}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1957888,"data_stored":1277670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.441},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.755},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.86099999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:47.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:47.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.906+0000 7f11b4f82640 1 Processor -- start 2023-07-09T21:39:47.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.906+0000 7f11b4f82640 1 -- start start 2023-07-09T21:39:47.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11b4f82640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11b00b7ab0 0x7f11b006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11b4f82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11b00cef80 0x7f11b00b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11b4f82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11b00b49f0 con 0x7f11b00b4170 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11b4f82640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00b7e80 con 0x7f11b00b7ab0 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11b4f82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b00b4610 con 0x7f11b00cef80 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f11b00b7ab0 0x7f11b006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11aed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11b00b4170 0x7f11b015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40458/0 (socket says 172.21.15.37:40458) 2023-07-09T21:39:47.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11aed9d640 1 -- 172.21.15.37:0/2011250798 learned_addr learned my addr 172.21.15.37:0/2011250798 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:47.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11a7fff640 1 --2- 172.21.15.37:0/2011250798 >> v2:172.21.15.119:3300/0 conn(0x7f11b00cef80 0x7f11b00b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 -- 172.21.15.37:0/2011250798 >> v2:172.21.15.119:3300/0 conn(0x7f11b00cef80 msgr2=0x7f11b00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:47.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 --2- 172.21.15.37:0/2011250798 >> v2:172.21.15.119:3300/0 conn(0x7f11b00cef80 0x7f11b00b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 -- 172.21.15.37:0/2011250798 >> v1:172.21.15.37:6789/0 conn(0x7f11b00b4170 legacy=0x7f11b015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 -- 172.21.15.37:0/2011250798 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b00cc8a0 con 0x7f11b00b7ab0 2023-07-09T21:39:47.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11add9b640 1 -- 172.21.15.37:0/2011250798 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541585591 0 0) 0x7f11b00b49f0 con 0x7f11b00b4170 2023-07-09T21:39:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.910+0000 7f11ae59c640 1 --2- 172.21.15.37:0/2011250798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b7ab0 0x7f11b006aa50 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b4d10 tx=0x7f11a001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd45aa35dc64d40 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11add9b640 1 -- 172.21.15.37:0/2011250798 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a00a7070 con 0x7f11b00b7ab0 2023-07-09T21:39:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11add9b640 1 -- 172.21.15.37:0/2011250798 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a00ab430 con 0x7f11b00b7ab0 2023-07-09T21:39:47.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11add9b640 1 -- 172.21.15.37:0/2011250798 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a00ab7c0 con 0x7f11b00b7ab0 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- 172.21.15.37:0/2011250798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b7ab0 msgr2=0x7f11b006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- 172.21.15.37:0/2011250798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b7ab0 0x7f11b006aa50 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b4d10 tx=0x7f11a001c430 comp rx=0 tx=0).stop 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- 172.21.15.37:0/2011250798 shutdown_connections 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- 172.21.15.37:0/2011250798 >> v2:172.21.15.119:3300/0 conn(0x7f11b00cef80 0x7f11b00b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- 172.21.15.37:0/2011250798 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b7ab0 0x7f11b006aa50 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- 172.21.15.37:0/2011250798 >> 172.21.15.37:0/2011250798 conn(0x7f11b0073090 msgr2=0x7f11b0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- 172.21.15.37:0/2011250798 shutdown_connections 2023-07-09T21:39:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- 172.21.15.37:0/2011250798 wait complete. 2023-07-09T21:39:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 Processor -- start 2023-07-09T21:39:47.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 -- start start 2023-07-09T21:39:47.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 0x7f11b00b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.914+0000 7f11b4f82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11b00cef80 0x7f11b00b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00cbf10 con 0x7f11b00b4170 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00cb300 con 0x7f11b00cef80 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b00cb5e0 con 0x7f11b00b7ab0 2023-07-09T21:39:47.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54078/0 (socket says 172.21.15.37:54078) 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 -- 172.21.15.37:0/3563390873 learned_addr learned my addr 172.21.15.37:0/3563390873 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a7fff640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 0x7f11b00b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11aed9d640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11b00cef80 0x7f11b00b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 -- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 msgr2=0x7f11b00b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 0x7f11b00b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 -- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11b00cef80 msgr2=0x7f11b00b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:47.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11b00cef80 0x7f11b00b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 -- 172.21.15.37:0/3563390873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009420 con 0x7f11b00b4170 2023-07-09T21:39:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a7fff640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 0x7f11b00b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:47.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11ae59c640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f11a00ad040 tx=0x7f11a001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a00b5810 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a00b5990 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b00cb8c0 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a00b5d40 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b00cafa0 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b004d7d0 con 0x7f11b00b4170 2023-07-09T21:39:47.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.918+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11a00b4390 con 0x7f11b00b4170 2023-07-09T21:39:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.922+0000 7f11a6ffd640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 0x7f1190068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:47.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.922+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11a011e8d0 con 0x7f11b00b4170 2023-07-09T21:39:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.922+0000 7f11a7fff640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 0x7f1190068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:47.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.922+0000 7f11a7fff640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 0x7f1190068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11b013be90 tx=0x7f1198008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:47.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:47.926+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11a00ebb20 con 0x7f11b00b4170 2023-07-09T21:39:48.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.078+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b00cf4d0 con 0x7f11900663a0 2023-07-09T21:39:48.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.086+0000 7f11a6ffd640 1 -- 172.21.15.37:0/3563390873 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306560 (secure 0 0 0) 0x7f119800b200 con 0x7f11900663a0 2023-07-09T21:39:48.092 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:48.093 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 msgr2=0x7f1190068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 0x7f1190068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f11b013be90 tx=0x7f1198008040 comp rx=0 tx=0).stop 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 msgr2=0x7f11b00caa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f11a00ad040 tx=0x7f11a001ac70 comp rx=0 tx=0).stop 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 shutdown_connections 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f11900663a0 0x7f1190068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11b00cef80 0x7f11b00b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11b00b7ab0 0x7f11b00b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 --2- 172.21.15.37:0/3563390873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11b00b4170 0x7f11b00caa60 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 >> 172.21.15.37:0/3563390873 conn(0x7f11b0073090 msgr2=0x7f11b00b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 shutdown_connections 2023-07-09T21:39:48.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.090+0000 7f11b4f82640 1 -- 172.21.15.37:0/3563390873 wait complete. 2023-07-09T21:39:48.111 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:39:46.874221+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330704,"kb_used_data":11792,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754644016,"statfs":{"total":773094113280,"available":772755472384,"internally_reserved":0,"allocated":12075008,"data_stored":6665896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.664798"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222829+0000","last_change":"2023-07-09T21:39:42.222829+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222829+0000","last_undegraded":"2023-07-09T21:39:42.222829+0000","last_fullsized":"2023-07-09T21:39:42.222829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222406+0000","last_change":"2023-07-09T21:39:42.222406+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222406+0000","last_undegraded":"2023-07-09T21:39:42.222406+0000","last_fullsized":"2023-07-09T21:39:42.222406+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223788+0000","last_change":"2023-07-09T21:39:42.223788+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223788+0000","last_undegraded":"2023-07-09T21:39:42.223788+0000","last_fullsized":"2023-07-09T21:39:42.223788+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221904+0000","last_change":"2023-07-09T21:39:42.221904+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221904+0000","last_undegraded":"2023-07-09T21:39:42.221904+0000","last_fullsized":"2023-07-09T21:39:42.221904+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224747+0000","last_change":"2023-07-09T21:39:42.224747+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224747+0000","last_undegraded":"2023-07-09T21:39:42.224747+0000","last_fullsized":"2023-07-09T21:39:42.224747+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225310+0000","last_change":"2023-07-09T21:39:42.225310+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225310+0000","last_undegraded":"2023-07-09T21:39:42.225310+0000","last_fullsized":"2023-07-09T21:39:42.225310+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230574+0000","last_change":"2023-07-09T21:39:42.230574+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230574+0000","last_undegraded":"2023-07-09T21:39:42.230574+0000","last_fullsized":"2023-07-09T21:39:42.230574+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220602+0000","last_change":"2023-07-09T21:39:42.220602+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220602+0000","last_undegraded":"2023-07-09T21:39:42.220602+0000","last_fullsized":"2023-07-09T21:39:42.220602+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225568+0000","last_change":"2023-07-09T21:39:42.225568+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225568+0000","last_undegraded":"2023-07-09T21:39:42.225568+0000","last_fullsized":"2023-07-09T21:39:42.225568+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219622+0000","last_change":"2023-07-09T21:39:42.219622+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219622+0000","last_undegraded":"2023-07-09T21:39:42.219622+0000","last_fullsized":"2023-07-09T21:39:42.219622+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227858+0000","last_change":"2023-07-09T21:39:42.227858+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227858+0000","last_undegraded":"2023-07-09T21:39:42.227858+0000","last_fullsized":"2023-07-09T21:39:42.227858+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218223+0000","last_change":"2023-07-09T21:39:42.218223+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218223+0000","last_undegraded":"2023-07-09T21:39:42.218223+0000","last_fullsized":"2023-07-09T21:39:42.218223+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219045+0000","last_change":"2023-07-09T21:39:42.219045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219045+0000","last_undegraded":"2023-07-09T21:39:42.219045+0000","last_fullsized":"2023-07-09T21:39:42.219045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224804+0000","last_change":"2023-07-09T21:39:42.224804+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224804+0000","last_undegraded":"2023-07-09T21:39:42.224804+0000","last_fullsized":"2023-07-09T21:39:42.224804+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219081+0000","last_change":"2023-07-09T21:39:42.219081+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219081+0000","last_undegraded":"2023-07-09T21:39:42.219081+0000","last_fullsized":"2023-07-09T21:39:42.219081+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220157+0000","last_change":"2023-07-09T21:39:42.220157+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220157+0000","last_undegraded":"2023-07-09T21:39:42.220157+0000","last_fullsized":"2023-07-09T21:39:42.220157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219451+0000","last_change":"2023-07-09T21:39:42.219451+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219451+0000","last_undegraded":"2023-07-09T21:39:42.219451+0000","last_fullsized":"2023-07-09T21:39:42.219451+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226271+0000","last_change":"2023-07-09T21:39:42.226271+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226271+0000","last_undegraded":"2023-07-09T21:39:42.226271+0000","last_fullsized":"2023-07-09T21:39:42.226271+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225545+0000","last_change":"2023-07-09T21:39:42.225545+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225545+0000","last_undegraded":"2023-07-09T21:39:42.225545+0000","last_fullsized":"2023-07-09T21:39:42.225545+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221425+0000","last_change":"2023-07-09T21:39:42.221425+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221425+0000","last_undegraded":"2023-07-09T21:39:42.221425+0000","last_fullsized":"2023-07-09T21:39:42.221425+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225272+0000","last_change":"2023-07-09T21:39:42.225272+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225272+0000","last_undegraded":"2023-07-09T21:39:42.225272+0000","last_fullsized":"2023-07-09T21:39:42.225272+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224252+0000","last_change":"2023-07-09T21:39:42.224252+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224252+0000","last_undegraded":"2023-07-09T21:39:42.224252+0000","last_fullsized":"2023-07-09T21:39:42.224252+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.228334+0000","last_change":"2023-07-09T21:39:42.228334+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.228334+0000","last_undegraded":"2023-07-09T21:39:42.228334+0000","last_fullsized":"2023-07-09T21:39:42.228334+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224147+0000","last_change":"2023-07-09T21:39:42.224147+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224147+0000","last_undegraded":"2023-07-09T21:39:42.224147+0000","last_fullsized":"2023-07-09T21:39:42.224147+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223216+0000","last_change":"2023-07-09T21:39:42.223216+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223216+0000","last_undegraded":"2023-07-09T21:39:42.223216+0000","last_fullsized":"2023-07-09T21:39:42.223216+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227051+0000","last_change":"2023-07-09T21:39:42.227051+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227051+0000","last_undegraded":"2023-07-09T21:39:42.227051+0000","last_fullsized":"2023-07-09T21:39:42.227051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219552+0000","last_change":"2023-07-09T21:39:42.219552+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219552+0000","last_undegraded":"2023-07-09T21:39:42.219552+0000","last_fullsized":"2023-07-09T21:39:42.219552+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.220974+0000","last_change":"2023-07-09T21:39:42.220974+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.220974+0000","last_undegraded":"2023-07-09T21:39:42.220974+0000","last_fullsized":"2023-07-09T21:39:42.220974+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229053+0000","last_change":"2023-07-09T21:39:42.229053+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229053+0000","last_undegraded":"2023-07-09T21:39:42.229053+0000","last_fullsized":"2023-07-09T21:39:42.229053+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223724+0000","last_change":"2023-07-09T21:39:42.223724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223724+0000","last_undegraded":"2023-07-09T21:39:42.223724+0000","last_fullsized":"2023-07-09T21:39:42.223724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223278+0000","last_change":"2023-07-09T21:39:42.223278+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223278+0000","last_undegraded":"2023-07-09T21:39:42.223278+0000","last_fullsized":"2023-07-09T21:39:42.223278+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219716+0000","last_change":"2023-07-09T21:39:42.219716+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219716+0000","last_undegraded":"2023-07-09T21:39:42.219716+0000","last_fullsized":"2023-07-09T21:39:42.219716+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219003+0000","last_change":"2023-07-09T21:39:42.219003+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219003+0000","last_undegraded":"2023-07-09T21:39:42.219003+0000","last_fullsized":"2023-07-09T21:39:42.219003+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245608+0000","last_change":"2023-07-09T21:39:42.244780+0000","last_active":"2023-07-09T21:39:42.245608+0000","last_peered":"2023-07-09T21:39:42.245608+0000","last_clean":"2023-07-09T21:39:42.245608+0000","last_became_active":"2023-07-09T21:39:42.244462+0000","last_became_peered":"2023-07-09T21:39:42.244462+0000","last_unstale":"2023-07-09T21:39:42.245608+0000","last_undegraded":"2023-07-09T21:39:42.245608+0000","last_fullsized":"2023-07-09T21:39:42.245608+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:54.826324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.219926+0000","last_change":"2023-07-09T21:39:42.219926+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.219926+0000","last_undegraded":"2023-07-09T21:39:42.219926+0000","last_fullsized":"2023-07-09T21:39:42.219926+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238132+0000","last_change":"2023-07-09T21:39:42.236524+0000","last_active":"2023-07-09T21:39:42.238132+0000","last_peered":"2023-07-09T21:39:42.238132+0000","last_clean":"2023-07-09T21:39:42.238132+0000","last_became_active":"2023-07-09T21:39:42.236106+0000","last_became_peered":"2023-07-09T21:39:42.236106+0000","last_unstale":"2023-07-09T21:39:42.238132+0000","last_undegraded":"2023-07-09T21:39:42.238132+0000","last_fullsized":"2023-07-09T21:39:42.238132+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:05.688418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.230211+0000","last_change":"2023-07-09T21:39:42.230211+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.230211+0000","last_undegraded":"2023-07-09T21:39:42.230211+0000","last_fullsized":"2023-07-09T21:39:42.230211+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242793+0000","last_change":"2023-07-09T21:39:42.240015+0000","last_active":"2023-07-09T21:39:42.242793+0000","last_peered":"2023-07-09T21:39:42.242793+0000","last_clean":"2023-07-09T21:39:42.242793+0000","last_became_active":"2023-07-09T21:39:42.239692+0000","last_became_peered":"2023-07-09T21:39:42.239692+0000","last_unstale":"2023-07-09T21:39:42.242793+0000","last_undegraded":"2023-07-09T21:39:42.242793+0000","last_fullsized":"2023-07-09T21:39:42.242793+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:36:11.352927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218929+0000","last_change":"2023-07-09T21:39:42.218929+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218929+0000","last_undegraded":"2023-07-09T21:39:42.218929+0000","last_fullsized":"2023-07-09T21:39:42.218929+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241279+0000","last_change":"2023-07-09T21:39:42.240133+0000","last_active":"2023-07-09T21:39:42.241279+0000","last_peered":"2023-07-09T21:39:42.241279+0000","last_clean":"2023-07-09T21:39:42.241279+0000","last_became_active":"2023-07-09T21:39:42.239809+0000","last_became_peered":"2023-07-09T21:39:42.239809+0000","last_unstale":"2023-07-09T21:39:42.241279+0000","last_undegraded":"2023-07-09T21:39:42.241279+0000","last_fullsized":"2023-07-09T21:39:42.241279+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:08.728171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221816+0000","last_change":"2023-07-09T21:39:42.221816+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221816+0000","last_undegraded":"2023-07-09T21:39:42.221816+0000","last_fullsized":"2023-07-09T21:39:42.221816+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234237+0000","last_change":"2023-07-09T21:39:42.232268+0000","last_active":"2023-07-09T21:39:42.234237+0000","last_peered":"2023-07-09T21:39:42.234237+0000","last_clean":"2023-07-09T21:39:42.234237+0000","last_became_active":"2023-07-09T21:39:42.231985+0000","last_became_peered":"2023-07-09T21:39:42.231985+0000","last_unstale":"2023-07-09T21:39:42.234237+0000","last_undegraded":"2023-07-09T21:39:42.234237+0000","last_fullsized":"2023-07-09T21:39:42.234237+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:23.103634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226576+0000","last_change":"2023-07-09T21:39:42.226576+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226576+0000","last_undegraded":"2023-07-09T21:39:42.226576+0000","last_fullsized":"2023-07-09T21:39:42.226576+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236966+0000","last_change":"2023-07-09T21:39:42.229864+0000","last_active":"2023-07-09T21:39:42.236966+0000","last_peered":"2023-07-09T21:39:42.236966+0000","last_clean":"2023-07-09T21:39:42.236966+0000","last_became_active":"2023-07-09T21:39:42.229579+0000","last_became_peered":"2023-07-09T21:39:42.229579+0000","last_unstale":"2023-07-09T21:39:42.236966+0000","last_undegraded":"2023-07-09T21:39:42.236966+0000","last_fullsized":"2023-07-09T21:39:42.236966+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:46.633446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218724+0000","last_change":"2023-07-09T21:39:42.218724+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218724+0000","last_undegraded":"2023-07-09T21:39:42.218724+0000","last_fullsized":"2023-07-09T21:39:42.218724+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.234419+0000","last_change":"2023-07-09T21:39:42.230843+0000","last_active":"2023-07-09T21:39:42.234419+0000","last_peered":"2023-07-09T21:39:42.234419+0000","last_clean":"2023-07-09T21:39:42.234419+0000","last_became_active":"2023-07-09T21:39:42.230544+0000","last_became_peered":"2023-07-09T21:39:42.230544+0000","last_unstale":"2023-07-09T21:39:42.234419+0000","last_undegraded":"2023-07-09T21:39:42.234419+0000","last_fullsized":"2023-07-09T21:39:42.234419+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:41:14.352861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218489+0000","last_change":"2023-07-09T21:39:42.218489+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218489+0000","last_undegraded":"2023-07-09T21:39:42.218489+0000","last_fullsized":"2023-07-09T21:39:42.218489+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245686+0000","last_change":"2023-07-09T21:39:42.244876+0000","last_active":"2023-07-09T21:39:42.245686+0000","last_peered":"2023-07-09T21:39:42.245686+0000","last_clean":"2023-07-09T21:39:42.245686+0000","last_became_active":"2023-07-09T21:39:42.244551+0000","last_became_peered":"2023-07-09T21:39:42.244551+0000","last_unstale":"2023-07-09T21:39:42.245686+0000","last_undegraded":"2023-07-09T21:39:42.245686+0000","last_fullsized":"2023-07-09T21:39:42.245686+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:10.799330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225366+0000","last_change":"2023-07-09T21:39:42.225366+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225366+0000","last_undegraded":"2023-07-09T21:39:42.225366+0000","last_fullsized":"2023-07-09T21:39:42.225366+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241088+0000","last_change":"2023-07-09T21:39:42.233682+0000","last_active":"2023-07-09T21:39:42.241088+0000","last_peered":"2023-07-09T21:39:42.241088+0000","last_clean":"2023-07-09T21:39:42.241088+0000","last_became_active":"2023-07-09T21:39:42.233399+0000","last_became_peered":"2023-07-09T21:39:42.233399+0000","last_unstale":"2023-07-09T21:39:42.241088+0000","last_undegraded":"2023-07-09T21:39:42.241088+0000","last_fullsized":"2023-07-09T21:39:42.241088+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:32.383104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.231792+0000","last_change":"2023-07-09T21:39:42.231792+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.231792+0000","last_undegraded":"2023-07-09T21:39:42.231792+0000","last_fullsized":"2023-07-09T21:39:42.231792+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238527+0000","last_change":"2023-07-09T21:39:42.237809+0000","last_active":"2023-07-09T21:39:42.238527+0000","last_peered":"2023-07-09T21:39:42.238527+0000","last_clean":"2023-07-09T21:39:42.238527+0000","last_became_active":"2023-07-09T21:39:42.237410+0000","last_became_peered":"2023-07-09T21:39:42.237410+0000","last_unstale":"2023-07-09T21:39:42.238527+0000","last_undegraded":"2023-07-09T21:39:42.238527+0000","last_fullsized":"2023-07-09T21:39:42.238527+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:48.003891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225822+0000","last_change":"2023-07-09T21:39:42.225822+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225822+0000","last_undegraded":"2023-07-09T21:39:42.225822+0000","last_fullsized":"2023-07-09T21:39:42.225822+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246127+0000","last_change":"2023-07-09T21:39:42.244755+0000","last_active":"2023-07-09T21:39:42.246127+0000","last_peered":"2023-07-09T21:39:42.246127+0000","last_clean":"2023-07-09T21:39:42.246127+0000","last_became_active":"2023-07-09T21:39:42.244416+0000","last_became_peered":"2023-07-09T21:39:42.244416+0000","last_unstale":"2023-07-09T21:39:42.246127+0000","last_undegraded":"2023-07-09T21:39:42.246127+0000","last_fullsized":"2023-07-09T21:39:42.246127+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:51:25.237510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218727+0000","last_change":"2023-07-09T21:39:42.218727+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218727+0000","last_undegraded":"2023-07-09T21:39:42.218727+0000","last_fullsized":"2023-07-09T21:39:42.218727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238304+0000","last_change":"2023-07-09T21:39:42.227954+0000","last_active":"2023-07-09T21:39:42.238304+0000","last_peered":"2023-07-09T21:39:42.238304+0000","last_clean":"2023-07-09T21:39:42.238304+0000","last_became_active":"2023-07-09T21:39:42.227639+0000","last_became_peered":"2023-07-09T21:39:42.227639+0000","last_unstale":"2023-07-09T21:39:42.238304+0000","last_undegraded":"2023-07-09T21:39:42.238304+0000","last_fullsized":"2023-07-09T21:39:42.238304+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:56.473783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.221264+0000","last_change":"2023-07-09T21:39:42.221264+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.221264+0000","last_undegraded":"2023-07-09T21:39:42.221264+0000","last_fullsized":"2023-07-09T21:39:42.221264+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.246177+0000","last_change":"2023-07-09T21:39:42.245324+0000","last_active":"2023-07-09T21:39:42.246177+0000","last_peered":"2023-07-09T21:39:42.246177+0000","last_clean":"2023-07-09T21:39:42.246177+0000","last_became_active":"2023-07-09T21:39:42.244983+0000","last_became_peered":"2023-07-09T21:39:42.244983+0000","last_unstale":"2023-07-09T21:39:42.246177+0000","last_undegraded":"2023-07-09T21:39:42.246177+0000","last_fullsized":"2023-07-09T21:39:42.246177+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:50.112136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.223016+0000","last_change":"2023-07-09T21:39:42.223016+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.223016+0000","last_undegraded":"2023-07-09T21:39:42.223016+0000","last_fullsized":"2023-07-09T21:39:42.223016+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238087+0000","last_change":"2023-07-09T21:39:42.230619+0000","last_active":"2023-07-09T21:39:42.238087+0000","last_peered":"2023-07-09T21:39:42.238087+0000","last_clean":"2023-07-09T21:39:42.238087+0000","last_became_active":"2023-07-09T21:39:42.228042+0000","last_became_peered":"2023-07-09T21:39:42.228042+0000","last_unstale":"2023-07-09T21:39:42.238087+0000","last_undegraded":"2023-07-09T21:39:42.238087+0000","last_fullsized":"2023-07-09T21:39:42.238087+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:00.504417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218044+0000","last_change":"2023-07-09T21:39:42.218044+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218044+0000","last_undegraded":"2023-07-09T21:39:42.218044+0000","last_fullsized":"2023-07-09T21:39:42.218044+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237017+0000","last_change":"2023-07-09T21:39:42.231175+0000","last_active":"2023-07-09T21:39:42.237017+0000","last_peered":"2023-07-09T21:39:42.237017+0000","last_clean":"2023-07-09T21:39:42.237017+0000","last_became_active":"2023-07-09T21:39:42.230911+0000","last_became_peered":"2023-07-09T21:39:42.230911+0000","last_unstale":"2023-07-09T21:39:42.237017+0000","last_undegraded":"2023-07-09T21:39:42.237017+0000","last_fullsized":"2023-07-09T21:39:42.237017+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:54.534853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217840+0000","last_change":"2023-07-09T21:39:42.217840+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217840+0000","last_undegraded":"2023-07-09T21:39:42.217840+0000","last_fullsized":"2023-07-09T21:39:42.217840+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238639+0000","last_change":"2023-07-09T21:39:42.233317+0000","last_active":"2023-07-09T21:39:42.238639+0000","last_peered":"2023-07-09T21:39:42.238639+0000","last_clean":"2023-07-09T21:39:42.238639+0000","last_became_active":"2023-07-09T21:39:42.233048+0000","last_became_peered":"2023-07-09T21:39:42.233048+0000","last_unstale":"2023-07-09T21:39:42.238639+0000","last_undegraded":"2023-07-09T21:39:42.238639+0000","last_fullsized":"2023-07-09T21:39:42.238639+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:28:35.710801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227056+0000","last_change":"2023-07-09T21:39:42.227056+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227056+0000","last_undegraded":"2023-07-09T21:39:42.227056+0000","last_fullsized":"2023-07-09T21:39:42.227056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242704+0000","last_change":"2023-07-09T21:39:42.238834+0000","last_active":"2023-07-09T21:39:42.242704+0000","last_peered":"2023-07-09T21:39:42.242704+0000","last_clean":"2023-07-09T21:39:42.242704+0000","last_became_active":"2023-07-09T21:39:42.238523+0000","last_became_peered":"2023-07-09T21:39:42.238523+0000","last_unstale":"2023-07-09T21:39:42.242704+0000","last_undegraded":"2023-07-09T21:39:42.242704+0000","last_fullsized":"2023-07-09T21:39:42.242704+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:40:05.335063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217235+0000","last_change":"2023-07-09T21:39:42.217235+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217235+0000","last_undegraded":"2023-07-09T21:39:42.217235+0000","last_fullsized":"2023-07-09T21:39:42.217235+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238113+0000","last_change":"2023-07-09T21:39:42.235742+0000","last_active":"2023-07-09T21:39:42.238113+0000","last_peered":"2023-07-09T21:39:42.238113+0000","last_clean":"2023-07-09T21:39:42.238113+0000","last_became_active":"2023-07-09T21:39:42.235449+0000","last_became_peered":"2023-07-09T21:39:42.235449+0000","last_unstale":"2023-07-09T21:39:42.238113+0000","last_undegraded":"2023-07-09T21:39:42.238113+0000","last_fullsized":"2023-07-09T21:39:42.238113+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:10.587136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217234+0000","last_change":"2023-07-09T21:39:42.217234+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217234+0000","last_undegraded":"2023-07-09T21:39:42.217234+0000","last_fullsized":"2023-07-09T21:39:42.217234+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.245763+0000","last_change":"2023-07-09T21:39:42.244672+0000","last_active":"2023-07-09T21:39:42.245763+0000","last_peered":"2023-07-09T21:39:42.245763+0000","last_clean":"2023-07-09T21:39:42.245763+0000","last_became_active":"2023-07-09T21:39:42.244373+0000","last_became_peered":"2023-07-09T21:39:42.244373+0000","last_unstale":"2023-07-09T21:39:42.245763+0000","last_undegraded":"2023-07-09T21:39:42.245763+0000","last_fullsized":"2023-07-09T21:39:42.245763+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:46.527940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222693+0000","last_change":"2023-07-09T21:39:42.222693+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222693+0000","last_undegraded":"2023-07-09T21:39:42.222693+0000","last_fullsized":"2023-07-09T21:39:42.222693+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.237360+0000","last_change":"2023-07-09T21:39:42.234762+0000","last_active":"2023-07-09T21:39:42.237360+0000","last_peered":"2023-07-09T21:39:42.237360+0000","last_clean":"2023-07-09T21:39:42.237360+0000","last_became_active":"2023-07-09T21:39:42.234479+0000","last_became_peered":"2023-07-09T21:39:42.234479+0000","last_unstale":"2023-07-09T21:39:42.237360+0000","last_undegraded":"2023-07-09T21:39:42.237360+0000","last_fullsized":"2023-07-09T21:39:42.237360+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:48.765795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217610+0000","last_change":"2023-07-09T21:39:42.217610+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217610+0000","last_undegraded":"2023-07-09T21:39:42.217610+0000","last_fullsized":"2023-07-09T21:39:42.217610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238242+0000","last_change":"2023-07-09T21:39:42.232385+0000","last_active":"2023-07-09T21:39:42.238242+0000","last_peered":"2023-07-09T21:39:42.238242+0000","last_clean":"2023-07-09T21:39:42.238242+0000","last_became_active":"2023-07-09T21:39:42.231546+0000","last_became_peered":"2023-07-09T21:39:42.231546+0000","last_unstale":"2023-07-09T21:39:42.238242+0000","last_undegraded":"2023-07-09T21:39:42.238242+0000","last_fullsized":"2023-07-09T21:39:42.238242+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:10.038367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.225714+0000","last_change":"2023-07-09T21:39:42.225714+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.225714+0000","last_undegraded":"2023-07-09T21:39:42.225714+0000","last_fullsized":"2023-07-09T21:39:42.225714+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241802+0000","last_change":"2023-07-09T21:39:42.236910+0000","last_active":"2023-07-09T21:39:42.241802+0000","last_peered":"2023-07-09T21:39:42.241802+0000","last_clean":"2023-07-09T21:39:42.241802+0000","last_became_active":"2023-07-09T21:39:42.236606+0000","last_became_peered":"2023-07-09T21:39:42.236606+0000","last_unstale":"2023-07-09T21:39:42.241802+0000","last_undegraded":"2023-07-09T21:39:42.241802+0000","last_fullsized":"2023-07-09T21:39:42.241802+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:59.712895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.224626+0000","last_change":"2023-07-09T21:39:42.224626+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.224626+0000","last_undegraded":"2023-07-09T21:39:42.224626+0000","last_fullsized":"2023-07-09T21:39:42.224626+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240357+0000","last_change":"2023-07-09T21:39:42.238711+0000","last_active":"2023-07-09T21:39:42.240357+0000","last_peered":"2023-07-09T21:39:42.240357+0000","last_clean":"2023-07-09T21:39:42.240357+0000","last_became_active":"2023-07-09T21:39:42.238400+0000","last_became_peered":"2023-07-09T21:39:42.238400+0000","last_unstale":"2023-07-09T21:39:42.240357+0000","last_undegraded":"2023-07-09T21:39:42.240357+0000","last_fullsized":"2023-07-09T21:39:42.240357+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:33.222075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217418+0000","last_change":"2023-07-09T21:39:42.217418+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217418+0000","last_undegraded":"2023-07-09T21:39:42.217418+0000","last_fullsized":"2023-07-09T21:39:42.217418+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242746+0000","last_change":"2023-07-09T21:39:42.239328+0000","last_active":"2023-07-09T21:39:42.242746+0000","last_peered":"2023-07-09T21:39:42.242746+0000","last_clean":"2023-07-09T21:39:42.242746+0000","last_became_active":"2023-07-09T21:39:42.239048+0000","last_became_peered":"2023-07-09T21:39:42.239048+0000","last_unstale":"2023-07-09T21:39:42.242746+0000","last_undegraded":"2023-07-09T21:39:42.242746+0000","last_fullsized":"2023-07-09T21:39:42.242746+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:49:31.191652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.229459+0000","last_change":"2023-07-09T21:39:42.229459+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.229459+0000","last_undegraded":"2023-07-09T21:39:42.229459+0000","last_fullsized":"2023-07-09T21:39:42.229459+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.238725+0000","last_change":"2023-07-09T21:39:42.235946+0000","last_active":"2023-07-09T21:39:42.238725+0000","last_peered":"2023-07-09T21:39:42.238725+0000","last_clean":"2023-07-09T21:39:42.238725+0000","last_became_active":"2023-07-09T21:39:42.235643+0000","last_became_peered":"2023-07-09T21:39:42.235643+0000","last_unstale":"2023-07-09T21:39:42.238725+0000","last_undegraded":"2023-07-09T21:39:42.238725+0000","last_fullsized":"2023-07-09T21:39:42.238725+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:56:23.785562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"101'205","reported_seq":649,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229771+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:42.229771+0000","last_peered":"2023-07-09T21:39:42.229771+0000","last_clean":"2023-07-09T21:39:42.229771+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:42.229771+0000","last_undegraded":"2023-07-09T21:39:42.229771+0000","last_fullsized":"2023-07-09T21:39:42.229771+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:03.342507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222569+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:42.222569+0000","last_peered":"2023-07-09T21:39:42.222569+0000","last_clean":"2023-07-09T21:39:42.222569+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:42.222569+0000","last_undegraded":"2023-07-09T21:39:42.222569+0000","last_fullsized":"2023-07-09T21:39:42.222569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:20:44.185194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218336+0000","last_change":"2023-07-09T21:39:42.218336+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218336+0000","last_undegraded":"2023-07-09T21:39:42.218336+0000","last_fullsized":"2023-07-09T21:39:42.218336+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240651+0000","last_change":"2023-07-09T21:39:42.238970+0000","last_active":"2023-07-09T21:39:42.240651+0000","last_peered":"2023-07-09T21:39:42.240651+0000","last_clean":"2023-07-09T21:39:42.240651+0000","last_became_active":"2023-07-09T21:39:42.237884+0000","last_became_peered":"2023-07-09T21:39:42.237884+0000","last_unstale":"2023-07-09T21:39:42.240651+0000","last_undegraded":"2023-07-09T21:39:42.240651+0000","last_fullsized":"2023-07-09T21:39:42.240651+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:40.688727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.229599+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:42.229599+0000","last_peered":"2023-07-09T21:39:42.229599+0000","last_clean":"2023-07-09T21:39:42.229599+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:42.229599+0000","last_undegraded":"2023-07-09T21:39:42.229599+0000","last_fullsized":"2023-07-09T21:39:42.229599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:35:44.480339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.227045+0000","last_change":"2023-07-09T21:39:42.227045+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.227045+0000","last_undegraded":"2023-07-09T21:39:42.227045+0000","last_fullsized":"2023-07-09T21:39:42.227045+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.243159+0000","last_change":"2023-07-09T21:39:42.241874+0000","last_active":"2023-07-09T21:39:42.243159+0000","last_peered":"2023-07-09T21:39:42.243159+0000","last_clean":"2023-07-09T21:39:42.243159+0000","last_became_active":"2023-07-09T21:39:42.241590+0000","last_became_peered":"2023-07-09T21:39:42.241590+0000","last_unstale":"2023-07-09T21:39:42.243159+0000","last_undegraded":"2023-07-09T21:39:42.243159+0000","last_fullsized":"2023-07-09T21:39:42.243159+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:07:33.516145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218745+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:42.218745+0000","last_peered":"2023-07-09T21:39:42.218745+0000","last_clean":"2023-07-09T21:39:42.218745+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:42.218745+0000","last_undegraded":"2023-07-09T21:39:42.218745+0000","last_fullsized":"2023-07-09T21:39:42.218745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:29:36.617515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.226601+0000","last_change":"2023-07-09T21:39:42.226601+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.226601+0000","last_undegraded":"2023-07-09T21:39:42.226601+0000","last_fullsized":"2023-07-09T21:39:42.226601+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.240989+0000","last_change":"2023-07-09T21:39:42.240044+0000","last_active":"2023-07-09T21:39:42.240989+0000","last_peered":"2023-07-09T21:39:42.240989+0000","last_clean":"2023-07-09T21:39:42.240989+0000","last_became_active":"2023-07-09T21:39:42.239664+0000","last_became_peered":"2023-07-09T21:39:42.239664+0000","last_unstale":"2023-07-09T21:39:42.240989+0000","last_undegraded":"2023-07-09T21:39:42.240989+0000","last_fullsized":"2023-07-09T21:39:42.240989+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:10:33.117486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":203,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.226075+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:42.226075+0000","last_peered":"2023-07-09T21:39:42.226075+0000","last_clean":"2023-07-09T21:39:42.226075+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:42.226075+0000","last_undegraded":"2023-07-09T21:39:42.226075+0000","last_fullsized":"2023-07-09T21:39:42.226075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:05:51.349439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.217257+0000","last_change":"2023-07-09T21:39:42.217257+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.217257+0000","last_undegraded":"2023-07-09T21:39:42.217257+0000","last_fullsized":"2023-07-09T21:39:42.217257+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.241771+0000","last_change":"2023-07-09T21:39:42.237844+0000","last_active":"2023-07-09T21:39:42.241771+0000","last_peered":"2023-07-09T21:39:42.241771+0000","last_clean":"2023-07-09T21:39:42.241771+0000","last_became_active":"2023-07-09T21:39:42.237413+0000","last_became_peered":"2023-07-09T21:39:42.237413+0000","last_unstale":"2023-07-09T21:39:42.241771+0000","last_undegraded":"2023-07-09T21:39:42.241771+0000","last_fullsized":"2023-07-09T21:39:42.241771+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:48.795873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":169,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.222216+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:42.222216+0000","last_peered":"2023-07-09T21:39:42.222216+0000","last_clean":"2023-07-09T21:39:42.222216+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:42.222216+0000","last_undegraded":"2023-07-09T21:39:42.222216+0000","last_fullsized":"2023-07-09T21:39:42.222216+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:38.969088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222781+0000","last_change":"2023-07-09T21:39:42.222781+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222781+0000","last_undegraded":"2023-07-09T21:39:42.222781+0000","last_fullsized":"2023-07-09T21:39:42.222781+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.236142+0000","last_change":"2023-07-09T21:39:42.233837+0000","last_active":"2023-07-09T21:39:42.236142+0000","last_peered":"2023-07-09T21:39:42.236142+0000","last_clean":"2023-07-09T21:39:42.236142+0000","last_became_active":"2023-07-09T21:39:42.233428+0000","last_became_peered":"2023-07-09T21:39:42.233428+0000","last_unstale":"2023-07-09T21:39:42.236142+0000","last_undegraded":"2023-07-09T21:39:42.236142+0000","last_fullsized":"2023-07-09T21:39:42.236142+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:29:45.393745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.233824+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:42.233824+0000","last_peered":"2023-07-09T21:39:42.233824+0000","last_clean":"2023-07-09T21:39:42.233824+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:42.233824+0000","last_undegraded":"2023-07-09T21:39:42.233824+0000","last_fullsized":"2023-07-09T21:39:42.233824+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:36.805502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.222414+0000","last_change":"2023-07-09T21:39:42.222414+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.222414+0000","last_undegraded":"2023-07-09T21:39:42.222414+0000","last_fullsized":"2023-07-09T21:39:42.222414+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.242834+0000","last_change":"2023-07-09T21:39:42.241936+0000","last_active":"2023-07-09T21:39:42.242834+0000","last_peered":"2023-07-09T21:39:42.242834+0000","last_clean":"2023-07-09T21:39:42.242834+0000","last_became_active":"2023-07-09T21:39:42.241566+0000","last_became_peered":"2023-07-09T21:39:42.241566+0000","last_unstale":"2023-07-09T21:39:42.242834+0000","last_undegraded":"2023-07-09T21:39:42.242834+0000","last_fullsized":"2023-07-09T21:39:42.242834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:19.824206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":171,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.218183+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:42.218183+0000","last_peered":"2023-07-09T21:39:42.218183+0000","last_clean":"2023-07-09T21:39:42.218183+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:42.218183+0000","last_undegraded":"2023-07-09T21:39:42.218183+0000","last_fullsized":"2023-07-09T21:39:42.218183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:16.871379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":1,"reported_epoch":111,"state":"creating+peering","last_fresh":"2023-07-09T21:39:42.218131+0000","last_change":"2023-07-09T21:39:42.218131+0000","last_active":"2023-07-09T21:39:42.202790+0000","last_peered":"2023-07-09T21:39:42.202790+0000","last_clean":"2023-07-09T21:39:42.202790+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:39:42.218131+0000","last_undegraded":"2023-07-09T21:39:42.218131+0000","last_fullsized":"2023-07-09T21:39:42.218131+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.231571+0000","last_change":"2023-07-09T21:39:42.228204+0000","last_active":"2023-07-09T21:39:42.231571+0000","last_peered":"2023-07-09T21:39:42.231571+0000","last_clean":"2023-07-09T21:39:42.231571+0000","last_became_active":"2023-07-09T21:39:42.227935+0000","last_became_peered":"2023-07-09T21:39:42.227935+0000","last_unstale":"2023-07-09T21:39:42.231571+0000","last_undegraded":"2023-07-09T21:39:42.231571+0000","last_fullsized":"2023-07-09T21:39:42.231571+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:03:34.915164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":177,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-07-09T21:39:42.225425+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:42.225425+0000","last_peered":"2023-07-09T21:39:42.225425+0000","last_clean":"2023-07-09T21:39:42.225425+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:42.225425+0000","last_undegraded":"2023-07-09T21:39:42.225425+0000","last_fullsized":"2023-07-09T21:39:42.225425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:22.448454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575057,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59188,"kb_used_data":1900,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312652,"statfs":{"total":96636764160,"available":96576155648,"internally_reserved":0,"allocated":1945600,"data_stored":1271042,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.48199999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.77200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.502}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575056,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.76500000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.89600000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.94699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":1.01}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.92200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":1.05},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.034}]}]},{"osd":5,"up_from":13,"seq":55834575055,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50428,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321412,"statfs":{"total":96636764160,"available":96585125888,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.64200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.94099999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":1.083},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.87}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575057,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32368,"kb_used_data":1320,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339472,"statfs":{"total":96636764160,"available":96603619328,"internally_reserved":0,"allocated":1351680,"data_stored":680674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.36199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.64300000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.57099999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.54400000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.68400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575056,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27000000000000002},"max":{"1min":0.63800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.61099999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.49199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45500000000000002,"15min":0.46400000000000002},"min":{"1min":0.32300000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.59599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50800000000000001,"15min":0.51300000000000001},"min":{"1min":0.39300000000000002,"5min":0.35799999999999998,"15min":0.314},"max":{"1min":0.58899999999999997,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.439}]},{"osd":2,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.56799999999999995,"15min":0.57699999999999996},"min":{"1min":0.42299999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66300000000000003,"5min":0.89200000000000002,"15min":0.96599999999999997},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.47299999999999998,"5min":0.40799999999999997,"15min":0.38400000000000001},"max":{"1min":0.76700000000000002,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.52100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.53600000000000003,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":1.0029999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.79500000000000004,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.47099999999999997},"max":{"1min":0.98999999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80200000000000005,"15min":0.82399999999999995},"min":{"1min":0.61899999999999999,"5min":0.54500000000000004,"15min":0.503},"max":{"1min":1.0249999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79200000000000004,"15min":0.80300000000000005},"min":{"1min":0.57699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.1140000000000001,"15min":1.208},"last":0.68400000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77600000000000002,"15min":0.77700000000000002},"min":{"1min":0.502,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.97199999999999998,"5min":1.51,"15min":1.51},"last":0.628},{"interface":"front","average":{"1min":0.754,"5min":0.76100000000000001,"15min":0.76600000000000001},"min":{"1min":0.48499999999999999,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93899999999999995,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:44 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.97199999999999998,"5min":1.1100000000000001,"15min":1.159},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48599999999999999},"max":{"1min":0.93600000000000005,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575057,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54524,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317316,"statfs":{"total":96636764160,"available":96580931584,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.437}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.496}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.55500000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.70599999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":687302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.311},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.434},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.35599999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.83399999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.81899999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.93400000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.872},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.747}]}]},{"osd":0,"up_from":13,"seq":55834575057,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37056,"kb_used_data":1912,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334784,"statfs":{"total":96636764160,"available":96598818816,"internally_reserved":0,"allocated":1957888,"data_stored":1277670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.441},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.38800000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.755},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":0.86099999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.72299999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.90100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:48.118 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3f is not active+clean 2023-07-09T21:39:48.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.222829+0000', 'last_change': '2023-07-09T21:39:42.222829+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.222829+0000', 'last_undegraded': '2023-07-09T21:39:42.222829+0000', 'last_fullsized': '2023-07-09T21:39:42.222829+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.119 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3e is not active+clean 2023-07-09T21:39:48.119 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.222406+0000', 'last_change': '2023-07-09T21:39:42.222406+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.222406+0000', 'last_undegraded': '2023-07-09T21:39:42.222406+0000', 'last_fullsized': '2023-07-09T21:39:42.222406+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3d is not active+clean 2023-07-09T21:39:48.120 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.223788+0000', 'last_change': '2023-07-09T21:39:42.223788+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.223788+0000', 'last_undegraded': '2023-07-09T21:39:42.223788+0000', 'last_fullsized': '2023-07-09T21:39:42.223788+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.120 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3c is not active+clean 2023-07-09T21:39:48.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.221904+0000', 'last_change': '2023-07-09T21:39:42.221904+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.221904+0000', 'last_undegraded': '2023-07-09T21:39:42.221904+0000', 'last_fullsized': '2023-07-09T21:39:42.221904+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.121 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3b is not active+clean 2023-07-09T21:39:48.121 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.224747+0000', 'last_change': '2023-07-09T21:39:42.224747+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.224747+0000', 'last_undegraded': '2023-07-09T21:39:42.224747+0000', 'last_fullsized': '2023-07-09T21:39:42.224747+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.122 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3a is not active+clean 2023-07-09T21:39:48.122 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225310+0000', 'last_change': '2023-07-09T21:39:42.225310+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225310+0000', 'last_undegraded': '2023-07-09T21:39:42.225310+0000', 'last_fullsized': '2023-07-09T21:39:42.225310+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.39 is not active+clean 2023-07-09T21:39:48.123 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.230574+0000', 'last_change': '2023-07-09T21:39:42.230574+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.230574+0000', 'last_undegraded': '2023-07-09T21:39:42.230574+0000', 'last_fullsized': '2023-07-09T21:39:42.230574+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:48.123 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.38 is not active+clean 2023-07-09T21:39:48.124 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.220602+0000', 'last_change': '2023-07-09T21:39:42.220602+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.220602+0000', 'last_undegraded': '2023-07-09T21:39:42.220602+0000', 'last_fullsized': '2023-07-09T21:39:42.220602+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.124 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.37 is not active+clean 2023-07-09T21:39:48.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225568+0000', 'last_change': '2023-07-09T21:39:42.225568+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225568+0000', 'last_undegraded': '2023-07-09T21:39:42.225568+0000', 'last_fullsized': '2023-07-09T21:39:42.225568+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.125 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.36 is not active+clean 2023-07-09T21:39:48.125 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219622+0000', 'last_change': '2023-07-09T21:39:42.219622+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219622+0000', 'last_undegraded': '2023-07-09T21:39:42.219622+0000', 'last_fullsized': '2023-07-09T21:39:42.219622+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.35 is not active+clean 2023-07-09T21:39:48.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.227858+0000', 'last_change': '2023-07-09T21:39:42.227858+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.227858+0000', 'last_undegraded': '2023-07-09T21:39:42.227858+0000', 'last_fullsized': '2023-07-09T21:39:42.227858+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.34 is not active+clean 2023-07-09T21:39:48.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218223+0000', 'last_change': '2023-07-09T21:39:42.218223+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218223+0000', 'last_undegraded': '2023-07-09T21:39:42.218223+0000', 'last_fullsized': '2023-07-09T21:39:42.218223+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.33 is not active+clean 2023-07-09T21:39:48.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219045+0000', 'last_change': '2023-07-09T21:39:42.219045+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219045+0000', 'last_undegraded': '2023-07-09T21:39:42.219045+0000', 'last_fullsized': '2023-07-09T21:39:42.219045+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.32 is not active+clean 2023-07-09T21:39:48.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.224804+0000', 'last_change': '2023-07-09T21:39:42.224804+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.224804+0000', 'last_undegraded': '2023-07-09T21:39:42.224804+0000', 'last_fullsized': '2023-07-09T21:39:42.224804+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.31 is not active+clean 2023-07-09T21:39:48.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219081+0000', 'last_change': '2023-07-09T21:39:42.219081+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219081+0000', 'last_undegraded': '2023-07-09T21:39:42.219081+0000', 'last_fullsized': '2023-07-09T21:39:42.219081+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.30 is not active+clean 2023-07-09T21:39:48.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.220157+0000', 'last_change': '2023-07-09T21:39:42.220157+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.220157+0000', 'last_undegraded': '2023-07-09T21:39:42.220157+0000', 'last_fullsized': '2023-07-09T21:39:42.220157+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2f is not active+clean 2023-07-09T21:39:48.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219451+0000', 'last_change': '2023-07-09T21:39:42.219451+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219451+0000', 'last_undegraded': '2023-07-09T21:39:42.219451+0000', 'last_fullsized': '2023-07-09T21:39:42.219451+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2e is not active+clean 2023-07-09T21:39:48.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.226271+0000', 'last_change': '2023-07-09T21:39:42.226271+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.226271+0000', 'last_undegraded': '2023-07-09T21:39:42.226271+0000', 'last_fullsized': '2023-07-09T21:39:42.226271+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2d is not active+clean 2023-07-09T21:39:48.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225545+0000', 'last_change': '2023-07-09T21:39:42.225545+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225545+0000', 'last_undegraded': '2023-07-09T21:39:42.225545+0000', 'last_fullsized': '2023-07-09T21:39:42.225545+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2c is not active+clean 2023-07-09T21:39:48.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.221425+0000', 'last_change': '2023-07-09T21:39:42.221425+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.221425+0000', 'last_undegraded': '2023-07-09T21:39:42.221425+0000', 'last_fullsized': '2023-07-09T21:39:42.221425+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2b is not active+clean 2023-07-09T21:39:48.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225272+0000', 'last_change': '2023-07-09T21:39:42.225272+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225272+0000', 'last_undegraded': '2023-07-09T21:39:42.225272+0000', 'last_fullsized': '2023-07-09T21:39:42.225272+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2a is not active+clean 2023-07-09T21:39:48.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.224252+0000', 'last_change': '2023-07-09T21:39:42.224252+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.224252+0000', 'last_undegraded': '2023-07-09T21:39:42.224252+0000', 'last_fullsized': '2023-07-09T21:39:42.224252+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.29 is not active+clean 2023-07-09T21:39:48.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.228334+0000', 'last_change': '2023-07-09T21:39:42.228334+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.228334+0000', 'last_undegraded': '2023-07-09T21:39:42.228334+0000', 'last_fullsized': '2023-07-09T21:39:42.228334+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:48.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.28 is not active+clean 2023-07-09T21:39:48.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.224147+0000', 'last_change': '2023-07-09T21:39:42.224147+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.224147+0000', 'last_undegraded': '2023-07-09T21:39:42.224147+0000', 'last_fullsized': '2023-07-09T21:39:42.224147+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.27 is not active+clean 2023-07-09T21:39:48.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.223216+0000', 'last_change': '2023-07-09T21:39:42.223216+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.223216+0000', 'last_undegraded': '2023-07-09T21:39:42.223216+0000', 'last_fullsized': '2023-07-09T21:39:42.223216+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.26 is not active+clean 2023-07-09T21:39:48.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.227051+0000', 'last_change': '2023-07-09T21:39:42.227051+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.227051+0000', 'last_undegraded': '2023-07-09T21:39:42.227051+0000', 'last_fullsized': '2023-07-09T21:39:42.227051+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.25 is not active+clean 2023-07-09T21:39:48.138 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219552+0000', 'last_change': '2023-07-09T21:39:42.219552+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219552+0000', 'last_undegraded': '2023-07-09T21:39:42.219552+0000', 'last_fullsized': '2023-07-09T21:39:42.219552+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.138 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.24 is not active+clean 2023-07-09T21:39:48.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.220974+0000', 'last_change': '2023-07-09T21:39:42.220974+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.220974+0000', 'last_undegraded': '2023-07-09T21:39:42.220974+0000', 'last_fullsized': '2023-07-09T21:39:42.220974+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.139 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.23 is not active+clean 2023-07-09T21:39:48.139 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.229053+0000', 'last_change': '2023-07-09T21:39:42.229053+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.229053+0000', 'last_undegraded': '2023-07-09T21:39:42.229053+0000', 'last_fullsized': '2023-07-09T21:39:42.229053+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:48.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.22 is not active+clean 2023-07-09T21:39:48.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.223724+0000', 'last_change': '2023-07-09T21:39:42.223724+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.223724+0000', 'last_undegraded': '2023-07-09T21:39:42.223724+0000', 'last_fullsized': '2023-07-09T21:39:42.223724+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.140 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.21 is not active+clean 2023-07-09T21:39:48.140 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.223278+0000', 'last_change': '2023-07-09T21:39:42.223278+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.223278+0000', 'last_undegraded': '2023-07-09T21:39:42.223278+0000', 'last_fullsized': '2023-07-09T21:39:42.223278+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.20 is not active+clean 2023-07-09T21:39:48.141 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219716+0000', 'last_change': '2023-07-09T21:39:42.219716+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219716+0000', 'last_undegraded': '2023-07-09T21:39:42.219716+0000', 'last_fullsized': '2023-07-09T21:39:42.219716+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.141 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1c is not active+clean 2023-07-09T21:39:48.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219003+0000', 'last_change': '2023-07-09T21:39:42.219003+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219003+0000', 'last_undegraded': '2023-07-09T21:39:42.219003+0000', 'last_fullsized': '2023-07-09T21:39:42.219003+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.142 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1d is not active+clean 2023-07-09T21:39:48.142 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.219926+0000', 'last_change': '2023-07-09T21:39:42.219926+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.219926+0000', 'last_undegraded': '2023-07-09T21:39:42.219926+0000', 'last_fullsized': '2023-07-09T21:39:42.219926+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1e is not active+clean 2023-07-09T21:39:48.143 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.230211+0000', 'last_change': '2023-07-09T21:39:42.230211+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.230211+0000', 'last_undegraded': '2023-07-09T21:39:42.230211+0000', 'last_fullsized': '2023-07-09T21:39:42.230211+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:48.143 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1f is not active+clean 2023-07-09T21:39:48.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218929+0000', 'last_change': '2023-07-09T21:39:42.218929+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218929+0000', 'last_undegraded': '2023-07-09T21:39:42.218929+0000', 'last_fullsized': '2023-07-09T21:39:42.218929+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.144 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.18 is not active+clean 2023-07-09T21:39:48.144 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.221816+0000', 'last_change': '2023-07-09T21:39:42.221816+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.221816+0000', 'last_undegraded': '2023-07-09T21:39:42.221816+0000', 'last_fullsized': '2023-07-09T21:39:42.221816+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.19 is not active+clean 2023-07-09T21:39:48.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.226576+0000', 'last_change': '2023-07-09T21:39:42.226576+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.226576+0000', 'last_undegraded': '2023-07-09T21:39:42.226576+0000', 'last_fullsized': '2023-07-09T21:39:42.226576+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:48.145 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1a is not active+clean 2023-07-09T21:39:48.145 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218724+0000', 'last_change': '2023-07-09T21:39:42.218724+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218724+0000', 'last_undegraded': '2023-07-09T21:39:42.218724+0000', 'last_fullsized': '2023-07-09T21:39:42.218724+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1b is not active+clean 2023-07-09T21:39:48.146 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218489+0000', 'last_change': '2023-07-09T21:39:42.218489+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218489+0000', 'last_undegraded': '2023-07-09T21:39:42.218489+0000', 'last_fullsized': '2023-07-09T21:39:42.218489+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.146 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.14 is not active+clean 2023-07-09T21:39:48.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225366+0000', 'last_change': '2023-07-09T21:39:42.225366+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225366+0000', 'last_undegraded': '2023-07-09T21:39:42.225366+0000', 'last_fullsized': '2023-07-09T21:39:42.225366+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.147 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.15 is not active+clean 2023-07-09T21:39:48.147 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.231792+0000', 'last_change': '2023-07-09T21:39:42.231792+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.231792+0000', 'last_undegraded': '2023-07-09T21:39:42.231792+0000', 'last_fullsized': '2023-07-09T21:39:42.231792+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:48.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.16 is not active+clean 2023-07-09T21:39:48.148 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225822+0000', 'last_change': '2023-07-09T21:39:42.225822+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225822+0000', 'last_undegraded': '2023-07-09T21:39:42.225822+0000', 'last_fullsized': '2023-07-09T21:39:42.225822+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.148 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.17 is not active+clean 2023-07-09T21:39:48.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218727+0000', 'last_change': '2023-07-09T21:39:42.218727+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218727+0000', 'last_undegraded': '2023-07-09T21:39:42.218727+0000', 'last_fullsized': '2023-07-09T21:39:42.218727+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.149 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.10 is not active+clean 2023-07-09T21:39:48.149 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.221264+0000', 'last_change': '2023-07-09T21:39:42.221264+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.221264+0000', 'last_undegraded': '2023-07-09T21:39:42.221264+0000', 'last_fullsized': '2023-07-09T21:39:42.221264+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:39:48.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.11 is not active+clean 2023-07-09T21:39:48.150 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.223016+0000', 'last_change': '2023-07-09T21:39:42.223016+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.223016+0000', 'last_undegraded': '2023-07-09T21:39:42.223016+0000', 'last_fullsized': '2023-07-09T21:39:42.223016+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.150 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.12 is not active+clean 2023-07-09T21:39:48.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218044+0000', 'last_change': '2023-07-09T21:39:42.218044+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218044+0000', 'last_undegraded': '2023-07-09T21:39:42.218044+0000', 'last_fullsized': '2023-07-09T21:39:42.218044+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.151 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.13 is not active+clean 2023-07-09T21:39:48.151 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217840+0000', 'last_change': '2023-07-09T21:39:42.217840+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217840+0000', 'last_undegraded': '2023-07-09T21:39:42.217840+0000', 'last_fullsized': '2023-07-09T21:39:42.217840+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.4 is not active+clean 2023-07-09T21:39:48.152 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.227056+0000', 'last_change': '2023-07-09T21:39:42.227056+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.227056+0000', 'last_undegraded': '2023-07-09T21:39:42.227056+0000', 'last_fullsized': '2023-07-09T21:39:42.227056+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:48.152 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.5 is not active+clean 2023-07-09T21:39:48.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217235+0000', 'last_change': '2023-07-09T21:39:42.217235+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217235+0000', 'last_undegraded': '2023-07-09T21:39:42.217235+0000', 'last_fullsized': '2023-07-09T21:39:42.217235+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.153 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.6 is not active+clean 2023-07-09T21:39:48.153 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217234+0000', 'last_change': '2023-07-09T21:39:42.217234+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217234+0000', 'last_undegraded': '2023-07-09T21:39:42.217234+0000', 'last_fullsized': '2023-07-09T21:39:42.217234+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.7 is not active+clean 2023-07-09T21:39:48.154 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.222693+0000', 'last_change': '2023-07-09T21:39:42.222693+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.222693+0000', 'last_undegraded': '2023-07-09T21:39:42.222693+0000', 'last_fullsized': '2023-07-09T21:39:42.222693+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.154 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.0 is not active+clean 2023-07-09T21:39:48.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217610+0000', 'last_change': '2023-07-09T21:39:42.217610+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217610+0000', 'last_undegraded': '2023-07-09T21:39:42.217610+0000', 'last_fullsized': '2023-07-09T21:39:42.217610+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:39:48.155 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.1 is not active+clean 2023-07-09T21:39:48.155 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.225714+0000', 'last_change': '2023-07-09T21:39:42.225714+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.225714+0000', 'last_undegraded': '2023-07-09T21:39:42.225714+0000', 'last_fullsized': '2023-07-09T21:39:42.225714+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:39:48.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.2 is not active+clean 2023-07-09T21:39:48.156 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.224626+0000', 'last_change': '2023-07-09T21:39:42.224626+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.224626+0000', 'last_undegraded': '2023-07-09T21:39:42.224626+0000', 'last_fullsized': '2023-07-09T21:39:42.224626+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:48.156 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.3 is not active+clean 2023-07-09T21:39:48.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217418+0000', 'last_change': '2023-07-09T21:39:42.217418+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217418+0000', 'last_undegraded': '2023-07-09T21:39:42.217418+0000', 'last_fullsized': '2023-07-09T21:39:42.217418+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.f is not active+clean 2023-07-09T21:39:48.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.229459+0000', 'last_change': '2023-07-09T21:39:42.229459+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.229459+0000', 'last_undegraded': '2023-07-09T21:39:42.229459+0000', 'last_fullsized': '2023-07-09T21:39:42.229459+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:39:48.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.c is not active+clean 2023-07-09T21:39:48.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218336+0000', 'last_change': '2023-07-09T21:39:42.218336+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218336+0000', 'last_undegraded': '2023-07-09T21:39:42.218336+0000', 'last_fullsized': '2023-07-09T21:39:42.218336+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.d is not active+clean 2023-07-09T21:39:48.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.227045+0000', 'last_change': '2023-07-09T21:39:42.227045+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.227045+0000', 'last_undegraded': '2023-07-09T21:39:42.227045+0000', 'last_fullsized': '2023-07-09T21:39:42.227045+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:39:48.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.e is not active+clean 2023-07-09T21:39:48.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.226601+0000', 'last_change': '2023-07-09T21:39:42.226601+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.226601+0000', 'last_undegraded': '2023-07-09T21:39:42.226601+0000', 'last_fullsized': '2023-07-09T21:39:42.226601+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:39:48.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.8 is not active+clean 2023-07-09T21:39:48.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.217257+0000', 'last_change': '2023-07-09T21:39:42.217257+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.217257+0000', 'last_undegraded': '2023-07-09T21:39:42.217257+0000', 'last_fullsized': '2023-07-09T21:39:42.217257+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.9 is not active+clean 2023-07-09T21:39:48.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.222781+0000', 'last_change': '2023-07-09T21:39:42.222781+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.222781+0000', 'last_undegraded': '2023-07-09T21:39:42.222781+0000', 'last_fullsized': '2023-07-09T21:39:42.222781+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.a is not active+clean 2023-07-09T21:39:48.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.222414+0000', 'last_change': '2023-07-09T21:39:42.222414+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.222414+0000', 'last_undegraded': '2023-07-09T21:39:42.222414+0000', 'last_fullsized': '2023-07-09T21:39:42.222414+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:39:48.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 14.b is not active+clean 2023-07-09T21:39:48.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '14.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 111, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:39:42.218131+0000', 'last_change': '2023-07-09T21:39:42.218131+0000', 'last_active': '2023-07-09T21:39:42.202790+0000', 'last_peered': '2023-07-09T21:39:42.202790+0000', 'last_clean': '2023-07-09T21:39:42.202790+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:39:42.218131+0000', 'last_undegraded': '2023-07-09T21:39:42.218131+0000', 'last_fullsized': '2023-07-09T21:39:42.218131+0000', 'mapping_epoch': 111, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 111, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'last_clean_scrub_stamp': '2023-07-09T21:39:42.202790+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:39:48.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:39:48.191 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-09T21:39:48.186+0000 7efc66ed2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:39:48.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.302+0000 7f2538740640 1 Processor -- start 2023-07-09T21:39:48.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.302+0000 7f2538740640 1 -- start start 2023-07-09T21:39:48.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2538740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300af830 0x7f25300afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2538740640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f25300cc320 0x7f253006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2538740640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25300cbe90 con 0x7f25300cc770 2023-07-09T21:39:48.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2538740640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253006d370 con 0x7f25300cc320 2023-07-09T21:39:48.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2538740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300b0140 con 0x7f25300af830 2023-07-09T21:39:48.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f25300cc320 0x7f253006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f25300cc320 0x7f253006efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54088/0 (socket says 172.21.15.37:54088) 2023-07-09T21:39:48.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 -- 172.21.15.37:0/169865846 learned_addr learned my addr 172.21.15.37:0/169865846 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:48.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f25364dc640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300af830 0x7f25300afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 -- 172.21.15.37:0/169865846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300af830 msgr2=0x7f25300afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:48.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300af830 0x7f25300afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 -- 172.21.15.37:0/169865846 >> v1:172.21.15.119:6789/0 conn(0x7f25300cc770 legacy=0x7f253006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 -- 172.21.15.37:0/169865846 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2530159bb0 con 0x7f25300cc320 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f2535cdb640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300cc320 0x7f253006efc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44239369e6b8e57c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.306+0000 7f25354da640 1 -- 172.21.15.37:0/169865846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200aa670 con 0x7f25300cc320 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f25354da640 1 -- 172.21.15.37:0/169865846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25200aa7d0 con 0x7f25300cc320 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f25354da640 1 -- 172.21.15.37:0/169865846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25200aab60 con 0x7f25300cc320 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- 172.21.15.37:0/169865846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300cc320 msgr2=0x7f253006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300cc320 0x7f253006efc0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f2520009870 tx=0x7f252001c510 comp rx=0 tx=0).stop 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- 172.21.15.37:0/169865846 shutdown_connections 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300cc320 0x7f253006efc0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- 172.21.15.37:0/169865846 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300af830 0x7f25300afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- 172.21.15.37:0/169865846 >> 172.21.15.37:0/169865846 conn(0x7f25300ca830 msgr2=0x7f25300cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- 172.21.15.37:0/169865846 shutdown_connections 2023-07-09T21:39:48.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- 172.21.15.37:0/169865846 wait complete. 2023-07-09T21:39:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 Processor -- start 2023-07-09T21:39:48.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- start start 2023-07-09T21:39:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cc320 0x7f25300c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300cc770 0x7f25301539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253014ca90 con 0x7f25300af830 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2530152100 con 0x7f25300cc320 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2538740640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253014c5e0 con 0x7f25300cc770 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f25364dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f25364dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54104/0 (socket says 172.21.15.37:54104) 2023-07-09T21:39:48.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f25364dc640 1 -- 172.21.15.37:0/3786292767 learned_addr learned my addr 172.21.15.37:0/3786292767 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2535cdb640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cc320 0x7f25300c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.310+0000 7f2536cdd640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300cc770 0x7f25301539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 -- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300cc770 msgr2=0x7f25301539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300cc770 0x7f25301539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 -- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cc320 msgr2=0x7f25300c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cc320 0x7f25300c2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 -- 172.21.15.37:0/3786292767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25200094d0 con 0x7f25300af830 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f25364dc640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f252c00d800 tx=0x7f252c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00b6c0 con 0x7f25300af830 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c00b820 con 0x7f25300af830 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00bb90 con 0x7f25300af830 2023-07-09T21:39:48.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25301517d0 con 0x7f25300af830 2023-07-09T21:39:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2530151d90 con 0x7f25300af830 2023-07-09T21:39:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253006b550 con 0x7f25300af830 2023-07-09T21:39:48.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f252c00bcf0 con 0x7f25300af830 2023-07-09T21:39:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 0x7f2514068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.314+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f252c084280 con 0x7f25300af830 2023-07-09T21:39:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.318+0000 7f2535cdb640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 0x7f2514068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.318+0000 7f2535cdb640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 0x7f2514068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25200ae000 tx=0x7f25200b5040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.318+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f252c051690 con 0x7f25300af830 2023-07-09T21:39:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f253004d7d0 con 0x7f25300af830 2023-07-09T21:39:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2526ffd640 1 -- 172.21.15.37:0/3786292767 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f252c054cb0 con 0x7f25300af830 2023-07-09T21:39:48.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:48.533 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1063,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":338640896,"bytes_avail":772755472384,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":7881}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":11,"modified":"2023-07-09T21:39:30.870519+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:39:48.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 msgr2=0x7f2514068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 0x7f2514068880 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f25200ae000 tx=0x7f25200b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 msgr2=0x7f25300c2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f252c00d800 tx=0x7f252c00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 shutdown_connections 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f25140663d0 0x7f2514068880 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f25300cc770 0x7f25301539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25300cc320 0x7f25300c2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 --2- 172.21.15.37:0/3786292767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25300af830 0x7f25300c2030 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 >> 172.21.15.37:0/3786292767 conn(0x7f25300ca830 msgr2=0x7f25301531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 shutdown_connections 2023-07-09T21:39:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.526+0000 7f2538740640 1 -- 172.21.15.37:0/3786292767 wait complete. 2023-07-09T21:39:48.551 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:39:48.551 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.734+0000 7fcef9693640 1 Processor -- start 2023-07-09T21:39:48.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.734+0000 7fcef9693640 1 -- start start 2023-07-09T21:39:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef9693640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40b4340 0x7fcef406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef9693640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcef40cef80 0x7fcef40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef9693640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef40b49f0 con 0x7fcef40b7ab0 2023-07-09T21:39:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef9693640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef40b7e80 con 0x7fcef40cef80 2023-07-09T21:39:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef9693640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40cc8a0 con 0x7fcef40b4340 2023-07-09T21:39:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcef40cef80 0x7fcef40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcef40cef80 0x7fcef40d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54114/0 (socket says 172.21.15.37:54114) 2023-07-09T21:39:48.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 -- 172.21.15.37:0/551604171 learned_addr learned my addr 172.21.15.37:0/551604171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:48.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fceebfff640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40b4340 0x7fcef406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 -- 172.21.15.37:0/551604171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40b4340 msgr2=0x7fcef406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:48.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40b4340 0x7fcef406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 -- 172.21.15.37:0/551604171 >> v1:172.21.15.119:6789/0 conn(0x7fcef40b7ab0 legacy=0x7fcef40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 -- 172.21.15.37:0/551604171 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef40ccb80 con 0x7fcef40cef80 2023-07-09T21:39:48.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef37fe640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40cef80 0x7fcef40d02a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fceec009e50 tx=0x7fceec01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ab884f60599087 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef27fc640 1 -- 172.21.15.37:0/551604171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a58a0 con 0x7fcef40cef80 2023-07-09T21:39:48.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef27fc640 1 -- 172.21.15.37:0/551604171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceec0a5a00 con 0x7fcef40cef80 2023-07-09T21:39:48.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.738+0000 7fcef27fc640 1 -- 172.21.15.37:0/551604171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceec0a5d90 con 0x7fcef40cef80 2023-07-09T21:39:48.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- 172.21.15.37:0/551604171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40cef80 msgr2=0x7fcef40d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40cef80 0x7fcef40d02a0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fceec009e50 tx=0x7fceec01c9e0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- 172.21.15.37:0/551604171 shutdown_connections 2023-07-09T21:39:48.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40b4340 0x7fcef406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- 172.21.15.37:0/551604171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40cef80 0x7fcef40d02a0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- 172.21.15.37:0/551604171 >> 172.21.15.37:0/551604171 conn(0x7fcef4073090 msgr2=0x7fcef4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:48.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- 172.21.15.37:0/551604171 shutdown_connections 2023-07-09T21:39:48.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- 172.21.15.37:0/551604171 wait complete. 2023-07-09T21:39:48.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 Processor -- start 2023-07-09T21:39:48.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- start start 2023-07-09T21:39:48.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef40b7ab0 0x7fcef414f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40cef80 0x7fcef40d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40cac90 con 0x7fcef40b4340 2023-07-09T21:39:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40caf70 con 0x7fcef40b7ab0 2023-07-09T21:39:48.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef9693640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef40cb250 con 0x7fcef40cef80 2023-07-09T21:39:48.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54120/0 (socket says 172.21.15.37:54120) 2023-07-09T21:39:48.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 -- 172.21.15.37:0/1806825225 learned_addr learned my addr 172.21.15.37:0/1806825225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:48.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fceebfff640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef40b7ab0 0x7fcef414f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef37fe640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40cef80 0x7fcef40d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 -- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40cef80 msgr2=0x7fcef40d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40cef80 0x7fcef40d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 -- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef40b7ab0 msgr2=0x7fcef414f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef40b7ab0 0x7fcef414f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.742+0000 7fcef2ffd640 1 -- 172.21.15.37:0/1806825225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec009b30 con 0x7fcef40b4340 2023-07-09T21:39:48.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fcef2ffd640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fcee400c500 tx=0x7fcee400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4005220 con 0x7fcef40b4340 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee4005380 con 0x7fcef40b4340 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef40cb530 con 0x7fcef40b4340 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee4007270 con 0x7fcef40b4340 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef40ca940 con 0x7fcef40b4340 2023-07-09T21:39:48.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef404d7d0 con 0x7fcef40b4340 2023-07-09T21:39:48.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcee40073d0 con 0x7fcef40b4340 2023-07-09T21:39:48.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 0x7fced4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:48.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcee4083770 con 0x7fcef40b4340 2023-07-09T21:39:48.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.746+0000 7fceebfff640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 0x7fced4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:48.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.750+0000 7fceebfff640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 0x7fced4068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcef406a3c0 tx=0x7fcedc009190 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:48.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.750+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcee4050a50 con 0x7fcef40b4340 2023-07-09T21:39:48.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.906+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcef40cb0e0 con 0x7fced40663a0 2023-07-09T21:39:48.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fceeb7fe640 1 -- 172.21.15.37:0/1806825225 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311923 (secure 0 0 0) 0x7fcef40cb0e0 con 0x7fced40663a0 2023-07-09T21:39:48.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:48.924 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 msgr2=0x7fced4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 0x7fced4068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcef406a3c0 tx=0x7fcedc009190 comp rx=0 tx=0).stop 2023-07-09T21:39:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 msgr2=0x7fcef40cba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:48.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fcee400c500 tx=0x7fcee400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 shutdown_connections 2023-07-09T21:39:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fced40663a0 0x7fced4068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcef40cef80 0x7fcef40d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcef40b7ab0 0x7fcef414f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 --2- 172.21.15.37:0/1806825225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcef40b4340 0x7fcef40cba50 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 >> 172.21.15.37:0/1806825225 conn(0x7fcef4073090 msgr2=0x7fcef40d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 shutdown_connections 2023-07-09T21:39:48.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:48.918+0000 7fcef9693640 1 -- 172.21.15.37:0/1806825225 wait complete. 2023-07-09T21:39:48.942 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:39:48.874628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330984,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754643736,"statfs":{"total":773094113280,"available":772755185664,"internally_reserved":0,"allocated":12361728,"data_stored":6794124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.655252"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016962+0000","last_change":"2023-07-09T21:39:43.237709+0000","last_active":"2023-07-09T21:39:45.016962+0000","last_peered":"2023-07-09T21:39:45.016962+0000","last_clean":"2023-07-09T21:39:45.016962+0000","last_became_active":"2023-07-09T21:39:43.237390+0000","last_became_peered":"2023-07-09T21:39:43.237390+0000","last_unstale":"2023-07-09T21:39:45.016962+0000","last_undegraded":"2023-07-09T21:39:45.016962+0000","last_fullsized":"2023-07-09T21:39:45.016962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:02.533381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229450+0000","last_change":"2023-07-09T21:39:43.255741+0000","last_active":"2023-07-09T21:39:44.229450+0000","last_peered":"2023-07-09T21:39:44.229450+0000","last_clean":"2023-07-09T21:39:44.229450+0000","last_became_active":"2023-07-09T21:39:43.255377+0000","last_became_peered":"2023-07-09T21:39:43.255377+0000","last_unstale":"2023-07-09T21:39:44.229450+0000","last_undegraded":"2023-07-09T21:39:44.229450+0000","last_fullsized":"2023-07-09T21:39:44.229450+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:22.418235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017074+0000","last_change":"2023-07-09T21:39:43.237635+0000","last_active":"2023-07-09T21:39:45.017074+0000","last_peered":"2023-07-09T21:39:45.017074+0000","last_clean":"2023-07-09T21:39:45.017074+0000","last_became_active":"2023-07-09T21:39:43.237288+0000","last_became_peered":"2023-07-09T21:39:43.237288+0000","last_unstale":"2023-07-09T21:39:45.017074+0000","last_undegraded":"2023-07-09T21:39:45.017074+0000","last_fullsized":"2023-07-09T21:39:45.017074+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:51:12.148225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016899+0000","last_change":"2023-07-09T21:39:43.233943+0000","last_active":"2023-07-09T21:39:45.016899+0000","last_peered":"2023-07-09T21:39:45.016899+0000","last_clean":"2023-07-09T21:39:45.016899+0000","last_became_active":"2023-07-09T21:39:43.233629+0000","last_became_peered":"2023-07-09T21:39:43.233629+0000","last_unstale":"2023-07-09T21:39:45.016899+0000","last_undegraded":"2023-07-09T21:39:45.016899+0000","last_fullsized":"2023-07-09T21:39:45.016899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:47:18.661290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228465+0000","last_change":"2023-07-09T21:39:43.238673+0000","last_active":"2023-07-09T21:39:44.228465+0000","last_peered":"2023-07-09T21:39:44.228465+0000","last_clean":"2023-07-09T21:39:44.228465+0000","last_became_active":"2023-07-09T21:39:43.238348+0000","last_became_peered":"2023-07-09T21:39:43.238348+0000","last_unstale":"2023-07-09T21:39:44.228465+0000","last_undegraded":"2023-07-09T21:39:44.228465+0000","last_fullsized":"2023-07-09T21:39:44.228465+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:55.834580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219524+0000","last_change":"2023-07-09T21:39:43.241522+0000","last_active":"2023-07-09T21:39:44.219524+0000","last_peered":"2023-07-09T21:39:44.219524+0000","last_clean":"2023-07-09T21:39:44.219524+0000","last_became_active":"2023-07-09T21:39:43.241058+0000","last_became_peered":"2023-07-09T21:39:43.241058+0000","last_unstale":"2023-07-09T21:39:44.219524+0000","last_undegraded":"2023-07-09T21:39:44.219524+0000","last_fullsized":"2023-07-09T21:39:44.219524+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:49.438528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022452+0000","last_change":"2023-07-09T21:39:43.256041+0000","last_active":"2023-07-09T21:39:45.022452+0000","last_peered":"2023-07-09T21:39:45.022452+0000","last_clean":"2023-07-09T21:39:45.022452+0000","last_became_active":"2023-07-09T21:39:43.255687+0000","last_became_peered":"2023-07-09T21:39:43.255687+0000","last_unstale":"2023-07-09T21:39:45.022452+0000","last_undegraded":"2023-07-09T21:39:45.022452+0000","last_fullsized":"2023-07-09T21:39:45.022452+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:21.815572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017390+0000","last_change":"2023-07-09T21:39:43.235416+0000","last_active":"2023-07-09T21:39:45.017390+0000","last_peered":"2023-07-09T21:39:45.017390+0000","last_clean":"2023-07-09T21:39:45.017390+0000","last_became_active":"2023-07-09T21:39:43.234733+0000","last_became_peered":"2023-07-09T21:39:43.234733+0000","last_unstale":"2023-07-09T21:39:45.017390+0000","last_undegraded":"2023-07-09T21:39:45.017390+0000","last_fullsized":"2023-07-09T21:39:45.017390+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:05.075221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228491+0000","last_change":"2023-07-09T21:39:43.238204+0000","last_active":"2023-07-09T21:39:44.228491+0000","last_peered":"2023-07-09T21:39:44.228491+0000","last_clean":"2023-07-09T21:39:44.228491+0000","last_became_active":"2023-07-09T21:39:43.237913+0000","last_became_peered":"2023-07-09T21:39:43.237913+0000","last_unstale":"2023-07-09T21:39:44.228491+0000","last_undegraded":"2023-07-09T21:39:44.228491+0000","last_fullsized":"2023-07-09T21:39:44.228491+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:09.736428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881434+0000","last_change":"2023-07-09T21:39:43.238143+0000","last_active":"2023-07-09T21:39:44.881434+0000","last_peered":"2023-07-09T21:39:44.881434+0000","last_clean":"2023-07-09T21:39:44.881434+0000","last_became_active":"2023-07-09T21:39:43.237890+0000","last_became_peered":"2023-07-09T21:39:43.237890+0000","last_unstale":"2023-07-09T21:39:44.881434+0000","last_undegraded":"2023-07-09T21:39:44.881434+0000","last_fullsized":"2023-07-09T21:39:44.881434+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:44.336686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228932+0000","last_change":"2023-07-09T21:39:43.246681+0000","last_active":"2023-07-09T21:39:44.228932+0000","last_peered":"2023-07-09T21:39:44.228932+0000","last_clean":"2023-07-09T21:39:44.228932+0000","last_became_active":"2023-07-09T21:39:43.246334+0000","last_became_peered":"2023-07-09T21:39:43.246334+0000","last_unstale":"2023-07-09T21:39:44.228932+0000","last_undegraded":"2023-07-09T21:39:44.228932+0000","last_fullsized":"2023-07-09T21:39:44.228932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:49:10.068342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881258+0000","last_change":"2023-07-09T21:39:43.249257+0000","last_active":"2023-07-09T21:39:44.881258+0000","last_peered":"2023-07-09T21:39:44.881258+0000","last_clean":"2023-07-09T21:39:44.881258+0000","last_became_active":"2023-07-09T21:39:43.248963+0000","last_became_peered":"2023-07-09T21:39:43.248963+0000","last_unstale":"2023-07-09T21:39:44.881258+0000","last_undegraded":"2023-07-09T21:39:44.881258+0000","last_fullsized":"2023-07-09T21:39:44.881258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:13.930327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017268+0000","last_change":"2023-07-09T21:39:43.237359+0000","last_active":"2023-07-09T21:39:45.017268+0000","last_peered":"2023-07-09T21:39:45.017268+0000","last_clean":"2023-07-09T21:39:45.017268+0000","last_became_active":"2023-07-09T21:39:43.237092+0000","last_became_peered":"2023-07-09T21:39:43.237092+0000","last_unstale":"2023-07-09T21:39:45.017268+0000","last_undegraded":"2023-07-09T21:39:45.017268+0000","last_fullsized":"2023-07-09T21:39:45.017268+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:18:50.879861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228293+0000","last_change":"2023-07-09T21:39:43.248040+0000","last_active":"2023-07-09T21:39:44.228293+0000","last_peered":"2023-07-09T21:39:44.228293+0000","last_clean":"2023-07-09T21:39:44.228293+0000","last_became_active":"2023-07-09T21:39:43.247735+0000","last_became_peered":"2023-07-09T21:39:43.247735+0000","last_unstale":"2023-07-09T21:39:44.228293+0000","last_undegraded":"2023-07-09T21:39:44.228293+0000","last_fullsized":"2023-07-09T21:39:44.228293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:27:04.403041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017087+0000","last_change":"2023-07-09T21:39:43.250975+0000","last_active":"2023-07-09T21:39:45.017087+0000","last_peered":"2023-07-09T21:39:45.017087+0000","last_clean":"2023-07-09T21:39:45.017087+0000","last_became_active":"2023-07-09T21:39:43.250687+0000","last_became_peered":"2023-07-09T21:39:43.250687+0000","last_unstale":"2023-07-09T21:39:45.017087+0000","last_undegraded":"2023-07-09T21:39:45.017087+0000","last_fullsized":"2023-07-09T21:39:45.017087+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:45.440969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219394+0000","last_change":"2023-07-09T21:39:43.253977+0000","last_active":"2023-07-09T21:39:44.219394+0000","last_peered":"2023-07-09T21:39:44.219394+0000","last_clean":"2023-07-09T21:39:44.219394+0000","last_became_active":"2023-07-09T21:39:43.251898+0000","last_became_peered":"2023-07-09T21:39:43.251898+0000","last_unstale":"2023-07-09T21:39:44.219394+0000","last_undegraded":"2023-07-09T21:39:44.219394+0000","last_fullsized":"2023-07-09T21:39:44.219394+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:31.454290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.220070+0000","last_change":"2023-07-09T21:39:43.251047+0000","last_active":"2023-07-09T21:39:44.220070+0000","last_peered":"2023-07-09T21:39:44.220070+0000","last_clean":"2023-07-09T21:39:44.220070+0000","last_became_active":"2023-07-09T21:39:43.250689+0000","last_became_peered":"2023-07-09T21:39:43.250689+0000","last_unstale":"2023-07-09T21:39:44.220070+0000","last_undegraded":"2023-07-09T21:39:44.220070+0000","last_fullsized":"2023-07-09T21:39:44.220070+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:55.934693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017240+0000","last_change":"2023-07-09T21:39:43.249086+0000","last_active":"2023-07-09T21:39:45.017240+0000","last_peered":"2023-07-09T21:39:45.017240+0000","last_clean":"2023-07-09T21:39:45.017240+0000","last_became_active":"2023-07-09T21:39:43.248732+0000","last_became_peered":"2023-07-09T21:39:43.248732+0000","last_unstale":"2023-07-09T21:39:45.017240+0000","last_undegraded":"2023-07-09T21:39:45.017240+0000","last_fullsized":"2023-07-09T21:39:45.017240+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:53.199192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229075+0000","last_change":"2023-07-09T21:39:43.246311+0000","last_active":"2023-07-09T21:39:44.229075+0000","last_peered":"2023-07-09T21:39:44.229075+0000","last_clean":"2023-07-09T21:39:44.229075+0000","last_became_active":"2023-07-09T21:39:43.245945+0000","last_became_peered":"2023-07-09T21:39:43.245945+0000","last_unstale":"2023-07-09T21:39:44.229075+0000","last_undegraded":"2023-07-09T21:39:44.229075+0000","last_fullsized":"2023-07-09T21:39:44.229075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:18.186863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016996+0000","last_change":"2023-07-09T21:39:43.251532+0000","last_active":"2023-07-09T21:39:45.016996+0000","last_peered":"2023-07-09T21:39:45.016996+0000","last_clean":"2023-07-09T21:39:45.016996+0000","last_became_active":"2023-07-09T21:39:43.251261+0000","last_became_peered":"2023-07-09T21:39:43.251261+0000","last_unstale":"2023-07-09T21:39:45.016996+0000","last_undegraded":"2023-07-09T21:39:45.016996+0000","last_fullsized":"2023-07-09T21:39:45.016996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:24.010563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228271+0000","last_change":"2023-07-09T21:39:43.238722+0000","last_active":"2023-07-09T21:39:44.228271+0000","last_peered":"2023-07-09T21:39:44.228271+0000","last_clean":"2023-07-09T21:39:44.228271+0000","last_became_active":"2023-07-09T21:39:43.238407+0000","last_became_peered":"2023-07-09T21:39:43.238407+0000","last_unstale":"2023-07-09T21:39:44.228271+0000","last_undegraded":"2023-07-09T21:39:44.228271+0000","last_fullsized":"2023-07-09T21:39:44.228271+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:13.925480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228301+0000","last_change":"2023-07-09T21:39:43.247578+0000","last_active":"2023-07-09T21:39:44.228301+0000","last_peered":"2023-07-09T21:39:44.228301+0000","last_clean":"2023-07-09T21:39:44.228301+0000","last_became_active":"2023-07-09T21:39:43.247289+0000","last_became_peered":"2023-07-09T21:39:43.247289+0000","last_unstale":"2023-07-09T21:39:44.228301+0000","last_undegraded":"2023-07-09T21:39:44.228301+0000","last_fullsized":"2023-07-09T21:39:44.228301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:11.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022669+0000","last_change":"2023-07-09T21:39:43.244334+0000","last_active":"2023-07-09T21:39:45.022669+0000","last_peered":"2023-07-09T21:39:45.022669+0000","last_clean":"2023-07-09T21:39:45.022669+0000","last_became_active":"2023-07-09T21:39:43.244002+0000","last_became_peered":"2023-07-09T21:39:43.244002+0000","last_unstale":"2023-07-09T21:39:45.022669+0000","last_undegraded":"2023-07-09T21:39:45.022669+0000","last_fullsized":"2023-07-09T21:39:45.022669+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:38:03.681220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016995+0000","last_change":"2023-07-09T21:39:43.248847+0000","last_active":"2023-07-09T21:39:45.016995+0000","last_peered":"2023-07-09T21:39:45.016995+0000","last_clean":"2023-07-09T21:39:45.016995+0000","last_became_active":"2023-07-09T21:39:43.248539+0000","last_became_peered":"2023-07-09T21:39:43.248539+0000","last_unstale":"2023-07-09T21:39:45.016995+0000","last_undegraded":"2023-07-09T21:39:45.016995+0000","last_fullsized":"2023-07-09T21:39:45.016995+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:50.134990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229255+0000","last_change":"2023-07-09T21:39:43.232941+0000","last_active":"2023-07-09T21:39:44.229255+0000","last_peered":"2023-07-09T21:39:44.229255+0000","last_clean":"2023-07-09T21:39:44.229255+0000","last_became_active":"2023-07-09T21:39:43.232622+0000","last_became_peered":"2023-07-09T21:39:43.232622+0000","last_unstale":"2023-07-09T21:39:44.229255+0000","last_undegraded":"2023-07-09T21:39:44.229255+0000","last_fullsized":"2023-07-09T21:39:44.229255+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:30.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228983+0000","last_change":"2023-07-09T21:39:43.247921+0000","last_active":"2023-07-09T21:39:44.228983+0000","last_peered":"2023-07-09T21:39:44.228983+0000","last_clean":"2023-07-09T21:39:44.228983+0000","last_became_active":"2023-07-09T21:39:43.247520+0000","last_became_peered":"2023-07-09T21:39:43.247520+0000","last_unstale":"2023-07-09T21:39:44.228983+0000","last_undegraded":"2023-07-09T21:39:44.228983+0000","last_fullsized":"2023-07-09T21:39:44.228983+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:26:53.507732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881332+0000","last_change":"2023-07-09T21:39:43.232083+0000","last_active":"2023-07-09T21:39:44.881332+0000","last_peered":"2023-07-09T21:39:44.881332+0000","last_clean":"2023-07-09T21:39:44.881332+0000","last_became_active":"2023-07-09T21:39:43.231782+0000","last_became_peered":"2023-07-09T21:39:43.231782+0000","last_unstale":"2023-07-09T21:39:44.881332+0000","last_undegraded":"2023-07-09T21:39:44.881332+0000","last_fullsized":"2023-07-09T21:39:44.881332+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:18:15.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017221+0000","last_change":"2023-07-09T21:39:43.240169+0000","last_active":"2023-07-09T21:39:45.017221+0000","last_peered":"2023-07-09T21:39:45.017221+0000","last_clean":"2023-07-09T21:39:45.017221+0000","last_became_active":"2023-07-09T21:39:43.239840+0000","last_became_peered":"2023-07-09T21:39:43.239840+0000","last_unstale":"2023-07-09T21:39:45.017221+0000","last_undegraded":"2023-07-09T21:39:45.017221+0000","last_fullsized":"2023-07-09T21:39:45.017221+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:00.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022340+0000","last_change":"2023-07-09T21:39:43.240935+0000","last_active":"2023-07-09T21:39:45.022340+0000","last_peered":"2023-07-09T21:39:45.022340+0000","last_clean":"2023-07-09T21:39:45.022340+0000","last_became_active":"2023-07-09T21:39:43.240650+0000","last_became_peered":"2023-07-09T21:39:43.240650+0000","last_unstale":"2023-07-09T21:39:45.022340+0000","last_undegraded":"2023-07-09T21:39:45.022340+0000","last_fullsized":"2023-07-09T21:39:45.022340+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:33:41.134184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228465+0000","last_change":"2023-07-09T21:39:43.237784+0000","last_active":"2023-07-09T21:39:44.228465+0000","last_peered":"2023-07-09T21:39:44.228465+0000","last_clean":"2023-07-09T21:39:44.228465+0000","last_became_active":"2023-07-09T21:39:43.237497+0000","last_became_peered":"2023-07-09T21:39:43.237497+0000","last_unstale":"2023-07-09T21:39:44.228465+0000","last_undegraded":"2023-07-09T21:39:44.228465+0000","last_fullsized":"2023-07-09T21:39:44.228465+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:49.774052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228189+0000","last_change":"2023-07-09T21:39:43.247310+0000","last_active":"2023-07-09T21:39:44.228189+0000","last_peered":"2023-07-09T21:39:44.228189+0000","last_clean":"2023-07-09T21:39:44.228189+0000","last_became_active":"2023-07-09T21:39:43.246994+0000","last_became_peered":"2023-07-09T21:39:43.246994+0000","last_unstale":"2023-07-09T21:39:44.228189+0000","last_undegraded":"2023-07-09T21:39:44.228189+0000","last_fullsized":"2023-07-09T21:39:44.228189+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:11:45.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219470+0000","last_change":"2023-07-09T21:39:43.251975+0000","last_active":"2023-07-09T21:39:44.219470+0000","last_peered":"2023-07-09T21:39:44.219470+0000","last_clean":"2023-07-09T21:39:44.219470+0000","last_became_active":"2023-07-09T21:39:43.251545+0000","last_became_peered":"2023-07-09T21:39:43.251545+0000","last_unstale":"2023-07-09T21:39:44.219470+0000","last_undegraded":"2023-07-09T21:39:44.219470+0000","last_fullsized":"2023-07-09T21:39:44.219470+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:54:36.874604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219664+0000","last_change":"2023-07-09T21:39:43.234627+0000","last_active":"2023-07-09T21:39:44.219664+0000","last_peered":"2023-07-09T21:39:44.219664+0000","last_clean":"2023-07-09T21:39:44.219664+0000","last_became_active":"2023-07-09T21:39:43.234162+0000","last_became_peered":"2023-07-09T21:39:43.234162+0000","last_unstale":"2023-07-09T21:39:44.219664+0000","last_undegraded":"2023-07-09T21:39:44.219664+0000","last_fullsized":"2023-07-09T21:39:44.219664+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:01.939074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"112'4","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022931+0000","last_change":"2023-07-09T21:39:42.244780+0000","last_active":"2023-07-09T21:39:45.022931+0000","last_peered":"2023-07-09T21:39:45.022931+0000","last_clean":"2023-07-09T21:39:45.022931+0000","last_became_active":"2023-07-09T21:39:42.244462+0000","last_became_peered":"2023-07-09T21:39:42.244462+0000","last_unstale":"2023-07-09T21:39:45.022931+0000","last_undegraded":"2023-07-09T21:39:45.022931+0000","last_fullsized":"2023-07-09T21:39:45.022931+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:55.936777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219884+0000","last_change":"2023-07-09T21:39:43.234797+0000","last_active":"2023-07-09T21:39:44.219884+0000","last_peered":"2023-07-09T21:39:44.219884+0000","last_clean":"2023-07-09T21:39:44.219884+0000","last_became_active":"2023-07-09T21:39:43.234317+0000","last_became_peered":"2023-07-09T21:39:43.234317+0000","last_unstale":"2023-07-09T21:39:44.219884+0000","last_undegraded":"2023-07-09T21:39:44.219884+0000","last_fullsized":"2023-07-09T21:39:44.219884+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:19.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229144+0000","last_change":"2023-07-09T21:39:42.236524+0000","last_active":"2023-07-09T21:39:44.229144+0000","last_peered":"2023-07-09T21:39:44.229144+0000","last_clean":"2023-07-09T21:39:44.229144+0000","last_became_active":"2023-07-09T21:39:42.236106+0000","last_became_peered":"2023-07-09T21:39:42.236106+0000","last_unstale":"2023-07-09T21:39:44.229144+0000","last_undegraded":"2023-07-09T21:39:44.229144+0000","last_fullsized":"2023-07-09T21:39:44.229144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:36:00.281061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022391+0000","last_change":"2023-07-09T21:39:43.250327+0000","last_active":"2023-07-09T21:39:45.022391+0000","last_peered":"2023-07-09T21:39:45.022391+0000","last_clean":"2023-07-09T21:39:45.022391+0000","last_became_active":"2023-07-09T21:39:43.249969+0000","last_became_peered":"2023-07-09T21:39:43.249969+0000","last_unstale":"2023-07-09T21:39:45.022391+0000","last_undegraded":"2023-07-09T21:39:45.022391+0000","last_fullsized":"2023-07-09T21:39:45.022391+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:31.131303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022861+0000","last_change":"2023-07-09T21:39:42.240015+0000","last_active":"2023-07-09T21:39:45.022861+0000","last_peered":"2023-07-09T21:39:45.022861+0000","last_clean":"2023-07-09T21:39:45.022861+0000","last_became_active":"2023-07-09T21:39:42.239692+0000","last_became_peered":"2023-07-09T21:39:42.239692+0000","last_unstale":"2023-07-09T21:39:45.022861+0000","last_undegraded":"2023-07-09T21:39:45.022861+0000","last_fullsized":"2023-07-09T21:39:45.022861+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:13.170451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.220116+0000","last_change":"2023-07-09T21:39:43.232600+0000","last_active":"2023-07-09T21:39:44.220116+0000","last_peered":"2023-07-09T21:39:44.220116+0000","last_clean":"2023-07-09T21:39:44.220116+0000","last_became_active":"2023-07-09T21:39:43.232330+0000","last_became_peered":"2023-07-09T21:39:43.232330+0000","last_unstale":"2023-07-09T21:39:44.220116+0000","last_undegraded":"2023-07-09T21:39:44.220116+0000","last_fullsized":"2023-07-09T21:39:44.220116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:09:10.079268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022672+0000","last_change":"2023-07-09T21:39:42.240133+0000","last_active":"2023-07-09T21:39:45.022672+0000","last_peered":"2023-07-09T21:39:45.022672+0000","last_clean":"2023-07-09T21:39:45.022672+0000","last_became_active":"2023-07-09T21:39:42.239809+0000","last_became_peered":"2023-07-09T21:39:42.239809+0000","last_unstale":"2023-07-09T21:39:45.022672+0000","last_undegraded":"2023-07-09T21:39:45.022672+0000","last_fullsized":"2023-07-09T21:39:45.022672+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:41.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016894+0000","last_change":"2023-07-09T21:39:43.251574+0000","last_active":"2023-07-09T21:39:45.016894+0000","last_peered":"2023-07-09T21:39:45.016894+0000","last_clean":"2023-07-09T21:39:45.016894+0000","last_became_active":"2023-07-09T21:39:43.251247+0000","last_became_peered":"2023-07-09T21:39:43.251247+0000","last_unstale":"2023-07-09T21:39:45.016894+0000","last_undegraded":"2023-07-09T21:39:45.016894+0000","last_fullsized":"2023-07-09T21:39:45.016894+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:27.280135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228612+0000","last_change":"2023-07-09T21:39:42.232268+0000","last_active":"2023-07-09T21:39:44.228612+0000","last_peered":"2023-07-09T21:39:44.228612+0000","last_clean":"2023-07-09T21:39:44.228612+0000","last_became_active":"2023-07-09T21:39:42.231985+0000","last_became_peered":"2023-07-09T21:39:42.231985+0000","last_unstale":"2023-07-09T21:39:44.228612+0000","last_undegraded":"2023-07-09T21:39:44.228612+0000","last_fullsized":"2023-07-09T21:39:44.228612+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:40.688727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022657+0000","last_change":"2023-07-09T21:39:43.243276+0000","last_active":"2023-07-09T21:39:45.022657+0000","last_peered":"2023-07-09T21:39:45.022657+0000","last_clean":"2023-07-09T21:39:45.022657+0000","last_became_active":"2023-07-09T21:39:43.242979+0000","last_became_peered":"2023-07-09T21:39:43.242979+0000","last_unstale":"2023-07-09T21:39:45.022657+0000","last_undegraded":"2023-07-09T21:39:45.022657+0000","last_fullsized":"2023-07-09T21:39:45.022657+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:22:38.223877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017861+0000","last_change":"2023-07-09T21:39:42.229864+0000","last_active":"2023-07-09T21:39:45.017861+0000","last_peered":"2023-07-09T21:39:45.017861+0000","last_clean":"2023-07-09T21:39:45.017861+0000","last_became_active":"2023-07-09T21:39:42.229579+0000","last_became_peered":"2023-07-09T21:39:42.229579+0000","last_unstale":"2023-07-09T21:39:45.017861+0000","last_undegraded":"2023-07-09T21:39:45.017861+0000","last_fullsized":"2023-07-09T21:39:45.017861+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:56.473783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219429+0000","last_change":"2023-07-09T21:39:43.241318+0000","last_active":"2023-07-09T21:39:44.219429+0000","last_peered":"2023-07-09T21:39:44.219429+0000","last_clean":"2023-07-09T21:39:44.219429+0000","last_became_active":"2023-07-09T21:39:43.240699+0000","last_became_peered":"2023-07-09T21:39:43.240699+0000","last_unstale":"2023-07-09T21:39:44.219429+0000","last_undegraded":"2023-07-09T21:39:44.219429+0000","last_fullsized":"2023-07-09T21:39:44.219429+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:59.637000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016731+0000","last_change":"2023-07-09T21:39:42.230843+0000","last_active":"2023-07-09T21:39:45.016731+0000","last_peered":"2023-07-09T21:39:45.016731+0000","last_clean":"2023-07-09T21:39:45.016731+0000","last_became_active":"2023-07-09T21:39:42.230544+0000","last_became_peered":"2023-07-09T21:39:42.230544+0000","last_unstale":"2023-07-09T21:39:45.016731+0000","last_undegraded":"2023-07-09T21:39:45.016731+0000","last_fullsized":"2023-07-09T21:39:45.016731+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:10.264521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017266+0000","last_change":"2023-07-09T21:39:43.233167+0000","last_active":"2023-07-09T21:39:45.017266+0000","last_peered":"2023-07-09T21:39:45.017266+0000","last_clean":"2023-07-09T21:39:45.017266+0000","last_became_active":"2023-07-09T21:39:43.232864+0000","last_became_peered":"2023-07-09T21:39:43.232864+0000","last_unstale":"2023-07-09T21:39:45.017266+0000","last_undegraded":"2023-07-09T21:39:45.017266+0000","last_fullsized":"2023-07-09T21:39:45.017266+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:00:58.699242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022070+0000","last_change":"2023-07-09T21:39:42.244876+0000","last_active":"2023-07-09T21:39:45.022070+0000","last_peered":"2023-07-09T21:39:45.022070+0000","last_clean":"2023-07-09T21:39:45.022070+0000","last_became_active":"2023-07-09T21:39:42.244551+0000","last_became_peered":"2023-07-09T21:39:42.244551+0000","last_unstale":"2023-07-09T21:39:45.022070+0000","last_undegraded":"2023-07-09T21:39:45.022070+0000","last_fullsized":"2023-07-09T21:39:45.022070+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:49.755719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228644+0000","last_change":"2023-07-09T21:39:43.257003+0000","last_active":"2023-07-09T21:39:44.228644+0000","last_peered":"2023-07-09T21:39:44.228644+0000","last_clean":"2023-07-09T21:39:44.228644+0000","last_became_active":"2023-07-09T21:39:43.254621+0000","last_became_peered":"2023-07-09T21:39:43.254621+0000","last_unstale":"2023-07-09T21:39:44.228644+0000","last_undegraded":"2023-07-09T21:39:44.228644+0000","last_fullsized":"2023-07-09T21:39:44.228644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:39.877537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229502+0000","last_change":"2023-07-09T21:39:42.233682+0000","last_active":"2023-07-09T21:39:44.229502+0000","last_peered":"2023-07-09T21:39:44.229502+0000","last_clean":"2023-07-09T21:39:44.229502+0000","last_became_active":"2023-07-09T21:39:42.233399+0000","last_became_peered":"2023-07-09T21:39:42.233399+0000","last_unstale":"2023-07-09T21:39:44.229502+0000","last_undegraded":"2023-07-09T21:39:44.229502+0000","last_fullsized":"2023-07-09T21:39:44.229502+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:34:20.303219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022963+0000","last_change":"2023-07-09T21:39:43.241300+0000","last_active":"2023-07-09T21:39:45.022963+0000","last_peered":"2023-07-09T21:39:45.022963+0000","last_clean":"2023-07-09T21:39:45.022963+0000","last_became_active":"2023-07-09T21:39:43.241033+0000","last_became_peered":"2023-07-09T21:39:43.241033+0000","last_unstale":"2023-07-09T21:39:45.022963+0000","last_undegraded":"2023-07-09T21:39:45.022963+0000","last_fullsized":"2023-07-09T21:39:45.022963+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:46.262581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017368+0000","last_change":"2023-07-09T21:39:42.237809+0000","last_active":"2023-07-09T21:39:45.017368+0000","last_peered":"2023-07-09T21:39:45.017368+0000","last_clean":"2023-07-09T21:39:45.017368+0000","last_became_active":"2023-07-09T21:39:42.237410+0000","last_became_peered":"2023-07-09T21:39:42.237410+0000","last_unstale":"2023-07-09T21:39:45.017368+0000","last_undegraded":"2023-07-09T21:39:45.017368+0000","last_fullsized":"2023-07-09T21:39:45.017368+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:26.271878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017261+0000","last_change":"2023-07-09T21:39:43.240890+0000","last_active":"2023-07-09T21:39:45.017261+0000","last_peered":"2023-07-09T21:39:45.017261+0000","last_clean":"2023-07-09T21:39:45.017261+0000","last_became_active":"2023-07-09T21:39:43.240587+0000","last_became_peered":"2023-07-09T21:39:43.240587+0000","last_unstale":"2023-07-09T21:39:45.017261+0000","last_undegraded":"2023-07-09T21:39:45.017261+0000","last_fullsized":"2023-07-09T21:39:45.017261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:47:18.661290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"112'3","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229295+0000","last_change":"2023-07-09T21:39:42.244755+0000","last_active":"2023-07-09T21:39:44.229295+0000","last_peered":"2023-07-09T21:39:44.229295+0000","last_clean":"2023-07-09T21:39:44.229295+0000","last_became_active":"2023-07-09T21:39:42.244416+0000","last_became_peered":"2023-07-09T21:39:42.244416+0000","last_unstale":"2023-07-09T21:39:44.229295+0000","last_undegraded":"2023-07-09T21:39:44.229295+0000","last_fullsized":"2023-07-09T21:39:44.229295+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:15.068631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017871+0000","last_change":"2023-07-09T21:39:43.237004+0000","last_active":"2023-07-09T21:39:45.017871+0000","last_peered":"2023-07-09T21:39:45.017871+0000","last_clean":"2023-07-09T21:39:45.017871+0000","last_became_active":"2023-07-09T21:39:43.235538+0000","last_became_peered":"2023-07-09T21:39:43.235538+0000","last_unstale":"2023-07-09T21:39:45.017871+0000","last_undegraded":"2023-07-09T21:39:45.017871+0000","last_fullsized":"2023-07-09T21:39:45.017871+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:11.046624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'6","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219790+0000","last_change":"2023-07-09T21:39:42.227954+0000","last_active":"2023-07-09T21:39:44.219790+0000","last_peered":"2023-07-09T21:39:44.219790+0000","last_clean":"2023-07-09T21:39:44.219790+0000","last_became_active":"2023-07-09T21:39:42.227639+0000","last_became_peered":"2023-07-09T21:39:42.227639+0000","last_unstale":"2023-07-09T21:39:44.219790+0000","last_undegraded":"2023-07-09T21:39:44.219790+0000","last_fullsized":"2023-07-09T21:39:44.219790+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:32:20.240701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017062+0000","last_change":"2023-07-09T21:39:43.236823+0000","last_active":"2023-07-09T21:39:45.017062+0000","last_peered":"2023-07-09T21:39:45.017062+0000","last_clean":"2023-07-09T21:39:45.017062+0000","last_became_active":"2023-07-09T21:39:43.235081+0000","last_became_peered":"2023-07-09T21:39:43.235081+0000","last_unstale":"2023-07-09T21:39:45.017062+0000","last_undegraded":"2023-07-09T21:39:45.017062+0000","last_fullsized":"2023-07-09T21:39:45.017062+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:46.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022361+0000","last_change":"2023-07-09T21:39:42.245324+0000","last_active":"2023-07-09T21:39:45.022361+0000","last_peered":"2023-07-09T21:39:45.022361+0000","last_clean":"2023-07-09T21:39:45.022361+0000","last_became_active":"2023-07-09T21:39:42.244983+0000","last_became_peered":"2023-07-09T21:39:42.244983+0000","last_unstale":"2023-07-09T21:39:45.022361+0000","last_undegraded":"2023-07-09T21:39:45.022361+0000","last_fullsized":"2023-07-09T21:39:45.022361+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228136+0000","last_change":"2023-07-09T21:39:43.238940+0000","last_active":"2023-07-09T21:39:44.228136+0000","last_peered":"2023-07-09T21:39:44.228136+0000","last_clean":"2023-07-09T21:39:44.228136+0000","last_became_active":"2023-07-09T21:39:43.238569+0000","last_became_peered":"2023-07-09T21:39:43.238569+0000","last_unstale":"2023-07-09T21:39:44.228136+0000","last_undegraded":"2023-07-09T21:39:44.228136+0000","last_fullsized":"2023-07-09T21:39:44.228136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:34.230332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219555+0000","last_change":"2023-07-09T21:39:42.230619+0000","last_active":"2023-07-09T21:39:44.219555+0000","last_peered":"2023-07-09T21:39:44.219555+0000","last_clean":"2023-07-09T21:39:44.219555+0000","last_became_active":"2023-07-09T21:39:42.228042+0000","last_became_peered":"2023-07-09T21:39:42.228042+0000","last_unstale":"2023-07-09T21:39:44.219555+0000","last_undegraded":"2023-07-09T21:39:44.219555+0000","last_fullsized":"2023-07-09T21:39:44.219555+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:52.362799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881051+0000","last_change":"2023-07-09T21:39:43.240988+0000","last_active":"2023-07-09T21:39:44.881051+0000","last_peered":"2023-07-09T21:39:44.881051+0000","last_clean":"2023-07-09T21:39:44.881051+0000","last_became_active":"2023-07-09T21:39:43.240695+0000","last_became_peered":"2023-07-09T21:39:43.240695+0000","last_unstale":"2023-07-09T21:39:44.881051+0000","last_undegraded":"2023-07-09T21:39:44.881051+0000","last_fullsized":"2023-07-09T21:39:44.881051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:08.072485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017495+0000","last_change":"2023-07-09T21:39:42.231175+0000","last_active":"2023-07-09T21:39:45.017495+0000","last_peered":"2023-07-09T21:39:45.017495+0000","last_clean":"2023-07-09T21:39:45.017495+0000","last_became_active":"2023-07-09T21:39:42.230911+0000","last_became_peered":"2023-07-09T21:39:42.230911+0000","last_unstale":"2023-07-09T21:39:45.017495+0000","last_undegraded":"2023-07-09T21:39:45.017495+0000","last_fullsized":"2023-07-09T21:39:45.017495+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:30.849292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881299+0000","last_change":"2023-07-09T21:39:43.233717+0000","last_active":"2023-07-09T21:39:44.881299+0000","last_peered":"2023-07-09T21:39:44.881299+0000","last_clean":"2023-07-09T21:39:44.881299+0000","last_became_active":"2023-07-09T21:39:43.233422+0000","last_became_peered":"2023-07-09T21:39:43.233422+0000","last_unstale":"2023-07-09T21:39:44.881299+0000","last_undegraded":"2023-07-09T21:39:44.881299+0000","last_fullsized":"2023-07-09T21:39:44.881299+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:36:27.160889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'8","reported_seq":21,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017218+0000","last_change":"2023-07-09T21:39:42.233317+0000","last_active":"2023-07-09T21:39:45.017218+0000","last_peered":"2023-07-09T21:39:45.017218+0000","last_clean":"2023-07-09T21:39:45.017218+0000","last_became_active":"2023-07-09T21:39:42.233048+0000","last_became_peered":"2023-07-09T21:39:42.233048+0000","last_unstale":"2023-07-09T21:39:45.017218+0000","last_undegraded":"2023-07-09T21:39:45.017218+0000","last_fullsized":"2023-07-09T21:39:45.017218+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:15.099956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022494+0000","last_change":"2023-07-09T21:39:43.237326+0000","last_active":"2023-07-09T21:39:45.022494+0000","last_peered":"2023-07-09T21:39:45.022494+0000","last_clean":"2023-07-09T21:39:45.022494+0000","last_became_active":"2023-07-09T21:39:43.237006+0000","last_became_peered":"2023-07-09T21:39:43.237006+0000","last_unstale":"2023-07-09T21:39:45.022494+0000","last_undegraded":"2023-07-09T21:39:45.022494+0000","last_fullsized":"2023-07-09T21:39:45.022494+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:27:11.409848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022607+0000","last_change":"2023-07-09T21:39:42.238834+0000","last_active":"2023-07-09T21:39:45.022607+0000","last_peered":"2023-07-09T21:39:45.022607+0000","last_clean":"2023-07-09T21:39:45.022607+0000","last_became_active":"2023-07-09T21:39:42.238523+0000","last_became_peered":"2023-07-09T21:39:42.238523+0000","last_unstale":"2023-07-09T21:39:45.022607+0000","last_undegraded":"2023-07-09T21:39:45.022607+0000","last_fullsized":"2023-07-09T21:39:45.022607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.848840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219947+0000","last_change":"2023-07-09T21:39:43.234589+0000","last_active":"2023-07-09T21:39:44.219947+0000","last_peered":"2023-07-09T21:39:44.219947+0000","last_clean":"2023-07-09T21:39:44.219947+0000","last_became_active":"2023-07-09T21:39:43.234019+0000","last_became_peered":"2023-07-09T21:39:43.234019+0000","last_unstale":"2023-07-09T21:39:44.219947+0000","last_undegraded":"2023-07-09T21:39:44.219947+0000","last_fullsized":"2023-07-09T21:39:44.219947+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:40:41.363837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"113'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229246+0000","last_change":"2023-07-09T21:39:42.235742+0000","last_active":"2023-07-09T21:39:44.229246+0000","last_peered":"2023-07-09T21:39:44.229246+0000","last_clean":"2023-07-09T21:39:44.229246+0000","last_became_active":"2023-07-09T21:39:42.235449+0000","last_became_peered":"2023-07-09T21:39:42.235449+0000","last_unstale":"2023-07-09T21:39:44.229246+0000","last_undegraded":"2023-07-09T21:39:44.229246+0000","last_fullsized":"2023-07-09T21:39:44.229246+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.331324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219856+0000","last_change":"2023-07-09T21:39:43.231810+0000","last_active":"2023-07-09T21:39:44.219856+0000","last_peered":"2023-07-09T21:39:44.219856+0000","last_clean":"2023-07-09T21:39:44.219856+0000","last_became_active":"2023-07-09T21:39:43.231537+0000","last_became_peered":"2023-07-09T21:39:43.231537+0000","last_unstale":"2023-07-09T21:39:44.219856+0000","last_undegraded":"2023-07-09T21:39:44.219856+0000","last_fullsized":"2023-07-09T21:39:44.219856+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:00.030355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229520+0000","last_change":"2023-07-09T21:39:42.244672+0000","last_active":"2023-07-09T21:39:44.229520+0000","last_peered":"2023-07-09T21:39:44.229520+0000","last_clean":"2023-07-09T21:39:44.229520+0000","last_became_active":"2023-07-09T21:39:42.244373+0000","last_became_peered":"2023-07-09T21:39:42.244373+0000","last_unstale":"2023-07-09T21:39:44.229520+0000","last_undegraded":"2023-07-09T21:39:44.229520+0000","last_fullsized":"2023-07-09T21:39:44.229520+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:24.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229385+0000","last_change":"2023-07-09T21:39:43.237520+0000","last_active":"2023-07-09T21:39:44.229385+0000","last_peered":"2023-07-09T21:39:44.229385+0000","last_clean":"2023-07-09T21:39:44.229385+0000","last_became_active":"2023-07-09T21:39:43.237250+0000","last_became_peered":"2023-07-09T21:39:43.237250+0000","last_unstale":"2023-07-09T21:39:44.229385+0000","last_undegraded":"2023-07-09T21:39:44.229385+0000","last_fullsized":"2023-07-09T21:39:44.229385+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:47.210573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022820+0000","last_change":"2023-07-09T21:39:42.234762+0000","last_active":"2023-07-09T21:39:45.022820+0000","last_peered":"2023-07-09T21:39:45.022820+0000","last_clean":"2023-07-09T21:39:45.022820+0000","last_became_active":"2023-07-09T21:39:42.234479+0000","last_became_peered":"2023-07-09T21:39:42.234479+0000","last_unstale":"2023-07-09T21:39:45.022820+0000","last_undegraded":"2023-07-09T21:39:45.022820+0000","last_fullsized":"2023-07-09T21:39:45.022820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:24.214088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.880995+0000","last_change":"2023-07-09T21:39:43.232518+0000","last_active":"2023-07-09T21:39:44.880995+0000","last_peered":"2023-07-09T21:39:44.880995+0000","last_clean":"2023-07-09T21:39:44.880995+0000","last_became_active":"2023-07-09T21:39:43.232114+0000","last_became_peered":"2023-07-09T21:39:43.232114+0000","last_unstale":"2023-07-09T21:39:44.880995+0000","last_undegraded":"2023-07-09T21:39:44.880995+0000","last_fullsized":"2023-07-09T21:39:44.880995+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:31.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219998+0000","last_change":"2023-07-09T21:39:42.232385+0000","last_active":"2023-07-09T21:39:44.219998+0000","last_peered":"2023-07-09T21:39:44.219998+0000","last_clean":"2023-07-09T21:39:44.219998+0000","last_became_active":"2023-07-09T21:39:42.231546+0000","last_became_peered":"2023-07-09T21:39:42.231546+0000","last_unstale":"2023-07-09T21:39:44.219998+0000","last_undegraded":"2023-07-09T21:39:44.219998+0000","last_fullsized":"2023-07-09T21:39:44.219998+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:55:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016545+0000","last_change":"2023-07-09T21:39:43.242211+0000","last_active":"2023-07-09T21:39:45.016545+0000","last_peered":"2023-07-09T21:39:45.016545+0000","last_clean":"2023-07-09T21:39:45.016545+0000","last_became_active":"2023-07-09T21:39:43.241875+0000","last_became_peered":"2023-07-09T21:39:43.241875+0000","last_unstale":"2023-07-09T21:39:45.016545+0000","last_undegraded":"2023-07-09T21:39:45.016545+0000","last_fullsized":"2023-07-09T21:39:45.016545+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:25.381192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228672+0000","last_change":"2023-07-09T21:39:42.236910+0000","last_active":"2023-07-09T21:39:44.228672+0000","last_peered":"2023-07-09T21:39:44.228672+0000","last_clean":"2023-07-09T21:39:44.228672+0000","last_became_active":"2023-07-09T21:39:42.236606+0000","last_became_peered":"2023-07-09T21:39:42.236606+0000","last_unstale":"2023-07-09T21:39:44.228672+0000","last_undegraded":"2023-07-09T21:39:44.228672+0000","last_fullsized":"2023-07-09T21:39:44.228672+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:07.622123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022178+0000","last_change":"2023-07-09T21:39:43.241841+0000","last_active":"2023-07-09T21:39:45.022178+0000","last_peered":"2023-07-09T21:39:45.022178+0000","last_clean":"2023-07-09T21:39:45.022178+0000","last_became_active":"2023-07-09T21:39:43.241373+0000","last_became_peered":"2023-07-09T21:39:43.241373+0000","last_unstale":"2023-07-09T21:39:45.022178+0000","last_undegraded":"2023-07-09T21:39:45.022178+0000","last_fullsized":"2023-07-09T21:39:45.022178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:26.451944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022834+0000","last_change":"2023-07-09T21:39:42.238711+0000","last_active":"2023-07-09T21:39:45.022834+0000","last_peered":"2023-07-09T21:39:45.022834+0000","last_clean":"2023-07-09T21:39:45.022834+0000","last_became_active":"2023-07-09T21:39:42.238400+0000","last_became_peered":"2023-07-09T21:39:42.238400+0000","last_unstale":"2023-07-09T21:39:45.022834+0000","last_undegraded":"2023-07-09T21:39:45.022834+0000","last_fullsized":"2023-07-09T21:39:45.022834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:43.093438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219875+0000","last_change":"2023-07-09T21:39:43.251032+0000","last_active":"2023-07-09T21:39:44.219875+0000","last_peered":"2023-07-09T21:39:44.219875+0000","last_clean":"2023-07-09T21:39:44.219875+0000","last_became_active":"2023-07-09T21:39:43.250738+0000","last_became_peered":"2023-07-09T21:39:43.250738+0000","last_unstale":"2023-07-09T21:39:44.219875+0000","last_undegraded":"2023-07-09T21:39:44.219875+0000","last_fullsized":"2023-07-09T21:39:44.219875+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:58.305064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022117+0000","last_change":"2023-07-09T21:39:42.239328+0000","last_active":"2023-07-09T21:39:45.022117+0000","last_peered":"2023-07-09T21:39:45.022117+0000","last_clean":"2023-07-09T21:39:45.022117+0000","last_became_active":"2023-07-09T21:39:42.239048+0000","last_became_peered":"2023-07-09T21:39:42.239048+0000","last_unstale":"2023-07-09T21:39:45.022117+0000","last_undegraded":"2023-07-09T21:39:45.022117+0000","last_fullsized":"2023-07-09T21:39:45.022117+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:49:20.710488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022715+0000","last_change":"2023-07-09T21:39:43.256625+0000","last_active":"2023-07-09T21:39:45.022715+0000","last_peered":"2023-07-09T21:39:45.022715+0000","last_clean":"2023-07-09T21:39:45.022715+0000","last_became_active":"2023-07-09T21:39:43.255808+0000","last_became_peered":"2023-07-09T21:39:43.255808+0000","last_unstale":"2023-07-09T21:39:45.022715+0000","last_undegraded":"2023-07-09T21:39:45.022715+0000","last_fullsized":"2023-07-09T21:39:45.022715+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:16.104208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017371+0000","last_change":"2023-07-09T21:39:42.235946+0000","last_active":"2023-07-09T21:39:45.017371+0000","last_peered":"2023-07-09T21:39:45.017371+0000","last_clean":"2023-07-09T21:39:45.017371+0000","last_became_active":"2023-07-09T21:39:42.235643+0000","last_became_peered":"2023-07-09T21:39:42.235643+0000","last_unstale":"2023-07-09T21:39:45.017371+0000","last_undegraded":"2023-07-09T21:39:45.017371+0000","last_fullsized":"2023-07-09T21:39:45.017371+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:21:53.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"101'205","reported_seq":653,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022357+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:45.022357+0000","last_peered":"2023-07-09T21:39:45.022357+0000","last_clean":"2023-07-09T21:39:45.022357+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:45.022357+0000","last_undegraded":"2023-07-09T21:39:45.022357+0000","last_fullsized":"2023-07-09T21:39:45.022357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:27:49.064781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228799+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:44.228799+0000","last_peered":"2023-07-09T21:39:44.228799+0000","last_clean":"2023-07-09T21:39:44.228799+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:44.228799+0000","last_undegraded":"2023-07-09T21:39:44.228799+0000","last_fullsized":"2023-07-09T21:39:44.228799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:57.387793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219706+0000","last_change":"2023-07-09T21:39:43.234437+0000","last_active":"2023-07-09T21:39:44.219706+0000","last_peered":"2023-07-09T21:39:44.219706+0000","last_clean":"2023-07-09T21:39:44.219706+0000","last_became_active":"2023-07-09T21:39:43.233792+0000","last_became_peered":"2023-07-09T21:39:43.233792+0000","last_unstale":"2023-07-09T21:39:44.219706+0000","last_undegraded":"2023-07-09T21:39:44.219706+0000","last_fullsized":"2023-07-09T21:39:44.219706+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:06:31.186502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022919+0000","last_change":"2023-07-09T21:39:42.238970+0000","last_active":"2023-07-09T21:39:45.022919+0000","last_peered":"2023-07-09T21:39:45.022919+0000","last_clean":"2023-07-09T21:39:45.022919+0000","last_became_active":"2023-07-09T21:39:42.237884+0000","last_became_peered":"2023-07-09T21:39:42.237884+0000","last_unstale":"2023-07-09T21:39:45.022919+0000","last_undegraded":"2023-07-09T21:39:45.022919+0000","last_fullsized":"2023-07-09T21:39:45.022919+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:00.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022269+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:45.022269+0000","last_peered":"2023-07-09T21:39:45.022269+0000","last_clean":"2023-07-09T21:39:45.022269+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:45.022269+0000","last_undegraded":"2023-07-09T21:39:45.022269+0000","last_fullsized":"2023-07-09T21:39:45.022269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:15.116607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022688+0000","last_change":"2023-07-09T21:39:43.229047+0000","last_active":"2023-07-09T21:39:45.022688+0000","last_peered":"2023-07-09T21:39:45.022688+0000","last_clean":"2023-07-09T21:39:45.022688+0000","last_became_active":"2023-07-09T21:39:43.228760+0000","last_became_peered":"2023-07-09T21:39:43.228760+0000","last_unstale":"2023-07-09T21:39:45.022688+0000","last_undegraded":"2023-07-09T21:39:45.022688+0000","last_fullsized":"2023-07-09T21:39:45.022688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:06:13.319912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022809+0000","last_change":"2023-07-09T21:39:42.241874+0000","last_active":"2023-07-09T21:39:45.022809+0000","last_peered":"2023-07-09T21:39:45.022809+0000","last_clean":"2023-07-09T21:39:45.022809+0000","last_became_active":"2023-07-09T21:39:42.241590+0000","last_became_peered":"2023-07-09T21:39:42.241590+0000","last_unstale":"2023-07-09T21:39:45.022809+0000","last_undegraded":"2023-07-09T21:39:45.022809+0000","last_fullsized":"2023-07-09T21:39:45.022809+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:44.947865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.880981+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:44.880981+0000","last_peered":"2023-07-09T21:39:44.880981+0000","last_clean":"2023-07-09T21:39:44.880981+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:44.880981+0000","last_undegraded":"2023-07-09T21:39:44.880981+0000","last_fullsized":"2023-07-09T21:39:44.880981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:12.931201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229059+0000","last_change":"2023-07-09T21:39:43.238915+0000","last_active":"2023-07-09T21:39:44.229059+0000","last_peered":"2023-07-09T21:39:44.229059+0000","last_clean":"2023-07-09T21:39:44.229059+0000","last_became_active":"2023-07-09T21:39:43.238265+0000","last_became_peered":"2023-07-09T21:39:43.238265+0000","last_unstale":"2023-07-09T21:39:44.229059+0000","last_undegraded":"2023-07-09T21:39:44.229059+0000","last_fullsized":"2023-07-09T21:39:44.229059+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:18.237395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229408+0000","last_change":"2023-07-09T21:39:42.240044+0000","last_active":"2023-07-09T21:39:44.229408+0000","last_peered":"2023-07-09T21:39:44.229408+0000","last_clean":"2023-07-09T21:39:44.229408+0000","last_became_active":"2023-07-09T21:39:42.239664+0000","last_became_peered":"2023-07-09T21:39:42.239664+0000","last_unstale":"2023-07-09T21:39:44.229408+0000","last_undegraded":"2023-07-09T21:39:44.229408+0000","last_fullsized":"2023-07-09T21:39:44.229408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:41.399231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228773+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:44.228773+0000","last_peered":"2023-07-09T21:39:44.228773+0000","last_clean":"2023-07-09T21:39:44.228773+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:44.228773+0000","last_undegraded":"2023-07-09T21:39:44.228773+0000","last_fullsized":"2023-07-09T21:39:44.228773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:12.868784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219548+0000","last_change":"2023-07-09T21:39:43.230750+0000","last_active":"2023-07-09T21:39:44.219548+0000","last_peered":"2023-07-09T21:39:44.219548+0000","last_clean":"2023-07-09T21:39:44.219548+0000","last_became_active":"2023-07-09T21:39:43.230459+0000","last_became_peered":"2023-07-09T21:39:43.230459+0000","last_unstale":"2023-07-09T21:39:44.219548+0000","last_undegraded":"2023-07-09T21:39:44.219548+0000","last_fullsized":"2023-07-09T21:39:44.219548+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:08.314071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228705+0000","last_change":"2023-07-09T21:39:42.237844+0000","last_active":"2023-07-09T21:39:44.228705+0000","last_peered":"2023-07-09T21:39:44.228705+0000","last_clean":"2023-07-09T21:39:44.228705+0000","last_became_active":"2023-07-09T21:39:42.237413+0000","last_became_peered":"2023-07-09T21:39:42.237413+0000","last_unstale":"2023-07-09T21:39:44.228705+0000","last_undegraded":"2023-07-09T21:39:44.228705+0000","last_fullsized":"2023-07-09T21:39:44.228705+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:21.829803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017551+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:45.017551+0000","last_peered":"2023-07-09T21:39:45.017551+0000","last_clean":"2023-07-09T21:39:45.017551+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:45.017551+0000","last_undegraded":"2023-07-09T21:39:45.017551+0000","last_fullsized":"2023-07-09T21:39:45.017551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:44.083591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228225+0000","last_change":"2023-07-09T21:39:43.255389+0000","last_active":"2023-07-09T21:39:44.228225+0000","last_peered":"2023-07-09T21:39:44.228225+0000","last_clean":"2023-07-09T21:39:44.228225+0000","last_became_active":"2023-07-09T21:39:43.255065+0000","last_became_peered":"2023-07-09T21:39:43.255065+0000","last_unstale":"2023-07-09T21:39:44.228225+0000","last_undegraded":"2023-07-09T21:39:44.228225+0000","last_fullsized":"2023-07-09T21:39:44.228225+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:30.700717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881100+0000","last_change":"2023-07-09T21:39:42.233837+0000","last_active":"2023-07-09T21:39:44.881100+0000","last_peered":"2023-07-09T21:39:44.881100+0000","last_clean":"2023-07-09T21:39:44.881100+0000","last_became_active":"2023-07-09T21:39:42.233428+0000","last_became_peered":"2023-07-09T21:39:42.233428+0000","last_unstale":"2023-07-09T21:39:44.881100+0000","last_undegraded":"2023-07-09T21:39:44.881100+0000","last_fullsized":"2023-07-09T21:39:44.881100+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:30.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022965+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:45.022965+0000","last_peered":"2023-07-09T21:39:45.022965+0000","last_clean":"2023-07-09T21:39:45.022965+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:45.022965+0000","last_undegraded":"2023-07-09T21:39:45.022965+0000","last_fullsized":"2023-07-09T21:39:45.022965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:40.558834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228642+0000","last_change":"2023-07-09T21:39:43.244142+0000","last_active":"2023-07-09T21:39:44.228642+0000","last_peered":"2023-07-09T21:39:44.228642+0000","last_clean":"2023-07-09T21:39:44.228642+0000","last_became_active":"2023-07-09T21:39:43.243813+0000","last_became_peered":"2023-07-09T21:39:43.243813+0000","last_unstale":"2023-07-09T21:39:44.228642+0000","last_undegraded":"2023-07-09T21:39:44.228642+0000","last_fullsized":"2023-07-09T21:39:44.228642+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:22.110352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228352+0000","last_change":"2023-07-09T21:39:42.241936+0000","last_active":"2023-07-09T21:39:44.228352+0000","last_peered":"2023-07-09T21:39:44.228352+0000","last_clean":"2023-07-09T21:39:44.228352+0000","last_became_active":"2023-07-09T21:39:42.241566+0000","last_became_peered":"2023-07-09T21:39:42.241566+0000","last_unstale":"2023-07-09T21:39:44.228352+0000","last_undegraded":"2023-07-09T21:39:44.228352+0000","last_fullsized":"2023-07-09T21:39:44.228352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:54.072313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017878+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:45.017878+0000","last_peered":"2023-07-09T21:39:45.017878+0000","last_clean":"2023-07-09T21:39:45.017878+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:45.017878+0000","last_undegraded":"2023-07-09T21:39:45.017878+0000","last_fullsized":"2023-07-09T21:39:45.017878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:22.964889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219752+0000","last_change":"2023-07-09T21:39:43.237351+0000","last_active":"2023-07-09T21:39:44.219752+0000","last_peered":"2023-07-09T21:39:44.219752+0000","last_clean":"2023-07-09T21:39:44.219752+0000","last_became_active":"2023-07-09T21:39:43.236242+0000","last_became_peered":"2023-07-09T21:39:43.236242+0000","last_unstale":"2023-07-09T21:39:44.219752+0000","last_undegraded":"2023-07-09T21:39:44.219752+0000","last_fullsized":"2023-07-09T21:39:44.219752+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:43.025815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881066+0000","last_change":"2023-07-09T21:39:42.228204+0000","last_active":"2023-07-09T21:39:44.881066+0000","last_peered":"2023-07-09T21:39:44.881066+0000","last_clean":"2023-07-09T21:39:44.881066+0000","last_became_active":"2023-07-09T21:39:42.227935+0000","last_became_peered":"2023-07-09T21:39:42.227935+0000","last_unstale":"2023-07-09T21:39:44.881066+0000","last_undegraded":"2023-07-09T21:39:44.881066+0000","last_fullsized":"2023-07-09T21:39:44.881066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:46.538349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.023042+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:45.023042+0000","last_peered":"2023-07-09T21:39:45.023042+0000","last_clean":"2023-07-09T21:39:45.023042+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:45.023042+0000","last_undegraded":"2023-07-09T21:39:45.023042+0000","last_fullsized":"2023-07-09T21:39:45.023042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:05:48.872843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575058,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312608,"statfs":{"total":96636764160,"available":96576110592,"internally_reserved":0,"allocated":1990656,"data_stored":1291507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.82799999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.626},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1409024,"data_stored":703251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.871}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.879}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50452,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321388,"statfs":{"total":96636764160,"available":96585101312,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.64400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.747}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68400000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575058,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1396736,"data_stored":701243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.58399999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575057,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.88600000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85599999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.435}]},{"osd":1,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":0.98899999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1419999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.752}]},{"osd":5,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.82499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.006,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98599999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.879}]},{"osd":6,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.56399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93799999999999994,"5min":1.51,"15min":1.51},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95299999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1,"5min":1.1100000000000001,"15min":1.159},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54548,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317292,"statfs":{"total":96636764160,"available":96580907008,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59299999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.432},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.872}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":701153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.32700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.69299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":2007040,"data_stored":1293721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.496},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.002}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1830000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.133},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.048},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:51.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:39:52.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 Processor -- start 2023-07-09T21:39:52.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 -- start start 2023-07-09T21:39:52.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c680c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680cd080 con 0x7f5c681600b0 2023-07-09T21:39:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680cd920 con 0x7f5c680aff40 2023-07-09T21:39:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6fcec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680ca2f0 con 0x7f5c6815fce0 2023-07-09T21:39:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6d287640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5c681600b0 0x7f5c680af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40470/0 (socket says 172.21.15.37:40470) 2023-07-09T21:39:52.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6d287640 1 -- 172.21.15.37:0/1788601422 learned_addr learned my addr 172.21.15.37:0/1788601422 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:52.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6da88640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c680c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713431480 0 0) 0x7f5c680cd080 con 0x7f5c681600b0 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.106+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c54003530 con 0x7f5c681600b0 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4178647325 0 0) 0x7f5c54003530 con 0x7f5c681600b0 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 msgr2=0x7f5c680c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c680c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 >> v1:172.21.15.119:6789/0 conn(0x7f5c680aff40 legacy=0x7f5c68070490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680cd2d0 con 0x7f5c681600b0 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f5c58001680 con 0x7f5c681600b0 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 >> v1:172.21.15.37:6789/0 conn(0x7f5c681600b0 legacy=0x7f5c680af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c540039b0 0x7f5c54003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c540047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c54004d10 0x7f5c54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680ca2f0 con 0x7f5c540039b0 2023-07-09T21:39:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5400ba40 con 0x7f5c54004d10 2023-07-09T21:39:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c5400bbd0 con 0x7f5c6815fce0 2023-07-09T21:39:52.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c540039b0 0x7f5c54003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6d287640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c540047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6e289640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c54004d10 0x7f5c54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 -- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 msgr2=0x7f5c540047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c6815fce0 0x7f5c540047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 -- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c54004d10 msgr2=0x7f5c54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c54004d10 0x7f5c54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 -- 172.21.15.37:0/1788601422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c54003530 con 0x7f5c540039b0 2023-07-09T21:39:52.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.110+0000 7f5c6da88640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c540039b0 0x7f5c54003d80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009ae0 tx=0x7f5c6401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb07a9bcfc3b056 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640a5610 con 0x7f5c540039b0 2023-07-09T21:39:52.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c640a5770 con 0x7f5c540039b0 2023-07-09T21:39:52.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6ca86640 1 -- 172.21.15.37:0/1788601422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c640a5b20 con 0x7f5c540039b0 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- 172.21.15.37:0/1788601422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c540039b0 msgr2=0x7f5c54003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/1788601422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c540039b0 0x7f5c54003d80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5c64009ae0 tx=0x7f5c6401ca20 comp rx=0 tx=0).stop 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6e289640 1 -- 172.21.15.37:0/1788601422 reap_dead start 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- 172.21.15.37:0/1788601422 shutdown_connections 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- 172.21.15.37:0/1788601422 >> 172.21.15.37:0/1788601422 conn(0x7f5c680ca830 msgr2=0x7f5c680cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:52.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- 172.21.15.37:0/1788601422 shutdown_connections 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- 172.21.15.37:0/1788601422 wait complete. 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 Processor -- start 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- start start 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c540039b0 0x7f5c680c18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c680c6b30 0x7f5c680b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680b3b30 con 0x7f5c6814ee50 2023-07-09T21:39:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6815e780 con 0x7f5c680c6b30 2023-07-09T21:39:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6fcec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c680c5db0 con 0x7f5c540039b0 2023-07-09T21:39:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.114+0000 7f5c6e289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54136/0 (socket says 172.21.15.37:54136) 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 -- 172.21.15.37:0/2561414067 learned_addr learned my addr 172.21.15.37:0/2561414067 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6da88640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c540039b0 0x7f5c680c18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6d287640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c680c6b30 0x7f5c680b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 -- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c540039b0 msgr2=0x7f5c680c18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c540039b0 0x7f5c680c18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 -- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c680c6b30 msgr2=0x7f5c680b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c680c6b30 0x7f5c680b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 -- 172.21.15.37:0/2561414067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680c1ec0 con 0x7f5c6814ee50 2023-07-09T21:39:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6e289640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5c680b0310 tx=0x7f5c6000e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c6000eda0 con 0x7f5c6814ee50 2023-07-09T21:39:52.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c600039d0 con 0x7f5c6814ee50 2023-07-09T21:39:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c680c6050 con 0x7f5c6814ee50 2023-07-09T21:39:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c60003dc0 con 0x7f5c6814ee50 2023-07-09T21:39:52.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c680c6610 con 0x7f5c6814ee50 2023-07-09T21:39:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6804d7d0 con 0x7f5c6814ee50 2023-07-09T21:39:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5c60005070 con 0x7f5c6814ee50 2023-07-09T21:39:52.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.118+0000 7f5c5e7fc640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 0x7f5c4c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.122+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5c600831e0 con 0x7f5c6814ee50 2023-07-09T21:39:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.122+0000 7f5c6da88640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 0x7f5c4c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.122+0000 7f5c6da88640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 0x7f5c4c068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c640af000 tx=0x7f5c640046d0 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.122+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c600504d0 con 0x7f5c6814ee50 2023-07-09T21:39:52.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.274+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c680c9a30 con 0x7f5c4c0663d0 2023-07-09T21:39:52.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.286+0000 7f5c5e7fc640 1 -- 172.21.15.37:0/2561414067 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311923 (secure 0 0 0) 0x7f5c640bd090 con 0x7f5c4c0663d0 2023-07-09T21:39:52.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:52.292 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:39:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 msgr2=0x7f5c4c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 0x7f5c4c068880 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c640af000 tx=0x7f5c640046d0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 msgr2=0x7f5c6814f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f5c680b0310 tx=0x7f5c6000e7c0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 shutdown_connections 2023-07-09T21:39:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f5c4c0663d0 0x7f5c4c068880 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c6814ee50 0x7f5c6814f2c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c680c6b30 0x7f5c680b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 --2- 172.21.15.37:0/2561414067 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c540039b0 0x7f5c680c18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 >> 172.21.15.37:0/2561414067 conn(0x7f5c680ca830 msgr2=0x7f5c6815f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 shutdown_connections 2023-07-09T21:39:52.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.290+0000 7f5c6fcec640 1 -- 172.21.15.37:0/2561414067 wait complete. 2023-07-09T21:39:52.313 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:39:50.875320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":364,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":244,"ondisk_log_size":244,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":330984,"kb_used_data":12072,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754643736,"statfs":{"total":773094113280,"available":772755185664,"internally_reserved":0,"allocated":12361728,"data_stored":6794124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002238"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016962+0000","last_change":"2023-07-09T21:39:43.237709+0000","last_active":"2023-07-09T21:39:45.016962+0000","last_peered":"2023-07-09T21:39:45.016962+0000","last_clean":"2023-07-09T21:39:45.016962+0000","last_became_active":"2023-07-09T21:39:43.237390+0000","last_became_peered":"2023-07-09T21:39:43.237390+0000","last_unstale":"2023-07-09T21:39:45.016962+0000","last_undegraded":"2023-07-09T21:39:45.016962+0000","last_fullsized":"2023-07-09T21:39:45.016962+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:58:02.533381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229450+0000","last_change":"2023-07-09T21:39:43.255741+0000","last_active":"2023-07-09T21:39:44.229450+0000","last_peered":"2023-07-09T21:39:44.229450+0000","last_clean":"2023-07-09T21:39:44.229450+0000","last_became_active":"2023-07-09T21:39:43.255377+0000","last_became_peered":"2023-07-09T21:39:43.255377+0000","last_unstale":"2023-07-09T21:39:44.229450+0000","last_undegraded":"2023-07-09T21:39:44.229450+0000","last_fullsized":"2023-07-09T21:39:44.229450+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:57:22.418235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017074+0000","last_change":"2023-07-09T21:39:43.237635+0000","last_active":"2023-07-09T21:39:45.017074+0000","last_peered":"2023-07-09T21:39:45.017074+0000","last_clean":"2023-07-09T21:39:45.017074+0000","last_became_active":"2023-07-09T21:39:43.237288+0000","last_became_peered":"2023-07-09T21:39:43.237288+0000","last_unstale":"2023-07-09T21:39:45.017074+0000","last_undegraded":"2023-07-09T21:39:45.017074+0000","last_fullsized":"2023-07-09T21:39:45.017074+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:51:12.148225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016899+0000","last_change":"2023-07-09T21:39:43.233943+0000","last_active":"2023-07-09T21:39:45.016899+0000","last_peered":"2023-07-09T21:39:45.016899+0000","last_clean":"2023-07-09T21:39:45.016899+0000","last_became_active":"2023-07-09T21:39:43.233629+0000","last_became_peered":"2023-07-09T21:39:43.233629+0000","last_unstale":"2023-07-09T21:39:45.016899+0000","last_undegraded":"2023-07-09T21:39:45.016899+0000","last_fullsized":"2023-07-09T21:39:45.016899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:47:18.661290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228465+0000","last_change":"2023-07-09T21:39:43.238673+0000","last_active":"2023-07-09T21:39:44.228465+0000","last_peered":"2023-07-09T21:39:44.228465+0000","last_clean":"2023-07-09T21:39:44.228465+0000","last_became_active":"2023-07-09T21:39:43.238348+0000","last_became_peered":"2023-07-09T21:39:43.238348+0000","last_unstale":"2023-07-09T21:39:44.228465+0000","last_undegraded":"2023-07-09T21:39:44.228465+0000","last_fullsized":"2023-07-09T21:39:44.228465+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:43:55.834580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219524+0000","last_change":"2023-07-09T21:39:43.241522+0000","last_active":"2023-07-09T21:39:44.219524+0000","last_peered":"2023-07-09T21:39:44.219524+0000","last_clean":"2023-07-09T21:39:44.219524+0000","last_became_active":"2023-07-09T21:39:43.241058+0000","last_became_peered":"2023-07-09T21:39:43.241058+0000","last_unstale":"2023-07-09T21:39:44.219524+0000","last_undegraded":"2023-07-09T21:39:44.219524+0000","last_fullsized":"2023-07-09T21:39:44.219524+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:49.438528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022452+0000","last_change":"2023-07-09T21:39:43.256041+0000","last_active":"2023-07-09T21:39:45.022452+0000","last_peered":"2023-07-09T21:39:45.022452+0000","last_clean":"2023-07-09T21:39:45.022452+0000","last_became_active":"2023-07-09T21:39:43.255687+0000","last_became_peered":"2023-07-09T21:39:43.255687+0000","last_unstale":"2023-07-09T21:39:45.022452+0000","last_undegraded":"2023-07-09T21:39:45.022452+0000","last_fullsized":"2023-07-09T21:39:45.022452+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:21.815572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017390+0000","last_change":"2023-07-09T21:39:43.235416+0000","last_active":"2023-07-09T21:39:45.017390+0000","last_peered":"2023-07-09T21:39:45.017390+0000","last_clean":"2023-07-09T21:39:45.017390+0000","last_became_active":"2023-07-09T21:39:43.234733+0000","last_became_peered":"2023-07-09T21:39:43.234733+0000","last_unstale":"2023-07-09T21:39:45.017390+0000","last_undegraded":"2023-07-09T21:39:45.017390+0000","last_fullsized":"2023-07-09T21:39:45.017390+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:05.075221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228491+0000","last_change":"2023-07-09T21:39:43.238204+0000","last_active":"2023-07-09T21:39:44.228491+0000","last_peered":"2023-07-09T21:39:44.228491+0000","last_clean":"2023-07-09T21:39:44.228491+0000","last_became_active":"2023-07-09T21:39:43.237913+0000","last_became_peered":"2023-07-09T21:39:43.237913+0000","last_unstale":"2023-07-09T21:39:44.228491+0000","last_undegraded":"2023-07-09T21:39:44.228491+0000","last_fullsized":"2023-07-09T21:39:44.228491+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:09.736428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881434+0000","last_change":"2023-07-09T21:39:43.238143+0000","last_active":"2023-07-09T21:39:44.881434+0000","last_peered":"2023-07-09T21:39:44.881434+0000","last_clean":"2023-07-09T21:39:44.881434+0000","last_became_active":"2023-07-09T21:39:43.237890+0000","last_became_peered":"2023-07-09T21:39:43.237890+0000","last_unstale":"2023-07-09T21:39:44.881434+0000","last_undegraded":"2023-07-09T21:39:44.881434+0000","last_fullsized":"2023-07-09T21:39:44.881434+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:44.336686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228932+0000","last_change":"2023-07-09T21:39:43.246681+0000","last_active":"2023-07-09T21:39:44.228932+0000","last_peered":"2023-07-09T21:39:44.228932+0000","last_clean":"2023-07-09T21:39:44.228932+0000","last_became_active":"2023-07-09T21:39:43.246334+0000","last_became_peered":"2023-07-09T21:39:43.246334+0000","last_unstale":"2023-07-09T21:39:44.228932+0000","last_undegraded":"2023-07-09T21:39:44.228932+0000","last_fullsized":"2023-07-09T21:39:44.228932+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:49:10.068342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881258+0000","last_change":"2023-07-09T21:39:43.249257+0000","last_active":"2023-07-09T21:39:44.881258+0000","last_peered":"2023-07-09T21:39:44.881258+0000","last_clean":"2023-07-09T21:39:44.881258+0000","last_became_active":"2023-07-09T21:39:43.248963+0000","last_became_peered":"2023-07-09T21:39:43.248963+0000","last_unstale":"2023-07-09T21:39:44.881258+0000","last_undegraded":"2023-07-09T21:39:44.881258+0000","last_fullsized":"2023-07-09T21:39:44.881258+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:13.930327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017268+0000","last_change":"2023-07-09T21:39:43.237359+0000","last_active":"2023-07-09T21:39:45.017268+0000","last_peered":"2023-07-09T21:39:45.017268+0000","last_clean":"2023-07-09T21:39:45.017268+0000","last_became_active":"2023-07-09T21:39:43.237092+0000","last_became_peered":"2023-07-09T21:39:43.237092+0000","last_unstale":"2023-07-09T21:39:45.017268+0000","last_undegraded":"2023-07-09T21:39:45.017268+0000","last_fullsized":"2023-07-09T21:39:45.017268+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:18:50.879861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228293+0000","last_change":"2023-07-09T21:39:43.248040+0000","last_active":"2023-07-09T21:39:44.228293+0000","last_peered":"2023-07-09T21:39:44.228293+0000","last_clean":"2023-07-09T21:39:44.228293+0000","last_became_active":"2023-07-09T21:39:43.247735+0000","last_became_peered":"2023-07-09T21:39:43.247735+0000","last_unstale":"2023-07-09T21:39:44.228293+0000","last_undegraded":"2023-07-09T21:39:44.228293+0000","last_fullsized":"2023-07-09T21:39:44.228293+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:27:04.403041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017087+0000","last_change":"2023-07-09T21:39:43.250975+0000","last_active":"2023-07-09T21:39:45.017087+0000","last_peered":"2023-07-09T21:39:45.017087+0000","last_clean":"2023-07-09T21:39:45.017087+0000","last_became_active":"2023-07-09T21:39:43.250687+0000","last_became_peered":"2023-07-09T21:39:43.250687+0000","last_unstale":"2023-07-09T21:39:45.017087+0000","last_undegraded":"2023-07-09T21:39:45.017087+0000","last_fullsized":"2023-07-09T21:39:45.017087+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:45.440969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219394+0000","last_change":"2023-07-09T21:39:43.253977+0000","last_active":"2023-07-09T21:39:44.219394+0000","last_peered":"2023-07-09T21:39:44.219394+0000","last_clean":"2023-07-09T21:39:44.219394+0000","last_became_active":"2023-07-09T21:39:43.251898+0000","last_became_peered":"2023-07-09T21:39:43.251898+0000","last_unstale":"2023-07-09T21:39:44.219394+0000","last_undegraded":"2023-07-09T21:39:44.219394+0000","last_fullsized":"2023-07-09T21:39:44.219394+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:31.454290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.220070+0000","last_change":"2023-07-09T21:39:43.251047+0000","last_active":"2023-07-09T21:39:44.220070+0000","last_peered":"2023-07-09T21:39:44.220070+0000","last_clean":"2023-07-09T21:39:44.220070+0000","last_became_active":"2023-07-09T21:39:43.250689+0000","last_became_peered":"2023-07-09T21:39:43.250689+0000","last_unstale":"2023-07-09T21:39:44.220070+0000","last_undegraded":"2023-07-09T21:39:44.220070+0000","last_fullsized":"2023-07-09T21:39:44.220070+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:55.934693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017240+0000","last_change":"2023-07-09T21:39:43.249086+0000","last_active":"2023-07-09T21:39:45.017240+0000","last_peered":"2023-07-09T21:39:45.017240+0000","last_clean":"2023-07-09T21:39:45.017240+0000","last_became_active":"2023-07-09T21:39:43.248732+0000","last_became_peered":"2023-07-09T21:39:43.248732+0000","last_unstale":"2023-07-09T21:39:45.017240+0000","last_undegraded":"2023-07-09T21:39:45.017240+0000","last_fullsized":"2023-07-09T21:39:45.017240+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:53.199192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229075+0000","last_change":"2023-07-09T21:39:43.246311+0000","last_active":"2023-07-09T21:39:44.229075+0000","last_peered":"2023-07-09T21:39:44.229075+0000","last_clean":"2023-07-09T21:39:44.229075+0000","last_became_active":"2023-07-09T21:39:43.245945+0000","last_became_peered":"2023-07-09T21:39:43.245945+0000","last_unstale":"2023-07-09T21:39:44.229075+0000","last_undegraded":"2023-07-09T21:39:44.229075+0000","last_fullsized":"2023-07-09T21:39:44.229075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:18.186863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016996+0000","last_change":"2023-07-09T21:39:43.251532+0000","last_active":"2023-07-09T21:39:45.016996+0000","last_peered":"2023-07-09T21:39:45.016996+0000","last_clean":"2023-07-09T21:39:45.016996+0000","last_became_active":"2023-07-09T21:39:43.251261+0000","last_became_peered":"2023-07-09T21:39:43.251261+0000","last_unstale":"2023-07-09T21:39:45.016996+0000","last_undegraded":"2023-07-09T21:39:45.016996+0000","last_fullsized":"2023-07-09T21:39:45.016996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:01:24.010563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228271+0000","last_change":"2023-07-09T21:39:43.238722+0000","last_active":"2023-07-09T21:39:44.228271+0000","last_peered":"2023-07-09T21:39:44.228271+0000","last_clean":"2023-07-09T21:39:44.228271+0000","last_became_active":"2023-07-09T21:39:43.238407+0000","last_became_peered":"2023-07-09T21:39:43.238407+0000","last_unstale":"2023-07-09T21:39:44.228271+0000","last_undegraded":"2023-07-09T21:39:44.228271+0000","last_fullsized":"2023-07-09T21:39:44.228271+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:13.925480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228301+0000","last_change":"2023-07-09T21:39:43.247578+0000","last_active":"2023-07-09T21:39:44.228301+0000","last_peered":"2023-07-09T21:39:44.228301+0000","last_clean":"2023-07-09T21:39:44.228301+0000","last_became_active":"2023-07-09T21:39:43.247289+0000","last_became_peered":"2023-07-09T21:39:43.247289+0000","last_unstale":"2023-07-09T21:39:44.228301+0000","last_undegraded":"2023-07-09T21:39:44.228301+0000","last_fullsized":"2023-07-09T21:39:44.228301+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:47:11.089607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022669+0000","last_change":"2023-07-09T21:39:43.244334+0000","last_active":"2023-07-09T21:39:45.022669+0000","last_peered":"2023-07-09T21:39:45.022669+0000","last_clean":"2023-07-09T21:39:45.022669+0000","last_became_active":"2023-07-09T21:39:43.244002+0000","last_became_peered":"2023-07-09T21:39:43.244002+0000","last_unstale":"2023-07-09T21:39:45.022669+0000","last_undegraded":"2023-07-09T21:39:45.022669+0000","last_fullsized":"2023-07-09T21:39:45.022669+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:38:03.681220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016995+0000","last_change":"2023-07-09T21:39:43.248847+0000","last_active":"2023-07-09T21:39:45.016995+0000","last_peered":"2023-07-09T21:39:45.016995+0000","last_clean":"2023-07-09T21:39:45.016995+0000","last_became_active":"2023-07-09T21:39:43.248539+0000","last_became_peered":"2023-07-09T21:39:43.248539+0000","last_unstale":"2023-07-09T21:39:45.016995+0000","last_undegraded":"2023-07-09T21:39:45.016995+0000","last_fullsized":"2023-07-09T21:39:45.016995+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:50.134990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229255+0000","last_change":"2023-07-09T21:39:43.232941+0000","last_active":"2023-07-09T21:39:44.229255+0000","last_peered":"2023-07-09T21:39:44.229255+0000","last_clean":"2023-07-09T21:39:44.229255+0000","last_became_active":"2023-07-09T21:39:43.232622+0000","last_became_peered":"2023-07-09T21:39:43.232622+0000","last_unstale":"2023-07-09T21:39:44.229255+0000","last_undegraded":"2023-07-09T21:39:44.229255+0000","last_fullsized":"2023-07-09T21:39:44.229255+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:30.122905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228983+0000","last_change":"2023-07-09T21:39:43.247921+0000","last_active":"2023-07-09T21:39:44.228983+0000","last_peered":"2023-07-09T21:39:44.228983+0000","last_clean":"2023-07-09T21:39:44.228983+0000","last_became_active":"2023-07-09T21:39:43.247520+0000","last_became_peered":"2023-07-09T21:39:43.247520+0000","last_unstale":"2023-07-09T21:39:44.228983+0000","last_undegraded":"2023-07-09T21:39:44.228983+0000","last_fullsized":"2023-07-09T21:39:44.228983+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:26:53.507732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881332+0000","last_change":"2023-07-09T21:39:43.232083+0000","last_active":"2023-07-09T21:39:44.881332+0000","last_peered":"2023-07-09T21:39:44.881332+0000","last_clean":"2023-07-09T21:39:44.881332+0000","last_became_active":"2023-07-09T21:39:43.231782+0000","last_became_peered":"2023-07-09T21:39:43.231782+0000","last_unstale":"2023-07-09T21:39:44.881332+0000","last_undegraded":"2023-07-09T21:39:44.881332+0000","last_fullsized":"2023-07-09T21:39:44.881332+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:18:15.216231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017221+0000","last_change":"2023-07-09T21:39:43.240169+0000","last_active":"2023-07-09T21:39:45.017221+0000","last_peered":"2023-07-09T21:39:45.017221+0000","last_clean":"2023-07-09T21:39:45.017221+0000","last_became_active":"2023-07-09T21:39:43.239840+0000","last_became_peered":"2023-07-09T21:39:43.239840+0000","last_unstale":"2023-07-09T21:39:45.017221+0000","last_undegraded":"2023-07-09T21:39:45.017221+0000","last_fullsized":"2023-07-09T21:39:45.017221+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:00.187048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022340+0000","last_change":"2023-07-09T21:39:43.240935+0000","last_active":"2023-07-09T21:39:45.022340+0000","last_peered":"2023-07-09T21:39:45.022340+0000","last_clean":"2023-07-09T21:39:45.022340+0000","last_became_active":"2023-07-09T21:39:43.240650+0000","last_became_peered":"2023-07-09T21:39:43.240650+0000","last_unstale":"2023-07-09T21:39:45.022340+0000","last_undegraded":"2023-07-09T21:39:45.022340+0000","last_fullsized":"2023-07-09T21:39:45.022340+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:33:41.134184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228465+0000","last_change":"2023-07-09T21:39:43.237784+0000","last_active":"2023-07-09T21:39:44.228465+0000","last_peered":"2023-07-09T21:39:44.228465+0000","last_clean":"2023-07-09T21:39:44.228465+0000","last_became_active":"2023-07-09T21:39:43.237497+0000","last_became_peered":"2023-07-09T21:39:43.237497+0000","last_unstale":"2023-07-09T21:39:44.228465+0000","last_undegraded":"2023-07-09T21:39:44.228465+0000","last_fullsized":"2023-07-09T21:39:44.228465+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:18:49.774052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228189+0000","last_change":"2023-07-09T21:39:43.247310+0000","last_active":"2023-07-09T21:39:44.228189+0000","last_peered":"2023-07-09T21:39:44.228189+0000","last_clean":"2023-07-09T21:39:44.228189+0000","last_became_active":"2023-07-09T21:39:43.246994+0000","last_became_peered":"2023-07-09T21:39:43.246994+0000","last_unstale":"2023-07-09T21:39:44.228189+0000","last_undegraded":"2023-07-09T21:39:44.228189+0000","last_fullsized":"2023-07-09T21:39:44.228189+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:11:45.869924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219470+0000","last_change":"2023-07-09T21:39:43.251975+0000","last_active":"2023-07-09T21:39:44.219470+0000","last_peered":"2023-07-09T21:39:44.219470+0000","last_clean":"2023-07-09T21:39:44.219470+0000","last_became_active":"2023-07-09T21:39:43.251545+0000","last_became_peered":"2023-07-09T21:39:43.251545+0000","last_unstale":"2023-07-09T21:39:44.219470+0000","last_undegraded":"2023-07-09T21:39:44.219470+0000","last_fullsized":"2023-07-09T21:39:44.219470+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:54:36.874604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219664+0000","last_change":"2023-07-09T21:39:43.234627+0000","last_active":"2023-07-09T21:39:44.219664+0000","last_peered":"2023-07-09T21:39:44.219664+0000","last_clean":"2023-07-09T21:39:44.219664+0000","last_became_active":"2023-07-09T21:39:43.234162+0000","last_became_peered":"2023-07-09T21:39:43.234162+0000","last_unstale":"2023-07-09T21:39:44.219664+0000","last_undegraded":"2023-07-09T21:39:44.219664+0000","last_fullsized":"2023-07-09T21:39:44.219664+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:23:01.939074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"112'4","reported_seq":17,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022931+0000","last_change":"2023-07-09T21:39:42.244780+0000","last_active":"2023-07-09T21:39:45.022931+0000","last_peered":"2023-07-09T21:39:45.022931+0000","last_clean":"2023-07-09T21:39:45.022931+0000","last_became_active":"2023-07-09T21:39:42.244462+0000","last_became_peered":"2023-07-09T21:39:42.244462+0000","last_unstale":"2023-07-09T21:39:45.022931+0000","last_undegraded":"2023-07-09T21:39:45.022931+0000","last_fullsized":"2023-07-09T21:39:45.022931+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:55.936777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219884+0000","last_change":"2023-07-09T21:39:43.234797+0000","last_active":"2023-07-09T21:39:44.219884+0000","last_peered":"2023-07-09T21:39:44.219884+0000","last_clean":"2023-07-09T21:39:44.219884+0000","last_became_active":"2023-07-09T21:39:43.234317+0000","last_became_peered":"2023-07-09T21:39:43.234317+0000","last_unstale":"2023-07-09T21:39:44.219884+0000","last_undegraded":"2023-07-09T21:39:44.219884+0000","last_fullsized":"2023-07-09T21:39:44.219884+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:19.440139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229144+0000","last_change":"2023-07-09T21:39:42.236524+0000","last_active":"2023-07-09T21:39:44.229144+0000","last_peered":"2023-07-09T21:39:44.229144+0000","last_clean":"2023-07-09T21:39:44.229144+0000","last_became_active":"2023-07-09T21:39:42.236106+0000","last_became_peered":"2023-07-09T21:39:42.236106+0000","last_unstale":"2023-07-09T21:39:44.229144+0000","last_undegraded":"2023-07-09T21:39:44.229144+0000","last_fullsized":"2023-07-09T21:39:44.229144+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:36:00.281061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022391+0000","last_change":"2023-07-09T21:39:43.250327+0000","last_active":"2023-07-09T21:39:45.022391+0000","last_peered":"2023-07-09T21:39:45.022391+0000","last_clean":"2023-07-09T21:39:45.022391+0000","last_became_active":"2023-07-09T21:39:43.249969+0000","last_became_peered":"2023-07-09T21:39:43.249969+0000","last_unstale":"2023-07-09T21:39:45.022391+0000","last_undegraded":"2023-07-09T21:39:45.022391+0000","last_fullsized":"2023-07-09T21:39:45.022391+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:31.131303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022861+0000","last_change":"2023-07-09T21:39:42.240015+0000","last_active":"2023-07-09T21:39:45.022861+0000","last_peered":"2023-07-09T21:39:45.022861+0000","last_clean":"2023-07-09T21:39:45.022861+0000","last_became_active":"2023-07-09T21:39:42.239692+0000","last_became_peered":"2023-07-09T21:39:42.239692+0000","last_unstale":"2023-07-09T21:39:45.022861+0000","last_undegraded":"2023-07-09T21:39:45.022861+0000","last_fullsized":"2023-07-09T21:39:45.022861+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:13.170451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.220116+0000","last_change":"2023-07-09T21:39:43.232600+0000","last_active":"2023-07-09T21:39:44.220116+0000","last_peered":"2023-07-09T21:39:44.220116+0000","last_clean":"2023-07-09T21:39:44.220116+0000","last_became_active":"2023-07-09T21:39:43.232330+0000","last_became_peered":"2023-07-09T21:39:43.232330+0000","last_unstale":"2023-07-09T21:39:44.220116+0000","last_undegraded":"2023-07-09T21:39:44.220116+0000","last_fullsized":"2023-07-09T21:39:44.220116+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:09:10.079268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022672+0000","last_change":"2023-07-09T21:39:42.240133+0000","last_active":"2023-07-09T21:39:45.022672+0000","last_peered":"2023-07-09T21:39:45.022672+0000","last_clean":"2023-07-09T21:39:45.022672+0000","last_became_active":"2023-07-09T21:39:42.239809+0000","last_became_peered":"2023-07-09T21:39:42.239809+0000","last_unstale":"2023-07-09T21:39:45.022672+0000","last_undegraded":"2023-07-09T21:39:45.022672+0000","last_fullsized":"2023-07-09T21:39:45.022672+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:50:41.268495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016894+0000","last_change":"2023-07-09T21:39:43.251574+0000","last_active":"2023-07-09T21:39:45.016894+0000","last_peered":"2023-07-09T21:39:45.016894+0000","last_clean":"2023-07-09T21:39:45.016894+0000","last_became_active":"2023-07-09T21:39:43.251247+0000","last_became_peered":"2023-07-09T21:39:43.251247+0000","last_unstale":"2023-07-09T21:39:45.016894+0000","last_undegraded":"2023-07-09T21:39:45.016894+0000","last_fullsized":"2023-07-09T21:39:45.016894+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:27.280135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228612+0000","last_change":"2023-07-09T21:39:42.232268+0000","last_active":"2023-07-09T21:39:44.228612+0000","last_peered":"2023-07-09T21:39:44.228612+0000","last_clean":"2023-07-09T21:39:44.228612+0000","last_became_active":"2023-07-09T21:39:42.231985+0000","last_became_peered":"2023-07-09T21:39:42.231985+0000","last_unstale":"2023-07-09T21:39:44.228612+0000","last_undegraded":"2023-07-09T21:39:44.228612+0000","last_fullsized":"2023-07-09T21:39:44.228612+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:40.688727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022657+0000","last_change":"2023-07-09T21:39:43.243276+0000","last_active":"2023-07-09T21:39:45.022657+0000","last_peered":"2023-07-09T21:39:45.022657+0000","last_clean":"2023-07-09T21:39:45.022657+0000","last_became_active":"2023-07-09T21:39:43.242979+0000","last_became_peered":"2023-07-09T21:39:43.242979+0000","last_unstale":"2023-07-09T21:39:45.022657+0000","last_undegraded":"2023-07-09T21:39:45.022657+0000","last_fullsized":"2023-07-09T21:39:45.022657+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:22:38.223877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017861+0000","last_change":"2023-07-09T21:39:42.229864+0000","last_active":"2023-07-09T21:39:45.017861+0000","last_peered":"2023-07-09T21:39:45.017861+0000","last_clean":"2023-07-09T21:39:45.017861+0000","last_became_active":"2023-07-09T21:39:42.229579+0000","last_became_peered":"2023-07-09T21:39:42.229579+0000","last_unstale":"2023-07-09T21:39:45.017861+0000","last_undegraded":"2023-07-09T21:39:45.017861+0000","last_fullsized":"2023-07-09T21:39:45.017861+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:44:56.473783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219429+0000","last_change":"2023-07-09T21:39:43.241318+0000","last_active":"2023-07-09T21:39:44.219429+0000","last_peered":"2023-07-09T21:39:44.219429+0000","last_clean":"2023-07-09T21:39:44.219429+0000","last_became_active":"2023-07-09T21:39:43.240699+0000","last_became_peered":"2023-07-09T21:39:43.240699+0000","last_unstale":"2023-07-09T21:39:44.219429+0000","last_undegraded":"2023-07-09T21:39:44.219429+0000","last_fullsized":"2023-07-09T21:39:44.219429+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:59.637000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016731+0000","last_change":"2023-07-09T21:39:42.230843+0000","last_active":"2023-07-09T21:39:45.016731+0000","last_peered":"2023-07-09T21:39:45.016731+0000","last_clean":"2023-07-09T21:39:45.016731+0000","last_became_active":"2023-07-09T21:39:42.230544+0000","last_became_peered":"2023-07-09T21:39:42.230544+0000","last_unstale":"2023-07-09T21:39:45.016731+0000","last_undegraded":"2023-07-09T21:39:45.016731+0000","last_fullsized":"2023-07-09T21:39:45.016731+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:21:10.264521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017266+0000","last_change":"2023-07-09T21:39:43.233167+0000","last_active":"2023-07-09T21:39:45.017266+0000","last_peered":"2023-07-09T21:39:45.017266+0000","last_clean":"2023-07-09T21:39:45.017266+0000","last_became_active":"2023-07-09T21:39:43.232864+0000","last_became_peered":"2023-07-09T21:39:43.232864+0000","last_unstale":"2023-07-09T21:39:45.017266+0000","last_undegraded":"2023-07-09T21:39:45.017266+0000","last_fullsized":"2023-07-09T21:39:45.017266+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:00:58.699242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022070+0000","last_change":"2023-07-09T21:39:42.244876+0000","last_active":"2023-07-09T21:39:45.022070+0000","last_peered":"2023-07-09T21:39:45.022070+0000","last_clean":"2023-07-09T21:39:45.022070+0000","last_became_active":"2023-07-09T21:39:42.244551+0000","last_became_peered":"2023-07-09T21:39:42.244551+0000","last_unstale":"2023-07-09T21:39:45.022070+0000","last_undegraded":"2023-07-09T21:39:45.022070+0000","last_fullsized":"2023-07-09T21:39:45.022070+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:49.755719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228644+0000","last_change":"2023-07-09T21:39:43.257003+0000","last_active":"2023-07-09T21:39:44.228644+0000","last_peered":"2023-07-09T21:39:44.228644+0000","last_clean":"2023-07-09T21:39:44.228644+0000","last_became_active":"2023-07-09T21:39:43.254621+0000","last_became_peered":"2023-07-09T21:39:43.254621+0000","last_unstale":"2023-07-09T21:39:44.228644+0000","last_undegraded":"2023-07-09T21:39:44.228644+0000","last_fullsized":"2023-07-09T21:39:44.228644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:55:39.877537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229502+0000","last_change":"2023-07-09T21:39:42.233682+0000","last_active":"2023-07-09T21:39:44.229502+0000","last_peered":"2023-07-09T21:39:44.229502+0000","last_clean":"2023-07-09T21:39:44.229502+0000","last_became_active":"2023-07-09T21:39:42.233399+0000","last_became_peered":"2023-07-09T21:39:42.233399+0000","last_unstale":"2023-07-09T21:39:44.229502+0000","last_undegraded":"2023-07-09T21:39:44.229502+0000","last_fullsized":"2023-07-09T21:39:44.229502+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:34:20.303219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022963+0000","last_change":"2023-07-09T21:39:43.241300+0000","last_active":"2023-07-09T21:39:45.022963+0000","last_peered":"2023-07-09T21:39:45.022963+0000","last_clean":"2023-07-09T21:39:45.022963+0000","last_became_active":"2023-07-09T21:39:43.241033+0000","last_became_peered":"2023-07-09T21:39:43.241033+0000","last_unstale":"2023-07-09T21:39:45.022963+0000","last_undegraded":"2023-07-09T21:39:45.022963+0000","last_fullsized":"2023-07-09T21:39:45.022963+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:46.262581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017368+0000","last_change":"2023-07-09T21:39:42.237809+0000","last_active":"2023-07-09T21:39:45.017368+0000","last_peered":"2023-07-09T21:39:45.017368+0000","last_clean":"2023-07-09T21:39:45.017368+0000","last_became_active":"2023-07-09T21:39:42.237410+0000","last_became_peered":"2023-07-09T21:39:42.237410+0000","last_unstale":"2023-07-09T21:39:45.017368+0000","last_undegraded":"2023-07-09T21:39:45.017368+0000","last_fullsized":"2023-07-09T21:39:45.017368+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:26.271878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017261+0000","last_change":"2023-07-09T21:39:43.240890+0000","last_active":"2023-07-09T21:39:45.017261+0000","last_peered":"2023-07-09T21:39:45.017261+0000","last_clean":"2023-07-09T21:39:45.017261+0000","last_became_active":"2023-07-09T21:39:43.240587+0000","last_became_peered":"2023-07-09T21:39:43.240587+0000","last_unstale":"2023-07-09T21:39:45.017261+0000","last_undegraded":"2023-07-09T21:39:45.017261+0000","last_fullsized":"2023-07-09T21:39:45.017261+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:47:18.661290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"112'3","reported_seq":16,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229295+0000","last_change":"2023-07-09T21:39:42.244755+0000","last_active":"2023-07-09T21:39:44.229295+0000","last_peered":"2023-07-09T21:39:44.229295+0000","last_clean":"2023-07-09T21:39:44.229295+0000","last_became_active":"2023-07-09T21:39:42.244416+0000","last_became_peered":"2023-07-09T21:39:42.244416+0000","last_unstale":"2023-07-09T21:39:44.229295+0000","last_undegraded":"2023-07-09T21:39:44.229295+0000","last_fullsized":"2023-07-09T21:39:44.229295+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:15.068631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017871+0000","last_change":"2023-07-09T21:39:43.237004+0000","last_active":"2023-07-09T21:39:45.017871+0000","last_peered":"2023-07-09T21:39:45.017871+0000","last_clean":"2023-07-09T21:39:45.017871+0000","last_became_active":"2023-07-09T21:39:43.235538+0000","last_became_peered":"2023-07-09T21:39:43.235538+0000","last_unstale":"2023-07-09T21:39:45.017871+0000","last_undegraded":"2023-07-09T21:39:45.017871+0000","last_fullsized":"2023-07-09T21:39:45.017871+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:11.046624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"112'6","reported_seq":19,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219790+0000","last_change":"2023-07-09T21:39:42.227954+0000","last_active":"2023-07-09T21:39:44.219790+0000","last_peered":"2023-07-09T21:39:44.219790+0000","last_clean":"2023-07-09T21:39:44.219790+0000","last_became_active":"2023-07-09T21:39:42.227639+0000","last_became_peered":"2023-07-09T21:39:42.227639+0000","last_unstale":"2023-07-09T21:39:44.219790+0000","last_undegraded":"2023-07-09T21:39:44.219790+0000","last_fullsized":"2023-07-09T21:39:44.219790+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:32:20.240701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017062+0000","last_change":"2023-07-09T21:39:43.236823+0000","last_active":"2023-07-09T21:39:45.017062+0000","last_peered":"2023-07-09T21:39:45.017062+0000","last_clean":"2023-07-09T21:39:45.017062+0000","last_became_active":"2023-07-09T21:39:43.235081+0000","last_became_peered":"2023-07-09T21:39:43.235081+0000","last_unstale":"2023-07-09T21:39:45.017062+0000","last_undegraded":"2023-07-09T21:39:45.017062+0000","last_fullsized":"2023-07-09T21:39:45.017062+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:46.846729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022361+0000","last_change":"2023-07-09T21:39:42.245324+0000","last_active":"2023-07-09T21:39:45.022361+0000","last_peered":"2023-07-09T21:39:45.022361+0000","last_clean":"2023-07-09T21:39:45.022361+0000","last_became_active":"2023-07-09T21:39:42.244983+0000","last_became_peered":"2023-07-09T21:39:42.244983+0000","last_unstale":"2023-07-09T21:39:45.022361+0000","last_undegraded":"2023-07-09T21:39:45.022361+0000","last_fullsized":"2023-07-09T21:39:45.022361+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:42:01.142209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228136+0000","last_change":"2023-07-09T21:39:43.238940+0000","last_active":"2023-07-09T21:39:44.228136+0000","last_peered":"2023-07-09T21:39:44.228136+0000","last_clean":"2023-07-09T21:39:44.228136+0000","last_became_active":"2023-07-09T21:39:43.238569+0000","last_became_peered":"2023-07-09T21:39:43.238569+0000","last_unstale":"2023-07-09T21:39:44.228136+0000","last_undegraded":"2023-07-09T21:39:44.228136+0000","last_fullsized":"2023-07-09T21:39:44.228136+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:34.230332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219555+0000","last_change":"2023-07-09T21:39:42.230619+0000","last_active":"2023-07-09T21:39:44.219555+0000","last_peered":"2023-07-09T21:39:44.219555+0000","last_clean":"2023-07-09T21:39:44.219555+0000","last_became_active":"2023-07-09T21:39:42.228042+0000","last_became_peered":"2023-07-09T21:39:42.228042+0000","last_unstale":"2023-07-09T21:39:44.219555+0000","last_undegraded":"2023-07-09T21:39:44.219555+0000","last_fullsized":"2023-07-09T21:39:44.219555+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:52.362799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881051+0000","last_change":"2023-07-09T21:39:43.240988+0000","last_active":"2023-07-09T21:39:44.881051+0000","last_peered":"2023-07-09T21:39:44.881051+0000","last_clean":"2023-07-09T21:39:44.881051+0000","last_became_active":"2023-07-09T21:39:43.240695+0000","last_became_peered":"2023-07-09T21:39:43.240695+0000","last_unstale":"2023-07-09T21:39:44.881051+0000","last_undegraded":"2023-07-09T21:39:44.881051+0000","last_fullsized":"2023-07-09T21:39:44.881051+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:59:08.072485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017495+0000","last_change":"2023-07-09T21:39:42.231175+0000","last_active":"2023-07-09T21:39:45.017495+0000","last_peered":"2023-07-09T21:39:45.017495+0000","last_clean":"2023-07-09T21:39:45.017495+0000","last_became_active":"2023-07-09T21:39:42.230911+0000","last_became_peered":"2023-07-09T21:39:42.230911+0000","last_unstale":"2023-07-09T21:39:45.017495+0000","last_undegraded":"2023-07-09T21:39:45.017495+0000","last_fullsized":"2023-07-09T21:39:45.017495+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:30.849292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881299+0000","last_change":"2023-07-09T21:39:43.233717+0000","last_active":"2023-07-09T21:39:44.881299+0000","last_peered":"2023-07-09T21:39:44.881299+0000","last_clean":"2023-07-09T21:39:44.881299+0000","last_became_active":"2023-07-09T21:39:43.233422+0000","last_became_peered":"2023-07-09T21:39:43.233422+0000","last_unstale":"2023-07-09T21:39:44.881299+0000","last_undegraded":"2023-07-09T21:39:44.881299+0000","last_fullsized":"2023-07-09T21:39:44.881299+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:36:27.160889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"112'8","reported_seq":21,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017218+0000","last_change":"2023-07-09T21:39:42.233317+0000","last_active":"2023-07-09T21:39:45.017218+0000","last_peered":"2023-07-09T21:39:45.017218+0000","last_clean":"2023-07-09T21:39:45.017218+0000","last_became_active":"2023-07-09T21:39:42.233048+0000","last_became_peered":"2023-07-09T21:39:42.233048+0000","last_unstale":"2023-07-09T21:39:45.017218+0000","last_undegraded":"2023-07-09T21:39:45.017218+0000","last_fullsized":"2023-07-09T21:39:45.017218+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:15.099956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022494+0000","last_change":"2023-07-09T21:39:43.237326+0000","last_active":"2023-07-09T21:39:45.022494+0000","last_peered":"2023-07-09T21:39:45.022494+0000","last_clean":"2023-07-09T21:39:45.022494+0000","last_became_active":"2023-07-09T21:39:43.237006+0000","last_became_peered":"2023-07-09T21:39:43.237006+0000","last_unstale":"2023-07-09T21:39:45.022494+0000","last_undegraded":"2023-07-09T21:39:45.022494+0000","last_fullsized":"2023-07-09T21:39:45.022494+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:27:11.409848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022607+0000","last_change":"2023-07-09T21:39:42.238834+0000","last_active":"2023-07-09T21:39:45.022607+0000","last_peered":"2023-07-09T21:39:45.022607+0000","last_clean":"2023-07-09T21:39:45.022607+0000","last_became_active":"2023-07-09T21:39:42.238523+0000","last_became_peered":"2023-07-09T21:39:42.238523+0000","last_unstale":"2023-07-09T21:39:45.022607+0000","last_undegraded":"2023-07-09T21:39:45.022607+0000","last_fullsized":"2023-07-09T21:39:45.022607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.848840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219947+0000","last_change":"2023-07-09T21:39:43.234589+0000","last_active":"2023-07-09T21:39:44.219947+0000","last_peered":"2023-07-09T21:39:44.219947+0000","last_clean":"2023-07-09T21:39:44.219947+0000","last_became_active":"2023-07-09T21:39:43.234019+0000","last_became_peered":"2023-07-09T21:39:43.234019+0000","last_unstale":"2023-07-09T21:39:44.219947+0000","last_undegraded":"2023-07-09T21:39:44.219947+0000","last_fullsized":"2023-07-09T21:39:44.219947+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:40:41.363837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"113'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229246+0000","last_change":"2023-07-09T21:39:42.235742+0000","last_active":"2023-07-09T21:39:44.229246+0000","last_peered":"2023-07-09T21:39:44.229246+0000","last_clean":"2023-07-09T21:39:44.229246+0000","last_became_active":"2023-07-09T21:39:42.235449+0000","last_became_peered":"2023-07-09T21:39:42.235449+0000","last_unstale":"2023-07-09T21:39:44.229246+0000","last_undegraded":"2023-07-09T21:39:44.229246+0000","last_fullsized":"2023-07-09T21:39:44.229246+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:37:06.331324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219856+0000","last_change":"2023-07-09T21:39:43.231810+0000","last_active":"2023-07-09T21:39:44.219856+0000","last_peered":"2023-07-09T21:39:44.219856+0000","last_clean":"2023-07-09T21:39:44.219856+0000","last_became_active":"2023-07-09T21:39:43.231537+0000","last_became_peered":"2023-07-09T21:39:43.231537+0000","last_unstale":"2023-07-09T21:39:44.219856+0000","last_undegraded":"2023-07-09T21:39:44.219856+0000","last_fullsized":"2023-07-09T21:39:44.219856+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:00.030355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229520+0000","last_change":"2023-07-09T21:39:42.244672+0000","last_active":"2023-07-09T21:39:44.229520+0000","last_peered":"2023-07-09T21:39:44.229520+0000","last_clean":"2023-07-09T21:39:44.229520+0000","last_became_active":"2023-07-09T21:39:42.244373+0000","last_became_peered":"2023-07-09T21:39:42.244373+0000","last_unstale":"2023-07-09T21:39:44.229520+0000","last_undegraded":"2023-07-09T21:39:44.229520+0000","last_fullsized":"2023-07-09T21:39:44.229520+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:24.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229385+0000","last_change":"2023-07-09T21:39:43.237520+0000","last_active":"2023-07-09T21:39:44.229385+0000","last_peered":"2023-07-09T21:39:44.229385+0000","last_clean":"2023-07-09T21:39:44.229385+0000","last_became_active":"2023-07-09T21:39:43.237250+0000","last_became_peered":"2023-07-09T21:39:43.237250+0000","last_unstale":"2023-07-09T21:39:44.229385+0000","last_undegraded":"2023-07-09T21:39:44.229385+0000","last_fullsized":"2023-07-09T21:39:44.229385+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:47.210573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022820+0000","last_change":"2023-07-09T21:39:42.234762+0000","last_active":"2023-07-09T21:39:45.022820+0000","last_peered":"2023-07-09T21:39:45.022820+0000","last_clean":"2023-07-09T21:39:45.022820+0000","last_became_active":"2023-07-09T21:39:42.234479+0000","last_became_peered":"2023-07-09T21:39:42.234479+0000","last_unstale":"2023-07-09T21:39:45.022820+0000","last_undegraded":"2023-07-09T21:39:45.022820+0000","last_fullsized":"2023-07-09T21:39:45.022820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:24.214088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.880995+0000","last_change":"2023-07-09T21:39:43.232518+0000","last_active":"2023-07-09T21:39:44.880995+0000","last_peered":"2023-07-09T21:39:44.880995+0000","last_clean":"2023-07-09T21:39:44.880995+0000","last_became_active":"2023-07-09T21:39:43.232114+0000","last_became_peered":"2023-07-09T21:39:43.232114+0000","last_unstale":"2023-07-09T21:39:44.880995+0000","last_undegraded":"2023-07-09T21:39:44.880995+0000","last_fullsized":"2023-07-09T21:39:44.880995+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:03:31.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219998+0000","last_change":"2023-07-09T21:39:42.232385+0000","last_active":"2023-07-09T21:39:44.219998+0000","last_peered":"2023-07-09T21:39:44.219998+0000","last_clean":"2023-07-09T21:39:44.219998+0000","last_became_active":"2023-07-09T21:39:42.231546+0000","last_became_peered":"2023-07-09T21:39:42.231546+0000","last_unstale":"2023-07-09T21:39:44.219998+0000","last_undegraded":"2023-07-09T21:39:44.219998+0000","last_fullsized":"2023-07-09T21:39:44.219998+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:55:54.765866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.016545+0000","last_change":"2023-07-09T21:39:43.242211+0000","last_active":"2023-07-09T21:39:45.016545+0000","last_peered":"2023-07-09T21:39:45.016545+0000","last_clean":"2023-07-09T21:39:45.016545+0000","last_became_active":"2023-07-09T21:39:43.241875+0000","last_became_peered":"2023-07-09T21:39:43.241875+0000","last_unstale":"2023-07-09T21:39:45.016545+0000","last_undegraded":"2023-07-09T21:39:45.016545+0000","last_fullsized":"2023-07-09T21:39:45.016545+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:05:25.381192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228672+0000","last_change":"2023-07-09T21:39:42.236910+0000","last_active":"2023-07-09T21:39:44.228672+0000","last_peered":"2023-07-09T21:39:44.228672+0000","last_clean":"2023-07-09T21:39:44.228672+0000","last_became_active":"2023-07-09T21:39:42.236606+0000","last_became_peered":"2023-07-09T21:39:42.236606+0000","last_unstale":"2023-07-09T21:39:44.228672+0000","last_undegraded":"2023-07-09T21:39:44.228672+0000","last_fullsized":"2023-07-09T21:39:44.228672+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:07.622123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022178+0000","last_change":"2023-07-09T21:39:43.241841+0000","last_active":"2023-07-09T21:39:45.022178+0000","last_peered":"2023-07-09T21:39:45.022178+0000","last_clean":"2023-07-09T21:39:45.022178+0000","last_became_active":"2023-07-09T21:39:43.241373+0000","last_became_peered":"2023-07-09T21:39:43.241373+0000","last_unstale":"2023-07-09T21:39:45.022178+0000","last_undegraded":"2023-07-09T21:39:45.022178+0000","last_fullsized":"2023-07-09T21:39:45.022178+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:26.451944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022834+0000","last_change":"2023-07-09T21:39:42.238711+0000","last_active":"2023-07-09T21:39:45.022834+0000","last_peered":"2023-07-09T21:39:45.022834+0000","last_clean":"2023-07-09T21:39:45.022834+0000","last_became_active":"2023-07-09T21:39:42.238400+0000","last_became_peered":"2023-07-09T21:39:42.238400+0000","last_unstale":"2023-07-09T21:39:45.022834+0000","last_undegraded":"2023-07-09T21:39:45.022834+0000","last_fullsized":"2023-07-09T21:39:45.022834+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:43.093438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219875+0000","last_change":"2023-07-09T21:39:43.251032+0000","last_active":"2023-07-09T21:39:44.219875+0000","last_peered":"2023-07-09T21:39:44.219875+0000","last_clean":"2023-07-09T21:39:44.219875+0000","last_became_active":"2023-07-09T21:39:43.250738+0000","last_became_peered":"2023-07-09T21:39:43.250738+0000","last_unstale":"2023-07-09T21:39:44.219875+0000","last_undegraded":"2023-07-09T21:39:44.219875+0000","last_fullsized":"2023-07-09T21:39:44.219875+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:58.305064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022117+0000","last_change":"2023-07-09T21:39:42.239328+0000","last_active":"2023-07-09T21:39:45.022117+0000","last_peered":"2023-07-09T21:39:45.022117+0000","last_clean":"2023-07-09T21:39:45.022117+0000","last_became_active":"2023-07-09T21:39:42.239048+0000","last_became_peered":"2023-07-09T21:39:42.239048+0000","last_unstale":"2023-07-09T21:39:45.022117+0000","last_undegraded":"2023-07-09T21:39:45.022117+0000","last_fullsized":"2023-07-09T21:39:45.022117+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:49:20.710488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022715+0000","last_change":"2023-07-09T21:39:43.256625+0000","last_active":"2023-07-09T21:39:45.022715+0000","last_peered":"2023-07-09T21:39:45.022715+0000","last_clean":"2023-07-09T21:39:45.022715+0000","last_became_active":"2023-07-09T21:39:43.255808+0000","last_became_peered":"2023-07-09T21:39:43.255808+0000","last_unstale":"2023-07-09T21:39:45.022715+0000","last_undegraded":"2023-07-09T21:39:45.022715+0000","last_fullsized":"2023-07-09T21:39:45.022715+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:16.104208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017371+0000","last_change":"2023-07-09T21:39:42.235946+0000","last_active":"2023-07-09T21:39:45.017371+0000","last_peered":"2023-07-09T21:39:45.017371+0000","last_clean":"2023-07-09T21:39:45.017371+0000","last_became_active":"2023-07-09T21:39:42.235643+0000","last_became_peered":"2023-07-09T21:39:42.235643+0000","last_unstale":"2023-07-09T21:39:45.017371+0000","last_undegraded":"2023-07-09T21:39:45.017371+0000","last_fullsized":"2023-07-09T21:39:45.017371+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:21:53.695079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"101'205","reported_seq":653,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022357+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:39:45.022357+0000","last_peered":"2023-07-09T21:39:45.022357+0000","last_clean":"2023-07-09T21:39:45.022357+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:39:45.022357+0000","last_undegraded":"2023-07-09T21:39:45.022357+0000","last_fullsized":"2023-07-09T21:39:45.022357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:27:49.064781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228799+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:39:44.228799+0000","last_peered":"2023-07-09T21:39:44.228799+0000","last_clean":"2023-07-09T21:39:44.228799+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:39:44.228799+0000","last_undegraded":"2023-07-09T21:39:44.228799+0000","last_fullsized":"2023-07-09T21:39:44.228799+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:57.387793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219706+0000","last_change":"2023-07-09T21:39:43.234437+0000","last_active":"2023-07-09T21:39:44.219706+0000","last_peered":"2023-07-09T21:39:44.219706+0000","last_clean":"2023-07-09T21:39:44.219706+0000","last_became_active":"2023-07-09T21:39:43.233792+0000","last_became_peered":"2023-07-09T21:39:43.233792+0000","last_unstale":"2023-07-09T21:39:44.219706+0000","last_undegraded":"2023-07-09T21:39:44.219706+0000","last_fullsized":"2023-07-09T21:39:44.219706+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:06:31.186502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022919+0000","last_change":"2023-07-09T21:39:42.238970+0000","last_active":"2023-07-09T21:39:45.022919+0000","last_peered":"2023-07-09T21:39:45.022919+0000","last_clean":"2023-07-09T21:39:45.022919+0000","last_became_active":"2023-07-09T21:39:42.237884+0000","last_became_peered":"2023-07-09T21:39:42.237884+0000","last_unstale":"2023-07-09T21:39:45.022919+0000","last_undegraded":"2023-07-09T21:39:45.022919+0000","last_fullsized":"2023-07-09T21:39:45.022919+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:00.973405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022269+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:39:45.022269+0000","last_peered":"2023-07-09T21:39:45.022269+0000","last_clean":"2023-07-09T21:39:45.022269+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:39:45.022269+0000","last_undegraded":"2023-07-09T21:39:45.022269+0000","last_fullsized":"2023-07-09T21:39:45.022269+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:15.116607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022688+0000","last_change":"2023-07-09T21:39:43.229047+0000","last_active":"2023-07-09T21:39:45.022688+0000","last_peered":"2023-07-09T21:39:45.022688+0000","last_clean":"2023-07-09T21:39:45.022688+0000","last_became_active":"2023-07-09T21:39:43.228760+0000","last_became_peered":"2023-07-09T21:39:43.228760+0000","last_unstale":"2023-07-09T21:39:45.022688+0000","last_undegraded":"2023-07-09T21:39:45.022688+0000","last_fullsized":"2023-07-09T21:39:45.022688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:06:13.319912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022809+0000","last_change":"2023-07-09T21:39:42.241874+0000","last_active":"2023-07-09T21:39:45.022809+0000","last_peered":"2023-07-09T21:39:45.022809+0000","last_clean":"2023-07-09T21:39:45.022809+0000","last_became_active":"2023-07-09T21:39:42.241590+0000","last_became_peered":"2023-07-09T21:39:42.241590+0000","last_unstale":"2023-07-09T21:39:45.022809+0000","last_undegraded":"2023-07-09T21:39:45.022809+0000","last_fullsized":"2023-07-09T21:39:45.022809+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:44.947865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":179,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.880981+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:39:44.880981+0000","last_peered":"2023-07-09T21:39:44.880981+0000","last_clean":"2023-07-09T21:39:44.880981+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:39:44.880981+0000","last_undegraded":"2023-07-09T21:39:44.880981+0000","last_fullsized":"2023-07-09T21:39:44.880981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:11:12.931201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229059+0000","last_change":"2023-07-09T21:39:43.238915+0000","last_active":"2023-07-09T21:39:44.229059+0000","last_peered":"2023-07-09T21:39:44.229059+0000","last_clean":"2023-07-09T21:39:44.229059+0000","last_became_active":"2023-07-09T21:39:43.238265+0000","last_became_peered":"2023-07-09T21:39:43.238265+0000","last_unstale":"2023-07-09T21:39:44.229059+0000","last_undegraded":"2023-07-09T21:39:44.229059+0000","last_fullsized":"2023-07-09T21:39:44.229059+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:18.237395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"112'1","reported_seq":14,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.229408+0000","last_change":"2023-07-09T21:39:42.240044+0000","last_active":"2023-07-09T21:39:44.229408+0000","last_peered":"2023-07-09T21:39:44.229408+0000","last_clean":"2023-07-09T21:39:44.229408+0000","last_became_active":"2023-07-09T21:39:42.239664+0000","last_became_peered":"2023-07-09T21:39:42.239664+0000","last_unstale":"2023-07-09T21:39:44.229408+0000","last_undegraded":"2023-07-09T21:39:44.229408+0000","last_fullsized":"2023-07-09T21:39:44.229408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:22:41.399231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":207,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228773+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:39:44.228773+0000","last_peered":"2023-07-09T21:39:44.228773+0000","last_clean":"2023-07-09T21:39:44.228773+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:39:44.228773+0000","last_undegraded":"2023-07-09T21:39:44.228773+0000","last_fullsized":"2023-07-09T21:39:44.228773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:12.868784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219548+0000","last_change":"2023-07-09T21:39:43.230750+0000","last_active":"2023-07-09T21:39:44.219548+0000","last_peered":"2023-07-09T21:39:44.219548+0000","last_clean":"2023-07-09T21:39:44.219548+0000","last_became_active":"2023-07-09T21:39:43.230459+0000","last_became_peered":"2023-07-09T21:39:43.230459+0000","last_unstale":"2023-07-09T21:39:44.219548+0000","last_undegraded":"2023-07-09T21:39:44.219548+0000","last_fullsized":"2023-07-09T21:39:44.219548+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:36:08.314071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"112'2","reported_seq":15,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228705+0000","last_change":"2023-07-09T21:39:42.237844+0000","last_active":"2023-07-09T21:39:44.228705+0000","last_peered":"2023-07-09T21:39:44.228705+0000","last_clean":"2023-07-09T21:39:44.228705+0000","last_became_active":"2023-07-09T21:39:42.237413+0000","last_became_peered":"2023-07-09T21:39:42.237413+0000","last_unstale":"2023-07-09T21:39:44.228705+0000","last_undegraded":"2023-07-09T21:39:44.228705+0000","last_fullsized":"2023-07-09T21:39:44.228705+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:21.829803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":173,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017551+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:39:45.017551+0000","last_peered":"2023-07-09T21:39:45.017551+0000","last_clean":"2023-07-09T21:39:45.017551+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:39:45.017551+0000","last_undegraded":"2023-07-09T21:39:45.017551+0000","last_fullsized":"2023-07-09T21:39:45.017551+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:31:44.083591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228225+0000","last_change":"2023-07-09T21:39:43.255389+0000","last_active":"2023-07-09T21:39:44.228225+0000","last_peered":"2023-07-09T21:39:44.228225+0000","last_clean":"2023-07-09T21:39:44.228225+0000","last_became_active":"2023-07-09T21:39:43.255065+0000","last_became_peered":"2023-07-09T21:39:43.255065+0000","last_unstale":"2023-07-09T21:39:44.228225+0000","last_undegraded":"2023-07-09T21:39:44.228225+0000","last_fullsized":"2023-07-09T21:39:44.228225+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:57:30.700717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881100+0000","last_change":"2023-07-09T21:39:42.233837+0000","last_active":"2023-07-09T21:39:44.881100+0000","last_peered":"2023-07-09T21:39:44.881100+0000","last_clean":"2023-07-09T21:39:44.881100+0000","last_became_active":"2023-07-09T21:39:42.233428+0000","last_became_peered":"2023-07-09T21:39:42.233428+0000","last_unstale":"2023-07-09T21:39:44.881100+0000","last_undegraded":"2023-07-09T21:39:44.881100+0000","last_fullsized":"2023-07-09T21:39:44.881100+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:30.611762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":185,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.022965+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:39:45.022965+0000","last_peered":"2023-07-09T21:39:45.022965+0000","last_clean":"2023-07-09T21:39:45.022965+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:39:45.022965+0000","last_undegraded":"2023-07-09T21:39:45.022965+0000","last_fullsized":"2023-07-09T21:39:45.022965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:40.558834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228642+0000","last_change":"2023-07-09T21:39:43.244142+0000","last_active":"2023-07-09T21:39:44.228642+0000","last_peered":"2023-07-09T21:39:44.228642+0000","last_clean":"2023-07-09T21:39:44.228642+0000","last_became_active":"2023-07-09T21:39:43.243813+0000","last_became_peered":"2023-07-09T21:39:43.243813+0000","last_unstale":"2023-07-09T21:39:44.228642+0000","last_undegraded":"2023-07-09T21:39:44.228642+0000","last_fullsized":"2023-07-09T21:39:44.228642+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:24:22.110352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.228352+0000","last_change":"2023-07-09T21:39:42.241936+0000","last_active":"2023-07-09T21:39:44.228352+0000","last_peered":"2023-07-09T21:39:44.228352+0000","last_clean":"2023-07-09T21:39:44.228352+0000","last_became_active":"2023-07-09T21:39:42.241566+0000","last_became_peered":"2023-07-09T21:39:42.241566+0000","last_unstale":"2023-07-09T21:39:44.228352+0000","last_undegraded":"2023-07-09T21:39:44.228352+0000","last_fullsized":"2023-07-09T21:39:44.228352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:54.072313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":175,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.017878+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:39:45.017878+0000","last_peered":"2023-07-09T21:39:45.017878+0000","last_clean":"2023-07-09T21:39:45.017878+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:39:45.017878+0000","last_undegraded":"2023-07-09T21:39:45.017878+0000","last_fullsized":"2023-07-09T21:39:45.017878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:22.964889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":11,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.219752+0000","last_change":"2023-07-09T21:39:43.237351+0000","last_active":"2023-07-09T21:39:44.219752+0000","last_peered":"2023-07-09T21:39:44.219752+0000","last_clean":"2023-07-09T21:39:44.219752+0000","last_became_active":"2023-07-09T21:39:43.236242+0000","last_became_peered":"2023-07-09T21:39:43.236242+0000","last_unstale":"2023-07-09T21:39:44.219752+0000","last_undegraded":"2023-07-09T21:39:44.219752+0000","last_fullsized":"2023-07-09T21:39:44.219752+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:42.202790+0000","last_clean_scrub_stamp":"2023-07-09T21:39:42.202790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:43.025815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:44.881066+0000","last_change":"2023-07-09T21:39:42.228204+0000","last_active":"2023-07-09T21:39:44.881066+0000","last_peered":"2023-07-09T21:39:44.881066+0000","last_clean":"2023-07-09T21:39:44.881066+0000","last_became_active":"2023-07-09T21:39:42.227935+0000","last_became_peered":"2023-07-09T21:39:42.227935+0000","last_unstale":"2023-07-09T21:39:44.881066+0000","last_undegraded":"2023-07-09T21:39:44.881066+0000","last_fullsized":"2023-07-09T21:39:44.881066+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:39:41.194533+0000","last_clean_scrub_stamp":"2023-07-09T21:39:41.194533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:46.538349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":113,"state":"active+clean","last_fresh":"2023-07-09T21:39:45.023042+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:39:45.023042+0000","last_peered":"2023-07-09T21:39:45.023042+0000","last_clean":"2023-07-09T21:39:45.023042+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:39:45.023042+0000","last_undegraded":"2023-07-09T21:39:45.023042+0000","last_fullsized":"2023-07-09T21:39:45.023042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:05:48.872843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":1748,"num_write":319,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575058,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59232,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312608,"statfs":{"total":96636764160,"available":96576110592,"internally_reserved":0,"allocated":1990656,"data_stored":1291507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68600000000000005,"15min":0.70699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88900000000000001,"5min":0.97299999999999998,"15min":0.99099999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.82799999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74299999999999999,"15min":0.73099999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":3.6389999999999998,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.71799999999999997,"15min":0.72199999999999998},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.34699999999999998},"max":{"1min":3.2149999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.626},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.502,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.97199999999999998,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.51500000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92500000000000004,"5min":1.0189999999999999,"15min":1.044},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.77000000000000002,"15min":0.77900000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.008,"5min":1.129,"15min":1.129},"last":0.58399999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":0.85599999999999998,"5min":0.91900000000000004,"15min":1.0249999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39600000000000002,"5min":0.372,"15min":0.35399999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":1.002},"last":0.68600000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.29599999999999999},"max":{"1min":0.89800000000000002,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65400000000000003},"min":{"1min":0.47899999999999998,"5min":0.45400000000000001,"15min":0.33100000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.71099999999999997,"15min":0.70399999999999996},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67300000000000004,"15min":0.66700000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.39600000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575057,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1376,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1409024,"data_stored":703251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.68000000000000005,"15min":0.70799999999999996},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.71799999999999997,"15min":0.73199999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":1.9339999999999999,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.76900000000000002,"15min":0.748},"min":{"1min":0.501,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":4.0979999999999999,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.70899999999999996,"15min":0.73399999999999999},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.79200000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.72299999999999998,"15min":0.749},"min":{"1min":0.45200000000000001,"5min":0.43099999999999999,"15min":0.42499999999999999},"max":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.77500000000000002,"15min":0.77100000000000002},"min":{"1min":0.48099999999999998,"5min":0.375,"15min":0.375},"max":{"1min":4.3019999999999996,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.871}]},{"osd":3,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.74099999999999999,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.53200000000000003,"15min":0.45500000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.749,"15min":0.75900000000000001},"min":{"1min":0.496,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.879}]},{"osd":4,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":0.66500000000000004,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.39100000000000001,"15min":0.318},"max":{"1min":6.101,"5min":6.101,"15min":6.101},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.083,"5min":0.68500000000000005,"15min":0.63200000000000001},"min":{"1min":0.45900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":7.2910000000000004,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.69599999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.69099999999999995,"15min":0.63800000000000001},"min":{"1min":0.46200000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":4.7450000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.69599999999999995,"15min":0.65200000000000002},"min":{"1min":0.47899999999999998,"5min":0.39500000000000002,"15min":0.374},"max":{"1min":5.1669999999999998,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.72799999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.503,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":3.4159999999999999,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.77600000000000002},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.76600000000000001,"15min":0.70699999999999996},"min":{"1min":0.54800000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.80700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834575056,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50452,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321388,"statfs":{"total":96636764160,"available":96585101312,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.70699999999999996},"min":{"1min":0.42099999999999999,"5min":0.34300000000000003,"15min":0.246},"max":{"1min":0.91500000000000004,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.71699999999999997},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96399999999999997,"5min":0.996,"15min":0.996},"last":0.64400000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.71599999999999997,"15min":0.73699999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.96099999999999997,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70099999999999996,"15min":0.71699999999999997},"min":{"1min":0.48599999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91600000000000004,"5min":1.02,"15min":1.02},"last":0.747}]},{"osd":2,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.72499999999999998,"15min":0.73699999999999999},"min":{"1min":0.54800000000000004,"5min":0.51400000000000001,"15min":0.45200000000000001},"max":{"1min":0.93300000000000005,"5min":0.96199999999999997,"15min":0.999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70499999999999996,"15min":0.72099999999999997},"min":{"1min":0.48799999999999999,"5min":0.38800000000000001,"15min":0.32300000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.68400000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.74299999999999999},"min":{"1min":0.47899999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92200000000000004,"5min":1.01,"15min":1.01},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.74199999999999999,"15min":0.747},"min":{"1min":0.61399999999999999,"5min":0.47799999999999998,"15min":0.45400000000000001},"max":{"1min":0.94199999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.70699999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57499999999999996,"15min":0.56200000000000006},"min":{"1min":0.42099999999999999,"5min":0.311,"15min":0.28399999999999997},"max":{"1min":0.80500000000000005,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.61599999999999999,"15min":0.60999999999999999},"min":{"1min":0.41799999999999998,"5min":0.40100000000000002,"15min":0.36799999999999999},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.48499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64800000000000002,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.40699999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.038},"last":0.61399999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68600000000000005,"15min":0.67100000000000004},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70499999999999996,"15min":0.68600000000000005},"min":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.39200000000000002},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.56399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575058,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32412,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339428,"statfs":{"total":96636764160,"available":96603574272,"internally_reserved":0,"allocated":1396736,"data_stored":701243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69599999999999995,"15min":0.71899999999999997},"min":{"1min":0.50600000000000001,"5min":0.35299999999999998,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.95299999999999996,"15min":1.0549999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68999999999999995,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.45100000000000001,"15min":0.35699999999999998},"max":{"1min":0.874,"5min":0.90100000000000002,"15min":0.94699999999999995},"last":0.76100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72299999999999998,"15min":0.72999999999999998},"min":{"1min":0.46999999999999997,"5min":0.43099999999999999,"15min":0.33600000000000002},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.56200000000000006,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.89700000000000002,"5min":0.97299999999999998,"15min":1.0229999999999999},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.872,"5min":0.97999999999999998,"15min":1.0069999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.752,"15min":0.751},"min":{"1min":0.52400000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93799999999999994,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.67700000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.73099999999999998,"15min":0.72699999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.47099999999999997},"max":{"1min":0.88,"5min":1.26,"15min":1.26},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.748,"15min":0.75900000000000001},"min":{"1min":0.53900000000000003,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.91400000000000003,"5min":1.05,"15min":1.081},"last":0.81399999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.36099999999999999,"15min":0.34899999999999998},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59999999999999998,"15min":0.59699999999999998},"min":{"1min":0.374,"5min":0.36899999999999999,"15min":0.32400000000000001},"max":{"1min":1.02,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61799999999999999,"15min":0.61399999999999999},"min":{"1min":0.43099999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.84699999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66500000000000004,"15min":0.66000000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39300000000000002},"max":{"1min":0.92700000000000005,"5min":1.0049999999999999,"15min":1.107},"last":0.58399999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.376},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.997},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71299999999999997,"15min":0.69799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.77900000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575057,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32404,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339436,"statfs":{"total":96636764160,"available":96603582464,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45900000000000002,"15min":0.46700000000000003},"min":{"1min":0.32800000000000001,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.88600000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.40999999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85599999999999998,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.435}]},{"osd":1,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84699999999999998,"15min":0.85399999999999998},"last":0.34499999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.56699999999999995,"15min":0.57999999999999996},"min":{"1min":0.39400000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.61799999999999999,"15min":0.63200000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.48799999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76400000000000001,"15min":0.78300000000000003},"min":{"1min":0.59399999999999997,"5min":0.46200000000000002,"15min":0.42099999999999999},"max":{"1min":0.98899999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78900000000000003,"15min":0.81599999999999995},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.1419999999999999,"5min":1.262,"15min":1.2689999999999999},"last":0.752}]},{"osd":5,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79800000000000004,"15min":0.82499999999999996},"min":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.006,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.78700000000000003,"15min":0.80500000000000005},"min":{"1min":0.53900000000000003,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98599999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.879}]},{"osd":6,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.76600000000000001,"15min":0.77800000000000002},"min":{"1min":0.56399999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93799999999999994,"5min":1.51,"15min":1.51},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.751,"15min":0.76700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95299999999999996,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.84499999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:39:47 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.56999999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1,"5min":1.1100000000000001,"15min":1.159},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76700000000000002,"15min":0.78900000000000003},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":0.96699999999999997,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.72799999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575058,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54548,"kb_used_data":1356,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317292,"statfs":{"total":96636764160,"available":96580907008,"internally_reserved":0,"allocated":1388544,"data_stored":701083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.46300000000000002},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.24099999999999999},"max":{"1min":0.59899999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.51400000000000001,"15min":0.52400000000000002},"min":{"1min":0.34599999999999997,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.58999999999999997,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.59299999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.46999999999999997,"15min":0.47099999999999997},"min":{"1min":0.35599999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.745,"5min":0.745,"15min":0.77200000000000002},"last":0.432},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.41699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.64000000000000001,"5min":0.88700000000000001,"15min":0.88900000000000001},"last":0.47499999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57899999999999996,"15min":0.57799999999999996},"min":{"1min":0.48299999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.55000000000000004},"min":{"1min":0.42099999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.60899999999999999,"5min":1.7050000000000001,"15min":1.7050000000000001},"last":0.50600000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.77200000000000002,"15min":0.79000000000000004},"min":{"1min":0.503,"5min":0.47799999999999998,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":1.3360000000000001,"15min":1.4570000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.79100000000000004,"15min":0.81399999999999995},"min":{"1min":0.54200000000000004,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88300000000000001,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.872}]},{"osd":5,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78600000000000003,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88200000000000001,"5min":1.377,"15min":1.3839999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.55100000000000005,"5min":0.52800000000000002,"15min":0.46100000000000002},"max":{"1min":0.89000000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.94599999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.82699999999999996,"15min":0.83699999999999997},"min":{"1min":0.623,"5min":0.51600000000000001,"15min":0.50800000000000001},"max":{"1min":0.94099999999999995,"5min":1.3899999999999999,"15min":1.4850000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.77600000000000002,"15min":0.80200000000000005},"min":{"1min":0.52400000000000002,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.85499999999999998,"5min":1.423,"15min":1.423},"last":0.79200000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:38:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.82399999999999995,"15min":0.83299999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.83499999999999996,"5min":1.48,"15min":1.48},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.81200000000000006,"15min":0.84699999999999998},"min":{"1min":0.56100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95899999999999996,"5min":1.496,"15min":1.496},"last":0.81399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575058,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1392640,"data_stored":701153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.46400000000000002,"15min":0.45700000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.63100000000000001,"5min":0.76800000000000002,"15min":0.871},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.68100000000000005,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.32700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.51800000000000002,"15min":0.49199999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.64800000000000002,"5min":1.5129999999999999,"15min":1.5129999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.499,"5min":0.54800000000000004,"15min":0.55600000000000005},"min":{"1min":0.38600000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.57199999999999995,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.52200000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.43099999999999999,"5min":0.40300000000000002,"15min":0.39300000000000002},"max":{"1min":0.76600000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.39100000000000001,"5min":0.378,"15min":0.34899999999999998},"max":{"1min":0.67600000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79000000000000004,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":1.129,"5min":1.129,"15min":1.3069999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.53800000000000003,"5min":0.48299999999999998,"15min":0.443},"max":{"1min":1.079,"5min":1.212,"15min":1.274},"last":0.70699999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77100000000000002,"15min":0.77600000000000002},"min":{"1min":0.56299999999999994,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0920000000000001,"5min":1.169,"15min":1.351},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77400000000000002,"15min":0.79900000000000004},"min":{"1min":0.58799999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1160000000000001,"5min":1.1479999999999999,"15min":1.242},"last":0.69299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.77300000000000002},"min":{"1min":0.51200000000000001,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.206},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.57999999999999996,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1699999999999999,"5min":1.2230000000000001,"15min":1.3799999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78800000000000003,"15min":0.80100000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.107,"5min":1.173,"15min":1.173},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.58499999999999996,"5min":0.54300000000000004,"15min":0.52000000000000002},"max":{"1min":1.1899999999999999,"5min":1.2929999999999999,"15min":1.4119999999999999},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834575058,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37104,"kb_used_data":1960,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334736,"statfs":{"total":96636764160,"available":96598769664,"internally_reserved":0,"allocated":2007040,"data_stored":1293721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.46600000000000003,"15min":0.47199999999999998},"min":{"1min":0.27300000000000002,"5min":0.25900000000000001,"15min":0.23000000000000001},"max":{"1min":0.59899999999999998,"5min":0.753,"15min":0.753},"last":0.496},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.55400000000000005},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.311},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.48499999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53800000000000003,"15min":0.52800000000000002},"min":{"1min":0.35099999999999998,"5min":0.34300000000000003,"15min":0.27500000000000002},"max":{"1min":1.8560000000000001,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54000000000000004},"min":{"1min":0.318,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.59299999999999997,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.45700000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.53100000000000003,"5min":0.52800000000000002,"15min":0.46500000000000002},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.46000000000000002,"15min":0.42299999999999999},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.002}]},{"osd":5,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.80800000000000005,"15min":0.81000000000000005},"min":{"1min":0.51700000000000002,"5min":0.49299999999999999,"15min":0.35799999999999998},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.1830000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.80700000000000005,"15min":0.80600000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.5},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":1.133},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81999999999999995,"15min":0.82099999999999995},"min":{"1min":0.60299999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.95799999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.58399999999999996,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6970000000000001,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":1.048},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80600000000000005,"15min":0.82099999999999995},"min":{"1min":0.53300000000000003,"5min":0.51000000000000001,"15min":0.48799999999999999},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:39:52.322 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:39:52.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:39:52.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.506+0000 7fb8ed89e640 1 Processor -- start 2023-07-09T21:39:52.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.506+0000 7fb8ed89e640 1 -- start start 2023-07-09T21:39:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 0x7fb8e8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 0x7fb8e80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8e80b3c20 0x7fb8e80b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80cd070 con 0x7fb8e80b3c20 2023-07-09T21:39:52.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80cfd70 con 0x7fb8e80ceb80 2023-07-09T21:39:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8ed89e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815bf80 con 0x7fb8e80b7980 2023-07-09T21:39:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8e80b3c20 0x7fb8e80b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8e80b3c20 0x7fb8e80b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54140/0 (socket says 172.21.15.37:54140) 2023-07-09T21:39:52.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 -- 172.21.15.37:0/3558294375 learned_addr learned my addr 172.21.15.37:0/3558294375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 0x7fb8e8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8dffff640 1 --2- 172.21.15.37:0/3558294375 >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 0x7fb8e80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 -- 172.21.15.37:0/3558294375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 msgr2=0x7fb8e8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 0x7fb8e8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 -- 172.21.15.37:0/3558294375 >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 msgr2=0x7fb8e80cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 --2- 172.21.15.37:0/3558294375 >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 0x7fb8e80cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e77fe640 1 -- 172.21.15.37:0/3558294375 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8160570 con 0x7fb8e80b3c20 2023-07-09T21:39:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8dffff640 1 --2- 172.21.15.37:0/3558294375 >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 0x7fb8e80cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.510+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 0x7fb8e8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:52.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8e77fe640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b3c20 0x7fb8e80b4080 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80b4ca0 tx=0x7fb8e001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4a1c0e59cb5c9d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8e67fc640 1 -- 172.21.15.37:0/3558294375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00a5650 con 0x7fb8e80b3c20 2023-07-09T21:39:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8e67fc640 1 -- 172.21.15.37:0/3558294375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e00a57b0 con 0x7fb8e80b3c20 2023-07-09T21:39:52.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8e67fc640 1 -- 172.21.15.37:0/3558294375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00a5b40 con 0x7fb8e80b3c20 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- 172.21.15.37:0/3558294375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b3c20 msgr2=0x7fb8e80b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b3c20 0x7fb8e80b4080 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80b4ca0 tx=0x7fb8e001c9d0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- 172.21.15.37:0/3558294375 shutdown_connections 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b3c20 0x7fb8e80b4080 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/3558294375 >> v2:172.21.15.119:3300/0 conn(0x7fb8e80ceb80 0x7fb8e80cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/3558294375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b7980 0x7fb8e8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- 172.21.15.37:0/3558294375 >> 172.21.15.37:0/3558294375 conn(0x7fb8e8073090 msgr2=0x7fb8e8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- 172.21.15.37:0/3558294375 shutdown_connections 2023-07-09T21:39:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- 172.21.15.37:0/3558294375 wait complete. 2023-07-09T21:39:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 Processor -- start 2023-07-09T21:39:52.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.514+0000 7fb8ed89e640 1 -- start start 2023-07-09T21:39:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 0x7fb8e815b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 0x7fb8e8151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e8151870 con 0x7fb8e80b7980 2023-07-09T21:39:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cbed0 con 0x7fb8e80ceb80 2023-07-09T21:39:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cc170 con 0x7fb8e80b3c20 2023-07-09T21:39:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54154/0 (socket says 172.21.15.37:54154) 2023-07-09T21:39:52.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 -- 172.21.15.37:0/2952770354 learned_addr learned my addr 172.21.15.37:0/2952770354 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 -- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 msgr2=0x7fb8e815b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 0x7fb8e815b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e77fe640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 0x7fb8e8151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 0x7fb8e815b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 -- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 msgr2=0x7fb8e8151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 0x7fb8e8151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 -- 172.21.15.37:0/2952770354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009b30 con 0x7fb8e80b7980 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e77fe640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 0x7fb8e8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:52.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 0x7fb8e815b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8dffff640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7c0 tx=0x7fb8d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0007a30 con 0x7fb8e80b7980 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d0007b90 con 0x7fb8e80b7980 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80cc450 con 0x7fb8e80b7980 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000ce70 con 0x7fb8e80b7980 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e815bbd0 con 0x7fb8e80b7980 2023-07-09T21:39:52.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e81519e0 con 0x7fb8e80b7980 2023-07-09T21:39:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.518+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb8d00113f0 con 0x7fb8e80b7980 2023-07-09T21:39:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.522+0000 7fb8e4ff9640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 0x7fb8c8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.522+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8d00843b0 con 0x7fb8e80b7980 2023-07-09T21:39:52.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.522+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 0x7fb8c8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.522+0000 7fb8e6ffd640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 0x7fb8c8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815b2f0 tx=0x7fb8d8008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.526+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8d00515f0 con 0x7fb8e80b7980 2023-07-09T21:39:52.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.730+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb8e804d7d0 con 0x7fb8e80b7980 2023-07-09T21:39:52.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8e4ff9640 1 -- 172.21.15.37:0/2952770354 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb8d0054c10 con 0x7fb8e80b7980 2023-07-09T21:39:52.739 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:39:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:39:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:39:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:39:52.740 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:39:52.740 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:39:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 msgr2=0x7fb8c8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 0x7fb8c8068880 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8e815b2f0 tx=0x7fb8d8008040 comp rx=0 tx=0).stop 2023-07-09T21:39:52.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 msgr2=0x7fb8e81502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000c7c0 tx=0x7fb8d000cc80 comp rx=0 tx=0).stop 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 shutdown_connections 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fb8c80663d0 0x7fb8c8068880 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8e80ceb80 0x7fb8e8151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8e80b7980 0x7fb8e81502e0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 --2- 172.21.15.37:0/2952770354 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8e80b3c20 0x7fb8e815b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 >> 172.21.15.37:0/2952770354 conn(0x7fb8e8073090 msgr2=0x7fb8e80b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 shutdown_connections 2023-07-09T21:39:52.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.738+0000 7fb8ed89e640 1 -- 172.21.15.37:0/2952770354 wait complete. 2023-07-09T21:39:52.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:39:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 Processor -- start 2023-07-09T21:39:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 -- start start 2023-07-09T21:39:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe35c0b7ab0 0x7fe35c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe35c0cef80 0x7fe35c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c0b49f0 con 0x7fe35c0b4170 2023-07-09T21:39:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c0b7e80 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe3621ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c0b4610 con 0x7fe35c0cef80 2023-07-09T21:39:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe35c0b7ab0 0x7fe35c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe35c0b7ab0 0x7fe35c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54156/0 (socket says 172.21.15.37:54156) 2023-07-09T21:39:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 -- 172.21.15.37:0/3214931122 learned_addr learned my addr 172.21.15.37:0/3214931122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35affd640 1 --2- 172.21.15.37:0/3214931122 >> v2:172.21.15.119:3300/0 conn(0x7fe35c0cef80 0x7fe35c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 -- 172.21.15.37:0/3214931122 >> v2:172.21.15.119:3300/0 conn(0x7fe35c0cef80 msgr2=0x7fe35c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 --2- 172.21.15.37:0/3214931122 >> v2:172.21.15.119:3300/0 conn(0x7fe35c0cef80 0x7fe35c0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 -- 172.21.15.37:0/3214931122 >> v1:172.21.15.119:6789/0 conn(0x7fe35c0b4170 legacy=0x7fe35c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.902+0000 7fe35b7fe640 1 -- 172.21.15.37:0/3214931122 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c0cc8a0 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe35b7fe640 1 --2- 172.21.15.37:0/3214931122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c06aa50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b4d10 tx=0x7fe34c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bee670a11cd8ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe35a7fc640 1 -- 172.21.15.37:0/3214931122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0aa430 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe35a7fc640 1 -- 172.21.15.37:0/3214931122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c0aa590 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe35a7fc640 1 -- 172.21.15.37:0/3214931122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c0aa920 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 -- 172.21.15.37:0/3214931122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0b7ab0 msgr2=0x7fe35c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 --2- 172.21.15.37:0/3214931122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c06aa50 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7fe35c0b4d10 tx=0x7fe34c01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 -- 172.21.15.37:0/3214931122 shutdown_connections 2023-07-09T21:39:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 --2- 172.21.15.37:0/3214931122 >> v2:172.21.15.119:3300/0 conn(0x7fe35c0cef80 0x7fe35c0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 --2- 172.21.15.37:0/3214931122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c06aa50 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 -- 172.21.15.37:0/3214931122 >> 172.21.15.37:0/3214931122 conn(0x7fe35c073090 msgr2=0x7fe35c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 -- 172.21.15.37:0/3214931122 shutdown_connections 2023-07-09T21:39:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.906+0000 7fe3621ac640 1 -- 172.21.15.37:0/3214931122 wait complete. 2023-07-09T21:39:52.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 Processor -- start 2023-07-09T21:39:52.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- start start 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe35c0b4170 0x7fe35c0c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c1f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c15e410 con 0x7fe35c0cef80 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c159640 con 0x7fe35c0b7ab0 2023-07-09T21:39:52.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c15e610 con 0x7fe35c0b4170 2023-07-09T21:39:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54158/0 (socket says 172.21.15.37:54158) 2023-07-09T21:39:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 -- 172.21.15.37:0/744826811 learned_addr learned my addr 172.21.15.37:0/744826811 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35affd640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c1f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35b7fe640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe35c0b4170 0x7fe35c0c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 -- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe35c0b4170 msgr2=0x7fe35c0c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe35c0b4170 0x7fe35c0c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 -- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe35c0b7ab0 msgr2=0x7fe35c1f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c1f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 -- 172.21.15.37:0/744826811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c0094d0 con 0x7fe35c0cef80 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe35bfff640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c730 tx=0x7fe35400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe354003b80 con 0x7fe35c0cef80 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe354003ce0 con 0x7fe35c0cef80 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c15e8f0 con 0x7fe35c0cef80 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35400aa30 con 0x7fe35c0cef80 2023-07-09T21:39:52.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.910+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c15eeb0 con 0x7fe35c0cef80 2023-07-09T21:39:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c04d7d0 con 0x7fe35c0cef80 2023-07-09T21:39:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe35400ab90 con 0x7fe35c0cef80 2023-07-09T21:39:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe343fff640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 0x7fe348068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe354083a80 con 0x7fe35c0cef80 2023-07-09T21:39:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe35b7fe640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 0x7fe348068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.914+0000 7fe35b7fe640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 0x7fe348068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ae000 tx=0x7fe34c0b5040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:52.918+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe354050f30 con 0x7fe35c0cef80 2023-07-09T21:39:53.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.102+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe35c071010 con 0x7fe35c0cef80 2023-07-09T21:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.102+0000 7fe343fff640 1 -- 172.21.15.37:0/744826811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fe354054550 con 0x7fe35c0cef80 2023-07-09T21:39:53.107 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:39:53.107 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:39:53.107 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:39:53.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 msgr2=0x7fe348068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 0x7fe348068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0ae000 tx=0x7fe34c0b5040 comp rx=0 tx=0).stop 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 msgr2=0x7fe35c1f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fe35400c730 tx=0x7fe35400cbf0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 shutdown_connections 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fe3480663a0 0x7fe348068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe35c0cef80 0x7fe35c1f81e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe35c0b7ab0 0x7fe35c1f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 --2- 172.21.15.37:0/744826811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe35c0b4170 0x7fe35c0c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 >> 172.21.15.37:0/744826811 conn(0x7fe35c073090 msgr2=0x7fe35c0ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 shutdown_connections 2023-07-09T21:39:53.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.106+0000 7fe3621ac640 1 -- 172.21.15.37:0/744826811 wait complete. 2023-07-09T21:39:53.531 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:39:42.620867+0000', 'modified': '2023-07-09T21:39:46.247149+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7881}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7881': {'gid': 7881, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/2299336314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6833', 'nonce': 2299336314}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2299336314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:39:53.532 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:39:53.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T21:39:53.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 Processor -- start 2023-07-09T21:39:53.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 -- start start 2023-07-09T21:39:53.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 0x7f68b40b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68b40b4140 0x7f68b40d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40cef80 con 0x7f68b40b7a60 2023-07-09T21:39:53.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40ccee0 con 0x7f68b40b4140 2023-07-09T21:39:53.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b9d74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40b45e0 con 0x7f68b40b47a0 2023-07-09T21:39:53.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68b40b4140 0x7f68b40d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68b40b4140 0x7f68b40d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54162/0 (socket says 172.21.15.37:54162) 2023-07-09T21:39:53.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.678+0000 7f68b3fff640 1 -- 172.21.15.37:0/2736807883 learned_addr learned my addr 172.21.15.37:0/2736807883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/2736807883 >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 0x7f68b40b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b3fff640 1 -- 172.21.15.37:0/2736807883 >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 msgr2=0x7f68b40b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b3fff640 1 --2- 172.21.15.37:0/2736807883 >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 0x7f68b40b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b3fff640 1 -- 172.21.15.37:0/2736807883 >> v1:172.21.15.119:6789/0 conn(0x7f68b40b7a60 legacy=0x7f68b40cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b3fff640 1 -- 172.21.15.37:0/2736807883 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40cf260 con 0x7f68b40b4140 2023-07-09T21:39:53.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/2736807883 >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 0x7f68b40b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b3fff640 1 --2- 172.21.15.37:0/2736807883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b4140 0x7f68b40d05f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f68b40c91b0 tx=0x7f68ac01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d4829804444e9d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b27fc640 1 -- 172.21.15.37:0/2736807883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5740 con 0x7f68b40b4140 2023-07-09T21:39:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b27fc640 1 -- 172.21.15.37:0/2736807883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0a58a0 con 0x7f68b40b4140 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b27fc640 1 -- 172.21.15.37:0/2736807883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0a5c30 con 0x7f68b40b4140 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b9d74640 1 -- 172.21.15.37:0/2736807883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b4140 msgr2=0x7f68b40d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.682+0000 7f68b9d74640 1 --2- 172.21.15.37:0/2736807883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b4140 0x7f68b40d05f0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f68b40c91b0 tx=0x7f68ac01c990 comp rx=0 tx=0).stop 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- 172.21.15.37:0/2736807883 shutdown_connections 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 --2- 172.21.15.37:0/2736807883 >> v2:172.21.15.119:3300/0 conn(0x7f68b40b47a0 0x7f68b40b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 --2- 172.21.15.37:0/2736807883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b4140 0x7f68b40d05f0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- 172.21.15.37:0/2736807883 >> 172.21.15.37:0/2736807883 conn(0x7f68b4073050 msgr2=0x7f68b4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- 172.21.15.37:0/2736807883 shutdown_connections 2023-07-09T21:39:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- 172.21.15.37:0/2736807883 wait complete. 2023-07-09T21:39:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 Processor -- start 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- start start 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 0x7f68b40c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 0x7f68b4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40cc1a0 con 0x7f68b40b7a60 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415c210 con 0x7f68b40b47a0 2023-07-09T21:39:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b9d74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415c4f0 con 0x7f68b40b4140 2023-07-09T21:39:53.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54164/0 (socket says 172.21.15.37:54164) 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 -- 172.21.15.37:0/1950909991 learned_addr learned my addr 172.21.15.37:0/1950909991 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 0x7f68b4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b37fe640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 0x7f68b40c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 -- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 msgr2=0x7f68b40c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 0x7f68b40c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 -- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 msgr2=0x7f68b4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 0x7f68b4151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 -- 172.21.15.37:0/1950909991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac009b30 con 0x7f68b40b7a60 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 0x7f68b4151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b37fe640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 0x7f68b40c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.686+0000 7f68b3fff640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0af040 tx=0x7f68ac019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 -- 172.21.15.37:0/1950909991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0b8670 con 0x7f68b40b7a60 2023-07-09T21:39:53.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 -- 172.21.15.37:0/1950909991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0b87d0 con 0x7f68b40b7a60 2023-07-09T21:39:53.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 -- 172.21.15.37:0/1950909991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0b8b80 con 0x7f68b40b7a60 2023-07-09T21:39:53.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b415c7d0 con 0x7f68b40b7a60 2023-07-09T21:39:53.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41524a0 con 0x7f68b40b7a60 2023-07-09T21:39:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 -- 172.21.15.37:0/1950909991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f68ac0b8ce0 con 0x7f68b40b7a60 2023-07-09T21:39:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 0x7f68a0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f689bfff640 1 -- 172.21.15.37:0/1950909991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68ac11f5b0 con 0x7f68b40b7a60 2023-07-09T21:39:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f68b37fe640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 0x7f68a0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f68bd0f4000 1 Processor -- start 2023-07-09T21:39:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.690+0000 7f68bd0f4000 1 -- start start 2023-07-09T21:39:53.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b37fe640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 0x7f68a0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68a400a850 tx=0x7f68a4008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043808800 0x564043808bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640437bef90 0x5640437bf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x564043685f80 con 0x564043809110 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640435bfc60 con 0x5640437bef90 2023-07-09T21:39:53.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x564043613700 con 0x564043808800 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54176/0 (socket says 172.21.15.37:54176) 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 -- 172.21.15.37:0/3380698643 learned_addr learned my addr 172.21.15.37:0/3380698643 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b37fe640 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043808800 0x564043808bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640437bef90 0x5640437bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 -- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043808800 msgr2=0x564043808bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043808800 0x564043808bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 -- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640437bef90 msgr2=0x5640437bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640437bef90 0x5640437bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 -- 172.21.15.37:0/3380698643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564043308890 con 0x564043809110 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f68a800ba50 tx=0x7f68a800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0d34579d9aea56 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68997fa640 1 -- 172.21.15.37:0/3380698643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800dd10 con 0x564043809110 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68997fa640 1 -- 172.21.15.37:0/3380698643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800c040 con 0x564043809110 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68997fa640 1 -- 172.21.15.37:0/3380698643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8012680 con 0x564043809110 2023-07-09T21:39:53.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3380698643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 msgr2=0x5640437bea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f68a800ba50 tx=0x7f68a800bf10 comp rx=0 tx=0).stop 2023-07-09T21:39:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3380698643 shutdown_connections 2023-07-09T21:39:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5640437bef90 0x5640437bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640437bea50 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3380698643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043808800 0x564043808bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3380698643 >> 172.21.15.37:0/3380698643 conn(0x564043681a70 msgr2=0x5640437bd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3380698643 shutdown_connections 2023-07-09T21:39:53.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3380698643 wait complete. 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 -- start start 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.694+0000 7f68bd0f4000 1 Processor -- start 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x5640437ca120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 0x5640437ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56404360c7a0 con 0x5640437bef90 2023-07-09T21:39:53.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640435c8f00 con 0x564043808800 2023-07-09T21:39:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640435c8ba0 con 0x564043809110 2023-07-09T21:39:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 10 client.0 _ll_register_callbacks cb 0x5640437aa930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:39:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54184/0 (socket says 172.21.15.37:54184) 2023-07-09T21:39:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 -- 172.21.15.37:0/212792779 learned_addr learned my addr 172.21.15.37:0/212792779 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x5640437ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 -- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 msgr2=0x5640437ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b3fff640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 0x5640437ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 0x5640437ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 -- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 msgr2=0x5640437ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x5640437ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 -- 172.21.15.37:0/212792779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68a800b680 con 0x5640437bef90 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x5640437ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b3fff640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 0x5640437ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b37fe640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f68a400cf80 tx=0x7f68a4004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e03e548cb765b32 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:39:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a401f600 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68a401f760 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56404360b0f0 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68a401f920 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 10 client.8055 fetch_fsmap learned FSMap version 48 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x5640435d1130 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56404360b0f0 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68a401e070 con 0x5640437bef90 2023-07-09T21:39:53.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 10 client.8055 fetch_fsmap finished waiting for FSMap version 48 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 10 client.8055 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 20 client.8055 populate_metadata read hostname 'smithi037' 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043817870 0x564043819c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 4 client.8055 mds_command: new command op to 7881 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 --> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640435d3e40 con 0x564043817870 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043817870 0x564043819c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043817870 0x564043819c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5c3ea684bc62c1 server_cookie=e4a64d3ab19aff15 in_seq=0 out_seq=0 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.698+0000 7f68927fc640 10 client.8055 ms_handle_connect on v2:172.21.15.37:6833/2299336314 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68927fc640 1 -- 172.21.15.37:0/212792779 <== mds.0 v2:172.21.15.37:6833/2299336314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5640435d3e40 con 0x564043817870 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68927fc640 10 client.8055 handle_command_reply: tid=0 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 client.8055 shutdown 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 msgr2=0x5640437c9be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f68a400cf80 tx=0x7f68a4004700 comp rx=0 tx=0).stop 2023-07-09T21:39:53.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 shutdown_connections 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x564043809110 0x5640437ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x5640437ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043817870 0x564043819c50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/212792779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5640437bef90 0x5640437c9be0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68927fc640 0 client.8055 ms_handle_reset on v2:172.21.15.37:6833/2299336314 2023-07-09T21:39:53.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 >> 172.21.15.37:0/212792779 conn(0x564043681a70 msgr2=0x5640437bda30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 shutdown_connections 2023-07-09T21:39:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 1 -- 172.21.15.37:0/212792779 wait complete. 2023-07-09T21:39:53.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.702+0000 7f68bd0f4000 20 client.8055 trim_cache size 0 max 16384 2023-07-09T21:39:53.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 Processor -- start 2023-07-09T21:39:53.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- start start 2023-07-09T21:39:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x56404381b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x56404381b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640432c9940 con 0x564043809110 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640437c1d60 con 0x564043808800 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x56404364fc80 con 0x5640437bef90 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54198/0 (socket says 172.21.15.37:54198) 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 -- 172.21.15.37:0/3348023412 learned_addr learned my addr 172.21.15.37:0/3348023412 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 -- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 msgr2=0x56404381b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x56404381b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 -- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 msgr2=0x56404381b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x56404381b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 -- 172.21.15.37:0/3348023412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640435b73c0 con 0x564043809110 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f68ac01cf00 tx=0x7f68ac0f6040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a904382207ab3b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f6899ffb640 1 -- 172.21.15.37:0/3348023412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac11dae0 con 0x564043809110 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f6899ffb640 1 -- 172.21.15.37:0/3348023412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0eea60 con 0x564043809110 2023-07-09T21:39:53.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f6899ffb640 1 -- 172.21.15.37:0/3348023412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac0efd30 con 0x564043809110 2023-07-09T21:39:53.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3348023412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 msgr2=0x5640438035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f68ac01cf00 tx=0x7f68ac0f6040 comp rx=0 tx=0).stop 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3348023412 shutdown_connections 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x5640438035c0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x56404381b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3348023412 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x56404381b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3348023412 >> 172.21.15.37:0/3348023412 conn(0x564043681a70 msgr2=0x564043819c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3348023412 shutdown_connections 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3348023412 wait complete. 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.718+0000 7f68bd0f4000 1 -- start start 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 Processor -- start 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x564043866010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x564043866550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640437beab0 con 0x564043809110 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640435db230 con 0x564043808800 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640435db740 con 0x5640437bef90 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 10 client.0 _ll_register_callbacks cb 0x56404378b4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54202/0 (socket says 172.21.15.37:54202) 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 -- 172.21.15.37:0/3546649182 learned_addr learned my addr 172.21.15.37:0/3546649182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b37fe640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x564043866010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x564043866550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 -- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 msgr2=0x564043866010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x564043866010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 -- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 msgr2=0x564043866550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x564043866550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 -- 172.21.15.37:0/3546649182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b41524a0 con 0x564043809110 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b37fe640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x564043866010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b2ffd640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x564043866550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b3fff640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0f00d0 tx=0x7f68ac11f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d97a2b006166d10 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac10b070 con 0x564043809110 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f68ac0f86d0 con 0x564043809110 2023-07-09T21:39:53.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640437c28c0 con 0x564043809110 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ac11dae0 con 0x564043809110 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 10 client.8061 fetch_fsmap learned FSMap version 48 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x564043308cc0 con 0x564043809110 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640437c28c0 con 0x564043809110 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 48) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f68ac005d20 con 0x564043809110 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 10 client.8061 fetch_fsmap finished waiting for FSMap version 48 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 10 client.8061 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:39:53.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 20 client.8061 populate_metadata read hostname 'smithi037' 2023-07-09T21:39:53.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043806bb0 0x564043806f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 4 client.8061 mds_command: new command op to 7881 tid=0[{"prefix": "status"}] 2023-07-09T21:39:53.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 --> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5640435c56f0 con 0x564043806bb0 2023-07-09T21:39:53.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b37fe640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043806bb0 0x564043806f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68b37fe640 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043806bb0 0x564043806f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb756113209e8c26 server_cookie=b2634fb1627fa1fb in_seq=0 out_seq=0 2023-07-09T21:39:53.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 10 client.8061 ms_handle_connect on v2:172.21.15.37:6833/2299336314 2023-07-09T21:39:53.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 1 -- 172.21.15.37:0/3546649182 <== mds.0 v2:172.21.15.37:6833/2299336314 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5640435c56f0 con 0x564043806bb0 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 10 client.8061 handle_command_reply: tid=0 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 client.8061 shutdown 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 msgr2=0x564043806220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0f00d0 tx=0x7f68ac11f040 comp rx=0 tx=0).stop 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 shutdown_connections 2023-07-09T21:39:53.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:6833/2299336314,v1:172.21.15.37:6835/2299336314] conn(0x564043806bb0 0x564043806f80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564043809110 0x564043806220 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x564043808800 0x564043866550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 --2- 172.21.15.37:0/3546649182 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5640437bef90 0x564043866010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68927fc640 0 client.8061 ms_handle_reset on v2:172.21.15.37:6833/2299336314 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 >> 172.21.15.37:0/3546649182 conn(0x564043681a70 msgr2=0x56404381a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 shutdown_connections 2023-07-09T21:39:53.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.722+0000 7f68bd0f4000 1 -- 172.21.15.37:0/3546649182 wait complete. 2023-07-09T21:39:53.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68bd0f4000 20 client.8061 trim_cache size 0 max 16384 2023-07-09T21:39:53.736 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:39:53.736 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:39:53.736 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:39:53.736 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 7881, 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.499170153, 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 48, 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 113, 2023-07-09T21:39:53.737 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 113, 2023-07-09T21:39:53.738 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.437936886999999 2023-07-09T21:39:53.738 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 msgr2=0x7f68a0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 0x7f68a0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68a400a850 tx=0x7f68a4008040 comp rx=0 tx=0).stop 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 msgr2=0x7f68b415cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f68ac0af040 tx=0x7f68ac019730 comp rx=0 tx=0).stop 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 shutdown_connections 2023-07-09T21:39:53.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f68a00663a0 0x7f68a0068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68b40b7a60 0x7f68b415cfd0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f68b40b47a0 0x7f68b4151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 --2- 172.21.15.37:0/1950909991 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f68b40b4140 0x7f68b40c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 >> 172.21.15.37:0/1950909991 conn(0x7f68b4073050 msgr2=0x7f68b40b2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 shutdown_connections 2023-07-09T21:39:53.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.726+0000 7f68b9d74640 1 -- 172.21.15.37:0/1950909991 wait complete. 2023-07-09T21:39:53.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:39:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.886+0000 7fbf20456640 1 Processor -- start 2023-07-09T21:39:53.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.886+0000 7fbf20456640 1 -- start start 2023-07-09T21:39:53.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf20456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf20456640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf180aff40 0x7fbf1815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf20456640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1806efc0 con 0x7fbf1806b120 2023-07-09T21:39:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf20456640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1806d390 con 0x7fbf180aff40 2023-07-09T21:39:53.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf20456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1806f4f0 con 0x7fbf18158670 2023-07-09T21:39:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1d9f1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbf1806b120 0x7fbf180af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40476/0 (socket says 172.21.15.37:40476) 2023-07-09T21:39:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1d9f1640 1 -- 172.21.15.37:0/1938869967 learned_addr learned my addr 172.21.15.37:0/1938869967 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:53.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 --2- 172.21.15.37:0/1938869967 >> v2:172.21.15.37:3300/0 conn(0x7fbf180aff40 0x7fbf1815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e1f2640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 -- 172.21.15.37:0/1938869967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 msgr2=0x7fbf180ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 -- 172.21.15.37:0/1938869967 >> v1:172.21.15.37:6789/0 conn(0x7fbf1806b120 legacy=0x7fbf180af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 -- 172.21.15.37:0/1938869967 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1806fe90 con 0x7fbf180aff40 2023-07-09T21:39:53.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1d1f0640 1 -- 172.21.15.37:0/1938869967 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029726344 0 0) 0x7fbf1806efc0 con 0x7fbf1806b120 2023-07-09T21:39:53.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.890+0000 7fbf1e9f3640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180aff40 0x7fbf1815c1d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ea1715877d789b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1d1f0640 1 -- 172.21.15.37:0/1938869967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf100a5950 con 0x7fbf180aff40 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1d1f0640 1 -- 172.21.15.37:0/1938869967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf100a5ab0 con 0x7fbf180aff40 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1d1f0640 1 -- 172.21.15.37:0/1938869967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf100a5e40 con 0x7fbf180aff40 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- 172.21.15.37:0/1938869967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180aff40 msgr2=0x7fbf1815c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180aff40 0x7fbf1815c1d0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009d90 tx=0x7fbf1001c890 comp rx=0 tx=0).stop 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- 172.21.15.37:0/1938869967 shutdown_connections 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf180aff40 0x7fbf1815c1d0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- 172.21.15.37:0/1938869967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- 172.21.15.37:0/1938869967 >> 172.21.15.37:0/1938869967 conn(0x7fbf180ca830 msgr2=0x7fbf180cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- 172.21.15.37:0/1938869967 shutdown_connections 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- 172.21.15.37:0/1938869967 wait complete. 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 Processor -- start 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- start start 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 0x7fbf180c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180c3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c42c0 con 0x7fbf1806b120 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c3740 con 0x7fbf180aff40 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf20456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf1815ba70 con 0x7fbf18158670 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1e1f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1e1f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54220/0 (socket says 172.21.15.37:54220) 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.894+0000 7fbf1e1f2640 1 -- 172.21.15.37:0/2490166404 learned_addr learned my addr 172.21.15.37:0/2490166404 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e9f3640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1d9f1640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 0x7fbf180c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 -- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 msgr2=0x7fbf180c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 -- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 msgr2=0x7fbf180c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 0x7fbf180c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 -- 172.21.15.37:0/2490166404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10009a70 con 0x7fbf1806b120 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1d9f1640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 0x7fbf180c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:53.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf1e1f2640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400d830 tx=0x7fbf1400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400b6c0 con 0x7fbf1806b120 2023-07-09T21:39:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1400b860 con 0x7fbf1806b120 2023-07-09T21:39:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1400bc10 con 0x7fbf1806b120 2023-07-09T21:39:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180c3990 con 0x7fbf1806b120 2023-07-09T21:39:53.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180c3f50 con 0x7fbf1806b120 2023-07-09T21:39:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1804d7d0 con 0x7fbf1806b120 2023-07-09T21:39:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf1401e460 con 0x7fbf1806b120 2023-07-09T21:39:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 0x7fbefc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.898+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbf140847f0 con 0x7fbf1806b120 2023-07-09T21:39:53.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.902+0000 7fbf1d9f1640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 0x7fbefc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.902+0000 7fbf1d9f1640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 0x7fbefc068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf08007fd0 tx=0x7fbf08009040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:53.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:53.902+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf14051a30 con 0x7fbf1806b120 2023-07-09T21:39:54.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.090+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf180c8660 con 0x7fbf1806b120 2023-07-09T21:39:54.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.090+0000 7fbf0effd640 1 -- 172.21.15.37:0/2490166404 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbf14055050 con 0x7fbf1806b120 2023-07-09T21:39:54.095 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:39:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 msgr2=0x7fbefc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 0x7fbefc068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf08007fd0 tx=0x7fbf08009040 comp rx=0 tx=0).stop 2023-07-09T21:39:54.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 msgr2=0x7fbf1815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fbf1400d830 tx=0x7fbf1400dcf0 comp rx=0 tx=0).stop 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 shutdown_connections 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7fbefc0663a0 0x7fbefc068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbf18158670 0x7fbf180c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbf180aff40 0x7fbf180c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:54.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 --2- 172.21.15.37:0/2490166404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf1806b120 0x7fbf1815b440 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:54.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 >> 172.21.15.37:0/2490166404 conn(0x7fbf180ca830 msgr2=0x7fbf180cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:54.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 shutdown_connections 2023-07-09T21:39:54.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:54.094+0000 7fbf20456640 1 -- 172.21.15.37:0/2490166404 wait complete. 2023-07-09T21:39:54.115 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:39:54.116 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:39:54.116 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:39:54.117 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:39:54.117 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:54.117 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:39:54.117 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:39:54.118 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:39:54.118 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:54.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.119 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:39:54.130 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:39:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:39:54.130 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:39:54.131 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:39:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41409sec preferred_lft 41409sec 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.133 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.134 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:39:54.135 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:39:54.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.136 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:39:54.195 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:39:54.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.198 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:39:54.248 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:39:54.249 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:39:54.249 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:39:54.249 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:39:54.249 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:39:54.249 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:39:54.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.250 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:39:54.251 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:39:54.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:39:54.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:39:54.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:39:54.252 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:39:54.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.345 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:39:54.354 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:39:54.354 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:39:54.355 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:54.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.356 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:39:54.424 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:39:54.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:39:54.425 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:54.475 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:39:54.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:39:54.476 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:54.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:39:54.597 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:39:54.598 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:39:54.658 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:39:54.659 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:39:54.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.661 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:39:54.711 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:39:54.712 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:39:54.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:39:54.779 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:39:54.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:39:54.842 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:39:54.844 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:39:54.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:54.846 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:39:54.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:39:54.854+0000 7f496490a580 -1 init, newargv = 0x55db3f265120 newargc=15 2023-07-09T21:39:54.858 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[57460]: starting ceph client 2023-07-09T21:39:54.864 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[57460]: starting fuse 2023-07-09T21:39:54.866 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:39:54.866 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:39:54.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:39:54.867 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:39:54.867 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:39:54.868 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:39:54.868 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:39:54.868 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:54.869 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:39:54.869 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:39:54.869 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:39:54.870 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:39:54.870 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:54.870 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:39:54.871 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:39:54.871 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:39:54.871 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:39:54.871 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:54.872 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:39:54.872 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:39:54.872 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:39:54.873 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:39:54.873 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:39:54.874 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:39:54.874 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:39:54.874 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:39:54.875 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:39:54.875 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:39:54.875 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:39:54.989 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.57460.asok 2023-07-09T21:39:55.173 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57460.asok 2023-07-09T21:39:55.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:55.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57460.asok status 2023-07-09T21:39:55.348 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:39:55.348 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:39:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:39:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:39:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:39:55.349 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:39:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:39:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "57460", 2023-07-09T21:39:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:39:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:55.350 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8076, 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 8076 2023-07-09T21:39:55.351 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 641468524 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:55.352 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:39:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:39:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:39:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 641468524 2023-07-09T21:39:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:39:55.353 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.8076 192.168.0.1:0/641468524", 2023-07-09T21:39:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/641468524", 2023-07-09T21:39:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:39:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 48, 2023-07-09T21:39:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 113, 2023-07-09T21:39:55.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:39:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:39:55.355 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:39:55.355 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:39:55.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:55.366 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:39:55.366 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:55.376 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:39:55.377 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:55.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:39:55.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:39:55.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:39:55.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 Processor -- start 2023-07-09T21:39:55.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 -- start start 2023-07-09T21:39:55.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f49640b7a60 0x7f49640cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640cef80 con 0x7f49640b4140 2023-07-09T21:39:55.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640b45b0 con 0x7f49640b7a60 2023-07-09T21:39:55.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4968d0d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640cf260 con 0x7f49640b47a0 2023-07-09T21:39:55.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4962d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f49640b4140 0x7f496415f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40480/0 (socket says 172.21.15.37:40480) 2023-07-09T21:39:55.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4962d9d640 1 -- 172.21.15.37:0/3951992143 learned_addr learned my addr 172.21.15.37:0/3951992143 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:55.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496259c640 1 --2- 172.21.15.37:0/3951992143 >> v2:172.21.15.119:3300/0 conn(0x7f49640b7a60 0x7f49640cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4961d9b640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496159a640 1 -- 172.21.15.37:0/3951992143 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012110306 0 0) 0x7f49640cef80 con 0x7f49640b4140 2023-07-09T21:39:55.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496159a640 1 -- 172.21.15.37:0/3951992143 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c003530 con 0x7f49640b4140 2023-07-09T21:39:55.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496259c640 1 -- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 msgr2=0x7f49640b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:55.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496259c640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49640b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496259c640 1 -- 172.21.15.37:0/3951992143 >> v1:172.21.15.37:6789/0 conn(0x7f49640b4140 legacy=0x7f496415f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f496259c640 1 -- 172.21.15.37:0/3951992143 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640cf540 con 0x7f49640b7a60 2023-07-09T21:39:55.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.626+0000 7f4961d9b640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49640b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:55.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f496259c640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49640cc7d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f49540097c0 tx=0x7f495401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=822db7b9863d5932 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:55.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f496159a640 1 -- 172.21.15.37:0/3951992143 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540ab600 con 0x7f49640b7a60 2023-07-09T21:39:55.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f496159a640 1 -- 172.21.15.37:0/3951992143 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49540a7050 con 0x7f49640b7a60 2023-07-09T21:39:55.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f496159a640 1 -- 172.21.15.37:0/3951992143 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540ab960 con 0x7f49640b7a60 2023-07-09T21:39:55.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 -- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 msgr2=0x7f49640cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49640cc7d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f49540097c0 tx=0x7f495401c480 comp rx=0 tx=0).stop 2023-07-09T21:39:55.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 -- 172.21.15.37:0/3951992143 shutdown_connections 2023-07-09T21:39:55.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49640b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 --2- 172.21.15.37:0/3951992143 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49640cc7d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 -- 172.21.15.37:0/3951992143 >> 172.21.15.37:0/3951992143 conn(0x7f4964073050 msgr2=0x7f4964069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:55.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 -- 172.21.15.37:0/3951992143 shutdown_connections 2023-07-09T21:39:55.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.630+0000 7f4968d0d640 1 -- 172.21.15.37:0/3951992143 wait complete. 2023-07-09T21:39:55.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 Processor -- start 2023-07-09T21:39:55.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- start start 2023-07-09T21:39:55.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49641551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49641605a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4964156520 con 0x7f49640b4140 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ccae0 con 0x7f49640b7a60 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640cc280 con 0x7f49640b47a0 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54232/0 (socket says 172.21.15.37:54232) 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 -- 172.21.15.37:0/2811485285 learned_addr learned my addr 172.21.15.37:0/2811485285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4962d9d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49641605a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4961d9b640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49641551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 -- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 msgr2=0x7f49641551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49641551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 -- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 msgr2=0x7f49641605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49641605a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 -- 172.21.15.37:0/2811485285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4958009420 con 0x7f49640b4140 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4961d9b640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49641551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f496259c640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f495401a0b0 tx=0x7f4954019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540ba070 con 0x7f49640b4140 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49540abcf0 con 0x7f49640b4140 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49540b4620 con 0x7f49640b4140 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4954009420 con 0x7f49640b4140 2023-07-09T21:39:55.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.634+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640cc800 con 0x7f49640b4140 2023-07-09T21:39:55.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49640cdaa0 con 0x7f49640b4140 2023-07-09T21:39:55.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f49540b2040 con 0x7f49640b4140 2023-07-09T21:39:55.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4952ffd640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 0x7f4944068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f495411d570 con 0x7f49640b4140 2023-07-09T21:39:55.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4961d9b640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 0x7f4944068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.638+0000 7f4961d9b640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 0x7f4944068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49640b4110 tx=0x7f4958008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:55.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.642+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49540ea7c0 con 0x7f49640b4140 2023-07-09T21:39:55.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.814+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f49641688d0 con 0x7f49440663d0 2023-07-09T21:39:55.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4952ffd640 1 -- 172.21.15.37:0/2811485285 <== mgr.7315 v2:172.21.15.119:6832/2505789332 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f49580098f0 con 0x7f49440663d0 2023-07-09T21:39:55.821 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:39:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:39:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:39:55.821 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:39:55.821 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:39:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 msgr2=0x7f4944068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 0x7f4944068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f49640b4110 tx=0x7f4958008040 comp rx=0 tx=0).stop 2023-07-09T21:39:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 msgr2=0x7f4964158010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f495401a0b0 tx=0x7f4954019220 comp rx=0 tx=0).stop 2023-07-09T21:39:55.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 shutdown_connections 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f49440663d0 0x7f4944068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49640b7a60 0x7f49641605a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49640b47a0 0x7f49641551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 --2- 172.21.15.37:0/2811485285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49640b4140 0x7f4964158010 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 >> 172.21.15.37:0/2811485285 conn(0x7f4964073050 msgr2=0x7f49640b6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 shutdown_connections 2023-07-09T21:39:55.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.818+0000 7f4968d0d640 1 -- 172.21.15.37:0/2811485285 wait complete. 2023-07-09T21:39:55.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:39:55.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.982+0000 7f5432c9c640 1 Processor -- start 2023-07-09T21:39:55.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 -- start start 2023-07-09T21:39:55.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f542c0b7980 0x7f542c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 0x7f542c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c15bf80 con 0x7f542c0b3c20 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0cd070 con 0x7f542c0b7980 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5432c9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c0cfd70 con 0x7f542c0ceb80 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5430a38640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f542c0b7980 0x7f542c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f542bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 0x7f542c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f542bfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 0x7f542c0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:44152/0 (socket says 172.21.15.37:44152) 2023-07-09T21:39:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f542bfff640 1 -- 172.21.15.37:0/148538528 learned_addr learned my addr 172.21.15.37:0/148538528 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5430a38640 1 -- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 msgr2=0x7f542c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:55.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5430a38640 1 --2- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 0x7f542c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5430a38640 1 -- 172.21.15.37:0/148538528 >> v1:172.21.15.119:6789/0 conn(0x7f542c0b3c20 legacy=0x7f542c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f5430a38640 1 -- 172.21.15.37:0/148538528 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c160570 con 0x7f542c0b7980 2023-07-09T21:39:55.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.986+0000 7f542b7fe640 1 -- 172.21.15.37:0/148538528 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 791476688 0 0) 0x7f54240014a0 con 0x7f542c0b3c20 2023-07-09T21:39:55.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5430a38640 1 --2- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0b7980 0x7f542c160030 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f54200097c0 tx=0x7f542001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8abecd5fbe44268 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:55.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f542b7fe640 1 -- 172.21.15.37:0/148538528 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200ab600 con 0x7f542c0b7980 2023-07-09T21:39:55.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f542b7fe640 1 -- 172.21.15.37:0/148538528 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200a7050 con 0x7f542c0b7980 2023-07-09T21:39:55.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f542b7fe640 1 -- 172.21.15.37:0/148538528 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200ab980 con 0x7f542c0b7980 2023-07-09T21:39:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 -- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0b7980 msgr2=0x7f542c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 --2- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0b7980 0x7f542c160030 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f54200097c0 tx=0x7f542001c480 comp rx=0 tx=0).stop 2023-07-09T21:39:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 -- 172.21.15.37:0/148538528 shutdown_connections 2023-07-09T21:39:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 --2- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0ceb80 0x7f542c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 --2- 172.21.15.37:0/148538528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0b7980 0x7f542c160030 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 -- 172.21.15.37:0/148538528 >> 172.21.15.37:0/148538528 conn(0x7f542c073090 msgr2=0x7f542c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 -- 172.21.15.37:0/148538528 shutdown_connections 2023-07-09T21:39:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.990+0000 7f5432c9c640 1 -- 172.21.15.37:0/148538528 wait complete. 2023-07-09T21:39:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 Processor -- start 2023-07-09T21:39:55.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- start start 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 0x7f542c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 0x7f542c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c153850 con 0x7f542c0b3c20 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c153aa0 con 0x7f542c0ceb80 2023-07-09T21:39:55.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c153d80 con 0x7f542c0b7980 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54234/0 (socket says 172.21.15.37:54234) 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 -- 172.21.15.37:0/3764729579 learned_addr learned my addr 172.21.15.37:0/3764729579 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f542bfff640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 0x7f542c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 -- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 msgr2=0x7f542c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 0x7f542c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 -- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 msgr2=0x7f542c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:55.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5431239640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 0x7f542c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 0x7f542c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 -- 172.21.15.37:0/3764729579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420009420 con 0x7f542c0b3c20 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f542bfff640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 0x7f542c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5431239640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 0x7f542c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5430a38640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f542001a0b0 tx=0x7f5420019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200b4610 con 0x7f542c0b3c20 2023-07-09T21:39:56.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54200b4790 con 0x7f542c0b3c20 2023-07-09T21:39:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c154060 con 0x7f542c0b3c20 2023-07-09T21:39:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54200b4b40 con 0x7f542c0b3c20 2023-07-09T21:39:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c0ca8c0 con 0x7f542c0b3c20 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.994+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c04d7d0 con 0x7f542c0b3c20 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.998+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 40) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f54200b2040 con 0x7f542c0b3c20 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.998+0000 7f54297fa640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 0x7f5410068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.998+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f542011e220 con 0x7f542c0b3c20 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.998+0000 7f542bfff640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 0x7f5410068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:56.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:55.998+0000 7f542bfff640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 0x7f5410068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f542c152df0 tx=0x7f5418008040 comp rx=0 tx=0).ready entity=mgr.7315 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:56.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:56.002+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54200eb3e0 con 0x7f542c0b3c20 2023-07-09T21:39:56.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:56.194+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f542c160570 con 0x7f542c0b3c20 2023-07-09T21:39:57.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.150+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f54200eb7b0 con 0x7f542c0b3c20 2023-07-09T21:39:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.150+0000 7f54297fa640 1 -- 172.21.15.37:0/3764729579 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v41) v1 ==== 92+0+0 (secure 0 0 0) 0x7f5420104f10 con 0x7f542c0b3c20 2023-07-09T21:39:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 msgr2=0x7f5410068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 0x7f5410068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f542c152df0 tx=0x7f5418008040 comp rx=0 tx=0).stop 2023-07-09T21:39:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 msgr2=0x7f542c15c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f542001a0b0 tx=0x7f5420019220 comp rx=0 tx=0).stop 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 shutdown_connections 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f54100663a0 0x7f5410068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f542c0ceb80 0x7f542c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f542c0b7980 0x7f542c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 --2- 172.21.15.37:0/3764729579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f542c0b3c20 0x7f542c15c120 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 >> 172.21.15.37:0/3764729579 conn(0x7f542c073090 msgr2=0x7f542c0b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 shutdown_connections 2023-07-09T21:39:57.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.154+0000 7f5432c9c640 1 -- 172.21.15.37:0/3764729579 wait complete. 2023-07-09T21:39:57.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:39:57.328 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:57.333+0000 7f26bf3c2180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 Processor -- start 2023-07-09T21:39:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 -- start start 2023-07-09T21:39:57.337 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:57.334+0000 7fe7de14f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:39:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7415bf80 con 0x7f1f740d0780 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f74160570 con 0x7f1f740ceb80 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7beec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740cd070 con 0x7f1f740b7980 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7a489640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1f740d0780 0x7f1f740d0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54340/0 (socket says 172.21.15.37:54340) 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f7a489640 1 -- 172.21.15.37:0/2821726580 learned_addr learned my addr 172.21.15.37:0/2821726580 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:39:57.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f79c88640 1 --2- 172.21.15.37:0/2821726580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338320629 0 0) 0x7f1f6c0014a0 con 0x7f1f740d0780 2023-07-09T21:39:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f60003530 con 0x7f1f740d0780 2023-07-09T21:39:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f79c88640 1 -- 172.21.15.37:0/2821726580 >> v1:172.21.15.119:6789/0 conn(0x7f1f740ceb80 legacy=0x7f1f740cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416943193 0 0) 0x7f1f64001120 con 0x7f1f740ceb80 2023-07-09T21:39:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f79c88640 1 -- 172.21.15.37:0/2821726580 >> v1:172.21.15.37:6789/0 conn(0x7f1f740d0780 legacy=0x7f1f740d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.334+0000 7f1f79c88640 1 -- 172.21.15.37:0/2821726580 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740d02f0 con 0x7f1f740b7980 2023-07-09T21:39:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f79c88640 1 --2- 172.21.15.37:0/2821726580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74160030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f700097f0 tx=0x7f1f7001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47697a1b1dfa6ca7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700ab600 con 0x7f1f740b7980 2023-07-09T21:39:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f700a7050 con 0x7f1f740b7980 2023-07-09T21:39:57.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f78c86640 1 -- 172.21.15.37:0/2821726580 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f700ab980 con 0x7f1f740b7980 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 -- 172.21.15.37:0/2821726580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 msgr2=0x7f1f74160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 --2- 172.21.15.37:0/2821726580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74160030 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1f700097f0 tx=0x7f1f7001c4c0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 -- 172.21.15.37:0/2821726580 shutdown_connections 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 --2- 172.21.15.37:0/2821726580 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74160030 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 -- 172.21.15.37:0/2821726580 >> 172.21.15.37:0/2821726580 conn(0x7f1f74073090 msgr2=0x7f1f74069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 -- 172.21.15.37:0/2821726580 shutdown_connections 2023-07-09T21:39:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.338+0000 7f1f7beec640 1 -- 172.21.15.37:0/2821726580 wait complete. 2023-07-09T21:39:57.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 Processor -- start 2023-07-09T21:39:57.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- start start 2023-07-09T21:39:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740d0780 0x7f1f7414f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f740ca500 con 0x7f1f740ceb80 2023-07-09T21:39:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74155b70 con 0x7f1f740d0780 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f74155e50 con 0x7f1f740b7980 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49008/0 (socket says 172.21.15.37:49008) 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 -- 172.21.15.37:0/629447581 learned_addr learned my addr 172.21.15.37:0/629447581 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79c88640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7a489640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740d0780 0x7f1f7414f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 -- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 msgr2=0x7f1f74153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 -- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740d0780 msgr2=0x7f1f7414f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740d0780 0x7f1f7414f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 -- 172.21.15.37:0/629447581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f70009420 con 0x7f1f740ceb80 2023-07-09T21:39:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79c88640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:57.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f79487640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c750 tx=0x7f1f6400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64005270 con 0x7f1f740ceb80 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640053f0 con 0x7f1f740ceb80 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f74156130 con 0x7f1f740ceb80 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400a880 con 0x7f1f740ceb80 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.342+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f74150c60 con 0x7f1f740ceb80 2023-07-09T21:39:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f7404d7d0 con 0x7f1f740ceb80 2023-07-09T21:39:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f1f6400a9e0 con 0x7f1f740ceb80 2023-07-09T21:39:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f6a7fc640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 0x7f1f580688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1f64083380 con 0x7f1f740ceb80 2023-07-09T21:39:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f79c88640 1 -- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 msgr2=0x7f1f580688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.346+0000 7f1f79c88640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 0x7f1f580688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:57.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.350+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f64050700 con 0x7f1f740ceb80 2023-07-09T21:39:57.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.506+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f1f74160570 con 0x7f1f740ceb80 2023-07-09T21:39:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f6a7fc640 1 -- 172.21.15.37:0/629447581 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v35)=0 v35) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1f74160570 con 0x7f1f740ceb80 2023-07-09T21:39:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 msgr2=0x7f1f580688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 0x7f1f580688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 msgr2=0x7f1f741536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400c750 tx=0x7f1f6400cc10 comp rx=0 tx=0).stop 2023-07-09T21:39:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 shutdown_connections 2023-07-09T21:39:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f1f580663f0 0x7f1f580688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f740d0780 0x7f1f7414f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f740ceb80 0x7f1f741536a0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 --2- 172.21.15.37:0/629447581 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f740b7980 0x7f1f74153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.514+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 >> 172.21.15.37:0/629447581 conn(0x7f1f74073090 msgr2=0x7f1f7415db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:57.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.518+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 shutdown_connections 2023-07-09T21:39:57.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.518+0000 7f1f7beec640 1 -- 172.21.15.37:0/629447581 wait complete. 2023-07-09T21:39:57.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:39:57.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.682+0000 7f038ee31640 1 Processor -- start 2023-07-09T21:39:57.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.682+0000 7f038ee31640 1 -- start start 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038ee31640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f03880cfb40 0x7f03880cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038ee31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03880b0540 0x7f03880cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038ee31640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03880d0450 con 0x7f03880b1420 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038ee31640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03880ce640 con 0x7f03880b0540 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038ee31640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03880ce080 con 0x7f03880cfb40 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03880b0540 0x7f03880cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f03880b0540 0x7f03880cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49024/0 (socket says 172.21.15.37:49024) 2023-07-09T21:39:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 -- 172.21.15.37:0/2344367069 learned_addr learned my addr 172.21.15.37:0/2344367069 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038de2f640 1 --2- 172.21.15.37:0/2344367069 >> v2:172.21.15.119:3300/0 conn(0x7f03880cfb40 0x7f03880cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 -- 172.21.15.37:0/2344367069 >> v2:172.21.15.119:3300/0 conn(0x7f03880cfb40 msgr2=0x7f03880cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:57.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 --2- 172.21.15.37:0/2344367069 >> v2:172.21.15.119:3300/0 conn(0x7f03880cfb40 0x7f03880cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 -- 172.21.15.37:0/2344367069 >> v1:172.21.15.37:6789/0 conn(0x7f03880b1420 legacy=0x7f03880cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.686+0000 7f038e630640 1 -- 172.21.15.37:0/2344367069 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03880ce360 con 0x7f03880b0540 2023-07-09T21:39:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038e630640 1 --2- 172.21.15.37:0/2344367069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880b0540 0x7f03880cccd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f03880715d0 tx=0x7f038001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68328ff47e496d4d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ce2d640 1 -- 172.21.15.37:0/2344367069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800a5860 con 0x7f03880b0540 2023-07-09T21:39:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ce2d640 1 -- 172.21.15.37:0/2344367069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03800a59c0 con 0x7f03880b0540 2023-07-09T21:39:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ce2d640 1 -- 172.21.15.37:0/2344367069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800a5d50 con 0x7f03880b0540 2023-07-09T21:39:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- 172.21.15.37:0/2344367069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880b0540 msgr2=0x7f03880cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 --2- 172.21.15.37:0/2344367069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880b0540 0x7f03880cccd0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f03880715d0 tx=0x7f038001c9a0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- 172.21.15.37:0/2344367069 shutdown_connections 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 --2- 172.21.15.37:0/2344367069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880b0540 0x7f03880cccd0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 --2- 172.21.15.37:0/2344367069 >> v2:172.21.15.119:3300/0 conn(0x7f03880cfb40 0x7f03880cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- 172.21.15.37:0/2344367069 >> 172.21.15.37:0/2344367069 conn(0x7f0388072d20 msgr2=0x7f03880d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- 172.21.15.37:0/2344367069 shutdown_connections 2023-07-09T21:39:57.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- 172.21.15.37:0/2344367069 wait complete. 2023-07-09T21:39:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 Processor -- start 2023-07-09T21:39:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.690+0000 7f038ee31640 1 -- start start 2023-07-09T21:39:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03880b0540 0x7f03880b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03880b1420 0x7f038814eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0388153340 con 0x7f03880cfb40 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03881535b0 con 0x7f03880b1420 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0388153890 con 0x7f03880b0540 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49026/0 (socket says 172.21.15.37:49026) 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 -- 172.21.15.37:0/2584522666 learned_addr learned my addr 172.21.15.37:0/2584522666 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038d62e640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03880b1420 0x7f038814eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038de2f640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03880b0540 0x7f03880b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 -- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03880b0540 msgr2=0x7f03880b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03880b0540 0x7f03880b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 -- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03880b1420 msgr2=0x7f038814eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03880b1420 0x7f038814eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 -- 172.21.15.37:0/2584522666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0380009b30 con 0x7f03880cfb40 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038e630640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f03800195b0 tx=0x7f0380019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800b8670 con 0x7f03880cfb40 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03800b8830 con 0x7f03880cfb40 2023-07-09T21:39:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03800b8be0 con 0x7f03880cfb40 2023-07-09T21:39:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0388153b70 con 0x7f03880cfb40 2023-07-09T21:39:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03880b23f0 con 0x7f03880cfb40 2023-07-09T21:39:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038804e020 con 0x7f03880cfb40 2023-07-09T21:39:57.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.694+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f03800b8d40 con 0x7f03880cfb40 2023-07-09T21:39:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.698+0000 7f037e7fc640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 0x7f036c0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.698+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f038011f560 con 0x7f03880cfb40 2023-07-09T21:39:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.698+0000 7f038de2f640 1 -- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 msgr2=0x7f036c0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.698+0000 7f038de2f640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 0x7f036c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.702+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03800eca00 con 0x7f03880cfb40 2023-07-09T21:39:57.746 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:57.749+0000 7f26bf3c2180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:57.785 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:57.782+0000 7fe7de14f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:39:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.862+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f0388154020 con 0x7f03880cfb40 2023-07-09T21:39:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f037e7fc640 1 -- 172.21.15.37:0/2584522666 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v36)=0 v36) v1 ==== 133+0+0 (secure 0 0 0) 0x7f03800f0020 con 0x7f03880cfb40 2023-07-09T21:39:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 msgr2=0x7f036c0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:39:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 0x7f036c0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 msgr2=0x7f038814f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f03800195b0 tx=0x7f0380019740 comp rx=0 tx=0).stop 2023-07-09T21:39:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 shutdown_connections 2023-07-09T21:39:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f036c0663f0 0x7f036c0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03880cfb40 0x7f038814f020 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03880b1420 0x7f038814eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 --2- 172.21.15.37:0/2584522666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03880b0540 0x7f03880b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:57.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 >> 172.21.15.37:0/2584522666 conn(0x7f0388072d20 msgr2=0x7f0388069f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:57.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 shutdown_connections 2023-07-09T21:39:57.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:57.866+0000 7f038ee31640 1 -- 172.21.15.37:0/2584522666 wait complete. 2023-07-09T21:39:57.890 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /bad-path 1M 2023-07-09T21:39:57.896 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:57.901+0000 7f26bf3c2180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:57.946 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:57.942+0000 7fe7de14f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:39:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 Processor -- start 2023-07-09T21:39:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 -- start start 2023-07-09T21:39:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f452415bb30 0x7f45240ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45240b11a0 0x7f45240b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f4524072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240ce970 con 0x7f45240b11a0 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45240b4490 con 0x7f452415bb30 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4528980640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452415bf00 con 0x7f45240b4010 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45240b11a0 0x7f45240b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f45240b11a0 0x7f45240b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49032/0 (socket says 172.21.15.37:49032) 2023-07-09T21:39:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 -- 172.21.15.37:0/1615736656 learned_addr learned my addr 172.21.15.37:0/1615736656 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4523fff640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f4524072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f45237fe640 1 --2- 172.21.15.37:0/1615736656 >> v2:172.21.15.119:3300/0 conn(0x7f452415bb30 0x7f45240ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 -- 172.21.15.37:0/1615736656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 msgr2=0x7f4524072400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f4524072400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 -- 172.21.15.37:0/1615736656 >> v2:172.21.15.119:3300/0 conn(0x7f452415bb30 msgr2=0x7f45240ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 --2- 172.21.15.37:0/1615736656 >> v2:172.21.15.119:3300/0 conn(0x7f452415bb30 0x7f45240ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4522ffd640 1 -- 172.21.15.37:0/1615736656 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452415f6e0 con 0x7f45240b11a0 2023-07-09T21:39:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.038+0000 7f4523fff640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f4524072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:39:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4522ffd640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45240b11a0 0x7f45240b3ad0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4524073590 tx=0x7f451801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476f402b13ffdd4d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f45227fc640 1 -- 172.21.15.37:0/1615736656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180ab600 con 0x7f45240b11a0 2023-07-09T21:39:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f45227fc640 1 -- 172.21.15.37:0/1615736656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45180a7050 con 0x7f45240b11a0 2023-07-09T21:39:58.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f45227fc640 1 -- 172.21.15.37:0/1615736656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180ab980 con 0x7f45240b11a0 2023-07-09T21:39:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 -- 172.21.15.37:0/1615736656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45240b11a0 msgr2=0x7f45240b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45240b11a0 0x7f45240b3ad0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4524073590 tx=0x7f451801c180 comp rx=0 tx=0).stop 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 -- 172.21.15.37:0/1615736656 shutdown_connections 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45240b11a0 0x7f45240b3ad0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 --2- 172.21.15.37:0/1615736656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f4524072400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 --2- 172.21.15.37:0/1615736656 >> v2:172.21.15.119:3300/0 conn(0x7f452415bb30 0x7f45240ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 -- 172.21.15.37:0/1615736656 >> 172.21.15.37:0/1615736656 conn(0x7f452406aac0 msgr2=0x7f45240cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 -- 172.21.15.37:0/1615736656 shutdown_connections 2023-07-09T21:39:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.042+0000 7f4528980640 1 -- 172.21.15.37:0/1615736656 wait complete. 2023-07-09T21:39:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 Processor -- start 2023-07-09T21:39:58.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 -- start start 2023-07-09T21:39:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45240b11a0 0x7f452415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f45240c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415bb30 0x7f4524149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240b7260 con 0x7f452415bb30 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45240b7540 con 0x7f45240b11a0 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45240b7820 con 0x7f45240b4010 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4523fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415bb30 0x7f4524149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f45237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45240b11a0 0x7f452415ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f45240c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:39:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f45237fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45240b11a0 0x7f452415ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:33390/0 (socket says 172.21.15.37:33390) 2023-07-09T21:39:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f45237fe640 1 -- 172.21.15.37:0/60118650 learned_addr learned my addr 172.21.15.37:0/60118650 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:39:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45240b11a0 msgr2=0x7f452415ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f45240b11a0 0x7f452415ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415bb30 msgr2=0x7f4524149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:39:58.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f452415bb30 0x7f4524149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009a70 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4522ffd640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f45240c8420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45180ab000 tx=0x7f451801a9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180b6420 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45180b65a0 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180b6950 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.046+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45180094d0 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4524147830 con 0x7f45240b4010 2023-07-09T21:39:58.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45240b79e0 con 0x7f45240b4010 2023-07-09T21:39:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 41) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f45180b2040 con 0x7f45240b4010 2023-07-09T21:39:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f450bfff640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:39:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f451811e180 con 0x7f45240b4010 2023-07-09T21:39:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f45237fe640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 msgr2=0x7f45100688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:58.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.050+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:39:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.054+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45180eb480 con 0x7f45240b4010 2023-07-09T21:39:58.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.230+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4524160260 con 0x7f45100663f0 2023-07-09T21:39:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.254+0000 7f45237fe640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 msgr2=0x7f45100688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:58.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.254+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:39:58.374 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.377+0000 7f26bf3c2180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:58.432 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.437+0000 7f26bf3c2180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:58.459 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.454+0000 7fe7de14f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:58.487 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.489+0000 7f26bf3c2180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:58.520 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.518+0000 7fe7de14f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:39:58.571 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.573+0000 7f26bf3c2180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:58.578 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.574+0000 7fe7de14f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:39:58.628 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.633+0000 7f26bf3c2180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.658+0000 7f45237fe640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 msgr2=0x7f45100688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:58.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:58.658+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:39:58.671 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.670+0000 7fe7de14f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:39:58.712 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.717+0000 7f26bf3c2180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:58.730 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.726+0000 7fe7de14f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:39:58.768 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.769+0000 7f26bf3c2180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:58.818 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.814+0000 7fe7de14f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:39:58.877 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:58.874+0000 7fe7de14f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:39:58.908 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.913+0000 7f26bf3c2180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:58.965 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:58.969+0000 7f26bf3c2180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:59.033 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.030+0000 7fe7de14f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:39:59.093 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.090+0000 7fe7de14f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:39:59.203 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:59.203 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:59.203 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:59.211 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:59.213+0000 7f26bf3c2180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:59.344 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:39:59.344 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:39:59.345 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:39:59.347 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:59.349+0000 7f26bf3c2180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:59.352 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.350+0000 7fe7de14f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:39:59.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:59.462+0000 7f45237fe640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 msgr2=0x7f45100688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2505789332 2023-07-09T21:39:59.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:39:59.462+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:39:59.471 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:59.473+0000 7f26bf3c2180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:59.494 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.490+0000 7fe7de14f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:59.541 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:59.545+0000 7f26bf3c2180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:59.624 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.622+0000 7fe7de14f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:39:59.673 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:39:59.677+0000 7f26bf3c2180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:39:59.698 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.694+0000 7fe7de14f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:39:59.839 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:39:59.838+0000 7fe7de14f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:40:00.210 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.213+0000 7f26bf3c2180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:40:00.296 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.301+0000 7f26bf3c2180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:40:00.405 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:00.402+0000 7fe7de14f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:40:00.442 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.445+0000 7f26bf3c2180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:40:00.493 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:00.490+0000 7fe7de14f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:40:00.524 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.529+0000 7f26bf3c2180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:40:00.647 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:00.646+0000 7fe7de14f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:40:00.734 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:00.730+0000 7fe7de14f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:40:00.791 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.793+0000 7f26bf3c2180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:40:00.850 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.853+0000 7f26bf3c2180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:40:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:00.862+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mgrmap(e 42) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f45180eb850 con 0x7f45240b4010 2023-07-09T21:40:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:00.862+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 msgr2=0x7f45100688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:40:00.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:00.862+0000 7f450bfff640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/2505789332,v1:172.21.15.119:6833/2505789332] conn(0x7f45100663f0 0x7f45100688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:00.991 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f263e423640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.991 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f263e423640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f263e423640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f263e423640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f263e423640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f2641429640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f2641429640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f2641429640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.992 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f2641429640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:00.993 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:40:00.993+0000 7f2641429640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:40:01.035 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:01.030+0000 7fe7de14f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:40:01.098 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:40:01.094+0000 7fe7de14f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:40:01.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:40:01.358 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:40:01.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.866+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mon.2 v2:172.21.15.119:3301/0 8 ==== mgrmap(e 43) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f451811c4a0 con 0x7f45240b4010 2023-07-09T21:40:01.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.866+0000 7f450bfff640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4510033e70 0x7f45100708c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:01.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.866+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 --> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/bad-path", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4510034240 con 0x7f4510033e70 2023-07-09T21:40:01.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.870+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4510033e70 0x7f45100708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:01.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.874+0000 7f45237fe640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4510033e70 0x7f45100708c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45140097f0 tx=0x7f4514009190 comp rx=0 tx=0).ready entity=mgr.6860 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:40:01.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.934+0000 7f450bfff640 1 -- 172.21.15.37:0/60118650 <== mgr.6860 v2:172.21.15.119:6832/501737474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f4510034240 con 0x7f4510033e70 2023-07-09T21:40:01.938 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /bad-path 2023-07-09T21:40:01.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4510033e70 msgr2=0x7f45100708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:01.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4510033e70 0x7f45100708c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45140097f0 tx=0x7f4514009190 comp rx=0 tx=0).stop 2023-07-09T21:40:01.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 msgr2=0x7f45240c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 --2- 172.21.15.37:0/60118650 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f45240b4010 0x7f45240c8420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45180ab000 tx=0x7f451801a9c0 comp rx=0 tx=0).stop 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4523fff640 1 -- 172.21.15.37:0/60118650 reap_dead start 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 shutdown_connections 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 >> 172.21.15.37:0/60118650 conn(0x7f452406aac0 msgr2=0x7f4524154b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 shutdown_connections 2023-07-09T21:40:01.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:01.938+0000 7f4528980640 1 -- 172.21.15.37:0/60118650 wait complete. 2023-07-09T21:40:01.963 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /bad-path 2023-07-09T21:40:01.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-09T21:40:02.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.110+0000 7f06b45ac640 1 Processor -- start 2023-07-09T21:40:02.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.110+0000 7f06b45ac640 1 -- start start 2023-07-09T21:40:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.110+0000 7f06b45ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f06ac06c0d0 0x7f06ac15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.110+0000 7f06b45ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac15bf60 con 0x7f06ac15f610 2023-07-09T21:40:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.110+0000 7f06b45ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06ac1600d0 con 0x7f06ac15bb90 2023-07-09T21:40:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b45ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06ac0cc530 con 0x7f06ac06c0d0 2023-07-09T21:40:02.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1b47640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f06ac15f610 0x7f06ac06b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54348/0 (socket says 172.21.15.37:54348) 2023-07-09T21:40:02.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1b47640 1 -- 172.21.15.37:0/1358486212 learned_addr learned my addr 172.21.15.37:0/1358486212 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:40:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b2b49640 1 --2- 172.21.15.37:0/1358486212 >> v2:172.21.15.119:3300/0 conn(0x7f06ac06c0d0 0x7f06ac15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3556312459 0 0) 0x7f06ac15bf60 con 0x7f06ac15f610 2023-07-09T21:40:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0698003530 con 0x7f06ac15f610 2023-07-09T21:40:02.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010439241 0 0) 0x7f06ac1600d0 con 0x7f06ac15bb90 2023-07-09T21:40:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06ac15bf60 con 0x7f06ac15bb90 2023-07-09T21:40:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b2b49640 1 -- 172.21.15.37:0/1358486212 >> v1:172.21.15.119:6789/0 conn(0x7f06ac15bb90 legacy=0x7f06ac0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1800331728 0 0) 0x7f0698003530 con 0x7f06ac15f610 2023-07-09T21:40:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b2b49640 1 -- 172.21.15.37:0/1358486212 >> v1:172.21.15.37:6789/0 conn(0x7f06ac15f610 legacy=0x7f06ac06b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b2b49640 1 -- 172.21.15.37:0/1358486212 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ac1603b0 con 0x7f06ac06c0d0 2023-07-09T21:40:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.114+0000 7f06b2b49640 1 --2- 172.21.15.37:0/1358486212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15fa60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb658b242190b377 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069c001680 con 0x7f06ac06c0d0 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a40a55f0 con 0x7f06ac06c0d0 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b1346640 1 -- 172.21.15.37:0/1358486212 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40a5980 con 0x7f06ac06c0d0 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- 172.21.15.37:0/1358486212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 msgr2=0x7f06ac15fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 --2- 172.21.15.37:0/1358486212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15fa60 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a401c7b0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- 172.21.15.37:0/1358486212 shutdown_connections 2023-07-09T21:40:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 --2- 172.21.15.37:0/1358486212 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15fa60 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- 172.21.15.37:0/1358486212 >> 172.21.15.37:0/1358486212 conn(0x7f06ac06d230 msgr2=0x7f06ac06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:40:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- 172.21.15.37:0/1358486212 shutdown_connections 2023-07-09T21:40:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- 172.21.15.37:0/1358486212 wait complete. 2023-07-09T21:40:02.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 Processor -- start 2023-07-09T21:40:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- start start 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06ac15bb90 0x7f06ac15e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac15ee20 con 0x7f06ac15f610 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac152dd0 con 0x7f06ac06c0d0 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b45ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06ac152810 con 0x7f06ac15bb90 2023-07-09T21:40:02.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b2b49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b1b47640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06ac15bb90 0x7f06ac15e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b2348640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b2b49640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49048/0 (socket says 172.21.15.37:49048) 2023-07-09T21:40:02.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.118+0000 7f06b2b49640 1 -- 172.21.15.37:0/295802141 learned_addr learned my addr 172.21.15.37:0/295802141 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:40:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 -- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06ac15bb90 msgr2=0x7f06ac15e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06ac15bb90 0x7f06ac15e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 -- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 msgr2=0x7f06ac15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 -- 172.21.15.37:0/295802141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a4009a70 con 0x7f06ac15f610 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b2b49640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a4019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4003ba0 con 0x7f06ac15f610 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4003d00 con 0x7f06ac15f610 2023-07-09T21:40:02.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4004220 con 0x7f06ac15f610 2023-07-09T21:40:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ac152af0 con 0x7f06ac15f610 2023-07-09T21:40:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ac151c40 con 0x7f06ac15f610 2023-07-09T21:40:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06ac14c530 con 0x7f06ac15f610 2023-07-09T21:40:02.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 43) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f06a4004380 con 0x7f06ac15f610 2023-07-09T21:40:02.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.122+0000 7f06a2ffd640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 0x7f06900685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:40:02.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.126+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f06a411e860 con 0x7f06ac15f610 2023-07-09T21:40:02.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.126+0000 7f06b2348640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 0x7f06900685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:40:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.126+0000 7f06b2348640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 0x7f06900685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06a80011f0 tx=0x7f06a8009040 comp rx=0 tx=0).ready entity=mgr.6860 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:40:02.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.130+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06ac14c530 con 0x7f06ac15f610 2023-07-09T21:40:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.302+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 --> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06ac06ef70 con 0x7f0690066120 2023-07-09T21:40:02.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06a2ffd640 1 -- 172.21.15.37:0/295802141 <== mgr.6860 v2:172.21.15.119:6832/501737474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+287 (secure 0 0 0) 0x7f06a8001500 con 0x7f0690066120 2023-07-09T21:40:02.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:40:02.313 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:40:01", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-09T21:40:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 msgr2=0x7f06900685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 0x7f06900685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f06a80011f0 tx=0x7f06a8009040 comp rx=0 tx=0).stop 2023-07-09T21:40:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 msgr2=0x7f06ac15e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:40:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f06a4009d90 tx=0x7f06a4019550 comp rx=0 tx=0).stop 2023-07-09T21:40:02.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 shutdown_connections 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f0690066120 0x7f06900685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06ac15f610 0x7f06ac15e8e0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f06ac15bb90 0x7f06ac15e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 --2- 172.21.15.37:0/295802141 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f06ac06c0d0 0x7f06ac15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 >> 172.21.15.37:0/295802141 conn(0x7f06ac06d230 msgr2=0x7f06ac153010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:40:02.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 shutdown_connections 2023-07-09T21:40:02.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:40:02.310+0000 7f06b45ac640 1 -- 172.21.15.37:0/295802141 wait complete. 2023-07-09T21:40:02.334 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:40:01", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true}] 2023-07-09T21:40:31.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:40:31.429 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:41:00.948 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:00.955+0000 7f2630c08640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:00.948 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:00.955+0000 7f2630c08640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:00.948 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:00.955+0000 7f2630c08640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:00.949 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:00.955+0000 7f2630c08640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:00.949 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:00.955+0000 7f2630c08640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:01.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:41:01.502 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:41:02.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /bad-path 2023-07-09T21:41:02.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.489+0000 7fa82d359640 1 Processor -- start 2023-07-09T21:41:02.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.489+0000 7fa82d359640 1 -- start start 2023-07-09T21:41:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa82d359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8280cf290 0x7fa828160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa82d359640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa82815bf80 con 0x7fa8280d0780 2023-07-09T21:41:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa82d359640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa828160570 con 0x7fa8280b7980 2023-07-09T21:41:02.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa82d359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280cd070 con 0x7fa8280cf290 2023-07-09T21:41:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8280cf290 0x7fa828160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8280cf290 0x7fa828160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54434/0 (socket says 172.21.15.37:54434) 2023-07-09T21:41:02.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 -- 172.21.15.37:0/3714974950 learned_addr learned my addr 172.21.15.37:0/3714974950 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 -- 172.21.15.37:0/3714974950 >> v1:172.21.15.119:6789/0 conn(0x7fa8280b7980 legacy=0x7fa8280ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 -- 172.21.15.37:0/3714974950 >> v1:172.21.15.37:6789/0 conn(0x7fa8280d0780 legacy=0x7fa8280d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.493+0000 7fa81ffff640 1 -- 172.21.15.37:0/3714974950 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280d02f0 con 0x7fa8280cf290 2023-07-09T21:41:02.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa81ffff640 1 --2- 172.21.15.37:0/3714974950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa828160030 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa81001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e5d481fc2dffc85 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa8267fc640 1 -- 172.21.15.37:0/3714974950 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab600 con 0x7fa8280cf290 2023-07-09T21:41:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa8267fc640 1 -- 172.21.15.37:0/3714974950 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100a7050 con 0x7fa8280cf290 2023-07-09T21:41:02.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa8267fc640 1 -- 172.21.15.37:0/3714974950 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ab980 con 0x7fa8280cf290 2023-07-09T21:41:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- 172.21.15.37:0/3714974950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 msgr2=0x7fa828160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 --2- 172.21.15.37:0/3714974950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa828160030 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fa810009870 tx=0x7fa81001c500 comp rx=0 tx=0).stop 2023-07-09T21:41:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- 172.21.15.37:0/3714974950 shutdown_connections 2023-07-09T21:41:02.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 --2- 172.21.15.37:0/3714974950 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa828160030 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- 172.21.15.37:0/3714974950 >> 172.21.15.37:0/3714974950 conn(0x7fa828073090 msgr2=0x7fa828069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- 172.21.15.37:0/3714974950 shutdown_connections 2023-07-09T21:41:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- 172.21.15.37:0/3714974950 wait complete. 2023-07-09T21:41:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 Processor -- start 2023-07-09T21:41:02.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- start start 2023-07-09T21:41:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8280b7980 0x7fa82814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8280d0780 0x7fa82815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8280b2a10 con 0x7fa8280cf290 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828155240 con 0x7fa8280d0780 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa82d359640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa828155520 con 0x7fa8280b7980 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa81ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54450/0 (socket says 172.21.15.37:54450) 2023-07-09T21:41:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.497+0000 7fa81ffff640 1 -- 172.21.15.37:0/4090470131 learned_addr learned my addr 172.21.15.37:0/4090470131 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa8277fe640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8280d0780 0x7fa82815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa826ffd640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8280b7980 0x7fa82814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 -- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8280b7980 msgr2=0x7fa82814e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8280b7980 0x7fa82814e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 -- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8280d0780 msgr2=0x7fa82815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8280d0780 0x7fa82815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 -- 172.21.15.37:0/4090470131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8100094d0 con 0x7fa8280cf290 2023-07-09T21:41:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81ffff640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa8100ae040 tx=0x7fa8100192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b37d0 con 0x7fa8280cf290 2023-07-09T21:41:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8100b3930 con 0x7fa8280cf290 2023-07-09T21:41:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8280b2170 con 0x7fa8280cf290 2023-07-09T21:41:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100b3ce0 con 0x7fa8280cf290 2023-07-09T21:41:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8280b2730 con 0x7fa8280cf290 2023-07-09T21:41:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8281556b0 con 0x7fa8280cf290 2023-07-09T21:41:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa8100b2070 con 0x7fa8280cf290 2023-07-09T21:41:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.501+0000 7fa81f7fe640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 0x7fa808068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.505+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fa81011e5c0 con 0x7fa8280cf290 2023-07-09T21:41:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.505+0000 7fa826ffd640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 0x7fa808068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.505+0000 7fa826ffd640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 0x7fa808068930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8180016c0 tx=0x7fa818009040 comp rx=0 tx=0).ready entity=mgr.6860 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.509+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8100eb440 con 0x7fa8280cf290 2023-07-09T21:41:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.681+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 --> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa8280cff80 con 0x7fa808066480 2023-07-09T21:41:02.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.689+0000 7fa81f7fe640 1 -- 172.21.15.37:0/4090470131 <== mgr.6860 v2:172.21.15.119:6832/501737474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+288 (secure 0 0 0) 0x7fa818007da0 con 0x7fa808066480 2023-07-09T21:41:02.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:02.690 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:40:01", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-09T21:41:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 msgr2=0x7fa808068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 0x7fa808068930 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa8180016c0 tx=0x7fa818009040 comp rx=0 tx=0).stop 2023-07-09T21:41:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 msgr2=0x7fa8280b46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fa8100ae040 tx=0x7fa8100192a0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 shutdown_connections 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fa808066480 0x7fa808068930 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8280d0780 0x7fa82815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8280cf290 0x7fa8280b46b0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 --2- 172.21.15.37:0/4090470131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8280b7980 0x7fa82814e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 >> 172.21.15.37:0/4090470131 conn(0x7fa828073090 msgr2=0x7fa8280d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 shutdown_connections 2023-07-09T21:41:02.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.693+0000 7fa82d359640 1 -- 172.21.15.37:0/4090470131 wait complete. 2023-07-09T21:41:02.711 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/bad-path", "rel_path": "/bad-path", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:40:01", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": false}] 2023-07-09T21:41:02.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /bad-path 2023-07-09T21:41:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 Processor -- start 2023-07-09T21:41:02.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 -- start start 2023-07-09T21:41:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4c100c3e10 0x7f4c100c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c1015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100c9090 con 0x7f4c101585b0 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c100cbf40 con 0x7f4c100c3e10 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c17d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100c47d0 con 0x7f4c1015c200 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c15ac8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4c101585b0 0x7f4c1006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53152/0 (socket says 172.21.15.37:53152) 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c15ac8640 1 -- 172.21.15.37:0/2687287914 learned_addr learned my addr 172.21.15.37:0/2687287914 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c152c7640 1 --2- 172.21.15.37:0/2687287914 >> v2:172.21.15.37:3300/0 conn(0x7f4c100c3e10 0x7f4c100c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c162c9640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c1015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c152c7640 1 -- 172.21.15.37:0/2687287914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 msgr2=0x7f4c1015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c152c7640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c1015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c152c7640 1 -- 172.21.15.37:0/2687287914 >> v1:172.21.15.37:6789/0 conn(0x7f4c101585b0 legacy=0x7f4c1006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c152c7640 1 -- 172.21.15.37:0/2687287914 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1015cbc0 con 0x7f4c100c3e10 2023-07-09T21:41:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c14ac6640 1 -- 172.21.15.37:0/2687287914 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624428251 0 0) 0x7f4c100c9090 con 0x7f4c101585b0 2023-07-09T21:41:02.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.861+0000 7f4c162c9640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c1015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c152c7640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c100c4290 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097c0 tx=0x7f4c0001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5a07209babf2e73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c14ac6640 1 -- 172.21.15.37:0/2687287914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000a6040 con 0x7f4c100c3e10 2023-07-09T21:41:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c14ac6640 1 -- 172.21.15.37:0/2687287914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000aa600 con 0x7f4c100c3e10 2023-07-09T21:41:02.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c14ac6640 1 -- 172.21.15.37:0/2687287914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c000aa990 con 0x7f4c100c3e10 2023-07-09T21:41:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 -- 172.21.15.37:0/2687287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 msgr2=0x7f4c100c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c100c4290 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f4c000097c0 tx=0x7f4c0001c480 comp rx=0 tx=0).stop 2023-07-09T21:41:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 -- 172.21.15.37:0/2687287914 shutdown_connections 2023-07-09T21:41:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c1015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/2687287914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c100c4290 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 -- 172.21.15.37:0/2687287914 >> 172.21.15.37:0/2687287914 conn(0x7f4c100cde40 msgr2=0x7f4c100ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 -- 172.21.15.37:0/2687287914 shutdown_connections 2023-07-09T21:41:02.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.865+0000 7f4c17d2c640 1 -- 172.21.15.37:0/2687287914 wait complete. 2023-07-09T21:41:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 Processor -- start 2023-07-09T21:41:02.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- start start 2023-07-09T21:41:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c101585b0 0x7f4c100c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c100ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c10158980 con 0x7f4c100c3e10 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100ae950 con 0x7f4c101585b0 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c100aec20 con 0x7f4c1015c200 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54460/0 (socket says 172.21.15.37:54460) 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 -- 172.21.15.37:0/1620725048 learned_addr learned my addr 172.21.15.37:0/1620725048 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 -- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 msgr2=0x7f4c100ae410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c100ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 -- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c101585b0 msgr2=0x7f4c100c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c101585b0 0x7f4c100c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 -- 172.21.15.37:0/1620725048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00009420 con 0x7f4c100c3e10 2023-07-09T21:41:02.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c15ac8640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0011f0 tx=0x7f4c0c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0074e0 con 0x7f4c100c3e10 2023-07-09T21:41:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c007640 con 0x7f4c100c3e10 2023-07-09T21:41:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c004a10 con 0x7f4c100c3e10 2023-07-09T21:41:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c10158c40 con 0x7f4c100c3e10 2023-07-09T21:41:02.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c10159200 con 0x7f4c100c3e10 2023-07-09T21:41:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.869+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c10159420 con 0x7f4c100c3e10 2023-07-09T21:41:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.873+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 44) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f4c0c004b70 con 0x7f4c100c3e10 2023-07-09T21:41:02.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.873+0000 7f4c067fc640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 0x7f4bf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:02.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.873+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f4c0c083540 con 0x7f4c100c3e10 2023-07-09T21:41:02.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.873+0000 7f4c152c7640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 0x7f4bf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:02.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.873+0000 7f4c152c7640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 0x7f4bf4068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ae000 tx=0x7f4c00008040 comp rx=0 tx=0).ready entity=mgr.6860 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:02.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:02.877+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4c0c050560 con 0x7f4c100c3e10 2023-07-09T21:41:03.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.049+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 --> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/bad-path", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c100c8d20 con 0x7f4bf4066480 2023-07-09T21:41:03.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c067fc640 1 -- 172.21.15.37:0/1620725048 <== mgr.6860 v2:172.21.15.119:6832/501737474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+36 (secure 0 0 0) 0x7f4c000b7070 con 0x7f4bf4066480 2023-07-09T21:41:03.117 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /bad-path 2023-07-09T21:41:03.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 msgr2=0x7f4bf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 0x7f4bf4068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4c000ae000 tx=0x7f4c00008040 comp rx=0 tx=0).stop 2023-07-09T21:41:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 msgr2=0x7f4c1015b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0011f0 tx=0x7f4c0c00c9b0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 shutdown_connections 2023-07-09T21:41:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f4bf4066480 0x7f4bf4068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4c1015c200 0x7f4c100ae410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4c101585b0 0x7f4c100c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 --2- 172.21.15.37:0/1620725048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c100c3e10 0x7f4c1015b550 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 >> 172.21.15.37:0/1620725048 conn(0x7f4c100cde40 msgr2=0x7f4c100cc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 shutdown_connections 2023-07-09T21:41:03.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.117+0000 7f4c17d2c640 1 -- 172.21.15.37:0/1620725048 wait complete. 2023-07-09T21:41:03.138 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /bad-path 2023-07-09T21:41:03.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:41:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 Processor -- start 2023-07-09T21:41:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 -- start start 2023-07-09T21:41:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7efc0b7980 0x7f7efc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 0x7f7efc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7efc0b3c20 0x7f7efc0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0cd070 con 0x7f7efc0b3c20 2023-07-09T21:41:03.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7efc0cfd70 con 0x7f7efc0b7980 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f041db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15bf80 con 0x7f7efc0ceb80 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f02778640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7efc0b3c20 0x7f7efc0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f02778640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7efc0b3c20 0x7f7efc0b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54468/0 (socket says 172.21.15.37:54468) 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f02778640 1 -- 172.21.15.37:0/2808622968 learned_addr learned my addr 172.21.15.37:0/2808622968 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f01f77640 1 --2- 172.21.15.37:0/2808622968 >> v2:172.21.15.119:3300/0 conn(0x7f7efc0b7980 0x7f7efc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.289+0000 7f7f01776640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 0x7f7efc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 -- 172.21.15.37:0/2808622968 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 msgr2=0x7f7efc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 0x7f7efc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 -- 172.21.15.37:0/2808622968 >> v2:172.21.15.119:3300/0 conn(0x7f7efc0b7980 msgr2=0x7f7efc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 --2- 172.21.15.37:0/2808622968 >> v2:172.21.15.119:3300/0 conn(0x7f7efc0b7980 0x7f7efc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 -- 172.21.15.37:0/2808622968 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc160570 con 0x7f7efc0b3c20 2023-07-09T21:41:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f01776640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 0x7f7efc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f02778640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b3c20 0x7f7efc0b4080 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7efc069aa0 tx=0x7f7ef401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d700015326b189aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f00f75640 1 -- 172.21.15.37:0/2808622968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40a5650 con 0x7f7efc0b3c20 2023-07-09T21:41:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f00f75640 1 -- 172.21.15.37:0/2808622968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef40a57b0 con 0x7f7efc0b3c20 2023-07-09T21:41:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f00f75640 1 -- 172.21.15.37:0/2808622968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef40a5b40 con 0x7f7efc0b3c20 2023-07-09T21:41:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2808622968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b3c20 msgr2=0x7f7efc0b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b3c20 0x7f7efc0b4080 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7efc069aa0 tx=0x7f7ef401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2808622968 shutdown_connections 2023-07-09T21:41:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b3c20 0x7f7efc0b4080 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2808622968 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0ceb80 0x7f7efc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2808622968 >> v2:172.21.15.119:3300/0 conn(0x7f7efc0b7980 0x7f7efc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2808622968 >> 172.21.15.37:0/2808622968 conn(0x7f7efc073090 msgr2=0x7f7efc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- 172.21.15.37:0/2808622968 shutdown_connections 2023-07-09T21:41:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- 172.21.15.37:0/2808622968 wait complete. 2023-07-09T21:41:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 Processor -- start 2023-07-09T21:41:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- start start 2023-07-09T21:41:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0b3c20 0x7f7efc15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7efc0ceb80 0x7f7efc15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15c3b0 con 0x7f7efc0b7980 2023-07-09T21:41:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc15d020 con 0x7f7efc0ceb80 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc159d20 con 0x7f7efc0b3c20 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54472/0 (socket says 172.21.15.37:54472) 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 -- 172.21.15.37:0/2943713128 learned_addr learned my addr 172.21.15.37:0/2943713128 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01f77640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0b3c20 0x7f7efc15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f02778640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7efc0ceb80 0x7f7efc15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 -- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0b3c20 msgr2=0x7f7efc15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0b3c20 0x7f7efc15cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 -- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7efc0ceb80 msgr2=0x7f7efc15eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7efc0ceb80 0x7f7efc15eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:03.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 -- 172.21.15.37:0/2943713128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef4009b30 con 0x7f7efc0b7980 2023-07-09T21:41:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f01776640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e840 tx=0x7f7eec00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00c8d0 con 0x7f7efc0b7980 2023-07-09T21:41:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00ca30 con 0x7f7efc0b7980 2023-07-09T21:41:03.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00cde0 con 0x7f7efc0b7980 2023-07-09T21:41:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.297+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7efc15eff0 con 0x7f7efc0b7980 2023-07-09T21:41:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc0cc2f0 con 0x7f7efc0b7980 2023-07-09T21:41:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7efc0cff60 con 0x7f7efc0b7980 2023-07-09T21:41:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 45) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f7eec013410 con 0x7f7efc0b7980 2023-07-09T21:41:03.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 0x7f7ee00689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f7eec084260 con 0x7f7efc0b7980 2023-07-09T21:41:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7f01f77640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 0x7f7ee00689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.301+0000 7f7f01f77640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 0x7f7ee00689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7efc153fd0 tx=0x7f7ef8009190 comp rx=0 tx=0).ready entity=mgr.6860 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:03.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.305+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7efc0cff60 con 0x7f7efc0b7980 2023-07-09T21:41:03.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:03.497+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f7efc0cff60 con 0x7f7efc0b7980 2023-07-09T21:41:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.289+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7eec051480 con 0x7f7efc0b7980 2023-07-09T21:41:04.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7ef27fc640 1 -- 172.21.15.37:0/2943713128 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v46) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7eec081370 con 0x7f7efc0b7980 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 msgr2=0x7f7ee00689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 0x7f7ee00689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7efc153fd0 tx=0x7f7ef8009190 comp rx=0 tx=0).stop 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 msgr2=0x7f7efc15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00e840 tx=0x7f7eec00ed00 comp rx=0 tx=0).stop 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 shutdown_connections 2023-07-09T21:41:04.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f7ee0066510 0x7f7ee00689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7efc0ceb80 0x7f7efc15eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7efc0b7980 0x7f7efc15e570 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 --2- 172.21.15.37:0/2943713128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7efc0b3c20 0x7f7efc15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 >> 172.21.15.37:0/2943713128 conn(0x7f7efc073090 msgr2=0x7f7efc0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 shutdown_connections 2023-07-09T21:41:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.293+0000 7f7f041db640 1 -- 172.21.15.37:0/2943713128 wait complete. 2023-07-09T21:41:04.318 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:41:04.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:41:04.374 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:41:04.459 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:41:04.459 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:41:04.459 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:04.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:04.471 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:04.475+0000 7faa95647180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:41:04.472 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:04.473+0000 7fe89d01a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 Processor -- start 2023-07-09T21:41:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 -- start start 2023-07-09T21:41:04.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28640cef80 0x7f286406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640b49f0 con 0x7f28640b4340 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28640cc8a0 con 0x7f28640b7ab0 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f286b0ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28640b7e80 con 0x7f28640cef80 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2863fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28640b4340 0x7f28640d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53160/0 (socket says 172.21.15.37:53160) 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2863fff640 1 -- 172.21.15.37:0/3103427188 learned_addr learned my addr 172.21.15.37:0/3103427188 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:04.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2869667640 1 --2- 172.21.15.37:0/3103427188 >> v2:172.21.15.119:3300/0 conn(0x7f28640cef80 0x7f286406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817171144 0 0) 0x7f28640b49f0 con 0x7f28640b4340 2023-07-09T21:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2854003530 con 0x7f28640b4340 2023-07-09T21:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004372409 0 0) 0x7f28640cc8a0 con 0x7f28640b7ab0 2023-07-09T21:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28640b49f0 con 0x7f28640b7ab0 2023-07-09T21:41:04.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2869667640 1 -- 172.21.15.37:0/3103427188 >> v1:172.21.15.119:6789/0 conn(0x7f28640b7ab0 legacy=0x7f28640b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2869667640 1 -- 172.21.15.37:0/3103427188 >> v1:172.21.15.37:6789/0 conn(0x7f28640b4340 legacy=0x7f28640d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.617+0000 7f2869667640 1 -- 172.21.15.37:0/3103427188 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28640ccb80 con 0x7f28640cef80 2023-07-09T21:41:04.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f2869667640 1 --2- 172.21.15.37:0/3103427188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640cef80 0x7f286406aa50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23921ed60e36d38 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:04.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0a59e0 con 0x7f28640cef80 2023-07-09T21:41:04.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0a5b40 con 0x7f28640cef80 2023-07-09T21:41:04.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f28637fe640 1 -- 172.21.15.37:0/3103427188 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0ad440 con 0x7f28640cef80 2023-07-09T21:41:04.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 -- 172.21.15.37:0/3103427188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640cef80 msgr2=0x7f286406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3103427188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640cef80 0x7f286406aa50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c01c920 comp rx=0 tx=0).stop 2023-07-09T21:41:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 -- 172.21.15.37:0/3103427188 shutdown_connections 2023-07-09T21:41:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3103427188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640cef80 0x7f286406aa50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 -- 172.21.15.37:0/3103427188 >> 172.21.15.37:0/3103427188 conn(0x7f2864073090 msgr2=0x7f2864069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:04.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 -- 172.21.15.37:0/3103427188 shutdown_connections 2023-07-09T21:41:04.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.621+0000 7f286b0ca640 1 -- 172.21.15.37:0/3103427188 wait complete. 2023-07-09T21:41:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 Processor -- start 2023-07-09T21:41:04.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- start start 2023-07-09T21:41:04.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28640b4340 0x7f28641568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640b7ab0 0x7f28640c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c8270 con 0x7f28640cef80 2023-07-09T21:41:04.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2864154830 con 0x7f28640b7ab0 2023-07-09T21:41:04.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28640c84c0 con 0x7f28640b4340 2023-07-09T21:41:04.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54498/0 (socket says 172.21.15.37:54498) 2023-07-09T21:41:04.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2863fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640b7ab0 0x7f28640c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 -- 172.21.15.37:0/3836168831 learned_addr learned my addr 172.21.15.37:0/3836168831 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:04.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2868e66640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28640b4340 0x7f28641568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 -- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28640b4340 msgr2=0x7f28641568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28640b4340 0x7f28641568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 -- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640b7ab0 msgr2=0x7f28640c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640b7ab0 0x7f28640c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 -- 172.21.15.37:0/3836168831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c009a70 con 0x7f28640cef80 2023-07-09T21:41:04.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f2869667640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:04.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0adce0 con 0x7f28640cef80 2023-07-09T21:41:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285c0ade40 con 0x7f28640cef80 2023-07-09T21:41:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28640c87a0 con 0x7f28640cef80 2023-07-09T21:41:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285c0b9690 con 0x7f28640cef80 2023-07-09T21:41:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.625+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f286414c490 con 0x7f28640cef80 2023-07-09T21:41:04.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28641549c0 con 0x7f28640cef80 2023-07-09T21:41:04.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f285c0b97f0 con 0x7f28640cef80 2023-07-09T21:41:04.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f28617fa640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 0x7f28480689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f285c11f110 con 0x7f28640cef80 2023-07-09T21:41:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f2868e66640 1 -- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 msgr2=0x7f28480689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.629+0000 7f2868e66640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 0x7f28480689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:04.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.633+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f285c0ec1a0 con 0x7f28640cef80 2023-07-09T21:41:04.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.789+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f286404d7d0 con 0x7f28640cef80 2023-07-09T21:41:04.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.789+0000 7f28617fa640 1 -- 172.21.15.37:0/3836168831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18994 (secure 0 0 0) 0x7f285c009450 con 0x7f28640cef80 2023-07-09T21:41:04.789 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:04.789 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":116,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:02.265962+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/393451723":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2531669424":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1666164128":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6833/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6832/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/490648385":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1550900068":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/4027902757":"2023-07-10T21:40:00.854757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 msgr2=0x7f28480689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 0x7f28480689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 msgr2=0x7f286414bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f285c009d90 tx=0x7f285c0196c0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 shutdown_connections 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f28480664f0 0x7f28480689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28640cef80 0x7f286414bf50 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28640b7ab0 0x7f28640c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 --2- 172.21.15.37:0/3836168831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28640b4340 0x7f28641568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 >> 172.21.15.37:0/3836168831 conn(0x7f2864073090 msgr2=0x7f28640b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:04.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 shutdown_connections 2023-07-09T21:41:04.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.793+0000 7f286b0ca640 1 -- 172.21.15.37:0/3836168831 wait complete. 2023-07-09T21:41:04.812 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:39:40.732353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:39:41.604971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:41:04.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:41:04.881 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:04.887+0000 7faa95647180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:41:04.920 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:04.921+0000 7fe89d01a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:41:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.961+0000 7effbd048640 1 Processor -- start 2023-07-09T21:41:04.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.961+0000 7effbd048640 1 -- start start 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 0x7effb8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 0x7effb80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb80b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb80cd070 con 0x7effb80ceb80 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb80cfd70 con 0x7effb80b7980 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effbd048640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb815bf80 con 0x7effb80b3c20 2023-07-09T21:41:04.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 0x7effb80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 0x7effb8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb6d9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 0x7effb8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:44302/0 (socket says 172.21.15.37:44302) 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb6d9d640 1 -- 172.21.15.37:0/13852971 learned_addr learned my addr 172.21.15.37:0/13852971 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 0x7effb80cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54500/0 (socket says 172.21.15.37:54500) 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 --2- 172.21.15.37:0/13852971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb80b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 -- 172.21.15.37:0/13852971 >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 msgr2=0x7effb8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 --2- 172.21.15.37:0/13852971 >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 0x7effb8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 -- 172.21.15.37:0/13852971 >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 msgr2=0x7effb80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 --2- 172.21.15.37:0/13852971 >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 0x7effb80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.965+0000 7effb759e640 1 -- 172.21.15.37:0/13852971 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8160570 con 0x7effb80b3c20 2023-07-09T21:41:04.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effb759e640 1 --2- 172.21.15.37:0/13852971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb80b4060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7effb8069aa0 tx=0x7effb001c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc945929ac9bc4b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:04.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effb5d9b640 1 -- 172.21.15.37:0/13852971 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00a5790 con 0x7effb80b3c20 2023-07-09T21:41:04.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effb5d9b640 1 -- 172.21.15.37:0/13852971 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00a58f0 con 0x7effb80b3c20 2023-07-09T21:41:04.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effb5d9b640 1 -- 172.21.15.37:0/13852971 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00a5c80 con 0x7effb80b3c20 2023-07-09T21:41:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 -- 172.21.15.37:0/13852971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 msgr2=0x7effb80b4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 --2- 172.21.15.37:0/13852971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb80b4060 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7effb8069aa0 tx=0x7effb001c910 comp rx=0 tx=0).stop 2023-07-09T21:41:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 -- 172.21.15.37:0/13852971 shutdown_connections 2023-07-09T21:41:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 --2- 172.21.15.37:0/13852971 >> v2:172.21.15.37:3300/0 conn(0x7effb80ceb80 0x7effb80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 --2- 172.21.15.37:0/13852971 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb80b4060 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 --2- 172.21.15.37:0/13852971 >> v2:172.21.15.119:3300/0 conn(0x7effb80b7980 0x7effb8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 -- 172.21.15.37:0/13852971 >> 172.21.15.37:0/13852971 conn(0x7effb8073090 msgr2=0x7effb8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 -- 172.21.15.37:0/13852971 shutdown_connections 2023-07-09T21:41:04.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.969+0000 7effbd048640 1 -- 172.21.15.37:0/13852971 wait complete. 2023-07-09T21:41:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 Processor -- start 2023-07-09T21:41:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- start start 2023-07-09T21:41:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80ceb80 0x7effb815da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8150190 con 0x7effb80b7980 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8154410 con 0x7effb80ceb80 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb815dfd0 con 0x7effb80b3c20 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54508/0 (socket says 172.21.15.37:54508) 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 -- 172.21.15.37:0/905932544 learned_addr learned my addr 172.21.15.37:0/905932544 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb6d9d640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb759e640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80ceb80 0x7effb815da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:04.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 -- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 msgr2=0x7effb815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 -- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80ceb80 msgr2=0x7effb815da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:04.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80ceb80 0x7effb815da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 -- 172.21.15.37:0/905932544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009a70 con 0x7effb80b7980 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb6d9d640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effb659c640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7effac00e930 tx=0x7effac00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac009690 con 0x7effb80b7980 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00ca00 con 0x7effb80b7980 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00cd70 con 0x7effb80b7980 2023-07-09T21:41:04.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb815e270 con 0x7effb80b7980 2023-07-09T21:41:04.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb8153dc0 con 0x7effb80b7980 2023-07-09T21:41:04.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.973+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb804d7d0 con 0x7effb80b7980 2023-07-09T21:41:04.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.977+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7effac013470 con 0x7effb80b7980 2023-07-09T21:41:04.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.977+0000 7eff9f7fe640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 0x7effa4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:04.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.977+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7effac084560 con 0x7effb80b7980 2023-07-09T21:41:04.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.977+0000 7effb6d9d640 1 -- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 msgr2=0x7effa4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:04.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.977+0000 7effb6d9d640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 0x7effa4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:04.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:04.981+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effac051580 con 0x7effb80b7980 2023-07-09T21:41:05.032 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.035+0000 7faa95647180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:41:05.083 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.085+0000 7fe89d01a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:41:05.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effb80b1600 con 0x7effb80b7980 2023-07-09T21:41:05.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7eff9f7fe640 1 -- 172.21.15.37:0/905932544 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7effac054ba0 con 0x7effb80b7980 2023-07-09T21:41:05.138 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:41:05.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 msgr2=0x7effa4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 0x7effa4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 msgr2=0x7effb814fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7effac00e930 tx=0x7effac00edf0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 shutdown_connections 2023-07-09T21:41:05.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7effa40664c0 0x7effa4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb80ceb80 0x7effb815da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.137+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb80b7980 0x7effb814fc50 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.141+0000 7effbd048640 1 --2- 172.21.15.37:0/905932544 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80b3c20 0x7effb815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.141+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 >> 172.21.15.37:0/905932544 conn(0x7effb8073090 msgr2=0x7effb80b5060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.141+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 shutdown_connections 2023-07-09T21:41:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.141+0000 7effbd048640 1 -- 172.21.15.37:0/905932544 wait complete. 2023-07-09T21:41:05.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:41:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 Processor -- start 2023-07-09T21:41:05.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 -- start start 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0ac0b7980 0x7ff0ac160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 0x7ff0ac0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac15bf80 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0cd070 con 0x7ff0ac0b7980 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0b0dd2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0cfd70 con 0x7ff0ac0d0780 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0ac0b7980 0x7ff0ac160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0ac0b7980 0x7ff0ac160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54514/0 (socket says 172.21.15.37:54514) 2023-07-09T21:41:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 -- 172.21.15.37:0/1766599593 learned_addr learned my addr 172.21.15.37:0/1766599593 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aad9d640 1 --2- 172.21.15.37:0/1766599593 >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 0x7ff0ac0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 -- 172.21.15.37:0/1766599593 >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 msgr2=0x7ff0ac0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 --2- 172.21.15.37:0/1766599593 >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 0x7ff0ac0d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 -- 172.21.15.37:0/1766599593 >> v1:172.21.15.119:6789/0 conn(0x7ff0ac0ceb80 legacy=0x7ff0ac0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aa59c640 1 -- 172.21.15.37:0/1766599593 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac160570 con 0x7ff0ac0b7980 2023-07-09T21:41:05.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.313+0000 7ff0aad9d640 1 --2- 172.21.15.37:0/1766599593 >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 0x7ff0ac0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0aa59c640 1 --2- 172.21.15.37:0/1766599593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0b7980 0x7ff0ac160030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b1240 tx=0x7ff09c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44909001cb7e00c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0a959a640 1 -- 172.21.15.37:0/1766599593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0ab600 con 0x7ff0ac0b7980 2023-07-09T21:41:05.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0a959a640 1 -- 172.21.15.37:0/1766599593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c0a7050 con 0x7ff0ac0b7980 2023-07-09T21:41:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0a959a640 1 -- 172.21.15.37:0/1766599593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c0ab980 con 0x7ff0ac0b7980 2023-07-09T21:41:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1766599593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0b7980 msgr2=0x7ff0ac160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1766599593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0b7980 0x7ff0ac160030 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b1240 tx=0x7ff09c01c500 comp rx=0 tx=0).stop 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1766599593 shutdown_connections 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1766599593 >> v2:172.21.15.119:3300/0 conn(0x7ff0ac0d0780 0x7ff0ac0d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1766599593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0b7980 0x7ff0ac160030 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1766599593 >> 172.21.15.37:0/1766599593 conn(0x7ff0ac073090 msgr2=0x7ff0ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1766599593 shutdown_connections 2023-07-09T21:41:05.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.317+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1766599593 wait complete. 2023-07-09T21:41:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 Processor -- start 2023-07-09T21:41:05.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- start start 2023-07-09T21:41:05.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 0x7ff0ac1f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac0d0780 0x7ff0ac152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac15eff0 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac1f84a0 con 0x7ff0ac0d0780 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac15dc70 con 0x7ff0ac0b7980 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54518/0 (socket says 172.21.15.37:54518) 2023-07-09T21:41:05.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 -- 172.21.15.37:0/1966306701 learned_addr learned my addr 172.21.15.37:0/1966306701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0aa59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 0x7ff0ac1f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0aad9d640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac0d0780 0x7ff0ac152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 -- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 msgr2=0x7ff0ac1f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 0x7ff0ac1f7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 -- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac0d0780 msgr2=0x7ff0ac152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac0d0780 0x7ff0ac152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 -- 172.21.15.37:0/1966306701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0094d0 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0aa59c640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 0x7ff0ac1f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0a9d9b640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c500 tx=0x7ff0a000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0005220 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0005380 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac15df50 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0007270 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.321+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac15e510 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac04d7d0 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ff0a00073d0 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff09affd640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 0x7ff08c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ff0a0083960 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff0aa59c640 1 -- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 msgr2=0x7ff08c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.325+0000 7ff0aa59c640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 0x7ff08c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:05.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.329+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0a0050970 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff0ac15bf80 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff09affd640 1 -- 172.21.15.37:0/1966306701 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff0ac15bf80 con 0x7ff0ac0ceb80 2023-07-09T21:41:05.485 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 msgr2=0x7ff08c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 0x7ff08c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 msgr2=0x7ff0ac14c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.485+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000c500 tx=0x7ff0a000c9c0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 shutdown_connections 2023-07-09T21:41:05.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ff08c0664c0 0x7ff08c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac0d0780 0x7ff0ac152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0ac0ceb80 0x7ff0ac14c7d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 --2- 172.21.15.37:0/1966306701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0b7980 0x7ff0ac1f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 >> 172.21.15.37:0/1966306701 conn(0x7ff0ac073090 msgr2=0x7ff0ac0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 shutdown_connections 2023-07-09T21:41:05.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.489+0000 7ff0b0dd2640 1 -- 172.21.15.37:0/1966306701 wait complete. 2023-07-09T21:41:05.508 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.511+0000 7faa95647180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:05.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:41:05.566 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.571+0000 7faa95647180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:41:05.604 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.605+0000 7fe89d01a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:05.620 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.627+0000 7faa95647180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:41:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.657+0000 7f8b1229e640 1 Processor -- start 2023-07-09T21:41:05.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.657+0000 7f8b1229e640 1 -- start start 2023-07-09T21:41:05.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1229e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b0c0b7980 0x7f8b0c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1229e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1229e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c15bf80 con 0x7f8b0c0ceb80 2023-07-09T21:41:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1229e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0cd070 con 0x7f8b0c0d0780 2023-07-09T21:41:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1229e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0cfd70 con 0x7f8b0c0b7980 2023-07-09T21:41:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54534/0 (socket says 172.21.15.37:54534) 2023-07-09T21:41:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 -- 172.21.15.37:0/101231220 learned_addr learned my addr 172.21.15.37:0/101231220 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b0bfff640 1 --2- 172.21.15.37:0/101231220 >> v2:172.21.15.119:3300/0 conn(0x7f8b0c0b7980 0x7f8b0c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 -- 172.21.15.37:0/101231220 >> v2:172.21.15.119:3300/0 conn(0x7f8b0c0b7980 msgr2=0x7f8b0c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 --2- 172.21.15.37:0/101231220 >> v2:172.21.15.119:3300/0 conn(0x7f8b0c0b7980 0x7f8b0c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 -- 172.21.15.37:0/101231220 >> v1:172.21.15.37:6789/0 conn(0x7f8b0c0ceb80 legacy=0x7f8b0c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 -- 172.21.15.37:0/101231220 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c160570 con 0x7f8b0c0d0780 2023-07-09T21:41:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.661+0000 7f8b1083b640 1 --2- 172.21.15.37:0/101231220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c069aa0 tx=0x7f8b0401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b44e666c3d2c367 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b0affd640 1 -- 172.21.15.37:0/101231220 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040a5690 con 0x7f8b0c0d0780 2023-07-09T21:41:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b0affd640 1 -- 172.21.15.37:0/101231220 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b040a57f0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b0affd640 1 -- 172.21.15.37:0/101231220 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040a5b80 con 0x7f8b0c0d0780 2023-07-09T21:41:05.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- 172.21.15.37:0/101231220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 msgr2=0x7f8b0c0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- 172.21.15.37:0/101231220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c069aa0 tx=0x7f8b0401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- 172.21.15.37:0/101231220 shutdown_connections 2023-07-09T21:41:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- 172.21.15.37:0/101231220 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c0d0b80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- 172.21.15.37:0/101231220 >> v2:172.21.15.119:3300/0 conn(0x7f8b0c0b7980 0x7f8b0c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- 172.21.15.37:0/101231220 >> 172.21.15.37:0/101231220 conn(0x7f8b0c073090 msgr2=0x7f8b0c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- 172.21.15.37:0/101231220 shutdown_connections 2023-07-09T21:41:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- 172.21.15.37:0/101231220 wait complete. 2023-07-09T21:41:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 Processor -- start 2023-07-09T21:41:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 -- start start 2023-07-09T21:41:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 0x7f8b0c15b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b0c0ceb80 0x7f8b0c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.665+0000 7f8b1229e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c159d60 con 0x7f8b0c0d0780 2023-07-09T21:41:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c15a040 con 0x7f8b0c0b7980 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c15a320 con 0x7f8b0c0ceb80 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 0x7f8b0c15b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b0bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 0x7f8b0c15b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:44334/0 (socket says 172.21.15.37:44334) 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54550/0 (socket says 172.21.15.37:54550) 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b0bfff640 1 -- 172.21.15.37:0/3921884277 learned_addr learned my addr 172.21.15.37:0/3921884277 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b0b7fe640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b0c0ceb80 0x7f8b0c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 -- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b0c0ceb80 msgr2=0x7f8b0c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b0c0ceb80 0x7f8b0c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 -- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 msgr2=0x7f8b0c15b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 0x7f8b0c15b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 -- 172.21.15.37:0/3921884277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009b30 con 0x7f8b0c0d0780 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1083b640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8b040ab000 tx=0x7f8b04019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040bd070 con 0x7f8b0c0d0780 2023-07-09T21:41:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04009510 con 0x7f8b0c0d0780 2023-07-09T21:41:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040a5690 con 0x7f8b0c0d0780 2023-07-09T21:41:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c15a600 con 0x7f8b0c0d0780 2023-07-09T21:41:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c15b6c0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.675 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.669+0000 7fe89d01a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:41:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c0c9dc0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.669+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f8b040b88c0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.673+0000 7f8b08ff9640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 0x7f8af8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.673+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f8b0411eda0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.673+0000 7f8b0bfff640 1 -- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 msgr2=0x7f8af8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.673+0000 7f8b0bfff640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 0x7f8af8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:05.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.677+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b0c0c9dc0 con 0x7f8b0c0d0780 2023-07-09T21:41:05.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.711+0000 7faa95647180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:41:05.729 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.729+0000 7fe89d01a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:41:05.764 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.767+0000 7faa95647180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:41:05.821 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.821+0000 7fe89d01a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:41:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.833+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b0c160570 con 0x7f8b0c0d0780 2023-07-09T21:41:05.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.833+0000 7f8b08ff9640 1 -- 172.21.15.37:0/3921884277 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b0c160570 con 0x7f8b0c0d0780 2023-07-09T21:41:05.835 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:41:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 msgr2=0x7f8af8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 0x7f8af8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 msgr2=0x7f8b0c1532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:05.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f8b040ab000 tx=0x7f8b04019770 comp rx=0 tx=0).stop 2023-07-09T21:41:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 shutdown_connections 2023-07-09T21:41:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f8af80664c0 0x7f8af8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b0c0d0780 0x7f8b0c1532b0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b0c0ceb80 0x7f8b0c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 --2- 172.21.15.37:0/3921884277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b0c0b7980 0x7f8b0c15b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 >> 172.21.15.37:0/3921884277 conn(0x7f8b0c073090 msgr2=0x7f8b0c15cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 shutdown_connections 2023-07-09T21:41:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:05.837+0000 7f8b1229e640 1 -- 172.21.15.37:0/3921884277 wait complete. 2023-07-09T21:41:05.848 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.855+0000 7faa95647180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:41:05.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:41:05.884 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.885+0000 7fe89d01a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:41:05.905 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:05.911+0000 7faa95647180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:41:05.974 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:05.973+0000 7fe89d01a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:41:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.005+0000 7f0704aec640 1 Processor -- start 2023-07-09T21:41:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.005+0000 7f0704aec640 1 -- start start 2023-07-09T21:41:06.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f0704aec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f070015f130 0x7f07000b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f0704aec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f07000b74e0 0x7f07000cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f0704aec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07000b3bb0 con 0x7f07000d0360 2023-07-09T21:41:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f0704aec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07000b7960 con 0x7f070015f130 2023-07-09T21:41:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f0704aec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07000cccb0 con 0x7f07000b74e0 2023-07-09T21:41:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f070015f130 0x7f07000b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f070015f130 0x7f07000b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54566/0 (socket says 172.21.15.37:54566) 2023-07-09T21:41:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 -- 172.21.15.37:0/1301956963 learned_addr learned my addr 172.21.15.37:0/1301956963 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fdd9b640 1 --2- 172.21.15.37:0/1301956963 >> v2:172.21.15.119:3300/0 conn(0x7f07000b74e0 0x7f07000cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 -- 172.21.15.37:0/1301956963 >> v2:172.21.15.119:3300/0 conn(0x7f07000b74e0 msgr2=0x7f07000cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 --2- 172.21.15.37:0/1301956963 >> v2:172.21.15.119:3300/0 conn(0x7f07000b74e0 0x7f07000cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 -- 172.21.15.37:0/1301956963 >> v1:172.21.15.37:6789/0 conn(0x7f07000d0360 legacy=0x7f07000b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 -- 172.21.15.37:0/1301956963 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000d0780 con 0x7f070015f130 2023-07-09T21:41:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.009+0000 7f06fe59c640 1 --2- 172.21.15.37:0/1301956963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070015f130 0x7f07000b6fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0700069e90 tx=0x7f06f001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd98a8e46c9bd7c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f06fd59a640 1 -- 172.21.15.37:0/1301956963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00ab650 con 0x7f070015f130 2023-07-09T21:41:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f06fd59a640 1 -- 172.21.15.37:0/1301956963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00ab7b0 con 0x7f070015f130 2023-07-09T21:41:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f06fd59a640 1 -- 172.21.15.37:0/1301956963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00abb40 con 0x7f070015f130 2023-07-09T21:41:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 -- 172.21.15.37:0/1301956963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070015f130 msgr2=0x7f07000b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 --2- 172.21.15.37:0/1301956963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070015f130 0x7f07000b6fa0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0700069e90 tx=0x7f06f001c450 comp rx=0 tx=0).stop 2023-07-09T21:41:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 -- 172.21.15.37:0/1301956963 shutdown_connections 2023-07-09T21:41:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 --2- 172.21.15.37:0/1301956963 >> v2:172.21.15.119:3300/0 conn(0x7f07000b74e0 0x7f07000cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 --2- 172.21.15.37:0/1301956963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f070015f130 0x7f07000b6fa0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 -- 172.21.15.37:0/1301956963 >> 172.21.15.37:0/1301956963 conn(0x7f0700072d20 msgr2=0x7f07000d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 -- 172.21.15.37:0/1301956963 shutdown_connections 2023-07-09T21:41:06.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 -- 172.21.15.37:0/1301956963 wait complete. 2023-07-09T21:41:06.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.013+0000 7f0704aec640 1 Processor -- start 2023-07-09T21:41:06.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- start start 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07000d0360 0x7f07001546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f070015f130 0x7f0700159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015c920 con 0x7f07000b74e0 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015cc00 con 0x7f070015f130 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070015cee0 con 0x7f07000d0360 2023-07-09T21:41:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54568/0 (socket says 172.21.15.37:54568) 2023-07-09T21:41:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 -- 172.21.15.37:0/2528881301 learned_addr learned my addr 172.21.15.37:0/2528881301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fdd9b640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07000d0360 0x7f07001546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fed9d640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f070015f130 0x7f0700159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 -- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07000d0360 msgr2=0x7f07001546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07000d0360 0x7f07001546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 -- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f070015f130 msgr2=0x7f0700159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f070015f130 0x7f0700159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 -- 172.21.15.37:0/2528881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f00094d0 con 0x7f07000b74e0 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06fe59c640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f06f00ad040 tx=0x7f06f001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00b4800 con 0x7f07000b74e0 2023-07-09T21:41:06.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00b4960 con 0x7f07000b74e0 2023-07-09T21:41:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070015d1c0 con 0x7f07000b74e0 2023-07-09T21:41:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00b4cd0 con 0x7f07000b74e0 2023-07-09T21:41:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.017+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0700153040 con 0x7f07000b74e0 2023-07-09T21:41:06.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07000668f0 con 0x7f07000b74e0 2023-07-09T21:41:06.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f06f00b3380 con 0x7f07000b74e0 2023-07-09T21:41:06.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f06eeffd640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 0x7f06e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f06f011ecf0 con 0x7f07000b74e0 2023-07-09T21:41:06.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f06fdd9b640 1 -- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 msgr2=0x7f06e0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.021+0000 7f06fdd9b640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 0x7f06e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:06.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.025+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f06f00ebc50 con 0x7f07000b74e0 2023-07-09T21:41:06.041 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.041+0000 7fe89d01a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:41:06.048 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.051+0000 7faa95647180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:41:06.105 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.111+0000 7faa95647180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:41:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.181+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f07000b33c0 con 0x7f07000b74e0 2023-07-09T21:41:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.181+0000 7f06eeffd640 1 -- 172.21.15.37:0/2528881301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f00ef270 con 0x7f07000b74e0 2023-07-09T21:41:06.183 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:41:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 msgr2=0x7f06e0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 0x7f06e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 msgr2=0x7f0700152b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f06f00ad040 tx=0x7f06f001ac90 comp rx=0 tx=0).stop 2023-07-09T21:41:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 shutdown_connections 2023-07-09T21:41:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f06e00664c0 0x7f06e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f070015f130 0x7f0700159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f07000d0360 0x7f07001546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 --2- 172.21.15.37:0/2528881301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07000b74e0 0x7f0700152b00 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 >> 172.21.15.37:0/2528881301 conn(0x7f0700072d20 msgr2=0x7f07000cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 shutdown_connections 2023-07-09T21:41:06.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.185+0000 7f0704aec640 1 -- 172.21.15.37:0/2528881301 wait complete. 2023-07-09T21:41:06.192 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.193+0000 7fe89d01a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:41:06.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:41:06.257 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.257+0000 7fe89d01a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:41:06.345 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:41:06.345 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:41:06.345 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:41:06.353 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.359+0000 7faa95647180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:41:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.393+0000 7ffa63f9f640 1 Processor -- start 2023-07-09T21:41:06.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.393+0000 7ffa63f9f640 1 -- start start 2023-07-09T21:41:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa63f9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b7a60 0x7ffa5c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa63f9f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffa5c0b47a0 0x7ffa5c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa63f9f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa5c0cef80 con 0x7ffa5c0b4140 2023-07-09T21:41:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa63f9f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5c0b45b0 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa63f9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c0cf260 con 0x7ffa5c0b7a60 2023-07-09T21:41:06.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6153a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffa5c0b47a0 0x7ffa5c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6253c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7ffa5c0b4140 0x7ffa5c15f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57520/0 (socket says 172.21.15.37:57520) 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6253c640 1 -- 172.21.15.37:0/4183218424 learned_addr learned my addr 172.21.15.37:0/4183218424 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa61d3b640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b7a60 0x7ffa5c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6153a640 1 -- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b7a60 msgr2=0x7ffa5c0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6153a640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b7a60 0x7ffa5c0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6153a640 1 -- 172.21.15.37:0/4183218424 >> v1:172.21.15.119:6789/0 conn(0x7ffa5c0b4140 legacy=0x7ffa5c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa6153a640 1 -- 172.21.15.37:0/4183218424 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c0cf540 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.397+0000 7ffa60d39640 1 -- 172.21.15.37:0/4183218424 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986341926 0 0) 0x7ffa5c0cef80 con 0x7ffa5c0b4140 2023-07-09T21:41:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa6153a640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b47a0 0x7ffa5c0b3c00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0097c0 tx=0x7ffa4c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=345d622dec3ca44f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:06.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa60d39640 1 -- 172.21.15.37:0/4183218424 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0ab600 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa60d39640 1 -- 172.21.15.37:0/4183218424 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c0a7050 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa60d39640 1 -- 172.21.15.37:0/4183218424 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0ab980 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b47a0 msgr2=0x7ffa5c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b47a0 0x7ffa5c0b3c00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffa4c0097c0 tx=0x7ffa4c01c480 comp rx=0 tx=0).stop 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- 172.21.15.37:0/4183218424 shutdown_connections 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b47a0 0x7ffa5c0b3c00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 --2- 172.21.15.37:0/4183218424 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b7a60 0x7ffa5c0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- 172.21.15.37:0/4183218424 >> 172.21.15.37:0/4183218424 conn(0x7ffa5c073050 msgr2=0x7ffa5c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- 172.21.15.37:0/4183218424 shutdown_connections 2023-07-09T21:41:06.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- 172.21.15.37:0/4183218424 wait complete. 2023-07-09T21:41:06.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 Processor -- start 2023-07-09T21:41:06.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.401+0000 7ffa63f9f640 1 -- start start 2023-07-09T21:41:06.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b47a0 0x7ffa5c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa5c0b7a60 0x7ffa5c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15dfb0 con 0x7ffa5c0b7a60 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa6153a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b47a0 0x7ffa5c15caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:44368/0 (socket says 172.21.15.37:44368) 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 -- 172.21.15.37:0/120898675 learned_addr learned my addr 172.21.15.37:0/120898675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:06.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c153ef0 con 0x7ffa5c0b4140 2023-07-09T21:41:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5c15d3a0 con 0x7ffa5c0b47a0 2023-07-09T21:41:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa6253c640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa5c0b7a60 0x7ffa5c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b47a0 msgr2=0x7ffa5c15caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b47a0 0x7ffa5c15caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa5c0b7a60 msgr2=0x7ffa5c0b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa5c0b7a60 0x7ffa5c0b60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009420 con 0x7ffa5c0b4140 2023-07-09T21:41:06.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa61d3b640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800e930 tx=0x7ffa5800edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58009690 con 0x7ffa5c0b4140 2023-07-09T21:41:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800ca00 con 0x7ffa5c0b4140 2023-07-09T21:41:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800cd70 con 0x7ffa5c0b4140 2023-07-09T21:41:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa5c15d680 con 0x7ffa5c0b4140 2023-07-09T21:41:06.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.405+0000 7ffa63f9f640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa5c15dc40 con 0x7ffa5c0b4140 2023-07-09T21:41:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7ffa58013470 con 0x7ffa5c0b4140 2023-07-09T21:41:06.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5c0cdaa0 con 0x7ffa5c0b4140 2023-07-09T21:41:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa527fc640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 0x7ffa40068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7ffa58084550 con 0x7ffa5c0b4140 2023-07-09T21:41:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa6153a640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 msgr2=0x7ffa40068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:06.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.413+0000 7ffa6153a640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 0x7ffa40068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:06.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.417+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa58051610 con 0x7ffa5c0b4140 2023-07-09T21:41:06.488 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.495+0000 7faa95647180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:06.513 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:41:06.513 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:41:06.513 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:41:06.522 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.521+0000 7fe89d01a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:41:06.612 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.615+0000 7faa95647180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:06.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.617+0000 7ffa6153a640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 msgr2=0x7ffa40068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:06.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.617+0000 7ffa6153a640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 0x7ffa40068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:41:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.633+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa5c0c9880 con 0x7ffa5c0b4140 2023-07-09T21:41:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.633+0000 7ffa527fc640 1 -- 172.21.15.37:0/120898675 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v116) v1 ==== 80+0+476 (secure 0 0 0) 0x7ffa5c0c9880 con 0x7ffa5c0b4140 2023-07-09T21:41:06.635 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/393451723 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.635 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2531669424 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.635 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1666164128 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.635 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/2505789332 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.635 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/2505789332 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.636 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/490648385 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.636 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1550900068 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.636 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4027902757 2023-07-10T21:40:00.854757+0000 2023-07-09T21:41:06.636 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:41:06.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 msgr2=0x7ffa40068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 0x7ffa40068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 msgr2=0x7ffa5c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffa5800e930 tx=0x7ffa5800edf0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 shutdown_connections 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7ffa400664c0 0x7ffa40068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa5c0b7a60 0x7ffa5c0b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffa5c0b47a0 0x7ffa5c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 --2- 172.21.15.37:0/120898675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffa5c0b4140 0x7ffa5c1539b0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 >> 172.21.15.37:0/120898675 conn(0x7ffa5c073050 msgr2=0x7ffa5c0c8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 shutdown_connections 2023-07-09T21:41:06.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:06.637+0000 7ffa3ffff640 1 -- 172.21.15.37:0/120898675 wait complete. 2023-07-09T21:41:06.663 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:41:06.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:06.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:06.675 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.673+0000 7fe89d01a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:06.682 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.687+0000 7faa95647180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:41:06.693 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[57460]: fuse finished with error 0 and tester_r 0 2023-07-09T21:41:06.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:41:06.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:06.697 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:41:06.748 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:41:06.748 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:06.758 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:41:06.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:41:06.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:06.759 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:41:06.807 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:41:06.808 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:41:06.809 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:41:06.809 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:06.814 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.813+0000 7fe89d01a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:06.816 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:06.823+0000 7faa95647180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:06.820 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:41:06.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:41:06.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:06.821 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:41:06.876 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:41:06.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:41:06.878 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:41:06.878 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:06.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:41:06.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:41:06.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:06.888 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:41:06.890 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:06.889+0000 7fe89d01a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:41:06.935 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:41:06.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:41:06.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:07.033 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:07.033+0000 7fe89d01a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 Processor -- start 2023-07-09T21:41:07.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 -- start start 2023-07-09T21:41:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 0x7f770006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 0x7f77000d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77000b49f0 con 0x7f77000cef80 2023-07-09T21:41:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77000b7e80 con 0x7f77000b4340 2023-07-09T21:41:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f770531f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cc8a0 con 0x7f77000b7ab0 2023-07-09T21:41:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f76ff7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 0x7f77000d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f76feffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 0x7f770006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f76f7fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f77000cef80 0x7f77000b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57528/0 (socket says 172.21.15.37:57528) 2023-07-09T21:41:07.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.085+0000 7f76f7fff640 1 -- 172.21.15.37:0/7535168 learned_addr learned my addr 172.21.15.37:0/7535168 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76feffd640 1 -- 172.21.15.37:0/7535168 >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 msgr2=0x7f77000d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76feffd640 1 --2- 172.21.15.37:0/7535168 >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 0x7f77000d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76feffd640 1 -- 172.21.15.37:0/7535168 >> v1:172.21.15.119:6789/0 conn(0x7f77000cef80 legacy=0x7f77000b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76feffd640 1 -- 172.21.15.37:0/7535168 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77000ccb80 con 0x7f77000b7ab0 2023-07-09T21:41:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76ff7fe640 1 --2- 172.21.15.37:0/7535168 >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 0x7f77000d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:07.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76fe7fc640 1 -- 172.21.15.37:0/7535168 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1706866457 0 0) 0x7f77000b49f0 con 0x7f77000cef80 2023-07-09T21:41:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76feffd640 1 --2- 172.21.15.37:0/7535168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 0x7f770006aa50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097c0 tx=0x7f76f001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14fc39fea296563e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76fe7fc640 1 -- 172.21.15.37:0/7535168 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00ab650 con 0x7f77000b7ab0 2023-07-09T21:41:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76fe7fc640 1 -- 172.21.15.37:0/7535168 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00ab7b0 con 0x7f77000b7ab0 2023-07-09T21:41:07.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.089+0000 7f76fe7fc640 1 -- 172.21.15.37:0/7535168 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f00abb40 con 0x7f77000b7ab0 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- 172.21.15.37:0/7535168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 msgr2=0x7f770006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- 172.21.15.37:0/7535168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 0x7f770006aa50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f76f00097c0 tx=0x7f76f001c450 comp rx=0 tx=0).stop 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- 172.21.15.37:0/7535168 shutdown_connections 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- 172.21.15.37:0/7535168 >> v2:172.21.15.119:3300/0 conn(0x7f77000b4340 0x7f77000d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- 172.21.15.37:0/7535168 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b7ab0 0x7f770006aa50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- 172.21.15.37:0/7535168 >> 172.21.15.37:0/7535168 conn(0x7f7700073090 msgr2=0x7f7700069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- 172.21.15.37:0/7535168 shutdown_connections 2023-07-09T21:41:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- 172.21.15.37:0/7535168 wait complete. 2023-07-09T21:41:07.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 Processor -- start 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- start start 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b4340 0x7f770015e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77000cef80 0x7f7700155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77000cbed0 con 0x7f77000b7ab0 2023-07-09T21:41:07.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7700148ef0 con 0x7f77000cef80 2023-07-09T21:41:07.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f770531f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77000c9a80 con 0x7f77000b4340 2023-07-09T21:41:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54584/0 (socket says 172.21.15.37:54584) 2023-07-09T21:41:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 -- 172.21.15.37:0/2719588539 learned_addr learned my addr 172.21.15.37:0/2719588539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76feffd640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b4340 0x7f770015e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76ff7fe640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77000cef80 0x7f7700155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 -- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b4340 msgr2=0x7f770015e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b4340 0x7f770015e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 -- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77000cef80 msgr2=0x7f7700155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77000cef80 0x7f7700155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 -- 172.21.15.37:0/2719588539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f8009a70 con 0x7f77000b7ab0 2023-07-09T21:41:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.093+0000 7f76f7fff640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c480 tx=0x7f76e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80074e0 con 0x7f77000b7ab0 2023-07-09T21:41:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8007660 con 0x7f77000b7ab0 2023-07-09T21:41:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f0009420 con 0x7f77000b7ab0 2023-07-09T21:41:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8004a30 con 0x7f77000b7ab0 2023-07-09T21:41:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77000ca000 con 0x7f77000b7ab0 2023-07-09T21:41:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770004d7d0 con 0x7f77000b7ab0 2023-07-09T21:41:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f76e8004b90 con 0x7f77000b7ab0 2023-07-09T21:41:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 0x7f76e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f76e8084080 con 0x7f77000b7ab0 2023-07-09T21:41:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76feffd640 1 -- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 msgr2=0x7f76e0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.097+0000 7f76feffd640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 0x7f76e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:07.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.101+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76e80b4700 con 0x7f77000b7ab0 2023-07-09T21:41:07.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.293+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f770006a830 con 0x7f77000b7ab0 2023-07-09T21:41:07.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.293+0000 7f76f77fe640 1 -- 172.21.15.37:0/2719588539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f76e8050fc0 con 0x7f77000b7ab0 2023-07-09T21:41:07.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:07.294 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:41:07.294 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:41:07.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 msgr2=0x7f76e0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:07.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 0x7f76e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 msgr2=0x7f770014fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c480 tx=0x7f76e800c880 comp rx=0 tx=0).stop 2023-07-09T21:41:07.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 shutdown_connections 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f76e00664c0 0x7f76e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77000cef80 0x7f7700155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77000b7ab0 0x7f770014fbb0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 --2- 172.21.15.37:0/2719588539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77000b4340 0x7f770015e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 >> 172.21.15.37:0/2719588539 conn(0x7f7700073090 msgr2=0x7f77000d1590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 shutdown_connections 2023-07-09T21:41:07.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.297+0000 7f770531f640 1 -- 172.21.15.37:0/2719588539 wait complete. 2023-07-09T21:41:07.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:07.355 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:07.359+0000 7faa95647180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:41:07.441 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:07.447+0000 7faa95647180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:41:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.461+0000 7fdff7048640 1 Processor -- start 2023-07-09T21:41:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.461+0000 7fdff7048640 1 -- start start 2023-07-09T21:41:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdff7048640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdff00cc800 0x7fdff00ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdff7048640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff006acb0 con 0x7fdff015ba60 2023-07-09T21:41:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdff7048640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff00ccc90 con 0x7fdff00cf090 2023-07-09T21:41:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdff7048640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff00cfe20 con 0x7fdff00cc800 2023-07-09T21:41:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdff00cc800 0x7fdff00ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdff00cc800 0x7fdff00ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33054/0 (socket says 172.21.15.37:33054) 2023-07-09T21:41:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 -- 172.21.15.37:0/2848317313 learned_addr learned my addr 172.21.15.37:0/2848317313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdff4de4640 1 --1- 172.21.15.37:0/2848317313 >> v1:172.21.15.37:6789/0 conn(0x7fdff015ba60 0x7fdff01600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42946/0 (socket says 172.21.15.37:42946) 2023-07-09T21:41:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 -- 172.21.15.37:0/2848317313 >> v1:172.21.15.119:6789/0 conn(0x7fdff00cf090 legacy=0x7fdff00d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 -- 172.21.15.37:0/2848317313 >> v1:172.21.15.37:6789/0 conn(0x7fdff015ba60 legacy=0x7fdff01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfeffff640 1 -- 172.21.15.37:0/2848317313 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff00d0100 con 0x7fdff00cc800 2023-07-09T21:41:07.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.465+0000 7fdfef7fe640 1 -- 172.21.15.37:0/2848317313 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650725566 0 0) 0x7fdff006acb0 con 0x7fdff015ba60 2023-07-09T21:41:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdfeffff640 1 --2- 172.21.15.37:0/2848317313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cc800 0x7fdff00ceb50 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009870 tx=0x7fdfdc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd988e4adeed58f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdfef7fe640 1 -- 172.21.15.37:0/2848317313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0a95f0 con 0x7fdff00cc800 2023-07-09T21:41:07.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdfef7fe640 1 -- 172.21.15.37:0/2848317313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc0a9750 con 0x7fdff00cc800 2023-07-09T21:41:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdfef7fe640 1 -- 172.21.15.37:0/2848317313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0a9ae0 con 0x7fdff00cc800 2023-07-09T21:41:07.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- 172.21.15.37:0/2848317313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cc800 msgr2=0x7fdff00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 --2- 172.21.15.37:0/2848317313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cc800 0x7fdff00ceb50 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009870 tx=0x7fdfdc01c510 comp rx=0 tx=0).stop 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- 172.21.15.37:0/2848317313 shutdown_connections 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 --2- 172.21.15.37:0/2848317313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cc800 0x7fdff00ceb50 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- 172.21.15.37:0/2848317313 >> 172.21.15.37:0/2848317313 conn(0x7fdff0073090 msgr2=0x7fdff0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- 172.21.15.37:0/2848317313 shutdown_connections 2023-07-09T21:41:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- 172.21.15.37:0/2848317313 wait complete. 2023-07-09T21:41:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 Processor -- start 2023-07-09T21:41:07.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.469+0000 7fdff7048640 1 -- start start 2023-07-09T21:41:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 0x7fdff00b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdff015ba60 0x7fdff00c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00c9690 con 0x7fdff00cf090 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b4340 con 0x7fdff00cc800 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff00b4620 con 0x7fdff015ba60 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff4de4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 0x7fdff00b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33060/0 (socket says 172.21.15.37:33060) 2023-07-09T21:41:07.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff4de4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 0x7fdff00b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:45054/0 (socket says 172.21.15.37:45054) 2023-07-09T21:41:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 -- 172.21.15.37:0/3584099681 learned_addr learned my addr 172.21.15.37:0/3584099681 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:07.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff55e5640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdff015ba60 0x7fdff00c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 -- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdff015ba60 msgr2=0x7fdff00c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdff015ba60 0x7fdff00c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 -- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 msgr2=0x7fdff00b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 0x7fdff00b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 -- 172.21.15.37:0/3584099681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc0094d0 con 0x7fdff00cf090 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfeffff640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ab040 tx=0x7fdfdc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0a95b0 con 0x7fdff00cf090 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc004030 con 0x7fdff00cf090 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff00b4900 con 0x7fdff00cf090 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc0043c0 con 0x7fdff00cf090 2023-07-09T21:41:07.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff00d2b90 con 0x7fdff00cf090 2023-07-09T21:41:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff00668f0 con 0x7fdff00cf090 2023-07-09T21:41:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.473+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fdfdc003620 con 0x7fdff00cf090 2023-07-09T21:41:07.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.477+0000 7fdfed7fa640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 0x7fdfd4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.477+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7fdfdc11ee90 con 0x7fdff00cf090 2023-07-09T21:41:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.477+0000 7fdff4de4640 1 -- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 msgr2=0x7fdfd4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:07.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.477+0000 7fdff4de4640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 0x7fdfd4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:07.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.481+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdfdc0ebe90 con 0x7fdff00cf090 2023-07-09T21:41:07.588 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:07.591+0000 7faa95647180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:41:07.619 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:07.621+0000 7fe89d01a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:41:07.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.633+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdff006a7f0 con 0x7fdff00cf090 2023-07-09T21:41:07.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdfed7fa640 1 -- 172.21.15.37:0/3584099681 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18994 (secure 0 0 0) 0x7fdfdc0c0090 con 0x7fdff00cf090 2023-07-09T21:41:07.636 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:07.637 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":116,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:02.265962+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/393451723":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2531669424":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1666164128":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6833/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6832/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/490648385":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1550900068":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/4027902757":"2023-07-10T21:40:00.854757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 msgr2=0x7fdfd4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 0x7fdfd4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 msgr2=0x7fdff00b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc0ab040 tx=0x7fdfdc0046d0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 shutdown_connections 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7fdfd40664c0 0x7fdfd4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdff015ba60 0x7fdff00c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdff00cf090 0x7fdff00b3940 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 --2- 172.21.15.37:0/3584099681 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdff00cc800 0x7fdff00b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 >> 172.21.15.37:0/3584099681 conn(0x7fdff0073090 msgr2=0x7fdff0157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 shutdown_connections 2023-07-09T21:41:07.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.637+0000 7fdff7048640 1 -- 172.21.15.37:0/3584099681 wait complete. 2023-07-09T21:41:07.658 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:39:40.732353+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:39:41.604971+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:41:07.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:41:07.671 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:07.675+0000 7faa95647180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:41:07.713 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:07.713+0000 7fe89d01a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:41:07.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 Processor -- start 2023-07-09T21:41:07.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 -- start start 2023-07-09T21:41:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3aa00b7980 0x7f3aa0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3aa00ceb80 0x7f3aa00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b3c20 0x7f3aa00b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00cd070 con 0x7f3aa00ceb80 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aa00cfd70 con 0x7f3aa00b7980 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3aa4d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa015bf80 con 0x7f3aa00b3c20 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3aa00ceb80 0x7f3aa00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3aa00ceb80 0x7f3aa00cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33072/0 (socket says 172.21.15.37:33072) 2023-07-09T21:41:07.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/4000239931 learned_addr learned my addr 172.21.15.37:0/4000239931 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9ed9d640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b3c20 0x7f3aa00b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9e59c640 1 --2- 172.21.15.37:0/4000239931 >> v2:172.21.15.119:3300/0 conn(0x7f3aa00b7980 0x7f3aa0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/4000239931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b3c20 msgr2=0x7f3aa00b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b3c20 0x7f3aa00b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/4000239931 >> v2:172.21.15.119:3300/0 conn(0x7f3aa00b7980 msgr2=0x7f3aa0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:07.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/4000239931 >> v2:172.21.15.119:3300/0 conn(0x7f3aa00b7980 0x7f3aa0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.809+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/4000239931 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aa0160570 con 0x7f3aa00ceb80 2023-07-09T21:41:07.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa00cefc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0069aa0 tx=0x7f3a9401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb7f8416f37fbae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3a9d59a640 1 -- 172.21.15.37:0/4000239931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940ab600 con 0x7f3aa00ceb80 2023-07-09T21:41:07.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3a9d59a640 1 -- 172.21.15.37:0/4000239931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a940a7050 con 0x7f3aa00ceb80 2023-07-09T21:41:07.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3a9d59a640 1 -- 172.21.15.37:0/4000239931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940ab980 con 0x7f3aa00ceb80 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 -- 172.21.15.37:0/4000239931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 msgr2=0x7f3aa00cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa00cefc0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0069aa0 tx=0x7f3a9401c500 comp rx=0 tx=0).stop 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 -- 172.21.15.37:0/4000239931 shutdown_connections 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa00cefc0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/4000239931 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b3c20 0x7f3aa00b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/4000239931 >> v2:172.21.15.119:3300/0 conn(0x7f3aa00b7980 0x7f3aa0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 -- 172.21.15.37:0/4000239931 >> 172.21.15.37:0/4000239931 conn(0x7f3aa0073090 msgr2=0x7f3aa0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 -- 172.21.15.37:0/4000239931 shutdown_connections 2023-07-09T21:41:07.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.813+0000 7f3aa4d40640 1 -- 172.21.15.37:0/4000239931 wait complete. 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 Processor -- start 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- start start 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa00b3c20 0x7f3aa015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa01525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa015aae0 con 0x7f3aa00ceb80 2023-07-09T21:41:07.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa015a650 con 0x7f3aa00b3c20 2023-07-09T21:41:07.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa0159ab0 con 0x7f3aa00b7980 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33432/0 (socket says 172.21.15.37:33432) 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/2882391157 learned_addr learned my addr 172.21.15.37:0/2882391157 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa01525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9e59c640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa00b3c20 0x7f3aa015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:07.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa00b3c20 msgr2=0x7f3aa015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa00b3c20 0x7f3aa015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/2882391157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 msgr2=0x7f3aa01525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa01525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 -- 172.21.15.37:0/2882391157 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a940094d0 con 0x7f3aa00b7980 2023-07-09T21:41:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9ed9d640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa01525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a9dd9b640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ae040 tx=0x7f3a940192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940bc070 con 0x7f3aa00b7980 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a940b6420 con 0x7f3aa00b7980 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a940b67b0 con 0x7f3aa00b7980 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa0159d20 con 0x7f3aa00b7980 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.817+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa015a2e0 con 0x7f3aa00b7980 2023-07-09T21:41:07.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aa004d7d0 con 0x7f3aa00b7980 2023-07-09T21:41:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 46) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f3a940b2040 con 0x7f3aa00b7980 2023-07-09T21:41:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3a8effd640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 0x7f3a80068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6522+0+0 (secure 0 0 0) 0x7f3a9411dfa0 con 0x7f3aa00b7980 2023-07-09T21:41:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3a9e59c640 1 -- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 msgr2=0x7f3a80068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/501737474 2023-07-09T21:41:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.821+0000 7f3a9e59c640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 0x7f3a80068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.825+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3a940eaec0 con 0x7f3aa00b7980 2023-07-09T21:41:07.874 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:07.873+0000 7fe89d01a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:41:07.940 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:07.947+0000 7faa95647180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:41:07.962 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:07.961+0000 7fe89d01a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:41:07.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.981+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3aa0160570 con 0x7f3aa00b7980 2023-07-09T21:41:07.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.981+0000 7f3a8effd640 1 -- 172.21.15.37:0/2882391157 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3aa0160570 con 0x7f3aa00b7980 2023-07-09T21:41:07.981 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:41:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 msgr2=0x7f3a80068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 0x7f3a80068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 msgr2=0x7f3aa0152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:07.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3a940ae040 tx=0x7f3a940192a0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 shutdown_connections 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:6832/501737474,v1:172.21.15.119:6833/501737474] conn(0x7f3a800664c0 0x7f3a80068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3aa00ceb80 0x7f3aa01525b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3aa00b7980 0x7f3aa0152070 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 --2- 172.21.15.37:0/2882391157 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3aa00b3c20 0x7f3aa015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 >> 172.21.15.37:0/2882391157 conn(0x7f3aa0073090 msgr2=0x7f3aa00b5470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:07.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 shutdown_connections 2023-07-09T21:41:07.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:07.985+0000 7f3aa4d40640 1 -- 172.21.15.37:0/2882391157 wait complete. 2023-07-09T21:41:08.000 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.007+0000 7faa95647180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:41:08.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:41:08.081 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa1daeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.081 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa1daeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.082 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa1daeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.082 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa1daeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.082 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa1daeb640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa20af1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa20af1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa20af1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa20af1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:08.087+0000 7faa20af1640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:08.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 Processor -- start 2023-07-09T21:41:08.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 -- start start 2023-07-09T21:41:08.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f7248160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72480ceb80 0x7f72480cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72480b3c20 0x7f72480b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480cd070 con 0x7f72480ceb80 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72480cfd70 con 0x7f72480b3c20 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724f996640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724815bf80 con 0x7f72480b7980 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72480ceb80 0x7f72480cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72480ceb80 0x7f72480cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33090/0 (socket says 172.21.15.37:33090) 2023-07-09T21:41:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 -- 172.21.15.37:0/1081193120 learned_addr learned my addr 172.21.15.37:0/1081193120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724df33640 1 --2- 172.21.15.37:0/1081193120 >> v2:172.21.15.119:3300/0 conn(0x7f72480b3c20 0x7f72480b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724d732640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f7248160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 -- 172.21.15.37:0/1081193120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 msgr2=0x7f7248160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f7248160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 -- 172.21.15.37:0/1081193120 >> v2:172.21.15.119:3300/0 conn(0x7f72480b3c20 msgr2=0x7f72480b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 --2- 172.21.15.37:0/1081193120 >> v2:172.21.15.119:3300/0 conn(0x7f72480b3c20 0x7f72480b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.161+0000 7f724cf31640 1 -- 172.21.15.37:0/1081193120 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7248160570 con 0x7f72480ceb80 2023-07-09T21:41:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724cf31640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f72480cef90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f724808ad30 tx=0x7f723801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7404ddec09d2b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f723ffff640 1 -- 172.21.15.37:0/1081193120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380ab600 con 0x7f72480ceb80 2023-07-09T21:41:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f723ffff640 1 -- 172.21.15.37:0/1081193120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72380a7050 con 0x7f72480ceb80 2023-07-09T21:41:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f723ffff640 1 -- 172.21.15.37:0/1081193120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72380ab980 con 0x7f72480ceb80 2023-07-09T21:41:08.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- 172.21.15.37:0/1081193120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 msgr2=0x7f72480cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f72480cef90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f724808ad30 tx=0x7f723801c500 comp rx=0 tx=0).stop 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- 172.21.15.37:0/1081193120 shutdown_connections 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f72480cef90 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 --2- 172.21.15.37:0/1081193120 >> v2:172.21.15.119:3300/0 conn(0x7f72480b3c20 0x7f72480b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 --2- 172.21.15.37:0/1081193120 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f7248160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- 172.21.15.37:0/1081193120 >> 172.21.15.37:0/1081193120 conn(0x7f7248073090 msgr2=0x7f7248069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- 172.21.15.37:0/1081193120 shutdown_connections 2023-07-09T21:41:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- 172.21.15.37:0/1081193120 wait complete. 2023-07-09T21:41:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 Processor -- start 2023-07-09T21:41:08.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.169+0000 7f724f996640 1 -- start start 2023-07-09T21:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 0x7f72481598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f72481505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7248151070 con 0x7f72480ceb80 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72480b7180 con 0x7f72480b3c20 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480cc5b0 con 0x7f72480b7980 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724d732640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 0x7f72481598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33104/0 (socket says 172.21.15.37:33104) 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 -- 172.21.15.37:0/3180411865 learned_addr learned my addr 172.21.15.37:0/3180411865 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724cf31640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f72481505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 -- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 msgr2=0x7f72481505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f72481505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 -- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 msgr2=0x7f72481598f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 0x7f72481598f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 -- 172.21.15.37:0/3180411865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380094d0 con 0x7f72480ceb80 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724d732640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 0x7f72481598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724df33640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f724000efc0 tx=0x7f724000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240009ba0 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000f040 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400146c0 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72480b6bc0 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72480cc1f0 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72481511b0 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.173+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7240014820 con 0x7f72480ceb80 2023-07-09T21:41:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.177+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f7240084950 con 0x7f72480ceb80 2023-07-09T21:41:08.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.181+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72481511b0 con 0x7f72480ceb80 2023-07-09T21:41:08.274 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:08.273+0000 7fe89d01a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f72481511b0 con 0x7f72480ceb80 2023-07-09T21:41:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f723dffb640 1 -- 172.21.15.37:0/3180411865 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v117) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72481511b0 con 0x7f72480ceb80 2023-07-09T21:41:08.336 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:41:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 msgr2=0x7f724815e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f724000efc0 tx=0x7f724000c490 comp rx=0 tx=0).stop 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 shutdown_connections 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72480ceb80 0x7f724815e490 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72480b7980 0x7f72481505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 --2- 172.21.15.37:0/3180411865 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72480b3c20 0x7f72481598f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 >> 172.21.15.37:0/3180411865 conn(0x7f7248073090 msgr2=0x7f724815f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 shutdown_connections 2023-07-09T21:41:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.337+0000 7f724f996640 1 -- 172.21.15.37:0/3180411865 wait complete. 2023-07-09T21:41:08.340 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:08.341+0000 7fe89d01a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:41:08.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:41:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 Processor -- start 2023-07-09T21:41:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 -- start start 2023-07-09T21:41:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 0x7f60fc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc15bf80 con 0x7f60fc0ceb80 2023-07-09T21:41:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc160570 con 0x7f60fc0d0780 2023-07-09T21:41:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6102aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0cd070 con 0x7f60fc0b7980 2023-07-09T21:41:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60fc0ceb80 0x7f60fc0cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42956/0 (socket says 172.21.15.37:42956) 2023-07-09T21:41:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fbfff640 1 -- 172.21.15.37:0/1110684910 learned_addr learned my addr 172.21.15.37:0/1110684910 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:08.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6100888640 1 --2- 172.21.15.37:0/1110684910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 0x7f60fc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709150121 0 0) 0x7f60e8001120 con 0x7f60fc0ceb80 2023-07-09T21:41:08.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ec003530 con 0x7f60fc0ceb80 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 73994591 0 0) 0x7f60f40014a0 con 0x7f60fc0d0780 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60e8001120 con 0x7f60fc0d0780 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6100888640 1 -- 172.21.15.37:0/1110684910 >> v1:172.21.15.119:6789/0 conn(0x7f60fc0d0780 legacy=0x7f60fc0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1683127823 0 0) 0x7f60ec003530 con 0x7f60fc0ceb80 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6100888640 1 -- 172.21.15.37:0/1110684910 >> v1:172.21.15.37:6789/0 conn(0x7f60fc0ceb80 legacy=0x7f60fc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.505+0000 7f6100888640 1 -- 172.21.15.37:0/1110684910 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0d02f0 con 0x7f60fc0b7980 2023-07-09T21:41:08.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6100888640 1 --2- 172.21.15.37:0/1110684910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 0x7f60fc160030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f00097f0 tx=0x7f60f001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbebaccb2b8f8766 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8001810 con 0x7f60fc0b7980 2023-07-09T21:41:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f00a7050 con 0x7f60fc0b7980 2023-07-09T21:41:08.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1110684910 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00ab620 con 0x7f60fc0b7980 2023-07-09T21:41:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 -- 172.21.15.37:0/1110684910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 msgr2=0x7f60fc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 --2- 172.21.15.37:0/1110684910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 0x7f60fc160030 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60f00097f0 tx=0x7f60f001c3e0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 -- 172.21.15.37:0/1110684910 shutdown_connections 2023-07-09T21:41:08.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 --2- 172.21.15.37:0/1110684910 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0b7980 0x7f60fc160030 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 -- 172.21.15.37:0/1110684910 >> 172.21.15.37:0/1110684910 conn(0x7f60fc073090 msgr2=0x7f60fc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 -- 172.21.15.37:0/1110684910 shutdown_connections 2023-07-09T21:41:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.509+0000 7f6102aec640 1 -- 172.21.15.37:0/1110684910 wait complete. 2023-07-09T21:41:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 Processor -- start 2023-07-09T21:41:08.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 -- start start 2023-07-09T21:41:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60fc0ceb80 0x7f60fc0cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0d0780 0x7f60fc1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc15c120 con 0x7f60fc0b7980 2023-07-09T21:41:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0cbc70 con 0x7f60fc0ceb80 2023-07-09T21:41:08.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6102aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc14e7d0 con 0x7f60fc0d0780 2023-07-09T21:41:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33112/0 (socket says 172.21.15.37:33112) 2023-07-09T21:41:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 -- 172.21.15.37:0/3124250051 learned_addr learned my addr 172.21.15.37:0/3124250051 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:08.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6101089640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0d0780 0x7f60fc1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f60fbfff640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60fc0ceb80 0x7f60fc0cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 -- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0d0780 msgr2=0x7f60fc1402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0d0780 0x7f60fc1402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 -- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60fc0ceb80 msgr2=0x7f60fc0cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60fc0ceb80 0x7f60fc0cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 -- 172.21.15.37:0/3124250051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009420 con 0x7f60fc0b7980 2023-07-09T21:41:08.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f6100888640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009740 tx=0x7f60f0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.513+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0004020 con 0x7f60fc0b7980 2023-07-09T21:41:08.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f0004180 con 0x7f60fc0b7980 2023-07-09T21:41:08.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f00044f0 con 0x7f60fc0b7980 2023-07-09T21:41:08.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc14eab0 con 0x7f60fc0b7980 2023-07-09T21:41:08.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc14f070 con 0x7f60fc0b7980 2023-07-09T21:41:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc04d7d0 con 0x7f60fc0b7980 2023-07-09T21:41:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f60f00b2040 con 0x7f60fc0b7980 2023-07-09T21:41:08.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.517+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f60f011da30 con 0x7f60fc0b7980 2023-07-09T21:41:08.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.521+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60f00eaf40 con 0x7f60fc0b7980 2023-07-09T21:41:08.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.673+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f60fc0b1600 con 0x7f60fc0b7980 2023-07-09T21:41:08.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f60f97fa640 1 -- 172.21.15.37:0/3124250051 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v117) v1 ==== 104+0+11 (secure 0 0 0) 0x7f60f00ee560 con 0x7f60fc0b7980 2023-07-09T21:41:08.676 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 msgr2=0x7f60fc0ca740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009740 tx=0x7f60f0019180 comp rx=0 tx=0).stop 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 shutdown_connections 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60fc0d0780 0x7f60fc1402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60fc0ceb80 0x7f60fc0cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 --2- 172.21.15.37:0/3124250051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc0b7980 0x7f60fc0ca740 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 >> 172.21.15.37:0/3124250051 conn(0x7f60fc073090 msgr2=0x7f60fc15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 shutdown_connections 2023-07-09T21:41:08.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.677+0000 7f6102aec640 1 -- 172.21.15.37:0/3124250051 wait complete. 2023-07-09T21:41:08.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:41:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.841+0000 7f775727b640 1 Processor -- start 2023-07-09T21:41:08.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.841+0000 7f775727b640 1 -- start start 2023-07-09T21:41:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f775727b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f7750160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f775727b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77500d0780 0x7f77500d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f775727b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775015bf80 con 0x7f77500ceb80 2023-07-09T21:41:08.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f775727b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500cd070 con 0x7f77500d0780 2023-07-09T21:41:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f775727b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500cfd70 con 0x7f77500b7980 2023-07-09T21:41:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755818640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f77500d0780 0x7f77500d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7754816640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77500ceb80 0x7f77500cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42962/0 (socket says 172.21.15.37:42962) 2023-07-09T21:41:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7754816640 1 -- 172.21.15.37:0/1391736842 learned_addr learned my addr 172.21.15.37:0/1391736842 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:08.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755017640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f7750160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755818640 1 -- 172.21.15.37:0/1391736842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 msgr2=0x7f7750160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755818640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f7750160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755818640 1 -- 172.21.15.37:0/1391736842 >> v1:172.21.15.37:6789/0 conn(0x7f77500ceb80 legacy=0x7f77500cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7755818640 1 -- 172.21.15.37:0/1391736842 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750160570 con 0x7f77500d0780 2023-07-09T21:41:08.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.845+0000 7f7747fff640 1 -- 172.21.15.37:0/1391736842 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831921869 0 0) 0x7f7740001120 con 0x7f77500ceb80 2023-07-09T21:41:08.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f7755818640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500d0780 0x7f77500d0c00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f7748009d90 tx=0x7f774801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1bc029475ae3476 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f7747fff640 1 -- 172.21.15.37:0/1391736842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480a5810 con 0x7f77500d0780 2023-07-09T21:41:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f7747fff640 1 -- 172.21.15.37:0/1391736842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77480a5970 con 0x7f77500d0780 2023-07-09T21:41:08.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f7747fff640 1 -- 172.21.15.37:0/1391736842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77480a5d00 con 0x7f77500d0780 2023-07-09T21:41:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- 172.21.15.37:0/1391736842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500d0780 msgr2=0x7f77500d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500d0780 0x7f77500d0c00 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f7748009d90 tx=0x7f774801c950 comp rx=0 tx=0).stop 2023-07-09T21:41:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- 172.21.15.37:0/1391736842 shutdown_connections 2023-07-09T21:41:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500d0780 0x7f77500d0c00 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 --2- 172.21.15.37:0/1391736842 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f7750160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- 172.21.15.37:0/1391736842 >> 172.21.15.37:0/1391736842 conn(0x7f7750073090 msgr2=0x7f7750069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- 172.21.15.37:0/1391736842 shutdown_connections 2023-07-09T21:41:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- 172.21.15.37:0/1391736842 wait complete. 2023-07-09T21:41:08.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 Processor -- start 2023-07-09T21:41:08.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.849+0000 7f775727b640 1 -- start start 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f77500b2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 0x7f775014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775015ebf0 con 0x7f77500ceb80 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775015eed0 con 0x7f77500d0780 2023-07-09T21:41:08.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77501598f0 con 0x7f77500b7980 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33138/0 (socket says 172.21.15.37:33138) 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 -- 172.21.15.37:0/2382977033 learned_addr learned my addr 172.21.15.37:0/2382977033 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7755818640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 0x7f775014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7755017640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f77500b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 -- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 msgr2=0x7f77500b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f77500b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 -- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 msgr2=0x7f775014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 0x7f775014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 -- 172.21.15.37:0/2382977033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7748009a70 con 0x7f77500ceb80 2023-07-09T21:41:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7755818640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 0x7f775014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:08.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7754816640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f774000c780 tx=0x7f774000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400072d0 con 0x7f77500ceb80 2023-07-09T21:41:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7740007450 con 0x7f77500ceb80 2023-07-09T21:41:08.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77400047f0 con 0x7f77500ceb80 2023-07-09T21:41:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7750159bd0 con 0x7f77500ceb80 2023-07-09T21:41:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77500b2cc0 con 0x7f77500ceb80 2023-07-09T21:41:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775004d7d0 con 0x7f77500ceb80 2023-07-09T21:41:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.853+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 47) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f7740004950 con 0x7f77500ceb80 2023-07-09T21:41:08.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.857+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f7740082d70 con 0x7f77500ceb80 2023-07-09T21:41:08.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:08.861+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77400501d0 con 0x7f77500ceb80 2023-07-09T21:41:09.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.017+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f774004fc80 con 0x7f77500ceb80 2023-07-09T21:41:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.017+0000 7f7745ffb640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f773406c280 0x7f773406e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.017+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f775015bf60 con 0x7f77500ceb80 2023-07-09T21:41:09.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f7745ffb640 1 -- 172.21.15.37:0/2382977033 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v117) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77400701a0 con 0x7f77500ceb80 2023-07-09T21:41:09.020 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:41:09.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f7755017640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f773406c280 0x7f773406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f773406c280 msgr2=0x7f773406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f773406c280 0x7f773406e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 msgr2=0x7f775015a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f774000c780 tx=0x7f774000cc40 comp rx=0 tx=0).stop 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 shutdown_connections 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f773406c280 0x7f773406e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f77500d0780 0x7f775014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500ceb80 0x7f775015a3d0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 --2- 172.21.15.37:0/2382977033 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77500b7980 0x7f77500b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 >> 172.21.15.37:0/2382977033 conn(0x7f7750073090 msgr2=0x7f775015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 shutdown_connections 2023-07-09T21:41:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.021+0000 7f775727b640 1 -- 172.21.15.37:0/2382977033 wait complete. 2023-07-09T21:41:09.043 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 Processor -- start 2023-07-09T21:41:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 -- start start 2023-07-09T21:41:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f27980cef80 0x7f279806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980b49f0 con 0x7f27980b4340 2023-07-09T21:41:09.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27980cc8a0 con 0x7f27980b7ab0 2023-07-09T21:41:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279e559640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27980b7e80 con 0x7f27980cef80 2023-07-09T21:41:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f27977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27980b4340 0x7f27980d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42972/0 (socket says 172.21.15.37:42972) 2023-07-09T21:41:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f27977fe640 1 -- 172.21.15.37:0/3078153427 learned_addr learned my addr 172.21.15.37:0/3078153427 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279caf6640 1 --2- 172.21.15.37:0/3078153427 >> v2:172.21.15.119:3300/0 conn(0x7f27980cef80 0x7f279806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056939046 0 0) 0x7f27980b49f0 con 0x7f27980b4340 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2780003530 con 0x7f27980b4340 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869134431 0 0) 0x7f27980cc8a0 con 0x7f27980b7ab0 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27980b49f0 con 0x7f27980b7ab0 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279caf6640 1 -- 172.21.15.37:0/3078153427 >> v1:172.21.15.119:6789/0 conn(0x7f27980b7ab0 legacy=0x7f27980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279caf6640 1 -- 172.21.15.37:0/3078153427 >> v1:172.21.15.37:6789/0 conn(0x7f27980b4340 legacy=0x7f27980d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1188654420 0 0) 0x7f2780003530 con 0x7f27980b4340 2023-07-09T21:41:09.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.189+0000 7f279caf6640 1 -- 172.21.15.37:0/3078153427 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27980ccb80 con 0x7f27980cef80 2023-07-09T21:41:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279caf6640 1 --2- 172.21.15.37:0/3078153427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980cef80 0x7f279806aa50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f279001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a490a1209444eae3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278c001680 con 0x7f27980cef80 2023-07-09T21:41:09.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27900a5680 con 0x7f27980cef80 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f2796ffd640 1 -- 172.21.15.37:0/3078153427 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900a5a10 con 0x7f27980cef80 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 -- 172.21.15.37:0/3078153427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980cef80 msgr2=0x7f279806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 --2- 172.21.15.37:0/3078153427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980cef80 0x7f279806aa50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f279001c840 comp rx=0 tx=0).stop 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 -- 172.21.15.37:0/3078153427 shutdown_connections 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 --2- 172.21.15.37:0/3078153427 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980cef80 0x7f279806aa50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 -- 172.21.15.37:0/3078153427 >> 172.21.15.37:0/3078153427 conn(0x7f2798073090 msgr2=0x7f2798069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 -- 172.21.15.37:0/3078153427 shutdown_connections 2023-07-09T21:41:09.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.193+0000 7f279e559640 1 -- 172.21.15.37:0/3078153427 wait complete. 2023-07-09T21:41:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 Processor -- start 2023-07-09T21:41:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- start start 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980b4340 0x7f279814f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27980b7ab0 0x7f2798155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279814f2c0 con 0x7f27980cef80 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f279814e410 con 0x7f27980b4340 2023-07-09T21:41:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f279814e6b0 con 0x7f27980b7ab0 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33150/0 (socket says 172.21.15.37:33150) 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 -- 172.21.15.37:0/1995523655 learned_addr learned my addr 172.21.15.37:0/1995523655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f2797fff640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980b4340 0x7f279814f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f27977fe640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27980b7ab0 0x7f2798155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 -- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27980b7ab0 msgr2=0x7f2798155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27980b7ab0 0x7f2798155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 -- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980b4340 msgr2=0x7f279814f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980b4340 0x7f279814f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 -- 172.21.15.37:0/1995523655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2790009a70 con 0x7f27980cef80 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279caf6640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f27900195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2790003ba0 con 0x7f27980cef80 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2790003d00 con 0x7f27980cef80 2023-07-09T21:41:09.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f279814e990 con 0x7f27980cef80 2023-07-09T21:41:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27900b9860 con 0x7f27980cef80 2023-07-09T21:41:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.197+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f279814ef50 con 0x7f27980cef80 2023-07-09T21:41:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.201+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f279814f430 con 0x7f27980cef80 2023-07-09T21:41:09.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.201+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f27900b99c0 con 0x7f27980cef80 2023-07-09T21:41:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.201+0000 7f2794ff9640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 0x7f2784068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.201+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f279011eb50 con 0x7f27980cef80 2023-07-09T21:41:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.201+0000 7f2797fff640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 0x7f2784068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.205+0000 7f2797fff640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 0x7f2784068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27880011f0 tx=0x7f2788009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.205+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27900ebf70 con 0x7f27980cef80 2023-07-09T21:41:09.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f279804d7d0 con 0x7f27980cef80 2023-07-09T21:41:09.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f2794ff9640 1 -- 172.21.15.37:0/1995523655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f2790009450 con 0x7f27980cef80 2023-07-09T21:41:09.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:09.397 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:41:09.398 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 msgr2=0x7f2784068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 0x7f2784068580 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f27880011f0 tx=0x7f2788009040 comp rx=0 tx=0).stop 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 msgr2=0x7f279814ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f2790009d90 tx=0x7f27900195e0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 shutdown_connections 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27840660d0 0x7f2784068580 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27980cef80 0x7f279814ded0 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27980b7ab0 0x7f2798155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 --2- 172.21.15.37:0/1995523655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27980b4340 0x7f279814f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 >> 172.21.15.37:0/1995523655 conn(0x7f2798073090 msgr2=0x7f27980d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 shutdown_connections 2023-07-09T21:41:09.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.397+0000 7f279e559640 1 -- 172.21.15.37:0/1995523655 wait complete. 2023-07-09T21:41:09.418 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 Processor -- start 2023-07-09T21:41:09.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 -- start start 2023-07-09T21:41:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe40b7810 0x7fbbe415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe40ce1a0 0x7fbbe4069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40ccd40 con 0x7fbbe406a280 2023-07-09T21:41:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40cc5a0 con 0x7fbbe40b7810 2023-07-09T21:41:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe9c3c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe406a700 con 0x7fbbe40ce1a0 2023-07-09T21:41:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe8c3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe40b7810 0x7fbbe415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe8c3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbe40b7810 0x7fbbe415fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33154/0 (socket says 172.21.15.37:33154) 2023-07-09T21:41:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.561+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/3873877750 learned_addr learned my addr 172.21.15.37:0/3873877750 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe3fff640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe40ce1a0 0x7fbbe4069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/3873877750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe40ce1a0 msgr2=0x7fbbe4069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe8c3a640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe40ce1a0 0x7fbbe4069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/3873877750 >> v1:172.21.15.119:6789/0 conn(0x7fbbe406a280 legacy=0x7fbbe402ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/3873877750 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe41602d0 con 0x7fbbe40b7810 2023-07-09T21:41:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe8c3a640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe415fd90 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009870 tx=0x7fbbd801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f0e336c3e835c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe37fe640 1 -- 172.21.15.37:0/3873877750 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80aa670 con 0x7fbbe40b7810 2023-07-09T21:41:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe37fe640 1 -- 172.21.15.37:0/3873877750 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd80aa7d0 con 0x7fbbe40b7810 2023-07-09T21:41:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe37fe640 1 -- 172.21.15.37:0/3873877750 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80aab60 con 0x7fbbe40b7810 2023-07-09T21:41:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/3873877750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 msgr2=0x7fbbe415fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe415fd90 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009870 tx=0x7fbbd801c510 comp rx=0 tx=0).stop 2023-07-09T21:41:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/3873877750 shutdown_connections 2023-07-09T21:41:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe40ce1a0 0x7fbbe4069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/3873877750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe415fd90 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.565+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/3873877750 >> 172.21.15.37:0/3873877750 conn(0x7fbbe40cea60 msgr2=0x7fbbe40cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/3873877750 shutdown_connections 2023-07-09T21:41:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/3873877750 wait complete. 2023-07-09T21:41:09.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 Processor -- start 2023-07-09T21:41:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- start start 2023-07-09T21:41:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 0x7fbbe40b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbe40ce1a0 0x7fbbe4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40cbff0 con 0x7fbbe40b7810 2023-07-09T21:41:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe415af90 con 0x7fbbe40ce1a0 2023-07-09T21:41:09.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe9c3c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c91a0 con 0x7fbbe406a280 2023-07-09T21:41:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 0x7fbbe40b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33168/0 (socket says 172.21.15.37:33168) 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe3fff640 1 -- 172.21.15.37:0/2932725036 learned_addr learned my addr 172.21.15.37:0/2932725036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe943b640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbe40ce1a0 0x7fbbe4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbe40ce1a0 msgr2=0x7fbbe4158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbe40ce1a0 0x7fbbe4158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/2932725036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 msgr2=0x7fbbe40cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe8c3a640 1 -- 172.21.15.37:0/2932725036 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd80094d0 con 0x7fbbe406a280 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.569+0000 7fbbe3fff640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe8c3a640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 0x7fbbe40b4520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbbe408a270 tx=0x7fbbd801ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80b3800 con 0x7fbbe406a280 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd80b3980 con 0x7fbbe406a280 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80b3d30 con 0x7fbbe406a280 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe415b1e0 con 0x7fbbe406a280 2023-07-09T21:41:09.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40c9740 con 0x7fbbe406a280 2023-07-09T21:41:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe404e020 con 0x7fbbe406a280 2023-07-09T21:41:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fbbd80b2380 con 0x7fbbe406a280 2023-07-09T21:41:09.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 0x7fbbc8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7fbbd811e610 con 0x7fbbe406a280 2023-07-09T21:41:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.573+0000 7fbbe3fff640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 0x7fbbc8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.577+0000 7fbbe3fff640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 0x7fbbc8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4159070 tx=0x7fbbd0008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.581+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbd80eb9a0 con 0x7fbbe406a280 2023-07-09T21:41:09.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.733+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbe406bfa0 con 0x7fbbe406a280 2023-07-09T21:41:09.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe17fa640 1 -- 172.21.15.37:0/2932725036 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+19627 (secure 0 0 0) 0x7fbbd80c2090 con 0x7fbbe406a280 2023-07-09T21:41:09.737 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:09.737 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:08.004771+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3630556546":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/3798068339":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/734930504":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/1785301541":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/2819421465":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/2134231945":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6833/501737474":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6832/501737474":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/393451723":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2531669424":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1666164128":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1800433546":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6833/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6832/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/490648385":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2053430973":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/1550900068":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/4027902757":"2023-07-10T21:40:00.854757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:09.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 msgr2=0x7fbbc8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 0x7fbbc8068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4159070 tx=0x7fbbd0008040 comp rx=0 tx=0).stop 2023-07-09T21:41:09.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 msgr2=0x7fbbe40b4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 0x7fbbe40b4520 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbbe408a270 tx=0x7fbbd801ad50 comp rx=0 tx=0).stop 2023-07-09T21:41:09.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 shutdown_connections 2023-07-09T21:41:09.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fbbc80660d0 0x7fbbc8068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbe40ce1a0 0x7fbbe4158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40b7810 0x7fbbe40cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 --2- 172.21.15.37:0/2932725036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbe406a280 0x7fbbe40b4520 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 >> 172.21.15.37:0/2932725036 conn(0x7fbbe40cea60 msgr2=0x7fbbe40b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 shutdown_connections 2023-07-09T21:41:09.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.737+0000 7fbbe9c3c640 1 -- 172.21.15.37:0/2932725036 wait complete. 2023-07-09T21:41:09.758 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:41:09.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 Processor -- start 2023-07-09T21:41:09.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 -- start start 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f514c0cef80 0x7f514c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0b49f0 con 0x7f514c0b7ab0 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514c0cc8a0 con 0x7f514c0b4340 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f5151abd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514c0b7e80 con 0x7f514c0cef80 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f514c0b7ab0 0x7f514c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42982/0 (socket says 172.21.15.37:42982) 2023-07-09T21:41:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514b7fe640 1 -- 172.21.15.37:0/2208360670 learned_addr learned my addr 172.21.15.37:0/2208360670 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514bfff640 1 --2- 172.21.15.37:0/2208360670 >> v2:172.21.15.119:3300/0 conn(0x7f514c0cef80 0x7f514c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361829731 0 0) 0x7f514c0b49f0 con 0x7f514c0b7ab0 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5134003530 con 0x7f514c0b7ab0 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1041098345 0 0) 0x7f5134003530 con 0x7f514c0b7ab0 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 >> v2:172.21.15.119:3300/0 conn(0x7f514c0cef80 msgr2=0x7f514c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.901+0000 7f514a7fc640 1 --2- 172.21.15.37:0/2208360670 >> v2:172.21.15.119:3300/0 conn(0x7f514c0cef80 0x7f514c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 >> v1:172.21.15.119:6789/0 conn(0x7f514c0b4340 legacy=0x7f514c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c0ccb80 con 0x7f514c0b7ab0 2023-07-09T21:41:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f513c001680 con 0x7f514c0b7ab0 2023-07-09T21:41:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 >> v1:172.21.15.37:6789/0 conn(0x7f514c0b7ab0 legacy=0x7f514c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 0x7f5134003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134004370 0x7f5134004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5134005030 0x7f513400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513400bf80 con 0x7f5134003980 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513400c0c0 con 0x7f5134005030 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513400c280 con 0x7f5134004370 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 0x7f5134003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514affd640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134004370 0x7f5134004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514bfff640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5134005030 0x7f513400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 -- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134004370 msgr2=0x7f5134004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134004370 0x7f5134004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 -- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5134005030 msgr2=0x7f513400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5134005030 0x7f513400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 -- 172.21.15.37:0/2208360670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134003530 con 0x7f5134003980 2023-07-09T21:41:09.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514bfff640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5134005030 0x7f513400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:09.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514bfff640 1 -- 172.21.15.37:0/2208360670 reap_dead start 2023-07-09T21:41:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514b7fe640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 0x7f5134003d50 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c210 tx=0x7f513c01cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf338518c203679b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c005ae0 con 0x7f5134003980 2023-07-09T21:41:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c005c60 con 0x7f5134003980 2023-07-09T21:41:09.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.905+0000 7f514a7fc640 1 -- 172.21.15.37:0/2208360670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c0a59f0 con 0x7f5134003980 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 msgr2=0x7f5134003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 0x7f5134003d50 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f513c00c210 tx=0x7f513c01cbf0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- 172.21.15.37:0/2208360670 shutdown_connections 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 --2- 172.21.15.37:0/2208360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5134003980 0x7f5134003d50 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- 172.21.15.37:0/2208360670 >> 172.21.15.37:0/2208360670 conn(0x7f514c073090 msgr2=0x7f514c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- 172.21.15.37:0/2208360670 shutdown_connections 2023-07-09T21:41:09.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- 172.21.15.37:0/2208360670 wait complete. 2023-07-09T21:41:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 Processor -- start 2023-07-09T21:41:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- start start 2023-07-09T21:41:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134003980 0x7f514c1f3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c0d12f0 0x7f514c0d1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0c6cb0 con 0x7f514c0c5f80 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0d1ca0 con 0x7f514c0d12f0 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f5151abd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f514c1f4130 con 0x7f5134003980 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f514bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f514bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33186/0 (socket says 172.21.15.37:33186) 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f514bfff640 1 -- 172.21.15.37:0/803327528 learned_addr learned my addr 172.21.15.37:0/803327528 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f514b7fe640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134003980 0x7f514c1f3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.909+0000 7f514affd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c0d12f0 0x7f514c0d1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 -- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134003980 msgr2=0x7f514c1f3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134003980 0x7f514c1f3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 -- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c0d12f0 msgr2=0x7f514c0d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c0d12f0 0x7f514c0d1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 -- 172.21.15.37:0/803327528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f514c15c070 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f514bfff640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f514c15f3f0 tx=0x7f5144007d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514400e070 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5144003bb0 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5144003d40 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c15c350 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c15c910 con 0x7f514c0c5f80 2023-07-09T21:41:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c04d7d0 con 0x7f514c0c5f80 2023-07-09T21:41:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5144004030 con 0x7f514c0c5f80 2023-07-09T21:41:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 0x7f51380685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.913+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f5144083ad0 con 0x7f514c0c5f80 2023-07-09T21:41:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.917+0000 7f514b7fe640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 0x7f51380685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:09.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.917+0000 7f514b7fe640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 0x7f51380685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f513c0ab000 tx=0x7f513c0b1040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:09.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:09.917+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5144050e40 con 0x7f514c0c5f80 2023-07-09T21:41:10.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f514c06a830 con 0x7f514c0c5f80 2023-07-09T21:41:10.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5133fff640 1 -- 172.21.15.37:0/803327528 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f5144054460 con 0x7f514c0c5f80 2023-07-09T21:41:10.104 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:10.104 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:41:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 msgr2=0x7f51380685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 0x7f51380685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f513c0ab000 tx=0x7f513c0b1040 comp rx=0 tx=0).stop 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 msgr2=0x7f514c0c63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f514c15f3f0 tx=0x7f5144007d20 comp rx=0 tx=0).stop 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 shutdown_connections 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5138066100 0x7f51380685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f514c0c5f80 0x7f514c0c63f0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f514c0d12f0 0x7f514c0d1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 --2- 172.21.15.37:0/803327528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5134003980 0x7f514c1f3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 >> 172.21.15.37:0/803327528 conn(0x7f514c073090 msgr2=0x7f514c0b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 shutdown_connections 2023-07-09T21:41:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.105+0000 7f5151abd640 1 -- 172.21.15.37:0/803327528 wait complete. 2023-07-09T21:41:10.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.269+0000 7ff0db69e640 1 Processor -- start 2023-07-09T21:41:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.269+0000 7ff0db69e640 1 -- start start 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0db69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0db69e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff0d40b4340 0x7ff0d40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0db69e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40b49f0 con 0x7ff0d40cef80 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0db69e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d40b7e80 con 0x7ff0d40b4340 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0db69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40cc8a0 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d8c39640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0d40cef80 0x7ff0d40b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42998/0 (socket says 172.21.15.37:42998) 2023-07-09T21:41:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d8c39640 1 -- 172.21.15.37:0/1971711140 learned_addr learned my addr 172.21.15.37:0/1971711140 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d943a640 1 --2- 172.21.15.37:0/1971711140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d9c3b640 1 --2- 172.21.15.37:0/1971711140 >> v2:172.21.15.119:3300/0 conn(0x7ff0d40b4340 0x7ff0d40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0cbfff640 1 -- 172.21.15.37:0/1971711140 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424770053 0 0) 0x7ff0d40b49f0 con 0x7ff0d40cef80 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0cbfff640 1 -- 172.21.15.37:0/1971711140 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0c0003530 con 0x7ff0d40cef80 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d943a640 1 -- 172.21.15.37:0/1971711140 >> v2:172.21.15.119:3300/0 conn(0x7ff0d40b4340 msgr2=0x7ff0d40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d943a640 1 --2- 172.21.15.37:0/1971711140 >> v2:172.21.15.119:3300/0 conn(0x7ff0d40b4340 0x7ff0d40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d943a640 1 -- 172.21.15.37:0/1971711140 >> v1:172.21.15.37:6789/0 conn(0x7ff0d40cef80 legacy=0x7ff0d40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.273+0000 7ff0d943a640 1 -- 172.21.15.37:0/1971711140 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40ccb80 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0d943a640 1 --2- 172.21.15.37:0/1971711140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d406aa50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097c0 tx=0x7ff0d001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aeb04b20b57d54f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0cbfff640 1 -- 172.21.15.37:0/1971711140 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ab650 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0cbfff640 1 -- 172.21.15.37:0/1971711140 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00ab7b0 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0cbfff640 1 -- 172.21.15.37:0/1971711140 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00abb20 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 -- 172.21.15.37:0/1971711140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 msgr2=0x7ff0d406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 --2- 172.21.15.37:0/1971711140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d406aa50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00097c0 tx=0x7ff0d001c450 comp rx=0 tx=0).stop 2023-07-09T21:41:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 -- 172.21.15.37:0/1971711140 shutdown_connections 2023-07-09T21:41:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 --2- 172.21.15.37:0/1971711140 >> v2:172.21.15.119:3300/0 conn(0x7ff0d40b4340 0x7ff0d40d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 --2- 172.21.15.37:0/1971711140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d406aa50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 -- 172.21.15.37:0/1971711140 >> 172.21.15.37:0/1971711140 conn(0x7ff0d4073090 msgr2=0x7ff0d4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 -- 172.21.15.37:0/1971711140 shutdown_connections 2023-07-09T21:41:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 -- 172.21.15.37:0/1971711140 wait complete. 2023-07-09T21:41:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.277+0000 7ff0db69e640 1 Processor -- start 2023-07-09T21:41:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- start start 2023-07-09T21:41:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d40c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 0x7ff0d40d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40c8aa0 con 0x7ff0d40b4340 2023-07-09T21:41:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d41515b0 con 0x7ff0d40cef80 2023-07-09T21:41:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d4151890 con 0x7ff0d40b7ab0 2023-07-09T21:41:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33188/0 (socket says 172.21.15.37:33188) 2023-07-09T21:41:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 -- 172.21.15.37:0/3611217810 learned_addr learned my addr 172.21.15.37:0/3611217810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d8c39640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d40c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 -- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 msgr2=0x7ff0d40c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d9c3b640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 0x7ff0d40d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d40c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 -- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 msgr2=0x7ff0d40d2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 0x7ff0d40d2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 -- 172.21.15.37:0/3611217810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d0009420 con 0x7ff0d40b4340 2023-07-09T21:41:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d8c39640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d9c3b640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 0x7ff0d40d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0d943a640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c10 tx=0x7ff0d00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00ab920 con 0x7ff0d40b4340 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d00aba80 con 0x7ff0d40b4340 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d4151b70 con 0x7ff0d40b4340 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d00abe10 con 0x7ff0d40b4340 2023-07-09T21:41:10.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d4152130 con 0x7ff0d40b4340 2023-07-09T21:41:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.281+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d404d7d0 con 0x7ff0d40b4340 2023-07-09T21:41:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.285+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 48) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ff0d0003620 con 0x7ff0d40b4340 2023-07-09T21:41:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.285+0000 7ff0c9ffb640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 0x7ff0b8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.285+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7ff0d011e270 con 0x7ff0d40b4340 2023-07-09T21:41:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.285+0000 7ff0d8c39640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 0x7ff0b8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.285+0000 7ff0d8c39640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 0x7ff0b8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40b0e20 tx=0x7ff0c4009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.289+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0d00eb4d0 con 0x7ff0d40b4340 2023-07-09T21:41:10.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.309+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff0d00eb8a0 con 0x7ff0d40b4340 2023-07-09T21:41:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.481+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0d40c64d0 con 0x7ff0d40b4340 2023-07-09T21:41:10.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.481+0000 7ff0c9ffb640 1 -- 172.21.15.37:0/3611217810 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4679 (secure 0 0 0) 0x7ff0d01052f0 con 0x7ff0d40b4340 2023-07-09T21:41:10.483 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:10.483 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:39:42.620867+0000","modified":"2023-07-09T21:39:46.247149+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7881},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7881":{"gid":7881,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2299336314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":2299336314},{"type":"v1","addr":"172.21.15.37:6835","nonce":2299336314}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-07-09T21:41:10.483 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 48 2023-07-09T21:41:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 msgr2=0x7ff0b8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 0x7ff0b8068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff0d40b0e20 tx=0x7ff0c4009040 comp rx=0 tx=0).stop 2023-07-09T21:41:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 msgr2=0x7ff0d4149a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000c10 tx=0x7ff0d00191f0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 shutdown_connections 2023-07-09T21:41:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7ff0b80660d0 0x7ff0b8068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0d40cef80 0x7ff0d40d2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0d40b7ab0 0x7ff0d40c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 --2- 172.21.15.37:0/3611217810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0d40b4340 0x7ff0d4149a70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 >> 172.21.15.37:0/3611217810 conn(0x7ff0d4073090 msgr2=0x7ff0d40b6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 shutdown_connections 2023-07-09T21:41:10.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.485+0000 7ff0db69e640 1 -- 172.21.15.37:0/3611217810 wait complete. 2023-07-09T21:41:10.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 Processor -- start 2023-07-09T21:41:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 -- start start 2023-07-09T21:41:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f5406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 0x7f9f5406f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f540cbe90 con 0x7f9f540af830 2023-07-09T21:41:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5406d370 con 0x7f9f540cc770 2023-07-09T21:41:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f59ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f54159bb0 con 0x7f9f540cc320 2023-07-09T21:41:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f52ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f5406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f537fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f9f540af830 0x7f9f540afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:37484/0 (socket says 172.21.15.37:37484) 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f537fe640 1 -- 172.21.15.37:0/3557774110 learned_addr learned my addr 172.21.15.37:0/3557774110 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f53fff640 1 --2- 172.21.15.37:0/3557774110 >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 0x7f9f5406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f527fc640 1 -- 172.21.15.37:0/3557774110 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2072528433 0 0) 0x7f9f540cbe90 con 0x7f9f540af830 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f527fc640 1 -- 172.21.15.37:0/3557774110 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f3c003530 con 0x7f9f540af830 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f52ffd640 1 -- 172.21.15.37:0/3557774110 >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 msgr2=0x7f9f5406f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f52ffd640 1 --2- 172.21.15.37:0/3557774110 >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 0x7f9f5406f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f52ffd640 1 -- 172.21.15.37:0/3557774110 >> v1:172.21.15.119:6789/0 conn(0x7f9f540af830 legacy=0x7f9f540afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f52ffd640 1 -- 172.21.15.37:0/3557774110 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f540b38b0 con 0x7f9f540cc320 2023-07-09T21:41:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.649+0000 7f9f53fff640 1 --2- 172.21.15.37:0/3557774110 >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 0x7f9f5406f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f52ffd640 1 --2- 172.21.15.37:0/3557774110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f5406efc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f480097c0 tx=0x7f9f4801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e58d0dcd08d9a1db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f527fc640 1 -- 172.21.15.37:0/3557774110 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480ab680 con 0x7f9f540cc320 2023-07-09T21:41:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f527fc640 1 -- 172.21.15.37:0/3557774110 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f480ab7e0 con 0x7f9f540cc320 2023-07-09T21:41:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f527fc640 1 -- 172.21.15.37:0/3557774110 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f480abb70 con 0x7f9f540cc320 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 -- 172.21.15.37:0/3557774110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 msgr2=0x7f9f5406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/3557774110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f5406efc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f480097c0 tx=0x7f9f4801c480 comp rx=0 tx=0).stop 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 -- 172.21.15.37:0/3557774110 shutdown_connections 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/3557774110 >> v2:172.21.15.119:3300/0 conn(0x7f9f540cc770 0x7f9f5406f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/3557774110 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f5406efc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 -- 172.21.15.37:0/3557774110 >> 172.21.15.37:0/3557774110 conn(0x7f9f540ca830 msgr2=0x7f9f540cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 -- 172.21.15.37:0/3557774110 shutdown_connections 2023-07-09T21:41:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.653+0000 7f9f59ed8640 1 -- 172.21.15.37:0/3557774110 wait complete. 2023-07-09T21:41:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 Processor -- start 2023-07-09T21:41:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- start start 2023-07-09T21:41:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f540af830 0x7f9f54151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f540aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541524a0 con 0x7f9f540cc770 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541f3c60 con 0x7f9f540af830 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f541f3f40 con 0x7f9f540cc320 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33200/0 (socket says 172.21.15.37:33200) 2023-07-09T21:41:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 -- 172.21.15.37:0/2946431417 learned_addr learned my addr 172.21.15.37:0/2946431417 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f52ffd640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f540aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f537fe640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f540af830 0x7f9f54151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 -- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 msgr2=0x7f9f540aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f540aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 -- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f540af830 msgr2=0x7f9f54151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f540af830 0x7f9f54151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 -- 172.21.15.37:0/2946431417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4c009a70 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f53fff640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00efc0 tx=0x7f9f4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c009cd0 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4c00f040 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f48009420 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0039f0 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f541f4500 con 0x7f9f540cc770 2023-07-09T21:41:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.657+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5406b550 con 0x7f9f540cc770 2023-07-09T21:41:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.661+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f4c014480 con 0x7f9f540cc770 2023-07-09T21:41:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.661+0000 7f9f3bfff640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 0x7f9f40068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.661+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f9f4c084e00 con 0x7f9f540cc770 2023-07-09T21:41:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.661+0000 7f9f537fe640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 0x7f9f40068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.661+0000 7f9f537fe640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 0x7f9f40068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9f440011f0 tx=0x7f9f44007d40 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.665+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f4c055810 con 0x7f9f540cc770 2023-07-09T21:41:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.821+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f5404d7d0 con 0x7f9f540cc770 2023-07-09T21:41:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.821+0000 7f9f3bfff640 1 -- 172.21.15.37:0/2946431417 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+19627 (secure 0 0 0) 0x7f9f4c0553a0 con 0x7f9f540cc770 2023-07-09T21:41:10.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:10.822 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":117,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:08.004771+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:39:40.732353+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-07-09T21:39:41.604971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.2d","mappings":[{"from":1,"to":7}]},{"pgid":"14.36","mappings":[{"from":1,"to":5}]},{"pgid":"14.3a","mappings":[{"from":1,"to":7}]},{"pgid":"14.3c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3630556546":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/3798068339":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/734930504":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/1785301541":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/2819421465":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/2134231945":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6833/501737474":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6832/501737474":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/393451723":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2531669424":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1666164128":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/1800433546":"2023-07-10T21:41:08.004736+0000","172.21.15.119:6833/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:6832/2505789332":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/490648385":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/2053430973":"2023-07-10T21:41:08.004736+0000","172.21.15.119:0/1550900068":"2023-07-10T21:40:00.854757+0000","172.21.15.119:0/4027902757":"2023-07-10T21:40:00.854757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 msgr2=0x7f9f40068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 0x7f9f40068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9f440011f0 tx=0x7f9f44007d40 comp rx=0 tx=0).stop 2023-07-09T21:41:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 msgr2=0x7f9f541487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c00efc0 tx=0x7f9f4c00c490 comp rx=0 tx=0).stop 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 shutdown_connections 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9f400663a0 0x7f9f40068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f540cc770 0x7f9f541487f0 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f540cc320 0x7f9f540aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 --2- 172.21.15.37:0/2946431417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f540af830 0x7f9f54151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 >> 172.21.15.37:0/2946431417 conn(0x7f9f540ca830 msgr2=0x7f9f540b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 shutdown_connections 2023-07-09T21:41:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.825+0000 7f9f59ed8640 1 -- 172.21.15.37:0/2946431417 wait complete. 2023-07-09T21:41:10.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:41:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 Processor -- start 2023-07-09T21:41:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 -- start start 2023-07-09T21:41:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f105c0d1a60 0x7f105c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f105c0cc770 0x7f105c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0ccbb0 con 0x7f105c0ce9c0 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c0ce300 con 0x7f105c0d1a60 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f10623b6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c0ce5a0 con 0x7f105c0cc770 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f105c0d1a60 0x7f105c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f105c0d1a60 0x7f105c0b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33204/0 (socket says 172.21.15.37:33204) 2023-07-09T21:41:10.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 -- 172.21.15.37:0/2656939524 learned_addr learned my addr 172.21.15.37:0/2656939524 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1061bb5640 1 --2- 172.21.15.37:0/2656939524 >> v2:172.21.15.119:3300/0 conn(0x7f105c0cc770 0x7f105c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 -- 172.21.15.37:0/2656939524 >> v2:172.21.15.119:3300/0 conn(0x7f105c0cc770 msgr2=0x7f105c0b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 --2- 172.21.15.37:0/2656939524 >> v2:172.21.15.119:3300/0 conn(0x7f105c0cc770 0x7f105c0b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 -- 172.21.15.37:0/2656939524 >> v1:172.21.15.37:6789/0 conn(0x7f105c0ce9c0 legacy=0x7f105c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.989+0000 7f1060bb3640 1 -- 172.21.15.37:0/2656939524 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0d0730 con 0x7f105c0d1a60 2023-07-09T21:41:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f1060bb3640 1 --2- 172.21.15.37:0/2656939524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0d1a60 0x7f105c0b1400 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cf8b0 tx=0x7f104c01cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db4cc7452e2d9c07 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f1053fff640 1 -- 172.21.15.37:0/2656939524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0ac600 con 0x7f105c0d1a60 2023-07-09T21:41:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f1053fff640 1 -- 172.21.15.37:0/2656939524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c0a8050 con 0x7f105c0d1a60 2023-07-09T21:41:10.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f1053fff640 1 -- 172.21.15.37:0/2656939524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0ac980 con 0x7f105c0d1a60 2023-07-09T21:41:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 -- 172.21.15.37:0/2656939524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0d1a60 msgr2=0x7f105c0b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 --2- 172.21.15.37:0/2656939524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0d1a60 0x7f105c0b1400 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cf8b0 tx=0x7f104c01cde0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 -- 172.21.15.37:0/2656939524 shutdown_connections 2023-07-09T21:41:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 --2- 172.21.15.37:0/2656939524 >> v2:172.21.15.119:3300/0 conn(0x7f105c0cc770 0x7f105c0b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 --2- 172.21.15.37:0/2656939524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0d1a60 0x7f105c0b1400 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 -- 172.21.15.37:0/2656939524 >> 172.21.15.37:0/2656939524 conn(0x7f105c0d1fb0 msgr2=0x7f105c0d23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 -- 172.21.15.37:0/2656939524 shutdown_connections 2023-07-09T21:41:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.993+0000 7f10623b6640 1 -- 172.21.15.37:0/2656939524 wait complete. 2023-07-09T21:41:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 Processor -- start 2023-07-09T21:41:10.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- start start 2023-07-09T21:41:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 0x7f105c0b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f105c0d1a60 0x7f105c150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0c7130 con 0x7f105c0cc770 2023-07-09T21:41:10.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0c64c0 con 0x7f105c0ce9c0 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c0c6790 con 0x7f105c0d1a60 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33220/0 (socket says 172.21.15.37:33220) 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 -- 172.21.15.37:0/1087193034 learned_addr learned my addr 172.21.15.37:0/1087193034 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1060bb3640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 0x7f105c0b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1061bb5640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f105c0d1a60 0x7f105c150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 -- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f105c0d1a60 msgr2=0x7f105c150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f105c0d1a60 0x7f105c150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 -- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 msgr2=0x7f105c0b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:10.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 0x7f105c0b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 -- 172.21.15.37:0/1087193034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f104c0094d0 con 0x7f105c0cc770 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1060bb3640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 0x7f105c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10613b4640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f105800c500 tx=0x7f105800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058005220 con 0x7f105c0cc770 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1058005380 con 0x7f105c0cc770 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058007270 con 0x7f105c0cc770 2023-07-09T21:41:11.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c0c6a70 con 0x7f105c0cc770 2023-07-09T21:41:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:10.997+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c1572c0 con 0x7f105c0cc770 2023-07-09T21:41:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c0c7270 con 0x7f105c0cc770 2023-07-09T21:41:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f10580073d0 con 0x7f105c0cc770 2023-07-09T21:41:11.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f1051ffb640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 0x7f1040068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6952+0+0 (secure 0 0 0) 0x7f1058083b80 con 0x7f105c0cc770 2023-07-09T21:41:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f1060bb3640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 0x7f1040068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.001+0000 7f1060bb3640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 0x7f1040068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f104c0ae000 tx=0x7f104c004740 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:11.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.005+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f105c0c7270 con 0x7f105c0cc770 2023-07-09T21:41:11.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.193+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f105c0c7270 con 0x7f105c0cc770 2023-07-09T21:41:11.193 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:41:11.193+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:41:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.201+0000 7f1051ffb640 1 -- 172.21.15.37:0/1087193034 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7f105c0c7270 con 0x7f105c0cc770 2023-07-09T21:41:11.202 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:41:11.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 msgr2=0x7f1040068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 0x7f1040068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f104c0ae000 tx=0x7f104c004740 comp rx=0 tx=0).stop 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 msgr2=0x7f105c156d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f105800c500 tx=0x7f105800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 shutdown_connections 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f10400663d0 0x7f1040068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f105c0d1a60 0x7f105c150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f105c0ce9c0 0x7f105c0b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 --2- 172.21.15.37:0/1087193034 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f105c0cc770 0x7f105c156d80 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 >> 172.21.15.37:0/1087193034 conn(0x7f105c0d1fb0 msgr2=0x7f105c0b5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 shutdown_connections 2023-07-09T21:41:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.205+0000 7f10623b6640 1 -- 172.21.15.37:0/1087193034 wait complete. 2023-07-09T21:41:11.209 INFO:tasks.ceph.mds.a.smithi037.stderr: -5797> 2023-07-09T21:39:48.186+0000 7efc66ed2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:41:11.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:41:11.262 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:41:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.373+0000 7fed9d159640 1 Processor -- start 2023-07-09T21:41:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.373+0000 7fed9d159640 1 -- start start 2023-07-09T21:41:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9d159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9d159640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed980d0780 0x7fed980d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9d159640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9815bf80 con 0x7fed980ceb80 2023-07-09T21:41:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9d159640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed980cd070 con 0x7fed980d0780 2023-07-09T21:41:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9d159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed980cfd70 con 0x7fed980b7980 2023-07-09T21:41:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed980d0780 0x7fed980d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fed980d0780 0x7fed980d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33244/0 (socket says 172.21.15.37:33244) 2023-07-09T21:41:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 -- 172.21.15.37:0/2931202999 learned_addr learned my addr 172.21.15.37:0/2931202999 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed96d9d640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 -- 172.21.15.37:0/2931202999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 msgr2=0x7fed98160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 -- 172.21.15.37:0/2931202999 >> v1:172.21.15.119:6789/0 conn(0x7fed980ceb80 legacy=0x7fed980cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 -- 172.21.15.37:0/2931202999 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed98160570 con 0x7fed980d0780 2023-07-09T21:41:11.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.377+0000 7fed9759e640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980d0780 0x7fed980d0c00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fed90009e50 tx=0x7fed9001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eed6ca26f53180 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9659c640 1 -- 172.21.15.37:0/2931202999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a56e0 con 0x7fed980d0780 2023-07-09T21:41:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9659c640 1 -- 172.21.15.37:0/2931202999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed900a5840 con 0x7fed980d0780 2023-07-09T21:41:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9659c640 1 -- 172.21.15.37:0/2931202999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed900a5bd0 con 0x7fed980d0780 2023-07-09T21:41:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- 172.21.15.37:0/2931202999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980d0780 msgr2=0x7fed980d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980d0780 0x7fed980d0c00 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7fed90009e50 tx=0x7fed9001ca10 comp rx=0 tx=0).stop 2023-07-09T21:41:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- 172.21.15.37:0/2931202999 shutdown_connections 2023-07-09T21:41:11.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980d0780 0x7fed980d0c00 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- 172.21.15.37:0/2931202999 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- 172.21.15.37:0/2931202999 >> 172.21.15.37:0/2931202999 conn(0x7fed98073090 msgr2=0x7fed98069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- 172.21.15.37:0/2931202999 shutdown_connections 2023-07-09T21:41:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- 172.21.15.37:0/2931202999 wait complete. 2023-07-09T21:41:11.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 Processor -- start 2023-07-09T21:41:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- start start 2023-07-09T21:41:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed980d0780 0x7fed9815b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9815baf0 con 0x7fed980ceb80 2023-07-09T21:41:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9815a8c0 con 0x7fed980d0780 2023-07-09T21:41:11.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.381+0000 7fed9d159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed98152960 con 0x7fed980b7980 2023-07-09T21:41:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33250/0 (socket says 172.21.15.37:33250) 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 -- 172.21.15.37:0/1980816242 learned_addr learned my addr 172.21.15.37:0/1980816242 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed96d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed9759e640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed980d0780 0x7fed9815b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 -- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 msgr2=0x7fed98159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 -- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed980d0780 msgr2=0x7fed9815b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:11.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed980d0780 0x7fed9815b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 -- 172.21.15.37:0/1980816242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90009b30 con 0x7fed980ceb80 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8ffff640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c3c0 tx=0x7fed8000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed800052d0 con 0x7fed980ceb80 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed80005430 con 0x7fed980ceb80 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed80003840 con 0x7fed980ceb80 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9815a510 con 0x7fed980ceb80 2023-07-09T21:41:11.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9815adb0 con 0x7fed980ceb80 2023-07-09T21:41:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98159270 con 0x7fed980ceb80 2023-07-09T21:41:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.385+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fed800039a0 con 0x7fed980ceb80 2023-07-09T21:41:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.389+0000 7fed8f7fe640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 0x7fed78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:11.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.389+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 7038+0+0 (secure 0 0 0) 0x7fed800835e0 con 0x7fed980ceb80 2023-07-09T21:41:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.389+0000 7fed96d9d640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 0x7fed78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:11.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.389+0000 7fed96d9d640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 0x7fed78068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed88009ac0 tx=0x7fed88009190 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:11.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.393+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed80050590 con 0x7fed980ceb80 2023-07-09T21:41:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:11.581+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed9815bf60 con 0x7fed980ceb80 2023-07-09T21:41:12.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.201+0000 7fed8f7fe640 1 -- 172.21.15.37:0/1980816242 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed80053bb0 con 0x7fed980ceb80 2023-07-09T21:41:12.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 msgr2=0x7fed78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 0x7fed78068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fed88009ac0 tx=0x7fed88009190 comp rx=0 tx=0).stop 2023-07-09T21:41:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 msgr2=0x7fed9815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c3c0 tx=0x7fed8000c880 comp rx=0 tx=0).stop 2023-07-09T21:41:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 shutdown_connections 2023-07-09T21:41:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fed780663a0 0x7fed78068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed980d0780 0x7fed9815b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed980ceb80 0x7fed9815d490 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 --2- 172.21.15.37:0/1980816242 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed980b7980 0x7fed98159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 >> 172.21.15.37:0/1980816242 conn(0x7fed98073090 msgr2=0x7fed980cef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 shutdown_connections 2023-07-09T21:41:12.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.205+0000 7fed9d159640 1 -- 172.21.15.37:0/1980816242 wait complete. 2023-07-09T21:41:12.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:41:12.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.421+0000 7f11474ec640 1 Processor -- start 2023-07-09T21:41:12.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.421+0000 7f11474ec640 1 -- start start 2023-07-09T21:41:12.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f11474ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1140160030 0x7f11400d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:12.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f11474ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f114015bf80 con 0x7f11400b7980 2023-07-09T21:41:12.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f11474ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400d02f0 con 0x7f11400cf290 2023-07-09T21:41:12.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f11474ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400cd070 con 0x7f1140160030 2023-07-09T21:41:12.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145a89640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1140160030 0x7f11400d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:12.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145288640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f11400b7980 0x7f11400ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43036/0 (socket says 172.21.15.37:43036) 2023-07-09T21:41:12.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145288640 1 -- 172.21.15.37:0/1039297933 learned_addr learned my addr 172.21.15.37:0/1039297933 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:12.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145a89640 1 -- 172.21.15.37:0/1039297933 >> v1:172.21.15.119:6789/0 conn(0x7f11400cf290 legacy=0x7f11400d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145a89640 1 -- 172.21.15.37:0/1039297933 >> v1:172.21.15.37:6789/0 conn(0x7f11400b7980 legacy=0x7f11400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1145a89640 1 -- 172.21.15.37:0/1039297933 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400cc7f0 con 0x7f1140160030 2023-07-09T21:41:12.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.425+0000 7f1137fff640 1 -- 172.21.15.37:0/1039297933 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573885804 0 0) 0x7f113c001120 con 0x7f11400b7980 2023-07-09T21:41:12.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f1145a89640 1 --2- 172.21.15.37:0/1039297933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f11400d0e90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a05bc7035415a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f1137fff640 1 -- 172.21.15.37:0/1039297933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a5810 con 0x7f1140160030 2023-07-09T21:41:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f1137fff640 1 -- 172.21.15.37:0/1039297933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a5970 con 0x7f1140160030 2023-07-09T21:41:12.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f1137fff640 1 -- 172.21.15.37:0/1039297933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380a5d00 con 0x7f1140160030 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- 172.21.15.37:0/1039297933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 msgr2=0x7f11400d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 --2- 172.21.15.37:0/1039297933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f11400d0e90 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f113801c950 comp rx=0 tx=0).stop 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- 172.21.15.37:0/1039297933 shutdown_connections 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 --2- 172.21.15.37:0/1039297933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f11400d0e90 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- 172.21.15.37:0/1039297933 >> 172.21.15.37:0/1039297933 conn(0x7f1140073090 msgr2=0x7f1140069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:12.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- 172.21.15.37:0/1039297933 shutdown_connections 2023-07-09T21:41:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- 172.21.15.37:0/1039297933 wait complete. 2023-07-09T21:41:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 Processor -- start 2023-07-09T21:41:12.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.429+0000 7f11474ec640 1 -- start start 2023-07-09T21:41:12.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 0x7f1140153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 0x7f114014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114014f2a0 con 0x7f1140160030 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140153da0 con 0x7f11400b7980 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114014e620 con 0x7f11400cf290 2023-07-09T21:41:12.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33268/0 (socket says 172.21.15.37:33268) 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 -- 172.21.15.37:0/4171750155 learned_addr learned my addr 172.21.15.37:0/4171750155 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1144a87640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 0x7f114014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145288640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 0x7f1140153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 -- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 msgr2=0x7f114014b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 0x7f114014b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 -- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 msgr2=0x7f1140153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:12.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 0x7f1140153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 -- 172.21.15.37:0/4171750155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1138009a70 con 0x7f1140160030 2023-07-09T21:41:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1144a87640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 0x7f114014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:12.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145288640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 0x7f1140153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1145a89640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f11400d1be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380be070 con 0x7f1140160030 2023-07-09T21:41:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11380a57e0 con 0x7f1140160030 2023-07-09T21:41:12.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11380ad870 con 0x7f1140160030 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f114014e900 con 0x7f1140160030 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114014eec0 con 0x7f1140160030 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f114014f3e0 con 0x7f1140160030 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.433+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f11380b4040 con 0x7f1140160030 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.437+0000 7f1135ffb640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 0x7f1124068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:12.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.437+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 7038+0+0 (secure 0 0 0) 0x7f113811e860 con 0x7f1140160030 2023-07-09T21:41:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.437+0000 7f1145288640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 0x7f1124068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:12.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.437+0000 7f1145288640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 0x7f1124068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f113c000f70 tx=0x7f113c007b00 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:12.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.441+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f114014f3e0 con 0x7f1140160030 2023-07-09T21:41:12.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:12.597+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f114014f3e0 con 0x7f1140160030 2023-07-09T21:41:13.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f1135ffb640 1 -- 172.21.15.37:0/4171750155 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v119) v1 ==== 181+0+0 (secure 0 0 0) 0x7f114014f3e0 con 0x7f1140160030 2023-07-09T21:41:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 msgr2=0x7f1124068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 0x7f1124068850 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f113c000f70 tx=0x7f113c007b00 comp rx=0 tx=0).stop 2023-07-09T21:41:13.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 msgr2=0x7f1140157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f1138009d90 tx=0x7f11400d1be0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 shutdown_connections 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f11240663a0 0x7f1124068850 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1140160030 0x7f1140157a90 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11400cf290 0x7f114014b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 --2- 172.21.15.37:0/4171750155 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11400b7980 0x7f1140153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 >> 172.21.15.37:0/4171750155 conn(0x7f1140073090 msgr2=0x7f11400d0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 shutdown_connections 2023-07-09T21:41:13.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.325+0000 7f11474ec640 1 -- 172.21.15.37:0/4171750155 wait complete. 2023-07-09T21:41:13.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:41:13.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 Processor -- start 2023-07-09T21:41:13.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 -- start start 2023-07-09T21:41:13.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 0x7f9e50160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5015bf80 con 0x7f9e500b3c20 2023-07-09T21:41:13.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e500cd070 con 0x7f9e500b7980 2023-07-09T21:41:13.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e5485c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500cfd70 con 0x7f9e500ceb80 2023-07-09T21:41:13.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33666/0 (socket says 172.21.15.37:33666) 2023-07-09T21:41:13.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e47fff640 1 -- 172.21.15.37:0/1031367594 learned_addr learned my addr 172.21.15.37:0/1031367594 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.505+0000 7f9e4e59c640 1 --2- 172.21.15.37:0/1031367594 >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 0x7f9e50160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e47fff640 1 -- 172.21.15.37:0/1031367594 >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 msgr2=0x7f9e50160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e47fff640 1 --2- 172.21.15.37:0/1031367594 >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 0x7f9e50160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e47fff640 1 -- 172.21.15.37:0/1031367594 >> v1:172.21.15.119:6789/0 conn(0x7f9e500b3c20 legacy=0x7f9e500b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e47fff640 1 -- 172.21.15.37:0/1031367594 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50160570 con 0x7f9e500ceb80 2023-07-09T21:41:13.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e4e59c640 1 --2- 172.21.15.37:0/1031367594 >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 0x7f9e50160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:13.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e47fff640 1 --2- 172.21.15.37:0/1031367594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009870 tx=0x7f9e3801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0332fb1203724af server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:13.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e4dd9b640 1 -- 172.21.15.37:0/1031367594 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380ab600 con 0x7f9e500ceb80 2023-07-09T21:41:13.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e4dd9b640 1 -- 172.21.15.37:0/1031367594 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e380a7050 con 0x7f9e500ceb80 2023-07-09T21:41:13.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e4dd9b640 1 -- 172.21.15.37:0/1031367594 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380ab980 con 0x7f9e500ceb80 2023-07-09T21:41:13.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e5485c640 1 -- 172.21.15.37:0/1031367594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 msgr2=0x7f9e500cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.509+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1031367594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9e38009870 tx=0x7f9e3801c540 comp rx=0 tx=0).stop 2023-07-09T21:41:13.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- 172.21.15.37:0/1031367594 shutdown_connections 2023-07-09T21:41:13.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1031367594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500cef90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1031367594 >> v2:172.21.15.119:3300/0 conn(0x7f9e500b7980 0x7f9e50160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- 172.21.15.37:0/1031367594 >> 172.21.15.37:0/1031367594 conn(0x7f9e50073090 msgr2=0x7f9e50069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:13.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- 172.21.15.37:0/1031367594 shutdown_connections 2023-07-09T21:41:13.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- 172.21.15.37:0/1031367594 wait complete. 2023-07-09T21:41:13.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 Processor -- start 2023-07-09T21:41:13.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- start start 2023-07-09T21:41:13.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e500b3c20 0x7f9e500c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50153970 con 0x7f9e500b7980 2023-07-09T21:41:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e500c8560 con 0x7f9e500b3c20 2023-07-09T21:41:13.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e5485c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5015e110 con 0x7f9e500ceb80 2023-07-09T21:41:13.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33278/0 (socket says 172.21.15.37:33278) 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 -- 172.21.15.37:0/1357755748 learned_addr learned my addr 172.21.15.37:0/1357755748 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e4e59c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e500b3c20 0x7f9e500c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e4ed9d640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 -- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 msgr2=0x7f9e500b2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500b2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 -- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e500b3c20 msgr2=0x7f9e500c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:13.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e500b3c20 0x7f9e500c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 -- 172.21.15.37:0/1357755748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e40009420 con 0x7f9e500b7980 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e4ed9d640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.513+0000 7f9e47fff640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801abf0 tx=0x7f9e380192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380b9070 con 0x7f9e500b7980 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e380b4640 con 0x7f9e500b7980 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380b49d0 con 0x7f9e500b7980 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e380094d0 con 0x7f9e500b7980 2023-07-09T21:41:13.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50153600 con 0x7f9e500b7980 2023-07-09T21:41:13.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e501537c0 con 0x7f9e500b7980 2023-07-09T21:41:13.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9e380b2040 con 0x7f9e500b7980 2023-07-09T21:41:13.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 0x7f9e30068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:13.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.517+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6600+0+0 (secure 0 0 0) 0x7f9e3811d7d0 con 0x7f9e500b7980 2023-07-09T21:41:13.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.521+0000 7f9e4e59c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 0x7f9e30068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:13.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.521+0000 7f9e4e59c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 0x7f9e30068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e5008af40 tx=0x7f9e40008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:13.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.521+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e380ea800 con 0x7f9e500b7980 2023-07-09T21:41:13.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:13.677+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e50153180 con 0x7f9e500b7980 2023-07-09T21:41:14.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.345+0000 7f9e46ffd640 1 -- 172.21.15.37:0/1357755748 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v120) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9e50153180 con 0x7f9e500b7980 2023-07-09T21:41:14.347 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:41:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 msgr2=0x7f9e30068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 0x7f9e30068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e5008af40 tx=0x7f9e40008040 comp rx=0 tx=0).stop 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 msgr2=0x7f9e50153e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f9e3801abf0 tx=0x7f9e380192e0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 shutdown_connections 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f9e300663d0 0x7f9e30068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e500ceb80 0x7f9e500b2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e500b7980 0x7f9e50153e00 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 --2- 172.21.15.37:0/1357755748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e500b3c20 0x7f9e500c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 >> 172.21.15.37:0/1357755748 conn(0x7f9e50073090 msgr2=0x7f9e5015b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 shutdown_connections 2023-07-09T21:41:14.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.349+0000 7f9e5485c640 1 -- 172.21.15.37:0/1357755748 wait complete. 2023-07-09T21:41:14.373 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:41:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.517+0000 7f62df71f640 1 Processor -- start 2023-07-09T21:41:14.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62df71f640 1 -- start start 2023-07-09T21:41:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62df71f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62df71f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d815bf80 con 0x7f62d80ceb80 2023-07-09T21:41:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62df71f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62d8160570 con 0x7f62d80d0780 2023-07-09T21:41:14.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62df71f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80cd070 con 0x7f62d80b7980 2023-07-09T21:41:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f62d80ceb80 0x7f62d80cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43044/0 (socket says 172.21.15.37:43044) 2023-07-09T21:41:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 -- 172.21.15.37:0/3112499731 learned_addr learned my addr 172.21.15.37:0/3112499731 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dd4bb640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807845400 0 0) 0x7f62c8001120 con 0x7f62d80ceb80 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62c4003530 con 0x7f62d80ceb80 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829893259 0 0) 0x7f62c4003530 con 0x7f62d80ceb80 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 msgr2=0x7f62d8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62d8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 >> v1:172.21.15.119:6789/0 conn(0x7f62d80d0780 legacy=0x7f62d80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80d02f0 con 0x7f62d80ceb80 2023-07-09T21:41:14.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f62c8001810 con 0x7f62d80ceb80 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 >> v1:172.21.15.37:6789/0 conn(0x7f62d80ceb80 legacy=0x7f62d80cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62c40039b0 0x7f62c4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62c4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80cd070 con 0x7f62c40047d0 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c400ba40 con 0x7f62c40039b0 2023-07-09T21:41:14.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62c400bbd0 con 0x7f62d80b7980 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dd4bb640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62c40039b0 0x7f62c4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62ddcbc640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62c4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 -- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 msgr2=0x7f62c4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62c4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 -- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62c40039b0 msgr2=0x7f62c4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62c40039b0 0x7f62c4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62dccba640 1 -- 172.21.15.37:0/3112499731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4003530 con 0x7f62c40047d0 2023-07-09T21:41:14.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.521+0000 7f62ddcbc640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80b7980 0x7f62c4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62dccba640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62c4004c40 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f62c800c240 tx=0x7f62c801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2cb1fd1002a5e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8005ae0 con 0x7f62c40047d0 2023-07-09T21:41:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c80ab070 con 0x7f62c40047d0 2023-07-09T21:41:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62cffff640 1 -- 172.21.15.37:0/3112499731 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8005e60 con 0x7f62c40047d0 2023-07-09T21:41:14.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 -- 172.21.15.37:0/3112499731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 msgr2=0x7f62c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 --2- 172.21.15.37:0/3112499731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62c4004c40 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f62c800c240 tx=0x7f62c801f390 comp rx=0 tx=0).stop 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62ddcbc640 1 -- 172.21.15.37:0/3112499731 reap_dead start 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 -- 172.21.15.37:0/3112499731 shutdown_connections 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 -- 172.21.15.37:0/3112499731 >> 172.21.15.37:0/3112499731 conn(0x7f62d8073090 msgr2=0x7f62d8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 -- 172.21.15.37:0/3112499731 shutdown_connections 2023-07-09T21:41:14.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.525+0000 7f62df71f640 1 -- 172.21.15.37:0/3112499731 wait complete. 2023-07-09T21:41:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 Processor -- start 2023-07-09T21:41:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- start start 2023-07-09T21:41:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62d80c9270 0x7f62d80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80c8240 0x7f62d80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80b2e40 con 0x7f62c40047d0 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c86c0 con 0x7f62d80c9270 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62d80c9700 con 0x7f62d80c8240 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33294/0 (socket says 172.21.15.37:33294) 2023-07-09T21:41:14.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 -- 172.21.15.37:0/2210548096 learned_addr learned my addr 172.21.15.37:0/2210548096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dccba640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62d80c9270 0x7f62d80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62ddcbc640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80c8240 0x7f62d80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 -- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80c8240 msgr2=0x7f62d80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80c8240 0x7f62d80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 -- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62d80c9270 msgr2=0x7f62d80cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62d80c9270 0x7f62d80cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 -- 172.21.15.37:0/2210548096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d80b30e0 con 0x7f62c40047d0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62dd4bb640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f62d40119d0 tx=0x7f62d4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d400fb50 con 0x7f62c40047d0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d400fcb0 con 0x7f62c40047d0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d4014440 con 0x7f62c40047d0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d80b33c0 con 0x7f62c40047d0 2023-07-09T21:41:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.529+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d8157160 con 0x7f62c40047d0 2023-07-09T21:41:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d804d7d0 con 0x7f62c40047d0 2023-07-09T21:41:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f62d40145a0 con 0x7f62c40047d0 2023-07-09T21:41:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62cdffb640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 0x7f62bc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f62d40847f0 con 0x7f62c40047d0 2023-07-09T21:41:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62dccba640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 0x7f62bc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.533+0000 7f62dccba640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 0x7f62bc068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62c80af000 tx=0x7f62c80aa000 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.537+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62d4055600 con 0x7f62c40047d0 2023-07-09T21:41:14.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.693+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f62d80b3550 con 0x7f62c40047d0 2023-07-09T21:41:14.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.697+0000 7f62cdffb640 1 -- 172.21.15.37:0/2210548096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f62d4055190 con 0x7f62c40047d0 2023-07-09T21:41:14.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 msgr2=0x7f62bc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 0x7f62bc068880 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f62c80af000 tx=0x7f62c80aa000 comp rx=0 tx=0).stop 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 msgr2=0x7f62d8145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f62d40119d0 tx=0x7f62d4011e90 comp rx=0 tx=0).stop 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 shutdown_connections 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f62bc0663d0 0x7f62bc068880 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f62d80c8240 0x7f62d80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f62d80c9270 0x7f62d80cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 --2- 172.21.15.37:0/2210548096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62c40047d0 0x7f62d8145ea0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 >> 172.21.15.37:0/2210548096 conn(0x7f62d8073090 msgr2=0x7f62d80d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 shutdown_connections 2023-07-09T21:41:14.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.701+0000 7f62df71f640 1 -- 172.21.15.37:0/2210548096 wait complete. 2023-07-09T21:41:14.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:41:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 Processor -- start 2023-07-09T21:41:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 -- start start 2023-07-09T21:41:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 0x7f59900af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900ce080 con 0x7f59900cfb40 2023-07-09T21:41:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59900ce360 con 0x7f59900b0ed0 2023-07-09T21:41:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5996876640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59900ce640 con 0x7f59900b1420 2023-07-09T21:41:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5995874640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59900cfb40 0x7f59900cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43046/0 (socket says 172.21.15.37:43046) 2023-07-09T21:41:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.865+0000 7f5995874640 1 -- 172.21.15.37:0/899445941 learned_addr learned my addr 172.21.15.37:0/899445941 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5995073640 1 --2- 172.21.15.37:0/899445941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 0x7f59900af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354539136 0 0) 0x7f59900ce080 con 0x7f59900cfb40 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f597c003530 con 0x7f59900cfb40 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230074984 0 0) 0x7f59900ce360 con 0x7f59900b0ed0 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59900ce080 con 0x7f59900b0ed0 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5995073640 1 -- 172.21.15.37:0/899445941 >> v1:172.21.15.119:6789/0 conn(0x7f59900b0ed0 legacy=0x7f59900afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3502723102 0 0) 0x7f597c003530 con 0x7f59900cfb40 2023-07-09T21:41:14.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5995073640 1 -- 172.21.15.37:0/899445941 >> v1:172.21.15.37:6789/0 conn(0x7f59900cfb40 legacy=0x7f59900cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5995073640 1 -- 172.21.15.37:0/899445941 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59900aed30 con 0x7f59900b1420 2023-07-09T21:41:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5995073640 1 --2- 172.21.15.37:0/899445941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 0x7f59900af530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f59800097f0 tx=0x7f598001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0fe29bd18d679f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c001680 con 0x7f59900b1420 2023-07-09T21:41:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59800a7050 con 0x7f59900b1420 2023-07-09T21:41:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.869+0000 7f5994872640 1 -- 172.21.15.37:0/899445941 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59800ab600 con 0x7f59900b1420 2023-07-09T21:41:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- 172.21.15.37:0/899445941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 msgr2=0x7f59900af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 --2- 172.21.15.37:0/899445941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 0x7f59900af530 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f59800097f0 tx=0x7f598001c3b0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- 172.21.15.37:0/899445941 shutdown_connections 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 --2- 172.21.15.37:0/899445941 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900b1420 0x7f59900af530 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- 172.21.15.37:0/899445941 >> 172.21.15.37:0/899445941 conn(0x7f5990072d20 msgr2=0x7f59900d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- 172.21.15.37:0/899445941 shutdown_connections 2023-07-09T21:41:14.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- 172.21.15.37:0/899445941 wait complete. 2023-07-09T21:41:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 Processor -- start 2023-07-09T21:41:14.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- start start 2023-07-09T21:41:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59900b1420 0x7f599014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900cfb40 0x7f59900af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599006b070 con 0x7f59900b0ed0 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59900b40e0 con 0x7f59900b1420 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996876640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5990156be0 con 0x7f59900cfb40 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5995874640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5995874640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33296/0 (socket says 172.21.15.37:33296) 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5995874640 1 -- 172.21.15.37:0/2771788337 learned_addr learned my addr 172.21.15.37:0/2771788337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:14.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5995073640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59900b1420 0x7f599014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.873+0000 7f5996075640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900cfb40 0x7f59900af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 -- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900cfb40 msgr2=0x7f59900af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900cfb40 0x7f59900af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 -- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59900b1420 msgr2=0x7f599014ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59900b1420 0x7f599014ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 -- 172.21.15.37:0/2771788337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980009420 con 0x7f59900b0ed0 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5995874640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c760 tx=0x7f598c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c005ae0 con 0x7f59900b0ed0 2023-07-09T21:41:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c005c40 con 0x7f59900b0ed0 2023-07-09T21:41:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c007070 con 0x7f59900b0ed0 2023-07-09T21:41:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5990152a70 con 0x7f59900b0ed0 2023-07-09T21:41:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59900b4330 con 0x7f59900b0ed0 2023-07-09T21:41:14.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5990156d70 con 0x7f59900b0ed0 2023-07-09T21:41:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.877+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f598c0071d0 con 0x7f59900b0ed0 2023-07-09T21:41:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.881+0000 7f59867fc640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 0x7f5974068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.881+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f598c0834c0 con 0x7f59900b0ed0 2023-07-09T21:41:14.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.881+0000 7f5995073640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 0x7f5974068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.881+0000 7f5995073640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 0x7f5974068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f59800ad000 tx=0x7f5980004740 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:14.885+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f598c050830 con 0x7f59900b0ed0 2023-07-09T21:41:15.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.037+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f599004e020 con 0x7f59900b0ed0 2023-07-09T21:41:15.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.041+0000 7f59867fc640 1 -- 172.21.15.37:0/2771788337 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v38) v1 ==== 120+0+0 (secure 0 0 0) 0x7f598c053e50 con 0x7f59900b0ed0 2023-07-09T21:41:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 msgr2=0x7f5974068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 0x7f5974068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f59800ad000 tx=0x7f5980004740 comp rx=0 tx=0).stop 2023-07-09T21:41:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 msgr2=0x7f5990151d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f598c00c760 tx=0x7f598c00cc20 comp rx=0 tx=0).stop 2023-07-09T21:41:15.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 shutdown_connections 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f59740663a0 0x7f5974068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59900cfb40 0x7f59900af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59900b1420 0x7f599014ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 --2- 172.21.15.37:0/2771788337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59900b0ed0 0x7f5990151d90 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 >> 172.21.15.37:0/2771788337 conn(0x7f5990072d20 msgr2=0x7f599006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 shutdown_connections 2023-07-09T21:41:15.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.045+0000 7f5996876640 1 -- 172.21.15.37:0/2771788337 wait complete. 2023-07-09T21:41:15.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:41:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.217+0000 7f579f4ec640 1 Processor -- start 2023-07-09T21:41:15.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 -- start start 2023-07-09T21:41:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 0x7f5798160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57980d0780 0x7f57980d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579815bf80 con 0x7f57980b7980 2023-07-09T21:41:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57980cd070 con 0x7f57980d0780 2023-07-09T21:41:15.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579f4ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980cfd70 con 0x7f57980cf290 2023-07-09T21:41:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579ca87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 0x7f5798160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579da89640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57980d0780 0x7f57980d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579ca87640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 0x7f5798160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33754/0 (socket says 172.21.15.37:33754) 2023-07-09T21:41:15.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579ca87640 1 -- 172.21.15.37:0/1384319361 learned_addr learned my addr 172.21.15.37:0/1384319361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579d288640 1 --1- 172.21.15.37:0/1384319361 >> v1:172.21.15.119:6789/0 conn(0x7f57980b7980 0x7f57980ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:37536/0 (socket says 172.21.15.37:37536) 2023-07-09T21:41:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579da89640 1 -- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 msgr2=0x7f5798160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579da89640 1 --2- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 0x7f5798160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579da89640 1 -- 172.21.15.37:0/1384319361 >> v1:172.21.15.119:6789/0 conn(0x7f57980b7980 legacy=0x7f57980ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.221+0000 7f579da89640 1 -- 172.21.15.37:0/1384319361 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798160570 con 0x7f57980d0780 2023-07-09T21:41:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579da89640 1 --2- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980d0780 0x7f57980d0c00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5790009d90 tx=0x7f579001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ed5a0adfb31628 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f578ffff640 1 -- 172.21.15.37:0/1384319361 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57900a5810 con 0x7f57980d0780 2023-07-09T21:41:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f578ffff640 1 -- 172.21.15.37:0/1384319361 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57900a5970 con 0x7f57980d0780 2023-07-09T21:41:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f578ffff640 1 -- 172.21.15.37:0/1384319361 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57900a5d00 con 0x7f57980d0780 2023-07-09T21:41:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 -- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980d0780 msgr2=0x7f57980d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980d0780 0x7f57980d0c00 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5790009d90 tx=0x7f579001c950 comp rx=0 tx=0).stop 2023-07-09T21:41:15.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 -- 172.21.15.37:0/1384319361 shutdown_connections 2023-07-09T21:41:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980d0780 0x7f57980d0c00 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1384319361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980cf290 0x7f5798160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 -- 172.21.15.37:0/1384319361 >> 172.21.15.37:0/1384319361 conn(0x7f5798073090 msgr2=0x7f5798069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 -- 172.21.15.37:0/1384319361 shutdown_connections 2023-07-09T21:41:15.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 -- 172.21.15.37:0/1384319361 wait complete. 2023-07-09T21:41:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.225+0000 7f579f4ec640 1 Processor -- start 2023-07-09T21:41:15.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- start start 2023-07-09T21:41:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980cf290 0x7f57980cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980d0780 0x7f5798158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57981525b0 con 0x7f57980b7980 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980c9bf0 con 0x7f57980cf290 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5798153c80 con 0x7f57980d0780 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33310/0 (socket says 172.21.15.37:33310) 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 -- 172.21.15.37:0/1568039532 learned_addr learned my addr 172.21.15.37:0/1568039532 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579ca87640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980cf290 0x7f57980cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579da89640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980d0780 0x7f5798158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 -- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980d0780 msgr2=0x7f5798158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980d0780 0x7f5798158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 -- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980cf290 msgr2=0x7f57980cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980cf290 0x7f57980cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 -- 172.21.15.37:0/1568039532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009a70 con 0x7f57980b7980 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579d288640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f579400c490 tx=0x7f579400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794007480 con 0x7f57980b7980 2023-07-09T21:41:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57940075e0 con 0x7f57980b7980 2023-07-09T21:41:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5794004a10 con 0x7f57980b7980 2023-07-09T21:41:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5798153070 con 0x7f57980b7980 2023-07-09T21:41:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5798153630 con 0x7f57980b7980 2023-07-09T21:41:15.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.229+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579804d7d0 con 0x7f57980b7980 2023-07-09T21:41:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.233+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5794004b70 con 0x7f57980b7980 2023-07-09T21:41:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.233+0000 7f578dffb640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 0x7f577c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.233+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5794082ed0 con 0x7f57980b7980 2023-07-09T21:41:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.233+0000 7f579ca87640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 0x7f577c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.233+0000 7f579ca87640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 0x7f577c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f57980d30c0 tx=0x7f5788009240 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.237+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5794050240 con 0x7f57980b7980 2023-07-09T21:41:15.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.393+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f579815bf60 con 0x7f57980b7980 2023-07-09T21:41:15.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f578dffb640 1 -- 172.21.15.37:0/1568039532 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v39) v1 ==== 115+0+0 (secure 0 0 0) 0x7f5794018020 con 0x7f57980b7980 2023-07-09T21:41:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 msgr2=0x7f577c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 0x7f577c068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f57980d30c0 tx=0x7f5788009240 comp rx=0 tx=0).stop 2023-07-09T21:41:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 msgr2=0x7f57981504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f579400c490 tx=0x7f579400c950 comp rx=0 tx=0).stop 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 shutdown_connections 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f577c0663a0 0x7f577c068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57980d0780 0x7f5798158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57980cf290 0x7f57980cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 --2- 172.21.15.37:0/1568039532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57980b7980 0x7f57981504c0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 >> 172.21.15.37:0/1568039532 conn(0x7f5798073090 msgr2=0x7f5798154090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 shutdown_connections 2023-07-09T21:41:15.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.397+0000 7f579f4ec640 1 -- 172.21.15.37:0/1568039532 wait complete. 2023-07-09T21:41:15.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path' 2023-07-09T21:41:15.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 Processor -- start 2023-07-09T21:41:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 -- start start 2023-07-09T21:41:15.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ce40cef80 0x7f5ce406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce40b49f0 con 0x7f5ce40b4340 2023-07-09T21:41:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce40cc8a0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce9cd8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce40b7e80 con 0x7f5ce40cef80 2023-07-09T21:41:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5ce40b4340 0x7f5ce40d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43060/0 (socket says 172.21.15.37:43060) 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5ce40cef80 0x7f5ce406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce2ffd640 1 -- 172.21.15.37:0/745359875 learned_addr learned my addr 172.21.15.37:0/745359875 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce3fff640 1 -- 172.21.15.37:0/745359875 >> v1:172.21.15.119:6789/0 conn(0x7f5ce40b7ab0 legacy=0x7f5ce40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce3fff640 1 -- 172.21.15.37:0/745359875 >> v1:172.21.15.37:6789/0 conn(0x7f5ce40b4340 legacy=0x7f5ce40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce3fff640 1 -- 172.21.15.37:0/745359875 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce40ccb80 con 0x7f5ce40cef80 2023-07-09T21:41:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.561+0000 7f5ce27fc640 1 -- 172.21.15.37:0/745359875 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1060127774 0 0) 0x7f5ce40b49f0 con 0x7f5ce40b4340 2023-07-09T21:41:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce3fff640 1 --2- 172.21.15.37:0/745359875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40cef80 0x7f5ce406aa50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009d90 tx=0x7f5cdc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc8697f79eaf4862 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce27fc640 1 -- 172.21.15.37:0/745359875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a59e0 con 0x7f5ce40cef80 2023-07-09T21:41:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce27fc640 1 -- 172.21.15.37:0/745359875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0a5b40 con 0x7f5ce40cef80 2023-07-09T21:41:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce27fc640 1 -- 172.21.15.37:0/745359875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0ad440 con 0x7f5ce40cef80 2023-07-09T21:41:15.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/745359875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40cef80 msgr2=0x7f5ce406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/745359875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40cef80 0x7f5ce406aa50 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009d90 tx=0x7f5cdc01c920 comp rx=0 tx=0).stop 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/745359875 shutdown_connections 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/745359875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40cef80 0x7f5ce406aa50 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/745359875 >> 172.21.15.37:0/745359875 conn(0x7f5ce4073090 msgr2=0x7f5ce4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/745359875 shutdown_connections 2023-07-09T21:41:15.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.565+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/745359875 wait complete. 2023-07-09T21:41:15.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 Processor -- start 2023-07-09T21:41:15.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- start start 2023-07-09T21:41:15.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 0x7f5ce40cb270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 0x7f5ce40c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c6920 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40c5d80 con 0x7f5ce40cef80 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce40ca0b0 con 0x7f5ce40b4340 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33326/0 (socket says 172.21.15.37:33326) 2023-07-09T21:41:15.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 -- 172.21.15.37:0/405801725 learned_addr learned my addr 172.21.15.37:0/405801725 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:15.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 -- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 msgr2=0x7f5ce40cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce37fe640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 0x7f5ce40cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce3fff640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 0x7f5ce40c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 0x7f5ce40cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 -- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 msgr2=0x7f5ce40c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 0x7f5ce40c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:15.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 -- 172.21.15.37:0/405801725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc009a70 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce3fff640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 0x7f5ce40c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce37fe640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 0x7f5ce40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce2ffd640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c4e0 tx=0x7f5cd800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd80074e0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd8007680 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd8004a30 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce40cb7b0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.569+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce40c62d0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.573+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce40c6ad0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.573+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cd8004b90 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.573+0000 7f5ccbfff640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 0x7f5cd0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:15.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.573+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f5cd8082fc0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.573+0000 7f5ce37fe640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 0x7f5cd0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:15.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.577+0000 7f5ce37fe640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 0x7f5cd0068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cc380 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:15.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.577+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5ce40c6ad0 con 0x7f5ce40b7ab0 2023-07-09T21:41:15.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:15.785+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]} v 0) v1 -- 0x7f5ce40c6ad0 con 0x7f5ce40b7ab0 2023-07-09T21:41:16.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.349+0000 7f5ccbfff640 1 -- 172.21.15.37:0/405801725 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_schedule_auto_deactivation_for_non_existent_path"]}]=0 v711) v1 ==== 183+0+0 (secure 0 0 0) 0x7f5ce40c6ad0 con 0x7f5ce40b7ab0 2023-07-09T21:41:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 msgr2=0x7f5cd0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 0x7f5cd0068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5ce40cc380 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2023-07-09T21:41:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 msgr2=0x7f5ce40c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800c4e0 tx=0x7f5cd800c9a0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 shutdown_connections 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cd00663d0 0x7f5cd0068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ce40cef80 0x7f5ce40c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ce40b7ab0 0x7f5ce40c94e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 --2- 172.21.15.37:0/405801725 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ce40b4340 0x7f5ce40cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 >> 172.21.15.37:0/405801725 conn(0x7f5ce4073090 msgr2=0x7f5ce41568a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:16.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 shutdown_connections 2023-07-09T21:41:16.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.353+0000 7f5ce9cd8640 1 -- 172.21.15.37:0/405801725 wait complete. 2023-07-09T21:41:16.375 INFO:tasks.cephfs_test_runner:test_schedule_auto_deactivation_for_non_existent_path (tasks.cephfs.test_snap_schedules.TestSnapSchedules) ... ok 2023-07-09T21:41:16.376 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test existence of a scheduled snapshot 2023-07-09T21:41:16.376 INFO:tasks.cephfs_test_runner:test_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:41:16.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-09T21:41:16.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 Processor -- start 2023-07-09T21:41:16.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 -- start start 2023-07-09T21:41:16.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d6015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d600cb9f0 0x7f2d6015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6015ce20 con 0x7f2d600af830 2023-07-09T21:41:16.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d600cdbd0 con 0x7f2d600cb9f0 2023-07-09T21:41:16.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d64c93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6015bef0 con 0x7f2d60070700 2023-07-09T21:41:16.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d5e59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d6015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d57fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d600cb9f0 0x7f2d6015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d5ed9d640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f2d600af830 0x7f2d6006efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:37544/0 (socket says 172.21.15.37:37544) 2023-07-09T21:41:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.525+0000 7f2d5ed9d640 1 -- 172.21.15.37:0/780426792 learned_addr learned my addr 172.21.15.37:0/780426792 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d57fff640 1 -- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 msgr2=0x7f2d6015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d57fff640 1 --2- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d6015fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d57fff640 1 -- 172.21.15.37:0/780426792 >> v1:172.21.15.119:6789/0 conn(0x7f2d600af830 legacy=0x7f2d6006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d57fff640 1 -- 172.21.15.37:0/780426792 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d600cd610 con 0x7f2d600cb9f0 2023-07-09T21:41:16.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d57fff640 1 --2- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015c8e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d480097c0 tx=0x7f2d4801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba22d859a2d2925 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d5dd9b640 1 -- 172.21.15.37:0/780426792 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480ab600 con 0x7f2d600cb9f0 2023-07-09T21:41:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d5dd9b640 1 -- 172.21.15.37:0/780426792 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480a7050 con 0x7f2d600cb9f0 2023-07-09T21:41:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.529+0000 7f2d5dd9b640 1 -- 172.21.15.37:0/780426792 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480ab980 con 0x7f2d600cb9f0 2023-07-09T21:41:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600cb9f0 msgr2=0x7f2d6015c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015c8e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f2d480097c0 tx=0x7f2d4801c3f0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- 172.21.15.37:0/780426792 shutdown_connections 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015c8e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- 172.21.15.37:0/780426792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d6015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- 172.21.15.37:0/780426792 >> 172.21.15.37:0/780426792 conn(0x7f2d600ca830 msgr2=0x7f2d600cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- 172.21.15.37:0/780426792 shutdown_connections 2023-07-09T21:41:16.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- 172.21.15.37:0/780426792 wait complete. 2023-07-09T21:41:16.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 Processor -- start 2023-07-09T21:41:16.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- start start 2023-07-09T21:41:16.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d601587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600af830 0x7f2d60153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60159650 con 0x7f2d600cb9f0 2023-07-09T21:41:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60158db0 con 0x7f2d600af830 2023-07-09T21:41:16.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d64c93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d60159090 con 0x7f2d60070700 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33330/0 (socket says 172.21.15.37:33330) 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 -- 172.21.15.37:0/2330372481 learned_addr learned my addr 172.21.15.37:0/2330372481 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d57fff640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600af830 0x7f2d60153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5e59c640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d601587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 -- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 msgr2=0x7f2d601587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d601587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 -- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600af830 msgr2=0x7f2d60153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600af830 0x7f2d60153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:16.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.533+0000 7f2d5ed9d640 1 -- 172.21.15.37:0/2330372481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009420 con 0x7f2d600cb9f0 2023-07-09T21:41:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d5ed9d640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800cb10 tx=0x7f2d5800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5800ac70 con 0x7f2d600cb9f0 2023-07-09T21:41:16.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5800add0 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58012620 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d60159370 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d60157060 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6015e340 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d5801b3b0 con 0x7f2d600cb9f0 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 0x7f2d40068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:16.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.537+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f2d58083d60 con 0x7f2d600cb9f0 2023-07-09T21:41:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.541+0000 7f2d5e59c640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 0x7f2d40068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:16.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.541+0000 7f2d5e59c640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 0x7f2d40068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009ac0 tx=0x7f2d50009190 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:16.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.541+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d6015e340 con 0x7f2d600cb9f0 2023-07-09T21:41:16.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:16.749+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7f2d6015e340 con 0x7f2d600cb9f0 2023-07-09T21:41:17.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d56ffd640 1 -- 172.21.15.37:0/2330372481 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v712) v1 ==== 151+0+0 (secure 0 0 0) 0x7f2d6015e340 con 0x7f2d600cb9f0 2023-07-09T21:41:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 msgr2=0x7f2d40068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 0x7f2d40068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f2d50009ac0 tx=0x7f2d50009190 comp rx=0 tx=0).stop 2023-07-09T21:41:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 msgr2=0x7f2d6015ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f2d5800cb10 tx=0x7f2d5800a060 comp rx=0 tx=0).stop 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 shutdown_connections 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f2d400663d0 0x7f2d40068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d600cb9f0 0x7f2d6015ea00 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d600af830 0x7f2d60153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 --2- 172.21.15.37:0/2330372481 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d60070700 0x7f2d601587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 >> 172.21.15.37:0/2330372481 conn(0x7f2d600ca830 msgr2=0x7f2d600ad7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 shutdown_connections 2023-07-09T21:41:17.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.353+0000 7f2d64c93640 1 -- 172.21.15.37:0/2330372481 wait complete. 2023-07-09T21:41:17.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:41:17.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 Processor -- start 2023-07-09T21:41:17.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 -- start start 2023-07-09T21:41:17.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe38c0c3e10 0x7fe38c0c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c0c9090 con 0x7fe38c1585b0 2023-07-09T21:41:17.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe38c0c8a60 con 0x7fe38c15c200 2023-07-09T21:41:17.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe391456640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38c0cbf40 con 0x7fe38c0c3e10 2023-07-09T21:41:17.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe38c1585b0 0x7fe38c06b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57668/0 (socket says 172.21.15.37:57668) 2023-07-09T21:41:17.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38affd640 1 -- 172.21.15.37:0/164391210 learned_addr learned my addr 172.21.15.37:0/164391210 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:17.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755032145 0 0) 0x7fe38c0c9090 con 0x7fe38c1585b0 2023-07-09T21:41:17.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe383fff640 1 --2- 172.21.15.37:0/164391210 >> v2:172.21.15.119:3300/0 conn(0x7fe38c0c3e10 0x7fe38c0c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe378003530 con 0x7fe38c1585b0 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1964028732 0 0) 0x7fe378003530 con 0x7fe38c1585b0 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 >> v2:172.21.15.119:3300/0 conn(0x7fe38c0c3e10 msgr2=0x7fe38c0c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 --2- 172.21.15.37:0/164391210 >> v2:172.21.15.119:3300/0 conn(0x7fe38c0c3e10 0x7fe38c0c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 >> v1:172.21.15.119:6789/0 conn(0x7fe38c15c200 legacy=0x7fe38c15c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c06bb40 con 0x7fe38c1585b0 2023-07-09T21:41:17.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe37c001680 con 0x7fe38c1585b0 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 >> v1:172.21.15.37:6789/0 conn(0x7fe38c1585b0 legacy=0x7fe38c06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 0x7fe378003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3780047d0 0x7fe378004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe378005180 0x7fe37800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0cbf40 con 0x7fe378003980 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37800c000 con 0x7fe3780047d0 2023-07-09T21:41:17.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37800c1c0 con 0x7fe378005180 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.529+0000 7fe38affd640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 0x7fe378003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38b7fe640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe378005180 0x7fe37800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe383fff640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3780047d0 0x7fe378004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 -- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe378005180 msgr2=0x7fe37800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe378005180 0x7fe37800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 -- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3780047d0 msgr2=0x7fe378004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3780047d0 0x7fe378004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 -- 172.21.15.37:0/164391210 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378003530 con 0x7fe378003980 2023-07-09T21:41:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe383fff640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3780047d0 0x7fe378004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:17.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38b7fe640 1 -- 172.21.15.37:0/164391210 reap_dead start 2023-07-09T21:41:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38affd640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 0x7fe378003d90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c240 tx=0x7fe37c01cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceca1b51b269fea9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c005ae0 con 0x7fe378003980 2023-07-09T21:41:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c005c40 con 0x7fe378003980 2023-07-09T21:41:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.533+0000 7fe38a7fc640 1 -- 172.21.15.37:0/164391210 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37c0072b0 con 0x7fe378003980 2023-07-09T21:41:17.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 msgr2=0x7fe378003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 0x7fe378003d90 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe37c00c240 tx=0x7fe37c01cc10 comp rx=0 tx=0).stop 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- 172.21.15.37:0/164391210 shutdown_connections 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 --2- 172.21.15.37:0/164391210 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe378003980 0x7fe378003d90 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- 172.21.15.37:0/164391210 >> 172.21.15.37:0/164391210 conn(0x7fe38c0cde40 msgr2=0x7fe38c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- 172.21.15.37:0/164391210 shutdown_connections 2023-07-09T21:41:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- 172.21.15.37:0/164391210 wait complete. 2023-07-09T21:41:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 Processor -- start 2023-07-09T21:41:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- start start 2023-07-09T21:41:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe378003980 0x7fe38c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38c14d2d0 0x7fe38c0b1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0ae3b0 con 0x7fe38c0ada00 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c0b1b70 con 0x7fe378003980 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe391456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38c15ac50 con 0x7fe38c14d2d0 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54110/0 (socket says 172.21.15.37:54110) 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 -- 172.21.15.37:0/1378744956 learned_addr learned my addr 172.21.15.37:0/1378744956 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:17.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe383fff640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38c14d2d0 0x7fe38c0b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38affd640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe378003980 0x7fe38c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 -- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38c14d2d0 msgr2=0x7fe38c0b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38c14d2d0 0x7fe38c0b1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 -- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe378003980 msgr2=0x7fe38c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe378003980 0x7fe38c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 -- 172.21.15.37:0/1378744956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c15af30 con 0x7fe38c0ada00 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.537+0000 7fe38b7fe640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe38c15c5d0 tx=0x7fe38400e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38400ed60 con 0x7fe38c0ada00 2023-07-09T21:41:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe384003980 con 0x7fe38c0ada00 2023-07-09T21:41:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe384003d30 con 0x7fe38c0ada00 2023-07-09T21:41:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38c15b210 con 0x7fe38c0ada00 2023-07-09T21:41:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe38c0b18c0 con 0x7fe38c0ada00 2023-07-09T21:41:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38c04d7d0 con 0x7fe38c0ada00 2023-07-09T21:41:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe384005070 con 0x7fe38c0ada00 2023-07-09T21:41:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 0x7fe36c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.541+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7fe384083010 con 0x7fe38c0ada00 2023-07-09T21:41:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.545+0000 7fe38affd640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 0x7fe36c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.545+0000 7fe38affd640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 0x7fe36c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0ab000 tx=0x7fe37c0b1040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.545+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe384050380 con 0x7fe38c0ada00 2023-07-09T21:41:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.701+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe38c06f160 con 0x7fe38c0ada00 2023-07-09T21:41:17.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.705+0000 7fe3837fe640 1 -- 172.21.15.37:0/1378744956 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe384019030 con 0x7fe38c0ada00 2023-07-09T21:41:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 msgr2=0x7fe36c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 0x7fe36c068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe37c0ab000 tx=0x7fe37c0b1040 comp rx=0 tx=0).stop 2023-07-09T21:41:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 msgr2=0x7fe38c0ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe38c15c5d0 tx=0x7fe38400e840 comp rx=0 tx=0).stop 2023-07-09T21:41:17.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 shutdown_connections 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe36c0663a0 0x7fe36c068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe38c0ada00 0x7fe38c0ade70 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe38c14d2d0 0x7fe38c0b1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 --2- 172.21.15.37:0/1378744956 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe378003980 0x7fe38c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 >> 172.21.15.37:0/1378744956 conn(0x7fe38c0cde40 msgr2=0x7fe38c0ac0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 shutdown_connections 2023-07-09T21:41:17.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:17.709+0000 7fe391456640 1 -- 172.21.15.37:0/1378744956 wait complete. 2023-07-09T21:41:17.727 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:41:17.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:41:17.793 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:41:17.839 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:41:17.839 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:41:17.840 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:17.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:41:17.850 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:41:17.850 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:17.888 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:41:17.889 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:41:17.889 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:17.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:41:17.898 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:41:17.899 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:41:17.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:41:17.945 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:41:17.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 Processor -- start 2023-07-09T21:41:18.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 -- start start 2023-07-09T21:41:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 0x7f86d006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d00b49f0 con 0x7f86d00b7ab0 2023-07-09T21:41:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d00cc8a0 con 0x7f86d00b4340 2023-07-09T21:41:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d78d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00b7e80 con 0x7f86d00cef80 2023-07-09T21:41:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5674640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f86d00b7ab0 0x7f86d00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57676/0 (socket says 172.21.15.37:57676) 2023-07-09T21:41:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5674640 1 -- 172.21.15.37:0/4011915399 learned_addr learned my addr 172.21.15.37:0/4011915399 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5e75640 1 --2- 172.21.15.37:0/4011915399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 0x7f86d006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497160568 0 0) 0x7f86d00b49f0 con 0x7f86d00b7ab0 2023-07-09T21:41:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86bc003530 con 0x7f86d00b7ab0 2023-07-09T21:41:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601760412 0 0) 0x7f86d00cc8a0 con 0x7f86d00b4340 2023-07-09T21:41:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d00b49f0 con 0x7f86d00b4340 2023-07-09T21:41:18.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5e75640 1 -- 172.21.15.37:0/4011915399 >> v1:172.21.15.119:6789/0 conn(0x7f86d00b4340 legacy=0x7f86d00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5e75640 1 -- 172.21.15.37:0/4011915399 >> v1:172.21.15.37:6789/0 conn(0x7f86d00b7ab0 legacy=0x7f86d00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2631893809 0 0) 0x7f86bc003530 con 0x7f86d00b7ab0 2023-07-09T21:41:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.089+0000 7f86d5e75640 1 -- 172.21.15.37:0/4011915399 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00ccb80 con 0x7f86d00cef80 2023-07-09T21:41:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d5e75640 1 --2- 172.21.15.37:0/4011915399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 0x7f86d006aa50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009dc0 tx=0x7f86c801c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cc3dcc96a9b4aae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc001680 con 0x7f86d00cef80 2023-07-09T21:41:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c80a56a0 con 0x7f86d00cef80 2023-07-09T21:41:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86c7fff640 1 -- 172.21.15.37:0/4011915399 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80a5a30 con 0x7f86d00cef80 2023-07-09T21:41:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 -- 172.21.15.37:0/4011915399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 msgr2=0x7f86d006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 --2- 172.21.15.37:0/4011915399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 0x7f86d006aa50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009dc0 tx=0x7f86c801c860 comp rx=0 tx=0).stop 2023-07-09T21:41:18.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 -- 172.21.15.37:0/4011915399 shutdown_connections 2023-07-09T21:41:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 --2- 172.21.15.37:0/4011915399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00cef80 0x7f86d006aa50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 -- 172.21.15.37:0/4011915399 >> 172.21.15.37:0/4011915399 conn(0x7f86d0073090 msgr2=0x7f86d0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 -- 172.21.15.37:0/4011915399 shutdown_connections 2023-07-09T21:41:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.093+0000 7f86d78d8640 1 -- 172.21.15.37:0/4011915399 wait complete. 2023-07-09T21:41:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 Processor -- start 2023-07-09T21:41:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- start start 2023-07-09T21:41:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 0x7f86d014faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 0x7f86d00b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c7c40 con 0x7f86d00cef80 2023-07-09T21:41:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c7ee0 con 0x7f86d00b7ab0 2023-07-09T21:41:18.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00c81c0 con 0x7f86d00b4340 2023-07-09T21:41:18.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54126/0 (socket says 172.21.15.37:54126) 2023-07-09T21:41:18.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 -- 172.21.15.37:0/2886373167 learned_addr learned my addr 172.21.15.37:0/2886373167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:18.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5674640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 0x7f86d014faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d4e73640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 0x7f86d00b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 -- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 msgr2=0x7f86d014faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 0x7f86d014faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 -- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 msgr2=0x7f86d00b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 0x7f86d00b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 -- 172.21.15.37:0/2886373167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009a70 con 0x7f86d00cef80 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5674640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 0x7f86d014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d4e73640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 0x7f86d00b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d5e75640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b0040 tx=0x7f86c8019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8003ba0 con 0x7f86d00cef80 2023-07-09T21:41:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c8003d20 con 0x7f86d00cef80 2023-07-09T21:41:18.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c80ad890 con 0x7f86d00cef80 2023-07-09T21:41:18.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00c84a0 con 0x7f86d00cef80 2023-07-09T21:41:18.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.097+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d0150030 con 0x7f86d00cef80 2023-07-09T21:41:18.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d004d7d0 con 0x7f86d00cef80 2023-07-09T21:41:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86c80b4050 con 0x7f86d00cef80 2023-07-09T21:41:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86c5ffb640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 0x7f86b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f86c811ea70 con 0x7f86d00cef80 2023-07-09T21:41:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86d5674640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 0x7f86b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.101+0000 7f86d5674640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 0x7f86b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86cc001350 tx=0x7f86cc009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.105+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86c80ebdc0 con 0x7f86d00cef80 2023-07-09T21:41:18.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d006a830 con 0x7f86d00cef80 2023-07-09T21:41:18.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86c5ffb640 1 -- 172.21.15.37:0/2886373167 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f86c80b2de0 con 0x7f86d00cef80 2023-07-09T21:41:18.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:18.293 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":50,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6734,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3236343168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3236343168},{"type":"v1","addr":"172.21.15.119:6836","nonce":3236343168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7525,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1737930320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1737930320},{"type":"v1","addr":"172.21.15.119:6837","nonce":1737930320}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7878,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/4273974726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4273974726},{"type":"v1","addr":"172.21.15.37:6834","nonce":4273974726}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":8361,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/110945502","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":110945502},{"type":"v1","addr":"172.21.15.37:6835","nonce":110945502}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2023-07-09T21:41:18.294 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 50 2023-07-09T21:41:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 msgr2=0x7f86b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 0x7f86b4068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86cc001350 tx=0x7f86cc009040 comp rx=0 tx=0).stop 2023-07-09T21:41:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 msgr2=0x7f86d014a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.293+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f86c80b0040 tx=0x7f86c8019600 comp rx=0 tx=0).stop 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 shutdown_connections 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f86b40663a0 0x7f86b4068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d00cef80 0x7f86d014a090 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86d00b7ab0 0x7f86d00b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 --2- 172.21.15.37:0/2886373167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86d00b4340 0x7f86d014faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 >> 172.21.15.37:0/2886373167 conn(0x7f86d0073090 msgr2=0x7f86d00d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 shutdown_connections 2023-07-09T21:41:18.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.297+0000 7f86d78d8640 1 -- 172.21.15.37:0/2886373167 wait complete. 2023-07-09T21:41:18.315 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:41:18.315 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:41:18.316 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:41:18.316 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:41:18.317 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:41:18.317 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:41:18.317 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:41:18.318 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:41:18.318 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:41:18.319 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:41:18.319 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:41:18.319 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:41:18.320 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:41:18.321 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:41:18.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:41:18.321 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:41:18.331 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:41:18.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:41:18.333 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:41:18.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:41:18.335 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:41:18.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:41:18.336 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:41:18.337 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:41:18.379 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:41:18.379 DEBUG:teuthology.parallel:result is None 2023-07-09T21:41:18.380 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:41:18.381 DEBUG:teuthology.parallel:result is None 2023-07-09T21:41:18.382 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:41:18.382 DEBUG:teuthology.parallel:result is None 2023-07-09T21:41:18.384 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:41:18.384 DEBUG:teuthology.parallel:result is None 2023-07-09T21:41:18.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:41:18.469 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:41:18.472 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:41:18.473 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:41:18.475 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:41:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 Processor -- start 2023-07-09T21:41:18.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 -- start start 2023-07-09T21:41:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a806bf20 0x7f54a80cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a81592f0 con 0x7f54a8156320 2023-07-09T21:41:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a8159bb0 con 0x7f54a8159780 2023-07-09T21:41:18.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54afc19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a81566f0 con 0x7f54a806bf20 2023-07-09T21:41:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ad9b5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f54a8156320 0x7f54a8070120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57694/0 (socket says 172.21.15.37:57694) 2023-07-09T21:41:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ad9b5640 1 -- 172.21.15.37:0/3992219090 learned_addr learned my addr 172.21.15.37:0/3992219090 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:18.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ae1b6640 1 --2- 172.21.15.37:0/3992219090 >> v2:172.21.15.37:3300/0 conn(0x7f54a806bf20 0x7f54a80cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116620715 0 0) 0x7f54a81592f0 con 0x7f54a8156320 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5494003530 con 0x7f54a8156320 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ae1b6640 1 -- 172.21.15.37:0/3992219090 >> v1:172.21.15.119:6789/0 conn(0x7f54a8159780 legacy=0x7f54a806b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3918336547 0 0) 0x7f54a8159bb0 con 0x7f54a8159780 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ae1b6640 1 -- 172.21.15.37:0/3992219090 >> v1:172.21.15.37:6789/0 conn(0x7f54a8156320 legacy=0x7f54a8070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.533+0000 7f54ae1b6640 1 -- 172.21.15.37:0/3992219090 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a8070b50 con 0x7f54a806bf20 2023-07-09T21:41:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54ae1b6640 1 --2- 172.21.15.37:0/3992219090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a806bf20 0x7f54a80cd620 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009d90 tx=0x7f54a001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774097c3065669ef server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a80ce370 con 0x7f54a806bf20 2023-07-09T21:41:18.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a00a59e0 con 0x7f54a806bf20 2023-07-09T21:41:18.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54ac9b3640 1 -- 172.21.15.37:0/3992219090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00a5d70 con 0x7f54a806bf20 2023-07-09T21:41:18.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 -- 172.21.15.37:0/3992219090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a806bf20 msgr2=0x7f54a80cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 --2- 172.21.15.37:0/3992219090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a806bf20 0x7f54a80cd620 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f54a0009d90 tx=0x7f54a001c920 comp rx=0 tx=0).stop 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 -- 172.21.15.37:0/3992219090 shutdown_connections 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 --2- 172.21.15.37:0/3992219090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a806bf20 0x7f54a80cd620 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 -- 172.21.15.37:0/3992219090 >> 172.21.15.37:0/3992219090 conn(0x7f54a80694c0 msgr2=0x7f54a80698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 -- 172.21.15.37:0/3992219090 shutdown_connections 2023-07-09T21:41:18.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.537+0000 7f54afc19640 1 -- 172.21.15.37:0/3992219090 wait complete. 2023-07-09T21:41:18.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 Processor -- start 2023-07-09T21:41:18.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- start start 2023-07-09T21:41:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 0x7f54a8142860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54a8156320 0x7f54a8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80cc950 con 0x7f54a8159780 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80cbfb0 con 0x7f54a806bf20 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80cc290 con 0x7f54a8156320 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54192/0 (socket says 172.21.15.37:54192) 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 -- 172.21.15.37:0/1611023057 learned_addr learned my addr 172.21.15.37:0/1611023057 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:18.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ad9b5640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 0x7f54a8142860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ad1b4640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54a8156320 0x7f54a8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 -- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54a8156320 msgr2=0x7f54a8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54a8156320 0x7f54a8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 -- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 msgr2=0x7f54a8142860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 0x7f54a8142860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:18.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 -- 172.21.15.37:0/1611023057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a0009a70 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ad9b5640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 0x7f54a8142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54ae1b6640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f54a00b0040 tx=0x7f54a00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a0003ba0 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a0003d00 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a80cc570 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a00ad890 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.541+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80ccd70 con 0x7f54a8159780 2023-07-09T21:41:18.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a80cca90 con 0x7f54a8159780 2023-07-09T21:41:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f54a00b4050 con 0x7f54a8159780 2023-07-09T21:41:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f549e7fc640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 0x7f548c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:18.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6070+0+0 (secure 0 0 0) 0x7f54a011ee30 con 0x7f54a8159780 2023-07-09T21:41:18.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f54ad9b5640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 0x7f548c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:18.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.545+0000 7f54ad9b5640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 0x7f548c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54a4007fd0 tx=0x7f54a4009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:18.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.549+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54a80cca90 con 0x7f54a8159780 2023-07-09T21:41:18.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:18.717+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54a80cca90 con 0x7f54a8159780 2023-07-09T21:41:19.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.733+0000 7f549e7fc640 1 -- 172.21.15.37:0/1611023057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54a80cca90 con 0x7f54a8159780 2023-07-09T21:41:19.733 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:41:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 msgr2=0x7f548c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 0x7f548c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f54a4007fd0 tx=0x7f54a4009040 comp rx=0 tx=0).stop 2023-07-09T21:41:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 msgr2=0x7f54a8157360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f54a00b0040 tx=0x7f54a00196c0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 shutdown_connections 2023-07-09T21:41:19.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f548c0663a0 0x7f548c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a8159780 0x7f54a8157360 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f54a8156320 0x7f54a8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 --2- 172.21.15.37:0/1611023057 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f54a806bf20 0x7f54a8142860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 >> 172.21.15.37:0/1611023057 conn(0x7f54a80694c0 msgr2=0x7f54a80afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:19.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 shutdown_connections 2023-07-09T21:41:19.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.737+0000 7f54afc19640 1 -- 172.21.15.37:0/1611023057 wait complete. 2023-07-09T21:41:19.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:41:19.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.905+0000 7f273491f640 1 Processor -- start 2023-07-09T21:41:19.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.905+0000 7f273491f640 1 -- start start 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f273491f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273015ba20 0x7f27300cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f273491f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273015bdf0 con 0x7f27300b2140 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f273491f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27300b2720 con 0x7f273006c330 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f273491f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273006b650 con 0x7f273015ba20 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27300b2140 0x7f27300ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57710/0 (socket says 172.21.15.37:57710) 2023-07-09T21:41:19.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273015ba20 0x7f27300cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272ed9d640 1 -- 172.21.15.37:0/3035078381 learned_addr learned my addr 172.21.15.37:0/3035078381 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272e59c640 1 -- 172.21.15.37:0/3035078381 >> v1:172.21.15.119:6789/0 conn(0x7f273006c330 legacy=0x7f27300b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272e59c640 1 -- 172.21.15.37:0/3035078381 >> v1:172.21.15.37:6789/0 conn(0x7f27300b2140 legacy=0x7f27300ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272e59c640 1 -- 172.21.15.37:0/3035078381 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273006b850 con 0x7f273015ba20 2023-07-09T21:41:19.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.909+0000 7f272dd9b640 1 -- 172.21.15.37:0/3035078381 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2317662190 0 0) 0x7f273015bdf0 con 0x7f27300b2140 2023-07-09T21:41:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f272e59c640 1 --2- 172.21.15.37:0/3035078381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273015ba20 0x7f27300cc9c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f27200097c0 tx=0x7f272001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d88ffecf4907451c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:19.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f272dd9b640 1 -- 172.21.15.37:0/3035078381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200ad660 con 0x7f273015ba20 2023-07-09T21:41:19.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f272dd9b640 1 -- 172.21.15.37:0/3035078381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27200ad7c0 con 0x7f273015ba20 2023-07-09T21:41:19.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f272dd9b640 1 -- 172.21.15.37:0/3035078381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200adb50 con 0x7f273015ba20 2023-07-09T21:41:19.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- 172.21.15.37:0/3035078381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273015ba20 msgr2=0x7f27300cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 --2- 172.21.15.37:0/3035078381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273015ba20 0x7f27300cc9c0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f27200097c0 tx=0x7f272001c450 comp rx=0 tx=0).stop 2023-07-09T21:41:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- 172.21.15.37:0/3035078381 shutdown_connections 2023-07-09T21:41:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 --2- 172.21.15.37:0/3035078381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273015ba20 0x7f27300cc9c0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- 172.21.15.37:0/3035078381 >> 172.21.15.37:0/3035078381 conn(0x7f2730072400 msgr2=0x7f2730072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- 172.21.15.37:0/3035078381 shutdown_connections 2023-07-09T21:41:19.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- 172.21.15.37:0/3035078381 wait complete. 2023-07-09T21:41:19.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 Processor -- start 2023-07-09T21:41:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.913+0000 7f273491f640 1 -- start start 2023-07-09T21:41:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 0x7f27300b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 0x7f27300b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300b5f10 con 0x7f27300b2140 2023-07-09T21:41:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27300b5950 con 0x7f273015ba20 2023-07-09T21:41:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300b5c30 con 0x7f273006c330 2023-07-09T21:41:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54206/0 (socket says 172.21.15.37:54206) 2023-07-09T21:41:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 -- 172.21.15.37:0/1971051206 learned_addr learned my addr 172.21.15.37:0/1971051206 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:19.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f272e59c640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 0x7f27300b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f272ed9d640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 0x7f27300b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 -- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 msgr2=0x7f27300b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 0x7f27300b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 -- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 msgr2=0x7f27300b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 0x7f27300b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 -- 172.21.15.37:0/1971051206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2720009420 con 0x7f27300b2140 2023-07-09T21:41:19.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f272ed9d640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 0x7f27300b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f272e59c640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 0x7f27300b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2727fff640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f271800c500 tx=0x7f271800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718005220 con 0x7f27300b2140 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718005380 con 0x7f27300b2140 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718007270 con 0x7f27300b2140 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2730144f90 con 0x7f27300b2140 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730147660 con 0x7f27300b2140 2023-07-09T21:41:19.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273004d7d0 con 0x7f27300b2140 2023-07-09T21:41:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.917+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27180073d0 con 0x7f27300b2140 2023-07-09T21:41:19.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.921+0000 7f2726ffd640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 0x7f2710068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.921+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f2718083440 con 0x7f27300b2140 2023-07-09T21:41:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.921+0000 7f272e59c640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 0x7f2710068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.921+0000 7f272e59c640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 0x7f2710068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27200af000 tx=0x7f27200a7000 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:19.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:19.925+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2718050af0 con 0x7f27300b2140 2023-07-09T21:41:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.133+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f27300cc4b0 con 0x7f27300b2140 2023-07-09T21:41:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.133+0000 7f2726ffd640 1 -- 172.21.15.37:0/1971051206 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2718054110 con 0x7f27300b2140 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:41:20.134 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.135 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.136 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:41:20.137 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:41:20.138 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.138 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.138 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.138 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.139 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:41:20.139 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:41:20.139 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.139 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.140 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:41:20.140 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:41:20.140 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.140 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.140 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.141 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.142 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.143 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:41:20.144 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:41:20.145 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.146 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.147 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.148 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.149 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.150 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.151 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:41:20.152 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:41:20.153 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.154 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.155 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:41:20.156 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.157 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:41:20.158 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:41:20.159 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:41:20.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 msgr2=0x7f2710068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 0x7f2710068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f27200af000 tx=0x7f27200a7000 comp rx=0 tx=0).stop 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 msgr2=0x7f27300b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f271800c500 tx=0x7f271800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 shutdown_connections 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f27100663a0 0x7f2710068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273015ba20 0x7f27300b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27300b2140 0x7f27300b4d90 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 --2- 172.21.15.37:0/1971051206 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273006c330 0x7f27300b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 >> 172.21.15.37:0/1971051206 conn(0x7f2730072400 msgr2=0x7f273014e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 shutdown_connections 2023-07-09T21:41:20.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.137+0000 7f273491f640 1 -- 172.21.15.37:0/1971051206 wait complete. 2023-07-09T21:41:20.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:20.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.305+0000 7fda25a56640 1 Processor -- start 2023-07-09T21:41:20.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.305+0000 7fda25a56640 1 -- start start 2023-07-09T21:41:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda25a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fda200b4340 0x7fda2006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda25a56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200b49f0 con 0x7fda200cef80 2023-07-09T21:41:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda25a56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200cc8a0 con 0x7fda200b7ab0 2023-07-09T21:41:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda25a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda200b7e80 con 0x7fda200b4340 2023-07-09T21:41:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda200cef80 0x7fda200d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57712/0 (socket says 172.21.15.37:57712) 2023-07-09T21:41:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1f7fe640 1 -- 172.21.15.37:0/2989530496 learned_addr learned my addr 172.21.15.37:0/2989530496 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1e7fc640 1 --2- 172.21.15.37:0/2989530496 >> v2:172.21.15.119:3300/0 conn(0x7fda200b4340 0x7fda2006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744057780 0 0) 0x7fda200b49f0 con 0x7fda200cef80 2023-07-09T21:41:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003530 con 0x7fda200cef80 2023-07-09T21:41:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1e7fc640 1 -- 172.21.15.37:0/2989530496 >> v1:172.21.15.119:6789/0 conn(0x7fda200b7ab0 legacy=0x7fda200b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998358414 0 0) 0x7fda200cc8a0 con 0x7fda200b7ab0 2023-07-09T21:41:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1e7fc640 1 -- 172.21.15.37:0/2989530496 >> v1:172.21.15.37:6789/0 conn(0x7fda200cef80 legacy=0x7fda200d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.309+0000 7fda1e7fc640 1 -- 172.21.15.37:0/2989530496 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda200ccb80 con 0x7fda200b4340 2023-07-09T21:41:20.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda1e7fc640 1 --2- 172.21.15.37:0/2989530496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200b4340 0x7fda2006aa50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fda140097c0 tx=0x7fda1401c290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18a15b3d30553332 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18001980 con 0x7fda200b4340 2023-07-09T21:41:20.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda140a7050 con 0x7fda200b4340 2023-07-09T21:41:20.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda1dffb640 1 -- 172.21.15.37:0/2989530496 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda140ab620 con 0x7fda200b4340 2023-07-09T21:41:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- 172.21.15.37:0/2989530496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200b4340 msgr2=0x7fda2006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 --2- 172.21.15.37:0/2989530496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200b4340 0x7fda2006aa50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fda140097c0 tx=0x7fda1401c290 comp rx=0 tx=0).stop 2023-07-09T21:41:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- 172.21.15.37:0/2989530496 shutdown_connections 2023-07-09T21:41:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 --2- 172.21.15.37:0/2989530496 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200b4340 0x7fda2006aa50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- 172.21.15.37:0/2989530496 >> 172.21.15.37:0/2989530496 conn(0x7fda20073090 msgr2=0x7fda20069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- 172.21.15.37:0/2989530496 shutdown_connections 2023-07-09T21:41:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- 172.21.15.37:0/2989530496 wait complete. 2023-07-09T21:41:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 Processor -- start 2023-07-09T21:41:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.313+0000 7fda25a56640 1 -- start start 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda200b7ab0 0x7fda200c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 0x7fda200c66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c5b40 con 0x7fda200b4340 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c7f50 con 0x7fda200cef80 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200c6c30 con 0x7fda200b7ab0 2023-07-09T21:41:20.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54218/0 (socket says 172.21.15.37:54218) 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 -- 172.21.15.37:0/1234145174 learned_addr learned my addr 172.21.15.37:0/1234145174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 -- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda200b7ab0 msgr2=0x7fda200c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda200b7ab0 0x7fda200c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 -- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 msgr2=0x7fda200c66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1f7fe640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 0x7fda200c66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 0x7fda200c66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 -- 172.21.15.37:0/1234145174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda14009420 con 0x7fda200b4340 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1f7fe640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 0x7fda200c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda1effd640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c780 tx=0x7fda1000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10005270 con 0x7fda200b4340 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda100053d0 con 0x7fda200b4340 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda200c6eb0 con 0x7fda200b4340 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1000a840 con 0x7fda200b4340 2023-07-09T21:41:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda200c7470 con 0x7fda200b4340 2023-07-09T21:41:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda2004d7d0 con 0x7fda200b4340 2023-07-09T21:41:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.317+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fda1000a9a0 con 0x7fda200b4340 2023-07-09T21:41:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.321+0000 7fda07fff640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 0x7fda0c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.321+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fda10083830 con 0x7fda200b4340 2023-07-09T21:41:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.321+0000 7fda1e7fc640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 0x7fda0c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.321+0000 7fda1e7fc640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 0x7fda0c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda140ad000 tx=0x7fda14008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.325+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fda10050e50 con 0x7fda200b4340 2023-07-09T21:41:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda200709d0 con 0x7fda200b4340 2023-07-09T21:41:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda07fff640 1 -- 172.21.15.37:0/1234145174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+14637 (secure 0 0 0) 0x7fda10054470 con 0x7fda200b4340 2023-07-09T21:41:20.485 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:20.485 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":125,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:19.729100+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:20.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 msgr2=0x7fda0c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 0x7fda0c068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda140ad000 tx=0x7fda14008040 comp rx=0 tx=0).stop 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 msgr2=0x7fda200c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c780 tx=0x7fda1000cc40 comp rx=0 tx=0).stop 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 shutdown_connections 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fda0c0663a0 0x7fda0c068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda200cef80 0x7fda200c66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda200b7ab0 0x7fda200c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 --2- 172.21.15.37:0/1234145174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda200b4340 0x7fda200c8720 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 >> 172.21.15.37:0/1234145174 conn(0x7fda20073090 msgr2=0x7fda20156680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:20.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 shutdown_connections 2023-07-09T21:41:20.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.485+0000 7fda25a56640 1 -- 172.21.15.37:0/1234145174 wait complete. 2023-07-09T21:41:20.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:41:20.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:41:20.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 Processor -- start 2023-07-09T21:41:20.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 -- start start 2023-07-09T21:41:20.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02cc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc15bf80 con 0x7f02cc0cf290 2023-07-09T21:41:20.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc0d02f0 con 0x7f02cc0b7980 2023-07-09T21:41:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d38bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0cd070 con 0x7f02cc160030 2023-07-09T21:41:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d0e58640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02cc0cf290 0x7f02cc0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2023-07-09T21:41:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.653+0000 7f02d0e58640 1 -- 172.21.15.37:0/3487431978 learned_addr learned my addr 172.21.15.37:0/3487431978 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d1e5a640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02cc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788025173 0 0) 0x7f02bc001120 con 0x7f02cc0cf290 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b8003530 con 0x7f02cc0cf290 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3384157883 0 0) 0x7f02cc0d02f0 con 0x7f02cc0b7980 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02bc001120 con 0x7f02cc0b7980 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 764917147 0 0) 0x7f02b8003530 con 0x7f02cc0cf290 2023-07-09T21:41:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 msgr2=0x7f02cc0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02cc0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 >> v1:172.21.15.119:6789/0 conn(0x7f02cc0b7980 legacy=0x7f02cc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc0cc7f0 con 0x7f02cc0cf290 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f02bc001810 con 0x7f02cc0cf290 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 >> v1:172.21.15.37:6789/0 conn(0x7f02cc0cf290 legacy=0x7f02cc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b8003b40 0x7f02b8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b80047d0 0x7f02b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0cd070 con 0x7f02b80047d0 2023-07-09T21:41:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02b800ba40 con 0x7f02b8003b40 2023-07-09T21:41:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b800bbb0 con 0x7f02cc160030 2023-07-09T21:41:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b80047d0 0x7f02b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d1659640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b8003b40 0x7f02b8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d1e5a640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 -- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 msgr2=0x7f02b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc160030 0x7f02b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 -- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b8003b40 msgr2=0x7f02b8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b8003b40 0x7f02b8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.657+0000 7f02d0e58640 1 -- 172.21.15.37:0/3487431978 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8003530 con 0x7f02b80047d0 2023-07-09T21:41:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d0e58640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b80047d0 0x7f02b8004c40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cf6b0 tx=0x7f02bc01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13705f951f6535a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc0058e0 con 0x7f02b80047d0 2023-07-09T21:41:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02bc005a60 con 0x7f02b80047d0 2023-07-09T21:41:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02c3fff640 1 -- 172.21.15.37:0/3487431978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02bc005e10 con 0x7f02b80047d0 2023-07-09T21:41:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- 172.21.15.37:0/3487431978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b80047d0 msgr2=0x7f02b8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 --2- 172.21.15.37:0/3487431978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02b80047d0 0x7f02b8004c40 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cf6b0 tx=0x7f02bc01cb60 comp rx=0 tx=0).stop 2023-07-09T21:41:20.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d1e5a640 1 -- 172.21.15.37:0/3487431978 reap_dead start 2023-07-09T21:41:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- 172.21.15.37:0/3487431978 shutdown_connections 2023-07-09T21:41:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- 172.21.15.37:0/3487431978 >> 172.21.15.37:0/3487431978 conn(0x7f02cc073090 msgr2=0x7f02cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- 172.21.15.37:0/3487431978 shutdown_connections 2023-07-09T21:41:20.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- 172.21.15.37:0/3487431978 wait complete. 2023-07-09T21:41:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 Processor -- start 2023-07-09T21:41:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- start start 2023-07-09T21:41:20.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b80047d0 0x7f02cc0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc150110 0x7f02cc14f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0b4720 con 0x7f02cc15db10 2023-07-09T21:41:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15e4c0 con 0x7f02b80047d0 2023-07-09T21:41:20.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.661+0000 7f02d38bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c6210 con 0x7f02cc150110 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54236/0 (socket says 172.21.15.37:54236) 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 -- 172.21.15.37:0/2224518608 learned_addr learned my addr 172.21.15.37:0/2224518608 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d0e58640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc150110 0x7f02cc14f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1659640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b80047d0 0x7f02cc0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 -- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc150110 msgr2=0x7f02cc14f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc150110 0x7f02cc14f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 -- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b80047d0 msgr2=0x7f02cc0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b80047d0 0x7f02cc0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 -- 172.21.15.37:0/2224518608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc14fef0 con 0x7f02cc15db10 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d1e5a640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cd370 tx=0x7f02c4009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c400e070 con 0x7f02cc15db10 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4003c70 con 0x7f02cc15db10 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc0c6490 con 0x7f02cc15db10 2023-07-09T21:41:20.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4003e00 con 0x7f02cc15db10 2023-07-09T21:41:20.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc0c6a50 con 0x7f02cc15db10 2023-07-09T21:41:20.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc04d7d0 con 0x7f02cc15db10 2023-07-09T21:41:20.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f02c4004030 con 0x7f02cc15db10 2023-07-09T21:41:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.665+0000 7f02c1ffb640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 0x7f02b0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.669+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f02c4083b20 con 0x7f02cc15db10 2023-07-09T21:41:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.669+0000 7f02d1659640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 0x7f02b0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.669+0000 7f02d1659640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 0x7f02b0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02c8005630 tx=0x7f02c80071d0 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:20.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.669+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f02c4051170 con 0x7f02cc15db10 2023-07-09T21:41:20.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.825+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02cc0c5a70 con 0x7f02cc15db10 2023-07-09T21:41:20.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.825+0000 7f02c1ffb640 1 -- 172.21.15.37:0/2224518608 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02c4054790 con 0x7f02cc15db10 2023-07-09T21:41:20.826 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:41:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 msgr2=0x7f02b0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 0x7f02b0068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f02c8005630 tx=0x7f02c80071d0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 msgr2=0x7f02cc15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cd370 tx=0x7f02c4009f50 comp rx=0 tx=0).stop 2023-07-09T21:41:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 shutdown_connections 2023-07-09T21:41:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f02b00663a0 0x7f02b0068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02cc15db10 0x7f02cc15df80 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02cc150110 0x7f02cc14f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 --2- 172.21.15.37:0/2224518608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02b80047d0 0x7f02cc0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 >> 172.21.15.37:0/2224518608 conn(0x7f02cc073090 msgr2=0x7f02cc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:20.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 shutdown_connections 2023-07-09T21:41:20.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.829+0000 7f02d38bd640 1 -- 172.21.15.37:0/2224518608 wait complete. 2023-07-09T21:41:20.848 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:41:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 Processor -- start 2023-07-09T21:41:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 -- start start 2023-07-09T21:41:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 0x7f5e5c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 0x7f5e5c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5c0b3bb0 con 0x7f5e5c15f130 2023-07-09T21:41:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5c0d07e0 con 0x7f5e5c0d0360 2023-07-09T21:41:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e6185c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c0cccb0 con 0x7f5e5c0b76b0 2023-07-09T21:41:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5a7fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 0x7f5e5c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 0x7f5e5c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5affd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f5e5c15f130 0x7f5e5c0b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:33800/0 (socket says 172.21.15.37:33800) 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5affd640 1 -- 172.21.15.37:0/965448551 learned_addr learned my addr 172.21.15.37:0/965448551 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5a7fc640 1 -- 172.21.15.37:0/965448551 >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 msgr2=0x7f5e5c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5a7fc640 1 --2- 172.21.15.37:0/965448551 >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 0x7f5e5c0cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5a7fc640 1 -- 172.21.15.37:0/965448551 >> v1:172.21.15.119:6789/0 conn(0x7f5e5c15f130 legacy=0x7f5e5c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5a7fc640 1 -- 172.21.15.37:0/965448551 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c0b8100 con 0x7f5e5c0b76b0 2023-07-09T21:41:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e59ffb640 1 -- 172.21.15.37:0/965448551 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436610279 0 0) 0x7f5e5c0b3bb0 con 0x7f5e5c15f130 2023-07-09T21:41:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:20.997+0000 7f5e5b7fe640 1 --2- 172.21.15.37:0/965448551 >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 0x7f5e5c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e5a7fc640 1 --2- 172.21.15.37:0/965448551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 0x7f5e5c0cfe20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e500097c0 tx=0x7f5e5001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44d4f2fbdde63c66 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e59ffb640 1 -- 172.21.15.37:0/965448551 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500ac620 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e59ffb640 1 -- 172.21.15.37:0/965448551 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e500ac780 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e59ffb640 1 -- 172.21.15.37:0/965448551 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e500acb10 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 -- 172.21.15.37:0/965448551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 msgr2=0x7f5e5c0cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 --2- 172.21.15.37:0/965448551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 0x7f5e5c0cfe20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f5e500097c0 tx=0x7f5e5001c3c0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 -- 172.21.15.37:0/965448551 shutdown_connections 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 --2- 172.21.15.37:0/965448551 >> v2:172.21.15.119:3300/0 conn(0x7f5e5c0d0360 0x7f5e5c0cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 --2- 172.21.15.37:0/965448551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0b76b0 0x7f5e5c0cfe20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 -- 172.21.15.37:0/965448551 >> 172.21.15.37:0/965448551 conn(0x7f5e5c072d20 msgr2=0x7f5e5c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 -- 172.21.15.37:0/965448551 shutdown_connections 2023-07-09T21:41:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.001+0000 7f5e6185c640 1 -- 172.21.15.37:0/965448551 wait complete. 2023-07-09T21:41:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 Processor -- start 2023-07-09T21:41:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- start start 2023-07-09T21:41:21.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0d0360 0x7f5e5c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e5c15f130 0x7f5e5c1f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c1f76d0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c151b90 con 0x7f5e5c15f130 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5c151e70 con 0x7f5e5c0d0360 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54242/0 (socket says 172.21.15.37:54242) 2023-07-09T21:41:21.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 -- 172.21.15.37:0/2837692741 learned_addr learned my addr 172.21.15.37:0/2837692741 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:21.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5b7fe640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e5c15f130 0x7f5e5c1f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5a7fc640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0d0360 0x7f5e5c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 -- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0d0360 msgr2=0x7f5e5c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0d0360 0x7f5e5c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 -- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e5c15f130 msgr2=0x7f5e5c1f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e5c15f130 0x7f5e5c1f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 -- 172.21.15.37:0/2837692741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009a70 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e5affd640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c4a0 tx=0x7f5e4c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c0074e0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c007640 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c004a30 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e50009420 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.005+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5c152150 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5c0668f0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e4c004b90 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e43fff640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 0x7f5e48068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5e4c0837f0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e5a7fc640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 0x7f5e48068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.009+0000 7f5e5a7fc640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 0x7f5e48068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ae000 tx=0x7f5e500a7000 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.013+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e4c050eb0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e5c157e40 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e43fff640 1 -- 172.21.15.37:0/2837692741 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v125) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e4c0544d0 con 0x7f5e5c0b76b0 2023-07-09T21:41:21.168 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:41:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 msgr2=0x7f5e48068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 0x7f5e48068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e500ae000 tx=0x7f5e500a7000 comp rx=0 tx=0).stop 2023-07-09T21:41:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 msgr2=0x7f5e5c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f5e4c00c4a0 tx=0x7f5e4c00c8a0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 shutdown_connections 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5e480663d0 0x7f5e48068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e5c15f130 0x7f5e5c1f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e5c0d0360 0x7f5e5c1512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 --2- 172.21.15.37:0/2837692741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e5c0b76b0 0x7f5e5c154240 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 >> 172.21.15.37:0/2837692741 conn(0x7f5e5c072d20 msgr2=0x7f5e5c06a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:21.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 shutdown_connections 2023-07-09T21:41:21.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.169+0000 7f5e6185c640 1 -- 172.21.15.37:0/2837692741 wait complete. 2023-07-09T21:41:21.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:41:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 Processor -- start 2023-07-09T21:41:21.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 -- start start 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940b7ab0 0x7f839406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83940cef80 0x7f83940b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f83940b4170 0x7f839415f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940b7e80 con 0x7f83940cef80 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83940b45f0 con 0x7f83940b4170 2023-07-09T21:41:21.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f839a034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83940b49f0 con 0x7f83940b7ab0 2023-07-09T21:41:21.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83940cef80 0x7f83940b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f83940cef80 0x7f83940b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54250/0 (socket says 172.21.15.37:54250) 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 -- 172.21.15.37:0/3324609304 learned_addr learned my addr 172.21.15.37:0/3324609304 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8393fff640 1 --2- 172.21.15.37:0/3324609304 >> v2:172.21.15.119:3300/0 conn(0x7f83940b4170 0x7f839415f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f83937fe640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940b7ab0 0x7f839406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 -- 172.21.15.37:0/3324609304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940b7ab0 msgr2=0x7f839406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:21.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940b7ab0 0x7f839406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 -- 172.21.15.37:0/3324609304 >> v2:172.21.15.119:3300/0 conn(0x7f83940b4170 msgr2=0x7f839415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 --2- 172.21.15.37:0/3324609304 >> v2:172.21.15.119:3300/0 conn(0x7f83940b4170 0x7f839415f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.333+0000 7f8392ffd640 1 -- 172.21.15.37:0/3324609304 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940cc8a0 con 0x7f83940cef80 2023-07-09T21:41:21.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f8392ffd640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940cef80 0x7f83940b3c30 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f83940716a0 tx=0x7f838801c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adae94d88aa48f6d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f83927fc640 1 -- 172.21.15.37:0/3324609304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880ab600 con 0x7f83940cef80 2023-07-09T21:41:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f83927fc640 1 -- 172.21.15.37:0/3324609304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83880a7050 con 0x7f83940cef80 2023-07-09T21:41:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f83927fc640 1 -- 172.21.15.37:0/3324609304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880ab980 con 0x7f83940cef80 2023-07-09T21:41:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 -- 172.21.15.37:0/3324609304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940cef80 msgr2=0x7f83940b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940cef80 0x7f83940b3c30 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f83940716a0 tx=0x7f838801c210 comp rx=0 tx=0).stop 2023-07-09T21:41:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 -- 172.21.15.37:0/3324609304 shutdown_connections 2023-07-09T21:41:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940cef80 0x7f83940b3c30 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 --2- 172.21.15.37:0/3324609304 >> v2:172.21.15.119:3300/0 conn(0x7f83940b4170 0x7f839415f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 --2- 172.21.15.37:0/3324609304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940b7ab0 0x7f839406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 -- 172.21.15.37:0/3324609304 >> 172.21.15.37:0/3324609304 conn(0x7f8394073090 msgr2=0x7f8394069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 -- 172.21.15.37:0/3324609304 shutdown_connections 2023-07-09T21:41:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.337+0000 7f839a034640 1 -- 172.21.15.37:0/3324609304 wait complete. 2023-07-09T21:41:21.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 Processor -- start 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- start start 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83940b7ab0 0x7f8394159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 0x7f83940d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394156dc0 con 0x7f83940b4170 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8394155d40 con 0x7f83940b7ab0 2023-07-09T21:41:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8394155f10 con 0x7f83940cef80 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54262/0 (socket says 172.21.15.37:54262) 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 -- 172.21.15.37:0/2216821430 learned_addr learned my addr 172.21.15.37:0/2216821430 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f8392ffd640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83940b7ab0 0x7f8394159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f8393fff640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 0x7f83940d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 -- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 msgr2=0x7f83940d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 0x7f83940d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 -- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83940b7ab0 msgr2=0x7f8394159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83940b7ab0 0x7f8394159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 -- 172.21.15.37:0/2216821430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880094d0 con 0x7f83940b4170 2023-07-09T21:41:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f8393fff640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 0x7f83940d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f83937fe640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f838400e930 tx=0x7f838400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8384009690 con 0x7f83940b4170 2023-07-09T21:41:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838400ca00 con 0x7f83940b4170 2023-07-09T21:41:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838400cd70 con 0x7f83940b4170 2023-07-09T21:41:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8394157250 con 0x7f83940b4170 2023-07-09T21:41:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.341+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8394156490 con 0x7f83940b4170 2023-07-09T21:41:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839404d7d0 con 0x7f83940b4170 2023-07-09T21:41:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8384013470 con 0x7f83940b4170 2023-07-09T21:41:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f837bfff640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 0x7f8380068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8384083ca0 con 0x7f83940b4170 2023-07-09T21:41:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f8392ffd640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 0x7f8380068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.345+0000 7f8392ffd640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 0x7f8380068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83880ad000 tx=0x7f8388008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.349+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f83840514d0 con 0x7f83940b4170 2023-07-09T21:41:21.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.505+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f83940b6910 con 0x7f83940b4170 2023-07-09T21:41:21.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.505+0000 7f837bfff640 1 -- 172.21.15.37:0/2216821430 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8384021090 con 0x7f83940b4170 2023-07-09T21:41:21.507 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:21.507 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:41:21.507 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:21.507 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:21.508 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:41:21.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 msgr2=0x7f8380068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 0x7f8380068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f83880ad000 tx=0x7f8388008040 comp rx=0 tx=0).stop 2023-07-09T21:41:21.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 msgr2=0x7f8394155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f838400e930 tx=0x7f838400edf0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 shutdown_connections 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f83800663a0 0x7f8380068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f83940cef80 0x7f83940d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f83940b7ab0 0x7f8394159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 --2- 172.21.15.37:0/2216821430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83940b4170 0x7f8394155800 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 >> 172.21.15.37:0/2216821430 conn(0x7f8394073090 msgr2=0x7f8394158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:21.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 shutdown_connections 2023-07-09T21:41:21.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.509+0000 7f839a034640 1 -- 172.21.15.37:0/2216821430 wait complete. 2023-07-09T21:41:21.528 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:41:21.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:41:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.673+0000 7f3533a6d640 1 Processor -- start 2023-07-09T21:41:21.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.673+0000 7f3533a6d640 1 -- start start 2023-07-09T21:41:21.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3533a6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f352c160030 0x7f352c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3533a6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c15bf80 con 0x7f352c0b7980 2023-07-09T21:41:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3533a6d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352c0d02f0 con 0x7f352c0cf290 2023-07-09T21:41:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3533a6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352c0cd070 con 0x7f352c160030 2023-07-09T21:41:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f352c0b7980 0x7f352c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57728/0 (socket says 172.21.15.37:57728) 2023-07-09T21:41:21.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 -- 172.21.15.37:0/1261974411 learned_addr learned my addr 172.21.15.37:0/1261974411 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f353200a640 1 --2- 172.21.15.37:0/1261974411 >> v2:172.21.15.119:3300/0 conn(0x7f352c160030 0x7f352c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2357170435 0 0) 0x7f3528001120 con 0x7f352c0b7980 2023-07-09T21:41:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003530 con 0x7f352c0b7980 2023-07-09T21:41:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440436211 0 0) 0x7f3518003530 con 0x7f352c0b7980 2023-07-09T21:41:21.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 >> v2:172.21.15.119:3300/0 conn(0x7f352c160030 msgr2=0x7f352c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 --2- 172.21.15.37:0/1261974411 >> v2:172.21.15.119:3300/0 conn(0x7f352c160030 0x7f352c0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 >> v1:172.21.15.119:6789/0 conn(0x7f352c0cf290 legacy=0x7f352c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c0cc7f0 con 0x7f352c0b7980 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3528001810 con 0x7f352c0b7980 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 >> v1:172.21.15.37:6789/0 conn(0x7f352c0b7980 legacy=0x7f352c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 0x7f3518003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3518004370 0x7f3518004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518005030 0x7f351800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c0cd070 con 0x7f3518003980 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351800bf80 con 0x7f3518004370 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351800c140 con 0x7f3518005030 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 0x7f3518003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531008640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3518004370 0x7f3518004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f353200a640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518005030 0x7f351800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 -- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518005030 msgr2=0x7f351800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:21.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518005030 0x7f351800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 -- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3518004370 msgr2=0x7f3518004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:21.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3518004370 0x7f3518004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f3531809640 1 -- 172.21.15.37:0/1261974411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3518003530 con 0x7f3518003980 2023-07-09T21:41:21.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f353200a640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518005030 0x7f351800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:21.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.677+0000 7f353200a640 1 -- 172.21.15.37:0/1261974411 reap_dead start 2023-07-09T21:41:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3531809640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 0x7f3518003d50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f352800c1c0 tx=0x7f352801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982037e075ea6ffb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528005ae0 con 0x7f3518003980 2023-07-09T21:41:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3528005c60 con 0x7f3518003980 2023-07-09T21:41:21.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3530807640 1 -- 172.21.15.37:0/1261974411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280072b0 con 0x7f3518003980 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 -- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 msgr2=0x7f3518003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 0x7f3518003d50 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f352800c1c0 tx=0x7f352801cbc0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 -- 172.21.15.37:0/1261974411 shutdown_connections 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 --2- 172.21.15.37:0/1261974411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3518003980 0x7f3518003d50 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 -- 172.21.15.37:0/1261974411 >> 172.21.15.37:0/1261974411 conn(0x7f352c073090 msgr2=0x7f352c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 -- 172.21.15.37:0/1261974411 shutdown_connections 2023-07-09T21:41:21.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.681+0000 7f3533a6d640 1 -- 172.21.15.37:0/1261974411 wait complete. 2023-07-09T21:41:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 Processor -- start 2023-07-09T21:41:21.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- start start 2023-07-09T21:41:21.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 0x7f352c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 0x7f352c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 0x7f352c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c15d8b0 con 0x7f352c15d3a0 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352c15db90 con 0x7f352c15e950 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352c15de70 con 0x7f3518003980 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3531809640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 0x7f352c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 0x7f352c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3531809640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 0x7f352c158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:52910/0 (socket says 172.21.15.37:52910) 2023-07-09T21:41:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3531809640 1 -- 172.21.15.37:0/4014697196 learned_addr learned my addr 172.21.15.37:0/4014697196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3531008640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 0x7f352c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 -- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 msgr2=0x7f352c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 0x7f352c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 -- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 msgr2=0x7f352c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 0x7f352c15ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 -- 172.21.15.37:0/4014697196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f352c15e150 con 0x7f352c15d3a0 2023-07-09T21:41:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3531008640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 0x7f352c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f353200a640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 0x7f352c0c9af0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f352c0b0fe0 tx=0x7f3524007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352401b070 con 0x7f352c15d3a0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352400f040 con 0x7f352c15d3a0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352400e050 con 0x7f352c15d3a0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f352c15e430 con 0x7f352c15d3a0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f352c0cbbf0 con 0x7f352c15d3a0 2023-07-09T21:41:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.685+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f352c04d7d0 con 0x7f352c15d3a0 2023-07-09T21:41:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.689+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3524003be0 con 0x7f352c15d3a0 2023-07-09T21:41:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.689+0000 7f35227fc640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 0x7f3510068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.689+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3524083990 con 0x7f352c15d3a0 2023-07-09T21:41:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.689+0000 7f3531809640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 0x7f3510068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.689+0000 7f3531809640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 0x7f3510068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f352801cc00 tx=0x7f35280a7070 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.693+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3524050eb0 con 0x7f352c15d3a0 2023-07-09T21:41:21.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:21.849+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f352c15dfb0 con 0x7f352c15d3a0 2023-07-09T21:41:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.381+0000 7f35227fc640 1 -- 172.21.15.37:0/4014697196 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) v1 ==== 138+0+0 (secure 0 0 0) 0x7f352c15dfb0 con 0x7f352c15d3a0 2023-07-09T21:41:22.380 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:41:22.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 msgr2=0x7f3510068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 0x7f3510068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f352801cc00 tx=0x7f35280a7070 comp rx=0 tx=0).stop 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 msgr2=0x7f352c0c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 0x7f352c0c9af0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f352c0b0fe0 tx=0x7f3524007e40 comp rx=0 tx=0).stop 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 shutdown_connections 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f35100663a0 0x7f3510068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f352c15d3a0 0x7f352c0c9af0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f352c15e950 0x7f352c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 --2- 172.21.15.37:0/4014697196 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3518003980 0x7f352c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 >> 172.21.15.37:0/4014697196 conn(0x7f352c073090 msgr2=0x7f352c0b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 shutdown_connections 2023-07-09T21:41:22.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.385+0000 7f3533a6d640 1 -- 172.21.15.37:0/4014697196 wait complete. 2023-07-09T21:41:22.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:41:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 Processor -- start 2023-07-09T21:41:22.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 -- start start 2023-07-09T21:41:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39641595c0 0x7f39640c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39640c99e0 0x7f39640cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640c4c90 con 0x7f3964159990 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640ca730 con 0x7f39641595c0 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f39691ad640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39640ca170 con 0x7f39640c99e0 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39641595c0 0x7f39640c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39641595c0 0x7f39640c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54296/0 (socket says 172.21.15.37:54296) 2023-07-09T21:41:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 -- 172.21.15.37:0/1531364965 learned_addr learned my addr 172.21.15.37:0/1531364965 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f396359e640 1 --2- 172.21.15.37:0/1531364965 >> v2:172.21.15.119:3300/0 conn(0x7f39640c99e0 0x7f39640cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 -- 172.21.15.37:0/1531364965 >> v2:172.21.15.119:3300/0 conn(0x7f39640c99e0 msgr2=0x7f39640cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 --2- 172.21.15.37:0/1531364965 >> v2:172.21.15.119:3300/0 conn(0x7f39640c99e0 0x7f39640cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 -- 172.21.15.37:0/1531364965 >> v1:172.21.15.119:6789/0 conn(0x7f3964159990 legacy=0x7f396415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.561+0000 7f3962d9d640 1 -- 172.21.15.37:0/1531364965 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39640ca450 con 0x7f39641595c0 2023-07-09T21:41:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f3962d9d640 1 --2- 172.21.15.37:0/1531364965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39641595c0 0x7f39640c4750 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f39640cebf0 tx=0x7f395401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54abb79c589a4b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f396259c640 1 -- 172.21.15.37:0/1531364965 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540ac640 con 0x7f39641595c0 2023-07-09T21:41:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f396259c640 1 -- 172.21.15.37:0/1531364965 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39540ac7a0 con 0x7f39641595c0 2023-07-09T21:41:22.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f396259c640 1 -- 172.21.15.37:0/1531364965 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39540acb30 con 0x7f39641595c0 2023-07-09T21:41:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 -- 172.21.15.37:0/1531364965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39641595c0 msgr2=0x7f39640c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 --2- 172.21.15.37:0/1531364965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39641595c0 0x7f39640c4750 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f39640cebf0 tx=0x7f395401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 -- 172.21.15.37:0/1531364965 shutdown_connections 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 --2- 172.21.15.37:0/1531364965 >> v2:172.21.15.119:3300/0 conn(0x7f39640c99e0 0x7f39640cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 --2- 172.21.15.37:0/1531364965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39641595c0 0x7f39640c4750 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 -- 172.21.15.37:0/1531364965 >> 172.21.15.37:0/1531364965 conn(0x7f39640cde40 msgr2=0x7f39640ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 -- 172.21.15.37:0/1531364965 shutdown_connections 2023-07-09T21:41:22.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.565+0000 7f39691ad640 1 -- 172.21.15.37:0/1531364965 wait complete. 2023-07-09T21:41:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 Processor -- start 2023-07-09T21:41:22.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- start start 2023-07-09T21:41:22.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39640c99e0 0x7f39641f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39641595c0 0x7f3964156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396414b430 con 0x7f3964159990 2023-07-09T21:41:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f396406cbe0 con 0x7f39640c99e0 2023-07-09T21:41:22.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39641f3f70 con 0x7f39641595c0 2023-07-09T21:41:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54308/0 (socket says 172.21.15.37:54308) 2023-07-09T21:41:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 -- 172.21.15.37:0/968847929 learned_addr learned my addr 172.21.15.37:0/968847929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f3962d9d640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39640c99e0 0x7f39641f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f395bfff640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39641595c0 0x7f3964156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 -- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39641595c0 msgr2=0x7f3964156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39641595c0 0x7f3964156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 -- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39640c99e0 msgr2=0x7f39641f3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39640c99e0 0x7f39641f3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 -- 172.21.15.37:0/968847929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39540094d0 con 0x7f3964159990 2023-07-09T21:41:22.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f396359e640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f395c007e60 tx=0x7f395c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c014420 con 0x7f3964159990 2023-07-09T21:41:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395c0145a0 con 0x7f3964159990 2023-07-09T21:41:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395c014950 con 0x7f3964159990 2023-07-09T21:41:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f396406bfd0 con 0x7f3964159990 2023-07-09T21:41:22.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.569+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f396406c590 con 0x7f3964159990 2023-07-09T21:41:22.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.573+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f396406cd70 con 0x7f3964159990 2023-07-09T21:41:22.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.573+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f395c014ab0 con 0x7f3964159990 2023-07-09T21:41:22.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.573+0000 7f395b7fe640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 0x7f3944068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:22.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.573+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f395c0854a0 con 0x7f3964159990 2023-07-09T21:41:22.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.573+0000 7f3962d9d640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 0x7f3944068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:22.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.577+0000 7f3962d9d640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 0x7f3944068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39540ae000 tx=0x7f39540a7000 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:22.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.577+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f395c056460 con 0x7f3964159990 2023-07-09T21:41:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:22.737+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f396404d7d0 con 0x7f3964159990 2023-07-09T21:41:23.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.385+0000 7f395b7fe640 1 -- 172.21.15.37:0/968847929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) v1 ==== 170+0+0 (secure 0 0 0) 0x7f395c055ff0 con 0x7f3964159990 2023-07-09T21:41:23.385 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:41:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.401+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 msgr2=0x7f3944068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.401+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 0x7f3944068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f39540ae000 tx=0x7f39540a7000 comp rx=0 tx=0).stop 2023-07-09T21:41:23.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 msgr2=0x7f3964157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f395c007e60 tx=0x7f395c00e4b0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 shutdown_connections 2023-07-09T21:41:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f39440663a0 0x7f3944068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3964159990 0x7f3964157480 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39641595c0 0x7f3964156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 --2- 172.21.15.37:0/968847929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39640c99e0 0x7f39641f3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 >> 172.21.15.37:0/968847929 conn(0x7f39640cde40 msgr2=0x7f3964156170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 shutdown_connections 2023-07-09T21:41:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.405+0000 7f39691ad640 1 -- 172.21.15.37:0/968847929 wait complete. 2023-07-09T21:41:23.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:41:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.573+0000 7f438759e640 1 Processor -- start 2023-07-09T21:41:23.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.573+0000 7f438759e640 1 -- start start 2023-07-09T21:41:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43880cfb40 0x7f43880cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438759e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f43880b1420 0x7f43880cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43880d0450 con 0x7f43880b0ed0 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43880ce640 con 0x7f43880cfb40 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438759e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43880ce080 con 0x7f43880b1420 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f4386d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f43880b0ed0 0x7f43880ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57740/0 (socket says 172.21.15.37:57740) 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f4386d9d640 1 -- 172.21.15.37:0/1751670214 learned_addr learned my addr 172.21.15.37:0/1751670214 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:23.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f43880cfb40 0x7f43880cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f437ffff640 1 --2- 172.21.15.37:0/1751670214 >> v2:172.21.15.119:3300/0 conn(0x7f43880b1420 0x7f43880cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438659c640 1 -- 172.21.15.37:0/1751670214 >> v2:172.21.15.119:3300/0 conn(0x7f43880b1420 msgr2=0x7f43880cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438659c640 1 --2- 172.21.15.37:0/1751670214 >> v2:172.21.15.119:3300/0 conn(0x7f43880b1420 0x7f43880cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438659c640 1 -- 172.21.15.37:0/1751670214 >> v1:172.21.15.37:6789/0 conn(0x7f43880b0ed0 legacy=0x7f43880ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.577+0000 7f438659c640 1 -- 172.21.15.37:0/1751670214 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43880ce360 con 0x7f43880cfb40 2023-07-09T21:41:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438659c640 1 --2- 172.21.15.37:0/1751670214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880cfb40 0x7f43880cff10 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f43880716f0 tx=0x7f437801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b38bc84c6df9f8e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f4385d9b640 1 -- 172.21.15.37:0/1751670214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780a7070 con 0x7f43880cfb40 2023-07-09T21:41:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f4385d9b640 1 -- 172.21.15.37:0/1751670214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780ab430 con 0x7f43880cfb40 2023-07-09T21:41:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f4385d9b640 1 -- 172.21.15.37:0/1751670214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780ab7c0 con 0x7f43880cfb40 2023-07-09T21:41:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- 172.21.15.37:0/1751670214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880cfb40 msgr2=0x7f43880cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 --2- 172.21.15.37:0/1751670214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880cfb40 0x7f43880cff10 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f43880716f0 tx=0x7f437801c430 comp rx=0 tx=0).stop 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- 172.21.15.37:0/1751670214 shutdown_connections 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 --2- 172.21.15.37:0/1751670214 >> v2:172.21.15.119:3300/0 conn(0x7f43880b1420 0x7f43880cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 --2- 172.21.15.37:0/1751670214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880cfb40 0x7f43880cff10 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- 172.21.15.37:0/1751670214 >> 172.21.15.37:0/1751670214 conn(0x7f4388072d20 msgr2=0x7f43880d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- 172.21.15.37:0/1751670214 shutdown_connections 2023-07-09T21:41:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- 172.21.15.37:0/1751670214 wait complete. 2023-07-09T21:41:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 Processor -- start 2023-07-09T21:41:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 -- start start 2023-07-09T21:41:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.581+0000 7f438759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 0x7f438809f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43880cfb40 0x7f43880c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438815ad00 con 0x7f43880b0ed0 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438815afa0 con 0x7f43880b1420 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f438815b280 con 0x7f43880cfb40 2023-07-09T21:41:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54328/0 (socket says 172.21.15.37:54328) 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 -- 172.21.15.37:0/227906169 learned_addr learned my addr 172.21.15.37:0/227906169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 -- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43880cfb40 msgr2=0x7f43880c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43880cfb40 0x7f43880c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437ffff640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 0x7f438809f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 -- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 msgr2=0x7f438809f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 0x7f438809f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 -- 172.21.15.37:0/227906169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4378009420 con 0x7f43880b0ed0 2023-07-09T21:41:23.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437ffff640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 0x7f438809f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:23.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438659c640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4378019040 tx=0x7f437801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:23.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780b5610 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43780b5790 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f438815b560 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43780b5b40 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43880b5a10 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f438804e020 con 0x7f43880b0ed0 2023-07-09T21:41:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.585+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f43780b5ca0 con 0x7f43880b0ed0 2023-07-09T21:41:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.589+0000 7f437effd640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 0x7f4368068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.589+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f437811e970 con 0x7f43880b0ed0 2023-07-09T21:41:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.589+0000 7f437ffff640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 0x7f4368068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.589+0000 7f437ffff640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 0x7f4368068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f438808af40 tx=0x7f4370008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.589+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f43780ebd10 con 0x7f43880b0ed0 2023-07-09T21:41:23.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:23.777+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f438815ba10 con 0x7f43880b0ed0 2023-07-09T21:41:24.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.417+0000 7f437effd640 1 -- 172.21.15.37:0/227906169 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v52) v1 ==== 174+0+0 (secure 0 0 0) 0x7f43780ef330 con 0x7f43880b0ed0 2023-07-09T21:41:24.418 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 15 and data pool 16 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 msgr2=0x7f4368068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 0x7f4368068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f438808af40 tx=0x7f4370008040 comp rx=0 tx=0).stop 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 msgr2=0x7f4388155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f4378019040 tx=0x7f437801ac70 comp rx=0 tx=0).stop 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 shutdown_connections 2023-07-09T21:41:24.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f43680663d0 0x7f4368068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f43880cfb40 0x7f43880c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f43880b1420 0x7f438809f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 --2- 172.21.15.37:0/227906169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43880b0ed0 0x7f4388155220 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 >> 172.21.15.37:0/227906169 conn(0x7f4388072d20 msgr2=0x7f438815d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 shutdown_connections 2023-07-09T21:41:24.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.425+0000 7f438759e640 1 -- 172.21.15.37:0/227906169 wait complete. 2023-07-09T21:41:24.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 Processor -- start 2023-07-09T21:41:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 -- start start 2023-07-09T21:41:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa99806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 0x7fa9980d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980b49f0 con 0x7fa9980b7ab0 2023-07-09T21:41:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9980b7e80 con 0x7fa9980cef80 2023-07-09T21:41:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.593+0000 7fa99c937640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980cc8a0 con 0x7fa9980b4340 2023-07-09T21:41:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa99659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9980b7ab0 0x7fa9980b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57748/0 (socket says 172.21.15.37:57748) 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa99659c640 1 -- 172.21.15.37:0/3136270080 learned_addr learned my addr 172.21.15.37:0/3136270080 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 --2- 172.21.15.37:0/3136270080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa99806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa996d9d640 1 --2- 172.21.15.37:0/3136270080 >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 0x7fa9980d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa995d9b640 1 -- 172.21.15.37:0/3136270080 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653477419 0 0) 0x7fa9980b49f0 con 0x7fa9980b7ab0 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa995d9b640 1 -- 172.21.15.37:0/3136270080 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa984003530 con 0x7fa9980b7ab0 2023-07-09T21:41:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 -- 172.21.15.37:0/3136270080 >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 msgr2=0x7fa9980d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 --2- 172.21.15.37:0/3136270080 >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 0x7fa9980d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 -- 172.21.15.37:0/3136270080 >> v1:172.21.15.37:6789/0 conn(0x7fa9980b7ab0 legacy=0x7fa9980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 -- 172.21.15.37:0/3136270080 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ccb80 con 0x7fa9980b4340 2023-07-09T21:41:24.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa996d9d640 1 --2- 172.21.15.37:0/3136270080 >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 0x7fa9980d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.597+0000 7fa98ffff640 1 --2- 172.21.15.37:0/3136270080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa99806aa50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9800097c0 tx=0x7fa98001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=466586c9cd53618d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa995d9b640 1 -- 172.21.15.37:0/3136270080 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800ab650 con 0x7fa9980b4340 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa995d9b640 1 -- 172.21.15.37:0/3136270080 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9800ab7b0 con 0x7fa9980b4340 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa995d9b640 1 -- 172.21.15.37:0/3136270080 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800abb40 con 0x7fa9980b4340 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- 172.21.15.37:0/3136270080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 msgr2=0x7fa99806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- 172.21.15.37:0/3136270080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa99806aa50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9800097c0 tx=0x7fa98001c450 comp rx=0 tx=0).stop 2023-07-09T21:41:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- 172.21.15.37:0/3136270080 shutdown_connections 2023-07-09T21:41:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- 172.21.15.37:0/3136270080 >> v2:172.21.15.119:3300/0 conn(0x7fa9980cef80 0x7fa9980d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- 172.21.15.37:0/3136270080 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa99806aa50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- 172.21.15.37:0/3136270080 >> 172.21.15.37:0/3136270080 conn(0x7fa998073090 msgr2=0x7fa998069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- 172.21.15.37:0/3136270080 shutdown_connections 2023-07-09T21:41:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- 172.21.15.37:0/3136270080 wait complete. 2023-07-09T21:41:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 Processor -- start 2023-07-09T21:41:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- start start 2023-07-09T21:41:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa9981510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9980b7ab0 0x7fa9980b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998157270 con 0x7fa9980cef80 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa998150340 con 0x7fa9980b7ab0 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.601+0000 7fa99c937640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981568d0 con 0x7fa9980b4340 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa99659c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa9981510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54330/0 (socket says 172.21.15.37:54330) 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 -- 172.21.15.37:0/2147065713 learned_addr learned my addr 172.21.15.37:0/2147065713 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98ffff640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9980b7ab0 0x7fa9980b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 -- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 msgr2=0x7fa9981510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa9981510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 -- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9980b7ab0 msgr2=0x7fa9980b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9980b7ab0 0x7fa9980b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 -- 172.21.15.37:0/2147065713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa990009a70 con 0x7fa9980cef80 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa996d9d640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa99000efb0 tx=0x7fa99000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990014480 con 0x7fa9980cef80 2023-07-09T21:41:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000f040 con 0x7fa9980cef80 2023-07-09T21:41:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990014800 con 0x7fa9980cef80 2023-07-09T21:41:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa980009420 con 0x7fa9980cef80 2023-07-09T21:41:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998156e90 con 0x7fa9980cef80 2023-07-09T21:41:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9981573b0 con 0x7fa9980cef80 2023-07-09T21:41:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa990014960 con 0x7fa9980cef80 2023-07-09T21:41:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.605+0000 7fa98effd640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 0x7fa978068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.609+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa990084e40 con 0x7fa9980cef80 2023-07-09T21:41:24.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.609+0000 7fa99659c640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 0x7fa978068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.609+0000 7fa99659c640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 0x7fa978068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9880011f0 tx=0x7fa988007d40 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.609+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9981573b0 con 0x7fa9980cef80 2023-07-09T21:41:24.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.773+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9981573b0 con 0x7fa9980cef80 2023-07-09T21:41:24.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.773+0000 7fa98effd640 1 -- 172.21.15.37:0/2147065713 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18294 (secure 0 0 0) 0x7fa9981573b0 con 0x7fa9980cef80 2023-07-09T21:41:24.773 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:24.774 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":128,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:23.779756+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:24.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 msgr2=0x7fa978068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 0x7fa978068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa9880011f0 tx=0x7fa988007d40 comp rx=0 tx=0).stop 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 msgr2=0x7fa9980b5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fa99000efb0 tx=0x7fa99000c490 comp rx=0 tx=0).stop 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 shutdown_connections 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa9780663a0 0x7fa978068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9980cef80 0x7fa9980b5520 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9980b7ab0 0x7fa9980b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 --2- 172.21.15.37:0/2147065713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9980b4340 0x7fa9981510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 >> 172.21.15.37:0/2147065713 conn(0x7fa998073090 msgr2=0x7fa9981587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 shutdown_connections 2023-07-09T21:41:24.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.777+0000 7fa99c937640 1 -- 172.21.15.37:0/2147065713 wait complete. 2023-07-09T21:41:24.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 Processor -- start 2023-07-09T21:41:24.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 -- start start 2023-07-09T21:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcd80ce1a0 0x7efcd8069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efcd806a280 0x7efcd80cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd80ccd40 con 0x7efcd80b7810 2023-07-09T21:41:24.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd80cc5a0 con 0x7efcd80ce1a0 2023-07-09T21:41:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd912640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd806a680 con 0x7efcd806a280 2023-07-09T21:41:24.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efcd80ce1a0 0x7efcd8069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdc910640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efcd80b7810 0x7efcd815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57762/0 (socket says 172.21.15.37:57762) 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdc910640 1 -- 172.21.15.37:0/951796748 learned_addr learned my addr 172.21.15.37:0/951796748 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcdd111640 1 --2- 172.21.15.37:0/951796748 >> v2:172.21.15.119:3300/0 conn(0x7efcd806a280 0x7efcd80cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd7fff640 1 -- 172.21.15.37:0/951796748 >> v2:172.21.15.119:3300/0 conn(0x7efcd806a280 msgr2=0x7efcd80cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd7fff640 1 --2- 172.21.15.37:0/951796748 >> v2:172.21.15.119:3300/0 conn(0x7efcd806a280 0x7efcd80cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd7fff640 1 -- 172.21.15.37:0/951796748 >> v1:172.21.15.37:6789/0 conn(0x7efcd80b7810 legacy=0x7efcd815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd7fff640 1 -- 172.21.15.37:0/951796748 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80ce680 con 0x7efcd80ce1a0 2023-07-09T21:41:24.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.941+0000 7efcd77fe640 1 -- 172.21.15.37:0/951796748 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63685198 0 0) 0x7efcd80ccd40 con 0x7efcd80b7810 2023-07-09T21:41:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcd7fff640 1 --2- 172.21.15.37:0/951796748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd8069d40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b14e0 tx=0x7efcc401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d901fbb63e649557 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcd77fe640 1 -- 172.21.15.37:0/951796748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40a7070 con 0x7efcd80ce1a0 2023-07-09T21:41:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcd77fe640 1 -- 172.21.15.37:0/951796748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40ab430 con 0x7efcd80ce1a0 2023-07-09T21:41:24.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcd77fe640 1 -- 172.21.15.37:0/951796748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc40ab7c0 con 0x7efcd80ce1a0 2023-07-09T21:41:24.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 -- 172.21.15.37:0/951796748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 msgr2=0x7efcd8069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 --2- 172.21.15.37:0/951796748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd8069d40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7efcd80b14e0 tx=0x7efcc401c430 comp rx=0 tx=0).stop 2023-07-09T21:41:24.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 -- 172.21.15.37:0/951796748 shutdown_connections 2023-07-09T21:41:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 --2- 172.21.15.37:0/951796748 >> v2:172.21.15.119:3300/0 conn(0x7efcd806a280 0x7efcd80cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 --2- 172.21.15.37:0/951796748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd8069d40 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 -- 172.21.15.37:0/951796748 >> 172.21.15.37:0/951796748 conn(0x7efcd80cea60 msgr2=0x7efcd80cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 -- 172.21.15.37:0/951796748 shutdown_connections 2023-07-09T21:41:24.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 -- 172.21.15.37:0/951796748 wait complete. 2023-07-09T21:41:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.945+0000 7efcdd912640 1 Processor -- start 2023-07-09T21:41:24.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- start start 2023-07-09T21:41:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd806a280 0x7efcd815a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd80b7810 0x7efcd815dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd8159df0 con 0x7efcd80ce1a0 2023-07-09T21:41:24.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd81591e0 con 0x7efcd80b7810 2023-07-09T21:41:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd81594c0 con 0x7efcd806a280 2023-07-09T21:41:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54346/0 (socket says 172.21.15.37:54346) 2023-07-09T21:41:24.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 -- 172.21.15.37:0/1462693045 learned_addr learned my addr 172.21.15.37:0/1462693045 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdc910640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd806a280 0x7efcd815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcd7fff640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd80b7810 0x7efcd815dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 -- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd806a280 msgr2=0x7efcd815a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd806a280 0x7efcd815a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 -- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd80b7810 msgr2=0x7efcd815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd80b7810 0x7efcd815dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 -- 172.21.15.37:0/1462693045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009420 con 0x7efcd80ce1a0 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd111640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efcd000efc0 tx=0x7efcd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0014480 con 0x7efcd80ce1a0 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd000f040 con 0x7efcd80ce1a0 2023-07-09T21:41:24.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0014820 con 0x7efcd80ce1a0 2023-07-09T21:41:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd81597a0 con 0x7efcd80ce1a0 2023-07-09T21:41:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd8158e20 con 0x7efcd80ce1a0 2023-07-09T21:41:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.949+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8159f60 con 0x7efcd80ce1a0 2023-07-09T21:41:24.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.953+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efcd0014980 con 0x7efcd80ce1a0 2023-07-09T21:41:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.953+0000 7efcd57fa640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 0x7efcbc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.953+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efcd0084bd0 con 0x7efcd80ce1a0 2023-07-09T21:41:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.953+0000 7efcdc910640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 0x7efcbc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:24.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.953+0000 7efcdc910640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 0x7efcbc068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f70 tx=0x7efccc007b60 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:24.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:24.957+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efcd0051d90 con 0x7efcd80ce1a0 2023-07-09T21:41:25.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.113+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcd804e020 con 0x7efcd80ce1a0 2023-07-09T21:41:25.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcd57fa640 1 -- 172.21.15.37:0/1462693045 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+18294 (secure 0 0 0) 0x7efcd0018090 con 0x7efcd80ce1a0 2023-07-09T21:41:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:25.116 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":128,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:23.779756+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 msgr2=0x7efcbc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 0x7efcbc068880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efccc000f70 tx=0x7efccc007b60 comp rx=0 tx=0).stop 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 msgr2=0x7efcd815e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7efcd000efc0 tx=0x7efcd000c490 comp rx=0 tx=0).stop 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 shutdown_connections 2023-07-09T21:41:25.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7efcbc0663d0 0x7efcbc068880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efcd80ce1a0 0x7efcd815e1d0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efcd80b7810 0x7efcd815dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 --2- 172.21.15.37:0/1462693045 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efcd806a280 0x7efcd815a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 >> 172.21.15.37:0/1462693045 conn(0x7efcd80cea60 msgr2=0x7efcd8155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 shutdown_connections 2023-07-09T21:41:25.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.117+0000 7efcdd912640 1 -- 172.21.15.37:0/1462693045 wait complete. 2023-07-09T21:41:25.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:41:25.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 Processor -- start 2023-07-09T21:41:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 -- start start 2023-07-09T21:41:25.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb27c0b7980 0x7fb27c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c15bf80 con 0x7fb27c0ceb80 2023-07-09T21:41:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c160570 con 0x7fb27c0d0780 2023-07-09T21:41:25.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.285+0000 7fb281a93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0cd070 con 0x7fb27c0b7980 2023-07-09T21:41:25.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb27c0ceb80 0x7fb27c0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57774/0 (socket says 172.21.15.37:57774) 2023-07-09T21:41:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27affd640 1 -- 172.21.15.37:0/829046583 learned_addr learned my addr 172.21.15.37:0/829046583 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/829046583 >> v2:172.21.15.119:3300/0 conn(0x7fb27c0b7980 0x7fb27c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323999592 0 0) 0x7fb270001120 con 0x7fb27c0ceb80 2023-07-09T21:41:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb264003530 con 0x7fb27c0ceb80 2023-07-09T21:41:25.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255055250 0 0) 0x7fb264003530 con 0x7fb27c0ceb80 2023-07-09T21:41:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 >> v2:172.21.15.119:3300/0 conn(0x7fb27c0b7980 msgr2=0x7fb27c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 --2- 172.21.15.37:0/829046583 >> v2:172.21.15.119:3300/0 conn(0x7fb27c0b7980 0x7fb27c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 >> v1:172.21.15.119:6789/0 conn(0x7fb27c0d0780 legacy=0x7fb27c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0d02f0 con 0x7fb27c0ceb80 2023-07-09T21:41:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fb270001810 con 0x7fb27c0ceb80 2023-07-09T21:41:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 >> v1:172.21.15.37:6789/0 conn(0x7fb27c0ceb80 legacy=0x7fb27c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb264003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2640047d0 0x7fb264004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb264005180 0x7fb26400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0cd070 con 0x7fb264003980 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26400c000 con 0x7fb2640047d0 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26400c1c0 con 0x7fb264005180 2023-07-09T21:41:25.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb264003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27affd640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2640047d0 0x7fb264004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27bfff640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb264005180 0x7fb26400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 -- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb264005180 msgr2=0x7fb26400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb264005180 0x7fb26400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 -- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2640047d0 msgr2=0x7fb264004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2640047d0 0x7fb264004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27b7fe640 1 -- 172.21.15.37:0/829046583 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264003530 con 0x7fb264003980 2023-07-09T21:41:25.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27bfff640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb264005180 0x7fb26400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:25.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.289+0000 7fb27bfff640 1 -- 172.21.15.37:0/829046583 reap_dead start 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb264003d90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ae0 tx=0x7fb26c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ba97866f7b5f55 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0a9420 con 0x7fb264003980 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0a9580 con 0x7fb264003980 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb27a7fc640 1 -- 172.21.15.37:0/829046583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0a9930 con 0x7fb264003980 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 msgr2=0x7fb264003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb264003d90 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009ae0 tx=0x7fb26c01ca50 comp rx=0 tx=0).stop 2023-07-09T21:41:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- 172.21.15.37:0/829046583 shutdown_connections 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 --2- 172.21.15.37:0/829046583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb264003d90 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- 172.21.15.37:0/829046583 >> 172.21.15.37:0/829046583 conn(0x7fb27c073090 msgr2=0x7fb27c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- 172.21.15.37:0/829046583 shutdown_connections 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- 172.21.15.37:0/829046583 wait complete. 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 Processor -- start 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.293+0000 7fb281a93640 1 -- start start 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c0d1fa0 0x7fb27c0d2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 0x7fb27c1e97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c14eba0 con 0x7fb264003980 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0d2950 con 0x7fb27c1e9340 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c1ea0c0 con 0x7fb27c0d1fa0 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54356/0 (socket says 172.21.15.37:54356) 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 -- 172.21.15.37:0/3520879272 learned_addr learned my addr 172.21.15.37:0/3520879272 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27bfff640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 0x7fb27c1e97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27affd640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c0d1fa0 0x7fb27c0d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 -- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c0d1fa0 msgr2=0x7fb27c0d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c0d1fa0 0x7fb27c0d2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 -- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 msgr2=0x7fb27c1e97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:25.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 0x7fb27c1e97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:25.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 -- 172.21.15.37:0/3520879272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c1f5390 con 0x7fb264003980 2023-07-09T21:41:25.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27bfff640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 0x7fb27c1e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:25.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb27b7fe640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb26c01c880 tx=0x7fb26c01b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:25.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0a9c00 con 0x7fb264003980 2023-07-09T21:41:25.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0a9d60 con 0x7fb264003980 2023-07-09T21:41:25.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c1f5670 con 0x7fb264003980 2023-07-09T21:41:25.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c0b9600 con 0x7fb264003980 2023-07-09T21:41:25.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c1f5000 con 0x7fb264003980 2023-07-09T21:41:25.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c04d7d0 con 0x7fb264003980 2023-07-09T21:41:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.297+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb26c0b13f0 con 0x7fb264003980 2023-07-09T21:41:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.301+0000 7fb263fff640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 0x7fb268068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.301+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb26c11df40 con 0x7fb264003980 2023-07-09T21:41:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.301+0000 7fb27affd640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 0x7fb268068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:25.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.301+0000 7fb27affd640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 0x7fb268068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb270007fd0 tx=0x7fb270001310 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:25.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.305+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb26c0eb370 con 0x7fb264003980 2023-07-09T21:41:25.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:25.497+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb27c06a800 con 0x7fb264003980 2023-07-09T21:41:26.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb263fff640 1 -- 172.21.15.37:0/3520879272 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb26c0be020 con 0x7fb264003980 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 msgr2=0x7fb268068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 0x7fb268068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb270007fd0 tx=0x7fb270001310 comp rx=0 tx=0).stop 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 msgr2=0x7fb27c14e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fb26c01c880 tx=0x7fb26c01b290 comp rx=0 tx=0).stop 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 shutdown_connections 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fb2680663a0 0x7fb268068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb27c1e9340 0x7fb27c1e97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb27c0d1fa0 0x7fb27c0d2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 --2- 172.21.15.37:0/3520879272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb264003980 0x7fb27c14e660 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 >> 172.21.15.37:0/3520879272 conn(0x7fb27c073090 msgr2=0x7fb27c0d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 shutdown_connections 2023-07-09T21:41:26.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.421+0000 7fb281a93640 1 -- 172.21.15.37:0/3520879272 wait complete. 2023-07-09T21:41:26.445 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:41:26.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:41:26.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 Processor -- start 2023-07-09T21:41:26.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 -- start start 2023-07-09T21:41:26.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f059c160030 0x7f059c0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c15bf80 con 0x7f059c0cf290 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c0d02f0 con 0x7f059c0b7980 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a3f74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0cd070 con 0x7f059c160030 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a150f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f059c0cf290 0x7f059c0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57778/0 (socket says 172.21.15.37:57778) 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a150f640 1 -- 172.21.15.37:0/3254977078 learned_addr learned my addr 172.21.15.37:0/3254977078 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:26.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a2511640 1 --2- 172.21.15.37:0/3254977078 >> v2:172.21.15.119:3300/0 conn(0x7f059c160030 0x7f059c0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830290681 0 0) 0x7f058c001120 con 0x7f059c0cf290 2023-07-09T21:41:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0588003530 con 0x7f059c0cf290 2023-07-09T21:41:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676012953 0 0) 0x7f059c0d02f0 con 0x7f059c0b7980 2023-07-09T21:41:26.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058c001120 con 0x7f059c0b7980 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1665725458 0 0) 0x7f0588003530 con 0x7f059c0cf290 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 >> v2:172.21.15.119:3300/0 conn(0x7f059c160030 msgr2=0x7f059c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 --2- 172.21.15.37:0/3254977078 >> v2:172.21.15.119:3300/0 conn(0x7f059c160030 0x7f059c0d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 >> v1:172.21.15.119:6789/0 conn(0x7f059c0b7980 legacy=0x7f059c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0cc7f0 con 0x7f059c0cf290 2023-07-09T21:41:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f058c001810 con 0x7f059c0cf290 2023-07-09T21:41:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 >> v1:172.21.15.37:6789/0 conn(0x7f059c0cf290 legacy=0x7f059c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0588003b10 0x7f0588003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 0x7f0588004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0588005180 0x7f058800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0cd070 con 0x7f05880047d0 2023-07-09T21:41:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058800bfe0 con 0x7f0588005180 2023-07-09T21:41:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058800c1a0 con 0x7f0588003b10 2023-07-09T21:41:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a150f640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 0x7f0588004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a2511640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0588005180 0x7f058800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.597+0000 7f05a1d10640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0588003b10 0x7f0588003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 -- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0588003b10 msgr2=0x7f0588003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0588003b10 0x7f0588003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 -- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0588005180 msgr2=0x7f058800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0588005180 0x7f058800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 -- 172.21.15.37:0/3254977078 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0588003530 con 0x7f05880047d0 2023-07-09T21:41:26.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a2511640 1 -- 172.21.15.37:0/3254977078 reap_dead start 2023-07-09T21:41:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a150f640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 0x7f0588004c40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f059c0cf6b0 tx=0x7f058c01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b980c1ad02564e7a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:26.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0058e0 con 0x7f05880047d0 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c005a60 con 0x7f05880047d0 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a0d0e640 1 -- 172.21.15.37:0/3254977078 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c005e50 con 0x7f05880047d0 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a3f74640 1 -- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 msgr2=0x7f0588004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 0x7f0588004c40 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f059c0cf6b0 tx=0x7f058c01cb40 comp rx=0 tx=0).stop 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a3f74640 1 -- 172.21.15.37:0/3254977078 shutdown_connections 2023-07-09T21:41:26.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3254977078 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05880047d0 0x7f0588004c40 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.601+0000 7f05a3f74640 1 -- 172.21.15.37:0/3254977078 >> 172.21.15.37:0/3254977078 conn(0x7f059c073090 msgr2=0x7f059c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- 172.21.15.37:0/3254977078 shutdown_connections 2023-07-09T21:41:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- 172.21.15.37:0/3254977078 wait complete. 2023-07-09T21:41:26.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 Processor -- start 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- start start 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05880047d0 0x7f059c153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f059c0b35f0 0x7f059c0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15d120 con 0x7f059c15d990 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0b3fb0 con 0x7f059c0b35f0 2023-07-09T21:41:26.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15de00 con 0x7f05880047d0 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54368/0 (socket says 172.21.15.37:54368) 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 -- 172.21.15.37:0/3634345359 learned_addr learned my addr 172.21.15.37:0/3634345359 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a2511640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f059c0b35f0 0x7f059c0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a1d10640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05880047d0 0x7f059c153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 -- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05880047d0 msgr2=0x7f059c153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05880047d0 0x7f059c153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 -- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f059c0b35f0 msgr2=0x7f059c0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f059c0b35f0 0x7f059c0b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 -- 172.21.15.37:0/3634345359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c0c5d50 con 0x7f059c15d990 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a150f640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f058c01c970 tx=0x7f0588005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c004cc0 con 0x7f059c15d990 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058c004e20 con 0x7f059c15d990 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c0a5990 con 0x7f059c15d990 2023-07-09T21:41:26.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.605+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c15e050 con 0x7f059c15d990 2023-07-09T21:41:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c15e610 con 0x7f059c15d990 2023-07-09T21:41:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c04d7d0 con 0x7f059c15d990 2023-07-09T21:41:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f058c0a5af0 con 0x7f059c15d990 2023-07-09T21:41:26.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05927fc640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 0x7f0580068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0598001d30 con 0x7f059c15d990 2023-07-09T21:41:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.609+0000 7f05a1d10640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 0x7f0580068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.613+0000 7f05a1d10640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 0x7f0580068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f70 tx=0x7f0598000ee0 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:26.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.613+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f058c0eae10 con 0x7f059c15d990 2023-07-09T21:41:26.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:26.805+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f059c15bf80 con 0x7f059c15d990 2023-07-09T21:41:27.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.421+0000 7f05927fc640 1 -- 172.21.15.37:0/3634345359 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f059c15bf80 con 0x7f059c15d990 2023-07-09T21:41:27.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 msgr2=0x7f0580068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 0x7f0580068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0598000f70 tx=0x7f0598000ee0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 msgr2=0x7f059c15cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f058c01c970 tx=0x7f0588005800 comp rx=0 tx=0).stop 2023-07-09T21:41:27.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 shutdown_connections 2023-07-09T21:41:27.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f05800663d0 0x7f0580068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f059c0b35f0 0x7f059c0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f059c15d990 0x7f059c15cbe0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 --2- 172.21.15.37:0/3634345359 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05880047d0 0x7f059c153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 >> 172.21.15.37:0/3634345359 conn(0x7f059c073090 msgr2=0x7f059c0d05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:27.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 shutdown_connections 2023-07-09T21:41:27.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.425+0000 7f05a3f74640 1 -- 172.21.15.37:0/3634345359 wait complete. 2023-07-09T21:41:27.448 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:41:27.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:27.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 Processor -- start 2023-07-09T21:41:27.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 -- start start 2023-07-09T21:41:27.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc2c0b4340 0x7fcc2c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2c0b49f0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2c0b7e80 con 0x7fcc2c0b4340 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.597+0000 7fcc32456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0cc8a0 con 0x7fcc2c0cef80 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc2c0b4340 0x7fcc2c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc2c0b4340 0x7fcc2c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38648/0 (socket says 172.21.15.37:38648) 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/179063249 learned_addr learned my addr 172.21.15.37:0/179063249 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:27.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc309f3640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/179063249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 msgr2=0x7fcc2c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/179063249 >> v1:172.21.15.119:6789/0 conn(0x7fcc2c0b7ab0 legacy=0x7fcc2c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/179063249 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc2c0ccb80 con 0x7fcc2c0b4340 2023-07-09T21:41:27.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c06aa50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009870 tx=0x7fcc2001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17fffbed6de9b56c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2affd640 1 -- 172.21.15.37:0/179063249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200aa670 con 0x7fcc2c0b4340 2023-07-09T21:41:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2affd640 1 -- 172.21.15.37:0/179063249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc200aa7d0 con 0x7fcc2c0b4340 2023-07-09T21:41:27.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.601+0000 7fcc2affd640 1 -- 172.21.15.37:0/179063249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200aab60 con 0x7fcc2c0b4340 2023-07-09T21:41:27.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- 172.21.15.37:0/179063249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b4340 msgr2=0x7fcc2c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c06aa50 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fcc20009870 tx=0x7fcc2001c510 comp rx=0 tx=0).stop 2023-07-09T21:41:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- 172.21.15.37:0/179063249 shutdown_connections 2023-07-09T21:41:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- 172.21.15.37:0/179063249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c06aa50 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- 172.21.15.37:0/179063249 >> 172.21.15.37:0/179063249 conn(0x7fcc2c073090 msgr2=0x7fcc2c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- 172.21.15.37:0/179063249 shutdown_connections 2023-07-09T21:41:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- 172.21.15.37:0/179063249 wait complete. 2023-07-09T21:41:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 Processor -- start 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- start start 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0c7380 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0c75f0 con 0x7fcc2c0b4340 2023-07-09T21:41:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc32456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2c0c78d0 con 0x7fcc2c0cef80 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38650/0 (socket says 172.21.15.37:38650) 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/377759233 learned_addr learned my addr 172.21.15.37:0/377759233 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2bfff640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc309f3640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 msgr2=0x7fcc2c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c0b4340 msgr2=0x7fcc2c1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc2b7fe640 1 -- 172.21.15.37:0/377759233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc200094d0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.605+0000 7fcc309f3640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc2b7fe640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fcc200ac040 tx=0x7fcc2001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200b3800 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc200b3980 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc200b3d30 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c0c7bb0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc2c153be0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2c04d7d0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fcc200b2380 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 0x7fcc18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcc2011e860 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.609+0000 7fcc2bfff640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 0x7fcc18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.613+0000 7fcc2bfff640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 0x7fcc18068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c000f70 tx=0x7fcc1c009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.613+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcc200ebad0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc2c06a830 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc28ff9640 1 -- 172.21.15.37:0/377759233 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fcc200ef0f0 con 0x7fcc2c0b7ab0 2023-07-09T21:41:27.800 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:27.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:41:27.801 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 msgr2=0x7fcc18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 0x7fcc18068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c000f70 tx=0x7fcc1c009040 comp rx=0 tx=0).stop 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 msgr2=0x7fcc2c141d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fcc200ac040 tx=0x7fcc2001ad50 comp rx=0 tx=0).stop 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 shutdown_connections 2023-07-09T21:41:27.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fcc180663a0 0x7fcc18068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcc2c0cef80 0x7fcc2c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc2c0b7ab0 0x7fcc2c141d60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 --2- 172.21.15.37:0/377759233 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcc2c0b4340 0x7fcc2c1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 >> 172.21.15.37:0/377759233 conn(0x7fcc2c073090 msgr2=0x7fcc2c15ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 shutdown_connections 2023-07-09T21:41:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.801+0000 7fcc32456640 1 -- 172.21.15.37:0/377759233 wait complete. 2023-07-09T21:41:27.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:41:27.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 Processor -- start 2023-07-09T21:41:27.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 -- start start 2023-07-09T21:41:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81815bbf0 0x7fa8180d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa8180cf100 0x7fa8180cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8180d1380 con 0x7fa81806bc30 2023-07-09T21:41:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8180b13e0 con 0x7fa81815bbf0 2023-07-09T21:41:27.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81ebe6640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81802bbe0 con 0x7fa8180cf100 2023-07-09T21:41:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81815bbf0 0x7fa8180d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81815bbf0 0x7fa8180d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38660/0 (socket says 172.21.15.37:38660) 2023-07-09T21:41:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 -- 172.21.15.37:0/2949803761 learned_addr learned my addr 172.21.15.37:0/2949803761 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:27.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 -- 172.21.15.37:0/2949803761 >> v2:172.21.15.119:3300/0 conn(0x7fa8180cf100 msgr2=0x7fa8180cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:27.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 --2- 172.21.15.37:0/2949803761 >> v2:172.21.15.119:3300/0 conn(0x7fa8180cf100 0x7fa8180cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 -- 172.21.15.37:0/2949803761 >> v1:172.21.15.119:6789/0 conn(0x7fa81806bc30 legacy=0x7fa8180ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:27.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.965+0000 7fa81dbe4640 1 -- 172.21.15.37:0/2949803761 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8180b1100 con 0x7fa81815bbf0 2023-07-09T21:41:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81dbe4640 1 --2- 172.21.15.37:0/2949803761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81815bbf0 0x7fa8180d1810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c90c0 tx=0x7fa81401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697860681622ca7e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81cbe2640 1 -- 172.21.15.37:0/2949803761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140ac410 con 0x7fa81815bbf0 2023-07-09T21:41:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81cbe2640 1 -- 172.21.15.37:0/2949803761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8140ac570 con 0x7fa81815bbf0 2023-07-09T21:41:27.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81cbe2640 1 -- 172.21.15.37:0/2949803761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8140ac900 con 0x7fa81815bbf0 2023-07-09T21:41:27.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2949803761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81815bbf0 msgr2=0x7fa8180d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2949803761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81815bbf0 0x7fa8180d1810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa8180c90c0 tx=0x7fa81401c490 comp rx=0 tx=0).stop 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2949803761 shutdown_connections 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2949803761 >> v2:172.21.15.119:3300/0 conn(0x7fa8180cf100 0x7fa8180cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2949803761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81815bbf0 0x7fa8180d1810 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2949803761 >> 172.21.15.37:0/2949803761 conn(0x7fa81802b640 msgr2=0x7fa8180d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2949803761 shutdown_connections 2023-07-09T21:41:27.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.969+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2949803761 wait complete. 2023-07-09T21:41:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 Processor -- start 2023-07-09T21:41:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- start start 2023-07-09T21:41:27.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81806bc30 0x7fa8180c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81815bbf0 0x7fa8180d2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181511e0 con 0x7fa8180cf100 2023-07-09T21:41:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181514c0 con 0x7fa81815bbf0 2023-07-09T21:41:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8181517a0 con 0x7fa81806bc30 2023-07-09T21:41:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38666/0 (socket says 172.21.15.37:38666) 2023-07-09T21:41:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 -- 172.21.15.37:0/2993288933 learned_addr learned my addr 172.21.15.37:0/2993288933 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81dbe4640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81806bc30 0x7fa8180c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81e3e5640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81815bbf0 0x7fa8180d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 -- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81806bc30 msgr2=0x7fa8180c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81806bc30 0x7fa8180c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 -- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81815bbf0 msgr2=0x7fa8180d2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:27.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81815bbf0 0x7fa8180d2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 -- 172.21.15.37:0/2993288933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140094d0 con 0x7fa8180cf100 2023-07-09T21:41:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81d3e3640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa80800b3e0 tx=0x7fa80800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808011830 con 0x7fa8180cf100 2023-07-09T21:41:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080119b0 con 0x7fa8180cf100 2023-07-09T21:41:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa808011d60 con 0x7fa8180cf100 2023-07-09T21:41:27.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa818151a80 con 0x7fa8180cf100 2023-07-09T21:41:27.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.973+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8180c8060 con 0x7fa8180cf100 2023-07-09T21:41:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa81804e020 con 0x7fa8180cf100 2023-07-09T21:41:27.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa80801a400 con 0x7fa8180cf100 2023-07-09T21:41:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa80e7fc640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 0x7fa7fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa808083e80 con 0x7fa8180cf100 2023-07-09T21:41:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa81dbe4640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 0x7fa7fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:27.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.977+0000 7fa81dbe4640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 0x7fa7fc068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8140ae000 tx=0x7fa814009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:27.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:27.981+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8080512a0 con 0x7fa8180cf100 2023-07-09T21:41:28.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.137+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8181523e0 con 0x7fa8180cf100 2023-07-09T21:41:28.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.137+0000 7fa80e7fc640 1 -- 172.21.15.37:0/2993288933 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+18281 (secure 0 0 0) 0x7fa808015020 con 0x7fa8180cf100 2023-07-09T21:41:28.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:28.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":129,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:25.386916+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:41:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 msgr2=0x7fa7fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 0x7fa7fc068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8140ae000 tx=0x7fa814009040 comp rx=0 tx=0).stop 2023-07-09T21:41:28.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 msgr2=0x7fa8180af1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fa80800b3e0 tx=0x7fa80800b8a0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 shutdown_connections 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa7fc0663a0 0x7fa7fc068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81815bbf0 0x7fa8180d2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8180cf100 0x7fa8180af1f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 --2- 172.21.15.37:0/2993288933 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81806bc30 0x7fa8180c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 >> 172.21.15.37:0/2993288933 conn(0x7fa81802b640 msgr2=0x7fa8181556a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 shutdown_connections 2023-07-09T21:41:28.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.141+0000 7fa81ebe6640 1 -- 172.21.15.37:0/2993288933 wait complete. 2023-07-09T21:41:28.160 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:41:28.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:41:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 Processor -- start 2023-07-09T21:41:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 -- start start 2023-07-09T21:41:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f08680b7ab0 0x7f086806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08680b4340 0x7f08680d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08680b49f0 con 0x7f08680cef80 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680b7e80 con 0x7f08680b4340 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086e5d2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08680cc8a0 con 0x7f08680b7ab0 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08680b4340 0x7f08680d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08680b4340 0x7f08680d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38682/0 (socket says 172.21.15.37:38682) 2023-07-09T21:41:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 -- 172.21.15.37:0/2812337482 learned_addr learned my addr 172.21.15.37:0/2812337482 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f0867fff640 1 --2- 172.21.15.37:0/2812337482 >> v2:172.21.15.119:3300/0 conn(0x7f08680b7ab0 0x7f086806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 -- 172.21.15.37:0/2812337482 >> v2:172.21.15.119:3300/0 conn(0x7f08680b7ab0 msgr2=0x7f086806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 --2- 172.21.15.37:0/2812337482 >> v2:172.21.15.119:3300/0 conn(0x7f08680b7ab0 0x7f086806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 -- 172.21.15.37:0/2812337482 >> v1:172.21.15.119:6789/0 conn(0x7f08680cef80 legacy=0x7f08680b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.305+0000 7f086cb6f640 1 -- 172.21.15.37:0/2812337482 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08680ccb80 con 0x7f08680b4340 2023-07-09T21:41:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086cb6f640 1 --2- 172.21.15.37:0/2812337482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680d02a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f086806b360 tx=0x7f086001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e897b562de06c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f0866ffd640 1 -- 172.21.15.37:0/2812337482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5860 con 0x7f08680b4340 2023-07-09T21:41:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f0866ffd640 1 -- 172.21.15.37:0/2812337482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08600a59c0 con 0x7f08680b4340 2023-07-09T21:41:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f0866ffd640 1 -- 172.21.15.37:0/2812337482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08600a5d50 con 0x7f08680b4340 2023-07-09T21:41:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 -- 172.21.15.37:0/2812337482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 msgr2=0x7f08680d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 --2- 172.21.15.37:0/2812337482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680d02a0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f086806b360 tx=0x7f086001c9a0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 -- 172.21.15.37:0/2812337482 shutdown_connections 2023-07-09T21:41:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 --2- 172.21.15.37:0/2812337482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680d02a0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 --2- 172.21.15.37:0/2812337482 >> v2:172.21.15.119:3300/0 conn(0x7f08680b7ab0 0x7f086806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 -- 172.21.15.37:0/2812337482 >> 172.21.15.37:0/2812337482 conn(0x7f0868073090 msgr2=0x7f0868069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 -- 172.21.15.37:0/2812337482 shutdown_connections 2023-07-09T21:41:28.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.309+0000 7f086e5d2640 1 -- 172.21.15.37:0/2812337482 wait complete. 2023-07-09T21:41:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 Processor -- start 2023-07-09T21:41:28.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- start start 2023-07-09T21:41:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08680b7ab0 0x7f08680c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08680cef80 0x7f08680cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0868150df0 con 0x7f08680b4340 2023-07-09T21:41:28.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08681569f0 con 0x7f08680b7ab0 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08681501e0 con 0x7f08680cef80 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38684/0 (socket says 172.21.15.37:38684) 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 -- 172.21.15.37:0/204862584 learned_addr learned my addr 172.21.15.37:0/204862584 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f08677fe640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08680b7ab0 0x7f08680c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086cb6f640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08680cef80 0x7f08680cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 -- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08680cef80 msgr2=0x7f08680cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08680cef80 0x7f08680cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 -- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08680b7ab0 msgr2=0x7f08680c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08680b7ab0 0x7f08680c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 -- 172.21.15.37:0/204862584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0860009b30 con 0x7f08680b4340 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0867fff640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f085800e9b0 tx=0x7f085800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08580096b0 con 0x7f08680b4340 2023-07-09T21:41:28.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085800c9a0 con 0x7f08680b4340 2023-07-09T21:41:28.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085800cd30 con 0x7f08680b4340 2023-07-09T21:41:28.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08681504c0 con 0x7f08680b4340 2023-07-09T21:41:28.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.313+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0868150a80 con 0x7f08680b4340 2023-07-09T21:41:28.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086804d7d0 con 0x7f08680b4340 2023-07-09T21:41:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0858013470 con 0x7f08680b4340 2023-07-09T21:41:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f0864ff9640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 0x7f0854068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f08580841b0 con 0x7f08680b4340 2023-07-09T21:41:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f08677fe640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 0x7f0854068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.317+0000 7f08677fe640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 0x7f0854068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08680c84e0 tx=0x7f085c009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.321+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0858054f10 con 0x7f08680b4340 2023-07-09T21:41:28.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.477+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f08680cf4d0 con 0x7f08540663a0 2023-07-09T21:41:28.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.485+0000 7f0864ff9640 1 -- 172.21.15.37:0/204862584 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306782 (secure 0 0 0) 0x7f085c001380 con 0x7f08540663a0 2023-07-09T21:41:28.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:28.490 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:41:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 msgr2=0x7f0854068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 0x7f0854068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f08680c84e0 tx=0x7f085c009040 comp rx=0 tx=0).stop 2023-07-09T21:41:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 msgr2=0x7f08680c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f085800e9b0 tx=0x7f085800ee70 comp rx=0 tx=0).stop 2023-07-09T21:41:28.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 shutdown_connections 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f08540663a0 0x7f0854068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f08680cef80 0x7f08680cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f08680b7ab0 0x7f08680c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 --2- 172.21.15.37:0/204862584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08680b4340 0x7f08680c9280 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 >> 172.21.15.37:0/204862584 conn(0x7f0868073090 msgr2=0x7f08680d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:28.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 shutdown_connections 2023-07-09T21:41:28.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.489+0000 7f086e5d2640 1 -- 172.21.15.37:0/204862584 wait complete. 2023-07-09T21:41:28.509 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:41:28.037275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332316,"kb_used_data":13404,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642404,"statfs":{"total":773094113280,"available":772753821696,"internally_reserved":0,"allocated":13725696,"data_stored":7533956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.655311"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391503+0000","last_change":"2023-07-09T21:41:23.391503+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391503+0000","last_undegraded":"2023-07-09T21:41:23.391503+0000","last_fullsized":"2023-07-09T21:41:23.391503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396864+0000","last_change":"2023-07-09T21:41:23.396864+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396864+0000","last_undegraded":"2023-07-09T21:41:23.396864+0000","last_fullsized":"2023-07-09T21:41:23.396864+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393411+0000","last_change":"2023-07-09T21:41:23.393411+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393411+0000","last_undegraded":"2023-07-09T21:41:23.393411+0000","last_fullsized":"2023-07-09T21:41:23.393411+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392697+0000","last_change":"2023-07-09T21:41:23.392697+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392697+0000","last_undegraded":"2023-07-09T21:41:23.392697+0000","last_fullsized":"2023-07-09T21:41:23.392697+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392441+0000","last_change":"2023-07-09T21:41:23.392441+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392441+0000","last_undegraded":"2023-07-09T21:41:23.392441+0000","last_fullsized":"2023-07-09T21:41:23.392441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396279+0000","last_change":"2023-07-09T21:41:23.396279+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396279+0000","last_undegraded":"2023-07-09T21:41:23.396279+0000","last_fullsized":"2023-07-09T21:41:23.396279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398125+0000","last_change":"2023-07-09T21:41:23.398125+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398125+0000","last_undegraded":"2023-07-09T21:41:23.398125+0000","last_fullsized":"2023-07-09T21:41:23.398125+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396273+0000","last_change":"2023-07-09T21:41:23.396273+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396273+0000","last_undegraded":"2023-07-09T21:41:23.396273+0000","last_fullsized":"2023-07-09T21:41:23.396273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396877+0000","last_change":"2023-07-09T21:41:23.396877+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396877+0000","last_undegraded":"2023-07-09T21:41:23.396877+0000","last_fullsized":"2023-07-09T21:41:23.396877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391148+0000","last_change":"2023-07-09T21:41:23.391148+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391148+0000","last_undegraded":"2023-07-09T21:41:23.391148+0000","last_fullsized":"2023-07-09T21:41:23.391148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397954+0000","last_change":"2023-07-09T21:41:23.397954+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397954+0000","last_undegraded":"2023-07-09T21:41:23.397954+0000","last_fullsized":"2023-07-09T21:41:23.397954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394287+0000","last_change":"2023-07-09T21:41:23.394287+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394287+0000","last_undegraded":"2023-07-09T21:41:23.394287+0000","last_fullsized":"2023-07-09T21:41:23.394287+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389014+0000","last_change":"2023-07-09T21:41:23.389014+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389014+0000","last_undegraded":"2023-07-09T21:41:23.389014+0000","last_fullsized":"2023-07-09T21:41:23.389014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.403654+0000","last_change":"2023-07-09T21:41:23.403654+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.403654+0000","last_undegraded":"2023-07-09T21:41:23.403654+0000","last_fullsized":"2023-07-09T21:41:23.403654+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400504+0000","last_change":"2023-07-09T21:41:23.400504+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400504+0000","last_undegraded":"2023-07-09T21:41:23.400504+0000","last_fullsized":"2023-07-09T21:41:23.400504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.401336+0000","last_change":"2023-07-09T21:41:23.401336+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.401336+0000","last_undegraded":"2023-07-09T21:41:23.401336+0000","last_fullsized":"2023-07-09T21:41:23.401336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391110+0000","last_change":"2023-07-09T21:41:23.391110+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391110+0000","last_undegraded":"2023-07-09T21:41:23.391110+0000","last_fullsized":"2023-07-09T21:41:23.391110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396385+0000","last_change":"2023-07-09T21:41:23.396385+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396385+0000","last_undegraded":"2023-07-09T21:41:23.396385+0000","last_fullsized":"2023-07-09T21:41:23.396385+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392980+0000","last_change":"2023-07-09T21:41:23.392980+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392980+0000","last_undegraded":"2023-07-09T21:41:23.392980+0000","last_fullsized":"2023-07-09T21:41:23.392980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393625+0000","last_change":"2023-07-09T21:41:23.393625+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393625+0000","last_undegraded":"2023-07-09T21:41:23.393625+0000","last_fullsized":"2023-07-09T21:41:23.393625+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398769+0000","last_change":"2023-07-09T21:41:23.398769+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398769+0000","last_undegraded":"2023-07-09T21:41:23.398769+0000","last_fullsized":"2023-07-09T21:41:23.398769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391682+0000","last_change":"2023-07-09T21:41:23.391682+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391682+0000","last_undegraded":"2023-07-09T21:41:23.391682+0000","last_fullsized":"2023-07-09T21:41:23.391682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390312+0000","last_change":"2023-07-09T21:41:23.390312+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390312+0000","last_undegraded":"2023-07-09T21:41:23.390312+0000","last_fullsized":"2023-07-09T21:41:23.390312+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391809+0000","last_change":"2023-07-09T21:41:23.391809+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391809+0000","last_undegraded":"2023-07-09T21:41:23.391809+0000","last_fullsized":"2023-07-09T21:41:23.391809+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395829+0000","last_change":"2023-07-09T21:41:23.395829+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395829+0000","last_undegraded":"2023-07-09T21:41:23.395829+0000","last_fullsized":"2023-07-09T21:41:23.395829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395216+0000","last_change":"2023-07-09T21:41:23.395216+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395216+0000","last_undegraded":"2023-07-09T21:41:23.395216+0000","last_fullsized":"2023-07-09T21:41:23.395216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397472+0000","last_change":"2023-07-09T21:41:23.397472+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397472+0000","last_undegraded":"2023-07-09T21:41:23.397472+0000","last_fullsized":"2023-07-09T21:41:23.397472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395816+0000","last_change":"2023-07-09T21:41:23.395816+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395816+0000","last_undegraded":"2023-07-09T21:41:23.395816+0000","last_fullsized":"2023-07-09T21:41:23.395816+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389429+0000","last_change":"2023-07-09T21:41:23.389429+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389429+0000","last_undegraded":"2023-07-09T21:41:23.389429+0000","last_fullsized":"2023-07-09T21:41:23.389429+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395295+0000","last_change":"2023-07-09T21:41:23.395295+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395295+0000","last_undegraded":"2023-07-09T21:41:23.395295+0000","last_fullsized":"2023-07-09T21:41:23.395295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396491+0000","last_change":"2023-07-09T21:41:23.396491+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396491+0000","last_undegraded":"2023-07-09T21:41:23.396491+0000","last_fullsized":"2023-07-09T21:41:23.396491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395835+0000","last_change":"2023-07-09T21:41:23.395835+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395835+0000","last_undegraded":"2023-07-09T21:41:23.395835+0000","last_fullsized":"2023-07-09T21:41:23.395835+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389107+0000","last_change":"2023-07-09T21:41:23.389107+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389107+0000","last_undegraded":"2023-07-09T21:41:23.389107+0000","last_fullsized":"2023-07-09T21:41:23.389107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412979+0000","last_change":"2023-07-09T21:41:23.410170+0000","last_active":"2023-07-09T21:41:23.412979+0000","last_peered":"2023-07-09T21:41:23.412979+0000","last_clean":"2023-07-09T21:41:23.412979+0000","last_became_active":"2023-07-09T21:41:23.409871+0000","last_became_peered":"2023-07-09T21:41:23.409871+0000","last_unstale":"2023-07-09T21:41:23.412979+0000","last_undegraded":"2023-07-09T21:41:23.412979+0000","last_fullsized":"2023-07-09T21:41:23.412979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:37:19.570097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389527+0000","last_change":"2023-07-09T21:41:23.389527+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389527+0000","last_undegraded":"2023-07-09T21:41:23.389527+0000","last_fullsized":"2023-07-09T21:41:23.389527+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409869+0000","last_change":"2023-07-09T21:41:23.406204+0000","last_active":"2023-07-09T21:41:23.409869+0000","last_peered":"2023-07-09T21:41:23.409869+0000","last_clean":"2023-07-09T21:41:23.409869+0000","last_became_active":"2023-07-09T21:41:23.405916+0000","last_became_peered":"2023-07-09T21:41:23.405916+0000","last_unstale":"2023-07-09T21:41:23.409869+0000","last_undegraded":"2023-07-09T21:41:23.409869+0000","last_fullsized":"2023-07-09T21:41:23.409869+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:06.973837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394778+0000","last_change":"2023-07-09T21:41:23.394778+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394778+0000","last_undegraded":"2023-07-09T21:41:23.394778+0000","last_fullsized":"2023-07-09T21:41:23.394778+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413257+0000","last_change":"2023-07-09T21:41:23.409832+0000","last_active":"2023-07-09T21:41:23.413257+0000","last_peered":"2023-07-09T21:41:23.413257+0000","last_clean":"2023-07-09T21:41:23.413257+0000","last_became_active":"2023-07-09T21:41:23.409503+0000","last_became_peered":"2023-07-09T21:41:23.409503+0000","last_unstale":"2023-07-09T21:41:23.413257+0000","last_undegraded":"2023-07-09T21:41:23.413257+0000","last_fullsized":"2023-07-09T21:41:23.413257+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:19.850905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397311+0000","last_change":"2023-07-09T21:41:23.397311+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397311+0000","last_undegraded":"2023-07-09T21:41:23.397311+0000","last_fullsized":"2023-07-09T21:41:23.397311+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409352+0000","last_change":"2023-07-09T21:41:23.408440+0000","last_active":"2023-07-09T21:41:23.409352+0000","last_peered":"2023-07-09T21:41:23.409352+0000","last_clean":"2023-07-09T21:41:23.409352+0000","last_became_active":"2023-07-09T21:41:23.408100+0000","last_became_peered":"2023-07-09T21:41:23.408100+0000","last_unstale":"2023-07-09T21:41:23.409352+0000","last_undegraded":"2023-07-09T21:41:23.409352+0000","last_fullsized":"2023-07-09T21:41:23.409352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:13.089114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390712+0000","last_change":"2023-07-09T21:41:23.390712+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390712+0000","last_undegraded":"2023-07-09T21:41:23.390712+0000","last_fullsized":"2023-07-09T21:41:23.390712+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.416455+0000","last_change":"2023-07-09T21:41:23.415349+0000","last_active":"2023-07-09T21:41:23.416455+0000","last_peered":"2023-07-09T21:41:23.416455+0000","last_clean":"2023-07-09T21:41:23.416455+0000","last_became_active":"2023-07-09T21:41:23.415046+0000","last_became_peered":"2023-07-09T21:41:23.415046+0000","last_unstale":"2023-07-09T21:41:23.416455+0000","last_undegraded":"2023-07-09T21:41:23.416455+0000","last_fullsized":"2023-07-09T21:41:23.416455+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:39.023152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391939+0000","last_change":"2023-07-09T21:41:23.391939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391939+0000","last_undegraded":"2023-07-09T21:41:23.391939+0000","last_fullsized":"2023-07-09T21:41:23.391939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410090+0000","last_change":"2023-07-09T21:41:23.408634+0000","last_active":"2023-07-09T21:41:23.410090+0000","last_peered":"2023-07-09T21:41:23.410090+0000","last_clean":"2023-07-09T21:41:23.410090+0000","last_became_active":"2023-07-09T21:41:23.408353+0000","last_became_peered":"2023-07-09T21:41:23.408353+0000","last_unstale":"2023-07-09T21:41:23.410090+0000","last_undegraded":"2023-07-09T21:41:23.410090+0000","last_fullsized":"2023-07-09T21:41:23.410090+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:20.650730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395939+0000","last_change":"2023-07-09T21:41:23.395939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395939+0000","last_undegraded":"2023-07-09T21:41:23.395939+0000","last_fullsized":"2023-07-09T21:41:23.395939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414915+0000","last_change":"2023-07-09T21:41:23.411059+0000","last_active":"2023-07-09T21:41:23.414915+0000","last_peered":"2023-07-09T21:41:23.414915+0000","last_clean":"2023-07-09T21:41:23.414915+0000","last_became_active":"2023-07-09T21:41:23.410779+0000","last_became_peered":"2023-07-09T21:41:23.410779+0000","last_unstale":"2023-07-09T21:41:23.414915+0000","last_undegraded":"2023-07-09T21:41:23.414915+0000","last_fullsized":"2023-07-09T21:41:23.414915+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:55.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390184+0000","last_change":"2023-07-09T21:41:23.390184+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390184+0000","last_undegraded":"2023-07-09T21:41:23.390184+0000","last_fullsized":"2023-07-09T21:41:23.390184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407004+0000","last_change":"2023-07-09T21:41:23.400312+0000","last_active":"2023-07-09T21:41:23.407004+0000","last_peered":"2023-07-09T21:41:23.407004+0000","last_clean":"2023-07-09T21:41:23.407004+0000","last_became_active":"2023-07-09T21:41:23.400038+0000","last_became_peered":"2023-07-09T21:41:23.400038+0000","last_unstale":"2023-07-09T21:41:23.407004+0000","last_undegraded":"2023-07-09T21:41:23.407004+0000","last_fullsized":"2023-07-09T21:41:23.407004+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:16.171313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389722+0000","last_change":"2023-07-09T21:41:23.389722+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389722+0000","last_undegraded":"2023-07-09T21:41:23.389722+0000","last_fullsized":"2023-07-09T21:41:23.389722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414900+0000","last_change":"2023-07-09T21:41:23.410925+0000","last_active":"2023-07-09T21:41:23.414900+0000","last_peered":"2023-07-09T21:41:23.414900+0000","last_clean":"2023-07-09T21:41:23.414900+0000","last_became_active":"2023-07-09T21:41:23.410630+0000","last_became_peered":"2023-07-09T21:41:23.410630+0000","last_unstale":"2023-07-09T21:41:23.414900+0000","last_undegraded":"2023-07-09T21:41:23.414900+0000","last_fullsized":"2023-07-09T21:41:23.414900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:12.575978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393270+0000","last_change":"2023-07-09T21:41:23.393270+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393270+0000","last_undegraded":"2023-07-09T21:41:23.393270+0000","last_fullsized":"2023-07-09T21:41:23.393270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409419+0000","last_change":"2023-07-09T21:41:23.406825+0000","last_active":"2023-07-09T21:41:23.409419+0000","last_peered":"2023-07-09T21:41:23.409419+0000","last_clean":"2023-07-09T21:41:23.409419+0000","last_became_active":"2023-07-09T21:41:23.406551+0000","last_became_peered":"2023-07-09T21:41:23.406551+0000","last_unstale":"2023-07-09T21:41:23.409419+0000","last_undegraded":"2023-07-09T21:41:23.409419+0000","last_fullsized":"2023-07-09T21:41:23.409419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:39.659592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389013+0000","last_change":"2023-07-09T21:41:23.389013+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389013+0000","last_undegraded":"2023-07-09T21:41:23.389013+0000","last_fullsized":"2023-07-09T21:41:23.389013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412269+0000","last_change":"2023-07-09T21:41:23.410301+0000","last_active":"2023-07-09T21:41:23.412269+0000","last_peered":"2023-07-09T21:41:23.412269+0000","last_clean":"2023-07-09T21:41:23.412269+0000","last_became_active":"2023-07-09T21:41:23.410015+0000","last_became_peered":"2023-07-09T21:41:23.410015+0000","last_unstale":"2023-07-09T21:41:23.412269+0000","last_undegraded":"2023-07-09T21:41:23.412269+0000","last_fullsized":"2023-07-09T21:41:23.412269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:33.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391533+0000","last_change":"2023-07-09T21:41:23.391533+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391533+0000","last_undegraded":"2023-07-09T21:41:23.391533+0000","last_fullsized":"2023-07-09T21:41:23.391533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414456+0000","last_change":"2023-07-09T21:41:23.405581+0000","last_active":"2023-07-09T21:41:23.414456+0000","last_peered":"2023-07-09T21:41:23.414456+0000","last_clean":"2023-07-09T21:41:23.414456+0000","last_became_active":"2023-07-09T21:41:23.405276+0000","last_became_peered":"2023-07-09T21:41:23.405276+0000","last_unstale":"2023-07-09T21:41:23.414456+0000","last_undegraded":"2023-07-09T21:41:23.414456+0000","last_fullsized":"2023-07-09T21:41:23.414456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:30.319720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397436+0000","last_change":"2023-07-09T21:41:23.397436+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397436+0000","last_undegraded":"2023-07-09T21:41:23.397436+0000","last_fullsized":"2023-07-09T21:41:23.397436+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405385+0000","last_change":"2023-07-09T21:41:23.404033+0000","last_active":"2023-07-09T21:41:23.405385+0000","last_peered":"2023-07-09T21:41:23.405385+0000","last_clean":"2023-07-09T21:41:23.405385+0000","last_became_active":"2023-07-09T21:41:23.403730+0000","last_became_peered":"2023-07-09T21:41:23.403730+0000","last_unstale":"2023-07-09T21:41:23.405385+0000","last_undegraded":"2023-07-09T21:41:23.405385+0000","last_fullsized":"2023-07-09T21:41:23.405385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:15.939862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395930+0000","last_change":"2023-07-09T21:41:23.395930+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395930+0000","last_undegraded":"2023-07-09T21:41:23.395930+0000","last_fullsized":"2023-07-09T21:41:23.395930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409618+0000","last_change":"2023-07-09T21:41:23.402616+0000","last_active":"2023-07-09T21:41:23.409618+0000","last_peered":"2023-07-09T21:41:23.409618+0000","last_clean":"2023-07-09T21:41:23.409618+0000","last_became_active":"2023-07-09T21:41:23.402350+0000","last_became_peered":"2023-07-09T21:41:23.402350+0000","last_unstale":"2023-07-09T21:41:23.409618+0000","last_undegraded":"2023-07-09T21:41:23.409618+0000","last_fullsized":"2023-07-09T21:41:23.409618+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:28.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398030+0000","last_change":"2023-07-09T21:41:23.398030+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398030+0000","last_undegraded":"2023-07-09T21:41:23.398030+0000","last_fullsized":"2023-07-09T21:41:23.398030+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411058+0000","last_change":"2023-07-09T21:41:23.408629+0000","last_active":"2023-07-09T21:41:23.411058+0000","last_peered":"2023-07-09T21:41:23.411058+0000","last_clean":"2023-07-09T21:41:23.411058+0000","last_became_active":"2023-07-09T21:41:23.408327+0000","last_became_peered":"2023-07-09T21:41:23.408327+0000","last_unstale":"2023-07-09T21:41:23.411058+0000","last_undegraded":"2023-07-09T21:41:23.411058+0000","last_fullsized":"2023-07-09T21:41:23.411058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:23:51.485002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390717+0000","last_change":"2023-07-09T21:41:23.390717+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390717+0000","last_undegraded":"2023-07-09T21:41:23.390717+0000","last_fullsized":"2023-07-09T21:41:23.390717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413501+0000","last_change":"2023-07-09T21:41:23.409766+0000","last_active":"2023-07-09T21:41:23.413501+0000","last_peered":"2023-07-09T21:41:23.413501+0000","last_clean":"2023-07-09T21:41:23.413501+0000","last_became_active":"2023-07-09T21:41:23.409466+0000","last_became_peered":"2023-07-09T21:41:23.409466+0000","last_unstale":"2023-07-09T21:41:23.413501+0000","last_undegraded":"2023-07-09T21:41:23.413501+0000","last_fullsized":"2023-07-09T21:41:23.413501+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:17.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390168+0000","last_change":"2023-07-09T21:41:23.390168+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390168+0000","last_undegraded":"2023-07-09T21:41:23.390168+0000","last_fullsized":"2023-07-09T21:41:23.390168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405348+0000","last_change":"2023-07-09T21:41:23.403988+0000","last_active":"2023-07-09T21:41:23.405348+0000","last_peered":"2023-07-09T21:41:23.405348+0000","last_clean":"2023-07-09T21:41:23.405348+0000","last_became_active":"2023-07-09T21:41:23.403716+0000","last_became_peered":"2023-07-09T21:41:23.403716+0000","last_unstale":"2023-07-09T21:41:23.405348+0000","last_undegraded":"2023-07-09T21:41:23.405348+0000","last_fullsized":"2023-07-09T21:41:23.405348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:42.887152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394438+0000","last_change":"2023-07-09T21:41:23.394438+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394438+0000","last_undegraded":"2023-07-09T21:41:23.394438+0000","last_fullsized":"2023-07-09T21:41:23.394438+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407148+0000","last_change":"2023-07-09T21:41:23.405390+0000","last_active":"2023-07-09T21:41:23.407148+0000","last_peered":"2023-07-09T21:41:23.407148+0000","last_clean":"2023-07-09T21:41:23.407148+0000","last_became_active":"2023-07-09T21:41:23.405110+0000","last_became_peered":"2023-07-09T21:41:23.405110+0000","last_unstale":"2023-07-09T21:41:23.407148+0000","last_undegraded":"2023-07-09T21:41:23.407148+0000","last_fullsized":"2023-07-09T21:41:23.407148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:41.859320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390950+0000","last_change":"2023-07-09T21:41:23.390950+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390950+0000","last_undegraded":"2023-07-09T21:41:23.390950+0000","last_fullsized":"2023-07-09T21:41:23.390950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415826+0000","last_change":"2023-07-09T21:41:23.409226+0000","last_active":"2023-07-09T21:41:23.415826+0000","last_peered":"2023-07-09T21:41:23.415826+0000","last_clean":"2023-07-09T21:41:23.415826+0000","last_became_active":"2023-07-09T21:41:23.408915+0000","last_became_peered":"2023-07-09T21:41:23.408915+0000","last_unstale":"2023-07-09T21:41:23.415826+0000","last_undegraded":"2023-07-09T21:41:23.415826+0000","last_fullsized":"2023-07-09T21:41:23.415826+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:53.751852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397752+0000","last_change":"2023-07-09T21:41:23.397752+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397752+0000","last_undegraded":"2023-07-09T21:41:23.397752+0000","last_fullsized":"2023-07-09T21:41:23.397752+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411148+0000","last_change":"2023-07-09T21:41:23.410114+0000","last_active":"2023-07-09T21:41:23.411148+0000","last_peered":"2023-07-09T21:41:23.411148+0000","last_clean":"2023-07-09T21:41:23.411148+0000","last_became_active":"2023-07-09T21:41:23.409820+0000","last_became_peered":"2023-07-09T21:41:23.409820+0000","last_unstale":"2023-07-09T21:41:23.411148+0000","last_undegraded":"2023-07-09T21:41:23.411148+0000","last_fullsized":"2023-07-09T21:41:23.411148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:44.277158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389067+0000","last_change":"2023-07-09T21:41:23.389067+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389067+0000","last_undegraded":"2023-07-09T21:41:23.389067+0000","last_fullsized":"2023-07-09T21:41:23.389067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.417241+0000","last_change":"2023-07-09T21:41:23.415235+0000","last_active":"2023-07-09T21:41:23.417241+0000","last_peered":"2023-07-09T21:41:23.417241+0000","last_clean":"2023-07-09T21:41:23.417241+0000","last_became_active":"2023-07-09T21:41:23.414961+0000","last_became_peered":"2023-07-09T21:41:23.414961+0000","last_unstale":"2023-07-09T21:41:23.417241+0000","last_undegraded":"2023-07-09T21:41:23.417241+0000","last_fullsized":"2023-07-09T21:41:23.417241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:04.879441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389072+0000","last_change":"2023-07-09T21:41:23.389072+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389072+0000","last_undegraded":"2023-07-09T21:41:23.389072+0000","last_fullsized":"2023-07-09T21:41:23.389072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411033+0000","last_change":"2023-07-09T21:41:23.408567+0000","last_active":"2023-07-09T21:41:23.411033+0000","last_peered":"2023-07-09T21:41:23.411033+0000","last_clean":"2023-07-09T21:41:23.411033+0000","last_became_active":"2023-07-09T21:41:23.408258+0000","last_became_peered":"2023-07-09T21:41:23.408258+0000","last_unstale":"2023-07-09T21:41:23.411033+0000","last_undegraded":"2023-07-09T21:41:23.411033+0000","last_fullsized":"2023-07-09T21:41:23.411033+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:21.539588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400844+0000","last_change":"2023-07-09T21:41:23.400844+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400844+0000","last_undegraded":"2023-07-09T21:41:23.400844+0000","last_fullsized":"2023-07-09T21:41:23.400844+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414324+0000","last_change":"2023-07-09T21:41:23.404952+0000","last_active":"2023-07-09T21:41:23.414324+0000","last_peered":"2023-07-09T21:41:23.414324+0000","last_clean":"2023-07-09T21:41:23.414324+0000","last_became_active":"2023-07-09T21:41:23.404681+0000","last_became_peered":"2023-07-09T21:41:23.404681+0000","last_unstale":"2023-07-09T21:41:23.414324+0000","last_undegraded":"2023-07-09T21:41:23.414324+0000","last_fullsized":"2023-07-09T21:41:23.414324+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:27.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400113+0000","last_change":"2023-07-09T21:41:23.400113+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400113+0000","last_undegraded":"2023-07-09T21:41:23.400113+0000","last_fullsized":"2023-07-09T21:41:23.400113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411032+0000","last_change":"2023-07-09T21:41:23.408898+0000","last_active":"2023-07-09T21:41:23.411032+0000","last_peered":"2023-07-09T21:41:23.411032+0000","last_clean":"2023-07-09T21:41:23.411032+0000","last_became_active":"2023-07-09T21:41:23.408239+0000","last_became_peered":"2023-07-09T21:41:23.408239+0000","last_unstale":"2023-07-09T21:41:23.411032+0000","last_undegraded":"2023-07-09T21:41:23.411032+0000","last_fullsized":"2023-07-09T21:41:23.411032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:50.328513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396486+0000","last_change":"2023-07-09T21:41:23.396486+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396486+0000","last_undegraded":"2023-07-09T21:41:23.396486+0000","last_fullsized":"2023-07-09T21:41:23.396486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410941+0000","last_change":"2023-07-09T21:41:23.406811+0000","last_active":"2023-07-09T21:41:23.410941+0000","last_peered":"2023-07-09T21:41:23.410941+0000","last_clean":"2023-07-09T21:41:23.410941+0000","last_became_active":"2023-07-09T21:41:23.406502+0000","last_became_peered":"2023-07-09T21:41:23.406502+0000","last_unstale":"2023-07-09T21:41:23.410941+0000","last_undegraded":"2023-07-09T21:41:23.410941+0000","last_fullsized":"2023-07-09T21:41:23.410941+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:01.324915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'227","reported_seq":754,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401859+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:41:23.401859+0000","last_peered":"2023-07-09T21:41:23.401859+0000","last_clean":"2023-07-09T21:41:23.401859+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:41:23.401859+0000","last_undegraded":"2023-07-09T21:41:23.401859+0000","last_fullsized":"2023-07-09T21:41:23.401859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:20.016490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400386+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:41:23.400386+0000","last_peered":"2023-07-09T21:41:23.400386+0000","last_clean":"2023-07-09T21:41:23.400386+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:41:23.400386+0000","last_undegraded":"2023-07-09T21:41:23.400386+0000","last_fullsized":"2023-07-09T21:41:23.400386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:16:17.388174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395655+0000","last_change":"2023-07-09T21:41:23.395655+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395655+0000","last_undegraded":"2023-07-09T21:41:23.395655+0000","last_fullsized":"2023-07-09T21:41:23.395655+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415080+0000","last_change":"2023-07-09T21:41:23.412162+0000","last_active":"2023-07-09T21:41:23.415080+0000","last_peered":"2023-07-09T21:41:23.415080+0000","last_clean":"2023-07-09T21:41:23.415080+0000","last_became_active":"2023-07-09T21:41:23.411859+0000","last_became_peered":"2023-07-09T21:41:23.411859+0000","last_unstale":"2023-07-09T21:41:23.415080+0000","last_undegraded":"2023-07-09T21:41:23.415080+0000","last_fullsized":"2023-07-09T21:41:23.415080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:44.900575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401730+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:41:23.401730+0000","last_peered":"2023-07-09T21:41:23.401730+0000","last_clean":"2023-07-09T21:41:23.401730+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:41:23.401730+0000","last_undegraded":"2023-07-09T21:41:23.401730+0000","last_fullsized":"2023-07-09T21:41:23.401730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:44:49.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392010+0000","last_change":"2023-07-09T21:41:23.392010+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392010+0000","last_undegraded":"2023-07-09T21:41:23.392010+0000","last_fullsized":"2023-07-09T21:41:23.392010+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411348+0000","last_change":"2023-07-09T21:41:23.409499+0000","last_active":"2023-07-09T21:41:23.411348+0000","last_peered":"2023-07-09T21:41:23.411348+0000","last_clean":"2023-07-09T21:41:23.411348+0000","last_became_active":"2023-07-09T21:41:23.408924+0000","last_became_peered":"2023-07-09T21:41:23.408924+0000","last_unstale":"2023-07-09T21:41:23.411348+0000","last_undegraded":"2023-07-09T21:41:23.411348+0000","last_fullsized":"2023-07-09T21:41:23.411348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:22:12.027616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400332+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:41:23.400332+0000","last_peered":"2023-07-09T21:41:23.400332+0000","last_clean":"2023-07-09T21:41:23.400332+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:41:23.400332+0000","last_undegraded":"2023-07-09T21:41:23.400332+0000","last_fullsized":"2023-07-09T21:41:23.400332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:38.969759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394653+0000","last_change":"2023-07-09T21:41:23.394653+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394653+0000","last_undegraded":"2023-07-09T21:41:23.394653+0000","last_fullsized":"2023-07-09T21:41:23.394653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414557+0000","last_change":"2023-07-09T21:41:23.402034+0000","last_active":"2023-07-09T21:41:23.414557+0000","last_peered":"2023-07-09T21:41:23.414557+0000","last_clean":"2023-07-09T21:41:23.414557+0000","last_became_active":"2023-07-09T21:41:23.401726+0000","last_became_peered":"2023-07-09T21:41:23.401726+0000","last_unstale":"2023-07-09T21:41:23.414557+0000","last_undegraded":"2023-07-09T21:41:23.414557+0000","last_fullsized":"2023-07-09T21:41:23.414557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:37.771995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.397277+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:41:23.397277+0000","last_peered":"2023-07-09T21:41:23.397277+0000","last_clean":"2023-07-09T21:41:23.397277+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:41:23.397277+0000","last_undegraded":"2023-07-09T21:41:23.397277+0000","last_fullsized":"2023-07-09T21:41:23.397277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:04:07.544481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391224+0000","last_change":"2023-07-09T21:41:23.391224+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391224+0000","last_undegraded":"2023-07-09T21:41:23.391224+0000","last_fullsized":"2023-07-09T21:41:23.391224+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414270+0000","last_change":"2023-07-09T21:41:23.404513+0000","last_active":"2023-07-09T21:41:23.414270+0000","last_peered":"2023-07-09T21:41:23.414270+0000","last_clean":"2023-07-09T21:41:23.414270+0000","last_became_active":"2023-07-09T21:41:23.404196+0000","last_became_peered":"2023-07-09T21:41:23.404196+0000","last_unstale":"2023-07-09T21:41:23.414270+0000","last_undegraded":"2023-07-09T21:41:23.414270+0000","last_fullsized":"2023-07-09T21:41:23.414270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:59.010537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.393661+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:41:23.393661+0000","last_peered":"2023-07-09T21:41:23.393661+0000","last_clean":"2023-07-09T21:41:23.393661+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:41:23.393661+0000","last_undegraded":"2023-07-09T21:41:23.393661+0000","last_fullsized":"2023-07-09T21:41:23.393661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:00:05.074280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390208+0000","last_change":"2023-07-09T21:41:23.390208+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390208+0000","last_undegraded":"2023-07-09T21:41:23.390208+0000","last_fullsized":"2023-07-09T21:41:23.390208+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407166+0000","last_change":"2023-07-09T21:41:23.403900+0000","last_active":"2023-07-09T21:41:23.407166+0000","last_peered":"2023-07-09T21:41:23.407166+0000","last_clean":"2023-07-09T21:41:23.407166+0000","last_became_active":"2023-07-09T21:41:23.403592+0000","last_became_peered":"2023-07-09T21:41:23.403592+0000","last_unstale":"2023-07-09T21:41:23.407166+0000","last_undegraded":"2023-07-09T21:41:23.407166+0000","last_fullsized":"2023-07-09T21:41:23.407166+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:30.515338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":207,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.402198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:41:23.402198+0000","last_peered":"2023-07-09T21:41:23.402198+0000","last_clean":"2023-07-09T21:41:23.402198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:41:23.402198+0000","last_undegraded":"2023-07-09T21:41:23.402198+0000","last_fullsized":"2023-07-09T21:41:23.402198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392402+0000","last_change":"2023-07-09T21:41:23.392402+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392402+0000","last_undegraded":"2023-07-09T21:41:23.392402+0000","last_fullsized":"2023-07-09T21:41:23.392402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.403314+0000","last_change":"2023-07-09T21:41:23.401278+0000","last_active":"2023-07-09T21:41:23.403314+0000","last_peered":"2023-07-09T21:41:23.403314+0000","last_clean":"2023-07-09T21:41:23.403314+0000","last_became_active":"2023-07-09T21:41:23.400772+0000","last_became_peered":"2023-07-09T21:41:23.400772+0000","last_unstale":"2023-07-09T21:41:23.403314+0000","last_undegraded":"2023-07-09T21:41:23.403314+0000","last_fullsized":"2023-07-09T21:41:23.403314+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:29.997922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":199,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.391509+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:41:23.391509+0000","last_peered":"2023-07-09T21:41:23.391509+0000","last_clean":"2023-07-09T21:41:23.391509+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:41:23.391509+0000","last_undegraded":"2023-07-09T21:41:23.391509+0000","last_fullsized":"2023-07-09T21:41:23.391509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:36.931898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392389+0000","last_change":"2023-07-09T21:41:23.392389+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392389+0000","last_undegraded":"2023-07-09T21:41:23.392389+0000","last_fullsized":"2023-07-09T21:41:23.392389+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407194+0000","last_change":"2023-07-09T21:41:23.404279+0000","last_active":"2023-07-09T21:41:23.407194+0000","last_peered":"2023-07-09T21:41:23.407194+0000","last_clean":"2023-07-09T21:41:23.407194+0000","last_became_active":"2023-07-09T21:41:23.403598+0000","last_became_peered":"2023-07-09T21:41:23.403598+0000","last_unstale":"2023-07-09T21:41:23.407194+0000","last_undegraded":"2023-07-09T21:41:23.407194+0000","last_fullsized":"2023-07-09T21:41:23.407194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:36:22.583138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.394201+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:41:23.394201+0000","last_peered":"2023-07-09T21:41:23.394201+0000","last_clean":"2023-07-09T21:41:23.394201+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:41:23.394201+0000","last_undegraded":"2023-07-09T21:41:23.394201+0000","last_fullsized":"2023-07-09T21:41:23.394201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:22:33.817131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59400,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312440,"statfs":{"total":96636764160,"available":96575938560,"internally_reserved":0,"allocated":2162688,"data_stored":1385349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.59599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0249999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.97799999999999998,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0600000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.34699999999999998},"max":{"1min":0.998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.745,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.754,"15min":1.754},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1140000000000001,"5min":1.129,"15min":1.129},"last":0.88200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.89900000000000002,"5min":1.232,"15min":1.232},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.95399999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94999999999999996,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":1.0149999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98199999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.012,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.68999999999999995,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":6.101,"15min":6.101},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71999999999999997,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":1.252,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.65200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.80500000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.69199999999999995},"min":{"1min":0.55000000000000004,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.71999999999999997},"min":{"1min":0.54500000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.014,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50628,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.98799999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69199999999999995,"15min":0.71099999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.02},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.51100000000000001},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92300000000000004,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.33200000000000002},"max":{"1min":0.96299999999999997,"5min":1.083,"15min":1.083},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":1.0249999999999999,"15min":1.038},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.107,"15min":1.107},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.35299999999999998},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.97699999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94699999999999995},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90500000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91200000000000003,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.62}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86599999999999999,"5min":1.002,"15min":1.26},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.05},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":1.024,"15min":1.024},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.83599999999999997,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0569999999999999,"15min":1.0629999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.878,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.871},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.95899999999999996,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575075,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29399999999999998},"max":{"1min":0.70899999999999996,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.3320000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2689999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0649999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0409999999999999,"15min":1.208},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":0.997,"5min":1.51,"15min":1.51},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.46800000000000003},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.159},"last":0.624},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1910000000000001},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317116,"statfs":{"total":96636764160,"available":96580726784,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.0229999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.7050000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":1.145,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.62,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2989999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.50700000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.377,"15min":1.377},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.54200000000000004,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":1.262,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.83399999999999996},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":1.3400000000000001,"5min":1.423,"15min":1.423},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.163,"5min":1.48,"15min":1.48},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.84299999999999997},"min":{"1min":0.64400000000000002,"5min":0.53800000000000003,"15min":0.46100000000000002},"max":{"1min":1.3999999999999999,"5min":1.496,"15min":1.496},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.871},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.64800000000000002,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.501}]},{"osd":2,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.76100000000000001,"15min":1.5129999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":1.129,"15min":1.3069999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.274},"last":0.84499999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.351},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.242},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.206},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.46600000000000003},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80000000000000004},"min":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.173},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.65900000000000003,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37244,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":2150400,"data_stored":1378721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":0.68799999999999994,"15min":0.753},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":1.657,"15min":1.657},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66500000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.1080000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.749},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.42299999999999999},"max":{"1min":0.95899999999999996,"5min":1.835,"15min":1.835},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.726,"15min":1.726},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.615,"15min":1.615},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0409999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81100000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.0860000000000001,"5min":1.883,"15min":1.883},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:41:28.561 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:41:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 Processor -- start 2023-07-09T21:41:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 -- start start 2023-07-09T21:41:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cc80cef80 0x7f5cc806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc80b49f0 con 0x7f5cc80b4340 2023-07-09T21:41:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc80cc8a0 con 0x7f5cc80b7ab0 2023-07-09T21:41:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cd045c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc80b7e80 con 0x7f5cc80cef80 2023-07-09T21:41:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5ccd9f7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cc80b4340 0x7f5cc80d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37918/0 (socket says 172.21.15.37:37918) 2023-07-09T21:41:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5cce9f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cc80cef80 0x7f5cc806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.705+0000 7f5ccd9f7640 1 -- 172.21.15.37:0/1566893163 learned_addr learned my addr 172.21.15.37:0/1566893163 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cce9f9640 1 -- 172.21.15.37:0/1566893163 >> v1:172.21.15.119:6789/0 conn(0x7f5cc80b7ab0 legacy=0x7f5cc80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cce9f9640 1 -- 172.21.15.37:0/1566893163 >> v1:172.21.15.37:6789/0 conn(0x7f5cc80b4340 legacy=0x7f5cc80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cce9f9640 1 -- 172.21.15.37:0/1566893163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc80ccb80 con 0x7f5cc80cef80 2023-07-09T21:41:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5ccd1f6640 1 -- 172.21.15.37:0/1566893163 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036975785 0 0) 0x7f5cc80b49f0 con 0x7f5cc80b4340 2023-07-09T21:41:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cce9f9640 1 --2- 172.21.15.37:0/1566893163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc806aa50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009d90 tx=0x7f5cc001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5428ba7cab34fa69 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5ccd1f6640 1 -- 172.21.15.37:0/1566893163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00a59a0 con 0x7f5cc80cef80 2023-07-09T21:41:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5ccd1f6640 1 -- 172.21.15.37:0/1566893163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00a5b00 con 0x7f5cc80cef80 2023-07-09T21:41:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5ccd1f6640 1 -- 172.21.15.37:0/1566893163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00a5e90 con 0x7f5cc80cef80 2023-07-09T21:41:28.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cd045c640 1 -- 172.21.15.37:0/1566893163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 msgr2=0x7f5cc806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.709+0000 7f5cd045c640 1 --2- 172.21.15.37:0/1566893163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc806aa50 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009d90 tx=0x7f5cc001c8e0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- 172.21.15.37:0/1566893163 shutdown_connections 2023-07-09T21:41:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 --2- 172.21.15.37:0/1566893163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc806aa50 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- 172.21.15.37:0/1566893163 >> 172.21.15.37:0/1566893163 conn(0x7f5cc8073090 msgr2=0x7f5cc8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- 172.21.15.37:0/1566893163 shutdown_connections 2023-07-09T21:41:28.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- 172.21.15.37:0/1566893163 wait complete. 2023-07-09T21:41:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 Processor -- start 2023-07-09T21:41:28.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- start start 2023-07-09T21:41:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cc80b4340 0x7f5cc8146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cc80b7ab0 0x7f5cc80cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc8155260 con 0x7f5cc80cef80 2023-07-09T21:41:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc81470a0 con 0x7f5cc80b7ab0 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cd045c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc80cb840 con 0x7f5cc80b4340 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38706/0 (socket says 172.21.15.37:38706) 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 -- 172.21.15.37:0/2819183122 learned_addr learned my addr 172.21.15.37:0/2819183122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce1f8640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cc80b4340 0x7f5cc8146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5ccd9f7640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cc80b7ab0 0x7f5cc80cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 -- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cc80b4340 msgr2=0x7f5cc8146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cc80b4340 0x7f5cc8146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 -- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cc80b7ab0 msgr2=0x7f5cc80cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cc80b7ab0 0x7f5cc80cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 -- 172.21.15.37:0/2819183122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc0009a70 con 0x7f5cc80cef80 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.713+0000 7f5cce9f9640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00194f0 tx=0x7f5cc0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0009450 con 0x7f5cc80cef80 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00adca0 con 0x7f5cc80cef80 2023-07-09T21:41:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00b8620 con 0x7f5cc80cef80 2023-07-09T21:41:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc8154930 con 0x7f5cc80cef80 2023-07-09T21:41:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc8154ef0 con 0x7f5cc80cef80 2023-07-09T21:41:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc81553d0 con 0x7f5cc80cef80 2023-07-09T21:41:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cc00b8780 con 0x7f5cc80cef80 2023-07-09T21:41:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 0x7f5cac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5cc011f640 con 0x7f5cc80cef80 2023-07-09T21:41:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.717+0000 7f5cce1f8640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 0x7f5cac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.721+0000 7f5cce1f8640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 0x7f5cac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4004e30 tx=0x7f5cc4009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.721+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cc00ec910 con 0x7f5cc80cef80 2023-07-09T21:41:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.873+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5cc80cf4d0 con 0x7f5cac0663a0 2023-07-09T21:41:28.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.881+0000 7f5cbeffd640 1 -- 172.21.15.37:0/2819183122 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306782 (secure 0 0 0) 0x7f5cc40053b0 con 0x7f5cac0663a0 2023-07-09T21:41:28.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:41:28.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 msgr2=0x7f5cac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 0x7f5cac068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4004e30 tx=0x7f5cc4009040 comp rx=0 tx=0).stop 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 msgr2=0x7f5cc8153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00194f0 tx=0x7f5cc0019680 comp rx=0 tx=0).stop 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 shutdown_connections 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5cac0663a0 0x7f5cac068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cc80cef80 0x7f5cc8153c70 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5cc80b7ab0 0x7f5cc80cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 --2- 172.21.15.37:0/2819183122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5cc80b4340 0x7f5cc8146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 >> 172.21.15.37:0/2819183122 conn(0x7f5cc8073090 msgr2=0x7f5cc806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 shutdown_connections 2023-07-09T21:41:28.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:28.885+0000 7f5cd045c640 1 -- 172.21.15.37:0/2819183122 wait complete. 2023-07-09T21:41:28.902 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:41:28.037275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332316,"kb_used_data":13404,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642404,"statfs":{"total":773094113280,"available":772753821696,"internally_reserved":0,"allocated":13725696,"data_stored":7533956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.655311"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391503+0000","last_change":"2023-07-09T21:41:23.391503+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391503+0000","last_undegraded":"2023-07-09T21:41:23.391503+0000","last_fullsized":"2023-07-09T21:41:23.391503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396864+0000","last_change":"2023-07-09T21:41:23.396864+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396864+0000","last_undegraded":"2023-07-09T21:41:23.396864+0000","last_fullsized":"2023-07-09T21:41:23.396864+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393411+0000","last_change":"2023-07-09T21:41:23.393411+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393411+0000","last_undegraded":"2023-07-09T21:41:23.393411+0000","last_fullsized":"2023-07-09T21:41:23.393411+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392697+0000","last_change":"2023-07-09T21:41:23.392697+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392697+0000","last_undegraded":"2023-07-09T21:41:23.392697+0000","last_fullsized":"2023-07-09T21:41:23.392697+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392441+0000","last_change":"2023-07-09T21:41:23.392441+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392441+0000","last_undegraded":"2023-07-09T21:41:23.392441+0000","last_fullsized":"2023-07-09T21:41:23.392441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396279+0000","last_change":"2023-07-09T21:41:23.396279+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396279+0000","last_undegraded":"2023-07-09T21:41:23.396279+0000","last_fullsized":"2023-07-09T21:41:23.396279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398125+0000","last_change":"2023-07-09T21:41:23.398125+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398125+0000","last_undegraded":"2023-07-09T21:41:23.398125+0000","last_fullsized":"2023-07-09T21:41:23.398125+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396273+0000","last_change":"2023-07-09T21:41:23.396273+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396273+0000","last_undegraded":"2023-07-09T21:41:23.396273+0000","last_fullsized":"2023-07-09T21:41:23.396273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396877+0000","last_change":"2023-07-09T21:41:23.396877+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396877+0000","last_undegraded":"2023-07-09T21:41:23.396877+0000","last_fullsized":"2023-07-09T21:41:23.396877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391148+0000","last_change":"2023-07-09T21:41:23.391148+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391148+0000","last_undegraded":"2023-07-09T21:41:23.391148+0000","last_fullsized":"2023-07-09T21:41:23.391148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397954+0000","last_change":"2023-07-09T21:41:23.397954+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397954+0000","last_undegraded":"2023-07-09T21:41:23.397954+0000","last_fullsized":"2023-07-09T21:41:23.397954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394287+0000","last_change":"2023-07-09T21:41:23.394287+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394287+0000","last_undegraded":"2023-07-09T21:41:23.394287+0000","last_fullsized":"2023-07-09T21:41:23.394287+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389014+0000","last_change":"2023-07-09T21:41:23.389014+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389014+0000","last_undegraded":"2023-07-09T21:41:23.389014+0000","last_fullsized":"2023-07-09T21:41:23.389014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.403654+0000","last_change":"2023-07-09T21:41:23.403654+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.403654+0000","last_undegraded":"2023-07-09T21:41:23.403654+0000","last_fullsized":"2023-07-09T21:41:23.403654+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400504+0000","last_change":"2023-07-09T21:41:23.400504+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400504+0000","last_undegraded":"2023-07-09T21:41:23.400504+0000","last_fullsized":"2023-07-09T21:41:23.400504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.401336+0000","last_change":"2023-07-09T21:41:23.401336+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.401336+0000","last_undegraded":"2023-07-09T21:41:23.401336+0000","last_fullsized":"2023-07-09T21:41:23.401336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391110+0000","last_change":"2023-07-09T21:41:23.391110+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391110+0000","last_undegraded":"2023-07-09T21:41:23.391110+0000","last_fullsized":"2023-07-09T21:41:23.391110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396385+0000","last_change":"2023-07-09T21:41:23.396385+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396385+0000","last_undegraded":"2023-07-09T21:41:23.396385+0000","last_fullsized":"2023-07-09T21:41:23.396385+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392980+0000","last_change":"2023-07-09T21:41:23.392980+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392980+0000","last_undegraded":"2023-07-09T21:41:23.392980+0000","last_fullsized":"2023-07-09T21:41:23.392980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393625+0000","last_change":"2023-07-09T21:41:23.393625+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393625+0000","last_undegraded":"2023-07-09T21:41:23.393625+0000","last_fullsized":"2023-07-09T21:41:23.393625+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398769+0000","last_change":"2023-07-09T21:41:23.398769+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398769+0000","last_undegraded":"2023-07-09T21:41:23.398769+0000","last_fullsized":"2023-07-09T21:41:23.398769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391682+0000","last_change":"2023-07-09T21:41:23.391682+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391682+0000","last_undegraded":"2023-07-09T21:41:23.391682+0000","last_fullsized":"2023-07-09T21:41:23.391682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390312+0000","last_change":"2023-07-09T21:41:23.390312+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390312+0000","last_undegraded":"2023-07-09T21:41:23.390312+0000","last_fullsized":"2023-07-09T21:41:23.390312+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391809+0000","last_change":"2023-07-09T21:41:23.391809+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391809+0000","last_undegraded":"2023-07-09T21:41:23.391809+0000","last_fullsized":"2023-07-09T21:41:23.391809+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395829+0000","last_change":"2023-07-09T21:41:23.395829+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395829+0000","last_undegraded":"2023-07-09T21:41:23.395829+0000","last_fullsized":"2023-07-09T21:41:23.395829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395216+0000","last_change":"2023-07-09T21:41:23.395216+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395216+0000","last_undegraded":"2023-07-09T21:41:23.395216+0000","last_fullsized":"2023-07-09T21:41:23.395216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397472+0000","last_change":"2023-07-09T21:41:23.397472+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397472+0000","last_undegraded":"2023-07-09T21:41:23.397472+0000","last_fullsized":"2023-07-09T21:41:23.397472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395816+0000","last_change":"2023-07-09T21:41:23.395816+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395816+0000","last_undegraded":"2023-07-09T21:41:23.395816+0000","last_fullsized":"2023-07-09T21:41:23.395816+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389429+0000","last_change":"2023-07-09T21:41:23.389429+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389429+0000","last_undegraded":"2023-07-09T21:41:23.389429+0000","last_fullsized":"2023-07-09T21:41:23.389429+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395295+0000","last_change":"2023-07-09T21:41:23.395295+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395295+0000","last_undegraded":"2023-07-09T21:41:23.395295+0000","last_fullsized":"2023-07-09T21:41:23.395295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396491+0000","last_change":"2023-07-09T21:41:23.396491+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396491+0000","last_undegraded":"2023-07-09T21:41:23.396491+0000","last_fullsized":"2023-07-09T21:41:23.396491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395835+0000","last_change":"2023-07-09T21:41:23.395835+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395835+0000","last_undegraded":"2023-07-09T21:41:23.395835+0000","last_fullsized":"2023-07-09T21:41:23.395835+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389107+0000","last_change":"2023-07-09T21:41:23.389107+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389107+0000","last_undegraded":"2023-07-09T21:41:23.389107+0000","last_fullsized":"2023-07-09T21:41:23.389107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412979+0000","last_change":"2023-07-09T21:41:23.410170+0000","last_active":"2023-07-09T21:41:23.412979+0000","last_peered":"2023-07-09T21:41:23.412979+0000","last_clean":"2023-07-09T21:41:23.412979+0000","last_became_active":"2023-07-09T21:41:23.409871+0000","last_became_peered":"2023-07-09T21:41:23.409871+0000","last_unstale":"2023-07-09T21:41:23.412979+0000","last_undegraded":"2023-07-09T21:41:23.412979+0000","last_fullsized":"2023-07-09T21:41:23.412979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:37:19.570097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389527+0000","last_change":"2023-07-09T21:41:23.389527+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389527+0000","last_undegraded":"2023-07-09T21:41:23.389527+0000","last_fullsized":"2023-07-09T21:41:23.389527+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409869+0000","last_change":"2023-07-09T21:41:23.406204+0000","last_active":"2023-07-09T21:41:23.409869+0000","last_peered":"2023-07-09T21:41:23.409869+0000","last_clean":"2023-07-09T21:41:23.409869+0000","last_became_active":"2023-07-09T21:41:23.405916+0000","last_became_peered":"2023-07-09T21:41:23.405916+0000","last_unstale":"2023-07-09T21:41:23.409869+0000","last_undegraded":"2023-07-09T21:41:23.409869+0000","last_fullsized":"2023-07-09T21:41:23.409869+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:06.973837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394778+0000","last_change":"2023-07-09T21:41:23.394778+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394778+0000","last_undegraded":"2023-07-09T21:41:23.394778+0000","last_fullsized":"2023-07-09T21:41:23.394778+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413257+0000","last_change":"2023-07-09T21:41:23.409832+0000","last_active":"2023-07-09T21:41:23.413257+0000","last_peered":"2023-07-09T21:41:23.413257+0000","last_clean":"2023-07-09T21:41:23.413257+0000","last_became_active":"2023-07-09T21:41:23.409503+0000","last_became_peered":"2023-07-09T21:41:23.409503+0000","last_unstale":"2023-07-09T21:41:23.413257+0000","last_undegraded":"2023-07-09T21:41:23.413257+0000","last_fullsized":"2023-07-09T21:41:23.413257+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:19.850905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397311+0000","last_change":"2023-07-09T21:41:23.397311+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397311+0000","last_undegraded":"2023-07-09T21:41:23.397311+0000","last_fullsized":"2023-07-09T21:41:23.397311+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409352+0000","last_change":"2023-07-09T21:41:23.408440+0000","last_active":"2023-07-09T21:41:23.409352+0000","last_peered":"2023-07-09T21:41:23.409352+0000","last_clean":"2023-07-09T21:41:23.409352+0000","last_became_active":"2023-07-09T21:41:23.408100+0000","last_became_peered":"2023-07-09T21:41:23.408100+0000","last_unstale":"2023-07-09T21:41:23.409352+0000","last_undegraded":"2023-07-09T21:41:23.409352+0000","last_fullsized":"2023-07-09T21:41:23.409352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:13.089114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390712+0000","last_change":"2023-07-09T21:41:23.390712+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390712+0000","last_undegraded":"2023-07-09T21:41:23.390712+0000","last_fullsized":"2023-07-09T21:41:23.390712+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.416455+0000","last_change":"2023-07-09T21:41:23.415349+0000","last_active":"2023-07-09T21:41:23.416455+0000","last_peered":"2023-07-09T21:41:23.416455+0000","last_clean":"2023-07-09T21:41:23.416455+0000","last_became_active":"2023-07-09T21:41:23.415046+0000","last_became_peered":"2023-07-09T21:41:23.415046+0000","last_unstale":"2023-07-09T21:41:23.416455+0000","last_undegraded":"2023-07-09T21:41:23.416455+0000","last_fullsized":"2023-07-09T21:41:23.416455+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:39.023152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391939+0000","last_change":"2023-07-09T21:41:23.391939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391939+0000","last_undegraded":"2023-07-09T21:41:23.391939+0000","last_fullsized":"2023-07-09T21:41:23.391939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410090+0000","last_change":"2023-07-09T21:41:23.408634+0000","last_active":"2023-07-09T21:41:23.410090+0000","last_peered":"2023-07-09T21:41:23.410090+0000","last_clean":"2023-07-09T21:41:23.410090+0000","last_became_active":"2023-07-09T21:41:23.408353+0000","last_became_peered":"2023-07-09T21:41:23.408353+0000","last_unstale":"2023-07-09T21:41:23.410090+0000","last_undegraded":"2023-07-09T21:41:23.410090+0000","last_fullsized":"2023-07-09T21:41:23.410090+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:20.650730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395939+0000","last_change":"2023-07-09T21:41:23.395939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395939+0000","last_undegraded":"2023-07-09T21:41:23.395939+0000","last_fullsized":"2023-07-09T21:41:23.395939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414915+0000","last_change":"2023-07-09T21:41:23.411059+0000","last_active":"2023-07-09T21:41:23.414915+0000","last_peered":"2023-07-09T21:41:23.414915+0000","last_clean":"2023-07-09T21:41:23.414915+0000","last_became_active":"2023-07-09T21:41:23.410779+0000","last_became_peered":"2023-07-09T21:41:23.410779+0000","last_unstale":"2023-07-09T21:41:23.414915+0000","last_undegraded":"2023-07-09T21:41:23.414915+0000","last_fullsized":"2023-07-09T21:41:23.414915+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:55.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390184+0000","last_change":"2023-07-09T21:41:23.390184+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390184+0000","last_undegraded":"2023-07-09T21:41:23.390184+0000","last_fullsized":"2023-07-09T21:41:23.390184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407004+0000","last_change":"2023-07-09T21:41:23.400312+0000","last_active":"2023-07-09T21:41:23.407004+0000","last_peered":"2023-07-09T21:41:23.407004+0000","last_clean":"2023-07-09T21:41:23.407004+0000","last_became_active":"2023-07-09T21:41:23.400038+0000","last_became_peered":"2023-07-09T21:41:23.400038+0000","last_unstale":"2023-07-09T21:41:23.407004+0000","last_undegraded":"2023-07-09T21:41:23.407004+0000","last_fullsized":"2023-07-09T21:41:23.407004+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:16.171313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389722+0000","last_change":"2023-07-09T21:41:23.389722+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389722+0000","last_undegraded":"2023-07-09T21:41:23.389722+0000","last_fullsized":"2023-07-09T21:41:23.389722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414900+0000","last_change":"2023-07-09T21:41:23.410925+0000","last_active":"2023-07-09T21:41:23.414900+0000","last_peered":"2023-07-09T21:41:23.414900+0000","last_clean":"2023-07-09T21:41:23.414900+0000","last_became_active":"2023-07-09T21:41:23.410630+0000","last_became_peered":"2023-07-09T21:41:23.410630+0000","last_unstale":"2023-07-09T21:41:23.414900+0000","last_undegraded":"2023-07-09T21:41:23.414900+0000","last_fullsized":"2023-07-09T21:41:23.414900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:12.575978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393270+0000","last_change":"2023-07-09T21:41:23.393270+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393270+0000","last_undegraded":"2023-07-09T21:41:23.393270+0000","last_fullsized":"2023-07-09T21:41:23.393270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409419+0000","last_change":"2023-07-09T21:41:23.406825+0000","last_active":"2023-07-09T21:41:23.409419+0000","last_peered":"2023-07-09T21:41:23.409419+0000","last_clean":"2023-07-09T21:41:23.409419+0000","last_became_active":"2023-07-09T21:41:23.406551+0000","last_became_peered":"2023-07-09T21:41:23.406551+0000","last_unstale":"2023-07-09T21:41:23.409419+0000","last_undegraded":"2023-07-09T21:41:23.409419+0000","last_fullsized":"2023-07-09T21:41:23.409419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:39.659592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389013+0000","last_change":"2023-07-09T21:41:23.389013+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389013+0000","last_undegraded":"2023-07-09T21:41:23.389013+0000","last_fullsized":"2023-07-09T21:41:23.389013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412269+0000","last_change":"2023-07-09T21:41:23.410301+0000","last_active":"2023-07-09T21:41:23.412269+0000","last_peered":"2023-07-09T21:41:23.412269+0000","last_clean":"2023-07-09T21:41:23.412269+0000","last_became_active":"2023-07-09T21:41:23.410015+0000","last_became_peered":"2023-07-09T21:41:23.410015+0000","last_unstale":"2023-07-09T21:41:23.412269+0000","last_undegraded":"2023-07-09T21:41:23.412269+0000","last_fullsized":"2023-07-09T21:41:23.412269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:33.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391533+0000","last_change":"2023-07-09T21:41:23.391533+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391533+0000","last_undegraded":"2023-07-09T21:41:23.391533+0000","last_fullsized":"2023-07-09T21:41:23.391533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414456+0000","last_change":"2023-07-09T21:41:23.405581+0000","last_active":"2023-07-09T21:41:23.414456+0000","last_peered":"2023-07-09T21:41:23.414456+0000","last_clean":"2023-07-09T21:41:23.414456+0000","last_became_active":"2023-07-09T21:41:23.405276+0000","last_became_peered":"2023-07-09T21:41:23.405276+0000","last_unstale":"2023-07-09T21:41:23.414456+0000","last_undegraded":"2023-07-09T21:41:23.414456+0000","last_fullsized":"2023-07-09T21:41:23.414456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:30.319720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397436+0000","last_change":"2023-07-09T21:41:23.397436+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397436+0000","last_undegraded":"2023-07-09T21:41:23.397436+0000","last_fullsized":"2023-07-09T21:41:23.397436+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405385+0000","last_change":"2023-07-09T21:41:23.404033+0000","last_active":"2023-07-09T21:41:23.405385+0000","last_peered":"2023-07-09T21:41:23.405385+0000","last_clean":"2023-07-09T21:41:23.405385+0000","last_became_active":"2023-07-09T21:41:23.403730+0000","last_became_peered":"2023-07-09T21:41:23.403730+0000","last_unstale":"2023-07-09T21:41:23.405385+0000","last_undegraded":"2023-07-09T21:41:23.405385+0000","last_fullsized":"2023-07-09T21:41:23.405385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:15.939862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395930+0000","last_change":"2023-07-09T21:41:23.395930+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395930+0000","last_undegraded":"2023-07-09T21:41:23.395930+0000","last_fullsized":"2023-07-09T21:41:23.395930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409618+0000","last_change":"2023-07-09T21:41:23.402616+0000","last_active":"2023-07-09T21:41:23.409618+0000","last_peered":"2023-07-09T21:41:23.409618+0000","last_clean":"2023-07-09T21:41:23.409618+0000","last_became_active":"2023-07-09T21:41:23.402350+0000","last_became_peered":"2023-07-09T21:41:23.402350+0000","last_unstale":"2023-07-09T21:41:23.409618+0000","last_undegraded":"2023-07-09T21:41:23.409618+0000","last_fullsized":"2023-07-09T21:41:23.409618+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:28.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398030+0000","last_change":"2023-07-09T21:41:23.398030+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398030+0000","last_undegraded":"2023-07-09T21:41:23.398030+0000","last_fullsized":"2023-07-09T21:41:23.398030+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411058+0000","last_change":"2023-07-09T21:41:23.408629+0000","last_active":"2023-07-09T21:41:23.411058+0000","last_peered":"2023-07-09T21:41:23.411058+0000","last_clean":"2023-07-09T21:41:23.411058+0000","last_became_active":"2023-07-09T21:41:23.408327+0000","last_became_peered":"2023-07-09T21:41:23.408327+0000","last_unstale":"2023-07-09T21:41:23.411058+0000","last_undegraded":"2023-07-09T21:41:23.411058+0000","last_fullsized":"2023-07-09T21:41:23.411058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:23:51.485002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390717+0000","last_change":"2023-07-09T21:41:23.390717+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390717+0000","last_undegraded":"2023-07-09T21:41:23.390717+0000","last_fullsized":"2023-07-09T21:41:23.390717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413501+0000","last_change":"2023-07-09T21:41:23.409766+0000","last_active":"2023-07-09T21:41:23.413501+0000","last_peered":"2023-07-09T21:41:23.413501+0000","last_clean":"2023-07-09T21:41:23.413501+0000","last_became_active":"2023-07-09T21:41:23.409466+0000","last_became_peered":"2023-07-09T21:41:23.409466+0000","last_unstale":"2023-07-09T21:41:23.413501+0000","last_undegraded":"2023-07-09T21:41:23.413501+0000","last_fullsized":"2023-07-09T21:41:23.413501+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:17.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390168+0000","last_change":"2023-07-09T21:41:23.390168+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390168+0000","last_undegraded":"2023-07-09T21:41:23.390168+0000","last_fullsized":"2023-07-09T21:41:23.390168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405348+0000","last_change":"2023-07-09T21:41:23.403988+0000","last_active":"2023-07-09T21:41:23.405348+0000","last_peered":"2023-07-09T21:41:23.405348+0000","last_clean":"2023-07-09T21:41:23.405348+0000","last_became_active":"2023-07-09T21:41:23.403716+0000","last_became_peered":"2023-07-09T21:41:23.403716+0000","last_unstale":"2023-07-09T21:41:23.405348+0000","last_undegraded":"2023-07-09T21:41:23.405348+0000","last_fullsized":"2023-07-09T21:41:23.405348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:42.887152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394438+0000","last_change":"2023-07-09T21:41:23.394438+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394438+0000","last_undegraded":"2023-07-09T21:41:23.394438+0000","last_fullsized":"2023-07-09T21:41:23.394438+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407148+0000","last_change":"2023-07-09T21:41:23.405390+0000","last_active":"2023-07-09T21:41:23.407148+0000","last_peered":"2023-07-09T21:41:23.407148+0000","last_clean":"2023-07-09T21:41:23.407148+0000","last_became_active":"2023-07-09T21:41:23.405110+0000","last_became_peered":"2023-07-09T21:41:23.405110+0000","last_unstale":"2023-07-09T21:41:23.407148+0000","last_undegraded":"2023-07-09T21:41:23.407148+0000","last_fullsized":"2023-07-09T21:41:23.407148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:41.859320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390950+0000","last_change":"2023-07-09T21:41:23.390950+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390950+0000","last_undegraded":"2023-07-09T21:41:23.390950+0000","last_fullsized":"2023-07-09T21:41:23.390950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415826+0000","last_change":"2023-07-09T21:41:23.409226+0000","last_active":"2023-07-09T21:41:23.415826+0000","last_peered":"2023-07-09T21:41:23.415826+0000","last_clean":"2023-07-09T21:41:23.415826+0000","last_became_active":"2023-07-09T21:41:23.408915+0000","last_became_peered":"2023-07-09T21:41:23.408915+0000","last_unstale":"2023-07-09T21:41:23.415826+0000","last_undegraded":"2023-07-09T21:41:23.415826+0000","last_fullsized":"2023-07-09T21:41:23.415826+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:53.751852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397752+0000","last_change":"2023-07-09T21:41:23.397752+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397752+0000","last_undegraded":"2023-07-09T21:41:23.397752+0000","last_fullsized":"2023-07-09T21:41:23.397752+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411148+0000","last_change":"2023-07-09T21:41:23.410114+0000","last_active":"2023-07-09T21:41:23.411148+0000","last_peered":"2023-07-09T21:41:23.411148+0000","last_clean":"2023-07-09T21:41:23.411148+0000","last_became_active":"2023-07-09T21:41:23.409820+0000","last_became_peered":"2023-07-09T21:41:23.409820+0000","last_unstale":"2023-07-09T21:41:23.411148+0000","last_undegraded":"2023-07-09T21:41:23.411148+0000","last_fullsized":"2023-07-09T21:41:23.411148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:44.277158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389067+0000","last_change":"2023-07-09T21:41:23.389067+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389067+0000","last_undegraded":"2023-07-09T21:41:23.389067+0000","last_fullsized":"2023-07-09T21:41:23.389067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.417241+0000","last_change":"2023-07-09T21:41:23.415235+0000","last_active":"2023-07-09T21:41:23.417241+0000","last_peered":"2023-07-09T21:41:23.417241+0000","last_clean":"2023-07-09T21:41:23.417241+0000","last_became_active":"2023-07-09T21:41:23.414961+0000","last_became_peered":"2023-07-09T21:41:23.414961+0000","last_unstale":"2023-07-09T21:41:23.417241+0000","last_undegraded":"2023-07-09T21:41:23.417241+0000","last_fullsized":"2023-07-09T21:41:23.417241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:04.879441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389072+0000","last_change":"2023-07-09T21:41:23.389072+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389072+0000","last_undegraded":"2023-07-09T21:41:23.389072+0000","last_fullsized":"2023-07-09T21:41:23.389072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411033+0000","last_change":"2023-07-09T21:41:23.408567+0000","last_active":"2023-07-09T21:41:23.411033+0000","last_peered":"2023-07-09T21:41:23.411033+0000","last_clean":"2023-07-09T21:41:23.411033+0000","last_became_active":"2023-07-09T21:41:23.408258+0000","last_became_peered":"2023-07-09T21:41:23.408258+0000","last_unstale":"2023-07-09T21:41:23.411033+0000","last_undegraded":"2023-07-09T21:41:23.411033+0000","last_fullsized":"2023-07-09T21:41:23.411033+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:21.539588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400844+0000","last_change":"2023-07-09T21:41:23.400844+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400844+0000","last_undegraded":"2023-07-09T21:41:23.400844+0000","last_fullsized":"2023-07-09T21:41:23.400844+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414324+0000","last_change":"2023-07-09T21:41:23.404952+0000","last_active":"2023-07-09T21:41:23.414324+0000","last_peered":"2023-07-09T21:41:23.414324+0000","last_clean":"2023-07-09T21:41:23.414324+0000","last_became_active":"2023-07-09T21:41:23.404681+0000","last_became_peered":"2023-07-09T21:41:23.404681+0000","last_unstale":"2023-07-09T21:41:23.414324+0000","last_undegraded":"2023-07-09T21:41:23.414324+0000","last_fullsized":"2023-07-09T21:41:23.414324+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:27.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400113+0000","last_change":"2023-07-09T21:41:23.400113+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400113+0000","last_undegraded":"2023-07-09T21:41:23.400113+0000","last_fullsized":"2023-07-09T21:41:23.400113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411032+0000","last_change":"2023-07-09T21:41:23.408898+0000","last_active":"2023-07-09T21:41:23.411032+0000","last_peered":"2023-07-09T21:41:23.411032+0000","last_clean":"2023-07-09T21:41:23.411032+0000","last_became_active":"2023-07-09T21:41:23.408239+0000","last_became_peered":"2023-07-09T21:41:23.408239+0000","last_unstale":"2023-07-09T21:41:23.411032+0000","last_undegraded":"2023-07-09T21:41:23.411032+0000","last_fullsized":"2023-07-09T21:41:23.411032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:50.328513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396486+0000","last_change":"2023-07-09T21:41:23.396486+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396486+0000","last_undegraded":"2023-07-09T21:41:23.396486+0000","last_fullsized":"2023-07-09T21:41:23.396486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410941+0000","last_change":"2023-07-09T21:41:23.406811+0000","last_active":"2023-07-09T21:41:23.410941+0000","last_peered":"2023-07-09T21:41:23.410941+0000","last_clean":"2023-07-09T21:41:23.410941+0000","last_became_active":"2023-07-09T21:41:23.406502+0000","last_became_peered":"2023-07-09T21:41:23.406502+0000","last_unstale":"2023-07-09T21:41:23.410941+0000","last_undegraded":"2023-07-09T21:41:23.410941+0000","last_fullsized":"2023-07-09T21:41:23.410941+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:01.324915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'227","reported_seq":754,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401859+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:41:23.401859+0000","last_peered":"2023-07-09T21:41:23.401859+0000","last_clean":"2023-07-09T21:41:23.401859+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:41:23.401859+0000","last_undegraded":"2023-07-09T21:41:23.401859+0000","last_fullsized":"2023-07-09T21:41:23.401859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:20.016490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400386+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:41:23.400386+0000","last_peered":"2023-07-09T21:41:23.400386+0000","last_clean":"2023-07-09T21:41:23.400386+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:41:23.400386+0000","last_undegraded":"2023-07-09T21:41:23.400386+0000","last_fullsized":"2023-07-09T21:41:23.400386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:16:17.388174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395655+0000","last_change":"2023-07-09T21:41:23.395655+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395655+0000","last_undegraded":"2023-07-09T21:41:23.395655+0000","last_fullsized":"2023-07-09T21:41:23.395655+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415080+0000","last_change":"2023-07-09T21:41:23.412162+0000","last_active":"2023-07-09T21:41:23.415080+0000","last_peered":"2023-07-09T21:41:23.415080+0000","last_clean":"2023-07-09T21:41:23.415080+0000","last_became_active":"2023-07-09T21:41:23.411859+0000","last_became_peered":"2023-07-09T21:41:23.411859+0000","last_unstale":"2023-07-09T21:41:23.415080+0000","last_undegraded":"2023-07-09T21:41:23.415080+0000","last_fullsized":"2023-07-09T21:41:23.415080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:44.900575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401730+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:41:23.401730+0000","last_peered":"2023-07-09T21:41:23.401730+0000","last_clean":"2023-07-09T21:41:23.401730+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:41:23.401730+0000","last_undegraded":"2023-07-09T21:41:23.401730+0000","last_fullsized":"2023-07-09T21:41:23.401730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:44:49.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392010+0000","last_change":"2023-07-09T21:41:23.392010+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392010+0000","last_undegraded":"2023-07-09T21:41:23.392010+0000","last_fullsized":"2023-07-09T21:41:23.392010+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411348+0000","last_change":"2023-07-09T21:41:23.409499+0000","last_active":"2023-07-09T21:41:23.411348+0000","last_peered":"2023-07-09T21:41:23.411348+0000","last_clean":"2023-07-09T21:41:23.411348+0000","last_became_active":"2023-07-09T21:41:23.408924+0000","last_became_peered":"2023-07-09T21:41:23.408924+0000","last_unstale":"2023-07-09T21:41:23.411348+0000","last_undegraded":"2023-07-09T21:41:23.411348+0000","last_fullsized":"2023-07-09T21:41:23.411348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:22:12.027616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400332+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:41:23.400332+0000","last_peered":"2023-07-09T21:41:23.400332+0000","last_clean":"2023-07-09T21:41:23.400332+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:41:23.400332+0000","last_undegraded":"2023-07-09T21:41:23.400332+0000","last_fullsized":"2023-07-09T21:41:23.400332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:38.969759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394653+0000","last_change":"2023-07-09T21:41:23.394653+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394653+0000","last_undegraded":"2023-07-09T21:41:23.394653+0000","last_fullsized":"2023-07-09T21:41:23.394653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414557+0000","last_change":"2023-07-09T21:41:23.402034+0000","last_active":"2023-07-09T21:41:23.414557+0000","last_peered":"2023-07-09T21:41:23.414557+0000","last_clean":"2023-07-09T21:41:23.414557+0000","last_became_active":"2023-07-09T21:41:23.401726+0000","last_became_peered":"2023-07-09T21:41:23.401726+0000","last_unstale":"2023-07-09T21:41:23.414557+0000","last_undegraded":"2023-07-09T21:41:23.414557+0000","last_fullsized":"2023-07-09T21:41:23.414557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:37.771995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.397277+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:41:23.397277+0000","last_peered":"2023-07-09T21:41:23.397277+0000","last_clean":"2023-07-09T21:41:23.397277+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:41:23.397277+0000","last_undegraded":"2023-07-09T21:41:23.397277+0000","last_fullsized":"2023-07-09T21:41:23.397277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:04:07.544481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391224+0000","last_change":"2023-07-09T21:41:23.391224+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391224+0000","last_undegraded":"2023-07-09T21:41:23.391224+0000","last_fullsized":"2023-07-09T21:41:23.391224+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414270+0000","last_change":"2023-07-09T21:41:23.404513+0000","last_active":"2023-07-09T21:41:23.414270+0000","last_peered":"2023-07-09T21:41:23.414270+0000","last_clean":"2023-07-09T21:41:23.414270+0000","last_became_active":"2023-07-09T21:41:23.404196+0000","last_became_peered":"2023-07-09T21:41:23.404196+0000","last_unstale":"2023-07-09T21:41:23.414270+0000","last_undegraded":"2023-07-09T21:41:23.414270+0000","last_fullsized":"2023-07-09T21:41:23.414270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:59.010537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.393661+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:41:23.393661+0000","last_peered":"2023-07-09T21:41:23.393661+0000","last_clean":"2023-07-09T21:41:23.393661+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:41:23.393661+0000","last_undegraded":"2023-07-09T21:41:23.393661+0000","last_fullsized":"2023-07-09T21:41:23.393661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:00:05.074280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390208+0000","last_change":"2023-07-09T21:41:23.390208+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390208+0000","last_undegraded":"2023-07-09T21:41:23.390208+0000","last_fullsized":"2023-07-09T21:41:23.390208+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407166+0000","last_change":"2023-07-09T21:41:23.403900+0000","last_active":"2023-07-09T21:41:23.407166+0000","last_peered":"2023-07-09T21:41:23.407166+0000","last_clean":"2023-07-09T21:41:23.407166+0000","last_became_active":"2023-07-09T21:41:23.403592+0000","last_became_peered":"2023-07-09T21:41:23.403592+0000","last_unstale":"2023-07-09T21:41:23.407166+0000","last_undegraded":"2023-07-09T21:41:23.407166+0000","last_fullsized":"2023-07-09T21:41:23.407166+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:30.515338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":207,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.402198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:41:23.402198+0000","last_peered":"2023-07-09T21:41:23.402198+0000","last_clean":"2023-07-09T21:41:23.402198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:41:23.402198+0000","last_undegraded":"2023-07-09T21:41:23.402198+0000","last_fullsized":"2023-07-09T21:41:23.402198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392402+0000","last_change":"2023-07-09T21:41:23.392402+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392402+0000","last_undegraded":"2023-07-09T21:41:23.392402+0000","last_fullsized":"2023-07-09T21:41:23.392402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.403314+0000","last_change":"2023-07-09T21:41:23.401278+0000","last_active":"2023-07-09T21:41:23.403314+0000","last_peered":"2023-07-09T21:41:23.403314+0000","last_clean":"2023-07-09T21:41:23.403314+0000","last_became_active":"2023-07-09T21:41:23.400772+0000","last_became_peered":"2023-07-09T21:41:23.400772+0000","last_unstale":"2023-07-09T21:41:23.403314+0000","last_undegraded":"2023-07-09T21:41:23.403314+0000","last_fullsized":"2023-07-09T21:41:23.403314+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:29.997922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":199,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.391509+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:41:23.391509+0000","last_peered":"2023-07-09T21:41:23.391509+0000","last_clean":"2023-07-09T21:41:23.391509+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:41:23.391509+0000","last_undegraded":"2023-07-09T21:41:23.391509+0000","last_fullsized":"2023-07-09T21:41:23.391509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:36.931898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392389+0000","last_change":"2023-07-09T21:41:23.392389+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392389+0000","last_undegraded":"2023-07-09T21:41:23.392389+0000","last_fullsized":"2023-07-09T21:41:23.392389+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407194+0000","last_change":"2023-07-09T21:41:23.404279+0000","last_active":"2023-07-09T21:41:23.407194+0000","last_peered":"2023-07-09T21:41:23.407194+0000","last_clean":"2023-07-09T21:41:23.407194+0000","last_became_active":"2023-07-09T21:41:23.403598+0000","last_became_peered":"2023-07-09T21:41:23.403598+0000","last_unstale":"2023-07-09T21:41:23.407194+0000","last_undegraded":"2023-07-09T21:41:23.407194+0000","last_fullsized":"2023-07-09T21:41:23.407194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:36:22.583138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.394201+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:41:23.394201+0000","last_peered":"2023-07-09T21:41:23.394201+0000","last_clean":"2023-07-09T21:41:23.394201+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:41:23.394201+0000","last_undegraded":"2023-07-09T21:41:23.394201+0000","last_fullsized":"2023-07-09T21:41:23.394201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:22:33.817131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59400,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312440,"statfs":{"total":96636764160,"available":96575938560,"internally_reserved":0,"allocated":2162688,"data_stored":1385349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.59599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0249999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.97799999999999998,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0600000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.34699999999999998},"max":{"1min":0.998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.745,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.754,"15min":1.754},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1140000000000001,"5min":1.129,"15min":1.129},"last":0.88200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.89900000000000002,"5min":1.232,"15min":1.232},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.95399999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94999999999999996,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":1.0149999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98199999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.012,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.68999999999999995,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":6.101,"15min":6.101},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71999999999999997,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":1.252,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.65200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.80500000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.69199999999999995},"min":{"1min":0.55000000000000004,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.71999999999999997},"min":{"1min":0.54500000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.014,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50628,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.98799999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69199999999999995,"15min":0.71099999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.02},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.51100000000000001},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92300000000000004,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.33200000000000002},"max":{"1min":0.96299999999999997,"5min":1.083,"15min":1.083},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":1.0249999999999999,"15min":1.038},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.107,"15min":1.107},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.35299999999999998},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.97699999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94699999999999995},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90500000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91200000000000003,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.62}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86599999999999999,"5min":1.002,"15min":1.26},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.05},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":1.024,"15min":1.024},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.83599999999999997,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0569999999999999,"15min":1.0629999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.878,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.871},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.95899999999999996,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575075,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29399999999999998},"max":{"1min":0.70899999999999996,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.3320000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2689999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0649999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0409999999999999,"15min":1.208},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":0.997,"5min":1.51,"15min":1.51},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.46800000000000003},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.159},"last":0.624},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1910000000000001},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317116,"statfs":{"total":96636764160,"available":96580726784,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.0229999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.7050000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":1.145,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.62,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2989999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.50700000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.377,"15min":1.377},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.54200000000000004,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":1.262,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.83399999999999996},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":1.3400000000000001,"5min":1.423,"15min":1.423},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.163,"5min":1.48,"15min":1.48},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.84299999999999997},"min":{"1min":0.64400000000000002,"5min":0.53800000000000003,"15min":0.46100000000000002},"max":{"1min":1.3999999999999999,"5min":1.496,"15min":1.496},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.871},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.64800000000000002,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.501}]},{"osd":2,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.76100000000000001,"15min":1.5129999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":1.129,"15min":1.3069999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.274},"last":0.84499999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.351},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.242},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.206},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.46600000000000003},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80000000000000004},"min":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.173},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.65900000000000003,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37244,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":2150400,"data_stored":1378721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":0.68799999999999994,"15min":0.753},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":1.657,"15min":1.657},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66500000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.1080000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.749},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.42299999999999999},"max":{"1min":0.95899999999999996,"5min":1.835,"15min":1.835},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.726,"15min":1.726},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.615,"15min":1.615},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0409999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81100000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.0860000000000001,"5min":1.883,"15min":1.883},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:41:28.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:41:29.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 Processor -- start 2023-07-09T21:41:29.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 -- start start 2023-07-09T21:41:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65400cef80 0x7f654006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400b49f0 con 0x7f65400b7ab0 2023-07-09T21:41:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65400cc8a0 con 0x7f65400b4340 2023-07-09T21:41:29.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6548019640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65400b7e80 con 0x7f65400cef80 2023-07-09T21:41:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6545db5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65400b7ab0 0x7f65400b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37930/0 (socket says 172.21.15.37:37930) 2023-07-09T21:41:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6545db5640 1 -- 172.21.15.37:0/4047362377 learned_addr learned my addr 172.21.15.37:0/4047362377 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:29.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f65465b6640 1 --2- 172.21.15.37:0/4047362377 >> v2:172.21.15.37:3300/0 conn(0x7f65400cef80 0x7f654006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6544db3640 1 -- 172.21.15.37:0/4047362377 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399016643 0 0) 0x7f65400b49f0 con 0x7f65400b7ab0 2023-07-09T21:41:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f6544db3640 1 -- 172.21.15.37:0/4047362377 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f652c003530 con 0x7f65400b7ab0 2023-07-09T21:41:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f65465b6640 1 -- 172.21.15.37:0/4047362377 >> v1:172.21.15.119:6789/0 conn(0x7f65400b4340 legacy=0x7f65400d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f65465b6640 1 -- 172.21.15.37:0/4047362377 >> v1:172.21.15.37:6789/0 conn(0x7f65400b7ab0 legacy=0x7f65400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.089+0000 7f65465b6640 1 -- 172.21.15.37:0/4047362377 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65400ccb80 con 0x7f65400cef80 2023-07-09T21:41:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f65465b6640 1 --2- 172.21.15.37:0/4047362377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f654006aa50 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f653801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f98c3536e502e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6544db3640 1 -- 172.21.15.37:0/4047362377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a59a0 con 0x7f65400cef80 2023-07-09T21:41:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6544db3640 1 -- 172.21.15.37:0/4047362377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380a5b00 con 0x7f65400cef80 2023-07-09T21:41:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6544db3640 1 -- 172.21.15.37:0/4047362377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380a5e90 con 0x7f65400cef80 2023-07-09T21:41:29.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 -- 172.21.15.37:0/4047362377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 msgr2=0x7f654006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 --2- 172.21.15.37:0/4047362377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f654006aa50 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f6538009d90 tx=0x7f653801c8e0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 -- 172.21.15.37:0/4047362377 shutdown_connections 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 --2- 172.21.15.37:0/4047362377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f654006aa50 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 -- 172.21.15.37:0/4047362377 >> 172.21.15.37:0/4047362377 conn(0x7f6540073090 msgr2=0x7f6540069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 -- 172.21.15.37:0/4047362377 shutdown_connections 2023-07-09T21:41:29.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.093+0000 7f6548019640 1 -- 172.21.15.37:0/4047362377 wait complete. 2023-07-09T21:41:29.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 Processor -- start 2023-07-09T21:41:29.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- start start 2023-07-09T21:41:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65400b4340 0x7f6540156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65400b7ab0 0x7f654014edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540154800 con 0x7f65400cef80 2023-07-09T21:41:29.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6540155620 con 0x7f65400b4340 2023-07-09T21:41:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654014fce0 con 0x7f65400b7ab0 2023-07-09T21:41:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38710/0 (socket says 172.21.15.37:38710) 2023-07-09T21:41:29.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 -- 172.21.15.37:0/766839178 learned_addr learned my addr 172.21.15.37:0/766839178 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65455b4640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65400b7ab0 0x7f654014edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6545db5640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65400b4340 0x7f6540156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 -- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65400b7ab0 msgr2=0x7f654014edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65400b7ab0 0x7f654014edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 -- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65400b4340 msgr2=0x7f6540156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65400b4340 0x7f6540156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 -- 172.21.15.37:0/766839178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538009a70 con 0x7f65400cef80 2023-07-09T21:41:29.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65465b6640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f653801a510 tx=0x7f6538019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380add10 con 0x7f65400cef80 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380ade70 con 0x7f65400cef80 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380b9650 con 0x7f65400cef80 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65401567c0 con 0x7f65400cef80 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.097+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6540154cf0 con 0x7f65400cef80 2023-07-09T21:41:29.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65400c6c80 con 0x7f65400cef80 2023-07-09T21:41:29.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65380b97b0 con 0x7f65400cef80 2023-07-09T21:41:29.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f65367fc640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 0x7f6524068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f653811f640 con 0x7f65400cef80 2023-07-09T21:41:29.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f6545db5640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 0x7f6524068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.101+0000 7f6545db5640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 0x7f6524068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f653c0011f0 tx=0x7f653c009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.105+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65380ec9c0 con 0x7f65400cef80 2023-07-09T21:41:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.257+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f65400cf4d0 con 0x7f65240663a0 2023-07-09T21:41:29.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.265+0000 7f65367fc640 1 -- 172.21.15.37:0/766839178 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306782 (secure 0 0 0) 0x7f653c001cf0 con 0x7f65240663a0 2023-07-09T21:41:29.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:29.270 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:41:29.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 msgr2=0x7f6524068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 0x7f6524068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f653c0011f0 tx=0x7f653c009040 comp rx=0 tx=0).stop 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 msgr2=0x7f65401506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f653801a510 tx=0x7f6538019680 comp rx=0 tx=0).stop 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 shutdown_connections 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f65240663a0 0x7f6524068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65400cef80 0x7f65401506f0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65400b7ab0 0x7f654014edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 --2- 172.21.15.37:0/766839178 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65400b4340 0x7f6540156280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 >> 172.21.15.37:0/766839178 conn(0x7f6540073090 msgr2=0x7f6540069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:29.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 shutdown_connections 2023-07-09T21:41:29.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.269+0000 7f6548019640 1 -- 172.21.15.37:0/766839178 wait complete. 2023-07-09T21:41:29.289 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:41:28.037275+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332316,"kb_used_data":13404,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642404,"statfs":{"total":773094113280,"available":772753821696,"internally_reserved":0,"allocated":13725696,"data_stored":7533956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.655311"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391503+0000","last_change":"2023-07-09T21:41:23.391503+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391503+0000","last_undegraded":"2023-07-09T21:41:23.391503+0000","last_fullsized":"2023-07-09T21:41:23.391503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396864+0000","last_change":"2023-07-09T21:41:23.396864+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396864+0000","last_undegraded":"2023-07-09T21:41:23.396864+0000","last_fullsized":"2023-07-09T21:41:23.396864+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393411+0000","last_change":"2023-07-09T21:41:23.393411+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393411+0000","last_undegraded":"2023-07-09T21:41:23.393411+0000","last_fullsized":"2023-07-09T21:41:23.393411+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392697+0000","last_change":"2023-07-09T21:41:23.392697+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392697+0000","last_undegraded":"2023-07-09T21:41:23.392697+0000","last_fullsized":"2023-07-09T21:41:23.392697+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392441+0000","last_change":"2023-07-09T21:41:23.392441+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392441+0000","last_undegraded":"2023-07-09T21:41:23.392441+0000","last_fullsized":"2023-07-09T21:41:23.392441+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396279+0000","last_change":"2023-07-09T21:41:23.396279+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396279+0000","last_undegraded":"2023-07-09T21:41:23.396279+0000","last_fullsized":"2023-07-09T21:41:23.396279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398125+0000","last_change":"2023-07-09T21:41:23.398125+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398125+0000","last_undegraded":"2023-07-09T21:41:23.398125+0000","last_fullsized":"2023-07-09T21:41:23.398125+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396273+0000","last_change":"2023-07-09T21:41:23.396273+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396273+0000","last_undegraded":"2023-07-09T21:41:23.396273+0000","last_fullsized":"2023-07-09T21:41:23.396273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396877+0000","last_change":"2023-07-09T21:41:23.396877+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396877+0000","last_undegraded":"2023-07-09T21:41:23.396877+0000","last_fullsized":"2023-07-09T21:41:23.396877+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391148+0000","last_change":"2023-07-09T21:41:23.391148+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391148+0000","last_undegraded":"2023-07-09T21:41:23.391148+0000","last_fullsized":"2023-07-09T21:41:23.391148+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397954+0000","last_change":"2023-07-09T21:41:23.397954+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397954+0000","last_undegraded":"2023-07-09T21:41:23.397954+0000","last_fullsized":"2023-07-09T21:41:23.397954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394287+0000","last_change":"2023-07-09T21:41:23.394287+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394287+0000","last_undegraded":"2023-07-09T21:41:23.394287+0000","last_fullsized":"2023-07-09T21:41:23.394287+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389014+0000","last_change":"2023-07-09T21:41:23.389014+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389014+0000","last_undegraded":"2023-07-09T21:41:23.389014+0000","last_fullsized":"2023-07-09T21:41:23.389014+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.403654+0000","last_change":"2023-07-09T21:41:23.403654+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.403654+0000","last_undegraded":"2023-07-09T21:41:23.403654+0000","last_fullsized":"2023-07-09T21:41:23.403654+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400504+0000","last_change":"2023-07-09T21:41:23.400504+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400504+0000","last_undegraded":"2023-07-09T21:41:23.400504+0000","last_fullsized":"2023-07-09T21:41:23.400504+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.401336+0000","last_change":"2023-07-09T21:41:23.401336+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.401336+0000","last_undegraded":"2023-07-09T21:41:23.401336+0000","last_fullsized":"2023-07-09T21:41:23.401336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391110+0000","last_change":"2023-07-09T21:41:23.391110+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391110+0000","last_undegraded":"2023-07-09T21:41:23.391110+0000","last_fullsized":"2023-07-09T21:41:23.391110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396385+0000","last_change":"2023-07-09T21:41:23.396385+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396385+0000","last_undegraded":"2023-07-09T21:41:23.396385+0000","last_fullsized":"2023-07-09T21:41:23.396385+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392980+0000","last_change":"2023-07-09T21:41:23.392980+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392980+0000","last_undegraded":"2023-07-09T21:41:23.392980+0000","last_fullsized":"2023-07-09T21:41:23.392980+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393625+0000","last_change":"2023-07-09T21:41:23.393625+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393625+0000","last_undegraded":"2023-07-09T21:41:23.393625+0000","last_fullsized":"2023-07-09T21:41:23.393625+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398769+0000","last_change":"2023-07-09T21:41:23.398769+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398769+0000","last_undegraded":"2023-07-09T21:41:23.398769+0000","last_fullsized":"2023-07-09T21:41:23.398769+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391682+0000","last_change":"2023-07-09T21:41:23.391682+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391682+0000","last_undegraded":"2023-07-09T21:41:23.391682+0000","last_fullsized":"2023-07-09T21:41:23.391682+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390312+0000","last_change":"2023-07-09T21:41:23.390312+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390312+0000","last_undegraded":"2023-07-09T21:41:23.390312+0000","last_fullsized":"2023-07-09T21:41:23.390312+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391809+0000","last_change":"2023-07-09T21:41:23.391809+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391809+0000","last_undegraded":"2023-07-09T21:41:23.391809+0000","last_fullsized":"2023-07-09T21:41:23.391809+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395829+0000","last_change":"2023-07-09T21:41:23.395829+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395829+0000","last_undegraded":"2023-07-09T21:41:23.395829+0000","last_fullsized":"2023-07-09T21:41:23.395829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395216+0000","last_change":"2023-07-09T21:41:23.395216+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395216+0000","last_undegraded":"2023-07-09T21:41:23.395216+0000","last_fullsized":"2023-07-09T21:41:23.395216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397472+0000","last_change":"2023-07-09T21:41:23.397472+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397472+0000","last_undegraded":"2023-07-09T21:41:23.397472+0000","last_fullsized":"2023-07-09T21:41:23.397472+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395816+0000","last_change":"2023-07-09T21:41:23.395816+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395816+0000","last_undegraded":"2023-07-09T21:41:23.395816+0000","last_fullsized":"2023-07-09T21:41:23.395816+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389429+0000","last_change":"2023-07-09T21:41:23.389429+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389429+0000","last_undegraded":"2023-07-09T21:41:23.389429+0000","last_fullsized":"2023-07-09T21:41:23.389429+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395295+0000","last_change":"2023-07-09T21:41:23.395295+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395295+0000","last_undegraded":"2023-07-09T21:41:23.395295+0000","last_fullsized":"2023-07-09T21:41:23.395295+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396491+0000","last_change":"2023-07-09T21:41:23.396491+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396491+0000","last_undegraded":"2023-07-09T21:41:23.396491+0000","last_fullsized":"2023-07-09T21:41:23.396491+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395835+0000","last_change":"2023-07-09T21:41:23.395835+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395835+0000","last_undegraded":"2023-07-09T21:41:23.395835+0000","last_fullsized":"2023-07-09T21:41:23.395835+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389107+0000","last_change":"2023-07-09T21:41:23.389107+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389107+0000","last_undegraded":"2023-07-09T21:41:23.389107+0000","last_fullsized":"2023-07-09T21:41:23.389107+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412979+0000","last_change":"2023-07-09T21:41:23.410170+0000","last_active":"2023-07-09T21:41:23.412979+0000","last_peered":"2023-07-09T21:41:23.412979+0000","last_clean":"2023-07-09T21:41:23.412979+0000","last_became_active":"2023-07-09T21:41:23.409871+0000","last_became_peered":"2023-07-09T21:41:23.409871+0000","last_unstale":"2023-07-09T21:41:23.412979+0000","last_undegraded":"2023-07-09T21:41:23.412979+0000","last_fullsized":"2023-07-09T21:41:23.412979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:37:19.570097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389527+0000","last_change":"2023-07-09T21:41:23.389527+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389527+0000","last_undegraded":"2023-07-09T21:41:23.389527+0000","last_fullsized":"2023-07-09T21:41:23.389527+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409869+0000","last_change":"2023-07-09T21:41:23.406204+0000","last_active":"2023-07-09T21:41:23.409869+0000","last_peered":"2023-07-09T21:41:23.409869+0000","last_clean":"2023-07-09T21:41:23.409869+0000","last_became_active":"2023-07-09T21:41:23.405916+0000","last_became_peered":"2023-07-09T21:41:23.405916+0000","last_unstale":"2023-07-09T21:41:23.409869+0000","last_undegraded":"2023-07-09T21:41:23.409869+0000","last_fullsized":"2023-07-09T21:41:23.409869+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:06.973837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394778+0000","last_change":"2023-07-09T21:41:23.394778+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394778+0000","last_undegraded":"2023-07-09T21:41:23.394778+0000","last_fullsized":"2023-07-09T21:41:23.394778+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413257+0000","last_change":"2023-07-09T21:41:23.409832+0000","last_active":"2023-07-09T21:41:23.413257+0000","last_peered":"2023-07-09T21:41:23.413257+0000","last_clean":"2023-07-09T21:41:23.413257+0000","last_became_active":"2023-07-09T21:41:23.409503+0000","last_became_peered":"2023-07-09T21:41:23.409503+0000","last_unstale":"2023-07-09T21:41:23.413257+0000","last_undegraded":"2023-07-09T21:41:23.413257+0000","last_fullsized":"2023-07-09T21:41:23.413257+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:19.850905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397311+0000","last_change":"2023-07-09T21:41:23.397311+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397311+0000","last_undegraded":"2023-07-09T21:41:23.397311+0000","last_fullsized":"2023-07-09T21:41:23.397311+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409352+0000","last_change":"2023-07-09T21:41:23.408440+0000","last_active":"2023-07-09T21:41:23.409352+0000","last_peered":"2023-07-09T21:41:23.409352+0000","last_clean":"2023-07-09T21:41:23.409352+0000","last_became_active":"2023-07-09T21:41:23.408100+0000","last_became_peered":"2023-07-09T21:41:23.408100+0000","last_unstale":"2023-07-09T21:41:23.409352+0000","last_undegraded":"2023-07-09T21:41:23.409352+0000","last_fullsized":"2023-07-09T21:41:23.409352+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:13.089114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390712+0000","last_change":"2023-07-09T21:41:23.390712+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390712+0000","last_undegraded":"2023-07-09T21:41:23.390712+0000","last_fullsized":"2023-07-09T21:41:23.390712+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.416455+0000","last_change":"2023-07-09T21:41:23.415349+0000","last_active":"2023-07-09T21:41:23.416455+0000","last_peered":"2023-07-09T21:41:23.416455+0000","last_clean":"2023-07-09T21:41:23.416455+0000","last_became_active":"2023-07-09T21:41:23.415046+0000","last_became_peered":"2023-07-09T21:41:23.415046+0000","last_unstale":"2023-07-09T21:41:23.416455+0000","last_undegraded":"2023-07-09T21:41:23.416455+0000","last_fullsized":"2023-07-09T21:41:23.416455+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:39.023152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391939+0000","last_change":"2023-07-09T21:41:23.391939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391939+0000","last_undegraded":"2023-07-09T21:41:23.391939+0000","last_fullsized":"2023-07-09T21:41:23.391939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410090+0000","last_change":"2023-07-09T21:41:23.408634+0000","last_active":"2023-07-09T21:41:23.410090+0000","last_peered":"2023-07-09T21:41:23.410090+0000","last_clean":"2023-07-09T21:41:23.410090+0000","last_became_active":"2023-07-09T21:41:23.408353+0000","last_became_peered":"2023-07-09T21:41:23.408353+0000","last_unstale":"2023-07-09T21:41:23.410090+0000","last_undegraded":"2023-07-09T21:41:23.410090+0000","last_fullsized":"2023-07-09T21:41:23.410090+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:47:20.650730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395939+0000","last_change":"2023-07-09T21:41:23.395939+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395939+0000","last_undegraded":"2023-07-09T21:41:23.395939+0000","last_fullsized":"2023-07-09T21:41:23.395939+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414915+0000","last_change":"2023-07-09T21:41:23.411059+0000","last_active":"2023-07-09T21:41:23.414915+0000","last_peered":"2023-07-09T21:41:23.414915+0000","last_clean":"2023-07-09T21:41:23.414915+0000","last_became_active":"2023-07-09T21:41:23.410779+0000","last_became_peered":"2023-07-09T21:41:23.410779+0000","last_unstale":"2023-07-09T21:41:23.414915+0000","last_undegraded":"2023-07-09T21:41:23.414915+0000","last_fullsized":"2023-07-09T21:41:23.414915+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:55.034613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390184+0000","last_change":"2023-07-09T21:41:23.390184+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390184+0000","last_undegraded":"2023-07-09T21:41:23.390184+0000","last_fullsized":"2023-07-09T21:41:23.390184+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407004+0000","last_change":"2023-07-09T21:41:23.400312+0000","last_active":"2023-07-09T21:41:23.407004+0000","last_peered":"2023-07-09T21:41:23.407004+0000","last_clean":"2023-07-09T21:41:23.407004+0000","last_became_active":"2023-07-09T21:41:23.400038+0000","last_became_peered":"2023-07-09T21:41:23.400038+0000","last_unstale":"2023-07-09T21:41:23.407004+0000","last_undegraded":"2023-07-09T21:41:23.407004+0000","last_fullsized":"2023-07-09T21:41:23.407004+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:35:16.171313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389722+0000","last_change":"2023-07-09T21:41:23.389722+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389722+0000","last_undegraded":"2023-07-09T21:41:23.389722+0000","last_fullsized":"2023-07-09T21:41:23.389722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414900+0000","last_change":"2023-07-09T21:41:23.410925+0000","last_active":"2023-07-09T21:41:23.414900+0000","last_peered":"2023-07-09T21:41:23.414900+0000","last_clean":"2023-07-09T21:41:23.414900+0000","last_became_active":"2023-07-09T21:41:23.410630+0000","last_became_peered":"2023-07-09T21:41:23.410630+0000","last_unstale":"2023-07-09T21:41:23.414900+0000","last_undegraded":"2023-07-09T21:41:23.414900+0000","last_fullsized":"2023-07-09T21:41:23.414900+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:12.575978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.393270+0000","last_change":"2023-07-09T21:41:23.393270+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.393270+0000","last_undegraded":"2023-07-09T21:41:23.393270+0000","last_fullsized":"2023-07-09T21:41:23.393270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409419+0000","last_change":"2023-07-09T21:41:23.406825+0000","last_active":"2023-07-09T21:41:23.409419+0000","last_peered":"2023-07-09T21:41:23.409419+0000","last_clean":"2023-07-09T21:41:23.409419+0000","last_became_active":"2023-07-09T21:41:23.406551+0000","last_became_peered":"2023-07-09T21:41:23.406551+0000","last_unstale":"2023-07-09T21:41:23.409419+0000","last_undegraded":"2023-07-09T21:41:23.409419+0000","last_fullsized":"2023-07-09T21:41:23.409419+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:39.659592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389013+0000","last_change":"2023-07-09T21:41:23.389013+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389013+0000","last_undegraded":"2023-07-09T21:41:23.389013+0000","last_fullsized":"2023-07-09T21:41:23.389013+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.412269+0000","last_change":"2023-07-09T21:41:23.410301+0000","last_active":"2023-07-09T21:41:23.412269+0000","last_peered":"2023-07-09T21:41:23.412269+0000","last_clean":"2023-07-09T21:41:23.412269+0000","last_became_active":"2023-07-09T21:41:23.410015+0000","last_became_peered":"2023-07-09T21:41:23.410015+0000","last_unstale":"2023-07-09T21:41:23.412269+0000","last_undegraded":"2023-07-09T21:41:23.412269+0000","last_fullsized":"2023-07-09T21:41:23.412269+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:33.335789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391533+0000","last_change":"2023-07-09T21:41:23.391533+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391533+0000","last_undegraded":"2023-07-09T21:41:23.391533+0000","last_fullsized":"2023-07-09T21:41:23.391533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414456+0000","last_change":"2023-07-09T21:41:23.405581+0000","last_active":"2023-07-09T21:41:23.414456+0000","last_peered":"2023-07-09T21:41:23.414456+0000","last_clean":"2023-07-09T21:41:23.414456+0000","last_became_active":"2023-07-09T21:41:23.405276+0000","last_became_peered":"2023-07-09T21:41:23.405276+0000","last_unstale":"2023-07-09T21:41:23.414456+0000","last_undegraded":"2023-07-09T21:41:23.414456+0000","last_fullsized":"2023-07-09T21:41:23.414456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:30.319720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397436+0000","last_change":"2023-07-09T21:41:23.397436+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397436+0000","last_undegraded":"2023-07-09T21:41:23.397436+0000","last_fullsized":"2023-07-09T21:41:23.397436+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405385+0000","last_change":"2023-07-09T21:41:23.404033+0000","last_active":"2023-07-09T21:41:23.405385+0000","last_peered":"2023-07-09T21:41:23.405385+0000","last_clean":"2023-07-09T21:41:23.405385+0000","last_became_active":"2023-07-09T21:41:23.403730+0000","last_became_peered":"2023-07-09T21:41:23.403730+0000","last_unstale":"2023-07-09T21:41:23.405385+0000","last_undegraded":"2023-07-09T21:41:23.405385+0000","last_fullsized":"2023-07-09T21:41:23.405385+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:16:15.939862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395930+0000","last_change":"2023-07-09T21:41:23.395930+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395930+0000","last_undegraded":"2023-07-09T21:41:23.395930+0000","last_fullsized":"2023-07-09T21:41:23.395930+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.409618+0000","last_change":"2023-07-09T21:41:23.402616+0000","last_active":"2023-07-09T21:41:23.409618+0000","last_peered":"2023-07-09T21:41:23.409618+0000","last_clean":"2023-07-09T21:41:23.409618+0000","last_became_active":"2023-07-09T21:41:23.402350+0000","last_became_peered":"2023-07-09T21:41:23.402350+0000","last_unstale":"2023-07-09T21:41:23.409618+0000","last_undegraded":"2023-07-09T21:41:23.409618+0000","last_fullsized":"2023-07-09T21:41:23.409618+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:28.348788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.398030+0000","last_change":"2023-07-09T21:41:23.398030+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.398030+0000","last_undegraded":"2023-07-09T21:41:23.398030+0000","last_fullsized":"2023-07-09T21:41:23.398030+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411058+0000","last_change":"2023-07-09T21:41:23.408629+0000","last_active":"2023-07-09T21:41:23.411058+0000","last_peered":"2023-07-09T21:41:23.411058+0000","last_clean":"2023-07-09T21:41:23.411058+0000","last_became_active":"2023-07-09T21:41:23.408327+0000","last_became_peered":"2023-07-09T21:41:23.408327+0000","last_unstale":"2023-07-09T21:41:23.411058+0000","last_undegraded":"2023-07-09T21:41:23.411058+0000","last_fullsized":"2023-07-09T21:41:23.411058+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:23:51.485002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390717+0000","last_change":"2023-07-09T21:41:23.390717+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390717+0000","last_undegraded":"2023-07-09T21:41:23.390717+0000","last_fullsized":"2023-07-09T21:41:23.390717+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.413501+0000","last_change":"2023-07-09T21:41:23.409766+0000","last_active":"2023-07-09T21:41:23.413501+0000","last_peered":"2023-07-09T21:41:23.413501+0000","last_clean":"2023-07-09T21:41:23.413501+0000","last_became_active":"2023-07-09T21:41:23.409466+0000","last_became_peered":"2023-07-09T21:41:23.409466+0000","last_unstale":"2023-07-09T21:41:23.413501+0000","last_undegraded":"2023-07-09T21:41:23.413501+0000","last_fullsized":"2023-07-09T21:41:23.413501+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:17.715172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390168+0000","last_change":"2023-07-09T21:41:23.390168+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390168+0000","last_undegraded":"2023-07-09T21:41:23.390168+0000","last_fullsized":"2023-07-09T21:41:23.390168+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.405348+0000","last_change":"2023-07-09T21:41:23.403988+0000","last_active":"2023-07-09T21:41:23.405348+0000","last_peered":"2023-07-09T21:41:23.405348+0000","last_clean":"2023-07-09T21:41:23.405348+0000","last_became_active":"2023-07-09T21:41:23.403716+0000","last_became_peered":"2023-07-09T21:41:23.403716+0000","last_unstale":"2023-07-09T21:41:23.405348+0000","last_undegraded":"2023-07-09T21:41:23.405348+0000","last_fullsized":"2023-07-09T21:41:23.405348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:42.887152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394438+0000","last_change":"2023-07-09T21:41:23.394438+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394438+0000","last_undegraded":"2023-07-09T21:41:23.394438+0000","last_fullsized":"2023-07-09T21:41:23.394438+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407148+0000","last_change":"2023-07-09T21:41:23.405390+0000","last_active":"2023-07-09T21:41:23.407148+0000","last_peered":"2023-07-09T21:41:23.407148+0000","last_clean":"2023-07-09T21:41:23.407148+0000","last_became_active":"2023-07-09T21:41:23.405110+0000","last_became_peered":"2023-07-09T21:41:23.405110+0000","last_unstale":"2023-07-09T21:41:23.407148+0000","last_undegraded":"2023-07-09T21:41:23.407148+0000","last_fullsized":"2023-07-09T21:41:23.407148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:41.859320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390950+0000","last_change":"2023-07-09T21:41:23.390950+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390950+0000","last_undegraded":"2023-07-09T21:41:23.390950+0000","last_fullsized":"2023-07-09T21:41:23.390950+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415826+0000","last_change":"2023-07-09T21:41:23.409226+0000","last_active":"2023-07-09T21:41:23.415826+0000","last_peered":"2023-07-09T21:41:23.415826+0000","last_clean":"2023-07-09T21:41:23.415826+0000","last_became_active":"2023-07-09T21:41:23.408915+0000","last_became_peered":"2023-07-09T21:41:23.408915+0000","last_unstale":"2023-07-09T21:41:23.415826+0000","last_undegraded":"2023-07-09T21:41:23.415826+0000","last_fullsized":"2023-07-09T21:41:23.415826+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:53.751852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.397752+0000","last_change":"2023-07-09T21:41:23.397752+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.397752+0000","last_undegraded":"2023-07-09T21:41:23.397752+0000","last_fullsized":"2023-07-09T21:41:23.397752+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411148+0000","last_change":"2023-07-09T21:41:23.410114+0000","last_active":"2023-07-09T21:41:23.411148+0000","last_peered":"2023-07-09T21:41:23.411148+0000","last_clean":"2023-07-09T21:41:23.411148+0000","last_became_active":"2023-07-09T21:41:23.409820+0000","last_became_peered":"2023-07-09T21:41:23.409820+0000","last_unstale":"2023-07-09T21:41:23.411148+0000","last_undegraded":"2023-07-09T21:41:23.411148+0000","last_fullsized":"2023-07-09T21:41:23.411148+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:44.277158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389067+0000","last_change":"2023-07-09T21:41:23.389067+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389067+0000","last_undegraded":"2023-07-09T21:41:23.389067+0000","last_fullsized":"2023-07-09T21:41:23.389067+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.417241+0000","last_change":"2023-07-09T21:41:23.415235+0000","last_active":"2023-07-09T21:41:23.417241+0000","last_peered":"2023-07-09T21:41:23.417241+0000","last_clean":"2023-07-09T21:41:23.417241+0000","last_became_active":"2023-07-09T21:41:23.414961+0000","last_became_peered":"2023-07-09T21:41:23.414961+0000","last_unstale":"2023-07-09T21:41:23.417241+0000","last_undegraded":"2023-07-09T21:41:23.417241+0000","last_fullsized":"2023-07-09T21:41:23.417241+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:04.879441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.389072+0000","last_change":"2023-07-09T21:41:23.389072+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.389072+0000","last_undegraded":"2023-07-09T21:41:23.389072+0000","last_fullsized":"2023-07-09T21:41:23.389072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411033+0000","last_change":"2023-07-09T21:41:23.408567+0000","last_active":"2023-07-09T21:41:23.411033+0000","last_peered":"2023-07-09T21:41:23.411033+0000","last_clean":"2023-07-09T21:41:23.411033+0000","last_became_active":"2023-07-09T21:41:23.408258+0000","last_became_peered":"2023-07-09T21:41:23.408258+0000","last_unstale":"2023-07-09T21:41:23.411033+0000","last_undegraded":"2023-07-09T21:41:23.411033+0000","last_fullsized":"2023-07-09T21:41:23.411033+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:12:21.539588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400844+0000","last_change":"2023-07-09T21:41:23.400844+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400844+0000","last_undegraded":"2023-07-09T21:41:23.400844+0000","last_fullsized":"2023-07-09T21:41:23.400844+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414324+0000","last_change":"2023-07-09T21:41:23.404952+0000","last_active":"2023-07-09T21:41:23.414324+0000","last_peered":"2023-07-09T21:41:23.414324+0000","last_clean":"2023-07-09T21:41:23.414324+0000","last_became_active":"2023-07-09T21:41:23.404681+0000","last_became_peered":"2023-07-09T21:41:23.404681+0000","last_unstale":"2023-07-09T21:41:23.414324+0000","last_undegraded":"2023-07-09T21:41:23.414324+0000","last_fullsized":"2023-07-09T21:41:23.414324+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:27.831896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.400113+0000","last_change":"2023-07-09T21:41:23.400113+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.400113+0000","last_undegraded":"2023-07-09T21:41:23.400113+0000","last_fullsized":"2023-07-09T21:41:23.400113+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411032+0000","last_change":"2023-07-09T21:41:23.408898+0000","last_active":"2023-07-09T21:41:23.411032+0000","last_peered":"2023-07-09T21:41:23.411032+0000","last_clean":"2023-07-09T21:41:23.411032+0000","last_became_active":"2023-07-09T21:41:23.408239+0000","last_became_peered":"2023-07-09T21:41:23.408239+0000","last_unstale":"2023-07-09T21:41:23.411032+0000","last_undegraded":"2023-07-09T21:41:23.411032+0000","last_fullsized":"2023-07-09T21:41:23.411032+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:50.328513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.396486+0000","last_change":"2023-07-09T21:41:23.396486+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.396486+0000","last_undegraded":"2023-07-09T21:41:23.396486+0000","last_fullsized":"2023-07-09T21:41:23.396486+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.410941+0000","last_change":"2023-07-09T21:41:23.406811+0000","last_active":"2023-07-09T21:41:23.410941+0000","last_peered":"2023-07-09T21:41:23.410941+0000","last_clean":"2023-07-09T21:41:23.410941+0000","last_became_active":"2023-07-09T21:41:23.406502+0000","last_became_peered":"2023-07-09T21:41:23.406502+0000","last_unstale":"2023-07-09T21:41:23.410941+0000","last_undegraded":"2023-07-09T21:41:23.410941+0000","last_fullsized":"2023-07-09T21:41:23.410941+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:30:01.324915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'227","reported_seq":754,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401859+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:41:23.401859+0000","last_peered":"2023-07-09T21:41:23.401859+0000","last_clean":"2023-07-09T21:41:23.401859+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:41:23.401859+0000","last_undegraded":"2023-07-09T21:41:23.401859+0000","last_fullsized":"2023-07-09T21:41:23.401859+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:20.016490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400386+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:41:23.400386+0000","last_peered":"2023-07-09T21:41:23.400386+0000","last_clean":"2023-07-09T21:41:23.400386+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:41:23.400386+0000","last_undegraded":"2023-07-09T21:41:23.400386+0000","last_fullsized":"2023-07-09T21:41:23.400386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:16:17.388174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.395655+0000","last_change":"2023-07-09T21:41:23.395655+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.395655+0000","last_undegraded":"2023-07-09T21:41:23.395655+0000","last_fullsized":"2023-07-09T21:41:23.395655+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.415080+0000","last_change":"2023-07-09T21:41:23.412162+0000","last_active":"2023-07-09T21:41:23.415080+0000","last_peered":"2023-07-09T21:41:23.415080+0000","last_clean":"2023-07-09T21:41:23.415080+0000","last_became_active":"2023-07-09T21:41:23.411859+0000","last_became_peered":"2023-07-09T21:41:23.411859+0000","last_unstale":"2023-07-09T21:41:23.415080+0000","last_undegraded":"2023-07-09T21:41:23.415080+0000","last_fullsized":"2023-07-09T21:41:23.415080+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:22:44.900575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":208,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.401730+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:41:23.401730+0000","last_peered":"2023-07-09T21:41:23.401730+0000","last_clean":"2023-07-09T21:41:23.401730+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:41:23.401730+0000","last_undegraded":"2023-07-09T21:41:23.401730+0000","last_fullsized":"2023-07-09T21:41:23.401730+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:44:49.688004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392010+0000","last_change":"2023-07-09T21:41:23.392010+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392010+0000","last_undegraded":"2023-07-09T21:41:23.392010+0000","last_fullsized":"2023-07-09T21:41:23.392010+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.411348+0000","last_change":"2023-07-09T21:41:23.409499+0000","last_active":"2023-07-09T21:41:23.411348+0000","last_peered":"2023-07-09T21:41:23.411348+0000","last_clean":"2023-07-09T21:41:23.411348+0000","last_became_active":"2023-07-09T21:41:23.408924+0000","last_became_peered":"2023-07-09T21:41:23.408924+0000","last_unstale":"2023-07-09T21:41:23.411348+0000","last_undegraded":"2023-07-09T21:41:23.411348+0000","last_fullsized":"2023-07-09T21:41:23.411348+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:22:12.027616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":202,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.400332+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:41:23.400332+0000","last_peered":"2023-07-09T21:41:23.400332+0000","last_clean":"2023-07-09T21:41:23.400332+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:41:23.400332+0000","last_undegraded":"2023-07-09T21:41:23.400332+0000","last_fullsized":"2023-07-09T21:41:23.400332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:38.969759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.394653+0000","last_change":"2023-07-09T21:41:23.394653+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.394653+0000","last_undegraded":"2023-07-09T21:41:23.394653+0000","last_fullsized":"2023-07-09T21:41:23.394653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414557+0000","last_change":"2023-07-09T21:41:23.402034+0000","last_active":"2023-07-09T21:41:23.414557+0000","last_peered":"2023-07-09T21:41:23.414557+0000","last_clean":"2023-07-09T21:41:23.414557+0000","last_became_active":"2023-07-09T21:41:23.401726+0000","last_became_peered":"2023-07-09T21:41:23.401726+0000","last_unstale":"2023-07-09T21:41:23.414557+0000","last_undegraded":"2023-07-09T21:41:23.414557+0000","last_fullsized":"2023-07-09T21:41:23.414557+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:37.771995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":236,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.397277+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:41:23.397277+0000","last_peered":"2023-07-09T21:41:23.397277+0000","last_clean":"2023-07-09T21:41:23.397277+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:41:23.397277+0000","last_undegraded":"2023-07-09T21:41:23.397277+0000","last_fullsized":"2023-07-09T21:41:23.397277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:04:07.544481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.391224+0000","last_change":"2023-07-09T21:41:23.391224+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.391224+0000","last_undegraded":"2023-07-09T21:41:23.391224+0000","last_fullsized":"2023-07-09T21:41:23.391224+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.414270+0000","last_change":"2023-07-09T21:41:23.404513+0000","last_active":"2023-07-09T21:41:23.414270+0000","last_peered":"2023-07-09T21:41:23.414270+0000","last_clean":"2023-07-09T21:41:23.414270+0000","last_became_active":"2023-07-09T21:41:23.404196+0000","last_became_peered":"2023-07-09T21:41:23.404196+0000","last_unstale":"2023-07-09T21:41:23.414270+0000","last_undegraded":"2023-07-09T21:41:23.414270+0000","last_fullsized":"2023-07-09T21:41:23.414270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:59.010537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":198,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.393661+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:41:23.393661+0000","last_peered":"2023-07-09T21:41:23.393661+0000","last_clean":"2023-07-09T21:41:23.393661+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:41:23.393661+0000","last_undegraded":"2023-07-09T21:41:23.393661+0000","last_fullsized":"2023-07-09T21:41:23.393661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:00:05.074280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.390208+0000","last_change":"2023-07-09T21:41:23.390208+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.390208+0000","last_undegraded":"2023-07-09T21:41:23.390208+0000","last_fullsized":"2023-07-09T21:41:23.390208+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407166+0000","last_change":"2023-07-09T21:41:23.403900+0000","last_active":"2023-07-09T21:41:23.407166+0000","last_peered":"2023-07-09T21:41:23.407166+0000","last_clean":"2023-07-09T21:41:23.407166+0000","last_became_active":"2023-07-09T21:41:23.403592+0000","last_became_peered":"2023-07-09T21:41:23.403592+0000","last_unstale":"2023-07-09T21:41:23.407166+0000","last_undegraded":"2023-07-09T21:41:23.407166+0000","last_fullsized":"2023-07-09T21:41:23.407166+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:25:30.515338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":207,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.402198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:41:23.402198+0000","last_peered":"2023-07-09T21:41:23.402198+0000","last_clean":"2023-07-09T21:41:23.402198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:41:23.402198+0000","last_undegraded":"2023-07-09T21:41:23.402198+0000","last_fullsized":"2023-07-09T21:41:23.402198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392402+0000","last_change":"2023-07-09T21:41:23.392402+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392402+0000","last_undegraded":"2023-07-09T21:41:23.392402+0000","last_fullsized":"2023-07-09T21:41:23.392402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.403314+0000","last_change":"2023-07-09T21:41:23.401278+0000","last_active":"2023-07-09T21:41:23.403314+0000","last_peered":"2023-07-09T21:41:23.403314+0000","last_clean":"2023-07-09T21:41:23.403314+0000","last_became_active":"2023-07-09T21:41:23.400772+0000","last_became_peered":"2023-07-09T21:41:23.400772+0000","last_unstale":"2023-07-09T21:41:23.403314+0000","last_undegraded":"2023-07-09T21:41:23.403314+0000","last_fullsized":"2023-07-09T21:41:23.403314+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:29.997922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":199,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.391509+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:41:23.391509+0000","last_peered":"2023-07-09T21:41:23.391509+0000","last_clean":"2023-07-09T21:41:23.391509+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:41:23.391509+0000","last_undegraded":"2023-07-09T21:41:23.391509+0000","last_fullsized":"2023-07-09T21:41:23.391509+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:41:36.931898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-07-09T21:41:23.392389+0000","last_change":"2023-07-09T21:41:23.392389+0000","last_active":"2023-07-09T21:41:23.375678+0000","last_peered":"2023-07-09T21:41:23.375678+0000","last_clean":"2023-07-09T21:41:23.375678+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:41:23.392389+0000","last_undegraded":"2023-07-09T21:41:23.392389+0000","last_fullsized":"2023-07-09T21:41:23.392389+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.407194+0000","last_change":"2023-07-09T21:41:23.404279+0000","last_active":"2023-07-09T21:41:23.407194+0000","last_peered":"2023-07-09T21:41:23.407194+0000","last_clean":"2023-07-09T21:41:23.407194+0000","last_became_active":"2023-07-09T21:41:23.403598+0000","last_became_peered":"2023-07-09T21:41:23.403598+0000","last_unstale":"2023-07-09T21:41:23.407194+0000","last_undegraded":"2023-07-09T21:41:23.407194+0000","last_fullsized":"2023-07-09T21:41:23.407194+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:36:22.583138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":205,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-07-09T21:41:23.394201+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:41:23.394201+0000","last_peered":"2023-07-09T21:41:23.394201+0000","last_clean":"2023-07-09T21:41:23.394201+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:41:23.394201+0000","last_undegraded":"2023-07-09T21:41:23.394201+0000","last_fullsized":"2023-07-09T21:41:23.394201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:22:33.817131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59400,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312440,"statfs":{"total":96636764160,"available":96575938560,"internally_reserved":0,"allocated":2162688,"data_stored":1385349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.59599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.751,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0249999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.55600000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.97799999999999998,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0600000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.34699999999999998},"max":{"1min":0.998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.96499999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.745,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.754,"15min":1.754},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1140000000000001,"5min":1.129,"15min":1.129},"last":0.88200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.89900000000000002,"5min":1.232,"15min":1.232},"last":0.78700000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.95399999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69299999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575075,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94999999999999996,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60999999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":1.0149999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.63700000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98199999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.69799999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.012,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.74099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.68999999999999995,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":6.101,"15min":6.101},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71999999999999997,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":1.252,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.77100000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.65200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.80500000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.69199999999999995},"min":{"1min":0.55000000000000004,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.71999999999999997},"min":{"1min":0.54500000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.014,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.75800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575074,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50628,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321212,"statfs":{"total":96636764160,"available":96584921088,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.98799999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.77300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69199999999999995,"15min":0.71099999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.02},"last":0.55800000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.51100000000000001},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.999},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.54000000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92300000000000004,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":0.69499999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.33200000000000002},"max":{"1min":0.96299999999999997,"5min":1.083,"15min":1.083},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":1.0249999999999999,"15min":1.038},"last":0.625}]},{"osd":7,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.107,"15min":1.107},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575076,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.35299999999999998},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.97699999999999998},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94699999999999995},"last":0.59099999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90500000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.66200000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91200000000000003,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.62}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86599999999999999,"5min":1.002,"15min":1.26},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.05},"last":0.75600000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":1.024,"15min":1.024},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.83599999999999997,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.80900000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0569999999999999,"15min":1.0629999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.878,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.871},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.95899999999999996,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575075,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29399999999999998},"max":{"1min":0.70899999999999996,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33200000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.51800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.3320000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2689999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0649999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0409999999999999,"15min":1.208},"last":0.54200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":0.997,"5min":1.51,"15min":1.51},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.46800000000000003},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.159},"last":0.624},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1910000000000001},"last":0.66500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575076,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54724,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317116,"statfs":{"total":96636764160,"available":96580726784,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.438},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.0229999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.7050000000000001},"last":0.375}]},{"osd":4,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":1.145,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.62,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2989999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.50700000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.377,"15min":1.377},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.54200000000000004,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":1.262,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.68300000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.83399999999999996},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":1.3400000000000001,"5min":1.423,"15min":1.423},"last":0.61299999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.163,"5min":1.48,"15min":1.48},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.84299999999999997},"min":{"1min":0.64400000000000002,"5min":0.53800000000000003,"15min":0.46100000000000002},"max":{"1min":1.3999999999999999,"5min":1.496,"15min":1.496},"last":0.626}]}]},{"osd":1,"up_from":13,"seq":55834575076,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":794981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.871},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.64800000000000002,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.501}]},{"osd":2,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.76100000000000001,"15min":1.5129999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.443}]},{"osd":3,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.46600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":1.129,"15min":1.3069999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.274},"last":0.84499999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.351},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.242},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.206},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.46600000000000003},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80000000000000004},"min":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.173},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.65900000000000003,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.88800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575076,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37244,"kb_used_data":2100,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334596,"statfs":{"total":96636764160,"available":96598626304,"internally_reserved":0,"allocated":2150400,"data_stored":1378721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":0.68799999999999994,"15min":0.753},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":1.657,"15min":1.657},"last":0.54400000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66500000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.56699999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.1080000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.749},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.42299999999999999},"max":{"1min":0.95899999999999996,"5min":1.835,"15min":1.835},"last":0.71799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.726,"15min":1.726},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.615,"15min":1.615},"last":0.64500000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.629},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0409999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.73899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81100000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.0860000000000001,"5min":1.883,"15min":1.883},"last":0.76100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:41:29.296 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3f is not active+clean 2023-07-09T21:41:29.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391503+0000', 'last_change': '2023-07-09T21:41:23.391503+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391503+0000', 'last_undegraded': '2023-07-09T21:41:23.391503+0000', 'last_fullsized': '2023-07-09T21:41:23.391503+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.297 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3e is not active+clean 2023-07-09T21:41:29.297 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396864+0000', 'last_change': '2023-07-09T21:41:23.396864+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396864+0000', 'last_undegraded': '2023-07-09T21:41:23.396864+0000', 'last_fullsized': '2023-07-09T21:41:23.396864+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3d is not active+clean 2023-07-09T21:41:29.298 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.393411+0000', 'last_change': '2023-07-09T21:41:23.393411+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.393411+0000', 'last_undegraded': '2023-07-09T21:41:23.393411+0000', 'last_fullsized': '2023-07-09T21:41:23.393411+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.298 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3c is not active+clean 2023-07-09T21:41:29.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392697+0000', 'last_change': '2023-07-09T21:41:23.392697+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392697+0000', 'last_undegraded': '2023-07-09T21:41:23.392697+0000', 'last_fullsized': '2023-07-09T21:41:23.392697+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.299 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3b is not active+clean 2023-07-09T21:41:29.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392441+0000', 'last_change': '2023-07-09T21:41:23.392441+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392441+0000', 'last_undegraded': '2023-07-09T21:41:23.392441+0000', 'last_fullsized': '2023-07-09T21:41:23.392441+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3a is not active+clean 2023-07-09T21:41:29.300 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396279+0000', 'last_change': '2023-07-09T21:41:23.396279+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396279+0000', 'last_undegraded': '2023-07-09T21:41:23.396279+0000', 'last_fullsized': '2023-07-09T21:41:23.396279+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.300 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.39 is not active+clean 2023-07-09T21:41:29.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.398125+0000', 'last_change': '2023-07-09T21:41:23.398125+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.398125+0000', 'last_undegraded': '2023-07-09T21:41:23.398125+0000', 'last_fullsized': '2023-07-09T21:41:23.398125+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.301 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.38 is not active+clean 2023-07-09T21:41:29.301 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396273+0000', 'last_change': '2023-07-09T21:41:23.396273+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396273+0000', 'last_undegraded': '2023-07-09T21:41:23.396273+0000', 'last_fullsized': '2023-07-09T21:41:23.396273+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.37 is not active+clean 2023-07-09T21:41:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396877+0000', 'last_change': '2023-07-09T21:41:23.396877+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396877+0000', 'last_undegraded': '2023-07-09T21:41:23.396877+0000', 'last_fullsized': '2023-07-09T21:41:23.396877+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.36 is not active+clean 2023-07-09T21:41:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391148+0000', 'last_change': '2023-07-09T21:41:23.391148+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391148+0000', 'last_undegraded': '2023-07-09T21:41:23.391148+0000', 'last_fullsized': '2023-07-09T21:41:23.391148+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.35 is not active+clean 2023-07-09T21:41:29.303 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.397954+0000', 'last_change': '2023-07-09T21:41:23.397954+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.397954+0000', 'last_undegraded': '2023-07-09T21:41:23.397954+0000', 'last_fullsized': '2023-07-09T21:41:23.397954+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.303 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.34 is not active+clean 2023-07-09T21:41:29.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.394287+0000', 'last_change': '2023-07-09T21:41:23.394287+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.394287+0000', 'last_undegraded': '2023-07-09T21:41:23.394287+0000', 'last_fullsized': '2023-07-09T21:41:23.394287+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.304 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.33 is not active+clean 2023-07-09T21:41:29.304 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389014+0000', 'last_change': '2023-07-09T21:41:23.389014+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389014+0000', 'last_undegraded': '2023-07-09T21:41:23.389014+0000', 'last_fullsized': '2023-07-09T21:41:23.389014+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.32 is not active+clean 2023-07-09T21:41:29.305 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.403654+0000', 'last_change': '2023-07-09T21:41:23.403654+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.403654+0000', 'last_undegraded': '2023-07-09T21:41:23.403654+0000', 'last_fullsized': '2023-07-09T21:41:23.403654+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:41:29.305 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.31 is not active+clean 2023-07-09T21:41:29.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.400504+0000', 'last_change': '2023-07-09T21:41:23.400504+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.400504+0000', 'last_undegraded': '2023-07-09T21:41:23.400504+0000', 'last_fullsized': '2023-07-09T21:41:23.400504+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:41:29.306 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.30 is not active+clean 2023-07-09T21:41:29.306 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.401336+0000', 'last_change': '2023-07-09T21:41:23.401336+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.401336+0000', 'last_undegraded': '2023-07-09T21:41:23.401336+0000', 'last_fullsized': '2023-07-09T21:41:23.401336+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:41:29.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2f is not active+clean 2023-07-09T21:41:29.307 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391110+0000', 'last_change': '2023-07-09T21:41:23.391110+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391110+0000', 'last_undegraded': '2023-07-09T21:41:23.391110+0000', 'last_fullsized': '2023-07-09T21:41:23.391110+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.307 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2e is not active+clean 2023-07-09T21:41:29.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396385+0000', 'last_change': '2023-07-09T21:41:23.396385+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396385+0000', 'last_undegraded': '2023-07-09T21:41:23.396385+0000', 'last_fullsized': '2023-07-09T21:41:23.396385+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.308 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2d is not active+clean 2023-07-09T21:41:29.308 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392980+0000', 'last_change': '2023-07-09T21:41:23.392980+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392980+0000', 'last_undegraded': '2023-07-09T21:41:23.392980+0000', 'last_fullsized': '2023-07-09T21:41:23.392980+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2c is not active+clean 2023-07-09T21:41:29.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.393625+0000', 'last_change': '2023-07-09T21:41:23.393625+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.393625+0000', 'last_undegraded': '2023-07-09T21:41:23.393625+0000', 'last_fullsized': '2023-07-09T21:41:23.393625+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2b is not active+clean 2023-07-09T21:41:29.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.398769+0000', 'last_change': '2023-07-09T21:41:23.398769+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.398769+0000', 'last_undegraded': '2023-07-09T21:41:23.398769+0000', 'last_fullsized': '2023-07-09T21:41:23.398769+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2a is not active+clean 2023-07-09T21:41:29.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391682+0000', 'last_change': '2023-07-09T21:41:23.391682+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391682+0000', 'last_undegraded': '2023-07-09T21:41:23.391682+0000', 'last_fullsized': '2023-07-09T21:41:23.391682+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.29 is not active+clean 2023-07-09T21:41:29.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390312+0000', 'last_change': '2023-07-09T21:41:23.390312+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390312+0000', 'last_undegraded': '2023-07-09T21:41:23.390312+0000', 'last_fullsized': '2023-07-09T21:41:23.390312+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.28 is not active+clean 2023-07-09T21:41:29.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391809+0000', 'last_change': '2023-07-09T21:41:23.391809+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391809+0000', 'last_undegraded': '2023-07-09T21:41:23.391809+0000', 'last_fullsized': '2023-07-09T21:41:23.391809+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.27 is not active+clean 2023-07-09T21:41:29.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395829+0000', 'last_change': '2023-07-09T21:41:23.395829+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395829+0000', 'last_undegraded': '2023-07-09T21:41:23.395829+0000', 'last_fullsized': '2023-07-09T21:41:23.395829+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.26 is not active+clean 2023-07-09T21:41:29.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395216+0000', 'last_change': '2023-07-09T21:41:23.395216+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395216+0000', 'last_undegraded': '2023-07-09T21:41:23.395216+0000', 'last_fullsized': '2023-07-09T21:41:23.395216+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.25 is not active+clean 2023-07-09T21:41:29.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.397472+0000', 'last_change': '2023-07-09T21:41:23.397472+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.397472+0000', 'last_undegraded': '2023-07-09T21:41:23.397472+0000', 'last_fullsized': '2023-07-09T21:41:23.397472+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.24 is not active+clean 2023-07-09T21:41:29.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395816+0000', 'last_change': '2023-07-09T21:41:23.395816+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395816+0000', 'last_undegraded': '2023-07-09T21:41:23.395816+0000', 'last_fullsized': '2023-07-09T21:41:23.395816+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.23 is not active+clean 2023-07-09T21:41:29.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389429+0000', 'last_change': '2023-07-09T21:41:23.389429+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389429+0000', 'last_undegraded': '2023-07-09T21:41:23.389429+0000', 'last_fullsized': '2023-07-09T21:41:23.389429+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.22 is not active+clean 2023-07-09T21:41:29.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395295+0000', 'last_change': '2023-07-09T21:41:23.395295+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395295+0000', 'last_undegraded': '2023-07-09T21:41:23.395295+0000', 'last_fullsized': '2023-07-09T21:41:23.395295+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.21 is not active+clean 2023-07-09T21:41:29.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396491+0000', 'last_change': '2023-07-09T21:41:23.396491+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396491+0000', 'last_undegraded': '2023-07-09T21:41:23.396491+0000', 'last_fullsized': '2023-07-09T21:41:23.396491+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.20 is not active+clean 2023-07-09T21:41:29.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395835+0000', 'last_change': '2023-07-09T21:41:23.395835+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395835+0000', 'last_undegraded': '2023-07-09T21:41:23.395835+0000', 'last_fullsized': '2023-07-09T21:41:23.395835+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-07-09T21:41:29.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389107+0000', 'last_change': '2023-07-09T21:41:23.389107+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389107+0000', 'last_undegraded': '2023-07-09T21:41:23.389107+0000', 'last_fullsized': '2023-07-09T21:41:23.389107+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-07-09T21:41:29.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389527+0000', 'last_change': '2023-07-09T21:41:23.389527+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389527+0000', 'last_undegraded': '2023-07-09T21:41:23.389527+0000', 'last_fullsized': '2023-07-09T21:41:23.389527+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-07-09T21:41:29.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.394778+0000', 'last_change': '2023-07-09T21:41:23.394778+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.394778+0000', 'last_undegraded': '2023-07-09T21:41:23.394778+0000', 'last_fullsized': '2023-07-09T21:41:23.394778+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-07-09T21:41:29.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.397311+0000', 'last_change': '2023-07-09T21:41:23.397311+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.397311+0000', 'last_undegraded': '2023-07-09T21:41:23.397311+0000', 'last_fullsized': '2023-07-09T21:41:23.397311+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-07-09T21:41:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390712+0000', 'last_change': '2023-07-09T21:41:23.390712+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390712+0000', 'last_undegraded': '2023-07-09T21:41:23.390712+0000', 'last_fullsized': '2023-07-09T21:41:23.390712+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-07-09T21:41:29.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391939+0000', 'last_change': '2023-07-09T21:41:23.391939+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391939+0000', 'last_undegraded': '2023-07-09T21:41:23.391939+0000', 'last_fullsized': '2023-07-09T21:41:23.391939+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-07-09T21:41:29.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395939+0000', 'last_change': '2023-07-09T21:41:23.395939+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395939+0000', 'last_undegraded': '2023-07-09T21:41:23.395939+0000', 'last_fullsized': '2023-07-09T21:41:23.395939+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-07-09T21:41:29.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390184+0000', 'last_change': '2023-07-09T21:41:23.390184+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390184+0000', 'last_undegraded': '2023-07-09T21:41:23.390184+0000', 'last_fullsized': '2023-07-09T21:41:23.390184+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-07-09T21:41:29.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389722+0000', 'last_change': '2023-07-09T21:41:23.389722+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389722+0000', 'last_undegraded': '2023-07-09T21:41:23.389722+0000', 'last_fullsized': '2023-07-09T21:41:23.389722+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-07-09T21:41:29.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.393270+0000', 'last_change': '2023-07-09T21:41:23.393270+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.393270+0000', 'last_undegraded': '2023-07-09T21:41:23.393270+0000', 'last_fullsized': '2023-07-09T21:41:23.393270+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-07-09T21:41:29.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389013+0000', 'last_change': '2023-07-09T21:41:23.389013+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389013+0000', 'last_undegraded': '2023-07-09T21:41:23.389013+0000', 'last_fullsized': '2023-07-09T21:41:23.389013+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-07-09T21:41:29.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391533+0000', 'last_change': '2023-07-09T21:41:23.391533+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391533+0000', 'last_undegraded': '2023-07-09T21:41:23.391533+0000', 'last_fullsized': '2023-07-09T21:41:23.391533+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-07-09T21:41:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.397436+0000', 'last_change': '2023-07-09T21:41:23.397436+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.397436+0000', 'last_undegraded': '2023-07-09T21:41:23.397436+0000', 'last_fullsized': '2023-07-09T21:41:23.397436+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-07-09T21:41:29.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395930+0000', 'last_change': '2023-07-09T21:41:23.395930+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395930+0000', 'last_undegraded': '2023-07-09T21:41:23.395930+0000', 'last_fullsized': '2023-07-09T21:41:23.395930+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-07-09T21:41:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.398030+0000', 'last_change': '2023-07-09T21:41:23.398030+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.398030+0000', 'last_undegraded': '2023-07-09T21:41:23.398030+0000', 'last_fullsized': '2023-07-09T21:41:23.398030+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-07-09T21:41:29.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390717+0000', 'last_change': '2023-07-09T21:41:23.390717+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390717+0000', 'last_undegraded': '2023-07-09T21:41:23.390717+0000', 'last_fullsized': '2023-07-09T21:41:23.390717+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-07-09T21:41:29.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390168+0000', 'last_change': '2023-07-09T21:41:23.390168+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390168+0000', 'last_undegraded': '2023-07-09T21:41:23.390168+0000', 'last_fullsized': '2023-07-09T21:41:23.390168+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-07-09T21:41:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.394438+0000', 'last_change': '2023-07-09T21:41:23.394438+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.394438+0000', 'last_undegraded': '2023-07-09T21:41:23.394438+0000', 'last_fullsized': '2023-07-09T21:41:23.394438+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:41:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-07-09T21:41:29.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390950+0000', 'last_change': '2023-07-09T21:41:23.390950+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390950+0000', 'last_undegraded': '2023-07-09T21:41:23.390950+0000', 'last_fullsized': '2023-07-09T21:41:23.390950+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-07-09T21:41:29.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.397752+0000', 'last_change': '2023-07-09T21:41:23.397752+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.397752+0000', 'last_undegraded': '2023-07-09T21:41:23.397752+0000', 'last_fullsized': '2023-07-09T21:41:23.397752+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-07-09T21:41:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389067+0000', 'last_change': '2023-07-09T21:41:23.389067+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389067+0000', 'last_undegraded': '2023-07-09T21:41:23.389067+0000', 'last_fullsized': '2023-07-09T21:41:23.389067+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-07-09T21:41:29.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.389072+0000', 'last_change': '2023-07-09T21:41:23.389072+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.389072+0000', 'last_undegraded': '2023-07-09T21:41:23.389072+0000', 'last_fullsized': '2023-07-09T21:41:23.389072+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-07-09T21:41:29.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.400844+0000', 'last_change': '2023-07-09T21:41:23.400844+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.400844+0000', 'last_undegraded': '2023-07-09T21:41:23.400844+0000', 'last_fullsized': '2023-07-09T21:41:23.400844+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:41:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-07-09T21:41:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.400113+0000', 'last_change': '2023-07-09T21:41:23.400113+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.400113+0000', 'last_undegraded': '2023-07-09T21:41:23.400113+0000', 'last_fullsized': '2023-07-09T21:41:23.400113+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-07-09T21:41:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.396486+0000', 'last_change': '2023-07-09T21:41:23.396486+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.396486+0000', 'last_undegraded': '2023-07-09T21:41:23.396486+0000', 'last_fullsized': '2023-07-09T21:41:23.396486+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:41:29.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-07-09T21:41:29.334 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.395655+0000', 'last_change': '2023-07-09T21:41:23.395655+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.395655+0000', 'last_undegraded': '2023-07-09T21:41:23.395655+0000', 'last_fullsized': '2023-07-09T21:41:23.395655+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:41:29.334 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-07-09T21:41:29.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392010+0000', 'last_change': '2023-07-09T21:41:23.392010+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392010+0000', 'last_undegraded': '2023-07-09T21:41:23.392010+0000', 'last_fullsized': '2023-07-09T21:41:23.392010+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:41:29.335 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-07-09T21:41:29.335 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.394653+0000', 'last_change': '2023-07-09T21:41:23.394653+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.394653+0000', 'last_undegraded': '2023-07-09T21:41:23.394653+0000', 'last_fullsized': '2023-07-09T21:41:23.394653+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-07-09T21:41:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.391224+0000', 'last_change': '2023-07-09T21:41:23.391224+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.391224+0000', 'last_undegraded': '2023-07-09T21:41:23.391224+0000', 'last_fullsized': '2023-07-09T21:41:23.391224+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:41:29.336 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-07-09T21:41:29.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.390208+0000', 'last_change': '2023-07-09T21:41:23.390208+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.390208+0000', 'last_undegraded': '2023-07-09T21:41:23.390208+0000', 'last_fullsized': '2023-07-09T21:41:23.390208+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:41:29.337 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-07-09T21:41:29.337 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392402+0000', 'last_change': '2023-07-09T21:41:23.392402+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392402+0000', 'last_undegraded': '2023-07-09T21:41:23.392402+0000', 'last_fullsized': '2023-07-09T21:41:23.392402+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.338 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-07-09T21:41:29.338 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 127, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:41:23.392389+0000', 'last_change': '2023-07-09T21:41:23.392389+0000', 'last_active': '2023-07-09T21:41:23.375678+0000', 'last_peered': '2023-07-09T21:41:23.375678+0000', 'last_clean': '2023-07-09T21:41:23.375678+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:41:23.392389+0000', 'last_undegraded': '2023-07-09T21:41:23.392389+0000', 'last_fullsized': '2023-07-09T21:41:23.392389+0000', 'mapping_epoch': 127, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 127, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'last_clean_scrub_stamp': '2023-07-09T21:41:23.375678+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:41:29.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:41:29.367 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-09T21:41:29.369+0000 7f2d97338640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:41:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 Processor -- start 2023-07-09T21:41:29.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 -- start start 2023-07-09T21:41:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f631c0b4340 0x7f631c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f631c0cef80 0x7f631c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631c0b49f0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c0b7e80 con 0x7f631c0b4340 2023-07-09T21:41:29.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.481+0000 7f6323cec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631c0cc8a0 con 0x7f631c0cef80 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f631c0b4340 0x7f631c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f631c0b4340 0x7f631c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38724/0 (socket says 172.21.15.37:38724) 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 -- 172.21.15.37:0/452764552 learned_addr learned my addr 172.21.15.37:0/452764552 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6322289640 1 --2- 172.21.15.37:0/452764552 >> v2:172.21.15.119:3300/0 conn(0x7f631c0cef80 0x7f631c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 -- 172.21.15.37:0/452764552 >> v2:172.21.15.119:3300/0 conn(0x7f631c0cef80 msgr2=0x7f631c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:29.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 --2- 172.21.15.37:0/452764552 >> v2:172.21.15.119:3300/0 conn(0x7f631c0cef80 0x7f631c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 -- 172.21.15.37:0/452764552 >> v1:172.21.15.119:6789/0 conn(0x7f631c0b7ab0 legacy=0x7f631c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 -- 172.21.15.37:0/452764552 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c0ccb80 con 0x7f631c0b4340 2023-07-09T21:41:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6321287640 1 --2- 172.21.15.37:0/452764552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b4340 0x7f631c06aa50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f631c08b5b0 tx=0x7f630c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e63f93e51725e93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6320a86640 1 -- 172.21.15.37:0/452764552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0aa430 con 0x7f631c0b4340 2023-07-09T21:41:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6320a86640 1 -- 172.21.15.37:0/452764552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c0aa590 con 0x7f631c0b4340 2023-07-09T21:41:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.485+0000 7f6320a86640 1 -- 172.21.15.37:0/452764552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0aa920 con 0x7f631c0b4340 2023-07-09T21:41:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- 172.21.15.37:0/452764552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b4340 msgr2=0x7f631c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- 172.21.15.37:0/452764552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b4340 0x7f631c06aa50 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f631c08b5b0 tx=0x7f630c01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- 172.21.15.37:0/452764552 shutdown_connections 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- 172.21.15.37:0/452764552 >> v2:172.21.15.119:3300/0 conn(0x7f631c0cef80 0x7f631c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- 172.21.15.37:0/452764552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b4340 0x7f631c06aa50 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- 172.21.15.37:0/452764552 >> 172.21.15.37:0/452764552 conn(0x7f631c073090 msgr2=0x7f631c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:29.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- 172.21.15.37:0/452764552 shutdown_connections 2023-07-09T21:41:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- 172.21.15.37:0/452764552 wait complete. 2023-07-09T21:41:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 Processor -- start 2023-07-09T21:41:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- start start 2023-07-09T21:41:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 0x7f631c0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0cef80 0x7f631c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c14e9d0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0cbc10 con 0x7f631c0b4340 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6323cec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f631c0cbef0 con 0x7f631c0cef80 2023-07-09T21:41:29.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38732/0 (socket says 172.21.15.37:38732) 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 -- 172.21.15.37:0/1987783698 learned_addr learned my addr 172.21.15.37:0/1987783698 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321a88640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 0x7f631c0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6322289640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0cef80 0x7f631c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 -- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0cef80 msgr2=0x7f631c0c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0cef80 0x7f631c0c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 -- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 msgr2=0x7f631c0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 0x7f631c0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321287640 1 -- 172.21.15.37:0/1987783698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0094d0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.489+0000 7f6321a88640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 0x7f631c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:41:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f6321287640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f630c0190e0 tx=0x7f630c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0aa430 con 0x7f631c0b7ab0 2023-07-09T21:41:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c0b3820 con 0x7f631c0b7ab0 2023-07-09T21:41:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c0b3bd0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f631c0cc1d0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f631c14d490 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f631c14d680 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f630c0b3d30 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 0x7f6300068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f630c11e0a0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.493+0000 7f6321a88640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 0x7f6300068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.497+0000 7f6321a88640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 0x7f6300068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f631c0c50e0 tx=0x7f6318009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.497+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f630c0eb440 con 0x7f631c0b7ab0 2023-07-09T21:41:29.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.709+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f631c04d7d0 con 0x7f631c0b7ab0 2023-07-09T21:41:29.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f63127fc640 1 -- 172.21.15.37:0/1987783698 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f630c0c3080 con 0x7f631c0b7ab0 2023-07-09T21:41:29.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:29.711 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1164,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":340291584,"bytes_avail":772753821696,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":55,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":8448}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2023-07-09T21:41:12.033655+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:41:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 msgr2=0x7f6300068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 0x7f6300068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f631c0c50e0 tx=0x7f6318009040 comp rx=0 tx=0).stop 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 msgr2=0x7f631c14c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f630c0190e0 tx=0x7f630c01ad10 comp rx=0 tx=0).stop 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 shutdown_connections 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f63000663a0 0x7f6300068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f631c0cef80 0x7f631c0c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f631c0b7ab0 0x7f631c14c900 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 --2- 172.21.15.37:0/1987783698 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f631c0b4340 0x7f631c0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 >> 172.21.15.37:0/1987783698 conn(0x7f631c073090 msgr2=0x7f631c154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 shutdown_connections 2023-07-09T21:41:29.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.713+0000 7f6323cec640 1 -- 172.21.15.37:0/1987783698 wait complete. 2023-07-09T21:41:29.732 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:41:29.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:41:29.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 Processor -- start 2023-07-09T21:41:29.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 -- start start 2023-07-09T21:41:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400b4340 0x7f3b4006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b400cef80 0x7f3b400d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400b49f0 con 0x7f3b400b7ab0 2023-07-09T21:41:29.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400b7e80 con 0x7f3b400cef80 2023-07-09T21:41:29.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b4610d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b400cc8a0 con 0x7f3b400b4340 2023-07-09T21:41:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b400cef80 0x7f3b400d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b400b7ab0 0x7f3b400b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2023-07-09T21:41:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3f7fe640 1 -- 172.21.15.37:0/3910083756 learned_addr learned my addr 172.21.15.37:0/3910083756 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:29.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3effd640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400b4340 0x7f3b4006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3ffff640 1 -- 172.21.15.37:0/3910083756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400b4340 msgr2=0x7f3b4006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3ffff640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400b4340 0x7f3b4006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3ffff640 1 -- 172.21.15.37:0/3910083756 >> v1:172.21.15.37:6789/0 conn(0x7f3b400b7ab0 legacy=0x7f3b400b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3ffff640 1 -- 172.21.15.37:0/3910083756 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400ccb80 con 0x7f3b400cef80 2023-07-09T21:41:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.917+0000 7f3b3e7fc640 1 -- 172.21.15.37:0/3910083756 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711919930 0 0) 0x7f3b400b49f0 con 0x7f3b400b7ab0 2023-07-09T21:41:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b3ffff640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400cef80 0x7f3b400d02a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009d90 tx=0x7f3b3801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a4faf6d02058f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b3e7fc640 1 -- 172.21.15.37:0/3910083756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380a59e0 con 0x7f3b400cef80 2023-07-09T21:41:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b3e7fc640 1 -- 172.21.15.37:0/3910083756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b380a5b40 con 0x7f3b400cef80 2023-07-09T21:41:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b3e7fc640 1 -- 172.21.15.37:0/3910083756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b380ad440 con 0x7f3b400cef80 2023-07-09T21:41:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 -- 172.21.15.37:0/3910083756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400cef80 msgr2=0x7f3b400d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400cef80 0x7f3b400d02a0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f3b38009d90 tx=0x7f3b3801c920 comp rx=0 tx=0).stop 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 -- 172.21.15.37:0/3910083756 shutdown_connections 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400cef80 0x7f3b400d02a0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3910083756 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400b4340 0x7f3b4006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 -- 172.21.15.37:0/3910083756 >> 172.21.15.37:0/3910083756 conn(0x7f3b40073090 msgr2=0x7f3b40069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 -- 172.21.15.37:0/3910083756 shutdown_connections 2023-07-09T21:41:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.921+0000 7f3b4610d640 1 -- 172.21.15.37:0/3910083756 wait complete. 2023-07-09T21:41:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 Processor -- start 2023-07-09T21:41:29.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 -- start start 2023-07-09T21:41:29.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b400b7ab0 0x7f3b4015d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400cef80 0x7f3b4015d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4015e080 con 0x7f3b400b4340 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4015dda0 con 0x7f3b400b7ab0 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b40159120 con 0x7f3b400cef80 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38756/0 (socket says 172.21.15.37:38756) 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 -- 172.21.15.37:0/3711525535 learned_addr learned my addr 172.21.15.37:0/3711525535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 -- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400cef80 msgr2=0x7f3b4015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400cef80 0x7f3b4015d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 -- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b400b7ab0 msgr2=0x7f3b4015d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b400b7ab0 0x7f3b4015d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 -- 172.21.15.37:0/3711525535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b38009a70 con 0x7f3b400b4340 2023-07-09T21:41:29.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b3f7fe640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3b300011f0 tx=0x7f3b3000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300074e0 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30007640 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30004a10 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.925+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b40159400 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b40157c60 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b40159920 con 0x7f3b400b4340 2023-07-09T21:41:29.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b30004b70 con 0x7f3b400b4340 2023-07-09T21:41:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b27fff640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 0x7f3b2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3b300830f0 con 0x7f3b400b4340 2023-07-09T21:41:29.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b3effd640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 0x7f3b2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.929+0000 7f3b3effd640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 0x7f3b2c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b4780 tx=0x7f3b34008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:29.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:29.933+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b40159920 con 0x7f3b400b4340 2023-07-09T21:41:30.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.089+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3b400cf4d0 con 0x7f3b2c0663a0 2023-07-09T21:41:30.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.097+0000 7f3b27fff640 1 -- 172.21.15.37:0/3711525535 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312177 (secure 0 0 0) 0x7f3b34009120 con 0x7f3b2c0663a0 2023-07-09T21:41:30.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:30.102 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:41:30.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 msgr2=0x7f3b2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:30.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 0x7f3b2c068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b4780 tx=0x7f3b34008040 comp rx=0 tx=0).stop 2023-07-09T21:41:30.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 msgr2=0x7f3b401570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:30.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f3b300011f0 tx=0x7f3b3000c9b0 comp rx=0 tx=0).stop 2023-07-09T21:41:30.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 shutdown_connections 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3b2c0663a0 0x7f3b2c068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b400cef80 0x7f3b4015d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b400b7ab0 0x7f3b4015d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 --2- 172.21.15.37:0/3711525535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b400b4340 0x7f3b401570f0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 >> 172.21.15.37:0/3711525535 conn(0x7f3b40073090 msgr2=0x7f3b4006a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 shutdown_connections 2023-07-09T21:41:30.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:30.101+0000 7f3b4610d640 1 -- 172.21.15.37:0/3711525535 wait complete. 2023-07-09T21:41:30.120 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:41:30.037752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332584,"kb_used_data":13672,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642136,"statfs":{"total":773094113280,"available":772753547264,"internally_reserved":0,"allocated":14000128,"data_stored":7655556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.647043"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426336+0000","last_change":"2023-07-09T21:41:24.407078+0000","last_active":"2023-07-09T21:41:25.426336+0000","last_peered":"2023-07-09T21:41:25.426336+0000","last_clean":"2023-07-09T21:41:25.426336+0000","last_became_active":"2023-07-09T21:41:24.406793+0000","last_became_peered":"2023-07-09T21:41:24.406793+0000","last_unstale":"2023-07-09T21:41:25.426336+0000","last_undegraded":"2023-07-09T21:41:25.426336+0000","last_fullsized":"2023-07-09T21:41:25.426336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:51:56.006647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398132+0000","last_change":"2023-07-09T21:41:24.424413+0000","last_active":"2023-07-09T21:41:25.398132+0000","last_peered":"2023-07-09T21:41:25.398132+0000","last_clean":"2023-07-09T21:41:25.398132+0000","last_became_active":"2023-07-09T21:41:24.420731+0000","last_became_peered":"2023-07-09T21:41:24.420731+0000","last_unstale":"2023-07-09T21:41:25.398132+0000","last_undegraded":"2023-07-09T21:41:25.398132+0000","last_fullsized":"2023-07-09T21:41:25.398132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:21:08.088967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426161+0000","last_change":"2023-07-09T21:41:24.412921+0000","last_active":"2023-07-09T21:41:25.426161+0000","last_peered":"2023-07-09T21:41:25.426161+0000","last_clean":"2023-07-09T21:41:25.426161+0000","last_became_active":"2023-07-09T21:41:24.412638+0000","last_became_peered":"2023-07-09T21:41:24.412638+0000","last_unstale":"2023-07-09T21:41:25.426161+0000","last_undegraded":"2023-07-09T21:41:25.426161+0000","last_fullsized":"2023-07-09T21:41:25.426161+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:31.313704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424468+0000","last_change":"2023-07-09T21:41:24.406975+0000","last_active":"2023-07-09T21:41:25.424468+0000","last_peered":"2023-07-09T21:41:25.424468+0000","last_clean":"2023-07-09T21:41:25.424468+0000","last_became_active":"2023-07-09T21:41:24.406632+0000","last_became_peered":"2023-07-09T21:41:24.406632+0000","last_unstale":"2023-07-09T21:41:25.424468+0000","last_undegraded":"2023-07-09T21:41:25.424468+0000","last_fullsized":"2023-07-09T21:41:25.424468+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:13.745867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425423+0000","last_change":"2023-07-09T21:41:24.412920+0000","last_active":"2023-07-09T21:41:25.425423+0000","last_peered":"2023-07-09T21:41:25.425423+0000","last_clean":"2023-07-09T21:41:25.425423+0000","last_became_active":"2023-07-09T21:41:24.412611+0000","last_became_peered":"2023-07-09T21:41:24.412611+0000","last_unstale":"2023-07-09T21:41:25.425423+0000","last_undegraded":"2023-07-09T21:41:25.425423+0000","last_fullsized":"2023-07-09T21:41:25.425423+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:08.469032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397550+0000","last_change":"2023-07-09T21:41:24.422318+0000","last_active":"2023-07-09T21:41:25.397550+0000","last_peered":"2023-07-09T21:41:25.397550+0000","last_clean":"2023-07-09T21:41:25.397550+0000","last_became_active":"2023-07-09T21:41:24.421796+0000","last_became_peered":"2023-07-09T21:41:24.421796+0000","last_unstale":"2023-07-09T21:41:25.397550+0000","last_undegraded":"2023-07-09T21:41:25.397550+0000","last_fullsized":"2023-07-09T21:41:25.397550+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:13.585361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397509+0000","last_change":"2023-07-09T21:41:24.422113+0000","last_active":"2023-07-09T21:41:25.397509+0000","last_peered":"2023-07-09T21:41:25.397509+0000","last_clean":"2023-07-09T21:41:25.397509+0000","last_became_active":"2023-07-09T21:41:24.421729+0000","last_became_peered":"2023-07-09T21:41:24.421729+0000","last_unstale":"2023-07-09T21:41:25.397509+0000","last_undegraded":"2023-07-09T21:41:25.397509+0000","last_fullsized":"2023-07-09T21:41:25.397509+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:20.860287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424039+0000","last_change":"2023-07-09T21:41:24.409951+0000","last_active":"2023-07-09T21:41:25.424039+0000","last_peered":"2023-07-09T21:41:25.424039+0000","last_clean":"2023-07-09T21:41:25.424039+0000","last_became_active":"2023-07-09T21:41:24.409683+0000","last_became_peered":"2023-07-09T21:41:24.409683+0000","last_unstale":"2023-07-09T21:41:25.424039+0000","last_undegraded":"2023-07-09T21:41:25.424039+0000","last_fullsized":"2023-07-09T21:41:25.424039+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:54.080545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398045+0000","last_change":"2023-07-09T21:41:24.413844+0000","last_active":"2023-07-09T21:41:25.398045+0000","last_peered":"2023-07-09T21:41:25.398045+0000","last_clean":"2023-07-09T21:41:25.398045+0000","last_became_active":"2023-07-09T21:41:24.413460+0000","last_became_peered":"2023-07-09T21:41:24.413460+0000","last_unstale":"2023-07-09T21:41:25.398045+0000","last_undegraded":"2023-07-09T21:41:25.398045+0000","last_fullsized":"2023-07-09T21:41:25.398045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:04.073772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425075+0000","last_change":"2023-07-09T21:41:24.407150+0000","last_active":"2023-07-09T21:41:25.425075+0000","last_peered":"2023-07-09T21:41:25.425075+0000","last_clean":"2023-07-09T21:41:25.425075+0000","last_became_active":"2023-07-09T21:41:24.406811+0000","last_became_peered":"2023-07-09T21:41:24.406811+0000","last_unstale":"2023-07-09T21:41:25.425075+0000","last_undegraded":"2023-07-09T21:41:25.425075+0000","last_fullsized":"2023-07-09T21:41:25.425075+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:44:38.940984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402674+0000","last_change":"2023-07-09T21:41:24.411287+0000","last_active":"2023-07-09T21:41:25.402674+0000","last_peered":"2023-07-09T21:41:25.402674+0000","last_clean":"2023-07-09T21:41:25.402674+0000","last_became_active":"2023-07-09T21:41:24.410379+0000","last_became_peered":"2023-07-09T21:41:24.410379+0000","last_unstale":"2023-07-09T21:41:25.402674+0000","last_undegraded":"2023-07-09T21:41:25.402674+0000","last_fullsized":"2023-07-09T21:41:25.402674+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:04:22.131042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401402+0000","last_change":"2023-07-09T21:41:24.414135+0000","last_active":"2023-07-09T21:41:25.401402+0000","last_peered":"2023-07-09T21:41:25.401402+0000","last_clean":"2023-07-09T21:41:25.401402+0000","last_became_active":"2023-07-09T21:41:24.413459+0000","last_became_peered":"2023-07-09T21:41:24.413459+0000","last_unstale":"2023-07-09T21:41:25.401402+0000","last_undegraded":"2023-07-09T21:41:25.401402+0000","last_fullsized":"2023-07-09T21:41:25.401402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:28.383461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424112+0000","last_change":"2023-07-09T21:41:24.412787+0000","last_active":"2023-07-09T21:41:25.424112+0000","last_peered":"2023-07-09T21:41:25.424112+0000","last_clean":"2023-07-09T21:41:25.424112+0000","last_became_active":"2023-07-09T21:41:24.412514+0000","last_became_peered":"2023-07-09T21:41:24.412514+0000","last_unstale":"2023-07-09T21:41:25.424112+0000","last_undegraded":"2023-07-09T21:41:25.424112+0000","last_fullsized":"2023-07-09T21:41:25.424112+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:33.530443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428819+0000","last_change":"2023-07-09T21:41:24.417589+0000","last_active":"2023-07-09T21:41:25.428819+0000","last_peered":"2023-07-09T21:41:25.428819+0000","last_clean":"2023-07-09T21:41:25.428819+0000","last_became_active":"2023-07-09T21:41:24.417228+0000","last_became_peered":"2023-07-09T21:41:24.417228+0000","last_unstale":"2023-07-09T21:41:25.428819+0000","last_undegraded":"2023-07-09T21:41:25.428819+0000","last_fullsized":"2023-07-09T21:41:25.428819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:45.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428821+0000","last_change":"2023-07-09T21:41:24.418757+0000","last_active":"2023-07-09T21:41:25.428821+0000","last_peered":"2023-07-09T21:41:25.428821+0000","last_clean":"2023-07-09T21:41:25.428821+0000","last_became_active":"2023-07-09T21:41:24.418468+0000","last_became_peered":"2023-07-09T21:41:24.418468+0000","last_unstale":"2023-07-09T21:41:25.428821+0000","last_undegraded":"2023-07-09T21:41:25.428821+0000","last_fullsized":"2023-07-09T21:41:25.428821+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:11.903265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428921+0000","last_change":"2023-07-09T21:41:24.423747+0000","last_active":"2023-07-09T21:41:25.428921+0000","last_peered":"2023-07-09T21:41:25.428921+0000","last_clean":"2023-07-09T21:41:25.428921+0000","last_became_active":"2023-07-09T21:41:24.423242+0000","last_became_peered":"2023-07-09T21:41:24.423242+0000","last_unstale":"2023-07-09T21:41:25.428921+0000","last_undegraded":"2023-07-09T21:41:25.428921+0000","last_fullsized":"2023-07-09T21:41:25.428921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:16.296325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426392+0000","last_change":"2023-07-09T21:41:24.413371+0000","last_active":"2023-07-09T21:41:25.426392+0000","last_peered":"2023-07-09T21:41:25.426392+0000","last_clean":"2023-07-09T21:41:25.426392+0000","last_became_active":"2023-07-09T21:41:24.413089+0000","last_became_peered":"2023-07-09T21:41:24.413089+0000","last_unstale":"2023-07-09T21:41:25.426392+0000","last_undegraded":"2023-07-09T21:41:25.426392+0000","last_fullsized":"2023-07-09T21:41:25.426392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:56:07.183160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398151+0000","last_change":"2023-07-09T21:41:24.424325+0000","last_active":"2023-07-09T21:41:25.398151+0000","last_peered":"2023-07-09T21:41:25.398151+0000","last_clean":"2023-07-09T21:41:25.398151+0000","last_became_active":"2023-07-09T21:41:24.422074+0000","last_became_peered":"2023-07-09T21:41:24.422074+0000","last_unstale":"2023-07-09T21:41:25.398151+0000","last_undegraded":"2023-07-09T21:41:25.398151+0000","last_fullsized":"2023-07-09T21:41:25.398151+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:27.042812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426297+0000","last_change":"2023-07-09T21:41:24.405414+0000","last_active":"2023-07-09T21:41:25.426297+0000","last_peered":"2023-07-09T21:41:25.426297+0000","last_clean":"2023-07-09T21:41:25.426297+0000","last_became_active":"2023-07-09T21:41:24.405152+0000","last_became_peered":"2023-07-09T21:41:24.405152+0000","last_unstale":"2023-07-09T21:41:25.426297+0000","last_undegraded":"2023-07-09T21:41:25.426297+0000","last_fullsized":"2023-07-09T21:41:25.426297+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:06.278029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401628+0000","last_change":"2023-07-09T21:41:24.420800+0000","last_active":"2023-07-09T21:41:25.401628+0000","last_peered":"2023-07-09T21:41:25.401628+0000","last_clean":"2023-07-09T21:41:25.401628+0000","last_became_active":"2023-07-09T21:41:24.420520+0000","last_became_peered":"2023-07-09T21:41:24.420520+0000","last_unstale":"2023-07-09T21:41:25.401628+0000","last_undegraded":"2023-07-09T21:41:25.401628+0000","last_fullsized":"2023-07-09T21:41:25.401628+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:46.901803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424304+0000","last_change":"2023-07-09T21:41:24.409314+0000","last_active":"2023-07-09T21:41:25.424304+0000","last_peered":"2023-07-09T21:41:25.424304+0000","last_clean":"2023-07-09T21:41:25.424304+0000","last_became_active":"2023-07-09T21:41:24.408990+0000","last_became_peered":"2023-07-09T21:41:24.408990+0000","last_unstale":"2023-07-09T21:41:25.424304+0000","last_undegraded":"2023-07-09T21:41:25.424304+0000","last_fullsized":"2023-07-09T21:41:25.424304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:09:32.724352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424409+0000","last_change":"2023-07-09T21:41:24.408336+0000","last_active":"2023-07-09T21:41:25.424409+0000","last_peered":"2023-07-09T21:41:25.424409+0000","last_clean":"2023-07-09T21:41:25.424409+0000","last_became_active":"2023-07-09T21:41:24.407666+0000","last_became_peered":"2023-07-09T21:41:24.407666+0000","last_unstale":"2023-07-09T21:41:25.424409+0000","last_undegraded":"2023-07-09T21:41:25.424409+0000","last_fullsized":"2023-07-09T21:41:25.424409+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:34.881173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426284+0000","last_change":"2023-07-09T21:41:24.404248+0000","last_active":"2023-07-09T21:41:25.426284+0000","last_peered":"2023-07-09T21:41:25.426284+0000","last_clean":"2023-07-09T21:41:25.426284+0000","last_became_active":"2023-07-09T21:41:24.403938+0000","last_became_peered":"2023-07-09T21:41:24.403938+0000","last_unstale":"2023-07-09T21:41:25.426284+0000","last_undegraded":"2023-07-09T21:41:25.426284+0000","last_fullsized":"2023-07-09T21:41:25.426284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:40:30.190436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424834+0000","last_change":"2023-07-09T21:41:24.408573+0000","last_active":"2023-07-09T21:41:25.424834+0000","last_peered":"2023-07-09T21:41:25.424834+0000","last_clean":"2023-07-09T21:41:25.424834+0000","last_became_active":"2023-07-09T21:41:24.408261+0000","last_became_peered":"2023-07-09T21:41:24.408261+0000","last_unstale":"2023-07-09T21:41:25.424834+0000","last_undegraded":"2023-07-09T21:41:25.424834+0000","last_fullsized":"2023-07-09T21:41:25.424834+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:31:33.694325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401880+0000","last_change":"2023-07-09T21:41:24.416964+0000","last_active":"2023-07-09T21:41:25.401880+0000","last_peered":"2023-07-09T21:41:25.401880+0000","last_clean":"2023-07-09T21:41:25.401880+0000","last_became_active":"2023-07-09T21:41:24.415982+0000","last_became_peered":"2023-07-09T21:41:24.415982+0000","last_unstale":"2023-07-09T21:41:25.401880+0000","last_undegraded":"2023-07-09T21:41:25.401880+0000","last_fullsized":"2023-07-09T21:41:25.401880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:41.114037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401894+0000","last_change":"2023-07-09T21:41:24.409487+0000","last_active":"2023-07-09T21:41:25.401894+0000","last_peered":"2023-07-09T21:41:25.401894+0000","last_clean":"2023-07-09T21:41:25.401894+0000","last_became_active":"2023-07-09T21:41:24.409222+0000","last_became_peered":"2023-07-09T21:41:24.409222+0000","last_unstale":"2023-07-09T21:41:25.401894+0000","last_undegraded":"2023-07-09T21:41:25.401894+0000","last_fullsized":"2023-07-09T21:41:25.401894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:18.351485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402525+0000","last_change":"2023-07-09T21:41:24.418453+0000","last_active":"2023-07-09T21:41:25.402525+0000","last_peered":"2023-07-09T21:41:25.402525+0000","last_clean":"2023-07-09T21:41:25.402525+0000","last_became_active":"2023-07-09T21:41:24.418120+0000","last_became_peered":"2023-07-09T21:41:24.418120+0000","last_unstale":"2023-07-09T21:41:25.402525+0000","last_undegraded":"2023-07-09T21:41:25.402525+0000","last_fullsized":"2023-07-09T21:41:25.402525+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:23.791449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397753+0000","last_change":"2023-07-09T21:41:24.418500+0000","last_active":"2023-07-09T21:41:25.397753+0000","last_peered":"2023-07-09T21:41:25.397753+0000","last_clean":"2023-07-09T21:41:25.397753+0000","last_became_active":"2023-07-09T21:41:24.418159+0000","last_became_peered":"2023-07-09T21:41:24.418159+0000","last_unstale":"2023-07-09T21:41:25.397753+0000","last_undegraded":"2023-07-09T21:41:25.397753+0000","last_fullsized":"2023-07-09T21:41:25.397753+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:29.797478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424433+0000","last_change":"2023-07-09T21:41:24.414746+0000","last_active":"2023-07-09T21:41:25.424433+0000","last_peered":"2023-07-09T21:41:25.424433+0000","last_clean":"2023-07-09T21:41:25.424433+0000","last_became_active":"2023-07-09T21:41:24.414429+0000","last_became_peered":"2023-07-09T21:41:24.414429+0000","last_unstale":"2023-07-09T21:41:25.424433+0000","last_undegraded":"2023-07-09T21:41:25.424433+0000","last_fullsized":"2023-07-09T21:41:25.424433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:45:37.395282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401457+0000","last_change":"2023-07-09T21:41:24.416286+0000","last_active":"2023-07-09T21:41:25.401457+0000","last_peered":"2023-07-09T21:41:25.401457+0000","last_clean":"2023-07-09T21:41:25.401457+0000","last_became_active":"2023-07-09T21:41:24.416021+0000","last_became_peered":"2023-07-09T21:41:24.416021+0000","last_unstale":"2023-07-09T21:41:25.401457+0000","last_undegraded":"2023-07-09T21:41:25.401457+0000","last_fullsized":"2023-07-09T21:41:25.401457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:59:03.591123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397523+0000","last_change":"2023-07-09T21:41:24.422382+0000","last_active":"2023-07-09T21:41:25.397523+0000","last_peered":"2023-07-09T21:41:25.397523+0000","last_clean":"2023-07-09T21:41:25.397523+0000","last_became_active":"2023-07-09T21:41:24.422046+0000","last_became_peered":"2023-07-09T21:41:24.422046+0000","last_unstale":"2023-07-09T21:41:25.397523+0000","last_undegraded":"2023-07-09T21:41:25.397523+0000","last_fullsized":"2023-07-09T21:41:25.397523+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:05.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424167+0000","last_change":"2023-07-09T21:41:24.401379+0000","last_active":"2023-07-09T21:41:25.424167+0000","last_peered":"2023-07-09T21:41:25.424167+0000","last_clean":"2023-07-09T21:41:25.424167+0000","last_became_active":"2023-07-09T21:41:24.401120+0000","last_became_peered":"2023-07-09T21:41:24.401120+0000","last_unstale":"2023-07-09T21:41:25.424167+0000","last_undegraded":"2023-07-09T21:41:25.424167+0000","last_fullsized":"2023-07-09T21:41:25.424167+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:16.656481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425815+0000","last_change":"2023-07-09T21:41:24.403551+0000","last_active":"2023-07-09T21:41:25.425815+0000","last_peered":"2023-07-09T21:41:25.425815+0000","last_clean":"2023-07-09T21:41:25.425815+0000","last_became_active":"2023-07-09T21:41:24.403172+0000","last_became_peered":"2023-07-09T21:41:24.403172+0000","last_unstale":"2023-07-09T21:41:25.425815+0000","last_undegraded":"2023-07-09T21:41:25.425815+0000","last_fullsized":"2023-07-09T21:41:25.425815+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:02:49.922966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"128'4","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425582+0000","last_change":"2023-07-09T21:41:23.410170+0000","last_active":"2023-07-09T21:41:25.425582+0000","last_peered":"2023-07-09T21:41:25.425582+0000","last_clean":"2023-07-09T21:41:25.425582+0000","last_became_active":"2023-07-09T21:41:23.409871+0000","last_became_peered":"2023-07-09T21:41:23.409871+0000","last_unstale":"2023-07-09T21:41:25.425582+0000","last_undegraded":"2023-07-09T21:41:25.425582+0000","last_fullsized":"2023-07-09T21:41:25.425582+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:31.283899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424708+0000","last_change":"2023-07-09T21:41:24.414999+0000","last_active":"2023-07-09T21:41:25.424708+0000","last_peered":"2023-07-09T21:41:25.424708+0000","last_clean":"2023-07-09T21:41:25.424708+0000","last_became_active":"2023-07-09T21:41:24.414605+0000","last_became_peered":"2023-07-09T21:41:24.414605+0000","last_unstale":"2023-07-09T21:41:25.424708+0000","last_undegraded":"2023-07-09T21:41:25.424708+0000","last_fullsized":"2023-07-09T21:41:25.424708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:54.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425075+0000","last_change":"2023-07-09T21:41:23.406204+0000","last_active":"2023-07-09T21:41:25.425075+0000","last_peered":"2023-07-09T21:41:25.425075+0000","last_clean":"2023-07-09T21:41:25.425075+0000","last_became_active":"2023-07-09T21:41:23.405916+0000","last_became_peered":"2023-07-09T21:41:23.405916+0000","last_unstale":"2023-07-09T21:41:25.425075+0000","last_undegraded":"2023-07-09T21:41:25.425075+0000","last_fullsized":"2023-07-09T21:41:25.425075+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:08.915081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401490+0000","last_change":"2023-07-09T21:41:24.416218+0000","last_active":"2023-07-09T21:41:25.401490+0000","last_peered":"2023-07-09T21:41:25.401490+0000","last_clean":"2023-07-09T21:41:25.401490+0000","last_became_active":"2023-07-09T21:41:24.415874+0000","last_became_peered":"2023-07-09T21:41:24.415874+0000","last_unstale":"2023-07-09T21:41:25.401490+0000","last_undegraded":"2023-07-09T21:41:25.401490+0000","last_fullsized":"2023-07-09T21:41:25.401490+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:02.484364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401717+0000","last_change":"2023-07-09T21:41:23.409832+0000","last_active":"2023-07-09T21:41:25.401717+0000","last_peered":"2023-07-09T21:41:25.401717+0000","last_clean":"2023-07-09T21:41:25.401717+0000","last_became_active":"2023-07-09T21:41:23.409503+0000","last_became_peered":"2023-07-09T21:41:23.409503+0000","last_unstale":"2023-07-09T21:41:25.401717+0000","last_undegraded":"2023-07-09T21:41:25.401717+0000","last_fullsized":"2023-07-09T21:41:25.401717+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:21.993206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402494+0000","last_change":"2023-07-09T21:41:24.418511+0000","last_active":"2023-07-09T21:41:25.402494+0000","last_peered":"2023-07-09T21:41:25.402494+0000","last_clean":"2023-07-09T21:41:25.402494+0000","last_became_active":"2023-07-09T21:41:24.418221+0000","last_became_peered":"2023-07-09T21:41:24.418221+0000","last_unstale":"2023-07-09T21:41:25.402494+0000","last_undegraded":"2023-07-09T21:41:25.402494+0000","last_fullsized":"2023-07-09T21:41:25.402494+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:56.553515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426136+0000","last_change":"2023-07-09T21:41:23.408440+0000","last_active":"2023-07-09T21:41:25.426136+0000","last_peered":"2023-07-09T21:41:25.426136+0000","last_clean":"2023-07-09T21:41:25.426136+0000","last_became_active":"2023-07-09T21:41:23.408100+0000","last_became_peered":"2023-07-09T21:41:23.408100+0000","last_unstale":"2023-07-09T21:41:25.426136+0000","last_undegraded":"2023-07-09T21:41:25.426136+0000","last_fullsized":"2023-07-09T21:41:25.426136+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:38:19.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424582+0000","last_change":"2023-07-09T21:41:24.413636+0000","last_active":"2023-07-09T21:41:25.424582+0000","last_peered":"2023-07-09T21:41:25.424582+0000","last_clean":"2023-07-09T21:41:25.424582+0000","last_became_active":"2023-07-09T21:41:24.413352+0000","last_became_peered":"2023-07-09T21:41:24.413352+0000","last_unstale":"2023-07-09T21:41:25.424582+0000","last_undegraded":"2023-07-09T21:41:25.424582+0000","last_fullsized":"2023-07-09T21:41:25.424582+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:37:14.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428988+0000","last_change":"2023-07-09T21:41:23.415349+0000","last_active":"2023-07-09T21:41:25.428988+0000","last_peered":"2023-07-09T21:41:25.428988+0000","last_clean":"2023-07-09T21:41:25.428988+0000","last_became_active":"2023-07-09T21:41:23.415046+0000","last_became_peered":"2023-07-09T21:41:23.415046+0000","last_unstale":"2023-07-09T21:41:25.428988+0000","last_undegraded":"2023-07-09T21:41:25.428988+0000","last_fullsized":"2023-07-09T21:41:25.428988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:44:48.866438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426451+0000","last_change":"2023-07-09T21:41:24.405386+0000","last_active":"2023-07-09T21:41:25.426451+0000","last_peered":"2023-07-09T21:41:25.426451+0000","last_clean":"2023-07-09T21:41:25.426451+0000","last_became_active":"2023-07-09T21:41:24.404791+0000","last_became_peered":"2023-07-09T21:41:24.404791+0000","last_unstale":"2023-07-09T21:41:25.426451+0000","last_undegraded":"2023-07-09T21:41:25.426451+0000","last_fullsized":"2023-07-09T21:41:25.426451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:49:24.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402020+0000","last_change":"2023-07-09T21:41:23.408634+0000","last_active":"2023-07-09T21:41:25.402020+0000","last_peered":"2023-07-09T21:41:25.402020+0000","last_clean":"2023-07-09T21:41:25.402020+0000","last_became_active":"2023-07-09T21:41:23.408353+0000","last_became_peered":"2023-07-09T21:41:23.408353+0000","last_unstale":"2023-07-09T21:41:25.402020+0000","last_undegraded":"2023-07-09T21:41:25.402020+0000","last_fullsized":"2023-07-09T21:41:25.402020+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:11.705371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398228+0000","last_change":"2023-07-09T21:41:24.415060+0000","last_active":"2023-07-09T21:41:25.398228+0000","last_peered":"2023-07-09T21:41:25.398228+0000","last_clean":"2023-07-09T21:41:25.398228+0000","last_became_active":"2023-07-09T21:41:24.414528+0000","last_became_peered":"2023-07-09T21:41:24.414528+0000","last_unstale":"2023-07-09T21:41:25.398228+0000","last_undegraded":"2023-07-09T21:41:25.398228+0000","last_fullsized":"2023-07-09T21:41:25.398228+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:59:11.873605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401198+0000","last_change":"2023-07-09T21:41:23.411059+0000","last_active":"2023-07-09T21:41:25.401198+0000","last_peered":"2023-07-09T21:41:25.401198+0000","last_clean":"2023-07-09T21:41:25.401198+0000","last_became_active":"2023-07-09T21:41:23.410779+0000","last_became_peered":"2023-07-09T21:41:23.410779+0000","last_unstale":"2023-07-09T21:41:25.401198+0000","last_undegraded":"2023-07-09T21:41:25.401198+0000","last_fullsized":"2023-07-09T21:41:25.401198+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:29:54.980381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425442+0000","last_change":"2023-07-09T21:41:24.415774+0000","last_active":"2023-07-09T21:41:25.425442+0000","last_peered":"2023-07-09T21:41:25.425442+0000","last_clean":"2023-07-09T21:41:25.425442+0000","last_became_active":"2023-07-09T21:41:24.415461+0000","last_became_peered":"2023-07-09T21:41:24.415461+0000","last_unstale":"2023-07-09T21:41:25.425442+0000","last_undegraded":"2023-07-09T21:41:25.425442+0000","last_fullsized":"2023-07-09T21:41:25.425442+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:13.372797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.423904+0000","last_change":"2023-07-09T21:41:23.400312+0000","last_active":"2023-07-09T21:41:25.423904+0000","last_peered":"2023-07-09T21:41:25.423904+0000","last_clean":"2023-07-09T21:41:25.423904+0000","last_became_active":"2023-07-09T21:41:23.400038+0000","last_became_peered":"2023-07-09T21:41:23.400038+0000","last_unstale":"2023-07-09T21:41:25.423904+0000","last_undegraded":"2023-07-09T21:41:25.423904+0000","last_fullsized":"2023-07-09T21:41:25.423904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:23.437185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425776+0000","last_change":"2023-07-09T21:41:24.404916+0000","last_active":"2023-07-09T21:41:25.425776+0000","last_peered":"2023-07-09T21:41:25.425776+0000","last_clean":"2023-07-09T21:41:25.425776+0000","last_became_active":"2023-07-09T21:41:24.404612+0000","last_became_peered":"2023-07-09T21:41:24.404612+0000","last_unstale":"2023-07-09T21:41:25.425776+0000","last_undegraded":"2023-07-09T21:41:25.425776+0000","last_fullsized":"2023-07-09T21:41:25.425776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:28.625214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401884+0000","last_change":"2023-07-09T21:41:23.410925+0000","last_active":"2023-07-09T21:41:25.401884+0000","last_peered":"2023-07-09T21:41:25.401884+0000","last_clean":"2023-07-09T21:41:25.401884+0000","last_became_active":"2023-07-09T21:41:23.410630+0000","last_became_peered":"2023-07-09T21:41:23.410630+0000","last_unstale":"2023-07-09T21:41:25.401884+0000","last_undegraded":"2023-07-09T21:41:25.401884+0000","last_fullsized":"2023-07-09T21:41:25.401884+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:12.468131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425467+0000","last_change":"2023-07-09T21:41:24.401325+0000","last_active":"2023-07-09T21:41:25.425467+0000","last_peered":"2023-07-09T21:41:25.425467+0000","last_clean":"2023-07-09T21:41:25.425467+0000","last_became_active":"2023-07-09T21:41:24.401005+0000","last_became_peered":"2023-07-09T21:41:24.401005+0000","last_unstale":"2023-07-09T21:41:25.425467+0000","last_undegraded":"2023-07-09T21:41:25.425467+0000","last_fullsized":"2023-07-09T21:41:25.425467+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:04.766417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426101+0000","last_change":"2023-07-09T21:41:23.406825+0000","last_active":"2023-07-09T21:41:25.426101+0000","last_peered":"2023-07-09T21:41:25.426101+0000","last_clean":"2023-07-09T21:41:25.426101+0000","last_became_active":"2023-07-09T21:41:23.406551+0000","last_became_peered":"2023-07-09T21:41:23.406551+0000","last_unstale":"2023-07-09T21:41:25.426101+0000","last_undegraded":"2023-07-09T21:41:25.426101+0000","last_fullsized":"2023-07-09T21:41:25.426101+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:12.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424003+0000","last_change":"2023-07-09T21:41:24.414306+0000","last_active":"2023-07-09T21:41:25.424003+0000","last_peered":"2023-07-09T21:41:25.424003+0000","last_clean":"2023-07-09T21:41:25.424003+0000","last_became_active":"2023-07-09T21:41:24.414020+0000","last_became_peered":"2023-07-09T21:41:24.414020+0000","last_unstale":"2023-07-09T21:41:25.424003+0000","last_undegraded":"2023-07-09T21:41:25.424003+0000","last_fullsized":"2023-07-09T21:41:25.424003+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:35:08.507439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"128'3","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429057+0000","last_change":"2023-07-09T21:41:23.410301+0000","last_active":"2023-07-09T21:41:25.429057+0000","last_peered":"2023-07-09T21:41:25.429057+0000","last_clean":"2023-07-09T21:41:25.429057+0000","last_became_active":"2023-07-09T21:41:23.410015+0000","last_became_peered":"2023-07-09T21:41:23.410015+0000","last_unstale":"2023-07-09T21:41:25.429057+0000","last_undegraded":"2023-07-09T21:41:25.429057+0000","last_fullsized":"2023-07-09T21:41:25.429057+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:55.606948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425663+0000","last_change":"2023-07-09T21:41:24.406594+0000","last_active":"2023-07-09T21:41:25.425663+0000","last_peered":"2023-07-09T21:41:25.425663+0000","last_clean":"2023-07-09T21:41:25.425663+0000","last_became_active":"2023-07-09T21:41:24.402796+0000","last_became_peered":"2023-07-09T21:41:24.402796+0000","last_unstale":"2023-07-09T21:41:25.425663+0000","last_undegraded":"2023-07-09T21:41:25.425663+0000","last_fullsized":"2023-07-09T21:41:25.425663+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:07:39.847567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"128'6","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397872+0000","last_change":"2023-07-09T21:41:23.405581+0000","last_active":"2023-07-09T21:41:25.397872+0000","last_peered":"2023-07-09T21:41:25.397872+0000","last_clean":"2023-07-09T21:41:25.397872+0000","last_became_active":"2023-07-09T21:41:23.405276+0000","last_became_peered":"2023-07-09T21:41:23.405276+0000","last_unstale":"2023-07-09T21:41:25.397872+0000","last_undegraded":"2023-07-09T21:41:25.397872+0000","last_fullsized":"2023-07-09T21:41:25.397872+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:05.694114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402806+0000","last_change":"2023-07-09T21:41:24.411702+0000","last_active":"2023-07-09T21:41:25.402806+0000","last_peered":"2023-07-09T21:41:25.402806+0000","last_clean":"2023-07-09T21:41:25.402806+0000","last_became_active":"2023-07-09T21:41:24.411350+0000","last_became_peered":"2023-07-09T21:41:24.411350+0000","last_unstale":"2023-07-09T21:41:25.402806+0000","last_undegraded":"2023-07-09T21:41:25.402806+0000","last_fullsized":"2023-07-09T21:41:25.402806+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:56:52.159637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425677+0000","last_change":"2023-07-09T21:41:23.404033+0000","last_active":"2023-07-09T21:41:25.425677+0000","last_peered":"2023-07-09T21:41:25.425677+0000","last_clean":"2023-07-09T21:41:25.425677+0000","last_became_active":"2023-07-09T21:41:23.403730+0000","last_became_peered":"2023-07-09T21:41:23.403730+0000","last_unstale":"2023-07-09T21:41:25.425677+0000","last_undegraded":"2023-07-09T21:41:25.425677+0000","last_fullsized":"2023-07-09T21:41:25.425677+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:57.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397959+0000","last_change":"2023-07-09T21:41:24.413023+0000","last_active":"2023-07-09T21:41:25.397959+0000","last_peered":"2023-07-09T21:41:25.397959+0000","last_clean":"2023-07-09T21:41:25.397959+0000","last_became_active":"2023-07-09T21:41:24.412696+0000","last_became_peered":"2023-07-09T21:41:24.412696+0000","last_unstale":"2023-07-09T21:41:25.397959+0000","last_undegraded":"2023-07-09T21:41:25.397959+0000","last_fullsized":"2023-07-09T21:41:25.397959+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:37.750882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424258+0000","last_change":"2023-07-09T21:41:23.402616+0000","last_active":"2023-07-09T21:41:25.424258+0000","last_peered":"2023-07-09T21:41:25.424258+0000","last_clean":"2023-07-09T21:41:25.424258+0000","last_became_active":"2023-07-09T21:41:23.402350+0000","last_became_peered":"2023-07-09T21:41:23.402350+0000","last_unstale":"2023-07-09T21:41:25.424258+0000","last_undegraded":"2023-07-09T21:41:25.424258+0000","last_fullsized":"2023-07-09T21:41:25.424258+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:28.444968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425018+0000","last_change":"2023-07-09T21:41:24.401001+0000","last_active":"2023-07-09T21:41:25.425018+0000","last_peered":"2023-07-09T21:41:25.425018+0000","last_clean":"2023-07-09T21:41:25.425018+0000","last_became_active":"2023-07-09T21:41:24.400725+0000","last_became_peered":"2023-07-09T21:41:24.400725+0000","last_unstale":"2023-07-09T21:41:25.425018+0000","last_undegraded":"2023-07-09T21:41:25.425018+0000","last_fullsized":"2023-07-09T21:41:25.425018+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:17.487525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424742+0000","last_change":"2023-07-09T21:41:23.408629+0000","last_active":"2023-07-09T21:41:25.424742+0000","last_peered":"2023-07-09T21:41:25.424742+0000","last_clean":"2023-07-09T21:41:25.424742+0000","last_became_active":"2023-07-09T21:41:23.408327+0000","last_became_peered":"2023-07-09T21:41:23.408327+0000","last_unstale":"2023-07-09T21:41:25.424742+0000","last_undegraded":"2023-07-09T21:41:25.424742+0000","last_fullsized":"2023-07-09T21:41:25.424742+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:47.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426462+0000","last_change":"2023-07-09T21:41:24.413239+0000","last_active":"2023-07-09T21:41:25.426462+0000","last_peered":"2023-07-09T21:41:25.426462+0000","last_clean":"2023-07-09T21:41:25.426462+0000","last_became_active":"2023-07-09T21:41:24.412968+0000","last_became_peered":"2023-07-09T21:41:24.412968+0000","last_unstale":"2023-07-09T21:41:25.426462+0000","last_undegraded":"2023-07-09T21:41:25.426462+0000","last_fullsized":"2023-07-09T21:41:25.426462+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:10:15.499671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"128'8","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401166+0000","last_change":"2023-07-09T21:41:23.409766+0000","last_active":"2023-07-09T21:41:25.401166+0000","last_peered":"2023-07-09T21:41:25.401166+0000","last_clean":"2023-07-09T21:41:25.401166+0000","last_became_active":"2023-07-09T21:41:23.409466+0000","last_became_peered":"2023-07-09T21:41:23.409466+0000","last_unstale":"2023-07-09T21:41:25.401166+0000","last_undegraded":"2023-07-09T21:41:25.401166+0000","last_fullsized":"2023-07-09T21:41:25.401166+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:41:10.461371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425684+0000","last_change":"2023-07-09T21:41:24.405022+0000","last_active":"2023-07-09T21:41:25.425684+0000","last_peered":"2023-07-09T21:41:25.425684+0000","last_clean":"2023-07-09T21:41:25.425684+0000","last_became_active":"2023-07-09T21:41:24.404718+0000","last_became_peered":"2023-07-09T21:41:24.404718+0000","last_unstale":"2023-07-09T21:41:25.425684+0000","last_undegraded":"2023-07-09T21:41:25.425684+0000","last_fullsized":"2023-07-09T21:41:25.425684+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:52.597222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424822+0000","last_change":"2023-07-09T21:41:23.403988+0000","last_active":"2023-07-09T21:41:25.424822+0000","last_peered":"2023-07-09T21:41:25.424822+0000","last_clean":"2023-07-09T21:41:25.424822+0000","last_became_active":"2023-07-09T21:41:23.403716+0000","last_became_peered":"2023-07-09T21:41:23.403716+0000","last_unstale":"2023-07-09T21:41:25.424822+0000","last_undegraded":"2023-07-09T21:41:25.424822+0000","last_fullsized":"2023-07-09T21:41:25.424822+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:26.984462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401139+0000","last_change":"2023-07-09T21:41:24.412699+0000","last_active":"2023-07-09T21:41:25.401139+0000","last_peered":"2023-07-09T21:41:25.401139+0000","last_clean":"2023-07-09T21:41:25.401139+0000","last_became_active":"2023-07-09T21:41:24.412281+0000","last_became_peered":"2023-07-09T21:41:24.412281+0000","last_unstale":"2023-07-09T21:41:25.401139+0000","last_undegraded":"2023-07-09T21:41:25.401139+0000","last_fullsized":"2023-07-09T21:41:25.401139+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:04.010948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"129'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426251+0000","last_change":"2023-07-09T21:41:23.405390+0000","last_active":"2023-07-09T21:41:25.426251+0000","last_peered":"2023-07-09T21:41:25.426251+0000","last_clean":"2023-07-09T21:41:25.426251+0000","last_became_active":"2023-07-09T21:41:23.405110+0000","last_became_peered":"2023-07-09T21:41:23.405110+0000","last_unstale":"2023-07-09T21:41:25.426251+0000","last_undegraded":"2023-07-09T21:41:25.426251+0000","last_fullsized":"2023-07-09T21:41:25.426251+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:57.415102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424157+0000","last_change":"2023-07-09T21:41:24.409865+0000","last_active":"2023-07-09T21:41:25.424157+0000","last_peered":"2023-07-09T21:41:25.424157+0000","last_clean":"2023-07-09T21:41:25.424157+0000","last_became_active":"2023-07-09T21:41:24.409603+0000","last_became_peered":"2023-07-09T21:41:24.409603+0000","last_unstale":"2023-07-09T21:41:25.424157+0000","last_undegraded":"2023-07-09T21:41:25.424157+0000","last_fullsized":"2023-07-09T21:41:25.424157+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:42:35.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398035+0000","last_change":"2023-07-09T21:41:23.409226+0000","last_active":"2023-07-09T21:41:25.398035+0000","last_peered":"2023-07-09T21:41:25.398035+0000","last_clean":"2023-07-09T21:41:25.398035+0000","last_became_active":"2023-07-09T21:41:23.408915+0000","last_became_peered":"2023-07-09T21:41:23.408915+0000","last_unstale":"2023-07-09T21:41:25.398035+0000","last_undegraded":"2023-07-09T21:41:25.398035+0000","last_fullsized":"2023-07-09T21:41:25.398035+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:21.099794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402335+0000","last_change":"2023-07-09T21:41:24.411744+0000","last_active":"2023-07-09T21:41:25.402335+0000","last_peered":"2023-07-09T21:41:25.402335+0000","last_clean":"2023-07-09T21:41:25.402335+0000","last_became_active":"2023-07-09T21:41:24.411452+0000","last_became_peered":"2023-07-09T21:41:24.411452+0000","last_unstale":"2023-07-09T21:41:25.402335+0000","last_undegraded":"2023-07-09T21:41:25.402335+0000","last_fullsized":"2023-07-09T21:41:25.402335+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:45.969156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426357+0000","last_change":"2023-07-09T21:41:23.410114+0000","last_active":"2023-07-09T21:41:25.426357+0000","last_peered":"2023-07-09T21:41:25.426357+0000","last_clean":"2023-07-09T21:41:25.426357+0000","last_became_active":"2023-07-09T21:41:23.409820+0000","last_became_peered":"2023-07-09T21:41:23.409820+0000","last_unstale":"2023-07-09T21:41:25.426357+0000","last_undegraded":"2023-07-09T21:41:25.426357+0000","last_fullsized":"2023-07-09T21:41:25.426357+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:48.053439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424921+0000","last_change":"2023-07-09T21:41:24.414236+0000","last_active":"2023-07-09T21:41:25.424921+0000","last_peered":"2023-07-09T21:41:25.424921+0000","last_clean":"2023-07-09T21:41:25.424921+0000","last_became_active":"2023-07-09T21:41:24.413918+0000","last_became_peered":"2023-07-09T21:41:24.413918+0000","last_unstale":"2023-07-09T21:41:25.424921+0000","last_undegraded":"2023-07-09T21:41:25.424921+0000","last_fullsized":"2023-07-09T21:41:25.424921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:20.940772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401389+0000","last_change":"2023-07-09T21:41:23.415235+0000","last_active":"2023-07-09T21:41:25.401389+0000","last_peered":"2023-07-09T21:41:25.401389+0000","last_clean":"2023-07-09T21:41:25.401389+0000","last_became_active":"2023-07-09T21:41:23.414961+0000","last_became_peered":"2023-07-09T21:41:23.414961+0000","last_unstale":"2023-07-09T21:41:25.401389+0000","last_undegraded":"2023-07-09T21:41:25.401389+0000","last_fullsized":"2023-07-09T21:41:25.401389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:51:10.286411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424959+0000","last_change":"2023-07-09T21:41:24.414915+0000","last_active":"2023-07-09T21:41:25.424959+0000","last_peered":"2023-07-09T21:41:25.424959+0000","last_clean":"2023-07-09T21:41:25.424959+0000","last_became_active":"2023-07-09T21:41:24.414620+0000","last_became_peered":"2023-07-09T21:41:24.414620+0000","last_unstale":"2023-07-09T21:41:25.424959+0000","last_undegraded":"2023-07-09T21:41:25.424959+0000","last_fullsized":"2023-07-09T21:41:25.424959+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:59.330802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424112+0000","last_change":"2023-07-09T21:41:23.408567+0000","last_active":"2023-07-09T21:41:25.424112+0000","last_peered":"2023-07-09T21:41:25.424112+0000","last_clean":"2023-07-09T21:41:25.424112+0000","last_became_active":"2023-07-09T21:41:23.408258+0000","last_became_peered":"2023-07-09T21:41:23.408258+0000","last_unstale":"2023-07-09T21:41:25.424112+0000","last_undegraded":"2023-07-09T21:41:25.424112+0000","last_fullsized":"2023-07-09T21:41:25.424112+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:52.756350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429273+0000","last_change":"2023-07-09T21:41:24.424216+0000","last_active":"2023-07-09T21:41:25.429273+0000","last_peered":"2023-07-09T21:41:25.429273+0000","last_clean":"2023-07-09T21:41:25.429273+0000","last_became_active":"2023-07-09T21:41:24.423661+0000","last_became_peered":"2023-07-09T21:41:24.423661+0000","last_unstale":"2023-07-09T21:41:25.429273+0000","last_undegraded":"2023-07-09T21:41:25.429273+0000","last_fullsized":"2023-07-09T21:41:25.429273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:09:53.015213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397752+0000","last_change":"2023-07-09T21:41:23.404952+0000","last_active":"2023-07-09T21:41:25.397752+0000","last_peered":"2023-07-09T21:41:25.397752+0000","last_clean":"2023-07-09T21:41:25.397752+0000","last_became_active":"2023-07-09T21:41:23.404681+0000","last_became_peered":"2023-07-09T21:41:23.404681+0000","last_unstale":"2023-07-09T21:41:25.397752+0000","last_undegraded":"2023-07-09T21:41:25.397752+0000","last_fullsized":"2023-07-09T21:41:25.397752+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:31.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402918+0000","last_change":"2023-07-09T21:41:24.415229+0000","last_active":"2023-07-09T21:41:25.402918+0000","last_peered":"2023-07-09T21:41:25.402918+0000","last_clean":"2023-07-09T21:41:25.402918+0000","last_became_active":"2023-07-09T21:41:24.414945+0000","last_became_peered":"2023-07-09T21:41:24.414945+0000","last_unstale":"2023-07-09T21:41:25.402918+0000","last_undegraded":"2023-07-09T21:41:25.402918+0000","last_fullsized":"2023-07-09T21:41:25.402918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:07.685335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424509+0000","last_change":"2023-07-09T21:41:23.408898+0000","last_active":"2023-07-09T21:41:25.424509+0000","last_peered":"2023-07-09T21:41:25.424509+0000","last_clean":"2023-07-09T21:41:25.424509+0000","last_became_active":"2023-07-09T21:41:23.408239+0000","last_became_peered":"2023-07-09T21:41:23.408239+0000","last_unstale":"2023-07-09T21:41:25.424509+0000","last_undegraded":"2023-07-09T21:41:25.424509+0000","last_fullsized":"2023-07-09T21:41:25.424509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:19:52.481360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402216+0000","last_change":"2023-07-09T21:41:24.412664+0000","last_active":"2023-07-09T21:41:25.402216+0000","last_peered":"2023-07-09T21:41:25.402216+0000","last_clean":"2023-07-09T21:41:25.402216+0000","last_became_active":"2023-07-09T21:41:24.412291+0000","last_became_peered":"2023-07-09T21:41:24.412291+0000","last_unstale":"2023-07-09T21:41:25.402216+0000","last_undegraded":"2023-07-09T21:41:25.402216+0000","last_fullsized":"2023-07-09T21:41:25.402216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:33.354063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425117+0000","last_change":"2023-07-09T21:41:23.406811+0000","last_active":"2023-07-09T21:41:25.425117+0000","last_peered":"2023-07-09T21:41:25.425117+0000","last_clean":"2023-07-09T21:41:25.425117+0000","last_became_active":"2023-07-09T21:41:23.406502+0000","last_became_peered":"2023-07-09T21:41:23.406502+0000","last_unstale":"2023-07-09T21:41:25.425117+0000","last_undegraded":"2023-07-09T21:41:25.425117+0000","last_fullsized":"2023-07-09T21:41:25.425117+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:09:59.144464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'227","reported_seq":758,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429083+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:41:25.429083+0000","last_peered":"2023-07-09T21:41:25.429083+0000","last_clean":"2023-07-09T21:41:25.429083+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:41:25.429083+0000","last_undegraded":"2023-07-09T21:41:25.429083+0000","last_fullsized":"2023-07-09T21:41:25.429083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:14:11.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":240,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402526+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:41:25.402526+0000","last_peered":"2023-07-09T21:41:25.402526+0000","last_clean":"2023-07-09T21:41:25.402526+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:41:25.402526+0000","last_undegraded":"2023-07-09T21:41:25.402526+0000","last_fullsized":"2023-07-09T21:41:25.402526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:05.698641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397669+0000","last_change":"2023-07-09T21:41:24.409326+0000","last_active":"2023-07-09T21:41:25.397669+0000","last_peered":"2023-07-09T21:41:25.397669+0000","last_clean":"2023-07-09T21:41:25.397669+0000","last_became_active":"2023-07-09T21:41:24.409009+0000","last_became_peered":"2023-07-09T21:41:24.409009+0000","last_unstale":"2023-07-09T21:41:25.397669+0000","last_undegraded":"2023-07-09T21:41:25.397669+0000","last_fullsized":"2023-07-09T21:41:25.397669+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:56.043995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429108+0000","last_change":"2023-07-09T21:41:23.412162+0000","last_active":"2023-07-09T21:41:25.429108+0000","last_peered":"2023-07-09T21:41:25.429108+0000","last_clean":"2023-07-09T21:41:25.429108+0000","last_became_active":"2023-07-09T21:41:23.411859+0000","last_became_peered":"2023-07-09T21:41:23.411859+0000","last_unstale":"2023-07-09T21:41:25.429108+0000","last_undegraded":"2023-07-09T21:41:25.429108+0000","last_fullsized":"2023-07-09T21:41:25.429108+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:37.141424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":212,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428833+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:41:25.428833+0000","last_peered":"2023-07-09T21:41:25.428833+0000","last_clean":"2023-07-09T21:41:25.428833+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:41:25.428833+0000","last_undegraded":"2023-07-09T21:41:25.428833+0000","last_fullsized":"2023-07-09T21:41:25.428833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:36.427569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425564+0000","last_change":"2023-07-09T21:41:24.410923+0000","last_active":"2023-07-09T21:41:25.425564+0000","last_peered":"2023-07-09T21:41:25.425564+0000","last_clean":"2023-07-09T21:41:25.425564+0000","last_became_active":"2023-07-09T21:41:24.410584+0000","last_became_peered":"2023-07-09T21:41:24.410584+0000","last_unstale":"2023-07-09T21:41:25.425564+0000","last_undegraded":"2023-07-09T21:41:25.425564+0000","last_fullsized":"2023-07-09T21:41:25.425564+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:08.799650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402496+0000","last_change":"2023-07-09T21:41:23.409499+0000","last_active":"2023-07-09T21:41:25.402496+0000","last_peered":"2023-07-09T21:41:25.402496+0000","last_clean":"2023-07-09T21:41:25.402496+0000","last_became_active":"2023-07-09T21:41:23.408924+0000","last_became_peered":"2023-07-09T21:41:23.408924+0000","last_unstale":"2023-07-09T21:41:25.402496+0000","last_undegraded":"2023-07-09T21:41:25.402496+0000","last_fullsized":"2023-07-09T21:41:25.402496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:34.802847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424811+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:41:25.424811+0000","last_peered":"2023-07-09T21:41:25.424811+0000","last_clean":"2023-07-09T21:41:25.424811+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:41:25.424811+0000","last_undegraded":"2023-07-09T21:41:25.424811+0000","last_fullsized":"2023-07-09T21:41:25.424811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:59.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424291+0000","last_change":"2023-07-09T21:41:24.399624+0000","last_active":"2023-07-09T21:41:25.424291+0000","last_peered":"2023-07-09T21:41:25.424291+0000","last_clean":"2023-07-09T21:41:25.424291+0000","last_became_active":"2023-07-09T21:41:24.398474+0000","last_became_peered":"2023-07-09T21:41:24.398474+0000","last_unstale":"2023-07-09T21:41:25.424291+0000","last_undegraded":"2023-07-09T21:41:25.424291+0000","last_fullsized":"2023-07-09T21:41:25.424291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:13:23.199252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398074+0000","last_change":"2023-07-09T21:41:23.402034+0000","last_active":"2023-07-09T21:41:25.398074+0000","last_peered":"2023-07-09T21:41:25.398074+0000","last_clean":"2023-07-09T21:41:25.398074+0000","last_became_active":"2023-07-09T21:41:23.401726+0000","last_became_peered":"2023-07-09T21:41:23.401726+0000","last_unstale":"2023-07-09T21:41:25.398074+0000","last_undegraded":"2023-07-09T21:41:25.398074+0000","last_fullsized":"2023-07-09T21:41:25.398074+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:45.784943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":240,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402165+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:41:25.402165+0000","last_peered":"2023-07-09T21:41:25.402165+0000","last_clean":"2023-07-09T21:41:25.402165+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:41:25.402165+0000","last_undegraded":"2023-07-09T21:41:25.402165+0000","last_fullsized":"2023-07-09T21:41:25.402165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:13:07.995879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424595+0000","last_change":"2023-07-09T21:41:24.410445+0000","last_active":"2023-07-09T21:41:25.424595+0000","last_peered":"2023-07-09T21:41:25.424595+0000","last_clean":"2023-07-09T21:41:25.424595+0000","last_became_active":"2023-07-09T21:41:24.410184+0000","last_became_peered":"2023-07-09T21:41:24.410184+0000","last_unstale":"2023-07-09T21:41:25.424595+0000","last_undegraded":"2023-07-09T21:41:25.424595+0000","last_fullsized":"2023-07-09T21:41:25.424595+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:52.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397737+0000","last_change":"2023-07-09T21:41:23.404513+0000","last_active":"2023-07-09T21:41:25.397737+0000","last_peered":"2023-07-09T21:41:25.397737+0000","last_clean":"2023-07-09T21:41:25.397737+0000","last_became_active":"2023-07-09T21:41:23.404196+0000","last_became_peered":"2023-07-09T21:41:23.404196+0000","last_unstale":"2023-07-09T21:41:25.397737+0000","last_undegraded":"2023-07-09T21:41:25.397737+0000","last_fullsized":"2023-07-09T21:41:25.397737+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:00.228514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426252+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:41:25.426252+0000","last_peered":"2023-07-09T21:41:25.426252+0000","last_clean":"2023-07-09T21:41:25.426252+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:41:25.426252+0000","last_undegraded":"2023-07-09T21:41:25.426252+0000","last_fullsized":"2023-07-09T21:41:25.426252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:01.766432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425169+0000","last_change":"2023-07-09T21:41:24.415011+0000","last_active":"2023-07-09T21:41:25.425169+0000","last_peered":"2023-07-09T21:41:25.425169+0000","last_clean":"2023-07-09T21:41:25.425169+0000","last_became_active":"2023-07-09T21:41:24.414215+0000","last_became_peered":"2023-07-09T21:41:24.414215+0000","last_unstale":"2023-07-09T21:41:25.425169+0000","last_undegraded":"2023-07-09T21:41:25.425169+0000","last_fullsized":"2023-07-09T21:41:25.425169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:56.533672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424396+0000","last_change":"2023-07-09T21:41:23.403900+0000","last_active":"2023-07-09T21:41:25.424396+0000","last_peered":"2023-07-09T21:41:25.424396+0000","last_clean":"2023-07-09T21:41:25.424396+0000","last_became_active":"2023-07-09T21:41:23.403592+0000","last_became_peered":"2023-07-09T21:41:23.403592+0000","last_unstale":"2023-07-09T21:41:25.424396+0000","last_undegraded":"2023-07-09T21:41:25.424396+0000","last_fullsized":"2023-07-09T21:41:25.424396+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:11:00.254640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":212,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429226+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:41:25.429226+0000","last_peered":"2023-07-09T21:41:25.429226+0000","last_clean":"2023-07-09T21:41:25.429226+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:41:25.429226+0000","last_undegraded":"2023-07-09T21:41:25.429226+0000","last_fullsized":"2023-07-09T21:41:25.429226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:07:53.354187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426072+0000","last_change":"2023-07-09T21:41:24.410267+0000","last_active":"2023-07-09T21:41:25.426072+0000","last_peered":"2023-07-09T21:41:25.426072+0000","last_clean":"2023-07-09T21:41:25.426072+0000","last_became_active":"2023-07-09T21:41:24.409905+0000","last_became_peered":"2023-07-09T21:41:24.409905+0000","last_unstale":"2023-07-09T21:41:25.426072+0000","last_undegraded":"2023-07-09T21:41:25.426072+0000","last_fullsized":"2023-07-09T21:41:25.426072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:17:13.000493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424554+0000","last_change":"2023-07-09T21:41:23.401278+0000","last_active":"2023-07-09T21:41:25.424554+0000","last_peered":"2023-07-09T21:41:25.424554+0000","last_clean":"2023-07-09T21:41:25.424554+0000","last_became_active":"2023-07-09T21:41:23.400772+0000","last_became_peered":"2023-07-09T21:41:23.400772+0000","last_unstale":"2023-07-09T21:41:25.424554+0000","last_undegraded":"2023-07-09T21:41:25.424554+0000","last_fullsized":"2023-07-09T21:41:25.424554+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:49.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425182+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:41:25.425182+0000","last_peered":"2023-07-09T21:41:25.425182+0000","last_clean":"2023-07-09T21:41:25.425182+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:41:25.425182+0000","last_undegraded":"2023-07-09T21:41:25.425182+0000","last_fullsized":"2023-07-09T21:41:25.425182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:45.176979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426433+0000","last_change":"2023-07-09T21:41:24.408268+0000","last_active":"2023-07-09T21:41:25.426433+0000","last_peered":"2023-07-09T21:41:25.426433+0000","last_clean":"2023-07-09T21:41:25.426433+0000","last_became_active":"2023-07-09T21:41:24.407900+0000","last_became_peered":"2023-07-09T21:41:24.407900+0000","last_unstale":"2023-07-09T21:41:25.426433+0000","last_undegraded":"2023-07-09T21:41:25.426433+0000","last_fullsized":"2023-07-09T21:41:25.426433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:19:31.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.423858+0000","last_change":"2023-07-09T21:41:23.404279+0000","last_active":"2023-07-09T21:41:25.423858+0000","last_peered":"2023-07-09T21:41:25.423858+0000","last_clean":"2023-07-09T21:41:25.423858+0000","last_became_active":"2023-07-09T21:41:23.403598+0000","last_became_peered":"2023-07-09T21:41:23.403598+0000","last_unstale":"2023-07-09T21:41:25.423858+0000","last_undegraded":"2023-07-09T21:41:25.423858+0000","last_fullsized":"2023-07-09T21:41:25.423858+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:24.794133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398158+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:41:25.398158+0000","last_peered":"2023-07-09T21:41:25.398158+0000","last_clean":"2023-07-09T21:41:25.398158+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:41:25.398158+0000","last_undegraded":"2023-07-09T21:41:25.398158+0000","last_fullsized":"2023-07-09T21:41:25.398158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:02.872608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575077,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59432,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312408,"statfs":{"total":96636764160,"available":96575905792,"internally_reserved":0,"allocated":2195456,"data_stored":1399290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.59599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.748},{"interface":"front","average":{"1min":0.751,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0249999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.97799999999999998,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0600000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.69599999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.34699999999999998},"max":{"1min":0.998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.745,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.754,"15min":1.754},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1140000000000001,"5min":1.129,"15min":1.129},"last":0.70899999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.89900000000000002,"5min":1.232,"15min":1.232},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.95399999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1613824,"data_stored":810930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94999999999999996,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":1.0149999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98199999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.77500000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.012,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.68999999999999995,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":6.101,"15min":6.101},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71999999999999997,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":1.252,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.65200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.69199999999999995},"min":{"1min":0.55000000000000004,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.627},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.71999999999999997},"min":{"1min":0.54500000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.014,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50652,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321188,"statfs":{"total":96636764160,"available":96584896512,"internally_reserved":0,"allocated":1593344,"data_stored":808762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.98799999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.98099999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69199999999999995,"15min":0.71099999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.02},"last":0.88200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.51100000000000001},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.002}]},{"osd":3,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92300000000000004,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.33200000000000002},"max":{"1min":0.96299999999999997,"5min":1.083,"15min":1.083},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":1.0249999999999999,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.107,"15min":1.107},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1601536,"data_stored":808854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.35299999999999998},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.97699999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94699999999999995},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90500000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91200000000000003,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.749}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86599999999999999,"5min":1.002,"15min":1.26},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.05},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":1.024,"15min":1.024},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.83599999999999997,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0569999999999999,"15min":1.0629999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.878,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.95899999999999996,"5min":1.097,"15min":1.097},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575076,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1597440,"data_stored":809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29399999999999998},"max":{"1min":0.70899999999999996,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.3320000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2689999999999999},"last":0.746}]},{"osd":5,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0649999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0409999999999999,"15min":1.208},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":0.997,"5min":1.51,"15min":1.51},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.46800000000000003},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.159},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1910000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575077,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1597440,"data_stored":808796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.51700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.0229999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.7050000000000001},"last":0.499}]},{"osd":4,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":1.145,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.62,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2989999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.50700000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.377,"15min":1.377},"last":0.62},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.54200000000000004,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":1.262,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.83399999999999996},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":1.3400000000000001,"5min":1.423,"15min":1.423},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.163,"5min":1.48,"15min":1.48},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.84299999999999997},"min":{"1min":0.64400000000000002,"5min":0.53800000000000003,"15min":0.46100000000000002},"max":{"1min":1.3999999999999999,"5min":1.496,"15min":1.496},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1597440,"data_stored":808796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.871},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.64800000000000002,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.76100000000000001,"15min":1.5129999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":1.129,"15min":1.3069999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.274},"last":0.73299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.351},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.242},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.206},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.46600000000000003},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80000000000000004},"min":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.173},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.65900000000000003,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575077,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37296,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334544,"statfs":{"total":96636764160,"available":96598573056,"internally_reserved":0,"allocated":2203648,"data_stored":1400784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":0.68799999999999994,"15min":0.753},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.44}]},{"osd":2,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.375},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":1.657,"15min":1.657},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66500000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.1080000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.627},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.42299999999999999},"max":{"1min":0.95899999999999996,"5min":1.835,"15min":1.835},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.726,"15min":1.726},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.615,"15min":1.615},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0409999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81100000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.0860000000000001,"5min":1.883,"15min":1.883},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:41:31.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:41:31.607 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:41:33.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:41:33.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.280+0000 7f226329e640 1 Processor -- start 2023-07-09T21:41:33.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.280+0000 7f226329e640 1 -- start start 2023-07-09T21:41:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.280+0000 7f226329e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226329e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f225c0b4340 0x7f225c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226329e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f225c0b49f0 con 0x7f225c0cef80 2023-07-09T21:41:33.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226329e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f225c0b7e80 con 0x7f225c0b4340 2023-07-09T21:41:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226329e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0cc8a0 con 0x7f225c0b7ab0 2023-07-09T21:41:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f225c0b4340 0x7f225c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f225c0b4340 0x7f225c0d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38766/0 (socket says 172.21.15.37:38766) 2023-07-09T21:41:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 -- 172.21.15.37:0/3714342349 learned_addr learned my addr 172.21.15.37:0/3714342349 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:33.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226103a640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 -- 172.21.15.37:0/3714342349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 msgr2=0x7f225c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 -- 172.21.15.37:0/3714342349 >> v1:172.21.15.119:6789/0 conn(0x7f225c0cef80 legacy=0x7f225c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 -- 172.21.15.37:0/3714342349 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c0ccb80 con 0x7f225c0b4340 2023-07-09T21:41:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226103a640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:33.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f226183b640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c0d02a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f2254009e50 tx=0x7f225401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daa95a37de29de7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f2253fff640 1 -- 172.21.15.37:0/3714342349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540a58a0 con 0x7f225c0b4340 2023-07-09T21:41:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f2253fff640 1 -- 172.21.15.37:0/3714342349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540a5a00 con 0x7f225c0b4340 2023-07-09T21:41:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.284+0000 7f2253fff640 1 -- 172.21.15.37:0/3714342349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22540a5d90 con 0x7f225c0b4340 2023-07-09T21:41:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- 172.21.15.37:0/3714342349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 msgr2=0x7f225c0d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c0d02a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f2254009e50 tx=0x7f225401c9e0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- 172.21.15.37:0/3714342349 shutdown_connections 2023-07-09T21:41:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c0d02a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- 172.21.15.37:0/3714342349 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- 172.21.15.37:0/3714342349 >> 172.21.15.37:0/3714342349 conn(0x7f225c073090 msgr2=0x7f225c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- 172.21.15.37:0/3714342349 shutdown_connections 2023-07-09T21:41:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- 172.21.15.37:0/3714342349 wait complete. 2023-07-09T21:41:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 Processor -- start 2023-07-09T21:41:33.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- start start 2023-07-09T21:41:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f225c0cef80 0x7f225c147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c6c30 con 0x7f225c0b4340 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c152b30 con 0x7f225c0cef80 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226329e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c0c60b0 con 0x7f225c0b7ab0 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226103a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226103a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38772/0 (socket says 172.21.15.37:38772) 2023-07-09T21:41:33.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226103a640 1 -- 172.21.15.37:0/722371127 learned_addr learned my addr 172.21.15.37:0/722371127 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f226183b640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f225c0cef80 0x7f225c147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.288+0000 7f2260839640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 -- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 msgr2=0x7f225c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 -- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f225c0cef80 msgr2=0x7f225c147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f225c0cef80 0x7f225c147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 -- 172.21.15.37:0/722371127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254009b30 con 0x7f225c0b4340 2023-07-09T21:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2260839640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:33.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226103a640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f225800e810 tx=0x7f225800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800c8d0 con 0x7f225c0b4340 2023-07-09T21:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225800ca30 con 0x7f225c0b4340 2023-07-09T21:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225800cde0 con 0x7f225c0b4340 2023-07-09T21:41:33.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225c0c6390 con 0x7f225c0b4340 2023-07-09T21:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f225c0c6950 con 0x7f225c0b4340 2023-07-09T21:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225c04d7d0 con 0x7f225c0b4340 2023-07-09T21:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2258013410 con 0x7f225c0b4340 2023-07-09T21:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 0x7f2240068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.292+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2258083d20 con 0x7f225c0b4340 2023-07-09T21:41:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.296+0000 7f2260839640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 0x7f2240068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.296+0000 7f2260839640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 0x7f2240068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f225c149670 tx=0x7f224c009040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.296+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2258051020 con 0x7f225c0b4340 2023-07-09T21:41:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.448+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f225c0cf4d0 con 0x7f22400663a0 2023-07-09T21:41:33.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.456+0000 7f2251ffb640 1 -- 172.21.15.37:0/722371127 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312177 (secure 0 0 0) 0x7f224c001ca0 con 0x7f22400663a0 2023-07-09T21:41:33.461 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:33.462 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:41:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 msgr2=0x7f2240068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 0x7f2240068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f225c149670 tx=0x7f224c009040 comp rx=0 tx=0).stop 2023-07-09T21:41:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 msgr2=0x7f225c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f225800e810 tx=0x7f225800ecd0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 shutdown_connections 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f22400663a0 0x7f2240068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f225c0cef80 0x7f225c147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f225c0b7ab0 0x7f225c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 --2- 172.21.15.37:0/722371127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f225c0b4340 0x7f225c1525f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 >> 172.21.15.37:0/722371127 conn(0x7f225c073090 msgr2=0x7f225c0b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 shutdown_connections 2023-07-09T21:41:33.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.460+0000 7f226329e640 1 -- 172.21.15.37:0/722371127 wait complete. 2023-07-09T21:41:33.482 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:41:32.038377+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":404,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":266,"ondisk_log_size":266,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":332584,"kb_used_data":13672,"kb_used_omap":0,"kb_used_meta":318848,"kb_avail":754642136,"statfs":{"total":773094113280,"available":772753547264,"internally_reserved":0,"allocated":14000128,"data_stored":7655556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":326500352},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002286"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426336+0000","last_change":"2023-07-09T21:41:24.407078+0000","last_active":"2023-07-09T21:41:25.426336+0000","last_peered":"2023-07-09T21:41:25.426336+0000","last_clean":"2023-07-09T21:41:25.426336+0000","last_became_active":"2023-07-09T21:41:24.406793+0000","last_became_peered":"2023-07-09T21:41:24.406793+0000","last_unstale":"2023-07-09T21:41:25.426336+0000","last_undegraded":"2023-07-09T21:41:25.426336+0000","last_fullsized":"2023-07-09T21:41:25.426336+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:51:56.006647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398132+0000","last_change":"2023-07-09T21:41:24.424413+0000","last_active":"2023-07-09T21:41:25.398132+0000","last_peered":"2023-07-09T21:41:25.398132+0000","last_clean":"2023-07-09T21:41:25.398132+0000","last_became_active":"2023-07-09T21:41:24.420731+0000","last_became_peered":"2023-07-09T21:41:24.420731+0000","last_unstale":"2023-07-09T21:41:25.398132+0000","last_undegraded":"2023-07-09T21:41:25.398132+0000","last_fullsized":"2023-07-09T21:41:25.398132+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:21:08.088967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426161+0000","last_change":"2023-07-09T21:41:24.412921+0000","last_active":"2023-07-09T21:41:25.426161+0000","last_peered":"2023-07-09T21:41:25.426161+0000","last_clean":"2023-07-09T21:41:25.426161+0000","last_became_active":"2023-07-09T21:41:24.412638+0000","last_became_peered":"2023-07-09T21:41:24.412638+0000","last_unstale":"2023-07-09T21:41:25.426161+0000","last_undegraded":"2023-07-09T21:41:25.426161+0000","last_fullsized":"2023-07-09T21:41:25.426161+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:31.313704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424468+0000","last_change":"2023-07-09T21:41:24.406975+0000","last_active":"2023-07-09T21:41:25.424468+0000","last_peered":"2023-07-09T21:41:25.424468+0000","last_clean":"2023-07-09T21:41:25.424468+0000","last_became_active":"2023-07-09T21:41:24.406632+0000","last_became_peered":"2023-07-09T21:41:24.406632+0000","last_unstale":"2023-07-09T21:41:25.424468+0000","last_undegraded":"2023-07-09T21:41:25.424468+0000","last_fullsized":"2023-07-09T21:41:25.424468+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:35:13.745867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425423+0000","last_change":"2023-07-09T21:41:24.412920+0000","last_active":"2023-07-09T21:41:25.425423+0000","last_peered":"2023-07-09T21:41:25.425423+0000","last_clean":"2023-07-09T21:41:25.425423+0000","last_became_active":"2023-07-09T21:41:24.412611+0000","last_became_peered":"2023-07-09T21:41:24.412611+0000","last_unstale":"2023-07-09T21:41:25.425423+0000","last_undegraded":"2023-07-09T21:41:25.425423+0000","last_fullsized":"2023-07-09T21:41:25.425423+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:40:08.469032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397550+0000","last_change":"2023-07-09T21:41:24.422318+0000","last_active":"2023-07-09T21:41:25.397550+0000","last_peered":"2023-07-09T21:41:25.397550+0000","last_clean":"2023-07-09T21:41:25.397550+0000","last_became_active":"2023-07-09T21:41:24.421796+0000","last_became_peered":"2023-07-09T21:41:24.421796+0000","last_unstale":"2023-07-09T21:41:25.397550+0000","last_undegraded":"2023-07-09T21:41:25.397550+0000","last_fullsized":"2023-07-09T21:41:25.397550+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:13.585361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397509+0000","last_change":"2023-07-09T21:41:24.422113+0000","last_active":"2023-07-09T21:41:25.397509+0000","last_peered":"2023-07-09T21:41:25.397509+0000","last_clean":"2023-07-09T21:41:25.397509+0000","last_became_active":"2023-07-09T21:41:24.421729+0000","last_became_peered":"2023-07-09T21:41:24.421729+0000","last_unstale":"2023-07-09T21:41:25.397509+0000","last_undegraded":"2023-07-09T21:41:25.397509+0000","last_fullsized":"2023-07-09T21:41:25.397509+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:20.860287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424039+0000","last_change":"2023-07-09T21:41:24.409951+0000","last_active":"2023-07-09T21:41:25.424039+0000","last_peered":"2023-07-09T21:41:25.424039+0000","last_clean":"2023-07-09T21:41:25.424039+0000","last_became_active":"2023-07-09T21:41:24.409683+0000","last_became_peered":"2023-07-09T21:41:24.409683+0000","last_unstale":"2023-07-09T21:41:25.424039+0000","last_undegraded":"2023-07-09T21:41:25.424039+0000","last_fullsized":"2023-07-09T21:41:25.424039+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:54.080545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398045+0000","last_change":"2023-07-09T21:41:24.413844+0000","last_active":"2023-07-09T21:41:25.398045+0000","last_peered":"2023-07-09T21:41:25.398045+0000","last_clean":"2023-07-09T21:41:25.398045+0000","last_became_active":"2023-07-09T21:41:24.413460+0000","last_became_peered":"2023-07-09T21:41:24.413460+0000","last_unstale":"2023-07-09T21:41:25.398045+0000","last_undegraded":"2023-07-09T21:41:25.398045+0000","last_fullsized":"2023-07-09T21:41:25.398045+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:04.073772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425075+0000","last_change":"2023-07-09T21:41:24.407150+0000","last_active":"2023-07-09T21:41:25.425075+0000","last_peered":"2023-07-09T21:41:25.425075+0000","last_clean":"2023-07-09T21:41:25.425075+0000","last_became_active":"2023-07-09T21:41:24.406811+0000","last_became_peered":"2023-07-09T21:41:24.406811+0000","last_unstale":"2023-07-09T21:41:25.425075+0000","last_undegraded":"2023-07-09T21:41:25.425075+0000","last_fullsized":"2023-07-09T21:41:25.425075+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:44:38.940984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402674+0000","last_change":"2023-07-09T21:41:24.411287+0000","last_active":"2023-07-09T21:41:25.402674+0000","last_peered":"2023-07-09T21:41:25.402674+0000","last_clean":"2023-07-09T21:41:25.402674+0000","last_became_active":"2023-07-09T21:41:24.410379+0000","last_became_peered":"2023-07-09T21:41:24.410379+0000","last_unstale":"2023-07-09T21:41:25.402674+0000","last_undegraded":"2023-07-09T21:41:25.402674+0000","last_fullsized":"2023-07-09T21:41:25.402674+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:04:22.131042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401402+0000","last_change":"2023-07-09T21:41:24.414135+0000","last_active":"2023-07-09T21:41:25.401402+0000","last_peered":"2023-07-09T21:41:25.401402+0000","last_clean":"2023-07-09T21:41:25.401402+0000","last_became_active":"2023-07-09T21:41:24.413459+0000","last_became_peered":"2023-07-09T21:41:24.413459+0000","last_unstale":"2023-07-09T21:41:25.401402+0000","last_undegraded":"2023-07-09T21:41:25.401402+0000","last_fullsized":"2023-07-09T21:41:25.401402+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:27:28.383461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424112+0000","last_change":"2023-07-09T21:41:24.412787+0000","last_active":"2023-07-09T21:41:25.424112+0000","last_peered":"2023-07-09T21:41:25.424112+0000","last_clean":"2023-07-09T21:41:25.424112+0000","last_became_active":"2023-07-09T21:41:24.412514+0000","last_became_peered":"2023-07-09T21:41:24.412514+0000","last_unstale":"2023-07-09T21:41:25.424112+0000","last_undegraded":"2023-07-09T21:41:25.424112+0000","last_fullsized":"2023-07-09T21:41:25.424112+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:33.530443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428819+0000","last_change":"2023-07-09T21:41:24.417589+0000","last_active":"2023-07-09T21:41:25.428819+0000","last_peered":"2023-07-09T21:41:25.428819+0000","last_clean":"2023-07-09T21:41:25.428819+0000","last_became_active":"2023-07-09T21:41:24.417228+0000","last_became_peered":"2023-07-09T21:41:24.417228+0000","last_unstale":"2023-07-09T21:41:25.428819+0000","last_undegraded":"2023-07-09T21:41:25.428819+0000","last_fullsized":"2023-07-09T21:41:25.428819+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:45.637139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428821+0000","last_change":"2023-07-09T21:41:24.418757+0000","last_active":"2023-07-09T21:41:25.428821+0000","last_peered":"2023-07-09T21:41:25.428821+0000","last_clean":"2023-07-09T21:41:25.428821+0000","last_became_active":"2023-07-09T21:41:24.418468+0000","last_became_peered":"2023-07-09T21:41:24.418468+0000","last_unstale":"2023-07-09T21:41:25.428821+0000","last_undegraded":"2023-07-09T21:41:25.428821+0000","last_fullsized":"2023-07-09T21:41:25.428821+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:11.903265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428921+0000","last_change":"2023-07-09T21:41:24.423747+0000","last_active":"2023-07-09T21:41:25.428921+0000","last_peered":"2023-07-09T21:41:25.428921+0000","last_clean":"2023-07-09T21:41:25.428921+0000","last_became_active":"2023-07-09T21:41:24.423242+0000","last_became_peered":"2023-07-09T21:41:24.423242+0000","last_unstale":"2023-07-09T21:41:25.428921+0000","last_undegraded":"2023-07-09T21:41:25.428921+0000","last_fullsized":"2023-07-09T21:41:25.428921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:16.296325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426392+0000","last_change":"2023-07-09T21:41:24.413371+0000","last_active":"2023-07-09T21:41:25.426392+0000","last_peered":"2023-07-09T21:41:25.426392+0000","last_clean":"2023-07-09T21:41:25.426392+0000","last_became_active":"2023-07-09T21:41:24.413089+0000","last_became_peered":"2023-07-09T21:41:24.413089+0000","last_unstale":"2023-07-09T21:41:25.426392+0000","last_undegraded":"2023-07-09T21:41:25.426392+0000","last_fullsized":"2023-07-09T21:41:25.426392+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:56:07.183160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398151+0000","last_change":"2023-07-09T21:41:24.424325+0000","last_active":"2023-07-09T21:41:25.398151+0000","last_peered":"2023-07-09T21:41:25.398151+0000","last_clean":"2023-07-09T21:41:25.398151+0000","last_became_active":"2023-07-09T21:41:24.422074+0000","last_became_peered":"2023-07-09T21:41:24.422074+0000","last_unstale":"2023-07-09T21:41:25.398151+0000","last_undegraded":"2023-07-09T21:41:25.398151+0000","last_fullsized":"2023-07-09T21:41:25.398151+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:27.042812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426297+0000","last_change":"2023-07-09T21:41:24.405414+0000","last_active":"2023-07-09T21:41:25.426297+0000","last_peered":"2023-07-09T21:41:25.426297+0000","last_clean":"2023-07-09T21:41:25.426297+0000","last_became_active":"2023-07-09T21:41:24.405152+0000","last_became_peered":"2023-07-09T21:41:24.405152+0000","last_unstale":"2023-07-09T21:41:25.426297+0000","last_undegraded":"2023-07-09T21:41:25.426297+0000","last_fullsized":"2023-07-09T21:41:25.426297+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:17:06.278029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401628+0000","last_change":"2023-07-09T21:41:24.420800+0000","last_active":"2023-07-09T21:41:25.401628+0000","last_peered":"2023-07-09T21:41:25.401628+0000","last_clean":"2023-07-09T21:41:25.401628+0000","last_became_active":"2023-07-09T21:41:24.420520+0000","last_became_peered":"2023-07-09T21:41:24.420520+0000","last_unstale":"2023-07-09T21:41:25.401628+0000","last_undegraded":"2023-07-09T21:41:25.401628+0000","last_fullsized":"2023-07-09T21:41:25.401628+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:17:46.901803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424304+0000","last_change":"2023-07-09T21:41:24.409314+0000","last_active":"2023-07-09T21:41:25.424304+0000","last_peered":"2023-07-09T21:41:25.424304+0000","last_clean":"2023-07-09T21:41:25.424304+0000","last_became_active":"2023-07-09T21:41:24.408990+0000","last_became_peered":"2023-07-09T21:41:24.408990+0000","last_unstale":"2023-07-09T21:41:25.424304+0000","last_undegraded":"2023-07-09T21:41:25.424304+0000","last_fullsized":"2023-07-09T21:41:25.424304+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:09:32.724352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424409+0000","last_change":"2023-07-09T21:41:24.408336+0000","last_active":"2023-07-09T21:41:25.424409+0000","last_peered":"2023-07-09T21:41:25.424409+0000","last_clean":"2023-07-09T21:41:25.424409+0000","last_became_active":"2023-07-09T21:41:24.407666+0000","last_became_peered":"2023-07-09T21:41:24.407666+0000","last_unstale":"2023-07-09T21:41:25.424409+0000","last_undegraded":"2023-07-09T21:41:25.424409+0000","last_fullsized":"2023-07-09T21:41:25.424409+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:34.881173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426284+0000","last_change":"2023-07-09T21:41:24.404248+0000","last_active":"2023-07-09T21:41:25.426284+0000","last_peered":"2023-07-09T21:41:25.426284+0000","last_clean":"2023-07-09T21:41:25.426284+0000","last_became_active":"2023-07-09T21:41:24.403938+0000","last_became_peered":"2023-07-09T21:41:24.403938+0000","last_unstale":"2023-07-09T21:41:25.426284+0000","last_undegraded":"2023-07-09T21:41:25.426284+0000","last_fullsized":"2023-07-09T21:41:25.426284+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:40:30.190436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424834+0000","last_change":"2023-07-09T21:41:24.408573+0000","last_active":"2023-07-09T21:41:25.424834+0000","last_peered":"2023-07-09T21:41:25.424834+0000","last_clean":"2023-07-09T21:41:25.424834+0000","last_became_active":"2023-07-09T21:41:24.408261+0000","last_became_peered":"2023-07-09T21:41:24.408261+0000","last_unstale":"2023-07-09T21:41:25.424834+0000","last_undegraded":"2023-07-09T21:41:25.424834+0000","last_fullsized":"2023-07-09T21:41:25.424834+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:31:33.694325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401880+0000","last_change":"2023-07-09T21:41:24.416964+0000","last_active":"2023-07-09T21:41:25.401880+0000","last_peered":"2023-07-09T21:41:25.401880+0000","last_clean":"2023-07-09T21:41:25.401880+0000","last_became_active":"2023-07-09T21:41:24.415982+0000","last_became_peered":"2023-07-09T21:41:24.415982+0000","last_unstale":"2023-07-09T21:41:25.401880+0000","last_undegraded":"2023-07-09T21:41:25.401880+0000","last_fullsized":"2023-07-09T21:41:25.401880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:41.114037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401894+0000","last_change":"2023-07-09T21:41:24.409487+0000","last_active":"2023-07-09T21:41:25.401894+0000","last_peered":"2023-07-09T21:41:25.401894+0000","last_clean":"2023-07-09T21:41:25.401894+0000","last_became_active":"2023-07-09T21:41:24.409222+0000","last_became_peered":"2023-07-09T21:41:24.409222+0000","last_unstale":"2023-07-09T21:41:25.401894+0000","last_undegraded":"2023-07-09T21:41:25.401894+0000","last_fullsized":"2023-07-09T21:41:25.401894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:18.351485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402525+0000","last_change":"2023-07-09T21:41:24.418453+0000","last_active":"2023-07-09T21:41:25.402525+0000","last_peered":"2023-07-09T21:41:25.402525+0000","last_clean":"2023-07-09T21:41:25.402525+0000","last_became_active":"2023-07-09T21:41:24.418120+0000","last_became_peered":"2023-07-09T21:41:24.418120+0000","last_unstale":"2023-07-09T21:41:25.402525+0000","last_undegraded":"2023-07-09T21:41:25.402525+0000","last_fullsized":"2023-07-09T21:41:25.402525+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:23.791449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397753+0000","last_change":"2023-07-09T21:41:24.418500+0000","last_active":"2023-07-09T21:41:25.397753+0000","last_peered":"2023-07-09T21:41:25.397753+0000","last_clean":"2023-07-09T21:41:25.397753+0000","last_became_active":"2023-07-09T21:41:24.418159+0000","last_became_peered":"2023-07-09T21:41:24.418159+0000","last_unstale":"2023-07-09T21:41:25.397753+0000","last_undegraded":"2023-07-09T21:41:25.397753+0000","last_fullsized":"2023-07-09T21:41:25.397753+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:29.797478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424433+0000","last_change":"2023-07-09T21:41:24.414746+0000","last_active":"2023-07-09T21:41:25.424433+0000","last_peered":"2023-07-09T21:41:25.424433+0000","last_clean":"2023-07-09T21:41:25.424433+0000","last_became_active":"2023-07-09T21:41:24.414429+0000","last_became_peered":"2023-07-09T21:41:24.414429+0000","last_unstale":"2023-07-09T21:41:25.424433+0000","last_undegraded":"2023-07-09T21:41:25.424433+0000","last_fullsized":"2023-07-09T21:41:25.424433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:45:37.395282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401457+0000","last_change":"2023-07-09T21:41:24.416286+0000","last_active":"2023-07-09T21:41:25.401457+0000","last_peered":"2023-07-09T21:41:25.401457+0000","last_clean":"2023-07-09T21:41:25.401457+0000","last_became_active":"2023-07-09T21:41:24.416021+0000","last_became_peered":"2023-07-09T21:41:24.416021+0000","last_unstale":"2023-07-09T21:41:25.401457+0000","last_undegraded":"2023-07-09T21:41:25.401457+0000","last_fullsized":"2023-07-09T21:41:25.401457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:59:03.591123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397523+0000","last_change":"2023-07-09T21:41:24.422382+0000","last_active":"2023-07-09T21:41:25.397523+0000","last_peered":"2023-07-09T21:41:25.397523+0000","last_clean":"2023-07-09T21:41:25.397523+0000","last_became_active":"2023-07-09T21:41:24.422046+0000","last_became_peered":"2023-07-09T21:41:24.422046+0000","last_unstale":"2023-07-09T21:41:25.397523+0000","last_undegraded":"2023-07-09T21:41:25.397523+0000","last_fullsized":"2023-07-09T21:41:25.397523+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:05.888823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424167+0000","last_change":"2023-07-09T21:41:24.401379+0000","last_active":"2023-07-09T21:41:25.424167+0000","last_peered":"2023-07-09T21:41:25.424167+0000","last_clean":"2023-07-09T21:41:25.424167+0000","last_became_active":"2023-07-09T21:41:24.401120+0000","last_became_peered":"2023-07-09T21:41:24.401120+0000","last_unstale":"2023-07-09T21:41:25.424167+0000","last_undegraded":"2023-07-09T21:41:25.424167+0000","last_fullsized":"2023-07-09T21:41:25.424167+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:16.656481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425815+0000","last_change":"2023-07-09T21:41:24.403551+0000","last_active":"2023-07-09T21:41:25.425815+0000","last_peered":"2023-07-09T21:41:25.425815+0000","last_clean":"2023-07-09T21:41:25.425815+0000","last_became_active":"2023-07-09T21:41:24.403172+0000","last_became_peered":"2023-07-09T21:41:24.403172+0000","last_unstale":"2023-07-09T21:41:25.425815+0000","last_undegraded":"2023-07-09T21:41:25.425815+0000","last_fullsized":"2023-07-09T21:41:25.425815+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:02:49.922966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"128'4","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425582+0000","last_change":"2023-07-09T21:41:23.410170+0000","last_active":"2023-07-09T21:41:25.425582+0000","last_peered":"2023-07-09T21:41:25.425582+0000","last_clean":"2023-07-09T21:41:25.425582+0000","last_became_active":"2023-07-09T21:41:23.409871+0000","last_became_peered":"2023-07-09T21:41:23.409871+0000","last_unstale":"2023-07-09T21:41:25.425582+0000","last_undegraded":"2023-07-09T21:41:25.425582+0000","last_fullsized":"2023-07-09T21:41:25.425582+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:46:31.283899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424708+0000","last_change":"2023-07-09T21:41:24.414999+0000","last_active":"2023-07-09T21:41:25.424708+0000","last_peered":"2023-07-09T21:41:25.424708+0000","last_clean":"2023-07-09T21:41:25.424708+0000","last_became_active":"2023-07-09T21:41:24.414605+0000","last_became_peered":"2023-07-09T21:41:24.414605+0000","last_unstale":"2023-07-09T21:41:25.424708+0000","last_undegraded":"2023-07-09T21:41:25.424708+0000","last_fullsized":"2023-07-09T21:41:25.424708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:54.829492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425075+0000","last_change":"2023-07-09T21:41:23.406204+0000","last_active":"2023-07-09T21:41:25.425075+0000","last_peered":"2023-07-09T21:41:25.425075+0000","last_clean":"2023-07-09T21:41:25.425075+0000","last_became_active":"2023-07-09T21:41:23.405916+0000","last_became_peered":"2023-07-09T21:41:23.405916+0000","last_unstale":"2023-07-09T21:41:25.425075+0000","last_undegraded":"2023-07-09T21:41:25.425075+0000","last_fullsized":"2023-07-09T21:41:25.425075+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:08.915081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401490+0000","last_change":"2023-07-09T21:41:24.416218+0000","last_active":"2023-07-09T21:41:25.401490+0000","last_peered":"2023-07-09T21:41:25.401490+0000","last_clean":"2023-07-09T21:41:25.401490+0000","last_became_active":"2023-07-09T21:41:24.415874+0000","last_became_peered":"2023-07-09T21:41:24.415874+0000","last_unstale":"2023-07-09T21:41:25.401490+0000","last_undegraded":"2023-07-09T21:41:25.401490+0000","last_fullsized":"2023-07-09T21:41:25.401490+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:02.484364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401717+0000","last_change":"2023-07-09T21:41:23.409832+0000","last_active":"2023-07-09T21:41:25.401717+0000","last_peered":"2023-07-09T21:41:25.401717+0000","last_clean":"2023-07-09T21:41:25.401717+0000","last_became_active":"2023-07-09T21:41:23.409503+0000","last_became_peered":"2023-07-09T21:41:23.409503+0000","last_unstale":"2023-07-09T21:41:25.401717+0000","last_undegraded":"2023-07-09T21:41:25.401717+0000","last_fullsized":"2023-07-09T21:41:25.401717+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:21.993206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402494+0000","last_change":"2023-07-09T21:41:24.418511+0000","last_active":"2023-07-09T21:41:25.402494+0000","last_peered":"2023-07-09T21:41:25.402494+0000","last_clean":"2023-07-09T21:41:25.402494+0000","last_became_active":"2023-07-09T21:41:24.418221+0000","last_became_peered":"2023-07-09T21:41:24.418221+0000","last_unstale":"2023-07-09T21:41:25.402494+0000","last_undegraded":"2023-07-09T21:41:25.402494+0000","last_fullsized":"2023-07-09T21:41:25.402494+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:56.553515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426136+0000","last_change":"2023-07-09T21:41:23.408440+0000","last_active":"2023-07-09T21:41:25.426136+0000","last_peered":"2023-07-09T21:41:25.426136+0000","last_clean":"2023-07-09T21:41:25.426136+0000","last_became_active":"2023-07-09T21:41:23.408100+0000","last_became_peered":"2023-07-09T21:41:23.408100+0000","last_unstale":"2023-07-09T21:41:25.426136+0000","last_undegraded":"2023-07-09T21:41:25.426136+0000","last_fullsized":"2023-07-09T21:41:25.426136+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:38:19.948478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424582+0000","last_change":"2023-07-09T21:41:24.413636+0000","last_active":"2023-07-09T21:41:25.424582+0000","last_peered":"2023-07-09T21:41:25.424582+0000","last_clean":"2023-07-09T21:41:25.424582+0000","last_became_active":"2023-07-09T21:41:24.413352+0000","last_became_peered":"2023-07-09T21:41:24.413352+0000","last_unstale":"2023-07-09T21:41:25.424582+0000","last_undegraded":"2023-07-09T21:41:25.424582+0000","last_fullsized":"2023-07-09T21:41:25.424582+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:37:14.554943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428988+0000","last_change":"2023-07-09T21:41:23.415349+0000","last_active":"2023-07-09T21:41:25.428988+0000","last_peered":"2023-07-09T21:41:25.428988+0000","last_clean":"2023-07-09T21:41:25.428988+0000","last_became_active":"2023-07-09T21:41:23.415046+0000","last_became_peered":"2023-07-09T21:41:23.415046+0000","last_unstale":"2023-07-09T21:41:25.428988+0000","last_undegraded":"2023-07-09T21:41:25.428988+0000","last_fullsized":"2023-07-09T21:41:25.428988+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:44:48.866438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426451+0000","last_change":"2023-07-09T21:41:24.405386+0000","last_active":"2023-07-09T21:41:25.426451+0000","last_peered":"2023-07-09T21:41:25.426451+0000","last_clean":"2023-07-09T21:41:25.426451+0000","last_became_active":"2023-07-09T21:41:24.404791+0000","last_became_peered":"2023-07-09T21:41:24.404791+0000","last_unstale":"2023-07-09T21:41:25.426451+0000","last_undegraded":"2023-07-09T21:41:25.426451+0000","last_fullsized":"2023-07-09T21:41:25.426451+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:49:24.476435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402020+0000","last_change":"2023-07-09T21:41:23.408634+0000","last_active":"2023-07-09T21:41:25.402020+0000","last_peered":"2023-07-09T21:41:25.402020+0000","last_clean":"2023-07-09T21:41:25.402020+0000","last_became_active":"2023-07-09T21:41:23.408353+0000","last_became_peered":"2023-07-09T21:41:23.408353+0000","last_unstale":"2023-07-09T21:41:25.402020+0000","last_undegraded":"2023-07-09T21:41:25.402020+0000","last_fullsized":"2023-07-09T21:41:25.402020+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:11.705371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398228+0000","last_change":"2023-07-09T21:41:24.415060+0000","last_active":"2023-07-09T21:41:25.398228+0000","last_peered":"2023-07-09T21:41:25.398228+0000","last_clean":"2023-07-09T21:41:25.398228+0000","last_became_active":"2023-07-09T21:41:24.414528+0000","last_became_peered":"2023-07-09T21:41:24.414528+0000","last_unstale":"2023-07-09T21:41:25.398228+0000","last_undegraded":"2023-07-09T21:41:25.398228+0000","last_fullsized":"2023-07-09T21:41:25.398228+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:59:11.873605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401198+0000","last_change":"2023-07-09T21:41:23.411059+0000","last_active":"2023-07-09T21:41:25.401198+0000","last_peered":"2023-07-09T21:41:25.401198+0000","last_clean":"2023-07-09T21:41:25.401198+0000","last_became_active":"2023-07-09T21:41:23.410779+0000","last_became_peered":"2023-07-09T21:41:23.410779+0000","last_unstale":"2023-07-09T21:41:25.401198+0000","last_undegraded":"2023-07-09T21:41:25.401198+0000","last_fullsized":"2023-07-09T21:41:25.401198+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:29:54.980381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425442+0000","last_change":"2023-07-09T21:41:24.415774+0000","last_active":"2023-07-09T21:41:25.425442+0000","last_peered":"2023-07-09T21:41:25.425442+0000","last_clean":"2023-07-09T21:41:25.425442+0000","last_became_active":"2023-07-09T21:41:24.415461+0000","last_became_peered":"2023-07-09T21:41:24.415461+0000","last_unstale":"2023-07-09T21:41:25.425442+0000","last_undegraded":"2023-07-09T21:41:25.425442+0000","last_fullsized":"2023-07-09T21:41:25.425442+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:13.372797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.423904+0000","last_change":"2023-07-09T21:41:23.400312+0000","last_active":"2023-07-09T21:41:25.423904+0000","last_peered":"2023-07-09T21:41:25.423904+0000","last_clean":"2023-07-09T21:41:25.423904+0000","last_became_active":"2023-07-09T21:41:23.400038+0000","last_became_peered":"2023-07-09T21:41:23.400038+0000","last_unstale":"2023-07-09T21:41:25.423904+0000","last_undegraded":"2023-07-09T21:41:25.423904+0000","last_fullsized":"2023-07-09T21:41:25.423904+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:23.437185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425776+0000","last_change":"2023-07-09T21:41:24.404916+0000","last_active":"2023-07-09T21:41:25.425776+0000","last_peered":"2023-07-09T21:41:25.425776+0000","last_clean":"2023-07-09T21:41:25.425776+0000","last_became_active":"2023-07-09T21:41:24.404612+0000","last_became_peered":"2023-07-09T21:41:24.404612+0000","last_unstale":"2023-07-09T21:41:25.425776+0000","last_undegraded":"2023-07-09T21:41:25.425776+0000","last_fullsized":"2023-07-09T21:41:25.425776+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:28.625214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401884+0000","last_change":"2023-07-09T21:41:23.410925+0000","last_active":"2023-07-09T21:41:25.401884+0000","last_peered":"2023-07-09T21:41:25.401884+0000","last_clean":"2023-07-09T21:41:25.401884+0000","last_became_active":"2023-07-09T21:41:23.410630+0000","last_became_peered":"2023-07-09T21:41:23.410630+0000","last_unstale":"2023-07-09T21:41:25.401884+0000","last_undegraded":"2023-07-09T21:41:25.401884+0000","last_fullsized":"2023-07-09T21:41:25.401884+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:12.468131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425467+0000","last_change":"2023-07-09T21:41:24.401325+0000","last_active":"2023-07-09T21:41:25.425467+0000","last_peered":"2023-07-09T21:41:25.425467+0000","last_clean":"2023-07-09T21:41:25.425467+0000","last_became_active":"2023-07-09T21:41:24.401005+0000","last_became_peered":"2023-07-09T21:41:24.401005+0000","last_unstale":"2023-07-09T21:41:25.425467+0000","last_undegraded":"2023-07-09T21:41:25.425467+0000","last_fullsized":"2023-07-09T21:41:25.425467+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:31:04.766417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426101+0000","last_change":"2023-07-09T21:41:23.406825+0000","last_active":"2023-07-09T21:41:25.426101+0000","last_peered":"2023-07-09T21:41:25.426101+0000","last_clean":"2023-07-09T21:41:25.426101+0000","last_became_active":"2023-07-09T21:41:23.406551+0000","last_became_peered":"2023-07-09T21:41:23.406551+0000","last_unstale":"2023-07-09T21:41:25.426101+0000","last_undegraded":"2023-07-09T21:41:25.426101+0000","last_fullsized":"2023-07-09T21:41:25.426101+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:12.709185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424003+0000","last_change":"2023-07-09T21:41:24.414306+0000","last_active":"2023-07-09T21:41:25.424003+0000","last_peered":"2023-07-09T21:41:25.424003+0000","last_clean":"2023-07-09T21:41:25.424003+0000","last_became_active":"2023-07-09T21:41:24.414020+0000","last_became_peered":"2023-07-09T21:41:24.414020+0000","last_unstale":"2023-07-09T21:41:25.424003+0000","last_undegraded":"2023-07-09T21:41:25.424003+0000","last_fullsized":"2023-07-09T21:41:25.424003+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:35:08.507439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"128'3","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429057+0000","last_change":"2023-07-09T21:41:23.410301+0000","last_active":"2023-07-09T21:41:25.429057+0000","last_peered":"2023-07-09T21:41:25.429057+0000","last_clean":"2023-07-09T21:41:25.429057+0000","last_became_active":"2023-07-09T21:41:23.410015+0000","last_became_peered":"2023-07-09T21:41:23.410015+0000","last_unstale":"2023-07-09T21:41:25.429057+0000","last_undegraded":"2023-07-09T21:41:25.429057+0000","last_fullsized":"2023-07-09T21:41:25.429057+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:55.606948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425663+0000","last_change":"2023-07-09T21:41:24.406594+0000","last_active":"2023-07-09T21:41:25.425663+0000","last_peered":"2023-07-09T21:41:25.425663+0000","last_clean":"2023-07-09T21:41:25.425663+0000","last_became_active":"2023-07-09T21:41:24.402796+0000","last_became_peered":"2023-07-09T21:41:24.402796+0000","last_unstale":"2023-07-09T21:41:25.425663+0000","last_undegraded":"2023-07-09T21:41:25.425663+0000","last_fullsized":"2023-07-09T21:41:25.425663+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:07:39.847567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"128'6","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397872+0000","last_change":"2023-07-09T21:41:23.405581+0000","last_active":"2023-07-09T21:41:25.397872+0000","last_peered":"2023-07-09T21:41:25.397872+0000","last_clean":"2023-07-09T21:41:25.397872+0000","last_became_active":"2023-07-09T21:41:23.405276+0000","last_became_peered":"2023-07-09T21:41:23.405276+0000","last_unstale":"2023-07-09T21:41:25.397872+0000","last_undegraded":"2023-07-09T21:41:25.397872+0000","last_fullsized":"2023-07-09T21:41:25.397872+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:38:05.694114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402806+0000","last_change":"2023-07-09T21:41:24.411702+0000","last_active":"2023-07-09T21:41:25.402806+0000","last_peered":"2023-07-09T21:41:25.402806+0000","last_clean":"2023-07-09T21:41:25.402806+0000","last_became_active":"2023-07-09T21:41:24.411350+0000","last_became_peered":"2023-07-09T21:41:24.411350+0000","last_unstale":"2023-07-09T21:41:25.402806+0000","last_undegraded":"2023-07-09T21:41:25.402806+0000","last_fullsized":"2023-07-09T21:41:25.402806+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:56:52.159637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425677+0000","last_change":"2023-07-09T21:41:23.404033+0000","last_active":"2023-07-09T21:41:25.425677+0000","last_peered":"2023-07-09T21:41:25.425677+0000","last_clean":"2023-07-09T21:41:25.425677+0000","last_became_active":"2023-07-09T21:41:23.403730+0000","last_became_peered":"2023-07-09T21:41:23.403730+0000","last_unstale":"2023-07-09T21:41:25.425677+0000","last_undegraded":"2023-07-09T21:41:25.425677+0000","last_fullsized":"2023-07-09T21:41:25.425677+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:57.330621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397959+0000","last_change":"2023-07-09T21:41:24.413023+0000","last_active":"2023-07-09T21:41:25.397959+0000","last_peered":"2023-07-09T21:41:25.397959+0000","last_clean":"2023-07-09T21:41:25.397959+0000","last_became_active":"2023-07-09T21:41:24.412696+0000","last_became_peered":"2023-07-09T21:41:24.412696+0000","last_unstale":"2023-07-09T21:41:25.397959+0000","last_undegraded":"2023-07-09T21:41:25.397959+0000","last_fullsized":"2023-07-09T21:41:25.397959+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:37.750882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424258+0000","last_change":"2023-07-09T21:41:23.402616+0000","last_active":"2023-07-09T21:41:25.424258+0000","last_peered":"2023-07-09T21:41:25.424258+0000","last_clean":"2023-07-09T21:41:25.424258+0000","last_became_active":"2023-07-09T21:41:23.402350+0000","last_became_peered":"2023-07-09T21:41:23.402350+0000","last_unstale":"2023-07-09T21:41:25.424258+0000","last_undegraded":"2023-07-09T21:41:25.424258+0000","last_fullsized":"2023-07-09T21:41:25.424258+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:28.444968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425018+0000","last_change":"2023-07-09T21:41:24.401001+0000","last_active":"2023-07-09T21:41:25.425018+0000","last_peered":"2023-07-09T21:41:25.425018+0000","last_clean":"2023-07-09T21:41:25.425018+0000","last_became_active":"2023-07-09T21:41:24.400725+0000","last_became_peered":"2023-07-09T21:41:24.400725+0000","last_unstale":"2023-07-09T21:41:25.425018+0000","last_undegraded":"2023-07-09T21:41:25.425018+0000","last_fullsized":"2023-07-09T21:41:25.425018+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:17.487525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424742+0000","last_change":"2023-07-09T21:41:23.408629+0000","last_active":"2023-07-09T21:41:25.424742+0000","last_peered":"2023-07-09T21:41:25.424742+0000","last_clean":"2023-07-09T21:41:25.424742+0000","last_became_active":"2023-07-09T21:41:23.408327+0000","last_became_peered":"2023-07-09T21:41:23.408327+0000","last_unstale":"2023-07-09T21:41:25.424742+0000","last_undegraded":"2023-07-09T21:41:25.424742+0000","last_fullsized":"2023-07-09T21:41:25.424742+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:47.153174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426462+0000","last_change":"2023-07-09T21:41:24.413239+0000","last_active":"2023-07-09T21:41:25.426462+0000","last_peered":"2023-07-09T21:41:25.426462+0000","last_clean":"2023-07-09T21:41:25.426462+0000","last_became_active":"2023-07-09T21:41:24.412968+0000","last_became_peered":"2023-07-09T21:41:24.412968+0000","last_unstale":"2023-07-09T21:41:25.426462+0000","last_undegraded":"2023-07-09T21:41:25.426462+0000","last_fullsized":"2023-07-09T21:41:25.426462+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:10:15.499671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"128'8","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401166+0000","last_change":"2023-07-09T21:41:23.409766+0000","last_active":"2023-07-09T21:41:25.401166+0000","last_peered":"2023-07-09T21:41:25.401166+0000","last_clean":"2023-07-09T21:41:25.401166+0000","last_became_active":"2023-07-09T21:41:23.409466+0000","last_became_peered":"2023-07-09T21:41:23.409466+0000","last_unstale":"2023-07-09T21:41:25.401166+0000","last_undegraded":"2023-07-09T21:41:25.401166+0000","last_fullsized":"2023-07-09T21:41:25.401166+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:41:10.461371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425684+0000","last_change":"2023-07-09T21:41:24.405022+0000","last_active":"2023-07-09T21:41:25.425684+0000","last_peered":"2023-07-09T21:41:25.425684+0000","last_clean":"2023-07-09T21:41:25.425684+0000","last_became_active":"2023-07-09T21:41:24.404718+0000","last_became_peered":"2023-07-09T21:41:24.404718+0000","last_unstale":"2023-07-09T21:41:25.425684+0000","last_undegraded":"2023-07-09T21:41:25.425684+0000","last_fullsized":"2023-07-09T21:41:25.425684+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:12:52.597222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424822+0000","last_change":"2023-07-09T21:41:23.403988+0000","last_active":"2023-07-09T21:41:25.424822+0000","last_peered":"2023-07-09T21:41:25.424822+0000","last_clean":"2023-07-09T21:41:25.424822+0000","last_became_active":"2023-07-09T21:41:23.403716+0000","last_became_peered":"2023-07-09T21:41:23.403716+0000","last_unstale":"2023-07-09T21:41:25.424822+0000","last_undegraded":"2023-07-09T21:41:25.424822+0000","last_fullsized":"2023-07-09T21:41:25.424822+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:26.984462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401139+0000","last_change":"2023-07-09T21:41:24.412699+0000","last_active":"2023-07-09T21:41:25.401139+0000","last_peered":"2023-07-09T21:41:25.401139+0000","last_clean":"2023-07-09T21:41:25.401139+0000","last_became_active":"2023-07-09T21:41:24.412281+0000","last_became_peered":"2023-07-09T21:41:24.412281+0000","last_unstale":"2023-07-09T21:41:25.401139+0000","last_undegraded":"2023-07-09T21:41:25.401139+0000","last_fullsized":"2023-07-09T21:41:25.401139+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:04:04.010948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"129'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426251+0000","last_change":"2023-07-09T21:41:23.405390+0000","last_active":"2023-07-09T21:41:25.426251+0000","last_peered":"2023-07-09T21:41:25.426251+0000","last_clean":"2023-07-09T21:41:25.426251+0000","last_became_active":"2023-07-09T21:41:23.405110+0000","last_became_peered":"2023-07-09T21:41:23.405110+0000","last_unstale":"2023-07-09T21:41:25.426251+0000","last_undegraded":"2023-07-09T21:41:25.426251+0000","last_fullsized":"2023-07-09T21:41:25.426251+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:57.415102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424157+0000","last_change":"2023-07-09T21:41:24.409865+0000","last_active":"2023-07-09T21:41:25.424157+0000","last_peered":"2023-07-09T21:41:25.424157+0000","last_clean":"2023-07-09T21:41:25.424157+0000","last_became_active":"2023-07-09T21:41:24.409603+0000","last_became_peered":"2023-07-09T21:41:24.409603+0000","last_unstale":"2023-07-09T21:41:25.424157+0000","last_undegraded":"2023-07-09T21:41:25.424157+0000","last_fullsized":"2023-07-09T21:41:25.424157+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:42:35.446258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398035+0000","last_change":"2023-07-09T21:41:23.409226+0000","last_active":"2023-07-09T21:41:25.398035+0000","last_peered":"2023-07-09T21:41:25.398035+0000","last_clean":"2023-07-09T21:41:25.398035+0000","last_became_active":"2023-07-09T21:41:23.408915+0000","last_became_peered":"2023-07-09T21:41:23.408915+0000","last_unstale":"2023-07-09T21:41:25.398035+0000","last_undegraded":"2023-07-09T21:41:25.398035+0000","last_fullsized":"2023-07-09T21:41:25.398035+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:21.099794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402335+0000","last_change":"2023-07-09T21:41:24.411744+0000","last_active":"2023-07-09T21:41:25.402335+0000","last_peered":"2023-07-09T21:41:25.402335+0000","last_clean":"2023-07-09T21:41:25.402335+0000","last_became_active":"2023-07-09T21:41:24.411452+0000","last_became_peered":"2023-07-09T21:41:24.411452+0000","last_unstale":"2023-07-09T21:41:25.402335+0000","last_undegraded":"2023-07-09T21:41:25.402335+0000","last_fullsized":"2023-07-09T21:41:25.402335+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:45.969156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426357+0000","last_change":"2023-07-09T21:41:23.410114+0000","last_active":"2023-07-09T21:41:25.426357+0000","last_peered":"2023-07-09T21:41:25.426357+0000","last_clean":"2023-07-09T21:41:25.426357+0000","last_became_active":"2023-07-09T21:41:23.409820+0000","last_became_peered":"2023-07-09T21:41:23.409820+0000","last_unstale":"2023-07-09T21:41:25.426357+0000","last_undegraded":"2023-07-09T21:41:25.426357+0000","last_fullsized":"2023-07-09T21:41:25.426357+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:48.053439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424921+0000","last_change":"2023-07-09T21:41:24.414236+0000","last_active":"2023-07-09T21:41:25.424921+0000","last_peered":"2023-07-09T21:41:25.424921+0000","last_clean":"2023-07-09T21:41:25.424921+0000","last_became_active":"2023-07-09T21:41:24.413918+0000","last_became_peered":"2023-07-09T21:41:24.413918+0000","last_unstale":"2023-07-09T21:41:25.424921+0000","last_undegraded":"2023-07-09T21:41:25.424921+0000","last_fullsized":"2023-07-09T21:41:25.424921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:20.940772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.401389+0000","last_change":"2023-07-09T21:41:23.415235+0000","last_active":"2023-07-09T21:41:25.401389+0000","last_peered":"2023-07-09T21:41:25.401389+0000","last_clean":"2023-07-09T21:41:25.401389+0000","last_became_active":"2023-07-09T21:41:23.414961+0000","last_became_peered":"2023-07-09T21:41:23.414961+0000","last_unstale":"2023-07-09T21:41:25.401389+0000","last_undegraded":"2023-07-09T21:41:25.401389+0000","last_fullsized":"2023-07-09T21:41:25.401389+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:51:10.286411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424959+0000","last_change":"2023-07-09T21:41:24.414915+0000","last_active":"2023-07-09T21:41:25.424959+0000","last_peered":"2023-07-09T21:41:25.424959+0000","last_clean":"2023-07-09T21:41:25.424959+0000","last_became_active":"2023-07-09T21:41:24.414620+0000","last_became_peered":"2023-07-09T21:41:24.414620+0000","last_unstale":"2023-07-09T21:41:25.424959+0000","last_undegraded":"2023-07-09T21:41:25.424959+0000","last_fullsized":"2023-07-09T21:41:25.424959+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:59.330802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424112+0000","last_change":"2023-07-09T21:41:23.408567+0000","last_active":"2023-07-09T21:41:25.424112+0000","last_peered":"2023-07-09T21:41:25.424112+0000","last_clean":"2023-07-09T21:41:25.424112+0000","last_became_active":"2023-07-09T21:41:23.408258+0000","last_became_peered":"2023-07-09T21:41:23.408258+0000","last_unstale":"2023-07-09T21:41:25.424112+0000","last_undegraded":"2023-07-09T21:41:25.424112+0000","last_fullsized":"2023-07-09T21:41:25.424112+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:52.756350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429273+0000","last_change":"2023-07-09T21:41:24.424216+0000","last_active":"2023-07-09T21:41:25.429273+0000","last_peered":"2023-07-09T21:41:25.429273+0000","last_clean":"2023-07-09T21:41:25.429273+0000","last_became_active":"2023-07-09T21:41:24.423661+0000","last_became_peered":"2023-07-09T21:41:24.423661+0000","last_unstale":"2023-07-09T21:41:25.429273+0000","last_undegraded":"2023-07-09T21:41:25.429273+0000","last_fullsized":"2023-07-09T21:41:25.429273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:09:53.015213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397752+0000","last_change":"2023-07-09T21:41:23.404952+0000","last_active":"2023-07-09T21:41:25.397752+0000","last_peered":"2023-07-09T21:41:25.397752+0000","last_clean":"2023-07-09T21:41:25.397752+0000","last_became_active":"2023-07-09T21:41:23.404681+0000","last_became_peered":"2023-07-09T21:41:23.404681+0000","last_unstale":"2023-07-09T21:41:25.397752+0000","last_undegraded":"2023-07-09T21:41:25.397752+0000","last_fullsized":"2023-07-09T21:41:25.397752+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:31.678853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402918+0000","last_change":"2023-07-09T21:41:24.415229+0000","last_active":"2023-07-09T21:41:25.402918+0000","last_peered":"2023-07-09T21:41:25.402918+0000","last_clean":"2023-07-09T21:41:25.402918+0000","last_became_active":"2023-07-09T21:41:24.414945+0000","last_became_peered":"2023-07-09T21:41:24.414945+0000","last_unstale":"2023-07-09T21:41:25.402918+0000","last_undegraded":"2023-07-09T21:41:25.402918+0000","last_fullsized":"2023-07-09T21:41:25.402918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:07.685335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424509+0000","last_change":"2023-07-09T21:41:23.408898+0000","last_active":"2023-07-09T21:41:25.424509+0000","last_peered":"2023-07-09T21:41:25.424509+0000","last_clean":"2023-07-09T21:41:25.424509+0000","last_became_active":"2023-07-09T21:41:23.408239+0000","last_became_peered":"2023-07-09T21:41:23.408239+0000","last_unstale":"2023-07-09T21:41:25.424509+0000","last_undegraded":"2023-07-09T21:41:25.424509+0000","last_fullsized":"2023-07-09T21:41:25.424509+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:19:52.481360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402216+0000","last_change":"2023-07-09T21:41:24.412664+0000","last_active":"2023-07-09T21:41:25.402216+0000","last_peered":"2023-07-09T21:41:25.402216+0000","last_clean":"2023-07-09T21:41:25.402216+0000","last_became_active":"2023-07-09T21:41:24.412291+0000","last_became_peered":"2023-07-09T21:41:24.412291+0000","last_unstale":"2023-07-09T21:41:25.402216+0000","last_undegraded":"2023-07-09T21:41:25.402216+0000","last_fullsized":"2023-07-09T21:41:25.402216+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:33.354063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425117+0000","last_change":"2023-07-09T21:41:23.406811+0000","last_active":"2023-07-09T21:41:25.425117+0000","last_peered":"2023-07-09T21:41:25.425117+0000","last_clean":"2023-07-09T21:41:25.425117+0000","last_became_active":"2023-07-09T21:41:23.406502+0000","last_became_peered":"2023-07-09T21:41:23.406502+0000","last_unstale":"2023-07-09T21:41:25.425117+0000","last_undegraded":"2023-07-09T21:41:25.425117+0000","last_fullsized":"2023-07-09T21:41:25.425117+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:09:59.144464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"117'227","reported_seq":758,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429083+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:41:25.429083+0000","last_peered":"2023-07-09T21:41:25.429083+0000","last_clean":"2023-07-09T21:41:25.429083+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:41:25.429083+0000","last_undegraded":"2023-07-09T21:41:25.429083+0000","last_fullsized":"2023-07-09T21:41:25.429083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":227,"log_dups_size":0,"ondisk_log_size":227,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:14:11.289103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":240,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402526+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:41:25.402526+0000","last_peered":"2023-07-09T21:41:25.402526+0000","last_clean":"2023-07-09T21:41:25.402526+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:41:25.402526+0000","last_undegraded":"2023-07-09T21:41:25.402526+0000","last_fullsized":"2023-07-09T21:41:25.402526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:05.698641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397669+0000","last_change":"2023-07-09T21:41:24.409326+0000","last_active":"2023-07-09T21:41:25.397669+0000","last_peered":"2023-07-09T21:41:25.397669+0000","last_clean":"2023-07-09T21:41:25.397669+0000","last_became_active":"2023-07-09T21:41:24.409009+0000","last_became_peered":"2023-07-09T21:41:24.409009+0000","last_unstale":"2023-07-09T21:41:25.397669+0000","last_undegraded":"2023-07-09T21:41:25.397669+0000","last_fullsized":"2023-07-09T21:41:25.397669+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:58:56.043995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429108+0000","last_change":"2023-07-09T21:41:23.412162+0000","last_active":"2023-07-09T21:41:25.429108+0000","last_peered":"2023-07-09T21:41:25.429108+0000","last_clean":"2023-07-09T21:41:25.429108+0000","last_became_active":"2023-07-09T21:41:23.411859+0000","last_became_peered":"2023-07-09T21:41:23.411859+0000","last_unstale":"2023-07-09T21:41:25.429108+0000","last_undegraded":"2023-07-09T21:41:25.429108+0000","last_fullsized":"2023-07-09T21:41:25.429108+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:57:37.141424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":212,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.428833+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:41:25.428833+0000","last_peered":"2023-07-09T21:41:25.428833+0000","last_clean":"2023-07-09T21:41:25.428833+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:41:25.428833+0000","last_undegraded":"2023-07-09T21:41:25.428833+0000","last_fullsized":"2023-07-09T21:41:25.428833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:36.427569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425564+0000","last_change":"2023-07-09T21:41:24.410923+0000","last_active":"2023-07-09T21:41:25.425564+0000","last_peered":"2023-07-09T21:41:25.425564+0000","last_clean":"2023-07-09T21:41:25.425564+0000","last_became_active":"2023-07-09T21:41:24.410584+0000","last_became_peered":"2023-07-09T21:41:24.410584+0000","last_unstale":"2023-07-09T21:41:25.425564+0000","last_undegraded":"2023-07-09T21:41:25.425564+0000","last_fullsized":"2023-07-09T21:41:25.425564+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:19:08.799650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402496+0000","last_change":"2023-07-09T21:41:23.409499+0000","last_active":"2023-07-09T21:41:25.402496+0000","last_peered":"2023-07-09T21:41:25.402496+0000","last_clean":"2023-07-09T21:41:25.402496+0000","last_became_active":"2023-07-09T21:41:23.408924+0000","last_became_peered":"2023-07-09T21:41:23.408924+0000","last_unstale":"2023-07-09T21:41:25.402496+0000","last_undegraded":"2023-07-09T21:41:25.402496+0000","last_fullsized":"2023-07-09T21:41:25.402496+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:34.802847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":206,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424811+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:41:25.424811+0000","last_peered":"2023-07-09T21:41:25.424811+0000","last_clean":"2023-07-09T21:41:25.424811+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:41:25.424811+0000","last_undegraded":"2023-07-09T21:41:25.424811+0000","last_fullsized":"2023-07-09T21:41:25.424811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:59.149270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424291+0000","last_change":"2023-07-09T21:41:24.399624+0000","last_active":"2023-07-09T21:41:25.424291+0000","last_peered":"2023-07-09T21:41:25.424291+0000","last_clean":"2023-07-09T21:41:25.424291+0000","last_became_active":"2023-07-09T21:41:24.398474+0000","last_became_peered":"2023-07-09T21:41:24.398474+0000","last_unstale":"2023-07-09T21:41:25.424291+0000","last_undegraded":"2023-07-09T21:41:25.424291+0000","last_fullsized":"2023-07-09T21:41:25.424291+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:13:23.199252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"128'1","reported_seq":14,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398074+0000","last_change":"2023-07-09T21:41:23.402034+0000","last_active":"2023-07-09T21:41:25.398074+0000","last_peered":"2023-07-09T21:41:25.398074+0000","last_clean":"2023-07-09T21:41:25.398074+0000","last_became_active":"2023-07-09T21:41:23.401726+0000","last_became_peered":"2023-07-09T21:41:23.401726+0000","last_unstale":"2023-07-09T21:41:25.398074+0000","last_undegraded":"2023-07-09T21:41:25.398074+0000","last_fullsized":"2023-07-09T21:41:25.398074+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:45.784943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":240,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.402165+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:41:25.402165+0000","last_peered":"2023-07-09T21:41:25.402165+0000","last_clean":"2023-07-09T21:41:25.402165+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:41:25.402165+0000","last_undegraded":"2023-07-09T21:41:25.402165+0000","last_fullsized":"2023-07-09T21:41:25.402165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:13:07.995879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424595+0000","last_change":"2023-07-09T21:41:24.410445+0000","last_active":"2023-07-09T21:41:25.424595+0000","last_peered":"2023-07-09T21:41:25.424595+0000","last_clean":"2023-07-09T21:41:25.424595+0000","last_became_active":"2023-07-09T21:41:24.410184+0000","last_became_peered":"2023-07-09T21:41:24.410184+0000","last_unstale":"2023-07-09T21:41:25.424595+0000","last_undegraded":"2023-07-09T21:41:25.424595+0000","last_fullsized":"2023-07-09T21:41:25.424595+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:52.980475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.397737+0000","last_change":"2023-07-09T21:41:23.404513+0000","last_active":"2023-07-09T21:41:25.397737+0000","last_peered":"2023-07-09T21:41:25.397737+0000","last_clean":"2023-07-09T21:41:25.397737+0000","last_became_active":"2023-07-09T21:41:23.404196+0000","last_became_peered":"2023-07-09T21:41:23.404196+0000","last_unstale":"2023-07-09T21:41:25.397737+0000","last_undegraded":"2023-07-09T21:41:25.397737+0000","last_fullsized":"2023-07-09T21:41:25.397737+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:00.228514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":202,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426252+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:41:25.426252+0000","last_peered":"2023-07-09T21:41:25.426252+0000","last_clean":"2023-07-09T21:41:25.426252+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:41:25.426252+0000","last_undegraded":"2023-07-09T21:41:25.426252+0000","last_fullsized":"2023-07-09T21:41:25.426252+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:38:01.766432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425169+0000","last_change":"2023-07-09T21:41:24.415011+0000","last_active":"2023-07-09T21:41:25.425169+0000","last_peered":"2023-07-09T21:41:25.425169+0000","last_clean":"2023-07-09T21:41:25.425169+0000","last_became_active":"2023-07-09T21:41:24.414215+0000","last_became_peered":"2023-07-09T21:41:24.414215+0000","last_unstale":"2023-07-09T21:41:25.425169+0000","last_undegraded":"2023-07-09T21:41:25.425169+0000","last_fullsized":"2023-07-09T21:41:25.425169+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:56.533672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424396+0000","last_change":"2023-07-09T21:41:23.403900+0000","last_active":"2023-07-09T21:41:25.424396+0000","last_peered":"2023-07-09T21:41:25.424396+0000","last_clean":"2023-07-09T21:41:25.424396+0000","last_became_active":"2023-07-09T21:41:23.403592+0000","last_became_peered":"2023-07-09T21:41:23.403592+0000","last_unstale":"2023-07-09T21:41:25.424396+0000","last_undegraded":"2023-07-09T21:41:25.424396+0000","last_fullsized":"2023-07-09T21:41:25.424396+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:11:00.254640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":212,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.429226+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:41:25.429226+0000","last_peered":"2023-07-09T21:41:25.429226+0000","last_clean":"2023-07-09T21:41:25.429226+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:41:25.429226+0000","last_undegraded":"2023-07-09T21:41:25.429226+0000","last_fullsized":"2023-07-09T21:41:25.429226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:07:53.354187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426072+0000","last_change":"2023-07-09T21:41:24.410267+0000","last_active":"2023-07-09T21:41:25.426072+0000","last_peered":"2023-07-09T21:41:25.426072+0000","last_clean":"2023-07-09T21:41:25.426072+0000","last_became_active":"2023-07-09T21:41:24.409905+0000","last_became_peered":"2023-07-09T21:41:24.409905+0000","last_unstale":"2023-07-09T21:41:25.426072+0000","last_undegraded":"2023-07-09T21:41:25.426072+0000","last_fullsized":"2023-07-09T21:41:25.426072+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:17:13.000493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"128'2","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.424554+0000","last_change":"2023-07-09T21:41:23.401278+0000","last_active":"2023-07-09T21:41:25.424554+0000","last_peered":"2023-07-09T21:41:25.424554+0000","last_clean":"2023-07-09T21:41:25.424554+0000","last_became_active":"2023-07-09T21:41:23.400772+0000","last_became_peered":"2023-07-09T21:41:23.400772+0000","last_unstale":"2023-07-09T21:41:25.424554+0000","last_undegraded":"2023-07-09T21:41:25.424554+0000","last_fullsized":"2023-07-09T21:41:25.424554+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:49.506120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":203,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.425182+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:41:25.425182+0000","last_peered":"2023-07-09T21:41:25.425182+0000","last_clean":"2023-07-09T21:41:25.425182+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:41:25.425182+0000","last_undegraded":"2023-07-09T21:41:25.425182+0000","last_fullsized":"2023-07-09T21:41:25.425182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:45.176979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":11,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.426433+0000","last_change":"2023-07-09T21:41:24.408268+0000","last_active":"2023-07-09T21:41:25.426433+0000","last_peered":"2023-07-09T21:41:25.426433+0000","last_clean":"2023-07-09T21:41:25.426433+0000","last_became_active":"2023-07-09T21:41:24.407900+0000","last_became_peered":"2023-07-09T21:41:24.407900+0000","last_unstale":"2023-07-09T21:41:25.426433+0000","last_undegraded":"2023-07-09T21:41:25.426433+0000","last_fullsized":"2023-07-09T21:41:25.426433+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:23.375678+0000","last_clean_scrub_stamp":"2023-07-09T21:41:23.375678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:19:31.965172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.423858+0000","last_change":"2023-07-09T21:41:23.404279+0000","last_active":"2023-07-09T21:41:25.423858+0000","last_peered":"2023-07-09T21:41:25.423858+0000","last_clean":"2023-07-09T21:41:25.423858+0000","last_became_active":"2023-07-09T21:41:23.403598+0000","last_became_peered":"2023-07-09T21:41:23.403598+0000","last_unstale":"2023-07-09T21:41:25.423858+0000","last_undegraded":"2023-07-09T21:41:25.423858+0000","last_fullsized":"2023-07-09T21:41:25.423858+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:41:22.366296+0000","last_clean_scrub_stamp":"2023-07-09T21:41:22.366296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:57:24.794133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":209,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-07-09T21:41:25.398158+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:41:25.398158+0000","last_peered":"2023-07-09T21:41:25.398158+0000","last_clean":"2023-07-09T21:41:25.398158+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:41:25.398158+0000","last_undegraded":"2023-07-09T21:41:25.398158+0000","last_fullsized":"2023-07-09T21:41:25.398158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:46:02.872608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1076,"num_read_kb":2160,"num_write":359,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575077,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59432,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312408,"statfs":{"total":96636764160,"available":96575905792,"internally_reserved":0,"allocated":2195456,"data_stored":1399290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.69499999999999995,"15min":0.70999999999999996},"min":{"1min":0.59599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.748},{"interface":"front","average":{"1min":0.751,"5min":0.74299999999999999,"15min":0.73399999999999999},"min":{"1min":0.45600000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.0249999999999999,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.52300000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.73299999999999998,"15min":0.72999999999999998},"min":{"1min":0.42499999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.97799999999999998,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.751,"15min":0.73799999999999999},"min":{"1min":0.54300000000000004,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.0600000000000001,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.69599999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.72699999999999998},"min":{"1min":0.58699999999999997,"5min":0.45500000000000002,"15min":0.34699999999999998},"max":{"1min":0.998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.502},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.41899999999999998},"max":{"1min":0.98999999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.745,"15min":0.755},"min":{"1min":0.56100000000000005,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":1.0760000000000001,"5min":1.754,"15min":1.754},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77100000000000002,"15min":0.78200000000000003},"min":{"1min":0.63500000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1140000000000001,"5min":1.129,"15min":1.129},"last":0.70899999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.61299999999999999,"15min":0.59399999999999997},"min":{"1min":0.39600000000000002,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.82699999999999996,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.61599999999999999,"15min":0.60799999999999998},"min":{"1min":0.42399999999999999,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.85099999999999998,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.44500000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.64800000000000002,"15min":0.628},"min":{"1min":0.47099999999999997,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.85499999999999998,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.89900000000000002,"5min":1.232,"15min":1.232},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.71299999999999997,"15min":0.71099999999999997},"min":{"1min":0.498,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.95399999999999996,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.69099999999999995,"15min":0.67600000000000005},"min":{"1min":0.45700000000000002,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.88600000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575076,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1613824,"data_stored":810930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69799999999999995,"15min":0.70699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.79100000000000004,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73799999999999999,"15min":0.73499999999999999},"min":{"1min":0.41299999999999998,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94999999999999996,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.67300000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.58899999999999997,"5min":0.45600000000000002,"15min":0.33300000000000002},"max":{"1min":0.92800000000000005,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.55800000000000005,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":1.0149999999999999,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.65800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73599999999999999,"15min":0.749},"min":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.42499999999999999},"max":{"1min":0.997,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.78000000000000003,"15min":0.77100000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98199999999999998,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.77500000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.65500000000000003,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.94899999999999995,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.76100000000000001,"15min":0.76200000000000001},"min":{"1min":0.56499999999999995,"5min":0.48099999999999998,"15min":0.45900000000000002},"max":{"1min":1.012,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.72499999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.68999999999999995,"15min":0.60999999999999999},"min":{"1min":0.435,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":6.101,"15min":6.101},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.71999999999999997,"15min":0.64400000000000002},"min":{"1min":0.46400000000000002,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":1.252,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53500000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.73099999999999998,"15min":0.65200000000000002},"min":{"1min":0.52000000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.84799999999999998,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.49199999999999999,"5min":0.46100000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.55300000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.73899999999999999,"15min":0.69199999999999995},"min":{"1min":0.55000000000000004,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.96599999999999997,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.627},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.80400000000000005,"15min":0.71999999999999997},"min":{"1min":0.54500000000000004,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.014,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.57099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575075,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50652,"kb_used_data":1556,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321188,"statfs":{"total":96636764160,"available":96584896512,"internally_reserved":0,"allocated":1593344,"data_stored":808762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.52900000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.89500000000000002,"5min":0.91500000000000004,"15min":0.98799999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.71199999999999997},"min":{"1min":0.54600000000000004,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.98099999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.72799999999999998,"15min":0.73899999999999999},"min":{"1min":0.58399999999999996,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.94299999999999995,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.69199999999999995,"15min":0.71099999999999997},"min":{"1min":0.55500000000000005,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":1.02},"last":0.88200000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73199999999999998,"15min":0.73499999999999999},"min":{"1min":0.58899999999999997,"5min":0.53100000000000003,"15min":0.51100000000000001},"max":{"1min":0.91800000000000004,"5min":0.99299999999999999,"15min":0.999},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.70799999999999996,"15min":0.71999999999999997},"min":{"1min":0.53000000000000003,"5min":0.48799999999999999,"15min":0.38800000000000001},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":1.002}]},{"osd":3,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72499999999999998,"15min":0.73999999999999999},"min":{"1min":0.51900000000000002,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.74299999999999999,"15min":0.748},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92300000000000004,"5min":1.0169999999999999,"15min":1.0580000000000001},"last":1.0229999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.56299999999999994},"min":{"1min":0.42599999999999999,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.78700000000000003,"5min":0.91900000000000004,"15min":0.96899999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.86899999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.79200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.435,"15min":0.33200000000000002},"max":{"1min":0.96299999999999997,"5min":1.083,"15min":1.083},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66200000000000003,"15min":0.63900000000000001},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.90000000000000002,"5min":1.0249999999999999,"15min":1.038},"last":0.81899999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:40:52 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.69899999999999995,"15min":0.67500000000000004},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.89800000000000002,"5min":1.107,"15min":1.107},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.71699999999999997,"15min":0.68899999999999995},"min":{"1min":0.52700000000000002,"5min":0.51300000000000001,"15min":0.39200000000000002},"max":{"1min":0.91400000000000003,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.92100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575077,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32612,"kb_used_data":1564,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339228,"statfs":{"total":96636764160,"available":96603369472,"internally_reserved":0,"allocated":1601536,"data_stored":808854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70199999999999996,"15min":0.72399999999999998},"min":{"1min":0.63700000000000001,"5min":0.44400000000000001,"15min":0.35299999999999998},"max":{"1min":0.92900000000000005,"5min":0.95299999999999996,"15min":0.97699999999999998},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.70299999999999996},"min":{"1min":0.48699999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94699999999999995},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69899999999999995,"15min":0.72799999999999998},"min":{"1min":0.51200000000000001,"5min":0.42999999999999999,"15min":0.40699999999999997},"max":{"1min":0.90500000000000003,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.89800000000000002,"5min":1.083,"15min":1.083},"last":0.80200000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.72499999999999998,"15min":0.73899999999999999},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91200000000000003,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.752},"min":{"1min":0.47299999999999998,"5min":0.46500000000000002,"15min":0.40799999999999997},"max":{"1min":0.879,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.749}]},{"osd":3,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71299999999999997,"15min":0.73099999999999998},"min":{"1min":0.53400000000000003,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.86599999999999999,"5min":1.002,"15min":1.26},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.74399999999999999,"15min":0.76000000000000001},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":1.05,"15min":1.05},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.60399999999999998,"15min":0.59399999999999997},"min":{"1min":0.42899999999999999,"5min":0.39500000000000002,"15min":0.35299999999999998},"max":{"1min":0.93999999999999995,"5min":1.024,"15min":1.024},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60299999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.83599999999999997,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.44900000000000001,"5min":0.41399999999999998,"15min":0.377},"max":{"1min":0.75700000000000001,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.49299999999999999,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0569999999999999,"15min":1.0629999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.376,"15min":0.376},"max":{"1min":0.878,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72199999999999998,"15min":0.69899999999999995},"min":{"1min":0.499,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.95899999999999996,"5min":1.097,"15min":1.097},"last":0.73499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575076,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1597440,"data_stored":809344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.33500000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.75800000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52300000000000002,"15min":0.53600000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.38600000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.45400000000000001,"15min":0.46899999999999997},"min":{"1min":0.33500000000000002,"5min":0.29699999999999999,"15min":0.29399999999999998},"max":{"1min":0.70899999999999996,"5min":0.85099999999999998,"15min":0.97799999999999998},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.35899999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.42699999999999999,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.61799999999999999,"15min":0.63300000000000001},"min":{"1min":0.48899999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85999999999999999,"5min":1.024,"15min":1.024},"last":0.46100000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75800000000000001,"15min":0.78100000000000003},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":0.92200000000000004,"5min":1.0449999999999999,"15min":1.3320000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78200000000000003,"15min":0.81299999999999994},"min":{"1min":0.63600000000000001,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.97399999999999998,"5min":1.1870000000000001,"15min":1.2689999999999999},"last":0.746}]},{"osd":5,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79500000000000004,"15min":0.81899999999999995},"min":{"1min":0.64600000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.0649999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78700000000000003,"15min":0.80100000000000005},"min":{"1min":0.60699999999999998,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":0.93000000000000005,"5min":1.0409999999999999,"15min":1.208},"last":0.61299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.58699999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":0.997,"5min":1.51,"15min":1.51},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.74299999999999999,"15min":0.76500000000000001},"min":{"1min":0.56299999999999994,"5min":0.47299999999999998,"15min":0.46800000000000003},"max":{"1min":1.0129999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:40:49 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.76200000000000001,"15min":0.79000000000000004},"min":{"1min":0.625,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.083,"5min":1.083,"15min":1.159},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76200000000000001,"15min":0.78700000000000003},"min":{"1min":0.58199999999999996,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.1910000000000001},"last":0.69599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575077,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54752,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94317088,"statfs":{"total":96636764160,"available":96580698112,"internally_reserved":0,"allocated":1597440,"data_stored":808796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46600000000000003,"15min":0.46300000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.68700000000000006,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.505,"5min":0.503,"15min":0.52200000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.51700000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.34000000000000002,"5min":0.32000000000000001,"15min":0.28199999999999997},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54400000000000004,"15min":0.54700000000000004},"min":{"1min":0.436,"5min":0.35199999999999998,"15min":0.32700000000000001},"max":{"1min":0.75700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.42399999999999999,"5min":0.372,"15min":0.372},"max":{"1min":1.0229999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.55700000000000005,"15min":0.55500000000000005},"min":{"1min":0.38200000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.7050000000000001},"last":0.499}]},{"osd":4,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.51500000000000001,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":1.145,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.62,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.2989999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.59999999999999998,"5min":0.50700000000000001,"15min":0.44500000000000001},"max":{"1min":1.371,"5min":1.377,"15min":1.377},"last":0.62},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.79400000000000004,"15min":0.81000000000000005},"min":{"1min":0.54200000000000004,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":1.262,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.81299999999999994,"15min":0.83399999999999996},"min":{"1min":0.51700000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78000000000000003,"15min":0.79900000000000004},"min":{"1min":0.57699999999999996,"5min":0.47799999999999998,"15min":0.42599999999999999},"max":{"1min":1.3400000000000001,"5min":1.423,"15min":1.423},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:41:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.80100000000000005,"15min":0.82599999999999996},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.163,"5min":1.48,"15min":1.48},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.82399999999999995,"15min":0.84299999999999997},"min":{"1min":0.64400000000000002,"5min":0.53800000000000003,"15min":0.46100000000000002},"max":{"1min":1.3999999999999999,"5min":1.496,"15min":1.496},"last":0.63100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1560,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1597440,"data_stored":808796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.42899999999999999,"15min":0.45200000000000001},"min":{"1min":0.31,"5min":0.251,"15min":0.251},"max":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.871},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.50700000000000001},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.64800000000000002,"5min":0.76100000000000001,"15min":0.78800000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48599999999999999,"15min":0.49399999999999999},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.70199999999999996,"5min":0.76100000000000001,"15min":1.5129999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.52100000000000002,"15min":0.55000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.66500000000000004,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.44800000000000001,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.66800000000000004,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.53100000000000003,"15min":0.55000000000000004},"min":{"1min":0.42799999999999999,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.64700000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.40600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77500000000000002,"15min":0.80500000000000005},"min":{"1min":0.56100000000000005,"5min":0.53500000000000003,"15min":0.504},"max":{"1min":0.96799999999999997,"5min":1.129,"15min":1.3069999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80900000000000005},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.0049999999999999,"5min":1.079,"15min":1.274},"last":0.73299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.75900000000000001,"15min":0.77500000000000002},"min":{"1min":0.58299999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97199999999999998,"5min":1.0920000000000001,"15min":1.351},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.76900000000000002,"15min":0.79700000000000004},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.1160000000000001,"15min":1.242},"last":0.61499999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.74399999999999999,"15min":0.77100000000000002},"min":{"1min":0.59899999999999998,"5min":0.49399999999999999,"15min":0.49299999999999999},"max":{"1min":1.0109999999999999,"5min":1.0600000000000001,"15min":1.206},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.53400000000000003,"5min":0.51400000000000001,"15min":0.46600000000000003},"max":{"1min":1.024,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.64500000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:40:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76400000000000001,"15min":0.80000000000000004},"min":{"1min":0.59899999999999998,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.91800000000000004,"5min":1.107,"15min":1.173},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.77900000000000003,"15min":0.81399999999999995},"min":{"1min":0.65900000000000003,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":0.93600000000000005,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.67400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575077,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37296,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334544,"statfs":{"total":96636764160,"available":96598573056,"internally_reserved":0,"allocated":2203648,"data_stored":1400784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.33500000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.65200000000000002,"5min":0.68799999999999994,"15min":0.753},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56299999999999994,"15min":0.55900000000000005},"min":{"1min":0.433,"5min":0.36299999999999999,"15min":0.311},"max":{"1min":0.77700000000000002,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.44}]},{"osd":2,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.38,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.66300000000000003,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.375},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.32100000000000001,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.71499999999999997,"5min":1.657,"15min":1.657},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52100000000000002,"15min":0.51100000000000001},"min":{"1min":0.39300000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.66500000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.434,"5min":0.40600000000000003,"15min":0.35999999999999999},"max":{"1min":0.78000000000000003,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.82299999999999995,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.61799999999999999,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.1080000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.627},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.59399999999999997,"5min":0.53900000000000003,"15min":0.42299999999999999},"max":{"1min":0.95899999999999996,"5min":1.835,"15min":1.835},"last":0.64500000000000002}]},{"osd":5,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.80200000000000005,"15min":0.81399999999999995},"min":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0349999999999999,"5min":1.726,"15min":1.726},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.80200000000000005,"15min":0.81100000000000005},"min":{"1min":0.58699999999999997,"5min":0.55600000000000005,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.615,"15min":1.615},"last":0.71099999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81100000000000005,"15min":0.81499999999999995},"min":{"1min":0.61499999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.0609999999999999,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.81399999999999995,"15min":0.82599999999999996},"min":{"1min":0.65000000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0409999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:40:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.83099999999999996,"15min":0.82899999999999996},"min":{"1min":0.72199999999999998,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.0329999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.81100000000000005,"15min":0.82799999999999996},"min":{"1min":0.55600000000000005,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.0860000000000001,"5min":1.883,"15min":1.883},"last":0.68600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:41:33.490 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:41:33.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:41:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.668+0000 7f79ead0d640 1 Processor -- start 2023-07-09T21:41:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.668+0000 7f79ead0d640 1 -- start start 2023-07-09T21:41:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79ead0d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 0x7f79e4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79ead0d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e40ceb80 0x7f79e40cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79ead0d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e415bf80 con 0x7f79e40b3c20 2023-07-09T21:41:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79ead0d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40cd070 con 0x7f79e40ceb80 2023-07-09T21:41:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79ead0d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e40cfd70 con 0x7f79e40b7980 2023-07-09T21:41:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e40ceb80 0x7f79e40cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79e40ceb80 0x7f79e40cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38788/0 (socket says 172.21.15.37:38788) 2023-07-09T21:41:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 -- 172.21.15.37:0/3787581132 learned_addr learned my addr 172.21.15.37:0/3787581132 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e8aa9640 1 --2- 172.21.15.37:0/3787581132 >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 0x7f79e4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 -- 172.21.15.37:0/3787581132 >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 msgr2=0x7f79e4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 --2- 172.21.15.37:0/3787581132 >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 0x7f79e4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 -- 172.21.15.37:0/3787581132 >> v1:172.21.15.119:6789/0 conn(0x7f79e40b3c20 legacy=0x7f79e40b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e3fff640 1 -- 172.21.15.37:0/3787581132 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e4160570 con 0x7f79e40ceb80 2023-07-09T21:41:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.672+0000 7f79e8aa9640 1 --2- 172.21.15.37:0/3787581132 >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 0x7f79e4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:41:33.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79e3fff640 1 --2- 172.21.15.37:0/3787581132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40ceb80 0x7f79e40cefc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f79e4069aa0 tx=0x7f79d001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd0ddeb13f2180d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79e37fe640 1 -- 172.21.15.37:0/3787581132 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00ab600 con 0x7f79e40ceb80 2023-07-09T21:41:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79e37fe640 1 -- 172.21.15.37:0/3787581132 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00a7050 con 0x7f79e40ceb80 2023-07-09T21:41:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79e37fe640 1 -- 172.21.15.37:0/3787581132 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d00ab980 con 0x7f79e40ceb80 2023-07-09T21:41:33.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- 172.21.15.37:0/3787581132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40ceb80 msgr2=0x7f79e40cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 --2- 172.21.15.37:0/3787581132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40ceb80 0x7f79e40cefc0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f79e4069aa0 tx=0x7f79d001c4c0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- 172.21.15.37:0/3787581132 shutdown_connections 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 --2- 172.21.15.37:0/3787581132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40ceb80 0x7f79e40cefc0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 --2- 172.21.15.37:0/3787581132 >> v2:172.21.15.119:3300/0 conn(0x7f79e40b7980 0x7f79e4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- 172.21.15.37:0/3787581132 >> 172.21.15.37:0/3787581132 conn(0x7f79e4073090 msgr2=0x7f79e4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- 172.21.15.37:0/3787581132 shutdown_connections 2023-07-09T21:41:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- 172.21.15.37:0/3787581132 wait complete. 2023-07-09T21:41:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 Processor -- start 2023-07-09T21:41:33.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.676+0000 7f79ead0d640 1 -- start start 2023-07-09T21:41:33.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e40b7980 0x7f79e41587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e40ceb80 0x7f79e4159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e415b0f0 con 0x7f79e40b3c20 2023-07-09T21:41:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4152f80 con 0x7f79e40ceb80 2023-07-09T21:41:33.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e4152970 con 0x7f79e40b7980 2023-07-09T21:41:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38802/0 (socket says 172.21.15.37:38802) 2023-07-09T21:41:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 -- 172.21.15.37:0/586327748 learned_addr learned my addr 172.21.15.37:0/586327748 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e3fff640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e40b7980 0x7f79e41587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e92aa640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e40ceb80 0x7f79e4159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 -- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e40b7980 msgr2=0x7f79e41587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e40b7980 0x7f79e41587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 -- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e40ceb80 msgr2=0x7f79e4159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e40ceb80 0x7f79e4159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 -- 172.21.15.37:0/586327748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d00094d0 con 0x7f79e40b3c20 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e8aa9640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c7c0 tx=0x7f79d800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8007a30 con 0x7f79e40b3c20 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8007b90 con 0x7f79e40b3c20 2023-07-09T21:41:33.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800ce70 con 0x7f79e40b3c20 2023-07-09T21:41:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e4153630 con 0x7f79e40b3c20 2023-07-09T21:41:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e4152c10 con 0x7f79e40b3c20 2023-07-09T21:41:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e404d7d0 con 0x7f79e40b3c20 2023-07-09T21:41:33.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.680+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f79d80113f0 con 0x7f79e40b3c20 2023-07-09T21:41:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.684+0000 7f79e17fa640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 0x7f79c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.684+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f79d8084420 con 0x7f79e40b3c20 2023-07-09T21:41:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.684+0000 7f79e3fff640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 0x7f79c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:33.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.684+0000 7f79e3fff640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 0x7f79c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79d00ad000 tx=0x7f79d0008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:33.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.688+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f79d8051690 con 0x7f79e40b3c20 2023-07-09T21:41:33.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.896+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f79e40b1600 con 0x7f79e40b3c20 2023-07-09T21:41:33.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.900+0000 7f79e17fa640 1 -- 172.21.15.37:0/586327748 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+147 (secure 0 0 0) 0x7f79d8054cb0 con 0x7f79e40b3c20 2023-07-09T21:41:33.902 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:41:33.902 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:41:33.903 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:41:33.903 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:41:33.903 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:41:33.903 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:41:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 msgr2=0x7f79c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 0x7f79c8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79d00ad000 tx=0x7f79d0008040 comp rx=0 tx=0).stop 2023-07-09T21:41:33.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 msgr2=0x7f79e415b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f79d800c7c0 tx=0x7f79d800cc80 comp rx=0 tx=0).stop 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 shutdown_connections 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f79c80663a0 0x7f79c8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79e40ceb80 0x7f79e4159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79e40b7980 0x7f79e41587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 --2- 172.21.15.37:0/586327748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79e40b3c20 0x7f79e415b7d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:33.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 >> 172.21.15.37:0/586327748 conn(0x7f79e4073090 msgr2=0x7f79e415fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 shutdown_connections 2023-07-09T21:41:33.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:33.904+0000 7f79ead0d640 1 -- 172.21.15.37:0/586327748 wait complete. 2023-07-09T21:41:33.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:41:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 Processor -- start 2023-07-09T21:41:34.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 -- start start 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff780b7ab0 0x7eff7806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780cef80 0x7eff780b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff780b49f0 con 0x7eff780b4170 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff780b7e80 con 0x7eff780b7ab0 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7f540640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff780b4610 con 0x7eff780cef80 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff780b7ab0 0x7eff7806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff780b7ab0 0x7eff7806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38808/0 (socket says 172.21.15.37:38808) 2023-07-09T21:41:34.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 -- 172.21.15.37:0/1103039309 learned_addr learned my addr 172.21.15.37:0/1103039309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7cadb640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780cef80 0x7eff780b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 -- 172.21.15.37:0/1103039309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780cef80 msgr2=0x7eff780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780cef80 0x7eff780b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 -- 172.21.15.37:0/1103039309 >> v1:172.21.15.119:6789/0 conn(0x7eff780b4170 legacy=0x7eff7815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.068+0000 7eff7d2dc640 1 -- 172.21.15.37:0/1103039309 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780cc8a0 con 0x7eff780b7ab0 2023-07-09T21:41:34.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7d2dc640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b7ab0 0x7eff7806aa50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7eff74009870 tx=0x7eff7401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7d59e4353eba23 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff6ffff640 1 -- 172.21.15.37:0/1103039309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740aa5f0 con 0x7eff780b7ab0 2023-07-09T21:41:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff6ffff640 1 -- 172.21.15.37:0/1103039309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740aa750 con 0x7eff780b7ab0 2023-07-09T21:41:34.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff6ffff640 1 -- 172.21.15.37:0/1103039309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740aaae0 con 0x7eff780b7ab0 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 -- 172.21.15.37:0/1103039309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b7ab0 msgr2=0x7eff7806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b7ab0 0x7eff7806aa50 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7eff74009870 tx=0x7eff7401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 -- 172.21.15.37:0/1103039309 shutdown_connections 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780cef80 0x7eff780b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 --2- 172.21.15.37:0/1103039309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b7ab0 0x7eff7806aa50 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 -- 172.21.15.37:0/1103039309 >> 172.21.15.37:0/1103039309 conn(0x7eff78073090 msgr2=0x7eff78069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 -- 172.21.15.37:0/1103039309 shutdown_connections 2023-07-09T21:41:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.072+0000 7eff7f540640 1 -- 172.21.15.37:0/1103039309 wait complete. 2023-07-09T21:41:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 Processor -- start 2023-07-09T21:41:34.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- start start 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780b7ab0 0x7eff780d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff780cef80 0x7eff7813fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff781579e0 con 0x7eff780b4170 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff781583b0 con 0x7eff780cef80 2023-07-09T21:41:34.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff78140820 con 0x7eff780b7ab0 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38822/0 (socket says 172.21.15.37:38822) 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 -- 172.21.15.37:0/2893570181 learned_addr learned my addr 172.21.15.37:0/2893570181 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7dadd640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff780cef80 0x7eff7813fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7cadb640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780b7ab0 0x7eff780d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 -- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780b7ab0 msgr2=0x7eff780d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780b7ab0 0x7eff780d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 -- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff780cef80 msgr2=0x7eff7813fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff780cef80 0x7eff7813fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 -- 172.21.15.37:0/2893570181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff740094d0 con 0x7eff780b4170 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7d2dc640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7eff7401cd70 tx=0x7eff7401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740aa5f0 con 0x7eff780b4170 2023-07-09T21:41:34.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff740b3800 con 0x7eff780b4170 2023-07-09T21:41:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff78140b00 con 0x7eff780b4170 2023-07-09T21:41:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff740b3bb0 con 0x7eff780b4170 2023-07-09T21:41:34.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.076+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff78153540 con 0x7eff780b4170 2023-07-09T21:41:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7804d7d0 con 0x7eff780b4170 2023-07-09T21:41:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff740b3d10 con 0x7eff780b4170 2023-07-09T21:41:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff6dffb640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7eff740a7070 con 0x7eff780b4170 2023-07-09T21:41:34.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff7cadb640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.080+0000 7eff7cadb640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 0x7eff5c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff7815f300 tx=0x7eff68008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.084+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff740ebb90 con 0x7eff780b4170 2023-07-09T21:41:34.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.280+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff7806a830 con 0x7eff780b4170 2023-07-09T21:41:34.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.280+0000 7eff6dffb640 1 -- 172.21.15.37:0/2893570181 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7eff740ef1b0 con 0x7eff780b4170 2023-07-09T21:41:34.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:34.283 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:41:34.283 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:41:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 msgr2=0x7eff5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 0x7eff5c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7eff7815f300 tx=0x7eff68008040 comp rx=0 tx=0).stop 2023-07-09T21:41:34.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 msgr2=0x7eff78157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7eff7401cd70 tx=0x7eff7401ad10 comp rx=0 tx=0).stop 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 shutdown_connections 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7eff5c0663a0 0x7eff5c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff780cef80 0x7eff7813fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff780b7ab0 0x7eff780d23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 --2- 172.21.15.37:0/2893570181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff780b4170 0x7eff78157e70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 >> 172.21.15.37:0/2893570181 conn(0x7eff78073090 msgr2=0x7eff780b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 shutdown_connections 2023-07-09T21:41:34.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.284+0000 7eff7f540640 1 -- 172.21.15.37:0/2893570181 wait complete. 2023-07-09T21:41:34.707 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:41:23.780059+0000', 'modified': '2023-07-09T21:41:27.419291+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8448}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8448': {'gid': 8448, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/738892334', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 738892334}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 738892334}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:41:34.708 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:41:34.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T21:41:34.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 Processor -- start 2023-07-09T21:41:34.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 -- start start 2023-07-09T21:41:34.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3240b47a0 0x7fa3240b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240cef80 con 0x7fa3240b7a60 2023-07-09T21:41:34.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240cf260 con 0x7fa3240b4140 2023-07-09T21:41:34.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa32abfa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3240ccee0 con 0x7fa3240b47a0 2023-07-09T21:41:34.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa328996640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3240b7a60 0x7fa3240cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37948/0 (socket says 172.21.15.37:37948) 2023-07-09T21:41:34.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa328996640 1 -- 172.21.15.37:0/3017890155 learned_addr learned my addr 172.21.15.37:0/3017890155 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:41:34.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa323fff640 1 --2- 172.21.15.37:0/3017890155 >> v2:172.21.15.37:3300/0 conn(0x7fa3240b47a0 0x7fa3240b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa3237fe640 1 -- 172.21.15.37:0/3017890155 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1011880921 0 0) 0x7fa3240cef80 con 0x7fa3240b7a60 2023-07-09T21:41:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.852+0000 7fa3237fe640 1 -- 172.21.15.37:0/3017890155 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa314003530 con 0x7fa3240b7a60 2023-07-09T21:41:34.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa323fff640 1 -- 172.21.15.37:0/3017890155 >> v1:172.21.15.119:6789/0 conn(0x7fa3240b4140 legacy=0x7fa3240d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa323fff640 1 -- 172.21.15.37:0/3017890155 >> v1:172.21.15.37:6789/0 conn(0x7fa3240b7a60 legacy=0x7fa3240cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa323fff640 1 -- 172.21.15.37:0/3017890155 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240cf540 con 0x7fa3240b47a0 2023-07-09T21:41:34.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa323fff640 1 --2- 172.21.15.37:0/3017890155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b47a0 0x7fa3240b3c00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097c0 tx=0x7fa31001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234fa766f7b0c04b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa3237fe640 1 -- 172.21.15.37:0/3017890155 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100ab600 con 0x7fa3240b47a0 2023-07-09T21:41:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa3237fe640 1 -- 172.21.15.37:0/3017890155 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3100a7050 con 0x7fa3240b47a0 2023-07-09T21:41:34.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa3237fe640 1 -- 172.21.15.37:0/3017890155 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100ab960 con 0x7fa3240b47a0 2023-07-09T21:41:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 -- 172.21.15.37:0/3017890155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b47a0 msgr2=0x7fa3240b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 --2- 172.21.15.37:0/3017890155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b47a0 0x7fa3240b3c00 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fa3100097c0 tx=0x7fa31001c480 comp rx=0 tx=0).stop 2023-07-09T21:41:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 -- 172.21.15.37:0/3017890155 shutdown_connections 2023-07-09T21:41:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 --2- 172.21.15.37:0/3017890155 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b47a0 0x7fa3240b3c00 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 -- 172.21.15.37:0/3017890155 >> 172.21.15.37:0/3017890155 conn(0x7fa324073050 msgr2=0x7fa324069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 -- 172.21.15.37:0/3017890155 shutdown_connections 2023-07-09T21:41:34.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.856+0000 7fa32abfa640 1 -- 172.21.15.37:0/3017890155 wait complete. 2023-07-09T21:41:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 Processor -- start 2023-07-09T21:41:34.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 -- start start 2023-07-09T21:41:34.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3240b47a0 0x7fa3240c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 0x7fa3240c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241f3d30 con 0x7fa3240b4140 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241f3f30 con 0x7fa3240b7a60 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241f4210 con 0x7fa3240b47a0 2023-07-09T21:41:34.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38826/0 (socket says 172.21.15.37:38826) 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 -- 172.21.15.37:0/1398393686 learned_addr learned my addr 172.21.15.37:0/1398393686 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa329197640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 0x7fa3240c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa323fff640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3240b47a0 0x7fa3240c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 -- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3240b47a0 msgr2=0x7fa3240c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3240b47a0 0x7fa3240c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 -- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 msgr2=0x7fa3240c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 0x7fa3240c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 -- 172.21.15.37:0/1398393686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa310009420 con 0x7fa3240b4140 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa329197640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 0x7fa3240c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa328996640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c4d0 tx=0x7fa31800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa3217fa640 1 -- 172.21.15.37:0/1398393686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318005cf0 con 0x7fa3240b4140 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa3217fa640 1 -- 172.21.15.37:0/1398393686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318005e50 con 0x7fa3240b4140 2023-07-09T21:41:34.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa3217fa640 1 -- 172.21.15.37:0/1398393686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318007270 con 0x7fa3240b4140 2023-07-09T21:41:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.860+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3241f44f0 con 0x7fa3240b4140 2023-07-09T21:41:34.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.864+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32415dfe0 con 0x7fa3240b4140 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.864+0000 7fa3217fa640 1 -- 172.21.15.37:0/1398393686 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa3180073d0 con 0x7fa3240b4140 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.864+0000 7fa3217fa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 0x7fa308068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.864+0000 7fa3217fa640 1 -- 172.21.15.37:0/1398393686 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3180833a0 con 0x7fa3240b4140 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.864+0000 7fa323fff640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 0x7fa308068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 Processor -- start 2023-07-09T21:41:34.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- start start 2023-07-09T21:41:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa323fff640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 0x7fa308068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ad000 tx=0x7fa3100a6000 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbb5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbb5f90 0x55f23cbb6360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23ca7cf80 con 0x55f23cbff800 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23c9b6c60 con 0x55f23cbb5f90 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f23ca0a700 con 0x55f23cc00110 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38830/0 (socket says 172.21.15.37:38830) 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 -- 172.21.15.37:0/4157731195 learned_addr learned my addr 172.21.15.37:0/4157731195 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa323fff640 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbb5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa329197640 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbb5f90 0x55f23cbb6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 -- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 msgr2=0x55f23cbb5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbb5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 -- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbb5f90 msgr2=0x55f23cbb6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbb5f90 0x55f23cbb6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 -- 172.21.15.37:0/4157731195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f23c6ff890 con 0x55f23cbff800 2023-07-09T21:41:34.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa328996640 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa318001390 tx=0x7fa31805c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce796a04505c5715 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa30e7fc640 1 -- 172.21.15.37:0/4157731195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180528d0 con 0x55f23cbff800 2023-07-09T21:41:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa30e7fc640 1 -- 172.21.15.37:0/4157731195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa318058160 con 0x55f23cbff800 2023-07-09T21:41:34.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa30e7fc640 1 -- 172.21.15.37:0/4157731195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3180816c0 con 0x55f23cbff800 2023-07-09T21:41:34.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- 172.21.15.37:0/4157731195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 msgr2=0x55f23cbffbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa318001390 tx=0x7fa31805c850 comp rx=0 tx=0).stop 2023-07-09T21:41:34.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- 172.21.15.37:0/4157731195 shutdown_connections 2023-07-09T21:41:34.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbb5f90 0x55f23cbb6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbb5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 --2- 172.21.15.37:0/4157731195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cbffbd0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- 172.21.15.37:0/4157731195 >> 172.21.15.37:0/4157731195 conn(0x55f23ca78a70 msgr2=0x55f23cbb4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- 172.21.15.37:0/4157731195 shutdown_connections 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- 172.21.15.37:0/4157731195 wait complete. 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.868+0000 7fa32df6a000 1 -- start start 2023-07-09T21:41:34.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 Processor -- start 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff800 0x55f23cbc1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cbc1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23ca037a0 con 0x55f23cbb5f90 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23c9bff00 con 0x55f23cc00110 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f23c9bfba0 con 0x55f23cbff800 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 10 client.0 _ll_register_callbacks cb 0x55f23cba1930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:41:34.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38842/0 (socket says 172.21.15.37:38842) 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 -- 172.21.15.37:0/2477064294 learned_addr learned my addr 172.21.15.37:0/2477064294 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa323fff640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff800 0x55f23cbc1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa329197640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cbc1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 -- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff800 msgr2=0x55f23cbc1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff800 0x55f23cbc1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 -- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 msgr2=0x55f23cbc1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cbc1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 -- 172.21.15.37:0/2477064294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32415dfe0 con 0x55f23cbb5f90 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa328996640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa31800ce90 tx=0x7fa318001320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8dc137d0d9963f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31807f070 con 0x55f23cbb5f90 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f23ca020f0 con 0x55f23cbb5f90 2023-07-09T21:41:34.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3180528d0 con 0x55f23cbb5f90 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3180812b0 con 0x55f23cbb5f90 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 10 client.8619 fetch_fsmap learned FSMap version 55 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f23c9c8130 con 0x55f23cbb5f90 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f23ca020f0 con 0x55f23cbb5f90 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa318050b80 con 0x55f23cbb5f90 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 10 client.8619 fetch_fsmap finished waiting for FSMap version 55 2023-07-09T21:41:34.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 10 client.8619 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 20 client.8619 populate_metadata read hostname 'smithi037' 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc0e870 0x55f23cc10c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 4 client.8619 mds_command: new command op to 8448 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 --> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f23c9cae40 con 0x55f23cc0e870 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa323fff640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc0e870 0x55f23cc10c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa3037fe640 10 client.8619 ms_handle_connect on v2:172.21.15.37:6834/738892334 2023-07-09T21:41:34.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.872+0000 7fa323fff640 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc0e870 0x55f23cc10c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2bdf9c4e1d1cdb server_cookie=d1276defa2aabcc2 in_seq=0 out_seq=0 2023-07-09T21:41:34.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa3037fe640 1 -- 172.21.15.37:0/2477064294 <== mds.0 v2:172.21.15.37:6834/738892334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f23c9cae40 con 0x55f23cc0e870 2023-07-09T21:41:34.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa3037fe640 10 client.8619 handle_command_reply: tid=0 2023-07-09T21:41:34.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 client.8619 shutdown 2023-07-09T21:41:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 msgr2=0x55f23cbc0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fa31800ce90 tx=0x7fa318001320 comp rx=0 tx=0).stop 2023-07-09T21:41:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 shutdown_connections 2023-07-09T21:41:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc0e870 0x55f23cc10c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cbc1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff800 0x55f23cbc1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 --2- 172.21.15.37:0/2477064294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbb5f90 0x55f23cbc0df0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 >> 172.21.15.37:0/2477064294 conn(0x55f23ca78a70 msgr2=0x55f23cbb4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa3037fe640 0 client.8619 ms_handle_reset on v2:172.21.15.37:6834/738892334 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 shutdown_connections 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 1 -- 172.21.15.37:0/2477064294 wait complete. 2023-07-09T21:41:34.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.876+0000 7fa32df6a000 20 client.8619 trim_cache size 0 max 16384 2023-07-09T21:41:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 Processor -- start 2023-07-09T21:41:34.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- start start 2023-07-09T21:41:34.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cc128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff260 0x55f23cbfa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23c6c0940 con 0x55f23cbff800 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23c9d2740 con 0x55f23cc00110 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f23cbb5ab0 con 0x55f23cbff260 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38856/0 (socket says 172.21.15.37:38856) 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 -- 172.21.15.37:0/1452655140 learned_addr learned my addr 172.21.15.37:0/1452655140 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa323fff640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cc128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa329197640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff260 0x55f23cbfa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 -- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff260 msgr2=0x55f23cbfa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff260 0x55f23cbfa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 -- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 msgr2=0x55f23cc128b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cc128b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 -- 172.21.15.37:0/1452655140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f23c9ae3c0 con 0x55f23cbff800 2023-07-09T21:41:34.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa323fff640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cc128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa328996640 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa31805c1e0 tx=0x7fa318014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0b2152c1462fff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa30effd640 1 -- 172.21.15.37:0/1452655140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31807f040 con 0x55f23cbff800 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa30effd640 1 -- 172.21.15.37:0/1452655140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800e040 con 0x55f23cbff800 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa30effd640 1 -- 172.21.15.37:0/1452655140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa318052670 con 0x55f23cbff800 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- 172.21.15.37:0/1452655140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 msgr2=0x55f23cc12370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fa31805c1e0 tx=0x7fa318014070 comp rx=0 tx=0).stop 2023-07-09T21:41:34.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- 172.21.15.37:0/1452655140 shutdown_connections 2023-07-09T21:41:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cbff260 0x55f23cbfa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cc00110 0x55f23cc128b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1452655140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc12370 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- 172.21.15.37:0/1452655140 >> 172.21.15.37:0/1452655140 conn(0x55f23ca78a70 msgr2=0x55f23cc10c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- 172.21.15.37:0/1452655140 shutdown_connections 2023-07-09T21:41:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.892+0000 7fa32df6a000 1 -- 172.21.15.37:0/1452655140 wait complete. 2023-07-09T21:41:34.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- start start 2023-07-09T21:41:34.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 Processor -- start 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbff260 0x55f23cc5d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbfd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23cbb5ab0 con 0x55f23cbff800 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f23ca06300 con 0x55f23cbff260 2023-07-09T21:41:34.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f23ca02630 con 0x55f23cc00110 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 10 client.0 _ll_register_callbacks cb 0x55f23cb824d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38860/0 (socket says 172.21.15.37:38860) 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 -- 172.21.15.37:0/1640444018 learned_addr learned my addr 172.21.15.37:0/1640444018 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa329197640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbfd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa328996640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbff260 0x55f23cc5d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 -- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 msgr2=0x55f23cbfd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbfd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 -- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbff260 msgr2=0x55f23cc5d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbff260 0x55f23cc5d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 -- 172.21.15.37:0/1640444018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f23c9c8130 con 0x55f23cbff800 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa323fff640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa31001a0b0 tx=0x7fa31001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6127a0bf5d9ad3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3100c9070 con 0x55f23cbff800 2023-07-09T21:41:34.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f23c9bc6f0 con 0x55f23cbff800 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa3100ca310 con 0x55f23cbff800 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3100ca4d0 con 0x55f23cbff800 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 10 client.8625 fetch_fsmap learned FSMap version 55 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55f23c6ffcc0 con 0x55f23cbff800 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f23c9bc6f0 con 0x55f23cbff800 2023-07-09T21:41:34.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa3100c2040 con 0x55f23cbff800 2023-07-09T21:41:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 10 client.8625 fetch_fsmap finished waiting for FSMap version 55 2023-07-09T21:41:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 10 client.8625 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:41:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 20 client.8625 populate_metadata read hostname 'smithi037' 2023-07-09T21:41:34.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc64170 0x55f23cc66550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 4 client.8625 mds_command: new command op to 8448 tid=0[{"prefix": "status"}] 2023-07-09T21:41:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 --> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f23c9fc780 con 0x55f23cc64170 2023-07-09T21:41:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.896+0000 7fa328996640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc64170 0x55f23cc66550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:34.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa328996640 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc64170 0x55f23cc66550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a259c36add05de8 server_cookie=b01dad829860b110 in_seq=0 out_seq=0 2023-07-09T21:41:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa3037fe640 10 client.8625 ms_handle_connect on v2:172.21.15.37:6834/738892334 2023-07-09T21:41:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa3037fe640 1 -- 172.21.15.37:0/1640444018 <== mds.0 v2:172.21.15.37:6834/738892334 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55f23c9fc780 con 0x55f23cc64170 2023-07-09T21:41:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa3037fe640 10 client.8625 handle_command_reply: tid=0 2023-07-09T21:41:34.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 client.8625 shutdown 2023-07-09T21:41:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 msgr2=0x55f23cc5d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7fa31001a0b0 tx=0x7fa31001acc0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 shutdown_connections 2023-07-09T21:41:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:6834/738892334,v1:172.21.15.37:6835/738892334] conn(0x55f23cc64170 0x55f23cc66550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55f23cc00110 0x55f23cbfd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f23cbff800 0x55f23cc5d850 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 --2- 172.21.15.37:0/1640444018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55f23cbff260 0x55f23cc5d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa3037fe640 0 client.8625 ms_handle_reset on v2:172.21.15.37:6834/738892334 2023-07-09T21:41:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 >> 172.21.15.37:0/1640444018 conn(0x55f23ca78a70 msgr2=0x55f23cc10c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 shutdown_connections 2023-07-09T21:41:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 1 -- 172.21.15.37:0/1640444018 wait complete. 2023-07-09T21:41:34.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32df6a000 20 client.8625 trim_cache size 0 max 16384 2023-07-09T21:41:34.911 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:41:34.911 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:41:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:41:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8448, 2023-07-09T21:41:34.912 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.49539965, 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 55, 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 129, 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 129, 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.420468367000002 2023-07-09T21:41:34.913 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:41:34.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 msgr2=0x7fa308068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 0x7fa308068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3100ad000 tx=0x7fa3100a6000 comp rx=0 tx=0).stop 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 msgr2=0x7fa32415daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c4d0 tx=0x7fa31800c990 comp rx=0 tx=0).stop 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 shutdown_connections 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fa3080663a0 0x7fa308068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3240b7a60 0x7fa3240c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3240b47a0 0x7fa3240c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 --2- 172.21.15.37:0/1398393686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3240b4140 0x7fa32415daa0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:34.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 >> 172.21.15.37:0/1398393686 conn(0x7fa324073050 msgr2=0x7fa3240b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:34.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 shutdown_connections 2023-07-09T21:41:34.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:34.900+0000 7fa32abfa640 1 -- 172.21.15.37:0/1398393686 wait complete. 2023-07-09T21:41:34.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:41:35.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.060+0000 7f5a79093640 1 Processor -- start 2023-07-09T21:41:35.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.060+0000 7f5a79093640 1 -- start start 2023-07-09T21:41:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a79093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a7406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a79093640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740cef80 0x7f5a740b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a79093640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a740b49f0 con 0x7f5a740b4170 2023-07-09T21:41:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a79093640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a740b7e80 con 0x7f5a740cef80 2023-07-09T21:41:35.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a79093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740b45f0 con 0x7f5a740b7ab0 2023-07-09T21:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740cef80 0x7f5a740b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5a740cef80 0x7f5a740b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38862/0 (socket says 172.21.15.37:38862) 2023-07-09T21:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 -- 172.21.15.37:0/2728449667 learned_addr learned my addr 172.21.15.37:0/2728449667 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a72d9d640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a7406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 -- 172.21.15.37:0/2728449667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 msgr2=0x7f5a7406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a7406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 -- 172.21.15.37:0/2728449667 >> v1:172.21.15.119:6789/0 conn(0x7f5a740b4170 legacy=0x7f5a7415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.064+0000 7f5a7259c640 1 -- 172.21.15.37:0/2728449667 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a740cc8a0 con 0x7f5a740cef80 2023-07-09T21:41:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a7259c640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a740b3c30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009870 tx=0x7f5a6801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fed13214b6d1c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a71d9b640 1 -- 172.21.15.37:0/2728449667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680aa670 con 0x7f5a740cef80 2023-07-09T21:41:35.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a71d9b640 1 -- 172.21.15.37:0/2728449667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680aa7d0 con 0x7f5a740cef80 2023-07-09T21:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a71d9b640 1 -- 172.21.15.37:0/2728449667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680aab60 con 0x7f5a740cef80 2023-07-09T21:41:35.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- 172.21.15.37:0/2728449667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 msgr2=0x7f5a740b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a740b3c30 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009870 tx=0x7f5a6801c510 comp rx=0 tx=0).stop 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- 172.21.15.37:0/2728449667 shutdown_connections 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a740b3c30 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 --2- 172.21.15.37:0/2728449667 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a7406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- 172.21.15.37:0/2728449667 >> 172.21.15.37:0/2728449667 conn(0x7f5a74073090 msgr2=0x7f5a74069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:35.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- 172.21.15.37:0/2728449667 shutdown_connections 2023-07-09T21:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- 172.21.15.37:0/2728449667 wait complete. 2023-07-09T21:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 Processor -- start 2023-07-09T21:41:35.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.068+0000 7f5a79093640 1 -- start start 2023-07-09T21:41:35.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b4170 0x7f5a740c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a74147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740c6330 con 0x7f5a740cef80 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a74149870 con 0x7f5a740b4170 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a74157fb0 con 0x7f5a740b7ab0 2023-07-09T21:41:35.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a72d9d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b4170 0x7f5a740c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38876/0 (socket says 172.21.15.37:38876) 2023-07-09T21:41:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 -- 172.21.15.37:0/3038276142 learned_addr learned my addr 172.21.15.37:0/3038276142 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:35.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7259c640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a74147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 -- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 msgr2=0x7f5a74147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a74147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 -- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b4170 msgr2=0x7f5a740c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b4170 0x7f5a740c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 -- 172.21.15.37:0/3038276142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a680094d0 con 0x7f5a740cef80 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a7359e640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c730 tx=0x7f5a6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c003b80 con 0x7f5a740cef80 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c003ce0 con 0x7f5a740cef80 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c00aa30 con 0x7f5a740cef80 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a74158290 con 0x7f5a740cef80 2023-07-09T21:41:35.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a740c5fc0 con 0x7f5a740cef80 2023-07-09T21:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a740c64a0 con 0x7f5a740cef80 2023-07-09T21:41:35.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.072+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5a6c00ab90 con 0x7f5a740cef80 2023-07-09T21:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.076+0000 7f5a5b7fe640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 0x7f5a60068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.076+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5a6c083ac0 con 0x7f5a740cef80 2023-07-09T21:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.076+0000 7f5a72d9d640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 0x7f5a60068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:35.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.076+0000 7f5a72d9d640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 0x7f5a60068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006aa0 tx=0x7f5a64008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:35.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.080+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5a6c050ef0 con 0x7f5a740cef80 2023-07-09T21:41:35.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.264+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a7404d7d0 con 0x7f5a740cef80 2023-07-09T21:41:35.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a5b7fe640 1 -- 172.21.15.37:0/3038276142 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a6c054510 con 0x7f5a740cef80 2023-07-09T21:41:35.267 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:41:35.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 msgr2=0x7f5a60068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 0x7f5a60068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a64006aa0 tx=0x7f5a64008040 comp rx=0 tx=0).stop 2023-07-09T21:41:35.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 msgr2=0x7f5a7414ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:35.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c00c730 tx=0x7f5a6c00cbf0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 shutdown_connections 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f5a600663a0 0x7f5a60068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5a740cef80 0x7f5a7414ae80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5a740b7ab0 0x7f5a74147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 --2- 172.21.15.37:0/3038276142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5a740b4170 0x7f5a740c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 >> 172.21.15.37:0/3038276142 conn(0x7f5a74073090 msgr2=0x7f5a740b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 shutdown_connections 2023-07-09T21:41:35.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:35.268+0000 7f5a79093640 1 -- 172.21.15.37:0/3038276142 wait complete. 2023-07-09T21:41:35.288 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:41:35.289 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:41:35.289 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:41:35.289 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:41:35.290 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:35.290 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:41:35.290 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:41:35.291 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:41:35.291 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:41:35.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.292 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:41:35.301 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.302 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.303 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41308sec preferred_lft 41308sec 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:41:35.305 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:41:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:41:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:41:35.307 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:41:35.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.308 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:41:35.370 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:41:35.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.373 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:41:35.425 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:41:35.426 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:41:35.426 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:41:35.427 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:41:35.427 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:41:35.427 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:41:35.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.428 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:41:35.429 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:41:35.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:41:35.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:41:35.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:41:35.430 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:41:35.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.521 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:41:35.531 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:41:35.531 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:41:35.532 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:41:35.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:41:35.595 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:41:35.595 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:41:35.596 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:35.651 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:41:35.651 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:41:35.651 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:35.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:41:35.768 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:41:35.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:41:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:41:35.835 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:41:35.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:35.837 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:41:35.886 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:41:35.887 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:41:35.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:41:35.956 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:41:35.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:41:36.024 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:41:36.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:41:36.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:36.026 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:41:36.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:41:36.036+0000 7ff7a7a44580 -1 init, newargv = 0x5636696af4b0 newargc=15 2023-07-09T21:41:36.035 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[59349]: starting ceph client 2023-07-09T21:41:36.042 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[59349]: starting fuse 2023-07-09T21:41:36.043 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:41:36.044 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:41:36.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:41:36.045 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:41:36.045 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:41:36.045 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:41:36.046 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:41:36.046 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:41:36.046 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:41:36.046 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:41:36.047 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:41:36.047 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:41:36.047 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:41:36.048 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:41:36.048 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:41:36.048 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:41:36.049 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:41:36.049 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:41:36.049 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:41:36.050 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:41:36.050 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:41:36.050 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:41:36.051 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:41:36.051 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:41:36.051 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:41:36.051 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:41:36.052 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:41:36.052 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:41:36.052 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:41:36.173 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.59349.asok 2023-07-09T21:41:36.356 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59349.asok 2023-07-09T21:41:36.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:36.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59349.asok status 2023-07-09T21:41:36.536 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:41:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:41:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:41:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:41:36.536 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "59349", 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:41:36.537 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8637, 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 8637 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:41:36.538 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 443342368 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 443342368 2023-07-09T21:41:36.539 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.8637 192.168.0.1:0/443342368", 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/443342368", 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 55, 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 129, 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:41:36.540 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:41:36.541 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:41:36.541 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:41:36.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:36.553 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:41:36.553 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:36.563 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:41:36.563 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:36.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:36.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:41:36.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:41:36.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 Processor -- start 2023-07-09T21:41:36.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 -- start start 2023-07-09T21:41:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f610c156320 0x7f610c159780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c1592f0 con 0x7f610c070120 2023-07-09T21:41:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f610c070b50 con 0x7f610c06bf20 2023-07-09T21:41:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f6112c48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610c1566f0 con 0x7f610c156320 2023-07-09T21:41:36.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f61109e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f610c156320 0x7f610c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f61109e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f610c156320 0x7f610c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38892/0 (socket says 172.21.15.37:38892) 2023-07-09T21:41:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f61109e4640 1 -- 172.21.15.37:0/4003249514 learned_addr learned my addr 172.21.15.37:0/4003249514 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f61109e4640 1 -- 172.21.15.37:0/4003249514 >> v1:172.21.15.119:6789/0 conn(0x7f610c06bf20 legacy=0x7f610c0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:36.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.812+0000 7f61109e4640 1 -- 172.21.15.37:0/4003249514 >> v1:172.21.15.37:6789/0 conn(0x7f610c070120 legacy=0x7f610c06b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f61109e4640 1 -- 172.21.15.37:0/4003249514 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610c070e30 con 0x7f610c156320 2023-07-09T21:41:36.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f610b7fe640 1 -- 172.21.15.37:0/4003249514 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653212582 0 0) 0x7f610c1592f0 con 0x7f610c070120 2023-07-09T21:41:36.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f61109e4640 1 --2- 172.21.15.37:0/4003249514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c156320 0x7f610c159780 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6100006fd0 tx=0x7f610001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60af9b1bcf50b60 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:36.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f610b7fe640 1 -- 172.21.15.37:0/4003249514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000ab600 con 0x7f610c156320 2023-07-09T21:41:36.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f610b7fe640 1 -- 172.21.15.37:0/4003249514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61000a7050 con 0x7f610c156320 2023-07-09T21:41:36.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f610b7fe640 1 -- 172.21.15.37:0/4003249514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61000ab980 con 0x7f610c156320 2023-07-09T21:41:36.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f6112c48640 1 -- 172.21.15.37:0/4003249514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c156320 msgr2=0x7f610c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:36.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.816+0000 7f6112c48640 1 --2- 172.21.15.37:0/4003249514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c156320 0x7f610c159780 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6100006fd0 tx=0x7f610001c4f0 comp rx=0 tx=0).stop 2023-07-09T21:41:36.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- 172.21.15.37:0/4003249514 shutdown_connections 2023-07-09T21:41:36.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 --2- 172.21.15.37:0/4003249514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c156320 0x7f610c159780 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:36.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- 172.21.15.37:0/4003249514 >> 172.21.15.37:0/4003249514 conn(0x7f610c0694c0 msgr2=0x7f610c0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:36.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- 172.21.15.37:0/4003249514 shutdown_connections 2023-07-09T21:41:36.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- 172.21.15.37:0/4003249514 wait complete. 2023-07-09T21:41:36.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 Processor -- start 2023-07-09T21:41:36.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- start start 2023-07-09T21:41:36.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 0x7f610c136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:36.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:36.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f610c156320 0x7f610c0cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:36.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c1502b0 con 0x7f610c070120 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f610c14fca0 con 0x7f610c156320 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f6112c48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610c153730 con 0x7f610c06bf20 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38894/0 (socket says 172.21.15.37:38894) 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 -- 172.21.15.37:0/1114544768 learned_addr learned my addr 172.21.15.37:0/1114544768 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f61109e4640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 0x7f610c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:36.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f61111e5640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f610c156320 0x7f610c0cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 -- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 msgr2=0x7f610c136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 0x7f610c136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 -- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f610c156320 msgr2=0x7f610c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f610c156320 0x7f610c0cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 -- 172.21.15.37:0/1114544768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6100009480 con 0x7f610c070120 2023-07-09T21:41:36.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f61109e4640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 0x7f610c136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:41:36.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.820+0000 7f610bfff640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c480 tx=0x7f60f800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:36.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8005480 con 0x7f610c070120 2023-07-09T21:41:36.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8003600 con 0x7f610c070120 2023-07-09T21:41:36.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80039b0 con 0x7f610c070120 2023-07-09T21:41:36.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610c153a10 con 0x7f610c070120 2023-07-09T21:41:36.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f610c14d610 con 0x7f610c070120 2023-07-09T21:41:36.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f610c150420 con 0x7f610c070120 2023-07-09T21:41:36.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f60f8003b10 con 0x7f610c070120 2023-07-09T21:41:36.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 0x7f60f0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:36.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f60f8083a20 con 0x7f610c070120 2023-07-09T21:41:36.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.824+0000 7f61109e4640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 0x7f60f0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:36.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.828+0000 7f61109e4640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 0x7f60f0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61000ad000 tx=0x7f61000a4f90 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:36.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:36.828+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60f8050e20 con 0x7f610c070120 2023-07-09T21:41:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.004+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f610c0ce140 con 0x7f60f00663a0 2023-07-09T21:41:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.004+0000 7f61097fa640 1 -- 172.21.15.37:0/1114544768 <== mgr.8205 v2:172.21.15.119:6832/3013141456 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f6100004440 con 0x7f60f00663a0 2023-07-09T21:41:37.005 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:41:37.005 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:41:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:41:37.006 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:41:37.006 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:41:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 msgr2=0x7f60f0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 0x7f60f0068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61000ad000 tx=0x7f61000a4f90 comp rx=0 tx=0).stop 2023-07-09T21:41:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 msgr2=0x7f610c150a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c480 tx=0x7f60f800c940 comp rx=0 tx=0).stop 2023-07-09T21:41:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 shutdown_connections 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f60f00663a0 0x7f60f0068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f610c156320 0x7f610c0cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f610c070120 0x7f610c150a30 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 --2- 172.21.15.37:0/1114544768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f610c06bf20 0x7f610c136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 >> 172.21.15.37:0/1114544768 conn(0x7f610c0694c0 msgr2=0x7f610c1580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 shutdown_connections 2023-07-09T21:41:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.008+0000 7f6112c48640 1 -- 172.21.15.37:0/1114544768 wait complete. 2023-07-09T21:41:37.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:41:37.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 Processor -- start 2023-07-09T21:41:37.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 -- start start 2023-07-09T21:41:37.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c940b7980 0x7f8c94160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940ceb80 0x7f8c940cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940b3c20 0x7f8c940b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940cd070 con 0x7f8c940b3c20 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c940cfd70 con 0x7f8c940b7980 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9c711640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415bf80 con 0x7f8c940ceb80 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940b3c20 0x7f8c940b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c940b3c20 0x7f8c940b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38898/0 (socket says 172.21.15.37:38898) 2023-07-09T21:41:37.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 -- 172.21.15.37:0/565854235 learned_addr learned my addr 172.21.15.37:0/565854235 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:37.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9a4ad640 1 --2- 172.21.15.37:0/565854235 >> v2:172.21.15.119:3300/0 conn(0x7f8c940b7980 0x7f8c94160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c99cac640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940ceb80 0x7f8c940cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 -- 172.21.15.37:0/565854235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940ceb80 msgr2=0x7f8c940cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:37.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940ceb80 0x7f8c940cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 -- 172.21.15.37:0/565854235 >> v2:172.21.15.119:3300/0 conn(0x7f8c940b7980 msgr2=0x7f8c94160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:37.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 --2- 172.21.15.37:0/565854235 >> v2:172.21.15.119:3300/0 conn(0x7f8c940b7980 0x7f8c94160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.172+0000 7f8c9acae640 1 -- 172.21.15.37:0/565854235 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c94160570 con 0x7f8c940b3c20 2023-07-09T21:41:37.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9acae640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b3c20 0x7f8c940b4080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8c94069aa0 tx=0x7f8c8c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fc95831b859912 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:37.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c994ab640 1 -- 172.21.15.37:0/565854235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0a5650 con 0x7f8c940b3c20 2023-07-09T21:41:37.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c994ab640 1 -- 172.21.15.37:0/565854235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0a57b0 con 0x7f8c940b3c20 2023-07-09T21:41:37.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c994ab640 1 -- 172.21.15.37:0/565854235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0a5b40 con 0x7f8c940b3c20 2023-07-09T21:41:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/565854235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b3c20 msgr2=0x7f8c940b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b3c20 0x7f8c940b4080 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f8c94069aa0 tx=0x7f8c8c01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/565854235 shutdown_connections 2023-07-09T21:41:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940b3c20 0x7f8c940b4080 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/565854235 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940ceb80 0x7f8c940cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/565854235 >> v2:172.21.15.119:3300/0 conn(0x7f8c940b7980 0x7f8c94160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/565854235 >> 172.21.15.37:0/565854235 conn(0x7f8c94073090 msgr2=0x7f8c94069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/565854235 shutdown_connections 2023-07-09T21:41:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/565854235 wait complete. 2023-07-09T21:41:37.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 Processor -- start 2023-07-09T21:41:37.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- start start 2023-07-09T21:41:37.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b3c20 0x7f8c94150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7980 0x7f8c94159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415b5f0 con 0x7f8c940ceb80 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415d8b0 con 0x7f8c940b3c20 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c9415a970 con 0x7f8c940b7980 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38900/0 (socket says 172.21.15.37:38900) 2023-07-09T21:41:37.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 -- 172.21.15.37:0/2091916519 learned_addr learned my addr 172.21.15.37:0/2091916519 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c99cac640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7980 0x7f8c94159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9a4ad640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b3c20 0x7f8c94150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 -- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7980 msgr2=0x7f8c94159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7980 0x7f8c94159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 -- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b3c20 msgr2=0x7f8c94150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b3c20 0x7f8c94150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:37.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 -- 172.21.15.37:0/2091916519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8c009b30 con 0x7f8c940ceb80 2023-07-09T21:41:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9acae640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0af040 tx=0x7f8c8c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:37.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0a5650 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0b8880 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0b8c30 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9415ac50 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.180+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9415b210 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9415b730 con 0x7f8c940ceb80 2023-07-09T21:41:37.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 49) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8c8c0c3460 con 0x7f8c940ceb80 2023-07-09T21:41:37.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c8affd640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 0x7f8c78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:37.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8c8c11f4e0 con 0x7f8c940ceb80 2023-07-09T21:41:37.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c9a4ad640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 0x7f8c78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:37.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.184+0000 7f8c9a4ad640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 0x7f8c78068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b930 tx=0x7f8c90008040 comp rx=0 tx=0).ready entity=mgr.8205 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:37.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.188+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c9415b730 con 0x7f8c940ceb80 2023-07-09T21:41:37.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:37.380+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8c94160570 con 0x7f8c940ceb80 2023-07-09T21:41:38.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.172+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8c8c0eccb0 con 0x7f8c940ceb80 2023-07-09T21:41:38.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c8affd640 1 -- 172.21.15.37:0/2091916519 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v50) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8c8c0bae40 con 0x7f8c940ceb80 2023-07-09T21:41:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 msgr2=0x7f8c78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 0x7f8c78068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8c9000b930 tx=0x7f8c90008040 comp rx=0 tx=0).stop 2023-07-09T21:41:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 msgr2=0x7f8c94154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0af040 tx=0x7f8c8c019770 comp rx=0 tx=0).stop 2023-07-09T21:41:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 shutdown_connections 2023-07-09T21:41:38.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f8c780663a0 0x7f8c78068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c940ceb80 0x7f8c94154250 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c940b7980 0x7f8c94159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 --2- 172.21.15.37:0/2091916519 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c940b3c20 0x7f8c94150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 >> 172.21.15.37:0/2091916519 conn(0x7f8c94073090 msgr2=0x7f8c941551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 shutdown_connections 2023-07-09T21:41:38.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.176+0000 7f8c9c711640 1 -- 172.21.15.37:0/2091916519 wait complete. 2023-07-09T21:41:38.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:41:38.352 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:38.358+0000 7fc0e4c55180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:41:38.356 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:38.356+0000 7fb35cbd7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:41:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 Processor -- start 2023-07-09T21:41:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 -- start start 2023-07-09T21:41:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29e00cf290 0x7f29e0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29e00d0780 0x7f29e00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29e015bf80 con 0x7f29e00b7980 2023-07-09T21:41:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00cd070 con 0x7f29e00d0780 2023-07-09T21:41:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29e5cbd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29e00cfd70 con 0x7f29e00cf290 2023-07-09T21:41:38.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.356+0000 7f29dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29e00d0780 0x7f29e00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29e00d0780 0x7f29e00d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47788/0 (socket says 172.21.15.37:47788) 2023-07-09T21:41:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 -- 172.21.15.37:0/866526464 learned_addr learned my addr 172.21.15.37:0/866526464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29deffd640 1 --2- 172.21.15.37:0/866526464 >> v2:172.21.15.119:3300/0 conn(0x7f29e00cf290 0x7f29e0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 -- 172.21.15.37:0/866526464 >> v2:172.21.15.119:3300/0 conn(0x7f29e00cf290 msgr2=0x7f29e0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:38.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 --2- 172.21.15.37:0/866526464 >> v2:172.21.15.119:3300/0 conn(0x7f29e00cf290 0x7f29e0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 -- 172.21.15.37:0/866526464 >> v1:172.21.15.119:6789/0 conn(0x7f29e00b7980 legacy=0x7f29e00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29de7fc640 1 -- 172.21.15.37:0/866526464 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231473356 0 0) 0x7f29d0001120 con 0x7f29e00b7980 2023-07-09T21:41:38.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.360+0000 7f29dffff640 1 -- 172.21.15.37:0/866526464 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29e0160570 con 0x7f29e00d0780 2023-07-09T21:41:38.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29dffff640 1 --2- 172.21.15.37:0/866526464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00d0780 0x7f29e00d0b80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f29e00b4cd0 tx=0x7f29d801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4403f283b00455 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:38.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29de7fc640 1 -- 172.21.15.37:0/866526464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80a5690 con 0x7f29e00d0780 2023-07-09T21:41:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29de7fc640 1 -- 172.21.15.37:0/866526464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d80a57f0 con 0x7f29e00d0780 2023-07-09T21:41:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29de7fc640 1 -- 172.21.15.37:0/866526464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d80a5b80 con 0x7f29e00d0780 2023-07-09T21:41:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 -- 172.21.15.37:0/866526464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00d0780 msgr2=0x7f29e00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/866526464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00d0780 0x7f29e00d0b80 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f29e00b4cd0 tx=0x7f29d801c9d0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 -- 172.21.15.37:0/866526464 shutdown_connections 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/866526464 >> v2:172.21.15.119:3300/0 conn(0x7f29e00cf290 0x7f29e0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/866526464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00d0780 0x7f29e00d0b80 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 -- 172.21.15.37:0/866526464 >> 172.21.15.37:0/866526464 conn(0x7f29e0073090 msgr2=0x7f29e0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 -- 172.21.15.37:0/866526464 shutdown_connections 2023-07-09T21:41:38.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 -- 172.21.15.37:0/866526464 wait complete. 2023-07-09T21:41:38.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.364+0000 7f29e5cbd640 1 Processor -- start 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- start start 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e00b7980 0x7f29e0154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e00d0780 0x7f29e00b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0154250 con 0x7f29e00cf290 2023-07-09T21:41:38.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0153800 con 0x7f29e00d0780 2023-07-09T21:41:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29e0153dc0 con 0x7f29e00b7980 2023-07-09T21:41:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47796/0 (socket says 172.21.15.37:47796) 2023-07-09T21:41:38.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 -- 172.21.15.37:0/2621637230 learned_addr learned my addr 172.21.15.37:0/2621637230 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29df7fe640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e00b7980 0x7f29e0154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29dffff640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e00d0780 0x7f29e00b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 -- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e00b7980 msgr2=0x7f29e0154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e00b7980 0x7f29e0154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 -- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e00d0780 msgr2=0x7f29e00b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e00d0780 0x7f29e00b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 -- 172.21.15.37:0/2621637230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d8009b30 con 0x7f29e00cf290 2023-07-09T21:41:38.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29deffd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f29d400e930 tx=0x7f29d400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d4009690 con 0x7f29e00cf290 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d400ca00 con 0x7f29e00cf290 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d400cdb0 con 0x7f29e00cf290 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29e01511e0 con 0x7f29e00cf290 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29e01517a0 con 0x7f29e00cf290 2023-07-09T21:41:38.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.368+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29e0153f70 con 0x7f29e00cf290 2023-07-09T21:41:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.372+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f29d4013470 con 0x7f29e00cf290 2023-07-09T21:41:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.372+0000 7f29c7fff640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 0x7f29cc0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.372+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f29d40840c0 con 0x7f29e00cf290 2023-07-09T21:41:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.372+0000 7f29df7fe640 1 -- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 msgr2=0x7f29cc0688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:38.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.372+0000 7f29df7fe640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 0x7f29cc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:38.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.380+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29e0153f70 con 0x7f29e00cf290 2023-07-09T21:41:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.540+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f29e0153f30 con 0x7f29e00cf290 2023-07-09T21:41:38.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.544+0000 7f29c7fff640 1 -- 172.21.15.37:0/2621637230 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v41)=0 v41) v1 ==== 138+0+0 (secure 0 0 0) 0x7f29d4051500 con 0x7f29e00cf290 2023-07-09T21:41:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 msgr2=0x7f29cc0688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:38.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 0x7f29cc0688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 msgr2=0x7f29e00b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f29d400e930 tx=0x7f29d400edf0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 shutdown_connections 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f29cc0663f0 0x7f29cc0688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29e00d0780 0x7f29e00b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29e00cf290 0x7f29e00b5230 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 --2- 172.21.15.37:0/2621637230 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29e00b7980 0x7f29e0154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 >> 172.21.15.37:0/2621637230 conn(0x7f29e0073090 msgr2=0x7f29e01559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 shutdown_connections 2023-07-09T21:41:38.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.548+0000 7f29e5cbd640 1 -- 172.21.15.37:0/2621637230 wait complete. 2023-07-09T21:41:38.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:41:38.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 Processor -- start 2023-07-09T21:41:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 -- start start 2023-07-09T21:41:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe02c0b79d0 0x7fe02c0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe02c0cd070 0x7fe02c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c15f810 con 0x7fe02c0cd070 2023-07-09T21:41:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c0b7e50 con 0x7fe02c0b79d0 2023-07-09T21:41:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe031656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15fad0 con 0x7fe02c15bc60 2023-07-09T21:41:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe02c0cd070 0x7fe02c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe02c0cd070 0x7fe02c0b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47810/0 (socket says 172.21.15.37:47810) 2023-07-09T21:41:38.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02affd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe023fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe02c0b79d0 0x7fe02c0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 -- 172.21.15.37:0/3622788407 learned_addr learned my addr 172.21.15.37:0/3622788407 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 -- 172.21.15.37:0/3622788407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 msgr2=0x7fe02c0b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/3622788407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 -- 172.21.15.37:0/3622788407 >> v2:172.21.15.119:3300/0 conn(0x7fe02c0b79d0 msgr2=0x7fe02c0b3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:38.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/3622788407 >> v2:172.21.15.119:3300/0 conn(0x7fe02c0b79d0 0x7fe02c0b3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.716+0000 7fe02b7fe640 1 -- 172.21.15.37:0/3622788407 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c15fdb0 con 0x7fe02c0cd070 2023-07-09T21:41:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/3622788407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0cd070 0x7fe02c0b3fd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe02c069970 tx=0x7fe02401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bbd881b01a9be server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:38.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe02a7fc640 1 -- 172.21.15.37:0/3622788407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240a57b0 con 0x7fe02c0cd070 2023-07-09T21:41:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe02a7fc640 1 -- 172.21.15.37:0/3622788407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0240a5910 con 0x7fe02c0cd070 2023-07-09T21:41:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe02a7fc640 1 -- 172.21.15.37:0/3622788407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240a5ca0 con 0x7fe02c0cd070 2023-07-09T21:41:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 -- 172.21.15.37:0/3622788407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0cd070 msgr2=0x7fe02c0b3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 --2- 172.21.15.37:0/3622788407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0cd070 0x7fe02c0b3fd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe02c069970 tx=0x7fe02401c910 comp rx=0 tx=0).stop 2023-07-09T21:41:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 -- 172.21.15.37:0/3622788407 shutdown_connections 2023-07-09T21:41:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 --2- 172.21.15.37:0/3622788407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0cd070 0x7fe02c0b3fd0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 --2- 172.21.15.37:0/3622788407 >> v2:172.21.15.119:3300/0 conn(0x7fe02c0b79d0 0x7fe02c0b3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 --2- 172.21.15.37:0/3622788407 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 -- 172.21.15.37:0/3622788407 >> 172.21.15.37:0/3622788407 conn(0x7fe02c06aae0 msgr2=0x7fe02c0cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:38.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 -- 172.21.15.37:0/3622788407 shutdown_connections 2023-07-09T21:41:38.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.720+0000 7fe031656640 1 -- 172.21.15.37:0/3622788407 wait complete. 2023-07-09T21:41:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 Processor -- start 2023-07-09T21:41:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- start start 2023-07-09T21:41:38.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe02c0cd070 0x7fe02c147480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c1479c0 con 0x7fe02c0c8700 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0c98f0 con 0x7fe02c0cd070 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0c74b0 con 0x7fe02c15bc60 2023-07-09T21:41:38.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47826/0 (socket says 172.21.15.37:47826) 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 -- 172.21.15.37:0/962936618 learned_addr learned my addr 172.21.15.37:0/962936618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02affd640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe02c0cd070 0x7fe02c147480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe023fff640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 -- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 msgr2=0x7fe02c0c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 -- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe02c0cd070 msgr2=0x7fe02c147480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe02c0cd070 0x7fe02c147480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 -- 172.21.15.37:0/962936618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe024009b30 con 0x7fe02c0c8700 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe02b7fe640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe0240af040 tx=0x7fe0240196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240b8670 con 0x7fe02c0c8700 2023-07-09T21:41:38.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0240b87d0 con 0x7fe02c0c8700 2023-07-09T21:41:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0240b8b60 con 0x7fe02c0c8700 2023-07-09T21:41:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c0c68a0 con 0x7fe02c0c8700 2023-07-09T21:41:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.724+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c0c6e60 con 0x7fe02c0c8700 2023-07-09T21:41:38.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c04e020 con 0x7fe02c0c8700 2023-07-09T21:41:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe0240b8cc0 con 0x7fe02c0c8700 2023-07-09T21:41:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe0237fe640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 0x7fe00c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe02411f340 con 0x7fe02c0c8700 2023-07-09T21:41:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe02affd640 1 -- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 msgr2=0x7fe00c0688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:38.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.728+0000 7fe02affd640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 0x7fe00c0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:38.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.732+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0240ec6c0 con 0x7fe02c0c8700 2023-07-09T21:41:38.770 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:38.774+0000 7fc0e4c55180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:41:38.813 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:38.812+0000 7fb35cbd7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:41:38.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.888+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fe02c0c75f0 con 0x7fe02c0c8700 2023-07-09T21:41:38.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe0237fe640 1 -- 172.21.15.37:0/962936618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v42)=0 v42) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe024009510 con 0x7fe02c0c8700 2023-07-09T21:41:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 msgr2=0x7fe00c0688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 0x7fe00c0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 msgr2=0x7fe02c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fe0240af040 tx=0x7fe0240196b0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 shutdown_connections 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7fe00c066420 0x7fe00c0688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe02c0c8700 0x7fe02c15df80 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe02c15bc60 0x7fe02c0c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 --2- 172.21.15.37:0/962936618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe02c0cd070 0x7fe02c147480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 >> 172.21.15.37:0/962936618 conn(0x7fe02c06aae0 msgr2=0x7fe02c0b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 shutdown_connections 2023-07-09T21:41:38.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:38.896+0000 7fe031656640 1 -- 172.21.15.37:0/962936618 wait complete. 2023-07-09T21:41:38.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:38.918 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:41:38.922 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:38.926+0000 7fc0e4c55180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:41:38.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-09T21:41:38.974 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:38.972+0000 7fb35cbd7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:41:39.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 Processor -- start 2023-07-09T21:41:39.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 -- start start 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c0cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f302c0b0540 0x7f302c0cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302c0d0450 con 0x7f302c0b1420 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f302c0ce640 con 0x7f302c0b0540 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.120+0000 7f3030dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0ce080 con 0x7f302c0cfb40 2023-07-09T21:41:39.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f302c0b0540 0x7f302c0cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:39.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f302c0b0540 0x7f302c0cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47842/0 (socket says 172.21.15.37:47842) 2023-07-09T21:41:39.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 -- 172.21.15.37:0/3570361396 learned_addr learned my addr 172.21.15.37:0/3570361396 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:39.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302b7fe640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c0cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:39.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 -- 172.21.15.37:0/3570361396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 msgr2=0x7f302c0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:39.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c0cff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 -- 172.21.15.37:0/3570361396 >> v1:172.21.15.119:6789/0 conn(0x7f302c0b1420 legacy=0x7f302c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:39.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302bfff640 1 -- 172.21.15.37:0/3570361396 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302c0ce360 con 0x7f302c0b0540 2023-07-09T21:41:39.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.124+0000 7f302a7fc640 1 -- 172.21.15.37:0/3570361396 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626356878 0 0) 0x7f302c0d0450 con 0x7f302c0b1420 2023-07-09T21:41:39.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f302bfff640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0cccd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3024009e50 tx=0x7f302401c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10696111ab22560b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f302a7fc640 1 -- 172.21.15.37:0/3570361396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240a58a0 con 0x7f302c0b0540 2023-07-09T21:41:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f302a7fc640 1 -- 172.21.15.37:0/3570361396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30240a5a00 con 0x7f302c0b0540 2023-07-09T21:41:39.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f302a7fc640 1 -- 172.21.15.37:0/3570361396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240a5d90 con 0x7f302c0b0540 2023-07-09T21:41:39.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 -- 172.21.15.37:0/3570361396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 msgr2=0x7f302c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:39.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0cccd0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f3024009e50 tx=0x7f302401c9e0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 -- 172.21.15.37:0/3570361396 shutdown_connections 2023-07-09T21:41:39.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0cccd0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 --2- 172.21.15.37:0/3570361396 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c0cff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 -- 172.21.15.37:0/3570361396 >> 172.21.15.37:0/3570361396 conn(0x7f302c072d20 msgr2=0x7f302c0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:39.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 -- 172.21.15.37:0/3570361396 shutdown_connections 2023-07-09T21:41:39.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.128+0000 7f3030dd2640 1 -- 172.21.15.37:0/3570361396 wait complete. 2023-07-09T21:41:39.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 Processor -- start 2023-07-09T21:41:39.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- start start 2023-07-09T21:41:39.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f302c0b1420 0x7f302c0b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b6100 con 0x7f302c0b0540 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b54f0 con 0x7f302c0b1420 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302c0b57d0 con 0x7f302c0cfb40 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47844/0 (socket says 172.21.15.37:47844) 2023-07-09T21:41:39.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 -- 172.21.15.37:0/1381280352 learned_addr learned my addr 172.21.15.37:0/1381280352 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:39.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302bfff640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:39.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f302c0b1420 0x7f302c0b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 msgr2=0x7f302c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f302c0cfb40 0x7f302c1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f302c0b1420 msgr2=0x7f302c0b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f302c0b1420 0x7f302c0b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3024009b30 con 0x7f302c0b0540 2023-07-09T21:41:39.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f302b7fe640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0b4e30 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f301c00e870 tx=0x7f301c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c009510 con 0x7f302c0b0540 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00eec0 con 0x7f302c0b0540 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00cb40 con 0x7f302c0b0540 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f302c0b5ab0 con 0x7f302c0b0540 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.132+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302c0b7760 con 0x7f302c0b0540 2023-07-09T21:41:39.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302c04e020 con 0x7f302c0b0540 2023-07-09T21:41:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 50) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f301c00cca0 con 0x7f302c0b0540 2023-07-09T21:41:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f3013fff640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f301c084300 con 0x7f302c0b0540 2023-07-09T21:41:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f302affd640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 msgr2=0x7f30180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:39.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.136+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:41:39.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.140+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f301c051680 con 0x7f302c0b0540 2023-07-09T21:41:39.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.312+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f302c0d1d60 con 0x7f3018066420 2023-07-09T21:41:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.340+0000 7f302affd640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 msgr2=0x7f30180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:39.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.340+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:41:39.400 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.406+0000 7fc0e4c55180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:39.460 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.466+0000 7fc0e4c55180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:41:39.490 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.488+0000 7fb35cbd7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:39.516 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.522+0000 7fc0e4c55180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:41:39.552 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.552+0000 7fb35cbd7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:41:39.601 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.606+0000 7fc0e4c55180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:41:39.610 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.608+0000 7fb35cbd7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:41:39.659 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.662+0000 7fc0e4c55180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:41:39.702 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.700+0000 7fb35cbd7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:41:39.743 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.746+0000 7fc0e4c55180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:41:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.744+0000 7f302affd640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 msgr2=0x7f30180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:39.744+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:41:39.761 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.760+0000 7fb35cbd7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:41:39.798 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.802+0000 7fc0e4c55180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:41:39.849 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.848+0000 7fb35cbd7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:41:39.909 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:39.908+0000 7fb35cbd7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:41:39.941 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:39.946+0000 7fc0e4c55180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:41:39.999 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.002+0000 7fc0e4c55180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:41:40.059 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.060+0000 7fb35cbd7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:41:40.120 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.120+0000 7fb35cbd7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:41:40.238 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:41:40.239 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:41:40.239 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:41:40.246 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.250+0000 7fc0e4c55180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:41:40.370 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:41:40.371 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:41:40.371 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:41:40.379 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.382+0000 7fc0e4c55180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:40.380 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.380+0000 7fb35cbd7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:41:40.507 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.510+0000 7fc0e4c55180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:40.523 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.524+0000 7fb35cbd7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:40.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:40.548+0000 7f302affd640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 msgr2=0x7f30180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3013141456 2023-07-09T21:41:40.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:40.548+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:41:40.576 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.582+0000 7fc0e4c55180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:41:40.654 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.652+0000 7fb35cbd7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:41:40.709 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:40.714+0000 7fc0e4c55180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:40.729 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.728+0000 7fb35cbd7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:41:40.870 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:40.868+0000 7fb35cbd7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:41:41.244 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.250+0000 7fc0e4c55180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:41:41.329 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.334+0000 7fc0e4c55180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:41:41.438 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:41.436+0000 7fb35cbd7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:41:41.475 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.478+0000 7fc0e4c55180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:41:41.527 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:41.528+0000 7fb35cbd7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:41:41.558 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.562+0000 7fc0e4c55180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:41:41.682 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:41.680+0000 7fb35cbd7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:41:41.770 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:41.768+0000 7fb35cbd7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:41:41.824 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.826+0000 7fc0e4c55180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:41:41.883 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:41.886+0000 7fc0e4c55180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:41:41.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:41.896+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 51) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f301c051a50 con 0x7f302c0b0540 2023-07-09T21:41:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:41.896+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 msgr2=0x7f30180688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:41:41.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:41.896+0000 7f3013fff640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/3013141456,v1:172.21.15.119:6833/3013141456] conn(0x7f3018066420 0x7f30180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc063db0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc063db0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc063db0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc063db0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.021 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc063db0640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc066db6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc066db6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc066db6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc066db6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.022 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:41:42.026+0000 7fc066db6640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:41:42.071 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:42.072+0000 7fb35cbd7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:41:42.134 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:41:42.132+0000 7fb35cbd7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:41:42.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.900+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 52) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f301c082620 con 0x7f302c0b0540 2023-07-09T21:41:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.900+0000 7f3013fff640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f3018033ee0 0x7f30180708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.900+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 --> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f301801c480 con 0x7f3018033ee0 2023-07-09T21:41:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.904+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f3018033ee0 0x7f30180708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.912+0000 7f302affd640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f3018033ee0 0x7f30180708f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f302c06adb0 tx=0x7f3020007dc0 comp rx=0 tx=0).ready entity=mgr.8233 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:42.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3013fff640 1 -- 172.21.15.37:0/1381280352 <== mgr.8233 v2:172.21.15.119:6832/578953977 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f301801c480 con 0x7f3018033ee0 2023-07-09T21:41:42.975 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T21:41:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f3018033ee0 msgr2=0x7f30180708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f3018033ee0 0x7f30180708f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f302c06adb0 tx=0x7f3020007dc0 comp rx=0 tx=0).stop 2023-07-09T21:41:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 msgr2=0x7f302c0b4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:42.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 --2- 172.21.15.37:0/1381280352 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f302c0b0540 0x7f302c0b4e30 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f301c00e870 tx=0x7f301c00ec70 comp rx=0 tx=0).stop 2023-07-09T21:41:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f302bfff640 1 -- 172.21.15.37:0/1381280352 reap_dead start 2023-07-09T21:41:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 shutdown_connections 2023-07-09T21:41:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 >> 172.21.15.37:0/1381280352 conn(0x7f302c072d20 msgr2=0x7f302c15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 shutdown_connections 2023-07-09T21:41:42.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:42.976+0000 7f3030dd2640 1 -- 172.21.15.37:0/1381280352 wait complete. 2023-07-09T21:41:42.998 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T21:41:42.999 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-09-21_42_00 in ~18s... 2023-07-09T21:41:42.999 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [] 2023-07-09T21:41:42.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-09T21:41:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 Processor -- start 2023-07-09T21:41:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 -- start start 2023-07-09T21:41:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5080b7980 0x7ff508160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080d0780 0x7ff5080d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50815bf80 con 0x7ff5080ceb80 2023-07-09T21:41:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5080cd070 con 0x7ff5080b7980 2023-07-09T21:41:43.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff51029c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080cfd70 con 0x7ff5080d0780 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5080b7980 0x7ff508160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5080b7980 0x7ff508160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47850/0 (socket says 172.21.15.37:47850) 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 -- 172.21.15.37:0/1291355851 learned_addr learned my addr 172.21.15.37:0/1291355851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e839640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080d0780 0x7ff5080d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 -- 172.21.15.37:0/1291355851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080d0780 msgr2=0x7ff5080d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:41:43.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080d0780 0x7ff5080d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 -- 172.21.15.37:0/1291355851 >> v1:172.21.15.119:6789/0 conn(0x7ff5080ceb80 legacy=0x7ff5080cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.148+0000 7ff50e038640 1 -- 172.21.15.37:0/1291355851 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508160570 con 0x7ff5080b7980 2023-07-09T21:41:43.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff50e038640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff508160030 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e84cc27cedb9ef8d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff50d036640 1 -- 172.21.15.37:0/1291355851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040ab600 con 0x7ff5080b7980 2023-07-09T21:41:43.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff50d036640 1 -- 172.21.15.37:0/1291355851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5040a7050 con 0x7ff5080b7980 2023-07-09T21:41:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff50d036640 1 -- 172.21.15.37:0/1291355851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040ab980 con 0x7ff5080b7980 2023-07-09T21:41:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 -- 172.21.15.37:0/1291355851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 msgr2=0x7ff508160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff508160030 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff504009870 tx=0x7ff50401c540 comp rx=0 tx=0).stop 2023-07-09T21:41:43.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 -- 172.21.15.37:0/1291355851 shutdown_connections 2023-07-09T21:41:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080d0780 0x7ff5080d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 --2- 172.21.15.37:0/1291355851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff508160030 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 -- 172.21.15.37:0/1291355851 >> 172.21.15.37:0/1291355851 conn(0x7ff508073090 msgr2=0x7ff508069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:43.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 -- 172.21.15.37:0/1291355851 shutdown_connections 2023-07-09T21:41:43.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.152+0000 7ff51029c640 1 -- 172.21.15.37:0/1291355851 wait complete. 2023-07-09T21:41:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 Processor -- start 2023-07-09T21:41:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- start start 2023-07-09T21:41:43.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080ceb80 0x7ff508153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080d0780 0x7ff508151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815a500 con 0x7ff5080b7980 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50814fed0 con 0x7ff5080d0780 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815a990 con 0x7ff5080ceb80 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47858/0 (socket says 172.21.15.37:47858) 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 -- 172.21.15.37:0/611650194 learned_addr learned my addr 172.21.15.37:0/611650194 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50d837640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080ceb80 0x7ff508153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e839640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080d0780 0x7ff508151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 -- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080ceb80 msgr2=0x7ff508153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080ceb80 0x7ff508153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 -- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080d0780 msgr2=0x7ff508151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080d0780 0x7ff508151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 -- 172.21.15.37:0/611650194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094d0 con 0x7ff5080b7980 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff50e038640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff50401abf0 tx=0x7ff5040192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b35d0 con 0x7ff5080b7980 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5040b3730 con 0x7ff5080b7980 2023-07-09T21:41:43.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040b3ae0 con 0x7ff5080b7980 2023-07-09T21:41:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5081598f0 con 0x7ff5080b7980 2023-07-09T21:41:43.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.156+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff508159eb0 con 0x7ff5080b7980 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50804d7d0 con 0x7ff5080b7980 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 52) v1 ==== 85513+0+0 (secure 0 0 0) 0x7ff5040b2070 con 0x7ff5080b7980 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff4feffd640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 0x7ff4ec0685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7ff50411dbb0 con 0x7ff5080b7980 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff50d837640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 0x7ff4ec0685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:41:43.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.160+0000 7ff50d837640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 0x7ff4ec0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff508155640 tx=0x7ff4f8009040 comp rx=0 tx=0).ready entity=mgr.8233 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:41:43.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.164+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5040eb140 con 0x7ff5080b7980 2023-07-09T21:41:43.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.340+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 --> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff5080cff80 con 0x7ff4ec066120 2023-07-09T21:41:43.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff4feffd640 1 -- 172.21.15.37:0/611650194 <== mgr.8233 v2:172.21.15.119:6832/578953977 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+66 (secure 0 0 0) 0x7ff4f8001370 con 0x7ff4ec066120 2023-07-09T21:41:43.348 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:41:43.349 INFO:teuthology.orchestra.run.smithi037.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-09T21:41:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 msgr2=0x7ff4ec0685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 0x7ff4ec0685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff508155640 tx=0x7ff4f8009040 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 msgr2=0x7ff50814f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff50401abf0 tx=0x7ff5040192e0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 shutdown_connections 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7ff4ec066120 0x7ff4ec0685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5080d0780 0x7ff508151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5080ceb80 0x7ff508153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 --2- 172.21.15.37:0/611650194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5080b7980 0x7ff50814f990 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:41:43.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 >> 172.21.15.37:0/611650194 conn(0x7ff508073090 msgr2=0x7ff5080cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:41:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 shutdown_connections 2023-07-09T21:41:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:41:43.348+0000 7ff51029c640 1 -- 172.21.15.37:0/611650194 wait complete. 2023-07-09T21:41:43.369 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{}]} 2023-07-09T21:41:43.370 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{}]} 2023-07-09T21:41:43.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:43.370 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:43.386 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:43.386 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:43.386 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:44.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:44.388 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:44.405 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:44.406 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:44.406 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:45.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:45.407 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:45.425 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:45.425 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:45.425 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:46.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:46.427 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:46.444 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:46.445 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:46.445 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:47.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:47.446 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:47.464 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:47.464 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:47.465 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:48.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:48.467 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:48.485 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:48.485 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:48.486 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:49.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:49.488 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:49.506 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:49.506 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:49.507 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:50.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:50.508 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:50.525 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:50.526 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:50.527 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:51.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:51.529 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:51.546 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:51.546 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:51.547 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:52.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:52.549 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:52.565 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:52.566 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:52.566 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:53.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:53.567 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:53.585 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:53.585 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:53.586 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:54.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:54.588 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:54.604 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:54.605 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:54.605 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:55.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:55.607 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:55.624 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:55.625 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:55.625 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:56.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:56.626 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:56.643 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:56.644 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:56.644 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:57.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:57.647 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:57.665 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:57.665 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:57.665 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:58.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:58.667 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:58.684 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:58.684 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:58.685 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:41:59.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:41:59.687 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:41:59.704 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:41:59.705 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:41:59.705 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:42:00.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:00.707 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:42:00.723 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:42:00.724 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:42:00.724 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:42:00.988 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:00.989+0000 7fc056595640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:00.988 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:00.993+0000 7fc056595640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:00.988 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:00.993+0000 7fc056595640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:00.988 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:00.993+0000 7fc056595640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:00.989 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:00.993+0000 7fc056595640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:01.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:01.726 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:42:01.726 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:42:01.733 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:42:01.742 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_42_00_UTC 2023-07-09T21:42:01.744 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-21_42_00_UTC'} 2023-07-09T21:42:01.744 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-09-21_42_00_UTC'} 2023-07-09T21:42:01.745 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T21:42:01.746 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-09-21_42_00_UTC'] 2023-07-09T21:42:01.746 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688938902.9992096, now = 1688938921.746716, timo = 18 2023-07-09T21:42:02.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-09T21:42:02.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.904+0000 7f2b4187b640 1 Processor -- start 2023-07-09T21:42:02.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.904+0000 7f2b4187b640 1 -- start start 2023-07-09T21:42:02.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.904+0000 7f2b4187b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b3c0b7980 0x7f2b3c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b4187b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 0x7f2b3c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b4187b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b3c15bf80 con 0x7f2b3c0b3c20 2023-07-09T21:42:02.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b4187b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b3c0cd070 con 0x7f2b3c0b7980 2023-07-09T21:42:02.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b4187b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0cfd70 con 0x7f2b3c0ceb80 2023-07-09T21:42:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b3c0b7980 0x7f2b3c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2b3c0b7980 0x7f2b3c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42546/0 (socket says 172.21.15.37:42546) 2023-07-09T21:42:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 -- 172.21.15.37:0/2590796715 learned_addr learned my addr 172.21.15.37:0/2590796715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b33fff640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 0x7f2b3c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 -- 172.21.15.37:0/2590796715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 msgr2=0x7f2b3c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 0x7f2b3c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 -- 172.21.15.37:0/2590796715 >> v1:172.21.15.37:6789/0 conn(0x7f2b3c0b3c20 legacy=0x7f2b3c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 -- 172.21.15.37:0/2590796715 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c160570 con 0x7f2b3c0b7980 2023-07-09T21:42:02.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b33fff640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 0x7f2b3c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c160030 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c239605000e21ed7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:02.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3a7fc640 1 -- 172.21.15.37:0/2590796715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0ab600 con 0x7f2b3c0b7980 2023-07-09T21:42:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3a7fc640 1 -- 172.21.15.37:0/2590796715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c0a7050 con 0x7f2b3c0b7980 2023-07-09T21:42:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.908+0000 7f2b3a7fc640 1 -- 172.21.15.37:0/2590796715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c0ab980 con 0x7f2b3c0b7980 2023-07-09T21:42:02.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- 172.21.15.37:0/2590796715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 msgr2=0x7f2b3c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c160030 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c009870 tx=0x7f2b2c01c540 comp rx=0 tx=0).stop 2023-07-09T21:42:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- 172.21.15.37:0/2590796715 shutdown_connections 2023-07-09T21:42:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0ceb80 0x7f2b3c0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2590796715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c160030 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:02.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- 172.21.15.37:0/2590796715 >> 172.21.15.37:0/2590796715 conn(0x7f2b3c073090 msgr2=0x7f2b3c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- 172.21.15.37:0/2590796715 shutdown_connections 2023-07-09T21:42:02.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- 172.21.15.37:0/2590796715 wait complete. 2023-07-09T21:42:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 Processor -- start 2023-07-09T21:42:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- start start 2023-07-09T21:42:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 0x7f2b3c157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 0x7f2b3c0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0cae00 con 0x7f2b3c0b7980 2023-07-09T21:42:02.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0ca4d0 con 0x7f2b3c0ceb80 2023-07-09T21:42:02.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b4187b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3c0ca7b0 con 0x7f2b3c0b3c20 2023-07-09T21:42:02.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42552/0 (socket says 172.21.15.37:42552) 2023-07-09T21:42:02.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.912+0000 7f2b33fff640 1 -- 172.21.15.37:0/2770622039 learned_addr learned my addr 172.21.15.37:0/2770622039 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 0x7f2b3c157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 -- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 msgr2=0x7f2b3c157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 0x7f2b3c157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b3b7fe640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 0x7f2b3c0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 -- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 msgr2=0x7f2b3c0c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 0x7f2b3c0c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:02.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 -- 172.21.15.37:0/2770622039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c0094d0 con 0x7f2b3c0b7980 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 0x7f2b3c157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b3b7fe640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 0x7f2b3c0c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b33fff640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7c0 tx=0x7f2b2400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24007a30 con 0x7f2b3c0b7980 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24007b90 con 0x7f2b3c0b7980 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2400ce70 con 0x7f2b3c0b7980 2023-07-09T21:42:02.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b3c0caa90 con 0x7f2b3c0b7980 2023-07-09T21:42:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b3c1530e0 con 0x7f2b3c0b7980 2023-07-09T21:42:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3c04d7d0 con 0x7f2b3c0b7980 2023-07-09T21:42:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.916+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 54) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f2b240113f0 con 0x7f2b3c0b7980 2023-07-09T21:42:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.920+0000 7f2b38ff9640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 0x7f2b1c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.920+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f2b24084960 con 0x7f2b3c0b7980 2023-07-09T21:42:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.920+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 0x7f2b1c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:02.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.920+0000 7f2b3affd640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 0x7f2b1c0689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c08ad30 tx=0x7f2b2c008040 comp rx=0 tx=0).ready entity=mgr.8233 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:02.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:02.924+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2b24051800 con 0x7f2b3c0b7980 2023-07-09T21:42:03.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.096+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 --> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b3c0ccd90 con 0x7f2b1c066510 2023-07-09T21:42:03.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.168+0000 7f2b38ff9640 1 -- 172.21.15.37:0/2770622039 <== mgr.8233 v2:172.21.15.119:6832/578953977 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2b2c0ab830 con 0x7f2b1c066510 2023-07-09T21:42:03.171 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path snap_test_dir1 2023-07-09T21:42:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 msgr2=0x7f2b1c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 0x7f2b1c0689c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c08ad30 tx=0x7f2b2c008040 comp rx=0 tx=0).stop 2023-07-09T21:42:03.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 msgr2=0x7f2b3c0c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2b2400c7c0 tx=0x7f2b2400cc80 comp rx=0 tx=0).stop 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 shutdown_connections 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2b1c066510 0x7f2b1c0689c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2b3c0ceb80 0x7f2b3c0c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b3c0b7980 0x7f2b3c0c9270 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 --2- 172.21.15.37:0/2770622039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2b3c0b3c20 0x7f2b3c157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 >> 172.21.15.37:0/2770622039 conn(0x7f2b3c073090 msgr2=0x7f2b3c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 shutdown_connections 2023-07-09T21:42:03.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.172+0000 7f2b4187b640 1 -- 172.21.15.37:0/2770622039 wait complete. 2023-07-09T21:42:03.192 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-09T21:42:03.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:03.193 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:42:03.207 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_42_00_UTC 2023-07-09T21:42:03.208 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-09-21_42_00_UTC 2023-07-09T21:42:03.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:03.209 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-09-21_42_00_UTC) 2023-07-09T21:42:03.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:03.269 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T21:42:03.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:42:03.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 Processor -- start 2023-07-09T21:42:03.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 -- start start 2023-07-09T21:42:03.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1db8160030 0x7f1db80d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:03.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db815bf80 con 0x7f1db80cf290 2023-07-09T21:42:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db80d02f0 con 0x7f1db80b7980 2023-07-09T21:42:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dc02ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db80cd070 con 0x7f1db8160030 2023-07-09T21:42:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dbd887640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1db80cf290 0x7f1db80d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52746/0 (socket says 172.21.15.37:52746) 2023-07-09T21:42:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dbd887640 1 -- 172.21.15.37:0/2666589832 learned_addr learned my addr 172.21.15.37:0/2666589832 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:03.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.512+0000 7f1dbe889640 1 --2- 172.21.15.37:0/2666589832 >> v2:172.21.15.37:3300/0 conn(0x7f1db8160030 0x7f1db80d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbe889640 1 -- 172.21.15.37:0/2666589832 >> v1:172.21.15.119:6789/0 conn(0x7f1db80b7980 legacy=0x7f1db80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbe889640 1 -- 172.21.15.37:0/2666589832 >> v1:172.21.15.37:6789/0 conn(0x7f1db80cf290 legacy=0x7f1db80d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbe889640 1 -- 172.21.15.37:0/2666589832 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db80cc7f0 con 0x7f1db8160030 2023-07-09T21:42:03.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbe889640 1 --2- 172.21.15.37:0/2666589832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db80d0e90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009d90 tx=0x7f1db001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d0b647cf9f0716 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbd086640 1 -- 172.21.15.37:0/2666589832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00a57d0 con 0x7f1db8160030 2023-07-09T21:42:03.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbd086640 1 -- 172.21.15.37:0/2666589832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00a5930 con 0x7f1db8160030 2023-07-09T21:42:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dbd086640 1 -- 172.21.15.37:0/2666589832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00a5cc0 con 0x7f1db8160030 2023-07-09T21:42:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dc02ec640 1 -- 172.21.15.37:0/2666589832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 msgr2=0x7f1db80d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.516+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/2666589832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db80d0e90 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1db0009d90 tx=0x7f1db001c910 comp rx=0 tx=0).stop 2023-07-09T21:42:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- 172.21.15.37:0/2666589832 shutdown_connections 2023-07-09T21:42:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/2666589832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db80d0e90 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- 172.21.15.37:0/2666589832 >> 172.21.15.37:0/2666589832 conn(0x7f1db8073090 msgr2=0x7f1db8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- 172.21.15.37:0/2666589832 shutdown_connections 2023-07-09T21:42:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- 172.21.15.37:0/2666589832 wait complete. 2023-07-09T21:42:03.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 Processor -- start 2023-07-09T21:42:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- start start 2023-07-09T21:42:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 0x7f1db80c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:03.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 0x7f1db80c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8151470 con 0x7f1db8160030 2023-07-09T21:42:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db8151750 con 0x7f1db80cf290 2023-07-09T21:42:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db80b3eb0 con 0x7f1db80b7980 2023-07-09T21:42:03.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42562/0 (socket says 172.21.15.37:42562) 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 -- 172.21.15.37:0/1415511443 learned_addr learned my addr 172.21.15.37:0/1415511443 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe088640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 0x7f1db80c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbd887640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 0x7f1db80c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 -- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 msgr2=0x7f1db80c7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 0x7f1db80c7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 -- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 msgr2=0x7f1db80c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 0x7f1db80c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 -- 172.21.15.37:0/1415511443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db0009a70 con 0x7f1db8160030 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe088640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 0x7f1db80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbd887640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 0x7f1db80c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dbe889640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b0040 tx=0x7f1db80d1be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00a5750 con 0x7f1db8160030 2023-07-09T21:42:03.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1db00ad650 con 0x7f1db8160030 2023-07-09T21:42:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1db00ad9c0 con 0x7f1db8160030 2023-07-09T21:42:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.520+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db80b4190 con 0x7f1db8160030 2023-07-09T21:42:03.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db80c88a0 con 0x7f1db8160030 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db804d7d0 con 0x7f1db8160030 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 54) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f1db00b4040 con 0x7f1db8160030 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1daeffd640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 0x7f1d9c0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1db011e910 con 0x7f1db8160030 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1dbe088640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 0x7f1d9c0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:03.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.524+0000 7f1dbe088640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 0x7f1d9c0689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1db4003e40 tx=0x7f1db4009040 comp rx=0 tx=0).ready entity=mgr.8233 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:03.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.528+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1db00eb8c0 con 0x7f1db8160030 2023-07-09T21:42:03.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:03.724+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f1db80737d0 con 0x7f1db8160030 2023-07-09T21:42:04.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.212+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1db00ebc90 con 0x7f1db8160030 2023-07-09T21:42:04.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1daeffd640 1 -- 172.21.15.37:0/1415511443 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v55) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1db00f2f90 con 0x7f1db8160030 2023-07-09T21:42:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 msgr2=0x7f1d9c0689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 0x7f1d9c0689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1db4003e40 tx=0x7f1db4009040 comp rx=0 tx=0).stop 2023-07-09T21:42:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 msgr2=0x7f1db8151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f1db00b0040 tx=0x7f1db80d1be0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 shutdown_connections 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1d9c066510 0x7f1d9c0689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1db8160030 0x7f1db8151de0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1db80cf290 0x7f1db80c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 --2- 172.21.15.37:0/1415511443 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1db80b7980 0x7f1db80c7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 >> 172.21.15.37:0/1415511443 conn(0x7f1db8073090 msgr2=0x7f1db8154810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:04.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 shutdown_connections 2023-07-09T21:42:04.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.216+0000 7f1dc02ec640 1 -- 172.21.15.37:0/1415511443 wait complete. 2023-07-09T21:42:04.239 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:42:04.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:04.306 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:04.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:42:04.363 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:04.364 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:04.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:04.389 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:04.388+0000 7f5c25a0a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:04.392 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:04.397+0000 7fdaa48fd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.536+0000 7f4d3f007640 1 Processor -- start 2023-07-09T21:42:04.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.536+0000 7f4d3f007640 1 -- start start 2023-07-09T21:42:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3f007640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 0x7f4d3806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3f007640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4d380b4340 0x7f4d380d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3f007640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d380b49f0 con 0x7f4d380cef80 2023-07-09T21:42:04.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3f007640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380b7e80 con 0x7f4d380b4340 2023-07-09T21:42:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3f007640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380cc8a0 con 0x7f4d380b7ab0 2023-07-09T21:42:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d37fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4d380cef80 0x7f4d380b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52754/0 (socket says 172.21.15.37:52754) 2023-07-09T21:42:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d37fff640 1 -- 172.21.15.37:0/2748126305 learned_addr learned my addr 172.21.15.37:0/2748126305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2748126305 >> v2:172.21.15.119:3300/0 conn(0x7f4d380b4340 0x7f4d380d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3cda3640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 0x7f4d3806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d377fe640 1 -- 172.21.15.37:0/2748126305 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759023456 0 0) 0x7f4d380b49f0 con 0x7f4d380cef80 2023-07-09T21:42:04.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d377fe640 1 -- 172.21.15.37:0/2748126305 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d28003530 con 0x7f4d380cef80 2023-07-09T21:42:04.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 msgr2=0x7f4d3806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:04.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 0x7f4d3806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2748126305 >> v1:172.21.15.37:6789/0 conn(0x7f4d380cef80 legacy=0x7f4d380b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2748126305 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380ccb80 con 0x7f4d380b4340 2023-07-09T21:42:04.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.540+0000 7f4d3cda3640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 0x7f4d3806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:04.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b4340 0x7f4d380d02a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009d90 tx=0x7f4d3001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c60cd414503ee56b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:04.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d377fe640 1 -- 172.21.15.37:0/2748126305 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300a59e0 con 0x7f4d380b4340 2023-07-09T21:42:04.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d377fe640 1 -- 172.21.15.37:0/2748126305 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300a5b40 con 0x7f4d380b4340 2023-07-09T21:42:04.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d377fe640 1 -- 172.21.15.37:0/2748126305 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300ad440 con 0x7f4d380b4340 2023-07-09T21:42:04.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b4340 msgr2=0x7f4d380d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b4340 0x7f4d380d02a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4d30009d90 tx=0x7f4d3001c920 comp rx=0 tx=0).stop 2023-07-09T21:42:04.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- 172.21.15.37:0/2748126305 shutdown_connections 2023-07-09T21:42:04.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b4340 0x7f4d380d02a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2748126305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b7ab0 0x7f4d3806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- 172.21.15.37:0/2748126305 >> 172.21.15.37:0/2748126305 conn(0x7f4d38073090 msgr2=0x7f4d38069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:04.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- 172.21.15.37:0/2748126305 shutdown_connections 2023-07-09T21:42:04.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- 172.21.15.37:0/2748126305 wait complete. 2023-07-09T21:42:04.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 Processor -- start 2023-07-09T21:42:04.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.544+0000 7f4d3f007640 1 -- start start 2023-07-09T21:42:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b4340 0x7f4d381501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b7ab0 0x7f4d381551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380ca5a0 con 0x7f4d380cef80 2023-07-09T21:42:04.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c7200 con 0x7f4d380b7ab0 2023-07-09T21:42:04.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c6960 con 0x7f4d380b4340 2023-07-09T21:42:04.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42590/0 (socket says 172.21.15.37:42590) 2023-07-09T21:42:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2096503795 learned_addr learned my addr 172.21.15.37:0/2096503795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d37fff640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b7ab0 0x7f4d381551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3cda3640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b4340 0x7f4d381501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b4340 msgr2=0x7f4d381501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b4340 0x7f4d381501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b7ab0 msgr2=0x7f4d381551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b7ab0 0x7f4d381551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 -- 172.21.15.37:0/2096503795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c009420 con 0x7f4d380cef80 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3d5a4640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b0040 tx=0x7f4d300196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300adce0 con 0x7f4d380cef80 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d300ade40 con 0x7f4d380cef80 2023-07-09T21:42:04.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d300b7650 con 0x7f4d380cef80 2023-07-09T21:42:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d30009a70 con 0x7f4d380cef80 2023-07-09T21:42:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380c6f20 con 0x7f4d380cef80 2023-07-09T21:42:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.548+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3804d7d0 con 0x7f4d380cef80 2023-07-09T21:42:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.552+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f4d300b4050 con 0x7f4d380cef80 2023-07-09T21:42:04.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.552+0000 7f4d357fa640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 0x7f4d1c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.552+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f4d3011f380 con 0x7f4d380cef80 2023-07-09T21:42:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.552+0000 7f4d3cda3640 1 -- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 msgr2=0x7f4d1c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:04.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.552+0000 7f4d3cda3640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 0x7f4d1c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:04.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.556+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4d300ec350 con 0x7f4d380cef80 2023-07-09T21:42:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.724+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d3815efa0 con 0x7f4d380cef80 2023-07-09T21:42:04.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.724+0000 7f4d357fa640 1 -- 172.21.15.37:0/2096503795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+18790 (secure 0 0 0) 0x7f4d30009450 con 0x7f4d380cef80 2023-07-09T21:42:04.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:04.727 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":130,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:41.888508+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3057369556":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6833/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2604488903":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6832/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/4210238305":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2630218575":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/3890872655":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/1918439718":"2023-07-10T21:41:41.888477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 msgr2=0x7f4d1c0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 0x7f4d1c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 msgr2=0x7f4d38155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f4d300b0040 tx=0x7f4d300196c0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 shutdown_connections 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f4d1c0664f0 0x7f4d1c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4d380cef80 0x7f4d38155720 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4d380b7ab0 0x7f4d381551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 --2- 172.21.15.37:0/2096503795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4d380b4340 0x7f4d381501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 >> 172.21.15.37:0/2096503795 conn(0x7f4d38073090 msgr2=0x7f4d380b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 shutdown_connections 2023-07-09T21:42:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.728+0000 7f4d3f007640 1 -- 172.21.15.37:0/2096503795 wait complete. 2023-07-09T21:42:04.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:41:21.894951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:41:22.783509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:42:04.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:42:04.807 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:04.809+0000 7fdaa48fd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:04.838 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:04.836+0000 7f5c25a0a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:04.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.896+0000 7f3016be9640 1 Processor -- start 2023-07-09T21:42:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.896+0000 7f3016be9640 1 -- start start 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3016be9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 0x7f3010160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3016be9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30100d0780 0x7f30100d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3016be9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f301015bf80 con 0x7f30100b7980 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3016be9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30100cd070 con 0x7f30100d0780 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3016be9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30100cfd70 con 0x7f30100cf290 2023-07-09T21:42:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30100d0780 0x7f30100d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30100d0780 0x7f30100d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42592/0 (socket says 172.21.15.37:42592) 2023-07-09T21:42:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f300ffff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 0x7f3010160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 -- 172.21.15.37:0/3850221069 learned_addr learned my addr 172.21.15.37:0/3850221069 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:04.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 -- 172.21.15.37:0/3850221069 >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 msgr2=0x7f3010160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 --2- 172.21.15.37:0/3850221069 >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 0x7f3010160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 -- 172.21.15.37:0/3850221069 >> v1:172.21.15.119:6789/0 conn(0x7f30100b7980 legacy=0x7f30100ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f3015186640 1 -- 172.21.15.37:0/3850221069 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3010160570 con 0x7f30100d0780 2023-07-09T21:42:04.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.900+0000 7f300ffff640 1 --2- 172.21.15.37:0/3850221069 >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 0x7f3010160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:04.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3015186640 1 --2- 172.21.15.37:0/3850221069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100d0780 0x7f30100d0b80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f30100b4cd0 tx=0x7f300801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2214d81b049cef10 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:04.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f300f7fe640 1 -- 172.21.15.37:0/3850221069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080a5690 con 0x7f30100d0780 2023-07-09T21:42:04.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f300f7fe640 1 -- 172.21.15.37:0/3850221069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30080a57f0 con 0x7f30100d0780 2023-07-09T21:42:04.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f300f7fe640 1 -- 172.21.15.37:0/3850221069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30080a5b80 con 0x7f30100d0780 2023-07-09T21:42:04.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- 172.21.15.37:0/3850221069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100d0780 msgr2=0x7f30100d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 --2- 172.21.15.37:0/3850221069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100d0780 0x7f30100d0b80 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f30100b4cd0 tx=0x7f300801c9d0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- 172.21.15.37:0/3850221069 shutdown_connections 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 --2- 172.21.15.37:0/3850221069 >> v2:172.21.15.119:3300/0 conn(0x7f30100cf290 0x7f3010160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 --2- 172.21.15.37:0/3850221069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100d0780 0x7f30100d0b80 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- 172.21.15.37:0/3850221069 >> 172.21.15.37:0/3850221069 conn(0x7f3010073090 msgr2=0x7f3010069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- 172.21.15.37:0/3850221069 shutdown_connections 2023-07-09T21:42:04.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- 172.21.15.37:0/3850221069 wait complete. 2023-07-09T21:42:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 Processor -- start 2023-07-09T21:42:04.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.904+0000 7f3016be9640 1 -- start start 2023-07-09T21:42:04.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 0x7f30100b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30100d0780 0x7f3010152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301015a0a0 con 0x7f30100b7980 2023-07-09T21:42:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30100b4680 con 0x7f30100cf290 2023-07-09T21:42:04.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30100b4960 con 0x7f30100d0780 2023-07-09T21:42:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42600/0 (socket says 172.21.15.37:42600) 2023-07-09T21:42:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 -- 172.21.15.37:0/3495863523 learned_addr learned my addr 172.21.15.37:0/3495863523 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f300ffff640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 0x7f30100b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3015186640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30100d0780 0x7f3010152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:04.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 -- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30100d0780 msgr2=0x7f3010152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30100d0780 0x7f3010152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 -- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 msgr2=0x7f30100b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 0x7f30100b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 -- 172.21.15.37:0/3495863523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ffc009420 con 0x7f30100b7980 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f300ffff640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 0x7f30100b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3014985640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f300400c3c0 tx=0x7f300400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:04.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30040052d0 con 0x7f30100b7980 2023-07-09T21:42:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3004005430 con 0x7f30100b7980 2023-07-09T21:42:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004003840 con 0x7f30100b7980 2023-07-09T21:42:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3008009b30 con 0x7f30100b7980 2023-07-09T21:42:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3010159d30 con 0x7f30100b7980 2023-07-09T21:42:04.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.908+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301004d7d0 con 0x7f30100b7980 2023-07-09T21:42:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.912+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f30040039a0 con 0x7f30100b7980 2023-07-09T21:42:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.912+0000 7f300d7fa640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 0x7f2ff4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.912+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f3004083470 con 0x7f30100b7980 2023-07-09T21:42:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.912+0000 7f300ffff640 1 -- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 msgr2=0x7f2ff4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:04.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.912+0000 7f300ffff640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 0x7f2ff4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:04.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:04.916+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3004050640 con 0x7f30100b7980 2023-07-09T21:42:04.956 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:04.957+0000 7fdaa48fd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:05.001 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.000+0000 7f5c25a0a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:05.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.072+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f301015bf80 con 0x7f30100b7980 2023-07-09T21:42:05.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.072+0000 7f300d7fa640 1 -- 172.21.15.37:0/3495863523 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f301015bf80 con 0x7f30100b7980 2023-07-09T21:42:05.074 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:42:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 msgr2=0x7f2ff4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 0x7f2ff4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 msgr2=0x7f30100c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f300400c3c0 tx=0x7f300400c880 comp rx=0 tx=0).stop 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 shutdown_connections 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f2ff40664c0 0x7f2ff4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30100d0780 0x7f3010152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30100cf290 0x7f30100b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 --2- 172.21.15.37:0/3495863523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30100b7980 0x7f30100c5cb0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 >> 172.21.15.37:0/3495863523 conn(0x7f3010073090 msgr2=0x7f301015d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 shutdown_connections 2023-07-09T21:42:05.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.076+0000 7f3016be9640 1 -- 172.21.15.37:0/3495863523 wait complete. 2023-07-09T21:42:05.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:42:05.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 Processor -- start 2023-07-09T21:42:05.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 -- start start 2023-07-09T21:42:05.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 0x7f21440d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214415bf80 con 0x7f21440b7980 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21440d02f0 con 0x7f21440cf290 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.248+0000 7f214b89c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440cd070 con 0x7f2144160030 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149638640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f21440b7980 0x7f21440ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52764/0 (socket says 172.21.15.37:52764) 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149638640 1 -- 172.21.15.37:0/1632837169 learned_addr learned my addr 172.21.15.37:0/1632837169 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:05.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149e39640 1 --2- 172.21.15.37:0/1632837169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 0x7f21440d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479283276 0 0) 0x7f2140001120 con 0x7f21440b7980 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2130003530 con 0x7f21440b7980 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198579302 0 0) 0x7f21440d02f0 con 0x7f21440cf290 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2140001120 con 0x7f21440cf290 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149e39640 1 -- 172.21.15.37:0/1632837169 >> v1:172.21.15.119:6789/0 conn(0x7f21440cf290 legacy=0x7f21440d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149e39640 1 -- 172.21.15.37:0/1632837169 >> v1:172.21.15.37:6789/0 conn(0x7f21440b7980 legacy=0x7f21440ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149e39640 1 -- 172.21.15.37:0/1632837169 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21440cc7f0 con 0x7f2144160030 2023-07-09T21:42:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f2149e39640 1 --2- 172.21.15.37:0/1632837169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 0x7f21440d0e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f213c009dc0 tx=0x7f213c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26f0b8dff030bbfe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0a5830 con 0x7f2144160030 2023-07-09T21:42:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c0a5990 con 0x7f2144160030 2023-07-09T21:42:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.252+0000 7f213bfff640 1 -- 172.21.15.37:0/1632837169 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0a5d20 con 0x7f2144160030 2023-07-09T21:42:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- 172.21.15.37:0/1632837169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 msgr2=0x7f21440d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 --2- 172.21.15.37:0/1632837169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 0x7f21440d0e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f213c009dc0 tx=0x7f213c01c970 comp rx=0 tx=0).stop 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- 172.21.15.37:0/1632837169 shutdown_connections 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 --2- 172.21.15.37:0/1632837169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2144160030 0x7f21440d0e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- 172.21.15.37:0/1632837169 >> 172.21.15.37:0/1632837169 conn(0x7f2144073090 msgr2=0x7f2144069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- 172.21.15.37:0/1632837169 shutdown_connections 2023-07-09T21:42:05.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- 172.21.15.37:0/1632837169 wait complete. 2023-07-09T21:42:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 Processor -- start 2023-07-09T21:42:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- start start 2023-07-09T21:42:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21440b7980 0x7f21440c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21440cf290 0x7f21440b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c7c50 con 0x7f2144160030 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440b32e0 con 0x7f21440cf290 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f214b89c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440b38a0 con 0x7f21440b7980 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f2149e39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f2149e39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42614/0 (socket says 172.21.15.37:42614) 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f2149e39640 1 -- 172.21.15.37:0/3523245398 learned_addr learned my addr 172.21.15.37:0/3523245398 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f2149638640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21440b7980 0x7f21440c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.256+0000 7f2148e37640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21440cf290 0x7f21440b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 -- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21440b7980 msgr2=0x7f21440c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21440b7980 0x7f21440c7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 -- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21440cf290 msgr2=0x7f21440b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21440cf290 0x7f21440b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 -- 172.21.15.37:0/3523245398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213c009a70 con 0x7f2144160030 2023-07-09T21:42:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2149e39640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f213c019580 tx=0x7f21440d1be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0ad640 con 0x7f2144160030 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c0ad7a0 con 0x7f2144160030 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440c8160 con 0x7f2144160030 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c0adb30 con 0x7f2144160030 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440b3530 con 0x7f2144160030 2023-07-09T21:42:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21440c8610 con 0x7f2144160030 2023-07-09T21:42:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f213c0b4040 con 0x7f2144160030 2023-07-09T21:42:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 0x7f2128068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.260+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f213c11ee90 con 0x7f2144160030 2023-07-09T21:42:05.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.264+0000 7f2149638640 1 -- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 msgr2=0x7f2128068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:05.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.264+0000 7f2149638640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 0x7f2128068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:05.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.264+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f213c0ebf80 con 0x7f2144160030 2023-07-09T21:42:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21440b3a30 con 0x7f2144160030 2023-07-09T21:42:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f2139ffb640 1 -- 172.21.15.37:0/3523245398 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v130) v1 ==== 92+0+10 (secure 0 0 0) 0x7f213c0ef5a0 con 0x7f2144160030 2023-07-09T21:42:05.424 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:42:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 msgr2=0x7f2128068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 0x7f2128068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 msgr2=0x7f214415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f213c019580 tx=0x7f21440d1be0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 shutdown_connections 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f21280664c0 0x7f2128068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2144160030 0x7f214415c380 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f21440cf290 0x7f21440b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 --2- 172.21.15.37:0/3523245398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f21440b7980 0x7f21440c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 >> 172.21.15.37:0/3523245398 conn(0x7f2144073090 msgr2=0x7f2144154610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 shutdown_connections 2023-07-09T21:42:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.424+0000 7f214b89c640 1 -- 172.21.15.37:0/3523245398 wait complete. 2023-07-09T21:42:05.431 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.433+0000 7fdaa48fd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:05.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:42:05.489 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.493+0000 7fdaa48fd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:05.522 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.520+0000 7f5c25a0a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:05.544 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.549+0000 7fdaa48fd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:05.586 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.584+0000 7f5c25a0a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:05.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 Processor -- start 2023-07-09T21:42:05.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 -- start start 2023-07-09T21:42:05.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92900b7980 0x7f9290160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92900ceb80 0x7f92900cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929015bf80 con 0x7f92900b3c20 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cd070 con 0x7f92900b7980 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f9295e34640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900cfd70 con 0x7f92900ceb80 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92900b7980 0x7f9290160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92900b7980 0x7f9290160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42618/0 (socket says 172.21.15.37:42618) 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 -- 172.21.15.37:0/1867085727 learned_addr learned my addr 172.21.15.37:0/1867085727 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928effd640 1 --2- 172.21.15.37:0/1867085727 >> v2:172.21.15.119:3300/0 conn(0x7f92900ceb80 0x7f92900cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 -- 172.21.15.37:0/1867085727 >> v2:172.21.15.119:3300/0 conn(0x7f92900ceb80 msgr2=0x7f92900cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:05.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 --2- 172.21.15.37:0/1867085727 >> v2:172.21.15.119:3300/0 conn(0x7f92900ceb80 0x7f92900cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 -- 172.21.15.37:0/1867085727 >> v1:172.21.15.119:6789/0 conn(0x7f92900b3c20 legacy=0x7f92900b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.596+0000 7f928f7fe640 1 -- 172.21.15.37:0/1867085727 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290160570 con 0x7f92900b7980 2023-07-09T21:42:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f928f7fe640 1 --2- 172.21.15.37:0/1867085727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900b7980 0x7f9290160030 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f92900b4cd0 tx=0x7f928001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76cec5f527139b94 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f928e7fc640 1 -- 172.21.15.37:0/1867085727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800ab600 con 0x7f92900b7980 2023-07-09T21:42:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f928e7fc640 1 -- 172.21.15.37:0/1867085727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800a7050 con 0x7f92900b7980 2023-07-09T21:42:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f928e7fc640 1 -- 172.21.15.37:0/1867085727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800ab980 con 0x7f92900b7980 2023-07-09T21:42:05.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 -- 172.21.15.37:0/1867085727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900b7980 msgr2=0x7f9290160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 --2- 172.21.15.37:0/1867085727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900b7980 0x7f9290160030 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f92900b4cd0 tx=0x7f928001c500 comp rx=0 tx=0).stop 2023-07-09T21:42:05.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 -- 172.21.15.37:0/1867085727 shutdown_connections 2023-07-09T21:42:05.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 --2- 172.21.15.37:0/1867085727 >> v2:172.21.15.119:3300/0 conn(0x7f92900ceb80 0x7f92900cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 --2- 172.21.15.37:0/1867085727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900b7980 0x7f9290160030 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 -- 172.21.15.37:0/1867085727 >> 172.21.15.37:0/1867085727 conn(0x7f9290073090 msgr2=0x7f9290069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 -- 172.21.15.37:0/1867085727 shutdown_connections 2023-07-09T21:42:05.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 -- 172.21.15.37:0/1867085727 wait complete. 2023-07-09T21:42:05.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.600+0000 7f9295e34640 1 Processor -- start 2023-07-09T21:42:05.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- start start 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 0x7f929014db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92900b7980 0x7f92901522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 0x7f9290154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9290155b30 con 0x7f92900ceb80 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901528f0 con 0x7f92900b3c20 2023-07-09T21:42:05.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9290152bd0 con 0x7f92900b7980 2023-07-09T21:42:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 0x7f9290154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 0x7f929014db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 0x7f9290154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42626/0 (socket says 172.21.15.37:42626) 2023-07-09T21:42:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928ffff640 1 -- 172.21.15.37:0/1546074618 learned_addr learned my addr 172.21.15.37:0/1546074618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:05.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928effd640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92900b7980 0x7f92901522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 -- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92900b7980 msgr2=0x7f92901522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92900b7980 0x7f92901522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 -- 172.21.15.37:0/1546074618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 msgr2=0x7f9290154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 0x7f9290154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 -- 172.21.15.37:0/1546074618 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92800094d0 con 0x7f92900b3c20 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f928f7fe640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 0x7f929014db80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f92800ab000 tx=0x7f92800192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800b8070 con 0x7f92900b3c20 2023-07-09T21:42:05.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92800b35d0 con 0x7f92900b3c20 2023-07-09T21:42:05.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9290152eb0 con 0x7f92900b3c20 2023-07-09T21:42:05.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92800b3960 con 0x7f92900b3c20 2023-07-09T21:42:05.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9290153470 con 0x7f92900b3c20 2023-07-09T21:42:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.604+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92900cd600 con 0x7f92900b3c20 2023-07-09T21:42:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.608+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f92800b2070 con 0x7f92900b3c20 2023-07-09T21:42:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.608+0000 7f9277fff640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 0x7f927c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.608+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f928011da90 con 0x7f92900b3c20 2023-07-09T21:42:05.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.608+0000 7f928effd640 1 -- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 msgr2=0x7f927c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:05.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.608+0000 7f928effd640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 0x7f927c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:05.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.616+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92900cd600 con 0x7f92900b3c20 2023-07-09T21:42:05.633 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.637+0000 7fdaa48fd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:05.647 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.648+0000 7f5c25a0a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:05.691 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.693+0000 7fdaa48fd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:05.739 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.740+0000 7f5c25a0a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:05.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.772+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9290160570 con 0x7f92900b3c20 2023-07-09T21:42:05.774 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.777+0000 7fdaa48fd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:05.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.772+0000 7f9277fff640 1 -- 172.21.15.37:0/1546074618 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9290160570 con 0x7f92900b3c20 2023-07-09T21:42:05.774 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:42:05.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 msgr2=0x7f927c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:05.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 0x7f927c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 msgr2=0x7f929014db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 0x7f929014db80 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f92800ab000 tx=0x7f92800192a0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 shutdown_connections 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f927c0664c0 0x7f927c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92900ceb80 0x7f9290154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92900b7980 0x7f92901522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 --2- 172.21.15.37:0/1546074618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92900b3c20 0x7f929014db80 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 >> 172.21.15.37:0/1546074618 conn(0x7f9290073090 msgr2=0x7f92900b31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 shutdown_connections 2023-07-09T21:42:05.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.776+0000 7f9295e34640 1 -- 172.21.15.37:0/1546074618 wait complete. 2023-07-09T21:42:05.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:42:05.800 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.800+0000 7f5c25a0a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:05.829 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.833+0000 7fdaa48fd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:05.891 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.892+0000 7f5c25a0a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:05.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 Processor -- start 2023-07-09T21:42:05.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 -- start start 2023-07-09T21:42:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 0x7fe18c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe18c0d0360 0x7fe18c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0b3bb0 con 0x7fe18c15f130 2023-07-09T21:42:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c0d07e0 con 0x7fe18c0d0360 2023-07-09T21:42:05.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe194774640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0cccb0 con 0x7fe18c0b76b0 2023-07-09T21:42:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe191d0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 0x7fe18c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe18c0d0360 0x7fe18c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe18c0d0360 0x7fe18c0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55564/0 (socket says 172.21.15.37:55564) 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe191d0f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 0x7fe18c0cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:40360/0 (socket says 172.21.15.37:40360) 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 -- 172.21.15.37:0/2698736655 learned_addr learned my addr 172.21.15.37:0/2698736655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192510640 1 --1- 172.21.15.37:0/2698736655 >> v1:172.21.15.119:6789/0 conn(0x7fe18c15f130 0x7fe18c0b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:34548/0 (socket says 172.21.15.37:34548) 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 -- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 msgr2=0x7fe18c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 --2- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 0x7fe18c0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 -- 172.21.15.37:0/2698736655 >> v1:172.21.15.119:6789/0 conn(0x7fe18c15f130 legacy=0x7fe18c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.944+0000 7fe192d11640 1 -- 172.21.15.37:0/2698736655 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c0b8100 con 0x7fe18c0d0360 2023-07-09T21:42:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe192d11640 1 --2- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c0d0360 0x7fe18c0cd140 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e50 tx=0x7fe18401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6c1edcaf0c055ec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe19150e640 1 -- 172.21.15.37:0/2698736655 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840a5810 con 0x7fe18c0d0360 2023-07-09T21:42:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe19150e640 1 -- 172.21.15.37:0/2698736655 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1840a5970 con 0x7fe18c0d0360 2023-07-09T21:42:05.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe19150e640 1 -- 172.21.15.37:0/2698736655 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1840a5d00 con 0x7fe18c0d0360 2023-07-09T21:42:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 -- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c0d0360 msgr2=0x7fe18c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 --2- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c0d0360 0x7fe18c0cd140 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe184009e50 tx=0x7fe18401c950 comp rx=0 tx=0).stop 2023-07-09T21:42:05.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 -- 172.21.15.37:0/2698736655 shutdown_connections 2023-07-09T21:42:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 --2- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c0d0360 0x7fe18c0cd140 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 --2- 172.21.15.37:0/2698736655 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0b76b0 0x7fe18c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 -- 172.21.15.37:0/2698736655 >> 172.21.15.37:0/2698736655 conn(0x7fe18c072d20 msgr2=0x7fe18c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 -- 172.21.15.37:0/2698736655 shutdown_connections 2023-07-09T21:42:05.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.948+0000 7fe194774640 1 -- 172.21.15.37:0/2698736655 wait complete. 2023-07-09T21:42:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 Processor -- start 2023-07-09T21:42:05.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- start start 2023-07-09T21:42:05.952 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:05.952+0000 7f5c25a0a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0d0360 0x7fe18c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c15f130 0x7fe18c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0c8b70 con 0x7fe18c0b76b0 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0c94e0 con 0x7fe18c15f130 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c0c82d0 con 0x7fe18c0d0360 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42630/0 (socket says 172.21.15.37:42630) 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 -- 172.21.15.37:0/878670176 learned_addr learned my addr 172.21.15.37:0/878670176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:05.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192d11640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c15f130 0x7fe18c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe191d0f640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0d0360 0x7fe18c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 -- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0d0360 msgr2=0x7fe18c0cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0d0360 0x7fe18c0cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 -- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c15f130 msgr2=0x7fe18c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c15f130 0x7fe18c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 -- 172.21.15.37:0/878670176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009b30 con 0x7fe18c0b76b0 2023-07-09T21:42:05.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe192510640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c4c0 tx=0x7fe18800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188007480 con 0x7fe18c0b76b0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1880075e0 con 0x7fe18c0b76b0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0c85b0 con 0x7fe18c0b76b0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188004a10 con 0x7fe18c0b76b0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.952+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0c7f30 con 0x7fe18c0b76b0 2023-07-09T21:42:05.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c0668f0 con 0x7fe18c0b76b0 2023-07-09T21:42:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe188004b70 con 0x7fe18c0b76b0 2023-07-09T21:42:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe182ffd640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 0x7fe170068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:05.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fe1880836b0 con 0x7fe18c0b76b0 2023-07-09T21:42:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe191d0f640 1 -- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 msgr2=0x7fe170068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:05.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.956+0000 7fe191d0f640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 0x7fe170068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:05.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:05.960+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe188050710 con 0x7fe18c0b76b0 2023-07-09T21:42:05.971 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:05.973+0000 7fdaa48fd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:06.029 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.033+0000 7fdaa48fd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:06.105 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.104+0000 7f5c25a0a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe18c0d2220 con 0x7fe18c0b76b0 2023-07-09T21:42:06.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe182ffd640 1 -- 172.21.15.37:0/878670176 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe188053d30 con 0x7fe18c0b76b0 2023-07-09T21:42:06.117 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:42:06.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 msgr2=0x7fe170068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 0x7fe170068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 msgr2=0x7fe18c151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c4c0 tx=0x7fe18800c980 comp rx=0 tx=0).stop 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 shutdown_connections 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fe1700664c0 0x7fe170068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe18c15f130 0x7fe18c156450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe18c0d0360 0x7fe18c0cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 --2- 172.21.15.37:0/878670176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe18c0b76b0 0x7fe18c151c90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 >> 172.21.15.37:0/878670176 conn(0x7fe18c072d20 msgr2=0x7fe18c0d2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.116+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 shutdown_connections 2023-07-09T21:42:06.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.120+0000 7fe194774640 1 -- 172.21.15.37:0/878670176 wait complete. 2023-07-09T21:42:06.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:42:06.168 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.168+0000 7f5c25a0a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:06.268 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:06.268 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:06.268 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:06.276 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.281+0000 7fdaa48fd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:06.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.312+0000 7fd23d3ac640 1 Processor -- start 2023-07-09T21:42:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.312+0000 7fd23d3ac640 1 -- start start 2023-07-09T21:42:06.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.312+0000 7fd23d3ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 0x7fd2380cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.312+0000 7fd23d3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 0x7fd2380b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd2377fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd2380b4140 0x7fd23815f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52774/0 (socket says 172.21.15.37:52774) 2023-07-09T21:42:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd2377fe640 1 -- 172.21.15.37:0/141781594 learned_addr learned my addr 172.21.15.37:0/141781594 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:06.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd22ffff640 1 --2- 172.21.15.37:0/141781594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 0x7fd2380b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd236ffd640 1 --2- 172.21.15.37:0/141781594 >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 0x7fd2380cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2380cef80 con 0x7fd2380b4140 2023-07-09T21:42:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2380b45b0 con 0x7fd2380b7a60 2023-07-09T21:42:06.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2380cf260 con 0x7fd2380b47a0 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd2367fc640 1 -- 172.21.15.37:0/141781594 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070339916 0 0) 0x7fd2380cef80 con 0x7fd2380b4140 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd22ffff640 1 -- 172.21.15.37:0/141781594 >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 msgr2=0x7fd2380cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd22ffff640 1 --2- 172.21.15.37:0/141781594 >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 0x7fd2380cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd22ffff640 1 -- 172.21.15.37:0/141781594 >> v1:172.21.15.37:6789/0 conn(0x7fd2380b4140 legacy=0x7fd23815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd22ffff640 1 -- 172.21.15.37:0/141781594 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2380cf540 con 0x7fd2380b47a0 2023-07-09T21:42:06.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.316+0000 7fd236ffd640 1 --2- 172.21.15.37:0/141781594 >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 0x7fd2380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:06.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.320+0000 7fd22ffff640 1 --2- 172.21.15.37:0/141781594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 0x7fd2380b3c00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2200097c0 tx=0x7fd22001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51c4fc0c6fec9b96 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.320+0000 7fd2367fc640 1 -- 172.21.15.37:0/141781594 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200ad640 con 0x7fd2380b47a0 2023-07-09T21:42:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.320+0000 7fd2367fc640 1 -- 172.21.15.37:0/141781594 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2200ad7a0 con 0x7fd2380b47a0 2023-07-09T21:42:06.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.320+0000 7fd2367fc640 1 -- 172.21.15.37:0/141781594 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2200adb30 con 0x7fd2380b47a0 2023-07-09T21:42:06.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 msgr2=0x7fd2380b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/141781594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 0x7fd2380b3c00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd2200097c0 tx=0x7fd22001c4a0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 shutdown_connections 2023-07-09T21:42:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/141781594 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b47a0 0x7fd2380b3c00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/141781594 >> v2:172.21.15.37:3300/0 conn(0x7fd2380b7a60 0x7fd2380cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 >> 172.21.15.37:0/141781594 conn(0x7fd238073050 msgr2=0x7fd238069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:06.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 shutdown_connections 2023-07-09T21:42:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 -- 172.21.15.37:0/141781594 wait complete. 2023-07-09T21:42:06.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.324+0000 7fd23d3ac640 1 Processor -- start 2023-07-09T21:42:06.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 -- start start 2023-07-09T21:42:06.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 0x7fd23815b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2380b47a0 0x7fd2381623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 0x7fd238163760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23815bc30 con 0x7fd2380b4140 2023-07-09T21:42:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2381641b0 con 0x7fd2380b47a0 2023-07-09T21:42:06.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd23d3ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd238164490 con 0x7fd2380b7a60 2023-07-09T21:42:06.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 0x7fd23815b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd236ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 0x7fd23815b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42642/0 (socket says 172.21.15.37:42642) 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd236ffd640 1 -- 172.21.15.37:0/184123781 learned_addr learned my addr 172.21.15.37:0/184123781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 0x7fd238163760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd22ffff640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2380b47a0 0x7fd2381623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2380b47a0 msgr2=0x7fd2381623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2380b47a0 0x7fd2381623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 msgr2=0x7fd23815b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 0x7fd23815b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 -- 172.21.15.37:0/184123781 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220009420 con 0x7fd2380b7a60 2023-07-09T21:42:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.328+0000 7fd2377fe640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 0x7fd238163760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c750 tx=0x7fd23000cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:06.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230004d80 con 0x7fd2380b7a60 2023-07-09T21:42:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd238161910 con 0x7fd2380b7a60 2023-07-09T21:42:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23000a640 con 0x7fd2380b7a60 2023-07-09T21:42:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd238161ed0 con 0x7fd2380b7a60 2023-07-09T21:42:06.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23000a9f0 con 0x7fd2380b7a60 2023-07-09T21:42:06.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.332+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fd23000ab50 con 0x7fd2380b7a60 2023-07-09T21:42:06.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.336+0000 7fd22f7fe640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 0x7fd218068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.336+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7fd230083930 con 0x7fd2380b7a60 2023-07-09T21:42:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.336+0000 7fd236ffd640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 msgr2=0x7fd218068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:06.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.336+0000 7fd236ffd640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 0x7fd218068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:06.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.336+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21c005260 con 0x7fd2380b7a60 2023-07-09T21:42:06.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.344+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd230050a30 con 0x7fd2380b7a60 2023-07-09T21:42:06.411 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.413+0000 7fdaa48fd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:06.426 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:06.426 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:06.427 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:06.435 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.436+0000 7f5c25a0a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:06.534 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.537+0000 7fdaa48fd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.540+0000 7fd236ffd640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 msgr2=0x7fd218068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:06.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.540+0000 7fd236ffd640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 0x7fd218068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:42:06.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.544+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd21c005510 con 0x7fd2380b7a60 2023-07-09T21:42:06.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.544+0000 7fd22f7fe640 1 -- 172.21.15.37:0/184123781 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v130) v1 ==== 80+0+478 (secure 0 0 0) 0x7fd230018030 con 0x7fd2380b7a60 2023-07-09T21:42:06.546 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3057369556 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/3013141456 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2604488903 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/3013141456 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4210238305 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2630218575 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.547 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3890872655 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.548 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1918439718 2023-07-10T21:41:41.888477+0000 2023-07-09T21:42:06.548 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 msgr2=0x7fd218068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 0x7fd218068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 msgr2=0x7fd238163760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 0x7fd238163760 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd23000c750 tx=0x7fd23000cc10 comp rx=0 tx=0).stop 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 shutdown_connections 2023-07-09T21:42:06.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7fd2180664c0 0x7fd218068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2380b7a60 0x7fd238163760 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2380b47a0 0x7fd2381623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 --2- 172.21.15.37:0/184123781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2380b4140 0x7fd23815b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 >> 172.21.15.37:0/184123781 conn(0x7fd238073050 msgr2=0x7fd2380b3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 shutdown_connections 2023-07-09T21:42:06.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.548+0000 7fd23d3ac640 1 -- 172.21.15.37:0/184123781 wait complete. 2023-07-09T21:42:06.567 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:42:06.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:06.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:06.578 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.576+0000 7f5c25a0a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:06.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[59349]: fuse finished with error 0 and tester_r 0 2023-07-09T21:42:06.590 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:42:06.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:06.591 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:42:06.604 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.605+0000 7fdaa48fd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:06.655 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:06.655 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:06.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:06.664 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:42:06.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:06.665 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:42:06.712 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.712+0000 7f5c25a0a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:06.716 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:42:06.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:06.717 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:06.717 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:06.726 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:06.727 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:42:06.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:06.728 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:42:06.737 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:06.741+0000 7fdaa48fd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:06.778 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:42:06.779 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:06.780 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:06.780 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:06.786 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.788+0000 7f5c25a0a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:06.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:06.789 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:42:06.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:06.790 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:42:06.840 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:42:06.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:06.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:06.929 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:06.928+0000 7f5c25a0a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:06.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.984+0000 7f6f4feec640 1 Processor -- start 2023-07-09T21:42:06.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.984+0000 7f6f4feec640 1 -- start start 2023-07-09T21:42:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4feec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6f480cef80 0x7f6f4806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4feec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480b49f0 con 0x7f6f480b4340 2023-07-09T21:42:06.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4feec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480cc8a0 con 0x7f6f480b7ab0 2023-07-09T21:42:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4feec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480b7e80 con 0x7f6f480cef80 2023-07-09T21:42:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4d487640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f480b4340 0x7f6f480d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52778/0 (socket says 172.21.15.37:52778) 2023-07-09T21:42:06.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4d487640 1 -- 172.21.15.37:0/1957791741 learned_addr learned my addr 172.21.15.37:0/1957791741 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4e489640 1 --2- 172.21.15.37:0/1957791741 >> v2:172.21.15.119:3300/0 conn(0x7f6f480cef80 0x7f6f4806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185095235 0 0) 0x7f6f480b49f0 con 0x7f6f480b4340 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f34003530 con 0x7f6f480b4340 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293423806 0 0) 0x7f6f480cc8a0 con 0x7f6f480b7ab0 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f480b49f0 con 0x7f6f480b7ab0 2023-07-09T21:42:06.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4e489640 1 -- 172.21.15.37:0/1957791741 >> v1:172.21.15.119:6789/0 conn(0x7f6f480b7ab0 legacy=0x7f6f480b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4e489640 1 -- 172.21.15.37:0/1957791741 >> v1:172.21.15.37:6789/0 conn(0x7f6f480b4340 legacy=0x7f6f480d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.988+0000 7f6f4e489640 1 -- 172.21.15.37:0/1957791741 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480ccb80 con 0x7f6f480cef80 2023-07-09T21:42:06.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4e489640 1 --2- 172.21.15.37:0/1957791741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480cef80 0x7f6f4806aa50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab39fa262a01fc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:06.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400a59e0 con 0x7f6f480cef80 2023-07-09T21:42:06.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f400a5b40 con 0x7f6f480cef80 2023-07-09T21:42:06.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4cc86640 1 -- 172.21.15.37:0/1957791741 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f400ad440 con 0x7f6f480cef80 2023-07-09T21:42:06.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 -- 172.21.15.37:0/1957791741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480cef80 msgr2=0x7f6f4806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 --2- 172.21.15.37:0/1957791741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480cef80 0x7f6f4806aa50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4001c920 comp rx=0 tx=0).stop 2023-07-09T21:42:06.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 -- 172.21.15.37:0/1957791741 shutdown_connections 2023-07-09T21:42:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 --2- 172.21.15.37:0/1957791741 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480cef80 0x7f6f4806aa50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 -- 172.21.15.37:0/1957791741 >> 172.21.15.37:0/1957791741 conn(0x7f6f48073090 msgr2=0x7f6f48069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 -- 172.21.15.37:0/1957791741 shutdown_connections 2023-07-09T21:42:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.992+0000 7f6f4feec640 1 -- 172.21.15.37:0/1957791741 wait complete. 2023-07-09T21:42:06.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 Processor -- start 2023-07-09T21:42:06.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- start start 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f480b4340 0x7f6f481568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f480cef80 0x7f6f4814bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c8270 con 0x7f6f480cef80 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f48154830 con 0x7f6f480b7ab0 2023-07-09T21:42:06.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c84c0 con 0x7f6f480b4340 2023-07-09T21:42:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4e489640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f480cef80 0x7f6f4814bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:55596/0 (socket says 172.21.15.37:55596) 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 -- 172.21.15.37:0/2013097343 learned_addr learned my addr 172.21.15.37:0/2013097343 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4dc88640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f480b4340 0x7f6f481568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f480b4340 msgr2=0x7f6f481568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f480b4340 0x7f6f481568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:06.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f480cef80 msgr2=0x7f6f4814bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f480cef80 0x7f6f4814bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 -- 172.21.15.37:0/2013097343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009a70 con 0x7f6f480b7ab0 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4d487640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f38005890 tx=0x7f6f3800c960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38005cf0 con 0x7f6f480b7ab0 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38005e50 con 0x7f6f480b7ab0 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f380072b0 con 0x7f6f480b7ab0 2023-07-09T21:42:07.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f480c87a0 con 0x7f6f480b7ab0 2023-07-09T21:42:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:06.996+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4814c490 con 0x7f6f480b7ab0 2023-07-09T21:42:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f481549c0 con 0x7f6f480b7ab0 2023-07-09T21:42:07.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f6f38007410 con 0x7f6f480b7ab0 2023-07-09T21:42:07.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f3e7fc640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 0x7f6f2c0689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f6f38083760 con 0x7f6f480b7ab0 2023-07-09T21:42:07.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f4dc88640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 msgr2=0x7f6f2c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:07.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.000+0000 7f6f4dc88640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 0x7f6f2c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:07.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.004+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f38050860 con 0x7f6f480b7ab0 2023-07-09T21:42:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.204+0000 7f6f4dc88640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 msgr2=0x7f6f2c0689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:07.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.204+0000 7f6f4dc88640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 0x7f6f2c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:42:07.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.224+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f4804d7d0 con 0x7f6f480b7ab0 2023-07-09T21:42:07.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.224+0000 7f6f3e7fc640 1 -- 172.21.15.37:0/2013097343 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f6f38053e80 con 0x7f6f480b7ab0 2023-07-09T21:42:07.226 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:07.227 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:42:07.227 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:42:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 msgr2=0x7f6f2c0689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 0x7f6f2c0689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 msgr2=0x7f6f480c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6f38005890 tx=0x7f6f3800c960 comp rx=0 tx=0).stop 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 shutdown_connections 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f6f2c0664f0 0x7f6f2c0689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f480cef80 0x7f6f4814bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6f480b7ab0 0x7f6f480c5ce0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 --2- 172.21.15.37:0/2013097343 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6f480b4340 0x7f6f481568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 >> 172.21.15.37:0/2013097343 conn(0x7f6f48073090 msgr2=0x7f6f480b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 shutdown_connections 2023-07-09T21:42:07.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.228+0000 7f6f4feec640 1 -- 172.21.15.37:0/2013097343 wait complete. 2023-07-09T21:42:07.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:07.273 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.277+0000 7fdaa48fd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:07.358 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.361+0000 7fdaa48fd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.392+0000 7f1fd1d8f640 1 Processor -- start 2023-07-09T21:42:07.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.392+0000 7f1fd1d8f640 1 -- start start 2023-07-09T21:42:07.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fd1d8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1fcc0cef80 0x7f1fcc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fd1d8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0b49f0 con 0x7f1fcc0b4340 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fd1d8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fcc0cc8a0 con 0x7f1fcc0b7ab0 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fd1d8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fcc0b7e80 con 0x7f1fcc0cef80 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1fcc0b4340 0x7f1fcc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48452/0 (socket says 172.21.15.37:48452) 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcaffd640 1 -- 172.21.15.37:0/3151912452 learned_addr learned my addr 172.21.15.37:0/3151912452 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:07.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcbfff640 1 --2- 172.21.15.37:0/3151912452 >> v2:172.21.15.119:3300/0 conn(0x7f1fcc0cef80 0x7f1fcc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fca7fc640 1 -- 172.21.15.37:0/3151912452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56940159 0 0) 0x7f1fcc0b49f0 con 0x7f1fcc0b4340 2023-07-09T21:42:07.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fca7fc640 1 -- 172.21.15.37:0/3151912452 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb4003530 con 0x7f1fcc0b4340 2023-07-09T21:42:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcbfff640 1 -- 172.21.15.37:0/3151912452 >> v1:172.21.15.119:6789/0 conn(0x7f1fcc0b7ab0 legacy=0x7f1fcc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcbfff640 1 -- 172.21.15.37:0/3151912452 >> v1:172.21.15.37:6789/0 conn(0x7f1fcc0b4340 legacy=0x7f1fcc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.396+0000 7f1fcbfff640 1 -- 172.21.15.37:0/3151912452 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc0ccb80 con 0x7f1fcc0cef80 2023-07-09T21:42:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fcbfff640 1 --2- 172.21.15.37:0/3151912452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc06aa50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009d90 tx=0x7f1fc401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d13702bda075d62 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:07.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fca7fc640 1 -- 172.21.15.37:0/3151912452 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40a59e0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fca7fc640 1 -- 172.21.15.37:0/3151912452 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40a5b40 con 0x7f1fcc0cef80 2023-07-09T21:42:07.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fca7fc640 1 -- 172.21.15.37:0/3151912452 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40ad440 con 0x7f1fcc0cef80 2023-07-09T21:42:07.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/3151912452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0cef80 msgr2=0x7f1fcc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/3151912452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc06aa50 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4009d90 tx=0x7f1fc401c920 comp rx=0 tx=0).stop 2023-07-09T21:42:07.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/3151912452 shutdown_connections 2023-07-09T21:42:07.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/3151912452 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc06aa50 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/3151912452 >> 172.21.15.37:0/3151912452 conn(0x7f1fcc073090 msgr2=0x7f1fcc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/3151912452 shutdown_connections 2023-07-09T21:42:07.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/3151912452 wait complete. 2023-07-09T21:42:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 Processor -- start 2023-07-09T21:42:07.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.400+0000 7f1fd1d8f640 1 -- start start 2023-07-09T21:42:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0b4340 0x7f1fcc14f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1fcc0b7ab0 0x7f1fcc1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0cbec0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0cb2b0 con 0x7f1fcc0b4340 2023-07-09T21:42:07.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fcc0cb590 con 0x7f1fcc0b7ab0 2023-07-09T21:42:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53876/0 (socket says 172.21.15.37:53876) 2023-07-09T21:42:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 -- 172.21.15.37:0/1196537591 learned_addr learned my addr 172.21.15.37:0/1196537591 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:07.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcb7fe640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0b4340 0x7f1fcc14f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcaffd640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1fcc0b7ab0 0x7f1fcc1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 -- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1fcc0b7ab0 msgr2=0x7f1fcc1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1fcc0b7ab0 0x7f1fcc1503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 -- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0b4340 msgr2=0x7f1fcc14f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0b4340 0x7f1fcc14f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 -- 172.21.15.37:0/1196537591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4009a70 con 0x7f1fcc0cef80 2023-07-09T21:42:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fcbfff640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40b0040 tx=0x7f1fc40196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40add90 con 0x7f1fcc0cef80 2023-07-09T21:42:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4009450 con 0x7f1fcc0cef80 2023-07-09T21:42:07.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40b9690 con 0x7f1fcc0cef80 2023-07-09T21:42:07.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fcc0cb870 con 0x7f1fcc0cef80 2023-07-09T21:42:07.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fcc0caed0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fcc04d7d0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.404+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f1fc40b97f0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.408+0000 7f1fb3fff640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 0x7f1fb8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.408+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f1fc411f8e0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.408+0000 7f1fcb7fe640 1 -- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 msgr2=0x7f1fb8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.408+0000 7f1fcb7fe640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 0x7f1fb8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:07.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.412+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fc40ec9d0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.504 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.509+0000 7fdaa48fd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:07.536 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:07.536+0000 7f5c25a0a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:07.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.568+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fcc0cb6d0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.568+0000 7f1fb3fff640 1 -- 172.21.15.37:0/1196537591 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+18790 (secure 0 0 0) 0x7f1fcc0cb6d0 con 0x7f1fcc0cef80 2023-07-09T21:42:07.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:07.570 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":130,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:41:41.888508+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3057369556":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6833/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2604488903":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6832/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/4210238305":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2630218575":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/3890872655":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/1918439718":"2023-07-10T21:41:41.888477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:07.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 msgr2=0x7f1fb8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 0x7f1fb8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 msgr2=0x7f1fcc14ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40b0040 tx=0x7f1fc40196c0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 shutdown_connections 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f1fb80664c0 0x7f1fb8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fcc0cef80 0x7f1fcc14ddb0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1fcc0b7ab0 0x7f1fcc1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 --2- 172.21.15.37:0/1196537591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1fcc0b4340 0x7f1fcc14f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 >> 172.21.15.37:0/1196537591 conn(0x7f1fcc073090 msgr2=0x7f1fcc069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 shutdown_connections 2023-07-09T21:42:07.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.572+0000 7f1fd1d8f640 1 -- 172.21.15.37:0/1196537591 wait complete. 2023-07-09T21:42:07.587 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.589+0000 7fdaa48fd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:07.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:41:21.894951+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:41:22.783509+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:42:07.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:42:07.627 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:07.628+0000 7f5c25a0a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:07.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 Processor -- start 2023-07-09T21:42:07.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 -- start start 2023-07-09T21:42:07.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f78d80b7980 0x7f78d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d815bf80 con 0x7f78d80ceb80 2023-07-09T21:42:07.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d8160570 con 0x7f78d80d0780 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78de911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d80cd070 con 0x7f78d80b7980 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78d77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f78d80ceb80 0x7f78d80cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48464/0 (socket says 172.21.15.37:48464) 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78d77fe640 1 -- 172.21.15.37:0/1698841283 learned_addr learned my addr 172.21.15.37:0/1698841283 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78d7fff640 1 --2- 172.21.15.37:0/1698841283 >> v2:172.21.15.119:3300/0 conn(0x7f78d80b7980 0x7f78d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12345836 0 0) 0x7f78cc001120 con 0x7f78d80ceb80 2023-07-09T21:42:07.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.740+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78c0003530 con 0x7f78d80ceb80 2023-07-09T21:42:07.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d7fff640 1 -- 172.21.15.37:0/1698841283 >> v1:172.21.15.119:6789/0 conn(0x7f78d80d0780 legacy=0x7f78d80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3156009882 0 0) 0x7f78d00014a0 con 0x7f78d80d0780 2023-07-09T21:42:07.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d7fff640 1 -- 172.21.15.37:0/1698841283 >> v1:172.21.15.37:6789/0 conn(0x7f78d80ceb80 legacy=0x7f78d80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d7fff640 1 -- 172.21.15.37:0/1698841283 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80d02f0 con 0x7f78d80b7980 2023-07-09T21:42:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d7fff640 1 --2- 172.21.15.37:0/1698841283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80b7980 0x7f78d8160030 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f78c80097c0 tx=0x7f78c801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=528a9d2aca7fcab2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80ab600 con 0x7f78d80b7980 2023-07-09T21:42:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c80a7050 con 0x7f78d80b7980 2023-07-09T21:42:07.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78d6ffd640 1 -- 172.21.15.37:0/1698841283 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80ab980 con 0x7f78d80b7980 2023-07-09T21:42:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78de911640 1 -- 172.21.15.37:0/1698841283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80b7980 msgr2=0x7f78d8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.744+0000 7f78de911640 1 --2- 172.21.15.37:0/1698841283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80b7980 0x7f78d8160030 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f78c80097c0 tx=0x7f78c801c480 comp rx=0 tx=0).stop 2023-07-09T21:42:07.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- 172.21.15.37:0/1698841283 shutdown_connections 2023-07-09T21:42:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 --2- 172.21.15.37:0/1698841283 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80b7980 0x7f78d8160030 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- 172.21.15.37:0/1698841283 >> 172.21.15.37:0/1698841283 conn(0x7f78d8073090 msgr2=0x7f78d8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:07.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- 172.21.15.37:0/1698841283 shutdown_connections 2023-07-09T21:42:07.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- 172.21.15.37:0/1698841283 wait complete. 2023-07-09T21:42:07.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 Processor -- start 2023-07-09T21:42:07.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- start start 2023-07-09T21:42:07.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80ceb80 0x7f78d814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78d80d0780 0x7f78d80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8151770 con 0x7f78d80b7980 2023-07-09T21:42:07.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d80c5460 con 0x7f78d80ceb80 2023-07-09T21:42:07.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78de911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8150ed0 con 0x7f78d80d0780 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53890/0 (socket says 172.21.15.37:53890) 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 -- 172.21.15.37:0/3720778834 learned_addr learned my addr 172.21.15.37:0/3720778834 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d77fe640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80ceb80 0x7f78d814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78dceae640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78d80d0780 0x7f78d80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 -- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78d80d0780 msgr2=0x7f78d80c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78d80d0780 0x7f78d80c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 -- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80ceb80 msgr2=0x7f78d814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80ceb80 0x7f78d814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.748+0000 7f78d7fff640 1 -- 172.21.15.37:0/3720778834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c8009420 con 0x7f78d80b7980 2023-07-09T21:42:07.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d7fff640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f78c80ae040 tx=0x7f78c8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:07.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80bb070 con 0x7f78d80b7980 2023-07-09T21:42:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c8004020 con 0x7f78d80b7980 2023-07-09T21:42:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8004390 con 0x7f78d80b7980 2023-07-09T21:42:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78d81511b0 con 0x7f78d80b7980 2023-07-09T21:42:07.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d8151f80 con 0x7f78d80b7980 2023-07-09T21:42:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d8151de0 con 0x7f78d80b7980 2023-07-09T21:42:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 55) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f78c80b2040 con 0x7f78d80b7980 2023-07-09T21:42:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 0x7f78c4068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6406+0+0 (secure 0 0 0) 0x7f78c811dcf0 con 0x7f78d80b7980 2023-07-09T21:42:07.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d77fe640 1 -- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 msgr2=0x7f78c4068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/578953977 2023-07-09T21:42:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.752+0000 7f78d77fe640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 0x7f78c4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:07.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.756+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f78d8151de0 con 0x7f78d80b7980 2023-07-09T21:42:07.786 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:07.784+0000 7f5c25a0a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:07.854 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.857+0000 7fdaa48fd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:07.875 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:07.876+0000 7f5c25a0a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:07.913 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.917+0000 7fdaa48fd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.916+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f78d8151de0 con 0x7f78d80b7980 2023-07-09T21:42:07.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.916+0000 7f78d4ff9640 1 -- 172.21.15.37:0/3720778834 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f78d8151de0 con 0x7f78d80b7980 2023-07-09T21:42:07.919 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:42:07.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 msgr2=0x7f78c4068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 0x7f78c4068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 msgr2=0x7f78d81507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f78c80ae040 tx=0x7f78c8019220 comp rx=0 tx=0).stop 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 shutdown_connections 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:6832/578953977,v1:172.21.15.119:6833/578953977] conn(0x7f78c40664c0 0x7f78c4068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f78d80d0780 0x7f78d80c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f78d80ceb80 0x7f78d814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 --2- 172.21.15.37:0/3720778834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78d80b7980 0x7f78d81507d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 >> 172.21.15.37:0/3720778834 conn(0x7f78d8073090 msgr2=0x7f78d80b6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 shutdown_connections 2023-07-09T21:42:07.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:07.920+0000 7f78de911640 1 -- 172.21.15.37:0/3720778834 wait complete. 2023-07-09T21:42:07.946 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:42:07.994 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ea6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.995 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ea6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.995 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ea6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.996 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ea6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.996 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ea6e640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.996 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ca6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.996 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ca6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.997 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ca6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.997 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ca6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:07.997 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:07.997+0000 7fda2ca6a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.140+0000 7f8df359e640 1 Processor -- start 2023-07-09T21:42:08.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.140+0000 7f8df359e640 1 -- start start 2023-07-09T21:42:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8df40b41e0 0x7f8df40ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8df40b11a0 0x7f8df40cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df415bf00 con 0x7f8df415bb30 2023-07-09T21:42:08.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df40ce970 con 0x7f8df40b41e0 2023-07-09T21:42:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df359e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df415f6e0 con 0x7f8df40b11a0 2023-07-09T21:42:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8df40b41e0 0x7f8df40ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8df415bb30 0x7f8df40b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48476/0 (socket says 172.21.15.37:48476) 2023-07-09T21:42:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8df40b41e0 0x7f8df40ce430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53894/0 (socket says 172.21.15.37:53894) 2023-07-09T21:42:08.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df259c640 1 -- 172.21.15.37:0/4172905028 learned_addr learned my addr 172.21.15.37:0/4172905028 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8df2d9d640 1 --2- 172.21.15.37:0/4172905028 >> v2:172.21.15.119:3300/0 conn(0x7f8df40b11a0 0x7f8df40cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 -- 172.21.15.37:0/4172905028 >> v2:172.21.15.119:3300/0 conn(0x7f8df40b11a0 msgr2=0x7f8df40cfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 --2- 172.21.15.37:0/4172905028 >> v2:172.21.15.119:3300/0 conn(0x7f8df40b11a0 0x7f8df40cfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 -- 172.21.15.37:0/4172905028 >> v1:172.21.15.37:6789/0 conn(0x7f8df415bb30 legacy=0x7f8df40b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.144+0000 7f8debfff640 1 -- 172.21.15.37:0/4172905028 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df415f9c0 con 0x7f8df40b41e0 2023-07-09T21:42:08.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8debfff640 1 --2- 172.21.15.37:0/4172905028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b41e0 0x7f8df40ce430 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8df4073500 tx=0x7f8ddc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce988b16c7485e0e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df1d9b640 1 -- 172.21.15.37:0/4172905028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0a7070 con 0x7f8df40b41e0 2023-07-09T21:42:08.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df1d9b640 1 -- 172.21.15.37:0/4172905028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ddc0ab430 con 0x7f8df40b41e0 2023-07-09T21:42:08.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df1d9b640 1 -- 172.21.15.37:0/4172905028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc0ab7c0 con 0x7f8df40b41e0 2023-07-09T21:42:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 -- 172.21.15.37:0/4172905028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b41e0 msgr2=0x7f8df40ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 --2- 172.21.15.37:0/4172905028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b41e0 0x7f8df40ce430 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8df4073500 tx=0x7f8ddc01c430 comp rx=0 tx=0).stop 2023-07-09T21:42:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 -- 172.21.15.37:0/4172905028 shutdown_connections 2023-07-09T21:42:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 --2- 172.21.15.37:0/4172905028 >> v2:172.21.15.119:3300/0 conn(0x7f8df40b11a0 0x7f8df40cfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 --2- 172.21.15.37:0/4172905028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b41e0 0x7f8df40ce430 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 -- 172.21.15.37:0/4172905028 >> 172.21.15.37:0/4172905028 conn(0x7f8df406aac0 msgr2=0x7f8df40cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 -- 172.21.15.37:0/4172905028 shutdown_connections 2023-07-09T21:42:08.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 -- 172.21.15.37:0/4172905028 wait complete. 2023-07-09T21:42:08.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.148+0000 7f8df359e640 1 Processor -- start 2023-07-09T21:42:08.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- start start 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df40b41e0 0x7f8df414d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8df415bb30 0x7f8df40c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df414d8b0 con 0x7f8df40b11a0 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df40c7db0 con 0x7f8df40b41e0 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df414c2d0 con 0x7f8df415bb30 2023-07-09T21:42:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53906/0 (socket says 172.21.15.37:53906) 2023-07-09T21:42:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 -- 172.21.15.37:0/4041514618 learned_addr learned my addr 172.21.15.37:0/4041514618 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8debfff640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df40b41e0 0x7f8df414d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df2d9d640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8df415bb30 0x7f8df40c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 -- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8df415bb30 msgr2=0x7f8df40c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8df415bb30 0x7f8df40c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 -- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df40b41e0 msgr2=0x7f8df414d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df40b41e0 0x7f8df414d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 -- 172.21.15.37:0/4041514618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc009420 con 0x7f8df40b11a0 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df259c640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c430 tx=0x7f8de400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4005cf0 con 0x7f8df40b11a0 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4005e50 con 0x7f8df40b11a0 2023-07-09T21:42:08.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40072d0 con 0x7f8df40b11a0 2023-07-09T21:42:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df414c5b0 con 0x7f8df40b11a0 2023-07-09T21:42:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.152+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df414cb70 con 0x7f8df40b11a0 2023-07-09T21:42:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.156+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df40c89e0 con 0x7f8df40b11a0 2023-07-09T21:42:08.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.156+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8de4007430 con 0x7f8df40b11a0 2023-07-09T21:42:08.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.156+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f8de4082f80 con 0x7f8df40b11a0 2023-07-09T21:42:08.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.160+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8de40b3700 con 0x7f8df40b11a0 2023-07-09T21:42:08.180 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:08.180+0000 7f5c25a0a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:08.245 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:08.244+0000 7f5c25a0a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:08.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.320+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8df404e020 con 0x7f8df40b11a0 2023-07-09T21:42:08.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.320+0000 7f8deaffd640 1 -- 172.21.15.37:0/4041514618 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v131) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8de40170a0 con 0x7f8df40b11a0 2023-07-09T21:42:08.322 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:42:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 msgr2=0x7f8df40c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8de400c430 tx=0x7f8de400c8f0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 shutdown_connections 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8df415bb30 0x7f8df40c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8df40b41e0 0x7f8df414d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 --2- 172.21.15.37:0/4041514618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8df40b11a0 0x7f8df40c84a0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 >> 172.21.15.37:0/4041514618 conn(0x7f8df406aac0 msgr2=0x7f8df4153d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 shutdown_connections 2023-07-09T21:42:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.324+0000 7f8df359e640 1 -- 172.21.15.37:0/4041514618 wait complete. 2023-07-09T21:42:08.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:42:08.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.488+0000 7f0babf59640 1 Processor -- start 2023-07-09T21:42:08.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.488+0000 7f0babf59640 1 -- start start 2023-07-09T21:42:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0babf59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ba40b7980 0x7f0ba4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0babf59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba415bf80 con 0x7f0ba40ceb80 2023-07-09T21:42:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0babf59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba4160570 con 0x7f0ba40d0780 2023-07-09T21:42:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0babf59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba40cd070 con 0x7f0ba40b7980 2023-07-09T21:42:08.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ba40b7980 0x7f0ba4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ba40b7980 0x7f0ba4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53914/0 (socket says 172.21.15.37:53914) 2023-07-09T21:42:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1716291908 learned_addr learned my addr 172.21.15.37:0/1716291908 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:08.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba94f4640 1 --1- 172.21.15.37:0/1716291908 >> v1:172.21.15.37:6789/0 conn(0x7f0ba40ceb80 0x7f0ba40cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48486/0 (socket says 172.21.15.37:48486) 2023-07-09T21:42:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1716291908 >> v1:172.21.15.119:6789/0 conn(0x7f0ba40d0780 legacy=0x7f0ba40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1716291908 >> v1:172.21.15.37:6789/0 conn(0x7f0ba40ceb80 legacy=0x7f0ba40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba8cf3640 1 -- 172.21.15.37:0/1716291908 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134454822 0 0) 0x7f0b9c0014a0 con 0x7f0ba40d0780 2023-07-09T21:42:08.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1716291908 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba40d02f0 con 0x7f0ba40b7980 2023-07-09T21:42:08.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba9cf5640 1 --2- 172.21.15.37:0/1716291908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba4160030 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1904a0fc99eae04 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.492+0000 7f0ba8cf3640 1 -- 172.21.15.37:0/1716291908 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00ab600 con 0x7f0ba40b7980 2023-07-09T21:42:08.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba8cf3640 1 -- 172.21.15.37:0/1716291908 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00a7050 con 0x7f0ba40b7980 2023-07-09T21:42:08.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba8cf3640 1 -- 172.21.15.37:0/1716291908 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00ab980 con 0x7f0ba40b7980 2023-07-09T21:42:08.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- 172.21.15.37:0/1716291908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 msgr2=0x7f0ba4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 --2- 172.21.15.37:0/1716291908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba4160030 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0009870 tx=0x7f0ba001c3d0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- 172.21.15.37:0/1716291908 shutdown_connections 2023-07-09T21:42:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 --2- 172.21.15.37:0/1716291908 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba4160030 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- 172.21.15.37:0/1716291908 >> 172.21.15.37:0/1716291908 conn(0x7f0ba4073090 msgr2=0x7f0ba4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- 172.21.15.37:0/1716291908 shutdown_connections 2023-07-09T21:42:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- 172.21.15.37:0/1716291908 wait complete. 2023-07-09T21:42:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 Processor -- start 2023-07-09T21:42:08.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- start start 2023-07-09T21:42:08.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ba40ceb80 0x7f0ba40b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ba40d0780 0x7f0ba40c9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40ca060 con 0x7f0ba40b7980 2023-07-09T21:42:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b2c20 con 0x7f0ba40ceb80 2023-07-09T21:42:08.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0babf59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40b2f00 con 0x7f0ba40d0780 2023-07-09T21:42:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba9cf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba9cf5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53930/0 (socket says 172.21.15.37:53930) 2023-07-09T21:42:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1746784214 learned_addr learned my addr 172.21.15.37:0/1746784214 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:08.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0ba94f4640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ba40ceb80 0x7f0ba40b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.496+0000 7f0baa4f6640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ba40d0780 0x7f0ba40c9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ba40d0780 msgr2=0x7f0ba40c9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ba40d0780 0x7f0ba40c9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ba40ceb80 msgr2=0x7f0ba40b0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ba40ceb80 0x7f0ba40b0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 -- 172.21.15.37:0/1746784214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba00094d0 con 0x7f0ba40b7980 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0ba9cf5640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00ae040 tx=0x7f0ba001ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00aa970 con 0x7f0ba40b7980 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba00aaad0 con 0x7f0ba40b7980 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba00aae80 con 0x7f0ba40b7980 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40b31e0 con 0x7f0ba40b7980 2023-07-09T21:42:08.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba40b37a0 con 0x7f0ba40b7980 2023-07-09T21:42:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba40b3990 con 0x7f0ba40b7980 2023-07-09T21:42:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0ba00b2040 con 0x7f0ba40b7980 2023-07-09T21:42:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.500+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6836+0+0 (secure 0 0 0) 0x7f0ba011e460 con 0x7f0ba40b7980 2023-07-09T21:42:08.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.504+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ba00eb9e0 con 0x7f0ba40b7980 2023-07-09T21:42:08.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.656+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0ba404d7d0 con 0x7f0ba40b7980 2023-07-09T21:42:08.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.656+0000 7f0b9a7fc640 1 -- 172.21.15.37:0/1746784214 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ba00ef000 con 0x7f0ba40b7980 2023-07-09T21:42:08.659 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:42:08.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 msgr2=0x7f0ba40b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00ae040 tx=0x7f0ba001ac10 comp rx=0 tx=0).stop 2023-07-09T21:42:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 shutdown_connections 2023-07-09T21:42:08.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ba40d0780 0x7f0ba40c9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ba40ceb80 0x7f0ba40b0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 --2- 172.21.15.37:0/1746784214 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ba40b7980 0x7f0ba40b23f0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 >> 172.21.15.37:0/1746784214 conn(0x7f0ba4073090 msgr2=0x7f0ba415ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:08.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 shutdown_connections 2023-07-09T21:42:08.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.660+0000 7f0babf59640 1 -- 172.21.15.37:0/1746784214 wait complete. 2023-07-09T21:42:08.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:42:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.824+0000 7efeb29f4640 1 Processor -- start 2023-07-09T21:42:08.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.824+0000 7efeb29f4640 1 -- start start 2023-07-09T21:42:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb29f4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeac0b1420 0x7efeac0af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb29f4640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 0x7efeac0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb29f4640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeac0ce080 con 0x7efeac0cfb40 2023-07-09T21:42:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb29f4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0ce640 con 0x7efeac0b1420 2023-07-09T21:42:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb29f4640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeac0ce360 con 0x7efeac0b0ed0 2023-07-09T21:42:08.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeac0b1420 0x7efeac0af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efeac0b1420 0x7efeac0af530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53940/0 (socket says 172.21.15.37:53940) 2023-07-09T21:42:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 -- 172.21.15.37:0/2367099258 learned_addr learned my addr 172.21.15.37:0/2367099258 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb21f3640 1 --2- 172.21.15.37:0/2367099258 >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 0x7efeac0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 -- 172.21.15.37:0/2367099258 >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 msgr2=0x7efeac0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 --2- 172.21.15.37:0/2367099258 >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 0x7efeac0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 -- 172.21.15.37:0/2367099258 >> v1:172.21.15.119:6789/0 conn(0x7efeac0cfb40 legacy=0x7efeac0cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb11f1640 1 -- 172.21.15.37:0/2367099258 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0aed30 con 0x7efeac0b1420 2023-07-09T21:42:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.828+0000 7efeb21f3640 1 --2- 172.21.15.37:0/2367099258 >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 0x7efeac0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:08.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb11f1640 1 --2- 172.21.15.37:0/2367099258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac0af530 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7efeac08b4d0 tx=0x7efe9c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ceba7f19343e06 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb09f0640 1 -- 172.21.15.37:0/2367099258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0ab650 con 0x7efeac0b1420 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb09f0640 1 -- 172.21.15.37:0/2367099258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c0ab7b0 con 0x7efeac0b1420 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb09f0640 1 -- 172.21.15.37:0/2367099258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0abb40 con 0x7efeac0b1420 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- 172.21.15.37:0/2367099258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 msgr2=0x7efeac0af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 --2- 172.21.15.37:0/2367099258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac0af530 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7efeac08b4d0 tx=0x7efe9c01c490 comp rx=0 tx=0).stop 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- 172.21.15.37:0/2367099258 shutdown_connections 2023-07-09T21:42:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 --2- 172.21.15.37:0/2367099258 >> v2:172.21.15.119:3300/0 conn(0x7efeac0b0ed0 0x7efeac0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 --2- 172.21.15.37:0/2367099258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac0af530 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- 172.21.15.37:0/2367099258 >> 172.21.15.37:0/2367099258 conn(0x7efeac072d20 msgr2=0x7efeac0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- 172.21.15.37:0/2367099258 shutdown_connections 2023-07-09T21:42:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- 172.21.15.37:0/2367099258 wait complete. 2023-07-09T21:42:08.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 Processor -- start 2023-07-09T21:42:08.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 -- start start 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 0x7efeac0b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.832+0000 7efeb29f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 0x7efeac0b3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0b2d50 con 0x7efeac0b1420 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0b1ea0 con 0x7efeac0b0ed0 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeac0b20d0 con 0x7efeac0cfb40 2023-07-09T21:42:08.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53944/0 (socket says 172.21.15.37:53944) 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 -- 172.21.15.37:0/643216732 learned_addr learned my addr 172.21.15.37:0/643216732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb21f3640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 0x7efeac0b3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 -- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 msgr2=0x7efeac0b3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb19f2640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 0x7efeac0b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 0x7efeac0b3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 -- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 msgr2=0x7efeac0b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:08.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 0x7efeac0b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 -- 172.21.15.37:0/643216732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0094d0 con 0x7efeac0b1420 2023-07-09T21:42:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb21f3640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 0x7efeac0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb19f2640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 0x7efeac0b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:08.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb11f1640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01a0c0 tx=0x7efe9c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0b4800 con 0x7efeac0b1420 2023-07-09T21:42:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c0b4960 con 0x7efeac0b1420 2023-07-09T21:42:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9c0b4d10 con 0x7efeac0b1420 2023-07-09T21:42:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeac0b23b0 con 0x7efeac0b1420 2023-07-09T21:42:08.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeac0b2970 con 0x7efeac0b1420 2023-07-09T21:42:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeac0b2e90 con 0x7efeac0b1420 2023-07-09T21:42:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.836+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 56) v1 ==== 85369+0+0 (secure 0 0 0) 0x7efe9c0b3380 con 0x7efeac0b1420 2023-07-09T21:42:08.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.840+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6836+0+0 (secure 0 0 0) 0x7efe9c11e3f0 con 0x7efeac0b1420 2023-07-09T21:42:08.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.840+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efeac0b2e90 con 0x7efeac0b1420 2023-07-09T21:42:08.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.940+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7efe9c0eb3d0 con 0x7efeac0b1420 2023-07-09T21:42:08.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.940+0000 7efea27fc640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 0x7efe9006e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:08.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.940+0000 7efeb19f2640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 0x7efe9006e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:08.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:08.944+0000 7efeb19f2640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 0x7efe9006e4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efea800a830 tx=0x7efea8008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.000+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efeac0b2e90 con 0x7efeac0b1420 2023-07-09T21:42:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.000+0000 7efea27fc640 1 -- 172.21.15.37:0/643216732 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v132) v1 ==== 100+0+11 (secure 0 0 0) 0x7efeac0b2e90 con 0x7efeac0b1420 2023-07-09T21:42:09.003 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 msgr2=0x7efe9006e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 0x7efe9006e4c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efea800a830 tx=0x7efea8008040 comp rx=0 tx=0).stop 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 msgr2=0x7efeac152620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7efe9c01a0c0 tx=0x7efe9c01acd0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 shutdown_connections 2023-07-09T21:42:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7efe9006c0e0 0x7efe9006e4c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efeac0cfb40 0x7efeac0b3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efeac0b1420 0x7efeac152620 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 --2- 172.21.15.37:0/643216732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efeac0b0ed0 0x7efeac0b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 >> 172.21.15.37:0/643216732 conn(0x7efeac072d20 msgr2=0x7efeac159640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 shutdown_connections 2023-07-09T21:42:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.004+0000 7efeb29f4640 1 -- 172.21.15.37:0/643216732 wait complete. 2023-07-09T21:42:09.023 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.172+0000 7fe2fce6d640 1 Processor -- start 2023-07-09T21:42:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 -- start start 2023-07-09T21:42:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80b7ab0 0x7fe2f806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f80b4340 0x7fe2f80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f80b49f0 con 0x7fe2f80cef80 2023-07-09T21:42:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f80b7e80 con 0x7fe2f80b4340 2023-07-09T21:42:09.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2fce6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80cc8a0 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f80b4340 0x7fe2f80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2f80b4340 0x7fe2f80d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53958/0 (socket says 172.21.15.37:53958) 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 -- 172.21.15.37:0/491328119 learned_addr learned my addr 172.21.15.37:0/491328119 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f659c640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80b7ab0 0x7fe2f806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 -- 172.21.15.37:0/491328119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80b7ab0 msgr2=0x7fe2f806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80b7ab0 0x7fe2f806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 -- 172.21.15.37:0/491328119 >> v1:172.21.15.119:6789/0 conn(0x7fe2f80cef80 legacy=0x7fe2f80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.176+0000 7fe2f6d9d640 1 -- 172.21.15.37:0/491328119 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f80ccb80 con 0x7fe2f80b4340 2023-07-09T21:42:09.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2f6d9d640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b4340 0x7fe2f80d02a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009e50 tx=0x7fe2f001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22780caae52f8f70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2f559a640 1 -- 172.21.15.37:0/491328119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00a5820 con 0x7fe2f80b4340 2023-07-09T21:42:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2f559a640 1 -- 172.21.15.37:0/491328119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f00a5980 con 0x7fe2f80b4340 2023-07-09T21:42:09.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2f559a640 1 -- 172.21.15.37:0/491328119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f00a5d10 con 0x7fe2f80b4340 2023-07-09T21:42:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 -- 172.21.15.37:0/491328119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b4340 msgr2=0x7fe2f80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b4340 0x7fe2f80d02a0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009e50 tx=0x7fe2f001c9a0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 -- 172.21.15.37:0/491328119 shutdown_connections 2023-07-09T21:42:09.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b4340 0x7fe2f80d02a0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/491328119 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80b7ab0 0x7fe2f806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 -- 172.21.15.37:0/491328119 >> 172.21.15.37:0/491328119 conn(0x7fe2f8073090 msgr2=0x7fe2f8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 -- 172.21.15.37:0/491328119 shutdown_connections 2023-07-09T21:42:09.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.180+0000 7fe2fce6d640 1 -- 172.21.15.37:0/491328119 wait complete. 2023-07-09T21:42:09.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 Processor -- start 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- start start 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f80b4340 0x7fe2f80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80cef80 0x7fe2f814f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f81555c0 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f80b6380 con 0x7fe2f80b4340 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f8152330 con 0x7fe2f80cef80 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f6d9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80cef80 0x7fe2f814f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53968/0 (socket says 172.21.15.37:53968) 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 -- 172.21.15.37:0/3994376983 learned_addr learned my addr 172.21.15.37:0/3994376983 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f659c640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f80b4340 0x7fe2f80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 -- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80cef80 msgr2=0x7fe2f814f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80cef80 0x7fe2f814f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 -- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f80b4340 msgr2=0x7fe2f80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f80b4340 0x7fe2f80b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 -- 172.21.15.37:0/3994376983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009b30 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2f5d9b640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00b410 tx=0x7fe2ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec004020 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec004180 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec011630 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f81552e0 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f80c99e0 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.184+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f80c9540 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.188+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fe2ec011790 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.188+0000 7fe2e6ffd640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 0x7fe2d8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.188+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fe2ec083990 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.188+0000 7fe2f659c640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 0x7fe2d8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.188+0000 7fe2f659c640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 0x7fe2d8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80d1c20 tx=0x7fe2e8008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.192+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe2ec050df0 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2f80c9c00 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2e6ffd640 1 -- 172.21.15.37:0/3994376983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fe2ec054410 con 0x7fe2f80b7ab0 2023-07-09T21:42:09.385 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:09.385 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:42:09.385 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:42:09.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 msgr2=0x7fe2d8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 0x7fe2d8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe2f80d1c20 tx=0x7fe2e8008040 comp rx=0 tx=0).stop 2023-07-09T21:42:09.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 msgr2=0x7fe2f81588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00b410 tx=0x7fe2ec00b8d0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 shutdown_connections 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe2d80660d0 0x7fe2d8068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2f80cef80 0x7fe2f814f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2f80b7ab0 0x7fe2f81588f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 --2- 172.21.15.37:0/3994376983 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2f80b4340 0x7fe2f80b5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 >> 172.21.15.37:0/3994376983 conn(0x7fe2f8073090 msgr2=0x7fe2f80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 shutdown_connections 2023-07-09T21:42:09.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.384+0000 7fe2fce6d640 1 -- 172.21.15.37:0/3994376983 wait complete. 2023-07-09T21:42:09.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:09.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 Processor -- start 2023-07-09T21:42:09.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 -- start start 2023-07-09T21:42:09.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 0x7fb4b406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4b40cef80 0x7fb4b40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b40b49f0 con 0x7fb4b40b4170 2023-07-09T21:42:09.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b40b7e80 con 0x7fb4b40cef80 2023-07-09T21:42:09.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4ba340640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b40b4610 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4b40cef80 0x7fb4b40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4b88dd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb4b40b4170 0x7fb4b415f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48500/0 (socket says 172.21.15.37:48500) 2023-07-09T21:42:09.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4b88dd640 1 -- 172.21.15.37:0/425235723 learned_addr learned my addr 172.21.15.37:0/425235723 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:09.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb4b40cef80 0x7fb4b40b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53982/0 (socket says 172.21.15.37:53982) 2023-07-09T21:42:09.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.548+0000 7fb4b3fff640 1 --2- 172.21.15.37:0/425235723 >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 0x7fb4b406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b37fe640 1 -- 172.21.15.37:0/425235723 >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 msgr2=0x7fb4b406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b37fe640 1 --2- 172.21.15.37:0/425235723 >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 0x7fb4b406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b37fe640 1 -- 172.21.15.37:0/425235723 >> v1:172.21.15.37:6789/0 conn(0x7fb4b40b4170 legacy=0x7fb4b415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b37fe640 1 -- 172.21.15.37:0/425235723 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b40cc8a0 con 0x7fb4b40cef80 2023-07-09T21:42:09.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b3fff640 1 --2- 172.21.15.37:0/425235723 >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 0x7fb4b406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:09.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b37fe640 1 --2- 172.21.15.37:0/425235723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40cef80 0x7fb4b40b3c30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb4b406b360 tx=0x7fb4a801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7594151afa8b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b2ffd640 1 -- 172.21.15.37:0/425235723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80a7070 con 0x7fb4b40cef80 2023-07-09T21:42:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b2ffd640 1 -- 172.21.15.37:0/425235723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a80ab430 con 0x7fb4b40cef80 2023-07-09T21:42:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4b2ffd640 1 -- 172.21.15.37:0/425235723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80ab7c0 con 0x7fb4b40cef80 2023-07-09T21:42:09.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 -- 172.21.15.37:0/425235723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40cef80 msgr2=0x7fb4b40b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 --2- 172.21.15.37:0/425235723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40cef80 0x7fb4b40b3c30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb4b406b360 tx=0x7fb4a801c430 comp rx=0 tx=0).stop 2023-07-09T21:42:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 -- 172.21.15.37:0/425235723 shutdown_connections 2023-07-09T21:42:09.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 --2- 172.21.15.37:0/425235723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40cef80 0x7fb4b40b3c30 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 --2- 172.21.15.37:0/425235723 >> v2:172.21.15.119:3300/0 conn(0x7fb4b40b7ab0 0x7fb4b406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 -- 172.21.15.37:0/425235723 >> 172.21.15.37:0/425235723 conn(0x7fb4b4073090 msgr2=0x7fb4b4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 -- 172.21.15.37:0/425235723 shutdown_connections 2023-07-09T21:42:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.552+0000 7fb4ba340640 1 -- 172.21.15.37:0/425235723 wait complete. 2023-07-09T21:42:09.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 Processor -- start 2023-07-09T21:42:09.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 -- start start 2023-07-09T21:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b40b4170 0x7fb4b4154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b40cef80 0x7fb4b40cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4154600 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4153cd0 con 0x7fb4b40b4170 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b4153fb0 con 0x7fb4b40cef80 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53990/0 (socket says 172.21.15.37:53990) 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 -- 172.21.15.37:0/3716537390 learned_addr learned my addr 172.21.15.37:0/3716537390 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:09.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 -- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b40cef80 msgr2=0x7fb4b40cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b40cef80 0x7fb4b40cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 -- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b40b4170 msgr2=0x7fb4b4154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b40b4170 0x7fb4b4154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 -- 172.21.15.37:0/3716537390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a8009420 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b37fe640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8019040 tx=0x7fb4a80191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80bf450 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4a80bf5b0 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80bf920 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.556+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b4154290 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b40cc210 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b404d7d0 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb4a80b43f0 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4b0ff9640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 0x7fb4a0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fb4a811e190 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4b3fff640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 0x7fb4a0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.560+0000 7fb4b3fff640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 0x7fb4a0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006e90 tx=0x7fb4a4008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.564+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb4a80eb660 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4b406a830 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4b0ff9640 1 -- 172.21.15.37:0/3716537390 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+19533 (secure 0 0 0) 0x7fb4a80eec80 con 0x7fb4b40b7ab0 2023-07-09T21:42:09.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:09.721 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":132,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:08.922289+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":132,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/578953977":"2023-07-10T21:42:07.918608+0000","172.21.15.119:6832/578953977":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3675244468":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/849668989":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1245005382":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1620704315":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3375862298":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1367737776":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3524814105":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/618591754":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3057369556":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6833/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2604488903":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6832/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/4210238305":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2630218575":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/3890872655":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/1918439718":"2023-07-10T21:41:41.888477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 msgr2=0x7fb4a0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 0x7fb4a0068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb4a4006e90 tx=0x7fb4a4008040 comp rx=0 tx=0).stop 2023-07-09T21:42:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 msgr2=0x7fb4b4153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8019040 tx=0x7fb4a80191d0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 shutdown_connections 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb4a00660d0 0x7fb4a0068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb4b40cef80 0x7fb4b40cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb4b40b7ab0 0x7fb4b4153320 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 --2- 172.21.15.37:0/3716537390 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb4b40b4170 0x7fb4b4154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.720+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 >> 172.21.15.37:0/3716537390 conn(0x7fb4b4073090 msgr2=0x7fb4b40d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.724+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 shutdown_connections 2023-07-09T21:42:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.724+0000 7fb4ba340640 1 -- 172.21.15.37:0/3716537390 wait complete. 2023-07-09T21:42:09.742 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:42:09.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 Processor -- start 2023-07-09T21:42:09.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 -- start start 2023-07-09T21:42:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd1806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdd180b4340 0x7fdd180d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180b49f0 con 0x7fdd180cef80 2023-07-09T21:42:09.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180b7e80 con 0x7fdd180b4340 2023-07-09T21:42:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1e456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180cc8a0 con 0x7fdd180b7ab0 2023-07-09T21:42:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd177fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd180cef80 0x7fdd180b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48506/0 (socket says 172.21.15.37:48506) 2023-07-09T21:42:09.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd177fe640 1 -- 172.21.15.37:0/2944939342 learned_addr learned my addr 172.21.15.37:0/2944939342 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1c9f3640 1 --2- 172.21.15.37:0/2944939342 >> v2:172.21.15.119:3300/0 conn(0x7fdd180b4340 0x7fdd180d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378957865 0 0) 0x7fdd180b49f0 con 0x7fdd180cef80 2023-07-09T21:42:09.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd00003530 con 0x7fdd180cef80 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd1806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4285360145 0 0) 0x7fdd00003530 con 0x7fdd180cef80 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 msgr2=0x7fdd1806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd1806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 >> v2:172.21.15.119:3300/0 conn(0x7fdd180b4340 msgr2=0x7fdd180d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 --2- 172.21.15.37:0/2944939342 >> v2:172.21.15.119:3300/0 conn(0x7fdd180b4340 0x7fdd180d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180ccb80 con 0x7fdd180cef80 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fdd0c001680 con 0x7fdd180cef80 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 >> v1:172.21.15.37:6789/0 conn(0x7fdd180cef80 legacy=0x7fdd180b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd00003980 0x7fdd00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd000047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd00004d10 0x7fdd00005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180cc8a0 con 0x7fdd00003980 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0000b990 con 0x7fdd00004d10 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd0000bad0 con 0x7fdd180b7ab0 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd00003980 0x7fdd00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd1c9f3640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd00004d10 0x7fdd00005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd177fe640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd000047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 -- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 msgr2=0x7fdd000047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd000047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 -- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd00004d10 msgr2=0x7fdd00005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:09.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd00004d10 0x7fdd00005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd17fff640 1 -- 172.21.15.37:0/2944939342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00003530 con 0x7fdd00003980 2023-07-09T21:42:09.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.888+0000 7fdd177fe640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd180b7ab0 0x7fdd000047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:09.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd00003980 0x7fdd00003d90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009ae0 tx=0x7fdd0801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d8189d7b1209d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080a6510 con 0x7fdd00003980 2023-07-09T21:42:09.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd080a6670 con 0x7fdd00003980 2023-07-09T21:42:09.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd16ffd640 1 -- 172.21.15.37:0/2944939342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080a6a20 con 0x7fdd00003980 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 -- 172.21.15.37:0/2944939342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd00003980 msgr2=0x7fdd00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2944939342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd00003980 0x7fdd00003d90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fdd08009ae0 tx=0x7fdd0801c9c0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1c9f3640 1 -- 172.21.15.37:0/2944939342 reap_dead start 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 -- 172.21.15.37:0/2944939342 shutdown_connections 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 -- 172.21.15.37:0/2944939342 >> 172.21.15.37:0/2944939342 conn(0x7fdd18073090 msgr2=0x7fdd18069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 -- 172.21.15.37:0/2944939342 shutdown_connections 2023-07-09T21:42:09.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.892+0000 7fdd1e456640 1 -- 172.21.15.37:0/2944939342 wait complete. 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 Processor -- start 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- start start 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd00003980 0x7fdd180ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd181f7b70 0x7fdd181f7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180caf10 con 0x7fdd180c5e30 2023-07-09T21:42:09.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd181f8520 con 0x7fdd181f7b70 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180c7d10 con 0x7fdd00003980 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54012/0 (socket says 172.21.15.37:54012) 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 -- 172.21.15.37:0/2244293517 learned_addr learned my addr 172.21.15.37:0/2244293517 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd00003980 0x7fdd180ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1c9f3640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd181f7b70 0x7fdd181f7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 -- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd00003980 msgr2=0x7fdd180ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd00003980 0x7fdd180ca9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 -- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd181f7b70 msgr2=0x7fdd181f7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd181f7b70 0x7fdd181f7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 -- 172.21.15.37:0/2244293517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180c7fd0 con 0x7fdd180c5e30 2023-07-09T21:42:09.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd177fe640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e770 tx=0x7fdd0c00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00ee80 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c00c8d0 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c00cc40 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd180c82b0 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.896+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd180c8870 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180c8a30 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 57) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fdd0c01d460 con 0x7fdd180c5e30 2023-07-09T21:42:09.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd14ff9640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 0x7fdd04068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7fdd0c083bc0 con 0x7fdd180c5e30 2023-07-09T21:42:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 0x7fdd04068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.900+0000 7fdd17fff640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 0x7fdd04068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd080af000 tx=0x7fdd080046d0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:09.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:09.904+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd0c051020 con 0x7fdd180c5e30 2023-07-09T21:42:10.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.092+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd180d1fb0 con 0x7fdd180c5e30 2023-07-09T21:42:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd14ff9640 1 -- 172.21.15.37:0/2244293517 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fdd0c054640 con 0x7fdd180c5e30 2023-07-09T21:42:10.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:10.095 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:42:10.096 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:42:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 msgr2=0x7fdd04068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 0x7fdd04068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdd080af000 tx=0x7fdd080046d0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 msgr2=0x7fdd180c77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c00e770 tx=0x7fdd0c00ec30 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 shutdown_connections 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd040660d0 0x7fdd04068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd181f7b70 0x7fdd181f7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd180c5e30 0x7fdd180c77d0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 --2- 172.21.15.37:0/2244293517 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd00003980 0x7fdd180ca9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 >> 172.21.15.37:0/2244293517 conn(0x7fdd18073090 msgr2=0x7fdd1815e730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 shutdown_connections 2023-07-09T21:42:10.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.096+0000 7fdd1e456640 1 -- 172.21.15.37:0/2244293517 wait complete. 2023-07-09T21:42:10.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 Processor -- start 2023-07-09T21:42:10.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 -- start start 2023-07-09T21:42:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4a700b4340 0x7f4a7006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700b49f0 con 0x7f4a700b7ab0 2023-07-09T21:42:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a700cc8a0 con 0x7f4a700cef80 2023-07-09T21:42:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a785e2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a700b7e80 con 0x7f4a700b4340 2023-07-09T21:42:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7637e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a700b7ab0 0x7f4a700b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48518/0 (socket says 172.21.15.37:48518) 2023-07-09T21:42:10.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7637e640 1 -- 172.21.15.37:0/4280316731 learned_addr learned my addr 172.21.15.37:0/4280316731 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a75b7d640 1 --2- 172.21.15.37:0/4280316731 >> v2:172.21.15.119:3300/0 conn(0x7f4a700b4340 0x7f4a7006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570564429 0 0) 0x7f4a700b49f0 con 0x7f4a700b7ab0 2023-07-09T21:42:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a5c003530 con 0x7f4a700b7ab0 2023-07-09T21:42:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 370271238 0 0) 0x7f4a700cc8a0 con 0x7f4a700cef80 2023-07-09T21:42:10.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a700b49f0 con 0x7f4a700cef80 2023-07-09T21:42:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a75b7d640 1 -- 172.21.15.37:0/4280316731 >> v1:172.21.15.119:6789/0 conn(0x7f4a700cef80 legacy=0x7f4a700d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a75b7d640 1 -- 172.21.15.37:0/4280316731 >> v1:172.21.15.37:6789/0 conn(0x7f4a700b7ab0 legacy=0x7f4a700b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.264+0000 7f4a75b7d640 1 -- 172.21.15.37:0/4280316731 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a700ccb80 con 0x7f4a700b4340 2023-07-09T21:42:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a75b7d640 1 --2- 172.21.15.37:0/4280316731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a7006aa50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a600097c0 tx=0x7f4a6001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5888311bc880e781 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600ab650 con 0x7f4a700b4340 2023-07-09T21:42:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a600ab7b0 con 0x7f4a700b4340 2023-07-09T21:42:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a7537c640 1 -- 172.21.15.37:0/4280316731 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a600abb40 con 0x7f4a700b4340 2023-07-09T21:42:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 -- 172.21.15.37:0/4280316731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 msgr2=0x7f4a7006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 --2- 172.21.15.37:0/4280316731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a7006aa50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4a600097c0 tx=0x7f4a6001c450 comp rx=0 tx=0).stop 2023-07-09T21:42:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 -- 172.21.15.37:0/4280316731 shutdown_connections 2023-07-09T21:42:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 --2- 172.21.15.37:0/4280316731 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a7006aa50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 -- 172.21.15.37:0/4280316731 >> 172.21.15.37:0/4280316731 conn(0x7f4a70073090 msgr2=0x7f4a70069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.268+0000 7f4a785e2640 1 -- 172.21.15.37:0/4280316731 shutdown_connections 2023-07-09T21:42:10.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 -- 172.21.15.37:0/4280316731 wait complete. 2023-07-09T21:42:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 Processor -- start 2023-07-09T21:42:10.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 -- start start 2023-07-09T21:42:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a700b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a700b7ab0 0x7f4a700c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a70150120 con 0x7f4a700cef80 2023-07-09T21:42:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b63c0 con 0x7f4a700b4340 2023-07-09T21:42:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a785e2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a700b6660 con 0x7f4a700b7ab0 2023-07-09T21:42:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54022/0 (socket says 172.21.15.37:54022) 2023-07-09T21:42:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 -- 172.21.15.37:0/1195681330 learned_addr learned my addr 172.21.15.37:0/1195681330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a7637e640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a700b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a75b7d640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a700b7ab0 0x7f4a700c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 -- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a700b7ab0 msgr2=0x7f4a700c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a700b7ab0 0x7f4a700c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 -- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 msgr2=0x7f4a700b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a700b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 -- 172.21.15.37:0/1195681330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a60009420 con 0x7f4a700cef80 2023-07-09T21:42:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.272+0000 7f4a76b7f640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c6c0 tx=0x7f4a6800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68003b80 con 0x7f4a700cef80 2023-07-09T21:42:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68003ce0 con 0x7f4a700cef80 2023-07-09T21:42:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7014fb60 con 0x7f4a700cef80 2023-07-09T21:42:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680052f0 con 0x7f4a700cef80 2023-07-09T21:42:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a70156400 con 0x7f4a700cef80 2023-07-09T21:42:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a70154a40 con 0x7f4a700cef80 2023-07-09T21:42:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4a68005450 con 0x7f4a700cef80 2023-07-09T21:42:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 0x7f4a54068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f4a68083ef0 con 0x7f4a700cef80 2023-07-09T21:42:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.276+0000 7f4a7637e640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 0x7f4a54068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.280+0000 7f4a7637e640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 0x7f4a54068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000f70 tx=0x7f4a6c007d40 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.280+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a70154a40 con 0x7f4a700cef80 2023-07-09T21:42:10.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.468+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a70154a40 con 0x7f4a700cef80 2023-07-09T21:42:10.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.468+0000 7f4a66ffd640 1 -- 172.21.15.37:0/1195681330 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f4a70154a40 con 0x7f4a700cef80 2023-07-09T21:42:10.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:10.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:41:23.780059+0000","modified":"2023-07-09T21:41:27.419291+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8448":{"gid":8448,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/738892334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":738892334},{"type":"v1","addr":"172.21.15.37:6835","nonce":738892334}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-07-09T21:42:10.471 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 55 2023-07-09T21:42:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 msgr2=0x7f4a54068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 0x7f4a54068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c000f70 tx=0x7f4a6c007d40 comp rx=0 tx=0).stop 2023-07-09T21:42:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 msgr2=0x7f4a700c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c6c0 tx=0x7f4a6800cb80 comp rx=0 tx=0).stop 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 shutdown_connections 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f4a540663a0 0x7f4a54068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a700cef80 0x7f4a700c6b30 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4a700b7ab0 0x7f4a700c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 --2- 172.21.15.37:0/1195681330 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4a700b4340 0x7f4a700b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 >> 172.21.15.37:0/1195681330 conn(0x7f4a70073090 msgr2=0x7f4a700b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 shutdown_connections 2023-07-09T21:42:10.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.472+0000 7f4a785e2640 1 -- 172.21.15.37:0/1195681330 wait complete. 2023-07-09T21:42:10.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:10.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.632+0000 7f3b0be9c640 1 Processor -- start 2023-07-09T21:42:10.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.632+0000 7f3b0be9c640 1 -- start start 2023-07-09T21:42:10.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.632+0000 7f3b0be9c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3b040cc320 0x7f3b0406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0be9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3b0406f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0be9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040cbe90 con 0x7f3b040af830 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0be9c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0406d370 con 0x7f3b040cc320 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0be9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04159bb0 con 0x7f3b040cc770 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09c38640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b040af830 0x7f3b040afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48520/0 (socket says 172.21.15.37:48520) 2023-07-09T21:42:10.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09c38640 1 -- 172.21.15.37:0/4164054538 learned_addr learned my addr 172.21.15.37:0/4164054538 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:10.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> v2:172.21.15.119:3300/0 conn(0x7f3b040cc320 0x7f3b0406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0a439640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3b0406f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685828940 0 0) 0x7f3b040cbe90 con 0x7f3b040af830 2023-07-09T21:42:10.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af0003530 con 0x7f3b040af830 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2237579100 0 0) 0x7f3af0003530 con 0x7f3b040af830 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 msgr2=0x7f3b0406f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3b0406f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 >> v2:172.21.15.119:3300/0 conn(0x7f3b040cc320 msgr2=0x7f3b0406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 --2- 172.21.15.37:0/4164054538 >> v2:172.21.15.119:3300/0 conn(0x7f3b040cc320 0x7f3b0406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040b38b0 con 0x7f3b040af830 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3b00001680 con 0x7f3b040af830 2023-07-09T21:42:10.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> v2:172.21.15.119:3300/0 conn(0x7f3b040cc320 0x7f3b0406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 >> v1:172.21.15.37:6789/0 conn(0x7f3b040af830 legacy=0x7f3b040afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af0003980 0x7f3af0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3af00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3af0004d10 0x7f3af0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0406d370 con 0x7f3af0004d10 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04159bb0 con 0x7f3af0003980 2023-07-09T21:42:10.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af000b990 con 0x7f3b040cc770 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b0a439640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3af0004d10 0x7f3af0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09c38640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af0003980 0x7f3af0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3af00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 -- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af0003980 msgr2=0x7f3af0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3af0003980 0x7f3af0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 -- 172.21.15.37:0/4164054538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3af0004d10 msgr2=0x7f3af0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:10.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3af0004d10 0x7f3af0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.636+0000 7f3b09437640 1 -- 172.21.15.37:0/4164054538 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0003530 con 0x7f3b040cc770 2023-07-09T21:42:10.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b09437640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3af00047d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009cb0 tx=0x7f3af401cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=774a67d38ea5003e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a5930 con 0x7f3b040cc770 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af40a5a90 con 0x7f3b040cc770 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b08c36640 1 -- 172.21.15.37:0/4164054538 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40a5e40 con 0x7f3b040cc770 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 msgr2=0x7f3af00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/4164054538 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b040cc770 0x7f3af00047d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009cb0 tx=0x7f3af401cc70 comp rx=0 tx=0).stop 2023-07-09T21:42:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0a439640 1 -- 172.21.15.37:0/4164054538 reap_dead start 2023-07-09T21:42:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- 172.21.15.37:0/4164054538 shutdown_connections 2023-07-09T21:42:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- 172.21.15.37:0/4164054538 >> 172.21.15.37:0/4164054538 conn(0x7f3b040ca830 msgr2=0x7f3b040cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- 172.21.15.37:0/4164054538 shutdown_connections 2023-07-09T21:42:10.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- 172.21.15.37:0/4164054538 wait complete. 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 Processor -- start 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.640+0000 7f3b0be9c640 1 -- start start 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b04150d90 0x7f3b040c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 0x7f3b04155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c53c0 con 0x7f3b040cc770 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b04155330 con 0x7f3b04150d90 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b040c55b0 con 0x7f3b041504d0 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54050/0 (socket says 172.21.15.37:54050) 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 -- 172.21.15.37:0/1194783161 learned_addr learned my addr 172.21.15.37:0/1194783161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09437640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b04150d90 0x7f3b040c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0a439640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 0x7f3b04155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 -- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 msgr2=0x7f3b04155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 0x7f3b04155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 -- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b04150d90 msgr2=0x7f3b040c1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b04150d90 0x7f3b040c1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 -- 172.21.15.37:0/1194783161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b040c5890 con 0x7f3b040cc770 2023-07-09T21:42:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0a439640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 0x7f3b04155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b09c38640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3b00007340 tx=0x7f3b00007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000f960 con 0x7f3b040cc770 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0000fac0 con 0x7f3b040cc770 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0000fe30 con 0x7f3b040cc770 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b040c5b70 con 0x7f3b040cc770 2023-07-09T21:42:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b040c6130 con 0x7f3b040cc770 2023-07-09T21:42:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.644+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0404d7d0 con 0x7f3b040cc770 2023-07-09T21:42:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.648+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b0001d360 con 0x7f3b040cc770 2023-07-09T21:42:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.648+0000 7f3afa7fc640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 0x7f3ae8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.648+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f3b00083ac0 con 0x7f3b040cc770 2023-07-09T21:42:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.648+0000 7f3b09437640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 0x7f3ae8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.648+0000 7f3b09437640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 0x7f3ae8068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3af40af000 tx=0x7f3af40046d0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.652+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b00050ae0 con 0x7f3b040cc770 2023-07-09T21:42:10.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.804+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b040cd820 con 0x7f3b040cc770 2023-07-09T21:42:10.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.804+0000 7f3afa7fc640 1 -- 172.21.15.37:0/1194783161 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) v1 ==== 74+0+19533 (secure 0 0 0) 0x7f3b0001a090 con 0x7f3b040cc770 2023-07-09T21:42:10.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:10.807 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":132,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:08.922289+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:41:21.894951+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-07-09T21:41:22.783509+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"132","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":132,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/578953977":"2023-07-10T21:42:07.918608+0000","172.21.15.119:6832/578953977":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3675244468":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/849668989":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1245005382":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1620704315":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3375862298":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/1367737776":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3524814105":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/618591754":"2023-07-10T21:42:07.918608+0000","172.21.15.119:0/3057369556":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6833/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2604488903":"2023-07-10T21:41:41.888477+0000","172.21.15.119:6832/3013141456":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/4210238305":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/2630218575":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/3890872655":"2023-07-10T21:41:41.888477+0000","172.21.15.119:0/1918439718":"2023-07-10T21:41:41.888477+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:10.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 msgr2=0x7f3ae8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 0x7f3ae8068880 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3af40af000 tx=0x7f3af40046d0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 msgr2=0x7f3b040c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f3b00007340 tx=0x7f3b00007800 comp rx=0 tx=0).stop 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 shutdown_connections 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f3ae80663d0 0x7f3ae8068880 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3b041504d0 0x7f3b04155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3b04150d90 0x7f3b040c1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 --2- 172.21.15.37:0/1194783161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b040cc770 0x7f3b040c4e80 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 >> 172.21.15.37:0/1194783161 conn(0x7f3b040ca830 msgr2=0x7f3b04152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 shutdown_connections 2023-07-09T21:42:10.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.808+0000 7f3b0be9c640 1 -- 172.21.15.37:0/1194783161 wait complete. 2023-07-09T21:42:10.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:42:10.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.972+0000 7f527e940640 1 Processor -- start 2023-07-09T21:42:10.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.972+0000 7f527e940640 1 -- start start 2023-07-09T21:42:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527e940640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 0x7f52780cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527e940640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f52780b47a0 0x7f52780b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527e940640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52780cef80 con 0x7f52780b4140 2023-07-09T21:42:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527e940640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52780b45b0 con 0x7f52780b47a0 2023-07-09T21:42:10.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527e940640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52780cf260 con 0x7f52780b7a60 2023-07-09T21:42:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527cedd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f52780b4140 0x7f527815f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48522/0 (socket says 172.21.15.37:48522) 2023-07-09T21:42:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f527cedd640 1 -- 172.21.15.37:0/4107399665 learned_addr learned my addr 172.21.15.37:0/4107399665 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:10.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f52777fe640 1 --2- 172.21.15.37:0/4107399665 >> v2:172.21.15.119:3300/0 conn(0x7f52780b47a0 0x7f52780b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f5277fff640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 0x7f52780cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f5276ffd640 1 -- 172.21.15.37:0/4107399665 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700975830 0 0) 0x7f52780cef80 con 0x7f52780b4140 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f5276ffd640 1 -- 172.21.15.37:0/4107399665 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5260003530 con 0x7f52780b4140 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f52777fe640 1 -- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 msgr2=0x7f52780cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f52777fe640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 0x7f52780cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f52777fe640 1 -- 172.21.15.37:0/4107399665 >> v1:172.21.15.37:6789/0 conn(0x7f52780b4140 legacy=0x7f527815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f52777fe640 1 -- 172.21.15.37:0/4107399665 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52780cf540 con 0x7f52780b47a0 2023-07-09T21:42:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.976+0000 7f5277fff640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 0x7f52780cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:10.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f52777fe640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f52780b3c00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f526c0097c0 tx=0x7f526c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d067776630051bbe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f5276ffd640 1 -- 172.21.15.37:0/4107399665 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ab600 con 0x7f52780b47a0 2023-07-09T21:42:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f5276ffd640 1 -- 172.21.15.37:0/4107399665 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f526c0a7050 con 0x7f52780b47a0 2023-07-09T21:42:10.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f5276ffd640 1 -- 172.21.15.37:0/4107399665 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ab960 con 0x7f52780b47a0 2023-07-09T21:42:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 -- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 msgr2=0x7f52780b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f52780b3c00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f526c0097c0 tx=0x7f526c01c480 comp rx=0 tx=0).stop 2023-07-09T21:42:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 -- 172.21.15.37:0/4107399665 shutdown_connections 2023-07-09T21:42:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f52780b3c00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 --2- 172.21.15.37:0/4107399665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b7a60 0x7f52780cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 -- 172.21.15.37:0/4107399665 >> 172.21.15.37:0/4107399665 conn(0x7f5278073050 msgr2=0x7f5278069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:10.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 -- 172.21.15.37:0/4107399665 shutdown_connections 2023-07-09T21:42:10.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 -- 172.21.15.37:0/4107399665 wait complete. 2023-07-09T21:42:10.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.980+0000 7f527e940640 1 Processor -- start 2023-07-09T21:42:10.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- start start 2023-07-09T21:42:10.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b4140 0x7f5278151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f5278152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5278151bb0 con 0x7f52780b7a60 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527815c6f0 con 0x7f52780b47a0 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527815c130 con 0x7f52780b4140 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54052/0 (socket says 172.21.15.37:54052) 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 -- 172.21.15.37:0/4271947512 learned_addr learned my addr 172.21.15.37:0/4271947512 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 -- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b4140 msgr2=0x7f5278151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b4140 0x7f5278151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 -- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 msgr2=0x7f5278152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f5278152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 -- 172.21.15.37:0/4271947512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5268009420 con 0x7f52780b7a60 2023-07-09T21:42:10.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527cedd640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f527000cad0 tx=0x7f527000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527000ac30 con 0x7f52780b7a60 2023-07-09T21:42:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527000ad90 con 0x7f52780b7a60 2023-07-09T21:42:10.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270012620 con 0x7f52780b7a60 2023-07-09T21:42:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526c009420 con 0x7f52780b7a60 2023-07-09T21:42:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52780c93d0 con 0x7f52780b7a60 2023-07-09T21:42:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.984+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52780cdaa0 con 0x7f52780b7a60 2023-07-09T21:42:10.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.988+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5270007070 con 0x7f52780b7a60 2023-07-09T21:42:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.988+0000 7f5274ff9640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 0x7f5264068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.988+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6892+0+0 (secure 0 0 0) 0x7f5270084190 con 0x7f52780b7a60 2023-07-09T21:42:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.988+0000 7f5277fff640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 0x7f5264068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:10.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.988+0000 7f5277fff640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 0x7f5264068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5268006e90 tx=0x7f5268006de0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:10.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:10.992+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f52700511b0 con 0x7f52780b7a60 2023-07-09T21:42:11.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.180+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f52780c95c0 con 0x7f52780b7a60 2023-07-09T21:42:11.181 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:42:11.180+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:42:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f5274ff9640 1 -- 172.21.15.37:0/4271947512 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7f52700547d0 con 0x7f52780b7a60 2023-07-09T21:42:11.187 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:42:11.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 msgr2=0x7f5264068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 0x7f5264068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5268006e90 tx=0x7f5268006de0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 msgr2=0x7f52780b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f527000cad0 tx=0x7f527000cf90 comp rx=0 tx=0).stop 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 shutdown_connections 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f52640663d0 0x7f5264068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52780b7a60 0x7f52780b6080 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f52780b47a0 0x7f5278152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 --2- 172.21.15.37:0/4271947512 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f52780b4140 0x7f5278151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 >> 172.21.15.37:0/4271947512 conn(0x7f5278073050 msgr2=0x7f527815f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 shutdown_connections 2023-07-09T21:42:11.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.188+0000 7f527e940640 1 -- 172.21.15.37:0/4271947512 wait complete. 2023-07-09T21:42:11.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:42:11.251 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:42:11.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 Processor -- start 2023-07-09T21:42:11.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 -- start start 2023-07-09T21:42:11.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa1a80b7980 0x7fa1a8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1a80ceb80 0x7fa1a80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1a815bf80 con 0x7fa1a80b3c20 2023-07-09T21:42:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80cd070 con 0x7fa1a80ceb80 2023-07-09T21:42:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1add74640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1a80cfd70 con 0x7fa1a80b7980 2023-07-09T21:42:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1a80ceb80 0x7fa1a80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa1a80ceb80 0x7fa1a80cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54066/0 (socket says 172.21.15.37:54066) 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 -- 172.21.15.37:0/2888528374 learned_addr learned my addr 172.21.15.37:0/2888528374 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a77fe640 1 --2- 172.21.15.37:0/2888528374 >> v2:172.21.15.119:3300/0 conn(0x7fa1a80b7980 0x7fa1a8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 -- 172.21.15.37:0/2888528374 >> v2:172.21.15.119:3300/0 conn(0x7fa1a80b7980 msgr2=0x7fa1a8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 --2- 172.21.15.37:0/2888528374 >> v2:172.21.15.119:3300/0 conn(0x7fa1a80b7980 0x7fa1a8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 -- 172.21.15.37:0/2888528374 >> v1:172.21.15.119:6789/0 conn(0x7fa1a80b3c20 legacy=0x7fa1a80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.360+0000 7fa1a6ffd640 1 -- 172.21.15.37:0/2888528374 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1a8160570 con 0x7fa1a80ceb80 2023-07-09T21:42:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1a6ffd640 1 --2- 172.21.15.37:0/2888528374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a80cefc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8069aa0 tx=0x7fa19c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d52df38b22ebf256 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1a67fc640 1 -- 172.21.15.37:0/2888528374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0ab600 con 0x7fa1a80ceb80 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1a67fc640 1 -- 172.21.15.37:0/2888528374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19c0a7050 con 0x7fa1a80ceb80 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1a67fc640 1 -- 172.21.15.37:0/2888528374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa19c0ab980 con 0x7fa1a80ceb80 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 -- 172.21.15.37:0/2888528374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 msgr2=0x7fa1a80cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 --2- 172.21.15.37:0/2888528374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a80cefc0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8069aa0 tx=0x7fa19c01c500 comp rx=0 tx=0).stop 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 -- 172.21.15.37:0/2888528374 shutdown_connections 2023-07-09T21:42:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 --2- 172.21.15.37:0/2888528374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a80cefc0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 --2- 172.21.15.37:0/2888528374 >> v2:172.21.15.119:3300/0 conn(0x7fa1a80b7980 0x7fa1a8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 -- 172.21.15.37:0/2888528374 >> 172.21.15.37:0/2888528374 conn(0x7fa1a8073090 msgr2=0x7fa1a8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 -- 172.21.15.37:0/2888528374 shutdown_connections 2023-07-09T21:42:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.364+0000 7fa1add74640 1 -- 172.21.15.37:0/2888528374 wait complete. 2023-07-09T21:42:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 Processor -- start 2023-07-09T21:42:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- start start 2023-07-09T21:42:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b3c20 0x7fa1a8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80b7980 0x7fa1a8152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c82b0 con 0x7fa1a80ceb80 2023-07-09T21:42:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a815eca0 con 0x7fa1a80b7980 2023-07-09T21:42:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1a80c8550 con 0x7fa1a80b3c20 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b3c20 0x7fa1a8154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54072/0 (socket says 172.21.15.37:54072) 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 -- 172.21.15.37:0/3090120462 learned_addr learned my addr 172.21.15.37:0/3090120462 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a6ffd640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80b7980 0x7fa1a8152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 -- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b3c20 msgr2=0x7fa1a8154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b3c20 0x7fa1a8154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 -- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80b7980 msgr2=0x7fa1a8152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80b7980 0x7fa1a8152d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 -- 172.21.15.37:0/3090120462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0094d0 con 0x7fa1a80ceb80 2023-07-09T21:42:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1a7fff640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c770 tx=0x7fa1a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a0003b80 con 0x7fa1a80ceb80 2023-07-09T21:42:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a0003ce0 con 0x7fa1a80ceb80 2023-07-09T21:42:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1a80c8830 con 0x7fa1a80ceb80 2023-07-09T21:42:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000aa90 con 0x7fa1a80ceb80 2023-07-09T21:42:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.368+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1a8154740 con 0x7fa1a80ceb80 2023-07-09T21:42:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1a80c8a20 con 0x7fa1a80ceb80 2023-07-09T21:42:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa1a000abf0 con 0x7fa1a80ceb80 2023-07-09T21:42:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa18ffff640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6950+0+0 (secure 0 0 0) 0x7fa1a0083e40 con 0x7fa1a80ceb80 2023-07-09T21:42:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa1a77fe640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.372+0000 7fa1a77fe640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 0x7fa194068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa198007a60 tx=0x7fa198008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.376+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa1a0050e40 con 0x7fa1a80ceb80 2023-07-09T21:42:11.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:11.564+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa1a815bf60 con 0x7fa1a80ceb80 2023-07-09T21:42:12.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa18ffff640 1 -- 172.21.15.37:0/3090120462 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa1a0054460 con 0x7fa1a80ceb80 2023-07-09T21:42:12.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 msgr2=0x7fa194068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 0x7fa194068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa198007a60 tx=0x7fa198008040 comp rx=0 tx=0).stop 2023-07-09T21:42:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 msgr2=0x7fa1a81f80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000c770 tx=0x7fa1a000cc30 comp rx=0 tx=0).stop 2023-07-09T21:42:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 shutdown_connections 2023-07-09T21:42:12.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa1940663a0 0x7fa194068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa1a80ceb80 0x7fa1a81f80e0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa1a80b7980 0x7fa1a8152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 --2- 172.21.15.37:0/3090120462 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa1a80b3c20 0x7fa1a8154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.240+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 >> 172.21.15.37:0/3090120462 conn(0x7fa1a8073090 msgr2=0x7fa1a80b3450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:12.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.244+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 shutdown_connections 2023-07-09T21:42:12.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.244+0000 7fa1add74640 1 -- 172.21.15.37:0/3090120462 wait complete. 2023-07-09T21:42:12.265 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:42:12.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 Processor -- start 2023-07-09T21:42:12.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 -- start start 2023-07-09T21:42:12.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0ac160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac15bf80 con 0x7ff0ac0b7980 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac160570 con 0x7ff0ac0d0780 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0b27d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0cd070 con 0x7ff0ac0cf290 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0abfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff0ac0b7980 0x7ff0ac0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48536/0 (socket says 172.21.15.37:48536) 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.456+0000 7ff0abfff640 1 -- 172.21.15.37:0/1846687188 learned_addr learned my addr 172.21.15.37:0/1846687188 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 428030497 0 0) 0x7ff09c001120 con 0x7ff0ac0b7980 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff094003530 con 0x7ff0ac0b7980 2023-07-09T21:42:12.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0ab7fe640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0ac160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 731247041 0 0) 0x7ff094003530 con 0x7ff0ac0b7980 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 msgr2=0x7ff0ac160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0ac160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 >> v1:172.21.15.119:6789/0 conn(0x7ff0ac0d0780 legacy=0x7ff0ac0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0d02f0 con 0x7ff0ac0b7980 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ff09c001810 con 0x7ff0ac0b7980 2023-07-09T21:42:12.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 >> v1:172.21.15.37:6789/0 conn(0x7ff0ac0b7980 legacy=0x7ff0ac0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0940039b0 0x7ff094003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff094005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0cd070 con 0x7ff094004d10 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09400ba40 con 0x7ff0940039b0 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09400bc00 con 0x7ff0ac0cf290 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff094005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0abfff640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0940039b0 0x7ff094003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0ab7fe640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 -- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 msgr2=0x7ff0940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cf290 0x7ff0940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 -- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0940039b0 msgr2=0x7ff094003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0940039b0 0x7ff094003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.460+0000 7ff0b0d72640 1 -- 172.21.15.37:0/1846687188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff094003530 con 0x7ff094004d10 2023-07-09T21:42:12.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b0d72640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff094005180 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001cd0 tx=0x7ff0a401c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a575837af642a977 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4003b80 con 0x7ff094004d10 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4003ce0 con 0x7ff094004d10 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0aaffd640 1 -- 172.21.15.37:0/1846687188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4005310 con 0x7ff094004d10 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- 172.21.15.37:0/1846687188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 msgr2=0x7ff094005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/1846687188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff094005180 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4001cd0 tx=0x7ff0a401c5c0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b0d72640 1 -- 172.21.15.37:0/1846687188 reap_dead start 2023-07-09T21:42:12.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- 172.21.15.37:0/1846687188 shutdown_connections 2023-07-09T21:42:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- 172.21.15.37:0/1846687188 >> 172.21.15.37:0/1846687188 conn(0x7ff0ac073090 msgr2=0x7ff0ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- 172.21.15.37:0/1846687188 shutdown_connections 2023-07-09T21:42:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- 172.21.15.37:0/1846687188 wait complete. 2023-07-09T21:42:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 Processor -- start 2023-07-09T21:42:12.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.464+0000 7ff0b27d5640 1 -- start start 2023-07-09T21:42:12.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cc050 0x7ff0ac14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac1491a0 0x7ff0ac0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0b0a50 con 0x7ff094004d10 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0c6d20 con 0x7ff0ac1491a0 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0c7860 con 0x7ff0ac0cc050 2023-07-09T21:42:12.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54090/0 (socket says 172.21.15.37:54090) 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 -- 172.21.15.37:0/2466487979 learned_addr learned my addr 172.21.15.37:0/2466487979 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0ab7fe640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cc050 0x7ff0ac14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b0d72640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac1491a0 0x7ff0ac0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 -- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cc050 msgr2=0x7ff0ac14b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cc050 0x7ff0ac14b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 -- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac1491a0 msgr2=0x7ff0ac0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac1491a0 0x7ff0ac0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 -- 172.21.15.37:0/2466487979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac148ee0 con 0x7ff094004d10 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0abfff640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ff09c001280 tx=0x7ff09c0074b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c007700 con 0x7ff094004d10 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09c00f990 con 0x7ff094004d10 2023-07-09T21:42:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff09c00fd00 con 0x7ff094004d10 2023-07-09T21:42:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac0c6f30 con 0x7ff094004d10 2023-07-09T21:42:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac0c74f0 con 0x7ff094004d10 2023-07-09T21:42:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac04d7d0 con 0x7ff094004d10 2023-07-09T21:42:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.468+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff09c01d460 con 0x7ff094004d10 2023-07-09T21:42:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.472+0000 7ff0a8ff9640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 0x7ff098068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.472+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 6950+0+0 (secure 0 0 0) 0x7ff09c084160 con 0x7ff094004d10 2023-07-09T21:42:12.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.472+0000 7ff0ab7fe640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 0x7ff098068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:12.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.472+0000 7ff0ab7fe640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 0x7ff098068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac15f030 tx=0x7ff0a0009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:12.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.476+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff09c0510b0 con 0x7ff094004d10 2023-07-09T21:42:12.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:12.628+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff0ac15bf80 con 0x7ff094004d10 2023-07-09T21:42:13.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.248+0000 7ff0a8ff9640 1 -- 172.21.15.37:0/2466487979 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v134) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff0ac15bf80 con 0x7ff094004d10 2023-07-09T21:42:13.249 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:42:13.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 msgr2=0x7ff098068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 0x7ff098068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac15f030 tx=0x7ff0a0009190 comp rx=0 tx=0).stop 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 msgr2=0x7ff0ac0b0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ff09c001280 tx=0x7ff09c0074b0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 shutdown_connections 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0980663a0 0x7ff098068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0ac1491a0 0x7ff0ac0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0ac0cc050 0x7ff0ac14b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 --2- 172.21.15.37:0/2466487979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff094004d10 0x7ff0ac0b0510 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 >> 172.21.15.37:0/2466487979 conn(0x7ff0ac073090 msgr2=0x7ff0ac0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 shutdown_connections 2023-07-09T21:42:13.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.252+0000 7ff0b27d5640 1 -- 172.21.15.37:0/2466487979 wait complete. 2023-07-09T21:42:13.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:42:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 Processor -- start 2023-07-09T21:42:13.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 -- start start 2023-07-09T21:42:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea000c3e10 0x7fea000c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fea0015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea000c9090 con 0x7fea001585b0 2023-07-09T21:42:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea000cbf40 con 0x7fea000c3e10 2023-07-09T21:42:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea068d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c47d0 con 0x7fea0015c200 2023-07-09T21:42:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9fffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fea001585b0 0x7fea0006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48546/0 (socket says 172.21.15.37:48546) 2023-07-09T21:42:13.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9fffff640 1 -- 172.21.15.37:0/2474604358 learned_addr learned my addr 172.21.15.37:0/2474604358 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> v2:172.21.15.119:3300/0 conn(0x7fea000c3e10 0x7fea000c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea04e75640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fea0015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652901173 0 0) 0x7fea000c9090 con 0x7fea001585b0 2023-07-09T21:42:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9e8003530 con 0x7fea001585b0 2023-07-09T21:42:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 795097585 0 0) 0x7fe9e8003530 con 0x7fea001585b0 2023-07-09T21:42:13.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 msgr2=0x7fea0015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fea0015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 >> v2:172.21.15.119:3300/0 conn(0x7fea000c3e10 msgr2=0x7fea000c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 --2- 172.21.15.37:0/2474604358 >> v2:172.21.15.119:3300/0 conn(0x7fea000c3e10 0x7fea000c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0015cbc0 con 0x7fea001585b0 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fe9f0001680 con 0x7fea001585b0 2023-07-09T21:42:13.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> v2:172.21.15.119:3300/0 conn(0x7fea000c3e10 0x7fea000c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 >> v1:172.21.15.37:6789/0 conn(0x7fea001585b0 legacy=0x7fea0006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e8003980 0x7fe9e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fe9e8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fe9e8004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000cbf40 con 0x7fe9e80043b0 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000c47d0 con 0x7fe9e8003980 2023-07-09T21:42:13.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e800dba0 con 0x7fea0015c200 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fe9e8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fe9fffff640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e8003980 0x7fe9e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.424+0000 7fea04e75640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fe9e8004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 -- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 msgr2=0x7fe9e8004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fe9e8004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 -- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e8003980 msgr2=0x7fe9e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9e8003980 0x7fe9e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 -- 172.21.15.37:0/2474604358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e8003530 con 0x7fe9e80043b0 2023-07-09T21:42:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea04e75640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0015c200 0x7fe9e8004f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fe9e8004870 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009cb0 tx=0x7fe9f401cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eddc4d307d497f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a5930 con 0x7fe9e80043b0 2023-07-09T21:42:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f40a5a90 con 0x7fe9e80043b0 2023-07-09T21:42:13.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fe9feffd640 1 -- 172.21.15.37:0/2474604358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f40a5e40 con 0x7fe9e80043b0 2023-07-09T21:42:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 -- 172.21.15.37:0/2474604358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 msgr2=0x7fe9e8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 --2- 172.21.15.37:0/2474604358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fe9e8004870 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009cb0 tx=0x7fe9f401cc70 comp rx=0 tx=0).stop 2023-07-09T21:42:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea04e75640 1 -- 172.21.15.37:0/2474604358 reap_dead start 2023-07-09T21:42:13.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 -- 172.21.15.37:0/2474604358 shutdown_connections 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 -- 172.21.15.37:0/2474604358 >> 172.21.15.37:0/2474604358 conn(0x7fea000cde40 msgr2=0x7fea000ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 -- 172.21.15.37:0/2474604358 shutdown_connections 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.428+0000 7fea068d8640 1 -- 172.21.15.37:0/2474604358 wait complete. 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 Processor -- start 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 -- start start 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 0x7fea000af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 0x7fea001f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea000b01c0 con 0x7fe9e80043b0 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea00151240 con 0x7fea000afd50 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea068d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea000ada00 con 0x7fea001f1a50 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54112/0 (socket says 172.21.15.37:54112) 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 -- 172.21.15.37:0/1403055961 learned_addr learned my addr 172.21.15.37:0/1403055961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea04e75640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 0x7fea001f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 0x7fea000af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 -- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 msgr2=0x7fea000af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 0x7fea000af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 -- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 msgr2=0x7fea001f45c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 0x7fea001f45c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 -- 172.21.15.37:0/1403055961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea000adca0 con 0x7fe9e80043b0 2023-07-09T21:42:13.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 0x7fea000af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fea04e75640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 0x7fea001f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.432+0000 7fe9fffff640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0012540 tx=0x7fe9f0012a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0014810 con 0x7fe9e80043b0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0014970 con 0x7fe9e80043b0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0014d20 con 0x7fe9e80043b0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea000adf80 con 0x7fe9e80043b0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea000ae540 con 0x7fe9e80043b0 2023-07-09T21:42:13.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0004d7d0 con 0x7fe9e80043b0 2023-07-09T21:42:13.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9f0016480 con 0x7fe9e80043b0 2023-07-09T21:42:13.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:13.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 6512+0+0 (secure 0 0 0) 0x7fe9f00874c0 con 0x7fe9e80043b0 2023-07-09T21:42:13.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.436+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:13.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.440+0000 7fe9ff7fe640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 0x7fe9ec068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40af000 tx=0x7fe9f40046d0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:13.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.440+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe9f0054740 con 0x7fe9e80043b0 2023-07-09T21:42:13.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:13.596+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea0006b210 con 0x7fe9e80043b0 2023-07-09T21:42:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.252+0000 7fe9fcff9640 1 -- 172.21.15.37:0/1403055961 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v135) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe9f0057d60 con 0x7fe9e80043b0 2023-07-09T21:42:14.255 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:42:14.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 msgr2=0x7fe9ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 0x7fe9ec068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe9f40af000 tx=0x7fe9f40046d0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 msgr2=0x7fea001f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0012540 tx=0x7fe9f0012a00 comp rx=0 tx=0).stop 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 shutdown_connections 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea000afd50 0x7fea001f45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea001f1a50 0x7fea000af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 --2- 172.21.15.37:0/1403055961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9e80043b0 0x7fea001f0af0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 >> 172.21.15.37:0/1403055961 conn(0x7fea000cde40 msgr2=0x7fea0006b430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 shutdown_connections 2023-07-09T21:42:14.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.256+0000 7fea068d8640 1 -- 172.21.15.37:0/1403055961 wait complete. 2023-07-09T21:42:14.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:42:14.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 Processor -- start 2023-07-09T21:42:14.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 -- start start 2023-07-09T21:42:14.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8fc00b1420 0x7f8fc00af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00ce080 con 0x7f8fc00b0ed0 2023-07-09T21:42:14.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc00ce360 con 0x7f8fc00cfb40 2023-07-09T21:42:14.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc520b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc00ce640 con 0x7f8fc00b1420 2023-07-09T21:42:14.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc4a0a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8fc00b0ed0 0x7f8fc00afa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48550/0 (socket says 172.21.15.37:48550) 2023-07-09T21:42:14.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.428+0000 7f8fc4a0a640 1 -- 172.21.15.37:0/3774673190 learned_addr learned my addr 172.21.15.37:0/3774673190 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:14.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbf7fe640 1 --2- 172.21.15.37:0/3774673190 >> v2:172.21.15.119:3300/0 conn(0x7f8fc00b1420 0x7f8fc00af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 493045454 0 0) 0x7f8fc00ce080 con 0x7f8fc00b0ed0 2023-07-09T21:42:14.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa8003530 con 0x7f8fc00b0ed0 2023-07-09T21:42:14.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831005070 0 0) 0x7f8fc00ce360 con 0x7f8fc00cfb40 2023-07-09T21:42:14.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fc00ce080 con 0x7f8fc00cfb40 2023-07-09T21:42:14.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbf7fe640 1 -- 172.21.15.37:0/3774673190 >> v1:172.21.15.119:6789/0 conn(0x7f8fc00cfb40 legacy=0x7f8fc00cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032187269 0 0) 0x7f8fa8003530 con 0x7f8fc00b0ed0 2023-07-09T21:42:14.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbf7fe640 1 -- 172.21.15.37:0/3774673190 >> v1:172.21.15.37:6789/0 conn(0x7f8fc00b0ed0 legacy=0x7f8fc00afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbf7fe640 1 -- 172.21.15.37:0/3774673190 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00aed30 con 0x7f8fc00b1420 2023-07-09T21:42:14.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbf7fe640 1 --2- 172.21.15.37:0/3774673190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc00af530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40097c0 tx=0x7f8fb401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79073dd430bd6151 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8001a00 con 0x7f8fc00b1420 2023-07-09T21:42:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40a7050 con 0x7f8fc00b1420 2023-07-09T21:42:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.432+0000 7f8fbeffd640 1 -- 172.21.15.37:0/3774673190 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40ab620 con 0x7f8fc00b1420 2023-07-09T21:42:14.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- 172.21.15.37:0/3774673190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 msgr2=0x7f8fc00af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3774673190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc00af530 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40097c0 tx=0x7f8fb401c370 comp rx=0 tx=0).stop 2023-07-09T21:42:14.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- 172.21.15.37:0/3774673190 shutdown_connections 2023-07-09T21:42:14.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3774673190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc00af530 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- 172.21.15.37:0/3774673190 >> 172.21.15.37:0/3774673190 conn(0x7f8fc0072d20 msgr2=0x7f8fc00d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:14.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- 172.21.15.37:0/3774673190 shutdown_connections 2023-07-09T21:42:14.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- 172.21.15.37:0/3774673190 wait complete. 2023-07-09T21:42:14.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 Processor -- start 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- start start 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc00b0ed0 0x7f8fc0156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc0158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0158ba0 con 0x7f8fc00cfb40 2023-07-09T21:42:14.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0157510 con 0x7f8fc00b1420 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc520b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01577f0 con 0x7f8fc00b0ed0 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54114/0 (socket says 172.21.15.37:54114) 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 -- 172.21.15.37:0/3530651902 learned_addr learned my addr 172.21.15.37:0/3530651902 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fbf7fe640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc0158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fbffff640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc00b0ed0 0x7f8fc0156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 -- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc00b0ed0 msgr2=0x7f8fc0156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc00b0ed0 0x7f8fc0156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 -- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 msgr2=0x7f8fc0158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc0158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.436+0000 7f8fc4a0a640 1 -- 172.21.15.37:0/3530651902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009420 con 0x7f8fc00cfb40 2023-07-09T21:42:14.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fc4a0a640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cc80 tx=0x7f8fb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800ce90 con 0x7f8fc00cfb40 2023-07-09T21:42:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8012400 con 0x7f8fc00cfb40 2023-07-09T21:42:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc0157ad0 con 0x7f8fc00cfb40 2023-07-09T21:42:14.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80127b0 con 0x7f8fc00cfb40 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc015a560 con 0x7f8fc00cfb40 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc004e020 con 0x7f8fc00cfb40 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8fb8012910 con 0x7f8fc00cfb40 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 0x7f8fac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f8fb8084510 con 0x7f8fc00cfb40 2023-07-09T21:42:14.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.440+0000 7f8fbffff640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 0x7f8fac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.444+0000 7f8fbffff640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 0x7f8fac068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00011f0 tx=0x7f8fb0009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.444+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fb8051860 con 0x7f8fc00cfb40 2023-07-09T21:42:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.624+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8fc00d10c0 con 0x7f8fc00cfb40 2023-07-09T21:42:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.628+0000 7f8fbcff9640 1 -- 172.21.15.37:0/3530651902 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fb8054e80 con 0x7f8fc00cfb40 2023-07-09T21:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 msgr2=0x7f8fac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 0x7f8fac068880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8fb00011f0 tx=0x7f8fb0009040 comp rx=0 tx=0).stop 2023-07-09T21:42:14.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 msgr2=0x7f8fc00b6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800cc80 tx=0x7f8fb800a430 comp rx=0 tx=0).stop 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 shutdown_connections 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8fac0663d0 0x7f8fac068880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fc00cfb40 0x7f8fc00b6770 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8fc00b1420 0x7f8fc0158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 --2- 172.21.15.37:0/3530651902 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8fc00b0ed0 0x7f8fc0156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 >> 172.21.15.37:0/3530651902 conn(0x7f8fc0072d20 msgr2=0x7f8fc00af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 shutdown_connections 2023-07-09T21:42:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.632+0000 7f8fc520b640 1 -- 172.21.15.37:0/3530651902 wait complete. 2023-07-09T21:42:14.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:42:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 Processor -- start 2023-07-09T21:42:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 -- start start 2023-07-09T21:42:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f39881595c0 0x7f39880c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39880c99e0 0x7f39880cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39880c4c90 con 0x7f3988159990 2023-07-09T21:42:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880ca730 con 0x7f39880c99e0 2023-07-09T21:42:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.796+0000 7f398ce6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39880ca170 con 0x7f39881595c0 2023-07-09T21:42:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39880c99e0 0x7f39880cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f39880c99e0 0x7f39880cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54116/0 (socket says 172.21.15.37:54116) 2023-07-09T21:42:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 -- 172.21.15.37:0/357486217 learned_addr learned my addr 172.21.15.37:0/357486217 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f398659c640 1 --2- 172.21.15.37:0/357486217 >> v2:172.21.15.119:3300/0 conn(0x7f39881595c0 0x7f39880c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 -- 172.21.15.37:0/357486217 >> v2:172.21.15.119:3300/0 conn(0x7f39881595c0 msgr2=0x7f39880c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:14.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 --2- 172.21.15.37:0/357486217 >> v2:172.21.15.119:3300/0 conn(0x7f39881595c0 0x7f39880c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 -- 172.21.15.37:0/357486217 >> v1:172.21.15.37:6789/0 conn(0x7f3988159990 legacy=0x7f398815dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 -- 172.21.15.37:0/357486217 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39880ca450 con 0x7f39880c99e0 2023-07-09T21:42:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f3986d9d640 1 --2- 172.21.15.37:0/357486217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39880c99e0 0x7f39880cd300 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f398806e9e0 tx=0x7f398001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e749ce55a0021ea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f398559a640 1 -- 172.21.15.37:0/357486217 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800a56c0 con 0x7f39880c99e0 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f398559a640 1 -- 172.21.15.37:0/357486217 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39800a5820 con 0x7f39880c99e0 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.800+0000 7f398559a640 1 -- 172.21.15.37:0/357486217 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800a5bb0 con 0x7f39880c99e0 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- 172.21.15.37:0/357486217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39880c99e0 msgr2=0x7f39880cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- 172.21.15.37:0/357486217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39880c99e0 0x7f39880cd300 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f398806e9e0 tx=0x7f398001c860 comp rx=0 tx=0).stop 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- 172.21.15.37:0/357486217 shutdown_connections 2023-07-09T21:42:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- 172.21.15.37:0/357486217 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39880c99e0 0x7f39880cd300 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- 172.21.15.37:0/357486217 >> v2:172.21.15.119:3300/0 conn(0x7f39881595c0 0x7f39880c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- 172.21.15.37:0/357486217 >> 172.21.15.37:0/357486217 conn(0x7f39880cde40 msgr2=0x7f39880ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- 172.21.15.37:0/357486217 shutdown_connections 2023-07-09T21:42:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- 172.21.15.37:0/357486217 wait complete. 2023-07-09T21:42:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 Processor -- start 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- start start 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39880c99e0 0x7f398814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 0x7f3988147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39881f0e00 con 0x7f3988159990 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39880c5920 con 0x7f39881595c0 2023-07-09T21:42:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398ce6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3988149c90 con 0x7f39880c99e0 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f3986d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f3986d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54128/0 (socket says 172.21.15.37:54128) 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f3986d9d640 1 -- 172.21.15.37:0/2530772482 learned_addr learned my addr 172.21.15.37:0/2530772482 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f398659c640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39880c99e0 0x7f398814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.804+0000 7f3985d9b640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 0x7f3988147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 -- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39880c99e0 msgr2=0x7f398814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39880c99e0 0x7f398814a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 -- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 msgr2=0x7f3988147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 0x7f3988147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 -- 172.21.15.37:0/2530772482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009b30 con 0x7f3988159990 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3985d9b640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 0x7f3988147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3986d9d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f398001a490 tx=0x7f3980019600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39800a56c0 con 0x7f3988159990 2023-07-09T21:42:14.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980007bb0 con 0x7f3988159990 2023-07-09T21:42:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980009510 con 0x7f3988159990 2023-07-09T21:42:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3988149f70 con 0x7f3988159990 2023-07-09T21:42:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398814de70 con 0x7f3988159990 2023-07-09T21:42:14.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398804d7d0 con 0x7f3988159990 2023-07-09T21:42:14.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f39800b8470 con 0x7f3988159990 2023-07-09T21:42:14.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 0x7f3968068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:14.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.808+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f398011f7d0 con 0x7f3988159990 2023-07-09T21:42:14.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.812+0000 7f398659c640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 0x7f3968068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:14.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.812+0000 7f398659c640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 0x7f3968068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f397800b930 tx=0x7f3978008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:14.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.812+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39800ecb00 con 0x7f3988159990 2023-07-09T21:42:14.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.968+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f398814a420 con 0x7f3988159990 2023-07-09T21:42:14.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f3976ffd640 1 -- 172.21.15.37:0/2530772482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v44) v1 ==== 120+0+0 (secure 0 0 0) 0x7f39800f0120 con 0x7f3988159990 2023-07-09T21:42:14.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 msgr2=0x7f3968068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 0x7f3968068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f397800b930 tx=0x7f3978008040 comp rx=0 tx=0).stop 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 msgr2=0x7f39880c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f398001a490 tx=0x7f3980019600 comp rx=0 tx=0).stop 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 shutdown_connections 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f39680663a0 0x7f3968068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3988159990 0x7f39880c4e80 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f39881595c0 0x7f3988147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 --2- 172.21.15.37:0/2530772482 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f39880c99e0 0x7f398814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:14.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 >> 172.21.15.37:0/2530772482 conn(0x7f39880cde40 msgr2=0x7f398806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:14.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 shutdown_connections 2023-07-09T21:42:14.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:14.976+0000 7f398ce6d640 1 -- 172.21.15.37:0/2530772482 wait complete. 2023-07-09T21:42:14.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:42:15.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.140+0000 7fa03ebc5640 1 Processor -- start 2023-07-09T21:42:15.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.140+0000 7fa03ebc5640 1 -- start start 2023-07-09T21:42:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03ebc5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0380b7980 0x7fa038160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03ebc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0380cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03ebc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03815bf80 con 0x7fa0380b3c20 2023-07-09T21:42:15.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03ebc5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0380cd070 con 0x7fa0380b7980 2023-07-09T21:42:15.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03ebc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380cfd70 con 0x7fa0380ceb80 2023-07-09T21:42:15.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0380b3c20 0x7fa0380b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48558/0 (socket says 172.21.15.37:48558) 2023-07-09T21:42:15.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 -- 172.21.15.37:0/1979447844 learned_addr learned my addr 172.21.15.37:0/1979447844 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03c961640 1 --2- 172.21.15.37:0/1979447844 >> v2:172.21.15.119:3300/0 conn(0x7fa0380b7980 0x7fa038160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa037fff640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0380cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775058135 0 0) 0x7fa0300014a0 con 0x7fa0380b3c20 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa028003530 con 0x7fa0380b3c20 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1732846008 0 0) 0x7fa028003530 con 0x7fa0380b3c20 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 msgr2=0x7fa0380cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0380cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 >> v2:172.21.15.119:3300/0 conn(0x7fa0380b7980 msgr2=0x7fa038160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 --2- 172.21.15.37:0/1979447844 >> v2:172.21.15.119:3300/0 conn(0x7fa0380b7980 0x7fa038160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa038160570 con 0x7fa0380b3c20 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fa030001b90 con 0x7fa0380b3c20 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 >> v1:172.21.15.37:6789/0 conn(0x7fa0380b3c20 legacy=0x7fa0380b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa028003980 0x7fa028003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa028005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380cd070 con 0x7fa028004d10 2023-07-09T21:42:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380cfd70 con 0x7fa028003980 2023-07-09T21:42:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa02800b990 con 0x7fa0380ceb80 2023-07-09T21:42:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa028005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03c961640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa028003980 0x7fa028003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa037fff640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 -- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 msgr2=0x7fa0280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0380ceb80 0x7fa0280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 -- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa028003980 msgr2=0x7fa028003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa028003980 0x7fa028003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03d162640 1 -- 172.21.15.37:0/1979447844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa028003530 con 0x7fa028004d10 2023-07-09T21:42:15.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.144+0000 7fa03c961640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa028003980 0x7fa028003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03d162640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa028005180 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa03000a830 tx=0x7fa03001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01f9b9875c579f7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300ad630 con 0x7fa028004d10 2023-07-09T21:42:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0300a8070 con 0x7fa028004d10 2023-07-09T21:42:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa0377fe640 1 -- 172.21.15.37:0/1979447844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0300ad9f0 con 0x7fa028004d10 2023-07-09T21:42:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- 172.21.15.37:0/1979447844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 msgr2=0x7fa028005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/1979447844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa028005180 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fa03000a830 tx=0x7fa03001d360 comp rx=0 tx=0).stop 2023-07-09T21:42:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03d162640 1 -- 172.21.15.37:0/1979447844 reap_dead start 2023-07-09T21:42:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- 172.21.15.37:0/1979447844 shutdown_connections 2023-07-09T21:42:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- 172.21.15.37:0/1979447844 >> 172.21.15.37:0/1979447844 conn(0x7fa038073090 msgr2=0x7fa038069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- 172.21.15.37:0/1979447844 shutdown_connections 2023-07-09T21:42:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- 172.21.15.37:0/1979447844 wait complete. 2023-07-09T21:42:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 Processor -- start 2023-07-09T21:42:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.148+0000 7fa03ebc5640 1 -- start start 2023-07-09T21:42:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa038156690 0x7fa03815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 0x7fa03814c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380d3000 con 0x7fa028004d10 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0381f5e50 con 0x7fa03814c1b0 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03814cb60 con 0x7fa038156690 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54136/0 (socket says 172.21.15.37:54136) 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 -- 172.21.15.37:0/3483702361 learned_addr learned my addr 172.21.15.37:0/3483702361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa037fff640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa038156690 0x7fa03815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03d162640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 0x7fa03814c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 -- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa038156690 msgr2=0x7fa03815cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa038156690 0x7fa03815cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 -- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 msgr2=0x7fa03814c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 0x7fa03814c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 -- 172.21.15.37:0/3483702361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0381f5890 con 0x7fa028004d10 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03d162640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 0x7fa03814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03c961640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa02c011d00 tx=0x7fa02c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00fcc0 con 0x7fa028004d10 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00fe20 con 0x7fa028004d10 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c004240 con 0x7fa028004d10 2023-07-09T21:42:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0381f5b70 con 0x7fa028004d10 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa038156da0 con 0x7fa028004d10 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.152+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03804d7d0 con 0x7fa028004d10 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.156+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa02c0043a0 con 0x7fa028004d10 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.156+0000 7fa0357fa640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 0x7fa01c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.156+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fa02c0845a0 con 0x7fa028004d10 2023-07-09T21:42:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.156+0000 7fa037fff640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 0x7fa01c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.156+0000 7fa037fff640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 0x7fa01c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa038069e80 tx=0x7fa024009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.160+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa02c051840 con 0x7fa028004d10 2023-07-09T21:42:15.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.316+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fa0380b1600 con 0x7fa028004d10 2023-07-09T21:42:15.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.324+0000 7fa0357fa640 1 -- 172.21.15.37:0/3483702361 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v45) v1 ==== 115+0+0 (secure 0 0 0) 0x7fa02c054e60 con 0x7fa028004d10 2023-07-09T21:42:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 msgr2=0x7fa01c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 0x7fa01c068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa038069e80 tx=0x7fa024009190 comp rx=0 tx=0).stop 2023-07-09T21:42:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 msgr2=0x7fa03815eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fa02c011d00 tx=0x7fa02c00f610 comp rx=0 tx=0).stop 2023-07-09T21:42:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 shutdown_connections 2023-07-09T21:42:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa01c0663a0 0x7fa01c068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa03814c1b0 0x7fa03814c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa038156690 0x7fa03815cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 --2- 172.21.15.37:0/3483702361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa028004d10 0x7fa03815eb20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 >> 172.21.15.37:0/3483702361 conn(0x7fa038073090 msgr2=0x7fa03815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 shutdown_connections 2023-07-09T21:42:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.328+0000 7fa03ebc5640 1 -- 172.21.15.37:0/3483702361 wait complete. 2023-07-09T21:42:15.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule' 2023-07-09T21:42:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 Processor -- start 2023-07-09T21:42:15.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 -- start start 2023-07-09T21:42:15.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9000b7ab0 0x7ff90006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff9000b4340 0x7ff9000d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9000b49f0 con 0x7ff9000cef80 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000b7e80 con 0x7ff9000b7ab0 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff907e93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000cc8a0 con 0x7ff9000b4340 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.488+0000 7ff905c2f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9000b7ab0 0x7ff90006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff90542e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff9000cef80 0x7ff9000b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48564/0 (socket says 172.21.15.37:48564) 2023-07-09T21:42:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff90542e640 1 -- 172.21.15.37:0/912116915 learned_addr learned my addr 172.21.15.37:0/912116915 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff906430640 1 --2- 172.21.15.37:0/912116915 >> v2:172.21.15.119:3300/0 conn(0x7ff9000b4340 0x7ff9000d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff905c2f640 1 -- 172.21.15.37:0/912116915 >> v2:172.21.15.119:3300/0 conn(0x7ff9000b4340 msgr2=0x7ff9000d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:15.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff905c2f640 1 --2- 172.21.15.37:0/912116915 >> v2:172.21.15.119:3300/0 conn(0x7ff9000b4340 0x7ff9000d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff905c2f640 1 -- 172.21.15.37:0/912116915 >> v1:172.21.15.37:6789/0 conn(0x7ff9000cef80 legacy=0x7ff9000b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff905c2f640 1 -- 172.21.15.37:0/912116915 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000ccb80 con 0x7ff9000b7ab0 2023-07-09T21:42:15.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff904c2d640 1 -- 172.21.15.37:0/912116915 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811565477 0 0) 0x7ff9000b49f0 con 0x7ff9000cef80 2023-07-09T21:42:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff905c2f640 1 --2- 172.21.15.37:0/912116915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff90006aa50 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b4710 tx=0x7ff8fc01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f7b24a01d939ee server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff904c2d640 1 -- 172.21.15.37:0/912116915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0a7070 con 0x7ff9000b7ab0 2023-07-09T21:42:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff904c2d640 1 -- 172.21.15.37:0/912116915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc0ab430 con 0x7ff9000b7ab0 2023-07-09T21:42:15.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.492+0000 7ff904c2d640 1 -- 172.21.15.37:0/912116915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc0ab7c0 con 0x7ff9000b7ab0 2023-07-09T21:42:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- 172.21.15.37:0/912116915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 msgr2=0x7ff90006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- 172.21.15.37:0/912116915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff90006aa50 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7ff9000b4710 tx=0x7ff8fc01c430 comp rx=0 tx=0).stop 2023-07-09T21:42:15.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- 172.21.15.37:0/912116915 shutdown_connections 2023-07-09T21:42:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- 172.21.15.37:0/912116915 >> v2:172.21.15.119:3300/0 conn(0x7ff9000b4340 0x7ff9000d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- 172.21.15.37:0/912116915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff90006aa50 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- 172.21.15.37:0/912116915 >> 172.21.15.37:0/912116915 conn(0x7ff900073090 msgr2=0x7ff900069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- 172.21.15.37:0/912116915 shutdown_connections 2023-07-09T21:42:15.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- 172.21.15.37:0/912116915 wait complete. 2023-07-09T21:42:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 Processor -- start 2023-07-09T21:42:15.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- start start 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9000b4340 0x7ff9001509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9000cef80 0x7ff90013b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90013bcd0 con 0x7ff9000b7ab0 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff900150fc0 con 0x7ff9000b4340 2023-07-09T21:42:15.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff907e93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9001512a0 con 0x7ff9000cef80 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54154/0 (socket says 172.21.15.37:54154) 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 -- 172.21.15.37:0/1942362030 learned_addr learned my addr 172.21.15.37:0/1942362030 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff906430640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9000cef80 0x7ff90013b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff905c2f640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9000b4340 0x7ff9001509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 -- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9000cef80 msgr2=0x7ff90013b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9000cef80 0x7ff90013b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 -- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9000b4340 msgr2=0x7ff9001509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9000b4340 0x7ff9001509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.496+0000 7ff90542e640 1 -- 172.21.15.37:0/1942362030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8fc009420 con 0x7ff9000b7ab0 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff90542e640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000c450 tx=0x7ff8f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00074e0 con 0x7ff9000b7ab0 2023-07-09T21:42:15.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0007640 con 0x7ff9000b7ab0 2023-07-09T21:42:15.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f00049f0 con 0x7ff9000b7ab0 2023-07-09T21:42:15.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9000cacd0 con 0x7ff9000b7ab0 2023-07-09T21:42:15.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9000cb290 con 0x7ff9000b7ab0 2023-07-09T21:42:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9000cab30 con 0x7ff9000b7ab0 2023-07-09T21:42:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff8f0004b50 con 0x7ff9000b7ab0 2023-07-09T21:42:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 0x7ff8e4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7ff8f0083160 con 0x7ff9000b7ab0 2023-07-09T21:42:15.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.500+0000 7ff905c2f640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 0x7ff8e4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:15.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.504+0000 7ff905c2f640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 0x7ff8e4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0af000 tx=0x7ff8fc0a7000 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.504+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9000cab30 con 0x7ff9000b7ab0 2023-07-09T21:42:15.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:15.716+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]} v 0) v1 -- 0x7ff9000cab30 con 0x7ff9000b7ab0 2023-07-09T21:42:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff8f67fc640 1 -- 172.21.15.37:0/1942362030 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule"]}]=0 v758) v1 ==== 148+0+0 (secure 0 0 0) 0x7ff9000cab30 con 0x7ff9000b7ab0 2023-07-09T21:42:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 msgr2=0x7ff8e4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 0x7ff8e4068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc0af000 tx=0x7ff8fc0a7000 comp rx=0 tx=0).stop 2023-07-09T21:42:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 msgr2=0x7ff900139be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7ff8f000c450 tx=0x7ff8f000c910 comp rx=0 tx=0).stop 2023-07-09T21:42:16.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 shutdown_connections 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff8e40663a0 0x7ff8e4068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9000cef80 0x7ff90013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9000b7ab0 0x7ff900139be0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 --2- 172.21.15.37:0/1942362030 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9000b4340 0x7ff9001509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 >> 172.21.15.37:0/1942362030 conn(0x7ff900073090 msgr2=0x7ff9000ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 shutdown_connections 2023-07-09T21:42:16.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.260+0000 7ff907e93640 1 -- 172.21.15.37:0/1942362030 wait complete. 2023-07-09T21:42:16.282 INFO:tasks.cephfs_test_runner:Test existence of a scheduled snapshot ... ok 2023-07-09T21:42:16.283 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test listing snap schedules post removal of a schedule 2023-07-09T21:42:16.283 INFO:tasks.cephfs_test_runner:test_snap_schedule_list_post_schedule_remove (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:42:16.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-09T21:42:16.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 Processor -- start 2023-07-09T21:42:16.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 -- start start 2023-07-09T21:42:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80b7ab0 0x7f72d806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72d80b4340 0x7f72d80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72d80b49f0 con 0x7f72d80cef80 2023-07-09T21:42:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72d80b7e80 con 0x7f72d80b4340 2023-07-09T21:42:16.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72dd00b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80cc8a0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72cffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72d80cef80 0x7f72d80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:48578/0 (socket says 172.21.15.37:48578) 2023-07-09T21:42:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72cffff640 1 -- 172.21.15.37:0/1644492435 learned_addr learned my addr 172.21.15.37:0/1644492435 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d759e640 1 --2- 172.21.15.37:0/1644492435 >> v2:172.21.15.119:3300/0 conn(0x7f72d80b4340 0x7f72d80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d6d9d640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80b7ab0 0x7f72d806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d659c640 1 -- 172.21.15.37:0/1644492435 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2306890021 0 0) 0x7f72d80b49f0 con 0x7f72d80cef80 2023-07-09T21:42:16.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d659c640 1 -- 172.21.15.37:0/1644492435 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72c4003530 con 0x7f72d80cef80 2023-07-09T21:42:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d759e640 1 -- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80b7ab0 msgr2=0x7f72d806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d759e640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80b7ab0 0x7f72d806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.428+0000 7f72d759e640 1 -- 172.21.15.37:0/1644492435 >> v1:172.21.15.37:6789/0 conn(0x7f72d80cef80 legacy=0x7f72d80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72d759e640 1 -- 172.21.15.37:0/1644492435 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d80ccb80 con 0x7f72d80b4340 2023-07-09T21:42:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72d759e640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d80d02a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009d90 tx=0x7f72d001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284e29cd25fca8e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72d659c640 1 -- 172.21.15.37:0/1644492435 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00a59e0 con 0x7f72d80b4340 2023-07-09T21:42:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72d659c640 1 -- 172.21.15.37:0/1644492435 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72d00a5b40 con 0x7f72d80b4340 2023-07-09T21:42:16.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72d659c640 1 -- 172.21.15.37:0/1644492435 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72d00ad440 con 0x7f72d80b4340 2023-07-09T21:42:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 -- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 msgr2=0x7f72d80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d80d02a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f72d0009d90 tx=0x7f72d001c920 comp rx=0 tx=0).stop 2023-07-09T21:42:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 -- 172.21.15.37:0/1644492435 shutdown_connections 2023-07-09T21:42:16.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d80d02a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 --2- 172.21.15.37:0/1644492435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80b7ab0 0x7f72d806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 -- 172.21.15.37:0/1644492435 >> 172.21.15.37:0/1644492435 conn(0x7f72d8073090 msgr2=0x7f72d8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 -- 172.21.15.37:0/1644492435 shutdown_connections 2023-07-09T21:42:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.432+0000 7f72dd00b640 1 -- 172.21.15.37:0/1644492435 wait complete. 2023-07-09T21:42:16.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 Processor -- start 2023-07-09T21:42:16.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 -- start start 2023-07-09T21:42:16.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d81501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80cef80 0x7f72d8155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80ca5a0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c7200 con 0x7f72d80b4340 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72dd00b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72d80c6960 con 0x7f72d80cef80 2023-07-09T21:42:16.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54162/0 (socket says 172.21.15.37:54162) 2023-07-09T21:42:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 -- 172.21.15.37:0/3997304395 learned_addr learned my addr 172.21.15.37:0/3997304395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72d6d9d640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d81501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72d759e640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80cef80 0x7f72d8155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 -- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80cef80 msgr2=0x7f72d8155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80cef80 0x7f72d8155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 -- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 msgr2=0x7f72d81501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d81501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 -- 172.21.15.37:0/3997304395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72d0009a70 con 0x7f72d80b7ab0 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.436+0000 7f72cffff640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c420 tx=0x7f72c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0005cf0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0005e50 con 0x7f72d80b7ab0 2023-07-09T21:42:16.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c00072d0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72d80c6c40 con 0x7f72d80b7ab0 2023-07-09T21:42:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72d80ca7b0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72d804d7d0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72c0007430 con 0x7f72d80b7ab0 2023-07-09T21:42:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 0x7f72b8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f72c00833e0 con 0x7f72d80b7ab0 2023-07-09T21:42:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.440+0000 7f72d6d9d640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 0x7f72b8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:16.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.444+0000 7f72d6d9d640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 0x7f72b8068880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009b60 tx=0x7f72c8009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:16.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.444+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72c0050730 con 0x7f72d80b7ab0 2023-07-09T21:42:16.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:16.656+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7f72d815efa0 con 0x7f72d80b7ab0 2023-07-09T21:42:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.260+0000 7f72cf7fe640 1 -- 172.21.15.37:0/3997304395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v759) v1 ==== 177+0+0 (secure 0 0 0) 0x7f72c0053d50 con 0x7f72d80b7ab0 2023-07-09T21:42:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 msgr2=0x7f72b8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 0x7f72b8068880 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009b60 tx=0x7f72c8009190 comp rx=0 tx=0).stop 2023-07-09T21:42:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 msgr2=0x7f72d81551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c420 tx=0x7f72c000c8e0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 shutdown_connections 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f72b80663d0 0x7f72b8068880 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72d80cef80 0x7f72d8155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72d80b7ab0 0x7f72d81551e0 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 --2- 172.21.15.37:0/3997304395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72d80b4340 0x7f72d81501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 >> 172.21.15.37:0/3997304395 conn(0x7f72d8073090 msgr2=0x7f72d80b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 shutdown_connections 2023-07-09T21:42:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.264+0000 7f72dd00b640 1 -- 172.21.15.37:0/3997304395 wait complete. 2023-07-09T21:42:17.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:42:17.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.432+0000 7fb762f8f640 1 Processor -- start 2023-07-09T21:42:17.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.432+0000 7fb762f8f640 1 -- start start 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb762f8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c1585b0 0x7fb75c06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb762f8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0c9090 con 0x7fb75c06b970 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb762f8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0c8a60 con 0x7fb75c0c4520 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb762f8f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0cbf40 con 0x7fb75c1585b0 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c1585b0 0x7fb75c06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:17.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb75c1585b0 0x7fb75c06b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37498/0 (socket says 172.21.15.37:37498) 2023-07-09T21:42:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 -- 172.21.15.37:0/490881987 learned_addr learned my addr 172.21.15.37:0/490881987 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb75bfff640 1 --1- 172.21.15.37:0/490881987 >> v1:172.21.15.37:6789/0 conn(0x7fb75c06b970 0x7fb75c0c3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39222/0 (socket says 172.21.15.37:39222) 2023-07-09T21:42:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 -- 172.21.15.37:0/490881987 >> v1:172.21.15.119:6789/0 conn(0x7fb75c0c4520 legacy=0x7fb75c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 -- 172.21.15.37:0/490881987 >> v1:172.21.15.37:6789/0 conn(0x7fb75c06b970 legacy=0x7fb75c0c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.436+0000 7fb760d2b640 1 -- 172.21.15.37:0/490881987 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c15ce10 con 0x7fb75c1585b0 2023-07-09T21:42:17.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb760d2b640 1 --2- 172.21.15.37:0/490881987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c1585b0 0x7fb75c06b430 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb75001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101b33a6134b3228 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb75b7fe640 1 -- 172.21.15.37:0/490881987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a95f0 con 0x7fb75c1585b0 2023-07-09T21:42:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb75b7fe640 1 -- 172.21.15.37:0/490881987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7500a9750 con 0x7fb75c1585b0 2023-07-09T21:42:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb75b7fe640 1 -- 172.21.15.37:0/490881987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500a9ae0 con 0x7fb75c1585b0 2023-07-09T21:42:17.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- 172.21.15.37:0/490881987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c1585b0 msgr2=0x7fb75c06b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 --2- 172.21.15.37:0/490881987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c1585b0 0x7fb75c06b430 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fb750009870 tx=0x7fb75001c510 comp rx=0 tx=0).stop 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- 172.21.15.37:0/490881987 shutdown_connections 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 --2- 172.21.15.37:0/490881987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c1585b0 0x7fb75c06b430 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- 172.21.15.37:0/490881987 >> 172.21.15.37:0/490881987 conn(0x7fb75c0cde40 msgr2=0x7fb75c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- 172.21.15.37:0/490881987 shutdown_connections 2023-07-09T21:42:17.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- 172.21.15.37:0/490881987 wait complete. 2023-07-09T21:42:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 Processor -- start 2023-07-09T21:42:17.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.440+0000 7fb762f8f640 1 -- start start 2023-07-09T21:42:17.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb75c06b970 0x7fb75c1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 0x7fb75c167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c146450 con 0x7fb75c0c4520 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c147e40 con 0x7fb75c1585b0 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c159020 con 0x7fb75c06b970 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:17.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37508/0 (socket says 172.21.15.37:37508) 2023-07-09T21:42:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 -- 172.21.15.37:0/314445759 learned_addr learned my addr 172.21.15.37:0/314445759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb760d2b640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb75c06b970 0x7fb75c1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:17.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb76152c640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 0x7fb75c167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 -- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb75c06b970 msgr2=0x7fb75c1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb75c06b970 0x7fb75c1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 -- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 msgr2=0x7fb75c167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 0x7fb75c167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 -- 172.21.15.37:0/314445759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7500094d0 con 0x7fb75c0c4520 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb76152c640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 0x7fb75c167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb75bfff640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c490 tx=0x7fb74800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748007480 con 0x7fb75c0c4520 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7480075e0 con 0x7fb75c0c4520 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c159300 con 0x7fb75c0c4520 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb748004a10 con 0x7fb75c0c4520 2023-07-09T21:42:17.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c1598c0 con 0x7fb75c0c4520 2023-07-09T21:42:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.444+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c159ae0 con 0x7fb75c0c4520 2023-07-09T21:42:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.448+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb748004b70 con 0x7fb75c0c4520 2023-07-09T21:42:17.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.448+0000 7fb7597fa640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 0x7fb740068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:17.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.448+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7fb748083260 con 0x7fb75c0c4520 2023-07-09T21:42:17.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.448+0000 7fb760d2b640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 0x7fb740068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:17.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.448+0000 7fb760d2b640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 0x7fb740068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7500ae000 tx=0x7fb7500b3040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:17.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.452+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb748050650 con 0x7fb75c0c4520 2023-07-09T21:42:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.608+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fb75c04d7d0 con 0x7fb75c0c4520 2023-07-09T21:42:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.612+0000 7fb7597fa640 1 -- 172.21.15.37:0/314445759 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb748053c70 con 0x7fb75c0c4520 2023-07-09T21:42:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.612+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 msgr2=0x7fb740068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.612+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 0x7fb740068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb7500ae000 tx=0x7fb7500b3040 comp rx=0 tx=0).stop 2023-07-09T21:42:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.612+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 msgr2=0x7fb75c1678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.612+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fb74800c490 tx=0x7fb74800c950 comp rx=0 tx=0).stop 2023-07-09T21:42:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 shutdown_connections 2023-07-09T21:42:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fb7400663a0 0x7fb740068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb75c1585b0 0x7fb75c167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb75c0c4520 0x7fb75c1678b0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 --2- 172.21.15.37:0/314445759 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb75c06b970 0x7fb75c1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 >> 172.21.15.37:0/314445759 conn(0x7fb75c0cde40 msgr2=0x7fb75c0ac240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 shutdown_connections 2023-07-09T21:42:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:17.616+0000 7fb762f8f640 1 -- 172.21.15.37:0/314445759 wait complete. 2023-07-09T21:42:17.634 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:42:17.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:17.689 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:17.755 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:42:17.756 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:17.756 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:17.765 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:17.765 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:17.766 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:17.775 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:17.775 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:17.776 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:17.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:17.815 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:17.815 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:17.827 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:17.828 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:42:17.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:18.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 Processor -- start 2023-07-09T21:42:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 -- start start 2023-07-09T21:42:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f79a006a450 0x7f79a00cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00ccd40 con 0x7f79a00ce1a0 2023-07-09T21:42:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00cc5a0 con 0x7f79a006a450 2023-07-09T21:42:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f79a48ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01602d0 con 0x7f79a00b7810 2023-07-09T21:42:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f7997fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f79a00ce1a0 0x7f79a0069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:42574/0 (socket says 172.21.15.37:42574) 2023-07-09T21:42:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799ed9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f7997fff640 1 -- 172.21.15.37:0/4228765715 learned_addr learned my addr 172.21.15.37:0/4228765715 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799f59e640 1 --2- 172.21.15.37:0/4228765715 >> v2:172.21.15.119:3300/0 conn(0x7f79a006a450 0x7f79a00cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799e59c640 1 -- 172.21.15.37:0/4228765715 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4033145204 0 0) 0x7f79a00ccd40 con 0x7f79a00ce1a0 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799e59c640 1 -- 172.21.15.37:0/4228765715 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f798c003530 con 0x7f79a00ce1a0 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799f59e640 1 -- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 msgr2=0x7f79a015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799f59e640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.000+0000 7f799f59e640 1 -- 172.21.15.37:0/4228765715 >> v1:172.21.15.119:6789/0 conn(0x7f79a00ce1a0 legacy=0x7f79a0069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799f59e640 1 -- 172.21.15.37:0/4228765715 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00ce680 con 0x7f79a006a450 2023-07-09T21:42:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799ed9d640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:18.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799f59e640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a006a450 0x7f79a00cff00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7998009d90 tx=0x7f799801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c6b16fa23dae85 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799e59c640 1 -- 172.21.15.37:0/4228765715 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980a59e0 con 0x7f79a006a450 2023-07-09T21:42:18.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799e59c640 1 -- 172.21.15.37:0/4228765715 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980a5b40 con 0x7f79a006a450 2023-07-09T21:42:18.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f799e59c640 1 -- 172.21.15.37:0/4228765715 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980ad440 con 0x7f79a006a450 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 -- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a006a450 msgr2=0x7f79a00cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a006a450 0x7f79a00cff00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7998009d90 tx=0x7f799801c920 comp rx=0 tx=0).stop 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 -- 172.21.15.37:0/4228765715 shutdown_connections 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a006a450 0x7f79a00cff00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 --2- 172.21.15.37:0/4228765715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 -- 172.21.15.37:0/4228765715 >> 172.21.15.37:0/4228765715 conn(0x7f79a00cea60 msgr2=0x7f79a00cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:18.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 -- 172.21.15.37:0/4228765715 shutdown_connections 2023-07-09T21:42:18.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.004+0000 7f79a48ca640 1 -- 172.21.15.37:0/4228765715 wait complete. 2023-07-09T21:42:18.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 Processor -- start 2023-07-09T21:42:18.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 -- start start 2023-07-09T21:42:18.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a00c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a00ce1a0 0x7f79a00c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a015a4b0 con 0x7f79a006a450 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a015a790 con 0x7f79a00ce1a0 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79a48ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a015aa70 con 0x7f79a00b7810 2023-07-09T21:42:18.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37524/0 (socket says 172.21.15.37:37524) 2023-07-09T21:42:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 -- 172.21.15.37:0/256776190 learned_addr learned my addr 172.21.15.37:0/256776190 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799f59e640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a00ce1a0 0x7f79a00c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f7997fff640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a00c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 -- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 msgr2=0x7f79a00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a00c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 -- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a00ce1a0 msgr2=0x7f79a00c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a00ce1a0 0x7f79a00c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 -- 172.21.15.37:0/256776190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990009420 con 0x7f79a006a450 2023-07-09T21:42:18.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f799ed9d640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f799000ebe0 tx=0x7f799000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.008+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799000eee0 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799000cc30 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990013470 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7998009a70 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00c7dc0 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a00b22f0 con 0x7f79a006a450 2023-07-09T21:42:18.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f79900135d0 con 0x7f79a006a450 2023-07-09T21:42:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79977fe640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 0x7f7980068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f7990084140 con 0x7f79a006a450 2023-07-09T21:42:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.012+0000 7f7997fff640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 0x7f7980068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.016+0000 7f7997fff640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 0x7f7980068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79a01f8460 tx=0x7f7988007d40 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.016+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7990051490 con 0x7f79a006a450 2023-07-09T21:42:18.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79a004e020 con 0x7f79a006a450 2023-07-09T21:42:18.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79977fe640 1 -- 172.21.15.37:0/256776190 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f7990017de0 con 0x7f79a006a450 2023-07-09T21:42:18.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:18.205 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7130,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/1494236246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":1494236246},{"type":"v1","addr":"172.21.15.119:6836","nonce":1494236246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8038,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/3885906454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":3885906454},{"type":"v1","addr":"172.21.15.37:6833","nonce":3885906454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1364637624","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1364637624},{"type":"v1","addr":"172.21.15.119:6837","nonce":1364637624}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":8916,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1207013568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1207013568},{"type":"v1","addr":"172.21.15.37:6835","nonce":1207013568}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57}],"filesystems":[]} 2023-07-09T21:42:18.206 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 57 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 msgr2=0x7f7980068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 0x7f7980068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f79a01f8460 tx=0x7f7988007d40 comp rx=0 tx=0).stop 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 msgr2=0x7f79a00c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f799000ebe0 tx=0x7f799000c520 comp rx=0 tx=0).stop 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 shutdown_connections 2023-07-09T21:42:18.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f79800663a0 0x7f7980068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79a00ce1a0 0x7f79a00c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79a00b7810 0x7f79a00c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 --2- 172.21.15.37:0/256776190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79a006a450 0x7f79a00c7880 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.204+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 >> 172.21.15.37:0/256776190 conn(0x7f79a00cea60 msgr2=0x7f79a015bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.208+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 shutdown_connections 2023-07-09T21:42:18.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.208+0000 7f79a48ca640 1 -- 172.21.15.37:0/256776190 wait complete. 2023-07-09T21:42:18.226 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:42:18.226 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:42:18.227 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:42:18.227 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:18.227 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:42:18.227 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:42:18.227 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:42:18.228 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:18.228 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:42:18.228 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:42:18.228 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:42:18.229 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:18.229 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:42:18.229 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:42:18.229 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:42:18.229 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:18.238 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:42:18.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:42:18.239 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:42:18.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:42:18.242 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:42:18.243 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:42:18.244 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:42:18.244 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:42:18.281 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:42:18.282 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:18.283 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:42:18.283 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:18.294 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:42:18.294 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:18.296 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:42:18.297 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:18.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:42:18.369 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:42:18.371 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:42:18.384 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:42:18.387 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:42:18.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 Processor -- start 2023-07-09T21:42:18.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 -- start start 2023-07-09T21:42:18.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 0x7f5ccc1668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0cef80 con 0x7f5ccc0b47a0 2023-07-09T21:42:18.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ccc0cf260 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd3d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0ccee0 con 0x7f5ccc0b4310 2023-07-09T21:42:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd12c7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5ccc0b47a0 0x7f5ccc0b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39226/0 (socket says 172.21.15.37:39226) 2023-07-09T21:42:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd12c7640 1 -- 172.21.15.37:0/2357130305 learned_addr learned my addr 172.21.15.37:0/2357130305 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:18.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd22c9640 1 --2- 172.21.15.37:0/2357130305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 0x7f5ccc1668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364177864 0 0) 0x7f5ccc0cef80 con 0x7f5ccc0b47a0 2023-07-09T21:42:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb8003530 con 0x7f5ccc0b47a0 2023-07-09T21:42:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337340996 0 0) 0x7f5ccc0cf260 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ccc0cef80 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd22c9640 1 -- 172.21.15.37:0/2357130305 >> v1:172.21.15.119:6789/0 conn(0x7f5ccc0b7a60 legacy=0x7f5ccc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd22c9640 1 -- 172.21.15.37:0/2357130305 >> v1:172.21.15.37:6789/0 conn(0x7f5ccc0b47a0 legacy=0x7f5ccc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.448+0000 7f5cd22c9640 1 -- 172.21.15.37:0/2357130305 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0cf540 con 0x7f5ccc0b4310 2023-07-09T21:42:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd22c9640 1 --2- 172.21.15.37:0/2357130305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 0x7f5ccc1668c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009dc0 tx=0x7f5cc401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9961425d9b15b20c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40a5920 con 0x7f5ccc0b4310 2023-07-09T21:42:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc40a5a80 con 0x7f5ccc0b4310 2023-07-09T21:42:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd0ac6640 1 -- 172.21.15.37:0/2357130305 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40a5e10 con 0x7f5ccc0b4310 2023-07-09T21:42:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/2357130305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 msgr2=0x7f5ccc1668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/2357130305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 0x7f5ccc1668c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5cc4009dc0 tx=0x7f5cc401c970 comp rx=0 tx=0).stop 2023-07-09T21:42:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/2357130305 shutdown_connections 2023-07-09T21:42:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/2357130305 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b4310 0x7f5ccc1668c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/2357130305 >> 172.21.15.37:0/2357130305 conn(0x7f5ccc073050 msgr2=0x7f5ccc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/2357130305 shutdown_connections 2023-07-09T21:42:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.452+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/2357130305 wait complete. 2023-07-09T21:42:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 Processor -- start 2023-07-09T21:42:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- start start 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 0x7f5ccc0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b47a0 0x7f5ccc152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 0x7f5ccc157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0cb150 con 0x7f5ccc0b4310 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc1552a0 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc0ca210 con 0x7f5ccc0b47a0 2023-07-09T21:42:18.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd1ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 0x7f5ccc0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 0x7f5ccc157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd12c7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b47a0 0x7f5ccc152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd1ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 0x7f5ccc0c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37548/0 (socket says 172.21.15.37:37548) 2023-07-09T21:42:18.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd1ac8640 1 -- 172.21.15.37:0/1328756422 learned_addr learned my addr 172.21.15.37:0/1328756422 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 -- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b47a0 msgr2=0x7f5ccc152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b47a0 0x7f5ccc152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 -- 172.21.15.37:0/1328756422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 msgr2=0x7f5ccc0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 0x7f5ccc0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 -- 172.21.15.37:0/1328756422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009a70 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd22c9640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 0x7f5ccc157030 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40ac000 tx=0x7f5cc4019710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40add20 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc40ade80 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc40b9690 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc0ca4d0 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.456+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc0caa90 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc0cdaa0 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5cc40b97f0 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cc27fc640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 0x7f5cb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 6098+0+0 (secure 0 0 0) 0x7f5cc411f420 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cd1ac8640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 0x7f5cb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:18.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.460+0000 7f5cd1ac8640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 0x7f5cb0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80011f0 tx=0x7f5cc8009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:18.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.464+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5cc40ec9c0 con 0x7f5ccc0b7a60 2023-07-09T21:42:18.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:18.632+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5ccc0cb290 con 0x7f5ccc0b7a60 2023-07-09T21:42:19.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.648+0000 7f5cc27fc640 1 -- 172.21.15.37:0/1328756422 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v140) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ccc0cb290 con 0x7f5ccc0b7a60 2023-07-09T21:42:19.651 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:42:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 msgr2=0x7f5cb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 0x7f5cb0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5cc80011f0 tx=0x7f5cc8009040 comp rx=0 tx=0).stop 2023-07-09T21:42:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 msgr2=0x7f5ccc157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 0x7f5ccc157030 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5cc40ac000 tx=0x7f5cc4019710 comp rx=0 tx=0).stop 2023-07-09T21:42:19.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 shutdown_connections 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f5cb00663a0 0x7f5cb0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5ccc0b7a60 0x7f5ccc157030 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5ccc0b47a0 0x7f5ccc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 --2- 172.21.15.37:0/1328756422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ccc0b4310 0x7f5ccc0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 >> 172.21.15.37:0/1328756422 conn(0x7f5ccc073050 msgr2=0x7f5ccc158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 shutdown_connections 2023-07-09T21:42:19.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.652+0000 7f5cd3d2c640 1 -- 172.21.15.37:0/1328756422 wait complete. 2023-07-09T21:42:19.676 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:42:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 Processor -- start 2023-07-09T21:42:19.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 -- start start 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b7ab0 0x7f491806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49180cef80 0x7f49180b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49180b49f0 con 0x7f49180b4170 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49180b7e80 con 0x7f49180cef80 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f491d959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49180b45f0 con 0x7f49180b7ab0 2023-07-09T21:42:19.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49180cef80 0x7f49180b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f49180cef80 0x7f49180b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37560/0 (socket says 172.21.15.37:37560) 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 -- 172.21.15.37:0/1952577745 learned_addr learned my addr 172.21.15.37:0/1952577745 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f4916ffd640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b7ab0 0x7f491806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 -- 172.21.15.37:0/1952577745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b7ab0 msgr2=0x7f491806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b7ab0 0x7f491806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 -- 172.21.15.37:0/1952577745 >> v1:172.21.15.119:6789/0 conn(0x7f49180b4170 legacy=0x7f491815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.824+0000 7f490ffff640 1 -- 172.21.15.37:0/1952577745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49180cc8a0 con 0x7f49180cef80 2023-07-09T21:42:19.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f490ffff640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180cef80 0x7f49180b3c30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f4900009870 tx=0x7f490001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=729e70153528e2e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f49167fc640 1 -- 172.21.15.37:0/1952577745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000aa670 con 0x7f49180cef80 2023-07-09T21:42:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f49167fc640 1 -- 172.21.15.37:0/1952577745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000aa7d0 con 0x7f49180cef80 2023-07-09T21:42:19.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f49167fc640 1 -- 172.21.15.37:0/1952577745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000aab60 con 0x7f49180cef80 2023-07-09T21:42:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 -- 172.21.15.37:0/1952577745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180cef80 msgr2=0x7f49180b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180cef80 0x7f49180b3c30 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f4900009870 tx=0x7f490001c510 comp rx=0 tx=0).stop 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 -- 172.21.15.37:0/1952577745 shutdown_connections 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180cef80 0x7f49180b3c30 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 --2- 172.21.15.37:0/1952577745 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b7ab0 0x7f491806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 -- 172.21.15.37:0/1952577745 >> 172.21.15.37:0/1952577745 conn(0x7f4918073090 msgr2=0x7f4918069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 -- 172.21.15.37:0/1952577745 shutdown_connections 2023-07-09T21:42:19.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.828+0000 7f491d959640 1 -- 172.21.15.37:0/1952577745 wait complete. 2023-07-09T21:42:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 Processor -- start 2023-07-09T21:42:19.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- start start 2023-07-09T21:42:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b4170 0x7f49180c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49180cef80 0x7f491814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49180c6330 con 0x7f49180b7ab0 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4918149870 con 0x7f49180cef80 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4918157fb0 con 0x7f49180b4170 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37568/0 (socket says 172.21.15.37:37568) 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 -- 172.21.15.37:0/2806250788 learned_addr learned my addr 172.21.15.37:0/2806250788 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:19.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f4916ffd640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b4170 0x7f49180c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f49177fe640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49180cef80 0x7f491814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 -- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b4170 msgr2=0x7f49180c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b4170 0x7f49180c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 -- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49180cef80 msgr2=0x7f491814ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49180cef80 0x7f491814ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:19.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 -- 172.21.15.37:0/2806250788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49000094d0 con 0x7f49180b7ab0 2023-07-09T21:42:19.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f490ffff640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f49000ac040 tx=0x7f490001ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:19.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000b3800 con 0x7f49180b7ab0 2023-07-09T21:42:19.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49000b3980 con 0x7f49180b7ab0 2023-07-09T21:42:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49000b3d30 con 0x7f49180b7ab0 2023-07-09T21:42:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4918158290 con 0x7f49180b7ab0 2023-07-09T21:42:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.832+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49180c5fc0 con 0x7f49180b7ab0 2023-07-09T21:42:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49180c64a0 con 0x7f49180b7ab0 2023-07-09T21:42:19.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f49000b2380 con 0x7f49180b7ab0 2023-07-09T21:42:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f4914ff9640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 0x7f48f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f490011e580 con 0x7f49180b7ab0 2023-07-09T21:42:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f4916ffd640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 0x7f48f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:19.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.836+0000 7f4916ffd640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 0x7f48f8068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4908006aa0 tx=0x7f4908008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:19.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:19.840+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f49000ebc30 con 0x7f49180b7ab0 2023-07-09T21:42:20.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.044+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f491804d7d0 con 0x7f49180b7ab0 2023-07-09T21:42:20.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f4914ff9640 1 -- 172.21.15.37:0/2806250788 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f49000ef250 con 0x7f49180b7ab0 2023-07-09T21:42:20.048 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:20.048 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:42:20.048 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:42:20.048 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.048 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.049 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:42:20.050 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.051 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.052 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.053 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.054 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.054 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:42:20.054 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:42:20.054 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.055 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.055 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.055 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.056 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.056 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.056 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.056 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:42:20.057 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:42:20.057 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.057 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.057 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.058 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.058 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.058 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.059 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.059 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:42:20.059 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:42:20.060 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.060 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.060 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.060 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.061 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.061 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.061 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.062 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:42:20.062 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:42:20.062 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.062 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.062 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.063 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.063 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.063 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.063 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.064 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:42:20.064 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:42:20.064 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.064 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.065 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.065 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.065 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.065 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.065 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.066 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.067 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.068 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:42:20.069 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.070 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:42:20.071 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:42:20.072 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:42:20.073 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.074 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:42:20.075 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:42:20.076 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:42:20.077 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:42:20.078 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:42:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 msgr2=0x7f48f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 0x7f48f8068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4908006aa0 tx=0x7f4908008040 comp rx=0 tx=0).stop 2023-07-09T21:42:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 msgr2=0x7f4918147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f49000ac040 tx=0x7f490001ad50 comp rx=0 tx=0).stop 2023-07-09T21:42:20.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 shutdown_connections 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f48f80663a0 0x7f48f8068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f49180cef80 0x7f491814ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49180b7ab0 0x7f4918147720 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 --2- 172.21.15.37:0/2806250788 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f49180b4170 0x7f49180c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 >> 172.21.15.37:0/2806250788 conn(0x7f4918073090 msgr2=0x7f49180b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 shutdown_connections 2023-07-09T21:42:20.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.048+0000 7f491d959640 1 -- 172.21.15.37:0/2806250788 wait complete. 2023-07-09T21:42:20.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.224+0000 7f7c356bd640 1 Processor -- start 2023-07-09T21:42:20.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.224+0000 7f7c356bd640 1 -- start start 2023-07-09T21:42:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300b7ab0 0x7f7c3006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7c300cef80 0x7f7c300b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c300b4170 0x7f7c3015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300b7e80 con 0x7f7c300b4170 2023-07-09T21:42:20.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c300b45f0 con 0x7f7c300cef80 2023-07-09T21:42:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c356bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300b49f0 con 0x7f7c300b7ab0 2023-07-09T21:42:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c300b4170 0x7f7c3015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c300b4170 0x7f7c3015f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37574/0 (socket says 172.21.15.37:37574) 2023-07-09T21:42:20.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2809965686 learned_addr learned my addr 172.21.15.37:0/2809965686 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2effd640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300b7ab0 0x7f7c3006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c27fff640 1 --2- 172.21.15.37:0/2809965686 >> v2:172.21.15.119:3300/0 conn(0x7f7c300cef80 0x7f7c300b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2809965686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300b7ab0 msgr2=0x7f7c3006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300b7ab0 0x7f7c3006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2809965686 >> v2:172.21.15.119:3300/0 conn(0x7f7c300cef80 msgr2=0x7f7c300b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2809965686 >> v2:172.21.15.119:3300/0 conn(0x7f7c300cef80 0x7f7c300b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2809965686 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300cc8a0 con 0x7f7c300b4170 2023-07-09T21:42:20.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.228+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b4170 0x7f7c3015f490 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f7c3008b310 tx=0x7f7c2801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26b907efe0b7581 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c2e7fc640 1 -- 172.21.15.37:0/2809965686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a5560 con 0x7f7c300b4170 2023-07-09T21:42:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c2e7fc640 1 -- 172.21.15.37:0/2809965686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c280a56c0 con 0x7f7c300b4170 2023-07-09T21:42:20.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c2e7fc640 1 -- 172.21.15.37:0/2809965686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a5a50 con 0x7f7c300b4170 2023-07-09T21:42:20.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- 172.21.15.37:0/2809965686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b4170 msgr2=0x7f7c3015f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b4170 0x7f7c3015f490 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f7c3008b310 tx=0x7f7c2801c6e0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- 172.21.15.37:0/2809965686 shutdown_connections 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b4170 0x7f7c3015f490 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2809965686 >> v2:172.21.15.119:3300/0 conn(0x7f7c300cef80 0x7f7c300b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2809965686 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300b7ab0 0x7f7c3006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- 172.21.15.37:0/2809965686 >> 172.21.15.37:0/2809965686 conn(0x7f7c30073090 msgr2=0x7f7c30069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- 172.21.15.37:0/2809965686 shutdown_connections 2023-07-09T21:42:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- 172.21.15.37:0/2809965686 wait complete. 2023-07-09T21:42:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 Processor -- start 2023-07-09T21:42:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- start start 2023-07-09T21:42:20.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300b4170 0x7f7c3015b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 0x7f7c30157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3015ca10 con 0x7f7c300b7ab0 2023-07-09T21:42:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c300c85f0 con 0x7f7c300b4170 2023-07-09T21:42:20.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c356bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3015d2d0 con 0x7f7c300cef80 2023-07-09T21:42:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37590/0 (socket says 172.21.15.37:37590) 2023-07-09T21:42:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.232+0000 7f7c27fff640 1 -- 172.21.15.37:0/2609963643 learned_addr learned my addr 172.21.15.37:0/2609963643 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:20.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 0x7f7c30157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2effd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300b4170 0x7f7c3015b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300b4170 msgr2=0x7f7c3015b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300b4170 0x7f7c3015b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2609963643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 msgr2=0x7f7c30159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 -- 172.21.15.37:0/2609963643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c28009b30 con 0x7f7c300cef80 2023-07-09T21:42:20.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c27fff640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c2f7fe640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 0x7f7c30157800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ab000 tx=0x7f7c28019480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280a5560 con 0x7f7c300cef80 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c28009510 con 0x7f7c300cef80 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280b8690 con 0x7f7c300cef80 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c30159950 con 0x7f7c300cef80 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c30159f10 con 0x7f7c300cef80 2023-07-09T21:42:20.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3015d4a0 con 0x7f7c300cef80 2023-07-09T21:42:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7c280b87f0 con 0x7f7c300cef80 2023-07-09T21:42:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.236+0000 7f7c277fe640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 0x7f7c10068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.240+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f7c2811e770 con 0x7f7c300cef80 2023-07-09T21:42:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.240+0000 7f7c2effd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 0x7f7c10068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.240+0000 7f7c2effd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 0x7f7c10068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c301f79a0 tx=0x7f7c20009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.244+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7c3015d4a0 con 0x7f7c300cef80 2023-07-09T21:42:20.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.400+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c3015d4a0 con 0x7f7c300cef80 2023-07-09T21:42:20.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.400+0000 7f7c277fe640 1 -- 172.21.15.37:0/2609963643 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+14681 (secure 0 0 0) 0x7f7c3015d4a0 con 0x7f7c300cef80 2023-07-09T21:42:20.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":140,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:19.642533+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:20.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 msgr2=0x7f7c10068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 0x7f7c10068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c301f79a0 tx=0x7f7c20009190 comp rx=0 tx=0).stop 2023-07-09T21:42:20.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 msgr2=0x7f7c30157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 0x7f7c30157800 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c280ab000 tx=0x7f7c28019480 comp rx=0 tx=0).stop 2023-07-09T21:42:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 shutdown_connections 2023-07-09T21:42:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f7c100663a0 0x7f7c10068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7c300cef80 0x7f7c30157800 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c300b7ab0 0x7f7c30159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 --2- 172.21.15.37:0/2609963643 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7c300b4170 0x7f7c3015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 >> 172.21.15.37:0/2609963643 conn(0x7f7c30073090 msgr2=0x7f7c300b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 shutdown_connections 2023-07-09T21:42:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.404+0000 7f7c356bd640 1 -- 172.21.15.37:0/2609963643 wait complete. 2023-07-09T21:42:20.423 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:42:20.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:42:20.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.568+0000 7f59c958f640 1 Processor -- start 2023-07-09T21:42:20.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.568+0000 7f59c958f640 1 -- start start 2023-07-09T21:42:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c958f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f59c40b7980 0x7f59c4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c958f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 0x7f59c40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c958f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c415bf80 con 0x7f59c40ceb80 2023-07-09T21:42:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c958f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40cd070 con 0x7f59c40b7980 2023-07-09T21:42:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c958f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c40cfd70 con 0x7f59c40d0780 2023-07-09T21:42:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59bbfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f59c40ceb80 0x7f59c40cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39230/0 (socket says 172.21.15.37:39230) 2023-07-09T21:42:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59bbfff640 1 -- 172.21.15.37:0/3561168117 learned_addr learned my addr 172.21.15.37:0/3561168117 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:20.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/3561168117 >> v2:172.21.15.37:3300/0 conn(0x7f59c40b7980 0x7f59c4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c37fe640 1 --2- 172.21.15.37:0/3561168117 >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 0x7f59c40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 -- 172.21.15.37:0/3561168117 >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 msgr2=0x7f59c40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/3561168117 >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 0x7f59c40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c27fc640 1 -- 172.21.15.37:0/3561168117 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405368617 0 0) 0x7f59ac001120 con 0x7f59c40ceb80 2023-07-09T21:42:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 -- 172.21.15.37:0/3561168117 >> v1:172.21.15.37:6789/0 conn(0x7f59c40ceb80 legacy=0x7f59c40cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 -- 172.21.15.37:0/3561168117 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c4160570 con 0x7f59c40b7980 2023-07-09T21:42:20.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c37fe640 1 --2- 172.21.15.37:0/3561168117 >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 0x7f59c40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/3561168117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40b7980 0x7f59c4160030 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f59c40b1240 tx=0x7f59b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0489d3e9da13ff server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c27fc640 1 -- 172.21.15.37:0/3561168117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab600 con 0x7f59c40b7980 2023-07-09T21:42:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c27fc640 1 -- 172.21.15.37:0/3561168117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a7050 con 0x7f59c40b7980 2023-07-09T21:42:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.572+0000 7f59c27fc640 1 -- 172.21.15.37:0/3561168117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab980 con 0x7f59c40b7980 2023-07-09T21:42:20.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- 172.21.15.37:0/3561168117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40b7980 msgr2=0x7f59c4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- 172.21.15.37:0/3561168117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40b7980 0x7f59c4160030 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f59c40b1240 tx=0x7f59b401c460 comp rx=0 tx=0).stop 2023-07-09T21:42:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- 172.21.15.37:0/3561168117 shutdown_connections 2023-07-09T21:42:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- 172.21.15.37:0/3561168117 >> v2:172.21.15.119:3300/0 conn(0x7f59c40d0780 0x7f59c40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- 172.21.15.37:0/3561168117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40b7980 0x7f59c4160030 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- 172.21.15.37:0/3561168117 >> 172.21.15.37:0/3561168117 conn(0x7f59c4073090 msgr2=0x7f59c4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- 172.21.15.37:0/3561168117 shutdown_connections 2023-07-09T21:42:20.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- 172.21.15.37:0/3561168117 wait complete. 2023-07-09T21:42:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 Processor -- start 2023-07-09T21:42:20.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- start start 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b7980 0x7f59c40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40d0780 0x7f59c4157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40ca9e0 con 0x7f59c40ceb80 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c40b4b30 con 0x7f59c40b7980 2023-07-09T21:42:20.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c958f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c415ba70 con 0x7f59c40d0780 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37610/0 (socket says 172.21.15.37:37610) 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59bbfff640 1 -- 172.21.15.37:0/268019363 learned_addr learned my addr 172.21.15.37:0/268019363 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c37fe640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40d0780 0x7f59c4157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.576+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b7980 0x7f59c40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 -- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40d0780 msgr2=0x7f59c4157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40d0780 0x7f59c4157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 -- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b7980 msgr2=0x7f59c40caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b7980 0x7f59c40caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 -- 172.21.15.37:0/268019363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009420 con 0x7f59c40ceb80 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bbfff640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c780 tx=0x7f59ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0072d0 con 0x7f59c40ceb80 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac007450 con 0x7f59c40ceb80 2023-07-09T21:42:20.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0047f0 con 0x7f59c40ceb80 2023-07-09T21:42:20.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c4159a70 con 0x7f59c40ceb80 2023-07-09T21:42:20.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c415a030 con 0x7f59c40ceb80 2023-07-09T21:42:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c404d7d0 con 0x7f59c40ceb80 2023-07-09T21:42:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f59ac004950 con 0x7f59c40ceb80 2023-07-09T21:42:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 0x7f59a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.580+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f59ac082bb0 con 0x7f59c40ceb80 2023-07-09T21:42:20.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.584+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 0x7f59a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.584+0000 7f59c2ffd640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 0x7f59a4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ad000 tx=0x7f59b40a6000 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.584+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f59ac050240 con 0x7f59c40ceb80 2023-07-09T21:42:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.740+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59c415bf80 con 0x7f59c40ceb80 2023-07-09T21:42:20.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.740+0000 7f59bb7fe640 1 -- 172.21.15.37:0/268019363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f59c415bf80 con 0x7f59c40ceb80 2023-07-09T21:42:20.742 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:42:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 msgr2=0x7f59a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 0x7f59a4068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f59b40ad000 tx=0x7f59b40a6000 comp rx=0 tx=0).stop 2023-07-09T21:42:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 msgr2=0x7f59c4157820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00c780 tx=0x7f59ac00cc40 comp rx=0 tx=0).stop 2023-07-09T21:42:20.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 shutdown_connections 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f59a40663a0 0x7f59a4068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f59c40d0780 0x7f59c4157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59c40ceb80 0x7f59c4157820 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 --2- 172.21.15.37:0/268019363 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f59c40b7980 0x7f59c40caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 >> 172.21.15.37:0/268019363 conn(0x7f59c4073090 msgr2=0x7f59c415dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 shutdown_connections 2023-07-09T21:42:20.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.744+0000 7f59c958f640 1 -- 172.21.15.37:0/268019363 wait complete. 2023-07-09T21:42:20.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:42:20.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 Processor -- start 2023-07-09T21:42:20.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 -- start start 2023-07-09T21:42:20.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 0x7ff5b0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5b00d0780 0x7ff5b00d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5b015bf80 con 0x7ff5b00b7980 2023-07-09T21:42:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5b00cd070 con 0x7ff5b00d0780 2023-07-09T21:42:20.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b7dac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b00cfd70 con 0x7ff5b00cf290 2023-07-09T21:42:20.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b5b48640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5b00b7980 0x7ff5b00ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39246/0 (socket says 172.21.15.37:39246) 2023-07-09T21:42:20.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b5b48640 1 -- 172.21.15.37:0/643915679 learned_addr learned my addr 172.21.15.37:0/643915679 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:20.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b6349640 1 --2- 172.21.15.37:0/643915679 >> v2:172.21.15.119:3300/0 conn(0x7ff5b00d0780 0x7ff5b00d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b5347640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 0x7ff5b0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3929873218 0 0) 0x7ff5ac001120 con 0x7ff5b00b7980 2023-07-09T21:42:20.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff59c003530 con 0x7ff5b00b7980 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b6349640 1 -- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 msgr2=0x7ff5b0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b6349640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 0x7ff5b0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543761485 0 0) 0x7ff59c003530 con 0x7ff5b00b7980 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b6349640 1 -- 172.21.15.37:0/643915679 >> v1:172.21.15.37:6789/0 conn(0x7ff5b00b7980 legacy=0x7ff5b00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b6349640 1 -- 172.21.15.37:0/643915679 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0160570 con 0x7ff5b00d0780 2023-07-09T21:42:20.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.908+0000 7ff5b5347640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 0x7ff5b0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:20.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b6349640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00d0780 0x7ff5b00d0c00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a801c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0a95ee23c86dc52 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac001810 con 0x7ff5b00d0780 2023-07-09T21:42:20.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a80a6480 con 0x7ff5b00d0780 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b4b46640 1 -- 172.21.15.37:0/643915679 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80a6810 con 0x7ff5b00d0780 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 -- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00d0780 msgr2=0x7ff5b00d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00d0780 0x7ff5b00d0c00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a801c870 comp rx=0 tx=0).stop 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 -- 172.21.15.37:0/643915679 shutdown_connections 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00d0780 0x7ff5b00d0c00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/643915679 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00cf290 0x7ff5b0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 -- 172.21.15.37:0/643915679 >> 172.21.15.37:0/643915679 conn(0x7ff5b0073090 msgr2=0x7ff5b0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 -- 172.21.15.37:0/643915679 shutdown_connections 2023-07-09T21:42:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.912+0000 7ff5b7dac640 1 -- 172.21.15.37:0/643915679 wait complete. 2023-07-09T21:42:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 Processor -- start 2023-07-09T21:42:20.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 -- start start 2023-07-09T21:42:20.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00b7980 0x7ff5b0153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 0x7ff5b015aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b014fb10 con 0x7ff5b00d0780 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b015af90 con 0x7ff5b00cf290 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5b014ee90 con 0x7ff5b00b7980 2023-07-09T21:42:20.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37620/0 (socket says 172.21.15.37:37620) 2023-07-09T21:42:20.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 -- 172.21.15.37:0/1210314615 learned_addr learned my addr 172.21.15.37:0/1210314615 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:20.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b5347640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 0x7ff5b015aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b5b48640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00b7980 0x7ff5b0153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 -- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00b7980 msgr2=0x7ff5b0153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00b7980 0x7ff5b0153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 -- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 msgr2=0x7ff5b015aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 0x7ff5b015aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 -- 172.21.15.37:0/1210314615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a0009420 con 0x7ff5b00d0780 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b5347640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 0x7ff5b015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:20.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b6349640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a8019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80b7070 con 0x7ff5b00d0780 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a80a6e10 con 0x7ff5b00d0780 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a80a78b0 con 0x7ff5b00d0780 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.916+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a8009a70 con 0x7ff5b00d0780 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5b014f450 con 0x7ff5b00d0780 2023-07-09T21:42:20.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5b014fc50 con 0x7ff5b00d0780 2023-07-09T21:42:20.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5a80a7a10 con 0x7ff5b00d0780 2023-07-09T21:42:20.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5a67fc640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 0x7ff594068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:20.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7ff5a811e1a0 con 0x7ff5b00d0780 2023-07-09T21:42:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.920+0000 7ff5b5b48640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 0x7ff594068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:20.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.924+0000 7ff5b5b48640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 0x7ff594068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac001ec0 tx=0x7ff5ac009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:20.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:20.924+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5b014fc50 con 0x7ff5b00d0780 2023-07-09T21:42:21.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.080+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff5b00737d0 con 0x7ff5b00d0780 2023-07-09T21:42:21.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.080+0000 7ff5a67fc640 1 -- 172.21.15.37:0/1210314615 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v140) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff5b00737d0 con 0x7ff5b00d0780 2023-07-09T21:42:21.082 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:42:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 msgr2=0x7ff594068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 0x7ff594068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac001ec0 tx=0x7ff5ac009040 comp rx=0 tx=0).stop 2023-07-09T21:42:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 msgr2=0x7ff5b01515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009d90 tx=0x7ff5a8019610 comp rx=0 tx=0).stop 2023-07-09T21:42:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 shutdown_connections 2023-07-09T21:42:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff5940663a0 0x7ff594068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b00d0780 0x7ff5b01515b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5b00cf290 0x7ff5b015aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 --2- 172.21.15.37:0/1210314615 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5b00b7980 0x7ff5b0153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 >> 172.21.15.37:0/1210314615 conn(0x7ff5b0073090 msgr2=0x7ff5b015f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:21.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 shutdown_connections 2023-07-09T21:42:21.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.084+0000 7ff5b7dac640 1 -- 172.21.15.37:0/1210314615 wait complete. 2023-07-09T21:42:21.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:42:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 Processor -- start 2023-07-09T21:42:21.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 -- start start 2023-07-09T21:42:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9c780b7ab0 0x7f9c7806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c780b49f0 con 0x7f9c780b4170 2023-07-09T21:42:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c780b7e80 con 0x7f9c780b7ab0 2023-07-09T21:42:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7cd59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b4610 con 0x7f9c780cef80 2023-07-09T21:42:21.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:38396/0 (socket says 172.21.15.37:38396) 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 -- 172.21.15.37:0/730470988 learned_addr learned my addr 172.21.15.37:0/730470988 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c7659c640 1 --2- 172.21.15.37:0/730470988 >> v2:172.21.15.119:3300/0 conn(0x7f9c780b7ab0 0x7f9c7806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 -- 172.21.15.37:0/730470988 >> v2:172.21.15.119:3300/0 conn(0x7f9c780b7ab0 msgr2=0x7f9c7806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 --2- 172.21.15.37:0/730470988 >> v2:172.21.15.119:3300/0 conn(0x7f9c780b7ab0 0x7f9c7806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 -- 172.21.15.37:0/730470988 >> v1:172.21.15.119:6789/0 conn(0x7f9c780b4170 legacy=0x7f9c7815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.248+0000 7f9c75d9b640 1 -- 172.21.15.37:0/730470988 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c780cc8a0 con 0x7f9c780cef80 2023-07-09T21:42:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c75d9b640 1 --2- 172.21.15.37:0/730470988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009870 tx=0x7f9c6c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4a4b3b1bf937210 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7559a640 1 -- 172.21.15.37:0/730470988 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0aa670 con 0x7f9c780cef80 2023-07-09T21:42:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7559a640 1 -- 172.21.15.37:0/730470988 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0aa7d0 con 0x7f9c780cef80 2023-07-09T21:42:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7559a640 1 -- 172.21.15.37:0/730470988 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0aab60 con 0x7f9c780cef80 2023-07-09T21:42:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 -- 172.21.15.37:0/730470988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 msgr2=0x7f9c780b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/730470988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009870 tx=0x7f9c6c01c510 comp rx=0 tx=0).stop 2023-07-09T21:42:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 -- 172.21.15.37:0/730470988 shutdown_connections 2023-07-09T21:42:21.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/730470988 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780cef80 0x7f9c780b3c30 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/730470988 >> v2:172.21.15.119:3300/0 conn(0x7f9c780b7ab0 0x7f9c7806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 -- 172.21.15.37:0/730470988 >> 172.21.15.37:0/730470988 conn(0x7f9c78073090 msgr2=0x7f9c78069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 -- 172.21.15.37:0/730470988 shutdown_connections 2023-07-09T21:42:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.252+0000 7f9c7cd59640 1 -- 172.21.15.37:0/730470988 wait complete. 2023-07-09T21:42:21.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 Processor -- start 2023-07-09T21:42:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- start start 2023-07-09T21:42:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c780b4170 0x7f9c7814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780b7ab0 0x7f9c78149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7814ba90 con 0x7f9c780cef80 2023-07-09T21:42:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b6df0 con 0x7f9c780b4170 2023-07-09T21:42:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c780b6830 con 0x7f9c780b7ab0 2023-07-09T21:42:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c75d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780b7ab0 0x7f9c78149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37634/0 (socket says 172.21.15.37:37634) 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 -- 172.21.15.37:0/3925077177 learned_addr learned my addr 172.21.15.37:0/3925077177 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7659c640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c780b4170 0x7f9c7814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 -- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780b7ab0 msgr2=0x7f9c78149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780b7ab0 0x7f9c78149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 -- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c780b4170 msgr2=0x7f9c7814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c780b4170 0x7f9c7814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 -- 172.21.15.37:0/3925077177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c0094d0 con 0x7f9c780cef80 2023-07-09T21:42:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c76d9d640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c730 tx=0x7f9c7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70003b80 con 0x7f9c780cef80 2023-07-09T21:42:21.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70003ce0 con 0x7f9c780cef80 2023-07-09T21:42:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000aa30 con 0x7f9c780cef80 2023-07-09T21:42:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c780b6b10 con 0x7f9c780cef80 2023-07-09T21:42:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.256+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7814ab50 con 0x7f9c780cef80 2023-07-09T21:42:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7814ad40 con 0x7f9c780cef80 2023-07-09T21:42:21.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9c7000ab90 con 0x7f9c780cef80 2023-07-09T21:42:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c66ffd640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 0x7f9c58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f9c700837f0 con 0x7f9c780cef80 2023-07-09T21:42:21.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c7659c640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 0x7f9c58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.260+0000 7f9c7659c640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 0x7f9c58068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c780651d0 tx=0x7f9c68009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.264+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c70050f30 con 0x7f9c780cef80 2023-07-09T21:42:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.424+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9c7804d7d0 con 0x7f9c780cef80 2023-07-09T21:42:21.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.424+0000 7f9c66ffd640 1 -- 172.21.15.37:0/3925077177 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v140) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9c70054550 con 0x7f9c780cef80 2023-07-09T21:42:21.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:21.426 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:42:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:42:21.427 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:21.427 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 msgr2=0x7f9c58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 0x7f9c58068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9c780651d0 tx=0x7f9c68009190 comp rx=0 tx=0).stop 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 msgr2=0x7f9c780ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c730 tx=0x7f9c7000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 shutdown_connections 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f9c580663a0 0x7f9c58068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c780cef80 0x7f9c780ca5c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9c780b7ab0 0x7f9c78149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 --2- 172.21.15.37:0/3925077177 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9c780b4170 0x7f9c7814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 >> 172.21.15.37:0/3925077177 conn(0x7f9c78073090 msgr2=0x7f9c780b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 shutdown_connections 2023-07-09T21:42:21.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.428+0000 7f9c7cd59640 1 -- 172.21.15.37:0/3925077177 wait complete. 2023-07-09T21:42:21.447 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:42:21.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 Processor -- start 2023-07-09T21:42:21.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 -- start start 2023-07-09T21:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8840160030 0x7f88400d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884015bf80 con 0x7f88400cf290 2023-07-09T21:42:21.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400d02f0 con 0x7f88400b7980 2023-07-09T21:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8847959640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88400cd070 con 0x7f8840160030 2023-07-09T21:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8844ef4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88400cf290 0x7f88400d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39258/0 (socket says 172.21.15.37:39258) 2023-07-09T21:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8844ef4640 1 -- 172.21.15.37:0/397741571 learned_addr learned my addr 172.21.15.37:0/397741571 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:21.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8845ef6640 1 --2- 172.21.15.37:0/397741571 >> v2:172.21.15.37:3300/0 conn(0x7f8840160030 0x7f88400d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934758403 0 0) 0x7f8830001120 con 0x7f88400cf290 2023-07-09T21:42:21.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f882c003530 con 0x7f88400cf290 2023-07-09T21:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187037546 0 0) 0x7f88400d02f0 con 0x7f88400b7980 2023-07-09T21:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8845ef6640 1 -- 172.21.15.37:0/397741571 >> v1:172.21.15.119:6789/0 conn(0x7f88400b7980 legacy=0x7f88400ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8845ef6640 1 -- 172.21.15.37:0/397741571 >> v1:172.21.15.37:6789/0 conn(0x7f88400cf290 legacy=0x7f88400d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.596+0000 7f8845ef6640 1 -- 172.21.15.37:0/397741571 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400cc7f0 con 0x7f8840160030 2023-07-09T21:42:21.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8845ef6640 1 --2- 172.21.15.37:0/397741571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88400d0e90 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8838009d90 tx=0x7f883801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7bf53b7454c2c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380a5810 con 0x7f8840160030 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88380a5970 con 0x7f8840160030 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8837fff640 1 -- 172.21.15.37:0/397741571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380a5d00 con 0x7f8840160030 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 -- 172.21.15.37:0/397741571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 msgr2=0x7f88400d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 --2- 172.21.15.37:0/397741571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88400d0e90 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f8838009d90 tx=0x7f883801c950 comp rx=0 tx=0).stop 2023-07-09T21:42:21.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 -- 172.21.15.37:0/397741571 shutdown_connections 2023-07-09T21:42:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 --2- 172.21.15.37:0/397741571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88400d0e90 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 -- 172.21.15.37:0/397741571 >> 172.21.15.37:0/397741571 conn(0x7f8840073090 msgr2=0x7f8840069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 -- 172.21.15.37:0/397741571 shutdown_connections 2023-07-09T21:42:21.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.600+0000 7f8847959640 1 -- 172.21.15.37:0/397741571 wait complete. 2023-07-09T21:42:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 Processor -- start 2023-07-09T21:42:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- start start 2023-07-09T21:42:21.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88400b7980 0x7f8840148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88400cf290 0x7f884014bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840148680 con 0x7f8840160030 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840156380 con 0x7f88400b7980 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8840153c70 con 0x7f88400cf290 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37646/0 (socket says 172.21.15.37:37646) 2023-07-09T21:42:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 -- 172.21.15.37:0/274420663 learned_addr learned my addr 172.21.15.37:0/274420663 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f88456f5640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88400b7980 0x7f8840148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8844ef4640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88400cf290 0x7f884014bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 -- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88400cf290 msgr2=0x7f884014bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88400cf290 0x7f884014bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 -- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88400b7980 msgr2=0x7f8840148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88400b7980 0x7f8840148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 -- 172.21.15.37:0/274420663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838009a70 con 0x7f8840160030 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8845ef6640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f883801ce30 tx=0x7f88400d1be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380be070 con 0x7f8840160030 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88380ad440 con 0x7f8840160030 2023-07-09T21:42:21.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88380ad810 con 0x7f8840160030 2023-07-09T21:42:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88401f7f10 con 0x7f8840160030 2023-07-09T21:42:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8840153900 con 0x7f8840160030 2023-07-09T21:42:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.604+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8840153de0 con 0x7f8840160030 2023-07-09T21:42:21.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.608+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f88380b4040 con 0x7f8840160030 2023-07-09T21:42:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.608+0000 7f8835ffb640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 0x7f8824068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:21.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.608+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f883811dca0 con 0x7f8840160030 2023-07-09T21:42:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.608+0000 7f88456f5640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 0x7f8824068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.608+0000 7f88456f5640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 0x7f8824068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f883c000f70 tx=0x7f883c009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:21.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.612+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88380eb2a0 con 0x7f8840160030 2023-07-09T21:42:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:21.768+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f884004d7d0 con 0x7f8840160030 2023-07-09T21:42:22.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.288+0000 7f8835ffb640 1 -- 172.21.15.37:0/274420663 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v141) v1 ==== 138+0+0 (secure 0 0 0) 0x7f88380ee8c0 con 0x7f8840160030 2023-07-09T21:42:22.289 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 msgr2=0x7f8824068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 0x7f8824068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f883c000f70 tx=0x7f883c009040 comp rx=0 tx=0).stop 2023-07-09T21:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 msgr2=0x7f88401f7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f883801ce30 tx=0x7f88400d1be0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 shutdown_connections 2023-07-09T21:42:22.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f88240663a0 0x7f8824068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8840160030 0x7f88401f7490 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88400cf290 0x7f884014bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 --2- 172.21.15.37:0/274420663 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88400b7980 0x7f8840148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.292+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 >> 172.21.15.37:0/274420663 conn(0x7f8840073090 msgr2=0x7f88400cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.296+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 shutdown_connections 2023-07-09T21:42:22.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.296+0000 7f8847959640 1 -- 172.21.15.37:0/274420663 wait complete. 2023-07-09T21:42:22.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:42:22.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 Processor -- start 2023-07-09T21:42:22.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 -- start start 2023-07-09T21:42:22.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2a400b7980 0x7f2a40160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 0x7f2a400cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4015bf80 con 0x7f2a400b3c20 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a400cd070 con 0x7f2a400b7980 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a4547b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a400cfd70 con 0x7f2a400ceb80 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a3f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2a400b3c20 0x7f2a400b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39264/0 (socket says 172.21.15.37:39264) 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a3f7fe640 1 -- 172.21.15.37:0/3901783591 learned_addr learned my addr 172.21.15.37:0/3901783591 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:22.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a3effd640 1 --2- 172.21.15.37:0/3901783591 >> v2:172.21.15.119:3300/0 conn(0x7f2a400b7980 0x7f2a40160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a37fff640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 0x7f2a400cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a3e7fc640 1 -- 172.21.15.37:0/3901783591 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235208475 0 0) 0x7f2a380014a0 con 0x7f2a400b3c20 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.468+0000 7f2a3e7fc640 1 -- 172.21.15.37:0/3901783591 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a2c003530 con 0x7f2a400b3c20 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3effd640 1 -- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 msgr2=0x7f2a400cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3effd640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 0x7f2a400cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3effd640 1 -- 172.21.15.37:0/3901783591 >> v1:172.21.15.37:6789/0 conn(0x7f2a400b3c20 legacy=0x7f2a400b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3effd640 1 -- 172.21.15.37:0/3901783591 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40160570 con 0x7f2a400b7980 2023-07-09T21:42:22.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a37fff640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 0x7f2a400cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:22.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3effd640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b7980 0x7f2a40160030 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097c0 tx=0x7f2a3001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7841a19658e056d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3e7fc640 1 -- 172.21.15.37:0/3901783591 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a300ab600 con 0x7f2a400b7980 2023-07-09T21:42:22.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3e7fc640 1 -- 172.21.15.37:0/3901783591 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a300a7050 con 0x7f2a400b7980 2023-07-09T21:42:22.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a3e7fc640 1 -- 172.21.15.37:0/3901783591 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a300ab980 con 0x7f2a400b7980 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a4547b640 1 -- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b7980 msgr2=0x7f2a40160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.472+0000 7f2a4547b640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b7980 0x7f2a40160030 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f2a300097c0 tx=0x7f2a3001c480 comp rx=0 tx=0).stop 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- 172.21.15.37:0/3901783591 shutdown_connections 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400ceb80 0x7f2a400cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 --2- 172.21.15.37:0/3901783591 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b7980 0x7f2a40160030 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- 172.21.15.37:0/3901783591 >> 172.21.15.37:0/3901783591 conn(0x7f2a40073090 msgr2=0x7f2a40069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:22.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- 172.21.15.37:0/3901783591 shutdown_connections 2023-07-09T21:42:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- 172.21.15.37:0/3901783591 wait complete. 2023-07-09T21:42:22.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 Processor -- start 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- start start 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 0x7f2a4015a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 0x7f2a400b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015bcd0 con 0x7f2a400ceb80 2023-07-09T21:42:22.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4015a330 con 0x7f2a400b3c20 2023-07-09T21:42:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a4547b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a40159a00 con 0x7f2a400b7980 2023-07-09T21:42:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37656/0 (socket says 172.21.15.37:37656) 2023-07-09T21:42:22.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 -- 172.21.15.37:0/169154966 learned_addr learned my addr 172.21.15.37:0/169154966 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3effd640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 0x7f2a4015a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 -- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 msgr2=0x7f2a400b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a37fff640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 0x7f2a400b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 0x7f2a400b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 -- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 msgr2=0x7f2a4015a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 0x7f2a4015a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 -- 172.21.15.37:0/169154966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a28009420 con 0x7f2a400ceb80 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3effd640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 0x7f2a4015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a37fff640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 0x7f2a400b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:22.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.476+0000 7f2a3f7fe640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800cae0 tx=0x7f2a3800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3800ac40 con 0x7f2a400ceb80 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3800ada0 con 0x7f2a400ceb80 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a30009420 con 0x7f2a400ceb80 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a38012620 con 0x7f2a400ceb80 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a40159fc0 con 0x7f2a400ceb80 2023-07-09T21:42:22.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4015a4c0 con 0x7f2a400ceb80 2023-07-09T21:42:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2a38007070 con 0x7f2a400ceb80 2023-07-09T21:42:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 0x7f2a20068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5608+0+0 (secure 0 0 0) 0x7f2a38083f20 con 0x7f2a400ceb80 2023-07-09T21:42:22.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.480+0000 7f2a3effd640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 0x7f2a20068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:22.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.484+0000 7f2a3effd640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 0x7f2a20068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a300ad000 tx=0x7f2a30008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:22.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.484+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2a38054f50 con 0x7f2a400ceb80 2023-07-09T21:42:22.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:22.640+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2a4004d7d0 con 0x7f2a400ceb80 2023-07-09T21:42:23.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.296+0000 7f2a377fe640 1 -- 172.21.15.37:0/169154966 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v142) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2a38001b80 con 0x7f2a400ceb80 2023-07-09T21:42:23.297 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:42:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 msgr2=0x7f2a20068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 0x7f2a20068880 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2a300ad000 tx=0x7f2a30008040 comp rx=0 tx=0).stop 2023-07-09T21:42:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 msgr2=0x7f2a400b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:23.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f2a3800cae0 tx=0x7f2a3800a060 comp rx=0 tx=0).stop 2023-07-09T21:42:23.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 shutdown_connections 2023-07-09T21:42:23.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f2a200663d0 0x7f2a20068880 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2a400ceb80 0x7f2a400b2140 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2a400b7980 0x7f2a400b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 --2- 172.21.15.37:0/169154966 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2a400b3c20 0x7f2a4015a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 >> 172.21.15.37:0/169154966 conn(0x7f2a40073090 msgr2=0x7f2a400b5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:23.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 shutdown_connections 2023-07-09T21:42:23.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.308+0000 7f2a4547b640 1 -- 172.21.15.37:0/169154966 wait complete. 2023-07-09T21:42:23.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:42:23.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.484+0000 7f81a9434640 1 Processor -- start 2023-07-09T21:42:23.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.484+0000 7f81a9434640 1 -- start start 2023-07-09T21:42:23.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a9434640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a9434640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a9434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a415bf80 con 0x7f81a40b7980 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a9434640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40cd070 con 0x7f81a40cf290 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a9434640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40cfd70 con 0x7f81a40d0780 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37672/0 (socket says 172.21.15.37:37672) 2023-07-09T21:42:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 -- 172.21.15.37:0/3828110393 learned_addr learned my addr 172.21.15.37:0/3828110393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a37fe640 1 --2- 172.21.15.37:0/3828110393 >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 -- 172.21.15.37:0/3828110393 >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 msgr2=0x7f81a40d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 --2- 172.21.15.37:0/3828110393 >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 -- 172.21.15.37:0/3828110393 >> v1:172.21.15.119:6789/0 conn(0x7f81a40b7980 legacy=0x7f81a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f819bfff640 1 -- 172.21.15.37:0/3828110393 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4160570 con 0x7f81a40cf290 2023-07-09T21:42:23.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.488+0000 7f81a37fe640 1 --2- 172.21.15.37:0/3828110393 >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f819bfff640 1 --2- 172.21.15.37:0/3828110393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a4160030 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f81a40b1240 tx=0x7f818c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d80921e11f09ab4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a27fc640 1 -- 172.21.15.37:0/3828110393 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0ab600 con 0x7f81a40cf290 2023-07-09T21:42:23.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a27fc640 1 -- 172.21.15.37:0/3828110393 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c0a7050 con 0x7f81a40cf290 2023-07-09T21:42:23.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a27fc640 1 -- 172.21.15.37:0/3828110393 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c0ab980 con 0x7f81a40cf290 2023-07-09T21:42:23.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- 172.21.15.37:0/3828110393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 msgr2=0x7f81a4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:23.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 --2- 172.21.15.37:0/3828110393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a4160030 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f81a40b1240 tx=0x7f818c01c4c0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- 172.21.15.37:0/3828110393 shutdown_connections 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 --2- 172.21.15.37:0/3828110393 >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 --2- 172.21.15.37:0/3828110393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- 172.21.15.37:0/3828110393 >> 172.21.15.37:0/3828110393 conn(0x7f81a4073090 msgr2=0x7f81a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- 172.21.15.37:0/3828110393 shutdown_connections 2023-07-09T21:42:23.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- 172.21.15.37:0/3828110393 wait complete. 2023-07-09T21:42:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 Processor -- start 2023-07-09T21:42:23.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.492+0000 7f81a9434640 1 -- start start 2023-07-09T21:42:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a414ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40cf290 0x7f81a414f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a414fe00 con 0x7f81a40d0780 2023-07-09T21:42:23.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41500e0 con 0x7f81a40cf290 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a41503c0 con 0x7f81a40b7980 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a414ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37686/0 (socket says 172.21.15.37:37686) 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 -- 172.21.15.37:0/1978336760 learned_addr learned my addr 172.21.15.37:0/1978336760 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:23.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f819bfff640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40cf290 0x7f81a414f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 -- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 msgr2=0x7f81a414ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a414ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 -- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40cf290 msgr2=0x7f81a414f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40cf290 0x7f81a414f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 -- 172.21.15.37:0/1978336760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094d0 con 0x7f81a40d0780 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a37fe640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f819c00cd50 tx=0x7f819c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00f680 con 0x7f81a40d0780 2023-07-09T21:42:23.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00f800 con 0x7f81a40d0780 2023-07-09T21:42:23.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c00fbb0 con 0x7f81a40d0780 2023-07-09T21:42:23.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a41506a0 con 0x7f81a40d0780 2023-07-09T21:42:23.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a40ca550 con 0x7f81a40d0780 2023-07-09T21:42:23.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.496+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a40ca7a0 con 0x7f81a40d0780 2023-07-09T21:42:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.500+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f819c00b040 con 0x7f81a40d0780 2023-07-09T21:42:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.500+0000 7f819b7fe640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 0x7f8184068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.500+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5990+0+0 (secure 0 0 0) 0x7f819c084920 con 0x7f81a40d0780 2023-07-09T21:42:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.500+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 0x7f8184068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:23.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.500+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 0x7f8184068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81a4166920 tx=0x7f8194007e40 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:23.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.504+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f819c051ce0 con 0x7f81a40d0780 2023-07-09T21:42:23.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:23.688+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f81a404d7d0 con 0x7f81a40d0780 2023-07-09T21:42:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.316+0000 7f819b7fe640 1 -- 172.21.15.37:0/1978336760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f819c055300 con 0x7f81a40d0780 2023-07-09T21:42:24.327 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 17 and data pool 18 2023-07-09T21:42:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.328+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 msgr2=0x7f8184068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.328+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 0x7f8184068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f81a4166920 tx=0x7f8194007e40 comp rx=0 tx=0).stop 2023-07-09T21:42:24.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 msgr2=0x7f81a415c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f819c00cd50 tx=0x7f819c00a650 comp rx=0 tx=0).stop 2023-07-09T21:42:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 shutdown_connections 2023-07-09T21:42:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f81840663a0 0x7f8184068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40d0780 0x7f81a415c6e0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40cf290 0x7f81a414f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 --2- 172.21.15.37:0/1978336760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a414ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 >> 172.21.15.37:0/1978336760 conn(0x7f81a4073090 msgr2=0x7f81a415f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 shutdown_connections 2023-07-09T21:42:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.332+0000 7f81a9434640 1 -- 172.21.15.37:0/1978336760 wait complete. 2023-07-09T21:42:24.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 Processor -- start 2023-07-09T21:42:24.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 -- start start 2023-07-09T21:42:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11300b7ab0 0x7f113006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11300b49f0 con 0x7f11300cef80 2023-07-09T21:42:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11300b7e80 con 0x7f11300b7ab0 2023-07-09T21:42:24.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f1135140640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300cc8a0 con 0x7f11300b4340 2023-07-09T21:42:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112e59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f11300cef80 0x7f11300b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:42666/0 (socket says 172.21.15.37:42666) 2023-07-09T21:42:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112ed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f11300b7ab0 0x7f113006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112e59c640 1 -- 172.21.15.37:0/1551383246 learned_addr learned my addr 172.21.15.37:0/1551383246 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:38444/0 (socket says 172.21.15.37:38444) 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112dd9b640 1 -- 172.21.15.37:0/1551383246 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938475283 0 0) 0x7f11300b49f0 con 0x7f11300cef80 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112dd9b640 1 -- 172.21.15.37:0/1551383246 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1118003530 con 0x7f11300cef80 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 -- 172.21.15.37:0/1551383246 >> v2:172.21.15.119:3300/0 conn(0x7f11300b7ab0 msgr2=0x7f113006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 --2- 172.21.15.37:0/1551383246 >> v2:172.21.15.119:3300/0 conn(0x7f11300b7ab0 0x7f113006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 -- 172.21.15.37:0/1551383246 >> v1:172.21.15.119:6789/0 conn(0x7f11300cef80 legacy=0x7f11300b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.504+0000 7f112f59e640 1 -- 172.21.15.37:0/1551383246 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11300ccb80 con 0x7f11300b4340 2023-07-09T21:42:24.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f112f59e640 1 --2- 172.21.15.37:0/1551383246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cf44beb41798f0e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f112dd9b640 1 -- 172.21.15.37:0/1551383246 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280a59e0 con 0x7f11300b4340 2023-07-09T21:42:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f112dd9b640 1 -- 172.21.15.37:0/1551383246 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11280a5b40 con 0x7f11300b4340 2023-07-09T21:42:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f112dd9b640 1 -- 172.21.15.37:0/1551383246 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280ad440 con 0x7f11300b4340 2023-07-09T21:42:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 -- 172.21.15.37:0/1551383246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 msgr2=0x7f11300d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 --2- 172.21.15.37:0/1551383246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1128009d90 tx=0x7f112801c920 comp rx=0 tx=0).stop 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 -- 172.21.15.37:0/1551383246 shutdown_connections 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 --2- 172.21.15.37:0/1551383246 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300b4340 0x7f11300d02a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 --2- 172.21.15.37:0/1551383246 >> v2:172.21.15.119:3300/0 conn(0x7f11300b7ab0 0x7f113006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 -- 172.21.15.37:0/1551383246 >> 172.21.15.37:0/1551383246 conn(0x7f1130073090 msgr2=0x7f1130069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 -- 172.21.15.37:0/1551383246 shutdown_connections 2023-07-09T21:42:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.508+0000 7f1135140640 1 -- 172.21.15.37:0/1551383246 wait complete. 2023-07-09T21:42:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 Processor -- start 2023-07-09T21:42:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- start start 2023-07-09T21:42:24.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11300b7ab0 0x7f11300b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 0x7f11300b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11300cc2b0 con 0x7f11300b4340 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113014f700 con 0x7f11300b7ab0 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11300b26d0 con 0x7f11300cef80 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37688/0 (socket says 172.21.15.37:37688) 2023-07-09T21:42:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 -- 172.21.15.37:0/4145923018 learned_addr learned my addr 172.21.15.37:0/4145923018 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112e59c640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11300b7ab0 0x7f11300b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112f59e640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 0x7f11300b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 -- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 msgr2=0x7f11300b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 0x7f11300b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 -- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11300b7ab0 msgr2=0x7f11300b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11300b7ab0 0x7f11300b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 -- 172.21.15.37:0/4145923018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1128009a70 con 0x7f11300b4340 2023-07-09T21:42:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112f59e640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 0x7f11300b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f112ed9d640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f112000e960 tx=0x7f112000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120009690 con 0x7f11300b4340 2023-07-09T21:42:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112000ca00 con 0x7f11300b4340 2023-07-09T21:42:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000cd70 con 0x7f11300b4340 2023-07-09T21:42:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11300c5ce0 con 0x7f11300b4340 2023-07-09T21:42:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.512+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11300c6860 con 0x7f11300b4340 2023-07-09T21:42:24.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113006a610 con 0x7f11300b4340 2023-07-09T21:42:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1120013470 con 0x7f11300b4340 2023-07-09T21:42:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f11177fe640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 0x7f111c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1120084090 con 0x7f11300b4340 2023-07-09T21:42:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f112e59c640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 0x7f111c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.516+0000 7f112e59c640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 0x7f111c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11300b2e20 tx=0x7f1124009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.520+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11200513d0 con 0x7f11300b4340 2023-07-09T21:42:24.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113004d7d0 con 0x7f11300b4340 2023-07-09T21:42:24.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f11177fe640 1 -- 172.21.15.37:0/4145923018 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f11200549f0 con 0x7f11300b4340 2023-07-09T21:42:24.682 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:24.682 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":143,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:23.692487+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 msgr2=0x7f111c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 0x7f111c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f11300b2e20 tx=0x7f1124009040 comp rx=0 tx=0).stop 2023-07-09T21:42:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 msgr2=0x7f113014f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f112000e960 tx=0x7f112000ee20 comp rx=0 tx=0).stop 2023-07-09T21:42:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 shutdown_connections 2023-07-09T21:42:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f111c0663a0 0x7f111c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f11300cef80 0x7f11300b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f11300b7ab0 0x7f11300b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 --2- 172.21.15.37:0/4145923018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11300b4340 0x7f113014f1c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 >> 172.21.15.37:0/4145923018 conn(0x7f1130073090 msgr2=0x7f11300d1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:24.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 shutdown_connections 2023-07-09T21:42:24.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.680+0000 7f1135140640 1 -- 172.21.15.37:0/4145923018 wait complete. 2023-07-09T21:42:24.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:24.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.844+0000 7f0a3eecb640 1 Processor -- start 2023-07-09T21:42:24.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.844+0000 7f0a3eecb640 1 -- start start 2023-07-09T21:42:24.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3eecb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 0x7f0a3806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3eecb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 0x7f0a380d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3eecb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380b49f0 con 0x7f0a380cef80 2023-07-09T21:42:24.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3eecb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380b7e80 con 0x7f0a380b4340 2023-07-09T21:42:24.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3eecb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380cc8a0 con 0x7f0a380b7ab0 2023-07-09T21:42:24.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a37fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0a380cef80 0x7f0a380b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39266/0 (socket says 172.21.15.37:39266) 2023-07-09T21:42:24.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a37fff640 1 -- 172.21.15.37:0/3752183509 learned_addr learned my addr 172.21.15.37:0/3752183509 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/3752183509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 0x7f0a3806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3d468640 1 --2- 172.21.15.37:0/3752183509 >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 0x7f0a380d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a377fe640 1 -- 172.21.15.37:0/3752183509 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524895449 0 0) 0x7f0a380b49f0 con 0x7f0a380cef80 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a377fe640 1 -- 172.21.15.37:0/3752183509 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a28003530 con 0x7f0a380cef80 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3cc67640 1 -- 172.21.15.37:0/3752183509 >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 msgr2=0x7f0a380d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/3752183509 >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 0x7f0a380d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3cc67640 1 -- 172.21.15.37:0/3752183509 >> v1:172.21.15.37:6789/0 conn(0x7f0a380cef80 legacy=0x7f0a380b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3cc67640 1 -- 172.21.15.37:0/3752183509 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380ccb80 con 0x7f0a380b7ab0 2023-07-09T21:42:24.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.848+0000 7f0a3d468640 1 --2- 172.21.15.37:0/3752183509 >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 0x7f0a380d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:24.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/3752183509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 0x7f0a3806aa50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15bf79d6c4b2951c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a377fe640 1 -- 172.21.15.37:0/3752183509 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0ab650 con 0x7f0a380b7ab0 2023-07-09T21:42:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a377fe640 1 -- 172.21.15.37:0/3752183509 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c0ab7b0 con 0x7f0a380b7ab0 2023-07-09T21:42:24.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a377fe640 1 -- 172.21.15.37:0/3752183509 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0abb20 con 0x7f0a380b7ab0 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- 172.21.15.37:0/3752183509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 msgr2=0x7f0a3806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/3752183509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 0x7f0a3806aa50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0097c0 tx=0x7f0a2c01c450 comp rx=0 tx=0).stop 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- 172.21.15.37:0/3752183509 shutdown_connections 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/3752183509 >> v2:172.21.15.119:3300/0 conn(0x7f0a380b4340 0x7f0a380d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/3752183509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b7ab0 0x7f0a3806aa50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- 172.21.15.37:0/3752183509 >> 172.21.15.37:0/3752183509 conn(0x7f0a38073090 msgr2=0x7f0a38069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- 172.21.15.37:0/3752183509 shutdown_connections 2023-07-09T21:42:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- 172.21.15.37:0/3752183509 wait complete. 2023-07-09T21:42:24.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 Processor -- start 2023-07-09T21:42:24.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.852+0000 7f0a3eecb640 1 -- start start 2023-07-09T21:42:24.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 0x7f0a3814f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a380b7ab0 0x7f0a380b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380b6c80 con 0x7f0a380cef80 2023-07-09T21:42:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f78d0 con 0x7f0a380b7ab0 2023-07-09T21:42:24.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a380b69a0 con 0x7f0a380b4340 2023-07-09T21:42:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37700/0 (socket says 172.21.15.37:37700) 2023-07-09T21:42:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 -- 172.21.15.37:0/4168645476 learned_addr learned my addr 172.21.15.37:0/4168645476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 0x7f0a3814f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a37fff640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a380b7ab0 0x7f0a380b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 -- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 msgr2=0x7f0a3814f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 0x7f0a3814f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 -- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a380b7ab0 msgr2=0x7f0a380b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a380b7ab0 0x7f0a380b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 -- 172.21.15.37:0/4168645476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30009a70 con 0x7f0a380cef80 2023-07-09T21:42:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 0x7f0a3814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:24.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3d468640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000efc0 tx=0x7f0a30009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a30009d70 con 0x7f0a380cef80 2023-07-09T21:42:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3000f040 con 0x7f0a380cef80 2023-07-09T21:42:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c009420 con 0x7f0a380cef80 2023-07-09T21:42:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300039a0 con 0x7f0a380cef80 2023-07-09T21:42:24.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a381f7560 con 0x7f0a380cef80 2023-07-09T21:42:24.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a381f70e0 con 0x7f0a380cef80 2023-07-09T21:42:24.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.856+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0a300144a0 con 0x7f0a380cef80 2023-07-09T21:42:24.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.860+0000 7f0a357fa640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 0x7f0a1c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:24.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.860+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f0a30084b90 con 0x7f0a380cef80 2023-07-09T21:42:24.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.860+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 0x7f0a1c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:24.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.860+0000 7f0a3cc67640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 0x7f0a1c068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0af000 tx=0x7f0a2c0a7000 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:24.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:24.864+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0a381f70e0 con 0x7f0a380cef80 2023-07-09T21:42:25.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.016+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a381f70e0 con 0x7f0a380cef80 2023-07-09T21:42:25.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a357fa640 1 -- 172.21.15.37:0/4168645476 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+18406 (secure 0 0 0) 0x7f0a381f70e0 con 0x7f0a380cef80 2023-07-09T21:42:25.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:25.021 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":143,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:23.692487+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:25.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 msgr2=0x7f0a1c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 0x7f0a1c068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0af000 tx=0x7f0a2c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:42:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 msgr2=0x7f0a380b22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f0a3000efc0 tx=0x7f0a30009f90 comp rx=0 tx=0).stop 2023-07-09T21:42:25.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 shutdown_connections 2023-07-09T21:42:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f0a1c0663d0 0x7f0a1c068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a380cef80 0x7f0a380b22d0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0a380b7ab0 0x7f0a380b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 --2- 172.21.15.37:0/4168645476 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0a380b4340 0x7f0a3814f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 >> 172.21.15.37:0/4168645476 conn(0x7f0a38073090 msgr2=0x7f0a380ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 shutdown_connections 2023-07-09T21:42:25.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.020+0000 7f0a3eecb640 1 -- 172.21.15.37:0/4168645476 wait complete. 2023-07-09T21:42:25.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:42:25.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 Processor -- start 2023-07-09T21:42:25.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 -- start start 2023-07-09T21:42:25.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae4160030 0x7f8ae40d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae415bf80 con 0x7f8ae40cf290 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40d02f0 con 0x7f8ae40b7980 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8aeba0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40cd070 con 0x7f8ae4160030 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8ae40cf290 0x7f8ae40d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39274/0 (socket says 172.21.15.37:39274) 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 -- 172.21.15.37:0/2580836815 learned_addr learned my addr 172.21.15.37:0/2580836815 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:25.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae4160030 0x7f8ae40d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800017451 0 0) 0x7f8ad4001120 con 0x7f8ae40cf290 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad0003530 con 0x7f8ae40cf290 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163975587 0 0) 0x7f8ae40d02f0 con 0x7f8ae40b7980 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ad4001120 con 0x7f8ae40b7980 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 985321773 0 0) 0x7f8ad0003530 con 0x7f8ae40cf290 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae4160030 msgr2=0x7f8ae40d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:25.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae4160030 0x7f8ae40d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 >> v1:172.21.15.119:6789/0 conn(0x7f8ae40b7980 legacy=0x7f8ae40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40cc7f0 con 0x7f8ae40cf290 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f8ad4001810 con 0x7f8ae40cf290 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 >> v1:172.21.15.37:6789/0 conn(0x7f8ae40cf290 legacy=0x7f8ae40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad0003b40 0x7f8ad0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad00047d0 0x7f8ad0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad0005180 0x7f8ad000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40cd070 con 0x7f8ad00047d0 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad000bf50 con 0x7f8ad0005180 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ad000c110 con 0x7f8ad0003b40 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad00047d0 0x7f8ad0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae97a7640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad0003b40 0x7f8ad0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad0005180 0x7f8ad000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 -- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad0003b40 msgr2=0x7f8ad0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad0003b40 0x7f8ad0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 -- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad0005180 msgr2=0x7f8ad000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad0005180 0x7f8ad000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae8fa6640 1 -- 172.21.15.37:0/2580836815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad0003530 con 0x7f8ad00047d0 2023-07-09T21:42:25.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.188+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ad0005180 0x7f8ad000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8ae8fa6640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad00047d0 0x7f8ad0004c40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40cf6b0 tx=0x7f8ad401cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65f9fa8e65b0e3c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:25.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad40058e0 con 0x7f8ad00047d0 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad4005a40 con 0x7f8ad00047d0 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8adbfff640 1 -- 172.21.15.37:0/2580836815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad4005e30 con 0x7f8ad00047d0 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 -- 172.21.15.37:0/2580836815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad00047d0 msgr2=0x7f8ad0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/2580836815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ad00047d0 0x7f8ad0004c40 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40cf6b0 tx=0x7f8ad401cac0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8ae9fa8640 1 -- 172.21.15.37:0/2580836815 reap_dead start 2023-07-09T21:42:25.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 -- 172.21.15.37:0/2580836815 shutdown_connections 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 -- 172.21.15.37:0/2580836815 >> 172.21.15.37:0/2580836815 conn(0x7f8ae4073090 msgr2=0x7f8ae4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 -- 172.21.15.37:0/2580836815 shutdown_connections 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.192+0000 7f8aeba0b640 1 -- 172.21.15.37:0/2580836815 wait complete. 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 Processor -- start 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 -- start start 2023-07-09T21:42:25.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad00047d0 0x7f8ae414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40b3910 0x7f8ae4159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b2e40 con 0x7f8ae40b3d80 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b1da0 con 0x7f8ae40b3910 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40b2080 con 0x7f8ad00047d0 2023-07-09T21:42:25.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37712/0 (socket says 172.21.15.37:37712) 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 -- 172.21.15.37:0/1186278253 learned_addr learned my addr 172.21.15.37:0/1186278253 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae97a7640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad00047d0 0x7f8ae414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae8fa6640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40b3910 0x7f8ae4159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 -- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad00047d0 msgr2=0x7f8ae414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad00047d0 0x7f8ae414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 -- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40b3910 msgr2=0x7f8ae4159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40b3910 0x7f8ae4159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 -- 172.21.15.37:0/1186278253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40b2360 con 0x7f8ae40b3d80 2023-07-09T21:42:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ae9fa8640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40b1b50 tx=0x7f8adc0101c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc01b070 con 0x7f8ae40b3d80 2023-07-09T21:42:25.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc00f040 con 0x7f8ae40b3d80 2023-07-09T21:42:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc00e050 con 0x7f8ae40b3d80 2023-07-09T21:42:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.196+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae40b2640 con 0x7f8ae40b3d80 2023-07-09T21:42:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41506e0 con 0x7f8ae40b3d80 2023-07-09T21:42:25.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae404d7d0 con 0x7f8ae40b3d80 2023-07-09T21:42:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8adc010720 con 0x7f8ae40b3d80 2023-07-09T21:42:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8ad9ffb640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 0x7f8ac8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8adc083d50 con 0x7f8ae40b3d80 2023-07-09T21:42:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8ae97a7640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 0x7f8ac8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:25.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.200+0000 7f8ae97a7640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 0x7f8ac8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005630 tx=0x7f8ae0009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.204+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8adc087030 con 0x7f8ae40b3d80 2023-07-09T21:42:25.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:25.396+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ae40b2af0 con 0x7f8ae40b3d80 2023-07-09T21:42:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.320+0000 7f8ad9ffb640 1 -- 172.21.15.37:0/1186278253 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8adc051020 con 0x7f8ae40b3d80 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 msgr2=0x7f8ac8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 0x7f8ac8068850 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0005630 tx=0x7f8ae0009040 comp rx=0 tx=0).stop 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 msgr2=0x7f8ae4159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8ae40b1b50 tx=0x7f8adc0101c0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 shutdown_connections 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8ac80663a0 0x7f8ac8068850 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae40b3d80 0x7f8ae4159770 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae40b3910 0x7f8ae4159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 --2- 172.21.15.37:0/1186278253 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ad00047d0 0x7f8ae414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 >> 172.21.15.37:0/1186278253 conn(0x7f8ae4073090 msgr2=0x7f8ae40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 shutdown_connections 2023-07-09T21:42:26.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.324+0000 7f8aeba0b640 1 -- 172.21.15.37:0/1186278253 wait complete. 2023-07-09T21:42:26.348 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:42:26.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:42:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 Processor -- start 2023-07-09T21:42:26.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 -- start start 2023-07-09T21:42:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340b7980 0x7fdd34160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd340d0780 0x7fdd340d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3415bf80 con 0x7fdd340ceb80 2023-07-09T21:42:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd340cd070 con 0x7fdd340d0780 2023-07-09T21:42:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd39e9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340cfd70 con 0x7fdd340b7980 2023-07-09T21:42:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd33fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd340d0780 0x7fdd340d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.500+0000 7fdd32ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd340ceb80 0x7fdd340cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:39282/0 (socket says 172.21.15.37:39282) 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd32ffd640 1 -- 172.21.15.37:0/90337162 learned_addr learned my addr 172.21.15.37:0/90337162 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd337fe640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340b7980 0x7fdd34160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd33fff640 1 -- 172.21.15.37:0/90337162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340b7980 msgr2=0x7fdd34160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd33fff640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340b7980 0x7fdd34160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd33fff640 1 -- 172.21.15.37:0/90337162 >> v1:172.21.15.37:6789/0 conn(0x7fdd340ceb80 legacy=0x7fdd340cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd327fc640 1 -- 172.21.15.37:0/90337162 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166517710 0 0) 0x7fdd28001120 con 0x7fdd340ceb80 2023-07-09T21:42:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd33fff640 1 -- 172.21.15.37:0/90337162 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd34160570 con 0x7fdd340d0780 2023-07-09T21:42:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd33fff640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340d0780 0x7fdd340d0c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009d90 tx=0x7fdd2c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bc3eddd2982a48 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd327fc640 1 -- 172.21.15.37:0/90337162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0a5810 con 0x7fdd340d0780 2023-07-09T21:42:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd327fc640 1 -- 172.21.15.37:0/90337162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2c0a5970 con 0x7fdd340d0780 2023-07-09T21:42:26.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.504+0000 7fdd327fc640 1 -- 172.21.15.37:0/90337162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2c0a5d00 con 0x7fdd340d0780 2023-07-09T21:42:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- 172.21.15.37:0/90337162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340d0780 msgr2=0x7fdd340d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340d0780 0x7fdd340d0c00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009d90 tx=0x7fdd2c01c950 comp rx=0 tx=0).stop 2023-07-09T21:42:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- 172.21.15.37:0/90337162 shutdown_connections 2023-07-09T21:42:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340d0780 0x7fdd340d0c00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/90337162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340b7980 0x7fdd34160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- 172.21.15.37:0/90337162 >> 172.21.15.37:0/90337162 conn(0x7fdd34073090 msgr2=0x7fdd34069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- 172.21.15.37:0/90337162 shutdown_connections 2023-07-09T21:42:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- 172.21.15.37:0/90337162 wait complete. 2023-07-09T21:42:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 Processor -- start 2023-07-09T21:42:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- start start 2023-07-09T21:42:26.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340ceb80 0x7fdd340b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd340d0780 0x7fdd340b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3415a500 con 0x7fdd340b7980 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd341598f0 con 0x7fdd340d0780 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd39e9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34159bd0 con 0x7fdd340ceb80 2023-07-09T21:42:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37734/0 (socket says 172.21.15.37:37734) 2023-07-09T21:42:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 -- 172.21.15.37:0/3529581773 learned_addr learned my addr 172.21.15.37:0/3529581773 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd32ffd640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340ceb80 0x7fdd340b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd33fff640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd340d0780 0x7fdd340b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 -- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340ceb80 msgr2=0x7fdd340b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340ceb80 0x7fdd340b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 -- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd340d0780 msgr2=0x7fdd340b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:26.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd340d0780 0x7fdd340b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 -- 172.21.15.37:0/3529581773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2c009a70 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.508+0000 7fdd337fe640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d800 tx=0x7fdd2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400b6c0 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2400b820 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd34159eb0 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2400bb90 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd34151bf0 con 0x7fdd340b7980 2023-07-09T21:42:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3404d7d0 con 0x7fdd340b7980 2023-07-09T21:42:26.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdd2400bcf0 con 0x7fdd340b7980 2023-07-09T21:42:26.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 0x7fdd20068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:26.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fdd240844f0 con 0x7fdd340b7980 2023-07-09T21:42:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.512+0000 7fdd32ffd640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 0x7fdd20068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:26.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.516+0000 7fdd32ffd640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 0x7fdd20068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd28007fd0 tx=0x7fdd280079c0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:26.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.516+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd24055230 con 0x7fdd340b7980 2023-07-09T21:42:26.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:26.708+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdd340b1600 con 0x7fdd340b7980 2023-07-09T21:42:27.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.324+0000 7fdd1bfff640 1 -- 172.21.15.37:0/3529581773 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdd24054dc0 con 0x7fdd340b7980 2023-07-09T21:42:27.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 msgr2=0x7fdd20068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 0x7fdd20068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd28007fd0 tx=0x7fdd280079c0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 msgr2=0x7fdd341516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fdd2400d800 tx=0x7fdd2400dcc0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 shutdown_connections 2023-07-09T21:42:27.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fdd200663a0 0x7fdd20068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd340d0780 0x7fdd340b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd340ceb80 0x7fdd340b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 --2- 172.21.15.37:0/3529581773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd340b7980 0x7fdd341516b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 >> 172.21.15.37:0/3529581773 conn(0x7fdd34073090 msgr2=0x7fdd3415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:27.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 shutdown_connections 2023-07-09T21:42:27.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.328+0000 7fdd39e9c640 1 -- 172.21.15.37:0/3529581773 wait complete. 2023-07-09T21:42:27.351 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:42:27.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:27.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 Processor -- start 2023-07-09T21:42:27.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 -- start start 2023-07-09T21:42:27.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe37015bbf0 0x7fe3700d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3700d1380 con 0x7fe37006bc30 2023-07-09T21:42:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3700b13e0 con 0x7fe3700cf100 2023-07-09T21:42:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe375970640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37002bbe0 con 0x7fe37015bbf0 2023-07-09T21:42:27.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe36ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe37006bc30 0x7fe3700ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37764/0 (socket says 172.21.15.37:37764) 2023-07-09T21:42:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe36ffff640 1 -- 172.21.15.37:0/574188503 learned_addr learned my addr 172.21.15.37:0/574188503 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.500+0000 7fe37496e640 1 --2- 172.21.15.37:0/574188503 >> v2:172.21.15.119:3300/0 conn(0x7fe37015bbf0 0x7fe3700d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4245372103 0 0) 0x7fe3700d1380 con 0x7fe37006bc30 2023-07-09T21:42:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe360003530 con 0x7fe37006bc30 2023-07-09T21:42:27.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367038868 0 0) 0x7fe3700b13e0 con 0x7fe3700cf100 2023-07-09T21:42:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3700d1380 con 0x7fe3700cf100 2023-07-09T21:42:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe37496e640 1 -- 172.21.15.37:0/574188503 >> v1:172.21.15.119:6789/0 conn(0x7fe3700cf100 legacy=0x7fe3700cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe37496e640 1 -- 172.21.15.37:0/574188503 >> v1:172.21.15.37:6789/0 conn(0x7fe37006bc30 legacy=0x7fe3700ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 704611587 0 0) 0x7fe360003530 con 0x7fe37006bc30 2023-07-09T21:42:27.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe37496e640 1 -- 172.21.15.37:0/574188503 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3700b1100 con 0x7fe37015bbf0 2023-07-09T21:42:27.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe37496e640 1 --2- 172.21.15.37:0/574188503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe37015bbf0 0x7fe3700d1810 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097c0 tx=0x7fe36401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58b668107bfbe7dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640a4ea0 con 0x7fe37015bbf0 2023-07-09T21:42:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640a7050 con 0x7fe37015bbf0 2023-07-09T21:42:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.504+0000 7fe36f7fe640 1 -- 172.21.15.37:0/574188503 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe35c001680 con 0x7fe37015bbf0 2023-07-09T21:42:27.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- 172.21.15.37:0/574188503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe37015bbf0 msgr2=0x7fe3700d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 --2- 172.21.15.37:0/574188503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe37015bbf0 0x7fe3700d1810 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fe3640097c0 tx=0x7fe36401c370 comp rx=0 tx=0).stop 2023-07-09T21:42:27.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- 172.21.15.37:0/574188503 shutdown_connections 2023-07-09T21:42:27.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 --2- 172.21.15.37:0/574188503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe37015bbf0 0x7fe3700d1810 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- 172.21.15.37:0/574188503 >> 172.21.15.37:0/574188503 conn(0x7fe37002b640 msgr2=0x7fe3700d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- 172.21.15.37:0/574188503 shutdown_connections 2023-07-09T21:42:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- 172.21.15.37:0/574188503 wait complete. 2023-07-09T21:42:27.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 Processor -- start 2023-07-09T21:42:27.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- start start 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 0x7fe3700afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 0x7fe3700b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3701562d0 con 0x7fe37006bc30 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3700b3410 con 0x7fe3700cf100 2023-07-09T21:42:27.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe375970640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe370155650 con 0x7fe37015bbf0 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe37496e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe37496e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39620/0 (socket says 172.21.15.37:39620) 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe37496e640 1 -- 172.21.15.37:0/497194645 learned_addr learned my addr 172.21.15.37:0/497194645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe36ffff640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 0x7fe3700afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.508+0000 7fe37516f640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 0x7fe3700b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 -- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 msgr2=0x7fe3700b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 0x7fe3700b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 -- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 msgr2=0x7fe3700afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 0x7fe3700afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 -- 172.21.15.37:0/497194645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe364009420 con 0x7fe37006bc30 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36ffff640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 0x7fe3700afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37516f640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 0x7fe3700b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe37496e640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe36401c850 tx=0x7fe364019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640abdd0 con 0x7fe37006bc30 2023-07-09T21:42:27.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3640b4400 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3640b4770 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe370155930 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe370155ef0 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37004e020 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe3640b2040 con 0x7fe37006bc30 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 0x7fe354068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.512+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fe36411de60 con 0x7fe37006bc30 2023-07-09T21:42:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.516+0000 7fe36ffff640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 0x7fe354068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.516+0000 7fe36ffff640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 0x7fe354068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3700b3060 tx=0x7fe35c009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.516+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3640eb1e0 con 0x7fe37006bc30 2023-07-09T21:42:27.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.704+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3700ceee0 con 0x7fe37006bc30 2023-07-09T21:42:27.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe36d7fa640 1 -- 172.21.15.37:0/497194645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fe3640b9020 con 0x7fe37006bc30 2023-07-09T21:42:27.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:27.708 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:27.708 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:27.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 msgr2=0x7fe354068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 0x7fe354068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe3700b3060 tx=0x7fe35c009040 comp rx=0 tx=0).stop 2023-07-09T21:42:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 msgr2=0x7fe37014fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7fe36401c850 tx=0x7fe364019110 comp rx=0 tx=0).stop 2023-07-09T21:42:27.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 shutdown_connections 2023-07-09T21:42:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fe3540663a0 0x7fe354068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe37015bbf0 0x7fe3700b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3700cf100 0x7fe3700afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 --2- 172.21.15.37:0/497194645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe37006bc30 0x7fe37014fba0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 >> 172.21.15.37:0/497194645 conn(0x7fe37002b640 msgr2=0x7fe370158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 shutdown_connections 2023-07-09T21:42:27.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.708+0000 7fe375970640 1 -- 172.21.15.37:0/497194645 wait complete. 2023-07-09T21:42:27.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:27.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 Processor -- start 2023-07-09T21:42:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 -- start start 2023-07-09T21:42:27.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95a00b4340 0x7f95a006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f95a00cef80 0x7f95a00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95a00b49f0 con 0x7f95a00b7ab0 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00b7e80 con 0x7f95a00b4340 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a77ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95a00cc8a0 con 0x7f95a00cef80 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95a00b4340 0x7f95a006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95a00b4340 0x7f95a006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39628/0 (socket says 172.21.15.37:39628) 2023-07-09T21:42:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 -- 172.21.15.37:0/2659397532 learned_addr learned my addr 172.21.15.37:0/2659397532 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a5d49640 1 --2- 172.21.15.37:0/2659397532 >> v2:172.21.15.119:3300/0 conn(0x7f95a00cef80 0x7f95a00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 -- 172.21.15.37:0/2659397532 >> v2:172.21.15.119:3300/0 conn(0x7f95a00cef80 msgr2=0x7f95a00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 --2- 172.21.15.37:0/2659397532 >> v2:172.21.15.119:3300/0 conn(0x7f95a00cef80 0x7f95a00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 -- 172.21.15.37:0/2659397532 >> v1:172.21.15.119:6789/0 conn(0x7f95a00b7ab0 legacy=0x7f95a00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:27.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.872+0000 7f95a4d47640 1 -- 172.21.15.37:0/2659397532 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a00ccb80 con 0x7f95a00b4340 2023-07-09T21:42:27.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a4d47640 1 --2- 172.21.15.37:0/2659397532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a006aa50 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f95a008b5b0 tx=0x7f959001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774d33557d9759d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f9597fff640 1 -- 172.21.15.37:0/2659397532 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900aa430 con 0x7f95a00b4340 2023-07-09T21:42:27.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f9597fff640 1 -- 172.21.15.37:0/2659397532 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95900aa590 con 0x7f95a00b4340 2023-07-09T21:42:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f9597fff640 1 -- 172.21.15.37:0/2659397532 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95900aa920 con 0x7f95a00b4340 2023-07-09T21:42:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 -- 172.21.15.37:0/2659397532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 msgr2=0x7f95a006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 --2- 172.21.15.37:0/2659397532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a006aa50 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f95a008b5b0 tx=0x7f959001c4d0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 -- 172.21.15.37:0/2659397532 shutdown_connections 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 --2- 172.21.15.37:0/2659397532 >> v2:172.21.15.119:3300/0 conn(0x7f95a00cef80 0x7f95a00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 --2- 172.21.15.37:0/2659397532 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a006aa50 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 -- 172.21.15.37:0/2659397532 >> 172.21.15.37:0/2659397532 conn(0x7f95a0073090 msgr2=0x7f95a0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 -- 172.21.15.37:0/2659397532 shutdown_connections 2023-07-09T21:42:27.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.876+0000 7f95a77ac640 1 -- 172.21.15.37:0/2659397532 wait complete. 2023-07-09T21:42:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 Processor -- start 2023-07-09T21:42:27.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 -- start start 2023-07-09T21:42:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95a00b7ab0 0x7f95a014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 0x7f95a00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a014e9d0 con 0x7f95a00b4340 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00cbc10 con 0x7f95a00b7ab0 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95a00cbef0 con 0x7f95a00cef80 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39632/0 (socket says 172.21.15.37:39632) 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 -- 172.21.15.37:0/1454826444 learned_addr learned my addr 172.21.15.37:0/1454826444 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:27.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5d49640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 0x7f95a00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a4d47640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95a00b7ab0 0x7f95a014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 -- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 msgr2=0x7f95a00c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 0x7f95a00c9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 -- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95a00b7ab0 msgr2=0x7f95a014c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95a00b7ab0 0x7f95a014c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 -- 172.21.15.37:0/1454826444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900094d0 con 0x7f95a00b4340 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5d49640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 0x7f95a00c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:27.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a5548640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f959c00c500 tx=0x7f959c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c005220 con 0x7f95a00b4340 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f959c005380 con 0x7f95a00b4340 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f959c007270 con 0x7f95a00b4340 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.880+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95a00cc1d0 con 0x7f95a00b4340 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95a014d490 con 0x7f95a00b4340 2023-07-09T21:42:27.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95a004d7d0 con 0x7f95a00b4340 2023-07-09T21:42:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f959c0073d0 con 0x7f95a00b4340 2023-07-09T21:42:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f9595ffb640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 0x7f9584068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f959c083790 con 0x7f95a00b4340 2023-07-09T21:42:27.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.884+0000 7f95a4d47640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 0x7f9584068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:27.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.888+0000 7f95a4d47640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 0x7f9584068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95900ae000 tx=0x7f95900b5040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:27.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:27.888+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f959c050a50 con 0x7f95a00b4340 2023-07-09T21:42:28.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.044+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95a00ced60 con 0x7f95a00b4340 2023-07-09T21:42:28.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.044+0000 7f9595ffb640 1 -- 172.21.15.37:0/1454826444 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v144) v1 ==== 74+0+18393 (secure 0 0 0) 0x7f959c054070 con 0x7f95a00b4340 2023-07-09T21:42:28.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:28.046 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":144,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:25.296759+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:28.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 msgr2=0x7f9584068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 0x7f9584068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f95900ae000 tx=0x7f95900b5040 comp rx=0 tx=0).stop 2023-07-09T21:42:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 msgr2=0x7f95a00c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f959c00c500 tx=0x7f959c00c9c0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 shutdown_connections 2023-07-09T21:42:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f95840663a0 0x7f9584068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f95a00cef80 0x7f95a00c9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f95a00b7ab0 0x7f95a014c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 --2- 172.21.15.37:0/1454826444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95a00b4340 0x7f95a00c5fd0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 >> 172.21.15.37:0/1454826444 conn(0x7f95a0073090 msgr2=0x7f95a0154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 shutdown_connections 2023-07-09T21:42:28.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.048+0000 7f95a77ac640 1 -- 172.21.15.37:0/1454826444 wait complete. 2023-07-09T21:42:28.067 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:42:28.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:42:28.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 Processor -- start 2023-07-09T21:42:28.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 -- start start 2023-07-09T21:42:28.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbc40b4340 0x7fbbc406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40cef80 0x7fbbc40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc40b49f0 con 0x7fbbc40b7ab0 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc40b7e80 con 0x7fbbc40b4340 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc8c56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40cc8a0 con 0x7fbbc40cef80 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbc40b4340 0x7fbbc406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbc40b4340 0x7fbbc406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39646/0 (socket says 172.21.15.37:39646) 2023-07-09T21:42:28.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 -- 172.21.15.37:0/254950211 learned_addr learned my addr 172.21.15.37:0/254950211 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc2d9d640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40cef80 0x7fbbc40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 -- 172.21.15.37:0/254950211 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40cef80 msgr2=0x7fbbc40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40cef80 0x7fbbc40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 -- 172.21.15.37:0/254950211 >> v1:172.21.15.119:6789/0 conn(0x7fbbc40b7ab0 legacy=0x7fbbc40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.212+0000 7fbbc1d9b640 1 -- 172.21.15.37:0/254950211 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc40ccb80 con 0x7fbbc40b4340 2023-07-09T21:42:28.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc1d9b640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40b4340 0x7fbbc406aa50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009870 tx=0x7fbbb801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7daa2ae26756dc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc159a640 1 -- 172.21.15.37:0/254950211 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80aa670 con 0x7fbbc40b4340 2023-07-09T21:42:28.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc159a640 1 -- 172.21.15.37:0/254950211 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb80aa7d0 con 0x7fbbc40b4340 2023-07-09T21:42:28.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc159a640 1 -- 172.21.15.37:0/254950211 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb80aab60 con 0x7fbbc40b4340 2023-07-09T21:42:28.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 -- 172.21.15.37:0/254950211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40b4340 msgr2=0x7fbbc406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40b4340 0x7fbbc406aa50 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8009870 tx=0x7fbbb801c510 comp rx=0 tx=0).stop 2023-07-09T21:42:28.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 -- 172.21.15.37:0/254950211 shutdown_connections 2023-07-09T21:42:28.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40cef80 0x7fbbc40d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/254950211 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40b4340 0x7fbbc406aa50 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 -- 172.21.15.37:0/254950211 >> 172.21.15.37:0/254950211 conn(0x7fbbc4073090 msgr2=0x7fbbc4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 -- 172.21.15.37:0/254950211 shutdown_connections 2023-07-09T21:42:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.216+0000 7fbbc8c56640 1 -- 172.21.15.37:0/254950211 wait complete. 2023-07-09T21:42:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 Processor -- start 2023-07-09T21:42:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- start start 2023-07-09T21:42:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40b4340 0x7fbbc41536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc40b7ab0 0x7fbbc4141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c7380 con 0x7fbbc40cef80 2023-07-09T21:42:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c75f0 con 0x7fbbc40b7ab0 2023-07-09T21:42:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c78d0 con 0x7fbbc40b4340 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39656/0 (socket says 172.21.15.37:39656) 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 -- 172.21.15.37:0/1177508449 learned_addr learned my addr 172.21.15.37:0/1177508449 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc1d9b640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc40b7ab0 0x7fbbc4141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc259c640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40b4340 0x7fbbc41536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 -- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40b4340 msgr2=0x7fbbc41536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40b4340 0x7fbbc41536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 -- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc40b7ab0 msgr2=0x7fbbc4141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc40b7ab0 0x7fbbc4141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 -- 172.21.15.37:0/1177508449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80094d0 con 0x7fbbc40cef80 2023-07-09T21:42:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc2d9d640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009fd0 tx=0x7fbbbc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc014420 con 0x7fbbc40cef80 2023-07-09T21:42:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc014580 con 0x7fbbc40cef80 2023-07-09T21:42:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc014930 con 0x7fbbc40cef80 2023-07-09T21:42:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc40c7bb0 con 0x7fbbc40cef80 2023-07-09T21:42:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc4153be0 con 0x7fbbc40cef80 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.220+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc40c7dd0 con 0x7fbbc40cef80 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.224+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbbbc014a90 con 0x7fbbc40cef80 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.224+0000 7fbbb2ffd640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 0x7fbba4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.224+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fbbbc0846f0 con 0x7fbbc40cef80 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.224+0000 7fbbc259c640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 0x7fbba4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.224+0000 7fbbc259c640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 0x7fbba4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007fd0 tx=0x7fbbb4009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.228+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbbbc0554e0 con 0x7fbbc40cef80 2023-07-09T21:42:28.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.384+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbc40c7760 con 0x7fbba40663a0 2023-07-09T21:42:28.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.392+0000 7fbbb2ffd640 1 -- 172.21.15.37:0/1177508449 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306566 (secure 0 0 0) 0x7fbbc40c7760 con 0x7fbba40663a0 2023-07-09T21:42:28.398 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:28.399 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:42:28.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 msgr2=0x7fbba4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 0x7fbba4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4007fd0 tx=0x7fbbb4009040 comp rx=0 tx=0).stop 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 msgr2=0x7fbbc40ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009fd0 tx=0x7fbbbc00e4b0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 shutdown_connections 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fbba40663a0 0x7fbba4068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc40cef80 0x7fbbc40ca200 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbbc40b7ab0 0x7fbbc4141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 --2- 172.21.15.37:0/1177508449 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbbc40b4340 0x7fbbc41536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 >> 172.21.15.37:0/1177508449 conn(0x7fbbc4073090 msgr2=0x7fbbc415ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 shutdown_connections 2023-07-09T21:42:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.396+0000 7fbbc8c56640 1 -- 172.21.15.37:0/1177508449 wait complete. 2023-07-09T21:42:28.418 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:42:27.949242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337928,"kb_used_data":14920,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636792,"statfs":{"total":773094113280,"available":772748075008,"internally_reserved":0,"allocated":15278080,"data_stored":8348632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.659657"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310004+0000","last_change":"2023-07-09T21:42:23.310004+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310004+0000","last_undegraded":"2023-07-09T21:42:23.310004+0000","last_fullsized":"2023-07-09T21:42:23.310004+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310493+0000","last_change":"2023-07-09T21:42:23.310493+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310493+0000","last_undegraded":"2023-07-09T21:42:23.310493+0000","last_fullsized":"2023-07-09T21:42:23.310493+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303821+0000","last_change":"2023-07-09T21:42:23.303821+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303821+0000","last_undegraded":"2023-07-09T21:42:23.303821+0000","last_fullsized":"2023-07-09T21:42:23.303821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303606+0000","last_change":"2023-07-09T21:42:23.303606+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303606+0000","last_undegraded":"2023-07-09T21:42:23.303606+0000","last_fullsized":"2023-07-09T21:42:23.303606+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309705+0000","last_change":"2023-07-09T21:42:23.309705+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309705+0000","last_undegraded":"2023-07-09T21:42:23.309705+0000","last_fullsized":"2023-07-09T21:42:23.309705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308749+0000","last_change":"2023-07-09T21:42:23.308749+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308749+0000","last_undegraded":"2023-07-09T21:42:23.308749+0000","last_fullsized":"2023-07-09T21:42:23.308749+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308437+0000","last_change":"2023-07-09T21:42:23.308437+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308437+0000","last_undegraded":"2023-07-09T21:42:23.308437+0000","last_fullsized":"2023-07-09T21:42:23.308437+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.302979+0000","last_change":"2023-07-09T21:42:23.302979+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.302979+0000","last_undegraded":"2023-07-09T21:42:23.302979+0000","last_fullsized":"2023-07-09T21:42:23.302979+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306444+0000","last_change":"2023-07-09T21:42:23.306444+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306444+0000","last_undegraded":"2023-07-09T21:42:23.306444+0000","last_fullsized":"2023-07-09T21:42:23.306444+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304802+0000","last_change":"2023-07-09T21:42:23.304802+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304802+0000","last_undegraded":"2023-07-09T21:42:23.304802+0000","last_fullsized":"2023-07-09T21:42:23.304802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311381+0000","last_change":"2023-07-09T21:42:23.311381+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311381+0000","last_undegraded":"2023-07-09T21:42:23.311381+0000","last_fullsized":"2023-07-09T21:42:23.311381+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310951+0000","last_change":"2023-07-09T21:42:23.310951+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310951+0000","last_undegraded":"2023-07-09T21:42:23.310951+0000","last_fullsized":"2023-07-09T21:42:23.310951+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306703+0000","last_change":"2023-07-09T21:42:23.306703+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306703+0000","last_undegraded":"2023-07-09T21:42:23.306703+0000","last_fullsized":"2023-07-09T21:42:23.306703+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311262+0000","last_change":"2023-07-09T21:42:23.311262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311262+0000","last_undegraded":"2023-07-09T21:42:23.311262+0000","last_fullsized":"2023-07-09T21:42:23.311262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310140+0000","last_change":"2023-07-09T21:42:23.310140+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310140+0000","last_undegraded":"2023-07-09T21:42:23.310140+0000","last_fullsized":"2023-07-09T21:42:23.310140+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.314499+0000","last_change":"2023-07-09T21:42:23.314499+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.314499+0000","last_undegraded":"2023-07-09T21:42:23.314499+0000","last_fullsized":"2023-07-09T21:42:23.314499+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305243+0000","last_change":"2023-07-09T21:42:23.305243+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305243+0000","last_undegraded":"2023-07-09T21:42:23.305243+0000","last_fullsized":"2023-07-09T21:42:23.305243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309975+0000","last_change":"2023-07-09T21:42:23.309975+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309975+0000","last_undegraded":"2023-07-09T21:42:23.309975+0000","last_fullsized":"2023-07-09T21:42:23.309975+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307726+0000","last_change":"2023-07-09T21:42:23.307726+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307726+0000","last_undegraded":"2023-07-09T21:42:23.307726+0000","last_fullsized":"2023-07-09T21:42:23.307726+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301131+0000","last_change":"2023-07-09T21:42:23.301131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301131+0000","last_undegraded":"2023-07-09T21:42:23.301131+0000","last_fullsized":"2023-07-09T21:42:23.301131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306131+0000","last_change":"2023-07-09T21:42:23.306131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306131+0000","last_undegraded":"2023-07-09T21:42:23.306131+0000","last_fullsized":"2023-07-09T21:42:23.306131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309637+0000","last_change":"2023-07-09T21:42:23.309637+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309637+0000","last_undegraded":"2023-07-09T21:42:23.309637+0000","last_fullsized":"2023-07-09T21:42:23.309637+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303449+0000","last_change":"2023-07-09T21:42:23.303449+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303449+0000","last_undegraded":"2023-07-09T21:42:23.303449+0000","last_fullsized":"2023-07-09T21:42:23.303449+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305954+0000","last_change":"2023-07-09T21:42:23.305954+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305954+0000","last_undegraded":"2023-07-09T21:42:23.305954+0000","last_fullsized":"2023-07-09T21:42:23.305954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306210+0000","last_change":"2023-07-09T21:42:23.306210+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306210+0000","last_undegraded":"2023-07-09T21:42:23.306210+0000","last_fullsized":"2023-07-09T21:42:23.306210+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301416+0000","last_change":"2023-07-09T21:42:23.301416+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301416+0000","last_undegraded":"2023-07-09T21:42:23.301416+0000","last_fullsized":"2023-07-09T21:42:23.301416+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307274+0000","last_change":"2023-07-09T21:42:23.307274+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307274+0000","last_undegraded":"2023-07-09T21:42:23.307274+0000","last_fullsized":"2023-07-09T21:42:23.307274+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310480+0000","last_change":"2023-07-09T21:42:23.310480+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310480+0000","last_undegraded":"2023-07-09T21:42:23.310480+0000","last_fullsized":"2023-07-09T21:42:23.310480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301051+0000","last_change":"2023-07-09T21:42:23.301051+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301051+0000","last_undegraded":"2023-07-09T21:42:23.301051+0000","last_fullsized":"2023-07-09T21:42:23.301051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310794+0000","last_change":"2023-07-09T21:42:23.310794+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310794+0000","last_undegraded":"2023-07-09T21:42:23.310794+0000","last_fullsized":"2023-07-09T21:42:23.310794+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306211+0000","last_change":"2023-07-09T21:42:23.306211+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306211+0000","last_undegraded":"2023-07-09T21:42:23.306211+0000","last_fullsized":"2023-07-09T21:42:23.306211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305336+0000","last_change":"2023-07-09T21:42:23.305336+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305336+0000","last_undegraded":"2023-07-09T21:42:23.305336+0000","last_fullsized":"2023-07-09T21:42:23.305336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304212+0000","last_change":"2023-07-09T21:42:23.304212+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304212+0000","last_undegraded":"2023-07-09T21:42:23.304212+0000","last_fullsized":"2023-07-09T21:42:23.304212+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323320+0000","last_change":"2023-07-09T21:42:23.319972+0000","last_active":"2023-07-09T21:42:23.323320+0000","last_peered":"2023-07-09T21:42:23.323320+0000","last_clean":"2023-07-09T21:42:23.323320+0000","last_became_active":"2023-07-09T21:42:23.319687+0000","last_became_peered":"2023-07-09T21:42:23.319687+0000","last_unstale":"2023-07-09T21:42:23.323320+0000","last_undegraded":"2023-07-09T21:42:23.323320+0000","last_fullsized":"2023-07-09T21:42:23.323320+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308158+0000","last_change":"2023-07-09T21:42:23.308158+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308158+0000","last_undegraded":"2023-07-09T21:42:23.308158+0000","last_fullsized":"2023-07-09T21:42:23.308158+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320230+0000","last_change":"2023-07-09T21:42:23.315824+0000","last_active":"2023-07-09T21:42:23.320230+0000","last_peered":"2023-07-09T21:42:23.320230+0000","last_clean":"2023-07-09T21:42:23.320230+0000","last_became_active":"2023-07-09T21:42:23.315550+0000","last_became_peered":"2023-07-09T21:42:23.315550+0000","last_unstale":"2023-07-09T21:42:23.320230+0000","last_undegraded":"2023-07-09T21:42:23.320230+0000","last_fullsized":"2023-07-09T21:42:23.320230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:32.701564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306443+0000","last_change":"2023-07-09T21:42:23.306443+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306443+0000","last_undegraded":"2023-07-09T21:42:23.306443+0000","last_fullsized":"2023-07-09T21:42:23.306443+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323699+0000","last_change":"2023-07-09T21:42:23.319552+0000","last_active":"2023-07-09T21:42:23.323699+0000","last_peered":"2023-07-09T21:42:23.323699+0000","last_clean":"2023-07-09T21:42:23.323699+0000","last_became_active":"2023-07-09T21:42:23.319258+0000","last_became_peered":"2023-07-09T21:42:23.319258+0000","last_unstale":"2023-07-09T21:42:23.323699+0000","last_undegraded":"2023-07-09T21:42:23.323699+0000","last_fullsized":"2023-07-09T21:42:23.323699+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:33:12.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303257+0000","last_change":"2023-07-09T21:42:23.303257+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303257+0000","last_undegraded":"2023-07-09T21:42:23.303257+0000","last_fullsized":"2023-07-09T21:42:23.303257+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323516+0000","last_change":"2023-07-09T21:42:23.318851+0000","last_active":"2023-07-09T21:42:23.323516+0000","last_peered":"2023-07-09T21:42:23.323516+0000","last_clean":"2023-07-09T21:42:23.323516+0000","last_became_active":"2023-07-09T21:42:23.318580+0000","last_became_peered":"2023-07-09T21:42:23.318580+0000","last_unstale":"2023-07-09T21:42:23.323516+0000","last_undegraded":"2023-07-09T21:42:23.323516+0000","last_fullsized":"2023-07-09T21:42:23.323516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:32:09.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304358+0000","last_change":"2023-07-09T21:42:23.304358+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304358+0000","last_undegraded":"2023-07-09T21:42:23.304358+0000","last_fullsized":"2023-07-09T21:42:23.304358+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325042+0000","last_change":"2023-07-09T21:42:23.321154+0000","last_active":"2023-07-09T21:42:23.325042+0000","last_peered":"2023-07-09T21:42:23.325042+0000","last_clean":"2023-07-09T21:42:23.325042+0000","last_became_active":"2023-07-09T21:42:23.320801+0000","last_became_peered":"2023-07-09T21:42:23.320801+0000","last_unstale":"2023-07-09T21:42:23.325042+0000","last_undegraded":"2023-07-09T21:42:23.325042+0000","last_fullsized":"2023-07-09T21:42:23.325042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309560+0000","last_change":"2023-07-09T21:42:23.309560+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309560+0000","last_undegraded":"2023-07-09T21:42:23.309560+0000","last_fullsized":"2023-07-09T21:42:23.309560+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325077+0000","last_change":"2023-07-09T21:42:23.320117+0000","last_active":"2023-07-09T21:42:23.325077+0000","last_peered":"2023-07-09T21:42:23.325077+0000","last_clean":"2023-07-09T21:42:23.325077+0000","last_became_active":"2023-07-09T21:42:23.319851+0000","last_became_peered":"2023-07-09T21:42:23.319851+0000","last_unstale":"2023-07-09T21:42:23.325077+0000","last_undegraded":"2023-07-09T21:42:23.325077+0000","last_fullsized":"2023-07-09T21:42:23.325077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:32:26.514529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310262+0000","last_change":"2023-07-09T21:42:23.310262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310262+0000","last_undegraded":"2023-07-09T21:42:23.310262+0000","last_fullsized":"2023-07-09T21:42:23.310262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.313881+0000","last_change":"2023-07-09T21:42:23.312549+0000","last_active":"2023-07-09T21:42:23.313881+0000","last_peered":"2023-07-09T21:42:23.313881+0000","last_clean":"2023-07-09T21:42:23.313881+0000","last_became_active":"2023-07-09T21:42:23.312253+0000","last_became_peered":"2023-07-09T21:42:23.312253+0000","last_unstale":"2023-07-09T21:42:23.313881+0000","last_undegraded":"2023-07-09T21:42:23.313881+0000","last_fullsized":"2023-07-09T21:42:23.313881+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:46.146110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306251+0000","last_change":"2023-07-09T21:42:23.306251+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306251+0000","last_undegraded":"2023-07-09T21:42:23.306251+0000","last_fullsized":"2023-07-09T21:42:23.306251+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323169+0000","last_change":"2023-07-09T21:42:23.318094+0000","last_active":"2023-07-09T21:42:23.323169+0000","last_peered":"2023-07-09T21:42:23.323169+0000","last_clean":"2023-07-09T21:42:23.323169+0000","last_became_active":"2023-07-09T21:42:23.317250+0000","last_became_peered":"2023-07-09T21:42:23.317250+0000","last_unstale":"2023-07-09T21:42:23.323169+0000","last_undegraded":"2023-07-09T21:42:23.323169+0000","last_fullsized":"2023-07-09T21:42:23.323169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:32.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306505+0000","last_change":"2023-07-09T21:42:23.306505+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306505+0000","last_undegraded":"2023-07-09T21:42:23.306505+0000","last_fullsized":"2023-07-09T21:42:23.306505+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325246+0000","last_change":"2023-07-09T21:42:23.321567+0000","last_active":"2023-07-09T21:42:23.325246+0000","last_peered":"2023-07-09T21:42:23.325246+0000","last_clean":"2023-07-09T21:42:23.325246+0000","last_became_active":"2023-07-09T21:42:23.321261+0000","last_became_peered":"2023-07-09T21:42:23.321261+0000","last_unstale":"2023-07-09T21:42:23.325246+0000","last_undegraded":"2023-07-09T21:42:23.325246+0000","last_fullsized":"2023-07-09T21:42:23.325246+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:19:58.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309329+0000","last_change":"2023-07-09T21:42:23.309329+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309329+0000","last_undegraded":"2023-07-09T21:42:23.309329+0000","last_fullsized":"2023-07-09T21:42:23.309329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321683+0000","last_change":"2023-07-09T21:42:23.312157+0000","last_active":"2023-07-09T21:42:23.321683+0000","last_peered":"2023-07-09T21:42:23.321683+0000","last_clean":"2023-07-09T21:42:23.321683+0000","last_became_active":"2023-07-09T21:42:23.311856+0000","last_became_peered":"2023-07-09T21:42:23.311856+0000","last_unstale":"2023-07-09T21:42:23.321683+0000","last_undegraded":"2023-07-09T21:42:23.321683+0000","last_fullsized":"2023-07-09T21:42:23.321683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:26.029179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309981+0000","last_change":"2023-07-09T21:42:23.309981+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309981+0000","last_undegraded":"2023-07-09T21:42:23.309981+0000","last_fullsized":"2023-07-09T21:42:23.309981+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323775+0000","last_change":"2023-07-09T21:42:23.321319+0000","last_active":"2023-07-09T21:42:23.323775+0000","last_peered":"2023-07-09T21:42:23.323775+0000","last_clean":"2023-07-09T21:42:23.323775+0000","last_became_active":"2023-07-09T21:42:23.319622+0000","last_became_peered":"2023-07-09T21:42:23.319622+0000","last_unstale":"2023-07-09T21:42:23.323775+0000","last_undegraded":"2023-07-09T21:42:23.323775+0000","last_fullsized":"2023-07-09T21:42:23.323775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:03.639582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305099+0000","last_change":"2023-07-09T21:42:23.305099+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305099+0000","last_undegraded":"2023-07-09T21:42:23.305099+0000","last_fullsized":"2023-07-09T21:42:23.305099+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.328339+0000","last_change":"2023-07-09T21:42:23.326843+0000","last_active":"2023-07-09T21:42:23.328339+0000","last_peered":"2023-07-09T21:42:23.328339+0000","last_clean":"2023-07-09T21:42:23.328339+0000","last_became_active":"2023-07-09T21:42:23.326611+0000","last_became_peered":"2023-07-09T21:42:23.326611+0000","last_unstale":"2023-07-09T21:42:23.328339+0000","last_undegraded":"2023-07-09T21:42:23.328339+0000","last_fullsized":"2023-07-09T21:42:23.328339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:32:29.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306822+0000","last_change":"2023-07-09T21:42:23.306822+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306822+0000","last_undegraded":"2023-07-09T21:42:23.306822+0000","last_fullsized":"2023-07-09T21:42:23.306822+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320794+0000","last_change":"2023-07-09T21:42:23.316515+0000","last_active":"2023-07-09T21:42:23.320794+0000","last_peered":"2023-07-09T21:42:23.320794+0000","last_clean":"2023-07-09T21:42:23.320794+0000","last_became_active":"2023-07-09T21:42:23.316240+0000","last_became_peered":"2023-07-09T21:42:23.316240+0000","last_unstale":"2023-07-09T21:42:23.320794+0000","last_undegraded":"2023-07-09T21:42:23.320794+0000","last_fullsized":"2023-07-09T21:42:23.320794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:13.833805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308712+0000","last_change":"2023-07-09T21:42:23.308712+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308712+0000","last_undegraded":"2023-07-09T21:42:23.308712+0000","last_fullsized":"2023-07-09T21:42:23.308712+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.324145+0000","last_change":"2023-07-09T21:42:23.321738+0000","last_active":"2023-07-09T21:42:23.324145+0000","last_peered":"2023-07-09T21:42:23.324145+0000","last_clean":"2023-07-09T21:42:23.324145+0000","last_became_active":"2023-07-09T21:42:23.321449+0000","last_became_peered":"2023-07-09T21:42:23.321449+0000","last_unstale":"2023-07-09T21:42:23.324145+0000","last_undegraded":"2023-07-09T21:42:23.324145+0000","last_fullsized":"2023-07-09T21:42:23.324145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:55.722517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305350+0000","last_change":"2023-07-09T21:42:23.305350+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305350+0000","last_undegraded":"2023-07-09T21:42:23.305350+0000","last_fullsized":"2023-07-09T21:42:23.305350+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323989+0000","last_change":"2023-07-09T21:42:23.322172+0000","last_active":"2023-07-09T21:42:23.323989+0000","last_peered":"2023-07-09T21:42:23.323989+0000","last_clean":"2023-07-09T21:42:23.323989+0000","last_became_active":"2023-07-09T21:42:23.321875+0000","last_became_peered":"2023-07-09T21:42:23.321875+0000","last_unstale":"2023-07-09T21:42:23.323989+0000","last_undegraded":"2023-07-09T21:42:23.323989+0000","last_fullsized":"2023-07-09T21:42:23.323989+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:27.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308081+0000","last_change":"2023-07-09T21:42:23.308081+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308081+0000","last_undegraded":"2023-07-09T21:42:23.308081+0000","last_fullsized":"2023-07-09T21:42:23.308081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323711+0000","last_change":"2023-07-09T21:42:23.319699+0000","last_active":"2023-07-09T21:42:23.323711+0000","last_peered":"2023-07-09T21:42:23.323711+0000","last_clean":"2023-07-09T21:42:23.323711+0000","last_became_active":"2023-07-09T21:42:23.319049+0000","last_became_peered":"2023-07-09T21:42:23.319049+0000","last_unstale":"2023-07-09T21:42:23.323711+0000","last_undegraded":"2023-07-09T21:42:23.323711+0000","last_fullsized":"2023-07-09T21:42:23.323711+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:36.389079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306306+0000","last_change":"2023-07-09T21:42:23.306306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306306+0000","last_undegraded":"2023-07-09T21:42:23.306306+0000","last_fullsized":"2023-07-09T21:42:23.306306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323081+0000","last_change":"2023-07-09T21:42:23.318581+0000","last_active":"2023-07-09T21:42:23.323081+0000","last_peered":"2023-07-09T21:42:23.323081+0000","last_clean":"2023-07-09T21:42:23.323081+0000","last_became_active":"2023-07-09T21:42:23.318274+0000","last_became_peered":"2023-07-09T21:42:23.318274+0000","last_unstale":"2023-07-09T21:42:23.323081+0000","last_undegraded":"2023-07-09T21:42:23.323081+0000","last_fullsized":"2023-07-09T21:42:23.323081+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:43.862658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305908+0000","last_change":"2023-07-09T21:42:23.305908+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305908+0000","last_undegraded":"2023-07-09T21:42:23.305908+0000","last_fullsized":"2023-07-09T21:42:23.305908+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.326013+0000","last_change":"2023-07-09T21:42:23.323391+0000","last_active":"2023-07-09T21:42:23.326013+0000","last_peered":"2023-07-09T21:42:23.326013+0000","last_clean":"2023-07-09T21:42:23.326013+0000","last_became_active":"2023-07-09T21:42:23.323092+0000","last_became_peered":"2023-07-09T21:42:23.323092+0000","last_unstale":"2023-07-09T21:42:23.326013+0000","last_undegraded":"2023-07-09T21:42:23.326013+0000","last_fullsized":"2023-07-09T21:42:23.326013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:14.399839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303378+0000","last_change":"2023-07-09T21:42:23.303378+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303378+0000","last_undegraded":"2023-07-09T21:42:23.303378+0000","last_fullsized":"2023-07-09T21:42:23.303378+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325889+0000","last_change":"2023-07-09T21:42:23.323134+0000","last_active":"2023-07-09T21:42:23.325889+0000","last_peered":"2023-07-09T21:42:23.325889+0000","last_clean":"2023-07-09T21:42:23.325889+0000","last_became_active":"2023-07-09T21:42:23.322812+0000","last_became_peered":"2023-07-09T21:42:23.322812+0000","last_unstale":"2023-07-09T21:42:23.325889+0000","last_undegraded":"2023-07-09T21:42:23.325889+0000","last_fullsized":"2023-07-09T21:42:23.325889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301132+0000","last_change":"2023-07-09T21:42:23.301132+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301132+0000","last_undegraded":"2023-07-09T21:42:23.301132+0000","last_fullsized":"2023-07-09T21:42:23.301132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323335+0000","last_change":"2023-07-09T21:42:23.319083+0000","last_active":"2023-07-09T21:42:23.323335+0000","last_peered":"2023-07-09T21:42:23.323335+0000","last_clean":"2023-07-09T21:42:23.323335+0000","last_became_active":"2023-07-09T21:42:23.318700+0000","last_became_peered":"2023-07-09T21:42:23.318700+0000","last_unstale":"2023-07-09T21:42:23.323335+0000","last_undegraded":"2023-07-09T21:42:23.323335+0000","last_fullsized":"2023-07-09T21:42:23.323335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:02.724090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305566+0000","last_change":"2023-07-09T21:42:23.305566+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305566+0000","last_undegraded":"2023-07-09T21:42:23.305566+0000","last_fullsized":"2023-07-09T21:42:23.305566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322221+0000","last_change":"2023-07-09T21:42:23.319864+0000","last_active":"2023-07-09T21:42:23.322221+0000","last_peered":"2023-07-09T21:42:23.322221+0000","last_clean":"2023-07-09T21:42:23.322221+0000","last_became_active":"2023-07-09T21:42:23.319564+0000","last_became_peered":"2023-07-09T21:42:23.319564+0000","last_unstale":"2023-07-09T21:42:23.322221+0000","last_undegraded":"2023-07-09T21:42:23.322221+0000","last_fullsized":"2023-07-09T21:42:23.322221+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308258+0000","last_change":"2023-07-09T21:42:23.308258+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308258+0000","last_undegraded":"2023-07-09T21:42:23.308258+0000","last_fullsized":"2023-07-09T21:42:23.308258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320696+0000","last_change":"2023-07-09T21:42:23.317172+0000","last_active":"2023-07-09T21:42:23.320696+0000","last_peered":"2023-07-09T21:42:23.320696+0000","last_clean":"2023-07-09T21:42:23.320696+0000","last_became_active":"2023-07-09T21:42:23.316822+0000","last_became_peered":"2023-07-09T21:42:23.316822+0000","last_unstale":"2023-07-09T21:42:23.320696+0000","last_undegraded":"2023-07-09T21:42:23.320696+0000","last_fullsized":"2023-07-09T21:42:23.320696+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303494+0000","last_change":"2023-07-09T21:42:23.303494+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303494+0000","last_undegraded":"2023-07-09T21:42:23.303494+0000","last_fullsized":"2023-07-09T21:42:23.303494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322929+0000","last_change":"2023-07-09T21:42:23.317406+0000","last_active":"2023-07-09T21:42:23.322929+0000","last_peered":"2023-07-09T21:42:23.322929+0000","last_clean":"2023-07-09T21:42:23.322929+0000","last_became_active":"2023-07-09T21:42:23.317101+0000","last_became_peered":"2023-07-09T21:42:23.317101+0000","last_unstale":"2023-07-09T21:42:23.322929+0000","last_undegraded":"2023-07-09T21:42:23.322929+0000","last_fullsized":"2023-07-09T21:42:23.322929+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:26.668887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305032+0000","last_change":"2023-07-09T21:42:23.305032+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305032+0000","last_undegraded":"2023-07-09T21:42:23.305032+0000","last_fullsized":"2023-07-09T21:42:23.305032+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323622+0000","last_change":"2023-07-09T21:42:23.317720+0000","last_active":"2023-07-09T21:42:23.323622+0000","last_peered":"2023-07-09T21:42:23.323622+0000","last_clean":"2023-07-09T21:42:23.323622+0000","last_became_active":"2023-07-09T21:42:23.317450+0000","last_became_peered":"2023-07-09T21:42:23.317450+0000","last_unstale":"2023-07-09T21:42:23.323622+0000","last_undegraded":"2023-07-09T21:42:23.323622+0000","last_fullsized":"2023-07-09T21:42:23.323622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:23.634144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303306+0000","last_change":"2023-07-09T21:42:23.303306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303306+0000","last_undegraded":"2023-07-09T21:42:23.303306+0000","last_fullsized":"2023-07-09T21:42:23.303306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322282+0000","last_change":"2023-07-09T21:42:23.317380+0000","last_active":"2023-07-09T21:42:23.322282+0000","last_peered":"2023-07-09T21:42:23.322282+0000","last_clean":"2023-07-09T21:42:23.322282+0000","last_became_active":"2023-07-09T21:42:23.317089+0000","last_became_peered":"2023-07-09T21:42:23.317089+0000","last_unstale":"2023-07-09T21:42:23.322282+0000","last_undegraded":"2023-07-09T21:42:23.322282+0000","last_fullsized":"2023-07-09T21:42:23.322282+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:02.420175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"131'249","reported_seq":856,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308584+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:42:23.308584+0000","last_peered":"2023-07-09T21:42:23.308584+0000","last_clean":"2023-07-09T21:42:23.308584+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:42:23.308584+0000","last_undegraded":"2023-07-09T21:42:23.308584+0000","last_fullsized":"2023-07-09T21:42:23.308584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:34.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308485+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:42:23.308485+0000","last_peered":"2023-07-09T21:42:23.308485+0000","last_clean":"2023-07-09T21:42:23.308485+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:42:23.308485+0000","last_undegraded":"2023-07-09T21:42:23.308485+0000","last_fullsized":"2023-07-09T21:42:23.308485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:55.782028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308292+0000","last_change":"2023-07-09T21:42:23.308292+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308292+0000","last_undegraded":"2023-07-09T21:42:23.308292+0000","last_fullsized":"2023-07-09T21:42:23.308292+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.317564+0000","last_change":"2023-07-09T21:42:23.315778+0000","last_active":"2023-07-09T21:42:23.317564+0000","last_peered":"2023-07-09T21:42:23.317564+0000","last_clean":"2023-07-09T21:42:23.317564+0000","last_became_active":"2023-07-09T21:42:23.315455+0000","last_became_peered":"2023-07-09T21:42:23.315455+0000","last_unstale":"2023-07-09T21:42:23.317564+0000","last_undegraded":"2023-07-09T21:42:23.317564+0000","last_fullsized":"2023-07-09T21:42:23.317564+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:21.900726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308519+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:42:23.308519+0000","last_peered":"2023-07-09T21:42:23.308519+0000","last_clean":"2023-07-09T21:42:23.308519+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:42:23.308519+0000","last_undegraded":"2023-07-09T21:42:23.308519+0000","last_fullsized":"2023-07-09T21:42:23.308519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:18.103723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306646+0000","last_change":"2023-07-09T21:42:23.306646+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306646+0000","last_undegraded":"2023-07-09T21:42:23.306646+0000","last_fullsized":"2023-07-09T21:42:23.306646+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321967+0000","last_change":"2023-07-09T21:42:23.316498+0000","last_active":"2023-07-09T21:42:23.321967+0000","last_peered":"2023-07-09T21:42:23.321967+0000","last_clean":"2023-07-09T21:42:23.321967+0000","last_became_active":"2023-07-09T21:42:23.316189+0000","last_became_peered":"2023-07-09T21:42:23.316189+0000","last_unstale":"2023-07-09T21:42:23.321967+0000","last_undegraded":"2023-07-09T21:42:23.321967+0000","last_fullsized":"2023-07-09T21:42:23.321967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.300696+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:42:23.300696+0000","last_peered":"2023-07-09T21:42:23.300696+0000","last_clean":"2023-07-09T21:42:23.300696+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:42:23.300696+0000","last_undegraded":"2023-07-09T21:42:23.300696+0000","last_fullsized":"2023-07-09T21:42:23.300696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:58.675126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301043+0000","last_change":"2023-07-09T21:42:23.301043+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301043+0000","last_undegraded":"2023-07-09T21:42:23.301043+0000","last_fullsized":"2023-07-09T21:42:23.301043+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321235+0000","last_change":"2023-07-09T21:42:23.316447+0000","last_active":"2023-07-09T21:42:23.321235+0000","last_peered":"2023-07-09T21:42:23.321235+0000","last_clean":"2023-07-09T21:42:23.321235+0000","last_became_active":"2023-07-09T21:42:23.316152+0000","last_became_peered":"2023-07-09T21:42:23.316152+0000","last_unstale":"2023-07-09T21:42:23.321235+0000","last_undegraded":"2023-07-09T21:42:23.321235+0000","last_fullsized":"2023-07-09T21:42:23.321235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304899+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:42:23.304899+0000","last_peered":"2023-07-09T21:42:23.304899+0000","last_clean":"2023-07-09T21:42:23.304899+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:42:23.304899+0000","last_undegraded":"2023-07-09T21:42:23.304899+0000","last_fullsized":"2023-07-09T21:42:23.304899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:06.456355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307102+0000","last_change":"2023-07-09T21:42:23.307102+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307102+0000","last_undegraded":"2023-07-09T21:42:23.307102+0000","last_fullsized":"2023-07-09T21:42:23.307102+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325910+0000","last_change":"2023-07-09T21:42:23.323352+0000","last_active":"2023-07-09T21:42:23.325910+0000","last_peered":"2023-07-09T21:42:23.325910+0000","last_clean":"2023-07-09T21:42:23.325910+0000","last_became_active":"2023-07-09T21:42:23.322924+0000","last_became_peered":"2023-07-09T21:42:23.322924+0000","last_unstale":"2023-07-09T21:42:23.325910+0000","last_undegraded":"2023-07-09T21:42:23.325910+0000","last_fullsized":"2023-07-09T21:42:23.325910+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":222,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304581+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:42:23.304581+0000","last_peered":"2023-07-09T21:42:23.304581+0000","last_clean":"2023-07-09T21:42:23.304581+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:42:23.304581+0000","last_undegraded":"2023-07-09T21:42:23.304581+0000","last_fullsized":"2023-07-09T21:42:23.304581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:53.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306107+0000","last_change":"2023-07-09T21:42:23.306107+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306107+0000","last_undegraded":"2023-07-09T21:42:23.306107+0000","last_fullsized":"2023-07-09T21:42:23.306107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319979+0000","last_change":"2023-07-09T21:42:23.318436+0000","last_active":"2023-07-09T21:42:23.319979+0000","last_peered":"2023-07-09T21:42:23.319979+0000","last_clean":"2023-07-09T21:42:23.319979+0000","last_became_active":"2023-07-09T21:42:23.318133+0000","last_became_peered":"2023-07-09T21:42:23.318133+0000","last_unstale":"2023-07-09T21:42:23.319979+0000","last_undegraded":"2023-07-09T21:42:23.319979+0000","last_fullsized":"2023-07-09T21:42:23.319979+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:40.990502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.314271+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:42:23.314271+0000","last_peered":"2023-07-09T21:42:23.314271+0000","last_clean":"2023-07-09T21:42:23.314271+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:42:23.314271+0000","last_undegraded":"2023-07-09T21:42:23.314271+0000","last_fullsized":"2023-07-09T21:42:23.314271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:04.317714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303228+0000","last_change":"2023-07-09T21:42:23.303228+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303228+0000","last_undegraded":"2023-07-09T21:42:23.303228+0000","last_fullsized":"2023-07-09T21:42:23.303228+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319872+0000","last_change":"2023-07-09T21:42:23.317942+0000","last_active":"2023-07-09T21:42:23.319872+0000","last_peered":"2023-07-09T21:42:23.319872+0000","last_clean":"2023-07-09T21:42:23.319872+0000","last_became_active":"2023-07-09T21:42:23.317646+0000","last_became_peered":"2023-07-09T21:42:23.317646+0000","last_unstale":"2023-07-09T21:42:23.319872+0000","last_undegraded":"2023-07-09T21:42:23.319872+0000","last_fullsized":"2023-07-09T21:42:23.319872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:06.279519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.306022+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:42:23.306022+0000","last_peered":"2023-07-09T21:42:23.306022+0000","last_clean":"2023-07-09T21:42:23.306022+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:42:23.306022+0000","last_undegraded":"2023-07-09T21:42:23.306022+0000","last_fullsized":"2023-07-09T21:42:23.306022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:24.538480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305666+0000","last_change":"2023-07-09T21:42:23.305666+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305666+0000","last_undegraded":"2023-07-09T21:42:23.305666+0000","last_fullsized":"2023-07-09T21:42:23.305666+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322004+0000","last_change":"2023-07-09T21:42:23.317308+0000","last_active":"2023-07-09T21:42:23.322004+0000","last_peered":"2023-07-09T21:42:23.322004+0000","last_clean":"2023-07-09T21:42:23.322004+0000","last_became_active":"2023-07-09T21:42:23.316951+0000","last_became_peered":"2023-07-09T21:42:23.316951+0000","last_unstale":"2023-07-09T21:42:23.322004+0000","last_undegraded":"2023-07-09T21:42:23.322004+0000","last_fullsized":"2023-07-09T21:42:23.322004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:54.667721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":230,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.305292+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:42:23.305292+0000","last_peered":"2023-07-09T21:42:23.305292+0000","last_clean":"2023-07-09T21:42:23.305292+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:42:23.305292+0000","last_undegraded":"2023-07-09T21:42:23.305292+0000","last_fullsized":"2023-07-09T21:42:23.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:00:33.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575087,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59588,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312252,"statfs":{"total":96636764160,"available":96575746048,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":1.03,"15min":1.03},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.73299999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98999999999999999,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.006,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.77900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.95199999999999996,"5min":1.754,"15min":1.754},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.1140000000000001,"15min":1.129},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.86399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.38,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":1.0109999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":1.232,"15min":1.232},"last":0.86699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575086,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.95399999999999996,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97499999999999998,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98499999999999999,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.60299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.98899999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68899999999999995,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.88400000000000001,"5min":6.101,"15min":6.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.72099999999999997,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.69799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":0.96999999999999997,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575085,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.95299999999999996,"15min":1.02},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.56299999999999994,"5min":0.48899999999999999,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.86899999999999999,"5min":1.083,"15min":1.083},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.038},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.107,"15min":1.107},"last":0.755},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.96899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.70099999999999996},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.88900000000000001,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":1.26},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.45800000000000002},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.05},"last":0.879}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.85799999999999998,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575086,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68400000000000005,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":1.101,"15min":1.101},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.44}]},{"osd":4,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.3320000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.095,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.81499999999999995},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.0449999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.59199999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.51},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.46800000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.127},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.66700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316928,"statfs":{"total":96636764160,"available":96580534272,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.754},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":1.111}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834575087,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.76800000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.77500000000000002,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.1060000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.085,"5min":1.085,"15min":1.274},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.351},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.1160000000000001,"15min":1.242},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.206},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.012,"5min":1.107,"15min":1.173},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.81299999999999994},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":1.137,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.753},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.35099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":1.657,"15min":1.657},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.497}]},{"osd":4,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.087,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":0.88700000000000001,"5min":1.835,"15min":1.835},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.726,"15min":1.726},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1220000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.1439999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.883,"15min":1.883},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:42:28.425 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:42:28.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 Processor -- start 2023-07-09T21:42:28.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 -- start start 2023-07-09T21:42:28.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd87006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8700b4340 0x7fd8700d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8700b49f0 con 0x7fd8700cef80 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8700b7e80 con 0x7fd8700b4340 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd876f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700cc8a0 con 0x7fd8700b7ab0 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8700cef80 0x7fd8700b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37780/0 (socket says 172.21.15.37:37780) 2023-07-09T21:42:28.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86ffff640 1 -- 172.21.15.37:0/2563721995 learned_addr learned my addr 172.21.15.37:0/2563721995 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:28.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd87006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd87551f640 1 --2- 172.21.15.37:0/2563721995 >> v2:172.21.15.119:3300/0 conn(0x7fd8700b4340 0x7fd8700d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1893949320 0 0) 0x7fd8700b49f0 con 0x7fd8700cef80 2023-07-09T21:42:28.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003530 con 0x7fd8700cef80 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2465654532 0 0) 0x7fd860003530 con 0x7fd8700cef80 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 msgr2=0x7fd87006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd87006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 >> v2:172.21.15.119:3300/0 conn(0x7fd8700b4340 msgr2=0x7fd8700d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 --2- 172.21.15.37:0/2563721995 >> v2:172.21.15.119:3300/0 conn(0x7fd8700b4340 0x7fd8700d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700ccb80 con 0x7fd8700cef80 2023-07-09T21:42:28.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fd85c001680 con 0x7fd8700cef80 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 >> v1:172.21.15.37:6789/0 conn(0x7fd8700cef80 legacy=0x7fd8700b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860003980 0x7fd860003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600043b0 0x7fd860004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd860004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700cc8a0 con 0x7fd860003980 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd860005680 con 0x7fd8600043b0 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000ba10 con 0x7fd8700b7ab0 2023-07-09T21:42:28.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860003980 0x7fd860003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86ffff640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600043b0 0x7fd860004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd87551f640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd860004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 -- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 msgr2=0x7fd860004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8700b7ab0 0x7fd860004f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 -- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600043b0 msgr2=0x7fd860004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600043b0 0x7fd860004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd874d1e640 1 -- 172.21.15.37:0/2563721995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003530 con 0x7fd860003980 2023-07-09T21:42:28.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.600+0000 7fd86ffff640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8600043b0 0x7fd860004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd874d1e640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860003980 0x7fd860003d90 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd864009ae0 tx=0x7fd86401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=836852c75e8614db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a6510 con 0x7fd860003980 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8640a6670 con 0x7fd860003980 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd86f7fe640 1 -- 172.21.15.37:0/2563721995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8640a6a20 con 0x7fd860003980 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 -- 172.21.15.37:0/2563721995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860003980 msgr2=0x7fd860003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 --2- 172.21.15.37:0/2563721995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd860003980 0x7fd860003d90 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fd864009ae0 tx=0x7fd86401ca20 comp rx=0 tx=0).stop 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd87551f640 1 -- 172.21.15.37:0/2563721995 reap_dead start 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 -- 172.21.15.37:0/2563721995 shutdown_connections 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 -- 172.21.15.37:0/2563721995 >> 172.21.15.37:0/2563721995 conn(0x7fd870073090 msgr2=0x7fd870069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 -- 172.21.15.37:0/2563721995 shutdown_connections 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.604+0000 7fd876f82640 1 -- 172.21.15.37:0/2563721995 wait complete. 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 Processor -- start 2023-07-09T21:42:28.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- start start 2023-07-09T21:42:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 0x7fd8700cafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 0x7fd8701f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700c8bc0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701f80e0 con 0x7fd8701f7730 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700cc060 con 0x7fd860003980 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39664/0 (socket says 172.21.15.37:39664) 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 -- 172.21.15.37:0/3161082735 learned_addr learned my addr 172.21.15.37:0/3161082735 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:28.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd87551f640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 0x7fd8701f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd874d1e640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 0x7fd8700cafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 -- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 msgr2=0x7fd8700cafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 0x7fd8700cafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 -- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 msgr2=0x7fd8701f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 0x7fd8701f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 -- 172.21.15.37:0/3161082735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700cb6d0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd87551f640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 0x7fd8701f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:28.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd874d1e640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 0x7fd8700cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86ffff640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005fd0 tx=0x7fd85c00eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00c6c0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00c820 con 0x7fd8700cbbf0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00cb90 con 0x7fd8700cbbf0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8700c93b0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.608+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8700c9970 con 0x7fd8700cbbf0 2023-07-09T21:42:28.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8700d1fb0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd85c00ccf0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd86d7fa640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 0x7fd854068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fd85c083d00 con 0x7fd8700cbbf0 2023-07-09T21:42:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd874d1e640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 0x7fd854068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.612+0000 7fd874d1e640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 0x7fd854068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8640af000 tx=0x7fd8640046d0 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.616+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd85c0510e0 con 0x7fd8700cbbf0 2023-07-09T21:42:28.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.768+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8700c6020 con 0x7fd8540663d0 2023-07-09T21:42:28.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.776+0000 7fd86d7fa640 1 -- 172.21.15.37:0/3161082735 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306566 (secure 0 0 0) 0x7fd8700c6020 con 0x7fd8540663d0 2023-07-09T21:42:28.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:28.779 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:42:28.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 msgr2=0x7fd854068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 0x7fd854068880 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd8640af000 tx=0x7fd8640046d0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 msgr2=0x7fd8700ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7fd85c005fd0 tx=0x7fd85c00eba0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 shutdown_connections 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fd8540663d0 0x7fd854068880 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8701f7730 0x7fd8701f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8700cbbf0 0x7fd8700ca170 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 --2- 172.21.15.37:0/3161082735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd860003980 0x7fd8700cafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 >> 172.21.15.37:0/3161082735 conn(0x7fd870073090 msgr2=0x7fd87015e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 shutdown_connections 2023-07-09T21:42:28.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.780+0000 7fd876f82640 1 -- 172.21.15.37:0/3161082735 wait complete. 2023-07-09T21:42:28.799 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:42:27.949242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337928,"kb_used_data":14920,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636792,"statfs":{"total":773094113280,"available":772748075008,"internally_reserved":0,"allocated":15278080,"data_stored":8348632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.659657"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310004+0000","last_change":"2023-07-09T21:42:23.310004+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310004+0000","last_undegraded":"2023-07-09T21:42:23.310004+0000","last_fullsized":"2023-07-09T21:42:23.310004+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310493+0000","last_change":"2023-07-09T21:42:23.310493+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310493+0000","last_undegraded":"2023-07-09T21:42:23.310493+0000","last_fullsized":"2023-07-09T21:42:23.310493+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303821+0000","last_change":"2023-07-09T21:42:23.303821+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303821+0000","last_undegraded":"2023-07-09T21:42:23.303821+0000","last_fullsized":"2023-07-09T21:42:23.303821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303606+0000","last_change":"2023-07-09T21:42:23.303606+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303606+0000","last_undegraded":"2023-07-09T21:42:23.303606+0000","last_fullsized":"2023-07-09T21:42:23.303606+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309705+0000","last_change":"2023-07-09T21:42:23.309705+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309705+0000","last_undegraded":"2023-07-09T21:42:23.309705+0000","last_fullsized":"2023-07-09T21:42:23.309705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308749+0000","last_change":"2023-07-09T21:42:23.308749+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308749+0000","last_undegraded":"2023-07-09T21:42:23.308749+0000","last_fullsized":"2023-07-09T21:42:23.308749+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308437+0000","last_change":"2023-07-09T21:42:23.308437+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308437+0000","last_undegraded":"2023-07-09T21:42:23.308437+0000","last_fullsized":"2023-07-09T21:42:23.308437+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.302979+0000","last_change":"2023-07-09T21:42:23.302979+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.302979+0000","last_undegraded":"2023-07-09T21:42:23.302979+0000","last_fullsized":"2023-07-09T21:42:23.302979+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306444+0000","last_change":"2023-07-09T21:42:23.306444+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306444+0000","last_undegraded":"2023-07-09T21:42:23.306444+0000","last_fullsized":"2023-07-09T21:42:23.306444+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304802+0000","last_change":"2023-07-09T21:42:23.304802+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304802+0000","last_undegraded":"2023-07-09T21:42:23.304802+0000","last_fullsized":"2023-07-09T21:42:23.304802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311381+0000","last_change":"2023-07-09T21:42:23.311381+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311381+0000","last_undegraded":"2023-07-09T21:42:23.311381+0000","last_fullsized":"2023-07-09T21:42:23.311381+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310951+0000","last_change":"2023-07-09T21:42:23.310951+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310951+0000","last_undegraded":"2023-07-09T21:42:23.310951+0000","last_fullsized":"2023-07-09T21:42:23.310951+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306703+0000","last_change":"2023-07-09T21:42:23.306703+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306703+0000","last_undegraded":"2023-07-09T21:42:23.306703+0000","last_fullsized":"2023-07-09T21:42:23.306703+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311262+0000","last_change":"2023-07-09T21:42:23.311262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311262+0000","last_undegraded":"2023-07-09T21:42:23.311262+0000","last_fullsized":"2023-07-09T21:42:23.311262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310140+0000","last_change":"2023-07-09T21:42:23.310140+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310140+0000","last_undegraded":"2023-07-09T21:42:23.310140+0000","last_fullsized":"2023-07-09T21:42:23.310140+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.314499+0000","last_change":"2023-07-09T21:42:23.314499+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.314499+0000","last_undegraded":"2023-07-09T21:42:23.314499+0000","last_fullsized":"2023-07-09T21:42:23.314499+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305243+0000","last_change":"2023-07-09T21:42:23.305243+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305243+0000","last_undegraded":"2023-07-09T21:42:23.305243+0000","last_fullsized":"2023-07-09T21:42:23.305243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309975+0000","last_change":"2023-07-09T21:42:23.309975+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309975+0000","last_undegraded":"2023-07-09T21:42:23.309975+0000","last_fullsized":"2023-07-09T21:42:23.309975+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307726+0000","last_change":"2023-07-09T21:42:23.307726+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307726+0000","last_undegraded":"2023-07-09T21:42:23.307726+0000","last_fullsized":"2023-07-09T21:42:23.307726+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301131+0000","last_change":"2023-07-09T21:42:23.301131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301131+0000","last_undegraded":"2023-07-09T21:42:23.301131+0000","last_fullsized":"2023-07-09T21:42:23.301131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306131+0000","last_change":"2023-07-09T21:42:23.306131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306131+0000","last_undegraded":"2023-07-09T21:42:23.306131+0000","last_fullsized":"2023-07-09T21:42:23.306131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309637+0000","last_change":"2023-07-09T21:42:23.309637+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309637+0000","last_undegraded":"2023-07-09T21:42:23.309637+0000","last_fullsized":"2023-07-09T21:42:23.309637+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303449+0000","last_change":"2023-07-09T21:42:23.303449+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303449+0000","last_undegraded":"2023-07-09T21:42:23.303449+0000","last_fullsized":"2023-07-09T21:42:23.303449+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305954+0000","last_change":"2023-07-09T21:42:23.305954+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305954+0000","last_undegraded":"2023-07-09T21:42:23.305954+0000","last_fullsized":"2023-07-09T21:42:23.305954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306210+0000","last_change":"2023-07-09T21:42:23.306210+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306210+0000","last_undegraded":"2023-07-09T21:42:23.306210+0000","last_fullsized":"2023-07-09T21:42:23.306210+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301416+0000","last_change":"2023-07-09T21:42:23.301416+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301416+0000","last_undegraded":"2023-07-09T21:42:23.301416+0000","last_fullsized":"2023-07-09T21:42:23.301416+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307274+0000","last_change":"2023-07-09T21:42:23.307274+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307274+0000","last_undegraded":"2023-07-09T21:42:23.307274+0000","last_fullsized":"2023-07-09T21:42:23.307274+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310480+0000","last_change":"2023-07-09T21:42:23.310480+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310480+0000","last_undegraded":"2023-07-09T21:42:23.310480+0000","last_fullsized":"2023-07-09T21:42:23.310480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301051+0000","last_change":"2023-07-09T21:42:23.301051+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301051+0000","last_undegraded":"2023-07-09T21:42:23.301051+0000","last_fullsized":"2023-07-09T21:42:23.301051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310794+0000","last_change":"2023-07-09T21:42:23.310794+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310794+0000","last_undegraded":"2023-07-09T21:42:23.310794+0000","last_fullsized":"2023-07-09T21:42:23.310794+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306211+0000","last_change":"2023-07-09T21:42:23.306211+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306211+0000","last_undegraded":"2023-07-09T21:42:23.306211+0000","last_fullsized":"2023-07-09T21:42:23.306211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305336+0000","last_change":"2023-07-09T21:42:23.305336+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305336+0000","last_undegraded":"2023-07-09T21:42:23.305336+0000","last_fullsized":"2023-07-09T21:42:23.305336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304212+0000","last_change":"2023-07-09T21:42:23.304212+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304212+0000","last_undegraded":"2023-07-09T21:42:23.304212+0000","last_fullsized":"2023-07-09T21:42:23.304212+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323320+0000","last_change":"2023-07-09T21:42:23.319972+0000","last_active":"2023-07-09T21:42:23.323320+0000","last_peered":"2023-07-09T21:42:23.323320+0000","last_clean":"2023-07-09T21:42:23.323320+0000","last_became_active":"2023-07-09T21:42:23.319687+0000","last_became_peered":"2023-07-09T21:42:23.319687+0000","last_unstale":"2023-07-09T21:42:23.323320+0000","last_undegraded":"2023-07-09T21:42:23.323320+0000","last_fullsized":"2023-07-09T21:42:23.323320+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308158+0000","last_change":"2023-07-09T21:42:23.308158+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308158+0000","last_undegraded":"2023-07-09T21:42:23.308158+0000","last_fullsized":"2023-07-09T21:42:23.308158+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320230+0000","last_change":"2023-07-09T21:42:23.315824+0000","last_active":"2023-07-09T21:42:23.320230+0000","last_peered":"2023-07-09T21:42:23.320230+0000","last_clean":"2023-07-09T21:42:23.320230+0000","last_became_active":"2023-07-09T21:42:23.315550+0000","last_became_peered":"2023-07-09T21:42:23.315550+0000","last_unstale":"2023-07-09T21:42:23.320230+0000","last_undegraded":"2023-07-09T21:42:23.320230+0000","last_fullsized":"2023-07-09T21:42:23.320230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:32.701564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306443+0000","last_change":"2023-07-09T21:42:23.306443+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306443+0000","last_undegraded":"2023-07-09T21:42:23.306443+0000","last_fullsized":"2023-07-09T21:42:23.306443+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323699+0000","last_change":"2023-07-09T21:42:23.319552+0000","last_active":"2023-07-09T21:42:23.323699+0000","last_peered":"2023-07-09T21:42:23.323699+0000","last_clean":"2023-07-09T21:42:23.323699+0000","last_became_active":"2023-07-09T21:42:23.319258+0000","last_became_peered":"2023-07-09T21:42:23.319258+0000","last_unstale":"2023-07-09T21:42:23.323699+0000","last_undegraded":"2023-07-09T21:42:23.323699+0000","last_fullsized":"2023-07-09T21:42:23.323699+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:33:12.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303257+0000","last_change":"2023-07-09T21:42:23.303257+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303257+0000","last_undegraded":"2023-07-09T21:42:23.303257+0000","last_fullsized":"2023-07-09T21:42:23.303257+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323516+0000","last_change":"2023-07-09T21:42:23.318851+0000","last_active":"2023-07-09T21:42:23.323516+0000","last_peered":"2023-07-09T21:42:23.323516+0000","last_clean":"2023-07-09T21:42:23.323516+0000","last_became_active":"2023-07-09T21:42:23.318580+0000","last_became_peered":"2023-07-09T21:42:23.318580+0000","last_unstale":"2023-07-09T21:42:23.323516+0000","last_undegraded":"2023-07-09T21:42:23.323516+0000","last_fullsized":"2023-07-09T21:42:23.323516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:32:09.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304358+0000","last_change":"2023-07-09T21:42:23.304358+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304358+0000","last_undegraded":"2023-07-09T21:42:23.304358+0000","last_fullsized":"2023-07-09T21:42:23.304358+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325042+0000","last_change":"2023-07-09T21:42:23.321154+0000","last_active":"2023-07-09T21:42:23.325042+0000","last_peered":"2023-07-09T21:42:23.325042+0000","last_clean":"2023-07-09T21:42:23.325042+0000","last_became_active":"2023-07-09T21:42:23.320801+0000","last_became_peered":"2023-07-09T21:42:23.320801+0000","last_unstale":"2023-07-09T21:42:23.325042+0000","last_undegraded":"2023-07-09T21:42:23.325042+0000","last_fullsized":"2023-07-09T21:42:23.325042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309560+0000","last_change":"2023-07-09T21:42:23.309560+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309560+0000","last_undegraded":"2023-07-09T21:42:23.309560+0000","last_fullsized":"2023-07-09T21:42:23.309560+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325077+0000","last_change":"2023-07-09T21:42:23.320117+0000","last_active":"2023-07-09T21:42:23.325077+0000","last_peered":"2023-07-09T21:42:23.325077+0000","last_clean":"2023-07-09T21:42:23.325077+0000","last_became_active":"2023-07-09T21:42:23.319851+0000","last_became_peered":"2023-07-09T21:42:23.319851+0000","last_unstale":"2023-07-09T21:42:23.325077+0000","last_undegraded":"2023-07-09T21:42:23.325077+0000","last_fullsized":"2023-07-09T21:42:23.325077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:32:26.514529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310262+0000","last_change":"2023-07-09T21:42:23.310262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310262+0000","last_undegraded":"2023-07-09T21:42:23.310262+0000","last_fullsized":"2023-07-09T21:42:23.310262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.313881+0000","last_change":"2023-07-09T21:42:23.312549+0000","last_active":"2023-07-09T21:42:23.313881+0000","last_peered":"2023-07-09T21:42:23.313881+0000","last_clean":"2023-07-09T21:42:23.313881+0000","last_became_active":"2023-07-09T21:42:23.312253+0000","last_became_peered":"2023-07-09T21:42:23.312253+0000","last_unstale":"2023-07-09T21:42:23.313881+0000","last_undegraded":"2023-07-09T21:42:23.313881+0000","last_fullsized":"2023-07-09T21:42:23.313881+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:46.146110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306251+0000","last_change":"2023-07-09T21:42:23.306251+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306251+0000","last_undegraded":"2023-07-09T21:42:23.306251+0000","last_fullsized":"2023-07-09T21:42:23.306251+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323169+0000","last_change":"2023-07-09T21:42:23.318094+0000","last_active":"2023-07-09T21:42:23.323169+0000","last_peered":"2023-07-09T21:42:23.323169+0000","last_clean":"2023-07-09T21:42:23.323169+0000","last_became_active":"2023-07-09T21:42:23.317250+0000","last_became_peered":"2023-07-09T21:42:23.317250+0000","last_unstale":"2023-07-09T21:42:23.323169+0000","last_undegraded":"2023-07-09T21:42:23.323169+0000","last_fullsized":"2023-07-09T21:42:23.323169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:32.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306505+0000","last_change":"2023-07-09T21:42:23.306505+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306505+0000","last_undegraded":"2023-07-09T21:42:23.306505+0000","last_fullsized":"2023-07-09T21:42:23.306505+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325246+0000","last_change":"2023-07-09T21:42:23.321567+0000","last_active":"2023-07-09T21:42:23.325246+0000","last_peered":"2023-07-09T21:42:23.325246+0000","last_clean":"2023-07-09T21:42:23.325246+0000","last_became_active":"2023-07-09T21:42:23.321261+0000","last_became_peered":"2023-07-09T21:42:23.321261+0000","last_unstale":"2023-07-09T21:42:23.325246+0000","last_undegraded":"2023-07-09T21:42:23.325246+0000","last_fullsized":"2023-07-09T21:42:23.325246+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:19:58.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309329+0000","last_change":"2023-07-09T21:42:23.309329+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309329+0000","last_undegraded":"2023-07-09T21:42:23.309329+0000","last_fullsized":"2023-07-09T21:42:23.309329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321683+0000","last_change":"2023-07-09T21:42:23.312157+0000","last_active":"2023-07-09T21:42:23.321683+0000","last_peered":"2023-07-09T21:42:23.321683+0000","last_clean":"2023-07-09T21:42:23.321683+0000","last_became_active":"2023-07-09T21:42:23.311856+0000","last_became_peered":"2023-07-09T21:42:23.311856+0000","last_unstale":"2023-07-09T21:42:23.321683+0000","last_undegraded":"2023-07-09T21:42:23.321683+0000","last_fullsized":"2023-07-09T21:42:23.321683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:26.029179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309981+0000","last_change":"2023-07-09T21:42:23.309981+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309981+0000","last_undegraded":"2023-07-09T21:42:23.309981+0000","last_fullsized":"2023-07-09T21:42:23.309981+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323775+0000","last_change":"2023-07-09T21:42:23.321319+0000","last_active":"2023-07-09T21:42:23.323775+0000","last_peered":"2023-07-09T21:42:23.323775+0000","last_clean":"2023-07-09T21:42:23.323775+0000","last_became_active":"2023-07-09T21:42:23.319622+0000","last_became_peered":"2023-07-09T21:42:23.319622+0000","last_unstale":"2023-07-09T21:42:23.323775+0000","last_undegraded":"2023-07-09T21:42:23.323775+0000","last_fullsized":"2023-07-09T21:42:23.323775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:03.639582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305099+0000","last_change":"2023-07-09T21:42:23.305099+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305099+0000","last_undegraded":"2023-07-09T21:42:23.305099+0000","last_fullsized":"2023-07-09T21:42:23.305099+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.328339+0000","last_change":"2023-07-09T21:42:23.326843+0000","last_active":"2023-07-09T21:42:23.328339+0000","last_peered":"2023-07-09T21:42:23.328339+0000","last_clean":"2023-07-09T21:42:23.328339+0000","last_became_active":"2023-07-09T21:42:23.326611+0000","last_became_peered":"2023-07-09T21:42:23.326611+0000","last_unstale":"2023-07-09T21:42:23.328339+0000","last_undegraded":"2023-07-09T21:42:23.328339+0000","last_fullsized":"2023-07-09T21:42:23.328339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:32:29.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306822+0000","last_change":"2023-07-09T21:42:23.306822+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306822+0000","last_undegraded":"2023-07-09T21:42:23.306822+0000","last_fullsized":"2023-07-09T21:42:23.306822+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320794+0000","last_change":"2023-07-09T21:42:23.316515+0000","last_active":"2023-07-09T21:42:23.320794+0000","last_peered":"2023-07-09T21:42:23.320794+0000","last_clean":"2023-07-09T21:42:23.320794+0000","last_became_active":"2023-07-09T21:42:23.316240+0000","last_became_peered":"2023-07-09T21:42:23.316240+0000","last_unstale":"2023-07-09T21:42:23.320794+0000","last_undegraded":"2023-07-09T21:42:23.320794+0000","last_fullsized":"2023-07-09T21:42:23.320794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:13.833805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308712+0000","last_change":"2023-07-09T21:42:23.308712+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308712+0000","last_undegraded":"2023-07-09T21:42:23.308712+0000","last_fullsized":"2023-07-09T21:42:23.308712+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.324145+0000","last_change":"2023-07-09T21:42:23.321738+0000","last_active":"2023-07-09T21:42:23.324145+0000","last_peered":"2023-07-09T21:42:23.324145+0000","last_clean":"2023-07-09T21:42:23.324145+0000","last_became_active":"2023-07-09T21:42:23.321449+0000","last_became_peered":"2023-07-09T21:42:23.321449+0000","last_unstale":"2023-07-09T21:42:23.324145+0000","last_undegraded":"2023-07-09T21:42:23.324145+0000","last_fullsized":"2023-07-09T21:42:23.324145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:55.722517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305350+0000","last_change":"2023-07-09T21:42:23.305350+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305350+0000","last_undegraded":"2023-07-09T21:42:23.305350+0000","last_fullsized":"2023-07-09T21:42:23.305350+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323989+0000","last_change":"2023-07-09T21:42:23.322172+0000","last_active":"2023-07-09T21:42:23.323989+0000","last_peered":"2023-07-09T21:42:23.323989+0000","last_clean":"2023-07-09T21:42:23.323989+0000","last_became_active":"2023-07-09T21:42:23.321875+0000","last_became_peered":"2023-07-09T21:42:23.321875+0000","last_unstale":"2023-07-09T21:42:23.323989+0000","last_undegraded":"2023-07-09T21:42:23.323989+0000","last_fullsized":"2023-07-09T21:42:23.323989+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:27.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308081+0000","last_change":"2023-07-09T21:42:23.308081+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308081+0000","last_undegraded":"2023-07-09T21:42:23.308081+0000","last_fullsized":"2023-07-09T21:42:23.308081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323711+0000","last_change":"2023-07-09T21:42:23.319699+0000","last_active":"2023-07-09T21:42:23.323711+0000","last_peered":"2023-07-09T21:42:23.323711+0000","last_clean":"2023-07-09T21:42:23.323711+0000","last_became_active":"2023-07-09T21:42:23.319049+0000","last_became_peered":"2023-07-09T21:42:23.319049+0000","last_unstale":"2023-07-09T21:42:23.323711+0000","last_undegraded":"2023-07-09T21:42:23.323711+0000","last_fullsized":"2023-07-09T21:42:23.323711+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:36.389079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306306+0000","last_change":"2023-07-09T21:42:23.306306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306306+0000","last_undegraded":"2023-07-09T21:42:23.306306+0000","last_fullsized":"2023-07-09T21:42:23.306306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323081+0000","last_change":"2023-07-09T21:42:23.318581+0000","last_active":"2023-07-09T21:42:23.323081+0000","last_peered":"2023-07-09T21:42:23.323081+0000","last_clean":"2023-07-09T21:42:23.323081+0000","last_became_active":"2023-07-09T21:42:23.318274+0000","last_became_peered":"2023-07-09T21:42:23.318274+0000","last_unstale":"2023-07-09T21:42:23.323081+0000","last_undegraded":"2023-07-09T21:42:23.323081+0000","last_fullsized":"2023-07-09T21:42:23.323081+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:43.862658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305908+0000","last_change":"2023-07-09T21:42:23.305908+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305908+0000","last_undegraded":"2023-07-09T21:42:23.305908+0000","last_fullsized":"2023-07-09T21:42:23.305908+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.326013+0000","last_change":"2023-07-09T21:42:23.323391+0000","last_active":"2023-07-09T21:42:23.326013+0000","last_peered":"2023-07-09T21:42:23.326013+0000","last_clean":"2023-07-09T21:42:23.326013+0000","last_became_active":"2023-07-09T21:42:23.323092+0000","last_became_peered":"2023-07-09T21:42:23.323092+0000","last_unstale":"2023-07-09T21:42:23.326013+0000","last_undegraded":"2023-07-09T21:42:23.326013+0000","last_fullsized":"2023-07-09T21:42:23.326013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:14.399839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303378+0000","last_change":"2023-07-09T21:42:23.303378+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303378+0000","last_undegraded":"2023-07-09T21:42:23.303378+0000","last_fullsized":"2023-07-09T21:42:23.303378+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325889+0000","last_change":"2023-07-09T21:42:23.323134+0000","last_active":"2023-07-09T21:42:23.325889+0000","last_peered":"2023-07-09T21:42:23.325889+0000","last_clean":"2023-07-09T21:42:23.325889+0000","last_became_active":"2023-07-09T21:42:23.322812+0000","last_became_peered":"2023-07-09T21:42:23.322812+0000","last_unstale":"2023-07-09T21:42:23.325889+0000","last_undegraded":"2023-07-09T21:42:23.325889+0000","last_fullsized":"2023-07-09T21:42:23.325889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301132+0000","last_change":"2023-07-09T21:42:23.301132+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301132+0000","last_undegraded":"2023-07-09T21:42:23.301132+0000","last_fullsized":"2023-07-09T21:42:23.301132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323335+0000","last_change":"2023-07-09T21:42:23.319083+0000","last_active":"2023-07-09T21:42:23.323335+0000","last_peered":"2023-07-09T21:42:23.323335+0000","last_clean":"2023-07-09T21:42:23.323335+0000","last_became_active":"2023-07-09T21:42:23.318700+0000","last_became_peered":"2023-07-09T21:42:23.318700+0000","last_unstale":"2023-07-09T21:42:23.323335+0000","last_undegraded":"2023-07-09T21:42:23.323335+0000","last_fullsized":"2023-07-09T21:42:23.323335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:02.724090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305566+0000","last_change":"2023-07-09T21:42:23.305566+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305566+0000","last_undegraded":"2023-07-09T21:42:23.305566+0000","last_fullsized":"2023-07-09T21:42:23.305566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322221+0000","last_change":"2023-07-09T21:42:23.319864+0000","last_active":"2023-07-09T21:42:23.322221+0000","last_peered":"2023-07-09T21:42:23.322221+0000","last_clean":"2023-07-09T21:42:23.322221+0000","last_became_active":"2023-07-09T21:42:23.319564+0000","last_became_peered":"2023-07-09T21:42:23.319564+0000","last_unstale":"2023-07-09T21:42:23.322221+0000","last_undegraded":"2023-07-09T21:42:23.322221+0000","last_fullsized":"2023-07-09T21:42:23.322221+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308258+0000","last_change":"2023-07-09T21:42:23.308258+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308258+0000","last_undegraded":"2023-07-09T21:42:23.308258+0000","last_fullsized":"2023-07-09T21:42:23.308258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320696+0000","last_change":"2023-07-09T21:42:23.317172+0000","last_active":"2023-07-09T21:42:23.320696+0000","last_peered":"2023-07-09T21:42:23.320696+0000","last_clean":"2023-07-09T21:42:23.320696+0000","last_became_active":"2023-07-09T21:42:23.316822+0000","last_became_peered":"2023-07-09T21:42:23.316822+0000","last_unstale":"2023-07-09T21:42:23.320696+0000","last_undegraded":"2023-07-09T21:42:23.320696+0000","last_fullsized":"2023-07-09T21:42:23.320696+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303494+0000","last_change":"2023-07-09T21:42:23.303494+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303494+0000","last_undegraded":"2023-07-09T21:42:23.303494+0000","last_fullsized":"2023-07-09T21:42:23.303494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322929+0000","last_change":"2023-07-09T21:42:23.317406+0000","last_active":"2023-07-09T21:42:23.322929+0000","last_peered":"2023-07-09T21:42:23.322929+0000","last_clean":"2023-07-09T21:42:23.322929+0000","last_became_active":"2023-07-09T21:42:23.317101+0000","last_became_peered":"2023-07-09T21:42:23.317101+0000","last_unstale":"2023-07-09T21:42:23.322929+0000","last_undegraded":"2023-07-09T21:42:23.322929+0000","last_fullsized":"2023-07-09T21:42:23.322929+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:26.668887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305032+0000","last_change":"2023-07-09T21:42:23.305032+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305032+0000","last_undegraded":"2023-07-09T21:42:23.305032+0000","last_fullsized":"2023-07-09T21:42:23.305032+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323622+0000","last_change":"2023-07-09T21:42:23.317720+0000","last_active":"2023-07-09T21:42:23.323622+0000","last_peered":"2023-07-09T21:42:23.323622+0000","last_clean":"2023-07-09T21:42:23.323622+0000","last_became_active":"2023-07-09T21:42:23.317450+0000","last_became_peered":"2023-07-09T21:42:23.317450+0000","last_unstale":"2023-07-09T21:42:23.323622+0000","last_undegraded":"2023-07-09T21:42:23.323622+0000","last_fullsized":"2023-07-09T21:42:23.323622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:23.634144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303306+0000","last_change":"2023-07-09T21:42:23.303306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303306+0000","last_undegraded":"2023-07-09T21:42:23.303306+0000","last_fullsized":"2023-07-09T21:42:23.303306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322282+0000","last_change":"2023-07-09T21:42:23.317380+0000","last_active":"2023-07-09T21:42:23.322282+0000","last_peered":"2023-07-09T21:42:23.322282+0000","last_clean":"2023-07-09T21:42:23.322282+0000","last_became_active":"2023-07-09T21:42:23.317089+0000","last_became_peered":"2023-07-09T21:42:23.317089+0000","last_unstale":"2023-07-09T21:42:23.322282+0000","last_undegraded":"2023-07-09T21:42:23.322282+0000","last_fullsized":"2023-07-09T21:42:23.322282+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:02.420175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"131'249","reported_seq":856,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308584+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:42:23.308584+0000","last_peered":"2023-07-09T21:42:23.308584+0000","last_clean":"2023-07-09T21:42:23.308584+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:42:23.308584+0000","last_undegraded":"2023-07-09T21:42:23.308584+0000","last_fullsized":"2023-07-09T21:42:23.308584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:34.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308485+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:42:23.308485+0000","last_peered":"2023-07-09T21:42:23.308485+0000","last_clean":"2023-07-09T21:42:23.308485+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:42:23.308485+0000","last_undegraded":"2023-07-09T21:42:23.308485+0000","last_fullsized":"2023-07-09T21:42:23.308485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:55.782028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308292+0000","last_change":"2023-07-09T21:42:23.308292+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308292+0000","last_undegraded":"2023-07-09T21:42:23.308292+0000","last_fullsized":"2023-07-09T21:42:23.308292+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.317564+0000","last_change":"2023-07-09T21:42:23.315778+0000","last_active":"2023-07-09T21:42:23.317564+0000","last_peered":"2023-07-09T21:42:23.317564+0000","last_clean":"2023-07-09T21:42:23.317564+0000","last_became_active":"2023-07-09T21:42:23.315455+0000","last_became_peered":"2023-07-09T21:42:23.315455+0000","last_unstale":"2023-07-09T21:42:23.317564+0000","last_undegraded":"2023-07-09T21:42:23.317564+0000","last_fullsized":"2023-07-09T21:42:23.317564+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:21.900726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308519+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:42:23.308519+0000","last_peered":"2023-07-09T21:42:23.308519+0000","last_clean":"2023-07-09T21:42:23.308519+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:42:23.308519+0000","last_undegraded":"2023-07-09T21:42:23.308519+0000","last_fullsized":"2023-07-09T21:42:23.308519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:18.103723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306646+0000","last_change":"2023-07-09T21:42:23.306646+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306646+0000","last_undegraded":"2023-07-09T21:42:23.306646+0000","last_fullsized":"2023-07-09T21:42:23.306646+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321967+0000","last_change":"2023-07-09T21:42:23.316498+0000","last_active":"2023-07-09T21:42:23.321967+0000","last_peered":"2023-07-09T21:42:23.321967+0000","last_clean":"2023-07-09T21:42:23.321967+0000","last_became_active":"2023-07-09T21:42:23.316189+0000","last_became_peered":"2023-07-09T21:42:23.316189+0000","last_unstale":"2023-07-09T21:42:23.321967+0000","last_undegraded":"2023-07-09T21:42:23.321967+0000","last_fullsized":"2023-07-09T21:42:23.321967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.300696+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:42:23.300696+0000","last_peered":"2023-07-09T21:42:23.300696+0000","last_clean":"2023-07-09T21:42:23.300696+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:42:23.300696+0000","last_undegraded":"2023-07-09T21:42:23.300696+0000","last_fullsized":"2023-07-09T21:42:23.300696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:58.675126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301043+0000","last_change":"2023-07-09T21:42:23.301043+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301043+0000","last_undegraded":"2023-07-09T21:42:23.301043+0000","last_fullsized":"2023-07-09T21:42:23.301043+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321235+0000","last_change":"2023-07-09T21:42:23.316447+0000","last_active":"2023-07-09T21:42:23.321235+0000","last_peered":"2023-07-09T21:42:23.321235+0000","last_clean":"2023-07-09T21:42:23.321235+0000","last_became_active":"2023-07-09T21:42:23.316152+0000","last_became_peered":"2023-07-09T21:42:23.316152+0000","last_unstale":"2023-07-09T21:42:23.321235+0000","last_undegraded":"2023-07-09T21:42:23.321235+0000","last_fullsized":"2023-07-09T21:42:23.321235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304899+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:42:23.304899+0000","last_peered":"2023-07-09T21:42:23.304899+0000","last_clean":"2023-07-09T21:42:23.304899+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:42:23.304899+0000","last_undegraded":"2023-07-09T21:42:23.304899+0000","last_fullsized":"2023-07-09T21:42:23.304899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:06.456355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307102+0000","last_change":"2023-07-09T21:42:23.307102+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307102+0000","last_undegraded":"2023-07-09T21:42:23.307102+0000","last_fullsized":"2023-07-09T21:42:23.307102+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325910+0000","last_change":"2023-07-09T21:42:23.323352+0000","last_active":"2023-07-09T21:42:23.325910+0000","last_peered":"2023-07-09T21:42:23.325910+0000","last_clean":"2023-07-09T21:42:23.325910+0000","last_became_active":"2023-07-09T21:42:23.322924+0000","last_became_peered":"2023-07-09T21:42:23.322924+0000","last_unstale":"2023-07-09T21:42:23.325910+0000","last_undegraded":"2023-07-09T21:42:23.325910+0000","last_fullsized":"2023-07-09T21:42:23.325910+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":222,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304581+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:42:23.304581+0000","last_peered":"2023-07-09T21:42:23.304581+0000","last_clean":"2023-07-09T21:42:23.304581+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:42:23.304581+0000","last_undegraded":"2023-07-09T21:42:23.304581+0000","last_fullsized":"2023-07-09T21:42:23.304581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:53.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306107+0000","last_change":"2023-07-09T21:42:23.306107+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306107+0000","last_undegraded":"2023-07-09T21:42:23.306107+0000","last_fullsized":"2023-07-09T21:42:23.306107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319979+0000","last_change":"2023-07-09T21:42:23.318436+0000","last_active":"2023-07-09T21:42:23.319979+0000","last_peered":"2023-07-09T21:42:23.319979+0000","last_clean":"2023-07-09T21:42:23.319979+0000","last_became_active":"2023-07-09T21:42:23.318133+0000","last_became_peered":"2023-07-09T21:42:23.318133+0000","last_unstale":"2023-07-09T21:42:23.319979+0000","last_undegraded":"2023-07-09T21:42:23.319979+0000","last_fullsized":"2023-07-09T21:42:23.319979+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:40.990502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.314271+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:42:23.314271+0000","last_peered":"2023-07-09T21:42:23.314271+0000","last_clean":"2023-07-09T21:42:23.314271+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:42:23.314271+0000","last_undegraded":"2023-07-09T21:42:23.314271+0000","last_fullsized":"2023-07-09T21:42:23.314271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:04.317714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303228+0000","last_change":"2023-07-09T21:42:23.303228+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303228+0000","last_undegraded":"2023-07-09T21:42:23.303228+0000","last_fullsized":"2023-07-09T21:42:23.303228+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319872+0000","last_change":"2023-07-09T21:42:23.317942+0000","last_active":"2023-07-09T21:42:23.319872+0000","last_peered":"2023-07-09T21:42:23.319872+0000","last_clean":"2023-07-09T21:42:23.319872+0000","last_became_active":"2023-07-09T21:42:23.317646+0000","last_became_peered":"2023-07-09T21:42:23.317646+0000","last_unstale":"2023-07-09T21:42:23.319872+0000","last_undegraded":"2023-07-09T21:42:23.319872+0000","last_fullsized":"2023-07-09T21:42:23.319872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:06.279519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.306022+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:42:23.306022+0000","last_peered":"2023-07-09T21:42:23.306022+0000","last_clean":"2023-07-09T21:42:23.306022+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:42:23.306022+0000","last_undegraded":"2023-07-09T21:42:23.306022+0000","last_fullsized":"2023-07-09T21:42:23.306022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:24.538480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305666+0000","last_change":"2023-07-09T21:42:23.305666+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305666+0000","last_undegraded":"2023-07-09T21:42:23.305666+0000","last_fullsized":"2023-07-09T21:42:23.305666+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322004+0000","last_change":"2023-07-09T21:42:23.317308+0000","last_active":"2023-07-09T21:42:23.322004+0000","last_peered":"2023-07-09T21:42:23.322004+0000","last_clean":"2023-07-09T21:42:23.322004+0000","last_became_active":"2023-07-09T21:42:23.316951+0000","last_became_peered":"2023-07-09T21:42:23.316951+0000","last_unstale":"2023-07-09T21:42:23.322004+0000","last_undegraded":"2023-07-09T21:42:23.322004+0000","last_fullsized":"2023-07-09T21:42:23.322004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:54.667721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":230,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.305292+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:42:23.305292+0000","last_peered":"2023-07-09T21:42:23.305292+0000","last_clean":"2023-07-09T21:42:23.305292+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:42:23.305292+0000","last_undegraded":"2023-07-09T21:42:23.305292+0000","last_fullsized":"2023-07-09T21:42:23.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:00:33.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575087,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59588,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312252,"statfs":{"total":96636764160,"available":96575746048,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":1.03,"15min":1.03},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.73299999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98999999999999999,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.006,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.77900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.95199999999999996,"5min":1.754,"15min":1.754},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.1140000000000001,"15min":1.129},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.86399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.38,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":1.0109999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":1.232,"15min":1.232},"last":0.86699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575086,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.95399999999999996,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97499999999999998,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98499999999999999,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.60299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.98899999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68899999999999995,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.88400000000000001,"5min":6.101,"15min":6.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.72099999999999997,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.69799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":0.96999999999999997,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575085,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.95299999999999996,"15min":1.02},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.56299999999999994,"5min":0.48899999999999999,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.86899999999999999,"5min":1.083,"15min":1.083},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.038},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.107,"15min":1.107},"last":0.755},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.96899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.70099999999999996},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.88900000000000001,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":1.26},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.45800000000000002},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.05},"last":0.879}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.85799999999999998,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575086,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68400000000000005,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":1.101,"15min":1.101},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.44}]},{"osd":4,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.3320000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.095,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.81499999999999995},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.0449999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.59199999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.51},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.46800000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.127},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.66700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316928,"statfs":{"total":96636764160,"available":96580534272,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.754},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":1.111}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834575087,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.76800000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.77500000000000002,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.1060000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.085,"5min":1.085,"15min":1.274},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.351},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.1160000000000001,"15min":1.242},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.206},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.012,"5min":1.107,"15min":1.173},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.81299999999999994},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":1.137,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.753},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.35099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":1.657,"15min":1.657},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.497}]},{"osd":4,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.087,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":0.88700000000000001,"5min":1.835,"15min":1.835},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.726,"15min":1.726},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1220000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.1439999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.883,"15min":1.883},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:42:28.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:42:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 Processor -- start 2023-07-09T21:42:28.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 -- start start 2023-07-09T21:42:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f260c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0b49f0 con 0x7f260c0cef80 2023-07-09T21:42:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f260c0cc8a0 con 0x7f260c0b7ab0 2023-07-09T21:42:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f2612182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0b7e80 con 0x7f260c0b4340 2023-07-09T21:42:28.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f260bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f260c0cef80 0x7f260c0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37788/0 (socket says 172.21.15.37:37788) 2023-07-09T21:42:28.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f260bfff640 1 -- 172.21.15.37:0/2746905130 learned_addr learned my addr 172.21.15.37:0/2746905130 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:28.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.984+0000 7f260affd640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f260c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200753133 0 0) 0x7f260c0b49f0 con 0x7f260c0cef80 2023-07-09T21:42:28.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25f4003530 con 0x7f260c0cef80 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264941008 0 0) 0x7f260c0cc8a0 con 0x7f260c0b7ab0 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f260c0b49f0 con 0x7f260c0b7ab0 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2953553036 0 0) 0x7f25f4003530 con 0x7f260c0cef80 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 msgr2=0x7f260c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f260c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 >> v1:172.21.15.119:6789/0 conn(0x7f260c0b7ab0 legacy=0x7f260c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0ccb80 con 0x7f260c0cef80 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2604001a00 con 0x7f260c0cef80 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 >> v1:172.21.15.37:6789/0 conn(0x7f260c0cef80 legacy=0x7f260c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25f4003b40 0x7f25f4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f25f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f25f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400ba40 con 0x7f25f4004d10 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400bb80 con 0x7f25f4003b40 2023-07-09T21:42:28.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f400bcf0 con 0x7f260c0b4340 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f25f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260affd640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f25f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260b7fe640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25f4003b40 0x7f25f4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 -- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 msgr2=0x7f25f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0b4340 0x7f25f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 -- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25f4003b40 msgr2=0x7f25f4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:28.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f25f4003b40 0x7f25f4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 -- 172.21.15.37:0/2746905130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f4003530 con 0x7f25f4004d10 2023-07-09T21:42:28.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.988+0000 7f260bfff640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f25f4005180 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f260c0cf400 tx=0x7f260401f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675077ad0a81d13a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040aa610 con 0x7f25f4004d10 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26040aa790 con 0x7f25f4004d10 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f260a7fc640 1 -- 172.21.15.37:0/2746905130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040aab40 con 0x7f25f4004d10 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- 172.21.15.37:0/2746905130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 msgr2=0x7f25f4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 --2- 172.21.15.37:0/2746905130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f25f4005180 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f260c0cf400 tx=0x7f260401f980 comp rx=0 tx=0).stop 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f260bfff640 1 -- 172.21.15.37:0/2746905130 reap_dead start 2023-07-09T21:42:28.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- 172.21.15.37:0/2746905130 shutdown_connections 2023-07-09T21:42:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- 172.21.15.37:0/2746905130 >> 172.21.15.37:0/2746905130 conn(0x7f260c073090 msgr2=0x7f260c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- 172.21.15.37:0/2746905130 shutdown_connections 2023-07-09T21:42:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- 172.21.15.37:0/2746905130 wait complete. 2023-07-09T21:42:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 Processor -- start 2023-07-09T21:42:28.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- start start 2023-07-09T21:42:28.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260c0c6d30 0x7f260c0cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0c71a0 0x7f260c0cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0cc5f0 con 0x7f25f4004d10 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0c7710 con 0x7f260c0c6d30 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f2612182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260c0c79f0 con 0x7f260c0c71a0 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.992+0000 7f260b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39674/0 (socket says 172.21.15.37:39674) 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 -- 172.21.15.37:0/985179176 learned_addr learned my addr 172.21.15.37:0/985179176 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260affd640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260c0c6d30 0x7f260c0cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260bfff640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0c71a0 0x7f260c0cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 -- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0c71a0 msgr2=0x7f260c0cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0c71a0 0x7f260c0cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 -- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260c0c6d30 msgr2=0x7f260c0cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260c0c6d30 0x7f260c0cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 -- 172.21.15.37:0/985179176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c0c7cd0 con 0x7f25f4004d10 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f260b7fe640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e7b0 tx=0x7f25fc00ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0050d0 con 0x7f25f4004d10 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc005230 con 0x7f25f4004d10 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f260c0c7fb0 con 0x7f25f4004d10 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc00c640 con 0x7f25f4004d10 2023-07-09T21:42:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f260c150cf0 con 0x7f25f4004d10 2023-07-09T21:42:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f260c04d7d0 con 0x7f25f4004d10 2023-07-09T21:42:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f25fc00c7a0 con 0x7f25f4004d10 2023-07-09T21:42:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:28.996+0000 7f25f3fff640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 0x7f25f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.000+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f25fc083c40 con 0x7f25f4004d10 2023-07-09T21:42:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.000+0000 7f260affd640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 0x7f25f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.000+0000 7f260affd640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 0x7f25f8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f260c15ff20 tx=0x7f2600009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.000+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f25fc050f80 con 0x7f25f4004d10 2023-07-09T21:42:29.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.156+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f260c0cfd80 con 0x7f25f80663a0 2023-07-09T21:42:29.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.164+0000 7f25f3fff640 1 -- 172.21.15.37:0/985179176 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306566 (secure 0 0 0) 0x7f2600014b90 con 0x7f25f80663a0 2023-07-09T21:42:29.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:29.168 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:42:29.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 msgr2=0x7f25f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 0x7f25f8068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f260c15ff20 tx=0x7f2600009190 comp rx=0 tx=0).stop 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 msgr2=0x7f260c1507b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f25fc00e7b0 tx=0x7f25fc00ebb0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 shutdown_connections 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f25f80663a0 0x7f25f8068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f260c0c71a0 0x7f260c0cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f260c0c6d30 0x7f260c0cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 --2- 172.21.15.37:0/985179176 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25f4004d10 0x7f260c1507b0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 >> 172.21.15.37:0/985179176 conn(0x7f260c073090 msgr2=0x7f260c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:29.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 shutdown_connections 2023-07-09T21:42:29.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.168+0000 7f2612182640 1 -- 172.21.15.37:0/985179176 wait complete. 2023-07-09T21:42:29.188 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:42:27.949242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":34,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":337928,"kb_used_data":14920,"kb_used_omap":0,"kb_used_meta":322944,"kb_avail":754636792,"statfs":{"total":773094113280,"available":772748075008,"internally_reserved":0,"allocated":15278080,"data_stored":8348632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":330694656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.659657"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310004+0000","last_change":"2023-07-09T21:42:23.310004+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310004+0000","last_undegraded":"2023-07-09T21:42:23.310004+0000","last_fullsized":"2023-07-09T21:42:23.310004+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310493+0000","last_change":"2023-07-09T21:42:23.310493+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310493+0000","last_undegraded":"2023-07-09T21:42:23.310493+0000","last_fullsized":"2023-07-09T21:42:23.310493+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303821+0000","last_change":"2023-07-09T21:42:23.303821+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303821+0000","last_undegraded":"2023-07-09T21:42:23.303821+0000","last_fullsized":"2023-07-09T21:42:23.303821+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303606+0000","last_change":"2023-07-09T21:42:23.303606+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303606+0000","last_undegraded":"2023-07-09T21:42:23.303606+0000","last_fullsized":"2023-07-09T21:42:23.303606+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309705+0000","last_change":"2023-07-09T21:42:23.309705+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309705+0000","last_undegraded":"2023-07-09T21:42:23.309705+0000","last_fullsized":"2023-07-09T21:42:23.309705+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308749+0000","last_change":"2023-07-09T21:42:23.308749+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308749+0000","last_undegraded":"2023-07-09T21:42:23.308749+0000","last_fullsized":"2023-07-09T21:42:23.308749+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308437+0000","last_change":"2023-07-09T21:42:23.308437+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308437+0000","last_undegraded":"2023-07-09T21:42:23.308437+0000","last_fullsized":"2023-07-09T21:42:23.308437+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.302979+0000","last_change":"2023-07-09T21:42:23.302979+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.302979+0000","last_undegraded":"2023-07-09T21:42:23.302979+0000","last_fullsized":"2023-07-09T21:42:23.302979+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306444+0000","last_change":"2023-07-09T21:42:23.306444+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306444+0000","last_undegraded":"2023-07-09T21:42:23.306444+0000","last_fullsized":"2023-07-09T21:42:23.306444+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304802+0000","last_change":"2023-07-09T21:42:23.304802+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304802+0000","last_undegraded":"2023-07-09T21:42:23.304802+0000","last_fullsized":"2023-07-09T21:42:23.304802+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311381+0000","last_change":"2023-07-09T21:42:23.311381+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311381+0000","last_undegraded":"2023-07-09T21:42:23.311381+0000","last_fullsized":"2023-07-09T21:42:23.311381+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310951+0000","last_change":"2023-07-09T21:42:23.310951+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310951+0000","last_undegraded":"2023-07-09T21:42:23.310951+0000","last_fullsized":"2023-07-09T21:42:23.310951+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306703+0000","last_change":"2023-07-09T21:42:23.306703+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306703+0000","last_undegraded":"2023-07-09T21:42:23.306703+0000","last_fullsized":"2023-07-09T21:42:23.306703+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.311262+0000","last_change":"2023-07-09T21:42:23.311262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.311262+0000","last_undegraded":"2023-07-09T21:42:23.311262+0000","last_fullsized":"2023-07-09T21:42:23.311262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310140+0000","last_change":"2023-07-09T21:42:23.310140+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310140+0000","last_undegraded":"2023-07-09T21:42:23.310140+0000","last_fullsized":"2023-07-09T21:42:23.310140+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.314499+0000","last_change":"2023-07-09T21:42:23.314499+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.314499+0000","last_undegraded":"2023-07-09T21:42:23.314499+0000","last_fullsized":"2023-07-09T21:42:23.314499+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305243+0000","last_change":"2023-07-09T21:42:23.305243+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305243+0000","last_undegraded":"2023-07-09T21:42:23.305243+0000","last_fullsized":"2023-07-09T21:42:23.305243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309975+0000","last_change":"2023-07-09T21:42:23.309975+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309975+0000","last_undegraded":"2023-07-09T21:42:23.309975+0000","last_fullsized":"2023-07-09T21:42:23.309975+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307726+0000","last_change":"2023-07-09T21:42:23.307726+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307726+0000","last_undegraded":"2023-07-09T21:42:23.307726+0000","last_fullsized":"2023-07-09T21:42:23.307726+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301131+0000","last_change":"2023-07-09T21:42:23.301131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301131+0000","last_undegraded":"2023-07-09T21:42:23.301131+0000","last_fullsized":"2023-07-09T21:42:23.301131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306131+0000","last_change":"2023-07-09T21:42:23.306131+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306131+0000","last_undegraded":"2023-07-09T21:42:23.306131+0000","last_fullsized":"2023-07-09T21:42:23.306131+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309637+0000","last_change":"2023-07-09T21:42:23.309637+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309637+0000","last_undegraded":"2023-07-09T21:42:23.309637+0000","last_fullsized":"2023-07-09T21:42:23.309637+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303449+0000","last_change":"2023-07-09T21:42:23.303449+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303449+0000","last_undegraded":"2023-07-09T21:42:23.303449+0000","last_fullsized":"2023-07-09T21:42:23.303449+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305954+0000","last_change":"2023-07-09T21:42:23.305954+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305954+0000","last_undegraded":"2023-07-09T21:42:23.305954+0000","last_fullsized":"2023-07-09T21:42:23.305954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306210+0000","last_change":"2023-07-09T21:42:23.306210+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306210+0000","last_undegraded":"2023-07-09T21:42:23.306210+0000","last_fullsized":"2023-07-09T21:42:23.306210+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301416+0000","last_change":"2023-07-09T21:42:23.301416+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301416+0000","last_undegraded":"2023-07-09T21:42:23.301416+0000","last_fullsized":"2023-07-09T21:42:23.301416+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307274+0000","last_change":"2023-07-09T21:42:23.307274+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307274+0000","last_undegraded":"2023-07-09T21:42:23.307274+0000","last_fullsized":"2023-07-09T21:42:23.307274+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310480+0000","last_change":"2023-07-09T21:42:23.310480+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310480+0000","last_undegraded":"2023-07-09T21:42:23.310480+0000","last_fullsized":"2023-07-09T21:42:23.310480+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301051+0000","last_change":"2023-07-09T21:42:23.301051+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301051+0000","last_undegraded":"2023-07-09T21:42:23.301051+0000","last_fullsized":"2023-07-09T21:42:23.301051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310794+0000","last_change":"2023-07-09T21:42:23.310794+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310794+0000","last_undegraded":"2023-07-09T21:42:23.310794+0000","last_fullsized":"2023-07-09T21:42:23.310794+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306211+0000","last_change":"2023-07-09T21:42:23.306211+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306211+0000","last_undegraded":"2023-07-09T21:42:23.306211+0000","last_fullsized":"2023-07-09T21:42:23.306211+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305336+0000","last_change":"2023-07-09T21:42:23.305336+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305336+0000","last_undegraded":"2023-07-09T21:42:23.305336+0000","last_fullsized":"2023-07-09T21:42:23.305336+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304212+0000","last_change":"2023-07-09T21:42:23.304212+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304212+0000","last_undegraded":"2023-07-09T21:42:23.304212+0000","last_fullsized":"2023-07-09T21:42:23.304212+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323320+0000","last_change":"2023-07-09T21:42:23.319972+0000","last_active":"2023-07-09T21:42:23.323320+0000","last_peered":"2023-07-09T21:42:23.323320+0000","last_clean":"2023-07-09T21:42:23.323320+0000","last_became_active":"2023-07-09T21:42:23.319687+0000","last_became_peered":"2023-07-09T21:42:23.319687+0000","last_unstale":"2023-07-09T21:42:23.323320+0000","last_undegraded":"2023-07-09T21:42:23.323320+0000","last_fullsized":"2023-07-09T21:42:23.323320+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308158+0000","last_change":"2023-07-09T21:42:23.308158+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308158+0000","last_undegraded":"2023-07-09T21:42:23.308158+0000","last_fullsized":"2023-07-09T21:42:23.308158+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320230+0000","last_change":"2023-07-09T21:42:23.315824+0000","last_active":"2023-07-09T21:42:23.320230+0000","last_peered":"2023-07-09T21:42:23.320230+0000","last_clean":"2023-07-09T21:42:23.320230+0000","last_became_active":"2023-07-09T21:42:23.315550+0000","last_became_peered":"2023-07-09T21:42:23.315550+0000","last_unstale":"2023-07-09T21:42:23.320230+0000","last_undegraded":"2023-07-09T21:42:23.320230+0000","last_fullsized":"2023-07-09T21:42:23.320230+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:44:32.701564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306443+0000","last_change":"2023-07-09T21:42:23.306443+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306443+0000","last_undegraded":"2023-07-09T21:42:23.306443+0000","last_fullsized":"2023-07-09T21:42:23.306443+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323699+0000","last_change":"2023-07-09T21:42:23.319552+0000","last_active":"2023-07-09T21:42:23.323699+0000","last_peered":"2023-07-09T21:42:23.323699+0000","last_clean":"2023-07-09T21:42:23.323699+0000","last_became_active":"2023-07-09T21:42:23.319258+0000","last_became_peered":"2023-07-09T21:42:23.319258+0000","last_unstale":"2023-07-09T21:42:23.323699+0000","last_undegraded":"2023-07-09T21:42:23.323699+0000","last_fullsized":"2023-07-09T21:42:23.323699+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:33:12.292822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303257+0000","last_change":"2023-07-09T21:42:23.303257+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303257+0000","last_undegraded":"2023-07-09T21:42:23.303257+0000","last_fullsized":"2023-07-09T21:42:23.303257+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323516+0000","last_change":"2023-07-09T21:42:23.318851+0000","last_active":"2023-07-09T21:42:23.323516+0000","last_peered":"2023-07-09T21:42:23.323516+0000","last_clean":"2023-07-09T21:42:23.323516+0000","last_became_active":"2023-07-09T21:42:23.318580+0000","last_became_peered":"2023-07-09T21:42:23.318580+0000","last_unstale":"2023-07-09T21:42:23.323516+0000","last_undegraded":"2023-07-09T21:42:23.323516+0000","last_fullsized":"2023-07-09T21:42:23.323516+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:32:09.308290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.304358+0000","last_change":"2023-07-09T21:42:23.304358+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.304358+0000","last_undegraded":"2023-07-09T21:42:23.304358+0000","last_fullsized":"2023-07-09T21:42:23.304358+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325042+0000","last_change":"2023-07-09T21:42:23.321154+0000","last_active":"2023-07-09T21:42:23.325042+0000","last_peered":"2023-07-09T21:42:23.325042+0000","last_clean":"2023-07-09T21:42:23.325042+0000","last_became_active":"2023-07-09T21:42:23.320801+0000","last_became_peered":"2023-07-09T21:42:23.320801+0000","last_unstale":"2023-07-09T21:42:23.325042+0000","last_undegraded":"2023-07-09T21:42:23.325042+0000","last_fullsized":"2023-07-09T21:42:23.325042+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309560+0000","last_change":"2023-07-09T21:42:23.309560+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309560+0000","last_undegraded":"2023-07-09T21:42:23.309560+0000","last_fullsized":"2023-07-09T21:42:23.309560+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325077+0000","last_change":"2023-07-09T21:42:23.320117+0000","last_active":"2023-07-09T21:42:23.325077+0000","last_peered":"2023-07-09T21:42:23.325077+0000","last_clean":"2023-07-09T21:42:23.325077+0000","last_became_active":"2023-07-09T21:42:23.319851+0000","last_became_peered":"2023-07-09T21:42:23.319851+0000","last_unstale":"2023-07-09T21:42:23.325077+0000","last_undegraded":"2023-07-09T21:42:23.325077+0000","last_fullsized":"2023-07-09T21:42:23.325077+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:32:26.514529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.310262+0000","last_change":"2023-07-09T21:42:23.310262+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.310262+0000","last_undegraded":"2023-07-09T21:42:23.310262+0000","last_fullsized":"2023-07-09T21:42:23.310262+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.313881+0000","last_change":"2023-07-09T21:42:23.312549+0000","last_active":"2023-07-09T21:42:23.313881+0000","last_peered":"2023-07-09T21:42:23.313881+0000","last_clean":"2023-07-09T21:42:23.313881+0000","last_became_active":"2023-07-09T21:42:23.312253+0000","last_became_peered":"2023-07-09T21:42:23.312253+0000","last_unstale":"2023-07-09T21:42:23.313881+0000","last_undegraded":"2023-07-09T21:42:23.313881+0000","last_fullsized":"2023-07-09T21:42:23.313881+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:46.146110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306251+0000","last_change":"2023-07-09T21:42:23.306251+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306251+0000","last_undegraded":"2023-07-09T21:42:23.306251+0000","last_fullsized":"2023-07-09T21:42:23.306251+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323169+0000","last_change":"2023-07-09T21:42:23.318094+0000","last_active":"2023-07-09T21:42:23.323169+0000","last_peered":"2023-07-09T21:42:23.323169+0000","last_clean":"2023-07-09T21:42:23.323169+0000","last_became_active":"2023-07-09T21:42:23.317250+0000","last_became_peered":"2023-07-09T21:42:23.317250+0000","last_unstale":"2023-07-09T21:42:23.323169+0000","last_undegraded":"2023-07-09T21:42:23.323169+0000","last_fullsized":"2023-07-09T21:42:23.323169+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:32.139545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306505+0000","last_change":"2023-07-09T21:42:23.306505+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306505+0000","last_undegraded":"2023-07-09T21:42:23.306505+0000","last_fullsized":"2023-07-09T21:42:23.306505+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325246+0000","last_change":"2023-07-09T21:42:23.321567+0000","last_active":"2023-07-09T21:42:23.325246+0000","last_peered":"2023-07-09T21:42:23.325246+0000","last_clean":"2023-07-09T21:42:23.325246+0000","last_became_active":"2023-07-09T21:42:23.321261+0000","last_became_peered":"2023-07-09T21:42:23.321261+0000","last_unstale":"2023-07-09T21:42:23.325246+0000","last_undegraded":"2023-07-09T21:42:23.325246+0000","last_fullsized":"2023-07-09T21:42:23.325246+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:19:58.699676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309329+0000","last_change":"2023-07-09T21:42:23.309329+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309329+0000","last_undegraded":"2023-07-09T21:42:23.309329+0000","last_fullsized":"2023-07-09T21:42:23.309329+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321683+0000","last_change":"2023-07-09T21:42:23.312157+0000","last_active":"2023-07-09T21:42:23.321683+0000","last_peered":"2023-07-09T21:42:23.321683+0000","last_clean":"2023-07-09T21:42:23.321683+0000","last_became_active":"2023-07-09T21:42:23.311856+0000","last_became_peered":"2023-07-09T21:42:23.311856+0000","last_unstale":"2023-07-09T21:42:23.321683+0000","last_undegraded":"2023-07-09T21:42:23.321683+0000","last_fullsized":"2023-07-09T21:42:23.321683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:26.029179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.309981+0000","last_change":"2023-07-09T21:42:23.309981+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.309981+0000","last_undegraded":"2023-07-09T21:42:23.309981+0000","last_fullsized":"2023-07-09T21:42:23.309981+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323775+0000","last_change":"2023-07-09T21:42:23.321319+0000","last_active":"2023-07-09T21:42:23.323775+0000","last_peered":"2023-07-09T21:42:23.323775+0000","last_clean":"2023-07-09T21:42:23.323775+0000","last_became_active":"2023-07-09T21:42:23.319622+0000","last_became_peered":"2023-07-09T21:42:23.319622+0000","last_unstale":"2023-07-09T21:42:23.323775+0000","last_undegraded":"2023-07-09T21:42:23.323775+0000","last_fullsized":"2023-07-09T21:42:23.323775+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:03.639582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305099+0000","last_change":"2023-07-09T21:42:23.305099+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305099+0000","last_undegraded":"2023-07-09T21:42:23.305099+0000","last_fullsized":"2023-07-09T21:42:23.305099+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.328339+0000","last_change":"2023-07-09T21:42:23.326843+0000","last_active":"2023-07-09T21:42:23.328339+0000","last_peered":"2023-07-09T21:42:23.328339+0000","last_clean":"2023-07-09T21:42:23.328339+0000","last_became_active":"2023-07-09T21:42:23.326611+0000","last_became_peered":"2023-07-09T21:42:23.326611+0000","last_unstale":"2023-07-09T21:42:23.328339+0000","last_undegraded":"2023-07-09T21:42:23.328339+0000","last_fullsized":"2023-07-09T21:42:23.328339+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:32:29.099940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306822+0000","last_change":"2023-07-09T21:42:23.306822+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306822+0000","last_undegraded":"2023-07-09T21:42:23.306822+0000","last_fullsized":"2023-07-09T21:42:23.306822+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320794+0000","last_change":"2023-07-09T21:42:23.316515+0000","last_active":"2023-07-09T21:42:23.320794+0000","last_peered":"2023-07-09T21:42:23.320794+0000","last_clean":"2023-07-09T21:42:23.320794+0000","last_became_active":"2023-07-09T21:42:23.316240+0000","last_became_peered":"2023-07-09T21:42:23.316240+0000","last_unstale":"2023-07-09T21:42:23.320794+0000","last_undegraded":"2023-07-09T21:42:23.320794+0000","last_fullsized":"2023-07-09T21:42:23.320794+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:13.833805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308712+0000","last_change":"2023-07-09T21:42:23.308712+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308712+0000","last_undegraded":"2023-07-09T21:42:23.308712+0000","last_fullsized":"2023-07-09T21:42:23.308712+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.324145+0000","last_change":"2023-07-09T21:42:23.321738+0000","last_active":"2023-07-09T21:42:23.324145+0000","last_peered":"2023-07-09T21:42:23.324145+0000","last_clean":"2023-07-09T21:42:23.324145+0000","last_became_active":"2023-07-09T21:42:23.321449+0000","last_became_peered":"2023-07-09T21:42:23.321449+0000","last_unstale":"2023-07-09T21:42:23.324145+0000","last_undegraded":"2023-07-09T21:42:23.324145+0000","last_fullsized":"2023-07-09T21:42:23.324145+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:55.722517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305350+0000","last_change":"2023-07-09T21:42:23.305350+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305350+0000","last_undegraded":"2023-07-09T21:42:23.305350+0000","last_fullsized":"2023-07-09T21:42:23.305350+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323989+0000","last_change":"2023-07-09T21:42:23.322172+0000","last_active":"2023-07-09T21:42:23.323989+0000","last_peered":"2023-07-09T21:42:23.323989+0000","last_clean":"2023-07-09T21:42:23.323989+0000","last_became_active":"2023-07-09T21:42:23.321875+0000","last_became_peered":"2023-07-09T21:42:23.321875+0000","last_unstale":"2023-07-09T21:42:23.323989+0000","last_undegraded":"2023-07-09T21:42:23.323989+0000","last_fullsized":"2023-07-09T21:42:23.323989+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:27.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308081+0000","last_change":"2023-07-09T21:42:23.308081+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308081+0000","last_undegraded":"2023-07-09T21:42:23.308081+0000","last_fullsized":"2023-07-09T21:42:23.308081+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323711+0000","last_change":"2023-07-09T21:42:23.319699+0000","last_active":"2023-07-09T21:42:23.323711+0000","last_peered":"2023-07-09T21:42:23.323711+0000","last_clean":"2023-07-09T21:42:23.323711+0000","last_became_active":"2023-07-09T21:42:23.319049+0000","last_became_peered":"2023-07-09T21:42:23.319049+0000","last_unstale":"2023-07-09T21:42:23.323711+0000","last_undegraded":"2023-07-09T21:42:23.323711+0000","last_fullsized":"2023-07-09T21:42:23.323711+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:36.389079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306306+0000","last_change":"2023-07-09T21:42:23.306306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306306+0000","last_undegraded":"2023-07-09T21:42:23.306306+0000","last_fullsized":"2023-07-09T21:42:23.306306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323081+0000","last_change":"2023-07-09T21:42:23.318581+0000","last_active":"2023-07-09T21:42:23.323081+0000","last_peered":"2023-07-09T21:42:23.323081+0000","last_clean":"2023-07-09T21:42:23.323081+0000","last_became_active":"2023-07-09T21:42:23.318274+0000","last_became_peered":"2023-07-09T21:42:23.318274+0000","last_unstale":"2023-07-09T21:42:23.323081+0000","last_undegraded":"2023-07-09T21:42:23.323081+0000","last_fullsized":"2023-07-09T21:42:23.323081+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:43.862658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305908+0000","last_change":"2023-07-09T21:42:23.305908+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305908+0000","last_undegraded":"2023-07-09T21:42:23.305908+0000","last_fullsized":"2023-07-09T21:42:23.305908+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.326013+0000","last_change":"2023-07-09T21:42:23.323391+0000","last_active":"2023-07-09T21:42:23.326013+0000","last_peered":"2023-07-09T21:42:23.326013+0000","last_clean":"2023-07-09T21:42:23.326013+0000","last_became_active":"2023-07-09T21:42:23.323092+0000","last_became_peered":"2023-07-09T21:42:23.323092+0000","last_unstale":"2023-07-09T21:42:23.326013+0000","last_undegraded":"2023-07-09T21:42:23.326013+0000","last_fullsized":"2023-07-09T21:42:23.326013+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:14.399839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303378+0000","last_change":"2023-07-09T21:42:23.303378+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303378+0000","last_undegraded":"2023-07-09T21:42:23.303378+0000","last_fullsized":"2023-07-09T21:42:23.303378+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325889+0000","last_change":"2023-07-09T21:42:23.323134+0000","last_active":"2023-07-09T21:42:23.325889+0000","last_peered":"2023-07-09T21:42:23.325889+0000","last_clean":"2023-07-09T21:42:23.325889+0000","last_became_active":"2023-07-09T21:42:23.322812+0000","last_became_peered":"2023-07-09T21:42:23.322812+0000","last_unstale":"2023-07-09T21:42:23.325889+0000","last_undegraded":"2023-07-09T21:42:23.325889+0000","last_fullsized":"2023-07-09T21:42:23.325889+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301132+0000","last_change":"2023-07-09T21:42:23.301132+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301132+0000","last_undegraded":"2023-07-09T21:42:23.301132+0000","last_fullsized":"2023-07-09T21:42:23.301132+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323335+0000","last_change":"2023-07-09T21:42:23.319083+0000","last_active":"2023-07-09T21:42:23.323335+0000","last_peered":"2023-07-09T21:42:23.323335+0000","last_clean":"2023-07-09T21:42:23.323335+0000","last_became_active":"2023-07-09T21:42:23.318700+0000","last_became_peered":"2023-07-09T21:42:23.318700+0000","last_unstale":"2023-07-09T21:42:23.323335+0000","last_undegraded":"2023-07-09T21:42:23.323335+0000","last_fullsized":"2023-07-09T21:42:23.323335+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:02.724090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305566+0000","last_change":"2023-07-09T21:42:23.305566+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305566+0000","last_undegraded":"2023-07-09T21:42:23.305566+0000","last_fullsized":"2023-07-09T21:42:23.305566+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322221+0000","last_change":"2023-07-09T21:42:23.319864+0000","last_active":"2023-07-09T21:42:23.322221+0000","last_peered":"2023-07-09T21:42:23.322221+0000","last_clean":"2023-07-09T21:42:23.322221+0000","last_became_active":"2023-07-09T21:42:23.319564+0000","last_became_peered":"2023-07-09T21:42:23.319564+0000","last_unstale":"2023-07-09T21:42:23.322221+0000","last_undegraded":"2023-07-09T21:42:23.322221+0000","last_fullsized":"2023-07-09T21:42:23.322221+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:18:05.178197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308258+0000","last_change":"2023-07-09T21:42:23.308258+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308258+0000","last_undegraded":"2023-07-09T21:42:23.308258+0000","last_fullsized":"2023-07-09T21:42:23.308258+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.320696+0000","last_change":"2023-07-09T21:42:23.317172+0000","last_active":"2023-07-09T21:42:23.320696+0000","last_peered":"2023-07-09T21:42:23.320696+0000","last_clean":"2023-07-09T21:42:23.320696+0000","last_became_active":"2023-07-09T21:42:23.316822+0000","last_became_peered":"2023-07-09T21:42:23.316822+0000","last_unstale":"2023-07-09T21:42:23.320696+0000","last_undegraded":"2023-07-09T21:42:23.320696+0000","last_fullsized":"2023-07-09T21:42:23.320696+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:54.906815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303494+0000","last_change":"2023-07-09T21:42:23.303494+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303494+0000","last_undegraded":"2023-07-09T21:42:23.303494+0000","last_fullsized":"2023-07-09T21:42:23.303494+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322929+0000","last_change":"2023-07-09T21:42:23.317406+0000","last_active":"2023-07-09T21:42:23.322929+0000","last_peered":"2023-07-09T21:42:23.322929+0000","last_clean":"2023-07-09T21:42:23.322929+0000","last_became_active":"2023-07-09T21:42:23.317101+0000","last_became_peered":"2023-07-09T21:42:23.317101+0000","last_unstale":"2023-07-09T21:42:23.322929+0000","last_undegraded":"2023-07-09T21:42:23.322929+0000","last_fullsized":"2023-07-09T21:42:23.322929+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:26.668887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305032+0000","last_change":"2023-07-09T21:42:23.305032+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305032+0000","last_undegraded":"2023-07-09T21:42:23.305032+0000","last_fullsized":"2023-07-09T21:42:23.305032+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.323622+0000","last_change":"2023-07-09T21:42:23.317720+0000","last_active":"2023-07-09T21:42:23.323622+0000","last_peered":"2023-07-09T21:42:23.323622+0000","last_clean":"2023-07-09T21:42:23.323622+0000","last_became_active":"2023-07-09T21:42:23.317450+0000","last_became_peered":"2023-07-09T21:42:23.317450+0000","last_unstale":"2023-07-09T21:42:23.323622+0000","last_undegraded":"2023-07-09T21:42:23.323622+0000","last_fullsized":"2023-07-09T21:42:23.323622+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:45:23.634144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303306+0000","last_change":"2023-07-09T21:42:23.303306+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303306+0000","last_undegraded":"2023-07-09T21:42:23.303306+0000","last_fullsized":"2023-07-09T21:42:23.303306+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322282+0000","last_change":"2023-07-09T21:42:23.317380+0000","last_active":"2023-07-09T21:42:23.322282+0000","last_peered":"2023-07-09T21:42:23.322282+0000","last_clean":"2023-07-09T21:42:23.322282+0000","last_became_active":"2023-07-09T21:42:23.317089+0000","last_became_peered":"2023-07-09T21:42:23.317089+0000","last_unstale":"2023-07-09T21:42:23.322282+0000","last_undegraded":"2023-07-09T21:42:23.322282+0000","last_fullsized":"2023-07-09T21:42:23.322282+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:02.420175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"131'249","reported_seq":856,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308584+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:42:23.308584+0000","last_peered":"2023-07-09T21:42:23.308584+0000","last_clean":"2023-07-09T21:42:23.308584+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:42:23.308584+0000","last_undegraded":"2023-07-09T21:42:23.308584+0000","last_fullsized":"2023-07-09T21:42:23.308584+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:34.930525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308485+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:42:23.308485+0000","last_peered":"2023-07-09T21:42:23.308485+0000","last_clean":"2023-07-09T21:42:23.308485+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:42:23.308485+0000","last_undegraded":"2023-07-09T21:42:23.308485+0000","last_fullsized":"2023-07-09T21:42:23.308485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:42:55.782028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.308292+0000","last_change":"2023-07-09T21:42:23.308292+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.308292+0000","last_undegraded":"2023-07-09T21:42:23.308292+0000","last_fullsized":"2023-07-09T21:42:23.308292+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.317564+0000","last_change":"2023-07-09T21:42:23.315778+0000","last_active":"2023-07-09T21:42:23.317564+0000","last_peered":"2023-07-09T21:42:23.317564+0000","last_clean":"2023-07-09T21:42:23.317564+0000","last_became_active":"2023-07-09T21:42:23.315455+0000","last_became_peered":"2023-07-09T21:42:23.315455+0000","last_unstale":"2023-07-09T21:42:23.317564+0000","last_undegraded":"2023-07-09T21:42:23.317564+0000","last_fullsized":"2023-07-09T21:42:23.317564+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:21.900726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.308519+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:42:23.308519+0000","last_peered":"2023-07-09T21:42:23.308519+0000","last_clean":"2023-07-09T21:42:23.308519+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:42:23.308519+0000","last_undegraded":"2023-07-09T21:42:23.308519+0000","last_fullsized":"2023-07-09T21:42:23.308519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:18.103723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306646+0000","last_change":"2023-07-09T21:42:23.306646+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306646+0000","last_undegraded":"2023-07-09T21:42:23.306646+0000","last_fullsized":"2023-07-09T21:42:23.306646+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321967+0000","last_change":"2023-07-09T21:42:23.316498+0000","last_active":"2023-07-09T21:42:23.321967+0000","last_peered":"2023-07-09T21:42:23.321967+0000","last_clean":"2023-07-09T21:42:23.321967+0000","last_became_active":"2023-07-09T21:42:23.316189+0000","last_became_peered":"2023-07-09T21:42:23.316189+0000","last_unstale":"2023-07-09T21:42:23.321967+0000","last_undegraded":"2023-07-09T21:42:23.321967+0000","last_fullsized":"2023-07-09T21:42:23.321967+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":226,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.300696+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:42:23.300696+0000","last_peered":"2023-07-09T21:42:23.300696+0000","last_clean":"2023-07-09T21:42:23.300696+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:42:23.300696+0000","last_undegraded":"2023-07-09T21:42:23.300696+0000","last_fullsized":"2023-07-09T21:42:23.300696+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:58.675126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.301043+0000","last_change":"2023-07-09T21:42:23.301043+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.301043+0000","last_undegraded":"2023-07-09T21:42:23.301043+0000","last_fullsized":"2023-07-09T21:42:23.301043+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.321235+0000","last_change":"2023-07-09T21:42:23.316447+0000","last_active":"2023-07-09T21:42:23.321235+0000","last_peered":"2023-07-09T21:42:23.321235+0000","last_clean":"2023-07-09T21:42:23.321235+0000","last_became_active":"2023-07-09T21:42:23.316152+0000","last_became_peered":"2023-07-09T21:42:23.316152+0000","last_unstale":"2023-07-09T21:42:23.321235+0000","last_undegraded":"2023-07-09T21:42:23.321235+0000","last_fullsized":"2023-07-09T21:42:23.321235+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":266,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304899+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:42:23.304899+0000","last_peered":"2023-07-09T21:42:23.304899+0000","last_clean":"2023-07-09T21:42:23.304899+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:42:23.304899+0000","last_undegraded":"2023-07-09T21:42:23.304899+0000","last_fullsized":"2023-07-09T21:42:23.304899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:00:06.456355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.307102+0000","last_change":"2023-07-09T21:42:23.307102+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.307102+0000","last_undegraded":"2023-07-09T21:42:23.307102+0000","last_fullsized":"2023-07-09T21:42:23.307102+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.325910+0000","last_change":"2023-07-09T21:42:23.323352+0000","last_active":"2023-07-09T21:42:23.325910+0000","last_peered":"2023-07-09T21:42:23.325910+0000","last_clean":"2023-07-09T21:42:23.325910+0000","last_became_active":"2023-07-09T21:42:23.322924+0000","last_became_peered":"2023-07-09T21:42:23.322924+0000","last_unstale":"2023-07-09T21:42:23.325910+0000","last_undegraded":"2023-07-09T21:42:23.325910+0000","last_fullsized":"2023-07-09T21:42:23.325910+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:57:06.083328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":222,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.304581+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:42:23.304581+0000","last_peered":"2023-07-09T21:42:23.304581+0000","last_clean":"2023-07-09T21:42:23.304581+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:42:23.304581+0000","last_undegraded":"2023-07-09T21:42:23.304581+0000","last_fullsized":"2023-07-09T21:42:23.304581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:24:53.002809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.306107+0000","last_change":"2023-07-09T21:42:23.306107+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.306107+0000","last_undegraded":"2023-07-09T21:42:23.306107+0000","last_fullsized":"2023-07-09T21:42:23.306107+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319979+0000","last_change":"2023-07-09T21:42:23.318436+0000","last_active":"2023-07-09T21:42:23.319979+0000","last_peered":"2023-07-09T21:42:23.319979+0000","last_clean":"2023-07-09T21:42:23.319979+0000","last_became_active":"2023-07-09T21:42:23.318133+0000","last_became_peered":"2023-07-09T21:42:23.318133+0000","last_unstale":"2023-07-09T21:42:23.319979+0000","last_undegraded":"2023-07-09T21:42:23.319979+0000","last_fullsized":"2023-07-09T21:42:23.319979+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:40.990502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":232,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.314271+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:42:23.314271+0000","last_peered":"2023-07-09T21:42:23.314271+0000","last_clean":"2023-07-09T21:42:23.314271+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:42:23.314271+0000","last_undegraded":"2023-07-09T21:42:23.314271+0000","last_fullsized":"2023-07-09T21:42:23.314271+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:04.317714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.303228+0000","last_change":"2023-07-09T21:42:23.303228+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.303228+0000","last_undegraded":"2023-07-09T21:42:23.303228+0000","last_fullsized":"2023-07-09T21:42:23.303228+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.319872+0000","last_change":"2023-07-09T21:42:23.317942+0000","last_active":"2023-07-09T21:42:23.319872+0000","last_peered":"2023-07-09T21:42:23.319872+0000","last_clean":"2023-07-09T21:42:23.319872+0000","last_became_active":"2023-07-09T21:42:23.317646+0000","last_became_peered":"2023-07-09T21:42:23.317646+0000","last_unstale":"2023-07-09T21:42:23.319872+0000","last_undegraded":"2023-07-09T21:42:23.319872+0000","last_fullsized":"2023-07-09T21:42:23.319872+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:06.279519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":224,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.306022+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:42:23.306022+0000","last_peered":"2023-07-09T21:42:23.306022+0000","last_clean":"2023-07-09T21:42:23.306022+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:42:23.306022+0000","last_undegraded":"2023-07-09T21:42:23.306022+0000","last_fullsized":"2023-07-09T21:42:23.306022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:36:24.538480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":142,"state":"creating+peering","last_fresh":"2023-07-09T21:42:23.305666+0000","last_change":"2023-07-09T21:42:23.305666+0000","last_active":"2023-07-09T21:42:23.283408+0000","last_peered":"2023-07-09T21:42:23.283408+0000","last_clean":"2023-07-09T21:42:23.283408+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:42:23.305666+0000","last_undegraded":"2023-07-09T21:42:23.305666+0000","last_fullsized":"2023-07-09T21:42:23.305666+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.322004+0000","last_change":"2023-07-09T21:42:23.317308+0000","last_active":"2023-07-09T21:42:23.322004+0000","last_peered":"2023-07-09T21:42:23.322004+0000","last_clean":"2023-07-09T21:42:23.322004+0000","last_became_active":"2023-07-09T21:42:23.316951+0000","last_became_peered":"2023-07-09T21:42:23.316951+0000","last_unstale":"2023-07-09T21:42:23.322004+0000","last_undegraded":"2023-07-09T21:42:23.322004+0000","last_fullsized":"2023-07-09T21:42:23.322004+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:54.667721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":230,"reported_epoch":142,"state":"active+clean","last_fresh":"2023-07-09T21:42:23.305292+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:42:23.305292+0000","last_peered":"2023-07-09T21:42:23.305292+0000","last_clean":"2023-07-09T21:42:23.305292+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:42:23.305292+0000","last_undegraded":"2023-07-09T21:42:23.305292+0000","last_fullsized":"2023-07-09T21:42:23.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:00:33.363202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575087,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59588,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312252,"statfs":{"total":96636764160,"available":96575746048,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":1.03,"15min":1.03},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.73299999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98999999999999999,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.006,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.77900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.95199999999999996,"5min":1.754,"15min":1.754},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.1140000000000001,"15min":1.129},"last":0.89100000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.86399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.38,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":1.0109999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":1.232,"15min":1.232},"last":0.86699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.69799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834575086,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.95399999999999996,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97499999999999998,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98499999999999999,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.60299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.98899999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68899999999999995,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.88400000000000001,"5min":6.101,"15min":6.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.72099999999999997,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.69799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":0.96999999999999997,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575085,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50816,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94321024,"statfs":{"total":96636764160,"available":96584728576,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.52500000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.95299999999999996,"15min":1.02},"last":0.65900000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.56299999999999994,"5min":0.48899999999999999,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.79600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.78400000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.86899999999999999,"5min":1.083,"15min":1.083},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.038},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.107,"15min":1.107},"last":0.755},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.96899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.70099999999999996},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.88900000000000001,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":1.26},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.45800000000000002},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.05},"last":0.879}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.85799999999999998,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575086,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36864,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334976,"statfs":{"total":96636764160,"available":96599015424,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68400000000000005,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.33700000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":1.101,"15min":1.101},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.44}]},{"osd":4,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.3320000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.095,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.81499999999999995},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.0449999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.67700000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.59199999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.51},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.46800000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.127},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.66700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575087,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54912,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316928,"statfs":{"total":96636764160,"available":96580534272,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.48699999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.754},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":1.111}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.72599999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.2}]}]},{"osd":1,"up_from":13,"seq":55834575087,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1720,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1761280,"data_stored":895987,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.76800000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.436}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.77500000000000002,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.33800000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.1060000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.751},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.085,"5min":1.085,"15min":1.274},"last":0.79100000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.351},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.1160000000000001,"15min":1.242},"last":0.69499999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.206},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.71599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.012,"5min":1.107,"15min":1.173},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.81299999999999994},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":1.137,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575087,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37444,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334396,"statfs":{"total":96636764160,"available":96598421504,"internally_reserved":0,"allocated":2355200,"data_stored":1486355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.753},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.41999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.35099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":1.657,"15min":1.657},"last":0.46800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.497}]},{"osd":4,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.087,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":0.88700000000000001,"5min":1.835,"15min":1.835},"last":0.57199999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.726,"15min":1.726},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.751,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.60099999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1220000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.1439999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.883,"15min":1.883},"last":0.51800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:42:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3f is not active+clean 2023-07-09T21:42:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310004+0000', 'last_change': '2023-07-09T21:42:23.310004+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310004+0000', 'last_undegraded': '2023-07-09T21:42:23.310004+0000', 'last_fullsized': '2023-07-09T21:42:23.310004+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3e is not active+clean 2023-07-09T21:42:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310493+0000', 'last_change': '2023-07-09T21:42:23.310493+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310493+0000', 'last_undegraded': '2023-07-09T21:42:23.310493+0000', 'last_fullsized': '2023-07-09T21:42:23.310493+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3d is not active+clean 2023-07-09T21:42:29.201 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303821+0000', 'last_change': '2023-07-09T21:42:23.303821+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303821+0000', 'last_undegraded': '2023-07-09T21:42:23.303821+0000', 'last_fullsized': '2023-07-09T21:42:23.303821+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.201 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3c is not active+clean 2023-07-09T21:42:29.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303606+0000', 'last_change': '2023-07-09T21:42:23.303606+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303606+0000', 'last_undegraded': '2023-07-09T21:42:23.303606+0000', 'last_fullsized': '2023-07-09T21:42:23.303606+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.202 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3b is not active+clean 2023-07-09T21:42:29.202 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309705+0000', 'last_change': '2023-07-09T21:42:23.309705+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309705+0000', 'last_undegraded': '2023-07-09T21:42:23.309705+0000', 'last_fullsized': '2023-07-09T21:42:23.309705+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3a is not active+clean 2023-07-09T21:42:29.203 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308749+0000', 'last_change': '2023-07-09T21:42:23.308749+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308749+0000', 'last_undegraded': '2023-07-09T21:42:23.308749+0000', 'last_fullsized': '2023-07-09T21:42:23.308749+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.203 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.39 is not active+clean 2023-07-09T21:42:29.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308437+0000', 'last_change': '2023-07-09T21:42:23.308437+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308437+0000', 'last_undegraded': '2023-07-09T21:42:23.308437+0000', 'last_fullsized': '2023-07-09T21:42:23.308437+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.204 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.38 is not active+clean 2023-07-09T21:42:29.204 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.302979+0000', 'last_change': '2023-07-09T21:42:23.302979+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.302979+0000', 'last_undegraded': '2023-07-09T21:42:23.302979+0000', 'last_fullsized': '2023-07-09T21:42:23.302979+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.37 is not active+clean 2023-07-09T21:42:29.205 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306444+0000', 'last_change': '2023-07-09T21:42:23.306444+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306444+0000', 'last_undegraded': '2023-07-09T21:42:23.306444+0000', 'last_fullsized': '2023-07-09T21:42:23.306444+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.205 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.36 is not active+clean 2023-07-09T21:42:29.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.304802+0000', 'last_change': '2023-07-09T21:42:23.304802+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.304802+0000', 'last_undegraded': '2023-07-09T21:42:23.304802+0000', 'last_fullsized': '2023-07-09T21:42:23.304802+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.206 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.35 is not active+clean 2023-07-09T21:42:29.206 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.311381+0000', 'last_change': '2023-07-09T21:42:23.311381+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.311381+0000', 'last_undegraded': '2023-07-09T21:42:23.311381+0000', 'last_fullsized': '2023-07-09T21:42:23.311381+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.34 is not active+clean 2023-07-09T21:42:29.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310951+0000', 'last_change': '2023-07-09T21:42:23.310951+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310951+0000', 'last_undegraded': '2023-07-09T21:42:23.310951+0000', 'last_fullsized': '2023-07-09T21:42:23.310951+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.207 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.33 is not active+clean 2023-07-09T21:42:29.207 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306703+0000', 'last_change': '2023-07-09T21:42:23.306703+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306703+0000', 'last_undegraded': '2023-07-09T21:42:23.306703+0000', 'last_fullsized': '2023-07-09T21:42:23.306703+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.208 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.32 is not active+clean 2023-07-09T21:42:29.208 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.311262+0000', 'last_change': '2023-07-09T21:42:23.311262+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.311262+0000', 'last_undegraded': '2023-07-09T21:42:23.311262+0000', 'last_fullsized': '2023-07-09T21:42:23.311262+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.31 is not active+clean 2023-07-09T21:42:29.209 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310140+0000', 'last_change': '2023-07-09T21:42:23.310140+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310140+0000', 'last_undegraded': '2023-07-09T21:42:23.310140+0000', 'last_fullsized': '2023-07-09T21:42:23.310140+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.209 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.30 is not active+clean 2023-07-09T21:42:29.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.314499+0000', 'last_change': '2023-07-09T21:42:23.314499+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.314499+0000', 'last_undegraded': '2023-07-09T21:42:23.314499+0000', 'last_fullsized': '2023-07-09T21:42:23.314499+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.210 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2f is not active+clean 2023-07-09T21:42:29.210 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305243+0000', 'last_change': '2023-07-09T21:42:23.305243+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305243+0000', 'last_undegraded': '2023-07-09T21:42:23.305243+0000', 'last_fullsized': '2023-07-09T21:42:23.305243+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2e is not active+clean 2023-07-09T21:42:29.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309975+0000', 'last_change': '2023-07-09T21:42:23.309975+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309975+0000', 'last_undegraded': '2023-07-09T21:42:23.309975+0000', 'last_fullsized': '2023-07-09T21:42:23.309975+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.211 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2d is not active+clean 2023-07-09T21:42:29.211 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.307726+0000', 'last_change': '2023-07-09T21:42:23.307726+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.307726+0000', 'last_undegraded': '2023-07-09T21:42:23.307726+0000', 'last_fullsized': '2023-07-09T21:42:23.307726+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:42:29.212 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2c is not active+clean 2023-07-09T21:42:29.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.301131+0000', 'last_change': '2023-07-09T21:42:23.301131+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.301131+0000', 'last_undegraded': '2023-07-09T21:42:23.301131+0000', 'last_fullsized': '2023-07-09T21:42:23.301131+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:42:29.213 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2b is not active+clean 2023-07-09T21:42:29.213 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306131+0000', 'last_change': '2023-07-09T21:42:23.306131+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306131+0000', 'last_undegraded': '2023-07-09T21:42:23.306131+0000', 'last_fullsized': '2023-07-09T21:42:23.306131+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2a is not active+clean 2023-07-09T21:42:29.214 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309637+0000', 'last_change': '2023-07-09T21:42:23.309637+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309637+0000', 'last_undegraded': '2023-07-09T21:42:23.309637+0000', 'last_fullsized': '2023-07-09T21:42:23.309637+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.214 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.29 is not active+clean 2023-07-09T21:42:29.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303449+0000', 'last_change': '2023-07-09T21:42:23.303449+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303449+0000', 'last_undegraded': '2023-07-09T21:42:23.303449+0000', 'last_fullsized': '2023-07-09T21:42:23.303449+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.215 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.28 is not active+clean 2023-07-09T21:42:29.215 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305954+0000', 'last_change': '2023-07-09T21:42:23.305954+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305954+0000', 'last_undegraded': '2023-07-09T21:42:23.305954+0000', 'last_fullsized': '2023-07-09T21:42:23.305954+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.27 is not active+clean 2023-07-09T21:42:29.216 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306210+0000', 'last_change': '2023-07-09T21:42:23.306210+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306210+0000', 'last_undegraded': '2023-07-09T21:42:23.306210+0000', 'last_fullsized': '2023-07-09T21:42:23.306210+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.216 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.26 is not active+clean 2023-07-09T21:42:29.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.301416+0000', 'last_change': '2023-07-09T21:42:23.301416+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.301416+0000', 'last_undegraded': '2023-07-09T21:42:23.301416+0000', 'last_fullsized': '2023-07-09T21:42:23.301416+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:42:29.217 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.25 is not active+clean 2023-07-09T21:42:29.217 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.307274+0000', 'last_change': '2023-07-09T21:42:23.307274+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.307274+0000', 'last_undegraded': '2023-07-09T21:42:23.307274+0000', 'last_fullsized': '2023-07-09T21:42:23.307274+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:42:29.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.24 is not active+clean 2023-07-09T21:42:29.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310480+0000', 'last_change': '2023-07-09T21:42:23.310480+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310480+0000', 'last_undegraded': '2023-07-09T21:42:23.310480+0000', 'last_fullsized': '2023-07-09T21:42:23.310480+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.218 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.23 is not active+clean 2023-07-09T21:42:29.218 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.301051+0000', 'last_change': '2023-07-09T21:42:23.301051+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.301051+0000', 'last_undegraded': '2023-07-09T21:42:23.301051+0000', 'last_fullsized': '2023-07-09T21:42:23.301051+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:42:29.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.22 is not active+clean 2023-07-09T21:42:29.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310794+0000', 'last_change': '2023-07-09T21:42:23.310794+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310794+0000', 'last_undegraded': '2023-07-09T21:42:23.310794+0000', 'last_fullsized': '2023-07-09T21:42:23.310794+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.219 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.21 is not active+clean 2023-07-09T21:42:29.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306211+0000', 'last_change': '2023-07-09T21:42:23.306211+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306211+0000', 'last_undegraded': '2023-07-09T21:42:23.306211+0000', 'last_fullsized': '2023-07-09T21:42:23.306211+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.220 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.20 is not active+clean 2023-07-09T21:42:29.220 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305336+0000', 'last_change': '2023-07-09T21:42:23.305336+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305336+0000', 'last_undegraded': '2023-07-09T21:42:23.305336+0000', 'last_fullsized': '2023-07-09T21:42:23.305336+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1c is not active+clean 2023-07-09T21:42:29.221 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.304212+0000', 'last_change': '2023-07-09T21:42:23.304212+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.304212+0000', 'last_undegraded': '2023-07-09T21:42:23.304212+0000', 'last_fullsized': '2023-07-09T21:42:23.304212+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.221 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1d is not active+clean 2023-07-09T21:42:29.222 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308158+0000', 'last_change': '2023-07-09T21:42:23.308158+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308158+0000', 'last_undegraded': '2023-07-09T21:42:23.308158+0000', 'last_fullsized': '2023-07-09T21:42:23.308158+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.222 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1e is not active+clean 2023-07-09T21:42:29.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306443+0000', 'last_change': '2023-07-09T21:42:23.306443+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306443+0000', 'last_undegraded': '2023-07-09T21:42:23.306443+0000', 'last_fullsized': '2023-07-09T21:42:23.306443+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.223 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1f is not active+clean 2023-07-09T21:42:29.223 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303257+0000', 'last_change': '2023-07-09T21:42:23.303257+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303257+0000', 'last_undegraded': '2023-07-09T21:42:23.303257+0000', 'last_fullsized': '2023-07-09T21:42:23.303257+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.18 is not active+clean 2023-07-09T21:42:29.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.304358+0000', 'last_change': '2023-07-09T21:42:23.304358+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.304358+0000', 'last_undegraded': '2023-07-09T21:42:23.304358+0000', 'last_fullsized': '2023-07-09T21:42:23.304358+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.19 is not active+clean 2023-07-09T21:42:29.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309560+0000', 'last_change': '2023-07-09T21:42:23.309560+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309560+0000', 'last_undegraded': '2023-07-09T21:42:23.309560+0000', 'last_fullsized': '2023-07-09T21:42:23.309560+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1a is not active+clean 2023-07-09T21:42:29.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.310262+0000', 'last_change': '2023-07-09T21:42:23.310262+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.310262+0000', 'last_undegraded': '2023-07-09T21:42:23.310262+0000', 'last_fullsized': '2023-07-09T21:42:23.310262+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1b is not active+clean 2023-07-09T21:42:29.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306251+0000', 'last_change': '2023-07-09T21:42:23.306251+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306251+0000', 'last_undegraded': '2023-07-09T21:42:23.306251+0000', 'last_fullsized': '2023-07-09T21:42:23.306251+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.c is not active+clean 2023-07-09T21:42:29.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306505+0000', 'last_change': '2023-07-09T21:42:23.306505+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306505+0000', 'last_undegraded': '2023-07-09T21:42:23.306505+0000', 'last_fullsized': '2023-07-09T21:42:23.306505+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.d is not active+clean 2023-07-09T21:42:29.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309329+0000', 'last_change': '2023-07-09T21:42:23.309329+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309329+0000', 'last_undegraded': '2023-07-09T21:42:23.309329+0000', 'last_fullsized': '2023-07-09T21:42:23.309329+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:42:29.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.e is not active+clean 2023-07-09T21:42:29.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.309981+0000', 'last_change': '2023-07-09T21:42:23.309981+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.309981+0000', 'last_undegraded': '2023-07-09T21:42:23.309981+0000', 'last_fullsized': '2023-07-09T21:42:23.309981+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.f is not active+clean 2023-07-09T21:42:29.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305099+0000', 'last_change': '2023-07-09T21:42:23.305099+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305099+0000', 'last_undegraded': '2023-07-09T21:42:23.305099+0000', 'last_fullsized': '2023-07-09T21:42:23.305099+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.8 is not active+clean 2023-07-09T21:42:29.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306822+0000', 'last_change': '2023-07-09T21:42:23.306822+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306822+0000', 'last_undegraded': '2023-07-09T21:42:23.306822+0000', 'last_fullsized': '2023-07-09T21:42:23.306822+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.9 is not active+clean 2023-07-09T21:42:29.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308712+0000', 'last_change': '2023-07-09T21:42:23.308712+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308712+0000', 'last_undegraded': '2023-07-09T21:42:23.308712+0000', 'last_fullsized': '2023-07-09T21:42:23.308712+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.a is not active+clean 2023-07-09T21:42:29.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305350+0000', 'last_change': '2023-07-09T21:42:23.305350+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305350+0000', 'last_undegraded': '2023-07-09T21:42:23.305350+0000', 'last_fullsized': '2023-07-09T21:42:23.305350+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.b is not active+clean 2023-07-09T21:42:29.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308081+0000', 'last_change': '2023-07-09T21:42:23.308081+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308081+0000', 'last_undegraded': '2023-07-09T21:42:23.308081+0000', 'last_fullsized': '2023-07-09T21:42:23.308081+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.4 is not active+clean 2023-07-09T21:42:29.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306306+0000', 'last_change': '2023-07-09T21:42:23.306306+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306306+0000', 'last_undegraded': '2023-07-09T21:42:23.306306+0000', 'last_fullsized': '2023-07-09T21:42:23.306306+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.5 is not active+clean 2023-07-09T21:42:29.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305908+0000', 'last_change': '2023-07-09T21:42:23.305908+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305908+0000', 'last_undegraded': '2023-07-09T21:42:23.305908+0000', 'last_fullsized': '2023-07-09T21:42:23.305908+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.6 is not active+clean 2023-07-09T21:42:29.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303378+0000', 'last_change': '2023-07-09T21:42:23.303378+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303378+0000', 'last_undegraded': '2023-07-09T21:42:23.303378+0000', 'last_fullsized': '2023-07-09T21:42:23.303378+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.7 is not active+clean 2023-07-09T21:42:29.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.301132+0000', 'last_change': '2023-07-09T21:42:23.301132+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.301132+0000', 'last_undegraded': '2023-07-09T21:42:23.301132+0000', 'last_fullsized': '2023-07-09T21:42:23.301132+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:42:29.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.0 is not active+clean 2023-07-09T21:42:29.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305566+0000', 'last_change': '2023-07-09T21:42:23.305566+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305566+0000', 'last_undegraded': '2023-07-09T21:42:23.305566+0000', 'last_fullsized': '2023-07-09T21:42:23.305566+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:42:29.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.1 is not active+clean 2023-07-09T21:42:29.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308258+0000', 'last_change': '2023-07-09T21:42:23.308258+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308258+0000', 'last_undegraded': '2023-07-09T21:42:23.308258+0000', 'last_fullsized': '2023-07-09T21:42:23.308258+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.2 is not active+clean 2023-07-09T21:42:29.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303494+0000', 'last_change': '2023-07-09T21:42:23.303494+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303494+0000', 'last_undegraded': '2023-07-09T21:42:23.303494+0000', 'last_fullsized': '2023-07-09T21:42:23.303494+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.3 is not active+clean 2023-07-09T21:42:29.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305032+0000', 'last_change': '2023-07-09T21:42:23.305032+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305032+0000', 'last_undegraded': '2023-07-09T21:42:23.305032+0000', 'last_fullsized': '2023-07-09T21:42:23.305032+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.13 is not active+clean 2023-07-09T21:42:29.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303306+0000', 'last_change': '2023-07-09T21:42:23.303306+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303306+0000', 'last_undegraded': '2023-07-09T21:42:23.303306+0000', 'last_fullsized': '2023-07-09T21:42:23.303306+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:42:29.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.10 is not active+clean 2023-07-09T21:42:29.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.308292+0000', 'last_change': '2023-07-09T21:42:23.308292+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.308292+0000', 'last_undegraded': '2023-07-09T21:42:23.308292+0000', 'last_fullsized': '2023-07-09T21:42:23.308292+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:42:29.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.11 is not active+clean 2023-07-09T21:42:29.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306646+0000', 'last_change': '2023-07-09T21:42:23.306646+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306646+0000', 'last_undegraded': '2023-07-09T21:42:23.306646+0000', 'last_fullsized': '2023-07-09T21:42:23.306646+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:42:29.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.12 is not active+clean 2023-07-09T21:42:29.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.301043+0000', 'last_change': '2023-07-09T21:42:23.301043+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.301043+0000', 'last_undegraded': '2023-07-09T21:42:23.301043+0000', 'last_fullsized': '2023-07-09T21:42:23.301043+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:42:29.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.14 is not active+clean 2023-07-09T21:42:29.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.307102+0000', 'last_change': '2023-07-09T21:42:23.307102+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.307102+0000', 'last_undegraded': '2023-07-09T21:42:23.307102+0000', 'last_fullsized': '2023-07-09T21:42:23.307102+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:42:29.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.15 is not active+clean 2023-07-09T21:42:29.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.306107+0000', 'last_change': '2023-07-09T21:42:23.306107+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.306107+0000', 'last_undegraded': '2023-07-09T21:42:23.306107+0000', 'last_fullsized': '2023-07-09T21:42:23.306107+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.16 is not active+clean 2023-07-09T21:42:29.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.303228+0000', 'last_change': '2023-07-09T21:42:23.303228+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.303228+0000', 'last_undegraded': '2023-07-09T21:42:23.303228+0000', 'last_fullsized': '2023-07-09T21:42:23.303228+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:42:29.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 18.17 is not active+clean 2023-07-09T21:42:29.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '18.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 142, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:42:23.305666+0000', 'last_change': '2023-07-09T21:42:23.305666+0000', 'last_active': '2023-07-09T21:42:23.283408+0000', 'last_peered': '2023-07-09T21:42:23.283408+0000', 'last_clean': '2023-07-09T21:42:23.283408+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:42:23.305666+0000', 'last_undegraded': '2023-07-09T21:42:23.305666+0000', 'last_fullsized': '2023-07-09T21:42:23.305666+0000', 'mapping_epoch': 142, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 142, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'last_clean_scrub_stamp': '2023-07-09T21:42:23.283408+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:42:29.242 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:42:29.273 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-09T21:42:29.272+0000 7fb46d3a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:42:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 Processor -- start 2023-07-09T21:42:29.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 -- start start 2023-07-09T21:42:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a340b7ab0 0x7f8a3406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340cef80 0x7f8a340b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a340b49f0 con 0x7f8a340b4170 2023-07-09T21:42:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a340b7e80 con 0x7f8a340b7ab0 2023-07-09T21:42:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a38d8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340b4610 con 0x7f8a340cef80 2023-07-09T21:42:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a3259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a340b7ab0 0x7f8a3406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a3259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8a340b7ab0 0x7f8a3406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39676/0 (socket says 172.21.15.37:39676) 2023-07-09T21:42:29.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.384+0000 7f8a3259c640 1 -- 172.21.15.37:0/1394997692 learned_addr learned my addr 172.21.15.37:0/1394997692 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a31d9b640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340cef80 0x7f8a340b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3259c640 1 -- 172.21.15.37:0/1394997692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340cef80 msgr2=0x7f8a340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3259c640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340cef80 0x7f8a340b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3259c640 1 -- 172.21.15.37:0/1394997692 >> v1:172.21.15.119:6789/0 conn(0x7f8a340b4170 legacy=0x7f8a3415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:29.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3259c640 1 -- 172.21.15.37:0/1394997692 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340cc8a0 con 0x7f8a340b7ab0 2023-07-09T21:42:29.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3259c640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b7ab0 0x7f8a3406aa50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009870 tx=0x7f8a2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5672deee4549dbb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3159a640 1 -- 172.21.15.37:0/1394997692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240aa5f0 con 0x7f8a340b7ab0 2023-07-09T21:42:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3159a640 1 -- 172.21.15.37:0/1394997692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240aa750 con 0x7f8a340b7ab0 2023-07-09T21:42:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a3159a640 1 -- 172.21.15.37:0/1394997692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240aaae0 con 0x7f8a340b7ab0 2023-07-09T21:42:29.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a38d8f640 1 -- 172.21.15.37:0/1394997692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b7ab0 msgr2=0x7f8a3406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.388+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b7ab0 0x7f8a3406aa50 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f8a24009870 tx=0x7f8a2401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- 172.21.15.37:0/1394997692 shutdown_connections 2023-07-09T21:42:29.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340cef80 0x7f8a340b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/1394997692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b7ab0 0x7f8a3406aa50 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- 172.21.15.37:0/1394997692 >> 172.21.15.37:0/1394997692 conn(0x7f8a34073090 msgr2=0x7f8a34069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- 172.21.15.37:0/1394997692 shutdown_connections 2023-07-09T21:42:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- 172.21.15.37:0/1394997692 wait complete. 2023-07-09T21:42:29.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 Processor -- start 2023-07-09T21:42:29.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- start start 2023-07-09T21:42:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340b7ab0 0x7f8a340d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a340cef80 0x7f8a3413fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a341579e0 con 0x7f8a340b4170 2023-07-09T21:42:29.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a341583b0 con 0x7f8a340cef80 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a38d8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34140820 con 0x7f8a340b7ab0 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39682/0 (socket says 172.21.15.37:39682) 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 -- 172.21.15.37:0/29586059 learned_addr learned my addr 172.21.15.37:0/29586059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a31d9b640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340b7ab0 0x7f8a340d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a32d9d640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a340cef80 0x7f8a3413fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 -- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340b7ab0 msgr2=0x7f8a340d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340b7ab0 0x7f8a340d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 -- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a340cef80 msgr2=0x7f8a3413fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a340cef80 0x7f8a3413fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 -- 172.21.15.37:0/29586059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240094d0 con 0x7f8a340b4170 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.392+0000 7f8a3259c640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401cd70 tx=0x7f8a2401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240aa5f0 con 0x7f8a340b4170 2023-07-09T21:42:29.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240b3800 con 0x7f8a340b4170 2023-07-09T21:42:29.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240b3bb0 con 0x7f8a340b4170 2023-07-09T21:42:29.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a34140b00 con 0x7f8a340b4170 2023-07-09T21:42:29.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a34153540 con 0x7f8a340b4170 2023-07-09T21:42:29.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a3404d7d0 con 0x7f8a340b4170 2023-07-09T21:42:29.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8a240b3d10 con 0x7f8a340b4170 2023-07-09T21:42:29.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 0x7f8a14068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8a240a7070 con 0x7f8a340b4170 2023-07-09T21:42:29.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a31d9b640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 0x7f8a14068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.396+0000 7f8a31d9b640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 0x7f8a14068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a3415f300 tx=0x7f8a28008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.400+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8a240eb880 con 0x7f8a340b4170 2023-07-09T21:42:29.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8a3406a830 con 0x7f8a340b4170 2023-07-09T21:42:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a22ffd640 1 -- 172.21.15.37:0/29586059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7f8a240eeea0 con 0x7f8a340b4170 2023-07-09T21:42:29.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:29.608 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1224,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":144,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":346038272,"bytes_avail":772748075008,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":62,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":8994}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2023-07-09T21:42:11.945986+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:42:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 msgr2=0x7f8a14068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 0x7f8a14068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a3415f300 tx=0x7f8a28008040 comp rx=0 tx=0).stop 2023-07-09T21:42:29.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 msgr2=0x7f8a34157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f8a2401cd70 tx=0x7f8a2401ad10 comp rx=0 tx=0).stop 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 shutdown_connections 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f8a140663a0 0x7f8a14068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8a340cef80 0x7f8a3413fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8a340b7ab0 0x7f8a340d23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 --2- 172.21.15.37:0/29586059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a340b4170 0x7f8a34157e70 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 >> 172.21.15.37:0/29586059 conn(0x7f8a34073090 msgr2=0x7f8a340b69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 shutdown_connections 2023-07-09T21:42:29.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.608+0000 7f8a38d8f640 1 -- 172.21.15.37:0/29586059 wait complete. 2023-07-09T21:42:29.629 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:42:29.629 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:42:29.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 Processor -- start 2023-07-09T21:42:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 -- start start 2023-07-09T21:42:29.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf980b7ab0 0x7faf9806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b4340 0x7faf980d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980b49f0 con 0x7faf980cef80 2023-07-09T21:42:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980b7e80 con 0x7faf980b7ab0 2023-07-09T21:42:29.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9f434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980cc8a0 con 0x7faf980b4340 2023-07-09T21:42:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf980b7ab0 0x7faf9806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9c9cf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faf980cef80 0x7faf980b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37804/0 (socket says 172.21.15.37:37804) 2023-07-09T21:42:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faf980b7ab0 0x7faf9806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39688/0 (socket says 172.21.15.37:39688) 2023-07-09T21:42:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9c9cf640 1 -- 172.21.15.37:0/539286604 learned_addr learned my addr 172.21.15.37:0/539286604 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d9d1640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b4340 0x7faf980d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 -- 172.21.15.37:0/539286604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b4340 msgr2=0x7faf980d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b4340 0x7faf980d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 -- 172.21.15.37:0/539286604 >> v1:172.21.15.37:6789/0 conn(0x7faf980cef80 legacy=0x7faf980b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.816+0000 7faf9d1d0640 1 -- 172.21.15.37:0/539286604 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980ccb80 con 0x7faf980b7ab0 2023-07-09T21:42:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9d1d0640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980b7ab0 0x7faf9806aa50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7faf940097c0 tx=0x7faf9401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a3fff0e1604a318 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf8ffff640 1 -- 172.21.15.37:0/539286604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940ab650 con 0x7faf980b7ab0 2023-07-09T21:42:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf8ffff640 1 -- 172.21.15.37:0/539286604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940ab7b0 con 0x7faf980b7ab0 2023-07-09T21:42:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf8ffff640 1 -- 172.21.15.37:0/539286604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940abb40 con 0x7faf980b7ab0 2023-07-09T21:42:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 -- 172.21.15.37:0/539286604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980b7ab0 msgr2=0x7faf9806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980b7ab0 0x7faf9806aa50 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7faf940097c0 tx=0x7faf9401c450 comp rx=0 tx=0).stop 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 -- 172.21.15.37:0/539286604 shutdown_connections 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b4340 0x7faf980d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 --2- 172.21.15.37:0/539286604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980b7ab0 0x7faf9806aa50 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 -- 172.21.15.37:0/539286604 >> 172.21.15.37:0/539286604 conn(0x7faf98073090 msgr2=0x7faf98069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 -- 172.21.15.37:0/539286604 shutdown_connections 2023-07-09T21:42:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.820+0000 7faf9f434640 1 -- 172.21.15.37:0/539286604 wait complete. 2023-07-09T21:42:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 Processor -- start 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- start start 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf980b4340 0x7faf9814dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b7ab0 0x7faf980b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9814e210 con 0x7faf980cef80 2023-07-09T21:42:29.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98153080 con 0x7faf980b4340 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf98152470 con 0x7faf980b7ab0 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39694/0 (socket says 172.21.15.37:39694) 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 -- 172.21.15.37:0/981614401 learned_addr learned my addr 172.21.15.37:0/981614401 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 -- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b7ab0 msgr2=0x7faf980b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b7ab0 0x7faf980b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 -- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf980b4340 msgr2=0x7faf9814dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf980b4340 0x7faf9814dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 -- 172.21.15.37:0/981614401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf94009420 con 0x7faf980cef80 2023-07-09T21:42:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9d9d1640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faf90007e30 tx=0x7faf9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf90014620 con 0x7faf980cef80 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9000ee90 con 0x7faf980cef80 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf98152750 con 0x7faf980cef80 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900149c0 con 0x7faf980cef80 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.824+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf98152d10 con 0x7faf980cef80 2023-07-09T21:42:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9804d7d0 con 0x7faf980cef80 2023-07-09T21:42:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faf90014b20 con 0x7faf980cef80 2023-07-09T21:42:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf8dffb640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 0x7faf7c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7faf90084840 con 0x7faf980cef80 2023-07-09T21:42:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf9d1d0640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 0x7faf7c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.828+0000 7faf9d1d0640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 0x7faf7c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf940af000 tx=0x7faf94008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.832+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf90051b80 con 0x7faf980cef80 2023-07-09T21:42:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.984+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf981531f0 con 0x7faf7c0663a0 2023-07-09T21:42:29.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.992+0000 7faf8dffb640 1 -- 172.21.15.37:0/981614401 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311925 (secure 0 0 0) 0x7faf981531f0 con 0x7faf7c0663a0 2023-07-09T21:42:29.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:29.999 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:42:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 msgr2=0x7faf7c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 0x7faf7c068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faf940af000 tx=0x7faf94008040 comp rx=0 tx=0).stop 2023-07-09T21:42:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 msgr2=0x7faf980d2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7faf90007e30 tx=0x7faf9000e4b0 comp rx=0 tx=0).stop 2023-07-09T21:42:30.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 shutdown_connections 2023-07-09T21:42:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7faf7c0663a0 0x7faf7c068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faf980cef80 0x7faf980d2140 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faf980b7ab0 0x7faf980b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:30.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 --2- 172.21.15.37:0/981614401 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faf980b4340 0x7faf9814dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 >> 172.21.15.37:0/981614401 conn(0x7faf98073090 msgr2=0x7faf980b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 shutdown_connections 2023-07-09T21:42:30.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:29.996+0000 7faf9f434640 1 -- 172.21.15.37:0/981614401 wait complete. 2023-07-09T21:42:30.017 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:42:29.949724+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342280,"kb_used_data":15176,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754632440,"statfs":{"total":773094113280,"available":772743618560,"internally_reserved":0,"allocated":15540224,"data_stored":8464052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.648614"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308795+0000","last_change":"2023-07-09T21:42:24.320700+0000","last_active":"2023-07-09T21:42:25.308795+0000","last_peered":"2023-07-09T21:42:25.308795+0000","last_clean":"2023-07-09T21:42:25.308795+0000","last_became_active":"2023-07-09T21:42:24.320336+0000","last_became_peered":"2023-07-09T21:42:24.320336+0000","last_unstale":"2023-07-09T21:42:25.308795+0000","last_undegraded":"2023-07-09T21:42:25.308795+0000","last_fullsized":"2023-07-09T21:42:25.308795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:57.252677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543457+0000","last_change":"2023-07-09T21:42:24.319081+0000","last_active":"2023-07-09T21:42:26.543457+0000","last_peered":"2023-07-09T21:42:26.543457+0000","last_clean":"2023-07-09T21:42:26.543457+0000","last_became_active":"2023-07-09T21:42:24.318565+0000","last_became_peered":"2023-07-09T21:42:24.318565+0000","last_unstale":"2023-07-09T21:42:26.543457+0000","last_undegraded":"2023-07-09T21:42:26.543457+0000","last_fullsized":"2023-07-09T21:42:26.543457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:06.137104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543609+0000","last_change":"2023-07-09T21:42:24.321328+0000","last_active":"2023-07-09T21:42:26.543609+0000","last_peered":"2023-07-09T21:42:26.543609+0000","last_clean":"2023-07-09T21:42:26.543609+0000","last_became_active":"2023-07-09T21:42:24.321064+0000","last_became_peered":"2023-07-09T21:42:24.321064+0000","last_unstale":"2023-07-09T21:42:26.543609+0000","last_undegraded":"2023-07-09T21:42:26.543609+0000","last_fullsized":"2023-07-09T21:42:26.543609+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:18.567406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281668+0000","last_change":"2023-07-09T21:42:24.330547+0000","last_active":"2023-07-09T21:42:26.281668+0000","last_peered":"2023-07-09T21:42:26.281668+0000","last_clean":"2023-07-09T21:42:26.281668+0000","last_became_active":"2023-07-09T21:42:24.330284+0000","last_became_peered":"2023-07-09T21:42:24.330284+0000","last_unstale":"2023-07-09T21:42:26.281668+0000","last_undegraded":"2023-07-09T21:42:26.281668+0000","last_fullsized":"2023-07-09T21:42:26.281668+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:15:06.610326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308559+0000","last_change":"2023-07-09T21:42:24.315957+0000","last_active":"2023-07-09T21:42:25.308559+0000","last_peered":"2023-07-09T21:42:25.308559+0000","last_clean":"2023-07-09T21:42:25.308559+0000","last_became_active":"2023-07-09T21:42:24.315612+0000","last_became_peered":"2023-07-09T21:42:24.315612+0000","last_unstale":"2023-07-09T21:42:25.308559+0000","last_undegraded":"2023-07-09T21:42:25.308559+0000","last_fullsized":"2023-07-09T21:42:25.308559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543108+0000","last_change":"2023-07-09T21:42:24.315089+0000","last_active":"2023-07-09T21:42:26.543108+0000","last_peered":"2023-07-09T21:42:26.543108+0000","last_clean":"2023-07-09T21:42:26.543108+0000","last_became_active":"2023-07-09T21:42:24.314794+0000","last_became_peered":"2023-07-09T21:42:24.314794+0000","last_unstale":"2023-07-09T21:42:26.543108+0000","last_undegraded":"2023-07-09T21:42:26.543108+0000","last_fullsized":"2023-07-09T21:42:26.543108+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:38.058536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542794+0000","last_change":"2023-07-09T21:42:24.332137+0000","last_active":"2023-07-09T21:42:26.542794+0000","last_peered":"2023-07-09T21:42:26.542794+0000","last_clean":"2023-07-09T21:42:26.542794+0000","last_became_active":"2023-07-09T21:42:24.331843+0000","last_became_peered":"2023-07-09T21:42:24.331843+0000","last_unstale":"2023-07-09T21:42:26.542794+0000","last_undegraded":"2023-07-09T21:42:26.542794+0000","last_fullsized":"2023-07-09T21:42:26.542794+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:45.544869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542272+0000","last_change":"2023-07-09T21:42:24.319671+0000","last_active":"2023-07-09T21:42:26.542272+0000","last_peered":"2023-07-09T21:42:26.542272+0000","last_clean":"2023-07-09T21:42:26.542272+0000","last_became_active":"2023-07-09T21:42:24.319403+0000","last_became_peered":"2023-07-09T21:42:24.319403+0000","last_unstale":"2023-07-09T21:42:26.542272+0000","last_undegraded":"2023-07-09T21:42:26.542272+0000","last_fullsized":"2023-07-09T21:42:26.542272+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:37.469112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281991+0000","last_change":"2023-07-09T21:42:24.331784+0000","last_active":"2023-07-09T21:42:26.281991+0000","last_peered":"2023-07-09T21:42:26.281991+0000","last_clean":"2023-07-09T21:42:26.281991+0000","last_became_active":"2023-07-09T21:42:24.331501+0000","last_became_peered":"2023-07-09T21:42:24.331501+0000","last_unstale":"2023-07-09T21:42:26.281991+0000","last_undegraded":"2023-07-09T21:42:26.281991+0000","last_fullsized":"2023-07-09T21:42:26.281991+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:26.741847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486421+0000","last_change":"2023-07-09T21:42:24.320325+0000","last_active":"2023-07-09T21:42:26.486421+0000","last_peered":"2023-07-09T21:42:26.486421+0000","last_clean":"2023-07-09T21:42:26.486421+0000","last_became_active":"2023-07-09T21:42:24.320047+0000","last_became_peered":"2023-07-09T21:42:24.320047+0000","last_unstale":"2023-07-09T21:42:26.486421+0000","last_undegraded":"2023-07-09T21:42:26.486421+0000","last_fullsized":"2023-07-09T21:42:26.486421+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:14.046789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308387+0000","last_change":"2023-07-09T21:42:24.318936+0000","last_active":"2023-07-09T21:42:25.308387+0000","last_peered":"2023-07-09T21:42:25.308387+0000","last_clean":"2023-07-09T21:42:25.308387+0000","last_became_active":"2023-07-09T21:42:24.318648+0000","last_became_peered":"2023-07-09T21:42:24.318648+0000","last_unstale":"2023-07-09T21:42:25.308387+0000","last_undegraded":"2023-07-09T21:42:25.308387+0000","last_fullsized":"2023-07-09T21:42:25.308387+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:56.198796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542836+0000","last_change":"2023-07-09T21:42:24.319127+0000","last_active":"2023-07-09T21:42:26.542836+0000","last_peered":"2023-07-09T21:42:26.542836+0000","last_clean":"2023-07-09T21:42:26.542836+0000","last_became_active":"2023-07-09T21:42:24.318813+0000","last_became_peered":"2023-07-09T21:42:24.318813+0000","last_unstale":"2023-07-09T21:42:26.542836+0000","last_undegraded":"2023-07-09T21:42:26.542836+0000","last_fullsized":"2023-07-09T21:42:26.542836+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:05:16.204055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486217+0000","last_change":"2023-07-09T21:42:24.324227+0000","last_active":"2023-07-09T21:42:26.486217+0000","last_peered":"2023-07-09T21:42:26.486217+0000","last_clean":"2023-07-09T21:42:26.486217+0000","last_became_active":"2023-07-09T21:42:24.323954+0000","last_became_peered":"2023-07-09T21:42:24.323954+0000","last_unstale":"2023-07-09T21:42:26.486217+0000","last_undegraded":"2023-07-09T21:42:26.486217+0000","last_fullsized":"2023-07-09T21:42:26.486217+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:48.197704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543002+0000","last_change":"2023-07-09T21:42:24.311669+0000","last_active":"2023-07-09T21:42:26.543002+0000","last_peered":"2023-07-09T21:42:26.543002+0000","last_clean":"2023-07-09T21:42:26.543002+0000","last_became_active":"2023-07-09T21:42:24.311057+0000","last_became_peered":"2023-07-09T21:42:24.311057+0000","last_unstale":"2023-07-09T21:42:26.543002+0000","last_undegraded":"2023-07-09T21:42:26.543002+0000","last_fullsized":"2023-07-09T21:42:26.543002+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:16.183667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308179+0000","last_change":"2023-07-09T21:42:24.318441+0000","last_active":"2023-07-09T21:42:25.308179+0000","last_peered":"2023-07-09T21:42:25.308179+0000","last_clean":"2023-07-09T21:42:25.308179+0000","last_became_active":"2023-07-09T21:42:24.318054+0000","last_became_peered":"2023-07-09T21:42:24.318054+0000","last_unstale":"2023-07-09T21:42:25.308179+0000","last_undegraded":"2023-07-09T21:42:25.308179+0000","last_fullsized":"2023-07-09T21:42:25.308179+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:52:06.320126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542553+0000","last_change":"2023-07-09T21:42:24.313128+0000","last_active":"2023-07-09T21:42:26.542553+0000","last_peered":"2023-07-09T21:42:26.542553+0000","last_clean":"2023-07-09T21:42:26.542553+0000","last_became_active":"2023-07-09T21:42:24.312844+0000","last_became_peered":"2023-07-09T21:42:24.312844+0000","last_unstale":"2023-07-09T21:42:26.542553+0000","last_undegraded":"2023-07-09T21:42:26.542553+0000","last_fullsized":"2023-07-09T21:42:26.542553+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:20.253057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486457+0000","last_change":"2023-07-09T21:42:24.323658+0000","last_active":"2023-07-09T21:42:26.486457+0000","last_peered":"2023-07-09T21:42:26.486457+0000","last_clean":"2023-07-09T21:42:26.486457+0000","last_became_active":"2023-07-09T21:42:24.323382+0000","last_became_peered":"2023-07-09T21:42:24.323382+0000","last_unstale":"2023-07-09T21:42:26.486457+0000","last_undegraded":"2023-07-09T21:42:26.486457+0000","last_fullsized":"2023-07-09T21:42:26.486457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:32:11.653957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543577+0000","last_change":"2023-07-09T21:42:24.318861+0000","last_active":"2023-07-09T21:42:26.543577+0000","last_peered":"2023-07-09T21:42:26.543577+0000","last_clean":"2023-07-09T21:42:26.543577+0000","last_became_active":"2023-07-09T21:42:24.318109+0000","last_became_peered":"2023-07-09T21:42:24.318109+0000","last_unstale":"2023-07-09T21:42:26.543577+0000","last_undegraded":"2023-07-09T21:42:26.543577+0000","last_fullsized":"2023-07-09T21:42:26.543577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:46.425360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307319+0000","last_change":"2023-07-09T21:42:24.324450+0000","last_active":"2023-07-09T21:42:25.307319+0000","last_peered":"2023-07-09T21:42:25.307319+0000","last_clean":"2023-07-09T21:42:25.307319+0000","last_became_active":"2023-07-09T21:42:24.324180+0000","last_became_peered":"2023-07-09T21:42:24.324180+0000","last_unstale":"2023-07-09T21:42:25.307319+0000","last_undegraded":"2023-07-09T21:42:25.307319+0000","last_fullsized":"2023-07-09T21:42:25.307319+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:22.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883954+0000","last_change":"2023-07-09T21:42:24.312805+0000","last_active":"2023-07-09T21:42:25.883954+0000","last_peered":"2023-07-09T21:42:25.883954+0000","last_clean":"2023-07-09T21:42:25.883954+0000","last_became_active":"2023-07-09T21:42:24.312452+0000","last_became_peered":"2023-07-09T21:42:24.312452+0000","last_unstale":"2023-07-09T21:42:25.883954+0000","last_undegraded":"2023-07-09T21:42:25.883954+0000","last_fullsized":"2023-07-09T21:42:25.883954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:03.583981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281648+0000","last_change":"2023-07-09T21:42:24.333192+0000","last_active":"2023-07-09T21:42:26.281648+0000","last_peered":"2023-07-09T21:42:26.281648+0000","last_clean":"2023-07-09T21:42:26.281648+0000","last_became_active":"2023-07-09T21:42:24.332913+0000","last_became_peered":"2023-07-09T21:42:24.332913+0000","last_unstale":"2023-07-09T21:42:26.281648+0000","last_undegraded":"2023-07-09T21:42:26.281648+0000","last_fullsized":"2023-07-09T21:42:26.281648+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:05.878304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308417+0000","last_change":"2023-07-09T21:42:24.317180+0000","last_active":"2023-07-09T21:42:25.308417+0000","last_peered":"2023-07-09T21:42:25.308417+0000","last_clean":"2023-07-09T21:42:25.308417+0000","last_became_active":"2023-07-09T21:42:24.315646+0000","last_became_peered":"2023-07-09T21:42:24.315646+0000","last_unstale":"2023-07-09T21:42:25.308417+0000","last_undegraded":"2023-07-09T21:42:25.308417+0000","last_fullsized":"2023-07-09T21:42:25.308417+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:03.427737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281324+0000","last_change":"2023-07-09T21:42:24.330060+0000","last_active":"2023-07-09T21:42:26.281324+0000","last_peered":"2023-07-09T21:42:26.281324+0000","last_clean":"2023-07-09T21:42:26.281324+0000","last_became_active":"2023-07-09T21:42:24.329796+0000","last_became_peered":"2023-07-09T21:42:24.329796+0000","last_unstale":"2023-07-09T21:42:26.281324+0000","last_undegraded":"2023-07-09T21:42:26.281324+0000","last_fullsized":"2023-07-09T21:42:26.281324+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:27.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308065+0000","last_change":"2023-07-09T21:42:24.322282+0000","last_active":"2023-07-09T21:42:25.308065+0000","last_peered":"2023-07-09T21:42:25.308065+0000","last_clean":"2023-07-09T21:42:25.308065+0000","last_became_active":"2023-07-09T21:42:24.321973+0000","last_became_peered":"2023-07-09T21:42:24.321973+0000","last_unstale":"2023-07-09T21:42:25.308065+0000","last_undegraded":"2023-07-09T21:42:25.308065+0000","last_fullsized":"2023-07-09T21:42:25.308065+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:14:17.642951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309640+0000","last_change":"2023-07-09T21:42:24.326306+0000","last_active":"2023-07-09T21:42:25.309640+0000","last_peered":"2023-07-09T21:42:25.309640+0000","last_clean":"2023-07-09T21:42:25.309640+0000","last_became_active":"2023-07-09T21:42:24.323346+0000","last_became_peered":"2023-07-09T21:42:24.323346+0000","last_unstale":"2023-07-09T21:42:25.309640+0000","last_undegraded":"2023-07-09T21:42:25.309640+0000","last_fullsized":"2023-07-09T21:42:25.309640+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:39:55.371802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884050+0000","last_change":"2023-07-09T21:42:24.322707+0000","last_active":"2023-07-09T21:42:25.884050+0000","last_peered":"2023-07-09T21:42:25.884050+0000","last_clean":"2023-07-09T21:42:25.884050+0000","last_became_active":"2023-07-09T21:42:24.322350+0000","last_became_peered":"2023-07-09T21:42:24.322350+0000","last_unstale":"2023-07-09T21:42:25.884050+0000","last_undegraded":"2023-07-09T21:42:25.884050+0000","last_fullsized":"2023-07-09T21:42:25.884050+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:06.060013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307504+0000","last_change":"2023-07-09T21:42:24.324461+0000","last_active":"2023-07-09T21:42:25.307504+0000","last_peered":"2023-07-09T21:42:25.307504+0000","last_clean":"2023-07-09T21:42:25.307504+0000","last_became_active":"2023-07-09T21:42:24.323819+0000","last_became_peered":"2023-07-09T21:42:24.323819+0000","last_unstale":"2023-07-09T21:42:25.307504+0000","last_undegraded":"2023-07-09T21:42:25.307504+0000","last_fullsized":"2023-07-09T21:42:25.307504+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:28.031154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542964+0000","last_change":"2023-07-09T21:42:24.329530+0000","last_active":"2023-07-09T21:42:26.542964+0000","last_peered":"2023-07-09T21:42:26.542964+0000","last_clean":"2023-07-09T21:42:26.542964+0000","last_became_active":"2023-07-09T21:42:24.329234+0000","last_became_peered":"2023-07-09T21:42:24.329234+0000","last_unstale":"2023-07-09T21:42:26.542964+0000","last_undegraded":"2023-07-09T21:42:26.542964+0000","last_fullsized":"2023-07-09T21:42:26.542964+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:21:56.524061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883997+0000","last_change":"2023-07-09T21:42:24.312815+0000","last_active":"2023-07-09T21:42:25.883997+0000","last_peered":"2023-07-09T21:42:25.883997+0000","last_clean":"2023-07-09T21:42:25.883997+0000","last_became_active":"2023-07-09T21:42:24.312323+0000","last_became_peered":"2023-07-09T21:42:24.312323+0000","last_unstale":"2023-07-09T21:42:25.883997+0000","last_undegraded":"2023-07-09T21:42:25.883997+0000","last_fullsized":"2023-07-09T21:42:25.883997+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:09:44.223731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543133+0000","last_change":"2023-07-09T21:42:24.308822+0000","last_active":"2023-07-09T21:42:26.543133+0000","last_peered":"2023-07-09T21:42:26.543133+0000","last_clean":"2023-07-09T21:42:26.543133+0000","last_became_active":"2023-07-09T21:42:24.308482+0000","last_became_peered":"2023-07-09T21:42:24.308482+0000","last_unstale":"2023-07-09T21:42:26.543133+0000","last_undegraded":"2023-07-09T21:42:26.543133+0000","last_fullsized":"2023-07-09T21:42:26.543133+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:18.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308497+0000","last_change":"2023-07-09T21:42:24.323092+0000","last_active":"2023-07-09T21:42:25.308497+0000","last_peered":"2023-07-09T21:42:25.308497+0000","last_clean":"2023-07-09T21:42:25.308497+0000","last_became_active":"2023-07-09T21:42:24.321280+0000","last_became_peered":"2023-07-09T21:42:24.321280+0000","last_unstale":"2023-07-09T21:42:25.308497+0000","last_undegraded":"2023-07-09T21:42:25.308497+0000","last_fullsized":"2023-07-09T21:42:25.308497+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:22.475707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308198+0000","last_change":"2023-07-09T21:42:24.317249+0000","last_active":"2023-07-09T21:42:25.308198+0000","last_peered":"2023-07-09T21:42:25.308198+0000","last_clean":"2023-07-09T21:42:25.308198+0000","last_became_active":"2023-07-09T21:42:24.316970+0000","last_became_peered":"2023-07-09T21:42:24.316970+0000","last_unstale":"2023-07-09T21:42:25.308198+0000","last_undegraded":"2023-07-09T21:42:25.308198+0000","last_fullsized":"2023-07-09T21:42:25.308198+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:39.080935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486181+0000","last_change":"2023-07-09T21:42:24.316911+0000","last_active":"2023-07-09T21:42:26.486181+0000","last_peered":"2023-07-09T21:42:26.486181+0000","last_clean":"2023-07-09T21:42:26.486181+0000","last_became_active":"2023-07-09T21:42:24.316642+0000","last_became_peered":"2023-07-09T21:42:24.316642+0000","last_unstale":"2023-07-09T21:42:26.486181+0000","last_undegraded":"2023-07-09T21:42:26.486181+0000","last_fullsized":"2023-07-09T21:42:26.486181+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:39.940264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"143'4","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307739+0000","last_change":"2023-07-09T21:42:23.319972+0000","last_active":"2023-07-09T21:42:25.307739+0000","last_peered":"2023-07-09T21:42:25.307739+0000","last_clean":"2023-07-09T21:42:25.307739+0000","last_became_active":"2023-07-09T21:42:23.319687+0000","last_became_peered":"2023-07-09T21:42:23.319687+0000","last_unstale":"2023-07-09T21:42:25.307739+0000","last_undegraded":"2023-07-09T21:42:25.307739+0000","last_fullsized":"2023-07-09T21:42:25.307739+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:56.245115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542599+0000","last_change":"2023-07-09T21:42:24.329695+0000","last_active":"2023-07-09T21:42:26.542599+0000","last_peered":"2023-07-09T21:42:26.542599+0000","last_clean":"2023-07-09T21:42:26.542599+0000","last_became_active":"2023-07-09T21:42:24.329398+0000","last_became_peered":"2023-07-09T21:42:24.329398+0000","last_unstale":"2023-07-09T21:42:26.542599+0000","last_undegraded":"2023-07-09T21:42:26.542599+0000","last_fullsized":"2023-07-09T21:42:26.542599+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:54.489026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486465+0000","last_change":"2023-07-09T21:42:23.315824+0000","last_active":"2023-07-09T21:42:26.486465+0000","last_peered":"2023-07-09T21:42:26.486465+0000","last_clean":"2023-07-09T21:42:26.486465+0000","last_became_active":"2023-07-09T21:42:23.315550+0000","last_became_peered":"2023-07-09T21:42:23.315550+0000","last_unstale":"2023-07-09T21:42:26.486465+0000","last_undegraded":"2023-07-09T21:42:26.486465+0000","last_fullsized":"2023-07-09T21:42:26.486465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:34.113245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309395+0000","last_change":"2023-07-09T21:42:24.322646+0000","last_active":"2023-07-09T21:42:25.309395+0000","last_peered":"2023-07-09T21:42:25.309395+0000","last_clean":"2023-07-09T21:42:25.309395+0000","last_became_active":"2023-07-09T21:42:24.322232+0000","last_became_peered":"2023-07-09T21:42:24.322232+0000","last_unstale":"2023-07-09T21:42:25.309395+0000","last_undegraded":"2023-07-09T21:42:25.309395+0000","last_fullsized":"2023-07-09T21:42:25.309395+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:36.657127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281683+0000","last_change":"2023-07-09T21:42:23.319552+0000","last_active":"2023-07-09T21:42:26.281683+0000","last_peered":"2023-07-09T21:42:26.281683+0000","last_clean":"2023-07-09T21:42:26.281683+0000","last_became_active":"2023-07-09T21:42:23.319258+0000","last_became_peered":"2023-07-09T21:42:23.319258+0000","last_unstale":"2023-07-09T21:42:26.281683+0000","last_undegraded":"2023-07-09T21:42:26.281683+0000","last_fullsized":"2023-07-09T21:42:26.281683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:41.780743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.282106+0000","last_change":"2023-07-09T21:42:24.335134+0000","last_active":"2023-07-09T21:42:26.282106+0000","last_peered":"2023-07-09T21:42:26.282106+0000","last_clean":"2023-07-09T21:42:26.282106+0000","last_became_active":"2023-07-09T21:42:24.333956+0000","last_became_peered":"2023-07-09T21:42:24.333956+0000","last_unstale":"2023-07-09T21:42:26.282106+0000","last_undegraded":"2023-07-09T21:42:26.282106+0000","last_fullsized":"2023-07-09T21:42:26.282106+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:13:50.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486195+0000","last_change":"2023-07-09T21:42:23.318851+0000","last_active":"2023-07-09T21:42:26.486195+0000","last_peered":"2023-07-09T21:42:26.486195+0000","last_clean":"2023-07-09T21:42:26.486195+0000","last_became_active":"2023-07-09T21:42:23.318580+0000","last_became_peered":"2023-07-09T21:42:23.318580+0000","last_unstale":"2023-07-09T21:42:26.486195+0000","last_undegraded":"2023-07-09T21:42:26.486195+0000","last_fullsized":"2023-07-09T21:42:26.486195+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:15:23.922755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486079+0000","last_change":"2023-07-09T21:42:24.317917+0000","last_active":"2023-07-09T21:42:26.486079+0000","last_peered":"2023-07-09T21:42:26.486079+0000","last_clean":"2023-07-09T21:42:26.486079+0000","last_became_active":"2023-07-09T21:42:24.317630+0000","last_became_peered":"2023-07-09T21:42:24.317630+0000","last_unstale":"2023-07-09T21:42:26.486079+0000","last_undegraded":"2023-07-09T21:42:26.486079+0000","last_fullsized":"2023-07-09T21:42:26.486079+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:10.740041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308724+0000","last_change":"2023-07-09T21:42:23.321154+0000","last_active":"2023-07-09T21:42:25.308724+0000","last_peered":"2023-07-09T21:42:25.308724+0000","last_clean":"2023-07-09T21:42:25.308724+0000","last_became_active":"2023-07-09T21:42:23.320801+0000","last_became_peered":"2023-07-09T21:42:23.320801+0000","last_unstale":"2023-07-09T21:42:25.308724+0000","last_undegraded":"2023-07-09T21:42:25.308724+0000","last_fullsized":"2023-07-09T21:42:25.308724+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308930+0000","last_change":"2023-07-09T21:42:24.323195+0000","last_active":"2023-07-09T21:42:25.308930+0000","last_peered":"2023-07-09T21:42:25.308930+0000","last_clean":"2023-07-09T21:42:25.308930+0000","last_became_active":"2023-07-09T21:42:24.322909+0000","last_became_peered":"2023-07-09T21:42:24.322909+0000","last_unstale":"2023-07-09T21:42:25.308930+0000","last_undegraded":"2023-07-09T21:42:25.308930+0000","last_fullsized":"2023-07-09T21:42:25.308930+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:47:23.088693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543226+0000","last_change":"2023-07-09T21:42:23.320117+0000","last_active":"2023-07-09T21:42:26.543226+0000","last_peered":"2023-07-09T21:42:26.543226+0000","last_clean":"2023-07-09T21:42:26.543226+0000","last_became_active":"2023-07-09T21:42:23.319851+0000","last_became_peered":"2023-07-09T21:42:23.319851+0000","last_unstale":"2023-07-09T21:42:26.543226+0000","last_undegraded":"2023-07-09T21:42:26.543226+0000","last_fullsized":"2023-07-09T21:42:26.543226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:27:50.856326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543164+0000","last_change":"2023-07-09T21:42:24.322859+0000","last_active":"2023-07-09T21:42:26.543164+0000","last_peered":"2023-07-09T21:42:26.543164+0000","last_clean":"2023-07-09T21:42:26.543164+0000","last_became_active":"2023-07-09T21:42:24.322478+0000","last_became_peered":"2023-07-09T21:42:24.322478+0000","last_unstale":"2023-07-09T21:42:26.543164+0000","last_undegraded":"2023-07-09T21:42:26.543164+0000","last_fullsized":"2023-07-09T21:42:26.543164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:56.330434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308606+0000","last_change":"2023-07-09T21:42:23.312549+0000","last_active":"2023-07-09T21:42:25.308606+0000","last_peered":"2023-07-09T21:42:25.308606+0000","last_clean":"2023-07-09T21:42:25.308606+0000","last_became_active":"2023-07-09T21:42:23.312253+0000","last_became_peered":"2023-07-09T21:42:23.312253+0000","last_unstale":"2023-07-09T21:42:25.308606+0000","last_undegraded":"2023-07-09T21:42:25.308606+0000","last_fullsized":"2023-07-09T21:42:25.308606+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:57:59.972035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486243+0000","last_change":"2023-07-09T21:42:24.319456+0000","last_active":"2023-07-09T21:42:26.486243+0000","last_peered":"2023-07-09T21:42:26.486243+0000","last_clean":"2023-07-09T21:42:26.486243+0000","last_became_active":"2023-07-09T21:42:24.319185+0000","last_became_peered":"2023-07-09T21:42:24.319185+0000","last_unstale":"2023-07-09T21:42:26.486243+0000","last_undegraded":"2023-07-09T21:42:26.486243+0000","last_fullsized":"2023-07-09T21:42:26.486243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:45.817688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542831+0000","last_change":"2023-07-09T21:42:23.318094+0000","last_active":"2023-07-09T21:42:26.542831+0000","last_peered":"2023-07-09T21:42:26.542831+0000","last_clean":"2023-07-09T21:42:26.542831+0000","last_became_active":"2023-07-09T21:42:23.317250+0000","last_became_peered":"2023-07-09T21:42:23.317250+0000","last_unstale":"2023-07-09T21:42:26.542831+0000","last_undegraded":"2023-07-09T21:42:26.542831+0000","last_fullsized":"2023-07-09T21:42:26.542831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:10:33.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308123+0000","last_change":"2023-07-09T21:42:24.323411+0000","last_active":"2023-07-09T21:42:25.308123+0000","last_peered":"2023-07-09T21:42:25.308123+0000","last_clean":"2023-07-09T21:42:25.308123+0000","last_became_active":"2023-07-09T21:42:24.322409+0000","last_became_peered":"2023-07-09T21:42:24.322409+0000","last_unstale":"2023-07-09T21:42:25.308123+0000","last_undegraded":"2023-07-09T21:42:25.308123+0000","last_fullsized":"2023-07-09T21:42:25.308123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:59.423999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486485+0000","last_change":"2023-07-09T21:42:23.321567+0000","last_active":"2023-07-09T21:42:26.486485+0000","last_peered":"2023-07-09T21:42:26.486485+0000","last_clean":"2023-07-09T21:42:26.486485+0000","last_became_active":"2023-07-09T21:42:23.321261+0000","last_became_peered":"2023-07-09T21:42:23.321261+0000","last_unstale":"2023-07-09T21:42:26.486485+0000","last_undegraded":"2023-07-09T21:42:26.486485+0000","last_fullsized":"2023-07-09T21:42:26.486485+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:24.490479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308473+0000","last_change":"2023-07-09T21:42:24.315233+0000","last_active":"2023-07-09T21:42:25.308473+0000","last_peered":"2023-07-09T21:42:25.308473+0000","last_clean":"2023-07-09T21:42:25.308473+0000","last_became_active":"2023-07-09T21:42:24.314910+0000","last_became_peered":"2023-07-09T21:42:24.314910+0000","last_unstale":"2023-07-09T21:42:25.308473+0000","last_undegraded":"2023-07-09T21:42:25.308473+0000","last_fullsized":"2023-07-09T21:42:25.308473+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:22.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884084+0000","last_change":"2023-07-09T21:42:23.312157+0000","last_active":"2023-07-09T21:42:25.884084+0000","last_peered":"2023-07-09T21:42:25.884084+0000","last_clean":"2023-07-09T21:42:25.884084+0000","last_became_active":"2023-07-09T21:42:23.311856+0000","last_became_peered":"2023-07-09T21:42:23.311856+0000","last_unstale":"2023-07-09T21:42:25.884084+0000","last_undegraded":"2023-07-09T21:42:25.884084+0000","last_fullsized":"2023-07-09T21:42:25.884084+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:26.409487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543438+0000","last_change":"2023-07-09T21:42:24.322714+0000","last_active":"2023-07-09T21:42:26.543438+0000","last_peered":"2023-07-09T21:42:26.543438+0000","last_clean":"2023-07-09T21:42:26.543438+0000","last_became_active":"2023-07-09T21:42:24.322451+0000","last_became_peered":"2023-07-09T21:42:24.322451+0000","last_unstale":"2023-07-09T21:42:26.543438+0000","last_undegraded":"2023-07-09T21:42:26.543438+0000","last_fullsized":"2023-07-09T21:42:26.543438+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:12.019033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281836+0000","last_change":"2023-07-09T21:42:23.321319+0000","last_active":"2023-07-09T21:42:26.281836+0000","last_peered":"2023-07-09T21:42:26.281836+0000","last_clean":"2023-07-09T21:42:26.281836+0000","last_became_active":"2023-07-09T21:42:23.319622+0000","last_became_peered":"2023-07-09T21:42:23.319622+0000","last_unstale":"2023-07-09T21:42:26.281836+0000","last_undegraded":"2023-07-09T21:42:26.281836+0000","last_fullsized":"2023-07-09T21:42:26.281836+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:59.825456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309811+0000","last_change":"2023-07-09T21:42:24.327694+0000","last_active":"2023-07-09T21:42:25.309811+0000","last_peered":"2023-07-09T21:42:25.309811+0000","last_clean":"2023-07-09T21:42:25.309811+0000","last_became_active":"2023-07-09T21:42:24.326048+0000","last_became_peered":"2023-07-09T21:42:24.326048+0000","last_unstale":"2023-07-09T21:42:25.309811+0000","last_undegraded":"2023-07-09T21:42:25.309811+0000","last_fullsized":"2023-07-09T21:42:25.309811+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:05:31.200474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281691+0000","last_change":"2023-07-09T21:42:23.326843+0000","last_active":"2023-07-09T21:42:26.281691+0000","last_peered":"2023-07-09T21:42:26.281691+0000","last_clean":"2023-07-09T21:42:26.281691+0000","last_became_active":"2023-07-09T21:42:23.326611+0000","last_became_peered":"2023-07-09T21:42:23.326611+0000","last_unstale":"2023-07-09T21:42:26.281691+0000","last_undegraded":"2023-07-09T21:42:26.281691+0000","last_fullsized":"2023-07-09T21:42:26.281691+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:14.646468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542558+0000","last_change":"2023-07-09T21:42:24.322003+0000","last_active":"2023-07-09T21:42:26.542558+0000","last_peered":"2023-07-09T21:42:26.542558+0000","last_clean":"2023-07-09T21:42:26.542558+0000","last_became_active":"2023-07-09T21:42:24.321726+0000","last_became_peered":"2023-07-09T21:42:24.321726+0000","last_unstale":"2023-07-09T21:42:26.542558+0000","last_undegraded":"2023-07-09T21:42:26.542558+0000","last_fullsized":"2023-07-09T21:42:26.542558+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:35.681151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542461+0000","last_change":"2023-07-09T21:42:23.316515+0000","last_active":"2023-07-09T21:42:26.542461+0000","last_peered":"2023-07-09T21:42:26.542461+0000","last_clean":"2023-07-09T21:42:26.542461+0000","last_became_active":"2023-07-09T21:42:23.316240+0000","last_became_peered":"2023-07-09T21:42:23.316240+0000","last_unstale":"2023-07-09T21:42:26.542461+0000","last_undegraded":"2023-07-09T21:42:26.542461+0000","last_fullsized":"2023-07-09T21:42:26.542461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:43:55.887355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542337+0000","last_change":"2023-07-09T21:42:24.318386+0000","last_active":"2023-07-09T21:42:26.542337+0000","last_peered":"2023-07-09T21:42:26.542337+0000","last_clean":"2023-07-09T21:42:26.542337+0000","last_became_active":"2023-07-09T21:42:24.318097+0000","last_became_peered":"2023-07-09T21:42:24.318097+0000","last_unstale":"2023-07-09T21:42:26.542337+0000","last_undegraded":"2023-07-09T21:42:26.542337+0000","last_fullsized":"2023-07-09T21:42:26.542337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:22.003060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281389+0000","last_change":"2023-07-09T21:42:23.321738+0000","last_active":"2023-07-09T21:42:26.281389+0000","last_peered":"2023-07-09T21:42:26.281389+0000","last_clean":"2023-07-09T21:42:26.281389+0000","last_became_active":"2023-07-09T21:42:23.321449+0000","last_became_peered":"2023-07-09T21:42:23.321449+0000","last_unstale":"2023-07-09T21:42:26.281389+0000","last_undegraded":"2023-07-09T21:42:26.281389+0000","last_fullsized":"2023-07-09T21:42:26.281389+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:18.502643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543284+0000","last_change":"2023-07-09T21:42:24.311433+0000","last_active":"2023-07-09T21:42:26.543284+0000","last_peered":"2023-07-09T21:42:26.543284+0000","last_clean":"2023-07-09T21:42:26.543284+0000","last_became_active":"2023-07-09T21:42:24.310674+0000","last_became_peered":"2023-07-09T21:42:24.310674+0000","last_unstale":"2023-07-09T21:42:26.543284+0000","last_undegraded":"2023-07-09T21:42:26.543284+0000","last_fullsized":"2023-07-09T21:42:26.543284+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:15.988951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542535+0000","last_change":"2023-07-09T21:42:23.322172+0000","last_active":"2023-07-09T21:42:26.542535+0000","last_peered":"2023-07-09T21:42:26.542535+0000","last_clean":"2023-07-09T21:42:26.542535+0000","last_became_active":"2023-07-09T21:42:23.321875+0000","last_became_peered":"2023-07-09T21:42:23.321875+0000","last_unstale":"2023-07-09T21:42:26.542535+0000","last_undegraded":"2023-07-09T21:42:26.542535+0000","last_fullsized":"2023-07-09T21:42:26.542535+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:07:34.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308999+0000","last_change":"2023-07-09T21:42:24.316356+0000","last_active":"2023-07-09T21:42:25.308999+0000","last_peered":"2023-07-09T21:42:25.308999+0000","last_clean":"2023-07-09T21:42:25.308999+0000","last_became_active":"2023-07-09T21:42:24.316093+0000","last_became_peered":"2023-07-09T21:42:24.316093+0000","last_unstale":"2023-07-09T21:42:25.308999+0000","last_undegraded":"2023-07-09T21:42:25.308999+0000","last_fullsized":"2023-07-09T21:42:25.308999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:42:28.903572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281069+0000","last_change":"2023-07-09T21:42:23.319699+0000","last_active":"2023-07-09T21:42:26.281069+0000","last_peered":"2023-07-09T21:42:26.281069+0000","last_clean":"2023-07-09T21:42:26.281069+0000","last_became_active":"2023-07-09T21:42:23.319049+0000","last_became_peered":"2023-07-09T21:42:23.319049+0000","last_unstale":"2023-07-09T21:42:26.281069+0000","last_undegraded":"2023-07-09T21:42:26.281069+0000","last_fullsized":"2023-07-09T21:42:26.281069+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:03:59.024886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543086+0000","last_change":"2023-07-09T21:42:24.328772+0000","last_active":"2023-07-09T21:42:26.543086+0000","last_peered":"2023-07-09T21:42:26.543086+0000","last_clean":"2023-07-09T21:42:26.543086+0000","last_became_active":"2023-07-09T21:42:24.328424+0000","last_became_peered":"2023-07-09T21:42:24.328424+0000","last_unstale":"2023-07-09T21:42:26.543086+0000","last_undegraded":"2023-07-09T21:42:26.543086+0000","last_fullsized":"2023-07-09T21:42:26.543086+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:16.202930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543606+0000","last_change":"2023-07-09T21:42:23.318581+0000","last_active":"2023-07-09T21:42:26.543606+0000","last_peered":"2023-07-09T21:42:26.543606+0000","last_clean":"2023-07-09T21:42:26.543606+0000","last_became_active":"2023-07-09T21:42:23.318274+0000","last_became_peered":"2023-07-09T21:42:23.318274+0000","last_unstale":"2023-07-09T21:42:26.543606+0000","last_undegraded":"2023-07-09T21:42:26.543606+0000","last_fullsized":"2023-07-09T21:42:26.543606+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:11.641391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486207+0000","last_change":"2023-07-09T21:42:24.315715+0000","last_active":"2023-07-09T21:42:26.486207+0000","last_peered":"2023-07-09T21:42:26.486207+0000","last_clean":"2023-07-09T21:42:26.486207+0000","last_became_active":"2023-07-09T21:42:24.315375+0000","last_became_peered":"2023-07-09T21:42:24.315375+0000","last_unstale":"2023-07-09T21:42:26.486207+0000","last_undegraded":"2023-07-09T21:42:26.486207+0000","last_fullsized":"2023-07-09T21:42:26.486207+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:34.252902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"144'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307608+0000","last_change":"2023-07-09T21:42:23.323391+0000","last_active":"2023-07-09T21:42:25.307608+0000","last_peered":"2023-07-09T21:42:25.307608+0000","last_clean":"2023-07-09T21:42:25.307608+0000","last_became_active":"2023-07-09T21:42:23.323092+0000","last_became_peered":"2023-07-09T21:42:23.323092+0000","last_unstale":"2023-07-09T21:42:25.307608+0000","last_undegraded":"2023-07-09T21:42:25.307608+0000","last_fullsized":"2023-07-09T21:42:25.307608+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281750+0000","last_change":"2023-07-09T21:42:24.331450+0000","last_active":"2023-07-09T21:42:26.281750+0000","last_peered":"2023-07-09T21:42:26.281750+0000","last_clean":"2023-07-09T21:42:26.281750+0000","last_became_active":"2023-07-09T21:42:24.331154+0000","last_became_peered":"2023-07-09T21:42:24.331154+0000","last_unstale":"2023-07-09T21:42:26.281750+0000","last_undegraded":"2023-07-09T21:42:26.281750+0000","last_fullsized":"2023-07-09T21:42:26.281750+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:12.334847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307507+0000","last_change":"2023-07-09T21:42:23.323134+0000","last_active":"2023-07-09T21:42:25.307507+0000","last_peered":"2023-07-09T21:42:25.307507+0000","last_clean":"2023-07-09T21:42:25.307507+0000","last_became_active":"2023-07-09T21:42:23.322812+0000","last_became_peered":"2023-07-09T21:42:23.322812+0000","last_unstale":"2023-07-09T21:42:25.307507+0000","last_undegraded":"2023-07-09T21:42:25.307507+0000","last_fullsized":"2023-07-09T21:42:25.307507+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884083+0000","last_change":"2023-07-09T21:42:24.323623+0000","last_active":"2023-07-09T21:42:25.884083+0000","last_peered":"2023-07-09T21:42:25.884083+0000","last_clean":"2023-07-09T21:42:25.884083+0000","last_became_active":"2023-07-09T21:42:24.323353+0000","last_became_peered":"2023-07-09T21:42:24.323353+0000","last_unstale":"2023-07-09T21:42:25.884083+0000","last_undegraded":"2023-07-09T21:42:25.884083+0000","last_fullsized":"2023-07-09T21:42:25.884083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:37:06.878932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543256+0000","last_change":"2023-07-09T21:42:23.319083+0000","last_active":"2023-07-09T21:42:26.543256+0000","last_peered":"2023-07-09T21:42:26.543256+0000","last_clean":"2023-07-09T21:42:26.543256+0000","last_became_active":"2023-07-09T21:42:23.318700+0000","last_became_peered":"2023-07-09T21:42:23.318700+0000","last_unstale":"2023-07-09T21:42:26.543256+0000","last_undegraded":"2023-07-09T21:42:26.543256+0000","last_fullsized":"2023-07-09T21:42:26.543256+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:10:51.915381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542707+0000","last_change":"2023-07-09T21:42:24.317731+0000","last_active":"2023-07-09T21:42:26.542707+0000","last_peered":"2023-07-09T21:42:26.542707+0000","last_clean":"2023-07-09T21:42:26.542707+0000","last_became_active":"2023-07-09T21:42:24.317346+0000","last_became_peered":"2023-07-09T21:42:24.317346+0000","last_unstale":"2023-07-09T21:42:26.542707+0000","last_undegraded":"2023-07-09T21:42:26.542707+0000","last_fullsized":"2023-07-09T21:42:26.542707+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:11.810995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308725+0000","last_change":"2023-07-09T21:42:23.319864+0000","last_active":"2023-07-09T21:42:25.308725+0000","last_peered":"2023-07-09T21:42:25.308725+0000","last_clean":"2023-07-09T21:42:25.308725+0000","last_became_active":"2023-07-09T21:42:23.319564+0000","last_became_peered":"2023-07-09T21:42:23.319564+0000","last_unstale":"2023-07-09T21:42:25.308725+0000","last_undegraded":"2023-07-09T21:42:25.308725+0000","last_fullsized":"2023-07-09T21:42:25.308725+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542422+0000","last_change":"2023-07-09T21:42:24.319093+0000","last_active":"2023-07-09T21:42:26.542422+0000","last_peered":"2023-07-09T21:42:26.542422+0000","last_clean":"2023-07-09T21:42:26.542422+0000","last_became_active":"2023-07-09T21:42:24.318812+0000","last_became_peered":"2023-07-09T21:42:24.318812+0000","last_unstale":"2023-07-09T21:42:26.542422+0000","last_undegraded":"2023-07-09T21:42:26.542422+0000","last_fullsized":"2023-07-09T21:42:26.542422+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:17.613420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308557+0000","last_change":"2023-07-09T21:42:23.317172+0000","last_active":"2023-07-09T21:42:25.308557+0000","last_peered":"2023-07-09T21:42:25.308557+0000","last_clean":"2023-07-09T21:42:25.308557+0000","last_became_active":"2023-07-09T21:42:23.316822+0000","last_became_peered":"2023-07-09T21:42:23.316822+0000","last_unstale":"2023-07-09T21:42:25.308557+0000","last_undegraded":"2023-07-09T21:42:25.308557+0000","last_fullsized":"2023-07-09T21:42:25.308557+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:27.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281235+0000","last_change":"2023-07-09T21:42:24.336909+0000","last_active":"2023-07-09T21:42:26.281235+0000","last_peered":"2023-07-09T21:42:26.281235+0000","last_clean":"2023-07-09T21:42:26.281235+0000","last_became_active":"2023-07-09T21:42:24.336603+0000","last_became_peered":"2023-07-09T21:42:24.336603+0000","last_unstale":"2023-07-09T21:42:26.281235+0000","last_undegraded":"2023-07-09T21:42:26.281235+0000","last_fullsized":"2023-07-09T21:42:26.281235+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:16.593371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542923+0000","last_change":"2023-07-09T21:42:23.317406+0000","last_active":"2023-07-09T21:42:26.542923+0000","last_peered":"2023-07-09T21:42:26.542923+0000","last_clean":"2023-07-09T21:42:26.542923+0000","last_became_active":"2023-07-09T21:42:23.317101+0000","last_became_peered":"2023-07-09T21:42:23.317101+0000","last_unstale":"2023-07-09T21:42:26.542923+0000","last_undegraded":"2023-07-09T21:42:26.542923+0000","last_fullsized":"2023-07-09T21:42:26.542923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:45:48.775989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486333+0000","last_change":"2023-07-09T21:42:24.331382+0000","last_active":"2023-07-09T21:42:26.486333+0000","last_peered":"2023-07-09T21:42:26.486333+0000","last_clean":"2023-07-09T21:42:26.486333+0000","last_became_active":"2023-07-09T21:42:24.331074+0000","last_became_peered":"2023-07-09T21:42:24.331074+0000","last_unstale":"2023-07-09T21:42:26.486333+0000","last_undegraded":"2023-07-09T21:42:26.486333+0000","last_fullsized":"2023-07-09T21:42:26.486333+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:35.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281072+0000","last_change":"2023-07-09T21:42:23.317720+0000","last_active":"2023-07-09T21:42:26.281072+0000","last_peered":"2023-07-09T21:42:26.281072+0000","last_clean":"2023-07-09T21:42:26.281072+0000","last_became_active":"2023-07-09T21:42:23.317450+0000","last_became_peered":"2023-07-09T21:42:23.317450+0000","last_unstale":"2023-07-09T21:42:26.281072+0000","last_undegraded":"2023-07-09T21:42:26.281072+0000","last_fullsized":"2023-07-09T21:42:26.281072+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:12:25.172628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281789+0000","last_change":"2023-07-09T21:42:24.334558+0000","last_active":"2023-07-09T21:42:26.281789+0000","last_peered":"2023-07-09T21:42:26.281789+0000","last_clean":"2023-07-09T21:42:26.281789+0000","last_became_active":"2023-07-09T21:42:24.334267+0000","last_became_peered":"2023-07-09T21:42:24.334267+0000","last_unstale":"2023-07-09T21:42:26.281789+0000","last_undegraded":"2023-07-09T21:42:26.281789+0000","last_fullsized":"2023-07-09T21:42:26.281789+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:49.940493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"143'8","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542361+0000","last_change":"2023-07-09T21:42:23.317380+0000","last_active":"2023-07-09T21:42:26.542361+0000","last_peered":"2023-07-09T21:42:26.542361+0000","last_clean":"2023-07-09T21:42:26.542361+0000","last_became_active":"2023-07-09T21:42:23.317089+0000","last_became_peered":"2023-07-09T21:42:23.317089+0000","last_unstale":"2023-07-09T21:42:26.542361+0000","last_undegraded":"2023-07-09T21:42:26.542361+0000","last_fullsized":"2023-07-09T21:42:26.542361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:01.871859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"131'249","reported_seq":860,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281454+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:42:26.281454+0000","last_peered":"2023-07-09T21:42:26.281454+0000","last_clean":"2023-07-09T21:42:26.281454+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:42:26.281454+0000","last_undegraded":"2023-07-09T21:42:26.281454+0000","last_fullsized":"2023-07-09T21:42:26.281454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:06:56.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":270,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309108+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:42:25.309108+0000","last_peered":"2023-07-09T21:42:25.309108+0000","last_clean":"2023-07-09T21:42:25.309108+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:42:25.309108+0000","last_undegraded":"2023-07-09T21:42:25.309108+0000","last_fullsized":"2023-07-09T21:42:25.309108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:54:45.538792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307349+0000","last_change":"2023-07-09T21:42:24.324636+0000","last_active":"2023-07-09T21:42:25.307349+0000","last_peered":"2023-07-09T21:42:25.307349+0000","last_clean":"2023-07-09T21:42:25.307349+0000","last_became_active":"2023-07-09T21:42:24.324383+0000","last_became_peered":"2023-07-09T21:42:24.324383+0000","last_unstale":"2023-07-09T21:42:25.307349+0000","last_undegraded":"2023-07-09T21:42:25.307349+0000","last_fullsized":"2023-07-09T21:42:25.307349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543348+0000","last_change":"2023-07-09T21:42:23.315778+0000","last_active":"2023-07-09T21:42:26.543348+0000","last_peered":"2023-07-09T21:42:26.543348+0000","last_clean":"2023-07-09T21:42:26.543348+0000","last_became_active":"2023-07-09T21:42:23.315455+0000","last_became_peered":"2023-07-09T21:42:23.315455+0000","last_unstale":"2023-07-09T21:42:26.543348+0000","last_undegraded":"2023-07-09T21:42:26.543348+0000","last_fullsized":"2023-07-09T21:42:26.543348+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:18.916955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281398+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:42:26.281398+0000","last_peered":"2023-07-09T21:42:26.281398+0000","last_clean":"2023-07-09T21:42:26.281398+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:42:26.281398+0000","last_undegraded":"2023-07-09T21:42:26.281398+0000","last_fullsized":"2023-07-09T21:42:26.281398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:08:27.824598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486051+0000","last_change":"2023-07-09T21:42:24.330451+0000","last_active":"2023-07-09T21:42:26.486051+0000","last_peered":"2023-07-09T21:42:26.486051+0000","last_clean":"2023-07-09T21:42:26.486051+0000","last_became_active":"2023-07-09T21:42:24.329921+0000","last_became_peered":"2023-07-09T21:42:24.329921+0000","last_unstale":"2023-07-09T21:42:26.486051+0000","last_undegraded":"2023-07-09T21:42:26.486051+0000","last_fullsized":"2023-07-09T21:42:26.486051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:29:44.068474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543307+0000","last_change":"2023-07-09T21:42:23.316498+0000","last_active":"2023-07-09T21:42:26.543307+0000","last_peered":"2023-07-09T21:42:26.543307+0000","last_clean":"2023-07-09T21:42:26.543307+0000","last_became_active":"2023-07-09T21:42:23.316189+0000","last_became_peered":"2023-07-09T21:42:23.316189+0000","last_unstale":"2023-07-09T21:42:26.543307+0000","last_undegraded":"2023-07-09T21:42:26.543307+0000","last_fullsized":"2023-07-09T21:42:26.543307+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:30:27.558671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883774+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:42:25.883774+0000","last_peered":"2023-07-09T21:42:25.883774+0000","last_clean":"2023-07-09T21:42:25.883774+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:42:25.883774+0000","last_undegraded":"2023-07-09T21:42:25.883774+0000","last_fullsized":"2023-07-09T21:42:25.883774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:15.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883824+0000","last_change":"2023-07-09T21:42:24.312092+0000","last_active":"2023-07-09T21:42:25.883824+0000","last_peered":"2023-07-09T21:42:25.883824+0000","last_clean":"2023-07-09T21:42:25.883824+0000","last_became_active":"2023-07-09T21:42:24.311806+0000","last_became_peered":"2023-07-09T21:42:24.311806+0000","last_unstale":"2023-07-09T21:42:25.883824+0000","last_undegraded":"2023-07-09T21:42:25.883824+0000","last_fullsized":"2023-07-09T21:42:25.883824+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:45.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542455+0000","last_change":"2023-07-09T21:42:23.316447+0000","last_active":"2023-07-09T21:42:26.542455+0000","last_peered":"2023-07-09T21:42:26.542455+0000","last_clean":"2023-07-09T21:42:26.542455+0000","last_became_active":"2023-07-09T21:42:23.316152+0000","last_became_peered":"2023-07-09T21:42:23.316152+0000","last_unstale":"2023-07-09T21:42:26.542455+0000","last_undegraded":"2023-07-09T21:42:26.542455+0000","last_fullsized":"2023-07-09T21:42:26.542455+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:20.620357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":270,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308852+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:42:25.308852+0000","last_peered":"2023-07-09T21:42:25.308852+0000","last_clean":"2023-07-09T21:42:25.308852+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:42:25.308852+0000","last_undegraded":"2023-07-09T21:42:25.308852+0000","last_fullsized":"2023-07-09T21:42:25.308852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:34.432158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307157+0000","last_change":"2023-07-09T21:42:24.322986+0000","last_active":"2023-07-09T21:42:25.307157+0000","last_peered":"2023-07-09T21:42:25.307157+0000","last_clean":"2023-07-09T21:42:25.307157+0000","last_became_active":"2023-07-09T21:42:24.322654+0000","last_became_peered":"2023-07-09T21:42:24.322654+0000","last_unstale":"2023-07-09T21:42:25.307157+0000","last_undegraded":"2023-07-09T21:42:25.307157+0000","last_fullsized":"2023-07-09T21:42:25.307157+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:03.427737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307912+0000","last_change":"2023-07-09T21:42:23.323352+0000","last_active":"2023-07-09T21:42:25.307912+0000","last_peered":"2023-07-09T21:42:25.307912+0000","last_clean":"2023-07-09T21:42:25.307912+0000","last_became_active":"2023-07-09T21:42:23.322924+0000","last_became_peered":"2023-07-09T21:42:23.322924+0000","last_unstale":"2023-07-09T21:42:25.307912+0000","last_undegraded":"2023-07-09T21:42:25.307912+0000","last_fullsized":"2023-07-09T21:42:25.307912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:34:32.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486301+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:42:26.486301+0000","last_peered":"2023-07-09T21:42:26.486301+0000","last_clean":"2023-07-09T21:42:26.486301+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:42:26.486301+0000","last_undegraded":"2023-07-09T21:42:26.486301+0000","last_fullsized":"2023-07-09T21:42:26.486301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309632+0000","last_change":"2023-07-09T21:42:24.321965+0000","last_active":"2023-07-09T21:42:25.309632+0000","last_peered":"2023-07-09T21:42:25.309632+0000","last_clean":"2023-07-09T21:42:25.309632+0000","last_became_active":"2023-07-09T21:42:24.321646+0000","last_became_peered":"2023-07-09T21:42:24.321646+0000","last_unstale":"2023-07-09T21:42:25.309632+0000","last_undegraded":"2023-07-09T21:42:25.309632+0000","last_fullsized":"2023-07-09T21:42:25.309632+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:36.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309475+0000","last_change":"2023-07-09T21:42:23.318436+0000","last_active":"2023-07-09T21:42:25.309475+0000","last_peered":"2023-07-09T21:42:25.309475+0000","last_clean":"2023-07-09T21:42:25.309475+0000","last_became_active":"2023-07-09T21:42:23.318133+0000","last_became_peered":"2023-07-09T21:42:23.318133+0000","last_unstale":"2023-07-09T21:42:25.309475+0000","last_undegraded":"2023-07-09T21:42:25.309475+0000","last_fullsized":"2023-07-09T21:42:25.309475+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:52:24.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281880+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:42:26.281880+0000","last_peered":"2023-07-09T21:42:26.281880+0000","last_clean":"2023-07-09T21:42:26.281880+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:42:26.281880+0000","last_undegraded":"2023-07-09T21:42:26.281880+0000","last_fullsized":"2023-07-09T21:42:26.281880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:16.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543690+0000","last_change":"2023-07-09T21:42:24.311018+0000","last_active":"2023-07-09T21:42:26.543690+0000","last_peered":"2023-07-09T21:42:26.543690+0000","last_clean":"2023-07-09T21:42:26.543690+0000","last_became_active":"2023-07-09T21:42:24.310650+0000","last_became_peered":"2023-07-09T21:42:24.310650+0000","last_unstale":"2023-07-09T21:42:26.543690+0000","last_undegraded":"2023-07-09T21:42:26.543690+0000","last_fullsized":"2023-07-09T21:42:26.543690+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:03.100035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"143'3","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309468+0000","last_change":"2023-07-09T21:42:23.317942+0000","last_active":"2023-07-09T21:42:25.309468+0000","last_peered":"2023-07-09T21:42:25.309468+0000","last_clean":"2023-07-09T21:42:25.309468+0000","last_became_active":"2023-07-09T21:42:23.317646+0000","last_became_peered":"2023-07-09T21:42:23.317646+0000","last_unstale":"2023-07-09T21:42:25.309468+0000","last_undegraded":"2023-07-09T21:42:25.309468+0000","last_fullsized":"2023-07-09T21:42:25.309468+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:55:51.766273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.485896+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:42:26.485896+0000","last_peered":"2023-07-09T21:42:26.485896+0000","last_clean":"2023-07-09T21:42:26.485896+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:42:26.485896+0000","last_undegraded":"2023-07-09T21:42:26.485896+0000","last_fullsized":"2023-07-09T21:42:26.485896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:58.734204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309722+0000","last_change":"2023-07-09T21:42:24.325666+0000","last_active":"2023-07-09T21:42:25.309722+0000","last_peered":"2023-07-09T21:42:25.309722+0000","last_clean":"2023-07-09T21:42:25.309722+0000","last_became_active":"2023-07-09T21:42:24.321581+0000","last_became_peered":"2023-07-09T21:42:24.321581+0000","last_unstale":"2023-07-09T21:42:25.309722+0000","last_undegraded":"2023-07-09T21:42:25.309722+0000","last_fullsized":"2023-07-09T21:42:25.309722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:56.739441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"143'6","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542924+0000","last_change":"2023-07-09T21:42:23.317308+0000","last_active":"2023-07-09T21:42:26.542924+0000","last_peered":"2023-07-09T21:42:26.542924+0000","last_clean":"2023-07-09T21:42:26.542924+0000","last_became_active":"2023-07-09T21:42:23.316951+0000","last_became_peered":"2023-07-09T21:42:23.316951+0000","last_unstale":"2023-07-09T21:42:26.542924+0000","last_undegraded":"2023-07-09T21:42:26.542924+0000","last_fullsized":"2023-07-09T21:42:26.542924+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:35:21.353584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":234,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307888+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:42:25.307888+0000","last_peered":"2023-07-09T21:42:25.307888+0000","last_clean":"2023-07-09T21:42:25.307888+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:42:25.307888+0000","last_undegraded":"2023-07-09T21:42:25.307888+0000","last_fullsized":"2023-07-09T21:42:25.307888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:27:24.578992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59628,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312212,"statfs":{"total":96636764160,"available":96575705088,"internally_reserved":0,"allocated":2396160,"data_stored":1500968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":1.03,"15min":1.03},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98999999999999999,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.006,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.76900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.95199999999999996,"5min":1.754,"15min":1.754},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.1140000000000001,"15min":1.129},"last":0.753}]},{"osd":4,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.86399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.38,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":1.0109999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":1.232,"15min":1.232},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.72899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575087,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1789952,"data_stored":910406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.95399999999999996,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97499999999999998,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98499999999999999,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.60299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.98899999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68899999999999995,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.88400000000000001,"5min":6.101,"15min":6.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.72099999999999997,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.69799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":0.96999999999999997,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575086,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50848,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320992,"statfs":{"total":96636764160,"available":96584695808,"internally_reserved":0,"allocated":1794048,"data_stored":909984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.874},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.95299999999999996,"15min":1.02},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63}]},{"osd":3,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.56299999999999994,"5min":0.48899999999999999,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.86899999999999999,"5min":1.083,"15min":1.083},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.038},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.107,"15min":1.107},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575088,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1798144,"data_stored":911388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.96899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.70099999999999996},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.88900000000000001,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":1.26},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.45800000000000002},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.05},"last":0.879}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.85799999999999998,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1802240,"data_stored":911422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68400000000000005,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.318},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":1.101,"15min":1.101},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.499}]},{"osd":4,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.3320000000000001},"last":0.622},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.095,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.81499999999999995},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.0449999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.65600000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.59199999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.51},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.46800000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.127},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54936,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316904,"statfs":{"total":96636764160,"available":96580509696,"internally_reserved":0,"allocated":1785856,"data_stored":909824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.376},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.753},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1789952,"data_stored":909846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.76800000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.77500000000000002,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.1060000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.085,"5min":1.085,"15min":1.274},"last":0.68500000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.351},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.1160000000000001,"15min":1.242},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.206},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.012,"5min":1.107,"15min":1.173},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.81299999999999994},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":1.137,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575088,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37472,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334368,"statfs":{"total":96636764160,"available":96598392832,"internally_reserved":0,"allocated":2383872,"data_stored":1500214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.753},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.629}]},{"osd":2,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.35099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":1.657,"15min":1.657},"last":0.73999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.087,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":0.88700000000000001,"5min":1.835,"15min":1.835},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.726,"15min":1.726},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1220000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.1439999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.883,"15min":1.883},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:42:31.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:42:31.910 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:42:33.026 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:42:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 Processor -- start 2023-07-09T21:42:33.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 -- start start 2023-07-09T21:42:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f79580b7ab0 0x7f795806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f79580b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79580b4170 0x7f795815f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79580b7e80 con 0x7f79580b4170 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79580b4610 con 0x7f79580b7ab0 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f796031f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580b49f0 con 0x7f79580cef80 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79580b4170 0x7f795815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f79580b4170 0x7f795815f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39710/0 (socket says 172.21.15.37:39710) 2023-07-09T21:42:33.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 -- 172.21.15.37:0/466667131 learned_addr learned my addr 172.21.15.37:0/466667131 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:33.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795d8ba640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f79580b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e0bb640 1 --2- 172.21.15.37:0/466667131 >> v2:172.21.15.119:3300/0 conn(0x7f79580b7ab0 0x7f795806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 -- 172.21.15.37:0/466667131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 msgr2=0x7f79580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f79580b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 -- 172.21.15.37:0/466667131 >> v2:172.21.15.119:3300/0 conn(0x7f79580b7ab0 msgr2=0x7f795806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 --2- 172.21.15.37:0/466667131 >> v2:172.21.15.119:3300/0 conn(0x7f79580b7ab0 0x7f795806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.180+0000 7f795e8bc640 1 -- 172.21.15.37:0/466667131 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79580cc8a0 con 0x7f79580b4170 2023-07-09T21:42:33.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f795e8bc640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b4170 0x7f795815f490 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f795806b360 tx=0x7f795001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2670d184db4257 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f795d0b9640 1 -- 172.21.15.37:0/466667131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500a5560 con 0x7f79580b4170 2023-07-09T21:42:33.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f795d0b9640 1 -- 172.21.15.37:0/466667131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79500a56c0 con 0x7f79580b4170 2023-07-09T21:42:33.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f795d0b9640 1 -- 172.21.15.37:0/466667131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79500a5a50 con 0x7f79580b4170 2023-07-09T21:42:33.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 -- 172.21.15.37:0/466667131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b4170 msgr2=0x7f795815f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b4170 0x7f795815f490 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f795806b360 tx=0x7f795001c6e0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 -- 172.21.15.37:0/466667131 shutdown_connections 2023-07-09T21:42:33.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b4170 0x7f795815f490 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 --2- 172.21.15.37:0/466667131 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f79580b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 --2- 172.21.15.37:0/466667131 >> v2:172.21.15.119:3300/0 conn(0x7f79580b7ab0 0x7f795806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 -- 172.21.15.37:0/466667131 >> 172.21.15.37:0/466667131 conn(0x7f7958073090 msgr2=0x7f7958069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:33.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 -- 172.21.15.37:0/466667131 shutdown_connections 2023-07-09T21:42:33.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.184+0000 7f796031f640 1 -- 172.21.15.37:0/466667131 wait complete. 2023-07-09T21:42:33.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 Processor -- start 2023-07-09T21:42:33.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- start start 2023-07-09T21:42:33.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 0x7f79580cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f7958156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580ca260 con 0x7f79580b7ab0 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79580cb190 con 0x7f79580b4170 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79580cb470 con 0x7f79580cef80 2023-07-09T21:42:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39720/0 (socket says 172.21.15.37:39720) 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 -- 172.21.15.37:0/212730097 learned_addr learned my addr 172.21.15.37:0/212730097 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795e0bb640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 0x7f79580cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795e8bc640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f7958156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 -- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 msgr2=0x7f7958156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f7958156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 -- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 msgr2=0x7f79580cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 0x7f79580cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 -- 172.21.15.37:0/212730097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7950009b30 con 0x7f79580b7ab0 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795e0bb640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 0x7f79580cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795e8bc640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f7958156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f795d8ba640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f794800d5d0 tx=0x7f794800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948004240 con 0x7f79580b7ab0 2023-07-09T21:42:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480043a0 con 0x7f79580b7ab0 2023-07-09T21:42:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948003840 con 0x7f79580b7ab0 2023-07-09T21:42:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79580cb750 con 0x7f79580b7ab0 2023-07-09T21:42:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.188+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79580cbd10 con 0x7f79580b7ab0 2023-07-09T21:42:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795804d7d0 con 0x7f79580b7ab0 2023-07-09T21:42:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f79480039a0 con 0x7f79580b7ab0 2023-07-09T21:42:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f794effd640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 0x7f793c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f7948083ff0 con 0x7f79580b7ab0 2023-07-09T21:42:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f795e0bb640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 0x7f793c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.192+0000 7f795e0bb640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 0x7f793c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7954009840 tx=0x7f7954008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.196+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7948051330 con 0x7f79580b7ab0 2023-07-09T21:42:33.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.352+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79580cf4d0 con 0x7f793c0663a0 2023-07-09T21:42:33.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.360+0000 7f794effd640 1 -- 172.21.15.37:0/212730097 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311925 (secure 0 0 0) 0x7f7954009e20 con 0x7f793c0663a0 2023-07-09T21:42:33.363 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:33.365 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:42:33.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 msgr2=0x7f793c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 0x7f793c068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7954009840 tx=0x7f7954008040 comp rx=0 tx=0).stop 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 msgr2=0x7f79580c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f794800d5d0 tx=0x7f794800da90 comp rx=0 tx=0).stop 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 shutdown_connections 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f793c0663a0 0x7f793c068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f79580cef80 0x7f7958156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79580b7ab0 0x7f79580c9d20 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 --2- 172.21.15.37:0/212730097 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79580b4170 0x7f79580cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 >> 172.21.15.37:0/212730097 conn(0x7f7958073090 msgr2=0x7f79580b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 shutdown_connections 2023-07-09T21:42:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.364+0000 7f796031f640 1 -- 172.21.15.37:0/212730097 wait complete. 2023-07-09T21:42:33.383 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:42:31.950396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":444,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":288,"ondisk_log_size":288,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":342280,"kb_used_data":15176,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754632440,"statfs":{"total":773094113280,"available":772743618560,"internally_reserved":0,"allocated":15540224,"data_stored":8464052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":43,"apply_latency_ms":43,"commit_latency_ns":43000000,"apply_latency_ns":43000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002016"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308795+0000","last_change":"2023-07-09T21:42:24.320700+0000","last_active":"2023-07-09T21:42:25.308795+0000","last_peered":"2023-07-09T21:42:25.308795+0000","last_clean":"2023-07-09T21:42:25.308795+0000","last_became_active":"2023-07-09T21:42:24.320336+0000","last_became_peered":"2023-07-09T21:42:24.320336+0000","last_unstale":"2023-07-09T21:42:25.308795+0000","last_undegraded":"2023-07-09T21:42:25.308795+0000","last_fullsized":"2023-07-09T21:42:25.308795+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:57.252677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543457+0000","last_change":"2023-07-09T21:42:24.319081+0000","last_active":"2023-07-09T21:42:26.543457+0000","last_peered":"2023-07-09T21:42:26.543457+0000","last_clean":"2023-07-09T21:42:26.543457+0000","last_became_active":"2023-07-09T21:42:24.318565+0000","last_became_peered":"2023-07-09T21:42:24.318565+0000","last_unstale":"2023-07-09T21:42:26.543457+0000","last_undegraded":"2023-07-09T21:42:26.543457+0000","last_fullsized":"2023-07-09T21:42:26.543457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:06.137104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543609+0000","last_change":"2023-07-09T21:42:24.321328+0000","last_active":"2023-07-09T21:42:26.543609+0000","last_peered":"2023-07-09T21:42:26.543609+0000","last_clean":"2023-07-09T21:42:26.543609+0000","last_became_active":"2023-07-09T21:42:24.321064+0000","last_became_peered":"2023-07-09T21:42:24.321064+0000","last_unstale":"2023-07-09T21:42:26.543609+0000","last_undegraded":"2023-07-09T21:42:26.543609+0000","last_fullsized":"2023-07-09T21:42:26.543609+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:18.567406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281668+0000","last_change":"2023-07-09T21:42:24.330547+0000","last_active":"2023-07-09T21:42:26.281668+0000","last_peered":"2023-07-09T21:42:26.281668+0000","last_clean":"2023-07-09T21:42:26.281668+0000","last_became_active":"2023-07-09T21:42:24.330284+0000","last_became_peered":"2023-07-09T21:42:24.330284+0000","last_unstale":"2023-07-09T21:42:26.281668+0000","last_undegraded":"2023-07-09T21:42:26.281668+0000","last_fullsized":"2023-07-09T21:42:26.281668+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:15:06.610326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308559+0000","last_change":"2023-07-09T21:42:24.315957+0000","last_active":"2023-07-09T21:42:25.308559+0000","last_peered":"2023-07-09T21:42:25.308559+0000","last_clean":"2023-07-09T21:42:25.308559+0000","last_became_active":"2023-07-09T21:42:24.315612+0000","last_became_peered":"2023-07-09T21:42:24.315612+0000","last_unstale":"2023-07-09T21:42:25.308559+0000","last_undegraded":"2023-07-09T21:42:25.308559+0000","last_fullsized":"2023-07-09T21:42:25.308559+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543108+0000","last_change":"2023-07-09T21:42:24.315089+0000","last_active":"2023-07-09T21:42:26.543108+0000","last_peered":"2023-07-09T21:42:26.543108+0000","last_clean":"2023-07-09T21:42:26.543108+0000","last_became_active":"2023-07-09T21:42:24.314794+0000","last_became_peered":"2023-07-09T21:42:24.314794+0000","last_unstale":"2023-07-09T21:42:26.543108+0000","last_undegraded":"2023-07-09T21:42:26.543108+0000","last_fullsized":"2023-07-09T21:42:26.543108+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:38.058536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542794+0000","last_change":"2023-07-09T21:42:24.332137+0000","last_active":"2023-07-09T21:42:26.542794+0000","last_peered":"2023-07-09T21:42:26.542794+0000","last_clean":"2023-07-09T21:42:26.542794+0000","last_became_active":"2023-07-09T21:42:24.331843+0000","last_became_peered":"2023-07-09T21:42:24.331843+0000","last_unstale":"2023-07-09T21:42:26.542794+0000","last_undegraded":"2023-07-09T21:42:26.542794+0000","last_fullsized":"2023-07-09T21:42:26.542794+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:45.544869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542272+0000","last_change":"2023-07-09T21:42:24.319671+0000","last_active":"2023-07-09T21:42:26.542272+0000","last_peered":"2023-07-09T21:42:26.542272+0000","last_clean":"2023-07-09T21:42:26.542272+0000","last_became_active":"2023-07-09T21:42:24.319403+0000","last_became_peered":"2023-07-09T21:42:24.319403+0000","last_unstale":"2023-07-09T21:42:26.542272+0000","last_undegraded":"2023-07-09T21:42:26.542272+0000","last_fullsized":"2023-07-09T21:42:26.542272+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:16:37.469112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281991+0000","last_change":"2023-07-09T21:42:24.331784+0000","last_active":"2023-07-09T21:42:26.281991+0000","last_peered":"2023-07-09T21:42:26.281991+0000","last_clean":"2023-07-09T21:42:26.281991+0000","last_became_active":"2023-07-09T21:42:24.331501+0000","last_became_peered":"2023-07-09T21:42:24.331501+0000","last_unstale":"2023-07-09T21:42:26.281991+0000","last_undegraded":"2023-07-09T21:42:26.281991+0000","last_fullsized":"2023-07-09T21:42:26.281991+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:26.741847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486421+0000","last_change":"2023-07-09T21:42:24.320325+0000","last_active":"2023-07-09T21:42:26.486421+0000","last_peered":"2023-07-09T21:42:26.486421+0000","last_clean":"2023-07-09T21:42:26.486421+0000","last_became_active":"2023-07-09T21:42:24.320047+0000","last_became_peered":"2023-07-09T21:42:24.320047+0000","last_unstale":"2023-07-09T21:42:26.486421+0000","last_undegraded":"2023-07-09T21:42:26.486421+0000","last_fullsized":"2023-07-09T21:42:26.486421+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:26:14.046789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308387+0000","last_change":"2023-07-09T21:42:24.318936+0000","last_active":"2023-07-09T21:42:25.308387+0000","last_peered":"2023-07-09T21:42:25.308387+0000","last_clean":"2023-07-09T21:42:25.308387+0000","last_became_active":"2023-07-09T21:42:24.318648+0000","last_became_peered":"2023-07-09T21:42:24.318648+0000","last_unstale":"2023-07-09T21:42:25.308387+0000","last_undegraded":"2023-07-09T21:42:25.308387+0000","last_fullsized":"2023-07-09T21:42:25.308387+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:19:56.198796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542836+0000","last_change":"2023-07-09T21:42:24.319127+0000","last_active":"2023-07-09T21:42:26.542836+0000","last_peered":"2023-07-09T21:42:26.542836+0000","last_clean":"2023-07-09T21:42:26.542836+0000","last_became_active":"2023-07-09T21:42:24.318813+0000","last_became_peered":"2023-07-09T21:42:24.318813+0000","last_unstale":"2023-07-09T21:42:26.542836+0000","last_undegraded":"2023-07-09T21:42:26.542836+0000","last_fullsized":"2023-07-09T21:42:26.542836+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:05:16.204055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486217+0000","last_change":"2023-07-09T21:42:24.324227+0000","last_active":"2023-07-09T21:42:26.486217+0000","last_peered":"2023-07-09T21:42:26.486217+0000","last_clean":"2023-07-09T21:42:26.486217+0000","last_became_active":"2023-07-09T21:42:24.323954+0000","last_became_peered":"2023-07-09T21:42:24.323954+0000","last_unstale":"2023-07-09T21:42:26.486217+0000","last_undegraded":"2023-07-09T21:42:26.486217+0000","last_fullsized":"2023-07-09T21:42:26.486217+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:48.197704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543002+0000","last_change":"2023-07-09T21:42:24.311669+0000","last_active":"2023-07-09T21:42:26.543002+0000","last_peered":"2023-07-09T21:42:26.543002+0000","last_clean":"2023-07-09T21:42:26.543002+0000","last_became_active":"2023-07-09T21:42:24.311057+0000","last_became_peered":"2023-07-09T21:42:24.311057+0000","last_unstale":"2023-07-09T21:42:26.543002+0000","last_undegraded":"2023-07-09T21:42:26.543002+0000","last_fullsized":"2023-07-09T21:42:26.543002+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:16.183667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308179+0000","last_change":"2023-07-09T21:42:24.318441+0000","last_active":"2023-07-09T21:42:25.308179+0000","last_peered":"2023-07-09T21:42:25.308179+0000","last_clean":"2023-07-09T21:42:25.308179+0000","last_became_active":"2023-07-09T21:42:24.318054+0000","last_became_peered":"2023-07-09T21:42:24.318054+0000","last_unstale":"2023-07-09T21:42:25.308179+0000","last_undegraded":"2023-07-09T21:42:25.308179+0000","last_fullsized":"2023-07-09T21:42:25.308179+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:52:06.320126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542553+0000","last_change":"2023-07-09T21:42:24.313128+0000","last_active":"2023-07-09T21:42:26.542553+0000","last_peered":"2023-07-09T21:42:26.542553+0000","last_clean":"2023-07-09T21:42:26.542553+0000","last_became_active":"2023-07-09T21:42:24.312844+0000","last_became_peered":"2023-07-09T21:42:24.312844+0000","last_unstale":"2023-07-09T21:42:26.542553+0000","last_undegraded":"2023-07-09T21:42:26.542553+0000","last_fullsized":"2023-07-09T21:42:26.542553+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:10:20.253057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486457+0000","last_change":"2023-07-09T21:42:24.323658+0000","last_active":"2023-07-09T21:42:26.486457+0000","last_peered":"2023-07-09T21:42:26.486457+0000","last_clean":"2023-07-09T21:42:26.486457+0000","last_became_active":"2023-07-09T21:42:24.323382+0000","last_became_peered":"2023-07-09T21:42:24.323382+0000","last_unstale":"2023-07-09T21:42:26.486457+0000","last_undegraded":"2023-07-09T21:42:26.486457+0000","last_fullsized":"2023-07-09T21:42:26.486457+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:32:11.653957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543577+0000","last_change":"2023-07-09T21:42:24.318861+0000","last_active":"2023-07-09T21:42:26.543577+0000","last_peered":"2023-07-09T21:42:26.543577+0000","last_clean":"2023-07-09T21:42:26.543577+0000","last_became_active":"2023-07-09T21:42:24.318109+0000","last_became_peered":"2023-07-09T21:42:24.318109+0000","last_unstale":"2023-07-09T21:42:26.543577+0000","last_undegraded":"2023-07-09T21:42:26.543577+0000","last_fullsized":"2023-07-09T21:42:26.543577+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:46.425360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307319+0000","last_change":"2023-07-09T21:42:24.324450+0000","last_active":"2023-07-09T21:42:25.307319+0000","last_peered":"2023-07-09T21:42:25.307319+0000","last_clean":"2023-07-09T21:42:25.307319+0000","last_became_active":"2023-07-09T21:42:24.324180+0000","last_became_peered":"2023-07-09T21:42:24.324180+0000","last_unstale":"2023-07-09T21:42:25.307319+0000","last_undegraded":"2023-07-09T21:42:25.307319+0000","last_fullsized":"2023-07-09T21:42:25.307319+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:22.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883954+0000","last_change":"2023-07-09T21:42:24.312805+0000","last_active":"2023-07-09T21:42:25.883954+0000","last_peered":"2023-07-09T21:42:25.883954+0000","last_clean":"2023-07-09T21:42:25.883954+0000","last_became_active":"2023-07-09T21:42:24.312452+0000","last_became_peered":"2023-07-09T21:42:24.312452+0000","last_unstale":"2023-07-09T21:42:25.883954+0000","last_undegraded":"2023-07-09T21:42:25.883954+0000","last_fullsized":"2023-07-09T21:42:25.883954+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:20:03.583981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281648+0000","last_change":"2023-07-09T21:42:24.333192+0000","last_active":"2023-07-09T21:42:26.281648+0000","last_peered":"2023-07-09T21:42:26.281648+0000","last_clean":"2023-07-09T21:42:26.281648+0000","last_became_active":"2023-07-09T21:42:24.332913+0000","last_became_peered":"2023-07-09T21:42:24.332913+0000","last_unstale":"2023-07-09T21:42:26.281648+0000","last_undegraded":"2023-07-09T21:42:26.281648+0000","last_fullsized":"2023-07-09T21:42:26.281648+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:05.878304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308417+0000","last_change":"2023-07-09T21:42:24.317180+0000","last_active":"2023-07-09T21:42:25.308417+0000","last_peered":"2023-07-09T21:42:25.308417+0000","last_clean":"2023-07-09T21:42:25.308417+0000","last_became_active":"2023-07-09T21:42:24.315646+0000","last_became_peered":"2023-07-09T21:42:24.315646+0000","last_unstale":"2023-07-09T21:42:25.308417+0000","last_undegraded":"2023-07-09T21:42:25.308417+0000","last_fullsized":"2023-07-09T21:42:25.308417+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:03.427737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281324+0000","last_change":"2023-07-09T21:42:24.330060+0000","last_active":"2023-07-09T21:42:26.281324+0000","last_peered":"2023-07-09T21:42:26.281324+0000","last_clean":"2023-07-09T21:42:26.281324+0000","last_became_active":"2023-07-09T21:42:24.329796+0000","last_became_peered":"2023-07-09T21:42:24.329796+0000","last_unstale":"2023-07-09T21:42:26.281324+0000","last_undegraded":"2023-07-09T21:42:26.281324+0000","last_fullsized":"2023-07-09T21:42:26.281324+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:27.977899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308065+0000","last_change":"2023-07-09T21:42:24.322282+0000","last_active":"2023-07-09T21:42:25.308065+0000","last_peered":"2023-07-09T21:42:25.308065+0000","last_clean":"2023-07-09T21:42:25.308065+0000","last_became_active":"2023-07-09T21:42:24.321973+0000","last_became_peered":"2023-07-09T21:42:24.321973+0000","last_unstale":"2023-07-09T21:42:25.308065+0000","last_undegraded":"2023-07-09T21:42:25.308065+0000","last_fullsized":"2023-07-09T21:42:25.308065+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:14:17.642951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309640+0000","last_change":"2023-07-09T21:42:24.326306+0000","last_active":"2023-07-09T21:42:25.309640+0000","last_peered":"2023-07-09T21:42:25.309640+0000","last_clean":"2023-07-09T21:42:25.309640+0000","last_became_active":"2023-07-09T21:42:24.323346+0000","last_became_peered":"2023-07-09T21:42:24.323346+0000","last_unstale":"2023-07-09T21:42:25.309640+0000","last_undegraded":"2023-07-09T21:42:25.309640+0000","last_fullsized":"2023-07-09T21:42:25.309640+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:39:55.371802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884050+0000","last_change":"2023-07-09T21:42:24.322707+0000","last_active":"2023-07-09T21:42:25.884050+0000","last_peered":"2023-07-09T21:42:25.884050+0000","last_clean":"2023-07-09T21:42:25.884050+0000","last_became_active":"2023-07-09T21:42:24.322350+0000","last_became_peered":"2023-07-09T21:42:24.322350+0000","last_unstale":"2023-07-09T21:42:25.884050+0000","last_undegraded":"2023-07-09T21:42:25.884050+0000","last_fullsized":"2023-07-09T21:42:25.884050+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:40:06.060013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307504+0000","last_change":"2023-07-09T21:42:24.324461+0000","last_active":"2023-07-09T21:42:25.307504+0000","last_peered":"2023-07-09T21:42:25.307504+0000","last_clean":"2023-07-09T21:42:25.307504+0000","last_became_active":"2023-07-09T21:42:24.323819+0000","last_became_peered":"2023-07-09T21:42:24.323819+0000","last_unstale":"2023-07-09T21:42:25.307504+0000","last_undegraded":"2023-07-09T21:42:25.307504+0000","last_fullsized":"2023-07-09T21:42:25.307504+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:28.031154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542964+0000","last_change":"2023-07-09T21:42:24.329530+0000","last_active":"2023-07-09T21:42:26.542964+0000","last_peered":"2023-07-09T21:42:26.542964+0000","last_clean":"2023-07-09T21:42:26.542964+0000","last_became_active":"2023-07-09T21:42:24.329234+0000","last_became_peered":"2023-07-09T21:42:24.329234+0000","last_unstale":"2023-07-09T21:42:26.542964+0000","last_undegraded":"2023-07-09T21:42:26.542964+0000","last_fullsized":"2023-07-09T21:42:26.542964+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:21:56.524061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883997+0000","last_change":"2023-07-09T21:42:24.312815+0000","last_active":"2023-07-09T21:42:25.883997+0000","last_peered":"2023-07-09T21:42:25.883997+0000","last_clean":"2023-07-09T21:42:25.883997+0000","last_became_active":"2023-07-09T21:42:24.312323+0000","last_became_peered":"2023-07-09T21:42:24.312323+0000","last_unstale":"2023-07-09T21:42:25.883997+0000","last_undegraded":"2023-07-09T21:42:25.883997+0000","last_fullsized":"2023-07-09T21:42:25.883997+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:09:44.223731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543133+0000","last_change":"2023-07-09T21:42:24.308822+0000","last_active":"2023-07-09T21:42:26.543133+0000","last_peered":"2023-07-09T21:42:26.543133+0000","last_clean":"2023-07-09T21:42:26.543133+0000","last_became_active":"2023-07-09T21:42:24.308482+0000","last_became_peered":"2023-07-09T21:42:24.308482+0000","last_unstale":"2023-07-09T21:42:26.543133+0000","last_undegraded":"2023-07-09T21:42:26.543133+0000","last_fullsized":"2023-07-09T21:42:26.543133+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:18.645110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308497+0000","last_change":"2023-07-09T21:42:24.323092+0000","last_active":"2023-07-09T21:42:25.308497+0000","last_peered":"2023-07-09T21:42:25.308497+0000","last_clean":"2023-07-09T21:42:25.308497+0000","last_became_active":"2023-07-09T21:42:24.321280+0000","last_became_peered":"2023-07-09T21:42:24.321280+0000","last_unstale":"2023-07-09T21:42:25.308497+0000","last_undegraded":"2023-07-09T21:42:25.308497+0000","last_fullsized":"2023-07-09T21:42:25.308497+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:55:22.475707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308198+0000","last_change":"2023-07-09T21:42:24.317249+0000","last_active":"2023-07-09T21:42:25.308198+0000","last_peered":"2023-07-09T21:42:25.308198+0000","last_clean":"2023-07-09T21:42:25.308198+0000","last_became_active":"2023-07-09T21:42:24.316970+0000","last_became_peered":"2023-07-09T21:42:24.316970+0000","last_unstale":"2023-07-09T21:42:25.308198+0000","last_undegraded":"2023-07-09T21:42:25.308198+0000","last_fullsized":"2023-07-09T21:42:25.308198+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:44:39.080935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486181+0000","last_change":"2023-07-09T21:42:24.316911+0000","last_active":"2023-07-09T21:42:26.486181+0000","last_peered":"2023-07-09T21:42:26.486181+0000","last_clean":"2023-07-09T21:42:26.486181+0000","last_became_active":"2023-07-09T21:42:24.316642+0000","last_became_peered":"2023-07-09T21:42:24.316642+0000","last_unstale":"2023-07-09T21:42:26.486181+0000","last_undegraded":"2023-07-09T21:42:26.486181+0000","last_fullsized":"2023-07-09T21:42:26.486181+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:39.940264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"143'4","reported_seq":17,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307739+0000","last_change":"2023-07-09T21:42:23.319972+0000","last_active":"2023-07-09T21:42:25.307739+0000","last_peered":"2023-07-09T21:42:25.307739+0000","last_clean":"2023-07-09T21:42:25.307739+0000","last_became_active":"2023-07-09T21:42:23.319687+0000","last_became_peered":"2023-07-09T21:42:23.319687+0000","last_unstale":"2023-07-09T21:42:25.307739+0000","last_undegraded":"2023-07-09T21:42:25.307739+0000","last_fullsized":"2023-07-09T21:42:25.307739+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:56.245115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542599+0000","last_change":"2023-07-09T21:42:24.329695+0000","last_active":"2023-07-09T21:42:26.542599+0000","last_peered":"2023-07-09T21:42:26.542599+0000","last_clean":"2023-07-09T21:42:26.542599+0000","last_became_active":"2023-07-09T21:42:24.329398+0000","last_became_peered":"2023-07-09T21:42:24.329398+0000","last_unstale":"2023-07-09T21:42:26.542599+0000","last_undegraded":"2023-07-09T21:42:26.542599+0000","last_fullsized":"2023-07-09T21:42:26.542599+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:59:54.489026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486465+0000","last_change":"2023-07-09T21:42:23.315824+0000","last_active":"2023-07-09T21:42:26.486465+0000","last_peered":"2023-07-09T21:42:26.486465+0000","last_clean":"2023-07-09T21:42:26.486465+0000","last_became_active":"2023-07-09T21:42:23.315550+0000","last_became_peered":"2023-07-09T21:42:23.315550+0000","last_unstale":"2023-07-09T21:42:26.486465+0000","last_undegraded":"2023-07-09T21:42:26.486465+0000","last_fullsized":"2023-07-09T21:42:26.486465+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:31:34.113245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309395+0000","last_change":"2023-07-09T21:42:24.322646+0000","last_active":"2023-07-09T21:42:25.309395+0000","last_peered":"2023-07-09T21:42:25.309395+0000","last_clean":"2023-07-09T21:42:25.309395+0000","last_became_active":"2023-07-09T21:42:24.322232+0000","last_became_peered":"2023-07-09T21:42:24.322232+0000","last_unstale":"2023-07-09T21:42:25.309395+0000","last_undegraded":"2023-07-09T21:42:25.309395+0000","last_fullsized":"2023-07-09T21:42:25.309395+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:36.657127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281683+0000","last_change":"2023-07-09T21:42:23.319552+0000","last_active":"2023-07-09T21:42:26.281683+0000","last_peered":"2023-07-09T21:42:26.281683+0000","last_clean":"2023-07-09T21:42:26.281683+0000","last_became_active":"2023-07-09T21:42:23.319258+0000","last_became_peered":"2023-07-09T21:42:23.319258+0000","last_unstale":"2023-07-09T21:42:26.281683+0000","last_undegraded":"2023-07-09T21:42:26.281683+0000","last_fullsized":"2023-07-09T21:42:26.281683+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:50:41.780743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.282106+0000","last_change":"2023-07-09T21:42:24.335134+0000","last_active":"2023-07-09T21:42:26.282106+0000","last_peered":"2023-07-09T21:42:26.282106+0000","last_clean":"2023-07-09T21:42:26.282106+0000","last_became_active":"2023-07-09T21:42:24.333956+0000","last_became_peered":"2023-07-09T21:42:24.333956+0000","last_unstale":"2023-07-09T21:42:26.282106+0000","last_undegraded":"2023-07-09T21:42:26.282106+0000","last_fullsized":"2023-07-09T21:42:26.282106+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:13:50.797648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486195+0000","last_change":"2023-07-09T21:42:23.318851+0000","last_active":"2023-07-09T21:42:26.486195+0000","last_peered":"2023-07-09T21:42:26.486195+0000","last_clean":"2023-07-09T21:42:26.486195+0000","last_became_active":"2023-07-09T21:42:23.318580+0000","last_became_peered":"2023-07-09T21:42:23.318580+0000","last_unstale":"2023-07-09T21:42:26.486195+0000","last_undegraded":"2023-07-09T21:42:26.486195+0000","last_fullsized":"2023-07-09T21:42:26.486195+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:15:23.922755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486079+0000","last_change":"2023-07-09T21:42:24.317917+0000","last_active":"2023-07-09T21:42:26.486079+0000","last_peered":"2023-07-09T21:42:26.486079+0000","last_clean":"2023-07-09T21:42:26.486079+0000","last_became_active":"2023-07-09T21:42:24.317630+0000","last_became_peered":"2023-07-09T21:42:24.317630+0000","last_unstale":"2023-07-09T21:42:26.486079+0000","last_undegraded":"2023-07-09T21:42:26.486079+0000","last_fullsized":"2023-07-09T21:42:26.486079+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:10.740041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308724+0000","last_change":"2023-07-09T21:42:23.321154+0000","last_active":"2023-07-09T21:42:25.308724+0000","last_peered":"2023-07-09T21:42:25.308724+0000","last_clean":"2023-07-09T21:42:25.308724+0000","last_became_active":"2023-07-09T21:42:23.320801+0000","last_became_peered":"2023-07-09T21:42:23.320801+0000","last_unstale":"2023-07-09T21:42:25.308724+0000","last_undegraded":"2023-07-09T21:42:25.308724+0000","last_fullsized":"2023-07-09T21:42:25.308724+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308930+0000","last_change":"2023-07-09T21:42:24.323195+0000","last_active":"2023-07-09T21:42:25.308930+0000","last_peered":"2023-07-09T21:42:25.308930+0000","last_clean":"2023-07-09T21:42:25.308930+0000","last_became_active":"2023-07-09T21:42:24.322909+0000","last_became_peered":"2023-07-09T21:42:24.322909+0000","last_unstale":"2023-07-09T21:42:25.308930+0000","last_undegraded":"2023-07-09T21:42:25.308930+0000","last_fullsized":"2023-07-09T21:42:25.308930+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:47:23.088693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543226+0000","last_change":"2023-07-09T21:42:23.320117+0000","last_active":"2023-07-09T21:42:26.543226+0000","last_peered":"2023-07-09T21:42:26.543226+0000","last_clean":"2023-07-09T21:42:26.543226+0000","last_became_active":"2023-07-09T21:42:23.319851+0000","last_became_peered":"2023-07-09T21:42:23.319851+0000","last_unstale":"2023-07-09T21:42:26.543226+0000","last_undegraded":"2023-07-09T21:42:26.543226+0000","last_fullsized":"2023-07-09T21:42:26.543226+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:27:50.856326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543164+0000","last_change":"2023-07-09T21:42:24.322859+0000","last_active":"2023-07-09T21:42:26.543164+0000","last_peered":"2023-07-09T21:42:26.543164+0000","last_clean":"2023-07-09T21:42:26.543164+0000","last_became_active":"2023-07-09T21:42:24.322478+0000","last_became_peered":"2023-07-09T21:42:24.322478+0000","last_unstale":"2023-07-09T21:42:26.543164+0000","last_undegraded":"2023-07-09T21:42:26.543164+0000","last_fullsized":"2023-07-09T21:42:26.543164+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:11:56.330434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308606+0000","last_change":"2023-07-09T21:42:23.312549+0000","last_active":"2023-07-09T21:42:25.308606+0000","last_peered":"2023-07-09T21:42:25.308606+0000","last_clean":"2023-07-09T21:42:25.308606+0000","last_became_active":"2023-07-09T21:42:23.312253+0000","last_became_peered":"2023-07-09T21:42:23.312253+0000","last_unstale":"2023-07-09T21:42:25.308606+0000","last_undegraded":"2023-07-09T21:42:25.308606+0000","last_fullsized":"2023-07-09T21:42:25.308606+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:57:59.972035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486243+0000","last_change":"2023-07-09T21:42:24.319456+0000","last_active":"2023-07-09T21:42:26.486243+0000","last_peered":"2023-07-09T21:42:26.486243+0000","last_clean":"2023-07-09T21:42:26.486243+0000","last_became_active":"2023-07-09T21:42:24.319185+0000","last_became_peered":"2023-07-09T21:42:24.319185+0000","last_unstale":"2023-07-09T21:42:26.486243+0000","last_undegraded":"2023-07-09T21:42:26.486243+0000","last_fullsized":"2023-07-09T21:42:26.486243+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:23:45.817688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542831+0000","last_change":"2023-07-09T21:42:23.318094+0000","last_active":"2023-07-09T21:42:26.542831+0000","last_peered":"2023-07-09T21:42:26.542831+0000","last_clean":"2023-07-09T21:42:26.542831+0000","last_became_active":"2023-07-09T21:42:23.317250+0000","last_became_peered":"2023-07-09T21:42:23.317250+0000","last_unstale":"2023-07-09T21:42:26.542831+0000","last_undegraded":"2023-07-09T21:42:26.542831+0000","last_fullsized":"2023-07-09T21:42:26.542831+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:10:33.929708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308123+0000","last_change":"2023-07-09T21:42:24.323411+0000","last_active":"2023-07-09T21:42:25.308123+0000","last_peered":"2023-07-09T21:42:25.308123+0000","last_clean":"2023-07-09T21:42:25.308123+0000","last_became_active":"2023-07-09T21:42:24.322409+0000","last_became_peered":"2023-07-09T21:42:24.322409+0000","last_unstale":"2023-07-09T21:42:25.308123+0000","last_undegraded":"2023-07-09T21:42:25.308123+0000","last_fullsized":"2023-07-09T21:42:25.308123+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:41:59.423999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486485+0000","last_change":"2023-07-09T21:42:23.321567+0000","last_active":"2023-07-09T21:42:26.486485+0000","last_peered":"2023-07-09T21:42:26.486485+0000","last_clean":"2023-07-09T21:42:26.486485+0000","last_became_active":"2023-07-09T21:42:23.321261+0000","last_became_peered":"2023-07-09T21:42:23.321261+0000","last_unstale":"2023-07-09T21:42:26.486485+0000","last_undegraded":"2023-07-09T21:42:26.486485+0000","last_fullsized":"2023-07-09T21:42:26.486485+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:19:24.490479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308473+0000","last_change":"2023-07-09T21:42:24.315233+0000","last_active":"2023-07-09T21:42:25.308473+0000","last_peered":"2023-07-09T21:42:25.308473+0000","last_clean":"2023-07-09T21:42:25.308473+0000","last_became_active":"2023-07-09T21:42:24.314910+0000","last_became_peered":"2023-07-09T21:42:24.314910+0000","last_unstale":"2023-07-09T21:42:25.308473+0000","last_undegraded":"2023-07-09T21:42:25.308473+0000","last_fullsized":"2023-07-09T21:42:25.308473+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:22.908287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884084+0000","last_change":"2023-07-09T21:42:23.312157+0000","last_active":"2023-07-09T21:42:25.884084+0000","last_peered":"2023-07-09T21:42:25.884084+0000","last_clean":"2023-07-09T21:42:25.884084+0000","last_became_active":"2023-07-09T21:42:23.311856+0000","last_became_peered":"2023-07-09T21:42:23.311856+0000","last_unstale":"2023-07-09T21:42:25.884084+0000","last_undegraded":"2023-07-09T21:42:25.884084+0000","last_fullsized":"2023-07-09T21:42:25.884084+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:26.409487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543438+0000","last_change":"2023-07-09T21:42:24.322714+0000","last_active":"2023-07-09T21:42:26.543438+0000","last_peered":"2023-07-09T21:42:26.543438+0000","last_clean":"2023-07-09T21:42:26.543438+0000","last_became_active":"2023-07-09T21:42:24.322451+0000","last_became_peered":"2023-07-09T21:42:24.322451+0000","last_unstale":"2023-07-09T21:42:26.543438+0000","last_undegraded":"2023-07-09T21:42:26.543438+0000","last_fullsized":"2023-07-09T21:42:26.543438+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:12.019033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"143'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281836+0000","last_change":"2023-07-09T21:42:23.321319+0000","last_active":"2023-07-09T21:42:26.281836+0000","last_peered":"2023-07-09T21:42:26.281836+0000","last_clean":"2023-07-09T21:42:26.281836+0000","last_became_active":"2023-07-09T21:42:23.319622+0000","last_became_peered":"2023-07-09T21:42:23.319622+0000","last_unstale":"2023-07-09T21:42:26.281836+0000","last_undegraded":"2023-07-09T21:42:26.281836+0000","last_fullsized":"2023-07-09T21:42:26.281836+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:59.825456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309811+0000","last_change":"2023-07-09T21:42:24.327694+0000","last_active":"2023-07-09T21:42:25.309811+0000","last_peered":"2023-07-09T21:42:25.309811+0000","last_clean":"2023-07-09T21:42:25.309811+0000","last_became_active":"2023-07-09T21:42:24.326048+0000","last_became_peered":"2023-07-09T21:42:24.326048+0000","last_unstale":"2023-07-09T21:42:25.309811+0000","last_undegraded":"2023-07-09T21:42:25.309811+0000","last_fullsized":"2023-07-09T21:42:25.309811+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:05:31.200474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281691+0000","last_change":"2023-07-09T21:42:23.326843+0000","last_active":"2023-07-09T21:42:26.281691+0000","last_peered":"2023-07-09T21:42:26.281691+0000","last_clean":"2023-07-09T21:42:26.281691+0000","last_became_active":"2023-07-09T21:42:23.326611+0000","last_became_peered":"2023-07-09T21:42:23.326611+0000","last_unstale":"2023-07-09T21:42:26.281691+0000","last_undegraded":"2023-07-09T21:42:26.281691+0000","last_fullsized":"2023-07-09T21:42:26.281691+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:14.646468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542558+0000","last_change":"2023-07-09T21:42:24.322003+0000","last_active":"2023-07-09T21:42:26.542558+0000","last_peered":"2023-07-09T21:42:26.542558+0000","last_clean":"2023-07-09T21:42:26.542558+0000","last_became_active":"2023-07-09T21:42:24.321726+0000","last_became_peered":"2023-07-09T21:42:24.321726+0000","last_unstale":"2023-07-09T21:42:26.542558+0000","last_undegraded":"2023-07-09T21:42:26.542558+0000","last_fullsized":"2023-07-09T21:42:26.542558+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:47:35.681151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542461+0000","last_change":"2023-07-09T21:42:23.316515+0000","last_active":"2023-07-09T21:42:26.542461+0000","last_peered":"2023-07-09T21:42:26.542461+0000","last_clean":"2023-07-09T21:42:26.542461+0000","last_became_active":"2023-07-09T21:42:23.316240+0000","last_became_peered":"2023-07-09T21:42:23.316240+0000","last_unstale":"2023-07-09T21:42:26.542461+0000","last_undegraded":"2023-07-09T21:42:26.542461+0000","last_fullsized":"2023-07-09T21:42:26.542461+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:43:55.887355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542337+0000","last_change":"2023-07-09T21:42:24.318386+0000","last_active":"2023-07-09T21:42:26.542337+0000","last_peered":"2023-07-09T21:42:26.542337+0000","last_clean":"2023-07-09T21:42:26.542337+0000","last_became_active":"2023-07-09T21:42:24.318097+0000","last_became_peered":"2023-07-09T21:42:24.318097+0000","last_unstale":"2023-07-09T21:42:26.542337+0000","last_undegraded":"2023-07-09T21:42:26.542337+0000","last_fullsized":"2023-07-09T21:42:26.542337+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:22.003060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281389+0000","last_change":"2023-07-09T21:42:23.321738+0000","last_active":"2023-07-09T21:42:26.281389+0000","last_peered":"2023-07-09T21:42:26.281389+0000","last_clean":"2023-07-09T21:42:26.281389+0000","last_became_active":"2023-07-09T21:42:23.321449+0000","last_became_peered":"2023-07-09T21:42:23.321449+0000","last_unstale":"2023-07-09T21:42:26.281389+0000","last_undegraded":"2023-07-09T21:42:26.281389+0000","last_fullsized":"2023-07-09T21:42:26.281389+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:18.502643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543284+0000","last_change":"2023-07-09T21:42:24.311433+0000","last_active":"2023-07-09T21:42:26.543284+0000","last_peered":"2023-07-09T21:42:26.543284+0000","last_clean":"2023-07-09T21:42:26.543284+0000","last_became_active":"2023-07-09T21:42:24.310674+0000","last_became_peered":"2023-07-09T21:42:24.310674+0000","last_unstale":"2023-07-09T21:42:26.543284+0000","last_undegraded":"2023-07-09T21:42:26.543284+0000","last_fullsized":"2023-07-09T21:42:26.543284+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:15.988951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542535+0000","last_change":"2023-07-09T21:42:23.322172+0000","last_active":"2023-07-09T21:42:26.542535+0000","last_peered":"2023-07-09T21:42:26.542535+0000","last_clean":"2023-07-09T21:42:26.542535+0000","last_became_active":"2023-07-09T21:42:23.321875+0000","last_became_peered":"2023-07-09T21:42:23.321875+0000","last_unstale":"2023-07-09T21:42:26.542535+0000","last_undegraded":"2023-07-09T21:42:26.542535+0000","last_fullsized":"2023-07-09T21:42:26.542535+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:07:34.263714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308999+0000","last_change":"2023-07-09T21:42:24.316356+0000","last_active":"2023-07-09T21:42:25.308999+0000","last_peered":"2023-07-09T21:42:25.308999+0000","last_clean":"2023-07-09T21:42:25.308999+0000","last_became_active":"2023-07-09T21:42:24.316093+0000","last_became_peered":"2023-07-09T21:42:24.316093+0000","last_unstale":"2023-07-09T21:42:25.308999+0000","last_undegraded":"2023-07-09T21:42:25.308999+0000","last_fullsized":"2023-07-09T21:42:25.308999+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:42:28.903572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281069+0000","last_change":"2023-07-09T21:42:23.319699+0000","last_active":"2023-07-09T21:42:26.281069+0000","last_peered":"2023-07-09T21:42:26.281069+0000","last_clean":"2023-07-09T21:42:26.281069+0000","last_became_active":"2023-07-09T21:42:23.319049+0000","last_became_peered":"2023-07-09T21:42:23.319049+0000","last_unstale":"2023-07-09T21:42:26.281069+0000","last_undegraded":"2023-07-09T21:42:26.281069+0000","last_fullsized":"2023-07-09T21:42:26.281069+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:03:59.024886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543086+0000","last_change":"2023-07-09T21:42:24.328772+0000","last_active":"2023-07-09T21:42:26.543086+0000","last_peered":"2023-07-09T21:42:26.543086+0000","last_clean":"2023-07-09T21:42:26.543086+0000","last_became_active":"2023-07-09T21:42:24.328424+0000","last_became_peered":"2023-07-09T21:42:24.328424+0000","last_unstale":"2023-07-09T21:42:26.543086+0000","last_undegraded":"2023-07-09T21:42:26.543086+0000","last_fullsized":"2023-07-09T21:42:26.543086+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:16.202930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543606+0000","last_change":"2023-07-09T21:42:23.318581+0000","last_active":"2023-07-09T21:42:26.543606+0000","last_peered":"2023-07-09T21:42:26.543606+0000","last_clean":"2023-07-09T21:42:26.543606+0000","last_became_active":"2023-07-09T21:42:23.318274+0000","last_became_peered":"2023-07-09T21:42:23.318274+0000","last_unstale":"2023-07-09T21:42:26.543606+0000","last_undegraded":"2023-07-09T21:42:26.543606+0000","last_fullsized":"2023-07-09T21:42:26.543606+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:11.641391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486207+0000","last_change":"2023-07-09T21:42:24.315715+0000","last_active":"2023-07-09T21:42:26.486207+0000","last_peered":"2023-07-09T21:42:26.486207+0000","last_clean":"2023-07-09T21:42:26.486207+0000","last_became_active":"2023-07-09T21:42:24.315375+0000","last_became_peered":"2023-07-09T21:42:24.315375+0000","last_unstale":"2023-07-09T21:42:26.486207+0000","last_undegraded":"2023-07-09T21:42:26.486207+0000","last_fullsized":"2023-07-09T21:42:26.486207+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:27:34.252902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"144'1","reported_seq":14,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307608+0000","last_change":"2023-07-09T21:42:23.323391+0000","last_active":"2023-07-09T21:42:25.307608+0000","last_peered":"2023-07-09T21:42:25.307608+0000","last_clean":"2023-07-09T21:42:25.307608+0000","last_became_active":"2023-07-09T21:42:23.323092+0000","last_became_peered":"2023-07-09T21:42:23.323092+0000","last_unstale":"2023-07-09T21:42:25.307608+0000","last_undegraded":"2023-07-09T21:42:25.307608+0000","last_fullsized":"2023-07-09T21:42:25.307608+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281750+0000","last_change":"2023-07-09T21:42:24.331450+0000","last_active":"2023-07-09T21:42:26.281750+0000","last_peered":"2023-07-09T21:42:26.281750+0000","last_clean":"2023-07-09T21:42:26.281750+0000","last_became_active":"2023-07-09T21:42:24.331154+0000","last_became_peered":"2023-07-09T21:42:24.331154+0000","last_unstale":"2023-07-09T21:42:26.281750+0000","last_undegraded":"2023-07-09T21:42:26.281750+0000","last_fullsized":"2023-07-09T21:42:26.281750+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:19:12.334847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307507+0000","last_change":"2023-07-09T21:42:23.323134+0000","last_active":"2023-07-09T21:42:25.307507+0000","last_peered":"2023-07-09T21:42:25.307507+0000","last_clean":"2023-07-09T21:42:25.307507+0000","last_became_active":"2023-07-09T21:42:23.322812+0000","last_became_peered":"2023-07-09T21:42:23.322812+0000","last_unstale":"2023-07-09T21:42:25.307507+0000","last_undegraded":"2023-07-09T21:42:25.307507+0000","last_fullsized":"2023-07-09T21:42:25.307507+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:16.831595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.884083+0000","last_change":"2023-07-09T21:42:24.323623+0000","last_active":"2023-07-09T21:42:25.884083+0000","last_peered":"2023-07-09T21:42:25.884083+0000","last_clean":"2023-07-09T21:42:25.884083+0000","last_became_active":"2023-07-09T21:42:24.323353+0000","last_became_peered":"2023-07-09T21:42:24.323353+0000","last_unstale":"2023-07-09T21:42:25.884083+0000","last_undegraded":"2023-07-09T21:42:25.884083+0000","last_fullsized":"2023-07-09T21:42:25.884083+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:37:06.878932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543256+0000","last_change":"2023-07-09T21:42:23.319083+0000","last_active":"2023-07-09T21:42:26.543256+0000","last_peered":"2023-07-09T21:42:26.543256+0000","last_clean":"2023-07-09T21:42:26.543256+0000","last_became_active":"2023-07-09T21:42:23.318700+0000","last_became_peered":"2023-07-09T21:42:23.318700+0000","last_unstale":"2023-07-09T21:42:26.543256+0000","last_undegraded":"2023-07-09T21:42:26.543256+0000","last_fullsized":"2023-07-09T21:42:26.543256+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:10:51.915381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542707+0000","last_change":"2023-07-09T21:42:24.317731+0000","last_active":"2023-07-09T21:42:26.542707+0000","last_peered":"2023-07-09T21:42:26.542707+0000","last_clean":"2023-07-09T21:42:26.542707+0000","last_became_active":"2023-07-09T21:42:24.317346+0000","last_became_peered":"2023-07-09T21:42:24.317346+0000","last_unstale":"2023-07-09T21:42:26.542707+0000","last_undegraded":"2023-07-09T21:42:26.542707+0000","last_fullsized":"2023-07-09T21:42:26.542707+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:11.810995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308725+0000","last_change":"2023-07-09T21:42:23.319864+0000","last_active":"2023-07-09T21:42:25.308725+0000","last_peered":"2023-07-09T21:42:25.308725+0000","last_clean":"2023-07-09T21:42:25.308725+0000","last_became_active":"2023-07-09T21:42:23.319564+0000","last_became_peered":"2023-07-09T21:42:23.319564+0000","last_unstale":"2023-07-09T21:42:25.308725+0000","last_undegraded":"2023-07-09T21:42:25.308725+0000","last_fullsized":"2023-07-09T21:42:25.308725+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:13:05.649702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542422+0000","last_change":"2023-07-09T21:42:24.319093+0000","last_active":"2023-07-09T21:42:26.542422+0000","last_peered":"2023-07-09T21:42:26.542422+0000","last_clean":"2023-07-09T21:42:26.542422+0000","last_became_active":"2023-07-09T21:42:24.318812+0000","last_became_peered":"2023-07-09T21:42:24.318812+0000","last_unstale":"2023-07-09T21:42:26.542422+0000","last_undegraded":"2023-07-09T21:42:26.542422+0000","last_fullsized":"2023-07-09T21:42:26.542422+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:30:17.613420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308557+0000","last_change":"2023-07-09T21:42:23.317172+0000","last_active":"2023-07-09T21:42:25.308557+0000","last_peered":"2023-07-09T21:42:25.308557+0000","last_clean":"2023-07-09T21:42:25.308557+0000","last_became_active":"2023-07-09T21:42:23.316822+0000","last_became_peered":"2023-07-09T21:42:23.316822+0000","last_unstale":"2023-07-09T21:42:25.308557+0000","last_undegraded":"2023-07-09T21:42:25.308557+0000","last_fullsized":"2023-07-09T21:42:25.308557+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:27.023592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281235+0000","last_change":"2023-07-09T21:42:24.336909+0000","last_active":"2023-07-09T21:42:26.281235+0000","last_peered":"2023-07-09T21:42:26.281235+0000","last_clean":"2023-07-09T21:42:26.281235+0000","last_became_active":"2023-07-09T21:42:24.336603+0000","last_became_peered":"2023-07-09T21:42:24.336603+0000","last_unstale":"2023-07-09T21:42:26.281235+0000","last_undegraded":"2023-07-09T21:42:26.281235+0000","last_fullsized":"2023-07-09T21:42:26.281235+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:24:16.593371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542923+0000","last_change":"2023-07-09T21:42:23.317406+0000","last_active":"2023-07-09T21:42:26.542923+0000","last_peered":"2023-07-09T21:42:26.542923+0000","last_clean":"2023-07-09T21:42:26.542923+0000","last_became_active":"2023-07-09T21:42:23.317101+0000","last_became_peered":"2023-07-09T21:42:23.317101+0000","last_unstale":"2023-07-09T21:42:26.542923+0000","last_undegraded":"2023-07-09T21:42:26.542923+0000","last_fullsized":"2023-07-09T21:42:26.542923+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:45:48.775989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486333+0000","last_change":"2023-07-09T21:42:24.331382+0000","last_active":"2023-07-09T21:42:26.486333+0000","last_peered":"2023-07-09T21:42:26.486333+0000","last_clean":"2023-07-09T21:42:26.486333+0000","last_became_active":"2023-07-09T21:42:24.331074+0000","last_became_peered":"2023-07-09T21:42:24.331074+0000","last_unstale":"2023-07-09T21:42:26.486333+0000","last_undegraded":"2023-07-09T21:42:26.486333+0000","last_fullsized":"2023-07-09T21:42:26.486333+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:35.356014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281072+0000","last_change":"2023-07-09T21:42:23.317720+0000","last_active":"2023-07-09T21:42:26.281072+0000","last_peered":"2023-07-09T21:42:26.281072+0000","last_clean":"2023-07-09T21:42:26.281072+0000","last_became_active":"2023-07-09T21:42:23.317450+0000","last_became_peered":"2023-07-09T21:42:23.317450+0000","last_unstale":"2023-07-09T21:42:26.281072+0000","last_undegraded":"2023-07-09T21:42:26.281072+0000","last_fullsized":"2023-07-09T21:42:26.281072+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:12:25.172628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281789+0000","last_change":"2023-07-09T21:42:24.334558+0000","last_active":"2023-07-09T21:42:26.281789+0000","last_peered":"2023-07-09T21:42:26.281789+0000","last_clean":"2023-07-09T21:42:26.281789+0000","last_became_active":"2023-07-09T21:42:24.334267+0000","last_became_peered":"2023-07-09T21:42:24.334267+0000","last_unstale":"2023-07-09T21:42:26.281789+0000","last_undegraded":"2023-07-09T21:42:26.281789+0000","last_fullsized":"2023-07-09T21:42:26.281789+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:49.940493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"143'8","reported_seq":21,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542361+0000","last_change":"2023-07-09T21:42:23.317380+0000","last_active":"2023-07-09T21:42:26.542361+0000","last_peered":"2023-07-09T21:42:26.542361+0000","last_clean":"2023-07-09T21:42:26.542361+0000","last_became_active":"2023-07-09T21:42:23.317089+0000","last_became_peered":"2023-07-09T21:42:23.317089+0000","last_unstale":"2023-07-09T21:42:26.542361+0000","last_undegraded":"2023-07-09T21:42:26.542361+0000","last_fullsized":"2023-07-09T21:42:26.542361+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:55:01.871859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"131'249","reported_seq":860,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281454+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:42:26.281454+0000","last_peered":"2023-07-09T21:42:26.281454+0000","last_clean":"2023-07-09T21:42:26.281454+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:42:26.281454+0000","last_undegraded":"2023-07-09T21:42:26.281454+0000","last_fullsized":"2023-07-09T21:42:26.281454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:06:56.510743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":270,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309108+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:42:25.309108+0000","last_peered":"2023-07-09T21:42:25.309108+0000","last_clean":"2023-07-09T21:42:25.309108+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:42:25.309108+0000","last_undegraded":"2023-07-09T21:42:25.309108+0000","last_fullsized":"2023-07-09T21:42:25.309108+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:54:45.538792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307349+0000","last_change":"2023-07-09T21:42:24.324636+0000","last_active":"2023-07-09T21:42:25.307349+0000","last_peered":"2023-07-09T21:42:25.307349+0000","last_clean":"2023-07-09T21:42:25.307349+0000","last_became_active":"2023-07-09T21:42:24.324383+0000","last_became_peered":"2023-07-09T21:42:24.324383+0000","last_unstale":"2023-07-09T21:42:25.307349+0000","last_undegraded":"2023-07-09T21:42:25.307349+0000","last_fullsized":"2023-07-09T21:42:25.307349+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:55.675283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"143'2","reported_seq":15,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543348+0000","last_change":"2023-07-09T21:42:23.315778+0000","last_active":"2023-07-09T21:42:26.543348+0000","last_peered":"2023-07-09T21:42:26.543348+0000","last_clean":"2023-07-09T21:42:26.543348+0000","last_became_active":"2023-07-09T21:42:23.315455+0000","last_became_peered":"2023-07-09T21:42:23.315455+0000","last_unstale":"2023-07-09T21:42:26.543348+0000","last_undegraded":"2023-07-09T21:42:26.543348+0000","last_fullsized":"2023-07-09T21:42:26.543348+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:18.916955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281398+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:42:26.281398+0000","last_peered":"2023-07-09T21:42:26.281398+0000","last_clean":"2023-07-09T21:42:26.281398+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:42:26.281398+0000","last_undegraded":"2023-07-09T21:42:26.281398+0000","last_fullsized":"2023-07-09T21:42:26.281398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:08:27.824598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486051+0000","last_change":"2023-07-09T21:42:24.330451+0000","last_active":"2023-07-09T21:42:26.486051+0000","last_peered":"2023-07-09T21:42:26.486051+0000","last_clean":"2023-07-09T21:42:26.486051+0000","last_became_active":"2023-07-09T21:42:24.329921+0000","last_became_peered":"2023-07-09T21:42:24.329921+0000","last_unstale":"2023-07-09T21:42:26.486051+0000","last_undegraded":"2023-07-09T21:42:26.486051+0000","last_fullsized":"2023-07-09T21:42:26.486051+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:29:44.068474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543307+0000","last_change":"2023-07-09T21:42:23.316498+0000","last_active":"2023-07-09T21:42:26.543307+0000","last_peered":"2023-07-09T21:42:26.543307+0000","last_clean":"2023-07-09T21:42:26.543307+0000","last_became_active":"2023-07-09T21:42:23.316189+0000","last_became_peered":"2023-07-09T21:42:23.316189+0000","last_unstale":"2023-07-09T21:42:26.543307+0000","last_undegraded":"2023-07-09T21:42:26.543307+0000","last_fullsized":"2023-07-09T21:42:26.543307+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:30:27.558671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":230,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883774+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:42:25.883774+0000","last_peered":"2023-07-09T21:42:25.883774+0000","last_clean":"2023-07-09T21:42:25.883774+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:42:25.883774+0000","last_undegraded":"2023-07-09T21:42:25.883774+0000","last_fullsized":"2023-07-09T21:42:25.883774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:00:15.496526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.883824+0000","last_change":"2023-07-09T21:42:24.312092+0000","last_active":"2023-07-09T21:42:25.883824+0000","last_peered":"2023-07-09T21:42:25.883824+0000","last_clean":"2023-07-09T21:42:25.883824+0000","last_became_active":"2023-07-09T21:42:24.311806+0000","last_became_peered":"2023-07-09T21:42:24.311806+0000","last_unstale":"2023-07-09T21:42:25.883824+0000","last_undegraded":"2023-07-09T21:42:25.883824+0000","last_fullsized":"2023-07-09T21:42:25.883824+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:45.194271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542455+0000","last_change":"2023-07-09T21:42:23.316447+0000","last_active":"2023-07-09T21:42:26.542455+0000","last_peered":"2023-07-09T21:42:26.542455+0000","last_clean":"2023-07-09T21:42:26.542455+0000","last_became_active":"2023-07-09T21:42:23.316152+0000","last_became_peered":"2023-07-09T21:42:23.316152+0000","last_unstale":"2023-07-09T21:42:26.542455+0000","last_undegraded":"2023-07-09T21:42:26.542455+0000","last_fullsized":"2023-07-09T21:42:26.542455+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:53:20.620357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":270,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.308852+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:42:25.308852+0000","last_peered":"2023-07-09T21:42:25.308852+0000","last_clean":"2023-07-09T21:42:25.308852+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:42:25.308852+0000","last_undegraded":"2023-07-09T21:42:25.308852+0000","last_fullsized":"2023-07-09T21:42:25.308852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:34.432158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307157+0000","last_change":"2023-07-09T21:42:24.322986+0000","last_active":"2023-07-09T21:42:25.307157+0000","last_peered":"2023-07-09T21:42:25.307157+0000","last_clean":"2023-07-09T21:42:25.307157+0000","last_became_active":"2023-07-09T21:42:24.322654+0000","last_became_peered":"2023-07-09T21:42:24.322654+0000","last_unstale":"2023-07-09T21:42:25.307157+0000","last_undegraded":"2023-07-09T21:42:25.307157+0000","last_fullsized":"2023-07-09T21:42:25.307157+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:03.427737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307912+0000","last_change":"2023-07-09T21:42:23.323352+0000","last_active":"2023-07-09T21:42:25.307912+0000","last_peered":"2023-07-09T21:42:25.307912+0000","last_clean":"2023-07-09T21:42:25.307912+0000","last_became_active":"2023-07-09T21:42:23.322924+0000","last_became_peered":"2023-07-09T21:42:23.322924+0000","last_unstale":"2023-07-09T21:42:25.307912+0000","last_undegraded":"2023-07-09T21:42:25.307912+0000","last_fullsized":"2023-07-09T21:42:25.307912+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:34:32.196969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":226,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.486301+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:42:26.486301+0000","last_peered":"2023-07-09T21:42:26.486301+0000","last_clean":"2023-07-09T21:42:26.486301+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:42:26.486301+0000","last_undegraded":"2023-07-09T21:42:26.486301+0000","last_fullsized":"2023-07-09T21:42:26.486301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309632+0000","last_change":"2023-07-09T21:42:24.321965+0000","last_active":"2023-07-09T21:42:25.309632+0000","last_peered":"2023-07-09T21:42:25.309632+0000","last_clean":"2023-07-09T21:42:25.309632+0000","last_became_active":"2023-07-09T21:42:24.321646+0000","last_became_peered":"2023-07-09T21:42:24.321646+0000","last_unstale":"2023-07-09T21:42:25.309632+0000","last_undegraded":"2023-07-09T21:42:25.309632+0000","last_fullsized":"2023-07-09T21:42:25.309632+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:06:36.777487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309475+0000","last_change":"2023-07-09T21:42:23.318436+0000","last_active":"2023-07-09T21:42:25.309475+0000","last_peered":"2023-07-09T21:42:25.309475+0000","last_clean":"2023-07-09T21:42:25.309475+0000","last_became_active":"2023-07-09T21:42:23.318133+0000","last_became_peered":"2023-07-09T21:42:23.318133+0000","last_unstale":"2023-07-09T21:42:25.309475+0000","last_undegraded":"2023-07-09T21:42:25.309475+0000","last_fullsized":"2023-07-09T21:42:25.309475+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:52:24.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":236,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.281880+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:42:26.281880+0000","last_peered":"2023-07-09T21:42:26.281880+0000","last_clean":"2023-07-09T21:42:26.281880+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:42:26.281880+0000","last_undegraded":"2023-07-09T21:42:26.281880+0000","last_fullsized":"2023-07-09T21:42:26.281880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:16.416144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.543690+0000","last_change":"2023-07-09T21:42:24.311018+0000","last_active":"2023-07-09T21:42:26.543690+0000","last_peered":"2023-07-09T21:42:26.543690+0000","last_clean":"2023-07-09T21:42:26.543690+0000","last_became_active":"2023-07-09T21:42:24.310650+0000","last_became_peered":"2023-07-09T21:42:24.310650+0000","last_unstale":"2023-07-09T21:42:26.543690+0000","last_undegraded":"2023-07-09T21:42:26.543690+0000","last_fullsized":"2023-07-09T21:42:26.543690+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:03.100035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"143'3","reported_seq":16,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309468+0000","last_change":"2023-07-09T21:42:23.317942+0000","last_active":"2023-07-09T21:42:25.309468+0000","last_peered":"2023-07-09T21:42:25.309468+0000","last_clean":"2023-07-09T21:42:25.309468+0000","last_became_active":"2023-07-09T21:42:23.317646+0000","last_became_peered":"2023-07-09T21:42:23.317646+0000","last_unstale":"2023-07-09T21:42:25.309468+0000","last_undegraded":"2023-07-09T21:42:25.309468+0000","last_fullsized":"2023-07-09T21:42:25.309468+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:55:51.766273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":228,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.485896+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:42:26.485896+0000","last_peered":"2023-07-09T21:42:26.485896+0000","last_clean":"2023-07-09T21:42:26.485896+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:42:26.485896+0000","last_undegraded":"2023-07-09T21:42:26.485896+0000","last_fullsized":"2023-07-09T21:42:26.485896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:58.734204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.309722+0000","last_change":"2023-07-09T21:42:24.325666+0000","last_active":"2023-07-09T21:42:25.309722+0000","last_peered":"2023-07-09T21:42:25.309722+0000","last_clean":"2023-07-09T21:42:25.309722+0000","last_became_active":"2023-07-09T21:42:24.321581+0000","last_became_peered":"2023-07-09T21:42:24.321581+0000","last_unstale":"2023-07-09T21:42:25.309722+0000","last_undegraded":"2023-07-09T21:42:25.309722+0000","last_fullsized":"2023-07-09T21:42:25.309722+0000","mapping_epoch":142,"log_start":"0'0","ondisk_log_start":"0'0","created":142,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:23.283408+0000","last_clean_scrub_stamp":"2023-07-09T21:42:23.283408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:56.739441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"143'6","reported_seq":19,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:26.542924+0000","last_change":"2023-07-09T21:42:23.317308+0000","last_active":"2023-07-09T21:42:26.542924+0000","last_peered":"2023-07-09T21:42:26.542924+0000","last_clean":"2023-07-09T21:42:26.542924+0000","last_became_active":"2023-07-09T21:42:23.316951+0000","last_became_peered":"2023-07-09T21:42:23.316951+0000","last_unstale":"2023-07-09T21:42:26.542924+0000","last_undegraded":"2023-07-09T21:42:26.542924+0000","last_fullsized":"2023-07-09T21:42:26.542924+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":141,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:42:22.275847+0000","last_clean_scrub_stamp":"2023-07-09T21:42:22.275847+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:35:21.353584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":234,"reported_epoch":144,"state":"active+clean","last_fresh":"2023-07-09T21:42:25.307888+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:42:25.307888+0000","last_peered":"2023-07-09T21:42:25.307888+0000","last_clean":"2023-07-09T21:42:25.307888+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:42:25.307888+0000","last_undegraded":"2023-07-09T21:42:25.307888+0000","last_fullsized":"2023-07-09T21:42:25.307888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:27:24.578992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1268,"num_read_kb":2572,"num_write":399,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":249,"ondisk_log_size":249,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575088,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59628,"kb_used_data":2340,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312212,"statfs":{"total":96636764160,"available":96575705088,"internally_reserved":0,"allocated":2396160,"data_stored":1500968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69299999999999995,"15min":0.70899999999999996},"min":{"1min":0.40500000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":1.03,"15min":1.03},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.74299999999999999,"15min":0.72999999999999998},"min":{"1min":0.52300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.97299999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.66600000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.72599999999999998,"15min":0.72999999999999998},"min":{"1min":0.46000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.98999999999999999,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.753,"15min":0.73799999999999999},"min":{"1min":0.41099999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.006,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.76900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.39000000000000001},"max":{"1min":1.0389999999999999,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73399999999999999,"15min":0.73599999999999999},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.41899999999999998},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.80300000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.754},"min":{"1min":0.59099999999999997,"5min":0.51500000000000001,"15min":0.48599999999999999},"max":{"1min":0.95199999999999996,"5min":1.754,"15min":1.754},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76700000000000002,"15min":0.78200000000000003},"min":{"1min":0.61299999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.02,"5min":1.1140000000000001,"15min":1.129},"last":0.753}]},{"osd":4,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.86399999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61099999999999999,"15min":0.60399999999999998},"min":{"1min":0.44500000000000001,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.88500000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.82999999999999996}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.38,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":1.0109999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.67100000000000004,"15min":0.66000000000000003},"min":{"1min":0.46400000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.91800000000000004,"5min":1.232,"15min":1.232},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70999999999999996,"15min":0.71099999999999997},"min":{"1min":0.56399999999999995,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.84899999999999998,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.68000000000000005,"15min":0.67300000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.90300000000000002,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.72899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575087,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36892,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334948,"statfs":{"total":96636764160,"available":96598986752,"internally_reserved":0,"allocated":1789952,"data_stored":910406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.70099999999999996},"min":{"1min":0.45900000000000002,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.95399999999999996,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.437,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.94099999999999995,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.75,"15min":0.751},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":0.91800000000000004,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.54000000000000004,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.93799999999999994,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.73699999999999999,"15min":0.74399999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97499999999999998,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.78500000000000003,"15min":0.76600000000000001},"min":{"1min":0.55500000000000005,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.98499999999999999,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.60299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.752,"15min":0.76000000000000001},"min":{"1min":0.54000000000000004,"5min":0.53200000000000003,"15min":0.48699999999999999},"max":{"1min":0.99099999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.76000000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.98899999999999999,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.73999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.68899999999999995,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.88400000000000001,"5min":6.101,"15min":6.101},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.72999999999999998,"15min":0.64800000000000002},"min":{"1min":0.503,"5min":0.42399999999999999,"15min":0.32500000000000001},"max":{"1min":0.86699999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.53600000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.72099999999999997,"15min":0.65700000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88200000000000001,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.72399999999999998,"15min":0.66700000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.92300000000000004,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.75,"15min":0.69799999999999995},"min":{"1min":0.55700000000000005,"5min":0.46000000000000002,"15min":0.38300000000000001},"max":{"1min":0.93799999999999994,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.80300000000000005,"15min":0.72699999999999998},"min":{"1min":0.53100000000000003,"5min":0.52300000000000002,"15min":0.44600000000000001},"max":{"1min":0.96999999999999997,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.82899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575086,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50848,"kb_used_data":1752,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320992,"statfs":{"total":96636764160,"available":96584695808,"internally_reserved":0,"allocated":1794048,"data_stored":909984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70199999999999996,"15min":0.70399999999999996},"min":{"1min":0.48599999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70899999999999996},"min":{"1min":0.505,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.98099999999999998,"5min":1.006,"15min":1.006},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.73599999999999999,"15min":0.73499999999999999},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.90400000000000003,"5min":0.96099999999999997,"15min":1.0409999999999999},"last":0.874},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.39700000000000002},"max":{"1min":0.89600000000000002,"5min":0.95299999999999996,"15min":1.02},"last":0.53000000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75800000000000001,"15min":0.73499999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.95999999999999996,"5min":0.99299999999999999,"15min":0.999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.71099999999999997,"15min":0.71799999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.63}]},{"osd":3,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.73799999999999999,"15min":0.73899999999999999},"min":{"1min":0.54700000000000004,"5min":0.44500000000000001,"15min":0.42399999999999999},"max":{"1min":0.88300000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.75700000000000001,"15min":0.747},"min":{"1min":0.56299999999999994,"5min":0.48899999999999999,"15min":0.47799999999999998},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.78100000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58399999999999996,"15min":0.56799999999999995},"min":{"1min":0.434,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.63,"15min":0.61599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.82799999999999996,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.73699999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.442,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.86899999999999999,"5min":1.083,"15min":1.083},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65100000000000002,"15min":0.64200000000000002},"min":{"1min":0.41099999999999998,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.84699999999999998,"5min":1.0249999999999999,"15min":1.038},"last":0.81299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:41:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.69199999999999995,"15min":0.67800000000000005},"min":{"1min":0.501,"5min":0.46300000000000002,"15min":0.34399999999999997},"max":{"1min":0.88200000000000001,"5min":1.107,"15min":1.107},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70899999999999996,"15min":0.69399999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.85799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575088,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32804,"kb_used_data":1756,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339036,"statfs":{"total":96636764160,"available":96603172864,"internally_reserved":0,"allocated":1798144,"data_stored":911388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.69499999999999995,"15min":0.71599999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.96899999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68200000000000005,"15min":0.70099999999999996},"min":{"1min":0.44,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.84899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69299999999999995,"15min":0.72199999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.84699999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.72899999999999998},"min":{"1min":0.46400000000000002,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.083,"15min":1.083},"last":0.75}]},{"osd":2,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72099999999999997,"15min":0.73799999999999999},"min":{"1min":0.56200000000000006,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.93700000000000006,"5min":0.95999999999999996,"15min":1.0069999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74099999999999999,"15min":0.749},"min":{"1min":0.53300000000000003,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.88900000000000001,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.89700000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71199999999999997,"15min":0.72899999999999998},"min":{"1min":0.499,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.95299999999999996,"5min":1.002,"15min":1.26},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.51600000000000001,"5min":0.51300000000000001,"15min":0.45800000000000002},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.05},"last":0.879}]},{"osd":5,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.59499999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60799999999999998,"15min":0.59899999999999998},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.85799999999999998,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.61599999999999999,"15min":0.61199999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.68000000000000005,"15min":0.66700000000000004},"min":{"1min":0.44500000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.93000000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:01 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66600000000000004,"15min":0.65800000000000003},"min":{"1min":0.45900000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.88600000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72499999999999998,"15min":0.70199999999999996},"min":{"1min":0.53500000000000003,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.89500000000000002,"5min":1.097,"15min":1.097},"last":0.83399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834575087,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36904,"kb_used_data":1760,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334936,"statfs":{"total":96636764160,"available":96598974464,"internally_reserved":0,"allocated":1802240,"data_stored":911422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.47099999999999997},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70999999999999996,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.53500000000000003},"min":{"1min":0.36499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68400000000000005,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.40500000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45000000000000001,"15min":0.46700000000000003},"min":{"1min":0.32200000000000001,"5min":0.307,"15min":0.29399999999999998},"max":{"1min":0.67000000000000004,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.318},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78600000000000003,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.58099999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33700000000000002},"max":{"1min":0.80700000000000005,"5min":1.101,"15min":1.101},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.63200000000000001},"min":{"1min":0.45600000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.84499999999999997,"5min":1.024,"15min":1.024},"last":0.499}]},{"osd":4,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.76300000000000001,"15min":0.77700000000000002},"min":{"1min":0.52800000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.111,"5min":1.111,"15min":1.3320000000000001},"last":0.622},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.57399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.095,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79200000000000004,"15min":0.81499999999999995},"min":{"1min":0.61199999999999999,"5min":0.55100000000000005,"15min":0.54500000000000004},"max":{"1min":1.0449999999999999,"5min":1.127,"15min":1.3109999999999999},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.79800000000000004},"min":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0409999999999999,"15min":1.208},"last":0.65600000000000003}]},{"osd":6,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.76300000000000001,"15min":0.77800000000000002},"min":{"1min":0.59199999999999997,"5min":0.502,"15min":0.48399999999999999},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.51},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.75,"15min":0.76500000000000001},"min":{"1min":0.59699999999999998,"5min":0.48499999999999999,"15min":0.46800000000000003},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:41:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77200000000000002,"15min":0.78900000000000003},"min":{"1min":0.59399999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0629999999999999,"5min":1.083,"15min":1.127},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76900000000000002,"15min":0.78800000000000003},"min":{"1min":0.55100000000000005,"5min":0.53900000000000003,"15min":0.53400000000000003},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.57799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575088,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54936,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316904,"statfs":{"total":96636764160,"available":96580509696,"internally_reserved":0,"allocated":1785856,"data_stored":909824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.45300000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.376},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.50600000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.437}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":0.66600000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.753},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":0.68899999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575088,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32796,"kb_used_data":1748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339044,"statfs":{"total":96636764160,"available":96603181056,"internally_reserved":0,"allocated":1789952,"data_stored":909846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.436,"15min":0.45000000000000001},"min":{"1min":0.29799999999999999,"5min":0.251,"15min":0.251},"max":{"1min":0.64700000000000002,"5min":0.67800000000000005,"15min":0.76800000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48699999999999999,"15min":0.502},"min":{"1min":0.34499999999999997,"5min":0.32100000000000001,"15min":0.32000000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.33600000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.32400000000000001,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.41799999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.96999999999999997},"last":0.46999999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.58999999999999997},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.77500000000000002,"5min":1.0129999999999999,"15min":1.3069999999999999},"last":0.443},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.54700000000000004},"min":{"1min":0.40600000000000003,"5min":0.373,"15min":0.34899999999999998},"max":{"1min":0.80500000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.38200000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.1060000000000001,"5min":1.129,"15min":1.3069999999999999},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.78200000000000003,"15min":0.80700000000000005},"min":{"1min":0.57899999999999996,"5min":0.47599999999999998,"15min":0.443},"max":{"1min":1.085,"5min":1.085,"15min":1.274},"last":0.68500000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.351},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.78500000000000003,"15min":0.79500000000000004},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.0169999999999999,"5min":1.1160000000000001,"15min":1.242},"last":0.64800000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.62,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.2,"5min":1.2,"15min":1.206},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.81200000000000006,"15min":0.81399999999999995},"min":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1699999999999999,"15min":1.3799999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:41:55 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.77500000000000002,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.012,"5min":1.107,"15min":1.173},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.79800000000000004,"15min":0.81299999999999994},"min":{"1min":0.60899999999999999,"5min":0.54600000000000004,"15min":0.54300000000000004},"max":{"1min":1.137,"5min":1.1899999999999999,"15min":1.4119999999999999},"last":0.61799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575088,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37472,"kb_used_data":2328,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334368,"statfs":{"total":96636764160,"available":96598392832,"internally_reserved":0,"allocated":2383872,"data_stored":1500214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47999999999999998,"15min":0.47699999999999998},"min":{"1min":0.28299999999999997,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.753},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55900000000000005,"15min":0.55400000000000005},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.70299999999999996,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.629}]},{"osd":2,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51900000000000002,"15min":0.52600000000000002},"min":{"1min":0.35099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69999999999999996,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41499999999999998,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.77200000000000002,"5min":1.657,"15min":1.657},"last":0.73999999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.78700000000000003,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.70199999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.79700000000000004,"15min":0.80400000000000005},"min":{"1min":0.57099999999999995,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":1.087,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.79100000000000004,"15min":0.79400000000000004},"min":{"1min":0.59999999999999998,"5min":0.55100000000000005,"15min":0.42299999999999999},"max":{"1min":0.88700000000000001,"5min":1.835,"15min":1.835},"last":0.72199999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.78800000000000003,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":1.0629999999999999,"5min":1.726,"15min":1.726},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.99399999999999999,"5min":1.615,"15min":1.615},"last":0.83099999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.52900000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.111,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.80400000000000005,"15min":0.81999999999999995},"min":{"1min":0.58799999999999997,"5min":0.57399999999999995,"15min":0.52200000000000002},"max":{"1min":1.1220000000000001,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:41:51 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.58299999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":1.1439999999999999,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.60799999999999998,"5min":0.53300000000000003,"15min":0.48799999999999999},"max":{"1min":1.008,"5min":1.883,"15min":1.883},"last":0.69299999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:42:33.391 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:42:33.391 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:42:33.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.572+0000 7f150fe48640 1 Processor -- start 2023-07-09T21:42:33.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 -- start start 2023-07-09T21:42:33.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15080b7980 0x7f1508160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15080d0780 0x7f15080d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150815bf80 con 0x7f15080ceb80 2023-07-09T21:42:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080cd070 con 0x7f15080d0780 2023-07-09T21:42:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150fe48640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080cfd70 con 0x7f15080b7980 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150e3e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f15080d0780 0x7f15080d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150d3e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f15080ceb80 0x7f15080cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37806/0 (socket says 172.21.15.37:37806) 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150d3e3640 1 -- 172.21.15.37:0/2534938614 learned_addr learned my addr 172.21.15.37:0/2534938614 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150dbe4640 1 --2- 172.21.15.37:0/2534938614 >> v2:172.21.15.119:3300/0 conn(0x7f15080b7980 0x7f1508160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150e3e5640 1 -- 172.21.15.37:0/2534938614 >> v2:172.21.15.119:3300/0 conn(0x7f15080b7980 msgr2=0x7f1508160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150e3e5640 1 --2- 172.21.15.37:0/2534938614 >> v2:172.21.15.119:3300/0 conn(0x7f15080b7980 0x7f1508160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150e3e5640 1 -- 172.21.15.37:0/2534938614 >> v1:172.21.15.37:6789/0 conn(0x7f15080ceb80 legacy=0x7f15080cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150e3e5640 1 -- 172.21.15.37:0/2534938614 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508160570 con 0x7f15080d0780 2023-07-09T21:42:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.576+0000 7f150cbe2640 1 -- 172.21.15.37:0/2534938614 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597123469 0 0) 0x7f14f8001120 con 0x7f15080ceb80 2023-07-09T21:42:33.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150e3e5640 1 --2- 172.21.15.37:0/2534938614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080d0780 0x7f15080d0b80 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1508069aa0 tx=0x7f150001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1566db54d1f83d2d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150cbe2640 1 -- 172.21.15.37:0/2534938614 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000a57d0 con 0x7f15080d0780 2023-07-09T21:42:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150cbe2640 1 -- 172.21.15.37:0/2534938614 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000a5930 con 0x7f15080d0780 2023-07-09T21:42:33.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150cbe2640 1 -- 172.21.15.37:0/2534938614 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000a5cc0 con 0x7f15080d0780 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- 172.21.15.37:0/2534938614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080d0780 msgr2=0x7f15080d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 --2- 172.21.15.37:0/2534938614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080d0780 0x7f15080d0b80 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f1508069aa0 tx=0x7f150001c910 comp rx=0 tx=0).stop 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- 172.21.15.37:0/2534938614 shutdown_connections 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 --2- 172.21.15.37:0/2534938614 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080d0780 0x7f15080d0b80 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 --2- 172.21.15.37:0/2534938614 >> v2:172.21.15.119:3300/0 conn(0x7f15080b7980 0x7f1508160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- 172.21.15.37:0/2534938614 >> 172.21.15.37:0/2534938614 conn(0x7f1508073090 msgr2=0x7f1508069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- 172.21.15.37:0/2534938614 shutdown_connections 2023-07-09T21:42:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- 172.21.15.37:0/2534938614 wait complete. 2023-07-09T21:42:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 Processor -- start 2023-07-09T21:42:33.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.580+0000 7f150fe48640 1 -- start start 2023-07-09T21:42:33.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 0x7f15080c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 0x7f1508150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150815e8a0 con 0x7f15080ceb80 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150815eb80 con 0x7f15080d0780 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1508159890 con 0x7f15080b7980 2023-07-09T21:42:33.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39732/0 (socket says 172.21.15.37:39732) 2023-07-09T21:42:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 -- 172.21.15.37:0/2381209547 learned_addr learned my addr 172.21.15.37:0/2381209547 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 -- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 msgr2=0x7f15080c8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150dbe4640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 0x7f15080c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150e3e5640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 0x7f1508150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 0x7f15080c8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 -- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 msgr2=0x7f1508150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 0x7f1508150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 -- 172.21.15.37:0/2381209547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009a70 con 0x7f15080ceb80 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150dbe4640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 0x7f15080c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150e3e5640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 0x7f1508150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150d3e3640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c780 tx=0x7f14f800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f80072d0 con 0x7f15080ceb80 2023-07-09T21:42:33.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8007450 con 0x7f15080ceb80 2023-07-09T21:42:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f80047f0 con 0x7f15080ceb80 2023-07-09T21:42:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1508159b70 con 0x7f15080ceb80 2023-07-09T21:42:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150815ee60 con 0x7f15080ceb80 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.584+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150815a090 con 0x7f15080ceb80 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.588+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14f8004950 con 0x7f15080ceb80 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.588+0000 7f14fe7fc640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 0x7f14ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.588+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f14f8083070 con 0x7f15080ceb80 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.588+0000 7f150dbe4640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 0x7f14ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.588+0000 7f150dbe4640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 0x7f14ec068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1504009ae0 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.592+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14f80b3700 con 0x7f15080ceb80 2023-07-09T21:42:33.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.800+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f150815bf80 con 0x7f15080ceb80 2023-07-09T21:42:33.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.804+0000 7f14fe7fc640 1 -- 172.21.15.37:0/2381209547 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+147 (secure 0 0 0) 0x7f150815bf80 con 0x7f15080ceb80 2023-07-09T21:42:33.805 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:42:33.805 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:42:33.805 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:42:33.806 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:42:33.806 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:42:33.806 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.804+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 msgr2=0x7f14ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.804+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 0x7f14ec068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1504009ae0 tx=0x7f1504008040 comp rx=0 tx=0).stop 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.804+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 msgr2=0x7f15080c6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.804+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f14f800c780 tx=0x7f14f800cc40 comp rx=0 tx=0).stop 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 shutdown_connections 2023-07-09T21:42:33.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f14ec0663a0 0x7f14ec068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15080d0780 0x7f1508150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15080ceb80 0x7f15080c6820 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 --2- 172.21.15.37:0/2381209547 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15080b7980 0x7f15080c8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 >> 172.21.15.37:0/2381209547 conn(0x7f1508073090 msgr2=0x7f150815c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:33.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 shutdown_connections 2023-07-09T21:42:33.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.808+0000 7f150fe48640 1 -- 172.21.15.37:0/2381209547 wait complete. 2023-07-09T21:42:33.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.968+0000 7f36a1fe9640 1 Processor -- start 2023-07-09T21:42:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.968+0000 7f36a1fe9640 1 -- start start 2023-07-09T21:42:33.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f36a1fe9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f369c0b7ab0 0x7f369c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f36a1fe9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c0b49f0 con 0x7f369c0cef80 2023-07-09T21:42:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f36a1fe9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369c0cc8a0 con 0x7f369c0b4340 2023-07-09T21:42:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f36a1fe9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369c0b7e80 con 0x7f369c0b7ab0 2023-07-09T21:42:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f369c0cef80 0x7f369c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37810/0 (socket says 172.21.15.37:37810) 2023-07-09T21:42:33.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 -- 172.21.15.37:0/1609478451 learned_addr learned my addr 172.21.15.37:0/1609478451 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369b7fe640 1 --2- 172.21.15.37:0/1609478451 >> v2:172.21.15.119:3300/0 conn(0x7f369c0b7ab0 0x7f369c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036333807 0 0) 0x7f369c0b49f0 con 0x7f369c0cef80 2023-07-09T21:42:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3684003530 con 0x7f369c0cef80 2023-07-09T21:42:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584182732 0 0) 0x7f369c0cc8a0 con 0x7f369c0b4340 2023-07-09T21:42:33.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f369c0b49f0 con 0x7f369c0b4340 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1106578190 0 0) 0x7f3684003530 con 0x7f369c0cef80 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 >> v2:172.21.15.119:3300/0 conn(0x7f369c0b7ab0 msgr2=0x7f369c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 --2- 172.21.15.37:0/1609478451 >> v2:172.21.15.119:3300/0 conn(0x7f369c0b7ab0 0x7f369c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 >> v1:172.21.15.119:6789/0 conn(0x7f369c0b4340 legacy=0x7f369c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0ccb80 con 0x7f369c0cef80 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3690001680 con 0x7f369c0cef80 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 >> v1:172.21.15.37:6789/0 conn(0x7f369c0cef80 legacy=0x7f369c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3684003b10 0x7f3684003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 0x7f3684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3684005180 0x7f368400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400bfb0 con 0x7f36840047d0 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c120 con 0x7f3684005180 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f368400c2e0 con 0x7f3684003b10 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 0x7f3684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369b7fe640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3684003b10 0x7f3684003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369bfff640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3684005180 0x7f368400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 -- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3684003b10 msgr2=0x7f3684003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3684003b10 0x7f3684003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 -- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3684005180 msgr2=0x7f368400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3684005180 0x7f368400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369affd640 1 -- 172.21.15.37:0/1609478451 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684003530 con 0x7f36840047d0 2023-07-09T21:42:33.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.972+0000 7f369bfff640 1 -- 172.21.15.37:0/1609478451 reap_dead start 2023-07-09T21:42:33.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f369affd640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 0x7f3684004c40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f369c06af90 tx=0x7f369001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d299a35f7f17b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900058e0 con 0x7f36840047d0 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690005a40 con 0x7f36840047d0 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f369a7fc640 1 -- 172.21.15.37:0/1609478451 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690005e50 con 0x7f36840047d0 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 -- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 msgr2=0x7f3684004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 0x7f3684004c40 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f369c06af90 tx=0x7f369001cb80 comp rx=0 tx=0).stop 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 -- 172.21.15.37:0/1609478451 shutdown_connections 2023-07-09T21:42:33.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/1609478451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36840047d0 0x7f3684004c40 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 -- 172.21.15.37:0/1609478451 >> 172.21.15.37:0/1609478451 conn(0x7f369c073090 msgr2=0x7f369c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 -- 172.21.15.37:0/1609478451 shutdown_connections 2023-07-09T21:42:33.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.976+0000 7f36a1fe9640 1 -- 172.21.15.37:0/1609478451 wait complete. 2023-07-09T21:42:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 Processor -- start 2023-07-09T21:42:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- start start 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36840047d0 0x7f369c1449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f369c0c9280 0x7f369c15df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0cc560 con 0x7f369c15e4d0 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0cbbc0 con 0x7f36840047d0 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369c0cbea0 con 0x7f369c0c9280 2023-07-09T21:42:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39754/0 (socket says 172.21.15.37:39754) 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 -- 172.21.15.37:0/525233161 learned_addr learned my addr 172.21.15.37:0/525233161 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369b7fe640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36840047d0 0x7f369c1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369affd640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f369c0c9280 0x7f369c15df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 -- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f369c0c9280 msgr2=0x7f369c15df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f369c0c9280 0x7f369c15df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 -- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36840047d0 msgr2=0x7f369c1449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:33.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36840047d0 0x7f369c1449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 -- 172.21.15.37:0/525233161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0cc180 con 0x7f369c15e4d0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f369bfff640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f36940059b0 tx=0x7f3694012870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940153e0 con 0x7f369c15e4d0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694015540 con 0x7f369c15e4d0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940158f0 con 0x7f369c15e4d0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369c0c9ab0 con 0x7f369c15e4d0 2023-07-09T21:42:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.980+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369c144330 con 0x7f369c15e4d0 2023-07-09T21:42:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369c153040 con 0x7f369c15e4d0 2023-07-09T21:42:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3694015a50 con 0x7f369c15e4d0 2023-07-09T21:42:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f3683fff640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 0x7f3688068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:33.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f36940861a0 con 0x7f369c15e4d0 2023-07-09T21:42:33.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f369b7fe640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 0x7f3688068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:33.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.984+0000 7f369b7fe640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 0x7f3688068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f369c04eae0 tx=0x7f368c009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:33.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:33.988+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f369c153040 con 0x7f369c15e4d0 2023-07-09T21:42:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.176+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f369c153040 con 0x7f369c15e4d0 2023-07-09T21:42:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.176+0000 7f3683fff640 1 -- 172.21.15.37:0/525233161 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f369c153040 con 0x7f369c15e4d0 2023-07-09T21:42:34.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:34.178 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:34.179 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:34.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 msgr2=0x7f3688068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 0x7f3688068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f369c04eae0 tx=0x7f368c009190 comp rx=0 tx=0).stop 2023-07-09T21:42:34.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 msgr2=0x7f369c143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f36940059b0 tx=0x7f3694012870 comp rx=0 tx=0).stop 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 shutdown_connections 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f36880663d0 0x7f3688068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f369c15e4d0 0x7f369c143df0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f369c0c9280 0x7f369c15df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 --2- 172.21.15.37:0/525233161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f36840047d0 0x7f369c1449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 >> 172.21.15.37:0/525233161 conn(0x7f369c073090 msgr2=0x7f369c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 shutdown_connections 2023-07-09T21:42:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.180+0000 7f36a1fe9640 1 -- 172.21.15.37:0/525233161 wait complete. 2023-07-09T21:42:34.601 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:42:23.692818+0000', 'modified': '2023-07-09T21:42:27.322156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8994}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8994': {'gid': 8994, 'name': 'a', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/723012105', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 723012105}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 723012105}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:42:34.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:42:34.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T21:42:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.748+0000 7f376baec640 1 Processor -- start 2023-07-09T21:42:34.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.748+0000 7f376baec640 1 -- start start 2023-07-09T21:42:34.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376baec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f376406d010 0x7f376406fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376baec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376406afa0 con 0x7f3764159830 2023-07-09T21:42:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376baec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376406b280 con 0x7f3764070bb0 2023-07-09T21:42:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376baec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3764070000 con 0x7f376406d010 2023-07-09T21:42:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3764159830 0x7f376406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37814/0 (socket says 172.21.15.37:37814) 2023-07-09T21:42:34.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 -- 172.21.15.37:0/1908835194 learned_addr learned my addr 172.21.15.37:0/1908835194 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712849699 0 0) 0x7f376406afa0 con 0x7f3764159830 2023-07-09T21:42:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3750003530 con 0x7f3764159830 2023-07-09T21:42:34.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769087640 1 --2- 172.21.15.37:0/1908835194 >> v2:172.21.15.119:3300/0 conn(0x7f376406d010 0x7f376406fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1325746533 0 0) 0x7f3750003530 con 0x7f3764159830 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 >> v2:172.21.15.119:3300/0 conn(0x7f376406d010 msgr2=0x7f376406fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 --2- 172.21.15.37:0/1908835194 >> v2:172.21.15.119:3300/0 conn(0x7f376406d010 0x7f376406fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 >> v1:172.21.15.119:6789/0 conn(0x7f3764070bb0 legacy=0x7f37640cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376406b560 con 0x7f3764159830 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f3760001800 con 0x7f3764159830 2023-07-09T21:42:34.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 >> v1:172.21.15.37:6789/0 conn(0x7f3764159830 legacy=0x7f376406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f3750003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37500047d0 0x7f3750004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3750005180 0x7f375000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764070000 con 0x7f3750003980 2023-07-09T21:42:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375000c110 con 0x7f37500047d0 2023-07-09T21:42:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375000c2d0 con 0x7f3750005180 2023-07-09T21:42:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f3750003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769087640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37500047d0 0x7f3750004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376a089640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3750005180 0x7f375000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 -- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3750005180 msgr2=0x7f375000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3750005180 0x7f375000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 -- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37500047d0 msgr2=0x7f3750004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37500047d0 0x7f3750004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769888640 1 -- 172.21.15.37:0/1908835194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3750003530 con 0x7f3750003980 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f3769087640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f37500047d0 0x7f3750004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:34.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.752+0000 7f376a089640 1 -- 172.21.15.37:0/1908835194 reap_dead start 2023-07-09T21:42:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f3769888640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f3750003d90 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f376000c210 tx=0x7f376001cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b780c65cf0bdb74d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600a5b40 con 0x7f3750003980 2023-07-09T21:42:34.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600a5cc0 con 0x7f3750003980 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f3768886640 1 -- 172.21.15.37:0/1908835194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600072b0 con 0x7f3750003980 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 -- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 msgr2=0x7f3750003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f3750003d90 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f376000c210 tx=0x7f376001cbb0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 -- 172.21.15.37:0/1908835194 shutdown_connections 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 --2- 172.21.15.37:0/1908835194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f3750003d90 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 -- 172.21.15.37:0/1908835194 >> 172.21.15.37:0/1908835194 conn(0x7f37640694c0 msgr2=0x7f37640698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 -- 172.21.15.37:0/1908835194 shutdown_connections 2023-07-09T21:42:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 -- 172.21.15.37:0/1908835194 wait complete. 2023-07-09T21:42:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.756+0000 7f376baec640 1 Processor -- start 2023-07-09T21:42:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- start start 2023-07-09T21:42:34.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 0x7f37640b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 0x7f376414d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764159c00 con 0x7f3750003980 2023-07-09T21:42:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37641f4b10 con 0x7f376414ca00 2023-07-09T21:42:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3764159de0 con 0x7f3764154f30 2023-07-09T21:42:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39758/0 (socket says 172.21.15.37:39758) 2023-07-09T21:42:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 -- 172.21.15.37:0/1101171186 learned_addr learned my addr 172.21.15.37:0/1101171186 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376a089640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 0x7f376414d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769087640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 0x7f37640b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 -- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 msgr2=0x7f37640b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 0x7f37640b1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 -- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 msgr2=0x7f376414d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 0x7f376414d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 -- 172.21.15.37:0/1101171186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376415a0c0 con 0x7f3750003980 2023-07-09T21:42:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769087640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 0x7f37640b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:34.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376a089640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 0x7f376414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f3769888640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f376000c210 tx=0x7f3750005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f375a7fc640 1 -- 172.21.15.37:0/1101171186 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600b3070 con 0x7f3750003980 2023-07-09T21:42:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f375a7fc640 1 -- 172.21.15.37:0/1101171186 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600a5940 con 0x7f3750003980 2023-07-09T21:42:34.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f375a7fc640 1 -- 172.21.15.37:0/1101171186 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600015c0 con 0x7f3750003980 2023-07-09T21:42:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376415a3a0 con 0x7f3750003980 2023-07-09T21:42:34.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.760+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640b1da0 con 0x7f3750003980 2023-07-09T21:42:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f375a7fc640 1 -- 172.21.15.37:0/1101171186 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f37600aeae0 con 0x7f3750003980 2023-07-09T21:42:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f375a7fc640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 0x7f3748068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f375a7fc640 1 -- 172.21.15.37:0/1101171186 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f376011db50 con 0x7f3750003980 2023-07-09T21:42:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 Processor -- start 2023-07-09T21:42:34.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 0x7f3748068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 -- start start 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 0x7f3748068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3764154ec0 tx=0x7f3754008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f2878bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f282f360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f26f5f80 con 0x55c6f2879110 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f262fc60 con 0x55c6f282ef90 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2683700 con 0x55c6f2878800 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39764/0 (socket says 172.21.15.37:39764) 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 -- 172.21.15.37:0/2626410911 learned_addr learned my addr 172.21.15.37:0/2626410911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f376a089640 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f282f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769888640 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f2878bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 -- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 msgr2=0x55c6f2878bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f2878bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 -- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 msgr2=0x55c6f282f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f282f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.764+0000 7f3769087640 1 -- 172.21.15.37:0/2626410911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f2378890 con 0x55c6f2879110 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f37540119e0 tx=0x7f3754014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92365df2160a2cc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f37477fe640 1 -- 172.21.15.37:0/2626410911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540159c0 con 0x55c6f2879110 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f37477fe640 1 -- 172.21.15.37:0/2626410911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754015b20 con 0x55c6f2879110 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f37477fe640 1 -- 172.21.15.37:0/2626410911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754015e90 con 0x55c6f2879110 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- 172.21.15.37:0/2626410911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 msgr2=0x55c6f282ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f37540119e0 tx=0x7f3754014000 comp rx=0 tx=0).stop 2023-07-09T21:42:34.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- 172.21.15.37:0/2626410911 shutdown_connections 2023-07-09T21:42:34.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f282f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2879110 0x55c6f282ea50 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2626410911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f2878bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- 172.21.15.37:0/2626410911 >> 172.21.15.37:0/2626410911 conn(0x55c6f26f1a70 msgr2=0x55c6f282d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- 172.21.15.37:0/2626410911 shutdown_connections 2023-07-09T21:42:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- 172.21.15.37:0/2626410911 wait complete. 2023-07-09T21:42:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- start start 2023-07-09T21:42:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 Processor -- start 2023-07-09T21:42:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f2839be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f283a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f267c7a0 con 0x55c6f2878800 2023-07-09T21:42:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2638f00 con 0x55c6f282ef90 2023-07-09T21:42:34.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2638ba0 con 0x55c6f2879110 2023-07-09T21:42:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376ee5d000 10 client.0 _ll_register_callbacks cb 0x55c6f281a930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:42:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39772/0 (socket says 172.21.15.37:39772) 2023-07-09T21:42:34.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 -- 172.21.15.37:0/764267474 learned_addr learned my addr 172.21.15.37:0/764267474 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376a089640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f283a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769888640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f2839be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 -- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 msgr2=0x55c6f283a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f283a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 -- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 msgr2=0x55c6f2839be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f2839be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f3769087640 1 -- 172.21.15.37:0/764267474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375400e040 con 0x55c6f2878800 2023-07-09T21:42:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.768+0000 7f376a089640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f283a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3769087640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3754022000 tx=0x7f37540046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee57b2a9c5ca281c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:42:34.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3754005bb0 con 0x55c6f2878800 2023-07-09T21:42:34.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6f267b0f0 con 0x55c6f2878800 2023-07-09T21:42:34.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3754005d10 con 0x55c6f2878800 2023-07-09T21:42:34.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3754006030 con 0x55c6f2878800 2023-07-09T21:42:34.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 10 client.9168 fetch_fsmap learned FSMap version 62 2023-07-09T21:42:34.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55c6f2641130 con 0x55c6f2878800 2023-07-09T21:42:34.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f267b0f0 con 0x55c6f2878800 2023-07-09T21:42:34.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3754006190 con 0x55c6f2878800 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 10 client.9168 fetch_fsmap finished waiting for FSMap version 62 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 10 client.9168 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 20 client.9168 populate_metadata read hostname 'smithi037' 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2887870 0x55c6f2889c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 4 client.9168 mds_command: new command op to 8994 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 --> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6f2643e40 con 0x55c6f2887870 2023-07-09T21:42:34.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3769888640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2887870 0x55c6f2889c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 10 client.9168 ms_handle_connect on v2:172.21.15.37:6834/723012105 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3769888640 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2887870 0x55c6f2889c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=548d1bbba5fc5406 server_cookie=c0ff84dd8add16fc in_seq=0 out_seq=0 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 1 -- 172.21.15.37:0/764267474 <== mds.0 v2:172.21.15.37:6834/723012105 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c6f2643e40 con 0x55c6f2887870 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 10 client.9168 handle_command_reply: tid=0 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 client.9168 shutdown 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 msgr2=0x55c6f283a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f3754022000 tx=0x7f37540046d0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 shutdown_connections 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2887870 0x55c6f2889c50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f283a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f283a120 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f3744ff9640 0 client.9168 ms_handle_reset on v2:172.21.15.37:6834/723012105 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 --2- 172.21.15.37:0/764267474 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f2839be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 >> 172.21.15.37:0/764267474 conn(0x55c6f26f1a70 msgr2=0x55c6f282da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 shutdown_connections 2023-07-09T21:42:34.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 1 -- 172.21.15.37:0/764267474 wait complete. 2023-07-09T21:42:34.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.772+0000 7f376ee5d000 20 client.9168 trim_cache size 0 max 16384 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 Processor -- start 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 -- start start 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f288b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f2879110 0x55c6f28735c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2339940 con 0x55c6f282ef90 2023-07-09T21:42:34.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2831d60 con 0x55c6f2879110 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6f264b230 con 0x55c6f2878800 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f3769888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f3769888640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39776/0 (socket says 172.21.15.37:39776) 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.788+0000 7f3769888640 1 -- 172.21.15.37:0/2961167264 learned_addr learned my addr 172.21.15.37:0/2961167264 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769087640 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f288b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376a089640 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f2879110 0x55c6f28735c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 -- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 msgr2=0x55c6f288b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f288b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 -- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f2879110 msgr2=0x55c6f28735c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f2879110 0x55c6f28735c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 -- 172.21.15.37:0/2961167264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f26273c0 con 0x55c6f282ef90 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f37600eb050 tx=0x7f37600eae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad1703a0cfadb2c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3747fff640 1 -- 172.21.15.37:0/2961167264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600aed90 con 0x55c6f282ef90 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3747fff640 1 -- 172.21.15.37:0/2961167264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760106070 con 0x55c6f282ef90 2023-07-09T21:42:34.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3747fff640 1 -- 172.21.15.37:0/2961167264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760007ce0 con 0x55c6f282ef90 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- 172.21.15.37:0/2961167264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 msgr2=0x55c6f288b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f37600eb050 tx=0x7f37600eae90 comp rx=0 tx=0).stop 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- 172.21.15.37:0/2961167264 shutdown_connections 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f2879110 0x55c6f28735c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2878800 0x55c6f288b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- 172.21.15.37:0/2961167264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f282ef90 0x55c6f288b370 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- 172.21.15.37:0/2961167264 >> 172.21.15.37:0/2961167264 conn(0x55c6f26f1a70 msgr2=0x55c6f2889c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- 172.21.15.37:0/2961167264 shutdown_connections 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- 172.21.15.37:0/2961167264 wait complete. 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- start start 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 Processor -- start 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f28d5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f2876220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f267f300 con 0x55c6f2878800 2023-07-09T21:42:34.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2619ea0 con 0x55c6f282ef90 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c6f2676c80 con 0x55c6f2879110 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376ee5d000 10 client.0 _ll_register_callbacks cb 0x55c6f27fb4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769087640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39790/0 (socket says 172.21.15.37:39790) 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769087640 1 -- 172.21.15.37:0/116980068 learned_addr learned my addr 172.21.15.37:0/116980068 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f3769888640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f28d5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.792+0000 7f376a089640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f2876220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 -- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 msgr2=0x55c6f2876220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f2876220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 -- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 msgr2=0x55c6f28d5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f28d5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 -- 172.21.15.37:0/116980068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37640b1da0 con 0x55c6f2878800 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769087640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f3754021910 tx=0x7f3754017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf6914597a051bd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:42:34.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540041c0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6f28328c0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f37540066a0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3754015cd0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 10 client.9174 fetch_fsmap learned FSMap version 62 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x55c6f2378cc0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c6f28328c0 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3754021950 con 0x55c6f2878800 2023-07-09T21:42:34.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 10 client.9174 fetch_fsmap finished waiting for FSMap version 62 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 10 client.9174 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 20 client.9174 populate_metadata read hostname 'smithi037' 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2876bb0 0x55c6f2876f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 4 client.9174 mds_command: new command op to 8994 tid=0[{"prefix": "status"}] 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 --> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c6f26356f0 con 0x55c6f2876bb0 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769888640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2876bb0 0x55c6f2876f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3769888640 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2876bb0 0x55c6f2876f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c0f72c60432ddab server_cookie=c59de7916d27bfc1 in_seq=0 out_seq=0 2023-07-09T21:42:34.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 10 client.9174 ms_handle_connect on v2:172.21.15.37:6834/723012105 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 1 -- 172.21.15.37:0/116980068 <== mds.0 v2:172.21.15.37:6834/723012105 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c6f26356f0 con 0x55c6f2876bb0 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 10 client.9174 handle_command_reply: tid=0 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 client.9174 shutdown 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 msgr2=0x55c6f28d6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f3754021910 tx=0x7f3754017000 comp rx=0 tx=0).stop 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 shutdown_connections 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:6834/723012105,v1:172.21.15.37:6835/723012105] conn(0x55c6f2876bb0 0x55c6f2876f80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c6f2879110 0x55c6f2876220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c6f2878800 0x55c6f28d6430 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 --2- 172.21.15.37:0/116980068 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c6f282ef90 0x55c6f28d5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f3744ff9640 0 client.9174 ms_handle_reset on v2:172.21.15.37:6834/723012105 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 >> 172.21.15.37:0/116980068 conn(0x55c6f26f1a70 msgr2=0x55c6f288a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 shutdown_connections 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 1 -- 172.21.15.37:0/116980068 wait complete. 2023-07-09T21:42:34.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376ee5d000 20 client.9174 trim_cache size 0 max 16384 2023-07-09T21:42:34.809 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:42:34.809 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:42:34.809 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:42:34.809 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 8994, 2023-07-09T21:42:34.809 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.485410971, 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 62, 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 144, 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 144, 2023-07-09T21:42:34.810 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.421059661000001 2023-07-09T21:42:34.811 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:42:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 msgr2=0x7f3748068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 0x7f3748068880 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3764154ec0 tx=0x7f3754008040 comp rx=0 tx=0).stop 2023-07-09T21:42:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 msgr2=0x7f37641f45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f376000c210 tx=0x7f3750005800 comp rx=0 tx=0).stop 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 shutdown_connections 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f37480663d0 0x7f3748068880 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f376414ca00 0x7f376414d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3764154f30 0x7f37640b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 --2- 172.21.15.37:0/1101171186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3750003980 0x7f37641f45d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 >> 172.21.15.37:0/1101171186 conn(0x7f37640694c0 msgr2=0x7f37640afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 shutdown_connections 2023-07-09T21:42:34.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.796+0000 7f376baec640 1 -- 172.21.15.37:0/1101171186 wait complete. 2023-07-09T21:42:34.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:42:34.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 Processor -- start 2023-07-09T21:42:34.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 -- start start 2023-07-09T21:42:34.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa4900b7ab0 0x7fa49006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 0x7fa4900b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4900b49f0 con 0x7fa4900b4170 2023-07-09T21:42:34.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4900b7e80 con 0x7fa4900b7ab0 2023-07-09T21:42:34.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa4951ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900b4610 con 0x7fa4900cef80 2023-07-09T21:42:34.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa48f59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4900b4170 0x7fa49015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37826/0 (socket says 172.21.15.37:37826) 2023-07-09T21:42:34.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa48f59e640 1 -- 172.21.15.37:0/1980069656 learned_addr learned my addr 172.21.15.37:0/1980069656 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:34.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa487fff640 1 --2- 172.21.15.37:0/1980069656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 0x7fa4900b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.960+0000 7fa48ed9d640 1 --2- 172.21.15.37:0/1980069656 >> v2:172.21.15.119:3300/0 conn(0x7fa4900b7ab0 0x7fa49006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa48e59c640 1 -- 172.21.15.37:0/1980069656 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482052933 0 0) 0x7fa4900b49f0 con 0x7fa4900b4170 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa48e59c640 1 -- 172.21.15.37:0/1980069656 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa47c003530 con 0x7fa4900b4170 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa487fff640 1 -- 172.21.15.37:0/1980069656 >> v2:172.21.15.119:3300/0 conn(0x7fa4900b7ab0 msgr2=0x7fa49006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa487fff640 1 --2- 172.21.15.37:0/1980069656 >> v2:172.21.15.119:3300/0 conn(0x7fa4900b7ab0 0x7fa49006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa487fff640 1 -- 172.21.15.37:0/1980069656 >> v1:172.21.15.37:6789/0 conn(0x7fa4900b4170 legacy=0x7fa49015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa487fff640 1 -- 172.21.15.37:0/1980069656 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900cc8a0 con 0x7fa4900cef80 2023-07-09T21:42:34.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa487fff640 1 --2- 172.21.15.37:0/1980069656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 0x7fa4900b3c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa4780097c0 tx=0x7fa47801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858850a35aad0ca1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa48e59c640 1 -- 172.21.15.37:0/1980069656 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780ab650 con 0x7fa4900cef80 2023-07-09T21:42:34.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa48e59c640 1 -- 172.21.15.37:0/1980069656 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780ab7b0 con 0x7fa4900cef80 2023-07-09T21:42:34.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.964+0000 7fa48e59c640 1 -- 172.21.15.37:0/1980069656 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780abb40 con 0x7fa4900cef80 2023-07-09T21:42:34.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- 172.21.15.37:0/1980069656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 msgr2=0x7fa4900b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- 172.21.15.37:0/1980069656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 0x7fa4900b3c30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa4780097c0 tx=0x7fa47801c450 comp rx=0 tx=0).stop 2023-07-09T21:42:34.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- 172.21.15.37:0/1980069656 shutdown_connections 2023-07-09T21:42:34.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- 172.21.15.37:0/1980069656 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900cef80 0x7fa4900b3c30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- 172.21.15.37:0/1980069656 >> v2:172.21.15.119:3300/0 conn(0x7fa4900b7ab0 0x7fa49006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- 172.21.15.37:0/1980069656 >> 172.21.15.37:0/1980069656 conn(0x7fa490073090 msgr2=0x7fa490069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:34.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- 172.21.15.37:0/1980069656 shutdown_connections 2023-07-09T21:42:34.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- 172.21.15.37:0/1980069656 wait complete. 2023-07-09T21:42:34.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 Processor -- start 2023-07-09T21:42:34.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- start start 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 0x7fa4900cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4900cef80 0x7fa4901552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c6d30 con 0x7fa4900b7ab0 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c72f0 con 0x7fa4900cef80 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa4951ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900ca6e0 con 0x7fa4900b4170 2023-07-09T21:42:34.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39798/0 (socket says 172.21.15.37:39798) 2023-07-09T21:42:34.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 -- 172.21.15.37:0/2316769929 learned_addr learned my addr 172.21.15.37:0/2316769929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa48ed9d640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 0x7fa4900cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa48f59e640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4900cef80 0x7fa4901552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 -- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 msgr2=0x7fa4900cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 0x7fa4900cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 -- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4900cef80 msgr2=0x7fa4901552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4900cef80 0x7fa4901552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa487fff640 1 -- 172.21.15.37:0/2316769929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa478009420 con 0x7fa4900b7ab0 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.968+0000 7fa48ed9d640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 0x7fa4900cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa487fff640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa47801ab00 tx=0x7fa4780191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780abdf0 con 0x7fa4900b7ab0 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4780bf450 con 0x7fa4900b7ab0 2023-07-09T21:42:34.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4780bf7e0 con 0x7fa4900b7ab0 2023-07-09T21:42:34.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4900ca9c0 con 0x7fa4900b7ab0 2023-07-09T21:42:34.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4900cb0c0 con 0x7fa4900b7ab0 2023-07-09T21:42:34.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4900cb250 con 0x7fa4900b7ab0 2023-07-09T21:42:34.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa4780bf940 con 0x7fa4900b7ab0 2023-07-09T21:42:34.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 0x7fa470068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:34.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fa47811e830 con 0x7fa4900b7ab0 2023-07-09T21:42:34.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.972+0000 7fa48ed9d640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 0x7fa470068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:34.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.976+0000 7fa48ed9d640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 0x7fa470068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa480009bb0 tx=0x7fa480008040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:34.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:34.976+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa4780ebae0 con 0x7fa4900b7ab0 2023-07-09T21:42:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4900c7480 con 0x7fa4900b7ab0 2023-07-09T21:42:35.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4877fe640 1 -- 172.21.15.37:0/2316769929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa4780ef100 con 0x7fa4900b7ab0 2023-07-09T21:42:35.164 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 msgr2=0x7fa470068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 0x7fa470068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa480009bb0 tx=0x7fa480008040 comp rx=0 tx=0).stop 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 msgr2=0x7fa4900c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7fa47801ab00 tx=0x7fa4780191f0 comp rx=0 tx=0).stop 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 shutdown_connections 2023-07-09T21:42:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa4700663a0 0x7fa470068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4900cef80 0x7fa4901552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4900b7ab0 0x7fa4900c9c90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 --2- 172.21.15.37:0/2316769929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4900b4170 0x7fa4900cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 >> 172.21.15.37:0/2316769929 conn(0x7fa490073090 msgr2=0x7fa490158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 shutdown_connections 2023-07-09T21:42:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:35.164+0000 7fa4951ac640 1 -- 172.21.15.37:0/2316769929 wait complete. 2023-07-09T21:42:35.185 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:42:35.186 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:42:35.186 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:42:35.186 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:42:35.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:35.187 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:42:35.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:42:35.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:42:35.187 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:42:35.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.188 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:42:35.198 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:42:35.199 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41248sec preferred_lft 41248sec 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:42:35.201 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.202 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:42:35.203 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:42:35.204 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:42:35.204 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:42:35.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.204 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:42:35.261 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:42:35.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.265 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:42:35.316 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:42:35.316 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:42:35.317 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:42:35.317 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:42:35.317 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:42:35.317 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:42:35.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:42:35.319 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:42:35.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:42:35.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:42:35.321 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:42:35.322 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:42:35.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.412 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:42:35.423 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:42:35.424 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:42:35.425 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:42:35.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:42:35.489 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:42:35.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:42:35.490 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:35.539 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:42:35.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:42:35.540 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:35.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:42:35.655 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:42:35.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:42:35.718 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:42:35.720 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:42:35.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.721 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:42:35.771 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:42:35.772 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:42:35.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:42:35.840 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:42:35.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:42:35.902 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:42:35.904 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:42:35.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:35.905 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:42:35.915 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:42:35.916+0000 7fedf67fc580 -1 init, newargv = 0x5641dce3b2d0 newargc=15 2023-07-09T21:42:35.916 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[61252]: starting ceph client 2023-07-09T21:42:35.923 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[61252]: starting fuse 2023-07-09T21:42:35.925 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:42:35.926 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:42:35.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:42:35.927 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:42:35.927 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:42:35.928 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:42:35.928 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:42:35.928 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:42:35.929 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:42:35.929 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:42:35.929 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:42:35.930 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:42:35.931 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:42:35.931 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:42:35.932 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:42:35.932 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:42:35.932 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:42:35.933 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:42:35.933 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:42:35.934 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:42:35.935 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:42:35.936 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:42:35.936 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:42:35.937 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:42:35.938 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:42:35.939 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:42:35.940 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:42:35.941 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:42:35.942 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:42:36.053 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.61252.asok 2023-07-09T21:42:36.237 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61252.asok 2023-07-09T21:42:36.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:36.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61252.asok status 2023-07-09T21:42:36.422 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:42:36.423 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "61252", 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9189, 2023-07-09T21:42:36.424 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 9189 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:42:36.425 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3752503026 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3752503026 2023-07-09T21:42:36.426 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:42:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.9189 192.168.0.1:0/3752503026", 2023-07-09T21:42:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3752503026", 2023-07-09T21:42:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:42:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 62, 2023-07-09T21:42:36.427 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 144, 2023-07-09T21:42:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:42:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:42:36.428 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:42:36.428 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:42:36.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:36.438 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:42:36.438 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:36.450 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:42:36.450 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:36.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:36.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:36.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:42:36.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.704+0000 7f424d91f640 1 Processor -- start 2023-07-09T21:42:36.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.704+0000 7f424d91f640 1 -- start start 2023-07-09T21:42:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f424d91f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f42480cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f424d91f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42480b4310 0x7f42480d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f424d91f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42480cef80 con 0x7f42480b47a0 2023-07-09T21:42:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f424d91f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480cf260 con 0x7f42480b4310 2023-07-09T21:42:36.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f424d91f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480cf540 con 0x7f42480b7a60 2023-07-09T21:42:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42480b4310 0x7f42480d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42480b4310 0x7f42480d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39800/0 (socket says 172.21.15.37:39800) 2023-07-09T21:42:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 -- 172.21.15.37:0/1762246743 learned_addr learned my addr 172.21.15.37:0/1762246743 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f4246ffd640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f42480cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 -- 172.21.15.37:0/1762246743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 msgr2=0x7f42480cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f42480cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 -- 172.21.15.37:0/1762246743 >> v1:172.21.15.119:6789/0 conn(0x7f42480b47a0 legacy=0x7f42480b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.708+0000 7f42477fe640 1 -- 172.21.15.37:0/1762246743 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480cfdf0 con 0x7f42480b4310 2023-07-09T21:42:36.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f42477fe640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b4310 0x7f42480d05f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4240009e50 tx=0x7f424001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278c515f3c33ce53 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f42467fc640 1 -- 172.21.15.37:0/1762246743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400a56e0 con 0x7f42480b4310 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f42467fc640 1 -- 172.21.15.37:0/1762246743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42400a5840 con 0x7f42480b4310 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f42467fc640 1 -- 172.21.15.37:0/1762246743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400a5bd0 con 0x7f42480b4310 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- 172.21.15.37:0/1762246743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b4310 msgr2=0x7f42480d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b4310 0x7f42480d05f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f4240009e50 tx=0x7f424001ca10 comp rx=0 tx=0).stop 2023-07-09T21:42:36.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- 172.21.15.37:0/1762246743 shutdown_connections 2023-07-09T21:42:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b4310 0x7f42480d05f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- 172.21.15.37:0/1762246743 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f42480cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- 172.21.15.37:0/1762246743 >> 172.21.15.37:0/1762246743 conn(0x7f4248073050 msgr2=0x7f4248069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- 172.21.15.37:0/1762246743 shutdown_connections 2023-07-09T21:42:36.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- 172.21.15.37:0/1762246743 wait complete. 2023-07-09T21:42:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 Processor -- start 2023-07-09T21:42:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- start start 2023-07-09T21:42:36.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 0x7f42481f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f4248160f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42481f4420 con 0x7f42480b47a0 2023-07-09T21:42:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42481f83a0 con 0x7f42480b4310 2023-07-09T21:42:36.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.712+0000 7f424d91f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42481f7de0 con 0x7f42480b7a60 2023-07-09T21:42:36.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4246ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 0x7f42481f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39812/0 (socket says 172.21.15.37:39812) 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 -- 172.21.15.37:0/3168847697 learned_addr learned my addr 172.21.15.37:0/3168847697 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f42477fe640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f4248160f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 -- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 msgr2=0x7f4248160f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f4248160f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 -- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 msgr2=0x7f42481f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 0x7f42481f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 -- 172.21.15.37:0/3168847697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009b30 con 0x7f42480b47a0 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4246ffd640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 0x7f42481f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f423ffff640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f423000c500 tx=0x7f423000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230005220 con 0x7f42480b47a0 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4230005380 con 0x7f42480b47a0 2023-07-09T21:42:36.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4230007270 con 0x7f42480b47a0 2023-07-09T21:42:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42481f80c0 con 0x7f42480b47a0 2023-07-09T21:42:36.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42481f4df0 con 0x7f42480b47a0 2023-07-09T21:42:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42480cdaa0 con 0x7f42480b47a0 2023-07-09T21:42:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.716+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f42300073d0 con 0x7f42480b47a0 2023-07-09T21:42:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.720+0000 7f4244ff9640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 0x7f4228068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:36.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.720+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f42300836e0 con 0x7f42480b47a0 2023-07-09T21:42:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.720+0000 7f4246ffd640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 0x7f4228068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:36.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.720+0000 7f4246ffd640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 0x7f4228068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42480ca870 tx=0x7f4238009190 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:36.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.724+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4230050a50 con 0x7f42480b47a0 2023-07-09T21:42:36.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.896+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f42481f3f10 con 0x7f42280663a0 2023-07-09T21:42:36.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f4244ff9640 1 -- 172.21.15.37:0/3168847697 <== mgr.7337 v2:172.21.15.119:6832/2490760228 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f42481f3f10 con 0x7f42280663a0 2023-07-09T21:42:36.899 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:42:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:42:36.899 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:42:36.900 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:42:36.900 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:42:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 msgr2=0x7f4228068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 0x7f4228068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42480ca870 tx=0x7f4238009190 comp rx=0 tx=0).stop 2023-07-09T21:42:36.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 msgr2=0x7f42481f7500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f423000c500 tx=0x7f423000c9c0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 shutdown_connections 2023-07-09T21:42:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7f42280663a0 0x7f4228068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f42480b7a60 0x7f4248160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42480b47a0 0x7f42481f7500 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 --2- 172.21.15.37:0/3168847697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f42480b4310 0x7f42481f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 >> 172.21.15.37:0/3168847697 conn(0x7f4248073050 msgr2=0x7f424815e180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 shutdown_connections 2023-07-09T21:42:36.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:36.900+0000 7f424d91f640 1 -- 172.21.15.37:0/3168847697 wait complete. 2023-07-09T21:42:36.920 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:42:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 Processor -- start 2023-07-09T21:42:37.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 -- start start 2023-07-09T21:42:37.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff30159990 0x7eff300c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 0x7eff300cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff300c4c90 con 0x7eff301595c0 2023-07-09T21:42:37.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300ca730 con 0x7eff30159990 2023-07-09T21:42:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.064+0000 7eff369db640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300ca170 con 0x7eff300c99e0 2023-07-09T21:42:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff30159990 0x7eff300c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff30159990 0x7eff300c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39818/0 (socket says 172.21.15.37:39818) 2023-07-09T21:42:37.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 -- 172.21.15.37:0/674265655 learned_addr learned my addr 172.21.15.37:0/674265655 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:37.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff34f78640 1 --2- 172.21.15.37:0/674265655 >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 0x7eff300cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 -- 172.21.15.37:0/674265655 >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 msgr2=0x7eff300cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 --2- 172.21.15.37:0/674265655 >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 0x7eff300cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 -- 172.21.15.37:0/674265655 >> v1:172.21.15.119:6789/0 conn(0x7eff301595c0 legacy=0x7eff3015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:37.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 -- 172.21.15.37:0/674265655 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff300ca450 con 0x7eff30159990 2023-07-09T21:42:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff34f78640 1 --2- 172.21.15.37:0/674265655 >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 0x7eff300cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2f7fe640 1 --2- 172.21.15.37:0/674265655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300c4750 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7eff300cebf0 tx=0x7eff2401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808e1d1761f97d0e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:37.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2effd640 1 -- 172.21.15.37:0/674265655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240ac640 con 0x7eff30159990 2023-07-09T21:42:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2effd640 1 -- 172.21.15.37:0/674265655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff240ac7a0 con 0x7eff30159990 2023-07-09T21:42:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.068+0000 7eff2effd640 1 -- 172.21.15.37:0/674265655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff240acb30 con 0x7eff30159990 2023-07-09T21:42:37.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- 172.21.15.37:0/674265655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 msgr2=0x7eff300c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- 172.21.15.37:0/674265655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300c4750 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7eff300cebf0 tx=0x7eff2401c4d0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- 172.21.15.37:0/674265655 shutdown_connections 2023-07-09T21:42:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- 172.21.15.37:0/674265655 >> v2:172.21.15.119:3300/0 conn(0x7eff300c99e0 0x7eff300cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- 172.21.15.37:0/674265655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300c4750 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- 172.21.15.37:0/674265655 >> 172.21.15.37:0/674265655 conn(0x7eff300cde40 msgr2=0x7eff300ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- 172.21.15.37:0/674265655 shutdown_connections 2023-07-09T21:42:37.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- 172.21.15.37:0/674265655 wait complete. 2023-07-09T21:42:37.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 Processor -- start 2023-07-09T21:42:37.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- start start 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 0x7eff301517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff301595c0 0x7eff300b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b3130 con 0x7eff30159990 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b2520 con 0x7eff301595c0 2023-07-09T21:42:37.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff369db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b2800 con 0x7eff300c99e0 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff34f78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff34f78640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39820/0 (socket says 172.21.15.37:39820) 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff34f78640 1 -- 172.21.15.37:0/2533303942 learned_addr learned my addr 172.21.15.37:0/2533303942 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff2f7fe640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff301595c0 0x7eff300b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.072+0000 7eff2ffff640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 0x7eff301517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 -- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 msgr2=0x7eff301517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 0x7eff301517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 -- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff301595c0 msgr2=0x7eff300b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff301595c0 0x7eff300b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 -- 172.21.15.37:0/2533303942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff28009a70 con 0x7eff30159990 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2ffff640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 0x7eff301517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff34f78640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7eff2800efc0 tx=0x7eff2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff28009cd0 con 0x7eff30159990 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2800f040 con 0x7eff30159990 2023-07-09T21:42:37.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff240094d0 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff280039a0 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff300b2dc0 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff300b32a0 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 58) v1 ==== 85760+0+0 (secure 0 0 0) 0x7eff28014480 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 0x7eff1c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.076+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7eff28084b50 con 0x7eff30159990 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.080+0000 7eff2ffff640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 0x7eff1c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:37.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.080+0000 7eff2ffff640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 0x7eff1c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff20000f70 tx=0x7eff20009040 comp rx=0 tx=0).ready entity=mgr.7337 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:37.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.080+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7eff28055820 con 0x7eff30159990 2023-07-09T21:42:37.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:37.276+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7eff3004d7d0 con 0x7eff30159990 2023-07-09T21:42:38.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.200+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7eff28082ef0 con 0x7eff30159990 2023-07-09T21:42:38.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff2cff9640 1 -- 172.21.15.37:0/2533303942 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v59) v1 ==== 92+0+0 (secure 0 0 0) 0x7eff2806fe30 con 0x7eff30159990 2023-07-09T21:42:38.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 msgr2=0x7eff1c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 0x7eff1c068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff20000f70 tx=0x7eff20009040 comp rx=0 tx=0).stop 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 msgr2=0x7eff300b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7eff2800efc0 tx=0x7eff2800c490 comp rx=0 tx=0).stop 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 shutdown_connections 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7eff1c0663a0 0x7eff1c068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff30159990 0x7eff300b12d0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7eff301595c0 0x7eff300b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 --2- 172.21.15.37:0/2533303942 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7eff300c99e0 0x7eff301517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 >> 172.21.15.37:0/2533303942 conn(0x7eff300cde40 msgr2=0x7eff3015a120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 shutdown_connections 2023-07-09T21:42:38.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.204+0000 7eff369db640 1 -- 172.21.15.37:0/2533303942 wait complete. 2023-07-09T21:42:38.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:42:38.377 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:38.380+0000 7f97be977180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 Processor -- start 2023-07-09T21:42:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 -- start start 2023-07-09T21:42:38.385 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:38.384+0000 7f38b293f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0340b7980 0x7ff034160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03415bf80 con 0x7ff0340b3c20 2023-07-09T21:42:38.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0340cd070 con 0x7ff0340b7980 2023-07-09T21:42:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03c50d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340cfd70 con 0x7ff0340ceb80 2023-07-09T21:42:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0340b7980 0x7ff034160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0340b7980 0x7ff034160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46366/0 (socket says 172.21.15.37:46366) 2023-07-09T21:42:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 -- 172.21.15.37:0/3124828069 learned_addr learned my addr 172.21.15.37:0/3124828069 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:38.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff039aa8640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 -- 172.21.15.37:0/3124828069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 msgr2=0x7ff0340cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.384+0000 7ff03a2a9640 1 -- 172.21.15.37:0/3124828069 >> v1:172.21.15.119:6789/0 conn(0x7ff0340b3c20 legacy=0x7ff0340b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff03a2a9640 1 -- 172.21.15.37:0/3124828069 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034160570 con 0x7ff0340b7980 2023-07-09T21:42:38.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff03a2a9640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034160030 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff030009870 tx=0x7ff03001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae6c7143e961b35 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff0392a7640 1 -- 172.21.15.37:0/3124828069 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab600 con 0x7ff0340b7980 2023-07-09T21:42:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff0392a7640 1 -- 172.21.15.37:0/3124828069 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300a7050 con 0x7ff0340b7980 2023-07-09T21:42:38.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff0392a7640 1 -- 172.21.15.37:0/3124828069 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab980 con 0x7ff0340b7980 2023-07-09T21:42:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff03c50d640 1 -- 172.21.15.37:0/3124828069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 msgr2=0x7ff034160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.388+0000 7ff03c50d640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034160030 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7ff030009870 tx=0x7ff03001c540 comp rx=0 tx=0).stop 2023-07-09T21:42:38.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- 172.21.15.37:0/3124828069 shutdown_connections 2023-07-09T21:42:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 --2- 172.21.15.37:0/3124828069 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034160030 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- 172.21.15.37:0/3124828069 >> 172.21.15.37:0/3124828069 conn(0x7ff034073090 msgr2=0x7ff034069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- 172.21.15.37:0/3124828069 shutdown_connections 2023-07-09T21:42:38.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- 172.21.15.37:0/3124828069 wait complete. 2023-07-09T21:42:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 Processor -- start 2023-07-09T21:42:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- start start 2023-07-09T21:42:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 0x7ff03415b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415c120 con 0x7ff0340b7980 2023-07-09T21:42:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415c400 con 0x7ff0340b3c20 2023-07-09T21:42:38.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03c50d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415c6e0 con 0x7ff0340ceb80 2023-07-09T21:42:38.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46374/0 (socket says 172.21.15.37:46374) 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 -- 172.21.15.37:0/2385492689 learned_addr learned my addr 172.21.15.37:0/2385492689 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03a2a9640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 0x7ff03415b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03aaaa640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 -- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 msgr2=0x7ff0340c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 -- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 msgr2=0x7ff03415b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 0x7ff03415b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 -- 172.21.15.37:0/2385492689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094d0 con 0x7ff0340b7980 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff03a2a9640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 0x7ff03415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.392+0000 7ff039aa8640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff02400e930 tx=0x7ff02400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff024009690 con 0x7ff0340b7980 2023-07-09T21:42:38.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02400ca00 con 0x7ff0340b7980 2023-07-09T21:42:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03415c9c0 con 0x7ff0340b7980 2023-07-09T21:42:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02400cd70 con 0x7ff0340b7980 2023-07-09T21:42:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0340c9e00 con 0x7ff0340b7980 2023-07-09T21:42:38.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03404d7d0 con 0x7ff0340b7980 2023-07-09T21:42:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff024013470 con 0x7ff0340b7980 2023-07-09T21:42:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 0x7ff0180688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7ff024084240 con 0x7ff0340b7980 2023-07-09T21:42:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff03a2a9640 1 -- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 msgr2=0x7ff0180688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:38.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.396+0000 7ff03a2a9640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 0x7ff0180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:38.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.400+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff0240515e0 con 0x7ff0340b7980 2023-07-09T21:42:38.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.560+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff03406a800 con 0x7ff0340b7980 2023-07-09T21:42:38.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff02affd640 1 -- 172.21.15.37:0/2385492689 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v47)=0 v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff024054c00 con 0x7ff0340b7980 2023-07-09T21:42:38.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 msgr2=0x7ff0180688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:38.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 0x7ff0180688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 msgr2=0x7ff034154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7ff02400e930 tx=0x7ff02400edf0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 shutdown_connections 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7ff0180663f0 0x7ff0180688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff0340ceb80 0x7ff0340c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0340b7980 0x7ff034154160 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 --2- 172.21.15.37:0/2385492689 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff0340b3c20 0x7ff03415b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 >> 172.21.15.37:0/2385492689 conn(0x7ff034073090 msgr2=0x7ff0340b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:38.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 shutdown_connections 2023-07-09T21:42:38.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.568+0000 7ff03c50d640 1 -- 172.21.15.37:0/2385492689 wait complete. 2023-07-09T21:42:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 Processor -- start 2023-07-09T21:42:38.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 -- start start 2023-07-09T21:42:38.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 0x7fa954160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9540d0780 0x7fa9540d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa95415bf80 con 0x7fa9540ceb80 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9540cd070 con 0x7fa9540d0780 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.736+0000 7fa959940640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540cfd70 con 0x7fa9540b7980 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa94bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9540ceb80 0x7fa9540cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40674/0 (socket says 172.21.15.37:40674) 2023-07-09T21:42:38.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa94bfff640 1 -- 172.21.15.37:0/2500747925 learned_addr learned my addr 172.21.15.37:0/2500747925 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:38.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2500747925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 0x7fa954160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9537fe640 1 --2- 172.21.15.37:0/2500747925 >> v2:172.21.15.119:3300/0 conn(0x7fa9540d0780 0x7fa9540d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9527fc640 1 -- 172.21.15.37:0/2500747925 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055389543 0 0) 0x7fa93c001120 con 0x7fa9540ceb80 2023-07-09T21:42:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9527fc640 1 -- 172.21.15.37:0/2500747925 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa940003530 con 0x7fa9540ceb80 2023-07-09T21:42:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 -- 172.21.15.37:0/2500747925 >> v2:172.21.15.119:3300/0 conn(0x7fa9540d0780 msgr2=0x7fa9540d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2500747925 >> v2:172.21.15.119:3300/0 conn(0x7fa9540d0780 0x7fa9540d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 -- 172.21.15.37:0/2500747925 >> v1:172.21.15.37:6789/0 conn(0x7fa9540ceb80 legacy=0x7fa9540cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 -- 172.21.15.37:0/2500747925 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954160570 con 0x7fa9540b7980 2023-07-09T21:42:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2500747925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 0x7fa954160030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6ffd06c4da0a83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9527fc640 1 -- 172.21.15.37:0/2500747925 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ab600 con 0x7fa9540b7980 2023-07-09T21:42:38.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9527fc640 1 -- 172.21.15.37:0/2500747925 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440a7050 con 0x7fa9540b7980 2023-07-09T21:42:38.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.740+0000 7fa9527fc640 1 -- 172.21.15.37:0/2500747925 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440ab980 con 0x7fa9540b7980 2023-07-09T21:42:38.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- 172.21.15.37:0/2500747925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 msgr2=0x7fa954160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- 172.21.15.37:0/2500747925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 0x7fa954160030 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa9440097c0 tx=0x7fa94401c480 comp rx=0 tx=0).stop 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- 172.21.15.37:0/2500747925 shutdown_connections 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- 172.21.15.37:0/2500747925 >> v2:172.21.15.119:3300/0 conn(0x7fa9540d0780 0x7fa9540d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- 172.21.15.37:0/2500747925 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540b7980 0x7fa954160030 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- 172.21.15.37:0/2500747925 >> 172.21.15.37:0/2500747925 conn(0x7fa954073090 msgr2=0x7fa954069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:38.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- 172.21.15.37:0/2500747925 shutdown_connections 2023-07-09T21:42:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- 172.21.15.37:0/2500747925 wait complete. 2023-07-09T21:42:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 Processor -- start 2023-07-09T21:42:38.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- start start 2023-07-09T21:42:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540ceb80 0x7fa9540c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9540d0780 0x7fa954156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9541577d0 con 0x7fa9540b7980 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9540c8560 con 0x7fa9540d0780 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa959940640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa954156bc0 con 0x7fa9540ceb80 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa952ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa952ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46380/0 (socket says 172.21.15.37:46380) 2023-07-09T21:42:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa952ffd640 1 -- 172.21.15.37:0/2762796228 learned_addr learned my addr 172.21.15.37:0/2762796228 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa94bfff640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540ceb80 0x7fa9540c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.744+0000 7fa9537fe640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9540d0780 0x7fa954156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 -- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540ceb80 msgr2=0x7fa9540c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540ceb80 0x7fa9540c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 -- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9540d0780 msgr2=0x7fa954156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9540d0780 0x7fa954156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 -- 172.21.15.37:0/2762796228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa944009420 con 0x7fa9540b7980 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa952ffd640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa944019090 tx=0x7fa944019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b48d0 con 0x7fa9540b7980 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9440b4a30 con 0x7fa9540b7980 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9440b4de0 con 0x7fa9540b7980 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa954156ea0 con 0x7fa9540b7980 2023-07-09T21:42:38.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954157460 con 0x7fa9540b7980 2023-07-09T21:42:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9540cff60 con 0x7fa9540b7980 2023-07-09T21:42:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.748+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fa9440b2040 con 0x7fa9540b7980 2023-07-09T21:42:38.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.752+0000 7fa950ff9640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 0x7fa9340688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:38.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.752+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fa94411df30 con 0x7fa9540b7980 2023-07-09T21:42:38.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.752+0000 7fa94bfff640 1 -- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 msgr2=0x7fa9340688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:38.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.752+0000 7fa94bfff640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 0x7fa9340688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:38.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.752+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9540cff60 con 0x7fa9540b7980 2023-07-09T21:42:38.795 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:38.796+0000 7f97be977180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:38.832 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:38.832+0000 7f38b293f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:38.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.912+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fa954160570 con 0x7fa9540b7980 2023-07-09T21:42:38.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.916+0000 7fa950ff9640 1 -- 172.21.15.37:0/2762796228 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v48)=0 v48) v1 ==== 133+0+0 (secure 0 0 0) 0x7fa954160570 con 0x7fa9540b7980 2023-07-09T21:42:38.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 msgr2=0x7fa9340688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:38.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 0x7fa9340688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 msgr2=0x7fa954157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa944019090 tx=0x7fa944019220 comp rx=0 tx=0).stop 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 shutdown_connections 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fa9340663f0 0x7fa9340688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9540d0780 0x7fa954156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9540ceb80 0x7fa9540c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 --2- 172.21.15.37:0/2762796228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9540b7980 0x7fa954157c60 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:38.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 >> 172.21.15.37:0/2762796228 conn(0x7fa954073090 msgr2=0x7fa95415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:38.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 shutdown_connections 2023-07-09T21:42:38.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:38.920+0000 7fa959940640 1 -- 172.21.15.37:0/2762796228 wait complete. 2023-07-09T21:42:38.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:38.940 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:42:38.945 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:38.948+0000 7f97be977180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:38.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1h 2023-07-09T21:42:38.995 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:38.996+0000 7f38b293f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 Processor -- start 2023-07-09T21:42:39.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 -- start start 2023-07-09T21:42:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcd940cf290 0x7fcd94160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd940d0780 0x7fcd940d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9415bf80 con 0x7fcd940b7980 2023-07-09T21:42:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940cd070 con 0x7fcd940d0780 2023-07-09T21:42:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.144+0000 7fcd9c434640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd940cfd70 con 0x7fcd940cf290 2023-07-09T21:42:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd940d0780 0x7fcd940d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:39.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd940d0780 0x7fcd940d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46392/0 (socket says 172.21.15.37:46392) 2023-07-09T21:42:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/3699269893 learned_addr learned my addr 172.21.15.37:0/3699269893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd999cf640 1 --2- 172.21.15.37:0/3699269893 >> v2:172.21.15.119:3300/0 conn(0x7fcd940cf290 0x7fcd94160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:39.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/3699269893 >> v2:172.21.15.119:3300/0 conn(0x7fcd940cf290 msgr2=0x7fcd94160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 --2- 172.21.15.37:0/3699269893 >> v2:172.21.15.119:3300/0 conn(0x7fcd940cf290 0x7fcd94160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/3699269893 >> v1:172.21.15.119:6789/0 conn(0x7fcd940b7980 legacy=0x7fcd940ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:39.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/3699269893 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94160570 con 0x7fcd940d0780 2023-07-09T21:42:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd9a9d1640 1 --2- 172.21.15.37:0/3699269893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd940d0b80 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fcd940b4cd0 tx=0x7fcd8c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e706aa7eb12fc32d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:39.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd991ce640 1 -- 172.21.15.37:0/3699269893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5690 con 0x7fcd940d0780 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd991ce640 1 -- 172.21.15.37:0/3699269893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0a57f0 con 0x7fcd940d0780 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.148+0000 7fcd991ce640 1 -- 172.21.15.37:0/3699269893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5b80 con 0x7fcd940d0780 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- 172.21.15.37:0/3699269893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 msgr2=0x7fcd940d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- 172.21.15.37:0/3699269893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd940d0b80 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fcd940b4cd0 tx=0x7fcd8c01c9d0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- 172.21.15.37:0/3699269893 shutdown_connections 2023-07-09T21:42:39.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- 172.21.15.37:0/3699269893 >> v2:172.21.15.119:3300/0 conn(0x7fcd940cf290 0x7fcd94160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- 172.21.15.37:0/3699269893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd940d0b80 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- 172.21.15.37:0/3699269893 >> 172.21.15.37:0/3699269893 conn(0x7fcd94073090 msgr2=0x7fcd94069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- 172.21.15.37:0/3699269893 shutdown_connections 2023-07-09T21:42:39.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- 172.21.15.37:0/3699269893 wait complete. 2023-07-09T21:42:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 Processor -- start 2023-07-09T21:42:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- start start 2023-07-09T21:42:39.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd940b7980 0x7fcd940c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd940cf290 0x7fcd940b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd94152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9415a0a0 con 0x7fcd940d0780 2023-07-09T21:42:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940b4680 con 0x7fcd940b7980 2023-07-09T21:42:39.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9c434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd940b4960 con 0x7fcd940cf290 2023-07-09T21:42:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9a9d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd94152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9a9d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd94152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46408/0 (socket says 172.21.15.37:46408) 2023-07-09T21:42:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/2260379568 learned_addr learned my addr 172.21.15.37:0/2260379568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:39.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd999cf640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd940cf290 0x7fcd940b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:39.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.152+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd940b7980 0x7fcd940c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:39.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd940cf290 msgr2=0x7fcd940b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:39.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcd940cf290 0x7fcd940b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd940b7980 msgr2=0x7fcd940c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:39.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcd940b7980 0x7fcd940c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:39.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009b30 con 0x7fcd940d0780 2023-07-09T21:42:39.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9a9d1640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd94152e40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0af040 tx=0x7fcd8c019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:39.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0a5690 con 0x7fcd940d0780 2023-07-09T21:42:39.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0b8880 con 0x7fcd940d0780 2023-07-09T21:42:39.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0b8c30 con 0x7fcd940d0780 2023-07-09T21:42:39.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd94159a50 con 0x7fcd940d0780 2023-07-09T21:42:39.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd940b4210 con 0x7fcd940d0780 2023-07-09T21:42:39.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9415a210 con 0x7fcd940d0780 2023-07-09T21:42:39.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 59) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fcd8c0b6440 con 0x7fcd940d0780 2023-07-09T21:42:39.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.156+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fcd8c11f380 con 0x7fcd940d0780 2023-07-09T21:42:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.160+0000 7fcd9a1d0640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 msgr2=0x7fcd780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:39.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.160+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:39.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.160+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcd8c0ec8d0 con 0x7fcd940d0780 2023-07-09T21:42:39.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.336+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd940cff80 con 0x7fcd780663f0 2023-07-09T21:42:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.364+0000 7fcd9a1d0640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 msgr2=0x7fcd780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:39.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.364+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:42:39.428 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.428+0000 7f97be977180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:39.486 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.488+0000 7f97be977180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:39.512 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.512+0000 7f38b293f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:39.542 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.544+0000 7f97be977180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:39.573 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.572+0000 7f38b293f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:39.627 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.628+0000 7f97be977180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:39.632 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.632+0000 7f38b293f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:39.686 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.688+0000 7f97be977180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:39.724 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.724+0000 7f38b293f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.768+0000 7fcd9a1d0640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 msgr2=0x7fcd780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:39.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:39.768+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:42:39.770 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.772+0000 7f97be977180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:39.783 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.784+0000 7f38b293f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:39.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.828+0000 7f97be977180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:39.871 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.872+0000 7f38b293f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:39.930 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:39.928+0000 7f38b293f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:39.968 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:39.968+0000 7f97be977180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:40.027 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.028+0000 7f97be977180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:40.080 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.080+0000 7f38b293f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:40.141 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.140+0000 7f38b293f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:40.268 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:40.269 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:40.269 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:40.276 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.280+0000 7f97be977180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:40.395 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:40.395 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:40.396 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:40.404 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.404+0000 7f38b293f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:40.414 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.416+0000 7f97be977180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:40.539 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.540+0000 7f97be977180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:40.544 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.544+0000 7f38b293f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:40.572+0000 7fcd9a1d0640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 msgr2=0x7fcd780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2490760228 2023-07-09T21:42:40.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:40.572+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:42:40.610 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.612+0000 7f97be977180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:40.675 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.676+0000 7f38b293f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:40.742 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:40.744+0000 7f97be977180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:40.749 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.748+0000 7f38b293f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:40.890 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:40.888+0000 7f38b293f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:41.279 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.280+0000 7f97be977180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:41.363 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.364+0000 7f97be977180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:41.456 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:41.456+0000 7f38b293f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:41.510 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.512+0000 7f97be977180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:41.544 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:41.544+0000 7f38b293f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:41.593 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.596+0000 7f97be977180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:41.699 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:41.700+0000 7f38b293f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:41.786 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:41.784+0000 7f38b293f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:41.862 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.864+0000 7f97be977180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:41.921 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:41.924+0000 7f97be977180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:41.932+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 60) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fcd8c0ecca0 con 0x7fcd940d0780 2023-07-09T21:42:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:41.932+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 msgr2=0x7fcd780688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:41.932+0000 7fcd8affd640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/2490760228,v1:172.21.15.119:6833/2490760228] conn(0x7fcd780663f0 0x7fcd780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:42.053 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f973dadc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.053 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f973dadc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.053 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f973dadc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f973dadc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f973dadc640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f9740ae2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f9740ae2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f9740ae2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.054 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f9740ae2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.055 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:42.056+0000 7f9740ae2640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:42.088 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:42.088+0000 7f38b293f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:42.151 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:42.152+0000 7f38b293f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:42.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:42.940+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fcd8c11d680 con 0x7fcd940d0780 2023-07-09T21:42:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:42.940+0000 7fcd8affd640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fcd78033e90 0x7fcd78070920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:42.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:42.940+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 --> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1h", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd78034260 con 0x7fcd78033e90 2023-07-09T21:42:42.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:42.944+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fcd78033e90 0x7fcd78070920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:42.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:42.948+0000 7fcd9a1d0640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fcd78033e90 0x7fcd78070920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd9415ebd0 tx=0x7fcd90007e40 comp rx=0 tx=0).ready entity=mgr.7646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.012+0000 7fcd8affd640 1 -- 172.21.15.37:0/2260379568 <== mgr.7646 v2:172.21.15.119:6832/3341716483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcd78034260 con 0x7fcd78033e90 2023-07-09T21:42:43.014 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T21:42:43.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fcd78033e90 msgr2=0x7fcd78070920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fcd78033e90 0x7fcd78070920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcd9415ebd0 tx=0x7fcd90007e40 comp rx=0 tx=0).stop 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 msgr2=0x7fcd94152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 --2- 172.21.15.37:0/2260379568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd940d0780 0x7fcd94152e40 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0af040 tx=0x7fcd8c019770 comp rx=0 tx=0).stop 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9a9d1640 1 -- 172.21.15.37:0/2260379568 reap_dead start 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 shutdown_connections 2023-07-09T21:42:43.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 >> 172.21.15.37:0/2260379568 conn(0x7fcd94073090 msgr2=0x7fcd9415d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:43.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 shutdown_connections 2023-07-09T21:42:43.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.016+0000 7fcd9c434640 1 -- 172.21.15.37:0/2260379568 wait complete. 2023-07-09T21:42:43.037 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T21:42:43.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-09T21:42:43.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 Processor -- start 2023-07-09T21:42:43.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 -- start start 2023-07-09T21:42:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2141595c0 0x7fa2140c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 0x7fa2140c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2140c4c90 con 0x7fa21415dd10 2023-07-09T21:42:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2140ca730 con 0x7fa2141595c0 2023-07-09T21:42:43.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa21a59f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140c9f20 con 0x7fa214159990 2023-07-09T21:42:43.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa213fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2141595c0 0x7fa2140c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa218b3c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fa21415dd10 0x7fa2140cd300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:54220/0 (socket says 172.21.15.37:54220) 2023-07-09T21:42:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa2137fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 0x7fa2140c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa218b3c640 1 -- 172.21.15.37:0/2371275819 learned_addr learned my addr 172.21.15.37:0/2371275819 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa2137fe640 1 -- 172.21.15.37:0/2371275819 >> v2:172.21.15.119:3300/0 conn(0x7fa2141595c0 msgr2=0x7fa2140c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa2137fe640 1 --2- 172.21.15.37:0/2371275819 >> v2:172.21.15.119:3300/0 conn(0x7fa2141595c0 0x7fa2140c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa2137fe640 1 -- 172.21.15.37:0/2371275819 >> v1:172.21.15.119:6789/0 conn(0x7fa21415dd10 legacy=0x7fa2140cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.188+0000 7fa2137fe640 1 -- 172.21.15.37:0/2371275819 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2140ca170 con 0x7fa214159990 2023-07-09T21:42:43.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa2137fe640 1 --2- 172.21.15.37:0/2371275819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 0x7fa2140c99e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa2080097c0 tx=0x7fa20801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=893b5ea10c9815d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa212ffd640 1 -- 172.21.15.37:0/2371275819 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080ab650 con 0x7fa214159990 2023-07-09T21:42:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa212ffd640 1 -- 172.21.15.37:0/2371275819 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080ab7b0 con 0x7fa214159990 2023-07-09T21:42:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa212ffd640 1 -- 172.21.15.37:0/2371275819 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080abb40 con 0x7fa214159990 2023-07-09T21:42:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 -- 172.21.15.37:0/2371275819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 msgr2=0x7fa2140c99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 --2- 172.21.15.37:0/2371275819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 0x7fa2140c99e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa2080097c0 tx=0x7fa20801c450 comp rx=0 tx=0).stop 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 -- 172.21.15.37:0/2371275819 shutdown_connections 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 --2- 172.21.15.37:0/2371275819 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa214159990 0x7fa2140c99e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 --2- 172.21.15.37:0/2371275819 >> v2:172.21.15.119:3300/0 conn(0x7fa2141595c0 0x7fa2140c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 -- 172.21.15.37:0/2371275819 >> 172.21.15.37:0/2371275819 conn(0x7fa2140cde40 msgr2=0x7fa2140ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 -- 172.21.15.37:0/2371275819 shutdown_connections 2023-07-09T21:42:43.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.192+0000 7fa21a59f640 1 -- 172.21.15.37:0/2371275819 wait complete. 2023-07-09T21:42:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 Processor -- start 2023-07-09T21:42:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- start start 2023-07-09T21:42:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2141595c0 0x7fa214152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 0x7fa214153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21415a770 con 0x7fa214159990 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2140c6b70 con 0x7fa21415dd10 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa214159f20 con 0x7fa2141595c0 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46418/0 (socket says 172.21.15.37:46418) 2023-07-09T21:42:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 -- 172.21.15.37:0/1104309013 learned_addr learned my addr 172.21.15.37:0/1104309013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa218b3c640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 0x7fa214153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa213fff640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2141595c0 0x7fa214152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 -- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2141595c0 msgr2=0x7fa214152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2141595c0 0x7fa214152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 -- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 msgr2=0x7fa214153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 0x7fa214153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 -- 172.21.15.37:0/1104309013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009420 con 0x7fa214159990 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa218b3c640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 0x7fa214153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa2137fe640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ad040 tx=0x7fa20801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080bf610 con 0x7fa214159990 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080bf790 con 0x7fa214159990 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080bfb40 con 0x7fa214159990 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21415a980 con 0x7fa214159990 2023-07-09T21:42:43.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.196+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa214152fc0 con 0x7fa214159990 2023-07-09T21:42:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2140aff00 con 0x7fa214159990 2023-07-09T21:42:43.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fa2080b5400 con 0x7fa214159990 2023-07-09T21:42:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa210ff9640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 0x7fa200068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fa20811ed20 con 0x7fa214159990 2023-07-09T21:42:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa213fff640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 0x7fa200068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.200+0000 7fa213fff640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 0x7fa200068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa21415a4f0 tx=0x7fa204008040 comp rx=0 tx=0).ready entity=mgr.7646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.204+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2080ec290 con 0x7fa214159990 2023-07-09T21:42:43.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.376+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 --> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa21415d7f0 con 0x7fa200066150 2023-07-09T21:42:43.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa210ff9640 1 -- 172.21.15.37:0/1104309013 <== mgr.7646 v2:172.21.15.119:6832/3341716483 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fa2040096a0 con 0x7fa200066150 2023-07-09T21:42:43.441 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path snap_test_dir1 2023-07-09T21:42:43.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 msgr2=0x7fa200068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 0x7fa200068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa21415a4f0 tx=0x7fa204008040 comp rx=0 tx=0).stop 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 msgr2=0x7fa214153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fa2080ad040 tx=0x7fa20801ac90 comp rx=0 tx=0).stop 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 shutdown_connections 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fa200066150 0x7fa200068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa21415dd10 0x7fa214153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa214159990 0x7fa214153240 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.440+0000 7fa21a59f640 1 --2- 172.21.15.37:0/1104309013 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2141595c0 0x7fa214152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.444+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 >> 172.21.15.37:0/1104309013 conn(0x7fa2140cde40 msgr2=0x7fa2141628d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.444+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 shutdown_connections 2023-07-09T21:42:43.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.444+0000 7fa21a59f640 1 -- 172.21.15.37:0/1104309013 wait complete. 2023-07-09T21:42:43.462 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-09T21:42:43.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs snap_test_dir1 2023-07-09T21:42:43.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 Processor -- start 2023-07-09T21:42:43.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 -- start start 2023-07-09T21:42:43.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8f80cf290 0x7fb8f8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f815bf80 con 0x7fb8f80b7980 2023-07-09T21:42:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8f8160570 con 0x7fb8f80d0780 2023-07-09T21:42:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb900774640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f80cd070 con 0x7fb8f80cf290 2023-07-09T21:42:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fe510640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8f80b7980 0x7fb8f80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40678/0 (socket says 172.21.15.37:40678) 2023-07-09T21:42:43.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fe510640 1 -- 172.21.15.37:0/1504140297 learned_addr learned my addr 172.21.15.37:0/1504140297 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fdd0f640 1 --2- 172.21.15.37:0/1504140297 >> v2:172.21.15.37:3300/0 conn(0x7fb8f80cf290 0x7fb8f8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fd50e640 1 -- 172.21.15.37:0/1504140297 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945794152 0 0) 0x7fb8f4001120 con 0x7fb8f80b7980 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fd50e640 1 -- 172.21.15.37:0/1504140297 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8e4003530 con 0x7fb8f80b7980 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fdd0f640 1 -- 172.21.15.37:0/1504140297 >> v1:172.21.15.119:6789/0 conn(0x7fb8f80d0780 legacy=0x7fb8f80d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fdd0f640 1 -- 172.21.15.37:0/1504140297 >> v1:172.21.15.37:6789/0 conn(0x7fb8f80b7980 legacy=0x7fb8f80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.608+0000 7fb8fdd0f640 1 -- 172.21.15.37:0/1504140297 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f80d02f0 con 0x7fb8f80cf290 2023-07-09T21:42:43.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb8fdd0f640 1 --2- 172.21.15.37:0/1504140297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cf290 0x7fb8f8160030 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80097c0 tx=0x7fb8e801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234c0bd49e09d06e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb8fd50e640 1 -- 172.21.15.37:0/1504140297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80ab600 con 0x7fb8f80cf290 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb8fd50e640 1 -- 172.21.15.37:0/1504140297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e80a7050 con 0x7fb8f80cf290 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb8fd50e640 1 -- 172.21.15.37:0/1504140297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e80ab960 con 0x7fb8f80cf290 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 -- 172.21.15.37:0/1504140297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cf290 msgr2=0x7fb8f8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 --2- 172.21.15.37:0/1504140297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cf290 0x7fb8f8160030 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fb8e80097c0 tx=0x7fb8e801c480 comp rx=0 tx=0).stop 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 -- 172.21.15.37:0/1504140297 shutdown_connections 2023-07-09T21:42:43.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 --2- 172.21.15.37:0/1504140297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80cf290 0x7fb8f8160030 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 -- 172.21.15.37:0/1504140297 >> 172.21.15.37:0/1504140297 conn(0x7fb8f8073090 msgr2=0x7fb8f8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:43.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 -- 172.21.15.37:0/1504140297 shutdown_connections 2023-07-09T21:42:43.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.612+0000 7fb900774640 1 -- 172.21.15.37:0/1504140297 wait complete. 2023-07-09T21:42:43.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 Processor -- start 2023-07-09T21:42:43.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- start start 2023-07-09T21:42:43.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8f80b7980 0x7fb8f80c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f80cf290 0x7fb8f80b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80d0780 0x7fb8f8153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c7330 con 0x7fb8f80d0780 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80b3720 con 0x7fb8f80cf290 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f80c8000 con 0x7fb8f80b7980 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80d0780 0x7fb8f8153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80d0780 0x7fb8f8153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46436/0 (socket says 172.21.15.37:46436) 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 -- 172.21.15.37:0/1108974082 learned_addr learned my addr 172.21.15.37:0/1108974082 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:43.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fdd0f640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f80cf290 0x7fb8f80b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fe510640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8f80b7980 0x7fb8f80c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 -- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8f80b7980 msgr2=0x7fb8f80c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb8f80b7980 0x7fb8f80c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 -- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f80cf290 msgr2=0x7fb8f80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f80cf290 0x7fb8f80b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 -- 172.21.15.37:0/1108974082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e8009420 con 0x7fb8f80d0780 2023-07-09T21:42:43.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fdd0f640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb8f80cf290 0x7fb8f80b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8fed11640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8f80d0780 0x7fb8f8153410 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7fb8f000c730 tx=0x7fb8f000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f0003b80 con 0x7fb8f80d0780 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f0003ce0 con 0x7fb8f80d0780 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f000aa30 con 0x7fb8f80d0780 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- 172.21.15.37:0/1108974082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8f80c6d00 con 0x7fb8f80d0780 2023-07-09T21:42:43.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.616+0000 7fb900774640 1 -- 172.21.15.37:0/1108974082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f80c8530 con 0x7fb8f80d0780 2023-07-09T21:42:43.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb900774640 1 -- 172.21.15.37:0/1108974082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f80c7470 con 0x7fb8f80d0780 2023-07-09T21:42:43.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 61) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb8f000ab90 con 0x7fb8f80d0780 2023-07-09T21:42:43.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb8eeffd640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fb8dc066150 0x7fb8dc068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:43.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fb8f0083800 con 0x7fb8f80d0780 2023-07-09T21:42:43.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb8fe510640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fb8dc066150 0x7fb8dc068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:43.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.620+0000 7fb8fe510640 1 --2- 172.21.15.37:0/1108974082 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fb8dc066150 0x7fb8dc068600 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4001280 tx=0x7fb8f4009040 comp rx=0 tx=0).ready entity=mgr.7646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:43.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.624+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8f80c7470 con 0x7fb8f80d0780 2023-07-09T21:42:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.800+0000 7fb900774640 1 -- 172.21.15.37:0/1108974082 --> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8f80ccd90 con 0x7fb8dc066150 2023-07-09T21:42:43.806 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:43.808+0000 7f9747af0640 -1 mgr.server reply reply (2) No such file or directory SnapSchedule for snap_test_dir1 not found 2023-07-09T21:42:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:43.804+0000 7fb8eeffd640 1 -- 172.21.15.37:0/1108974082 <== mgr.7646 v2:172.21.15.119:6832/3341716483 1 ==== mgr_command_reply(tid 0: -2 SnapSchedule for snap_test_dir1 not found) v1 ==== 49+0+0 (secure 0 0 0) 0x7fb8f4001d20 con 0x7fb8dc066150 2023-07-09T21:42:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:Error ENOENT: SnapSchedule for snap_test_dir1 not found 2023-07-09T21:42:43.815 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-07-09T21:42:43.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:43.817 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T21:42:43.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:42:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.020+0000 7f9199ebd640 1 Processor -- start 2023-07-09T21:42:44.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.020+0000 7f9199ebd640 1 -- start start 2023-07-09T21:42:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91940694c0 0x7f919406e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f919406cb20 0x7f9194069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9194070370 0x7f919406d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919406ebd0 con 0x7f91940694c0 2023-07-09T21:42:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919406c690 con 0x7f919406cb20 2023-07-09T21:42:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9199ebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9194069dd0 con 0x7f9194070370 2023-07-09T21:42:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91940694c0 0x7f919406e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91940694c0 0x7f919406e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46446/0 (socket says 172.21.15.37:46446) 2023-07-09T21:42:44.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 -- 172.21.15.37:0/3906306411 learned_addr learned my addr 172.21.15.37:0/3906306411 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9193fff640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9194070370 0x7f919406d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f9192ffd640 1 --2- 172.21.15.37:0/3906306411 >> v2:172.21.15.119:3300/0 conn(0x7f919406cb20 0x7f9194069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 -- 172.21.15.37:0/3906306411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9194070370 msgr2=0x7f919406d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9194070370 0x7f919406d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 -- 172.21.15.37:0/3906306411 >> v2:172.21.15.119:3300/0 conn(0x7f919406cb20 msgr2=0x7f9194069890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 --2- 172.21.15.37:0/3906306411 >> v2:172.21.15.119:3300/0 conn(0x7f919406cb20 0x7f9194069890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 -- 172.21.15.37:0/3906306411 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940b1e80 con 0x7f91940694c0 2023-07-09T21:42:44.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.024+0000 7f91937fe640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91940694c0 0x7f919406e690 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f91940cffe0 tx=0x7f918401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a6f0d03b7cb3fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:44.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f91927fc640 1 -- 172.21.15.37:0/3906306411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840ab600 con 0x7f91940694c0 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f91927fc640 1 -- 172.21.15.37:0/3906306411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91840a7050 con 0x7f91940694c0 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f91927fc640 1 -- 172.21.15.37:0/3906306411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840ab980 con 0x7f91940694c0 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- 172.21.15.37:0/3906306411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91940694c0 msgr2=0x7f919406e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91940694c0 0x7f919406e690 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f91940cffe0 tx=0x7f918401c210 comp rx=0 tx=0).stop 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- 172.21.15.37:0/3906306411 shutdown_connections 2023-07-09T21:42:44.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9194070370 0x7f919406d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- 172.21.15.37:0/3906306411 >> v2:172.21.15.119:3300/0 conn(0x7f919406cb20 0x7f9194069890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- 172.21.15.37:0/3906306411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91940694c0 0x7f919406e690 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- 172.21.15.37:0/3906306411 >> 172.21.15.37:0/3906306411 conn(0x7f919406b250 msgr2=0x7f91940cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- 172.21.15.37:0/3906306411 shutdown_connections 2023-07-09T21:42:44.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- 172.21.15.37:0/3906306411 wait complete. 2023-07-09T21:42:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 Processor -- start 2023-07-09T21:42:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- start start 2023-07-09T21:42:44.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91940694c0 0x7f9194156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f919406cb20 0x7f9194155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194145c00 con 0x7f9194070370 2023-07-09T21:42:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194156c60 con 0x7f919406cb20 2023-07-09T21:42:44.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.028+0000 7f9199ebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9194156f00 con 0x7f91940694c0 2023-07-09T21:42:44.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46460/0 (socket says 172.21.15.37:46460) 2023-07-09T21:42:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 -- 172.21.15.37:0/544940304 learned_addr learned my addr 172.21.15.37:0/544940304 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f91937fe640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91940694c0 0x7f9194156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9192ffd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f919406cb20 0x7f9194155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 -- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91940694c0 msgr2=0x7f9194156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91940694c0 0x7f9194156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 -- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f919406cb20 msgr2=0x7f9194155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f919406cb20 0x7f9194155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 -- 172.21.15.37:0/544940304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91840094d0 con 0x7f9194070370 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9193fff640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f918c007e60 tx=0x7f918c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:44.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c014420 con 0x7f9194070370 2023-07-09T21:42:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0145a0 con 0x7f9194070370 2023-07-09T21:42:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c014950 con 0x7f9194070370 2023-07-09T21:42:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91941571e0 con 0x7f9194070370 2023-07-09T21:42:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91941574c0 con 0x7f9194070370 2023-07-09T21:42:44.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9194145d70 con 0x7f9194070370 2023-07-09T21:42:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 62) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f918c014ab0 con 0x7f9194070370 2023-07-09T21:42:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.032+0000 7f917bfff640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 0x7f9180068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:44.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.036+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f918c084b10 con 0x7f9194070370 2023-07-09T21:42:44.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.036+0000 7f91937fe640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 0x7f9180068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:44.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.036+0000 7f91937fe640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 0x7f9180068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f91840a6000 comp rx=0 tx=0).ready entity=mgr.7646 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:44.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.036+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f918c051ba0 con 0x7f9194070370 2023-07-09T21:42:44.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:44.228+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f919404d7d0 con 0x7f9194070370 2023-07-09T21:42:45.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.000+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f918c051f70 con 0x7f9194070370 2023-07-09T21:42:45.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.004+0000 7f917bfff640 1 -- 172.21.15.37:0/544940304 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v63) v1 ==== 93+0+0 (secure 0 0 0) 0x7f918c06e6a0 con 0x7f9194070370 2023-07-09T21:42:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 msgr2=0x7f9180068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 0x7f9180068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f91840ad000 tx=0x7f91840a6000 comp rx=0 tx=0).stop 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 msgr2=0x7f919414a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f918c007e60 tx=0x7f918c00e4b0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 shutdown_connections 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f9180066480 0x7f9180068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194070370 0x7f919414a940 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f919406cb20 0x7f9194155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 --2- 172.21.15.37:0/544940304 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f91940694c0 0x7f9194156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 >> 172.21.15.37:0/544940304 conn(0x7f919406b250 msgr2=0x7f9194070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 shutdown_connections 2023-07-09T21:42:45.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.008+0000 7f9199ebd640 1 -- 172.21.15.37:0/544940304 wait complete. 2023-07-09T21:42:45.031 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:42:45.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:45.098 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:45.146 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:42:45.147 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:45.147 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:45.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:45.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:45.184+0000 7fd2c0603180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:45.183 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:45.184+0000 7fe542193180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:42:45.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 Processor -- start 2023-07-09T21:42:45.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 -- start start 2023-07-09T21:42:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7effb806b120 0x7effb80ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb806efc0 con 0x7effb8158670 2023-07-09T21:42:45.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb806f4f0 con 0x7effb80aff40 2023-07-09T21:42:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbf6ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb806d390 con 0x7effb806b120 2023-07-09T21:42:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbd488640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7effb8158670 0x7effb80af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40688/0 (socket says 172.21.15.37:40688) 2023-07-09T21:42:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbd488640 1 -- 172.21.15.37:0/524957709 learned_addr learned my addr 172.21.15.37:0/524957709 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:45.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbdc89640 1 --2- 172.21.15.37:0/524957709 >> v2:172.21.15.119:3300/0 conn(0x7effb806b120 0x7effb80ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704792982 0 0) 0x7effb806efc0 con 0x7effb8158670 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa4003530 con 0x7effb8158670 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbdc89640 1 -- 172.21.15.37:0/524957709 >> v1:172.21.15.119:6789/0 conn(0x7effb80aff40 legacy=0x7effb815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2294369133 0 0) 0x7effb806f4f0 con 0x7effb80aff40 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbdc89640 1 -- 172.21.15.37:0/524957709 >> v1:172.21.15.37:6789/0 conn(0x7effb8158670 legacy=0x7effb80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.328+0000 7effbdc89640 1 -- 172.21.15.37:0/524957709 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb806fe90 con 0x7effb806b120 2023-07-09T21:42:45.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbdc89640 1 --2- 172.21.15.37:0/524957709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb80ca2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7effb0009dc0 tx=0x7effb001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55c6c45001eb0db5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00a5930 con 0x7effb806b120 2023-07-09T21:42:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00a5a90 con 0x7effb806b120 2023-07-09T21:42:45.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effaffff640 1 -- 172.21.15.37:0/524957709 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00a5e20 con 0x7effb806b120 2023-07-09T21:42:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 -- 172.21.15.37:0/524957709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 msgr2=0x7effb80ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 --2- 172.21.15.37:0/524957709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb80ca2f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7effb0009dc0 tx=0x7effb001c870 comp rx=0 tx=0).stop 2023-07-09T21:42:45.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 -- 172.21.15.37:0/524957709 shutdown_connections 2023-07-09T21:42:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 --2- 172.21.15.37:0/524957709 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb80ca2f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 -- 172.21.15.37:0/524957709 >> 172.21.15.37:0/524957709 conn(0x7effb80ca830 msgr2=0x7effb80cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 -- 172.21.15.37:0/524957709 shutdown_connections 2023-07-09T21:42:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.332+0000 7effbf6ec640 1 -- 172.21.15.37:0/524957709 wait complete. 2023-07-09T21:42:45.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 Processor -- start 2023-07-09T21:42:45.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- start start 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb814f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80aff40 0x7effb80b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb814c8b0 con 0x7effb8158670 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb814cde0 con 0x7effb806b120 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb814cb00 con 0x7effb80aff40 2023-07-09T21:42:45.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46476/0 (socket says 172.21.15.37:46476) 2023-07-09T21:42:45.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 -- 172.21.15.37:0/2870113723 learned_addr learned my addr 172.21.15.37:0/2870113723 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbd488640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb814f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbcc87640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80aff40 0x7effb80b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 -- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80aff40 msgr2=0x7effb80b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80aff40 0x7effb80b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 -- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 msgr2=0x7effb814f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb814f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 -- 172.21.15.37:0/2870113723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009a70 con 0x7effb8158670 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbd488640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbdc89640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7effb00b0040 tx=0x7effb0019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00add70 con 0x7effb8158670 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb0009450 con 0x7effb8158670 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb00b9650 con 0x7effb8158670 2023-07-09T21:42:45.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb814afb0 con 0x7effb8158670 2023-07-09T21:42:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.336+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb80ae450 con 0x7effb8158670 2023-07-09T21:42:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb804d7d0 con 0x7effb8158670 2023-07-09T21:42:45.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7effb00b97b0 con 0x7effb8158670 2023-07-09T21:42:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effadffb640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 0x7eff9c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7effb011f850 con 0x7effb8158670 2023-07-09T21:42:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effbd488640 1 -- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 msgr2=0x7eff9c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:45.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.340+0000 7effbd488640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 0x7eff9c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:45.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.344+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effb00eca90 con 0x7effb8158670 2023-07-09T21:42:45.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.504+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb814b460 con 0x7effb8158670 2023-07-09T21:42:45.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.504+0000 7effadffb640 1 -- 172.21.15.37:0/2870113723 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18901 (secure 0 0 0) 0x7effb00f00b0 con 0x7effb8158670 2023-07-09T21:42:45.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:45.506 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":145,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:41.926198+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1175733732":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/1486892791":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2922098575":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/131712359":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2004893287":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2270449245":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6833/2490760228":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6832/2490760228":"2023-07-10T21:42:41.926166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:45.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 msgr2=0x7eff9c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 0x7eff9c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 msgr2=0x7effb814e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7effb00b0040 tx=0x7effb0019610 comp rx=0 tx=0).stop 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 shutdown_connections 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7eff9c066430 0x7eff9c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effb8158670 0x7effb814e0d0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effb80aff40 0x7effb80b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 --2- 172.21.15.37:0/2870113723 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effb806b120 0x7effb814f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 >> 172.21.15.37:0/2870113723 conn(0x7effb80ca830 msgr2=0x7effb806b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 shutdown_connections 2023-07-09T21:42:45.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.508+0000 7effbf6ec640 1 -- 172.21.15.37:0/2870113723 wait complete. 2023-07-09T21:42:45.528 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:42:21.815158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:42:22.687899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:42:45.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:42:45.599 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:45.600+0000 7fd2c0603180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:45.632 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:45.632+0000 7fe542193180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:42:45.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.676+0000 7f85b2b82640 1 Processor -- start 2023-07-09T21:42:45.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b2b82640 1 -- start start 2023-07-09T21:42:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b2b82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f85ac160030 0x7f85ac0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b2b82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac15bf80 con 0x7f85ac0b7980 2023-07-09T21:42:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b2b82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0d02f0 con 0x7f85ac0cf290 2023-07-09T21:42:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b2b82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0cd070 con 0x7f85ac160030 2023-07-09T21:42:45.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b091e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85ac0b7980 0x7f85ac0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40696/0 (socket says 172.21.15.37:40696) 2023-07-09T21:42:45.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b091e640 1 -- 172.21.15.37:0/3550960693 learned_addr learned my addr 172.21.15.37:0/3550960693 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:45.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b111f640 1 --2- 172.21.15.37:0/3550960693 >> v2:172.21.15.119:3300/0 conn(0x7f85ac160030 0x7f85ac0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3160042661 0 0) 0x7f85a0001120 con 0x7f85ac0b7980 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859c003530 con 0x7f85ac0b7980 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413504228 0 0) 0x7f85ac0d02f0 con 0x7f85ac0cf290 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85a0001120 con 0x7f85ac0cf290 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b111f640 1 -- 172.21.15.37:0/3550960693 >> v1:172.21.15.119:6789/0 conn(0x7f85ac0cf290 legacy=0x7f85ac0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b111f640 1 -- 172.21.15.37:0/3550960693 >> v1:172.21.15.37:6789/0 conn(0x7f85ac0b7980 legacy=0x7f85ac0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.680+0000 7f85b111f640 1 -- 172.21.15.37:0/3550960693 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0cc7f0 con 0x7f85ac160030 2023-07-09T21:42:45.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b111f640 1 --2- 172.21.15.37:0/3550960693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac160030 0x7f85ac0d0e90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009d90 tx=0x7f85a401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b89f2de152807240 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:45.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5810 con 0x7f85ac160030 2023-07-09T21:42:45.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a5970 con 0x7f85ac160030 2023-07-09T21:42:45.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85ab7fe640 1 -- 172.21.15.37:0/3550960693 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5d00 con 0x7f85ac160030 2023-07-09T21:42:45.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 -- 172.21.15.37:0/3550960693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac160030 msgr2=0x7f85ac0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 --2- 172.21.15.37:0/3550960693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac160030 0x7f85ac0d0e90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009d90 tx=0x7f85a401c950 comp rx=0 tx=0).stop 2023-07-09T21:42:45.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 -- 172.21.15.37:0/3550960693 shutdown_connections 2023-07-09T21:42:45.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 --2- 172.21.15.37:0/3550960693 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac160030 0x7f85ac0d0e90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 -- 172.21.15.37:0/3550960693 >> 172.21.15.37:0/3550960693 conn(0x7f85ac073090 msgr2=0x7f85ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:45.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 -- 172.21.15.37:0/3550960693 shutdown_connections 2023-07-09T21:42:45.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 -- 172.21.15.37:0/3550960693 wait complete. 2023-07-09T21:42:45.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.684+0000 7f85b2b82640 1 Processor -- start 2023-07-09T21:42:45.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- start start 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 0x7f85ac150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac0cf290 0x7f85ac0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c6760 con 0x7f85ac160030 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c5e30 con 0x7f85ac0cf290 2023-07-09T21:42:45.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c6110 con 0x7f85ac0b7980 2023-07-09T21:42:45.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b111f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 0x7f85ac150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b111f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46482/0 (socket says 172.21.15.37:46482) 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b111f640 1 -- 172.21.15.37:0/958804884 learned_addr learned my addr 172.21.15.37:0/958804884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85abfff640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac0cf290 0x7f85ac0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 -- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac0cf290 msgr2=0x7f85ac0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac0cf290 0x7f85ac0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 -- 172.21.15.37:0/958804884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 msgr2=0x7f85ac15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 -- 172.21.15.37:0/958804884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4009a70 con 0x7f85ac0b7980 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b111f640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b091e640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 0x7f85ac150fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c700 tx=0x7f85a000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0005a60 con 0x7f85ac0b7980 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a0005bc0 con 0x7f85ac0b7980 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0007070 con 0x7f85ac0b7980 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac0c63f0 con 0x7f85ac0b7980 2023-07-09T21:42:45.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.688+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0c8960 con 0x7f85ac0b7980 2023-07-09T21:42:45.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac04d7d0 con 0x7f85ac0b7980 2023-07-09T21:42:45.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f85a00071d0 con 0x7f85ac0b7980 2023-07-09T21:42:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85a97fa640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 0x7f85900688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f85a0083660 con 0x7f85ac0b7980 2023-07-09T21:42:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85abfff640 1 -- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 msgr2=0x7f85900688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:45.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.692+0000 7f85abfff640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 0x7f85900688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:45.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.696+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85a0050860 con 0x7f85ac0b7980 2023-07-09T21:42:45.748 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:45.752+0000 7fd2c0603180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:45.806 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:45.804+0000 7fe542193180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:42:45.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.868+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85ac15bf80 con 0x7f85ac0b7980 2023-07-09T21:42:45.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.868+0000 7f85a97fa640 1 -- 172.21.15.37:0/958804884 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85ac15bf80 con 0x7f85ac0b7980 2023-07-09T21:42:45.869 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 msgr2=0x7f85900688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 0x7f85900688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 msgr2=0x7f85ac150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 0x7f85ac150fa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c700 tx=0x7f85a000cbc0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 shutdown_connections 2023-07-09T21:42:45.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f8590066430 0x7f85900688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac160030 0x7f85ac15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac0cf290 0x7f85ac0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 --2- 172.21.15.37:0/958804884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b7980 0x7f85ac150fa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 >> 172.21.15.37:0/958804884 conn(0x7f85ac073090 msgr2=0x7f85ac154680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 shutdown_connections 2023-07-09T21:42:45.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:45.872+0000 7f85b2b82640 1 -- 172.21.15.37:0/958804884 wait complete. 2023-07-09T21:42:45.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:42:46.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 Processor -- start 2023-07-09T21:42:46.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 -- start start 2023-07-09T21:42:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f80b7980 0x7f81f8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81f80ceb80 0x7f81f80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81f815bf80 con 0x7f81f80b3c20 2023-07-09T21:42:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f80cd070 con 0x7f81f80b7980 2023-07-09T21:42:46.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81ffe34640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81f80cfd70 con 0x7f81f80ceb80 2023-07-09T21:42:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f80b7980 0x7f81f8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81f80b7980 0x7f81f8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46484/0 (socket says 172.21.15.37:46484) 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 -- 172.21.15.37:0/2782423256 learned_addr learned my addr 172.21.15.37:0/2782423256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fd3cf640 1 --2- 172.21.15.37:0/2782423256 >> v2:172.21.15.119:3300/0 conn(0x7f81f80ceb80 0x7f81f80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 -- 172.21.15.37:0/2782423256 >> v2:172.21.15.119:3300/0 conn(0x7f81f80ceb80 msgr2=0x7f81f80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 --2- 172.21.15.37:0/2782423256 >> v2:172.21.15.119:3300/0 conn(0x7f81f80ceb80 0x7f81f80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 -- 172.21.15.37:0/2782423256 >> v1:172.21.15.119:6789/0 conn(0x7f81f80b3c20 legacy=0x7f81f80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.040+0000 7f81fdbd0640 1 -- 172.21.15.37:0/2782423256 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f8160570 con 0x7f81f80b7980 2023-07-09T21:42:46.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81fdbd0640 1 --2- 172.21.15.37:0/2782423256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b7980 0x7f81f8160030 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b4cd0 tx=0x7f81f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4c9b73dfb16788e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81fcbce640 1 -- 172.21.15.37:0/2782423256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40ab600 con 0x7f81f80b7980 2023-07-09T21:42:46.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81fcbce640 1 -- 172.21.15.37:0/2782423256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f40a7050 con 0x7f81f80b7980 2023-07-09T21:42:46.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81fcbce640 1 -- 172.21.15.37:0/2782423256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40ab980 con 0x7f81f80b7980 2023-07-09T21:42:46.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 -- 172.21.15.37:0/2782423256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b7980 msgr2=0x7f81f8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 --2- 172.21.15.37:0/2782423256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b7980 0x7f81f8160030 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f81f80b4cd0 tx=0x7f81f401c500 comp rx=0 tx=0).stop 2023-07-09T21:42:46.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 -- 172.21.15.37:0/2782423256 shutdown_connections 2023-07-09T21:42:46.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 --2- 172.21.15.37:0/2782423256 >> v2:172.21.15.119:3300/0 conn(0x7f81f80ceb80 0x7f81f80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 --2- 172.21.15.37:0/2782423256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b7980 0x7f81f8160030 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 -- 172.21.15.37:0/2782423256 >> 172.21.15.37:0/2782423256 conn(0x7f81f8073090 msgr2=0x7f81f8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 -- 172.21.15.37:0/2782423256 shutdown_connections 2023-07-09T21:42:46.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.044+0000 7f81ffe34640 1 -- 172.21.15.37:0/2782423256 wait complete. 2023-07-09T21:42:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 Processor -- start 2023-07-09T21:42:46.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 -- start start 2023-07-09T21:42:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81f80b7980 0x7f81f815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 0x7f81f815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815e530 con 0x7f81f80b3c20 2023-07-09T21:42:46.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815da30 con 0x7f81f80b7980 2023-07-09T21:42:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f815d500 con 0x7f81f80ceb80 2023-07-09T21:42:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46492/0 (socket says 172.21.15.37:46492) 2023-07-09T21:42:46.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 -- 172.21.15.37:0/1071065180 learned_addr learned my addr 172.21.15.37:0/1071065180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fd3cf640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81f80b7980 0x7f81f815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fe3d1640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 0x7f81f815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 -- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 msgr2=0x7f81f815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 0x7f81f815a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 -- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81f80b7980 msgr2=0x7f81f815e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81f80b7980 0x7f81f815e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 -- 172.21.15.37:0/1071065180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f40094d0 con 0x7f81f80b3c20 2023-07-09T21:42:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fe3d1640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 0x7f81f815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:46.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81fdbd0640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f81f4019110 tx=0x7f81f40192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40b37d0 con 0x7f81f80b3c20 2023-07-09T21:42:46.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f40b3930 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40b3ca0 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.048+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f815d750 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f815e150 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81f804d7d0 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f81f40b2070 con 0x7f81f80b3c20 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81ee7fc640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 0x7f81dc0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f81f411e460 con 0x7f81f80b3c20 2023-07-09T21:42:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81fd3cf640 1 -- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 msgr2=0x7f81dc0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:46.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.052+0000 7f81fd3cf640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 0x7f81dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:46.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.056+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81f40eb330 con 0x7f81f80b3c20 2023-07-09T21:42:46.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f81f8160570 con 0x7f81f80b3c20 2023-07-09T21:42:46.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ee7fc640 1 -- 172.21.15.37:0/1071065180 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f81f8160570 con 0x7f81f80b3c20 2023-07-09T21:42:46.213 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 msgr2=0x7f81dc0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 0x7f81dc0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 msgr2=0x7f81f80ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.212+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f81f4019110 tx=0x7f81f40192a0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 shutdown_connections 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f81dc066430 0x7f81dc0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81f80ceb80 0x7f81f815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81f80b7980 0x7f81f815e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 --2- 172.21.15.37:0/1071065180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81f80b3c20 0x7f81f80ca4e0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 >> 172.21.15.37:0/1071065180 conn(0x7f81f8073090 msgr2=0x7f81f80b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 shutdown_connections 2023-07-09T21:42:46.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.216+0000 7f81ffe34640 1 -- 172.21.15.37:0/1071065180 wait complete. 2023-07-09T21:42:46.226 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.228+0000 7fd2c0603180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:46.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:42:46.285 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.288+0000 7fd2c0603180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:46.326 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.324+0000 7fe542193180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:46.341 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.344+0000 7fd2c0603180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.380+0000 7fc37a69e640 1 Processor -- start 2023-07-09T21:42:46.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 -- start start 2023-07-09T21:42:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc37415f130 0x7fc3740b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740d0530 0x7fc3740cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3740b3bb0 con 0x7fc3740b74e0 2023-07-09T21:42:46.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3740b7960 con 0x7fc37415f130 2023-07-09T21:42:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc37a69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3740cccb0 con 0x7fc3740d0530 2023-07-09T21:42:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc37415f130 0x7fc3740b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc37415f130 0x7fc3740b6fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46502/0 (socket says 172.21.15.37:46502) 2023-07-09T21:42:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 -- 172.21.15.37:0/777030457 learned_addr learned my addr 172.21.15.37:0/777030457 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:46.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc378c3b640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740d0530 0x7fc3740cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 -- 172.21.15.37:0/777030457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740d0530 msgr2=0x7fc3740cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740d0530 0x7fc3740cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 -- 172.21.15.37:0/777030457 >> v1:172.21.15.119:6789/0 conn(0x7fc3740b74e0 legacy=0x7fc3740cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.384+0000 7fc373fff640 1 -- 172.21.15.37:0/777030457 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3740b8100 con 0x7fc37415f130 2023-07-09T21:42:46.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc373fff640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc3740b6fa0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc364009870 tx=0x7fc36401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e394634537b4bc85 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc372ffd640 1 -- 172.21.15.37:0/777030457 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640ab680 con 0x7fc37415f130 2023-07-09T21:42:46.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc372ffd640 1 -- 172.21.15.37:0/777030457 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3640ab7e0 con 0x7fc37415f130 2023-07-09T21:42:46.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc372ffd640 1 -- 172.21.15.37:0/777030457 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3640abb70 con 0x7fc37415f130 2023-07-09T21:42:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 -- 172.21.15.37:0/777030457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 msgr2=0x7fc3740b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc3740b6fa0 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fc364009870 tx=0x7fc36401c480 comp rx=0 tx=0).stop 2023-07-09T21:42:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 -- 172.21.15.37:0/777030457 shutdown_connections 2023-07-09T21:42:46.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740d0530 0x7fc3740cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 --2- 172.21.15.37:0/777030457 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc3740b6fa0 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 -- 172.21.15.37:0/777030457 >> 172.21.15.37:0/777030457 conn(0x7fc374072d20 msgr2=0x7fc3740d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 -- 172.21.15.37:0/777030457 shutdown_connections 2023-07-09T21:42:46.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fc37a69e640 1 -- 172.21.15.37:0/777030457 wait complete. 2023-07-09T21:42:46.390 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.388+0000 7fe542193180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:42:46.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 Processor -- start 2023-07-09T21:42:46.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- start start 2023-07-09T21:42:46.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 0x7fc37415d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3740d0530 0x7fc3741525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374152ae0 con 0x7fc37415f130 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc374153010 con 0x7fc3740d0530 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37415da70 con 0x7fc3740b74e0 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc373fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 0x7fc37415d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc3737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3740d0530 0x7fc3741525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc373fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 0x7fc37415d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:43922/0 (socket says 172.21.15.37:43922) 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46504/0 (socket says 172.21.15.37:46504) 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc373fff640 1 -- 172.21.15.37:0/2707516654 learned_addr learned my addr 172.21.15.37:0/2707516654 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 -- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 msgr2=0x7fc37415d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 0x7fc37415d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 -- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3740d0530 msgr2=0x7fc3741525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3740d0530 0x7fc3741525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 -- 172.21.15.37:0/2707516654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640094d0 con 0x7fc37415f130 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc378c3b640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00eb70 tx=0x7fc36c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c00cd20 con 0x7fc37415f130 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36c00f040 con 0x7fc37415f130 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc37415dd50 con 0x7fc37415f130 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36c0146c0 con 0x7fc37415f130 2023-07-09T21:42:46.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc37415e310 con 0x7fc37415f130 2023-07-09T21:42:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.392+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc374153230 con 0x7fc37415f130 2023-07-09T21:42:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.396+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fc36c014820 con 0x7fc37415f130 2023-07-09T21:42:46.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.396+0000 7fc370ff9640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 0x7fc3600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.396+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fc36c084ef0 con 0x7fc37415f130 2023-07-09T21:42:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.396+0000 7fc373fff640 1 -- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 msgr2=0x7fc3600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:46.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.396+0000 7fc373fff640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 0x7fc3600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:46.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.400+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc374153230 con 0x7fc37415f130 2023-07-09T21:42:46.428 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.428+0000 7fd2c0603180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:46.450 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.452+0000 7fe542193180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:42:46.486 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.488+0000 7fd2c0603180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:46.543 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.544+0000 7fe542193180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:42:46.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.556+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc3741531d0 con 0x7fc37415f130 2023-07-09T21:42:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.556+0000 7fc370ff9640 1 -- 172.21.15.37:0/2707516654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v145) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc36c018020 con 0x7fc37415f130 2023-07-09T21:42:46.558 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:42:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 msgr2=0x7fc3600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 0x7fc3600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 msgr2=0x7fc37415a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00eb70 tx=0x7fc36c00c490 comp rx=0 tx=0).stop 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 shutdown_connections 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7fc360066430 0x7fc3600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc37415f130 0x7fc37415a080 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3740d0530 0x7fc3741525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 --2- 172.21.15.37:0/2707516654 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3740b74e0 0x7fc37415d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 >> 172.21.15.37:0/2707516654 conn(0x7fc374072d20 msgr2=0x7fc3740cde90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 shutdown_connections 2023-07-09T21:42:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.560+0000 7fc37a69e640 1 -- 172.21.15.37:0/2707516654 wait complete. 2023-07-09T21:42:46.570 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.572+0000 7fd2c0603180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:46.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:42:46.606 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.604+0000 7fe542193180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:42:46.626 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.628+0000 7fd2c0603180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:46.696 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.696+0000 7fe542193180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:42:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.728+0000 7f2718159640 1 Processor -- start 2023-07-09T21:42:46.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2718159640 1 -- start start 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2718159640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27100cf290 0x7f2710160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2718159640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271015bf80 con 0x7f27100b7980 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2718159640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2710160570 con 0x7f27100d0780 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2718159640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27100cd070 con 0x7f27100cf290 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2715ef5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f27100b7980 0x7f27100ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40708/0 (socket says 172.21.15.37:40708) 2023-07-09T21:42:46.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2715ef5640 1 -- 172.21.15.37:0/614136677 learned_addr learned my addr 172.21.15.37:0/614136677 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:46.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f27156f4640 1 --2- 172.21.15.37:0/614136677 >> v2:172.21.15.37:3300/0 conn(0x7f27100cf290 0x7f2710160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f27156f4640 1 -- 172.21.15.37:0/614136677 >> v1:172.21.15.119:6789/0 conn(0x7f27100d0780 legacy=0x7f27100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f27156f4640 1 -- 172.21.15.37:0/614136677 >> v1:172.21.15.37:6789/0 conn(0x7f27100b7980 legacy=0x7f27100ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f27156f4640 1 -- 172.21.15.37:0/614136677 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27100d02f0 con 0x7f27100cf290 2023-07-09T21:42:46.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.732+0000 7f2714ef3640 1 -- 172.21.15.37:0/614136677 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925160500 0 0) 0x7f270c001120 con 0x7f27100b7980 2023-07-09T21:42:46.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f27156f4640 1 --2- 172.21.15.37:0/614136677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100cf290 0x7f2710160030 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f27000097c0 tx=0x7f270001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e1db231a6efa83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2714ef3640 1 -- 172.21.15.37:0/614136677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000ab600 con 0x7f27100cf290 2023-07-09T21:42:46.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2714ef3640 1 -- 172.21.15.37:0/614136677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27000a7050 con 0x7f27100cf290 2023-07-09T21:42:46.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2714ef3640 1 -- 172.21.15.37:0/614136677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000ab980 con 0x7f27100cf290 2023-07-09T21:42:46.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- 172.21.15.37:0/614136677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100cf290 msgr2=0x7f2710160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 --2- 172.21.15.37:0/614136677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100cf290 0x7f2710160030 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f27000097c0 tx=0x7f270001c480 comp rx=0 tx=0).stop 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- 172.21.15.37:0/614136677 shutdown_connections 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 --2- 172.21.15.37:0/614136677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100cf290 0x7f2710160030 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- 172.21.15.37:0/614136677 >> 172.21.15.37:0/614136677 conn(0x7f2710073090 msgr2=0x7f2710069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- 172.21.15.37:0/614136677 shutdown_connections 2023-07-09T21:42:46.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- 172.21.15.37:0/614136677 wait complete. 2023-07-09T21:42:46.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 Processor -- start 2023-07-09T21:42:46.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.736+0000 7f2718159640 1 -- start start 2023-07-09T21:42:46.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27100cf290 0x7f27100c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27100d0780 0x7f2710155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710156f50 con 0x7f27100b7980 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2710157230 con 0x7f27100cf290 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27101553c0 con 0x7f27100d0780 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46514/0 (socket says 172.21.15.37:46514) 2023-07-09T21:42:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 -- 172.21.15.37:0/2448816042 learned_addr learned my addr 172.21.15.37:0/2448816042 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f27156f4640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27100cf290 0x7f27100c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f27166f6640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27100d0780 0x7f2710155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 -- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27100d0780 msgr2=0x7f2710155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27100d0780 0x7f2710155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 -- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27100cf290 msgr2=0x7f27100c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27100cf290 0x7f27100c72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 -- 172.21.15.37:0/2448816042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2700009420 con 0x7f27100b7980 2023-07-09T21:42:46.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2715ef5640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c780 tx=0x7f270c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0072d0 con 0x7f27100b7980 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c007430 con 0x7f27100b7980 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27101556a0 con 0x7f27100b7980 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c001d20 con 0x7f27100b7980 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27100b2490 con 0x7f27100b7980 2023-07-09T21:42:46.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.740+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2710157450 con 0x7f27100b7980 2023-07-09T21:42:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.744+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f270c0047f0 con 0x7f27100b7980 2023-07-09T21:42:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.744+0000 7f27067fc640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 0x7f26f40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.744+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f270c0835a0 con 0x7f27100b7980 2023-07-09T21:42:46.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.744+0000 7f27156f4640 1 -- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 msgr2=0x7f26f40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:46.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.744+0000 7f27156f4640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 0x7f26f40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.752+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f270c0506e0 con 0x7f27100b7980 2023-07-09T21:42:46.761 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.760+0000 7fe542193180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:42:46.767 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.768+0000 7fd2c0603180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:46.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:46.828+0000 7fd2c0603180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:46.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f271015d0e0 con 0x7f27100b7980 2023-07-09T21:42:46.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f27067fc640 1 -- 172.21.15.37:0/2448816042 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v145) v1 ==== 100+0+11 (secure 0 0 0) 0x7f270c053d00 con 0x7f27100b7980 2023-07-09T21:42:46.909 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:42:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 msgr2=0x7f26f40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 0x7f26f40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 msgr2=0x7f27100b1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:46.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f270c00c780 tx=0x7f270c00cc40 comp rx=0 tx=0).stop 2023-07-09T21:42:46.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 shutdown_connections 2023-07-09T21:42:46.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f26f4066430 0x7f26f40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27100d0780 0x7f2710155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27100cf290 0x7f27100c72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 --2- 172.21.15.37:0/2448816042 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27100b7980 0x7f27100b1f50 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:46.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 >> 172.21.15.37:0/2448816042 conn(0x7f2710073090 msgr2=0x7f27100d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:46.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 shutdown_connections 2023-07-09T21:42:46.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:46.908+0000 7f2718159640 1 -- 172.21.15.37:0/2448816042 wait complete. 2023-07-09T21:42:46.914 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.912+0000 7fe542193180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:42:46.931 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:42:46.978 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:46.976+0000 7fe542193180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:42:47.065 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:47.066 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:47.066 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:47.073 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:47.076+0000 7fd2c0603180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.120+0000 7f29d0959640 1 Processor -- start 2023-07-09T21:42:47.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.120+0000 7f29d0959640 1 -- start start 2023-07-09T21:42:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.120+0000 7f29d0959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.120+0000 7f29d0959640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29cc0b47a0 0x7f29cc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:43942/0 (socket says 172.21.15.37:43942) 2023-07-09T21:42:47.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29d0959640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 0x7f29cc15f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 -- 172.21.15.37:0/2001483500 learned_addr learned my addr 172.21.15.37:0/2001483500 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0b45b0 con 0x7f29cc0b4140 2023-07-09T21:42:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29cc0cef80 con 0x7f29cc0b47a0 2023-07-09T21:42:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0cf260 con 0x7f29cc0b7a60 2023-07-09T21:42:47.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29c3fff640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.119:3300/0 conn(0x7f29cc0b47a0 0x7f29cc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 -- 172.21.15.37:0/2001483500 >> v2:172.21.15.119:3300/0 conn(0x7f29cc0b47a0 msgr2=0x7f29cc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.119:3300/0 conn(0x7f29cc0b47a0 0x7f29cc0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29cad9d640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 0x7f29cc15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 -- 172.21.15.37:0/2001483500 >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 msgr2=0x7f29cc15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:47.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 0x7f29cc15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.124+0000 7f29ca59c640 1 -- 172.21.15.37:0/2001483500 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29cc0cf540 con 0x7f29cc0b7a60 2023-07-09T21:42:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.128+0000 7f29cad9d640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 0x7f29cc15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:47.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.128+0000 7f29ca59c640 1 --2- 172.21.15.37:0/2001483500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0699b0 tx=0x7f29bc01c260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60fb6f0e3283efc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.128+0000 7f29c9d9b640 1 -- 172.21.15.37:0/2001483500 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0ab600 con 0x7f29cc0b7a60 2023-07-09T21:42:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.128+0000 7f29c9d9b640 1 -- 172.21.15.37:0/2001483500 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a7050 con 0x7f29cc0b7a60 2023-07-09T21:42:47.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.128+0000 7f29c9d9b640 1 -- 172.21.15.37:0/2001483500 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0ab9c0 con 0x7f29cc0b7a60 2023-07-09T21:42:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 msgr2=0x7f29cc0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 --2- 172.21.15.37:0/2001483500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0699b0 tx=0x7f29bc01c260 comp rx=0 tx=0).stop 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 shutdown_connections 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.37:3300/0 conn(0x7f29cc0b4140 0x7f29cc15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 --2- 172.21.15.37:0/2001483500 >> v2:172.21.15.119:3300/0 conn(0x7f29cc0b47a0 0x7f29cc0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 --2- 172.21.15.37:0/2001483500 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0cc7d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 >> 172.21.15.37:0/2001483500 conn(0x7f29cc073050 msgr2=0x7f29cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 shutdown_connections 2023-07-09T21:42:47.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.132+0000 7f29d0959640 1 -- 172.21.15.37:0/2001483500 wait complete. 2023-07-09T21:42:47.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 Processor -- start 2023-07-09T21:42:47.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 -- start start 2023-07-09T21:42:47.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 0x7f29cc0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0ccaa0 con 0x7f29cc0b4140 2023-07-09T21:42:47.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0b24f0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29d0959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29cc0b27b0 con 0x7f29cc0b7a60 2023-07-09T21:42:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35950/0 (socket says 172.21.15.37:35950) 2023-07-09T21:42:47.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 -- 172.21.15.37:0/3379890680 learned_addr learned my addr 172.21.15.37:0/3379890680 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29cad9d640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29ca59c640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 0x7f29cc0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 msgr2=0x7f29cc0c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 msgr2=0x7f29cc0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 0x7f29cc0cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 -- 172.21.15.37:0/3379890680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0094d0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29ca59c640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 0x7f29cc0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.136+0000 7f29c3fff640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f29b400e930 tx=0x7f29b400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b4009690 con 0x7f29cc0b47a0 2023-07-09T21:42:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b400ca00 con 0x7f29cc0b47a0 2023-07-09T21:42:47.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29cc0b2a90 con 0x7f29cc0b47a0 2023-07-09T21:42:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b400cd70 con 0x7f29cc0b47a0 2023-07-09T21:42:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29cc0b3050 con 0x7f29cc0b47a0 2023-07-09T21:42:47.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.140+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f29b4013470 con 0x7f29cc0b47a0 2023-07-09T21:42:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.144+0000 7f29c2ffd640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 0x7f29ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.144+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f29b40842d0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.144+0000 7f29ca59c640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 msgr2=0x7f29ac068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:47.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.144+0000 7f29ca59c640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 0x7f29ac068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:47.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.144+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29cc0cdaa0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.148+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29b40514f0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.208 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:47.212+0000 7fd2c0603180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:47.235 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:42:47.235 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:42:47.236 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:42:47.244 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:47.244+0000 7fe542193180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:42:47.335 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:47.336+0000 7fd2c0603180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:47.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.348+0000 7f29ca59c640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 msgr2=0x7f29ac068930 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:47.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.348+0000 7f29ca59c640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 0x7f29ac068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:42:47.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f29cc04d7d0 con 0x7f29cc0b47a0 2023-07-09T21:42:47.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29c2ffd640 1 -- 172.21.15.37:0/3379890680 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v145) v1 ==== 80+0+477 (secure 0 0 0) 0x7f29b4021020 con 0x7f29cc0b47a0 2023-07-09T21:42:47.353 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1175733732 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.354 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1486892791 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.354 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2922098575 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.354 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/131712359 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.354 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2004893287 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.355 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2270449245 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.355 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/2490760228 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.355 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/2490760228 2023-07-10T21:42:41.926166+0000 2023-07-09T21:42:47.356 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T21:42:47.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 msgr2=0x7f29ac068930 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:47.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 0x7f29ac068930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 msgr2=0x7f29cc0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f29b400e930 tx=0x7f29b400edf0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 shutdown_connections 2023-07-09T21:42:47.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f29ac066480 0x7f29ac068930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29cc0b7a60 0x7f29cc0c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f29cc0b47a0 0x7f29cc0c7b70 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 --2- 172.21.15.37:0/3379890680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29cc0b4140 0x7f29cc0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 >> 172.21.15.37:0/3379890680 conn(0x7f29cc073050 msgr2=0x7f29cc0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 shutdown_connections 2023-07-09T21:42:47.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.352+0000 7f29d0959640 1 -- 172.21.15.37:0/3379890680 wait complete. 2023-07-09T21:42:47.374 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:42:47.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:47.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:42:47.389 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:47.388+0000 7fe542193180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:47.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[61252]: fuse finished with error 0 and tester_r 0 2023-07-09T21:42:47.396 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:42:47.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:47.397 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:42:47.405 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:47.408+0000 7fd2c0603180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:47.509 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:47.510 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:47.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:47.519 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:42:47.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:47.520 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:42:47.523 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:47.524+0000 7fe542193180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:42:47.540 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:47.544+0000 7fd2c0603180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:47.547 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:42:47.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:47.549 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:47.549 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:47.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:47.558 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:42:47.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:47.559 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:42:47.597 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:47.596+0000 7fe542193180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:42:47.606 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:42:47.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:47.607 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:47.608 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:47.616 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:47.616 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:42:47.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:42:47.617 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:42:47.672 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:42:47.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:42:47.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:47.740 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:47.740+0000 7fe542193180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:42:47.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.816+0000 7f50872ec640 1 Processor -- start 2023-07-09T21:42:47.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.816+0000 7f50872ec640 1 -- start start 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f50872ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50800b7ab0 0x7f508006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f50872ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50800b4340 0x7f50800d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f50872ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50800b49f0 con 0x7f50800cef80 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f50872ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50800b7e80 con 0x7f50800b4340 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f50872ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50800cc8a0 con 0x7f50800b7ab0 2023-07-09T21:42:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50800b4340 0x7f50800d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50800b4340 0x7f50800d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39550/0 (socket says 172.21.15.37:39550) 2023-07-09T21:42:47.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 -- 172.21.15.37:0/1232116776 learned_addr learned my addr 172.21.15.37:0/1232116776 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:47.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085088640 1 --2- 172.21.15.37:0/1232116776 >> v2:172.21.15.119:3300/0 conn(0x7f50800b7ab0 0x7f508006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 -- 172.21.15.37:0/1232116776 >> v2:172.21.15.119:3300/0 conn(0x7f50800b7ab0 msgr2=0x7f508006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:47.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 --2- 172.21.15.37:0/1232116776 >> v2:172.21.15.119:3300/0 conn(0x7f50800b7ab0 0x7f508006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 -- 172.21.15.37:0/1232116776 >> v1:172.21.15.119:6789/0 conn(0x7f50800cef80 legacy=0x7f50800b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.820+0000 7f5085889640 1 -- 172.21.15.37:0/1232116776 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800ccb80 con 0x7f50800b4340 2023-07-09T21:42:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f5085889640 1 --2- 172.21.15.37:0/1232116776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800d02a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f508006b360 tx=0x7f507801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a192c93cd51210 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f5077fff640 1 -- 172.21.15.37:0/1232116776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50780a5860 con 0x7f50800b4340 2023-07-09T21:42:47.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f5077fff640 1 -- 172.21.15.37:0/1232116776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50780a59c0 con 0x7f50800b4340 2023-07-09T21:42:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f5077fff640 1 -- 172.21.15.37:0/1232116776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50780a5d50 con 0x7f50800b4340 2023-07-09T21:42:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 -- 172.21.15.37:0/1232116776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 msgr2=0x7f50800d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 --2- 172.21.15.37:0/1232116776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800d02a0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f508006b360 tx=0x7f507801c9a0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 -- 172.21.15.37:0/1232116776 shutdown_connections 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 --2- 172.21.15.37:0/1232116776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800d02a0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 --2- 172.21.15.37:0/1232116776 >> v2:172.21.15.119:3300/0 conn(0x7f50800b7ab0 0x7f508006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 -- 172.21.15.37:0/1232116776 >> 172.21.15.37:0/1232116776 conn(0x7f5080073090 msgr2=0x7f5080069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 -- 172.21.15.37:0/1232116776 shutdown_connections 2023-07-09T21:42:47.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.824+0000 7f50872ec640 1 -- 172.21.15.37:0/1232116776 wait complete. 2023-07-09T21:42:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 Processor -- start 2023-07-09T21:42:47.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 -- start start 2023-07-09T21:42:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50800b7ab0 0x7f50800c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50800cef80 0x7f50800cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080150df0 con 0x7f50800b4340 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50801569f0 con 0x7f50800b7ab0 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f50872ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50801501e0 con 0x7f50800cef80 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f5085088640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f5085088640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39556/0 (socket says 172.21.15.37:39556) 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f5085088640 1 -- 172.21.15.37:0/2147859332 learned_addr learned my addr 172.21.15.37:0/2147859332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f5084887640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50800b7ab0 0x7f50800c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.828+0000 7f5085889640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50800cef80 0x7f50800cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 -- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50800cef80 msgr2=0x7f50800cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50800cef80 0x7f50800cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 -- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50800b7ab0 msgr2=0x7f50800c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50800b7ab0 0x7f50800c97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 -- 172.21.15.37:0/2147859332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078009b30 con 0x7f50800b4340 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5085088640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e930 tx=0x7f507c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c009690 con 0x7f50800b4340 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c00ca00 con 0x7f50800b4340 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c00cd70 con 0x7f50800b4340 2023-07-09T21:42:47.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50801504c0 con 0x7f50800b4340 2023-07-09T21:42:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5080150a80 con 0x7f50800b4340 2023-07-09T21:42:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508004d7d0 con 0x7f50800b4340 2023-07-09T21:42:47.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f507c013470 con 0x7f50800b4340 2023-07-09T21:42:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 0x7f50640688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.832+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f507c084360 con 0x7f50800b4340 2023-07-09T21:42:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.836+0000 7f5084887640 1 -- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 msgr2=0x7f50640688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:47.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.836+0000 7f5084887640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 0x7f50640688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:47.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:47.836+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f507c051560 con 0x7f50800b4340 2023-07-09T21:42:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.024+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f508006a830 con 0x7f50800b4340 2023-07-09T21:42:48.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.024+0000 7f5075ffb640 1 -- 172.21.15.37:0/2147859332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f507c054b80 con 0x7f50800b4340 2023-07-09T21:42:48.026 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:48.026 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:48.026 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:48.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 msgr2=0x7f50640688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 0x7f50640688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 msgr2=0x7f50800c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e930 tx=0x7f507c00edf0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 shutdown_connections 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f5064066430 0x7f50640688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50800cef80 0x7f50800cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50800b7ab0 0x7f50800c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 --2- 172.21.15.37:0/2147859332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50800b4340 0x7f50800c9280 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 >> 172.21.15.37:0/2147859332 conn(0x7f5080073090 msgr2=0x7f50800d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 shutdown_connections 2023-07-09T21:42:48.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.028+0000 7f50872ec640 1 -- 172.21.15.37:0/2147859332 wait complete. 2023-07-09T21:42:48.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:48.079 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.080+0000 7fd2c0603180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:48.164 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.164+0000 7fd2c0603180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:48.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 Processor -- start 2023-07-09T21:42:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 -- start start 2023-07-09T21:42:48.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80b49f0 con 0x7f99b80b4170 2023-07-09T21:42:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80b7e80 con 0x7f99b80b7ab0 2023-07-09T21:42:48.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99bde93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b4610 con 0x7f99b80cef80 2023-07-09T21:42:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:43438/0 (socket says 172.21.15.37:43438) 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:41768/0 (socket says 172.21.15.37:41768) 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b77fe640 1 -- 172.21.15.37:0/1589235030 learned_addr learned my addr 172.21.15.37:0/1589235030 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 -- 172.21.15.37:0/1589235030 >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 msgr2=0x7f99b806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 --2- 172.21.15.37:0/1589235030 >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 -- 172.21.15.37:0/1589235030 >> v1:172.21.15.119:6789/0 conn(0x7f99b80b4170 legacy=0x7f99b815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b6ffd640 1 -- 172.21.15.37:0/1589235030 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b80cc8a0 con 0x7f99b80cef80 2023-07-09T21:42:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.196+0000 7f99b77fe640 1 --2- 172.21.15.37:0/1589235030 >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:48.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99b6ffd640 1 --2- 172.21.15.37:0/1589235030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0097c0 tx=0x7f99ac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ebca54f2b24559 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99b67fc640 1 -- 172.21.15.37:0/1589235030 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0ab650 con 0x7f99b80cef80 2023-07-09T21:42:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99b67fc640 1 -- 172.21.15.37:0/1589235030 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac0ab7b0 con 0x7f99b80cef80 2023-07-09T21:42:48.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99b67fc640 1 -- 172.21.15.37:0/1589235030 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0abb40 con 0x7f99b80cef80 2023-07-09T21:42:48.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 -- 172.21.15.37:0/1589235030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 msgr2=0x7f99b80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 --2- 172.21.15.37:0/1589235030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f99ac0097c0 tx=0x7f99ac01c450 comp rx=0 tx=0).stop 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 -- 172.21.15.37:0/1589235030 shutdown_connections 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 --2- 172.21.15.37:0/1589235030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80cef80 0x7f99b80b3c30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 --2- 172.21.15.37:0/1589235030 >> v2:172.21.15.119:3300/0 conn(0x7f99b80b7ab0 0x7f99b806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 -- 172.21.15.37:0/1589235030 >> 172.21.15.37:0/1589235030 conn(0x7f99b8073090 msgr2=0x7f99b8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 -- 172.21.15.37:0/1589235030 shutdown_connections 2023-07-09T21:42:48.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.200+0000 7f99bde93640 1 -- 172.21.15.37:0/1589235030 wait complete. 2023-07-09T21:42:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 Processor -- start 2023-07-09T21:42:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- start start 2023-07-09T21:42:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b80b7ab0 0x7f99b8149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 0x7f99b80ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b814ba90 con 0x7f99b80cef80 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b6df0 con 0x7f99b80b7ab0 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b6830 con 0x7f99b80b4170 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 0x7f99b80ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b6ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b80b7ab0 0x7f99b8149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:41778/0 (socket says 172.21.15.37:41778) 2023-07-09T21:42:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 0x7f99b80ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39572/0 (socket says 172.21.15.37:39572) 2023-07-09T21:42:48.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 -- 172.21.15.37:0/1331369713 learned_addr learned my addr 172.21.15.37:0/1331369713 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 -- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b80b7ab0 msgr2=0x7f99b8149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b80b7ab0 0x7f99b8149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 -- 172.21.15.37:0/1331369713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 msgr2=0x7f99b80ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 0x7f99b80ca5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 -- 172.21.15.37:0/1331369713 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80094d0 con 0x7f99b80b4170 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99b77fe640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99a800e9d0 tx=0x7f99a800ee90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800ca60 con 0x7f99b80b4170 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800cbc0 con 0x7f99b80b4170 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ac009420 con 0x7f99b80b4170 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8013470 con 0x7f99b80b4170 2023-07-09T21:42:48.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.204+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b814a870 con 0x7f99b80b4170 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b804d7d0 con 0x7f99b80b4170 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f99a80135d0 con 0x7f99b80b4170 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f999ffff640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 0x7f99a40688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f99a80843c0 con 0x7f99b80b4170 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f99b6ffd640 1 -- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 msgr2=0x7f99a40688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:48.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.208+0000 7f99b6ffd640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 0x7f99a40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:48.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.212+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99a8051590 con 0x7f99b80b4170 2023-07-09T21:42:48.313 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.316+0000 7fd2c0603180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:48.334 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:48.332+0000 7fe542193180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:42:48.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b806a830 con 0x7f99b80b4170 2023-07-09T21:42:48.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f999ffff640 1 -- 172.21.15.37:0/1331369713 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+18901 (secure 0 0 0) 0x7f99a8054bb0 con 0x7f99b80b4170 2023-07-09T21:42:48.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:48.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":145,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:41.926198+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1175733732":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/1486892791":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2922098575":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/131712359":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2004893287":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2270449245":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6833/2490760228":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6832/2490760228":"2023-07-10T21:42:41.926166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 msgr2=0x7f99a40688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 0x7f99a40688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 msgr2=0x7f99b814b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.376+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f99a800e9d0 tx=0x7f99a800ee90 comp rx=0 tx=0).stop 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 shutdown_connections 2023-07-09T21:42:48.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f99a4066430 0x7f99a40688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99b80cef80 0x7f99b80ca5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99b80b7ab0 0x7f99b8149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 --2- 172.21.15.37:0/1331369713 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99b80b4170 0x7f99b814b070 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 >> 172.21.15.37:0/1331369713 conn(0x7f99b8073090 msgr2=0x7f99b80b2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 shutdown_connections 2023-07-09T21:42:48.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.380+0000 7f99bde93640 1 -- 172.21.15.37:0/1331369713 wait complete. 2023-07-09T21:42:48.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:42:21.815158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '143', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:42:22.687899+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '144', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:42:48.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:42:48.401 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.404+0000 7fd2c0603180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:48.429 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:48.428+0000 7fe542193180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:42:48.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 Processor -- start 2023-07-09T21:42:48.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 -- start start 2023-07-09T21:42:48.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30a00b7980 0x7f30a0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f30a00d0780 0x7f30a00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a015bf80 con 0x7f30a00ceb80 2023-07-09T21:42:48.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00cd070 con 0x7f30a00b7980 2023-07-09T21:42:48.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f30a529e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00cfd70 con 0x7f30a00d0780 2023-07-09T21:42:48.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f30a00b7980 0x7f30a0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f30a00ceb80 0x7f30a00cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51578/0 (socket says 172.21.15.37:51578) 2023-07-09T21:42:48.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309e7fc640 1 -- 172.21.15.37:0/3633004356 learned_addr learned my addr 172.21.15.37:0/3633004356 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309f7fe640 1 --2- 172.21.15.37:0/3633004356 >> v2:172.21.15.119:3300/0 conn(0x7f30a00d0780 0x7f30a00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309effd640 1 -- 172.21.15.37:0/3633004356 >> v2:172.21.15.119:3300/0 conn(0x7f30a00d0780 msgr2=0x7f30a00d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:48.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309effd640 1 --2- 172.21.15.37:0/3633004356 >> v2:172.21.15.119:3300/0 conn(0x7f30a00d0780 0x7f30a00d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309effd640 1 -- 172.21.15.37:0/3633004356 >> v1:172.21.15.37:6789/0 conn(0x7f30a00ceb80 legacy=0x7f30a00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.548+0000 7f309effd640 1 -- 172.21.15.37:0/3633004356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0160570 con 0x7f30a00b7980 2023-07-09T21:42:48.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f309effd640 1 --2- 172.21.15.37:0/3633004356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0160030 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b1240 tx=0x7f309001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63faaf482e2a319c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f309dffb640 1 -- 172.21.15.37:0/3633004356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900ab600 con 0x7f30a00b7980 2023-07-09T21:42:48.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f309dffb640 1 -- 172.21.15.37:0/3633004356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30900a7050 con 0x7f30a00b7980 2023-07-09T21:42:48.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f309dffb640 1 -- 172.21.15.37:0/3633004356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900ab980 con 0x7f30a00b7980 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 -- 172.21.15.37:0/3633004356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 msgr2=0x7f30a0160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 --2- 172.21.15.37:0/3633004356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0160030 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f30a00b1240 tx=0x7f309001c460 comp rx=0 tx=0).stop 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 -- 172.21.15.37:0/3633004356 shutdown_connections 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 --2- 172.21.15.37:0/3633004356 >> v2:172.21.15.119:3300/0 conn(0x7f30a00d0780 0x7f30a00d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 --2- 172.21.15.37:0/3633004356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0160030 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 -- 172.21.15.37:0/3633004356 >> 172.21.15.37:0/3633004356 conn(0x7f30a0073090 msgr2=0x7f30a0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 -- 172.21.15.37:0/3633004356 shutdown_connections 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.552+0000 7f30a529e640 1 -- 172.21.15.37:0/3633004356 wait complete. 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 Processor -- start 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- start start 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a00ceb80 0x7f30a00b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30a00d0780 0x7f30a00b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01553e0 con 0x7f30a00b7980 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c6dd0 con 0x7f30a00ceb80 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c6810 con 0x7f30a00d0780 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39604/0 (socket says 172.21.15.37:39604) 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 -- 172.21.15.37:0/2800885653 learned_addr learned my addr 172.21.15.37:0/2800885653 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:48.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309e7fc640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a00ceb80 0x7f30a00b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309f7fe640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30a00d0780 0x7f30a00b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 -- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30a00d0780 msgr2=0x7f30a00b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30a00d0780 0x7f30a00b5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 -- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a00ceb80 msgr2=0x7f30a00b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a00ceb80 0x7f30a00b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 -- 172.21.15.37:0/2800885653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090009420 con 0x7f30a00b7980 2023-07-09T21:42:48.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f309effd640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f30900ae040 tx=0x7f3090019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900b4840 con 0x7f30a00b7980 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a00c6af0 con 0x7f30a00b7980 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30900b49c0 con 0x7f30a00b7980 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900b4d70 con 0x7f30a00b7980 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.556+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a0153e80 con 0x7f30a00b7980 2023-07-09T21:42:48.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a0155240 con 0x7f30a00b7980 2023-07-09T21:42:48.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 63) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f30900b2040 con 0x7f30a00b7980 2023-07-09T21:42:48.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f30877fe640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 0x7f308c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f309011e3a0 con 0x7f30a00b7980 2023-07-09T21:42:48.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f309e7fc640 1 -- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 msgr2=0x7f308c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3341716483 2023-07-09T21:42:48.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.560+0000 7f309e7fc640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 0x7f308c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:42:48.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.564+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f30a0155240 con 0x7f30a00b7980 2023-07-09T21:42:48.589 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:48.588+0000 7fe542193180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:42:48.671 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.672+0000 7fd2c0603180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:48.678 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:48.676+0000 7fe542193180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:42:48.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.720+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30a00cd600 con 0x7f30a00b7980 2023-07-09T21:42:48.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.720+0000 7f30877fe640 1 -- 172.21.15.37:0/2800885653 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30a00cd600 con 0x7f30a00b7980 2023-07-09T21:42:48.722 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 msgr2=0x7f308c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 0x7f308c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 msgr2=0x7f30a0153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f30900ae040 tx=0x7f3090019200 comp rx=0 tx=0).stop 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 shutdown_connections 2023-07-09T21:42:48.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:6832/3341716483,v1:172.21.15.119:6833/3341716483] conn(0x7f308c066430 0x7f308c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f30a00d0780 0x7f30a00b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f30a00ceb80 0x7f30a00b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 --2- 172.21.15.37:0/2800885653 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f30a00b7980 0x7f30a0153940 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 >> 172.21.15.37:0/2800885653 conn(0x7f30a0073090 msgr2=0x7f30a00cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 shutdown_connections 2023-07-09T21:42:48.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.724+0000 7f30a529e640 1 -- 172.21.15.37:0/2800885653 wait complete. 2023-07-09T21:42:48.730 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.732+0000 7fd2c0603180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:48.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:42:48.816 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.816+0000 7fd24c782640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.816 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd24c782640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd24c782640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd24c782640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd24c782640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd248f7b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd248f7b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd248f7b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.817 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd248f7b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.818 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:42:48.820+0000 7fd248f7b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:42:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 Processor -- start 2023-07-09T21:42:48.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 -- start start 2023-07-09T21:42:48.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb54c0cf290 0x7fb54c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb54c0d0780 0x7fb54c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c15bf80 con 0x7fb54c0b7980 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0cd070 con 0x7fb54c0d0780 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb55325c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c0cfd70 con 0x7fb54c0cf290 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb550ff8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb54c0b7980 0x7fb54c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51588/0 (socket says 172.21.15.37:51588) 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb550ff8640 1 -- 172.21.15.37:0/1440743109 learned_addr learned my addr 172.21.15.37:0/1440743109 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:48.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb5517f9640 1 --2- 172.21.15.37:0/1440743109 >> v2:172.21.15.37:3300/0 conn(0x7fb54c0d0780 0x7fb54c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb54bfff640 1 --2- 172.21.15.37:0/1440743109 >> v2:172.21.15.119:3300/0 conn(0x7fb54c0cf290 0x7fb54c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb5517f9640 1 -- 172.21.15.37:0/1440743109 >> v2:172.21.15.119:3300/0 conn(0x7fb54c0cf290 msgr2=0x7fb54c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb5517f9640 1 --2- 172.21.15.37:0/1440743109 >> v2:172.21.15.119:3300/0 conn(0x7fb54c0cf290 0x7fb54c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb5517f9640 1 -- 172.21.15.37:0/1440743109 >> v1:172.21.15.37:6789/0 conn(0x7fb54c0b7980 legacy=0x7fb54c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.940+0000 7fb5517f9640 1 -- 172.21.15.37:0/1440743109 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c160570 con 0x7fb54c0d0780 2023-07-09T21:42:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb5517f9640 1 --2- 172.21.15.37:0/1440743109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d0780 0x7fb54c0d0b80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0b4cd0 tx=0x7fb54401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba36aae84d452ce8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb54b7fe640 1 -- 172.21.15.37:0/1440743109 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a57d0 con 0x7fb54c0d0780 2023-07-09T21:42:48.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb54b7fe640 1 -- 172.21.15.37:0/1440743109 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5440a5930 con 0x7fb54c0d0780 2023-07-09T21:42:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb54b7fe640 1 -- 172.21.15.37:0/1440743109 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5440a5cc0 con 0x7fb54c0d0780 2023-07-09T21:42:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 -- 172.21.15.37:0/1440743109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d0780 msgr2=0x7fb54c0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 --2- 172.21.15.37:0/1440743109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d0780 0x7fb54c0d0b80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0b4cd0 tx=0x7fb54401c910 comp rx=0 tx=0).stop 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 -- 172.21.15.37:0/1440743109 shutdown_connections 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 --2- 172.21.15.37:0/1440743109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0d0780 0x7fb54c0d0b80 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 --2- 172.21.15.37:0/1440743109 >> v2:172.21.15.119:3300/0 conn(0x7fb54c0cf290 0x7fb54c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 -- 172.21.15.37:0/1440743109 >> 172.21.15.37:0/1440743109 conn(0x7fb54c073090 msgr2=0x7fb54c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 -- 172.21.15.37:0/1440743109 shutdown_connections 2023-07-09T21:42:48.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.944+0000 7fb55325c640 1 -- 172.21.15.37:0/1440743109 wait complete. 2023-07-09T21:42:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 Processor -- start 2023-07-09T21:42:48.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 -- start start 2023-07-09T21:42:48.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb54c0b7980 0x7fb54c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 0x7fb54c15b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15ae00 con 0x7fb54c0cf290 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15a1f0 con 0x7fb54c0d0780 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb55325c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c15a4d0 con 0x7fb54c0b7980 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39622/0 (socket says 172.21.15.37:39622) 2023-07-09T21:42:48.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 -- 172.21.15.37:0/3837513811 learned_addr learned my addr 172.21.15.37:0/3837513811 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:48.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb550ff8640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb54c0b7980 0x7fb54c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb5517f9640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 0x7fb54c15b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 -- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb54c0b7980 msgr2=0x7fb54c0c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb54c0b7980 0x7fb54c0c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 -- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 msgr2=0x7fb54c15b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 0x7fb54c15b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 -- 172.21.15.37:0/3837513811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009a70 con 0x7fb54c0cf290 2023-07-09T21:42:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb5517f9640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 0x7fb54c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.948+0000 7fb54bfff640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d7d0 tx=0x7fb53800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800b6c0 con 0x7fb54c0cf290 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53800b820 con 0x7fb54c0cf290 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53800bbd0 con 0x7fb54c0cf290 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c15a7b0 con 0x7fb54c0cf290 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c159e80 con 0x7fb54c0cf290 2023-07-09T21:42:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c04d7d0 con 0x7fb54c0cf290 2023-07-09T21:42:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fb53800bd30 con 0x7fb54c0cf290 2023-07-09T21:42:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.952+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fb538083f90 con 0x7fb54c0cf290 2023-07-09T21:42:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:48.956+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb538051350 con 0x7fb54c0cf290 2023-07-09T21:42:48.988 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:48.988+0000 7fe542193180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:42:49.056 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:42:49.056+0000 7fe542193180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:42:49.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb54c06a800 con 0x7fb54c0cf290 2023-07-09T21:42:49.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb5497fa640 1 -- 172.21.15.37:0/3837513811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v146) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb538054b40 con 0x7fb54c0cf290 2023-07-09T21:42:49.116 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:42:49.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 msgr2=0x7fb54c151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb53800d7d0 tx=0x7fb53800dc90 comp rx=0 tx=0).stop 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 shutdown_connections 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb54c0d0780 0x7fb54c15b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb54c0cf290 0x7fb54c151e90 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 --2- 172.21.15.37:0/3837513811 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb54c0b7980 0x7fb54c0c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 >> 172.21.15.37:0/3837513811 conn(0x7fb54c073090 msgr2=0x7fb54c0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 shutdown_connections 2023-07-09T21:42:49.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.116+0000 7fb55325c640 1 -- 172.21.15.37:0/3837513811 wait complete. 2023-07-09T21:42:49.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:42:49.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.280+0000 7ff59e7e9640 1 Processor -- start 2023-07-09T21:42:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff59e7e9640 1 -- start start 2023-07-09T21:42:49.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff59e7e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff59e7e9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff59815bf80 con 0x7ff5980ceb80 2023-07-09T21:42:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff59e7e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff598160570 con 0x7ff5980d0780 2023-07-09T21:42:49.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff59e7e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5980cd070 con 0x7ff5980b7980 2023-07-09T21:42:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff5977fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5980ceb80 0x7ff5980cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51604/0 (socket says 172.21.15.37:51604) 2023-07-09T21:42:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff5977fe640 1 -- 172.21.15.37:0/2944578823 learned_addr learned my addr 172.21.15.37:0/2944578823 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff597fff640 1 --2- 172.21.15.37:0/2944578823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff596ffd640 1 -- 172.21.15.37:0/2944578823 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419033997 0 0) 0x7ff58c001120 con 0x7ff5980ceb80 2023-07-09T21:42:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff597fff640 1 -- 172.21.15.37:0/2944578823 >> v1:172.21.15.119:6789/0 conn(0x7ff5980d0780 legacy=0x7ff5980d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff597fff640 1 -- 172.21.15.37:0/2944578823 >> v1:172.21.15.37:6789/0 conn(0x7ff5980ceb80 legacy=0x7ff5980cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.284+0000 7ff597fff640 1 -- 172.21.15.37:0/2944578823 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980d02f0 con 0x7ff5980b7980 2023-07-09T21:42:49.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff597fff640 1 --2- 172.21.15.37:0/2944578823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598160030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff588009770 tx=0x7ff58801c2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=792631a910759a5d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff596ffd640 1 -- 172.21.15.37:0/2944578823 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880ac640 con 0x7ff5980b7980 2023-07-09T21:42:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff596ffd640 1 -- 172.21.15.37:0/2944578823 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5880ac7a0 con 0x7ff5980b7980 2023-07-09T21:42:49.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff596ffd640 1 -- 172.21.15.37:0/2944578823 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5880acb30 con 0x7ff5980b7980 2023-07-09T21:42:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 -- 172.21.15.37:0/2944578823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 msgr2=0x7ff598160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/2944578823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598160030 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff588009770 tx=0x7ff58801c2f0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 -- 172.21.15.37:0/2944578823 shutdown_connections 2023-07-09T21:42:49.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/2944578823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598160030 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 -- 172.21.15.37:0/2944578823 >> 172.21.15.37:0/2944578823 conn(0x7ff598073090 msgr2=0x7ff598069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 -- 172.21.15.37:0/2944578823 shutdown_connections 2023-07-09T21:42:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 -- 172.21.15.37:0/2944578823 wait complete. 2023-07-09T21:42:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.288+0000 7ff59e7e9640 1 Processor -- start 2023-07-09T21:42:49.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- start start 2023-07-09T21:42:49.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5980ceb80 0x7ff5981590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815ef30 con 0x7ff5980d0780 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815e320 con 0x7ff5980ceb80 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff59815e600 con 0x7ff5980b7980 2023-07-09T21:42:49.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39624/0 (socket says 172.21.15.37:39624) 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 -- 172.21.15.37:0/587949025 learned_addr learned my addr 172.21.15.37:0/587949025 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff597fff640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff5977fe640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5980ceb80 0x7ff5981590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 -- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 msgr2=0x7ff598150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 -- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5980ceb80 msgr2=0x7ff5981590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5980ceb80 0x7ff5981590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 -- 172.21.15.37:0/587949025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff588009420 con 0x7ff5980d0780 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59cd86640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff5900047d0 tx=0x7ff59000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900069e0 con 0x7ff5980d0780 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff590006b40 con 0x7ff5980d0780 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590008070 con 0x7ff5980d0780 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59815e8e0 con 0x7ff5980d0780 2023-07-09T21:42:49.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff598150cc0 con 0x7ff5980d0780 2023-07-09T21:42:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.292+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5981f1630 con 0x7ff5980d0780 2023-07-09T21:42:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.296+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ff5900081d0 con 0x7ff5980d0780 2023-07-09T21:42:49.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.296+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7ff590086750 con 0x7ff5980d0780 2023-07-09T21:42:49.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.300+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff590053dd0 con 0x7ff5980d0780 2023-07-09T21:42:49.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.452+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff598160570 con 0x7ff5980d0780 2023-07-09T21:42:49.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.452+0000 7ff594ff9640 1 -- 172.21.15.37:0/587949025 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v146) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff59001a020 con 0x7ff5980d0780 2023-07-09T21:42:49.453 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:42:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 msgr2=0x7ff5981595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff5900047d0 tx=0x7ff59000d430 comp rx=0 tx=0).stop 2023-07-09T21:42:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 shutdown_connections 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5980d0780 0x7ff5981595e0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5980ceb80 0x7ff5981590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 --2- 172.21.15.37:0/587949025 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5980b7980 0x7ff598150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 >> 172.21.15.37:0/587949025 conn(0x7ff598073090 msgr2=0x7ff5980b4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 shutdown_connections 2023-07-09T21:42:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.456+0000 7ff59e7e9640 1 -- 172.21.15.37:0/587949025 wait complete. 2023-07-09T21:42:49.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:42:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 Processor -- start 2023-07-09T21:42:49.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 -- start start 2023-07-09T21:42:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e100b7980 0x7f9e10160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100d0780 0x7f9e100d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e1015bf80 con 0x7f9e100ceb80 2023-07-09T21:42:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e100cd070 con 0x7f9e100b7980 2023-07-09T21:42:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e15500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e100cfd70 con 0x7f9e100d0780 2023-07-09T21:42:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9e100b7980 0x7f9e10160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0e7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9e100ceb80 0x7f9e100cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51610/0 (socket says 172.21.15.37:51610) 2023-07-09T21:42:49.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0e7fc640 1 -- 172.21.15.37:0/578035202 learned_addr learned my addr 172.21.15.37:0/578035202 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0f7fe640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100d0780 0x7f9e100d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0effd640 1 -- 172.21.15.37:0/578035202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100d0780 msgr2=0x7f9e100d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0effd640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100d0780 0x7f9e100d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0effd640 1 -- 172.21.15.37:0/578035202 >> v1:172.21.15.37:6789/0 conn(0x7f9e100ceb80 legacy=0x7f9e100cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0effd640 1 -- 172.21.15.37:0/578035202 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e10160570 con 0x7f9e100b7980 2023-07-09T21:42:49.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.620+0000 7f9e0dffb640 1 -- 172.21.15.37:0/578035202 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788646336 0 0) 0x7f9e04001120 con 0x7f9e100ceb80 2023-07-09T21:42:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e0effd640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100b7980 0x7f9e10160030 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097c0 tx=0x7f9e0001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc0faf106329d41 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e0dffb640 1 -- 172.21.15.37:0/578035202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000ab600 con 0x7f9e100b7980 2023-07-09T21:42:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e0dffb640 1 -- 172.21.15.37:0/578035202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e000a7050 con 0x7f9e100b7980 2023-07-09T21:42:49.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e0dffb640 1 -- 172.21.15.37:0/578035202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000ab980 con 0x7f9e100b7980 2023-07-09T21:42:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 -- 172.21.15.37:0/578035202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100b7980 msgr2=0x7f9e10160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100b7980 0x7f9e10160030 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097c0 tx=0x7f9e0001c480 comp rx=0 tx=0).stop 2023-07-09T21:42:49.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 -- 172.21.15.37:0/578035202 shutdown_connections 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100d0780 0x7f9e100d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 --2- 172.21.15.37:0/578035202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100b7980 0x7f9e10160030 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 -- 172.21.15.37:0/578035202 >> 172.21.15.37:0/578035202 conn(0x7f9e10073090 msgr2=0x7f9e10069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 -- 172.21.15.37:0/578035202 shutdown_connections 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.624+0000 7f9e15500640 1 -- 172.21.15.37:0/578035202 wait complete. 2023-07-09T21:42:49.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 Processor -- start 2023-07-09T21:42:49.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- start start 2023-07-09T21:42:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 0x7f9e10150e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e100ceb80 0x7f9e10152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e101539d0 con 0x7f9e100d0780 2023-07-09T21:42:49.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10153cb0 con 0x7f9e100ceb80 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e10151770 con 0x7f9e100b7980 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39658/0 (socket says 172.21.15.37:39658) 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0f7fe640 1 -- 172.21.15.37:0/3679071744 learned_addr learned my addr 172.21.15.37:0/3679071744 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 0x7f9e10150e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0e7fc640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e100ceb80 0x7f9e10152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 -- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e100ceb80 msgr2=0x7f9e10152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e100ceb80 0x7f9e10152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 -- 172.21.15.37:0/3679071744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 msgr2=0x7f9e1015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 -- 172.21.15.37:0/3679071744 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009420 con 0x7f9e100b7980 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0f7fe640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e0effd640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 0x7f9e10150e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e000ab000 tx=0x7f9e0001acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00004230 con 0x7f9e100b7980 2023-07-09T21:42:49.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00004390 con 0x7f9e100b7980 2023-07-09T21:42:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000b6870 con 0x7f9e100b7980 2023-07-09T21:42:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e10151a50 con 0x7f9e100b7980 2023-07-09T21:42:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e101513b0 con 0x7f9e100b7980 2023-07-09T21:42:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.628+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1004d7d0 con 0x7f9e100b7980 2023-07-09T21:42:49.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.632+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 64) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f9e000b69d0 con 0x7f9e100b7980 2023-07-09T21:42:49.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.632+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f9e0011e5a0 con 0x7f9e100b7980 2023-07-09T21:42:49.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.636+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9e000ebcd0 con 0x7f9e100b7980 2023-07-09T21:42:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.752+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f9e000eb780 con 0x7f9e100b7980 2023-07-09T21:42:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.752+0000 7f9df77fe640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 0x7f9dfc06e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.752+0000 7f9e0e7fc640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 0x7f9dfc06e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.756+0000 7f9e0e7fc640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 0x7f9dfc06e5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e100cc370 tx=0x7f9e04007ba0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.792+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e10160570 con 0x7f9e100b7980 2023-07-09T21:42:49.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.792+0000 7f9df77fe640 1 -- 172.21.15.37:0/3679071744 <== mon.2 v2:172.21.15.119:3301/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v146) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e10160570 con 0x7f9e100b7980 2023-07-09T21:42:49.794 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:42:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 msgr2=0x7f9dfc06e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 0x7f9dfc06e5a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9e100cc370 tx=0x7f9e04007ba0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 msgr2=0x7f9e10150e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 0x7f9e10150e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e000ab000 tx=0x7f9e0001acc0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 shutdown_connections 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f9dfc06c1c0 0x7f9dfc06e5a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9e100d0780 0x7f9e1015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9e100ceb80 0x7f9e10152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 --2- 172.21.15.37:0/3679071744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9e100b7980 0x7f9e10150e70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 >> 172.21.15.37:0/3679071744 conn(0x7f9e10073090 msgr2=0x7f9e100d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 shutdown_connections 2023-07-09T21:42:49.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.796+0000 7f9e15500640 1 -- 172.21.15.37:0/3679071744 wait complete. 2023-07-09T21:42:49.817 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 Processor -- start 2023-07-09T21:42:49.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 -- start start 2023-07-09T21:42:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01e80cc800 0x7f01e80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e806acb0 con 0x7f01e80cf090 2023-07-09T21:42:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e80ccc90 con 0x7f01e815ba60 2023-07-09T21:42:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01ed9ba640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e80cfe20 con 0x7f01e80cc800 2023-07-09T21:42:49.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01e6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f01e815ba60 0x7f01e81600b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:48138/0 (socket says 172.21.15.37:48138) 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01e6ffd640 1 -- 172.21.15.37:0/613818791 learned_addr learned my addr 172.21.15.37:0/613818791 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01dffff640 1 --2- 172.21.15.37:0/613818791 >> v2:172.21.15.37:3300/0 conn(0x7f01e80cc800 0x7f01e80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01dffff640 1 -- 172.21.15.37:0/613818791 >> v1:172.21.15.119:6789/0 conn(0x7f01e815ba60 legacy=0x7f01e81600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01e67fc640 1 -- 172.21.15.37:0/613818791 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912212109 0 0) 0x7f01e80ccc90 con 0x7f01e815ba60 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01dffff640 1 -- 172.21.15.37:0/613818791 >> v1:172.21.15.37:6789/0 conn(0x7f01e80cf090 legacy=0x7f01e80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.960+0000 7f01dffff640 1 -- 172.21.15.37:0/613818791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e80d0100 con 0x7f01e80cc800 2023-07-09T21:42:49.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01dffff640 1 --2- 172.21.15.37:0/613818791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cc800 0x7f01e80ceb50 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097c0 tx=0x7f01d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cbee95700a25e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01e67fc640 1 -- 172.21.15.37:0/613818791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00ab670 con 0x7f01e80cc800 2023-07-09T21:42:49.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01e67fc640 1 -- 172.21.15.37:0/613818791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d00ab7d0 con 0x7f01e80cc800 2023-07-09T21:42:49.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01e67fc640 1 -- 172.21.15.37:0/613818791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00abb60 con 0x7f01e80cc800 2023-07-09T21:42:49.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 -- 172.21.15.37:0/613818791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cc800 msgr2=0x7f01e80ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/613818791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cc800 0x7f01e80ceb50 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f01d00097c0 tx=0x7f01d001c450 comp rx=0 tx=0).stop 2023-07-09T21:42:49.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 -- 172.21.15.37:0/613818791 shutdown_connections 2023-07-09T21:42:49.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/613818791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cc800 0x7f01e80ceb50 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 -- 172.21.15.37:0/613818791 >> 172.21.15.37:0/613818791 conn(0x7f01e8073090 msgr2=0x7f01e8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:49.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 -- 172.21.15.37:0/613818791 shutdown_connections 2023-07-09T21:42:49.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.964+0000 7f01ed9ba640 1 -- 172.21.15.37:0/613818791 wait complete. 2023-07-09T21:42:49.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 Processor -- start 2023-07-09T21:42:49.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- start start 2023-07-09T21:42:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 0x7f01e80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e815ba60 0x7f01e8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8147100 con 0x7f01e80cf090 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80b3e80 con 0x7f01e80cc800 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80b4160 con 0x7f01e815ba60 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39678/0 (socket says 172.21.15.37:39678) 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 -- 172.21.15.37:0/4197140766 learned_addr learned my addr 172.21.15.37:0/4197140766 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 0x7f01e80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e77fe640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e815ba60 0x7f01e8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 -- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e815ba60 msgr2=0x7f01e8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e815ba60 0x7f01e8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 -- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 msgr2=0x7f01e80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 0x7f01e80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 -- 172.21.15.37:0/4197140766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d0009420 con 0x7f01e80cf090 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 0x7f01e80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01dffff640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ad040 tx=0x7f01d001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00b5810 con 0x7f01e80cf090 2023-07-09T21:42:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d00b5970 con 0x7f01e80cf090 2023-07-09T21:42:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e80b4440 con 0x7f01e80cf090 2023-07-09T21:42:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d00b5d20 con 0x7f01e80cf090 2023-07-09T21:42:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.968+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e80b4a00 con 0x7f01e80cf090 2023-07-09T21:42:49.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e80668f0 con 0x7f01e80cf090 2023-07-09T21:42:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f01d00b4390 con 0x7f01e80cf090 2023-07-09T21:42:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01e4ff9640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 0x7f01c8068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f01d011e680 con 0x7f01e80cf090 2023-07-09T21:42:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 0x7f01c8068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:49.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.972+0000 7f01e6ffd640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 0x7f01c8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000f70 tx=0x7f01d8007df0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:49.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:49.976+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01d00ebb20 con 0x7f01e80cf090 2023-07-09T21:42:50.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01e815f930 con 0x7f01e80cf090 2023-07-09T21:42:50.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01e4ff9640 1 -- 172.21.15.37:0/4197140766 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7f01d00c4090 con 0x7f01e80cf090 2023-07-09T21:42:50.172 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:50.173 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:50.173 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:50.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 msgr2=0x7f01c8068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 0x7f01c8068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f01d8000f70 tx=0x7f01d8007df0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 msgr2=0x7f01e80c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f01d00ad040 tx=0x7f01d001ac90 comp rx=0 tx=0).stop 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 shutdown_connections 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f01c80660d0 0x7f01c8068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01e815ba60 0x7f01e8154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01e80cf090 0x7f01e80c73d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 --2- 172.21.15.37:0/4197140766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01e80cc800 0x7f01e80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 >> 172.21.15.37:0/4197140766 conn(0x7f01e8073090 msgr2=0x7f01e80d21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:50.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 shutdown_connections 2023-07-09T21:42:50.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.172+0000 7f01ed9ba640 1 -- 172.21.15.37:0/4197140766 wait complete. 2023-07-09T21:42:50.195 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:50.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 Processor -- start 2023-07-09T21:42:50.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 -- start start 2023-07-09T21:42:50.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 0x7f284c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f284c0cef80 0x7f284c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b4170 0x7f284c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0b7e80 con 0x7f284c0cef80 2023-07-09T21:42:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0b4610 con 0x7f284c0b7ab0 2023-07-09T21:42:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2852a19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b49f0 con 0x7f284c0b4170 2023-07-09T21:42:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f284c0cef80 0x7f284c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f284c0cef80 0x7f284c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39680/0 (socket says 172.21.15.37:39680) 2023-07-09T21:42:50.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 -- 172.21.15.37:0/3205829151 learned_addr learned my addr 172.21.15.37:0/3205829151 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f2850fb6640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b4170 0x7f284c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284bfff640 1 --2- 172.21.15.37:0/3205829151 >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 0x7f284c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 -- 172.21.15.37:0/3205829151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b4170 msgr2=0x7f284c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b4170 0x7f284c15f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 -- 172.21.15.37:0/3205829151 >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 msgr2=0x7f284c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:50.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 --2- 172.21.15.37:0/3205829151 >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 0x7f284c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284b7fe640 1 -- 172.21.15.37:0/3205829151 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0cc8a0 con 0x7f284c0cef80 2023-07-09T21:42:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.340+0000 7f284bfff640 1 --2- 172.21.15.37:0/3205829151 >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 0x7f284c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:50.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f284b7fe640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b3c30 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f284c06b360 tx=0x7f284001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ee356770332675 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f284affd640 1 -- 172.21.15.37:0/3205829151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400ab600 con 0x7f284c0cef80 2023-07-09T21:42:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f284affd640 1 -- 172.21.15.37:0/3205829151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28400a7050 con 0x7f284c0cef80 2023-07-09T21:42:50.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f284affd640 1 -- 172.21.15.37:0/3205829151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400ab980 con 0x7f284c0cef80 2023-07-09T21:42:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 -- 172.21.15.37:0/3205829151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 msgr2=0x7f284c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b3c30 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f284c06b360 tx=0x7f284001c210 comp rx=0 tx=0).stop 2023-07-09T21:42:50.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 -- 172.21.15.37:0/3205829151 shutdown_connections 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b3c30 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 --2- 172.21.15.37:0/3205829151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b4170 0x7f284c15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 --2- 172.21.15.37:0/3205829151 >> v2:172.21.15.119:3300/0 conn(0x7f284c0b7ab0 0x7f284c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 -- 172.21.15.37:0/3205829151 >> 172.21.15.37:0/3205829151 conn(0x7f284c073090 msgr2=0x7f284c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 -- 172.21.15.37:0/3205829151 shutdown_connections 2023-07-09T21:42:50.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.344+0000 7f2852a19640 1 -- 172.21.15.37:0/3205829151 wait complete. 2023-07-09T21:42:50.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 Processor -- start 2023-07-09T21:42:50.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- start start 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 0x7f284c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b7ab0 0x7f284c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0cacf0 con 0x7f284c0cef80 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0b6380 con 0x7f284c0b4170 2023-07-09T21:42:50.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0cb180 con 0x7f284c0b7ab0 2023-07-09T21:42:50.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f284bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 0x7f284c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f284b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b7ab0 0x7f284c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f284bfff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 0x7f284c158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:43522/0 (socket says 172.21.15.37:43522) 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f284bfff640 1 -- 172.21.15.37:0/449908559 learned_addr learned my addr 172.21.15.37:0/449908559 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 -- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b7ab0 msgr2=0x7f284c1587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b7ab0 0x7f284c1587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 -- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 msgr2=0x7f284c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 0x7f284c158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 -- 172.21.15.37:0/449908559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400094d0 con 0x7f284c0cef80 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2850fb6640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b56c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f284400eed0 tx=0x7f284400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844010040 con 0x7f284c0cef80 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844009e60 con 0x7f284c0cef80 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c0ca3c0 con 0x7f284c0cef80 2023-07-09T21:42:50.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844014640 con 0x7f284c0cef80 2023-07-09T21:42:50.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.348+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0ca980 con 0x7f284c0cef80 2023-07-09T21:42:50.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c0cae60 con 0x7f284c0cef80 2023-07-09T21:42:50.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f28440147a0 con 0x7f284c0cef80 2023-07-09T21:42:50.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f2848ff9640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 0x7f2838068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7f28440846c0 con 0x7f284c0cef80 2023-07-09T21:42:50.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f284bfff640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 0x7f2838068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.352+0000 7f284bfff640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 0x7f2838068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f283c009a10 tx=0x7f283c008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.356+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2844051ae0 con 0x7f284c0cef80 2023-07-09T21:42:50.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.512+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f284c04d7d0 con 0x7f284c0cef80 2023-07-09T21:42:50.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2848ff9640 1 -- 172.21.15.37:0/449908559 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+19471 (secure 0 0 0) 0x7f2844055100 con 0x7f284c0cef80 2023-07-09T21:42:50.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:50.516 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":146,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:48.735835+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1563153642":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/55653990":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/4077172606":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1119473455":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1294728214":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/4177594131":"2023-07-10T21:42:48.735780+0000","172.21.15.119:6833/3341716483":"2023-07-10T21:42:48.735780+0000","172.21.15.119:6832/3341716483":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1175733732":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/858929480":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1486892791":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2922098575":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/131712359":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2004893287":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2270449245":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6833/2490760228":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6832/2490760228":"2023-07-10T21:42:41.926166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:50.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 msgr2=0x7f2838068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 0x7f2838068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f283c009a10 tx=0x7f283c008040 comp rx=0 tx=0).stop 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 msgr2=0x7f284c0b56c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b56c0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f284400eed0 tx=0x7f284400b480 comp rx=0 tx=0).stop 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 shutdown_connections 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28380660d0 0x7f2838068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f284c0cef80 0x7f284c0b56c0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f284c0b7ab0 0x7f284c1587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 --2- 172.21.15.37:0/449908559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f284c0b4170 0x7f284c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 >> 172.21.15.37:0/449908559 conn(0x7f284c073090 msgr2=0x7f284c0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 shutdown_connections 2023-07-09T21:42:50.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.516+0000 7f2852a19640 1 -- 172.21.15.37:0/449908559 wait complete. 2023-07-09T21:42:50.537 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:42:50.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 Processor -- start 2023-07-09T21:42:50.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 -- start start 2023-07-09T21:42:50.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7000b7ab0 0x7fb70006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 0x7fb7000b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7000b49f0 con 0x7fb7000b4170 2023-07-09T21:42:50.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7000b7e80 con 0x7fb7000b7ab0 2023-07-09T21:42:50.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb7055d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000b4610 con 0x7fb7000cef80 2023-07-09T21:42:50.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6ff7fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fb7000b4170 0x7fb70015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:48150/0 (socket says 172.21.15.37:48150) 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6ff7fe640 1 -- 172.21.15.37:0/3877656663 learned_addr learned my addr 172.21.15.37:0/3877656663 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6feffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb7000b7ab0 0x7fb70006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/3877656663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 0x7fb7000b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6fe7fc640 1 -- 172.21.15.37:0/3877656663 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501514240 0 0) 0x7fb7000b49f0 con 0x7fb7000b4170 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6fe7fc640 1 -- 172.21.15.37:0/3877656663 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6ec003530 con 0x7fb7000b4170 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6f7fff640 1 -- 172.21.15.37:0/3877656663 >> v2:172.21.15.119:3300/0 conn(0x7fb7000b7ab0 msgr2=0x7fb70006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:50.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/3877656663 >> v2:172.21.15.119:3300/0 conn(0x7fb7000b7ab0 0x7fb70006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6f7fff640 1 -- 172.21.15.37:0/3877656663 >> v1:172.21.15.119:6789/0 conn(0x7fb7000b4170 legacy=0x7fb70015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.680+0000 7fb6f7fff640 1 -- 172.21.15.37:0/3877656663 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7000cc8a0 con 0x7fb7000cef80 2023-07-09T21:42:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/3877656663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 0x7fb7000b3c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80097c0 tx=0x7fb6e801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=290ca0f25403095b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb6fe7fc640 1 -- 172.21.15.37:0/3877656663 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80ab650 con 0x7fb7000cef80 2023-07-09T21:42:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb6fe7fc640 1 -- 172.21.15.37:0/3877656663 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80ab7b0 con 0x7fb7000cef80 2023-07-09T21:42:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb6fe7fc640 1 -- 172.21.15.37:0/3877656663 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80abb40 con 0x7fb7000cef80 2023-07-09T21:42:50.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 -- 172.21.15.37:0/3877656663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 msgr2=0x7fb7000b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 --2- 172.21.15.37:0/3877656663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 0x7fb7000b3c30 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80097c0 tx=0x7fb6e801c450 comp rx=0 tx=0).stop 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 -- 172.21.15.37:0/3877656663 shutdown_connections 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 --2- 172.21.15.37:0/3877656663 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000cef80 0x7fb7000b3c30 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 --2- 172.21.15.37:0/3877656663 >> v2:172.21.15.119:3300/0 conn(0x7fb7000b7ab0 0x7fb70006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 -- 172.21.15.37:0/3877656663 >> 172.21.15.37:0/3877656663 conn(0x7fb700073090 msgr2=0x7fb700069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 -- 172.21.15.37:0/3877656663 shutdown_connections 2023-07-09T21:42:50.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.684+0000 7fb7055d2640 1 -- 172.21.15.37:0/3877656663 wait complete. 2023-07-09T21:42:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 Processor -- start 2023-07-09T21:42:50.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 -- start start 2023-07-09T21:42:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000b4170 0x7fb7000cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7000cef80 0x7fb7001552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000c6d30 con 0x7fb7000b7ab0 2023-07-09T21:42:50.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000c72f0 con 0x7fb7000cef80 2023-07-09T21:42:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7000ca6e0 con 0x7fb7000b4170 2023-07-09T21:42:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39690/0 (socket says 172.21.15.37:39690) 2023-07-09T21:42:50.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 -- 172.21.15.37:0/1924518669 learned_addr learned my addr 172.21.15.37:0/1924518669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6ff7fe640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7000cef80 0x7fb7001552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6feffd640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000b4170 0x7fb7000cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 -- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000b4170 msgr2=0x7fb7000cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000b4170 0x7fb7000cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 -- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7000cef80 msgr2=0x7fb7001552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7000cef80 0x7fb7001552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 -- 172.21.15.37:0/1924518669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009420 con 0x7fb7000b7ab0 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f7fff640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb6e801ab00 tx=0x7fb6e80191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80abdf0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80bf450 con 0x7fb7000b7ab0 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80bf7e0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.688+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7000ca9c0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7000cb0c0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7000cb250 con 0x7fb7000b7ab0 2023-07-09T21:42:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fb6e80bf940 con 0x7fb7000b7ab0 2023-07-09T21:42:50.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb6f77fe640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 0x7fb6e0068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fb6e811e4e0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb6feffd640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 0x7fb6e0068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:50.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.692+0000 7fb6feffd640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 0x7fb6e0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009b60 tx=0x7fb6f0009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:50.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.696+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb6e80eb980 con 0x7fb7000b7ab0 2023-07-09T21:42:50.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.884+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7000c7480 con 0x7fb7000b7ab0 2023-07-09T21:42:50.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.884+0000 7fb6f77fe640 1 -- 172.21.15.37:0/1924518669 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7fb6e80eefa0 con 0x7fb7000b7ab0 2023-07-09T21:42:50.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:50.886 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:50.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 msgr2=0x7fb6e0068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 0x7fb6e0068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0009b60 tx=0x7fb6f0009190 comp rx=0 tx=0).stop 2023-07-09T21:42:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 msgr2=0x7fb7000c9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:50.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fb6e801ab00 tx=0x7fb6e80191f0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 shutdown_connections 2023-07-09T21:42:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb6e00660d0 0x7fb6e0068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7000cef80 0x7fb7001552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7000b7ab0 0x7fb7000c9c90 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 --2- 172.21.15.37:0/1924518669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7000b4170 0x7fb7000cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 >> 172.21.15.37:0/1924518669 conn(0x7fb700073090 msgr2=0x7fb700158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:50.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 shutdown_connections 2023-07-09T21:42:50.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:50.888+0000 7fb7055d2640 1 -- 172.21.15.37:0/1924518669 wait complete. 2023-07-09T21:42:50.907 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 Processor -- start 2023-07-09T21:42:51.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 -- start start 2023-07-09T21:42:51.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0b7ab0 0x7ffbcc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0b49f0 con 0x7ffbcc0cef80 2023-07-09T21:42:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0cc8a0 con 0x7ffbcc0b4340 2023-07-09T21:42:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbd0f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0b7e80 con 0x7ffbcc0b7ab0 2023-07-09T21:42:51.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbcc0cef80 0x7ffbcc0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51624/0 (socket says 172.21.15.37:51624) 2023-07-09T21:42:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc3fff640 1 -- 172.21.15.37:0/1715364501 learned_addr learned my addr 172.21.15.37:0/1715364501 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbca59c640 1 --2- 172.21.15.37:0/1715364501 >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0b7ab0 0x7ffbcc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341624253 0 0) 0x7ffbcc0b49f0 con 0x7ffbcc0cef80 2023-07-09T21:42:51.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb8003530 con 0x7ffbcc0cef80 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2461705130 0 0) 0x7ffbb8003530 con 0x7ffbcc0cef80 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0b7ab0 msgr2=0x7ffbcc06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 --2- 172.21.15.37:0/1715364501 >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0b7ab0 0x7ffbcc06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 >> v1:172.21.15.119:6789/0 conn(0x7ffbcc0b4340 legacy=0x7ffbcc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0ccb80 con 0x7ffbcc0cef80 2023-07-09T21:42:51.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ffbb4001680 con 0x7ffbcc0cef80 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 >> v1:172.21.15.37:6789/0 conn(0x7ffbcc0cef80 legacy=0x7ffbcc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbb8003980 0x7ffbb8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbb8004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbb8005030 0x7ffbb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb800bf80 con 0x7ffbb8004370 2023-07-09T21:42:51.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb800c0c0 con 0x7ffbb8005030 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.052+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb800c280 con 0x7ffbb8003980 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbb8004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbca59c640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbb8003980 0x7ffbb8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbcad9d640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbb8005030 0x7ffbb800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 -- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbb8003980 msgr2=0x7ffbb8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbb8003980 0x7ffbb8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 -- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbb8005030 msgr2=0x7ffbb800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:51.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbb8005030 0x7ffbb800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 -- 172.21.15.37:0/1715364501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb8003530 con 0x7ffbb8004370 2023-07-09T21:42:51.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbcad9d640 1 -- 172.21.15.37:0/1715364501 reap_dead start 2023-07-09T21:42:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbb8004830 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06af90 tx=0x7ffbb401cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada7ec212061e3db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb4005ae0 con 0x7ffbb8004370 2023-07-09T21:42:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb4005c60 con 0x7ffbb8004370 2023-07-09T21:42:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.056+0000 7ffbc9d9b640 1 -- 172.21.15.37:0/1715364501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb40a59d0 con 0x7ffbb8004370 2023-07-09T21:42:51.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 msgr2=0x7ffbb8004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbb8004830 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc06af90 tx=0x7ffbb401cbd0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- 172.21.15.37:0/1715364501 shutdown_connections 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/1715364501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbb8004830 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- 172.21.15.37:0/1715364501 >> 172.21.15.37:0/1715364501 conn(0x7ffbcc073090 msgr2=0x7ffbcc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- 172.21.15.37:0/1715364501 shutdown_connections 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- 172.21.15.37:0/1715364501 wait complete. 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 Processor -- start 2023-07-09T21:42:51.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- start start 2023-07-09T21:42:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc15b660 0x7ffbcc15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15e750 0x7ffbcc15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc15bdd0 con 0x7ffbb8004370 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc1f43c0 con 0x7ffbcc15e750 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbd0f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc156540 con 0x7ffbcc15b660 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39706/0 (socket says 172.21.15.37:39706) 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbc3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc15b660 0x7ffbcc15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 -- 172.21.15.37:0/2466103341 learned_addr learned my addr 172.21.15.37:0/2466103341 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:51.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbcad9d640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15e750 0x7ffbcc15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 -- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc15b660 msgr2=0x7ffbcc15da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc15b660 0x7ffbcc15da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 -- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15e750 msgr2=0x7ffbcc15df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15e750 0x7ffbcc15df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.060+0000 7ffbca59c640 1 -- 172.21.15.37:0/2466103341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc15e4c0 con 0x7ffbb8004370 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbca59c640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc011900 tx=0x7ffbbc0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc004240 con 0x7ffbb8004370 2023-07-09T21:42:51.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbbc0043a0 con 0x7ffbb8004370 2023-07-09T21:42:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc003860 con 0x7ffbb8004370 2023-07-09T21:42:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc15baf0 con 0x7ffbb8004370 2023-07-09T21:42:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc0b6a80 con 0x7ffbb8004370 2023-07-09T21:42:51.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc04d7d0 con 0x7ffbb8004370 2023-07-09T21:42:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 65) v1 ==== 85496+0+0 (secure 0 0 0) 0x7ffbbc0039c0 con 0x7ffbb8004370 2023-07-09T21:42:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.064+0000 7ffbc2ffd640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 0x7ffbac068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.068+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7ffbbc083ed0 con 0x7ffbb8004370 2023-07-09T21:42:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.068+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 0x7ffbac068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.068+0000 7ffbc3fff640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 0x7ffbac068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40ab000 tx=0x7ffbb40b1040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.068+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbbc051370 con 0x7ffbb8004370 2023-07-09T21:42:51.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.192+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffbbc051740 con 0x7ffbb8004370 2023-07-09T21:42:51.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.256+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbcc06a830 con 0x7ffbb8004370 2023-07-09T21:42:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbc2ffd640 1 -- 172.21.15.37:0/2466103341 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4676 (secure 0 0 0) 0x7ffbbc023020 con 0x7ffbb8004370 2023-07-09T21:42:51.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:51.259 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:42:23.692818+0000","modified":"2023-07-09T21:42:27.322156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8994},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8994":{"gid":8994,"name":"a","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/723012105","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":723012105},{"type":"v1","addr":"172.21.15.37:6835","nonce":723012105}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-07-09T21:42:51.260 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 62 2023-07-09T21:42:51.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 msgr2=0x7ffbac068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 0x7ffbac068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40ab000 tx=0x7ffbb40b1040 comp rx=0 tx=0).stop 2023-07-09T21:42:51.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 msgr2=0x7ffbcc156000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc011900 tx=0x7ffbbc0119f0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 shutdown_connections 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ffbac0660d0 0x7ffbac068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15e750 0x7ffbcc15df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc15b660 0x7ffbcc15da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 --2- 172.21.15.37:0/2466103341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8004370 0x7ffbcc156000 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 >> 172.21.15.37:0/2466103341 conn(0x7ffbcc073090 msgr2=0x7ffbcc0cb290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 shutdown_connections 2023-07-09T21:42:51.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.260+0000 7ffbd0f40640 1 -- 172.21.15.37:0/2466103341 wait complete. 2023-07-09T21:42:51.280 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:42:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 Processor -- start 2023-07-09T21:42:51.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 -- start start 2023-07-09T21:42:51.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb2e00cef80 0x7fb2e00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e00b49f0 con 0x7fb2e00b7ab0 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e00b7e80 con 0x7fb2e00cef80 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e7511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00cc8a0 con 0x7fb2e00b4340 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e52ad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb2e00b7ab0 0x7fb2e00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51626/0 (socket says 172.21.15.37:51626) 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e52ad640 1 -- 172.21.15.37:0/474303849 learned_addr learned my addr 172.21.15.37:0/474303849 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/474303849 >> v2:172.21.15.37:3300/0 conn(0x7fb2e00cef80 0x7fb2e00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e4aac640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e5aae640 1 -- 172.21.15.37:0/474303849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 msgr2=0x7fb2e006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:51.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e5aae640 1 -- 172.21.15.37:0/474303849 >> v1:172.21.15.37:6789/0 conn(0x7fb2e00b7ab0 legacy=0x7fb2e00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2d7fff640 1 -- 172.21.15.37:0/474303849 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786251560 0 0) 0x7fb2e00b49f0 con 0x7fb2e00b7ab0 2023-07-09T21:42:51.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.424+0000 7fb2e5aae640 1 -- 172.21.15.37:0/474303849 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e00ccb80 con 0x7fb2e00cef80 2023-07-09T21:42:51.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e00d02a0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009d90 tx=0x7fb2d801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7702c64dd248fede server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2d7fff640 1 -- 172.21.15.37:0/474303849 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80a59e0 con 0x7fb2e00cef80 2023-07-09T21:42:51.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2d7fff640 1 -- 172.21.15.37:0/474303849 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d80a5b40 con 0x7fb2e00cef80 2023-07-09T21:42:51.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2d7fff640 1 -- 172.21.15.37:0/474303849 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80ad440 con 0x7fb2e00cef80 2023-07-09T21:42:51.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 -- 172.21.15.37:0/474303849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 msgr2=0x7fb2e00d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e00d02a0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009d90 tx=0x7fb2d801c920 comp rx=0 tx=0).stop 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 -- 172.21.15.37:0/474303849 shutdown_connections 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e00d02a0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 --2- 172.21.15.37:0/474303849 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 -- 172.21.15.37:0/474303849 >> 172.21.15.37:0/474303849 conn(0x7fb2e0073090 msgr2=0x7fb2e0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 -- 172.21.15.37:0/474303849 shutdown_connections 2023-07-09T21:42:51.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.428+0000 7fb2e7511640 1 -- 172.21.15.37:0/474303849 wait complete. 2023-07-09T21:42:51.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 Processor -- start 2023-07-09T21:42:51.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- start start 2023-07-09T21:42:51.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e00b7ab0 0x7fb2e00c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00c7860 con 0x7fb2e00cef80 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e014c4a0 con 0x7fb2e00b7ab0 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e00c7580 con 0x7fb2e00b4340 2023-07-09T21:42:51.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39724/0 (socket says 172.21.15.37:39724) 2023-07-09T21:42:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 -- 172.21.15.37:0/1903495298 learned_addr learned my addr 172.21.15.37:0/1903495298 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:51.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e52ad640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e4aac640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e00b7ab0 0x7fb2e00c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 -- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 msgr2=0x7fb2e014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e014bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 -- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e00b7ab0 msgr2=0x7fb2e00c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e00b7ab0 0x7fb2e00c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 -- 172.21.15.37:0/1903495298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d8009a70 con 0x7fb2e00cef80 2023-07-09T21:42:51.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e5aae640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009d90 tx=0x7fb2d80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80aee00 con 0x7fb2e00cef80 2023-07-09T21:42:51.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8009450 con 0x7fb2e00cef80 2023-07-09T21:42:51.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8003ba0 con 0x7fb2e00cef80 2023-07-09T21:42:51.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e00c9420 con 0x7fb2e00cef80 2023-07-09T21:42:51.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.432+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e00c99e0 con 0x7fb2e00cef80 2023-07-09T21:42:51.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e00c9280 con 0x7fb2e00cef80 2023-07-09T21:42:51.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb2d80b4050 con 0x7fb2e00cef80 2023-07-09T21:42:51.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2d5ffb640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 0x7fb2c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fb2d811e810 con 0x7fb2e00cef80 2023-07-09T21:42:51.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2e52ad640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 0x7fb2c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.436+0000 7fb2e52ad640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 0x7fb2c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc000f70 tx=0x7fb2dc007b60 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.440+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb2e00c9280 con 0x7fb2e00cef80 2023-07-09T21:42:51.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.596+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2e00c9280 con 0x7fb2e00cef80 2023-07-09T21:42:51.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2d5ffb640 1 -- 172.21.15.37:0/1903495298 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v146) v1 ==== 74+0+19471 (secure 0 0 0) 0x7fb2e00c9280 con 0x7fb2e00cef80 2023-07-09T21:42:51.600 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:51.600 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":146,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:42:48.735835+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:42:21.815158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"143","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-07-09T21:42:22.687899+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"144","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/1563153642":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/55653990":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/4077172606":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1119473455":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1294728214":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/4177594131":"2023-07-10T21:42:48.735780+0000","172.21.15.119:6833/3341716483":"2023-07-10T21:42:48.735780+0000","172.21.15.119:6832/3341716483":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1175733732":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/858929480":"2023-07-10T21:42:48.735780+0000","172.21.15.119:0/1486892791":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2922098575":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/131712359":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2004893287":"2023-07-10T21:42:41.926166+0000","172.21.15.119:0/2270449245":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6833/2490760228":"2023-07-10T21:42:41.926166+0000","172.21.15.119:6832/2490760228":"2023-07-10T21:42:41.926166+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 msgr2=0x7fb2c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 0x7fb2c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc000f70 tx=0x7fb2dc007b60 comp rx=0 tx=0).stop 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 msgr2=0x7fb2e01597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8009d90 tx=0x7fb2d80196c0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 shutdown_connections 2023-07-09T21:42:51.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb2c40663a0 0x7fb2c4068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2e00cef80 0x7fb2e01597e0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb2e00b7ab0 0x7fb2e00c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 --2- 172.21.15.37:0/1903495298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb2e00b4340 0x7fb2e014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 >> 172.21.15.37:0/1903495298 conn(0x7fb2e0073090 msgr2=0x7fb2e00b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 shutdown_connections 2023-07-09T21:42:51.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.600+0000 7fb2e7511640 1 -- 172.21.15.37:0/1903495298 wait complete. 2023-07-09T21:42:51.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:42:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.764+0000 7fc3b3256640 1 Processor -- start 2023-07-09T21:42:51.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.764+0000 7fc3b3256640 1 -- start start 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.764+0000 7fc3b3256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac1668c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.764+0000 7fc3b3256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0cef80 con 0x7fc3ac0b47a0 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b3256640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0cf260 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b3256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0ccee0 con 0x7fc3ac0b4310 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3abfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc3ac0b47a0 0x7fc3ac0b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51636/0 (socket says 172.21.15.37:51636) 2023-07-09T21:42:51.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3abfff640 1 -- 172.21.15.37:0/2175091193 learned_addr learned my addr 172.21.15.37:0/2175091193 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b17f3640 1 --2- 172.21.15.37:0/2175091193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac1668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228516564 0 0) 0x7fc3ac0cef80 con 0x7fc3ac0b47a0 2023-07-09T21:42:51.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc39c003530 con 0x7fc3ac0b47a0 2023-07-09T21:42:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695535288 0 0) 0x7fc3ac0cf260 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ac0cef80 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2175091193 >> v1:172.21.15.119:6789/0 conn(0x7fc3ac0b7a60 legacy=0x7fc3ac0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2175091193 >> v1:172.21.15.37:6789/0 conn(0x7fc3ac0b47a0 legacy=0x7fc3ac0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.768+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2175091193 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac0cf540 con 0x7fc3ac0b4310 2023-07-09T21:42:51.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b17f3640 1 --2- 172.21.15.37:0/2175091193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac1668c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009dc0 tx=0x7fc3a401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6efb4926ab3e246 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40a5920 con 0x7fc3ac0b4310 2023-07-09T21:42:51.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a40a5a80 con 0x7fc3ac0b4310 2023-07-09T21:42:51.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3ab7fe640 1 -- 172.21.15.37:0/2175091193 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40a5e10 con 0x7fc3ac0b4310 2023-07-09T21:42:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- 172.21.15.37:0/2175091193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 msgr2=0x7fc3ac1668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2175091193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac1668c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc3a4009dc0 tx=0x7fc3a401c970 comp rx=0 tx=0).stop 2023-07-09T21:42:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- 172.21.15.37:0/2175091193 shutdown_connections 2023-07-09T21:42:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2175091193 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac1668c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- 172.21.15.37:0/2175091193 >> 172.21.15.37:0/2175091193 conn(0x7fc3ac073050 msgr2=0x7fc3ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- 172.21.15.37:0/2175091193 shutdown_connections 2023-07-09T21:42:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- 172.21.15.37:0/2175091193 wait complete. 2023-07-09T21:42:51.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 Processor -- start 2023-07-09T21:42:51.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 -- start start 2023-07-09T21:42:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.772+0000 7fc3b3256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 0x7fc3ac152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0cb150 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac1552a0 con 0x7fc3ac0b47a0 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0ca210 con 0x7fc3ac0b4310 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39734/0 (socket says 172.21.15.37:39734) 2023-07-09T21:42:51.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2532170037 learned_addr learned my addr 172.21.15.37:0/2532170037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b0ff2640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3abfff640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 0x7fc3ac152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 msgr2=0x7fc3ac0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 msgr2=0x7fc3ac152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 0x7fc3ac152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 -- 172.21.15.37:0/2532170037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a4009a70 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b0ff2640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:51.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3abfff640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 0x7fc3ac152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:51.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b17f3640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40b0040 tx=0x7fc3a4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40adcc0 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a40ade40 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac0ca4d0 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a40b9690 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac0caa90 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac0cdaa0 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.776+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc3a40b97f0 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.780+0000 7fc3a97fa640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 0x7fc390068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.780+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 6821+0+0 (secure 0 0 0) 0x7fc3a411f900 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.780+0000 7fc3b0ff2640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 0x7fc390068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:51.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.780+0000 7fc3b0ff2640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 0x7fc390068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00011f0 tx=0x7fc3a0009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:51.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.784+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc3a40ec9a0 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.972+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc3ac0cb290 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.973 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:42:51.972+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:42:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.976+0000 7fc3a97fa640 1 -- 172.21.15.37:0/2532170037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc3ac0cb290 con 0x7fc3ac0b7a60 2023-07-09T21:42:51.978 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 msgr2=0x7fc390068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 0x7fc390068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc3a00011f0 tx=0x7fc3a0009040 comp rx=0 tx=0).stop 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 msgr2=0x7fc3ac157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fc3a40b0040 tx=0x7fc3a4019710 comp rx=0 tx=0).stop 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 shutdown_connections 2023-07-09T21:42:51.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc3900663a0 0x7fc390068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3ac0b7a60 0x7fc3ac157030 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc3ac0b47a0 0x7fc3ac152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 --2- 172.21.15.37:0/2532170037 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc3ac0b4310 0x7fc3ac0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 >> 172.21.15.37:0/2532170037 conn(0x7fc3ac073050 msgr2=0x7fc3ac158bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 shutdown_connections 2023-07-09T21:42:51.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:51.980+0000 7fc3b3256640 1 -- 172.21.15.37:0/2532170037 wait complete. 2023-07-09T21:42:51.986 INFO:tasks.ceph.mds.a.smithi037.stderr: -2860> 2023-07-09T21:42:29.272+0000 7fb46d3a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:42:52.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:42:52.042 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:42:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.152+0000 7fe0e711e640 1 Processor -- start 2023-07-09T21:42:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.152+0000 7fe0e711e640 1 -- start start 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e711e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e00cda10 0x7fe0e00c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e711e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e00c4c90 con 0x7fe0e01595c0 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e711e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e00ca170 con 0x7fe0e0159990 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e711e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e00ca730 con 0x7fe0e00cda10 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e00cda10 0x7fe0e00c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0e00cda10 0x7fe0e00c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39766/0 (socket says 172.21.15.37:39766) 2023-07-09T21:42:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e4eba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0e01595c0 0x7fe0e015dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51648/0 (socket says 172.21.15.37:51648) 2023-07-09T21:42:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 -- 172.21.15.37:0/2958297860 learned_addr learned my addr 172.21.15.37:0/2958297860 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 -- 172.21.15.37:0/2958297860 >> v1:172.21.15.119:6789/0 conn(0x7fe0e0159990 legacy=0x7fe0e00cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 -- 172.21.15.37:0/2958297860 >> v1:172.21.15.37:6789/0 conn(0x7fe0e01595c0 legacy=0x7fe0e015dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 -- 172.21.15.37:0/2958297860 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e00ca450 con 0x7fe0e00cda10 2023-07-09T21:42:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0e56bb640 1 --2- 172.21.15.37:0/2958297860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e00cda10 0x7fe0e00c4750 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e50 tx=0x7fe0d801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63fc0136dbadbfb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0df7fe640 1 -- 172.21.15.37:0/2958297860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80a5860 con 0x7fe0e00cda10 2023-07-09T21:42:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0df7fe640 1 -- 172.21.15.37:0/2958297860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80a59c0 con 0x7fe0e00cda10 2023-07-09T21:42:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.156+0000 7fe0df7fe640 1 -- 172.21.15.37:0/2958297860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80a5d50 con 0x7fe0e00cda10 2023-07-09T21:42:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- 172.21.15.37:0/2958297860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e00cda10 msgr2=0x7fe0e00c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 --2- 172.21.15.37:0/2958297860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e00cda10 0x7fe0e00c4750 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8009e50 tx=0x7fe0d801c9a0 comp rx=0 tx=0).stop 2023-07-09T21:42:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- 172.21.15.37:0/2958297860 shutdown_connections 2023-07-09T21:42:52.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 --2- 172.21.15.37:0/2958297860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e00cda10 0x7fe0e00c4750 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- 172.21.15.37:0/2958297860 >> 172.21.15.37:0/2958297860 conn(0x7fe0e00cde40 msgr2=0x7fe0e00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- 172.21.15.37:0/2958297860 shutdown_connections 2023-07-09T21:42:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- 172.21.15.37:0/2958297860 wait complete. 2023-07-09T21:42:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 Processor -- start 2023-07-09T21:42:52.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- start start 2023-07-09T21:42:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0e00cda10 0x7fe0e0148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0e01595c0 0x7fe0e0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e0149490 con 0x7fe0e0159990 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e015bc20 con 0x7fe0e01595c0 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e711e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e0070d80 con 0x7fe0e00cda10 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e56bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e56bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39768/0 (socket says 172.21.15.37:39768) 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.160+0000 7fe0e56bb640 1 -- 172.21.15.37:0/831852139 learned_addr learned my addr 172.21.15.37:0/831852139 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e4eba640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0e00cda10 0x7fe0e0148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dffff640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0e01595c0 0x7fe0e0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 -- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0e00cda10 msgr2=0x7fe0e0148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0e00cda10 0x7fe0e0148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 -- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0e01595c0 msgr2=0x7fe0e0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0e01595c0 0x7fe0e0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 -- 172.21.15.37:0/831852139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009b30 con 0x7fe0e0159990 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e56bb640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80af040 tx=0x7fe0d8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80b8670 con 0x7fe0e0159990 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80b87f0 con 0x7fe0e0159990 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e015be70 con 0x7fe0e0159990 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80b8ba0 con 0x7fe0e0159990 2023-07-09T21:42:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e015c430 con 0x7fe0e0159990 2023-07-09T21:42:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e004d7d0 con 0x7fe0e0159990 2023-07-09T21:42:52.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0d80b8d00 con 0x7fe0e0159990 2023-07-09T21:42:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 0x7fe0c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.164+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6907+0+0 (secure 0 0 0) 0x7fe0d811fad0 con 0x7fe0e0159990 2023-07-09T21:42:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.168+0000 7fe0e4eba640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 0x7fe0c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:52.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.168+0000 7fe0e4eba640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 0x7fe0c4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f70 tx=0x7fe0d4007c90 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:52.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.168+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe0d80ecb80 con 0x7fe0e0159990 2023-07-09T21:42:52.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:52.356+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe0e00cc960 con 0x7fe0e0159990 2023-07-09T21:42:53.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.020+0000 7fe0dd7fa640 1 -- 172.21.15.37:0/831852139 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe0d80f01a0 con 0x7fe0e0159990 2023-07-09T21:42:53.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 msgr2=0x7fe0c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 0x7fe0c4068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000f70 tx=0x7fe0d4007c90 comp rx=0 tx=0).stop 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 msgr2=0x7fe0e0152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80af040 tx=0x7fe0d8019740 comp rx=0 tx=0).stop 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 shutdown_connections 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fe0c40663a0 0x7fe0c4068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0e0159990 0x7fe0e0152650 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0e01595c0 0x7fe0e0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 --2- 172.21.15.37:0/831852139 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0e00cda10 0x7fe0e0148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 >> 172.21.15.37:0/831852139 conn(0x7fe0e00cde40 msgr2=0x7fe0e006c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 shutdown_connections 2023-07-09T21:42:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.024+0000 7fe0e711e640 1 -- 172.21.15.37:0/831852139 wait complete. 2023-07-09T21:42:53.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:42:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 Processor -- start 2023-07-09T21:42:53.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 -- start start 2023-07-09T21:42:53.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8cc0160030 0x7f8cc00d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc015bf80 con 0x7f8cc00cf290 2023-07-09T21:42:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc00d02f0 con 0x7f8cc00b7980 2023-07-09T21:42:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cc579f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc00cd070 con 0x7f8cc0160030 2023-07-09T21:42:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbe7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8cc00cf290 0x7f8cc00d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51654/0 (socket says 172.21.15.37:51654) 2023-07-09T21:42:53.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbe7fc640 1 -- 172.21.15.37:0/2961328154 learned_addr learned my addr 172.21.15.37:0/2961328154 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/2961328154 >> v2:172.21.15.119:3300/0 conn(0x7f8cc0160030 0x7f8cc00d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950913167 0 0) 0x7f8cb4001120 con 0x7f8cc00cf290 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ca8003530 con 0x7f8cc00cf290 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4039104074 0 0) 0x7f8cc00d02f0 con 0x7f8cc00b7980 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb4001120 con 0x7f8cc00b7980 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3740147586 0 0) 0x7f8ca8003530 con 0x7f8cc00cf290 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 >> v2:172.21.15.119:3300/0 conn(0x7f8cc0160030 msgr2=0x7f8cc00d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 --2- 172.21.15.37:0/2961328154 >> v2:172.21.15.119:3300/0 conn(0x7f8cc0160030 0x7f8cc00d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 >> v1:172.21.15.119:6789/0 conn(0x7f8cc00b7980 legacy=0x7f8cc00ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00cc7f0 con 0x7f8cc00cf290 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f8cb4001810 con 0x7f8cc00cf290 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 >> v1:172.21.15.37:6789/0 conn(0x7f8cc00cf290 legacy=0x7f8cc00d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca8003b10 0x7f8ca8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 0x7f8ca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca8005180 0x7f8ca800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00cd070 con 0x7f8ca80047d0 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca800bfe0 con 0x7f8ca8003b10 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca800c1a0 con 0x7f8ca8005180 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/2961328154 >> v2:172.21.15.119:3300/0 conn(0x7f8cc0160030 0x7f8cc00d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbe7fc640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 0x7f8ca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca8003b10 0x7f8ca8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.244+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca8005180 0x7f8ca800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 -- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca8005180 msgr2=0x7f8ca800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:53.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca8005180 0x7f8ca800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 -- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca8003b10 msgr2=0x7f8ca8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca8003b10 0x7f8ca8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 -- 172.21.15.37:0/2961328154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca8003530 con 0x7f8ca80047d0 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca8005180 0x7f8ca800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ca8003b10 0x7f8ca8003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:53.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbf7fe640 1 -- 172.21.15.37:0/2961328154 reap_dead start 2023-07-09T21:42:53.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbe7fc640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 0x7f8ca8004c40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00cf6b0 tx=0x7f8cb401cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e8b9e498666218 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb40058e0 con 0x7f8ca80047d0 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4005a60 con 0x7f8ca80047d0 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cbdffb640 1 -- 172.21.15.37:0/2961328154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4005e50 con 0x7f8ca80047d0 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 -- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 msgr2=0x7f8ca8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 0x7f8ca8004c40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00cf6b0 tx=0x7f8cb401cb10 comp rx=0 tx=0).stop 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 -- 172.21.15.37:0/2961328154 shutdown_connections 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 --2- 172.21.15.37:0/2961328154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ca80047d0 0x7f8ca8004c40 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 -- 172.21.15.37:0/2961328154 >> 172.21.15.37:0/2961328154 conn(0x7f8cc0073090 msgr2=0x7f8cc0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 -- 172.21.15.37:0/2961328154 shutdown_connections 2023-07-09T21:42:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.248+0000 7f8cc579f640 1 -- 172.21.15.37:0/2961328154 wait complete. 2023-07-09T21:42:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 Processor -- start 2023-07-09T21:42:53.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 -- start start 2023-07-09T21:42:53.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 0x7f8cc01501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cc01507f0 0x7f8cc015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc00cc130 con 0x7f8cc015c120 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc015ca90 con 0x7f8cc01507f0 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cc579f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc015cd70 con 0x7f8ca80047d0 2023-07-09T21:42:53.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39786/0 (socket says 172.21.15.37:39786) 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 -- 172.21.15.37:0/1945559391 learned_addr learned my addr 172.21.15.37:0/1945559391 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbe7fc640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cc01507f0 0x7f8cc015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 0x7f8cc01501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 -- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 msgr2=0x7f8cc01501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 0x7f8cc01501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 -- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cc01507f0 msgr2=0x7f8cc015db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cc01507f0 0x7f8cc015db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 -- 172.21.15.37:0/1945559391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc015d050 con 0x7f8cc015c120 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 0x7f8cc01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8cbf7fe640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00b1010 tx=0x7f8cb80111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.252+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800e070 con 0x7f8cc015c120 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb8003bb0 con 0x7f8cc015c120 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc015d330 con 0x7f8cc015c120 2023-07-09T21:42:53.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8003d60 con 0x7f8cc015c120 2023-07-09T21:42:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc015c5c0 con 0x7f8cc015c120 2023-07-09T21:42:53.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc004d7d0 con 0x7f8cc015c120 2023-07-09T21:42:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8cb8004030 con 0x7f8cc015c120 2023-07-09T21:42:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8ca77fe640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 0x7f8cac068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 6907+0+0 (secure 0 0 0) 0x7f8cb8084250 con 0x7f8cc015c120 2023-07-09T21:42:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.256+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 0x7f8cac068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:53.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.260+0000 7f8cbeffd640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 0x7f8cac068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000c10 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:53.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.260+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8cb8051150 con 0x7f8cc015c120 2023-07-09T21:42:53.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:53.416+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8cc015d7e0 con 0x7f8cc015c120 2023-07-09T21:42:54.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.024+0000 7f8ca77fe640 1 -- 172.21.15.37:0/1945559391 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v148) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8cb8054770 con 0x7f8cc015c120 2023-07-09T21:42:54.026 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:42:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 msgr2=0x7f8cac068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 0x7f8cac068880 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8cb0000c10 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 msgr2=0x7f8cc00b64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00b1010 tx=0x7f8cb80111d0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 shutdown_connections 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8cac0663d0 0x7f8cac068880 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cc015c120 0x7f8cc00b64b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8cc01507f0 0x7f8cc015db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 --2- 172.21.15.37:0/1945559391 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ca80047d0 0x7f8cc01501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 >> 172.21.15.37:0/1945559391 conn(0x7f8cc0073090 msgr2=0x7f8cc00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 shutdown_connections 2023-07-09T21:42:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.028+0000 7f8cc579f640 1 -- 172.21.15.37:0/1945559391 wait complete. 2023-07-09T21:42:54.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:42:54.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.208+0000 7f2d72dac640 1 Processor -- start 2023-07-09T21:42:54.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.208+0000 7f2d72dac640 1 -- start start 2023-07-09T21:42:54.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d72dac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 0x7f2d6c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d72dac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d6c0ceb80 0x7f2d6c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d72dac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d6c15bf80 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d72dac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d6c0cd070 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d72dac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c0cfd70 con 0x7f2d6c0b7980 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d71349640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2d6c0b3c20 0x7f2d6c0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51670/0 (socket says 172.21.15.37:51670) 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d71349640 1 -- 172.21.15.37:0/838903097 learned_addr learned my addr 172.21.15.37:0/838903097 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:54.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/838903097 >> v2:172.21.15.37:3300/0 conn(0x7f2d6c0ceb80 0x7f2d6c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d70b48640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 0x7f2d6c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 -- 172.21.15.37:0/838903097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 msgr2=0x7f2d6c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 0x7f2d6c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 -- 172.21.15.37:0/838903097 >> v1:172.21.15.37:6789/0 conn(0x7f2d6c0b3c20 legacy=0x7f2d6c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 -- 172.21.15.37:0/838903097 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c160570 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d70b48640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 0x7f2d6c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:54.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6b7fe640 1 -- 172.21.15.37:0/838903097 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540380153 0 0) 0x7f2d640014a0 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.212+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cef90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f2d580097c0 tx=0x7f2d5801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485a38879502fe7b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:54.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d6b7fe640 1 -- 172.21.15.37:0/838903097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ab600 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d6b7fe640 1 -- 172.21.15.37:0/838903097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d580a7050 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d6b7fe640 1 -- 172.21.15.37:0/838903097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580ab980 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- 172.21.15.37:0/838903097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0ceb80 msgr2=0x7f2d6c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cef90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f2d580097c0 tx=0x7f2d5801c480 comp rx=0 tx=0).stop 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- 172.21.15.37:0/838903097 shutdown_connections 2023-07-09T21:42:54.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cef90 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- 172.21.15.37:0/838903097 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0b7980 0x7f2d6c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- 172.21.15.37:0/838903097 >> 172.21.15.37:0/838903097 conn(0x7f2d6c073090 msgr2=0x7f2d6c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- 172.21.15.37:0/838903097 shutdown_connections 2023-07-09T21:42:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- 172.21.15.37:0/838903097 wait complete. 2023-07-09T21:42:54.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 Processor -- start 2023-07-09T21:42:54.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- start start 2023-07-09T21:42:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d6c0b7980 0x7f2d6c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c15b500 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c15b7e0 con 0x7f2d6c0b7980 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d72dac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c15bac0 con 0x7f2d6c0ceb80 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d70b48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d70b48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39806/0 (socket says 172.21.15.37:39806) 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.216+0000 7f2d70b48640 1 -- 172.21.15.37:0/2980461572 learned_addr learned my addr 172.21.15.37:0/2980461572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d6c0b7980 0x7f2d6c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d71349640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 -- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 msgr2=0x7f2d6c0cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 -- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d6c0b7980 msgr2=0x7f2d6c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:54.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d6c0b7980 0x7f2d6c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 -- 172.21.15.37:0/2980461572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58009420 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d71349640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:54.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d70b48640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e810 tx=0x7f2d6000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000c8d0 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d6000ca30 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6000cde0 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c0ca540 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c0ca1f0 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c04d7d0 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d60013410 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 0x7f2d50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.220+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6469+0+0 (secure 0 0 0) 0x7f2d60083f70 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.224+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 0x7f2d50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:54.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.224+0000 7f2d6bfff640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 0x7f2d50068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d580ad000 tx=0x7f2d580a6000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:54.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.224+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d60051020 con 0x7f2d6c0b3c20 2023-07-09T21:42:54.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:54.384+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d6c0b1600 con 0x7f2d6c0b3c20 2023-07-09T21:42:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.040+0000 7f2d697fa640 1 -- 172.21.15.37:0/2980461572 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v149) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2d60054640 con 0x7f2d6c0b3c20 2023-07-09T21:42:55.039 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:42:55.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.040+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 msgr2=0x7f2d50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.040+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 0x7f2d50068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2d580ad000 tx=0x7f2d580a6000 comp rx=0 tx=0).stop 2023-07-09T21:42:55.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.040+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 msgr2=0x7f2d6c0cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.040+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000e810 tx=0x7f2d6000ecd0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 shutdown_connections 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f2d500663a0 0x7f2d50068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d6c0ceb80 0x7f2d6c0cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d6c0b7980 0x7f2d6c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 --2- 172.21.15.37:0/2980461572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d6c0b3c20 0x7f2d6c0cbd90 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 >> 172.21.15.37:0/2980461572 conn(0x7f2d6c073090 msgr2=0x7f2d6c0b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 shutdown_connections 2023-07-09T21:42:55.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.044+0000 7f2d72dac640 1 -- 172.21.15.37:0/2980461572 wait complete. 2023-07-09T21:42:55.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:42:55.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 Processor -- start 2023-07-09T21:42:55.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 -- start start 2023-07-09T21:42:55.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f84b00b0390 0x7f84b0160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84b00c47c0 0x7f84b0163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84b00cbcd0 con 0x7f84b00c42b0 2023-07-09T21:42:55.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00ca6d0 con 0x7f84b00c47c0 2023-07-09T21:42:55.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b766d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84b00ca050 con 0x7f84b00b0390 2023-07-09T21:42:55.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84b00c47c0 0x7f84b0163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84b00c47c0 0x7f84b0163c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39816/0 (socket says 172.21.15.37:39816) 2023-07-09T21:42:55.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 -- 172.21.15.37:0/2744243558 learned_addr learned my addr 172.21.15.37:0/2744243558 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:55.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5409640 1 --2- 172.21.15.37:0/2744243558 >> v2:172.21.15.119:3300/0 conn(0x7f84b00b0390 0x7f84b0160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 -- 172.21.15.37:0/2744243558 >> v2:172.21.15.119:3300/0 conn(0x7f84b00b0390 msgr2=0x7f84b0160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:55.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 --2- 172.21.15.37:0/2744243558 >> v2:172.21.15.119:3300/0 conn(0x7f84b00b0390 0x7f84b0160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 -- 172.21.15.37:0/2744243558 >> v1:172.21.15.119:6789/0 conn(0x7f84b00c42b0 legacy=0x7f84b00cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.220+0000 7f84b5c0a640 1 -- 172.21.15.37:0/2744243558 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b006cb80 con 0x7f84b00c47c0 2023-07-09T21:42:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b5c0a640 1 --2- 172.21.15.37:0/2744243558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b0163c40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f84b006e940 tx=0x7f84a801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21374a9965288098 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84a7fff640 1 -- 172.21.15.37:0/2744243558 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a5710 con 0x7f84b00c47c0 2023-07-09T21:42:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84a7fff640 1 -- 172.21.15.37:0/2744243558 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80a5870 con 0x7f84b00c47c0 2023-07-09T21:42:55.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84a7fff640 1 -- 172.21.15.37:0/2744243558 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80a5c00 con 0x7f84b00c47c0 2023-07-09T21:42:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 -- 172.21.15.37:0/2744243558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 msgr2=0x7f84b0163c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 --2- 172.21.15.37:0/2744243558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b0163c40 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f84b006e940 tx=0x7f84a801c940 comp rx=0 tx=0).stop 2023-07-09T21:42:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 -- 172.21.15.37:0/2744243558 shutdown_connections 2023-07-09T21:42:55.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 --2- 172.21.15.37:0/2744243558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b0163c40 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 --2- 172.21.15.37:0/2744243558 >> v2:172.21.15.119:3300/0 conn(0x7f84b00b0390 0x7f84b0160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 -- 172.21.15.37:0/2744243558 >> 172.21.15.37:0/2744243558 conn(0x7f84b00cde40 msgr2=0x7f84b00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 -- 172.21.15.37:0/2744243558 shutdown_connections 2023-07-09T21:42:55.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.224+0000 7f84b766d640 1 -- 172.21.15.37:0/2744243558 wait complete. 2023-07-09T21:42:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 Processor -- start 2023-07-09T21:42:55.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- start start 2023-07-09T21:42:55.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00b0390 0x7f84b00b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b00c42b0 0x7f84b00b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b17c0 con 0x7f84b00c47c0 2023-07-09T21:42:55.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b1aa0 con 0x7f84b00c42b0 2023-07-09T21:42:55.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b00b1d80 con 0x7f84b00b0390 2023-07-09T21:42:55.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39822/0 (socket says 172.21.15.37:39822) 2023-07-09T21:42:55.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 -- 172.21.15.37:0/527765256 learned_addr learned my addr 172.21.15.37:0/527765256 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:55.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b4c08640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b00c42b0 0x7f84b00b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5409640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00b0390 0x7f84b00b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 -- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00b0390 msgr2=0x7f84b00b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00b0390 0x7f84b00b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 -- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b00c42b0 msgr2=0x7f84b00b30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b00c42b0 0x7f84b00b30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 -- 172.21.15.37:0/527765256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a8009b30 con 0x7f84b00c47c0 2023-07-09T21:42:55.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b5c0a640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f84a80af040 tx=0x7f84a80196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80b8670 con 0x7f84b00c47c0 2023-07-09T21:42:55.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a80b87f0 con 0x7f84b00c47c0 2023-07-09T21:42:55.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a80b8ba0 con 0x7f84b00c47c0 2023-07-09T21:42:55.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84b00b2060 con 0x7f84b00c47c0 2023-07-09T21:42:55.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84b0155180 con 0x7f84b00c47c0 2023-07-09T21:42:55.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.228+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84b004d7d0 con 0x7f84b00c47c0 2023-07-09T21:42:55.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.232+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84a80b8d00 con 0x7f84b00c47c0 2023-07-09T21:42:55.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.232+0000 7f84a5ffb640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 0x7f8494068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.232+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f84a811efa0 con 0x7f84b00c47c0 2023-07-09T21:42:55.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.232+0000 7f84b5409640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 0x7f8494068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.232+0000 7f84b5409640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 0x7f8494068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009b60 tx=0x7f84ac009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.236+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f84a80ec320 con 0x7f84b00c47c0 2023-07-09T21:42:55.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.392+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f84b0164990 con 0x7f84b00c47c0 2023-07-09T21:42:55.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.396+0000 7f84a5ffb640 1 -- 172.21.15.37:0/527765256 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84b0164990 con 0x7f84b00c47c0 2023-07-09T21:42:55.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 msgr2=0x7f8494068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 0x7f8494068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009b60 tx=0x7f84ac009190 comp rx=0 tx=0).stop 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 msgr2=0x7f84b00b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f84a80af040 tx=0x7f84a80196e0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 shutdown_connections 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f84940663a0 0x7f8494068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b00c47c0 0x7f84b00b0d90 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f84b00c42b0 0x7f84b00b30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 --2- 172.21.15.37:0/527765256 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f84b00b0390 0x7f84b00b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 >> 172.21.15.37:0/527765256 conn(0x7f84b00cde40 msgr2=0x7f84b00c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 shutdown_connections 2023-07-09T21:42:55.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.400+0000 7f84b766d640 1 -- 172.21.15.37:0/527765256 wait complete. 2023-07-09T21:42:55.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:42:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.564+0000 7f654d0fc640 1 Processor -- start 2023-07-09T21:42:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.564+0000 7f654d0fc640 1 -- start start 2023-07-09T21:42:55.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f654d0fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65480b7980 0x7f6548160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f654d0fc640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654815bf80 con 0x7f65480ceb80 2023-07-09T21:42:55.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f654d0fc640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6548160570 con 0x7f65480d0780 2023-07-09T21:42:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f654d0fc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65480cd070 con 0x7f65480b7980 2023-07-09T21:42:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f6546d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65480b7980 0x7f6548160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f653ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65480ceb80 0x7f65480cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51684/0 (socket says 172.21.15.37:51684) 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f653ffff640 1 -- 172.21.15.37:0/2528783838 learned_addr learned my addr 172.21.15.37:0/2528783838 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f6546d9d640 1 -- 172.21.15.37:0/2528783838 >> v1:172.21.15.119:6789/0 conn(0x7f65480d0780 legacy=0x7f65480d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f6546d9d640 1 -- 172.21.15.37:0/2528783838 >> v1:172.21.15.37:6789/0 conn(0x7f65480ceb80 legacy=0x7f65480cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f6546d9d640 1 -- 172.21.15.37:0/2528783838 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65480d02f0 con 0x7f65480b7980 2023-07-09T21:42:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.568+0000 7f654659c640 1 -- 172.21.15.37:0/2528783838 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057043772 0 0) 0x7f6530001120 con 0x7f65480ceb80 2023-07-09T21:42:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f6546d9d640 1 --2- 172.21.15.37:0/2528783838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548160030 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f65380097c0 tx=0x7f653801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467644f6637b1ffb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654659c640 1 -- 172.21.15.37:0/2528783838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380ab600 con 0x7f65480b7980 2023-07-09T21:42:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654659c640 1 -- 172.21.15.37:0/2528783838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380a7050 con 0x7f65480b7980 2023-07-09T21:42:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654659c640 1 -- 172.21.15.37:0/2528783838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380ab980 con 0x7f65480b7980 2023-07-09T21:42:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- 172.21.15.37:0/2528783838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 msgr2=0x7f6548160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 --2- 172.21.15.37:0/2528783838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548160030 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f65380097c0 tx=0x7f653801c440 comp rx=0 tx=0).stop 2023-07-09T21:42:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- 172.21.15.37:0/2528783838 shutdown_connections 2023-07-09T21:42:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 --2- 172.21.15.37:0/2528783838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548160030 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- 172.21.15.37:0/2528783838 >> 172.21.15.37:0/2528783838 conn(0x7f6548073090 msgr2=0x7f6548069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- 172.21.15.37:0/2528783838 shutdown_connections 2023-07-09T21:42:55.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- 172.21.15.37:0/2528783838 wait complete. 2023-07-09T21:42:55.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 Processor -- start 2023-07-09T21:42:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.572+0000 7f654d0fc640 1 -- start start 2023-07-09T21:42:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65480ceb80 0x7f65480cab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 0x7f65480cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c9270 con 0x7f65480b7980 2023-07-09T21:42:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480c9b10 con 0x7f65480d0780 2023-07-09T21:42:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65480cb5f0 con 0x7f65480ceb80 2023-07-09T21:42:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39840/0 (socket says 172.21.15.37:39840) 2023-07-09T21:42:55.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 -- 172.21.15.37:0/729076884 learned_addr learned my addr 172.21.15.37:0/729076884 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f653ffff640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65480ceb80 0x7f65480cab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654759e640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 0x7f65480cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 -- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65480ceb80 msgr2=0x7f65480cab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65480ceb80 0x7f65480cab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 -- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 msgr2=0x7f65480cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 0x7f65480cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 -- 172.21.15.37:0/729076884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6538009420 con 0x7f65480b7980 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654759e640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 0x7f65480cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f6546d9d640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6538019050 tx=0x7f653801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380b7860 con 0x7f65480b7980 2023-07-09T21:42:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65380b79c0 con 0x7f65480b7980 2023-07-09T21:42:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380b7d70 con 0x7f65480b7980 2023-07-09T21:42:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480cb880 con 0x7f65480b7980 2023-07-09T21:42:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65480c97a0 con 0x7f65480b7980 2023-07-09T21:42:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654804d7d0 con 0x7f65480b7980 2023-07-09T21:42:55.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.576+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65380b5400 con 0x7f65480b7980 2023-07-09T21:42:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.580+0000 7f653f7fe640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.580+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f653811ea50 con 0x7f65480b7980 2023-07-09T21:42:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.580+0000 7f653ffff640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.580+0000 7f653ffff640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 0x7f6528068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6530007fd0 tx=0x7f65300079c0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.584+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65380ebca0 con 0x7f65480b7980 2023-07-09T21:42:55.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.736+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f6548160570 con 0x7f65480b7980 2023-07-09T21:42:55.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.740+0000 7f653f7fe640 1 -- 172.21.15.37:0/729076884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v50) v1 ==== 120+0+0 (secure 0 0 0) 0x7f6548160570 con 0x7f65480b7980 2023-07-09T21:42:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 msgr2=0x7f6528068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 0x7f6528068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6530007fd0 tx=0x7f65300079c0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 msgr2=0x7f6548157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6538019050 tx=0x7f653801ac80 comp rx=0 tx=0).stop 2023-07-09T21:42:55.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 shutdown_connections 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65280663a0 0x7f6528068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65480d0780 0x7f65480cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65480ceb80 0x7f65480cab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 --2- 172.21.15.37:0/729076884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65480b7980 0x7f6548157980 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 >> 172.21.15.37:0/729076884 conn(0x7f6548073090 msgr2=0x7f65480b5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 shutdown_connections 2023-07-09T21:42:55.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.744+0000 7f654d0fc640 1 -- 172.21.15.37:0/729076884 wait complete. 2023-07-09T21:42:55.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:42:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.908+0000 7f66875ac640 1 Processor -- start 2023-07-09T21:42:55.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.908+0000 7f66875ac640 1 -- start start 2023-07-09T21:42:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f66875ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66800b7980 0x7f6680160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f66875ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f66800ceb80 0x7f66800cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f66875ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668015bf80 con 0x7f66800b3c20 2023-07-09T21:42:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f66875ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800cd070 con 0x7f66800b7980 2023-07-09T21:42:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f66875ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800cfd70 con 0x7f66800ceb80 2023-07-09T21:42:55.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685348640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66800b7980 0x7f6680160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685b49640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f66800b3c20 0x7f66800b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51694/0 (socket says 172.21.15.37:51694) 2023-07-09T21:42:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685b49640 1 -- 172.21.15.37:0/2317571691 learned_addr learned my addr 172.21.15.37:0/2317571691 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6684b47640 1 --2- 172.21.15.37:0/2317571691 >> v2:172.21.15.119:3300/0 conn(0x7f66800ceb80 0x7f66800cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6677fff640 1 -- 172.21.15.37:0/2317571691 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028635995 0 0) 0x7f66780014a0 con 0x7f66800b3c20 2023-07-09T21:42:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6677fff640 1 -- 172.21.15.37:0/2317571691 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c003530 con 0x7f66800b3c20 2023-07-09T21:42:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685348640 1 -- 172.21.15.37:0/2317571691 >> v2:172.21.15.119:3300/0 conn(0x7f66800ceb80 msgr2=0x7f66800cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:55.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685348640 1 --2- 172.21.15.37:0/2317571691 >> v2:172.21.15.119:3300/0 conn(0x7f66800ceb80 0x7f66800cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685348640 1 -- 172.21.15.37:0/2317571691 >> v1:172.21.15.37:6789/0 conn(0x7f66800b3c20 legacy=0x7f66800b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.912+0000 7f6685348640 1 -- 172.21.15.37:0/2317571691 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680160570 con 0x7f66800b7980 2023-07-09T21:42:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f6685348640 1 --2- 172.21.15.37:0/2317571691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b7980 0x7f6680160030 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f66800b4cd0 tx=0x7f667c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9c2cd8fc1a5b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f6677fff640 1 -- 172.21.15.37:0/2317571691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0ab600 con 0x7f66800b7980 2023-07-09T21:42:55.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f6677fff640 1 -- 172.21.15.37:0/2317571691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0a7050 con 0x7f66800b7980 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f6677fff640 1 -- 172.21.15.37:0/2317571691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0ab980 con 0x7f66800b7980 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- 172.21.15.37:0/2317571691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b7980 msgr2=0x7f6680160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- 172.21.15.37:0/2317571691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b7980 0x7f6680160030 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f66800b4cd0 tx=0x7f667c01c460 comp rx=0 tx=0).stop 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- 172.21.15.37:0/2317571691 shutdown_connections 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- 172.21.15.37:0/2317571691 >> v2:172.21.15.119:3300/0 conn(0x7f66800ceb80 0x7f66800cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- 172.21.15.37:0/2317571691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b7980 0x7f6680160030 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- 172.21.15.37:0/2317571691 >> 172.21.15.37:0/2317571691 conn(0x7f6680073090 msgr2=0x7f6680069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:55.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- 172.21.15.37:0/2317571691 shutdown_connections 2023-07-09T21:42:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- 172.21.15.37:0/2317571691 wait complete. 2023-07-09T21:42:55.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 Processor -- start 2023-07-09T21:42:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- start start 2023-07-09T21:42:55.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66800b7980 0x7f668015c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 0x7f6680159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668015cfa0 con 0x7f66800b3c20 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668015d9a0 con 0x7f66800ceb80 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.916+0000 7f66875ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668015dc80 con 0x7f66800b7980 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39844/0 (socket says 172.21.15.37:39844) 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 -- 172.21.15.37:0/1668449504 learned_addr learned my addr 172.21.15.37:0/1668449504 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6684b47640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66800b7980 0x7f668015c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685b49640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 0x7f6680159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 -- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66800b7980 msgr2=0x7f668015c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66800b7980 0x7f668015c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 -- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 msgr2=0x7f6680159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:55.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 0x7f6680159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 -- 172.21.15.37:0/1668449504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c009420 con 0x7f66800b3c20 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685b49640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 0x7f6680159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6685348640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae040 tx=0x7f667c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0b4840 con 0x7f66800b3c20 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f667c0b49c0 con 0x7f66800b3c20 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f668015df60 con 0x7f66800b3c20 2023-07-09T21:42:55.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0b4d70 con 0x7f66800b3c20 2023-07-09T21:42:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f668015e520 con 0x7f66800b3c20 2023-07-09T21:42:55.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668004d7d0 con 0x7f66800b3c20 2023-07-09T21:42:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.920+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f667c0b2040 con 0x7f66800b3c20 2023-07-09T21:42:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.924+0000 7f6675ffb640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 0x7f6664068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.924+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f667c11e060 con 0x7f66800b3c20 2023-07-09T21:42:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.924+0000 7f6684b47640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 0x7f6664068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:55.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.924+0000 7f6684b47640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 0x7f6664068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6680155cc0 tx=0x7f6670009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:55.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:55.928+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f667c0eb3d0 con 0x7f66800b3c20 2023-07-09T21:42:56.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.084+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f6680160570 con 0x7f66800b3c20 2023-07-09T21:42:56.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.088+0000 7f6675ffb640 1 -- 172.21.15.37:0/1668449504 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v51) v1 ==== 115+0+0 (secure 0 0 0) 0x7f6680160570 con 0x7f66800b3c20 2023-07-09T21:42:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 msgr2=0x7f6664068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 0x7f6664068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6680155cc0 tx=0x7f6670009190 comp rx=0 tx=0).stop 2023-07-09T21:42:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 msgr2=0x7f66801540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f667c0ae040 tx=0x7f667c019200 comp rx=0 tx=0).stop 2023-07-09T21:42:56.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 shutdown_connections 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f66640663a0 0x7f6664068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f66800ceb80 0x7f6680159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f66800b7980 0x7f668015c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 --2- 172.21.15.37:0/1668449504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66800b3c20 0x7f66801540c0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 >> 172.21.15.37:0/1668449504 conn(0x7f6680073090 msgr2=0x7f6680069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 shutdown_connections 2023-07-09T21:42:56.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.092+0000 7f66875ac640 1 -- 172.21.15.37:0/1668449504 wait complete. 2023-07-09T21:42:56.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove' 2023-07-09T21:42:56.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 Processor -- start 2023-07-09T21:42:56.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 -- start start 2023-07-09T21:42:56.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa0fc0b4340 0x7fa0fc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:56.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0b49f0 con 0x7fa0fc0cef80 2023-07-09T21:42:56.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0fc0cc8a0 con 0x7fa0fc0b7ab0 2023-07-09T21:42:56.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa102e5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0fc0b7e80 con 0x7fa0fc0b4340 2023-07-09T21:42:56.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa1013f9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0fc0cef80 0x7fa0fc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2023-07-09T21:42:56.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa1013f9640 1 -- 172.21.15.37:0/455243290 learned_addr learned my addr 172.21.15.37:0/455243290 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/455243290 >> v2:172.21.15.119:3300/0 conn(0x7fa0fc0b4340 0x7fa0fc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fb7fe640 1 -- 172.21.15.37:0/455243290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4294884822 0 0) 0x7fa0fc0b49f0 con 0x7fa0fc0cef80 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fb7fe640 1 -- 172.21.15.37:0/455243290 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0ec003530 con 0x7fa0fc0cef80 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fbfff640 1 -- 172.21.15.37:0/455243290 >> v1:172.21.15.119:6789/0 conn(0x7fa0fc0b7ab0 legacy=0x7fa0fc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fbfff640 1 -- 172.21.15.37:0/455243290 >> v1:172.21.15.37:6789/0 conn(0x7fa0fc0cef80 legacy=0x7fa0fc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.256+0000 7fa0fbfff640 1 -- 172.21.15.37:0/455243290 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc0ccb80 con 0x7fa0fc0b4340 2023-07-09T21:42:56.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/455243290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc06aa50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097c0 tx=0x7fa0e801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1e4e88e0f2ea6b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa0fb7fe640 1 -- 172.21.15.37:0/455243290 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80ab650 con 0x7fa0fc0b4340 2023-07-09T21:42:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa0fb7fe640 1 -- 172.21.15.37:0/455243290 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80ab7b0 con 0x7fa0fc0b4340 2023-07-09T21:42:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa0fb7fe640 1 -- 172.21.15.37:0/455243290 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80abb40 con 0x7fa0fc0b4340 2023-07-09T21:42:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 -- 172.21.15.37:0/455243290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0b4340 msgr2=0x7fa0fc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 --2- 172.21.15.37:0/455243290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc06aa50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80097c0 tx=0x7fa0e801c450 comp rx=0 tx=0).stop 2023-07-09T21:42:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 -- 172.21.15.37:0/455243290 shutdown_connections 2023-07-09T21:42:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 --2- 172.21.15.37:0/455243290 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc06aa50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 -- 172.21.15.37:0/455243290 >> 172.21.15.37:0/455243290 conn(0x7fa0fc073090 msgr2=0x7fa0fc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 -- 172.21.15.37:0/455243290 shutdown_connections 2023-07-09T21:42:56.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.260+0000 7fa102e5c640 1 -- 172.21.15.37:0/455243290 wait complete. 2023-07-09T21:42:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 Processor -- start 2023-07-09T21:42:56.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- start start 2023-07-09T21:42:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:56.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 0x7fa0fc0c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 0x7fa0fc0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc144270 con 0x7fa0fc0b4340 2023-07-09T21:42:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc155e80 con 0x7fa0fc0cef80 2023-07-09T21:42:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0fc156160 con 0x7fa0fc0b7ab0 2023-07-09T21:42:56.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:56.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39850/0 (socket says 172.21.15.37:39850) 2023-07-09T21:42:56.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 -- 172.21.15.37:0/2136118661 learned_addr learned my addr 172.21.15.37:0/2136118661 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 0x7fa0fc0c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa1013f9640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 0x7fa0fc0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 -- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 msgr2=0x7fa0fc0c6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 0x7fa0fc0c6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 -- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 msgr2=0x7fa0fc0c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 0x7fa0fc0c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 -- 172.21.15.37:0/2136118661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8009420 con 0x7fa0fc0b4340 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 0x7fa0fc0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa1013f9640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 0x7fa0fc0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa100bf8640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000c500 tx=0x7fa0f000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:56.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0005220 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0f0005380 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0f0007270 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0fc156440 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.264+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0fc0c71b0 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0fc04d7d0 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0f00073d0 con 0x7fa0fc0b4340 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa0f97fa640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 0x7fa0e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:56.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fa0f00837c0 con 0x7fa0fc0b4340 2023-07-09T21:42:56.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 0x7fa0e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:56.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.268+0000 7fa0fbfff640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 0x7fa0e0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80af000 tx=0x7fa0e8008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:56.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.272+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0f0050b40 con 0x7fa0fc0b4340 2023-07-09T21:42:56.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:56.496+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]} v 0) v1 -- 0x7fa0fc069ff0 con 0x7fa0fc0b4340 2023-07-09T21:42:57.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.056+0000 7fa0f97fa640 1 -- 172.21.15.37:0/2136118661 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_list_post_schedule_remove"]}]=0 v795) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa0f0054160 con 0x7fa0fc0b4340 2023-07-09T21:42:57.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 msgr2=0x7fa0e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 0x7fa0e0068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80af000 tx=0x7fa0e8008040 comp rx=0 tx=0).stop 2023-07-09T21:42:57.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 msgr2=0x7fa0fc1466e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa0f000c500 tx=0x7fa0f000c9c0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 shutdown_connections 2023-07-09T21:42:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fa0e00663a0 0x7fa0e0068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0fc0cef80 0x7fa0fc0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0fc0b7ab0 0x7fa0fc0c6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 --2- 172.21.15.37:0/2136118661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0fc0b4340 0x7fa0fc1466e0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 >> 172.21.15.37:0/2136118661 conn(0x7fa0fc073090 msgr2=0x7fa0fc0b5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 shutdown_connections 2023-07-09T21:42:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.060+0000 7fa102e5c640 1 -- 172.21.15.37:0/2136118661 wait complete. 2023-07-09T21:42:57.082 INFO:tasks.cephfs_test_runner:Test listing snap schedules post removal of a schedule ... ok 2023-07-09T21:42:57.083 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test that snap schedule is resumed after mgr restart 2023-07-09T21:42:57.083 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_mgr_restart (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:42:57.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-09T21:42:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.232+0000 7f63d230d640 1 Processor -- start 2023-07-09T21:42:57.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.232+0000 7f63d230d640 1 -- start start 2023-07-09T21:42:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.232+0000 7f63d230d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63d230d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63d230d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63cc0b49f0 con 0x7f63cc0b4170 2023-07-09T21:42:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63d230d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63cc0b7e80 con 0x7f63cc0cef80 2023-07-09T21:42:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63d230d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc0b45f0 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cb7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:42030/0 (socket says 172.21.15.37:42030) 2023-07-09T21:42:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cb7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:43696/0 (socket says 172.21.15.37:43696) 2023-07-09T21:42:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 -- 172.21.15.37:0/3795714252 learned_addr learned my addr 172.21.15.37:0/3795714252 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63d08aa640 1 --1- 172.21.15.37:0/3795714252 >> v1:172.21.15.119:6789/0 conn(0x7f63cc0b4170 0x7f63cc15f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:48226/0 (socket says 172.21.15.37:48226) 2023-07-09T21:42:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 -- 172.21.15.37:0/3795714252 >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 msgr2=0x7f63cc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 --2- 172.21.15.37:0/3795714252 >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 -- 172.21.15.37:0/3795714252 >> v1:172.21.15.119:6789/0 conn(0x7f63cc0b4170 legacy=0x7f63cc15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cbfff640 1 -- 172.21.15.37:0/3795714252 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc0cc8a0 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.236+0000 7f63cb7fe640 1 --2- 172.21.15.37:0/3795714252 >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:42:57.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63cbfff640 1 --2- 172.21.15.37:0/3795714252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009870 tx=0x7f63bc01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87e1d81fd8e57f1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63caffd640 1 -- 172.21.15.37:0/3795714252 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0aa670 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63caffd640 1 -- 172.21.15.37:0/3795714252 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc0aa7d0 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63caffd640 1 -- 172.21.15.37:0/3795714252 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0aab60 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- 172.21.15.37:0/3795714252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 msgr2=0x7f63cc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 --2- 172.21.15.37:0/3795714252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009870 tx=0x7f63bc01c510 comp rx=0 tx=0).stop 2023-07-09T21:42:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- 172.21.15.37:0/3795714252 shutdown_connections 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 --2- 172.21.15.37:0/3795714252 >> v2:172.21.15.119:3300/0 conn(0x7f63cc0cef80 0x7f63cc0b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 --2- 172.21.15.37:0/3795714252 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc06aa50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- 172.21.15.37:0/3795714252 >> 172.21.15.37:0/3795714252 conn(0x7f63cc073090 msgr2=0x7f63cc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- 172.21.15.37:0/3795714252 shutdown_connections 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- 172.21.15.37:0/3795714252 wait complete. 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 Processor -- start 2023-07-09T21:42:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 -- start start 2023-07-09T21:42:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.240+0000 7f63d230d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0b4170 0x7f63cc0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc154500 con 0x7f63cc0cef80 2023-07-09T21:42:57.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc15e7f0 con 0x7f63cc0b4170 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc15e510 con 0x7f63cc0b7ab0 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39862/0 (socket says 172.21.15.37:39862) 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 -- 172.21.15.37:0/1679118357 learned_addr learned my addr 172.21.15.37:0/1679118357 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63cbfff640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0b4170 0x7f63cc0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63cb7fe640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 -- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 msgr2=0x7f63cc0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 -- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0b4170 msgr2=0x7f63cc0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:57.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0b4170 0x7f63cc0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:57.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 -- 172.21.15.37:0/1679118357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009420 con 0x7f63cc0cef80 2023-07-09T21:42:57.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d08aa640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c700 tx=0x7f63c400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400ce10 con 0x7f63cc0cef80 2023-07-09T21:42:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c400a640 con 0x7f63cc0cef80 2023-07-09T21:42:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63bc0094d0 con 0x7f63cc0cef80 2023-07-09T21:42:57.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400a9b0 con 0x7f63cc0cef80 2023-07-09T21:42:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc153040 con 0x7f63cc0cef80 2023-07-09T21:42:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc04d7d0 con 0x7f63cc0cef80 2023-07-09T21:42:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.244+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f63c400ab10 con 0x7f63cc0cef80 2023-07-09T21:42:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.248+0000 7f63c8ff9640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 0x7f63b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.248+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f63c40835b0 con 0x7f63cc0cef80 2023-07-09T21:42:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.248+0000 7f63cbfff640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 0x7f63b8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.248+0000 7f63cbfff640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 0x7f63b8068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0ae000 tx=0x7f63bc0a7000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.248+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f63c40509c0 con 0x7f63cc0cef80 2023-07-09T21:42:57.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:57.464+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f63cc06a830 con 0x7f63cc0cef80 2023-07-09T21:42:58.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63c8ff9640 1 -- 172.21.15.37:0/1679118357 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v796) v1 ==== 168+0+0 (secure 0 0 0) 0x7f63c4053fe0 con 0x7f63cc0cef80 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 msgr2=0x7f63b8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 0x7f63b8068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0ae000 tx=0x7f63bc0a7000 comp rx=0 tx=0).stop 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 msgr2=0x7f63cc153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c700 tx=0x7f63c400cbc0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 shutdown_connections 2023-07-09T21:42:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f63b80663a0 0x7f63b8068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f63cc0cef80 0x7f63cc153820 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f63cc0b7ab0 0x7f63cc0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 --2- 172.21.15.37:0/1679118357 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f63cc0b4170 0x7f63cc0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 >> 172.21.15.37:0/1679118357 conn(0x7f63cc073090 msgr2=0x7f63cc0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 shutdown_connections 2023-07-09T21:42:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.060+0000 7f63d230d640 1 -- 172.21.15.37:0/1679118357 wait complete. 2023-07-09T21:42:58.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:42:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 Processor -- start 2023-07-09T21:42:58.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 -- start start 2023-07-09T21:42:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa806b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa806b970 0x7fbfa80c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbfa80c4350 0x7fbfa815c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80c47f0 con 0x7fbfa806b970 2023-07-09T21:42:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa80cbf40 con 0x7fbfa80c4350 2023-07-09T21:42:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfad182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa80c9090 con 0x7fbfa81585b0 2023-07-09T21:42:58.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa806b970 0x7fbfa80c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfa806b970 0x7fbfa80c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56562/0 (socket says 172.21.15.37:56562) 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 -- 172.21.15.37:0/3668169266 learned_addr learned my addr 172.21.15.37:0/3668169266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfa759e640 1 --2- 172.21.15.37:0/3668169266 >> v2:172.21.15.119:3300/0 conn(0x7fbfa80c4350 0x7fbfa815c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbfa6d9d640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa806b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 -- 172.21.15.37:0/3668169266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 msgr2=0x7fbfa806b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:58.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa806b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 -- 172.21.15.37:0/3668169266 >> v2:172.21.15.119:3300/0 conn(0x7fbfa80c4350 msgr2=0x7fbfa815c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/3668169266 >> v2:172.21.15.119:3300/0 conn(0x7fbfa80c4350 0x7fbfa815c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.236+0000 7fbf9ffff640 1 -- 172.21.15.37:0/3668169266 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa80c8a60 con 0x7fbfa806b970 2023-07-09T21:42:58.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa80c3e10 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbfa806b1e0 tx=0x7fbf9001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b45010e317d1751 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfa659c640 1 -- 172.21.15.37:0/3668169266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900aa610 con 0x7fbfa806b970 2023-07-09T21:42:58.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfa659c640 1 -- 172.21.15.37:0/3668169266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf900a6040 con 0x7fbfa806b970 2023-07-09T21:42:58.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfa659c640 1 -- 172.21.15.37:0/3668169266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf900aa990 con 0x7fbfa806b970 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 -- 172.21.15.37:0/3668169266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 msgr2=0x7fbfa80c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa80c3e10 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fbfa806b1e0 tx=0x7fbf9001c4d0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 -- 172.21.15.37:0/3668169266 shutdown_connections 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa80c3e10 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 --2- 172.21.15.37:0/3668169266 >> v2:172.21.15.119:3300/0 conn(0x7fbfa80c4350 0x7fbfa815c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 --2- 172.21.15.37:0/3668169266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa806b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 -- 172.21.15.37:0/3668169266 >> 172.21.15.37:0/3668169266 conn(0x7fbfa80cde40 msgr2=0x7fbfa80ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:58.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 -- 172.21.15.37:0/3668169266 shutdown_connections 2023-07-09T21:42:58.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 -- 172.21.15.37:0/3668169266 wait complete. 2023-07-09T21:42:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.240+0000 7fbfad182640 1 Processor -- start 2023-07-09T21:42:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- start start 2023-07-09T21:42:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfa80c4350 0x7fbfa81448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa814e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa814ddb0 con 0x7fbfa806b970 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa814cf00 con 0x7fbfa80c4350 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa8144e00 con 0x7fbfa81585b0 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56568/0 (socket says 172.21.15.37:56568) 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 -- 172.21.15.37:0/1696920105 learned_addr learned my addr 172.21.15.37:0/1696920105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:58.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfa80c4350 0x7fbfa81448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa759e640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa814e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 -- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 msgr2=0x7fbfa814e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa814e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 -- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfa80c4350 msgr2=0x7fbfa81448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfa80c4350 0x7fbfa81448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 -- 172.21.15.37:0/1696920105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf900094d0 con 0x7fbfa806b970 2023-07-09T21:42:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfa6d9d640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800e870 tx=0x7fbf9800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf98009510 con 0x7fbfa806b970 2023-07-09T21:42:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800eec0 con 0x7fbfa806b970 2023-07-09T21:42:58.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa814d1a0 con 0x7fbfa806b970 2023-07-09T21:42:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800cb40 con 0x7fbfa806b970 2023-07-09T21:42:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa814d760 con 0x7fbfa806b970 2023-07-09T21:42:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.244+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa804d7d0 con 0x7fbfa806b970 2023-07-09T21:42:58.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.248+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbf9800cca0 con 0x7fbfa806b970 2023-07-09T21:42:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.248+0000 7fbf9f7fe640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 0x7fbf88068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.248+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7fbf98083f50 con 0x7fbfa806b970 2023-07-09T21:42:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.248+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 0x7fbf88068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.248+0000 7fbf9ffff640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 0x7fbf88068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf900ae000 tx=0x7fbf900b5040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.252+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf980512e0 con 0x7fbfa806b970 2023-07-09T21:42:58.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.404+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbfa806b210 con 0x7fbfa806b970 2023-07-09T21:42:58.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.408+0000 7fbf9f7fe640 1 -- 172.21.15.37:0/1696920105 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v52)=0 v52) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbf98054900 con 0x7fbfa806b970 2023-07-09T21:42:58.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 msgr2=0x7fbf88068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 0x7fbf88068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbf900ae000 tx=0x7fbf900b5040 comp rx=0 tx=0).stop 2023-07-09T21:42:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 msgr2=0x7fbfa814c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800e870 tx=0x7fbf9800ec70 comp rx=0 tx=0).stop 2023-07-09T21:42:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 shutdown_connections 2023-07-09T21:42:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbf880663a0 0x7fbf88068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfa81585b0 0x7fbfa814e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfa80c4350 0x7fbfa81448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 --2- 172.21.15.37:0/1696920105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfa806b970 0x7fbfa814c9c0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 >> 172.21.15.37:0/1696920105 conn(0x7fbfa80cde40 msgr2=0x7fbfa814ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 shutdown_connections 2023-07-09T21:42:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.412+0000 7fbfad182640 1 -- 172.21.15.37:0/1696920105 wait complete. 2023-07-09T21:42:58.431 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:42:58.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:58.505 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:42:58.571 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:42:58.572 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:58.572 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:58.581 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:58.581 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:58.581 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:58.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:58.591 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:42:58.591 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:58.630 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:42:58.630 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:42:58.631 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:42:58.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:42:58.639 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:42:58.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:42:58.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 Processor -- start 2023-07-09T21:42:58.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 -- start start 2023-07-09T21:42:58.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b7ab0 0x7f377c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c0cef80 0x7f377c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f377c0b4170 0x7f377c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0b7e80 con 0x7f377c0cef80 2023-07-09T21:42:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f377c0b45f0 con 0x7f377c0b4170 2023-07-09T21:42:58.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3780f3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c0b49f0 con 0x7f377c0b7ab0 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c0cef80 0x7f377c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f377c0cef80 0x7f377c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56580/0 (socket says 172.21.15.37:56580) 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 -- 172.21.15.37:0/1383468265 learned_addr learned my addr 172.21.15.37:0/1383468265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f377a59c640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b7ab0 0x7f377c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f377ad9d640 1 --2- 172.21.15.37:0/1383468265 >> v2:172.21.15.119:3300/0 conn(0x7f377c0b4170 0x7f377c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 -- 172.21.15.37:0/1383468265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b7ab0 msgr2=0x7f377c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b7ab0 0x7f377c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 -- 172.21.15.37:0/1383468265 >> v2:172.21.15.119:3300/0 conn(0x7f377c0b4170 msgr2=0x7f377c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:42:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 --2- 172.21.15.37:0/1383468265 >> v2:172.21.15.119:3300/0 conn(0x7f377c0b4170 0x7f377c15f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.812+0000 7f3773fff640 1 -- 172.21.15.37:0/1383468265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c0cc8a0 con 0x7f377c0cef80 2023-07-09T21:42:58.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3773fff640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0b3c30 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f377c0716a0 tx=0x7f376401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a578dbaead5c82dd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3779d9b640 1 -- 172.21.15.37:0/1383468265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640ab600 con 0x7f377c0cef80 2023-07-09T21:42:58.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3779d9b640 1 -- 172.21.15.37:0/1383468265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37640a7050 con 0x7f377c0cef80 2023-07-09T21:42:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3779d9b640 1 -- 172.21.15.37:0/1383468265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640ab980 con 0x7f377c0cef80 2023-07-09T21:42:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 -- 172.21.15.37:0/1383468265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 msgr2=0x7f377c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0b3c30 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f377c0716a0 tx=0x7f376401c210 comp rx=0 tx=0).stop 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 -- 172.21.15.37:0/1383468265 shutdown_connections 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0b3c30 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1383468265 >> v2:172.21.15.119:3300/0 conn(0x7f377c0b4170 0x7f377c15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1383468265 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b7ab0 0x7f377c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 -- 172.21.15.37:0/1383468265 >> 172.21.15.37:0/1383468265 conn(0x7f377c073090 msgr2=0x7f377c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 -- 172.21.15.37:0/1383468265 shutdown_connections 2023-07-09T21:42:58.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.816+0000 7f3780f3a640 1 -- 172.21.15.37:0/1383468265 wait complete. 2023-07-09T21:42:58.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 Processor -- start 2023-07-09T21:42:58.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- start start 2023-07-09T21:42:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b4170 0x7f377c155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0b7ab0 0x7f377c159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c156dc0 con 0x7f377c0cef80 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377c155d40 con 0x7f377c0b7ab0 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377c155f10 con 0x7f377c0b4170 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377a59c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b4170 0x7f377c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56594/0 (socket says 172.21.15.37:56594) 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 -- 172.21.15.37:0/1740041732 learned_addr learned my addr 172.21.15.37:0/1740041732 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3773fff640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0b7ab0 0x7f377c159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 -- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b4170 msgr2=0x7f377c155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b4170 0x7f377c155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 -- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0b7ab0 msgr2=0x7f377c159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0b7ab0 0x7f377c159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 -- 172.21.15.37:0/1740041732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640094d0 con 0x7f377c0cef80 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f377ad9d640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f377400efc0 tx=0x7f377400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774014480 con 0x7f377c0cef80 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377400f040 con 0x7f377c0cef80 2023-07-09T21:42:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3774014820 con 0x7f377c0cef80 2023-07-09T21:42:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377c157250 con 0x7f377c0cef80 2023-07-09T21:42:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.820+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f377c156490 con 0x7f377c0cef80 2023-07-09T21:42:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.824+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377c04d7d0 con 0x7f377c0cef80 2023-07-09T21:42:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.824+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3774014980 con 0x7f377c0cef80 2023-07-09T21:42:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.824+0000 7f3772ffd640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 0x7f375c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.824+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f3774084ac0 con 0x7f377c0cef80 2023-07-09T21:42:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.824+0000 7f377a59c640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 0x7f375c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.828+0000 7f377a59c640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 0x7f375c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f377c0d1270 tx=0x7f376c009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:58.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:58.828+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3774051d30 con 0x7f377c0cef80 2023-07-09T21:42:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f377c156f00 con 0x7f377c0cef80 2023-07-09T21:42:59.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3772ffd640 1 -- 172.21.15.37:0/1740041732 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f3774018090 con 0x7f377c0cef80 2023-07-09T21:42:59.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:42:59.021 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7508,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/3810168513","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3810168513},{"type":"v1","addr":"172.21.15.119:6835","nonce":3810168513}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8560,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1271632610","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":1271632610},{"type":"v1","addr":"172.21.15.119:6837","nonce":1271632610}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8991,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2562122173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2562122173},{"type":"v1","addr":"172.21.15.37:6833","nonce":2562122173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":9450,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/998027483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":998027483},{"type":"v1","addr":"172.21.15.37:6835","nonce":998027483}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2023-07-09T21:42:59.021 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 64 2023-07-09T21:42:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 msgr2=0x7f375c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 0x7f375c068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f377c0d1270 tx=0x7f376c009190 comp rx=0 tx=0).stop 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 msgr2=0x7f377c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f377400efc0 tx=0x7f377400c490 comp rx=0 tx=0).stop 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 shutdown_connections 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f375c0663a0 0x7f375c068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f377c0cef80 0x7f377c0d0630 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f377c0b7ab0 0x7f377c159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 --2- 172.21.15.37:0/1740041732 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f377c0b4170 0x7f377c155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 >> 172.21.15.37:0/1740041732 conn(0x7f377c073090 msgr2=0x7f377c158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:59.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.020+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 shutdown_connections 2023-07-09T21:42:59.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.024+0000 7f3780f3a640 1 -- 172.21.15.37:0/1740041732 wait complete. 2023-07-09T21:42:59.042 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:42:59.042 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:42:59.042 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:42:59.042 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:59.043 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:42:59.043 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:42:59.043 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:42:59.043 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:59.044 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:42:59.044 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:42:59.044 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:42:59.044 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:59.044 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:42:59.045 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:42:59.045 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:42:59.045 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:42:59.054 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:42:59.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:42:59.055 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:42:59.056 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:42:59.065 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:42:59.066 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:42:59.067 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:42:59.067 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:42:59.105 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:42:59.105 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:59.107 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:42:59.108 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:59.111 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:42:59.111 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:59.113 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:42:59.113 DEBUG:teuthology.parallel:result is None 2023-07-09T21:42:59.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:42:59.193 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:42:59.194 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:42:59.202 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:42:59.203 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:42:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.260+0000 7f13e3bac640 1 Processor -- start 2023-07-09T21:42:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.260+0000 7f13e3bac640 1 -- start start 2023-07-09T21:42:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.260+0000 7f13e3bac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e3bac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0cef80 con 0x7f13dc0b4310 2023-07-09T21:42:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e3bac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0cf260 con 0x7f13dc0b47a0 2023-07-09T21:42:59.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e3bac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0cf540 con 0x7f13dc0b7a60 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e2149640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f13dc0b4310 0x7f13dc0d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58548/0 (socket says 172.21.15.37:58548) 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e2149640 1 -- 172.21.15.37:0/2977362310 learned_addr learned my addr 172.21.15.37:0/2977362310 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e1948640 1 --2- 172.21.15.37:0/2977362310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704569725 0 0) 0x7f13dc0cef80 con 0x7f13dc0b4310 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c8003530 con 0x7f13dc0b4310 2023-07-09T21:42:59.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710502438 0 0) 0x7f13dc0cf260 con 0x7f13dc0b47a0 2023-07-09T21:42:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13dc0cef80 con 0x7f13dc0b47a0 2023-07-09T21:42:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e1948640 1 -- 172.21.15.37:0/2977362310 >> v1:172.21.15.119:6789/0 conn(0x7f13dc0b47a0 legacy=0x7f13dc0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e1948640 1 -- 172.21.15.37:0/2977362310 >> v1:172.21.15.37:6789/0 conn(0x7f13dc0b4310 legacy=0x7f13dc0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e1948640 1 -- 172.21.15.37:0/2977362310 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0cfdf0 con 0x7f13dc0b7a60 2023-07-09T21:42:59.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.264+0000 7f13e1948640 1 --2- 172.21.15.37:0/2977362310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0cc7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097f0 tx=0x7f13d801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba3fa45a67af7e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:59.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ab600 con 0x7f13dc0b7a60 2023-07-09T21:42:59.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80a7050 con 0x7f13dc0b7a60 2023-07-09T21:42:59.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e0946640 1 -- 172.21.15.37:0/2977362310 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ab980 con 0x7f13dc0b7a60 2023-07-09T21:42:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- 172.21.15.37:0/2977362310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 msgr2=0x7f13dc0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2977362310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0cc7d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f13d80097f0 tx=0x7f13d801c4c0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- 172.21.15.37:0/2977362310 shutdown_connections 2023-07-09T21:42:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2977362310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0cc7d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- 172.21.15.37:0/2977362310 >> 172.21.15.37:0/2977362310 conn(0x7f13dc073050 msgr2=0x7f13dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:42:59.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- 172.21.15.37:0/2977362310 shutdown_connections 2023-07-09T21:42:59.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- 172.21.15.37:0/2977362310 wait complete. 2023-07-09T21:42:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 Processor -- start 2023-07-09T21:42:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- start start 2023-07-09T21:42:59.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 0x7f13dc15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0cb8d0 con 0x7f13dc0b47a0 2023-07-09T21:42:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc15dc70 con 0x7f13dc0b4310 2023-07-09T21:42:59.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.268+0000 7f13e3bac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc15df50 con 0x7f13dc0b7a60 2023-07-09T21:42:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56642/0 (socket says 172.21.15.37:56642) 2023-07-09T21:42:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 -- 172.21.15.37:0/2206942660 learned_addr learned my addr 172.21.15.37:0/2206942660 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:42:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e2149640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:59.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1948640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 0x7f13dc15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 -- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 msgr2=0x7f13dc0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 -- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 msgr2=0x7f13dc15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:42:59.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 0x7f13dc15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:42:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 -- 172.21.15.37:0/2206942660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d8009420 con 0x7f13dc0b47a0 2023-07-09T21:42:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1948640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 0x7f13dc15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:42:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e1147640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c430 tx=0x7f13cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0052d0 con 0x7f13dc0b47a0 2023-07-09T21:42:59.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc005450 con 0x7f13dc0b47a0 2023-07-09T21:42:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc003840 con 0x7f13dc0b47a0 2023-07-09T21:42:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc15e230 con 0x7f13dc0b47a0 2023-07-09T21:42:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc15e7f0 con 0x7f13dc0b47a0 2023-07-09T21:42:59.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0cdaa0 con 0x7f13dc0b47a0 2023-07-09T21:42:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.272+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f13cc0039a0 con 0x7f13dc0b47a0 2023-07-09T21:42:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.276+0000 7f13d27fc640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 0x7f13c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:42:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.276+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6055+0+0 (secure 0 0 0) 0x7f13cc083530 con 0x7f13dc0b47a0 2023-07-09T21:42:59.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.276+0000 7f13e1948640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 0x7f13c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:42:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.276+0000 7f13e1948640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 0x7f13c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ad000 tx=0x7f13d80a6000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:42:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.276+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f13cc050820 con 0x7f13dc0b47a0 2023-07-09T21:42:59.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:42:59.448+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f13dc04d7d0 con 0x7f13dc0b47a0 2023-07-09T21:43:00.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13d27fc640 1 -- 172.21.15.37:0/2206942660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v154) v1 ==== 97+0+0 (secure 0 0 0) 0x7f13cc053e40 con 0x7f13dc0b47a0 2023-07-09T21:43:00.431 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:43:00.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 msgr2=0x7f13c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 0x7f13c0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13d80ad000 tx=0x7f13d80a6000 comp rx=0 tx=0).stop 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 msgr2=0x7f13dc0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c430 tx=0x7f13cc00c8f0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 shutdown_connections 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f13c00663a0 0x7f13c0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f13dc0b7a60 0x7f13dc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13dc0b47a0 0x7f13dc0b3320 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 --2- 172.21.15.37:0/2206942660 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f13dc0b4310 0x7f13dc15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 >> 172.21.15.37:0/2206942660 conn(0x7f13dc073050 msgr2=0x7f13dc157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 shutdown_connections 2023-07-09T21:43:00.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.432+0000 7f13e3bac640 1 -- 172.21.15.37:0/2206942660 wait complete. 2023-07-09T21:43:00.457 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:43:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 Processor -- start 2023-07-09T21:43:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 -- start start 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f911c0b7ab0 0x7f911c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0cef80 0x7f911c0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c15f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0b7e80 con 0x7f911c0cef80 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f911c0b4610 con 0x7f911c0b7ab0 2023-07-09T21:43:00.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9122a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0b49f0 con 0x7f911c0b4170 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0cef80 0x7f911c0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f911c0cef80 0x7f911c0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56652/0 (socket says 172.21.15.37:56652) 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 -- 172.21.15.37:0/1580071961 learned_addr learned my addr 172.21.15.37:0/1580071961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f9120ff3640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c15f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911bfff640 1 --2- 172.21.15.37:0/1580071961 >> v2:172.21.15.119:3300/0 conn(0x7f911c0b7ab0 0x7f911c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 -- 172.21.15.37:0/1580071961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 msgr2=0x7f911c15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c15f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 -- 172.21.15.37:0/1580071961 >> v2:172.21.15.119:3300/0 conn(0x7f911c0b7ab0 msgr2=0x7f911c06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 --2- 172.21.15.37:0/1580071961 >> v2:172.21.15.119:3300/0 conn(0x7f911c0b7ab0 0x7f911c06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.604+0000 7f911b7fe640 1 -- 172.21.15.37:0/1580071961 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c0cc8a0 con 0x7f911c0cef80 2023-07-09T21:43:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f911b7fe640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cef80 0x7f911c0b3c30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f911c06b360 tx=0x7f911001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d2a6de624bd9cc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f911affd640 1 -- 172.21.15.37:0/1580071961 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100ab600 con 0x7f911c0cef80 2023-07-09T21:43:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f911affd640 1 -- 172.21.15.37:0/1580071961 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100a7050 con 0x7f911c0cef80 2023-07-09T21:43:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f911affd640 1 -- 172.21.15.37:0/1580071961 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100ab980 con 0x7f911c0cef80 2023-07-09T21:43:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 -- 172.21.15.37:0/1580071961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cef80 msgr2=0x7f911c0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cef80 0x7f911c0b3c30 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f911c06b360 tx=0x7f911001c210 comp rx=0 tx=0).stop 2023-07-09T21:43:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 -- 172.21.15.37:0/1580071961 shutdown_connections 2023-07-09T21:43:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0cef80 0x7f911c0b3c30 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 --2- 172.21.15.37:0/1580071961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c15f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 --2- 172.21.15.37:0/1580071961 >> v2:172.21.15.119:3300/0 conn(0x7f911c0b7ab0 0x7f911c06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 -- 172.21.15.37:0/1580071961 >> 172.21.15.37:0/1580071961 conn(0x7f911c073090 msgr2=0x7f911c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 -- 172.21.15.37:0/1580071961 shutdown_connections 2023-07-09T21:43:00.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 -- 172.21.15.37:0/1580071961 wait complete. 2023-07-09T21:43:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.608+0000 7f9122a56640 1 Processor -- start 2023-07-09T21:43:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- start start 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0cef80 0x7f911c0b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cacf0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0b6380 con 0x7f911c0cef80 2023-07-09T21:43:00.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f911c0cb180 con 0x7f911c0b4170 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56668/0 (socket says 172.21.15.37:56668) 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 -- 172.21.15.37:0/3064754777 learned_addr learned my addr 172.21.15.37:0/3064754777 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911bfff640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9120ff3640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0cef80 0x7f911c0b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 -- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 msgr2=0x7f911c158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 -- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0cef80 msgr2=0x7f911c0b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0cef80 0x7f911c0b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 -- 172.21.15.37:0/3064754777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91100094d0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f911b7fe640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f91100ae040 tx=0x7f9110018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100b6620 con 0x7f911c0b7ab0 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100b6780 con 0x7f911c0b7ab0 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91100b6b30 con 0x7f911c0b7ab0 2023-07-09T21:43:00.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f911c0ca3c0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f911c0ca980 con 0x7f911c0b7ab0 2023-07-09T21:43:00.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.612+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f911c0cae60 con 0x7f911c0b7ab0 2023-07-09T21:43:00.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.616+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f91100b2040 con 0x7f911c0b7ab0 2023-07-09T21:43:00.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.616+0000 7f9118ff9640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 0x7f9108068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.616+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f911011de50 con 0x7f911c0b7ab0 2023-07-09T21:43:00.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.616+0000 7f911bfff640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 0x7f9108068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:00.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.616+0000 7f911bfff640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 0x7f9108068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f910c0079e0 tx=0x7f910c008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:00.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.620+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f91100eb3d0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f911c04d7d0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9118ff9640 1 -- 172.21.15.37:0/3064754777 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91100ee9f0 con 0x7f911c0b7ab0 2023-07-09T21:43:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:00.828 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:43:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:43:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.828 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:43:00.830 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.831 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.832 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.833 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.834 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.835 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.836 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:43:00.837 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:43:00.838 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.839 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.840 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.841 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:43:00.842 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.843 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.844 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:43:00.845 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.846 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:43:00.847 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:43:00.848 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:43:00.849 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:43:00.850 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:43:00.851 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:43:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 msgr2=0x7f9108068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 0x7f9108068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f910c0079e0 tx=0x7f910c008040 comp rx=0 tx=0).stop 2023-07-09T21:43:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 msgr2=0x7f911c1587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f91100ae040 tx=0x7f9110018fb0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 shutdown_connections 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f91080663a0 0x7f9108068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f911c0cef80 0x7f911c0b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f911c0b7ab0 0x7f911c1587c0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 --2- 172.21.15.37:0/3064754777 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f911c0b4170 0x7f911c158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 >> 172.21.15.37:0/3064754777 conn(0x7f911c073090 msgr2=0x7f911c0b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 shutdown_connections 2023-07-09T21:43:00.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.828+0000 7f9122a56640 1 -- 172.21.15.37:0/3064754777 wait complete. 2023-07-09T21:43:00.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:43:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.996+0000 7f7fe6219640 1 Processor -- start 2023-07-09T21:43:00.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:00.996+0000 7f7fe6219640 1 -- start start 2023-07-09T21:43:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fe6219640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 0x7f7fe00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fe6219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 0x7f7fe006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:00.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fe6219640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fe00cbe90 con 0x7f7fe00cc770 2023-07-09T21:43:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fe6219640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fe006d370 con 0x7f7fe00af830 2023-07-09T21:43:01.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fe6219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe00b0140 con 0x7f7fe00cc320 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7fe00cc770 0x7f7fe006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58564/0 (socket says 172.21.15.37:58564) 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdffff640 1 -- 172.21.15.37:0/2506179848 learned_addr learned my addr 172.21.15.37:0/2506179848 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/2506179848 >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 0x7f7fe00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/2506179848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 0x7f7fe006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fde7fc640 1 -- 172.21.15.37:0/2506179848 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162697565 0 0) 0x7f7fe00cbe90 con 0x7f7fe00cc770 2023-07-09T21:43:01.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fde7fc640 1 -- 172.21.15.37:0/2506179848 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fc8003530 con 0x7f7fe00cc770 2023-07-09T21:43:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdeffd640 1 -- 172.21.15.37:0/2506179848 >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 msgr2=0x7f7fe00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/2506179848 >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 0x7f7fe00afc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdeffd640 1 -- 172.21.15.37:0/2506179848 >> v1:172.21.15.37:6789/0 conn(0x7f7fe00cc770 legacy=0x7f7fe006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdeffd640 1 -- 172.21.15.37:0/2506179848 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0159bb0 con 0x7f7fe00cc320 2023-07-09T21:43:01.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.000+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/2506179848 >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 0x7f7fe00afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/2506179848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 0x7f7fe006efc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40097c0 tx=0x7f7fd401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb8b04aed9c2887 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fde7fc640 1 -- 172.21.15.37:0/2506179848 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40ab650 con 0x7f7fe00cc320 2023-07-09T21:43:01.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fde7fc640 1 -- 172.21.15.37:0/2506179848 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40ab7b0 con 0x7f7fe00cc320 2023-07-09T21:43:01.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fde7fc640 1 -- 172.21.15.37:0/2506179848 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40abb20 con 0x7f7fe00cc320 2023-07-09T21:43:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- 172.21.15.37:0/2506179848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 msgr2=0x7f7fe006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 --2- 172.21.15.37:0/2506179848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 0x7f7fe006efc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7fd40097c0 tx=0x7f7fd401c450 comp rx=0 tx=0).stop 2023-07-09T21:43:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- 172.21.15.37:0/2506179848 shutdown_connections 2023-07-09T21:43:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 --2- 172.21.15.37:0/2506179848 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00cc320 0x7f7fe006efc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 --2- 172.21.15.37:0/2506179848 >> v2:172.21.15.119:3300/0 conn(0x7f7fe00af830 0x7f7fe00afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- 172.21.15.37:0/2506179848 >> 172.21.15.37:0/2506179848 conn(0x7f7fe00ca830 msgr2=0x7f7fe00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- 172.21.15.37:0/2506179848 shutdown_connections 2023-07-09T21:43:01.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- 172.21.15.37:0/2506179848 wait complete. 2023-07-09T21:43:01.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 Processor -- start 2023-07-09T21:43:01.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.004+0000 7f7fe6219640 1 -- start start 2023-07-09T21:43:01.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 0x7f7fe014f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe00cc770 0x7f7fe014a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe014c1c0 con 0x7f7fe00cc320 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe014c360 con 0x7f7fe00cc770 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe014c5b0 con 0x7f7fe00af830 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56682/0 (socket says 172.21.15.37:56682) 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 -- 172.21.15.37:0/3175502237 learned_addr learned my addr 172.21.15.37:0/3175502237 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdffff640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe00cc770 0x7f7fe014a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 0x7f7fe014f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 -- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 msgr2=0x7f7fe014f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 0x7f7fe014f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 -- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe00cc770 msgr2=0x7f7fe014a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe00cc770 0x7f7fe014a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 -- 172.21.15.37:0/3175502237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009420 con 0x7f7fe00cc320 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 0x7f7fe014f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:01.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fdeffd640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000c10 tx=0x7f7fd40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd4004450 con 0x7f7fe00cc320 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd40ab920 con 0x7f7fe00cc320 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd4009420 con 0x7f7fe00cc320 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd40abc90 con 0x7f7fe00cc320 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe014ce50 con 0x7f7fe00cc320 2023-07-09T21:43:01.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.008+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe006b550 con 0x7f7fe00cc320 2023-07-09T21:43:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.012+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7fd4003620 con 0x7f7fe00cc320 2023-07-09T21:43:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.012+0000 7f7fc7fff640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 0x7f7fcc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.012+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f7fd411dd50 con 0x7f7fe00cc320 2023-07-09T21:43:01.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.012+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 0x7f7fcc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.012+0000 7f7fdf7fe640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 0x7f7fcc068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ca0 tx=0x7f7fd0008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.016+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7fd4121030 con 0x7f7fe00cc320 2023-07-09T21:43:01.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.172+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fe00b2160 con 0x7f7fe00cc320 2023-07-09T21:43:01.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.172+0000 7f7fc7fff640 1 -- 172.21.15.37:0/3175502237 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) v1 ==== 74+0+14681 (secure 0 0 0) 0x7f7fd40eb480 con 0x7f7fe00cc320 2023-07-09T21:43:01.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:01.174 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":154,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:43:00.427933+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:43:01.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 msgr2=0x7f7fcc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 0x7f7fcc068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009ca0 tx=0x7f7fd0008040 comp rx=0 tx=0).stop 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 msgr2=0x7f7fe014e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f7fd4000c10 tx=0x7f7fd40191f0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 shutdown_connections 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f7fcc0663a0 0x7f7fcc068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7fe00cc770 0x7f7fe014a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fe00cc320 0x7f7fe014e410 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 --2- 172.21.15.37:0/3175502237 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7fe00af830 0x7f7fe014f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 >> 172.21.15.37:0/3175502237 conn(0x7f7fe00ca830 msgr2=0x7f7fe00aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 shutdown_connections 2023-07-09T21:43:01.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.176+0000 7f7fe6219640 1 -- 172.21.15.37:0/3175502237 wait complete. 2023-07-09T21:43:01.195 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:43:01.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:43:01.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.339+0000 7fbb27511640 1 Processor -- start 2023-07-09T21:43:01.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.339+0000 7fbb27511640 1 -- start start 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb27511640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb200cf290 0x7fbb20160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb27511640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2015bf80 con 0x7fbb200d0780 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb27511640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb20160570 con 0x7fbb200b7980 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb27511640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb200cd070 con 0x7fbb200cf290 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb200cf290 0x7fbb20160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb200cf290 0x7fbb20160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56690/0 (socket says 172.21.15.37:56690) 2023-07-09T21:43:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 -- 172.21.15.37:0/3990766320 learned_addr learned my addr 172.21.15.37:0/3990766320 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:01.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 -- 172.21.15.37:0/3990766320 >> v1:172.21.15.119:6789/0 conn(0x7fbb200b7980 legacy=0x7fbb200ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 -- 172.21.15.37:0/3990766320 >> v1:172.21.15.37:6789/0 conn(0x7fbb200d0780 legacy=0x7fbb200d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 -- 172.21.15.37:0/3990766320 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200d02f0 con 0x7fbb200cf290 2023-07-09T21:43:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb24aac640 1 --2- 172.21.15.37:0/3990766320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200cf290 0x7fbb20160030 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fddc52e6a020024f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb17fff640 1 -- 172.21.15.37:0/3990766320 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100ab600 con 0x7fbb200cf290 2023-07-09T21:43:01.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb17fff640 1 -- 172.21.15.37:0/3990766320 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb100a7050 con 0x7fbb200cf290 2023-07-09T21:43:01.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.343+0000 7fbb17fff640 1 -- 172.21.15.37:0/3990766320 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb100ab980 con 0x7fbb200cf290 2023-07-09T21:43:01.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- 172.21.15.37:0/3990766320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200cf290 msgr2=0x7fbb20160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 --2- 172.21.15.37:0/3990766320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200cf290 0x7fbb20160030 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7fbb10009870 tx=0x7fbb1001c500 comp rx=0 tx=0).stop 2023-07-09T21:43:01.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- 172.21.15.37:0/3990766320 shutdown_connections 2023-07-09T21:43:01.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 --2- 172.21.15.37:0/3990766320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200cf290 0x7fbb20160030 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- 172.21.15.37:0/3990766320 >> 172.21.15.37:0/3990766320 conn(0x7fbb20073090 msgr2=0x7fbb20069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- 172.21.15.37:0/3990766320 shutdown_connections 2023-07-09T21:43:01.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- 172.21.15.37:0/3990766320 wait complete. 2023-07-09T21:43:01.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 Processor -- start 2023-07-09T21:43:01.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- start start 2023-07-09T21:43:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb200cf290 0x7fbb20146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb200d0780 0x7fbb2014feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb20147410 con 0x7fbb200b7980 2023-07-09T21:43:01.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2014c970 con 0x7fbb200cf290 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb27511640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200c7ef0 con 0x7fbb200d0780 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb252ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb252ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56696/0 (socket says 172.21.15.37:56696) 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb252ad640 1 -- 172.21.15.37:0/4260273630 learned_addr learned my addr 172.21.15.37:0/4260273630 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb25aae640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb200d0780 0x7fbb2014feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb24aac640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb200cf290 0x7fbb20146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb252ad640 1 -- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb200d0780 msgr2=0x7fbb2014feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.347+0000 7fbb252ad640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb200d0780 0x7fbb2014feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb252ad640 1 -- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb200cf290 msgr2=0x7fbb20146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb252ad640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb200cf290 0x7fbb20146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb252ad640 1 -- 172.21.15.37:0/4260273630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb100094d0 con 0x7fbb200b7980 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb252ad640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00c450 tx=0x7fbb1c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c012830 con 0x7fbb200b7980 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c0129b0 con 0x7fbb200b7980 2023-07-09T21:43:01.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb200c81d0 con 0x7fbb200b7980 2023-07-09T21:43:01.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c012d60 con 0x7fbb200b7980 2023-07-09T21:43:01.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb200c8790 con 0x7fbb200b7980 2023-07-09T21:43:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2014b3e0 con 0x7fbb200b7980 2023-07-09T21:43:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbb1c01c460 con 0x7fbb200b7980 2023-07-09T21:43:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 0x7fbb04068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.351+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7fbb1c0839c0 con 0x7fbb200b7980 2023-07-09T21:43:01.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.355+0000 7fbb24aac640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 0x7fbb04068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.355+0000 7fbb24aac640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 0x7fbb04068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb100ad000 tx=0x7fbb10009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.355+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb2014b3e0 con 0x7fbb200b7980 2023-07-09T21:43:01.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb2014b3e0 con 0x7fbb200b7980 2023-07-09T21:43:01.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb15ffb640 1 -- 172.21.15.37:0/4260273630 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb2014b3e0 con 0x7fbb200b7980 2023-07-09T21:43:01.513 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:43:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 msgr2=0x7fbb04068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 0x7fbb04068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb100ad000 tx=0x7fbb10009040 comp rx=0 tx=0).stop 2023-07-09T21:43:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 msgr2=0x7fbb20150830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c00c450 tx=0x7fbb1c00c910 comp rx=0 tx=0).stop 2023-07-09T21:43:01.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 shutdown_connections 2023-07-09T21:43:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fbb040663d0 0x7fbb04068880 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb200d0780 0x7fbb2014feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb200cf290 0x7fbb20146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 --2- 172.21.15.37:0/4260273630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb200b7980 0x7fbb20150830 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 >> 172.21.15.37:0/4260273630 conn(0x7fbb20073090 msgr2=0x7fbb2015c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 shutdown_connections 2023-07-09T21:43:01.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.511+0000 7fbb27511640 1 -- 172.21.15.37:0/4260273630 wait complete. 2023-07-09T21:43:01.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:43:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 Processor -- start 2023-07-09T21:43:01.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 -- start start 2023-07-09T21:43:01.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 0x7f460806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f460806cb20 0x7f4608069890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f460806c690 con 0x7f4608070370 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460806ebd0 con 0x7f460806cb20 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f461020b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4608069dd0 con 0x7f46080694c0 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f460806cb20 0x7f4608069890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f460806cb20 0x7f4608069890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56710/0 (socket says 172.21.15.37:56710) 2023-07-09T21:43:01.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 -- 172.21.15.37:0/1373214255 learned_addr learned my addr 172.21.15.37:0/1373214255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:01.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460e7a8640 1 --1- 172.21.15.37:0/1373214255 >> v1:172.21.15.37:6789/0 conn(0x7f4608070370 0x7f460806d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58576/0 (socket says 172.21.15.37:58576) 2023-07-09T21:43:01.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460dfa7640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 0x7f460806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 -- 172.21.15.37:0/1373214255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 msgr2=0x7f460806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 0x7f460806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 -- 172.21.15.37:0/1373214255 >> v1:172.21.15.37:6789/0 conn(0x7f4608070370 legacy=0x7f460806d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460d7a6640 1 -- 172.21.15.37:0/1373214255 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46080b1e80 con 0x7f460806cb20 2023-07-09T21:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460cfa5640 1 -- 172.21.15.37:0/1373214255 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391254257 0 0) 0x7f460806c690 con 0x7f4608070370 2023-07-09T21:43:01.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.679+0000 7f460dfa7640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 0x7f460806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:01.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f460d7a6640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f4608069890 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009870 tx=0x7f45f801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4c54ee7d88602f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f460cfa5640 1 -- 172.21.15.37:0/1373214255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8004230 con 0x7f460806cb20 2023-07-09T21:43:01.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f460cfa5640 1 -- 172.21.15.37:0/1373214255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f80a7050 con 0x7f460806cb20 2023-07-09T21:43:01.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f460cfa5640 1 -- 172.21.15.37:0/1373214255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8003620 con 0x7f460806cb20 2023-07-09T21:43:01.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 -- 172.21.15.37:0/1373214255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 msgr2=0x7f4608069890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f4608069890 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009870 tx=0x7f45f801c540 comp rx=0 tx=0).stop 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 -- 172.21.15.37:0/1373214255 shutdown_connections 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f4608069890 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 --2- 172.21.15.37:0/1373214255 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46080694c0 0x7f460806e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 -- 172.21.15.37:0/1373214255 >> 172.21.15.37:0/1373214255 conn(0x7f460806b250 msgr2=0x7f46080cef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 -- 172.21.15.37:0/1373214255 shutdown_connections 2023-07-09T21:43:01.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.683+0000 7f461020b640 1 -- 172.21.15.37:0/1373214255 wait complete. 2023-07-09T21:43:01.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 Processor -- start 2023-07-09T21:43:01.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- start start 2023-07-09T21:43:01.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 0x7f46081f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 0x7f4608157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46081f8320 con 0x7f460806cb20 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4608158540 con 0x7f46080694c0 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080ce530 con 0x7f4608070370 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56712/0 (socket says 172.21.15.37:56712) 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 -- 172.21.15.37:0/2031145044 learned_addr learned my addr 172.21.15.37:0/2031145044 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460e7a8640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 0x7f4608157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460dfa7640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 0x7f46081f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 -- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 msgr2=0x7f4608157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 0x7f4608157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 -- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 msgr2=0x7f46081f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 0x7f46081f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 -- 172.21.15.37:0/2031145044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80094d0 con 0x7f460806cb20 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460e7a8640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 0x7f4608157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:43:01.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460dfa7640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 0x7f46081f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f460d7a6640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f45f801ca20 tx=0x7f45f80192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f8003ab0 con 0x7f460806cb20 2023-07-09T21:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f8003c10 con 0x7f460806cb20 2023-07-09T21:43:01.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46081f7a80 con 0x7f460806cb20 2023-07-09T21:43:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45f80ab440 con 0x7f460806cb20 2023-07-09T21:43:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46081f8040 con 0x7f460806cb20 2023-07-09T21:43:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.687+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46081582a0 con 0x7f460806cb20 2023-07-09T21:43:01.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.691+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f45f80b2050 con 0x7f460806cb20 2023-07-09T21:43:01.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.691+0000 7f45fe7fc640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 0x7f45ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:01.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.691+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f45f811df50 con 0x7f460806cb20 2023-07-09T21:43:01.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.691+0000 7f460dfa7640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 0x7f45ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:01.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.691+0000 7f460dfa7640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 0x7f45ec068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46080ce220 tx=0x7f4604008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:01.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.695+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46081582a0 con 0x7f460806cb20 2023-07-09T21:43:01.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.847+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4608158680 con 0x7f460806cb20 2023-07-09T21:43:01.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.847+0000 7f45fe7fc640 1 -- 172.21.15.37:0/2031145044 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v154) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4608158680 con 0x7f460806cb20 2023-07-09T21:43:01.850 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 msgr2=0x7f45ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 0x7f45ec068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46080ce220 tx=0x7f4604008040 comp rx=0 tx=0).stop 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 msgr2=0x7f46081f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f45f801ca20 tx=0x7f45f80192e0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 shutdown_connections 2023-07-09T21:43:01.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f45ec0663a0 0x7f45ec068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4608070370 0x7f4608157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f460806cb20 0x7f46081f7380 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 --2- 172.21.15.37:0/2031145044 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46080694c0 0x7f46081f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 >> 172.21.15.37:0/2031145044 conn(0x7f460806b250 msgr2=0x7f460815e850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 shutdown_connections 2023-07-09T21:43:01.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:01.851+0000 7f461020b640 1 -- 172.21.15.37:0/2031145044 wait complete. 2023-07-09T21:43:01.871 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:43:01.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:43:01.964 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:43:02.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.011+0000 7f75bfde2640 1 Processor -- start 2023-07-09T21:43:02.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.011+0000 7f75bfde2640 1 -- start start 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.011+0000 7f75bfde2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f75b80b7ab0 0x7f75b806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bfde2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75b80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bfde2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b80b49f0 con 0x7f75b80b4170 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bfde2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b80b7e80 con 0x7f75b80b7ab0 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bfde2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80b4610 con 0x7f75b80cef80 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75be37f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f75b80b4170 0x7f75b815f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58582/0 (socket says 172.21.15.37:58582) 2023-07-09T21:43:02.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75be37f640 1 -- 172.21.15.37:0/810599608 learned_addr learned my addr 172.21.15.37:0/810599608 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:02.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75b80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bdb7e640 1 --2- 172.21.15.37:0/810599608 >> v2:172.21.15.119:3300/0 conn(0x7f75b80b7ab0 0x7f75b806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141709108 0 0) 0x7f75b80b49f0 con 0x7f75b80b4170 2023-07-09T21:43:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75a4003530 con 0x7f75b80b4170 2023-07-09T21:43:02.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066490756 0 0) 0x7f75a4003530 con 0x7f75b80b4170 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 msgr2=0x7f75b80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75b80b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 >> v2:172.21.15.119:3300/0 conn(0x7f75b80b7ab0 msgr2=0x7f75b806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 --2- 172.21.15.37:0/810599608 >> v2:172.21.15.119:3300/0 conn(0x7f75b80b7ab0 0x7f75b806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80cc8a0 con 0x7f75b80b4170 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f75b0001a00 con 0x7f75b80b4170 2023-07-09T21:43:02.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 >> v1:172.21.15.37:6789/0 conn(0x7f75b80b4170 legacy=0x7f75b815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75a4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a4004d10 0x7f75a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400b990 con 0x7f75a4003f00 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400bad0 con 0x7f75a4004d10 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a400bc10 con 0x7f75b80cef80 2023-07-09T21:43:02.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bdb7e640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75a4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75be37f640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a4004d10 0x7f75a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 -- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 msgr2=0x7f75a4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:02.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80cef80 0x7f75a4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 -- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a4004d10 msgr2=0x7f75a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a4004d10 0x7f75a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75bd37d640 1 -- 172.21.15.37:0/810599608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4003530 con 0x7f75a4003f00 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.015+0000 7f75be37f640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75a4004d10 0x7f75a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bd37d640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75a40047d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009ab0 tx=0x7f75a801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378c92837d9c60ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a5620 con 0x7f75a4003f00 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a80a5780 con 0x7f75a4003f00 2023-07-09T21:43:02.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bcb7c640 1 -- 172.21.15.37:0/810599608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a5b30 con 0x7f75a4003f00 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- 172.21.15.37:0/810599608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 msgr2=0x7f75a40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 --2- 172.21.15.37:0/810599608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75a40047d0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009ab0 tx=0x7f75a801ca30 comp rx=0 tx=0).stop 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75be37f640 1 -- 172.21.15.37:0/810599608 reap_dead start 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- 172.21.15.37:0/810599608 shutdown_connections 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- 172.21.15.37:0/810599608 >> 172.21.15.37:0/810599608 conn(0x7f75b8073090 msgr2=0x7f75b8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- 172.21.15.37:0/810599608 shutdown_connections 2023-07-09T21:43:02.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- 172.21.15.37:0/810599608 wait complete. 2023-07-09T21:43:02.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 Processor -- start 2023-07-09T21:43:02.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.019+0000 7f75bfde2640 1 -- start start 2023-07-09T21:43:02.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75b80b2d40 0x7f75b8159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 0x7f75b80c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80c8890 con 0x7f75a4003f00 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b815c0d0 con 0x7f75b80b2d40 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80cc1c0 con 0x7f75b80c7eb0 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56736/0 (socket says 172.21.15.37:56736) 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 -- 172.21.15.37:0/3141332623 learned_addr learned my addr 172.21.15.37:0/3141332623 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:02.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75be37f640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 0x7f75b80c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 -- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 msgr2=0x7f75b80c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 0x7f75b80c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 -- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75b80b2d40 msgr2=0x7f75b8159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75b80b2d40 0x7f75b8159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 -- 172.21.15.37:0/3141332623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b80cb920 con 0x7f75a4003f00 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75be37f640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 0x7f75b80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bdb7e640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f75b4011aa0 tx=0x7f75b4011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b400fb80 con 0x7f75a4003f00 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75b400fce0 con 0x7f75a4003f00 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b4014680 con 0x7f75a4003f00 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b80cbc00 con 0x7f75a4003f00 2023-07-09T21:43:02.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b80cb510 con 0x7f75a4003f00 2023-07-09T21:43:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.023+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b804d7d0 con 0x7f75a4003f00 2023-07-09T21:43:02.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.027+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f75b40147e0 con 0x7f75a4003f00 2023-07-09T21:43:02.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.027+0000 7f75ae7fc640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 0x7f759c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.027+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7f75b4084510 con 0x7f75a4003f00 2023-07-09T21:43:02.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.027+0000 7f75bd37d640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 0x7f759c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.027+0000 7f75bd37d640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 0x7f759c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75a80af000 tx=0x7f75a8004740 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.031+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75b4051ba0 con 0x7f75a4003f00 2023-07-09T21:43:02.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f75b806a830 con 0x7f75a4003f00 2023-07-09T21:43:02.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75ae7fc640 1 -- 172.21.15.37:0/3141332623 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v154) v1 ==== 84+0+126 (secure 0 0 0) 0x7f75b40551c0 con 0x7f75a4003f00 2023-07-09T21:43:02.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:02.188 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:43:02.188 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:43:02.189 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:02.190 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:43:02.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 msgr2=0x7f759c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 0x7f759c068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f75a80af000 tx=0x7f75a8004740 comp rx=0 tx=0).stop 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 msgr2=0x7f75b80c9c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f75b4011aa0 tx=0x7f75b4011f60 comp rx=0 tx=0).stop 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 shutdown_connections 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f759c0663a0 0x7f759c068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f75b80c7eb0 0x7f75b80c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f75b80b2d40 0x7f75b8159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 --2- 172.21.15.37:0/3141332623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a4003f00 0x7f75b80c9c60 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 >> 172.21.15.37:0/3141332623 conn(0x7f75b8073090 msgr2=0x7f75b806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:02.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 shutdown_connections 2023-07-09T21:43:02.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.187+0000 7f75bfde2640 1 -- 172.21.15.37:0/3141332623 wait complete. 2023-07-09T21:43:02.209 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:43:02.209 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:43:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 Processor -- start 2023-07-09T21:43:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 -- start start 2023-07-09T21:43:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 0x7ff2dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2dc15bf80 con 0x7ff2dc0b7980 2023-07-09T21:43:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2dc0cd070 con 0x7ff2dc0cf290 2023-07-09T21:43:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e340b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0cfd70 con 0x7ff2dc0d0780 2023-07-09T21:43:02.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e09a6640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 0x7ff2dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:51722/0 (socket says 172.21.15.37:51722) 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 -- 172.21.15.37:0/1448694836 learned_addr learned my addr 172.21.15.37:0/1448694836 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 -- 172.21.15.37:0/1448694836 >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 msgr2=0x7ff2dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 --2- 172.21.15.37:0/1448694836 >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 0x7ff2dc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 -- 172.21.15.37:0/1448694836 >> v1:172.21.15.119:6789/0 conn(0x7ff2dc0b7980 legacy=0x7ff2dc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e19a8640 1 -- 172.21.15.37:0/1448694836 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc160570 con 0x7ff2dc0d0780 2023-07-09T21:43:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.399+0000 7ff2e09a6640 1 --2- 172.21.15.37:0/1448694836 >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 0x7ff2dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e19a8640 1 --2- 172.21.15.37:0/1448694836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009e50 tx=0x7ff2d401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880fff3d843e9763 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2d3fff640 1 -- 172.21.15.37:0/1448694836 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40a56e0 con 0x7ff2dc0d0780 2023-07-09T21:43:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2d3fff640 1 -- 172.21.15.37:0/1448694836 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d40a5840 con 0x7ff2dc0d0780 2023-07-09T21:43:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2d3fff640 1 -- 172.21.15.37:0/1448694836 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40a5bd0 con 0x7ff2dc0d0780 2023-07-09T21:43:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 -- 172.21.15.37:0/1448694836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 msgr2=0x7ff2dc0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 --2- 172.21.15.37:0/1448694836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009e50 tx=0x7ff2d401ca10 comp rx=0 tx=0).stop 2023-07-09T21:43:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 -- 172.21.15.37:0/1448694836 shutdown_connections 2023-07-09T21:43:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 --2- 172.21.15.37:0/1448694836 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0d0780 0x7ff2dc0d0bc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 --2- 172.21.15.37:0/1448694836 >> v2:172.21.15.119:3300/0 conn(0x7ff2dc0cf290 0x7ff2dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 -- 172.21.15.37:0/1448694836 >> 172.21.15.37:0/1448694836 conn(0x7ff2dc073090 msgr2=0x7ff2dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 -- 172.21.15.37:0/1448694836 shutdown_connections 2023-07-09T21:43:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.403+0000 7ff2e340b640 1 -- 172.21.15.37:0/1448694836 wait complete. 2023-07-09T21:43:02.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 Processor -- start 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 -- start start 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0b7980 0x7ff2dc15cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2dc0d0780 0x7ff2dc0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0b3c80 con 0x7ff2dc0cf290 2023-07-09T21:43:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc15a670 con 0x7ff2dc0d0780 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2dc0c61f0 con 0x7ff2dc0b7980 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56750/0 (socket says 172.21.15.37:56750) 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 -- 172.21.15.37:0/4260566744 learned_addr learned my addr 172.21.15.37:0/4260566744 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e19a8640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2dc0d0780 0x7ff2dc0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e11a7640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0b7980 0x7ff2dc15cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 -- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0b7980 msgr2=0x7ff2dc15cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0b7980 0x7ff2dc15cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 -- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2dc0d0780 msgr2=0x7ff2dc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2dc0d0780 0x7ff2dc0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 -- 172.21.15.37:0/4260566744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc009420 con 0x7ff2dc0cf290 2023-07-09T21:43:02.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e09a6640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00ea00 tx=0x7ff2cc00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00ca60 con 0x7ff2dc0cf290 2023-07-09T21:43:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00cbc0 con 0x7ff2dc0cf290 2023-07-09T21:43:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc013470 con 0x7ff2dc0cf290 2023-07-09T21:43:02.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.407+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4009b30 con 0x7ff2dc0cf290 2023-07-09T21:43:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2dc15a020 con 0x7ff2dc0cf290 2023-07-09T21:43:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2dc15a820 con 0x7ff2dc0cf290 2023-07-09T21:43:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff2cc0135d0 con 0x7ff2dc0cf290 2023-07-09T21:43:02.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2d1ffb640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 0x7ff2c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5238+0+0 (secure 0 0 0) 0x7ff2cc083ae0 con 0x7ff2dc0cf290 2023-07-09T21:43:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.411+0000 7ff2e11a7640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 0x7ff2c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:02.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.415+0000 7ff2e11a7640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 0x7ff2c0068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc153ab0 tx=0x7ff2d8009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:02.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.415+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff2dc15a820 con 0x7ff2dc0cf290 2023-07-09T21:43:02.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:02.571+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff2dc15a820 con 0x7ff2dc0cf290 2023-07-09T21:43:03.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.079+0000 7ff2d1ffb640 1 -- 172.21.15.37:0/4260566744 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v155) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff2dc15a820 con 0x7ff2dc0cf290 2023-07-09T21:43:03.082 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:43:03.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 msgr2=0x7ff2c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 0x7ff2c0068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc153ab0 tx=0x7ff2d8009040 comp rx=0 tx=0).stop 2023-07-09T21:43:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 msgr2=0x7ff2dc0c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00ea00 tx=0x7ff2cc00eec0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 shutdown_connections 2023-07-09T21:43:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7ff2c00663a0 0x7ff2c0068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff2dc0d0780 0x7ff2dc0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2dc0cf290 0x7ff2dc0c5cb0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 --2- 172.21.15.37:0/4260566744 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff2dc0b7980 0x7ff2dc15cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 >> 172.21.15.37:0/4260566744 conn(0x7ff2dc073090 msgr2=0x7ff2dc155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 shutdown_connections 2023-07-09T21:43:03.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.083+0000 7ff2e340b640 1 -- 172.21.15.37:0/4260566744 wait complete. 2023-07-09T21:43:03.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:43:03.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 Processor -- start 2023-07-09T21:43:03.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 -- start start 2023-07-09T21:43:03.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7effc00b7980 0x7effc0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effc00ceb80 0x7effc00cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc015bf80 con 0x7effc00b3c20 2023-07-09T21:43:03.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00cd070 con 0x7effc00b7980 2023-07-09T21:43:03.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.259+0000 7effc78bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cfd70 con 0x7effc00ceb80 2023-07-09T21:43:03.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7effc00b3c20 0x7effc00b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58584/0 (socket says 172.21.15.37:58584) 2023-07-09T21:43:03.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 -- 172.21.15.37:0/3824058064 learned_addr learned my addr 172.21.15.37:0/3824058064 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc4e58640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effc00ceb80 0x7effc00cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5659640 1 --2- 172.21.15.37:0/3824058064 >> v2:172.21.15.119:3300/0 conn(0x7effc00b7980 0x7effc0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815628229 0 0) 0x7effb80014a0 con 0x7effc00b3c20 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effac003530 con 0x7effc00b3c20 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311371042 0 0) 0x7effac003530 con 0x7effc00b3c20 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effc00ceb80 msgr2=0x7effc00cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:03.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effc00ceb80 0x7effc00cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 >> v2:172.21.15.119:3300/0 conn(0x7effc00b7980 msgr2=0x7effc0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 --2- 172.21.15.37:0/3824058064 >> v2:172.21.15.119:3300/0 conn(0x7effc00b7980 0x7effc0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0160570 con 0x7effc00b3c20 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7effb8001b90 con 0x7effc00b3c20 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 >> v1:172.21.15.37:6789/0 conn(0x7effc00b3c20 legacy=0x7effc00b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effac003980 0x7effac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac0043b0 0x7effac004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effac004e90 0x7effac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cd070 con 0x7effac004e90 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cfd70 con 0x7effac003980 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effac00bed0 con 0x7effac0043b0 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5659640 1 --2- 172.21.15.37:0/3824058064 >> v2:172.21.15.119:3300/0 conn(0x7effc00b7980 0x7effc0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc4e58640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effc00ceb80 0x7effc00cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effac004e90 0x7effac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5659640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effac003980 0x7effac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc4e58640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac0043b0 0x7effac004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 -- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac0043b0 msgr2=0x7effac004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:03.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac0043b0 0x7effac004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 -- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effac003980 msgr2=0x7effac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:03.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effac003980 0x7effac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.263+0000 7effc5e5a640 1 -- 172.21.15.37:0/3824058064 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac003530 con 0x7effac004e90 2023-07-09T21:43:03.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc5e5a640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effac004e90 0x7effac00b990 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7effb800a830 tx=0x7effb801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d124ded652c85b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:03.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80ad630 con 0x7effac004e90 2023-07-09T21:43:03.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb80a8070 con 0x7effac004e90 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effb7fff640 1 -- 172.21.15.37:0/3824058064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80ad9f0 con 0x7effac004e90 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- 172.21.15.37:0/3824058064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effac004e90 msgr2=0x7effac00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 --2- 172.21.15.37:0/3824058064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effac004e90 0x7effac00b990 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7effb800a830 tx=0x7effb801d360 comp rx=0 tx=0).stop 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc5e5a640 1 -- 172.21.15.37:0/3824058064 reap_dead start 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- 172.21.15.37:0/3824058064 shutdown_connections 2023-07-09T21:43:03.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- 172.21.15.37:0/3824058064 >> 172.21.15.37:0/3824058064 conn(0x7effc0073090 msgr2=0x7effc0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:03.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- 172.21.15.37:0/3824058064 shutdown_connections 2023-07-09T21:43:03.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- 172.21.15.37:0/3824058064 wait complete. 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 Processor -- start 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.267+0000 7effc78bd640 1 -- start start 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac004e90 0x7effc015eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effc00d2d50 0x7effc0149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc014a7c0 con 0x7effc00b3ff0 2023-07-09T21:43:03.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00b49a0 con 0x7effc00d2d50 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc014c320 con 0x7effac004e90 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56778/0 (socket says 172.21.15.37:56778) 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 -- 172.21.15.37:0/1065994597 learned_addr learned my addr 172.21.15.37:0/1065994597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5659640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac004e90 0x7effc015eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc4e58640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effc00d2d50 0x7effc0149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 -- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac004e90 msgr2=0x7effc015eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac004e90 0x7effc015eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 -- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effc00d2d50 msgr2=0x7effc0149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effc00d2d50 0x7effc0149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 -- 172.21.15.37:0/1065994597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc0149b40 con 0x7effc00b3ff0 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc5e5a640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f90 tx=0x7effac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8001b50 con 0x7effc00b3ff0 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb80014a0 con 0x7effc00b3ff0 2023-07-09T21:43:03.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80ad630 con 0x7effc00b3ff0 2023-07-09T21:43:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc0149e20 con 0x7effc00b3ff0 2023-07-09T21:43:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc014a3e0 con 0x7effc00b3ff0 2023-07-09T21:43:03.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.271+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc004d7d0 con 0x7effc00b3ff0 2023-07-09T21:43:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.275+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7effb80aa030 con 0x7effc00b3ff0 2023-07-09T21:43:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.275+0000 7effb5ffb640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 0x7effa4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.275+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5608+0+0 (secure 0 0 0) 0x7effb811d5e0 con 0x7effc00b3ff0 2023-07-09T21:43:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.275+0000 7effc5659640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 0x7effa4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:03.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.275+0000 7effc5659640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 0x7effa4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effbc009de0 tx=0x7effbc009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:03.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.279+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7effb80ea980 con 0x7effc00b3ff0 2023-07-09T21:43:03.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:03.435+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7effc0160570 con 0x7effc00b3ff0 2023-07-09T21:43:04.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.087+0000 7effb5ffb640 1 -- 172.21.15.37:0/1065994597 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v156) v1 ==== 170+0+0 (secure 0 0 0) 0x7effc0160570 con 0x7effc00b3ff0 2023-07-09T21:43:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:43:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.095+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 msgr2=0x7effa4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.095+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 0x7effa4068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effbc009de0 tx=0x7effbc009190 comp rx=0 tx=0).stop 2023-07-09T21:43:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 msgr2=0x7effc00b4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7effb8000f90 tx=0x7effac005800 comp rx=0 tx=0).stop 2023-07-09T21:43:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 shutdown_connections 2023-07-09T21:43:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7effa40663a0 0x7effa4068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7effc00b3ff0 0x7effc00b4460 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7effc00d2d50 0x7effc0149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 --2- 172.21.15.37:0/1065994597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7effac004e90 0x7effc015eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 >> 172.21.15.37:0/1065994597 conn(0x7effc0073090 msgr2=0x7effc00b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.099+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 shutdown_connections 2023-07-09T21:43:04.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.103+0000 7effc78bd640 1 -- 172.21.15.37:0/1065994597 wait complete. 2023-07-09T21:43:04.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:43:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 Processor -- start 2023-07-09T21:43:04.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 -- start start 2023-07-09T21:43:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd8dc0b7980 0x7fd8dc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 0x7fd8dc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc15bf80 con 0x7fd8dc0ceb80 2023-07-09T21:43:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0cd070 con 0x7fd8dc0b7980 2023-07-09T21:43:04.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8e1e6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0cfd70 con 0x7fd8dc0d0780 2023-07-09T21:43:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8daffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd8dc0ceb80 0x7fd8dc0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58598/0 (socket says 172.21.15.37:58598) 2023-07-09T21:43:04.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8daffd640 1 -- 172.21.15.37:0/817408389 learned_addr learned my addr 172.21.15.37:0/817408389 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/817408389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 0x7fd8dc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8db7fe640 1 --2- 172.21.15.37:0/817408389 >> v2:172.21.15.119:3300/0 conn(0x7fd8dc0b7980 0x7fd8dc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8da7fc640 1 -- 172.21.15.37:0/817408389 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110081793 0 0) 0x7fd8d0001120 con 0x7fd8dc0ceb80 2023-07-09T21:43:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8da7fc640 1 -- 172.21.15.37:0/817408389 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c4003530 con 0x7fd8dc0ceb80 2023-07-09T21:43:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8dbfff640 1 -- 172.21.15.37:0/817408389 >> v2:172.21.15.119:3300/0 conn(0x7fd8dc0b7980 msgr2=0x7fd8dc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:04.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/817408389 >> v2:172.21.15.119:3300/0 conn(0x7fd8dc0b7980 0x7fd8dc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8dbfff640 1 -- 172.21.15.37:0/817408389 >> v1:172.21.15.37:6789/0 conn(0x7fd8dc0ceb80 legacy=0x7fd8dc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.283+0000 7fd8dbfff640 1 -- 172.21.15.37:0/817408389 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc160570 con 0x7fd8dc0d0780 2023-07-09T21:43:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/817408389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 0x7fd8dc0d0bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009d90 tx=0x7fd8d401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5469af5a7b4b287 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:04.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8da7fc640 1 -- 172.21.15.37:0/817408389 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40a5810 con 0x7fd8dc0d0780 2023-07-09T21:43:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8da7fc640 1 -- 172.21.15.37:0/817408389 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40a5970 con 0x7fd8dc0d0780 2023-07-09T21:43:04.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8da7fc640 1 -- 172.21.15.37:0/817408389 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40a5d00 con 0x7fd8dc0d0780 2023-07-09T21:43:04.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/817408389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 msgr2=0x7fd8dc0d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/817408389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 0x7fd8dc0d0bc0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd8d4009d90 tx=0x7fd8d401c950 comp rx=0 tx=0).stop 2023-07-09T21:43:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/817408389 shutdown_connections 2023-07-09T21:43:04.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/817408389 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0d0780 0x7fd8dc0d0bc0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/817408389 >> v2:172.21.15.119:3300/0 conn(0x7fd8dc0b7980 0x7fd8dc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/817408389 >> 172.21.15.37:0/817408389 conn(0x7fd8dc073090 msgr2=0x7fd8dc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/817408389 shutdown_connections 2023-07-09T21:43:04.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.287+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/817408389 wait complete. 2023-07-09T21:43:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 Processor -- start 2023-07-09T21:43:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- start start 2023-07-09T21:43:04.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8dc0b7980 0x7fd8dc0c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0ceb80 0x7fd8dc0b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c6ff0 con 0x7fd8dc0d0780 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c84c0 con 0x7fd8dc0b7980 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc0c78b0 con 0x7fd8dc0ceb80 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56784/0 (socket says 172.21.15.37:56784) 2023-07-09T21:43:04.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 -- 172.21.15.37:0/3836093960 learned_addr learned my addr 172.21.15.37:0/3836093960 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8daffd640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0ceb80 0x7fd8dc0b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8db7fe640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8dc0b7980 0x7fd8dc0c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 -- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0ceb80 msgr2=0x7fd8dc0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0ceb80 0x7fd8dc0b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 -- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8dc0b7980 msgr2=0x7fd8dc0c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8dc0b7980 0x7fd8dc0c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:04.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 -- 172.21.15.37:0/3836093960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009a70 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8dbfff640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b0040 tx=0x7fd8d40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40b9860 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d40b99c0 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d40b9d50 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8dc0c7b90 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc0c8150 con 0x7fd8dc0d0780 2023-07-09T21:43:04.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.291+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc0b80e0 con 0x7fd8dc0d0780 2023-07-09T21:43:04.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.295+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd8d40ad440 con 0x7fd8dc0d0780 2023-07-09T21:43:04.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.295+0000 7fd8c3fff640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 0x7fd8c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:04.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.295+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5990+0+0 (secure 0 0 0) 0x7fd8d411f260 con 0x7fd8dc0d0780 2023-07-09T21:43:04.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.295+0000 7fd8db7fe640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 0x7fd8c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:04.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.299+0000 7fd8db7fe640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 0x7fd8c8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009b60 tx=0x7fd8cc009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:04.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.299+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd8d40ec830 con 0x7fd8dc0d0780 2023-07-09T21:43:04.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:04.487+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd8dc160570 con 0x7fd8dc0d0780 2023-07-09T21:43:05.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.143+0000 7fd8c3fff640 1 -- 172.21.15.37:0/3836093960 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd8dc160570 con 0x7fd8dc0d0780 2023-07-09T21:43:05.144 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 19 and data pool 20 2023-07-09T21:43:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.147+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 msgr2=0x7fd8c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.147+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 0x7fd8c8068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc009b60 tx=0x7fd8cc009190 comp rx=0 tx=0).stop 2023-07-09T21:43:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.147+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 msgr2=0x7fd8dc1526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.147+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd8d40b0040 tx=0x7fd8d40196f0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 shutdown_connections 2023-07-09T21:43:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd8c80663a0 0x7fd8c8068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8dc0d0780 0x7fd8dc1526c0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd8dc0ceb80 0x7fd8dc0b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 --2- 172.21.15.37:0/3836093960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd8dc0b7980 0x7fd8dc0c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 >> 172.21.15.37:0/3836093960 conn(0x7fd8dc073090 msgr2=0x7fd8dc0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 shutdown_connections 2023-07-09T21:43:05.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.151+0000 7fd8e1e6d640 1 -- 172.21.15.37:0/3836093960 wait complete. 2023-07-09T21:43:05.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:43:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 Processor -- start 2023-07-09T21:43:05.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 -- start start 2023-07-09T21:43:05.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16700cef80 0x7f167006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700b49f0 con 0x7f16700b7ab0 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16700cc8a0 con 0x7f16700b4340 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f167766d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16700b7e80 con 0x7f16700cef80 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675409640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16700b7ab0 0x7f16700b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58600/0 (socket says 172.21.15.37:58600) 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675409640 1 -- 172.21.15.37:0/3217552811 learned_addr learned my addr 172.21.15.37:0/3217552811 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:05.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675c0a640 1 --2- 172.21.15.37:0/3217552811 >> v2:172.21.15.37:3300/0 conn(0x7f16700cef80 0x7f167006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675c0a640 1 -- 172.21.15.37:0/3217552811 >> v1:172.21.15.119:6789/0 conn(0x7f16700b4340 legacy=0x7f16700d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:05.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675c0a640 1 -- 172.21.15.37:0/3217552811 >> v1:172.21.15.37:6789/0 conn(0x7f16700b7ab0 legacy=0x7f16700b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1675c0a640 1 -- 172.21.15.37:0/3217552811 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16700ccb80 con 0x7f16700cef80 2023-07-09T21:43:05.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.323+0000 7f1667fff640 1 -- 172.21.15.37:0/3217552811 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328837133 0 0) 0x7f16700b49f0 con 0x7f16700b7ab0 2023-07-09T21:43:05.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f1675c0a640 1 --2- 172.21.15.37:0/3217552811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700cef80 0x7f167006aa50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f1668009d90 tx=0x7f166801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3f8c13db0f8604 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f1667fff640 1 -- 172.21.15.37:0/3217552811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680a59a0 con 0x7f16700cef80 2023-07-09T21:43:05.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f1667fff640 1 -- 172.21.15.37:0/3217552811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16680a5b00 con 0x7f16700cef80 2023-07-09T21:43:05.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f1667fff640 1 -- 172.21.15.37:0/3217552811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16680a5e90 con 0x7f16700cef80 2023-07-09T21:43:05.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 -- 172.21.15.37:0/3217552811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700cef80 msgr2=0x7f167006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 --2- 172.21.15.37:0/3217552811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700cef80 0x7f167006aa50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f1668009d90 tx=0x7f166801c8e0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 -- 172.21.15.37:0/3217552811 shutdown_connections 2023-07-09T21:43:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 --2- 172.21.15.37:0/3217552811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700cef80 0x7f167006aa50 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 -- 172.21.15.37:0/3217552811 >> 172.21.15.37:0/3217552811 conn(0x7f1670073090 msgr2=0x7f1670069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 -- 172.21.15.37:0/3217552811 shutdown_connections 2023-07-09T21:43:05.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.327+0000 7f167766d640 1 -- 172.21.15.37:0/3217552811 wait complete. 2023-07-09T21:43:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 Processor -- start 2023-07-09T21:43:05.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 -- start start 2023-07-09T21:43:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16700b4340 0x7f167014c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16700cef80 0x7f1670150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16700c75e0 con 0x7f16700b7ab0 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1670155bd0 con 0x7f16700cef80 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16700c6960 con 0x7f16700b4340 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56798/0 (socket says 172.21.15.37:56798) 2023-07-09T21:43:05.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 -- 172.21.15.37:0/1601867606 learned_addr learned my addr 172.21.15.37:0/1601867606 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 -- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16700b4340 msgr2=0x7f167014c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16700b4340 0x7f167014c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 -- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16700cef80 msgr2=0x7f1670150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16700cef80 0x7f1670150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 -- 172.21.15.37:0/1601867606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1668009a70 con 0x7f16700b7ab0 2023-07-09T21:43:05.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1674c08640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f166000c410 tx=0x7f166000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660011790 con 0x7f16700b7ab0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16600118f0 con 0x7f16700b7ab0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1660011ca0 con 0x7f16700b7ab0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.331+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16700c6c40 con 0x7f16700b7ab0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16700c7200 con 0x7f16700b7ab0 2023-07-09T21:43:05.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167004d7d0 con 0x7f16700b7ab0 2023-07-09T21:43:05.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f166001c460 con 0x7f16700b7ab0 2023-07-09T21:43:05.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f1665ffb640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 0x7f1654068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1660083d00 con 0x7f16700b7ab0 2023-07-09T21:43:05.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f1675409640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 0x7f1654068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.335+0000 7f1675409640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 0x7f1654068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f166c0011f0 tx=0x7f166c007930 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.339+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1660050f20 con 0x7f16700b7ab0 2023-07-09T21:43:05.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16700c7720 con 0x7f16700b7ab0 2023-07-09T21:43:05.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f1665ffb640 1 -- 172.21.15.37:0/1601867606 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f16700c7720 con 0x7f16700b7ab0 2023-07-09T21:43:05.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:05.496 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":157,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:43:04.492124+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:43:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 msgr2=0x7f1654068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 0x7f1654068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f166c0011f0 tx=0x7f166c007930 comp rx=0 tx=0).stop 2023-07-09T21:43:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 msgr2=0x7f1670150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f166000c410 tx=0x7f166000c8d0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 shutdown_connections 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f16540663a0 0x7f1654068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16700cef80 0x7f1670150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16700b7ab0 0x7f1670150710 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 --2- 172.21.15.37:0/1601867606 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16700b4340 0x7f167014c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 >> 172.21.15.37:0/1601867606 conn(0x7f1670073090 msgr2=0x7f1670069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 shutdown_connections 2023-07-09T21:43:05.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.495+0000 7f167766d640 1 -- 172.21.15.37:0/1601867606 wait complete. 2023-07-09T21:43:05.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:43:05.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.659+0000 7f3ba7b82640 1 Processor -- start 2023-07-09T21:43:05.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.659+0000 7f3ba7b82640 1 -- start start 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba7b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba00b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba7b82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba00b0ad0 con 0x7f3ba015b860 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba7b82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba015f620 con 0x7f3ba015bc30 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba7b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba015f990 con 0x7f3ba0069bd0 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba591e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3ba015b860 0x7f3ba015fdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58602/0 (socket says 172.21.15.37:58602) 2023-07-09T21:43:05.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba591e640 1 -- 172.21.15.37:0/4292715555 learned_addr learned my addr 172.21.15.37:0/4292715555 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba611f640 1 --2- 172.21.15.37:0/4292715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba00b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774199936 0 0) 0x7f3ba00b0ad0 con 0x7f3ba015b860 2023-07-09T21:43:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8c003530 con 0x7f3ba015b860 2023-07-09T21:43:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367963533 0 0) 0x7f3ba015f620 con 0x7f3ba015bc30 2023-07-09T21:43:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba00b0ad0 con 0x7f3ba015bc30 2023-07-09T21:43:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba611f640 1 -- 172.21.15.37:0/4292715555 >> v1:172.21.15.119:6789/0 conn(0x7f3ba015bc30 legacy=0x7f3ba00694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4229954136 0 0) 0x7f3b8c003530 con 0x7f3ba015b860 2023-07-09T21:43:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba611f640 1 -- 172.21.15.37:0/4292715555 >> v1:172.21.15.37:6789/0 conn(0x7f3ba015b860 legacy=0x7f3ba015fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.663+0000 7f3ba611f640 1 -- 172.21.15.37:0/4292715555 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba01604c0 con 0x7f3ba0069bd0 2023-07-09T21:43:05.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba611f640 1 --2- 172.21.15.37:0/4292715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba00b4270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009dc0 tx=0x7f3b9801c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7876e42d29230177 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c001680 con 0x7f3ba0069bd0 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b980a5590 con 0x7f3ba0069bd0 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba491c640 1 -- 172.21.15.37:0/4292715555 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b980a5900 con 0x7f3ba0069bd0 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- 172.21.15.37:0/4292715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 msgr2=0x7f3ba00b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/4292715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba00b4270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009dc0 tx=0x7f3b9801c770 comp rx=0 tx=0).stop 2023-07-09T21:43:05.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- 172.21.15.37:0/4292715555 shutdown_connections 2023-07-09T21:43:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/4292715555 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba00b4270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- 172.21.15.37:0/4292715555 >> 172.21.15.37:0/4292715555 conn(0x7f3ba00ce630 msgr2=0x7f3ba00cea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- 172.21.15.37:0/4292715555 shutdown_connections 2023-07-09T21:43:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- 172.21.15.37:0/4292715555 wait complete. 2023-07-09T21:43:05.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 Processor -- start 2023-07-09T21:43:05.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.667+0000 7f3ba7b82640 1 -- start start 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba015bc30 0x7f3ba015d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0157200 con 0x7f3ba015b860 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba00c4a30 con 0x7f3ba015bc30 2023-07-09T21:43:05.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba0156f20 con 0x7f3ba0069bd0 2023-07-09T21:43:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56810/0 (socket says 172.21.15.37:56810) 2023-07-09T21:43:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 -- 172.21.15.37:0/2110038627 learned_addr learned my addr 172.21.15.37:0/2110038627 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba591e640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba611f640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba015bc30 0x7f3ba015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 -- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 msgr2=0x7f3ba01511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba01511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 -- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba015bc30 msgr2=0x7f3ba015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba015bc30 0x7f3ba015d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 -- 172.21.15.37:0/2110038627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009a70 con 0x7f3ba015b860 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba511d640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c430 tx=0x7f3b9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b900052d0 con 0x7f3ba015b860 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b90005450 con 0x7f3ba015b860 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b90003840 con 0x7f3ba015b860 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba00c3f50 con 0x7f3ba015b860 2023-07-09T21:43:05.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba00c4510 con 0x7f3ba015b860 2023-07-09T21:43:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba00c3db0 con 0x7f3ba015b860 2023-07-09T21:43:05.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.671+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f3b900039a0 con 0x7f3ba015b860 2023-07-09T21:43:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.675+0000 7f3b967fc640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 0x7f3b84068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.675+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f3b900834b0 con 0x7f3ba015b860 2023-07-09T21:43:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.675+0000 7f3ba591e640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 0x7f3b84068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:05.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.675+0000 7f3ba591e640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 0x7f3b84068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0011f0 tx=0x7f3b9c0016a0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:05.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.675+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ba00c3db0 con 0x7f3ba015b860 2023-07-09T21:43:05.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.831+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba00c3db0 con 0x7f3ba015b860 2023-07-09T21:43:05.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3b967fc640 1 -- 172.21.15.37:0/2110038627 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+18354 (secure 0 0 0) 0x7f3ba00c3db0 con 0x7f3ba015b860 2023-07-09T21:43:05.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:05.837 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":157,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:43:04.492124+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:43:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 msgr2=0x7f3b84068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 0x7f3b84068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c0011f0 tx=0x7f3b9c0016a0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 msgr2=0x7f3ba0151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f3b9000c430 tx=0x7f3b9000c8f0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 shutdown_connections 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f3b840663a0 0x7f3b84068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3ba015bc30 0x7f3ba015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ba015b860 0x7f3ba0151880 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 --2- 172.21.15.37:0/2110038627 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3ba0069bd0 0x7f3ba01511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:05.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 >> 172.21.15.37:0/2110038627 conn(0x7f3ba00ce630 msgr2=0x7f3ba015fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 shutdown_connections 2023-07-09T21:43:05.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:05.835+0000 7f3ba7b82640 1 -- 172.21.15.37:0/2110038627 wait complete. 2023-07-09T21:43:05.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:43:06.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 Processor -- start 2023-07-09T21:43:06.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 -- start start 2023-07-09T21:43:06.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 0x7f6594160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659415bf80 con 0x7f65940ceb80 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6594160570 con 0x7f65940d0780 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f659992c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940cd070 con 0x7f65940b7980 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f658bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f65940ceb80 0x7f65940cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58616/0 (socket says 172.21.15.37:58616) 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f658bfff640 1 -- 172.21.15.37:0/2247436379 learned_addr learned my addr 172.21.15.37:0/2247436379 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:06.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f6592ffd640 1 --2- 172.21.15.37:0/2247436379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 0x7f6594160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:06.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565786586 0 0) 0x7f657c001120 con 0x7f65940ceb80 2023-07-09T21:43:06.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6580003530 con 0x7f65940ceb80 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970155779 0 0) 0x7f658c0014a0 con 0x7f65940d0780 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f657c001120 con 0x7f65940d0780 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1913880151 0 0) 0x7f6580003530 con 0x7f65940ceb80 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f6592ffd640 1 -- 172.21.15.37:0/2247436379 >> v1:172.21.15.119:6789/0 conn(0x7f65940d0780 legacy=0x7f65940d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f6592ffd640 1 -- 172.21.15.37:0/2247436379 >> v1:172.21.15.37:6789/0 conn(0x7f65940ceb80 legacy=0x7f65940cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:06.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.003+0000 7f6592ffd640 1 -- 172.21.15.37:0/2247436379 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65940d02f0 con 0x7f65940b7980 2023-07-09T21:43:06.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f6592ffd640 1 --2- 172.21.15.37:0/2247436379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 0x7f6594160030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65840097f0 tx=0x7f658401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d474a7851b74e5dc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c001810 con 0x7f65940b7980 2023-07-09T21:43:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840a7050 con 0x7f65940b7980 2023-07-09T21:43:06.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f65927fc640 1 -- 172.21.15.37:0/2247436379 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840ab620 con 0x7f65940b7980 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 -- 172.21.15.37:0/2247436379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 msgr2=0x7f6594160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 --2- 172.21.15.37:0/2247436379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 0x7f6594160030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f65840097f0 tx=0x7f658401c3e0 comp rx=0 tx=0).stop 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 -- 172.21.15.37:0/2247436379 shutdown_connections 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 --2- 172.21.15.37:0/2247436379 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940b7980 0x7f6594160030 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 -- 172.21.15.37:0/2247436379 >> 172.21.15.37:0/2247436379 conn(0x7f6594073090 msgr2=0x7f6594069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:06.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 -- 172.21.15.37:0/2247436379 shutdown_connections 2023-07-09T21:43:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.007+0000 7f659992c640 1 -- 172.21.15.37:0/2247436379 wait complete. 2023-07-09T21:43:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 Processor -- start 2023-07-09T21:43:06.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- start start 2023-07-09T21:43:06.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65940ceb80 0x7f6594150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940d0780 0x7f659415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659415d850 con 0x7f65940b7980 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659415db30 con 0x7f65940ceb80 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659415de10 con 0x7f65940d0780 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:06.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56826/0 (socket says 172.21.15.37:56826) 2023-07-09T21:43:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 -- 172.21.15.37:0/3093874539 learned_addr learned my addr 172.21.15.37:0/3093874539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f65937fe640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940d0780 0x7f659415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:06.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f658bfff640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65940ceb80 0x7f6594150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 -- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940d0780 msgr2=0x7f659415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940d0780 0x7f659415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 -- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65940ceb80 msgr2=0x7f6594150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65940ceb80 0x7f6594150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:06.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 -- 172.21.15.37:0/3093874539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6584009420 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6592ffd640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f65840ae040 tx=0x7f6584019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584004030 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584004190 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584004520 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659415e0f0 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.011+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659415e6b0 con 0x7f65940b7980 2023-07-09T21:43:06.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659415ff80 con 0x7f65940b7980 2023-07-09T21:43:06.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f65840b2040 con 0x7f65940b7980 2023-07-09T21:43:06.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f6590ff9640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 0x7f6574068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:06.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f658411cff0 con 0x7f65940b7980 2023-07-09T21:43:06.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f658bfff640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 0x7f6574068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:06.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.015+0000 7f658bfff640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 0x7f6574068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f657c000f70 tx=0x7f657c001e20 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:06.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.019+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65840ea280 con 0x7f65940b7980 2023-07-09T21:43:06.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:06.211+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65940737d0 con 0x7f65940b7980 2023-07-09T21:43:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.143+0000 7f6590ff9640 1 -- 172.21.15.37:0/3093874539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v68) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65940737d0 con 0x7f65940b7980 2023-07-09T21:43:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 msgr2=0x7f6574068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 0x7f6574068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f657c000f70 tx=0x7f657c001e20 comp rx=0 tx=0).stop 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 msgr2=0x7f659415ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f65840ae040 tx=0x7f6584019180 comp rx=0 tx=0).stop 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 shutdown_connections 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f65740663d0 0x7f6574068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65940d0780 0x7f659415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65940ceb80 0x7f6594150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 --2- 172.21.15.37:0/3093874539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65940b7980 0x7f659415ebd0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 >> 172.21.15.37:0/3093874539 conn(0x7f6594073090 msgr2=0x7f65940b67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 shutdown_connections 2023-07-09T21:43:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.147+0000 7f659992c640 1 -- 172.21.15.37:0/3093874539 wait complete. 2023-07-09T21:43:07.173 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:43:07.173 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:43:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 Processor -- start 2023-07-09T21:43:07.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 -- start start 2023-07-09T21:43:07.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38e80ceb80 0x7f38e80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f38e80b3c20 0x7f38e80b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e80cd070 con 0x7f38e80ceb80 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38e80cfd70 con 0x7f38e80b3c20 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38ecb11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e815bf80 con 0x7f38e80b7980 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38e80ceb80 0x7f38e80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f38e80ceb80 0x7f38e80cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55086/0 (socket says 172.21.15.37:55086) 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 -- 172.21.15.37:0/124501169 learned_addr learned my addr 172.21.15.37:0/124501169 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38e6d9d640 1 --2- 172.21.15.37:0/124501169 >> v2:172.21.15.119:3300/0 conn(0x7f38e80b3c20 0x7f38e80b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38e659c640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 -- 172.21.15.37:0/124501169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 msgr2=0x7f38e8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 -- 172.21.15.37:0/124501169 >> v2:172.21.15.119:3300/0 conn(0x7f38e80b3c20 msgr2=0x7f38e80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:07.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 --2- 172.21.15.37:0/124501169 >> v2:172.21.15.119:3300/0 conn(0x7f38e80b3c20 0x7f38e80b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.323+0000 7f38dffff640 1 -- 172.21.15.37:0/124501169 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8160570 con 0x7f38e80ceb80 2023-07-09T21:43:07.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38dffff640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80ceb80 0x7f38e80cef90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f38e808ad30 tx=0x7f38d001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81a57de52975dea server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38e5d9b640 1 -- 172.21.15.37:0/124501169 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00ab600 con 0x7f38e80ceb80 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38e5d9b640 1 -- 172.21.15.37:0/124501169 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d00a7050 con 0x7f38e80ceb80 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38e5d9b640 1 -- 172.21.15.37:0/124501169 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d00ab980 con 0x7f38e80ceb80 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 -- 172.21.15.37:0/124501169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80ceb80 msgr2=0x7f38e80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80ceb80 0x7f38e80cef90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f38e808ad30 tx=0x7f38d001c500 comp rx=0 tx=0).stop 2023-07-09T21:43:07.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 -- 172.21.15.37:0/124501169 shutdown_connections 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80ceb80 0x7f38e80cef90 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 --2- 172.21.15.37:0/124501169 >> v2:172.21.15.119:3300/0 conn(0x7f38e80b3c20 0x7f38e80b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 --2- 172.21.15.37:0/124501169 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 -- 172.21.15.37:0/124501169 >> 172.21.15.37:0/124501169 conn(0x7f38e8073090 msgr2=0x7f38e8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 -- 172.21.15.37:0/124501169 shutdown_connections 2023-07-09T21:43:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.327+0000 7f38ecb11640 1 -- 172.21.15.37:0/124501169 wait complete. 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 Processor -- start 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- start start 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e81505a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e80ceb80 0x7f38e815e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e8151070 con 0x7f38e80b3c20 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80b7180 con 0x7f38e80ceb80 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38e80cc5b0 con 0x7f38e80b7980 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55102/0 (socket says 172.21.15.37:55102) 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 -- 172.21.15.37:0/2491720911 learned_addr learned my addr 172.21.15.37:0/2491720911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38dffff640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e81505a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e6d9d640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e80ceb80 0x7f38e815e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 -- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 msgr2=0x7f38e81505a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e81505a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 -- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e80ceb80 msgr2=0x7f38e815e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e80ceb80 0x7f38e815e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 -- 172.21.15.37:0/2491720911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00094d0 con 0x7f38e80b3c20 2023-07-09T21:43:07.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38e659c640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f38d800d800 tx=0x7f38d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800b6c0 con 0x7f38e80b3c20 2023-07-09T21:43:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d800b820 con 0x7f38e80b3c20 2023-07-09T21:43:07.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800bb90 con 0x7f38e80b3c20 2023-07-09T21:43:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38e80b6bc0 con 0x7f38e80b3c20 2023-07-09T21:43:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.331+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38e80cc1f0 con 0x7f38e80b3c20 2023-07-09T21:43:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38e804d7d0 con 0x7f38e80b3c20 2023-07-09T21:43:07.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f38d800bcf0 con 0x7f38e80b3c20 2023-07-09T21:43:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38deffd640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 0x7f38c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:07.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f38d8084220 con 0x7f38e80b3c20 2023-07-09T21:43:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38dffff640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 0x7f38c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:07.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.335+0000 7f38dffff640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 0x7f38c8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ad000 tx=0x7f38d00a6000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:07.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.339+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38d80550a0 con 0x7f38e80b3c20 2023-07-09T21:43:07.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:07.523+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f38e80b1600 con 0x7f38e80b3c20 2023-07-09T21:43:08.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.147+0000 7f38deffd640 1 -- 172.21.15.37:0/2491720911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v69) v1 ==== 122+0+0 (secure 0 0 0) 0x7f38d8054c30 con 0x7f38e80b3c20 2023-07-09T21:43:08.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 msgr2=0x7f38c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 0x7f38c8068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f38d00ad000 tx=0x7f38d00a6000 comp rx=0 tx=0).stop 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 msgr2=0x7f38e81598f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f38d800d800 tx=0x7f38d800dcc0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 shutdown_connections 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f38c80663a0 0x7f38c8068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38e80ceb80 0x7f38e815e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38e80b7980 0x7f38e81505a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 --2- 172.21.15.37:0/2491720911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38e80b3c20 0x7f38e81598f0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 >> 172.21.15.37:0/2491720911 conn(0x7f38e8073090 msgr2=0x7f38e815f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 shutdown_connections 2023-07-09T21:43:08.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.151+0000 7f38ecb11640 1 -- 172.21.15.37:0/2491720911 wait complete. 2023-07-09T21:43:08.176 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:43:08.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:43:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 Processor -- start 2023-07-09T21:43:08.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 -- start start 2023-07-09T21:43:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa5006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa500cef80 0x7faa500d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa500b49f0 con 0x7faa500b7ab0 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa500b7e80 con 0x7faa500cef80 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa5587b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa500cc8a0 con 0x7faa500b4340 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa4f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa500cef80 0x7faa500d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa4f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7faa500cef80 0x7faa500d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55110/0 (socket says 172.21.15.37:55110) 2023-07-09T21:43:08.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.323+0000 7faa4f7fe640 1 -- 172.21.15.37:0/2307089455 learned_addr learned my addr 172.21.15.37:0/2307089455 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa47fff640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa5006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4f7fe640 1 -- 172.21.15.37:0/2307089455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 msgr2=0x7faa5006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4f7fe640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa5006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4f7fe640 1 -- 172.21.15.37:0/2307089455 >> v1:172.21.15.119:6789/0 conn(0x7faa500b7ab0 legacy=0x7faa500b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4f7fe640 1 -- 172.21.15.37:0/2307089455 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa500ccb80 con 0x7faa500cef80 2023-07-09T21:43:08.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4f7fe640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa500d02a0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7faa48009e50 tx=0x7faa4801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac05fbc6c9ae825 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4e7fc640 1 -- 172.21.15.37:0/2307089455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a58a0 con 0x7faa500cef80 2023-07-09T21:43:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4e7fc640 1 -- 172.21.15.37:0/2307089455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480a5a00 con 0x7faa500cef80 2023-07-09T21:43:08.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa4e7fc640 1 -- 172.21.15.37:0/2307089455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480a5d90 con 0x7faa500cef80 2023-07-09T21:43:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa5587b640 1 -- 172.21.15.37:0/2307089455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 msgr2=0x7faa500d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.327+0000 7faa5587b640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa500d02a0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7faa48009e50 tx=0x7faa4801c9e0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- 172.21.15.37:0/2307089455 shutdown_connections 2023-07-09T21:43:08.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa5006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 --2- 172.21.15.37:0/2307089455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa500d02a0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- 172.21.15.37:0/2307089455 >> 172.21.15.37:0/2307089455 conn(0x7faa50073090 msgr2=0x7faa50069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- 172.21.15.37:0/2307089455 shutdown_connections 2023-07-09T21:43:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- 172.21.15.37:0/2307089455 wait complete. 2023-07-09T21:43:08.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 Processor -- start 2023-07-09T21:43:08.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- start start 2023-07-09T21:43:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa501571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa500b7ab0 0x7faa501485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501f82d0 con 0x7faa500cef80 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501564c0 con 0x7faa500b7ab0 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa5587b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa501f7970 con 0x7faa500b4340 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55126/0 (socket says 172.21.15.37:55126) 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 -- 172.21.15.37:0/858057374 learned_addr learned my addr 172.21.15.37:0/858057374 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:08.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4effd640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa501571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa47fff640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa500b7ab0 0x7faa501485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 -- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 msgr2=0x7faa501571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa501571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 -- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa500b7ab0 msgr2=0x7faa501485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa500b7ab0 0x7faa501485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 -- 172.21.15.37:0/858057374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa48009b30 con 0x7faa500cef80 2023-07-09T21:43:08.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.331+0000 7faa4f7fe640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7faa480af040 tx=0x7faa48019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b8640 con 0x7faa500cef80 2023-07-09T21:43:08.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa480b87a0 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501f7c10 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa480b8b10 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501f86f0 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa501f8410 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7faa480b8c70 con 0x7faa500cef80 2023-07-09T21:43:08.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 0x7faa30068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7faa4811f270 con 0x7faa500cef80 2023-07-09T21:43:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.335+0000 7faa4effd640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 0x7faa30068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.339+0000 7faa4effd640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 0x7faa30068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa40007fd0 tx=0x7faa40009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.339+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faa501f8410 con 0x7faa500cef80 2023-07-09T21:43:08.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.527+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa501f8410 con 0x7faa500cef80 2023-07-09T21:43:08.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.527+0000 7faa4cff9640 1 -- 172.21.15.37:0/858057374 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7faa501f8410 con 0x7faa500cef80 2023-07-09T21:43:08.529 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:08.529 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:43:08.530 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:43:08.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 msgr2=0x7faa30068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 0x7faa30068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faa40007fd0 tx=0x7faa40009040 comp rx=0 tx=0).stop 2023-07-09T21:43:08.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 msgr2=0x7faa50147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7faa480af040 tx=0x7faa48019780 comp rx=0 tx=0).stop 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 shutdown_connections 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7faa300663a0 0x7faa30068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa500cef80 0x7faa50147d00 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7faa500b7ab0 0x7faa501485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 --2- 172.21.15.37:0/858057374 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7faa500b4340 0x7faa501571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 >> 172.21.15.37:0/858057374 conn(0x7faa50073090 msgr2=0x7faa50069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:08.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 shutdown_connections 2023-07-09T21:43:08.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.531+0000 7faa5587b640 1 -- 172.21.15.37:0/858057374 wait complete. 2023-07-09T21:43:08.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:43:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 Processor -- start 2023-07-09T21:43:08.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 -- start start 2023-07-09T21:43:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc09015ba20 0x7fc0900cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0900b2140 0x7fc0900ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc09015bdf0 con 0x7fc09006c330 2023-07-09T21:43:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc09006b650 con 0x7fc0900b2140 2023-07-09T21:43:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.691+0000 7fc09711f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0900b2720 con 0x7fc09015ba20 2023-07-09T21:43:08.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0900b2140 0x7fc0900ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0900b2140 0x7fc0900ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55128/0 (socket says 172.21.15.37:55128) 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 -- 172.21.15.37:0/4190313275 learned_addr learned my addr 172.21.15.37:0/4190313275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc08ffff640 1 --1- 172.21.15.37:0/4190313275 >> v1:172.21.15.37:6789/0 conn(0x7fc09006c330 0x7fc0900b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33662/0 (socket says 172.21.15.37:33662) 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc094ebb640 1 --2- 172.21.15.37:0/4190313275 >> v2:172.21.15.119:3300/0 conn(0x7fc09015ba20 0x7fc0900cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 -- 172.21.15.37:0/4190313275 >> v2:172.21.15.119:3300/0 conn(0x7fc09015ba20 msgr2=0x7fc0900cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:08.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 --2- 172.21.15.37:0/4190313275 >> v2:172.21.15.119:3300/0 conn(0x7fc09015ba20 0x7fc0900cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 -- 172.21.15.37:0/4190313275 >> v1:172.21.15.37:6789/0 conn(0x7fc09006c330 legacy=0x7fc0900b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 -- 172.21.15.37:0/4190313275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09006b850 con 0x7fc0900b2140 2023-07-09T21:43:08.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc0956bc640 1 --2- 172.21.15.37:0/4190313275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc0900ccf00 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc09006d0b0 tx=0x7fc08801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=284b9fd7d8a8276c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc08f7fe640 1 -- 172.21.15.37:0/4190313275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880a5760 con 0x7fc0900b2140 2023-07-09T21:43:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc08f7fe640 1 -- 172.21.15.37:0/4190313275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880a58c0 con 0x7fc0900b2140 2023-07-09T21:43:08.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.695+0000 7fc08f7fe640 1 -- 172.21.15.37:0/4190313275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880a5c50 con 0x7fc0900b2140 2023-07-09T21:43:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- 172.21.15.37:0/4190313275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 msgr2=0x7fc0900ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- 172.21.15.37:0/4190313275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc0900ccf00 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc09006d0b0 tx=0x7fc08801c9a0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- 172.21.15.37:0/4190313275 shutdown_connections 2023-07-09T21:43:08.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- 172.21.15.37:0/4190313275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc0900ccf00 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- 172.21.15.37:0/4190313275 >> v2:172.21.15.119:3300/0 conn(0x7fc09015ba20 0x7fc0900cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- 172.21.15.37:0/4190313275 >> 172.21.15.37:0/4190313275 conn(0x7fc090072400 msgr2=0x7fc090072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- 172.21.15.37:0/4190313275 shutdown_connections 2023-07-09T21:43:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- 172.21.15.37:0/4190313275 wait complete. 2023-07-09T21:43:08.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 Processor -- start 2023-07-09T21:43:08.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- start start 2023-07-09T21:43:08.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09006c330 0x7fc0900c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc09015ba20 0x7fc0901514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c5ca0 con 0x7fc0900b2140 2023-07-09T21:43:08.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c5400 con 0x7fc09006c330 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc09711f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0900c56e0 con 0x7fc09015ba20 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55134/0 (socket says 172.21.15.37:55134) 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 -- 172.21.15.37:0/2121035036 learned_addr learned my addr 172.21.15.37:0/2121035036 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc094ebb640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09006c330 0x7fc0900c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc0956bc640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc09015ba20 0x7fc0901514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 -- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc09015ba20 msgr2=0x7fc0901514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc09015ba20 0x7fc0901514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 -- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09006c330 msgr2=0x7fc0900c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09006c330 0x7fc0900c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.699+0000 7fc08ffff640 1 -- 172.21.15.37:0/2121035036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009b30 con 0x7fc0900b2140 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08ffff640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c490 tx=0x7fc07c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c007480 con 0x7fc0900b2140 2023-07-09T21:43:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07c0075e0 con 0x7fc0900b2140 2023-07-09T21:43:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0900c59c0 con 0x7fc0900b2140 2023-07-09T21:43:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07c004a10 con 0x7fc0900b2140 2023-07-09T21:43:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09015e780 con 0x7fc0900b2140 2023-07-09T21:43:08.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc09004d7d0 con 0x7fc0900b2140 2023-07-09T21:43:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc07c004b70 con 0x7fc0900b2140 2023-07-09T21:43:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 0x7fc074068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fc07c0832e0 con 0x7fc0900b2140 2023-07-09T21:43:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.703+0000 7fc094ebb640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 0x7fc074068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:08.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.707+0000 7fc094ebb640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 0x7fc074068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc084009ac0 tx=0x7fc084009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:08.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.707+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc07c050640 con 0x7fc0900b2140 2023-07-09T21:43:08.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.863+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0900c72f0 con 0x7fc0900b2140 2023-07-09T21:43:08.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc08d7fa640 1 -- 172.21.15.37:0/2121035036 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v158) v1 ==== 74+0+18341 (secure 0 0 0) 0x7fc07c053c60 con 0x7fc0900b2140 2023-07-09T21:43:08.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:08.868 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":158,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:43:06.128420+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"158","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:43:08.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 msgr2=0x7fc074068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 0x7fc074068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc084009ac0 tx=0x7fc084009190 comp rx=0 tx=0).stop 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 msgr2=0x7fc090150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fc07c00c490 tx=0x7fc07c00c950 comp rx=0 tx=0).stop 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 shutdown_connections 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fc0740663a0 0x7fc074068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc09015ba20 0x7fc0901514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0900b2140 0x7fc090150fb0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 --2- 172.21.15.37:0/2121035036 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc09006c330 0x7fc0900c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:08.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 >> 172.21.15.37:0/2121035036 conn(0x7fc090072400 msgr2=0x7fc0900ca650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:08.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 shutdown_connections 2023-07-09T21:43:08.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:08.867+0000 7fc09711f640 1 -- 172.21.15.37:0/2121035036 wait complete. 2023-07-09T21:43:08.890 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:43:08.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:43:09.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.031+0000 7fd71acd8640 1 Processor -- start 2023-07-09T21:43:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.031+0000 7fd71acd8640 1 -- start start 2023-07-09T21:43:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.031+0000 7fd71acd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 0x7fd71406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd71acd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140b49f0 con 0x7fd7140cef80 2023-07-09T21:43:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd71acd8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7140cc8a0 con 0x7fd7140b7ab0 2023-07-09T21:43:09.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd71acd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140b7e80 con 0x7fd7140b4340 2023-07-09T21:43:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd719275640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7140cef80 0x7fd7140d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33674/0 (socket says 172.21.15.37:33674) 2023-07-09T21:43:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd719275640 1 -- 172.21.15.37:0/4247546803 learned_addr learned my addr 172.21.15.37:0/4247546803 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd713fff640 1 --2- 172.21.15.37:0/4247546803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 0x7fd71406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1962635030 0 0) 0x7fd7140b49f0 con 0x7fd7140cef80 2023-07-09T21:43:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003530 con 0x7fd7140cef80 2023-07-09T21:43:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529097353 0 0) 0x7fd7140cc8a0 con 0x7fd7140b7ab0 2023-07-09T21:43:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7140b49f0 con 0x7fd7140b7ab0 2023-07-09T21:43:09.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd713fff640 1 -- 172.21.15.37:0/4247546803 >> v1:172.21.15.119:6789/0 conn(0x7fd7140b7ab0 legacy=0x7fd7140b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504104582 0 0) 0x7fd704003530 con 0x7fd7140cef80 2023-07-09T21:43:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd713fff640 1 -- 172.21.15.37:0/4247546803 >> v1:172.21.15.37:6789/0 conn(0x7fd7140cef80 legacy=0x7fd7140d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.035+0000 7fd713fff640 1 -- 172.21.15.37:0/4247546803 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7140ccb80 con 0x7fd7140b4340 2023-07-09T21:43:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd713fff640 1 --2- 172.21.15.37:0/4247546803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 0x7fd71406aa50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd7000097f0 tx=0x7fd70001c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cb0cd0d440a9414 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c001a00 con 0x7fd7140b4340 2023-07-09T21:43:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7000a7050 con 0x7fd7140b4340 2023-07-09T21:43:09.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd7137fe640 1 -- 172.21.15.37:0/4247546803 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000ab620 con 0x7fd7140b4340 2023-07-09T21:43:09.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- 172.21.15.37:0/4247546803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 msgr2=0x7fd71406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 --2- 172.21.15.37:0/4247546803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 0x7fd71406aa50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd7000097f0 tx=0x7fd70001c3b0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- 172.21.15.37:0/4247546803 shutdown_connections 2023-07-09T21:43:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 --2- 172.21.15.37:0/4247546803 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b4340 0x7fd71406aa50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- 172.21.15.37:0/4247546803 >> 172.21.15.37:0/4247546803 conn(0x7fd714073090 msgr2=0x7fd714069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- 172.21.15.37:0/4247546803 shutdown_connections 2023-07-09T21:43:09.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- 172.21.15.37:0/4247546803 wait complete. 2023-07-09T21:43:09.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 Processor -- start 2023-07-09T21:43:09.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.039+0000 7fd71acd8640 1 -- start start 2023-07-09T21:43:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 0x7fd7141f7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7140cef80 0x7fd7141f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7141472a0 con 0x7fd7140b4340 2023-07-09T21:43:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140cad00 con 0x7fd7140cef80 2023-07-09T21:43:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7140cafe0 con 0x7fd7140b7ab0 2023-07-09T21:43:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55144/0 (socket says 172.21.15.37:55144) 2023-07-09T21:43:09.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 -- 172.21.15.37:0/2759985701 learned_addr learned my addr 172.21.15.37:0/2759985701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:09.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd713fff640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 0x7fd7141f7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd719275640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7140cef80 0x7fd7141f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 -- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 msgr2=0x7fd7141f7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 0x7fd7141f7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 -- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7140cef80 msgr2=0x7fd7141f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7140cef80 0x7fd7141f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 -- 172.21.15.37:0/2759985701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700009420 con 0x7fd7140b4340 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd713fff640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 0x7fd7141f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd718a74640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c490 tx=0x7fd70800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080052d0 con 0x7fd7140b4340 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd708005430 con 0x7fd7140b4340 2023-07-09T21:43:09.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7140cb2c0 con 0x7fd7140b4340 2023-07-09T21:43:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd708012870 con 0x7fd7140b4340 2023-07-09T21:43:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7140cb880 con 0x7fd7140b4340 2023-07-09T21:43:09.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71404d7d0 con 0x7fd7140b4340 2023-07-09T21:43:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.043+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7080129d0 con 0x7fd7140b4340 2023-07-09T21:43:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.047+0000 7fd7117fa640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 0x7fd6f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.047+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fd708083af0 con 0x7fd7140b4340 2023-07-09T21:43:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.047+0000 7fd713fff640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 0x7fd6f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.047+0000 7fd713fff640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 0x7fd6f8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7000ad000 tx=0x7fd700008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.047+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd708050da0 con 0x7fd7140b4340 2023-07-09T21:43:09.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.207+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7140cf4d0 con 0x7fd6f80663a0 2023-07-09T21:43:09.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.215+0000 7fd7117fa640 1 -- 172.21.15.37:0/2759985701 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306284 (secure 0 0 0) 0x7fd7000ab5e0 con 0x7fd6f80663a0 2023-07-09T21:43:09.220 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:09.221 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:43:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 msgr2=0x7fd6f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 0x7fd6f8068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd7000ad000 tx=0x7fd700008040 comp rx=0 tx=0).stop 2023-07-09T21:43:09.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 msgr2=0x7fd714146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fd70800c490 tx=0x7fd70800c950 comp rx=0 tx=0).stop 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 shutdown_connections 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fd6f80663a0 0x7fd6f8068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7140cef80 0x7fd7141f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7140b7ab0 0x7fd7141f7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 --2- 172.21.15.37:0/2759985701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7140b4340 0x7fd714146b70 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 >> 172.21.15.37:0/2759985701 conn(0x7fd714073090 msgr2=0x7fd714069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 shutdown_connections 2023-07-09T21:43:09.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.219+0000 7fd71acd8640 1 -- 172.21.15.37:0/2759985701 wait complete. 2023-07-09T21:43:09.241 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:43:08.769356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347480,"kb_used_data":16280,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754627240,"statfs":{"total":773094113280,"available":772738293760,"internally_reserved":0,"allocated":16670720,"data_stored":9067456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.681948"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.102346+0000","last_change":"2023-07-09T21:43:04.102346+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.102346+0000","last_undegraded":"2023-07-09T21:43:04.102346+0000","last_fullsized":"2023-07-09T21:43:04.102346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106932+0000","last_change":"2023-07-09T21:43:04.106932+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106932+0000","last_undegraded":"2023-07-09T21:43:04.106932+0000","last_fullsized":"2023-07-09T21:43:04.106932+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094340+0000","last_change":"2023-07-09T21:43:04.094340+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094340+0000","last_undegraded":"2023-07-09T21:43:04.094340+0000","last_fullsized":"2023-07-09T21:43:04.094340+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093239+0000","last_change":"2023-07-09T21:43:04.093239+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093239+0000","last_undegraded":"2023-07-09T21:43:04.093239+0000","last_fullsized":"2023-07-09T21:43:04.093239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095531+0000","last_change":"2023-07-09T21:43:04.095531+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095531+0000","last_undegraded":"2023-07-09T21:43:04.095531+0000","last_fullsized":"2023-07-09T21:43:04.095531+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096766+0000","last_change":"2023-07-09T21:43:04.096766+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096766+0000","last_undegraded":"2023-07-09T21:43:04.096766+0000","last_fullsized":"2023-07-09T21:43:04.096766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100114+0000","last_change":"2023-07-09T21:43:04.100114+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100114+0000","last_undegraded":"2023-07-09T21:43:04.100114+0000","last_fullsized":"2023-07-09T21:43:04.100114+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096895+0000","last_change":"2023-07-09T21:43:04.096895+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096895+0000","last_undegraded":"2023-07-09T21:43:04.096895+0000","last_fullsized":"2023-07-09T21:43:04.096895+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096892+0000","last_change":"2023-07-09T21:43:04.096892+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096892+0000","last_undegraded":"2023-07-09T21:43:04.096892+0000","last_fullsized":"2023-07-09T21:43:04.096892+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095050+0000","last_change":"2023-07-09T21:43:04.095050+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095050+0000","last_undegraded":"2023-07-09T21:43:04.095050+0000","last_fullsized":"2023-07-09T21:43:04.095050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.103102+0000","last_change":"2023-07-09T21:43:04.103102+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.103102+0000","last_undegraded":"2023-07-09T21:43:04.103102+0000","last_fullsized":"2023-07-09T21:43:04.103102+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094245+0000","last_change":"2023-07-09T21:43:04.094245+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094245+0000","last_undegraded":"2023-07-09T21:43:04.094245+0000","last_fullsized":"2023-07-09T21:43:04.094245+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101782+0000","last_change":"2023-07-09T21:43:04.101782+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101782+0000","last_undegraded":"2023-07-09T21:43:04.101782+0000","last_fullsized":"2023-07-09T21:43:04.101782+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094077+0000","last_change":"2023-07-09T21:43:04.094077+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094077+0000","last_undegraded":"2023-07-09T21:43:04.094077+0000","last_fullsized":"2023-07-09T21:43:04.094077+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095881+0000","last_change":"2023-07-09T21:43:04.095881+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095881+0000","last_undegraded":"2023-07-09T21:43:04.095881+0000","last_fullsized":"2023-07-09T21:43:04.095881+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093125+0000","last_change":"2023-07-09T21:43:04.093125+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093125+0000","last_undegraded":"2023-07-09T21:43:04.093125+0000","last_fullsized":"2023-07-09T21:43:04.093125+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095200+0000","last_change":"2023-07-09T21:43:04.095200+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095200+0000","last_undegraded":"2023-07-09T21:43:04.095200+0000","last_fullsized":"2023-07-09T21:43:04.095200+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098174+0000","last_change":"2023-07-09T21:43:04.098174+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098174+0000","last_undegraded":"2023-07-09T21:43:04.098174+0000","last_fullsized":"2023-07-09T21:43:04.098174+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094451+0000","last_change":"2023-07-09T21:43:04.094451+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094451+0000","last_undegraded":"2023-07-09T21:43:04.094451+0000","last_fullsized":"2023-07-09T21:43:04.094451+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094248+0000","last_change":"2023-07-09T21:43:04.094248+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094248+0000","last_undegraded":"2023-07-09T21:43:04.094248+0000","last_fullsized":"2023-07-09T21:43:04.094248+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101258+0000","last_change":"2023-07-09T21:43:04.101258+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101258+0000","last_undegraded":"2023-07-09T21:43:04.101258+0000","last_fullsized":"2023-07-09T21:43:04.101258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094276+0000","last_change":"2023-07-09T21:43:04.094276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094276+0000","last_undegraded":"2023-07-09T21:43:04.094276+0000","last_fullsized":"2023-07-09T21:43:04.094276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095344+0000","last_change":"2023-07-09T21:43:04.095344+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095344+0000","last_undegraded":"2023-07-09T21:43:04.095344+0000","last_fullsized":"2023-07-09T21:43:04.095344+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106434+0000","last_change":"2023-07-09T21:43:04.106434+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106434+0000","last_undegraded":"2023-07-09T21:43:04.106434+0000","last_fullsized":"2023-07-09T21:43:04.106434+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106362+0000","last_change":"2023-07-09T21:43:04.106362+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106362+0000","last_undegraded":"2023-07-09T21:43:04.106362+0000","last_fullsized":"2023-07-09T21:43:04.106362+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097667+0000","last_change":"2023-07-09T21:43:04.097667+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097667+0000","last_undegraded":"2023-07-09T21:43:04.097667+0000","last_fullsized":"2023-07-09T21:43:04.097667+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098581+0000","last_change":"2023-07-09T21:43:04.098581+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098581+0000","last_undegraded":"2023-07-09T21:43:04.098581+0000","last_fullsized":"2023-07-09T21:43:04.098581+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106428+0000","last_change":"2023-07-09T21:43:04.106428+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106428+0000","last_undegraded":"2023-07-09T21:43:04.106428+0000","last_fullsized":"2023-07-09T21:43:04.106428+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106342+0000","last_change":"2023-07-09T21:43:04.106342+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106342+0000","last_undegraded":"2023-07-09T21:43:04.106342+0000","last_fullsized":"2023-07-09T21:43:04.106342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099430+0000","last_change":"2023-07-09T21:43:04.099430+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099430+0000","last_undegraded":"2023-07-09T21:43:04.099430+0000","last_fullsized":"2023-07-09T21:43:04.099430+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097353+0000","last_change":"2023-07-09T21:43:04.097353+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097353+0000","last_undegraded":"2023-07-09T21:43:04.097353+0000","last_fullsized":"2023-07-09T21:43:04.097353+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099391+0000","last_change":"2023-07-09T21:43:04.099391+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099391+0000","last_undegraded":"2023-07-09T21:43:04.099391+0000","last_fullsized":"2023-07-09T21:43:04.099391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121976+0000","last_change":"2023-07-09T21:43:04.120316+0000","last_active":"2023-07-09T21:43:04.121976+0000","last_peered":"2023-07-09T21:43:04.121976+0000","last_clean":"2023-07-09T21:43:04.121976+0000","last_became_active":"2023-07-09T21:43:04.120005+0000","last_became_peered":"2023-07-09T21:43:04.120005+0000","last_unstale":"2023-07-09T21:43:04.121976+0000","last_undegraded":"2023-07-09T21:43:04.121976+0000","last_fullsized":"2023-07-09T21:43:04.121976+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:45.770224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093609+0000","last_change":"2023-07-09T21:43:04.093609+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093609+0000","last_undegraded":"2023-07-09T21:43:04.093609+0000","last_fullsized":"2023-07-09T21:43:04.093609+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106011+0000","last_change":"2023-07-09T21:43:04.097685+0000","last_active":"2023-07-09T21:43:04.106011+0000","last_peered":"2023-07-09T21:43:04.106011+0000","last_clean":"2023-07-09T21:43:04.106011+0000","last_became_active":"2023-07-09T21:43:04.097353+0000","last_became_peered":"2023-07-09T21:43:04.097353+0000","last_unstale":"2023-07-09T21:43:04.106011+0000","last_undegraded":"2023-07-09T21:43:04.106011+0000","last_fullsized":"2023-07-09T21:43:04.106011+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:36.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094504+0000","last_change":"2023-07-09T21:43:04.094504+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094504+0000","last_undegraded":"2023-07-09T21:43:04.094504+0000","last_fullsized":"2023-07-09T21:43:04.094504+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112995+0000","last_change":"2023-07-09T21:43:04.109765+0000","last_active":"2023-07-09T21:43:04.112995+0000","last_peered":"2023-07-09T21:43:04.112995+0000","last_clean":"2023-07-09T21:43:04.112995+0000","last_became_active":"2023-07-09T21:43:04.109464+0000","last_became_peered":"2023-07-09T21:43:04.109464+0000","last_unstale":"2023-07-09T21:43:04.112995+0000","last_undegraded":"2023-07-09T21:43:04.112995+0000","last_fullsized":"2023-07-09T21:43:04.112995+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:31.670684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100725+0000","last_change":"2023-07-09T21:43:04.100725+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100725+0000","last_undegraded":"2023-07-09T21:43:04.100725+0000","last_fullsized":"2023-07-09T21:43:04.100725+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112872+0000","last_change":"2023-07-09T21:43:04.108354+0000","last_active":"2023-07-09T21:43:04.112872+0000","last_peered":"2023-07-09T21:43:04.112872+0000","last_clean":"2023-07-09T21:43:04.112872+0000","last_became_active":"2023-07-09T21:43:04.108047+0000","last_became_peered":"2023-07-09T21:43:04.108047+0000","last_unstale":"2023-07-09T21:43:04.112872+0000","last_undegraded":"2023-07-09T21:43:04.112872+0000","last_fullsized":"2023-07-09T21:43:04.112872+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:27:34.241976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101065+0000","last_change":"2023-07-09T21:43:04.101065+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101065+0000","last_undegraded":"2023-07-09T21:43:04.101065+0000","last_fullsized":"2023-07-09T21:43:04.101065+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109468+0000","last_change":"2023-07-09T21:43:04.107762+0000","last_active":"2023-07-09T21:43:04.109468+0000","last_peered":"2023-07-09T21:43:04.109468+0000","last_clean":"2023-07-09T21:43:04.109468+0000","last_became_active":"2023-07-09T21:43:04.107396+0000","last_became_peered":"2023-07-09T21:43:04.107396+0000","last_unstale":"2023-07-09T21:43:04.109468+0000","last_undegraded":"2023-07-09T21:43:04.109468+0000","last_fullsized":"2023-07-09T21:43:04.109468+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:28.519104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100922+0000","last_change":"2023-07-09T21:43:04.100922+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100922+0000","last_undegraded":"2023-07-09T21:43:04.100922+0000","last_fullsized":"2023-07-09T21:43:04.100922+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109077+0000","last_change":"2023-07-09T21:43:04.102572+0000","last_active":"2023-07-09T21:43:04.109077+0000","last_peered":"2023-07-09T21:43:04.109077+0000","last_clean":"2023-07-09T21:43:04.109077+0000","last_became_active":"2023-07-09T21:43:04.102251+0000","last_became_peered":"2023-07-09T21:43:04.102251+0000","last_unstale":"2023-07-09T21:43:04.109077+0000","last_undegraded":"2023-07-09T21:43:04.109077+0000","last_fullsized":"2023-07-09T21:43:04.109077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:53:49.917585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112221+0000","last_change":"2023-07-09T21:43:04.109982+0000","last_active":"2023-07-09T21:43:04.112221+0000","last_peered":"2023-07-09T21:43:04.112221+0000","last_clean":"2023-07-09T21:43:04.112221+0000","last_became_active":"2023-07-09T21:43:04.109679+0000","last_became_peered":"2023-07-09T21:43:04.109679+0000","last_unstale":"2023-07-09T21:43:04.112221+0000","last_undegraded":"2023-07-09T21:43:04.112221+0000","last_fullsized":"2023-07-09T21:43:04.112221+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:02.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098246+0000","last_change":"2023-07-09T21:43:04.098246+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098246+0000","last_undegraded":"2023-07-09T21:43:04.098246+0000","last_fullsized":"2023-07-09T21:43:04.098246+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116883+0000","last_change":"2023-07-09T21:43:04.114995+0000","last_active":"2023-07-09T21:43:04.116883+0000","last_peered":"2023-07-09T21:43:04.116883+0000","last_clean":"2023-07-09T21:43:04.116883+0000","last_became_active":"2023-07-09T21:43:04.114707+0000","last_became_peered":"2023-07-09T21:43:04.114707+0000","last_unstale":"2023-07-09T21:43:04.116883+0000","last_undegraded":"2023-07-09T21:43:04.116883+0000","last_fullsized":"2023-07-09T21:43:04.116883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:48.063937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104416+0000","last_change":"2023-07-09T21:43:04.104416+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104416+0000","last_undegraded":"2023-07-09T21:43:04.104416+0000","last_fullsized":"2023-07-09T21:43:04.104416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114480+0000","last_change":"2023-07-09T21:43:04.111388+0000","last_active":"2023-07-09T21:43:04.114480+0000","last_peered":"2023-07-09T21:43:04.114480+0000","last_clean":"2023-07-09T21:43:04.114480+0000","last_became_active":"2023-07-09T21:43:04.110970+0000","last_became_peered":"2023-07-09T21:43:04.110970+0000","last_unstale":"2023-07-09T21:43:04.114480+0000","last_undegraded":"2023-07-09T21:43:04.114480+0000","last_fullsized":"2023-07-09T21:43:04.114480+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:52:18.361142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096276+0000","last_change":"2023-07-09T21:43:04.096276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096276+0000","last_undegraded":"2023-07-09T21:43:04.096276+0000","last_fullsized":"2023-07-09T21:43:04.096276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121900+0000","last_change":"2023-07-09T21:43:04.119311+0000","last_active":"2023-07-09T21:43:04.121900+0000","last_peered":"2023-07-09T21:43:04.121900+0000","last_clean":"2023-07-09T21:43:04.121900+0000","last_became_active":"2023-07-09T21:43:04.119040+0000","last_became_peered":"2023-07-09T21:43:04.119040+0000","last_unstale":"2023-07-09T21:43:04.121900+0000","last_undegraded":"2023-07-09T21:43:04.121900+0000","last_fullsized":"2023-07-09T21:43:04.121900+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099578+0000","last_change":"2023-07-09T21:43:04.099578+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099578+0000","last_undegraded":"2023-07-09T21:43:04.099578+0000","last_fullsized":"2023-07-09T21:43:04.099578+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.111985+0000","last_change":"2023-07-09T21:43:04.110053+0000","last_active":"2023-07-09T21:43:04.111985+0000","last_peered":"2023-07-09T21:43:04.111985+0000","last_clean":"2023-07-09T21:43:04.111985+0000","last_became_active":"2023-07-09T21:43:04.109787+0000","last_became_peered":"2023-07-09T21:43:04.109787+0000","last_unstale":"2023-07-09T21:43:04.111985+0000","last_undegraded":"2023-07-09T21:43:04.111985+0000","last_fullsized":"2023-07-09T21:43:04.111985+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:18.871391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098655+0000","last_change":"2023-07-09T21:43:04.098655+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098655+0000","last_undegraded":"2023-07-09T21:43:04.098655+0000","last_fullsized":"2023-07-09T21:43:04.098655+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113961+0000","last_change":"2023-07-09T21:43:04.111581+0000","last_active":"2023-07-09T21:43:04.113961+0000","last_peered":"2023-07-09T21:43:04.113961+0000","last_clean":"2023-07-09T21:43:04.113961+0000","last_became_active":"2023-07-09T21:43:04.111287+0000","last_became_peered":"2023-07-09T21:43:04.111287+0000","last_unstale":"2023-07-09T21:43:04.113961+0000","last_undegraded":"2023-07-09T21:43:04.113961+0000","last_fullsized":"2023-07-09T21:43:04.113961+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:00.043513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093872+0000","last_change":"2023-07-09T21:43:04.093872+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093872+0000","last_undegraded":"2023-07-09T21:43:04.093872+0000","last_fullsized":"2023-07-09T21:43:04.093872+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113839+0000","last_change":"2023-07-09T21:43:04.111715+0000","last_active":"2023-07-09T21:43:04.113839+0000","last_peered":"2023-07-09T21:43:04.113839+0000","last_clean":"2023-07-09T21:43:04.113839+0000","last_became_active":"2023-07-09T21:43:04.111369+0000","last_became_peered":"2023-07-09T21:43:04.111369+0000","last_unstale":"2023-07-09T21:43:04.113839+0000","last_undegraded":"2023-07-09T21:43:04.113839+0000","last_fullsized":"2023-07-09T21:43:04.113839+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:39.794983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093112+0000","last_change":"2023-07-09T21:43:04.093112+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093112+0000","last_undegraded":"2023-07-09T21:43:04.093112+0000","last_fullsized":"2023-07-09T21:43:04.093112+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115317+0000","last_change":"2023-07-09T21:43:04.110623+0000","last_active":"2023-07-09T21:43:04.115317+0000","last_peered":"2023-07-09T21:43:04.115317+0000","last_clean":"2023-07-09T21:43:04.115317+0000","last_became_active":"2023-07-09T21:43:04.110329+0000","last_became_peered":"2023-07-09T21:43:04.110329+0000","last_unstale":"2023-07-09T21:43:04.115317+0000","last_undegraded":"2023-07-09T21:43:04.115317+0000","last_fullsized":"2023-07-09T21:43:04.115317+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:01.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094161+0000","last_change":"2023-07-09T21:43:04.094161+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094161+0000","last_undegraded":"2023-07-09T21:43:04.094161+0000","last_fullsized":"2023-07-09T21:43:04.094161+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.118058+0000","last_change":"2023-07-09T21:43:04.116122+0000","last_active":"2023-07-09T21:43:04.118058+0000","last_peered":"2023-07-09T21:43:04.118058+0000","last_clean":"2023-07-09T21:43:04.118058+0000","last_became_active":"2023-07-09T21:43:04.115798+0000","last_became_peered":"2023-07-09T21:43:04.115798+0000","last_unstale":"2023-07-09T21:43:04.118058+0000","last_undegraded":"2023-07-09T21:43:04.118058+0000","last_fullsized":"2023-07-09T21:43:04.118058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:45.214691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094755+0000","last_change":"2023-07-09T21:43:04.094755+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094755+0000","last_undegraded":"2023-07-09T21:43:04.094755+0000","last_fullsized":"2023-07-09T21:43:04.094755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106801+0000","last_change":"2023-07-09T21:43:04.104644+0000","last_active":"2023-07-09T21:43:04.106801+0000","last_peered":"2023-07-09T21:43:04.106801+0000","last_clean":"2023-07-09T21:43:04.106801+0000","last_became_active":"2023-07-09T21:43:04.104004+0000","last_became_peered":"2023-07-09T21:43:04.104004+0000","last_unstale":"2023-07-09T21:43:04.106801+0000","last_undegraded":"2023-07-09T21:43:04.106801+0000","last_fullsized":"2023-07-09T21:43:04.106801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:03.915441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094206+0000","last_change":"2023-07-09T21:43:04.094206+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094206+0000","last_undegraded":"2023-07-09T21:43:04.094206+0000","last_fullsized":"2023-07-09T21:43:04.094206+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115495+0000","last_change":"2023-07-09T21:43:04.112265+0000","last_active":"2023-07-09T21:43:04.115495+0000","last_peered":"2023-07-09T21:43:04.115495+0000","last_clean":"2023-07-09T21:43:04.115495+0000","last_became_active":"2023-07-09T21:43:04.111982+0000","last_became_peered":"2023-07-09T21:43:04.111982+0000","last_unstale":"2023-07-09T21:43:04.115495+0000","last_undegraded":"2023-07-09T21:43:04.115495+0000","last_fullsized":"2023-07-09T21:43:04.115495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:20:00.036775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104326+0000","last_change":"2023-07-09T21:43:04.104326+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104326+0000","last_undegraded":"2023-07-09T21:43:04.104326+0000","last_fullsized":"2023-07-09T21:43:04.104326+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113936+0000","last_change":"2023-07-09T21:43:04.110528+0000","last_active":"2023-07-09T21:43:04.113936+0000","last_peered":"2023-07-09T21:43:04.113936+0000","last_clean":"2023-07-09T21:43:04.113936+0000","last_became_active":"2023-07-09T21:43:04.110266+0000","last_became_peered":"2023-07-09T21:43:04.110266+0000","last_unstale":"2023-07-09T21:43:04.113936+0000","last_undegraded":"2023-07-09T21:43:04.113936+0000","last_fullsized":"2023-07-09T21:43:04.113936+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:48.759355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100046+0000","last_change":"2023-07-09T21:43:04.100046+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100046+0000","last_undegraded":"2023-07-09T21:43:04.100046+0000","last_fullsized":"2023-07-09T21:43:04.100046+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121539+0000","last_change":"2023-07-09T21:43:04.119204+0000","last_active":"2023-07-09T21:43:04.121539+0000","last_peered":"2023-07-09T21:43:04.121539+0000","last_clean":"2023-07-09T21:43:04.121539+0000","last_became_active":"2023-07-09T21:43:04.118925+0000","last_became_peered":"2023-07-09T21:43:04.118925+0000","last_unstale":"2023-07-09T21:43:04.121539+0000","last_undegraded":"2023-07-09T21:43:04.121539+0000","last_fullsized":"2023-07-09T21:43:04.121539+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097332+0000","last_change":"2023-07-09T21:43:04.097332+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097332+0000","last_undegraded":"2023-07-09T21:43:04.097332+0000","last_fullsized":"2023-07-09T21:43:04.097332+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109022+0000","last_change":"2023-07-09T21:43:04.105009+0000","last_active":"2023-07-09T21:43:04.109022+0000","last_peered":"2023-07-09T21:43:04.109022+0000","last_clean":"2023-07-09T21:43:04.109022+0000","last_became_active":"2023-07-09T21:43:04.104702+0000","last_became_peered":"2023-07-09T21:43:04.104702+0000","last_unstale":"2023-07-09T21:43:04.109022+0000","last_undegraded":"2023-07-09T21:43:04.109022+0000","last_fullsized":"2023-07-09T21:43:04.109022+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:14:57.433408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093307+0000","last_change":"2023-07-09T21:43:04.093307+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093307+0000","last_undegraded":"2023-07-09T21:43:04.093307+0000","last_fullsized":"2023-07-09T21:43:04.093307+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115388+0000","last_change":"2023-07-09T21:43:04.112867+0000","last_active":"2023-07-09T21:43:04.115388+0000","last_peered":"2023-07-09T21:43:04.115388+0000","last_clean":"2023-07-09T21:43:04.115388+0000","last_became_active":"2023-07-09T21:43:04.112599+0000","last_became_peered":"2023-07-09T21:43:04.112599+0000","last_unstale":"2023-07-09T21:43:04.115388+0000","last_undegraded":"2023-07-09T21:43:04.115388+0000","last_fullsized":"2023-07-09T21:43:04.115388+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:38.070958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094775+0000","last_change":"2023-07-09T21:43:04.094775+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094775+0000","last_undegraded":"2023-07-09T21:43:04.094775+0000","last_fullsized":"2023-07-09T21:43:04.094775+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112965+0000","last_change":"2023-07-09T21:43:04.110316+0000","last_active":"2023-07-09T21:43:04.112965+0000","last_peered":"2023-07-09T21:43:04.112965+0000","last_clean":"2023-07-09T21:43:04.112965+0000","last_became_active":"2023-07-09T21:43:04.110028+0000","last_became_peered":"2023-07-09T21:43:04.110028+0000","last_unstale":"2023-07-09T21:43:04.112965+0000","last_undegraded":"2023-07-09T21:43:04.112965+0000","last_fullsized":"2023-07-09T21:43:04.112965+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:00.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093433+0000","last_change":"2023-07-09T21:43:04.093433+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093433+0000","last_undegraded":"2023-07-09T21:43:04.093433+0000","last_fullsized":"2023-07-09T21:43:04.093433+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109031+0000","last_change":"2023-07-09T21:43:04.105115+0000","last_active":"2023-07-09T21:43:04.109031+0000","last_peered":"2023-07-09T21:43:04.109031+0000","last_clean":"2023-07-09T21:43:04.109031+0000","last_became_active":"2023-07-09T21:43:04.104829+0000","last_became_peered":"2023-07-09T21:43:04.104829+0000","last_unstale":"2023-07-09T21:43:04.109031+0000","last_undegraded":"2023-07-09T21:43:04.109031+0000","last_fullsized":"2023-07-09T21:43:04.109031+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:36.844466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097747+0000","last_change":"2023-07-09T21:43:04.097747+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097747+0000","last_undegraded":"2023-07-09T21:43:04.097747+0000","last_fullsized":"2023-07-09T21:43:04.097747+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112115+0000","last_change":"2023-07-09T21:43:04.108077+0000","last_active":"2023-07-09T21:43:04.112115+0000","last_peered":"2023-07-09T21:43:04.112115+0000","last_clean":"2023-07-09T21:43:04.112115+0000","last_became_active":"2023-07-09T21:43:04.107786+0000","last_became_peered":"2023-07-09T21:43:04.107786+0000","last_unstale":"2023-07-09T21:43:04.112115+0000","last_undegraded":"2023-07-09T21:43:04.112115+0000","last_fullsized":"2023-07-09T21:43:04.112115+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:15.471607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104972+0000","last_change":"2023-07-09T21:43:04.104972+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104972+0000","last_undegraded":"2023-07-09T21:43:04.104972+0000","last_fullsized":"2023-07-09T21:43:04.104972+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121363+0000","last_change":"2023-07-09T21:43:04.120583+0000","last_active":"2023-07-09T21:43:04.121363+0000","last_peered":"2023-07-09T21:43:04.121363+0000","last_clean":"2023-07-09T21:43:04.121363+0000","last_became_active":"2023-07-09T21:43:04.120220+0000","last_became_peered":"2023-07-09T21:43:04.120220+0000","last_unstale":"2023-07-09T21:43:04.121363+0000","last_undegraded":"2023-07-09T21:43:04.121363+0000","last_fullsized":"2023-07-09T21:43:04.121363+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:47.144995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'271","reported_seq":955,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097362+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:43:04.097362+0000","last_peered":"2023-07-09T21:43:04.097362+0000","last_clean":"2023-07-09T21:43:04.097362+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:43:04.097362+0000","last_undegraded":"2023-07-09T21:43:04.097362+0000","last_fullsized":"2023-07-09T21:43:04.097362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:19.841173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.102886+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:43:04.102886+0000","last_peered":"2023-07-09T21:43:04.102886+0000","last_clean":"2023-07-09T21:43:04.102886+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:43:04.102886+0000","last_undegraded":"2023-07-09T21:43:04.102886+0000","last_fullsized":"2023-07-09T21:43:04.102886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:52:37.819952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095908+0000","last_change":"2023-07-09T21:43:04.095908+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095908+0000","last_undegraded":"2023-07-09T21:43:04.095908+0000","last_fullsized":"2023-07-09T21:43:04.095908+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116377+0000","last_change":"2023-07-09T21:43:04.110688+0000","last_active":"2023-07-09T21:43:04.116377+0000","last_peered":"2023-07-09T21:43:04.116377+0000","last_clean":"2023-07-09T21:43:04.116377+0000","last_became_active":"2023-07-09T21:43:04.110287+0000","last_became_peered":"2023-07-09T21:43:04.110287+0000","last_unstale":"2023-07-09T21:43:04.116377+0000","last_undegraded":"2023-07-09T21:43:04.116377+0000","last_fullsized":"2023-07-09T21:43:04.116377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:40.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":253,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097231+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:43:04.097231+0000","last_peered":"2023-07-09T21:43:04.097231+0000","last_clean":"2023-07-09T21:43:04.097231+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:43:04.097231+0000","last_undegraded":"2023-07-09T21:43:04.097231+0000","last_fullsized":"2023-07-09T21:43:04.097231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:33.464565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095558+0000","last_change":"2023-07-09T21:43:04.095558+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095558+0000","last_undegraded":"2023-07-09T21:43:04.095558+0000","last_fullsized":"2023-07-09T21:43:04.095558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109038+0000","last_change":"2023-07-09T21:43:04.106029+0000","last_active":"2023-07-09T21:43:04.109038+0000","last_peered":"2023-07-09T21:43:04.109038+0000","last_clean":"2023-07-09T21:43:04.109038+0000","last_became_active":"2023-07-09T21:43:04.105760+0000","last_became_peered":"2023-07-09T21:43:04.105760+0000","last_unstale":"2023-07-09T21:43:04.109038+0000","last_undegraded":"2023-07-09T21:43:04.109038+0000","last_fullsized":"2023-07-09T21:43:04.109038+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:42:39.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.107593+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:43:04.107593+0000","last_peered":"2023-07-09T21:43:04.107593+0000","last_clean":"2023-07-09T21:43:04.107593+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:43:04.107593+0000","last_undegraded":"2023-07-09T21:43:04.107593+0000","last_fullsized":"2023-07-09T21:43:04.107593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:25.535206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098094+0000","last_change":"2023-07-09T21:43:04.098094+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098094+0000","last_undegraded":"2023-07-09T21:43:04.098094+0000","last_fullsized":"2023-07-09T21:43:04.098094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115927+0000","last_change":"2023-07-09T21:43:04.113973+0000","last_active":"2023-07-09T21:43:04.115927+0000","last_peered":"2023-07-09T21:43:04.115927+0000","last_clean":"2023-07-09T21:43:04.115927+0000","last_became_active":"2023-07-09T21:43:04.113561+0000","last_became_peered":"2023-07-09T21:43:04.113561+0000","last_unstale":"2023-07-09T21:43:04.115927+0000","last_undegraded":"2023-07-09T21:43:04.115927+0000","last_fullsized":"2023-07-09T21:43:04.115927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:20.933013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097445+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:43:04.097445+0000","last_peered":"2023-07-09T21:43:04.097445+0000","last_clean":"2023-07-09T21:43:04.097445+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:43:04.097445+0000","last_undegraded":"2023-07-09T21:43:04.097445+0000","last_fullsized":"2023-07-09T21:43:04.097445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:31.193126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104323+0000","last_change":"2023-07-09T21:43:04.104323+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104323+0000","last_undegraded":"2023-07-09T21:43:04.104323+0000","last_fullsized":"2023-07-09T21:43:04.104323+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115442+0000","last_change":"2023-07-09T21:43:04.113801+0000","last_active":"2023-07-09T21:43:04.115442+0000","last_peered":"2023-07-09T21:43:04.115442+0000","last_clean":"2023-07-09T21:43:04.115442+0000","last_became_active":"2023-07-09T21:43:04.113490+0000","last_became_peered":"2023-07-09T21:43:04.113490+0000","last_unstale":"2023-07-09T21:43:04.115442+0000","last_undegraded":"2023-07-09T21:43:04.115442+0000","last_fullsized":"2023-07-09T21:43:04.115442+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:43:13.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":246,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096456+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:43:04.096456+0000","last_peered":"2023-07-09T21:43:04.096456+0000","last_clean":"2023-07-09T21:43:04.096456+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:43:04.096456+0000","last_undegraded":"2023-07-09T21:43:04.096456+0000","last_fullsized":"2023-07-09T21:43:04.096456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:02.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104447+0000","last_change":"2023-07-09T21:43:04.104447+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104447+0000","last_undegraded":"2023-07-09T21:43:04.104447+0000","last_fullsized":"2023-07-09T21:43:04.104447+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114938+0000","last_change":"2023-07-09T21:43:04.112763+0000","last_active":"2023-07-09T21:43:04.114938+0000","last_peered":"2023-07-09T21:43:04.114938+0000","last_clean":"2023-07-09T21:43:04.114938+0000","last_became_active":"2023-07-09T21:43:04.112041+0000","last_became_peered":"2023-07-09T21:43:04.112041+0000","last_unstale":"2023-07-09T21:43:04.114938+0000","last_undegraded":"2023-07-09T21:43:04.114938+0000","last_fullsized":"2023-07-09T21:43:04.114938+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:32:27.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":252,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.099198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:43:04.099198+0000","last_peered":"2023-07-09T21:43:04.099198+0000","last_clean":"2023-07-09T21:43:04.099198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:43:04.099198+0000","last_undegraded":"2023-07-09T21:43:04.099198+0000","last_fullsized":"2023-07-09T21:43:04.099198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:28:55.896008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093053+0000","last_change":"2023-07-09T21:43:04.093053+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093053+0000","last_undegraded":"2023-07-09T21:43:04.093053+0000","last_fullsized":"2023-07-09T21:43:04.093053+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.103639+0000","last_change":"2023-07-09T21:43:04.098406+0000","last_active":"2023-07-09T21:43:04.103639+0000","last_peered":"2023-07-09T21:43:04.103639+0000","last_clean":"2023-07-09T21:43:04.103639+0000","last_became_active":"2023-07-09T21:43:04.098107+0000","last_became_peered":"2023-07-09T21:43:04.098107+0000","last_unstale":"2023-07-09T21:43:04.103639+0000","last_undegraded":"2023-07-09T21:43:04.103639+0000","last_fullsized":"2023-07-09T21:43:04.103639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:13.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096527+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:43:04.096527+0000","last_peered":"2023-07-09T21:43:04.096527+0000","last_clean":"2023-07-09T21:43:04.096527+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:43:04.096527+0000","last_undegraded":"2023-07-09T21:43:04.096527+0000","last_fullsized":"2023-07-09T21:43:04.096527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:34.432158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095448+0000","last_change":"2023-07-09T21:43:04.095448+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095448+0000","last_undegraded":"2023-07-09T21:43:04.095448+0000","last_fullsized":"2023-07-09T21:43:04.095448+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115880+0000","last_change":"2023-07-09T21:43:04.113066+0000","last_active":"2023-07-09T21:43:04.115880+0000","last_peered":"2023-07-09T21:43:04.115880+0000","last_clean":"2023-07-09T21:43:04.115880+0000","last_became_active":"2023-07-09T21:43:04.112294+0000","last_became_peered":"2023-07-09T21:43:04.112294+0000","last_unstale":"2023-07-09T21:43:04.115880+0000","last_undegraded":"2023-07-09T21:43:04.115880+0000","last_fullsized":"2023-07-09T21:43:04.115880+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:53.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.100492+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:43:04.100492+0000","last_peered":"2023-07-09T21:43:04.100492+0000","last_clean":"2023-07-09T21:43:04.100492+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:43:04.100492+0000","last_undegraded":"2023-07-09T21:43:04.100492+0000","last_fullsized":"2023-07-09T21:43:04.100492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:14.958156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575094,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59764,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312076,"statfs":{"total":96636764160,"available":96575565824,"internally_reserved":0,"allocated":2535424,"data_stored":1579532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84999999999999998,"5min":1.03,"15min":1.03},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88300000000000001,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88600000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":1.754,"15min":1.754},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96299999999999997,"5min":1.1140000000000001,"15min":1.129},"last":0.70399999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":1.232,"15min":1.232},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.86799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.497},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575093,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.997,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.88900000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.746,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":1.0229999999999999,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.60399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.501,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.004,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.96199999999999997,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76000000000000001,"15min":0.75900000000000001},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.48699999999999999},"max":{"1min":1.0660000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76100000000000001,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.69999999999999996,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":6.101,"15min":6.101},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.64600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73899999999999999,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90900000000000003,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":0.70099999999999996},"min":{"1min":0.53600000000000003,"5min":0.503,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44600000000000001},"max":{"1min":0.95399999999999996,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575092,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.371,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":1.006},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0409999999999999},"last":0.621},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.02},"last":0.497}]},{"osd":2,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.002,"15min":1.002},"last":0.64000000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94399999999999995,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.438},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.625},"min":{"1min":0.504,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.083,"15min":1.083},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.038},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.34399999999999997},"max":{"1min":1.1060000000000001,"5min":1.107,"15min":1.107},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66700000000000004,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.95299999999999996},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.51400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.996,"15min":0.996},"last":0.79100000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.97999999999999998,"5min":1.083,"15min":1.083},"last":0.97999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.97999999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69299999999999995,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.26},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.034,"15min":1.05},"last":1.008}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.024,"15min":1.024},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91600000000000004,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.097,"15min":1.097},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575093,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46700000000000003},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67500000000000004,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.497,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52200000000000002,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.442},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.101,"15min":1.101},"last":0.502},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80600000000000005,"5min":1.024,"15min":1.024},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.0529999999999999,"5min":1.111,"15min":1.3320000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.879},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.208},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.51},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97199999999999998,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.083,"15min":1.127},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.034,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575094,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55076,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316764,"statfs":{"total":96636764160,"available":96580366336,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.73399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":1.123}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":1.081},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.94599999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.056}]}]},{"osd":1,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.76800000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.96999999999999997},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77500000000000002,"15min":1.3069999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.89300000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.0169999999999999,"5min":1.129,"15min":1.155},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78100000000000003,"15min":0.81000000000000005},"min":{"1min":0.60599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.212},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96499999999999997,"5min":1.177,"15min":1.1839999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.56799999999999995,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.024,"5min":1.1160000000000001,"15min":1.149},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.038,"5min":1.2,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.0349999999999999,"5min":1.1699999999999999,"15min":1.258},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98799999999999999,"5min":1.107,"15min":1.173},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1899999999999999,"15min":1.2929999999999999},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575094,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37608,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334232,"statfs":{"total":96636764160,"available":96598253568,"internally_reserved":0,"allocated":2523136,"data_stored":1572884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60099999999999998,"5min":0.67600000000000005,"15min":0.753},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.629,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":1.657,"15min":1.657},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.502}]},{"osd":4,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":1.835,"15min":1.835},"last":0.96699999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.726,"15min":1.726},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":1.615,"15min":1.615},"last":0.88800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.76500000000000001,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90800000000000003,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"max":{"1min":0.85299999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":0.93200000000000005,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":1.883,"15min":1.883},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:43:09.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:43:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 Processor -- start 2023-07-09T21:43:09.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 -- start start 2023-07-09T21:43:09.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f58780b4340 0x7f587806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58780cef80 0x7f58780d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58780b49f0 con 0x7f58780b7ab0 2023-07-09T21:43:09.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780b7e80 con 0x7f58780cef80 2023-07-09T21:43:09.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f587d500640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58780cc8a0 con 0x7f58780b4340 2023-07-09T21:43:09.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f5876ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f58780b7ab0 0x7f58780b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33684/0 (socket says 172.21.15.37:33684) 2023-07-09T21:43:09.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f5876ffd640 1 -- 172.21.15.37:0/2867717296 learned_addr learned my addr 172.21.15.37:0/2867717296 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:09.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f58777fe640 1 --2- 172.21.15.37:0/2867717296 >> v2:172.21.15.37:3300/0 conn(0x7f58780cef80 0x7f58780d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f586e7fc640 1 --2- 172.21.15.37:0/2867717296 >> v2:172.21.15.119:3300/0 conn(0x7f58780b4340 0x7f587806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58777fe640 1 -- 172.21.15.37:0/2867717296 >> v2:172.21.15.119:3300/0 conn(0x7f58780b4340 msgr2=0x7f587806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58777fe640 1 --2- 172.21.15.37:0/2867717296 >> v2:172.21.15.119:3300/0 conn(0x7f58780b4340 0x7f587806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58777fe640 1 -- 172.21.15.37:0/2867717296 >> v1:172.21.15.37:6789/0 conn(0x7f58780b7ab0 legacy=0x7f58780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.423+0000 7f58767fc640 1 -- 172.21.15.37:0/2867717296 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966916260 0 0) 0x7f58780b49f0 con 0x7f58780b7ab0 2023-07-09T21:43:09.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58777fe640 1 -- 172.21.15.37:0/2867717296 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780ccb80 con 0x7f58780cef80 2023-07-09T21:43:09.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58777fe640 1 --2- 172.21.15.37:0/2867717296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780cef80 0x7f58780d02a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f58780b4d10 tx=0x7f587001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e44827ceec6e6b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58767fc640 1 -- 172.21.15.37:0/2867717296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700a7070 con 0x7f58780cef80 2023-07-09T21:43:09.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58767fc640 1 -- 172.21.15.37:0/2867717296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700ab430 con 0x7f58780cef80 2023-07-09T21:43:09.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f58767fc640 1 -- 172.21.15.37:0/2867717296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58700ab7c0 con 0x7f58780cef80 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 -- 172.21.15.37:0/2867717296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780cef80 msgr2=0x7f58780d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 --2- 172.21.15.37:0/2867717296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780cef80 0x7f58780d02a0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f58780b4d10 tx=0x7f587001c430 comp rx=0 tx=0).stop 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 -- 172.21.15.37:0/2867717296 shutdown_connections 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 --2- 172.21.15.37:0/2867717296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780cef80 0x7f58780d02a0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 --2- 172.21.15.37:0/2867717296 >> v2:172.21.15.119:3300/0 conn(0x7f58780b4340 0x7f587806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 -- 172.21.15.37:0/2867717296 >> 172.21.15.37:0/2867717296 conn(0x7f5878073090 msgr2=0x7f5878069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 -- 172.21.15.37:0/2867717296 shutdown_connections 2023-07-09T21:43:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.427+0000 7f587d500640 1 -- 172.21.15.37:0/2867717296 wait complete. 2023-07-09T21:43:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 Processor -- start 2023-07-09T21:43:09.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 -- start start 2023-07-09T21:43:09.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 0x7f5878152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 0x7f5878153440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815ae60 con 0x7f58780b4340 2023-07-09T21:43:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587815a1e0 con 0x7f58780cef80 2023-07-09T21:43:09.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f587d500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587815a4c0 con 0x7f58780b7ab0 2023-07-09T21:43:09.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55166/0 (socket says 172.21.15.37:55166) 2023-07-09T21:43:09.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 -- 172.21.15.37:0/3977775911 learned_addr learned my addr 172.21.15.37:0/3977775911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:09.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f586e7fc640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 0x7f5878152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f58777fe640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 0x7f5878153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 -- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 msgr2=0x7f5878152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 0x7f5878152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 -- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 msgr2=0x7f5878153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 0x7f5878153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 -- 172.21.15.37:0/3977775911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5870009420 con 0x7f58780b4340 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f586e7fc640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 0x7f5878152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f58777fe640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 0x7f5878153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:09.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.431+0000 7f5876ffd640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f58680011f0 tx=0x7f586800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680074e0 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868007640 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868004a10 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587815a7a0 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587815b7c0 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587815ba40 con 0x7f58780b4340 2023-07-09T21:43:09.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5868004b70 con 0x7f58780b4340 2023-07-09T21:43:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 0x7f5858068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f58680831b0 con 0x7f58780b4340 2023-07-09T21:43:09.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.435+0000 7f586e7fc640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 0x7f5858068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.439+0000 7f586e7fc640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 0x7f5858068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5860003fd0 tx=0x7f58600039e0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.439+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58680504f0 con 0x7f58780b4340 2023-07-09T21:43:09.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.595+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58780cf4d0 con 0x7f58580663a0 2023-07-09T21:43:09.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.603+0000 7f586ffff640 1 -- 172.21.15.37:0/3977775911 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306284 (secure 0 0 0) 0x7f58600047b0 con 0x7f58580663a0 2023-07-09T21:43:09.606 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:09.607 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:43:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 msgr2=0x7f5858068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 0x7f5858068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5860003fd0 tx=0x7f58600039e0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 msgr2=0x7f587815b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f58680011f0 tx=0x7f586800c9b0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 shutdown_connections 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f58580663a0 0x7f5858068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58780cef80 0x7f5878153440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58780b7ab0 0x7f5878152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 --2- 172.21.15.37:0/3977775911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58780b4340 0x7f587815b280 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 >> 172.21.15.37:0/3977775911 conn(0x7f5878073090 msgr2=0x7f58780b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 shutdown_connections 2023-07-09T21:43:09.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.607+0000 7f587d500640 1 -- 172.21.15.37:0/3977775911 wait complete. 2023-07-09T21:43:09.627 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:43:08.769356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347480,"kb_used_data":16280,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754627240,"statfs":{"total":773094113280,"available":772738293760,"internally_reserved":0,"allocated":16670720,"data_stored":9067456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.681948"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.102346+0000","last_change":"2023-07-09T21:43:04.102346+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.102346+0000","last_undegraded":"2023-07-09T21:43:04.102346+0000","last_fullsized":"2023-07-09T21:43:04.102346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106932+0000","last_change":"2023-07-09T21:43:04.106932+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106932+0000","last_undegraded":"2023-07-09T21:43:04.106932+0000","last_fullsized":"2023-07-09T21:43:04.106932+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094340+0000","last_change":"2023-07-09T21:43:04.094340+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094340+0000","last_undegraded":"2023-07-09T21:43:04.094340+0000","last_fullsized":"2023-07-09T21:43:04.094340+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093239+0000","last_change":"2023-07-09T21:43:04.093239+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093239+0000","last_undegraded":"2023-07-09T21:43:04.093239+0000","last_fullsized":"2023-07-09T21:43:04.093239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095531+0000","last_change":"2023-07-09T21:43:04.095531+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095531+0000","last_undegraded":"2023-07-09T21:43:04.095531+0000","last_fullsized":"2023-07-09T21:43:04.095531+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096766+0000","last_change":"2023-07-09T21:43:04.096766+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096766+0000","last_undegraded":"2023-07-09T21:43:04.096766+0000","last_fullsized":"2023-07-09T21:43:04.096766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100114+0000","last_change":"2023-07-09T21:43:04.100114+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100114+0000","last_undegraded":"2023-07-09T21:43:04.100114+0000","last_fullsized":"2023-07-09T21:43:04.100114+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096895+0000","last_change":"2023-07-09T21:43:04.096895+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096895+0000","last_undegraded":"2023-07-09T21:43:04.096895+0000","last_fullsized":"2023-07-09T21:43:04.096895+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096892+0000","last_change":"2023-07-09T21:43:04.096892+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096892+0000","last_undegraded":"2023-07-09T21:43:04.096892+0000","last_fullsized":"2023-07-09T21:43:04.096892+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095050+0000","last_change":"2023-07-09T21:43:04.095050+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095050+0000","last_undegraded":"2023-07-09T21:43:04.095050+0000","last_fullsized":"2023-07-09T21:43:04.095050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.103102+0000","last_change":"2023-07-09T21:43:04.103102+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.103102+0000","last_undegraded":"2023-07-09T21:43:04.103102+0000","last_fullsized":"2023-07-09T21:43:04.103102+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094245+0000","last_change":"2023-07-09T21:43:04.094245+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094245+0000","last_undegraded":"2023-07-09T21:43:04.094245+0000","last_fullsized":"2023-07-09T21:43:04.094245+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101782+0000","last_change":"2023-07-09T21:43:04.101782+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101782+0000","last_undegraded":"2023-07-09T21:43:04.101782+0000","last_fullsized":"2023-07-09T21:43:04.101782+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094077+0000","last_change":"2023-07-09T21:43:04.094077+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094077+0000","last_undegraded":"2023-07-09T21:43:04.094077+0000","last_fullsized":"2023-07-09T21:43:04.094077+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095881+0000","last_change":"2023-07-09T21:43:04.095881+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095881+0000","last_undegraded":"2023-07-09T21:43:04.095881+0000","last_fullsized":"2023-07-09T21:43:04.095881+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093125+0000","last_change":"2023-07-09T21:43:04.093125+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093125+0000","last_undegraded":"2023-07-09T21:43:04.093125+0000","last_fullsized":"2023-07-09T21:43:04.093125+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095200+0000","last_change":"2023-07-09T21:43:04.095200+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095200+0000","last_undegraded":"2023-07-09T21:43:04.095200+0000","last_fullsized":"2023-07-09T21:43:04.095200+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098174+0000","last_change":"2023-07-09T21:43:04.098174+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098174+0000","last_undegraded":"2023-07-09T21:43:04.098174+0000","last_fullsized":"2023-07-09T21:43:04.098174+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094451+0000","last_change":"2023-07-09T21:43:04.094451+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094451+0000","last_undegraded":"2023-07-09T21:43:04.094451+0000","last_fullsized":"2023-07-09T21:43:04.094451+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094248+0000","last_change":"2023-07-09T21:43:04.094248+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094248+0000","last_undegraded":"2023-07-09T21:43:04.094248+0000","last_fullsized":"2023-07-09T21:43:04.094248+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101258+0000","last_change":"2023-07-09T21:43:04.101258+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101258+0000","last_undegraded":"2023-07-09T21:43:04.101258+0000","last_fullsized":"2023-07-09T21:43:04.101258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094276+0000","last_change":"2023-07-09T21:43:04.094276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094276+0000","last_undegraded":"2023-07-09T21:43:04.094276+0000","last_fullsized":"2023-07-09T21:43:04.094276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095344+0000","last_change":"2023-07-09T21:43:04.095344+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095344+0000","last_undegraded":"2023-07-09T21:43:04.095344+0000","last_fullsized":"2023-07-09T21:43:04.095344+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106434+0000","last_change":"2023-07-09T21:43:04.106434+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106434+0000","last_undegraded":"2023-07-09T21:43:04.106434+0000","last_fullsized":"2023-07-09T21:43:04.106434+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106362+0000","last_change":"2023-07-09T21:43:04.106362+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106362+0000","last_undegraded":"2023-07-09T21:43:04.106362+0000","last_fullsized":"2023-07-09T21:43:04.106362+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097667+0000","last_change":"2023-07-09T21:43:04.097667+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097667+0000","last_undegraded":"2023-07-09T21:43:04.097667+0000","last_fullsized":"2023-07-09T21:43:04.097667+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098581+0000","last_change":"2023-07-09T21:43:04.098581+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098581+0000","last_undegraded":"2023-07-09T21:43:04.098581+0000","last_fullsized":"2023-07-09T21:43:04.098581+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106428+0000","last_change":"2023-07-09T21:43:04.106428+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106428+0000","last_undegraded":"2023-07-09T21:43:04.106428+0000","last_fullsized":"2023-07-09T21:43:04.106428+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106342+0000","last_change":"2023-07-09T21:43:04.106342+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106342+0000","last_undegraded":"2023-07-09T21:43:04.106342+0000","last_fullsized":"2023-07-09T21:43:04.106342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099430+0000","last_change":"2023-07-09T21:43:04.099430+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099430+0000","last_undegraded":"2023-07-09T21:43:04.099430+0000","last_fullsized":"2023-07-09T21:43:04.099430+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097353+0000","last_change":"2023-07-09T21:43:04.097353+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097353+0000","last_undegraded":"2023-07-09T21:43:04.097353+0000","last_fullsized":"2023-07-09T21:43:04.097353+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099391+0000","last_change":"2023-07-09T21:43:04.099391+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099391+0000","last_undegraded":"2023-07-09T21:43:04.099391+0000","last_fullsized":"2023-07-09T21:43:04.099391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121976+0000","last_change":"2023-07-09T21:43:04.120316+0000","last_active":"2023-07-09T21:43:04.121976+0000","last_peered":"2023-07-09T21:43:04.121976+0000","last_clean":"2023-07-09T21:43:04.121976+0000","last_became_active":"2023-07-09T21:43:04.120005+0000","last_became_peered":"2023-07-09T21:43:04.120005+0000","last_unstale":"2023-07-09T21:43:04.121976+0000","last_undegraded":"2023-07-09T21:43:04.121976+0000","last_fullsized":"2023-07-09T21:43:04.121976+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:45.770224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093609+0000","last_change":"2023-07-09T21:43:04.093609+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093609+0000","last_undegraded":"2023-07-09T21:43:04.093609+0000","last_fullsized":"2023-07-09T21:43:04.093609+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106011+0000","last_change":"2023-07-09T21:43:04.097685+0000","last_active":"2023-07-09T21:43:04.106011+0000","last_peered":"2023-07-09T21:43:04.106011+0000","last_clean":"2023-07-09T21:43:04.106011+0000","last_became_active":"2023-07-09T21:43:04.097353+0000","last_became_peered":"2023-07-09T21:43:04.097353+0000","last_unstale":"2023-07-09T21:43:04.106011+0000","last_undegraded":"2023-07-09T21:43:04.106011+0000","last_fullsized":"2023-07-09T21:43:04.106011+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:36.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094504+0000","last_change":"2023-07-09T21:43:04.094504+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094504+0000","last_undegraded":"2023-07-09T21:43:04.094504+0000","last_fullsized":"2023-07-09T21:43:04.094504+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112995+0000","last_change":"2023-07-09T21:43:04.109765+0000","last_active":"2023-07-09T21:43:04.112995+0000","last_peered":"2023-07-09T21:43:04.112995+0000","last_clean":"2023-07-09T21:43:04.112995+0000","last_became_active":"2023-07-09T21:43:04.109464+0000","last_became_peered":"2023-07-09T21:43:04.109464+0000","last_unstale":"2023-07-09T21:43:04.112995+0000","last_undegraded":"2023-07-09T21:43:04.112995+0000","last_fullsized":"2023-07-09T21:43:04.112995+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:31.670684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100725+0000","last_change":"2023-07-09T21:43:04.100725+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100725+0000","last_undegraded":"2023-07-09T21:43:04.100725+0000","last_fullsized":"2023-07-09T21:43:04.100725+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112872+0000","last_change":"2023-07-09T21:43:04.108354+0000","last_active":"2023-07-09T21:43:04.112872+0000","last_peered":"2023-07-09T21:43:04.112872+0000","last_clean":"2023-07-09T21:43:04.112872+0000","last_became_active":"2023-07-09T21:43:04.108047+0000","last_became_peered":"2023-07-09T21:43:04.108047+0000","last_unstale":"2023-07-09T21:43:04.112872+0000","last_undegraded":"2023-07-09T21:43:04.112872+0000","last_fullsized":"2023-07-09T21:43:04.112872+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:27:34.241976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101065+0000","last_change":"2023-07-09T21:43:04.101065+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101065+0000","last_undegraded":"2023-07-09T21:43:04.101065+0000","last_fullsized":"2023-07-09T21:43:04.101065+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109468+0000","last_change":"2023-07-09T21:43:04.107762+0000","last_active":"2023-07-09T21:43:04.109468+0000","last_peered":"2023-07-09T21:43:04.109468+0000","last_clean":"2023-07-09T21:43:04.109468+0000","last_became_active":"2023-07-09T21:43:04.107396+0000","last_became_peered":"2023-07-09T21:43:04.107396+0000","last_unstale":"2023-07-09T21:43:04.109468+0000","last_undegraded":"2023-07-09T21:43:04.109468+0000","last_fullsized":"2023-07-09T21:43:04.109468+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:28.519104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100922+0000","last_change":"2023-07-09T21:43:04.100922+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100922+0000","last_undegraded":"2023-07-09T21:43:04.100922+0000","last_fullsized":"2023-07-09T21:43:04.100922+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109077+0000","last_change":"2023-07-09T21:43:04.102572+0000","last_active":"2023-07-09T21:43:04.109077+0000","last_peered":"2023-07-09T21:43:04.109077+0000","last_clean":"2023-07-09T21:43:04.109077+0000","last_became_active":"2023-07-09T21:43:04.102251+0000","last_became_peered":"2023-07-09T21:43:04.102251+0000","last_unstale":"2023-07-09T21:43:04.109077+0000","last_undegraded":"2023-07-09T21:43:04.109077+0000","last_fullsized":"2023-07-09T21:43:04.109077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:53:49.917585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112221+0000","last_change":"2023-07-09T21:43:04.109982+0000","last_active":"2023-07-09T21:43:04.112221+0000","last_peered":"2023-07-09T21:43:04.112221+0000","last_clean":"2023-07-09T21:43:04.112221+0000","last_became_active":"2023-07-09T21:43:04.109679+0000","last_became_peered":"2023-07-09T21:43:04.109679+0000","last_unstale":"2023-07-09T21:43:04.112221+0000","last_undegraded":"2023-07-09T21:43:04.112221+0000","last_fullsized":"2023-07-09T21:43:04.112221+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:02.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098246+0000","last_change":"2023-07-09T21:43:04.098246+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098246+0000","last_undegraded":"2023-07-09T21:43:04.098246+0000","last_fullsized":"2023-07-09T21:43:04.098246+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116883+0000","last_change":"2023-07-09T21:43:04.114995+0000","last_active":"2023-07-09T21:43:04.116883+0000","last_peered":"2023-07-09T21:43:04.116883+0000","last_clean":"2023-07-09T21:43:04.116883+0000","last_became_active":"2023-07-09T21:43:04.114707+0000","last_became_peered":"2023-07-09T21:43:04.114707+0000","last_unstale":"2023-07-09T21:43:04.116883+0000","last_undegraded":"2023-07-09T21:43:04.116883+0000","last_fullsized":"2023-07-09T21:43:04.116883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:48.063937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104416+0000","last_change":"2023-07-09T21:43:04.104416+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104416+0000","last_undegraded":"2023-07-09T21:43:04.104416+0000","last_fullsized":"2023-07-09T21:43:04.104416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114480+0000","last_change":"2023-07-09T21:43:04.111388+0000","last_active":"2023-07-09T21:43:04.114480+0000","last_peered":"2023-07-09T21:43:04.114480+0000","last_clean":"2023-07-09T21:43:04.114480+0000","last_became_active":"2023-07-09T21:43:04.110970+0000","last_became_peered":"2023-07-09T21:43:04.110970+0000","last_unstale":"2023-07-09T21:43:04.114480+0000","last_undegraded":"2023-07-09T21:43:04.114480+0000","last_fullsized":"2023-07-09T21:43:04.114480+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:52:18.361142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096276+0000","last_change":"2023-07-09T21:43:04.096276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096276+0000","last_undegraded":"2023-07-09T21:43:04.096276+0000","last_fullsized":"2023-07-09T21:43:04.096276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121900+0000","last_change":"2023-07-09T21:43:04.119311+0000","last_active":"2023-07-09T21:43:04.121900+0000","last_peered":"2023-07-09T21:43:04.121900+0000","last_clean":"2023-07-09T21:43:04.121900+0000","last_became_active":"2023-07-09T21:43:04.119040+0000","last_became_peered":"2023-07-09T21:43:04.119040+0000","last_unstale":"2023-07-09T21:43:04.121900+0000","last_undegraded":"2023-07-09T21:43:04.121900+0000","last_fullsized":"2023-07-09T21:43:04.121900+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099578+0000","last_change":"2023-07-09T21:43:04.099578+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099578+0000","last_undegraded":"2023-07-09T21:43:04.099578+0000","last_fullsized":"2023-07-09T21:43:04.099578+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.111985+0000","last_change":"2023-07-09T21:43:04.110053+0000","last_active":"2023-07-09T21:43:04.111985+0000","last_peered":"2023-07-09T21:43:04.111985+0000","last_clean":"2023-07-09T21:43:04.111985+0000","last_became_active":"2023-07-09T21:43:04.109787+0000","last_became_peered":"2023-07-09T21:43:04.109787+0000","last_unstale":"2023-07-09T21:43:04.111985+0000","last_undegraded":"2023-07-09T21:43:04.111985+0000","last_fullsized":"2023-07-09T21:43:04.111985+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:18.871391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098655+0000","last_change":"2023-07-09T21:43:04.098655+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098655+0000","last_undegraded":"2023-07-09T21:43:04.098655+0000","last_fullsized":"2023-07-09T21:43:04.098655+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113961+0000","last_change":"2023-07-09T21:43:04.111581+0000","last_active":"2023-07-09T21:43:04.113961+0000","last_peered":"2023-07-09T21:43:04.113961+0000","last_clean":"2023-07-09T21:43:04.113961+0000","last_became_active":"2023-07-09T21:43:04.111287+0000","last_became_peered":"2023-07-09T21:43:04.111287+0000","last_unstale":"2023-07-09T21:43:04.113961+0000","last_undegraded":"2023-07-09T21:43:04.113961+0000","last_fullsized":"2023-07-09T21:43:04.113961+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:00.043513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093872+0000","last_change":"2023-07-09T21:43:04.093872+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093872+0000","last_undegraded":"2023-07-09T21:43:04.093872+0000","last_fullsized":"2023-07-09T21:43:04.093872+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113839+0000","last_change":"2023-07-09T21:43:04.111715+0000","last_active":"2023-07-09T21:43:04.113839+0000","last_peered":"2023-07-09T21:43:04.113839+0000","last_clean":"2023-07-09T21:43:04.113839+0000","last_became_active":"2023-07-09T21:43:04.111369+0000","last_became_peered":"2023-07-09T21:43:04.111369+0000","last_unstale":"2023-07-09T21:43:04.113839+0000","last_undegraded":"2023-07-09T21:43:04.113839+0000","last_fullsized":"2023-07-09T21:43:04.113839+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:39.794983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093112+0000","last_change":"2023-07-09T21:43:04.093112+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093112+0000","last_undegraded":"2023-07-09T21:43:04.093112+0000","last_fullsized":"2023-07-09T21:43:04.093112+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115317+0000","last_change":"2023-07-09T21:43:04.110623+0000","last_active":"2023-07-09T21:43:04.115317+0000","last_peered":"2023-07-09T21:43:04.115317+0000","last_clean":"2023-07-09T21:43:04.115317+0000","last_became_active":"2023-07-09T21:43:04.110329+0000","last_became_peered":"2023-07-09T21:43:04.110329+0000","last_unstale":"2023-07-09T21:43:04.115317+0000","last_undegraded":"2023-07-09T21:43:04.115317+0000","last_fullsized":"2023-07-09T21:43:04.115317+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:01.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094161+0000","last_change":"2023-07-09T21:43:04.094161+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094161+0000","last_undegraded":"2023-07-09T21:43:04.094161+0000","last_fullsized":"2023-07-09T21:43:04.094161+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.118058+0000","last_change":"2023-07-09T21:43:04.116122+0000","last_active":"2023-07-09T21:43:04.118058+0000","last_peered":"2023-07-09T21:43:04.118058+0000","last_clean":"2023-07-09T21:43:04.118058+0000","last_became_active":"2023-07-09T21:43:04.115798+0000","last_became_peered":"2023-07-09T21:43:04.115798+0000","last_unstale":"2023-07-09T21:43:04.118058+0000","last_undegraded":"2023-07-09T21:43:04.118058+0000","last_fullsized":"2023-07-09T21:43:04.118058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:45.214691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094755+0000","last_change":"2023-07-09T21:43:04.094755+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094755+0000","last_undegraded":"2023-07-09T21:43:04.094755+0000","last_fullsized":"2023-07-09T21:43:04.094755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106801+0000","last_change":"2023-07-09T21:43:04.104644+0000","last_active":"2023-07-09T21:43:04.106801+0000","last_peered":"2023-07-09T21:43:04.106801+0000","last_clean":"2023-07-09T21:43:04.106801+0000","last_became_active":"2023-07-09T21:43:04.104004+0000","last_became_peered":"2023-07-09T21:43:04.104004+0000","last_unstale":"2023-07-09T21:43:04.106801+0000","last_undegraded":"2023-07-09T21:43:04.106801+0000","last_fullsized":"2023-07-09T21:43:04.106801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:03.915441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094206+0000","last_change":"2023-07-09T21:43:04.094206+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094206+0000","last_undegraded":"2023-07-09T21:43:04.094206+0000","last_fullsized":"2023-07-09T21:43:04.094206+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115495+0000","last_change":"2023-07-09T21:43:04.112265+0000","last_active":"2023-07-09T21:43:04.115495+0000","last_peered":"2023-07-09T21:43:04.115495+0000","last_clean":"2023-07-09T21:43:04.115495+0000","last_became_active":"2023-07-09T21:43:04.111982+0000","last_became_peered":"2023-07-09T21:43:04.111982+0000","last_unstale":"2023-07-09T21:43:04.115495+0000","last_undegraded":"2023-07-09T21:43:04.115495+0000","last_fullsized":"2023-07-09T21:43:04.115495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:20:00.036775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104326+0000","last_change":"2023-07-09T21:43:04.104326+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104326+0000","last_undegraded":"2023-07-09T21:43:04.104326+0000","last_fullsized":"2023-07-09T21:43:04.104326+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113936+0000","last_change":"2023-07-09T21:43:04.110528+0000","last_active":"2023-07-09T21:43:04.113936+0000","last_peered":"2023-07-09T21:43:04.113936+0000","last_clean":"2023-07-09T21:43:04.113936+0000","last_became_active":"2023-07-09T21:43:04.110266+0000","last_became_peered":"2023-07-09T21:43:04.110266+0000","last_unstale":"2023-07-09T21:43:04.113936+0000","last_undegraded":"2023-07-09T21:43:04.113936+0000","last_fullsized":"2023-07-09T21:43:04.113936+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:48.759355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100046+0000","last_change":"2023-07-09T21:43:04.100046+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100046+0000","last_undegraded":"2023-07-09T21:43:04.100046+0000","last_fullsized":"2023-07-09T21:43:04.100046+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121539+0000","last_change":"2023-07-09T21:43:04.119204+0000","last_active":"2023-07-09T21:43:04.121539+0000","last_peered":"2023-07-09T21:43:04.121539+0000","last_clean":"2023-07-09T21:43:04.121539+0000","last_became_active":"2023-07-09T21:43:04.118925+0000","last_became_peered":"2023-07-09T21:43:04.118925+0000","last_unstale":"2023-07-09T21:43:04.121539+0000","last_undegraded":"2023-07-09T21:43:04.121539+0000","last_fullsized":"2023-07-09T21:43:04.121539+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097332+0000","last_change":"2023-07-09T21:43:04.097332+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097332+0000","last_undegraded":"2023-07-09T21:43:04.097332+0000","last_fullsized":"2023-07-09T21:43:04.097332+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109022+0000","last_change":"2023-07-09T21:43:04.105009+0000","last_active":"2023-07-09T21:43:04.109022+0000","last_peered":"2023-07-09T21:43:04.109022+0000","last_clean":"2023-07-09T21:43:04.109022+0000","last_became_active":"2023-07-09T21:43:04.104702+0000","last_became_peered":"2023-07-09T21:43:04.104702+0000","last_unstale":"2023-07-09T21:43:04.109022+0000","last_undegraded":"2023-07-09T21:43:04.109022+0000","last_fullsized":"2023-07-09T21:43:04.109022+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:14:57.433408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093307+0000","last_change":"2023-07-09T21:43:04.093307+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093307+0000","last_undegraded":"2023-07-09T21:43:04.093307+0000","last_fullsized":"2023-07-09T21:43:04.093307+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115388+0000","last_change":"2023-07-09T21:43:04.112867+0000","last_active":"2023-07-09T21:43:04.115388+0000","last_peered":"2023-07-09T21:43:04.115388+0000","last_clean":"2023-07-09T21:43:04.115388+0000","last_became_active":"2023-07-09T21:43:04.112599+0000","last_became_peered":"2023-07-09T21:43:04.112599+0000","last_unstale":"2023-07-09T21:43:04.115388+0000","last_undegraded":"2023-07-09T21:43:04.115388+0000","last_fullsized":"2023-07-09T21:43:04.115388+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:38.070958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094775+0000","last_change":"2023-07-09T21:43:04.094775+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094775+0000","last_undegraded":"2023-07-09T21:43:04.094775+0000","last_fullsized":"2023-07-09T21:43:04.094775+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112965+0000","last_change":"2023-07-09T21:43:04.110316+0000","last_active":"2023-07-09T21:43:04.112965+0000","last_peered":"2023-07-09T21:43:04.112965+0000","last_clean":"2023-07-09T21:43:04.112965+0000","last_became_active":"2023-07-09T21:43:04.110028+0000","last_became_peered":"2023-07-09T21:43:04.110028+0000","last_unstale":"2023-07-09T21:43:04.112965+0000","last_undegraded":"2023-07-09T21:43:04.112965+0000","last_fullsized":"2023-07-09T21:43:04.112965+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:00.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093433+0000","last_change":"2023-07-09T21:43:04.093433+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093433+0000","last_undegraded":"2023-07-09T21:43:04.093433+0000","last_fullsized":"2023-07-09T21:43:04.093433+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109031+0000","last_change":"2023-07-09T21:43:04.105115+0000","last_active":"2023-07-09T21:43:04.109031+0000","last_peered":"2023-07-09T21:43:04.109031+0000","last_clean":"2023-07-09T21:43:04.109031+0000","last_became_active":"2023-07-09T21:43:04.104829+0000","last_became_peered":"2023-07-09T21:43:04.104829+0000","last_unstale":"2023-07-09T21:43:04.109031+0000","last_undegraded":"2023-07-09T21:43:04.109031+0000","last_fullsized":"2023-07-09T21:43:04.109031+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:36.844466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097747+0000","last_change":"2023-07-09T21:43:04.097747+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097747+0000","last_undegraded":"2023-07-09T21:43:04.097747+0000","last_fullsized":"2023-07-09T21:43:04.097747+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112115+0000","last_change":"2023-07-09T21:43:04.108077+0000","last_active":"2023-07-09T21:43:04.112115+0000","last_peered":"2023-07-09T21:43:04.112115+0000","last_clean":"2023-07-09T21:43:04.112115+0000","last_became_active":"2023-07-09T21:43:04.107786+0000","last_became_peered":"2023-07-09T21:43:04.107786+0000","last_unstale":"2023-07-09T21:43:04.112115+0000","last_undegraded":"2023-07-09T21:43:04.112115+0000","last_fullsized":"2023-07-09T21:43:04.112115+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:15.471607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104972+0000","last_change":"2023-07-09T21:43:04.104972+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104972+0000","last_undegraded":"2023-07-09T21:43:04.104972+0000","last_fullsized":"2023-07-09T21:43:04.104972+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121363+0000","last_change":"2023-07-09T21:43:04.120583+0000","last_active":"2023-07-09T21:43:04.121363+0000","last_peered":"2023-07-09T21:43:04.121363+0000","last_clean":"2023-07-09T21:43:04.121363+0000","last_became_active":"2023-07-09T21:43:04.120220+0000","last_became_peered":"2023-07-09T21:43:04.120220+0000","last_unstale":"2023-07-09T21:43:04.121363+0000","last_undegraded":"2023-07-09T21:43:04.121363+0000","last_fullsized":"2023-07-09T21:43:04.121363+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:47.144995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'271","reported_seq":955,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097362+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:43:04.097362+0000","last_peered":"2023-07-09T21:43:04.097362+0000","last_clean":"2023-07-09T21:43:04.097362+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:43:04.097362+0000","last_undegraded":"2023-07-09T21:43:04.097362+0000","last_fullsized":"2023-07-09T21:43:04.097362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:19.841173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.102886+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:43:04.102886+0000","last_peered":"2023-07-09T21:43:04.102886+0000","last_clean":"2023-07-09T21:43:04.102886+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:43:04.102886+0000","last_undegraded":"2023-07-09T21:43:04.102886+0000","last_fullsized":"2023-07-09T21:43:04.102886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:52:37.819952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095908+0000","last_change":"2023-07-09T21:43:04.095908+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095908+0000","last_undegraded":"2023-07-09T21:43:04.095908+0000","last_fullsized":"2023-07-09T21:43:04.095908+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116377+0000","last_change":"2023-07-09T21:43:04.110688+0000","last_active":"2023-07-09T21:43:04.116377+0000","last_peered":"2023-07-09T21:43:04.116377+0000","last_clean":"2023-07-09T21:43:04.116377+0000","last_became_active":"2023-07-09T21:43:04.110287+0000","last_became_peered":"2023-07-09T21:43:04.110287+0000","last_unstale":"2023-07-09T21:43:04.116377+0000","last_undegraded":"2023-07-09T21:43:04.116377+0000","last_fullsized":"2023-07-09T21:43:04.116377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:40.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":253,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097231+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:43:04.097231+0000","last_peered":"2023-07-09T21:43:04.097231+0000","last_clean":"2023-07-09T21:43:04.097231+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:43:04.097231+0000","last_undegraded":"2023-07-09T21:43:04.097231+0000","last_fullsized":"2023-07-09T21:43:04.097231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:33.464565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095558+0000","last_change":"2023-07-09T21:43:04.095558+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095558+0000","last_undegraded":"2023-07-09T21:43:04.095558+0000","last_fullsized":"2023-07-09T21:43:04.095558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109038+0000","last_change":"2023-07-09T21:43:04.106029+0000","last_active":"2023-07-09T21:43:04.109038+0000","last_peered":"2023-07-09T21:43:04.109038+0000","last_clean":"2023-07-09T21:43:04.109038+0000","last_became_active":"2023-07-09T21:43:04.105760+0000","last_became_peered":"2023-07-09T21:43:04.105760+0000","last_unstale":"2023-07-09T21:43:04.109038+0000","last_undegraded":"2023-07-09T21:43:04.109038+0000","last_fullsized":"2023-07-09T21:43:04.109038+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:42:39.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.107593+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:43:04.107593+0000","last_peered":"2023-07-09T21:43:04.107593+0000","last_clean":"2023-07-09T21:43:04.107593+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:43:04.107593+0000","last_undegraded":"2023-07-09T21:43:04.107593+0000","last_fullsized":"2023-07-09T21:43:04.107593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:25.535206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098094+0000","last_change":"2023-07-09T21:43:04.098094+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098094+0000","last_undegraded":"2023-07-09T21:43:04.098094+0000","last_fullsized":"2023-07-09T21:43:04.098094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115927+0000","last_change":"2023-07-09T21:43:04.113973+0000","last_active":"2023-07-09T21:43:04.115927+0000","last_peered":"2023-07-09T21:43:04.115927+0000","last_clean":"2023-07-09T21:43:04.115927+0000","last_became_active":"2023-07-09T21:43:04.113561+0000","last_became_peered":"2023-07-09T21:43:04.113561+0000","last_unstale":"2023-07-09T21:43:04.115927+0000","last_undegraded":"2023-07-09T21:43:04.115927+0000","last_fullsized":"2023-07-09T21:43:04.115927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:20.933013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097445+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:43:04.097445+0000","last_peered":"2023-07-09T21:43:04.097445+0000","last_clean":"2023-07-09T21:43:04.097445+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:43:04.097445+0000","last_undegraded":"2023-07-09T21:43:04.097445+0000","last_fullsized":"2023-07-09T21:43:04.097445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:31.193126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104323+0000","last_change":"2023-07-09T21:43:04.104323+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104323+0000","last_undegraded":"2023-07-09T21:43:04.104323+0000","last_fullsized":"2023-07-09T21:43:04.104323+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115442+0000","last_change":"2023-07-09T21:43:04.113801+0000","last_active":"2023-07-09T21:43:04.115442+0000","last_peered":"2023-07-09T21:43:04.115442+0000","last_clean":"2023-07-09T21:43:04.115442+0000","last_became_active":"2023-07-09T21:43:04.113490+0000","last_became_peered":"2023-07-09T21:43:04.113490+0000","last_unstale":"2023-07-09T21:43:04.115442+0000","last_undegraded":"2023-07-09T21:43:04.115442+0000","last_fullsized":"2023-07-09T21:43:04.115442+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:43:13.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":246,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096456+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:43:04.096456+0000","last_peered":"2023-07-09T21:43:04.096456+0000","last_clean":"2023-07-09T21:43:04.096456+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:43:04.096456+0000","last_undegraded":"2023-07-09T21:43:04.096456+0000","last_fullsized":"2023-07-09T21:43:04.096456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:02.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104447+0000","last_change":"2023-07-09T21:43:04.104447+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104447+0000","last_undegraded":"2023-07-09T21:43:04.104447+0000","last_fullsized":"2023-07-09T21:43:04.104447+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114938+0000","last_change":"2023-07-09T21:43:04.112763+0000","last_active":"2023-07-09T21:43:04.114938+0000","last_peered":"2023-07-09T21:43:04.114938+0000","last_clean":"2023-07-09T21:43:04.114938+0000","last_became_active":"2023-07-09T21:43:04.112041+0000","last_became_peered":"2023-07-09T21:43:04.112041+0000","last_unstale":"2023-07-09T21:43:04.114938+0000","last_undegraded":"2023-07-09T21:43:04.114938+0000","last_fullsized":"2023-07-09T21:43:04.114938+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:32:27.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":252,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.099198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:43:04.099198+0000","last_peered":"2023-07-09T21:43:04.099198+0000","last_clean":"2023-07-09T21:43:04.099198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:43:04.099198+0000","last_undegraded":"2023-07-09T21:43:04.099198+0000","last_fullsized":"2023-07-09T21:43:04.099198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:28:55.896008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093053+0000","last_change":"2023-07-09T21:43:04.093053+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093053+0000","last_undegraded":"2023-07-09T21:43:04.093053+0000","last_fullsized":"2023-07-09T21:43:04.093053+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.103639+0000","last_change":"2023-07-09T21:43:04.098406+0000","last_active":"2023-07-09T21:43:04.103639+0000","last_peered":"2023-07-09T21:43:04.103639+0000","last_clean":"2023-07-09T21:43:04.103639+0000","last_became_active":"2023-07-09T21:43:04.098107+0000","last_became_peered":"2023-07-09T21:43:04.098107+0000","last_unstale":"2023-07-09T21:43:04.103639+0000","last_undegraded":"2023-07-09T21:43:04.103639+0000","last_fullsized":"2023-07-09T21:43:04.103639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:13.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096527+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:43:04.096527+0000","last_peered":"2023-07-09T21:43:04.096527+0000","last_clean":"2023-07-09T21:43:04.096527+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:43:04.096527+0000","last_undegraded":"2023-07-09T21:43:04.096527+0000","last_fullsized":"2023-07-09T21:43:04.096527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:34.432158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095448+0000","last_change":"2023-07-09T21:43:04.095448+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095448+0000","last_undegraded":"2023-07-09T21:43:04.095448+0000","last_fullsized":"2023-07-09T21:43:04.095448+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115880+0000","last_change":"2023-07-09T21:43:04.113066+0000","last_active":"2023-07-09T21:43:04.115880+0000","last_peered":"2023-07-09T21:43:04.115880+0000","last_clean":"2023-07-09T21:43:04.115880+0000","last_became_active":"2023-07-09T21:43:04.112294+0000","last_became_peered":"2023-07-09T21:43:04.112294+0000","last_unstale":"2023-07-09T21:43:04.115880+0000","last_undegraded":"2023-07-09T21:43:04.115880+0000","last_fullsized":"2023-07-09T21:43:04.115880+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:53.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.100492+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:43:04.100492+0000","last_peered":"2023-07-09T21:43:04.100492+0000","last_clean":"2023-07-09T21:43:04.100492+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:43:04.100492+0000","last_undegraded":"2023-07-09T21:43:04.100492+0000","last_fullsized":"2023-07-09T21:43:04.100492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:14.958156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575094,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59764,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312076,"statfs":{"total":96636764160,"available":96575565824,"internally_reserved":0,"allocated":2535424,"data_stored":1579532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84999999999999998,"5min":1.03,"15min":1.03},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88300000000000001,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88600000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":1.754,"15min":1.754},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96299999999999997,"5min":1.1140000000000001,"15min":1.129},"last":0.70399999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":1.232,"15min":1.232},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.86799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.497},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575093,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.997,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.88900000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.746,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":1.0229999999999999,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.60399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.501,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.004,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.96199999999999997,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76000000000000001,"15min":0.75900000000000001},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.48699999999999999},"max":{"1min":1.0660000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76100000000000001,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.69999999999999996,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":6.101,"15min":6.101},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.64600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73899999999999999,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90900000000000003,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":0.70099999999999996},"min":{"1min":0.53600000000000003,"5min":0.503,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44600000000000001},"max":{"1min":0.95399999999999996,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575092,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.371,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":1.006},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0409999999999999},"last":0.621},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.02},"last":0.497}]},{"osd":2,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.002,"15min":1.002},"last":0.64000000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94399999999999995,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.438},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.625},"min":{"1min":0.504,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.083,"15min":1.083},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.038},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.34399999999999997},"max":{"1min":1.1060000000000001,"5min":1.107,"15min":1.107},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66700000000000004,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.95299999999999996},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.51400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.996,"15min":0.996},"last":0.79100000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.97999999999999998,"5min":1.083,"15min":1.083},"last":0.97999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.97999999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69299999999999995,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.26},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.034,"15min":1.05},"last":1.008}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.024,"15min":1.024},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91600000000000004,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.097,"15min":1.097},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575093,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46700000000000003},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67500000000000004,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.497,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52200000000000002,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.442},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.101,"15min":1.101},"last":0.502},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80600000000000005,"5min":1.024,"15min":1.024},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.0529999999999999,"5min":1.111,"15min":1.3320000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.879},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.208},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.51},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97199999999999998,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.083,"15min":1.127},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.034,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575094,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55076,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316764,"statfs":{"total":96636764160,"available":96580366336,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.73399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":1.123}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":1.081},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.94599999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.056}]}]},{"osd":1,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.76800000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.96999999999999997},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77500000000000002,"15min":1.3069999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.89300000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.0169999999999999,"5min":1.129,"15min":1.155},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78100000000000003,"15min":0.81000000000000005},"min":{"1min":0.60599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.212},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96499999999999997,"5min":1.177,"15min":1.1839999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.56799999999999995,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.024,"5min":1.1160000000000001,"15min":1.149},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.038,"5min":1.2,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.0349999999999999,"5min":1.1699999999999999,"15min":1.258},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98799999999999999,"5min":1.107,"15min":1.173},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1899999999999999,"15min":1.2929999999999999},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575094,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37608,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334232,"statfs":{"total":96636764160,"available":96598253568,"internally_reserved":0,"allocated":2523136,"data_stored":1572884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60099999999999998,"5min":0.67600000000000005,"15min":0.753},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.629,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":1.657,"15min":1.657},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.502}]},{"osd":4,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":1.835,"15min":1.835},"last":0.96699999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.726,"15min":1.726},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":1.615,"15min":1.615},"last":0.88800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.76500000000000001,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90800000000000003,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"max":{"1min":0.85299999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":0.93200000000000005,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":1.883,"15min":1.883},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:43:09.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:43:09.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 Processor -- start 2023-07-09T21:43:09.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 -- start start 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02540cef80 0x7f025406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540b49f0 con 0x7f02540b7ab0 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02540cc8a0 con 0x7f02540b4340 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f025a2d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02540b7e80 con 0x7f02540cef80 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0258875640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f02540cef80 0x7f025406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0253fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f02540b7ab0 0x7f02540b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33688/0 (socket says 172.21.15.37:33688) 2023-07-09T21:43:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0253fff640 1 -- 172.21.15.37:0/1574158512 learned_addr learned my addr 172.21.15.37:0/1574158512 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0258875640 1 -- 172.21.15.37:0/1574158512 >> v1:172.21.15.119:6789/0 conn(0x7f02540b4340 legacy=0x7f02540d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0258875640 1 -- 172.21.15.37:0/1574158512 >> v1:172.21.15.37:6789/0 conn(0x7f02540b7ab0 legacy=0x7f02540b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.815+0000 7f0258875640 1 -- 172.21.15.37:0/1574158512 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540ccb80 con 0x7f02540cef80 2023-07-09T21:43:09.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f0258875640 1 --2- 172.21.15.37:0/1574158512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025406aa50 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f024c009d90 tx=0x7f024c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c166145aa3ef8887 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f0252ffd640 1 -- 172.21.15.37:0/1574158512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0a59a0 con 0x7f02540cef80 2023-07-09T21:43:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f0252ffd640 1 -- 172.21.15.37:0/1574158512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0a5b00 con 0x7f02540cef80 2023-07-09T21:43:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f0252ffd640 1 -- 172.21.15.37:0/1574158512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0a5e90 con 0x7f02540cef80 2023-07-09T21:43:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 -- 172.21.15.37:0/1574158512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 msgr2=0x7f025406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 --2- 172.21.15.37:0/1574158512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025406aa50 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f024c009d90 tx=0x7f024c01c8e0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 -- 172.21.15.37:0/1574158512 shutdown_connections 2023-07-09T21:43:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 --2- 172.21.15.37:0/1574158512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025406aa50 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 -- 172.21.15.37:0/1574158512 >> 172.21.15.37:0/1574158512 conn(0x7f0254073090 msgr2=0x7f0254069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 -- 172.21.15.37:0/1574158512 shutdown_connections 2023-07-09T21:43:09.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.819+0000 7f025a2d8640 1 -- 172.21.15.37:0/1574158512 wait complete. 2023-07-09T21:43:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 Processor -- start 2023-07-09T21:43:09.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 -- start start 2023-07-09T21:43:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02540b4340 0x7f02540b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02540b7ab0 0x7f02540c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540b6c40 con 0x7f02540cef80 2023-07-09T21:43:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02540cae10 con 0x7f02540b7ab0 2023-07-09T21:43:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02540cb0f0 con 0x7f02540b4340 2023-07-09T21:43:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55186/0 (socket says 172.21.15.37:55186) 2023-07-09T21:43:09.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 -- 172.21.15.37:0/2436542332 learned_addr learned my addr 172.21.15.37:0/2436542332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:09.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f02537fe640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02540b7ab0 0x7f02540c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0253fff640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02540b4340 0x7f02540b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 -- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02540b4340 msgr2=0x7f02540b6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02540b4340 0x7f02540b6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 -- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02540b7ab0 msgr2=0x7f02540c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02540b7ab0 0x7f02540c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 -- 172.21.15.37:0/2436542332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024c009a70 con 0x7f02540cef80 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0258875640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f024c01a510 tx=0x7f024c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0addc0 con 0x7f02540cef80 2023-07-09T21:43:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c0b9450 con 0x7f02540cef80 2023-07-09T21:43:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c0b97e0 con 0x7f02540cef80 2023-07-09T21:43:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.823+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02540cb3d0 con 0x7f02540cef80 2023-07-09T21:43:09.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02540cb990 con 0x7f02540cef80 2023-07-09T21:43:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02540cbb80 con 0x7f02540cef80 2023-07-09T21:43:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f024c0b9940 con 0x7f02540cef80 2023-07-09T21:43:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f0250ff9640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f024c11f7f0 con 0x7f02540cef80 2023-07-09T21:43:09.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.827+0000 7f0253fff640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:09.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.831+0000 7f0253fff640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 0x7f0240068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0244005890 tx=0x7f0244009040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:09.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.831+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f024c0ecbc0 con 0x7f02540cef80 2023-07-09T21:43:09.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.983+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02540cf4d0 con 0x7f02400663a0 2023-07-09T21:43:09.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.991+0000 7f0250ff9640 1 -- 172.21.15.37:0/2436542332 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306284 (secure 0 0 0) 0x7f0244001c80 con 0x7f02400663a0 2023-07-09T21:43:09.995 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:09.997 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:43:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 msgr2=0x7f0240068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 0x7f0240068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0244005890 tx=0x7f0244009040 comp rx=0 tx=0).stop 2023-07-09T21:43:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 msgr2=0x7f025414aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:09.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f024c01a510 tx=0x7f024c019680 comp rx=0 tx=0).stop 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 shutdown_connections 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f02400663a0 0x7f0240068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02540cef80 0x7f025414aae0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f02540b7ab0 0x7f02540c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 --2- 172.21.15.37:0/2436542332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f02540b4340 0x7f02540b6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 >> 172.21.15.37:0/2436542332 conn(0x7f0254073090 msgr2=0x7f0254069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:09.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 shutdown_connections 2023-07-09T21:43:10.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:09.995+0000 7f025a2d8640 1 -- 172.21.15.37:0/2436542332 wait complete. 2023-07-09T21:43:10.016 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-07-09T21:43:08.769356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347480,"kb_used_data":16280,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754627240,"statfs":{"total":773094113280,"available":772738293760,"internally_reserved":0,"allocated":16670720,"data_stored":9067456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.681948"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.102346+0000","last_change":"2023-07-09T21:43:04.102346+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.102346+0000","last_undegraded":"2023-07-09T21:43:04.102346+0000","last_fullsized":"2023-07-09T21:43:04.102346+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106932+0000","last_change":"2023-07-09T21:43:04.106932+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106932+0000","last_undegraded":"2023-07-09T21:43:04.106932+0000","last_fullsized":"2023-07-09T21:43:04.106932+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094340+0000","last_change":"2023-07-09T21:43:04.094340+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094340+0000","last_undegraded":"2023-07-09T21:43:04.094340+0000","last_fullsized":"2023-07-09T21:43:04.094340+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093239+0000","last_change":"2023-07-09T21:43:04.093239+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093239+0000","last_undegraded":"2023-07-09T21:43:04.093239+0000","last_fullsized":"2023-07-09T21:43:04.093239+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095531+0000","last_change":"2023-07-09T21:43:04.095531+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095531+0000","last_undegraded":"2023-07-09T21:43:04.095531+0000","last_fullsized":"2023-07-09T21:43:04.095531+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096766+0000","last_change":"2023-07-09T21:43:04.096766+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096766+0000","last_undegraded":"2023-07-09T21:43:04.096766+0000","last_fullsized":"2023-07-09T21:43:04.096766+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100114+0000","last_change":"2023-07-09T21:43:04.100114+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100114+0000","last_undegraded":"2023-07-09T21:43:04.100114+0000","last_fullsized":"2023-07-09T21:43:04.100114+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096895+0000","last_change":"2023-07-09T21:43:04.096895+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096895+0000","last_undegraded":"2023-07-09T21:43:04.096895+0000","last_fullsized":"2023-07-09T21:43:04.096895+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096892+0000","last_change":"2023-07-09T21:43:04.096892+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096892+0000","last_undegraded":"2023-07-09T21:43:04.096892+0000","last_fullsized":"2023-07-09T21:43:04.096892+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095050+0000","last_change":"2023-07-09T21:43:04.095050+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095050+0000","last_undegraded":"2023-07-09T21:43:04.095050+0000","last_fullsized":"2023-07-09T21:43:04.095050+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.103102+0000","last_change":"2023-07-09T21:43:04.103102+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.103102+0000","last_undegraded":"2023-07-09T21:43:04.103102+0000","last_fullsized":"2023-07-09T21:43:04.103102+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094245+0000","last_change":"2023-07-09T21:43:04.094245+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094245+0000","last_undegraded":"2023-07-09T21:43:04.094245+0000","last_fullsized":"2023-07-09T21:43:04.094245+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101782+0000","last_change":"2023-07-09T21:43:04.101782+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101782+0000","last_undegraded":"2023-07-09T21:43:04.101782+0000","last_fullsized":"2023-07-09T21:43:04.101782+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094077+0000","last_change":"2023-07-09T21:43:04.094077+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094077+0000","last_undegraded":"2023-07-09T21:43:04.094077+0000","last_fullsized":"2023-07-09T21:43:04.094077+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095881+0000","last_change":"2023-07-09T21:43:04.095881+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095881+0000","last_undegraded":"2023-07-09T21:43:04.095881+0000","last_fullsized":"2023-07-09T21:43:04.095881+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093125+0000","last_change":"2023-07-09T21:43:04.093125+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093125+0000","last_undegraded":"2023-07-09T21:43:04.093125+0000","last_fullsized":"2023-07-09T21:43:04.093125+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095200+0000","last_change":"2023-07-09T21:43:04.095200+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095200+0000","last_undegraded":"2023-07-09T21:43:04.095200+0000","last_fullsized":"2023-07-09T21:43:04.095200+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098174+0000","last_change":"2023-07-09T21:43:04.098174+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098174+0000","last_undegraded":"2023-07-09T21:43:04.098174+0000","last_fullsized":"2023-07-09T21:43:04.098174+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094451+0000","last_change":"2023-07-09T21:43:04.094451+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094451+0000","last_undegraded":"2023-07-09T21:43:04.094451+0000","last_fullsized":"2023-07-09T21:43:04.094451+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094248+0000","last_change":"2023-07-09T21:43:04.094248+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094248+0000","last_undegraded":"2023-07-09T21:43:04.094248+0000","last_fullsized":"2023-07-09T21:43:04.094248+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101258+0000","last_change":"2023-07-09T21:43:04.101258+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101258+0000","last_undegraded":"2023-07-09T21:43:04.101258+0000","last_fullsized":"2023-07-09T21:43:04.101258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094276+0000","last_change":"2023-07-09T21:43:04.094276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094276+0000","last_undegraded":"2023-07-09T21:43:04.094276+0000","last_fullsized":"2023-07-09T21:43:04.094276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095344+0000","last_change":"2023-07-09T21:43:04.095344+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095344+0000","last_undegraded":"2023-07-09T21:43:04.095344+0000","last_fullsized":"2023-07-09T21:43:04.095344+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106434+0000","last_change":"2023-07-09T21:43:04.106434+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106434+0000","last_undegraded":"2023-07-09T21:43:04.106434+0000","last_fullsized":"2023-07-09T21:43:04.106434+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106362+0000","last_change":"2023-07-09T21:43:04.106362+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106362+0000","last_undegraded":"2023-07-09T21:43:04.106362+0000","last_fullsized":"2023-07-09T21:43:04.106362+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097667+0000","last_change":"2023-07-09T21:43:04.097667+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097667+0000","last_undegraded":"2023-07-09T21:43:04.097667+0000","last_fullsized":"2023-07-09T21:43:04.097667+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098581+0000","last_change":"2023-07-09T21:43:04.098581+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098581+0000","last_undegraded":"2023-07-09T21:43:04.098581+0000","last_fullsized":"2023-07-09T21:43:04.098581+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106428+0000","last_change":"2023-07-09T21:43:04.106428+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106428+0000","last_undegraded":"2023-07-09T21:43:04.106428+0000","last_fullsized":"2023-07-09T21:43:04.106428+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.106342+0000","last_change":"2023-07-09T21:43:04.106342+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.106342+0000","last_undegraded":"2023-07-09T21:43:04.106342+0000","last_fullsized":"2023-07-09T21:43:04.106342+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099430+0000","last_change":"2023-07-09T21:43:04.099430+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099430+0000","last_undegraded":"2023-07-09T21:43:04.099430+0000","last_fullsized":"2023-07-09T21:43:04.099430+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097353+0000","last_change":"2023-07-09T21:43:04.097353+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097353+0000","last_undegraded":"2023-07-09T21:43:04.097353+0000","last_fullsized":"2023-07-09T21:43:04.097353+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099391+0000","last_change":"2023-07-09T21:43:04.099391+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099391+0000","last_undegraded":"2023-07-09T21:43:04.099391+0000","last_fullsized":"2023-07-09T21:43:04.099391+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121976+0000","last_change":"2023-07-09T21:43:04.120316+0000","last_active":"2023-07-09T21:43:04.121976+0000","last_peered":"2023-07-09T21:43:04.121976+0000","last_clean":"2023-07-09T21:43:04.121976+0000","last_became_active":"2023-07-09T21:43:04.120005+0000","last_became_peered":"2023-07-09T21:43:04.120005+0000","last_unstale":"2023-07-09T21:43:04.121976+0000","last_undegraded":"2023-07-09T21:43:04.121976+0000","last_fullsized":"2023-07-09T21:43:04.121976+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:45.770224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093609+0000","last_change":"2023-07-09T21:43:04.093609+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093609+0000","last_undegraded":"2023-07-09T21:43:04.093609+0000","last_fullsized":"2023-07-09T21:43:04.093609+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106011+0000","last_change":"2023-07-09T21:43:04.097685+0000","last_active":"2023-07-09T21:43:04.106011+0000","last_peered":"2023-07-09T21:43:04.106011+0000","last_clean":"2023-07-09T21:43:04.106011+0000","last_became_active":"2023-07-09T21:43:04.097353+0000","last_became_peered":"2023-07-09T21:43:04.097353+0000","last_unstale":"2023-07-09T21:43:04.106011+0000","last_undegraded":"2023-07-09T21:43:04.106011+0000","last_fullsized":"2023-07-09T21:43:04.106011+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:36.685373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094504+0000","last_change":"2023-07-09T21:43:04.094504+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094504+0000","last_undegraded":"2023-07-09T21:43:04.094504+0000","last_fullsized":"2023-07-09T21:43:04.094504+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112995+0000","last_change":"2023-07-09T21:43:04.109765+0000","last_active":"2023-07-09T21:43:04.112995+0000","last_peered":"2023-07-09T21:43:04.112995+0000","last_clean":"2023-07-09T21:43:04.112995+0000","last_became_active":"2023-07-09T21:43:04.109464+0000","last_became_peered":"2023-07-09T21:43:04.109464+0000","last_unstale":"2023-07-09T21:43:04.112995+0000","last_undegraded":"2023-07-09T21:43:04.112995+0000","last_fullsized":"2023-07-09T21:43:04.112995+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:50:31.670684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100725+0000","last_change":"2023-07-09T21:43:04.100725+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100725+0000","last_undegraded":"2023-07-09T21:43:04.100725+0000","last_fullsized":"2023-07-09T21:43:04.100725+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112872+0000","last_change":"2023-07-09T21:43:04.108354+0000","last_active":"2023-07-09T21:43:04.112872+0000","last_peered":"2023-07-09T21:43:04.112872+0000","last_clean":"2023-07-09T21:43:04.112872+0000","last_became_active":"2023-07-09T21:43:04.108047+0000","last_became_peered":"2023-07-09T21:43:04.108047+0000","last_unstale":"2023-07-09T21:43:04.112872+0000","last_undegraded":"2023-07-09T21:43:04.112872+0000","last_fullsized":"2023-07-09T21:43:04.112872+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:27:34.241976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.101065+0000","last_change":"2023-07-09T21:43:04.101065+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.101065+0000","last_undegraded":"2023-07-09T21:43:04.101065+0000","last_fullsized":"2023-07-09T21:43:04.101065+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109468+0000","last_change":"2023-07-09T21:43:04.107762+0000","last_active":"2023-07-09T21:43:04.109468+0000","last_peered":"2023-07-09T21:43:04.109468+0000","last_clean":"2023-07-09T21:43:04.109468+0000","last_became_active":"2023-07-09T21:43:04.107396+0000","last_became_peered":"2023-07-09T21:43:04.107396+0000","last_unstale":"2023-07-09T21:43:04.109468+0000","last_undegraded":"2023-07-09T21:43:04.109468+0000","last_fullsized":"2023-07-09T21:43:04.109468+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:24:28.519104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100922+0000","last_change":"2023-07-09T21:43:04.100922+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100922+0000","last_undegraded":"2023-07-09T21:43:04.100922+0000","last_fullsized":"2023-07-09T21:43:04.100922+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109077+0000","last_change":"2023-07-09T21:43:04.102572+0000","last_active":"2023-07-09T21:43:04.109077+0000","last_peered":"2023-07-09T21:43:04.109077+0000","last_clean":"2023-07-09T21:43:04.109077+0000","last_became_active":"2023-07-09T21:43:04.102251+0000","last_became_peered":"2023-07-09T21:43:04.102251+0000","last_unstale":"2023-07-09T21:43:04.109077+0000","last_undegraded":"2023-07-09T21:43:04.109077+0000","last_fullsized":"2023-07-09T21:43:04.109077+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:53:49.917585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094718+0000","last_change":"2023-07-09T21:43:04.094718+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094718+0000","last_undegraded":"2023-07-09T21:43:04.094718+0000","last_fullsized":"2023-07-09T21:43:04.094718+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112221+0000","last_change":"2023-07-09T21:43:04.109982+0000","last_active":"2023-07-09T21:43:04.112221+0000","last_peered":"2023-07-09T21:43:04.112221+0000","last_clean":"2023-07-09T21:43:04.112221+0000","last_became_active":"2023-07-09T21:43:04.109679+0000","last_became_peered":"2023-07-09T21:43:04.109679+0000","last_unstale":"2023-07-09T21:43:04.112221+0000","last_undegraded":"2023-07-09T21:43:04.112221+0000","last_fullsized":"2023-07-09T21:43:04.112221+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:56:02.266164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098246+0000","last_change":"2023-07-09T21:43:04.098246+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098246+0000","last_undegraded":"2023-07-09T21:43:04.098246+0000","last_fullsized":"2023-07-09T21:43:04.098246+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116883+0000","last_change":"2023-07-09T21:43:04.114995+0000","last_active":"2023-07-09T21:43:04.116883+0000","last_peered":"2023-07-09T21:43:04.116883+0000","last_clean":"2023-07-09T21:43:04.116883+0000","last_became_active":"2023-07-09T21:43:04.114707+0000","last_became_peered":"2023-07-09T21:43:04.114707+0000","last_unstale":"2023-07-09T21:43:04.116883+0000","last_undegraded":"2023-07-09T21:43:04.116883+0000","last_fullsized":"2023-07-09T21:43:04.116883+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:48.063937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104416+0000","last_change":"2023-07-09T21:43:04.104416+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104416+0000","last_undegraded":"2023-07-09T21:43:04.104416+0000","last_fullsized":"2023-07-09T21:43:04.104416+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114480+0000","last_change":"2023-07-09T21:43:04.111388+0000","last_active":"2023-07-09T21:43:04.114480+0000","last_peered":"2023-07-09T21:43:04.114480+0000","last_clean":"2023-07-09T21:43:04.114480+0000","last_became_active":"2023-07-09T21:43:04.110970+0000","last_became_peered":"2023-07-09T21:43:04.110970+0000","last_unstale":"2023-07-09T21:43:04.114480+0000","last_undegraded":"2023-07-09T21:43:04.114480+0000","last_fullsized":"2023-07-09T21:43:04.114480+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:52:18.361142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.096276+0000","last_change":"2023-07-09T21:43:04.096276+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.096276+0000","last_undegraded":"2023-07-09T21:43:04.096276+0000","last_fullsized":"2023-07-09T21:43:04.096276+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121900+0000","last_change":"2023-07-09T21:43:04.119311+0000","last_active":"2023-07-09T21:43:04.121900+0000","last_peered":"2023-07-09T21:43:04.121900+0000","last_clean":"2023-07-09T21:43:04.121900+0000","last_became_active":"2023-07-09T21:43:04.119040+0000","last_became_peered":"2023-07-09T21:43:04.119040+0000","last_unstale":"2023-07-09T21:43:04.121900+0000","last_undegraded":"2023-07-09T21:43:04.121900+0000","last_fullsized":"2023-07-09T21:43:04.121900+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.099578+0000","last_change":"2023-07-09T21:43:04.099578+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.099578+0000","last_undegraded":"2023-07-09T21:43:04.099578+0000","last_fullsized":"2023-07-09T21:43:04.099578+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.111985+0000","last_change":"2023-07-09T21:43:04.110053+0000","last_active":"2023-07-09T21:43:04.111985+0000","last_peered":"2023-07-09T21:43:04.111985+0000","last_clean":"2023-07-09T21:43:04.111985+0000","last_became_active":"2023-07-09T21:43:04.109787+0000","last_became_peered":"2023-07-09T21:43:04.109787+0000","last_unstale":"2023-07-09T21:43:04.111985+0000","last_undegraded":"2023-07-09T21:43:04.111985+0000","last_fullsized":"2023-07-09T21:43:04.111985+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:18.871391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098655+0000","last_change":"2023-07-09T21:43:04.098655+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098655+0000","last_undegraded":"2023-07-09T21:43:04.098655+0000","last_fullsized":"2023-07-09T21:43:04.098655+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113961+0000","last_change":"2023-07-09T21:43:04.111581+0000","last_active":"2023-07-09T21:43:04.113961+0000","last_peered":"2023-07-09T21:43:04.113961+0000","last_clean":"2023-07-09T21:43:04.113961+0000","last_became_active":"2023-07-09T21:43:04.111287+0000","last_became_peered":"2023-07-09T21:43:04.111287+0000","last_unstale":"2023-07-09T21:43:04.113961+0000","last_undegraded":"2023-07-09T21:43:04.113961+0000","last_fullsized":"2023-07-09T21:43:04.113961+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:11:00.043513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093872+0000","last_change":"2023-07-09T21:43:04.093872+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093872+0000","last_undegraded":"2023-07-09T21:43:04.093872+0000","last_fullsized":"2023-07-09T21:43:04.093872+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113839+0000","last_change":"2023-07-09T21:43:04.111715+0000","last_active":"2023-07-09T21:43:04.113839+0000","last_peered":"2023-07-09T21:43:04.113839+0000","last_clean":"2023-07-09T21:43:04.113839+0000","last_became_active":"2023-07-09T21:43:04.111369+0000","last_became_peered":"2023-07-09T21:43:04.111369+0000","last_unstale":"2023-07-09T21:43:04.113839+0000","last_undegraded":"2023-07-09T21:43:04.113839+0000","last_fullsized":"2023-07-09T21:43:04.113839+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:39.794983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093112+0000","last_change":"2023-07-09T21:43:04.093112+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093112+0000","last_undegraded":"2023-07-09T21:43:04.093112+0000","last_fullsized":"2023-07-09T21:43:04.093112+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115317+0000","last_change":"2023-07-09T21:43:04.110623+0000","last_active":"2023-07-09T21:43:04.115317+0000","last_peered":"2023-07-09T21:43:04.115317+0000","last_clean":"2023-07-09T21:43:04.115317+0000","last_became_active":"2023-07-09T21:43:04.110329+0000","last_became_peered":"2023-07-09T21:43:04.110329+0000","last_unstale":"2023-07-09T21:43:04.115317+0000","last_undegraded":"2023-07-09T21:43:04.115317+0000","last_fullsized":"2023-07-09T21:43:04.115317+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:01.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094161+0000","last_change":"2023-07-09T21:43:04.094161+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094161+0000","last_undegraded":"2023-07-09T21:43:04.094161+0000","last_fullsized":"2023-07-09T21:43:04.094161+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.118058+0000","last_change":"2023-07-09T21:43:04.116122+0000","last_active":"2023-07-09T21:43:04.118058+0000","last_peered":"2023-07-09T21:43:04.118058+0000","last_clean":"2023-07-09T21:43:04.118058+0000","last_became_active":"2023-07-09T21:43:04.115798+0000","last_became_peered":"2023-07-09T21:43:04.115798+0000","last_unstale":"2023-07-09T21:43:04.118058+0000","last_undegraded":"2023-07-09T21:43:04.118058+0000","last_fullsized":"2023-07-09T21:43:04.118058+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:45.214691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094755+0000","last_change":"2023-07-09T21:43:04.094755+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094755+0000","last_undegraded":"2023-07-09T21:43:04.094755+0000","last_fullsized":"2023-07-09T21:43:04.094755+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.106801+0000","last_change":"2023-07-09T21:43:04.104644+0000","last_active":"2023-07-09T21:43:04.106801+0000","last_peered":"2023-07-09T21:43:04.106801+0000","last_clean":"2023-07-09T21:43:04.106801+0000","last_became_active":"2023-07-09T21:43:04.104004+0000","last_became_peered":"2023-07-09T21:43:04.104004+0000","last_unstale":"2023-07-09T21:43:04.106801+0000","last_undegraded":"2023-07-09T21:43:04.106801+0000","last_fullsized":"2023-07-09T21:43:04.106801+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:55:03.915441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094206+0000","last_change":"2023-07-09T21:43:04.094206+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094206+0000","last_undegraded":"2023-07-09T21:43:04.094206+0000","last_fullsized":"2023-07-09T21:43:04.094206+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115495+0000","last_change":"2023-07-09T21:43:04.112265+0000","last_active":"2023-07-09T21:43:04.115495+0000","last_peered":"2023-07-09T21:43:04.115495+0000","last_clean":"2023-07-09T21:43:04.115495+0000","last_became_active":"2023-07-09T21:43:04.111982+0000","last_became_peered":"2023-07-09T21:43:04.111982+0000","last_unstale":"2023-07-09T21:43:04.115495+0000","last_undegraded":"2023-07-09T21:43:04.115495+0000","last_fullsized":"2023-07-09T21:43:04.115495+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:20:00.036775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104326+0000","last_change":"2023-07-09T21:43:04.104326+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104326+0000","last_undegraded":"2023-07-09T21:43:04.104326+0000","last_fullsized":"2023-07-09T21:43:04.104326+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.113936+0000","last_change":"2023-07-09T21:43:04.110528+0000","last_active":"2023-07-09T21:43:04.113936+0000","last_peered":"2023-07-09T21:43:04.113936+0000","last_clean":"2023-07-09T21:43:04.113936+0000","last_became_active":"2023-07-09T21:43:04.110266+0000","last_became_peered":"2023-07-09T21:43:04.110266+0000","last_unstale":"2023-07-09T21:43:04.113936+0000","last_undegraded":"2023-07-09T21:43:04.113936+0000","last_fullsized":"2023-07-09T21:43:04.113936+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:11:48.759355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.100046+0000","last_change":"2023-07-09T21:43:04.100046+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.100046+0000","last_undegraded":"2023-07-09T21:43:04.100046+0000","last_fullsized":"2023-07-09T21:43:04.100046+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121539+0000","last_change":"2023-07-09T21:43:04.119204+0000","last_active":"2023-07-09T21:43:04.121539+0000","last_peered":"2023-07-09T21:43:04.121539+0000","last_clean":"2023-07-09T21:43:04.121539+0000","last_became_active":"2023-07-09T21:43:04.118925+0000","last_became_peered":"2023-07-09T21:43:04.118925+0000","last_unstale":"2023-07-09T21:43:04.121539+0000","last_undegraded":"2023-07-09T21:43:04.121539+0000","last_fullsized":"2023-07-09T21:43:04.121539+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:25:13.810484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097332+0000","last_change":"2023-07-09T21:43:04.097332+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097332+0000","last_undegraded":"2023-07-09T21:43:04.097332+0000","last_fullsized":"2023-07-09T21:43:04.097332+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109022+0000","last_change":"2023-07-09T21:43:04.105009+0000","last_active":"2023-07-09T21:43:04.109022+0000","last_peered":"2023-07-09T21:43:04.109022+0000","last_clean":"2023-07-09T21:43:04.109022+0000","last_became_active":"2023-07-09T21:43:04.104702+0000","last_became_peered":"2023-07-09T21:43:04.104702+0000","last_unstale":"2023-07-09T21:43:04.109022+0000","last_undegraded":"2023-07-09T21:43:04.109022+0000","last_fullsized":"2023-07-09T21:43:04.109022+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:14:57.433408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093307+0000","last_change":"2023-07-09T21:43:04.093307+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093307+0000","last_undegraded":"2023-07-09T21:43:04.093307+0000","last_fullsized":"2023-07-09T21:43:04.093307+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115388+0000","last_change":"2023-07-09T21:43:04.112867+0000","last_active":"2023-07-09T21:43:04.115388+0000","last_peered":"2023-07-09T21:43:04.115388+0000","last_clean":"2023-07-09T21:43:04.115388+0000","last_became_active":"2023-07-09T21:43:04.112599+0000","last_became_peered":"2023-07-09T21:43:04.112599+0000","last_unstale":"2023-07-09T21:43:04.115388+0000","last_undegraded":"2023-07-09T21:43:04.115388+0000","last_fullsized":"2023-07-09T21:43:04.115388+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:49:38.070958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.094775+0000","last_change":"2023-07-09T21:43:04.094775+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.094775+0000","last_undegraded":"2023-07-09T21:43:04.094775+0000","last_fullsized":"2023-07-09T21:43:04.094775+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112965+0000","last_change":"2023-07-09T21:43:04.110316+0000","last_active":"2023-07-09T21:43:04.112965+0000","last_peered":"2023-07-09T21:43:04.112965+0000","last_clean":"2023-07-09T21:43:04.112965+0000","last_became_active":"2023-07-09T21:43:04.110028+0000","last_became_peered":"2023-07-09T21:43:04.110028+0000","last_unstale":"2023-07-09T21:43:04.112965+0000","last_undegraded":"2023-07-09T21:43:04.112965+0000","last_fullsized":"2023-07-09T21:43:04.112965+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:00.683701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093433+0000","last_change":"2023-07-09T21:43:04.093433+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093433+0000","last_undegraded":"2023-07-09T21:43:04.093433+0000","last_fullsized":"2023-07-09T21:43:04.093433+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109031+0000","last_change":"2023-07-09T21:43:04.105115+0000","last_active":"2023-07-09T21:43:04.109031+0000","last_peered":"2023-07-09T21:43:04.109031+0000","last_clean":"2023-07-09T21:43:04.109031+0000","last_became_active":"2023-07-09T21:43:04.104829+0000","last_became_peered":"2023-07-09T21:43:04.104829+0000","last_unstale":"2023-07-09T21:43:04.109031+0000","last_undegraded":"2023-07-09T21:43:04.109031+0000","last_fullsized":"2023-07-09T21:43:04.109031+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:15:36.844466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.097747+0000","last_change":"2023-07-09T21:43:04.097747+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.097747+0000","last_undegraded":"2023-07-09T21:43:04.097747+0000","last_fullsized":"2023-07-09T21:43:04.097747+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.112115+0000","last_change":"2023-07-09T21:43:04.108077+0000","last_active":"2023-07-09T21:43:04.112115+0000","last_peered":"2023-07-09T21:43:04.112115+0000","last_clean":"2023-07-09T21:43:04.112115+0000","last_became_active":"2023-07-09T21:43:04.107786+0000","last_became_peered":"2023-07-09T21:43:04.107786+0000","last_unstale":"2023-07-09T21:43:04.112115+0000","last_undegraded":"2023-07-09T21:43:04.112115+0000","last_fullsized":"2023-07-09T21:43:04.112115+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:48:15.471607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104972+0000","last_change":"2023-07-09T21:43:04.104972+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104972+0000","last_undegraded":"2023-07-09T21:43:04.104972+0000","last_fullsized":"2023-07-09T21:43:04.104972+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.121363+0000","last_change":"2023-07-09T21:43:04.120583+0000","last_active":"2023-07-09T21:43:04.121363+0000","last_peered":"2023-07-09T21:43:04.121363+0000","last_clean":"2023-07-09T21:43:04.121363+0000","last_became_active":"2023-07-09T21:43:04.120220+0000","last_became_peered":"2023-07-09T21:43:04.120220+0000","last_unstale":"2023-07-09T21:43:04.121363+0000","last_undegraded":"2023-07-09T21:43:04.121363+0000","last_fullsized":"2023-07-09T21:43:04.121363+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:43:47.144995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'271","reported_seq":955,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097362+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:43:04.097362+0000","last_peered":"2023-07-09T21:43:04.097362+0000","last_clean":"2023-07-09T21:43:04.097362+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:43:04.097362+0000","last_undegraded":"2023-07-09T21:43:04.097362+0000","last_fullsized":"2023-07-09T21:43:04.097362+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:19.841173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.102886+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:43:04.102886+0000","last_peered":"2023-07-09T21:43:04.102886+0000","last_clean":"2023-07-09T21:43:04.102886+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:43:04.102886+0000","last_undegraded":"2023-07-09T21:43:04.102886+0000","last_fullsized":"2023-07-09T21:43:04.102886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:52:37.819952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095908+0000","last_change":"2023-07-09T21:43:04.095908+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095908+0000","last_undegraded":"2023-07-09T21:43:04.095908+0000","last_fullsized":"2023-07-09T21:43:04.095908+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.116377+0000","last_change":"2023-07-09T21:43:04.110688+0000","last_active":"2023-07-09T21:43:04.116377+0000","last_peered":"2023-07-09T21:43:04.116377+0000","last_clean":"2023-07-09T21:43:04.116377+0000","last_became_active":"2023-07-09T21:43:04.110287+0000","last_became_peered":"2023-07-09T21:43:04.110287+0000","last_unstale":"2023-07-09T21:43:04.116377+0000","last_undegraded":"2023-07-09T21:43:04.116377+0000","last_fullsized":"2023-07-09T21:43:04.116377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:46:40.531548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":253,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097231+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:43:04.097231+0000","last_peered":"2023-07-09T21:43:04.097231+0000","last_clean":"2023-07-09T21:43:04.097231+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:43:04.097231+0000","last_undegraded":"2023-07-09T21:43:04.097231+0000","last_fullsized":"2023-07-09T21:43:04.097231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:33.464565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095558+0000","last_change":"2023-07-09T21:43:04.095558+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095558+0000","last_undegraded":"2023-07-09T21:43:04.095558+0000","last_fullsized":"2023-07-09T21:43:04.095558+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.109038+0000","last_change":"2023-07-09T21:43:04.106029+0000","last_active":"2023-07-09T21:43:04.109038+0000","last_peered":"2023-07-09T21:43:04.109038+0000","last_clean":"2023-07-09T21:43:04.109038+0000","last_became_active":"2023-07-09T21:43:04.105760+0000","last_became_peered":"2023-07-09T21:43:04.105760+0000","last_unstale":"2023-07-09T21:43:04.109038+0000","last_undegraded":"2023-07-09T21:43:04.109038+0000","last_fullsized":"2023-07-09T21:43:04.109038+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:42:39.214455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.107593+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:43:04.107593+0000","last_peered":"2023-07-09T21:43:04.107593+0000","last_clean":"2023-07-09T21:43:04.107593+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:43:04.107593+0000","last_undegraded":"2023-07-09T21:43:04.107593+0000","last_fullsized":"2023-07-09T21:43:04.107593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:25.535206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.098094+0000","last_change":"2023-07-09T21:43:04.098094+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.098094+0000","last_undegraded":"2023-07-09T21:43:04.098094+0000","last_fullsized":"2023-07-09T21:43:04.098094+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115927+0000","last_change":"2023-07-09T21:43:04.113973+0000","last_active":"2023-07-09T21:43:04.115927+0000","last_peered":"2023-07-09T21:43:04.115927+0000","last_clean":"2023-07-09T21:43:04.115927+0000","last_became_active":"2023-07-09T21:43:04.113561+0000","last_became_peered":"2023-07-09T21:43:04.113561+0000","last_unstale":"2023-07-09T21:43:04.115927+0000","last_undegraded":"2023-07-09T21:43:04.115927+0000","last_fullsized":"2023-07-09T21:43:04.115927+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:20.933013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":294,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.097445+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:43:04.097445+0000","last_peered":"2023-07-09T21:43:04.097445+0000","last_clean":"2023-07-09T21:43:04.097445+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:43:04.097445+0000","last_undegraded":"2023-07-09T21:43:04.097445+0000","last_fullsized":"2023-07-09T21:43:04.097445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:07:31.193126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104323+0000","last_change":"2023-07-09T21:43:04.104323+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104323+0000","last_undegraded":"2023-07-09T21:43:04.104323+0000","last_fullsized":"2023-07-09T21:43:04.104323+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115442+0000","last_change":"2023-07-09T21:43:04.113801+0000","last_active":"2023-07-09T21:43:04.115442+0000","last_peered":"2023-07-09T21:43:04.115442+0000","last_clean":"2023-07-09T21:43:04.115442+0000","last_became_active":"2023-07-09T21:43:04.113490+0000","last_became_peered":"2023-07-09T21:43:04.113490+0000","last_unstale":"2023-07-09T21:43:04.115442+0000","last_undegraded":"2023-07-09T21:43:04.115442+0000","last_fullsized":"2023-07-09T21:43:04.115442+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:43:13.496089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":246,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096456+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:43:04.096456+0000","last_peered":"2023-07-09T21:43:04.096456+0000","last_clean":"2023-07-09T21:43:04.096456+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:43:04.096456+0000","last_undegraded":"2023-07-09T21:43:04.096456+0000","last_fullsized":"2023-07-09T21:43:04.096456+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:38:02.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.104447+0000","last_change":"2023-07-09T21:43:04.104447+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.104447+0000","last_undegraded":"2023-07-09T21:43:04.104447+0000","last_fullsized":"2023-07-09T21:43:04.104447+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.114938+0000","last_change":"2023-07-09T21:43:04.112763+0000","last_active":"2023-07-09T21:43:04.114938+0000","last_peered":"2023-07-09T21:43:04.114938+0000","last_clean":"2023-07-09T21:43:04.114938+0000","last_became_active":"2023-07-09T21:43:04.112041+0000","last_became_peered":"2023-07-09T21:43:04.112041+0000","last_unstale":"2023-07-09T21:43:04.114938+0000","last_undegraded":"2023-07-09T21:43:04.114938+0000","last_fullsized":"2023-07-09T21:43:04.114938+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:32:27.637413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":252,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.099198+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:43:04.099198+0000","last_peered":"2023-07-09T21:43:04.099198+0000","last_clean":"2023-07-09T21:43:04.099198+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:43:04.099198+0000","last_undegraded":"2023-07-09T21:43:04.099198+0000","last_fullsized":"2023-07-09T21:43:04.099198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:28:55.896008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.093053+0000","last_change":"2023-07-09T21:43:04.093053+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.093053+0000","last_undegraded":"2023-07-09T21:43:04.093053+0000","last_fullsized":"2023-07-09T21:43:04.093053+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.103639+0000","last_change":"2023-07-09T21:43:04.098406+0000","last_active":"2023-07-09T21:43:04.103639+0000","last_peered":"2023-07-09T21:43:04.103639+0000","last_clean":"2023-07-09T21:43:04.103639+0000","last_became_active":"2023-07-09T21:43:04.098107+0000","last_became_peered":"2023-07-09T21:43:04.098107+0000","last_unstale":"2023-07-09T21:43:04.103639+0000","last_undegraded":"2023-07-09T21:43:04.103639+0000","last_fullsized":"2023-07-09T21:43:04.103639+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:13.973295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":248,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.096527+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:43:04.096527+0000","last_peered":"2023-07-09T21:43:04.096527+0000","last_clean":"2023-07-09T21:43:04.096527+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:43:04.096527+0000","last_undegraded":"2023-07-09T21:43:04.096527+0000","last_fullsized":"2023-07-09T21:43:04.096527+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:33:34.432158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":156,"state":"creating+peering","last_fresh":"2023-07-09T21:43:04.095448+0000","last_change":"2023-07-09T21:43:04.095448+0000","last_active":"2023-07-09T21:43:04.080967+0000","last_peered":"2023-07-09T21:43:04.080967+0000","last_clean":"2023-07-09T21:43:04.080967+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:43:04.095448+0000","last_undegraded":"2023-07-09T21:43:04.095448+0000","last_fullsized":"2023-07-09T21:43:04.095448+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.115880+0000","last_change":"2023-07-09T21:43:04.113066+0000","last_active":"2023-07-09T21:43:04.115880+0000","last_peered":"2023-07-09T21:43:04.115880+0000","last_clean":"2023-07-09T21:43:04.115880+0000","last_became_active":"2023-07-09T21:43:04.112294+0000","last_became_peered":"2023-07-09T21:43:04.112294+0000","last_unstale":"2023-07-09T21:43:04.115880+0000","last_undegraded":"2023-07-09T21:43:04.115880+0000","last_fullsized":"2023-07-09T21:43:04.115880+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:20:53.222038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":256,"reported_epoch":156,"state":"active+clean","last_fresh":"2023-07-09T21:43:04.100492+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:43:04.100492+0000","last_peered":"2023-07-09T21:43:04.100492+0000","last_clean":"2023-07-09T21:43:04.100492+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:43:04.100492+0000","last_undegraded":"2023-07-09T21:43:04.100492+0000","last_fullsized":"2023-07-09T21:43:04.100492+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:14.958156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575094,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59764,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312076,"statfs":{"total":96636764160,"available":96575565824,"internally_reserved":0,"allocated":2535424,"data_stored":1579532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84999999999999998,"5min":1.03,"15min":1.03},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88300000000000001,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.68400000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88600000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.63400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.73099999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":1.754,"15min":1.754},"last":0.621},{"interface":"front","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96299999999999997,"5min":1.1140000000000001,"15min":1.129},"last":0.70399999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.438},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.47199999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":1.232,"15min":1.232},"last":0.58099999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.86799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.497},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.51200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575093,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.997,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.88900000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.60399999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.746,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":1.0229999999999999,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.60399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.64800000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.501,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.004,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.96199999999999997,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58599999999999997}]},{"osd":3,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76000000000000001,"15min":0.75900000000000001},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.48699999999999999},"max":{"1min":1.0660000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76100000000000001,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.69999999999999996,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":6.101,"15min":6.101},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.64600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.755}]},{"osd":5,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73899999999999999,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90900000000000003,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.79600000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":0.70099999999999996},"min":{"1min":0.53600000000000003,"5min":0.503,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44600000000000001},"max":{"1min":0.95399999999999996,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.81899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575092,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":50992,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320848,"statfs":{"total":96636764160,"available":96584548352,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.371,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":1.006},"last":0.56299999999999994}]},{"osd":1,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0409999999999999},"last":0.621},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.02},"last":0.497}]},{"osd":2,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.002,"15min":1.002},"last":0.64000000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94399999999999995,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.438},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.625},"min":{"1min":0.504,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.083,"15min":1.083},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.038},"last":0.57899999999999996}]},{"osd":7,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.34399999999999997},"max":{"1min":1.1060000000000001,"5min":1.107,"15min":1.107},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.59999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37028,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334812,"statfs":{"total":96636764160,"available":96598847488,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66700000000000004,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.95299999999999996},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.51400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.996,"15min":0.996},"last":0.79100000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.97999999999999998,"5min":1.083,"15min":1.083},"last":0.97999999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.97999999999999998},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69299999999999995,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.26},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.034,"15min":1.05},"last":1.008}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.024,"15min":1.024},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.72999999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91600000000000004,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.81100000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.097,"15min":1.097},"last":0.91200000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575093,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37040,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334800,"statfs":{"total":96636764160,"available":96598835200,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46700000000000003},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67500000000000004,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.497,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.46100000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52200000000000002,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.442},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.35399999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.101,"15min":1.101},"last":0.502},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80600000000000005,"5min":1.024,"15min":1.024},"last":0.53600000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.0529999999999999,"5min":1.111,"15min":1.3320000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.879},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.208},"last":0.83499999999999996}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.51},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97199999999999998,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.91200000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.083,"15min":1.127},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.034,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575094,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55076,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316764,"statfs":{"total":96636764160,"available":96580366336,"internally_reserved":0,"allocated":1929216,"data_stored":982516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.45600000000000002,"15min":0.46400000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.53200000000000003,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.496,"5min":0.5,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.70399999999999996,"5min":0.79200000000000004,"15min":0.80400000000000005},"last":0.73399999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.46700000000000003,"15min":0.47199999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.58899999999999997,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.374,"15min":0.32700000000000001},"max":{"1min":0.81200000000000006,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.78800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56200000000000006,"15min":0.57399999999999995},"min":{"1min":0.40200000000000002,"5min":0.372,"15min":0.372},"max":{"1min":0.628,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55200000000000005,"15min":0.55500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.78600000000000003,"5min":1.079,"15min":1.7050000000000001},"last":0.60999999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.76100000000000001,"15min":0.78900000000000003},"min":{"1min":0.58299999999999996,"5min":0.45900000000000002,"15min":0.40500000000000003},"max":{"1min":0.88900000000000001,"5min":1.21,"15min":1.3360000000000001},"last":0.996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77700000000000002,"15min":0.80800000000000005},"min":{"1min":0.52100000000000002,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":0.998,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":1.123}]},{"osd":5,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.78800000000000003,"15min":0.81699999999999995},"min":{"1min":0.62,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":0.999,"5min":1.371,"15min":1.377},"last":1.081},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.78000000000000003,"15min":0.81000000000000005},"min":{"1min":0.58599999999999997,"5min":0.52000000000000002,"15min":0.46100000000000002},"max":{"1min":0.873,"5min":1.353,"15min":1.4590000000000001},"last":0.876}]},{"osd":6,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.80100000000000005,"15min":0.82999999999999996},"min":{"1min":0.64400000000000002,"5min":0.51400000000000001,"15min":0.50800000000000001},"max":{"1min":0.92400000000000004,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77200000000000002,"15min":0.79800000000000004},"min":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.42599999999999999},"max":{"1min":0.91700000000000004,"5min":1.3400000000000001,"15min":1.423},"last":0.94599999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:42:02 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.78300000000000003,"15min":0.82299999999999995},"min":{"1min":0.59599999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95099999999999996,"5min":1.252,"15min":1.48},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.80500000000000005,"15min":0.83799999999999997},"min":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.46100000000000002},"max":{"1min":0.92500000000000004,"5min":1.3999999999999999,"15min":1.496},"last":1.056}]}]},{"osd":1,"up_from":13,"seq":55834575094,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1896,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1941504,"data_stored":989164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.76800000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.96999999999999997},"last":0.53800000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77500000000000002,"15min":1.3069999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.89300000000000002},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.0169999999999999,"5min":1.129,"15min":1.155},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78100000000000003,"15min":0.81000000000000005},"min":{"1min":0.60599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.212},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96499999999999997,"5min":1.177,"15min":1.1839999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.56799999999999995,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.024,"5min":1.1160000000000001,"15min":1.149},"last":0.67600000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.038,"5min":1.2,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.0349999999999999,"5min":1.1699999999999999,"15min":1.258},"last":0.56299999999999994}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98799999999999999,"5min":1.107,"15min":1.173},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1899999999999999,"15min":1.2929999999999999},"last":0.60599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575094,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37608,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334232,"statfs":{"total":96636764160,"available":96598253568,"internally_reserved":0,"allocated":2523136,"data_stored":1572884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60099999999999998,"5min":0.67600000000000005,"15min":0.753},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.629,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.42999999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":1.657,"15min":1.657},"last":0.48699999999999999}]},{"osd":3,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.502}]},{"osd":4,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":1.835,"15min":1.835},"last":0.96699999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.726,"15min":1.726},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":1.615,"15min":1.615},"last":0.88800000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.76500000000000001,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90800000000000003,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"max":{"1min":0.85299999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.85399999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":0.93200000000000005,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":1.883,"15min":1.883},"last":0.92400000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:43:10.022 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3f is not active+clean 2023-07-09T21:43:10.023 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.102346+0000', 'last_change': '2023-07-09T21:43:04.102346+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.102346+0000', 'last_undegraded': '2023-07-09T21:43:04.102346+0000', 'last_fullsized': '2023-07-09T21:43:04.102346+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.023 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3e is not active+clean 2023-07-09T21:43:10.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094718+0000', 'last_change': '2023-07-09T21:43:04.094718+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094718+0000', 'last_undegraded': '2023-07-09T21:43:04.094718+0000', 'last_fullsized': '2023-07-09T21:43:04.094718+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.024 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-07-09T21:43:10.024 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.106932+0000', 'last_change': '2023-07-09T21:43:04.106932+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.106932+0000', 'last_undegraded': '2023-07-09T21:43:04.106932+0000', 'last_fullsized': '2023-07-09T21:43:04.106932+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3c is not active+clean 2023-07-09T21:43:10.025 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094340+0000', 'last_change': '2023-07-09T21:43:04.094340+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094340+0000', 'last_undegraded': '2023-07-09T21:43:04.094340+0000', 'last_fullsized': '2023-07-09T21:43:04.094340+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.025 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3b is not active+clean 2023-07-09T21:43:10.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093239+0000', 'last_change': '2023-07-09T21:43:04.093239+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093239+0000', 'last_undegraded': '2023-07-09T21:43:04.093239+0000', 'last_fullsized': '2023-07-09T21:43:04.093239+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.026 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-07-09T21:43:10.026 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095531+0000', 'last_change': '2023-07-09T21:43:04.095531+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095531+0000', 'last_undegraded': '2023-07-09T21:43:04.095531+0000', 'last_fullsized': '2023-07-09T21:43:04.095531+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.39 is not active+clean 2023-07-09T21:43:10.027 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.096766+0000', 'last_change': '2023-07-09T21:43:04.096766+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.096766+0000', 'last_undegraded': '2023-07-09T21:43:04.096766+0000', 'last_fullsized': '2023-07-09T21:43:04.096766+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.027 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-07-09T21:43:10.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.100114+0000', 'last_change': '2023-07-09T21:43:04.100114+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.100114+0000', 'last_undegraded': '2023-07-09T21:43:04.100114+0000', 'last_fullsized': '2023-07-09T21:43:04.100114+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:43:10.028 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-07-09T21:43:10.028 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.096895+0000', 'last_change': '2023-07-09T21:43:04.096895+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.096895+0000', 'last_undegraded': '2023-07-09T21:43:04.096895+0000', 'last_fullsized': '2023-07-09T21:43:04.096895+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.36 is not active+clean 2023-07-09T21:43:10.029 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.096892+0000', 'last_change': '2023-07-09T21:43:04.096892+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.096892+0000', 'last_undegraded': '2023-07-09T21:43:04.096892+0000', 'last_fullsized': '2023-07-09T21:43:04.096892+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.029 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.35 is not active+clean 2023-07-09T21:43:10.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095050+0000', 'last_change': '2023-07-09T21:43:04.095050+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095050+0000', 'last_undegraded': '2023-07-09T21:43:04.095050+0000', 'last_fullsized': '2023-07-09T21:43:04.095050+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.030 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.34 is not active+clean 2023-07-09T21:43:10.030 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.103102+0000', 'last_change': '2023-07-09T21:43:04.103102+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.103102+0000', 'last_undegraded': '2023-07-09T21:43:04.103102+0000', 'last_fullsized': '2023-07-09T21:43:04.103102+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-07-09T21:43:10.031 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094245+0000', 'last_change': '2023-07-09T21:43:04.094245+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094245+0000', 'last_undegraded': '2023-07-09T21:43:04.094245+0000', 'last_fullsized': '2023-07-09T21:43:04.094245+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.031 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.32 is not active+clean 2023-07-09T21:43:10.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.101782+0000', 'last_change': '2023-07-09T21:43:04.101782+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.101782+0000', 'last_undegraded': '2023-07-09T21:43:04.101782+0000', 'last_fullsized': '2023-07-09T21:43:04.101782+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.032 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.31 is not active+clean 2023-07-09T21:43:10.032 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094077+0000', 'last_change': '2023-07-09T21:43:04.094077+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094077+0000', 'last_undegraded': '2023-07-09T21:43:04.094077+0000', 'last_fullsized': '2023-07-09T21:43:04.094077+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-07-09T21:43:10.033 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095881+0000', 'last_change': '2023-07-09T21:43:04.095881+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095881+0000', 'last_undegraded': '2023-07-09T21:43:04.095881+0000', 'last_fullsized': '2023-07-09T21:43:04.095881+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.033 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-07-09T21:43:10.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093125+0000', 'last_change': '2023-07-09T21:43:04.093125+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093125+0000', 'last_undegraded': '2023-07-09T21:43:04.093125+0000', 'last_fullsized': '2023-07-09T21:43:04.093125+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.034 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2e is not active+clean 2023-07-09T21:43:10.034 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095200+0000', 'last_change': '2023-07-09T21:43:04.095200+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095200+0000', 'last_undegraded': '2023-07-09T21:43:04.095200+0000', 'last_fullsized': '2023-07-09T21:43:04.095200+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2d is not active+clean 2023-07-09T21:43:10.035 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.098174+0000', 'last_change': '2023-07-09T21:43:04.098174+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.098174+0000', 'last_undegraded': '2023-07-09T21:43:04.098174+0000', 'last_fullsized': '2023-07-09T21:43:04.098174+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.035 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2c is not active+clean 2023-07-09T21:43:10.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094451+0000', 'last_change': '2023-07-09T21:43:04.094451+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094451+0000', 'last_undegraded': '2023-07-09T21:43:04.094451+0000', 'last_fullsized': '2023-07-09T21:43:04.094451+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.036 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2b is not active+clean 2023-07-09T21:43:10.036 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094248+0000', 'last_change': '2023-07-09T21:43:04.094248+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094248+0000', 'last_undegraded': '2023-07-09T21:43:04.094248+0000', 'last_fullsized': '2023-07-09T21:43:04.094248+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2a is not active+clean 2023-07-09T21:43:10.037 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.101258+0000', 'last_change': '2023-07-09T21:43:04.101258+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.101258+0000', 'last_undegraded': '2023-07-09T21:43:04.101258+0000', 'last_fullsized': '2023-07-09T21:43:04.101258+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.037 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.29 is not active+clean 2023-07-09T21:43:10.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094276+0000', 'last_change': '2023-07-09T21:43:04.094276+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094276+0000', 'last_undegraded': '2023-07-09T21:43:04.094276+0000', 'last_fullsized': '2023-07-09T21:43:04.094276+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.038 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-07-09T21:43:10.038 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095344+0000', 'last_change': '2023-07-09T21:43:04.095344+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095344+0000', 'last_undegraded': '2023-07-09T21:43:04.095344+0000', 'last_fullsized': '2023-07-09T21:43:04.095344+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-07-09T21:43:10.039 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.106434+0000', 'last_change': '2023-07-09T21:43:04.106434+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.106434+0000', 'last_undegraded': '2023-07-09T21:43:04.106434+0000', 'last_fullsized': '2023-07-09T21:43:04.106434+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.039 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-07-09T21:43:10.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.106362+0000', 'last_change': '2023-07-09T21:43:04.106362+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.106362+0000', 'last_undegraded': '2023-07-09T21:43:04.106362+0000', 'last_fullsized': '2023-07-09T21:43:04.106362+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.040 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.25 is not active+clean 2023-07-09T21:43:10.040 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.097667+0000', 'last_change': '2023-07-09T21:43:04.097667+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.097667+0000', 'last_undegraded': '2023-07-09T21:43:04.097667+0000', 'last_fullsized': '2023-07-09T21:43:04.097667+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.24 is not active+clean 2023-07-09T21:43:10.041 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.098581+0000', 'last_change': '2023-07-09T21:43:04.098581+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.098581+0000', 'last_undegraded': '2023-07-09T21:43:04.098581+0000', 'last_fullsized': '2023-07-09T21:43:04.098581+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.041 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-07-09T21:43:10.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.106428+0000', 'last_change': '2023-07-09T21:43:04.106428+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.106428+0000', 'last_undegraded': '2023-07-09T21:43:04.106428+0000', 'last_fullsized': '2023-07-09T21:43:04.106428+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.042 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-07-09T21:43:10.042 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.106342+0000', 'last_change': '2023-07-09T21:43:04.106342+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.106342+0000', 'last_undegraded': '2023-07-09T21:43:04.106342+0000', 'last_fullsized': '2023-07-09T21:43:04.106342+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-07-09T21:43:10.043 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.099430+0000', 'last_change': '2023-07-09T21:43:04.099430+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.099430+0000', 'last_undegraded': '2023-07-09T21:43:04.099430+0000', 'last_fullsized': '2023-07-09T21:43:04.099430+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:43:10.043 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.20 is not active+clean 2023-07-09T21:43:10.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.097353+0000', 'last_change': '2023-07-09T21:43:04.097353+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.097353+0000', 'last_undegraded': '2023-07-09T21:43:04.097353+0000', 'last_fullsized': '2023-07-09T21:43:04.097353+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.044 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-07-09T21:43:10.044 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.099391+0000', 'last_change': '2023-07-09T21:43:04.099391+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.099391+0000', 'last_undegraded': '2023-07-09T21:43:04.099391+0000', 'last_fullsized': '2023-07-09T21:43:04.099391+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:43:10.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-07-09T21:43:10.045 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093609+0000', 'last_change': '2023-07-09T21:43:04.093609+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093609+0000', 'last_undegraded': '2023-07-09T21:43:04.093609+0000', 'last_fullsized': '2023-07-09T21:43:04.093609+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.045 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-07-09T21:43:10.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094504+0000', 'last_change': '2023-07-09T21:43:04.094504+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094504+0000', 'last_undegraded': '2023-07-09T21:43:04.094504+0000', 'last_fullsized': '2023-07-09T21:43:04.094504+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.046 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-07-09T21:43:10.046 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.100725+0000', 'last_change': '2023-07-09T21:43:04.100725+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.100725+0000', 'last_undegraded': '2023-07-09T21:43:04.100725+0000', 'last_fullsized': '2023-07-09T21:43:04.100725+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-07-09T21:43:10.047 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.101065+0000', 'last_change': '2023-07-09T21:43:04.101065+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.101065+0000', 'last_undegraded': '2023-07-09T21:43:04.101065+0000', 'last_fullsized': '2023-07-09T21:43:04.101065+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:43:10.047 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-07-09T21:43:10.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.100922+0000', 'last_change': '2023-07-09T21:43:04.100922+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.100922+0000', 'last_undegraded': '2023-07-09T21:43:04.100922+0000', 'last_fullsized': '2023-07-09T21:43:04.100922+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:43:10.048 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-07-09T21:43:10.048 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094718+0000', 'last_change': '2023-07-09T21:43:04.094718+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094718+0000', 'last_undegraded': '2023-07-09T21:43:04.094718+0000', 'last_fullsized': '2023-07-09T21:43:04.094718+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-07-09T21:43:10.049 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.098246+0000', 'last_change': '2023-07-09T21:43:04.098246+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.098246+0000', 'last_undegraded': '2023-07-09T21:43:04.098246+0000', 'last_fullsized': '2023-07-09T21:43:04.098246+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.049 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-07-09T21:43:10.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.104416+0000', 'last_change': '2023-07-09T21:43:04.104416+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.104416+0000', 'last_undegraded': '2023-07-09T21:43:04.104416+0000', 'last_fullsized': '2023-07-09T21:43:04.104416+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.050 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-07-09T21:43:10.050 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.096276+0000', 'last_change': '2023-07-09T21:43:04.096276+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.096276+0000', 'last_undegraded': '2023-07-09T21:43:04.096276+0000', 'last_fullsized': '2023-07-09T21:43:04.096276+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-07-09T21:43:10.051 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.099578+0000', 'last_change': '2023-07-09T21:43:04.099578+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.099578+0000', 'last_undegraded': '2023-07-09T21:43:04.099578+0000', 'last_fullsized': '2023-07-09T21:43:04.099578+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.051 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-07-09T21:43:10.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.098655+0000', 'last_change': '2023-07-09T21:43:04.098655+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.098655+0000', 'last_undegraded': '2023-07-09T21:43:04.098655+0000', 'last_fullsized': '2023-07-09T21:43:04.098655+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.052 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-07-09T21:43:10.052 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093872+0000', 'last_change': '2023-07-09T21:43:04.093872+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093872+0000', 'last_undegraded': '2023-07-09T21:43:04.093872+0000', 'last_fullsized': '2023-07-09T21:43:04.093872+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-07-09T21:43:10.053 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093112+0000', 'last_change': '2023-07-09T21:43:04.093112+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093112+0000', 'last_undegraded': '2023-07-09T21:43:04.093112+0000', 'last_fullsized': '2023-07-09T21:43:04.093112+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.053 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-07-09T21:43:10.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094161+0000', 'last_change': '2023-07-09T21:43:04.094161+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094161+0000', 'last_undegraded': '2023-07-09T21:43:04.094161+0000', 'last_fullsized': '2023-07-09T21:43:04.094161+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.054 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-07-09T21:43:10.054 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094755+0000', 'last_change': '2023-07-09T21:43:04.094755+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094755+0000', 'last_undegraded': '2023-07-09T21:43:04.094755+0000', 'last_fullsized': '2023-07-09T21:43:04.094755+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:43:10.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-07-09T21:43:10.055 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094206+0000', 'last_change': '2023-07-09T21:43:04.094206+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094206+0000', 'last_undegraded': '2023-07-09T21:43:04.094206+0000', 'last_fullsized': '2023-07-09T21:43:04.094206+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.055 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-07-09T21:43:10.056 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.104326+0000', 'last_change': '2023-07-09T21:43:04.104326+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.104326+0000', 'last_undegraded': '2023-07-09T21:43:04.104326+0000', 'last_fullsized': '2023-07-09T21:43:04.104326+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.056 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-07-09T21:43:10.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.100046+0000', 'last_change': '2023-07-09T21:43:04.100046+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.100046+0000', 'last_undegraded': '2023-07-09T21:43:04.100046+0000', 'last_fullsized': '2023-07-09T21:43:04.100046+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.057 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-07-09T21:43:10.057 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.097332+0000', 'last_change': '2023-07-09T21:43:04.097332+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.097332+0000', 'last_undegraded': '2023-07-09T21:43:04.097332+0000', 'last_fullsized': '2023-07-09T21:43:04.097332+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-07-09T21:43:10.058 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093307+0000', 'last_change': '2023-07-09T21:43:04.093307+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093307+0000', 'last_undegraded': '2023-07-09T21:43:04.093307+0000', 'last_fullsized': '2023-07-09T21:43:04.093307+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.058 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-07-09T21:43:10.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.094775+0000', 'last_change': '2023-07-09T21:43:04.094775+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.094775+0000', 'last_undegraded': '2023-07-09T21:43:04.094775+0000', 'last_fullsized': '2023-07-09T21:43:04.094775+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.059 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-07-09T21:43:10.059 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093433+0000', 'last_change': '2023-07-09T21:43:04.093433+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093433+0000', 'last_undegraded': '2023-07-09T21:43:04.093433+0000', 'last_fullsized': '2023-07-09T21:43:04.093433+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-07-09T21:43:10.060 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.097747+0000', 'last_change': '2023-07-09T21:43:04.097747+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.097747+0000', 'last_undegraded': '2023-07-09T21:43:04.097747+0000', 'last_fullsized': '2023-07-09T21:43:04.097747+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.060 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-07-09T21:43:10.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.104972+0000', 'last_change': '2023-07-09T21:43:04.104972+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.104972+0000', 'last_undegraded': '2023-07-09T21:43:04.104972+0000', 'last_fullsized': '2023-07-09T21:43:04.104972+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.061 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-07-09T21:43:10.061 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095908+0000', 'last_change': '2023-07-09T21:43:04.095908+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095908+0000', 'last_undegraded': '2023-07-09T21:43:04.095908+0000', 'last_fullsized': '2023-07-09T21:43:04.095908+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:43:10.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-07-09T21:43:10.062 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095558+0000', 'last_change': '2023-07-09T21:43:04.095558+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095558+0000', 'last_undegraded': '2023-07-09T21:43:04.095558+0000', 'last_fullsized': '2023-07-09T21:43:04.095558+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:43:10.062 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-07-09T21:43:10.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.098094+0000', 'last_change': '2023-07-09T21:43:04.098094+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.098094+0000', 'last_undegraded': '2023-07-09T21:43:04.098094+0000', 'last_fullsized': '2023-07-09T21:43:04.098094+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:43:10.063 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-07-09T21:43:10.063 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.104323+0000', 'last_change': '2023-07-09T21:43:04.104323+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.104323+0000', 'last_undegraded': '2023-07-09T21:43:04.104323+0000', 'last_fullsized': '2023-07-09T21:43:04.104323+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-07-09T21:43:10.064 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.104447+0000', 'last_change': '2023-07-09T21:43:04.104447+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.104447+0000', 'last_undegraded': '2023-07-09T21:43:04.104447+0000', 'last_fullsized': '2023-07-09T21:43:04.104447+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:43:10.064 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-07-09T21:43:10.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.093053+0000', 'last_change': '2023-07-09T21:43:04.093053+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.093053+0000', 'last_undegraded': '2023-07-09T21:43:04.093053+0000', 'last_fullsized': '2023-07-09T21:43:04.093053+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:43:10.065 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-07-09T21:43:10.065 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 156, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:43:04.095448+0000', 'last_change': '2023-07-09T21:43:04.095448+0000', 'last_active': '2023-07-09T21:43:04.080967+0000', 'last_peered': '2023-07-09T21:43:04.080967+0000', 'last_clean': '2023-07-09T21:43:04.080967+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:43:04.095448+0000', 'last_undegraded': '2023-07-09T21:43:04.095448+0000', 'last_fullsized': '2023-07-09T21:43:04.095448+0000', 'mapping_epoch': 156, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 156, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'last_clean_scrub_stamp': '2023-07-09T21:43:04.080967+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:43:10.066 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:43:10.074 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-09T21:43:10.075+0000 7f5250823640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.207+0000 7fb1ce3fa640 1 Processor -- start 2023-07-09T21:43:10.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.207+0000 7fb1ce3fa640 1 -- start start 2023-07-09T21:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1ce3fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1ce3fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c80cef80 0x7fb1c80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1ce3fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80b49f0 con 0x7fb1c80b4170 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1ce3fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80b7e80 con 0x7fb1c80cef80 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1ce3fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80b45f0 con 0x7fb1c80b7ab0 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c80cef80 0x7fb1c80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb1c80cef80 0x7fb1c80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55196/0 (socket says 172.21.15.37:55196) 2023-07-09T21:43:10.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 -- 172.21.15.37:0/2732139327 learned_addr learned my addr 172.21.15.37:0/2732139327 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c7fff640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 -- 172.21.15.37:0/2732139327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 msgr2=0x7fb1c806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 -- 172.21.15.37:0/2732139327 >> v1:172.21.15.119:6789/0 conn(0x7fb1c80b4170 legacy=0x7fb1c815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.211+0000 7fb1c77fe640 1 -- 172.21.15.37:0/2732139327 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80cc8a0 con 0x7fb1c80cef80 2023-07-09T21:43:10.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1c77fe640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c80b3c30 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30703f1770bfd11 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1c6ffd640 1 -- 172.21.15.37:0/2732139327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0aa670 con 0x7fb1c80cef80 2023-07-09T21:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1c6ffd640 1 -- 172.21.15.37:0/2732139327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1bc0aa7d0 con 0x7fb1c80cef80 2023-07-09T21:43:10.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1c6ffd640 1 -- 172.21.15.37:0/2732139327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1bc0aab60 con 0x7fb1c80cef80 2023-07-09T21:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/2732139327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 msgr2=0x7fb1c80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c80b3c30 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc009870 tx=0x7fb1bc01c510 comp rx=0 tx=0).stop 2023-07-09T21:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/2732139327 shutdown_connections 2023-07-09T21:43:10.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c80b3c30 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/2732139327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/2732139327 >> 172.21.15.37:0/2732139327 conn(0x7fb1c8073090 msgr2=0x7fb1c8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/2732139327 shutdown_connections 2023-07-09T21:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/2732139327 wait complete. 2023-07-09T21:43:10.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 Processor -- start 2023-07-09T21:43:10.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 -- start start 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.215+0000 7fb1ce3fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c80b4170 0x7fb1c80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c8147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80c6330 con 0x7fb1c80cef80 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8149870 con 0x7fb1c80b4170 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c8157fb0 con 0x7fb1c80b7ab0 2023-07-09T21:43:10.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55212/0 (socket says 172.21.15.37:55212) 2023-07-09T21:43:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 -- 172.21.15.37:0/1892108624 learned_addr learned my addr 172.21.15.37:0/1892108624 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c7fff640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c80b4170 0x7fb1c80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c77fe640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c8147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 -- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 msgr2=0x7fb1c8147720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c8147720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 -- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c80b4170 msgr2=0x7fb1c80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c80b4170 0x7fb1c80c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 -- 172.21.15.37:0/1892108624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1bc0094d0 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1cc997640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c730 tx=0x7fb1c000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0003b80 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c0003ce0 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000aa30 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c8158290 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80c5fc0 con 0x7fb1c80cef80 2023-07-09T21:43:10.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c80c64a0 con 0x7fb1c80cef80 2023-07-09T21:43:10.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.219+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb1c000ab90 con 0x7fb1c80cef80 2023-07-09T21:43:10.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.223+0000 7fb1c4ff9640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 0x7fb1b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.223+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fb1c0083b40 con 0x7fb1c80cef80 2023-07-09T21:43:10.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.223+0000 7fb1c7fff640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 0x7fb1b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.223+0000 7fb1c7fff640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 0x7fb1b4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009b60 tx=0x7fb1b8009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.227+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb1c0050f30 con 0x7fb1c80cef80 2023-07-09T21:43:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb1c804d7d0 con 0x7fb1c80cef80 2023-07-09T21:43:10.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1c4ff9640 1 -- 172.21.15.37:0/1892108624 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3232 (secure 0 0 0) 0x7fb1c0054550 con 0x7fb1c80cef80 2023-07-09T21:43:10.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:10.440 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":1265,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":158,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":355819520,"bytes_avail":772738293760,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":69,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":9534}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-07-09T21:42:52.765782+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:43:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 msgr2=0x7fb1b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 0x7fb1b4068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8009b60 tx=0x7fb1b8009190 comp rx=0 tx=0).stop 2023-07-09T21:43:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 msgr2=0x7fb1c814ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000c730 tx=0x7fb1c000cbf0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 shutdown_connections 2023-07-09T21:43:10.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fb1b40663a0 0x7fb1b4068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1c80cef80 0x7fb1c814ae80 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb1c80b7ab0 0x7fb1c8147720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 --2- 172.21.15.37:0/1892108624 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb1c80b4170 0x7fb1c80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 >> 172.21.15.37:0/1892108624 conn(0x7fb1c8073090 msgr2=0x7fb1c80b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 shutdown_connections 2023-07-09T21:43:10.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.439+0000 7fb1ce3fa640 1 -- 172.21.15.37:0/1892108624 wait complete. 2023-07-09T21:43:10.461 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:43:10.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:43:10.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 Processor -- start 2023-07-09T21:43:10.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 -- start start 2023-07-09T21:43:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 0x7f34fc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0b49f0 con 0x7f34fc0cef80 2023-07-09T21:43:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34fc0cc8a0 con 0x7f34fc0b7ab0 2023-07-09T21:43:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3504559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0b7e80 con 0x7f34fc0b4340 2023-07-09T21:43:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3502af6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f34fc0cef80 0x7f34fc0d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33698/0 (socket says 172.21.15.37:33698) 2023-07-09T21:43:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3502af6640 1 -- 172.21.15.37:0/4151796334 learned_addr learned my addr 172.21.15.37:0/4151796334 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:10.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3501af4640 1 --2- 172.21.15.37:0/4151796334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 0x7f34fc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2632621205 0 0) 0x7f34fc0b49f0 con 0x7f34fc0cef80 2023-07-09T21:43:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34e8003530 con 0x7f34fc0cef80 2023-07-09T21:43:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773292356 0 0) 0x7f34fc0cc8a0 con 0x7f34fc0b7ab0 2023-07-09T21:43:10.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc0b49f0 con 0x7f34fc0b7ab0 2023-07-09T21:43:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3501af4640 1 -- 172.21.15.37:0/4151796334 >> v1:172.21.15.119:6789/0 conn(0x7f34fc0b7ab0 legacy=0x7f34fc0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3501af4640 1 -- 172.21.15.37:0/4151796334 >> v1:172.21.15.37:6789/0 conn(0x7f34fc0cef80 legacy=0x7f34fc0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.647+0000 7f3501af4640 1 -- 172.21.15.37:0/4151796334 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc0ccb80 con 0x7f34fc0b4340 2023-07-09T21:43:10.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3501af4640 1 --2- 172.21.15.37:0/4151796334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 0x7f34fc06aa50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097f0 tx=0x7f34ec01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c7cd2631bbf20bb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0aa5f0 con 0x7f34fc0b4340 2023-07-09T21:43:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0aa750 con 0x7f34fc0b4340 2023-07-09T21:43:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f35012f3640 1 -- 172.21.15.37:0/4151796334 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0aaae0 con 0x7f34fc0b4340 2023-07-09T21:43:10.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 -- 172.21.15.37:0/4151796334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 msgr2=0x7f34fc06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 --2- 172.21.15.37:0/4151796334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 0x7f34fc06aa50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0097f0 tx=0x7f34ec01c490 comp rx=0 tx=0).stop 2023-07-09T21:43:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 -- 172.21.15.37:0/4151796334 shutdown_connections 2023-07-09T21:43:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 --2- 172.21.15.37:0/4151796334 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0b4340 0x7f34fc06aa50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 -- 172.21.15.37:0/4151796334 >> 172.21.15.37:0/4151796334 conn(0x7f34fc073090 msgr2=0x7f34fc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 -- 172.21.15.37:0/4151796334 shutdown_connections 2023-07-09T21:43:10.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.651+0000 7f3504559640 1 -- 172.21.15.37:0/4151796334 wait complete. 2023-07-09T21:43:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 Processor -- start 2023-07-09T21:43:10.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- start start 2023-07-09T21:43:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34fc0b7ab0 0x7f34fc0cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0cef80 0x7f34fc0cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc0d31a0 con 0x7f34fc0b4340 2023-07-09T21:43:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc1581e0 con 0x7f34fc0b7ab0 2023-07-09T21:43:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc156040 con 0x7f34fc0cef80 2023-07-09T21:43:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55214/0 (socket says 172.21.15.37:55214) 2023-07-09T21:43:10.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 -- 172.21.15.37:0/3329764954 learned_addr learned my addr 172.21.15.37:0/3329764954 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 -- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0cef80 msgr2=0x7f34fc0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0cef80 0x7f34fc0cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 -- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34fc0b7ab0 msgr2=0x7f34fc0cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34fc0b7ab0 0x7f34fc0cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 -- 172.21.15.37:0/3329764954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009420 con 0x7f34fc0b4340 2023-07-09T21:43:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f35022f5640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c490 tx=0x7f34f800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f80052d0 con 0x7f34fc0b4340 2023-07-09T21:43:10.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f8005430 con 0x7f34fc0b4340 2023-07-09T21:43:10.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f8012870 con 0x7f34fc0b4340 2023-07-09T21:43:10.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34fc0b3460 con 0x7f34fc0b4340 2023-07-09T21:43:10.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.655+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34fc0d27e0 con 0x7f34fc0b4340 2023-07-09T21:43:10.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.659+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34fc04d7d0 con 0x7f34fc0b4340 2023-07-09T21:43:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.659+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f34f80129d0 con 0x7f34fc0b4340 2023-07-09T21:43:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.659+0000 7f34f2ffd640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 0x7f34e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:10.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.659+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f34f8083a80 con 0x7f34fc0b4340 2023-07-09T21:43:10.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.659+0000 7f3501af4640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 0x7f34e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:10.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.663+0000 7f3501af4640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 0x7f34e0068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ae000 tx=0x7f34ec008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:10.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.663+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f34f8050dc0 con 0x7f34fc0b4340 2023-07-09T21:43:10.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.815+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f34fc0cf4d0 con 0x7f34e00663a0 2023-07-09T21:43:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f34f2ffd640 1 -- 172.21.15.37:0/3329764954 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311785 (secure 0 0 0) 0x7f34ec0aa5b0 con 0x7f34e00663a0 2023-07-09T21:43:10.829 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:43:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 msgr2=0x7f34e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 0x7f34e0068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f34ec0ae000 tx=0x7f34ec008040 comp rx=0 tx=0).stop 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 msgr2=0x7f34fc0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f34f800c490 tx=0x7f34f800c950 comp rx=0 tx=0).stop 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 shutdown_connections 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f34e00663a0 0x7f34e0068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f34fc0cef80 0x7f34fc0cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f34fc0b7ab0 0x7f34fc0cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 --2- 172.21.15.37:0/3329764954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34fc0b4340 0x7f34fc0c8110 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 >> 172.21.15.37:0/3329764954 conn(0x7f34fc073090 msgr2=0x7f34fc0b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 shutdown_connections 2023-07-09T21:43:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:10.827+0000 7f3504559640 1 -- 172.21.15.37:0/3329764954 wait complete. 2023-07-09T21:43:10.849 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:43:10.769787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347784,"kb_used_data":16584,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754626936,"statfs":{"total":773094113280,"available":772737982464,"internally_reserved":0,"allocated":16982016,"data_stored":9209468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.678117"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189100+0000","last_change":"2023-07-09T21:43:05.134171+0000","last_active":"2023-07-09T21:43:06.189100+0000","last_peered":"2023-07-09T21:43:06.189100+0000","last_clean":"2023-07-09T21:43:06.189100+0000","last_became_active":"2023-07-09T21:43:05.133858+0000","last_became_peered":"2023-07-09T21:43:05.133858+0000","last_unstale":"2023-07-09T21:43:06.189100+0000","last_undegraded":"2023-07-09T21:43:06.189100+0000","last_fullsized":"2023-07-09T21:43:06.189100+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:43.897593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140551+0000","last_change":"2023-07-09T21:43:05.132799+0000","last_active":"2023-07-09T21:43:06.140551+0000","last_peered":"2023-07-09T21:43:06.140551+0000","last_clean":"2023-07-09T21:43:06.140551+0000","last_became_active":"2023-07-09T21:43:05.132518+0000","last_became_peered":"2023-07-09T21:43:05.132518+0000","last_unstale":"2023-07-09T21:43:06.140551+0000","last_undegraded":"2023-07-09T21:43:06.140551+0000","last_fullsized":"2023-07-09T21:43:06.140551+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:32:17.043376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193895+0000","last_change":"2023-07-09T21:43:05.144417+0000","last_active":"2023-07-09T21:43:06.193895+0000","last_peered":"2023-07-09T21:43:06.193895+0000","last_clean":"2023-07-09T21:43:06.193895+0000","last_became_active":"2023-07-09T21:43:05.142699+0000","last_became_peered":"2023-07-09T21:43:05.142699+0000","last_unstale":"2023-07-09T21:43:06.193895+0000","last_undegraded":"2023-07-09T21:43:06.193895+0000","last_fullsized":"2023-07-09T21:43:06.193895+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:48:59.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140138+0000","last_change":"2023-07-09T21:43:05.132709+0000","last_active":"2023-07-09T21:43:06.140138+0000","last_peered":"2023-07-09T21:43:06.140138+0000","last_clean":"2023-07-09T21:43:06.140138+0000","last_became_active":"2023-07-09T21:43:05.132386+0000","last_became_peered":"2023-07-09T21:43:05.132386+0000","last_unstale":"2023-07-09T21:43:06.140138+0000","last_undegraded":"2023-07-09T21:43:06.140138+0000","last_fullsized":"2023-07-09T21:43:06.140138+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:51.203743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135445+0000","last_change":"2023-07-09T21:43:05.129155+0000","last_active":"2023-07-09T21:43:06.135445+0000","last_peered":"2023-07-09T21:43:06.135445+0000","last_clean":"2023-07-09T21:43:06.135445+0000","last_became_active":"2023-07-09T21:43:05.128845+0000","last_became_peered":"2023-07-09T21:43:05.128845+0000","last_unstale":"2023-07-09T21:43:06.135445+0000","last_undegraded":"2023-07-09T21:43:06.135445+0000","last_fullsized":"2023-07-09T21:43:06.135445+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:26:11.120356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189260+0000","last_change":"2023-07-09T21:43:05.135509+0000","last_active":"2023-07-09T21:43:06.189260+0000","last_peered":"2023-07-09T21:43:06.189260+0000","last_clean":"2023-07-09T21:43:06.189260+0000","last_became_active":"2023-07-09T21:43:05.135223+0000","last_became_peered":"2023-07-09T21:43:05.135223+0000","last_unstale":"2023-07-09T21:43:06.189260+0000","last_undegraded":"2023-07-09T21:43:06.189260+0000","last_fullsized":"2023-07-09T21:43:06.189260+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:46:26.609589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139881+0000","last_change":"2023-07-09T21:43:05.145123+0000","last_active":"2023-07-09T21:43:06.139881+0000","last_peered":"2023-07-09T21:43:06.139881+0000","last_clean":"2023-07-09T21:43:06.139881+0000","last_became_active":"2023-07-09T21:43:05.144828+0000","last_became_peered":"2023-07-09T21:43:05.144828+0000","last_unstale":"2023-07-09T21:43:06.139881+0000","last_undegraded":"2023-07-09T21:43:06.139881+0000","last_fullsized":"2023-07-09T21:43:06.139881+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:35.391416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193434+0000","last_change":"2023-07-09T21:43:05.135847+0000","last_active":"2023-07-09T21:43:06.193434+0000","last_peered":"2023-07-09T21:43:06.193434+0000","last_clean":"2023-07-09T21:43:06.193434+0000","last_became_active":"2023-07-09T21:43:05.134268+0000","last_became_peered":"2023-07-09T21:43:05.134268+0000","last_unstale":"2023-07-09T21:43:06.193434+0000","last_undegraded":"2023-07-09T21:43:06.193434+0000","last_fullsized":"2023-07-09T21:43:06.193434+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:26.439217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.190042+0000","last_change":"2023-07-09T21:43:05.130704+0000","last_active":"2023-07-09T21:43:06.190042+0000","last_peered":"2023-07-09T21:43:06.190042+0000","last_clean":"2023-07-09T21:43:06.190042+0000","last_became_active":"2023-07-09T21:43:05.130395+0000","last_became_peered":"2023-07-09T21:43:05.130395+0000","last_unstale":"2023-07-09T21:43:06.190042+0000","last_undegraded":"2023-07-09T21:43:06.190042+0000","last_fullsized":"2023-07-09T21:43:06.190042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:37.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189022+0000","last_change":"2023-07-09T21:43:05.129087+0000","last_active":"2023-07-09T21:43:06.189022+0000","last_peered":"2023-07-09T21:43:06.189022+0000","last_clean":"2023-07-09T21:43:06.189022+0000","last_became_active":"2023-07-09T21:43:05.128731+0000","last_became_peered":"2023-07-09T21:43:05.128731+0000","last_unstale":"2023-07-09T21:43:06.189022+0000","last_undegraded":"2023-07-09T21:43:06.189022+0000","last_fullsized":"2023-07-09T21:43:06.189022+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:28.748551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140258+0000","last_change":"2023-07-09T21:43:05.138194+0000","last_active":"2023-07-09T21:43:06.140258+0000","last_peered":"2023-07-09T21:43:06.140258+0000","last_clean":"2023-07-09T21:43:06.140258+0000","last_became_active":"2023-07-09T21:43:05.137935+0000","last_became_peered":"2023-07-09T21:43:05.137935+0000","last_unstale":"2023-07-09T21:43:06.140258+0000","last_undegraded":"2023-07-09T21:43:06.140258+0000","last_fullsized":"2023-07-09T21:43:06.140258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:19.239341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188489+0000","last_change":"2023-07-09T21:43:05.134188+0000","last_active":"2023-07-09T21:43:06.188489+0000","last_peered":"2023-07-09T21:43:06.188489+0000","last_clean":"2023-07-09T21:43:06.188489+0000","last_became_active":"2023-07-09T21:43:05.133834+0000","last_became_peered":"2023-07-09T21:43:05.133834+0000","last_unstale":"2023-07-09T21:43:06.188489+0000","last_undegraded":"2023-07-09T21:43:06.188489+0000","last_fullsized":"2023-07-09T21:43:06.188489+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:46.934663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189624+0000","last_change":"2023-07-09T21:43:05.135524+0000","last_active":"2023-07-09T21:43:06.189624+0000","last_peered":"2023-07-09T21:43:06.189624+0000","last_clean":"2023-07-09T21:43:06.189624+0000","last_became_active":"2023-07-09T21:43:05.135063+0000","last_became_peered":"2023-07-09T21:43:05.135063+0000","last_unstale":"2023-07-09T21:43:06.189624+0000","last_undegraded":"2023-07-09T21:43:06.189624+0000","last_fullsized":"2023-07-09T21:43:06.189624+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:27.920576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188252+0000","last_change":"2023-07-09T21:43:05.134467+0000","last_active":"2023-07-09T21:43:06.188252+0000","last_peered":"2023-07-09T21:43:06.188252+0000","last_clean":"2023-07-09T21:43:06.188252+0000","last_became_active":"2023-07-09T21:43:05.133500+0000","last_became_peered":"2023-07-09T21:43:05.133500+0000","last_unstale":"2023-07-09T21:43:06.188252+0000","last_undegraded":"2023-07-09T21:43:06.188252+0000","last_fullsized":"2023-07-09T21:43:06.188252+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:56.786509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.187947+0000","last_change":"2023-07-09T21:43:05.142383+0000","last_active":"2023-07-09T21:43:06.187947+0000","last_peered":"2023-07-09T21:43:06.187947+0000","last_clean":"2023-07-09T21:43:06.187947+0000","last_became_active":"2023-07-09T21:43:05.142103+0000","last_became_peered":"2023-07-09T21:43:05.142103+0000","last_unstale":"2023-07-09T21:43:06.187947+0000","last_undegraded":"2023-07-09T21:43:06.187947+0000","last_fullsized":"2023-07-09T21:43:06.187947+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:08:16.068834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188668+0000","last_change":"2023-07-09T21:43:05.130275+0000","last_active":"2023-07-09T21:43:06.188668+0000","last_peered":"2023-07-09T21:43:06.188668+0000","last_clean":"2023-07-09T21:43:06.188668+0000","last_became_active":"2023-07-09T21:43:05.127729+0000","last_became_peered":"2023-07-09T21:43:05.127729+0000","last_unstale":"2023-07-09T21:43:06.188668+0000","last_undegraded":"2023-07-09T21:43:06.188668+0000","last_fullsized":"2023-07-09T21:43:06.188668+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:09.821775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.190105+0000","last_change":"2023-07-09T21:43:05.130241+0000","last_active":"2023-07-09T21:43:06.190105+0000","last_peered":"2023-07-09T21:43:06.190105+0000","last_clean":"2023-07-09T21:43:06.190105+0000","last_became_active":"2023-07-09T21:43:05.127706+0000","last_became_peered":"2023-07-09T21:43:05.127706+0000","last_unstale":"2023-07-09T21:43:06.190105+0000","last_undegraded":"2023-07-09T21:43:06.190105+0000","last_fullsized":"2023-07-09T21:43:06.190105+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:10.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135678+0000","last_change":"2023-07-09T21:43:05.128534+0000","last_active":"2023-07-09T21:43:06.135678+0000","last_peered":"2023-07-09T21:43:06.135678+0000","last_clean":"2023-07-09T21:43:06.135678+0000","last_became_active":"2023-07-09T21:43:05.128254+0000","last_became_peered":"2023-07-09T21:43:05.128254+0000","last_unstale":"2023-07-09T21:43:06.135678+0000","last_undegraded":"2023-07-09T21:43:06.135678+0000","last_fullsized":"2023-07-09T21:43:06.135678+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:17.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140900+0000","last_change":"2023-07-09T21:43:05.139959+0000","last_active":"2023-07-09T21:43:06.140900+0000","last_peered":"2023-07-09T21:43:06.140900+0000","last_clean":"2023-07-09T21:43:06.140900+0000","last_became_active":"2023-07-09T21:43:05.139445+0000","last_became_peered":"2023-07-09T21:43:05.139445+0000","last_unstale":"2023-07-09T21:43:06.140900+0000","last_undegraded":"2023-07-09T21:43:06.140900+0000","last_fullsized":"2023-07-09T21:43:06.140900+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:44:29.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135625+0000","last_change":"2023-07-09T21:43:05.130507+0000","last_active":"2023-07-09T21:43:06.135625+0000","last_peered":"2023-07-09T21:43:06.135625+0000","last_clean":"2023-07-09T21:43:06.135625+0000","last_became_active":"2023-07-09T21:43:05.130231+0000","last_became_peered":"2023-07-09T21:43:05.130231+0000","last_unstale":"2023-07-09T21:43:06.135625+0000","last_undegraded":"2023-07-09T21:43:06.135625+0000","last_fullsized":"2023-07-09T21:43:06.135625+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:23.192982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140074+0000","last_change":"2023-07-09T21:43:05.137749+0000","last_active":"2023-07-09T21:43:06.140074+0000","last_peered":"2023-07-09T21:43:06.140074+0000","last_clean":"2023-07-09T21:43:06.140074+0000","last_became_active":"2023-07-09T21:43:05.137405+0000","last_became_peered":"2023-07-09T21:43:05.137405+0000","last_unstale":"2023-07-09T21:43:06.140074+0000","last_undegraded":"2023-07-09T21:43:06.140074+0000","last_fullsized":"2023-07-09T21:43:06.140074+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:11.883329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188124+0000","last_change":"2023-07-09T21:43:05.133945+0000","last_active":"2023-07-09T21:43:06.188124+0000","last_peered":"2023-07-09T21:43:06.188124+0000","last_clean":"2023-07-09T21:43:06.188124+0000","last_became_active":"2023-07-09T21:43:05.133589+0000","last_became_peered":"2023-07-09T21:43:05.133589+0000","last_unstale":"2023-07-09T21:43:06.188124+0000","last_undegraded":"2023-07-09T21:43:06.188124+0000","last_fullsized":"2023-07-09T21:43:06.188124+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:37.127992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139404+0000","last_change":"2023-07-09T21:43:05.135315+0000","last_active":"2023-07-09T21:43:06.139404+0000","last_peered":"2023-07-09T21:43:06.139404+0000","last_clean":"2023-07-09T21:43:06.139404+0000","last_became_active":"2023-07-09T21:43:05.135052+0000","last_became_peered":"2023-07-09T21:43:05.135052+0000","last_unstale":"2023-07-09T21:43:06.139404+0000","last_undegraded":"2023-07-09T21:43:06.139404+0000","last_fullsized":"2023-07-09T21:43:06.139404+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:11:19.879211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188789+0000","last_change":"2023-07-09T21:43:05.131206+0000","last_active":"2023-07-09T21:43:06.188789+0000","last_peered":"2023-07-09T21:43:06.188789+0000","last_clean":"2023-07-09T21:43:06.188789+0000","last_became_active":"2023-07-09T21:43:05.130902+0000","last_became_peered":"2023-07-09T21:43:05.130902+0000","last_unstale":"2023-07-09T21:43:06.188789+0000","last_undegraded":"2023-07-09T21:43:06.188789+0000","last_fullsized":"2023-07-09T21:43:06.188789+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:25.768013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194581+0000","last_change":"2023-07-09T21:43:05.137950+0000","last_active":"2023-07-09T21:43:06.194581+0000","last_peered":"2023-07-09T21:43:06.194581+0000","last_clean":"2023-07-09T21:43:06.194581+0000","last_became_active":"2023-07-09T21:43:05.135641+0000","last_became_peered":"2023-07-09T21:43:05.135641+0000","last_unstale":"2023-07-09T21:43:06.194581+0000","last_undegraded":"2023-07-09T21:43:06.194581+0000","last_fullsized":"2023-07-09T21:43:06.194581+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:26.615246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194014+0000","last_change":"2023-07-09T21:43:05.145018+0000","last_active":"2023-07-09T21:43:06.194014+0000","last_peered":"2023-07-09T21:43:06.194014+0000","last_clean":"2023-07-09T21:43:06.194014+0000","last_became_active":"2023-07-09T21:43:05.144110+0000","last_became_peered":"2023-07-09T21:43:05.144110+0000","last_unstale":"2023-07-09T21:43:06.194014+0000","last_undegraded":"2023-07-09T21:43:06.194014+0000","last_fullsized":"2023-07-09T21:43:06.194014+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:19:40.800959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140977+0000","last_change":"2023-07-09T21:43:05.144561+0000","last_active":"2023-07-09T21:43:06.140977+0000","last_peered":"2023-07-09T21:43:06.140977+0000","last_clean":"2023-07-09T21:43:06.140977+0000","last_became_active":"2023-07-09T21:43:05.144297+0000","last_became_peered":"2023-07-09T21:43:05.144297+0000","last_unstale":"2023-07-09T21:43:06.140977+0000","last_undegraded":"2023-07-09T21:43:06.140977+0000","last_fullsized":"2023-07-09T21:43:06.140977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:15:20.351566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188770+0000","last_change":"2023-07-09T21:43:05.130159+0000","last_active":"2023-07-09T21:43:06.188770+0000","last_peered":"2023-07-09T21:43:06.188770+0000","last_clean":"2023-07-09T21:43:06.188770+0000","last_became_active":"2023-07-09T21:43:05.128733+0000","last_became_peered":"2023-07-09T21:43:05.128733+0000","last_unstale":"2023-07-09T21:43:06.188770+0000","last_undegraded":"2023-07-09T21:43:06.188770+0000","last_fullsized":"2023-07-09T21:43:06.188770+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:09.821775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194298+0000","last_change":"2023-07-09T21:43:05.142982+0000","last_active":"2023-07-09T21:43:06.194298+0000","last_peered":"2023-07-09T21:43:06.194298+0000","last_clean":"2023-07-09T21:43:06.194298+0000","last_became_active":"2023-07-09T21:43:05.142616+0000","last_became_peered":"2023-07-09T21:43:05.142616+0000","last_unstale":"2023-07-09T21:43:06.194298+0000","last_undegraded":"2023-07-09T21:43:06.194298+0000","last_fullsized":"2023-07-09T21:43:06.194298+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194426+0000","last_change":"2023-07-09T21:43:05.135129+0000","last_active":"2023-07-09T21:43:06.194426+0000","last_peered":"2023-07-09T21:43:06.194426+0000","last_clean":"2023-07-09T21:43:06.194426+0000","last_became_active":"2023-07-09T21:43:05.133774+0000","last_became_peered":"2023-07-09T21:43:05.133774+0000","last_unstale":"2023-07-09T21:43:06.194426+0000","last_undegraded":"2023-07-09T21:43:06.194426+0000","last_fullsized":"2023-07-09T21:43:06.194426+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:15.050460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193430+0000","last_change":"2023-07-09T21:43:05.138355+0000","last_active":"2023-07-09T21:43:06.193430+0000","last_peered":"2023-07-09T21:43:06.193430+0000","last_clean":"2023-07-09T21:43:06.193430+0000","last_became_active":"2023-07-09T21:43:05.138059+0000","last_became_peered":"2023-07-09T21:43:05.138059+0000","last_unstale":"2023-07-09T21:43:06.193430+0000","last_undegraded":"2023-07-09T21:43:06.193430+0000","last_fullsized":"2023-07-09T21:43:06.193430+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:16:48.710055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188401+0000","last_change":"2023-07-09T21:43:05.132146+0000","last_active":"2023-07-09T21:43:06.188401+0000","last_peered":"2023-07-09T21:43:06.188401+0000","last_clean":"2023-07-09T21:43:06.188401+0000","last_became_active":"2023-07-09T21:43:05.131865+0000","last_became_peered":"2023-07-09T21:43:05.131865+0000","last_unstale":"2023-07-09T21:43:06.188401+0000","last_undegraded":"2023-07-09T21:43:06.188401+0000","last_fullsized":"2023-07-09T21:43:06.188401+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:20.089411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193603+0000","last_change":"2023-07-09T21:43:05.135181+0000","last_active":"2023-07-09T21:43:06.193603+0000","last_peered":"2023-07-09T21:43:06.193603+0000","last_clean":"2023-07-09T21:43:06.193603+0000","last_became_active":"2023-07-09T21:43:05.134519+0000","last_became_peered":"2023-07-09T21:43:05.134519+0000","last_unstale":"2023-07-09T21:43:06.193603+0000","last_undegraded":"2023-07-09T21:43:06.193603+0000","last_fullsized":"2023-07-09T21:43:06.193603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:36:02.919713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194566+0000","last_change":"2023-07-09T21:43:04.120316+0000","last_active":"2023-07-09T21:43:06.194566+0000","last_peered":"2023-07-09T21:43:06.194566+0000","last_clean":"2023-07-09T21:43:06.194566+0000","last_became_active":"2023-07-09T21:43:04.120005+0000","last_became_peered":"2023-07-09T21:43:04.120005+0000","last_unstale":"2023-07-09T21:43:06.194566+0000","last_undegraded":"2023-07-09T21:43:06.194566+0000","last_fullsized":"2023-07-09T21:43:06.194566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:16:04.720773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188030+0000","last_change":"2023-07-09T21:43:05.141861+0000","last_active":"2023-07-09T21:43:06.188030+0000","last_peered":"2023-07-09T21:43:06.188030+0000","last_clean":"2023-07-09T21:43:06.188030+0000","last_became_active":"2023-07-09T21:43:05.141596+0000","last_became_peered":"2023-07-09T21:43:05.141596+0000","last_unstale":"2023-07-09T21:43:06.188030+0000","last_undegraded":"2023-07-09T21:43:06.188030+0000","last_fullsized":"2023-07-09T21:43:06.188030+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:03.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135984+0000","last_change":"2023-07-09T21:43:04.097685+0000","last_active":"2023-07-09T21:43:06.135984+0000","last_peered":"2023-07-09T21:43:06.135984+0000","last_clean":"2023-07-09T21:43:06.135984+0000","last_became_active":"2023-07-09T21:43:04.097353+0000","last_became_peered":"2023-07-09T21:43:04.097353+0000","last_unstale":"2023-07-09T21:43:06.135984+0000","last_undegraded":"2023-07-09T21:43:06.135984+0000","last_fullsized":"2023-07-09T21:43:06.135984+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:20.174298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139603+0000","last_change":"2023-07-09T21:43:05.137054+0000","last_active":"2023-07-09T21:43:06.139603+0000","last_peered":"2023-07-09T21:43:06.139603+0000","last_clean":"2023-07-09T21:43:06.139603+0000","last_became_active":"2023-07-09T21:43:05.136771+0000","last_became_peered":"2023-07-09T21:43:05.136771+0000","last_unstale":"2023-07-09T21:43:06.139603+0000","last_undegraded":"2023-07-09T21:43:06.139603+0000","last_fullsized":"2023-07-09T21:43:06.139603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:59.626679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141061+0000","last_change":"2023-07-09T21:43:04.109765+0000","last_active":"2023-07-09T21:43:06.141061+0000","last_peered":"2023-07-09T21:43:06.141061+0000","last_clean":"2023-07-09T21:43:06.141061+0000","last_became_active":"2023-07-09T21:43:04.109464+0000","last_became_peered":"2023-07-09T21:43:04.109464+0000","last_unstale":"2023-07-09T21:43:06.141061+0000","last_undegraded":"2023-07-09T21:43:06.141061+0000","last_fullsized":"2023-07-09T21:43:06.141061+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:30:07.157638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188067+0000","last_change":"2023-07-09T21:43:05.135745+0000","last_active":"2023-07-09T21:43:06.188067+0000","last_peered":"2023-07-09T21:43:06.188067+0000","last_clean":"2023-07-09T21:43:06.188067+0000","last_became_active":"2023-07-09T21:43:05.135463+0000","last_became_peered":"2023-07-09T21:43:05.135463+0000","last_unstale":"2023-07-09T21:43:06.188067+0000","last_undegraded":"2023-07-09T21:43:06.188067+0000","last_fullsized":"2023-07-09T21:43:06.188067+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:56.981225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140742+0000","last_change":"2023-07-09T21:43:04.108354+0000","last_active":"2023-07-09T21:43:06.140742+0000","last_peered":"2023-07-09T21:43:06.140742+0000","last_clean":"2023-07-09T21:43:06.140742+0000","last_became_active":"2023-07-09T21:43:04.108047+0000","last_became_peered":"2023-07-09T21:43:04.108047+0000","last_unstale":"2023-07-09T21:43:06.140742+0000","last_undegraded":"2023-07-09T21:43:06.140742+0000","last_fullsized":"2023-07-09T21:43:06.140742+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:31.574911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193870+0000","last_change":"2023-07-09T21:43:05.137002+0000","last_active":"2023-07-09T21:43:06.193870+0000","last_peered":"2023-07-09T21:43:06.193870+0000","last_clean":"2023-07-09T21:43:06.193870+0000","last_became_active":"2023-07-09T21:43:05.136744+0000","last_became_peered":"2023-07-09T21:43:05.136744+0000","last_unstale":"2023-07-09T21:43:06.193870+0000","last_undegraded":"2023-07-09T21:43:06.193870+0000","last_fullsized":"2023-07-09T21:43:06.193870+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:26.854967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193890+0000","last_change":"2023-07-09T21:43:04.107762+0000","last_active":"2023-07-09T21:43:06.193890+0000","last_peered":"2023-07-09T21:43:06.193890+0000","last_clean":"2023-07-09T21:43:06.193890+0000","last_became_active":"2023-07-09T21:43:04.107396+0000","last_became_peered":"2023-07-09T21:43:04.107396+0000","last_unstale":"2023-07-09T21:43:06.193890+0000","last_undegraded":"2023-07-09T21:43:06.193890+0000","last_fullsized":"2023-07-09T21:43:06.193890+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:28.627907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194478+0000","last_change":"2023-07-09T21:43:05.134120+0000","last_active":"2023-07-09T21:43:06.194478+0000","last_peered":"2023-07-09T21:43:06.194478+0000","last_clean":"2023-07-09T21:43:06.194478+0000","last_became_active":"2023-07-09T21:43:05.133138+0000","last_became_peered":"2023-07-09T21:43:05.133138+0000","last_unstale":"2023-07-09T21:43:06.194478+0000","last_undegraded":"2023-07-09T21:43:06.194478+0000","last_fullsized":"2023-07-09T21:43:06.194478+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:44.529210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135413+0000","last_change":"2023-07-09T21:43:04.102572+0000","last_active":"2023-07-09T21:43:06.135413+0000","last_peered":"2023-07-09T21:43:06.135413+0000","last_clean":"2023-07-09T21:43:06.135413+0000","last_became_active":"2023-07-09T21:43:04.102251+0000","last_became_peered":"2023-07-09T21:43:04.102251+0000","last_unstale":"2023-07-09T21:43:06.135413+0000","last_undegraded":"2023-07-09T21:43:06.135413+0000","last_fullsized":"2023-07-09T21:43:06.135413+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:45.084287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135805+0000","last_change":"2023-07-09T21:43:05.136883+0000","last_active":"2023-07-09T21:43:06.135805+0000","last_peered":"2023-07-09T21:43:06.135805+0000","last_clean":"2023-07-09T21:43:06.135805+0000","last_became_active":"2023-07-09T21:43:05.136608+0000","last_became_peered":"2023-07-09T21:43:05.136608+0000","last_unstale":"2023-07-09T21:43:06.135805+0000","last_undegraded":"2023-07-09T21:43:06.135805+0000","last_fullsized":"2023-07-09T21:43:06.135805+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:35.030360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189348+0000","last_change":"2023-07-09T21:43:04.109982+0000","last_active":"2023-07-09T21:43:06.189348+0000","last_peered":"2023-07-09T21:43:06.189348+0000","last_clean":"2023-07-09T21:43:06.189348+0000","last_became_active":"2023-07-09T21:43:04.109679+0000","last_became_peered":"2023-07-09T21:43:04.109679+0000","last_unstale":"2023-07-09T21:43:06.189348+0000","last_undegraded":"2023-07-09T21:43:06.189348+0000","last_fullsized":"2023-07-09T21:43:06.189348+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:22.100991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141062+0000","last_change":"2023-07-09T21:43:05.144919+0000","last_active":"2023-07-09T21:43:06.141062+0000","last_peered":"2023-07-09T21:43:06.141062+0000","last_clean":"2023-07-09T21:43:06.141062+0000","last_became_active":"2023-07-09T21:43:05.143681+0000","last_became_peered":"2023-07-09T21:43:05.143681+0000","last_unstale":"2023-07-09T21:43:06.141062+0000","last_undegraded":"2023-07-09T21:43:06.141062+0000","last_fullsized":"2023-07-09T21:43:06.141062+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:26:57.136672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193855+0000","last_change":"2023-07-09T21:43:04.114995+0000","last_active":"2023-07-09T21:43:06.193855+0000","last_peered":"2023-07-09T21:43:06.193855+0000","last_clean":"2023-07-09T21:43:06.193855+0000","last_became_active":"2023-07-09T21:43:04.114707+0000","last_became_peered":"2023-07-09T21:43:04.114707+0000","last_unstale":"2023-07-09T21:43:06.193855+0000","last_undegraded":"2023-07-09T21:43:06.193855+0000","last_fullsized":"2023-07-09T21:43:06.193855+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:51.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193822+0000","last_change":"2023-07-09T21:43:05.133607+0000","last_active":"2023-07-09T21:43:06.193822+0000","last_peered":"2023-07-09T21:43:06.193822+0000","last_clean":"2023-07-09T21:43:06.193822+0000","last_became_active":"2023-07-09T21:43:05.133293+0000","last_became_peered":"2023-07-09T21:43:05.133293+0000","last_unstale":"2023-07-09T21:43:06.193822+0000","last_undegraded":"2023-07-09T21:43:06.193822+0000","last_fullsized":"2023-07-09T21:43:06.193822+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:04.079861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140682+0000","last_change":"2023-07-09T21:43:04.111388+0000","last_active":"2023-07-09T21:43:06.140682+0000","last_peered":"2023-07-09T21:43:06.140682+0000","last_clean":"2023-07-09T21:43:06.140682+0000","last_became_active":"2023-07-09T21:43:04.110970+0000","last_became_peered":"2023-07-09T21:43:04.110970+0000","last_unstale":"2023-07-09T21:43:06.140682+0000","last_undegraded":"2023-07-09T21:43:06.140682+0000","last_fullsized":"2023-07-09T21:43:06.140682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:25:38.346286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139934+0000","last_change":"2023-07-09T21:43:05.139932+0000","last_active":"2023-07-09T21:43:06.139934+0000","last_peered":"2023-07-09T21:43:06.139934+0000","last_clean":"2023-07-09T21:43:06.139934+0000","last_became_active":"2023-07-09T21:43:05.139321+0000","last_became_peered":"2023-07-09T21:43:05.139321+0000","last_unstale":"2023-07-09T21:43:06.139934+0000","last_undegraded":"2023-07-09T21:43:06.139934+0000","last_fullsized":"2023-07-09T21:43:06.139934+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:24.549972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194161+0000","last_change":"2023-07-09T21:43:04.119311+0000","last_active":"2023-07-09T21:43:06.194161+0000","last_peered":"2023-07-09T21:43:06.194161+0000","last_clean":"2023-07-09T21:43:06.194161+0000","last_became_active":"2023-07-09T21:43:04.119040+0000","last_became_peered":"2023-07-09T21:43:04.119040+0000","last_unstale":"2023-07-09T21:43:06.194161+0000","last_undegraded":"2023-07-09T21:43:06.194161+0000","last_fullsized":"2023-07-09T21:43:06.194161+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:50.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140459+0000","last_change":"2023-07-09T21:43:05.140149+0000","last_active":"2023-07-09T21:43:06.140459+0000","last_peered":"2023-07-09T21:43:06.140459+0000","last_clean":"2023-07-09T21:43:06.140459+0000","last_became_active":"2023-07-09T21:43:05.139487+0000","last_became_peered":"2023-07-09T21:43:05.139487+0000","last_unstale":"2023-07-09T21:43:06.140459+0000","last_undegraded":"2023-07-09T21:43:06.140459+0000","last_fullsized":"2023-07-09T21:43:06.140459+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:18:25.286959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189891+0000","last_change":"2023-07-09T21:43:04.110053+0000","last_active":"2023-07-09T21:43:06.189891+0000","last_peered":"2023-07-09T21:43:06.189891+0000","last_clean":"2023-07-09T21:43:06.189891+0000","last_became_active":"2023-07-09T21:43:04.109787+0000","last_became_peered":"2023-07-09T21:43:04.109787+0000","last_unstale":"2023-07-09T21:43:06.189891+0000","last_undegraded":"2023-07-09T21:43:06.189891+0000","last_fullsized":"2023-07-09T21:43:06.189891+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:03:19.634808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188655+0000","last_change":"2023-07-09T21:43:05.137681+0000","last_active":"2023-07-09T21:43:06.188655+0000","last_peered":"2023-07-09T21:43:06.188655+0000","last_clean":"2023-07-09T21:43:06.188655+0000","last_became_active":"2023-07-09T21:43:05.136681+0000","last_became_peered":"2023-07-09T21:43:05.136681+0000","last_unstale":"2023-07-09T21:43:06.188655+0000","last_undegraded":"2023-07-09T21:43:06.188655+0000","last_fullsized":"2023-07-09T21:43:06.188655+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:51.259373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135749+0000","last_change":"2023-07-09T21:43:04.111581+0000","last_active":"2023-07-09T21:43:06.135749+0000","last_peered":"2023-07-09T21:43:06.135749+0000","last_clean":"2023-07-09T21:43:06.135749+0000","last_became_active":"2023-07-09T21:43:04.111287+0000","last_became_peered":"2023-07-09T21:43:04.111287+0000","last_unstale":"2023-07-09T21:43:06.135749+0000","last_undegraded":"2023-07-09T21:43:06.135749+0000","last_fullsized":"2023-07-09T21:43:06.135749+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:45.401555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135623+0000","last_change":"2023-07-09T21:43:05.143351+0000","last_active":"2023-07-09T21:43:06.135623+0000","last_peered":"2023-07-09T21:43:06.135623+0000","last_clean":"2023-07-09T21:43:06.135623+0000","last_became_active":"2023-07-09T21:43:05.143036+0000","last_became_peered":"2023-07-09T21:43:05.143036+0000","last_unstale":"2023-07-09T21:43:06.135623+0000","last_undegraded":"2023-07-09T21:43:06.135623+0000","last_fullsized":"2023-07-09T21:43:06.135623+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:58.038128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194046+0000","last_change":"2023-07-09T21:43:04.111715+0000","last_active":"2023-07-09T21:43:06.194046+0000","last_peered":"2023-07-09T21:43:06.194046+0000","last_clean":"2023-07-09T21:43:06.194046+0000","last_became_active":"2023-07-09T21:43:04.111369+0000","last_became_peered":"2023-07-09T21:43:04.111369+0000","last_unstale":"2023-07-09T21:43:06.194046+0000","last_undegraded":"2023-07-09T21:43:06.194046+0000","last_fullsized":"2023-07-09T21:43:06.194046+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:00.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188627+0000","last_change":"2023-07-09T21:43:05.142362+0000","last_active":"2023-07-09T21:43:06.188627+0000","last_peered":"2023-07-09T21:43:06.188627+0000","last_clean":"2023-07-09T21:43:06.188627+0000","last_became_active":"2023-07-09T21:43:05.142041+0000","last_became_peered":"2023-07-09T21:43:05.142041+0000","last_unstale":"2023-07-09T21:43:06.188627+0000","last_undegraded":"2023-07-09T21:43:06.188627+0000","last_fullsized":"2023-07-09T21:43:06.188627+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:27.222919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188365+0000","last_change":"2023-07-09T21:43:04.110623+0000","last_active":"2023-07-09T21:43:06.188365+0000","last_peered":"2023-07-09T21:43:06.188365+0000","last_clean":"2023-07-09T21:43:06.188365+0000","last_became_active":"2023-07-09T21:43:04.110329+0000","last_became_peered":"2023-07-09T21:43:04.110329+0000","last_unstale":"2023-07-09T21:43:06.188365+0000","last_undegraded":"2023-07-09T21:43:06.188365+0000","last_fullsized":"2023-07-09T21:43:06.188365+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:59.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135952+0000","last_change":"2023-07-09T21:43:05.134737+0000","last_active":"2023-07-09T21:43:06.135952+0000","last_peered":"2023-07-09T21:43:06.135952+0000","last_clean":"2023-07-09T21:43:06.135952+0000","last_became_active":"2023-07-09T21:43:05.134459+0000","last_became_peered":"2023-07-09T21:43:05.134459+0000","last_unstale":"2023-07-09T21:43:06.135952+0000","last_undegraded":"2023-07-09T21:43:06.135952+0000","last_fullsized":"2023-07-09T21:43:06.135952+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:19.928277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140023+0000","last_change":"2023-07-09T21:43:04.116122+0000","last_active":"2023-07-09T21:43:06.140023+0000","last_peered":"2023-07-09T21:43:06.140023+0000","last_clean":"2023-07-09T21:43:06.140023+0000","last_became_active":"2023-07-09T21:43:04.115798+0000","last_became_peered":"2023-07-09T21:43:04.115798+0000","last_unstale":"2023-07-09T21:43:06.140023+0000","last_undegraded":"2023-07-09T21:43:06.140023+0000","last_fullsized":"2023-07-09T21:43:06.140023+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:11:53.157556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140309+0000","last_change":"2023-07-09T21:43:05.139010+0000","last_active":"2023-07-09T21:43:06.140309+0000","last_peered":"2023-07-09T21:43:06.140309+0000","last_clean":"2023-07-09T21:43:06.140309+0000","last_became_active":"2023-07-09T21:43:05.138721+0000","last_became_peered":"2023-07-09T21:43:05.138721+0000","last_unstale":"2023-07-09T21:43:06.140309+0000","last_undegraded":"2023-07-09T21:43:06.140309+0000","last_fullsized":"2023-07-09T21:43:06.140309+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:13.175078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189005+0000","last_change":"2023-07-09T21:43:04.104644+0000","last_active":"2023-07-09T21:43:06.189005+0000","last_peered":"2023-07-09T21:43:06.189005+0000","last_clean":"2023-07-09T21:43:06.189005+0000","last_became_active":"2023-07-09T21:43:04.104004+0000","last_became_peered":"2023-07-09T21:43:04.104004+0000","last_unstale":"2023-07-09T21:43:06.189005+0000","last_undegraded":"2023-07-09T21:43:06.189005+0000","last_fullsized":"2023-07-09T21:43:06.189005+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:42.585253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135418+0000","last_change":"2023-07-09T21:43:05.136297+0000","last_active":"2023-07-09T21:43:06.135418+0000","last_peered":"2023-07-09T21:43:06.135418+0000","last_clean":"2023-07-09T21:43:06.135418+0000","last_became_active":"2023-07-09T21:43:05.136011+0000","last_became_peered":"2023-07-09T21:43:05.136011+0000","last_unstale":"2023-07-09T21:43:06.135418+0000","last_undegraded":"2023-07-09T21:43:06.135418+0000","last_fullsized":"2023-07-09T21:43:06.135418+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:04.416005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189153+0000","last_change":"2023-07-09T21:43:04.112265+0000","last_active":"2023-07-09T21:43:06.189153+0000","last_peered":"2023-07-09T21:43:06.189153+0000","last_clean":"2023-07-09T21:43:06.189153+0000","last_became_active":"2023-07-09T21:43:04.111982+0000","last_became_peered":"2023-07-09T21:43:04.111982+0000","last_unstale":"2023-07-09T21:43:06.189153+0000","last_undegraded":"2023-07-09T21:43:06.189153+0000","last_fullsized":"2023-07-09T21:43:06.189153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:26.977295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194016+0000","last_change":"2023-07-09T21:43:05.135389+0000","last_active":"2023-07-09T21:43:06.194016+0000","last_peered":"2023-07-09T21:43:06.194016+0000","last_clean":"2023-07-09T21:43:06.194016+0000","last_became_active":"2023-07-09T21:43:05.133820+0000","last_became_peered":"2023-07-09T21:43:05.133820+0000","last_unstale":"2023-07-09T21:43:06.194016+0000","last_undegraded":"2023-07-09T21:43:06.194016+0000","last_fullsized":"2023-07-09T21:43:06.194016+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:38.041463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"158'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194377+0000","last_change":"2023-07-09T21:43:04.110528+0000","last_active":"2023-07-09T21:43:06.194377+0000","last_peered":"2023-07-09T21:43:06.194377+0000","last_clean":"2023-07-09T21:43:06.194377+0000","last_became_active":"2023-07-09T21:43:04.110266+0000","last_became_peered":"2023-07-09T21:43:04.110266+0000","last_unstale":"2023-07-09T21:43:06.194377+0000","last_undegraded":"2023-07-09T21:43:06.194377+0000","last_fullsized":"2023-07-09T21:43:06.194377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:12.937563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140041+0000","last_change":"2023-07-09T21:43:05.146077+0000","last_active":"2023-07-09T21:43:06.140041+0000","last_peered":"2023-07-09T21:43:06.140041+0000","last_clean":"2023-07-09T21:43:06.140041+0000","last_became_active":"2023-07-09T21:43:05.145806+0000","last_became_peered":"2023-07-09T21:43:05.145806+0000","last_unstale":"2023-07-09T21:43:06.140041+0000","last_undegraded":"2023-07-09T21:43:06.140041+0000","last_fullsized":"2023-07-09T21:43:06.140041+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:03.988235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194108+0000","last_change":"2023-07-09T21:43:04.119204+0000","last_active":"2023-07-09T21:43:06.194108+0000","last_peered":"2023-07-09T21:43:06.194108+0000","last_clean":"2023-07-09T21:43:06.194108+0000","last_became_active":"2023-07-09T21:43:04.118925+0000","last_became_peered":"2023-07-09T21:43:04.118925+0000","last_unstale":"2023-07-09T21:43:06.194108+0000","last_undegraded":"2023-07-09T21:43:06.194108+0000","last_fullsized":"2023-07-09T21:43:06.194108+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:54.631823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188799+0000","last_change":"2023-07-09T21:43:05.129195+0000","last_active":"2023-07-09T21:43:06.188799+0000","last_peered":"2023-07-09T21:43:06.188799+0000","last_clean":"2023-07-09T21:43:06.188799+0000","last_became_active":"2023-07-09T21:43:05.128915+0000","last_became_peered":"2023-07-09T21:43:05.128915+0000","last_unstale":"2023-07-09T21:43:06.188799+0000","last_undegraded":"2023-07-09T21:43:06.188799+0000","last_fullsized":"2023-07-09T21:43:06.188799+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:43.592356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189502+0000","last_change":"2023-07-09T21:43:04.105009+0000","last_active":"2023-07-09T21:43:06.189502+0000","last_peered":"2023-07-09T21:43:06.189502+0000","last_clean":"2023-07-09T21:43:06.189502+0000","last_became_active":"2023-07-09T21:43:04.104702+0000","last_became_peered":"2023-07-09T21:43:04.104702+0000","last_unstale":"2023-07-09T21:43:06.189502+0000","last_undegraded":"2023-07-09T21:43:06.189502+0000","last_fullsized":"2023-07-09T21:43:06.189502+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:21.293310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189382+0000","last_change":"2023-07-09T21:43:05.144266+0000","last_active":"2023-07-09T21:43:06.189382+0000","last_peered":"2023-07-09T21:43:06.189382+0000","last_clean":"2023-07-09T21:43:06.189382+0000","last_became_active":"2023-07-09T21:43:05.144005+0000","last_became_peered":"2023-07-09T21:43:05.144005+0000","last_unstale":"2023-07-09T21:43:06.189382+0000","last_undegraded":"2023-07-09T21:43:06.189382+0000","last_fullsized":"2023-07-09T21:43:06.189382+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:19.732926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140233+0000","last_change":"2023-07-09T21:43:04.112867+0000","last_active":"2023-07-09T21:43:06.140233+0000","last_peered":"2023-07-09T21:43:06.140233+0000","last_clean":"2023-07-09T21:43:06.140233+0000","last_became_active":"2023-07-09T21:43:04.112599+0000","last_became_peered":"2023-07-09T21:43:04.112599+0000","last_unstale":"2023-07-09T21:43:06.140233+0000","last_undegraded":"2023-07-09T21:43:06.140233+0000","last_fullsized":"2023-07-09T21:43:06.140233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:12.139903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189825+0000","last_change":"2023-07-09T21:43:05.143678+0000","last_active":"2023-07-09T21:43:06.189825+0000","last_peered":"2023-07-09T21:43:06.189825+0000","last_clean":"2023-07-09T21:43:06.189825+0000","last_became_active":"2023-07-09T21:43:05.143374+0000","last_became_peered":"2023-07-09T21:43:05.143374+0000","last_unstale":"2023-07-09T21:43:06.189825+0000","last_undegraded":"2023-07-09T21:43:06.189825+0000","last_fullsized":"2023-07-09T21:43:06.189825+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:05.439264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140552+0000","last_change":"2023-07-09T21:43:04.110316+0000","last_active":"2023-07-09T21:43:06.140552+0000","last_peered":"2023-07-09T21:43:06.140552+0000","last_clean":"2023-07-09T21:43:06.140552+0000","last_became_active":"2023-07-09T21:43:04.110028+0000","last_became_peered":"2023-07-09T21:43:04.110028+0000","last_unstale":"2023-07-09T21:43:06.140552+0000","last_undegraded":"2023-07-09T21:43:06.140552+0000","last_fullsized":"2023-07-09T21:43:06.140552+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:48:47.052243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189754+0000","last_change":"2023-07-09T21:43:05.138787+0000","last_active":"2023-07-09T21:43:06.189754+0000","last_peered":"2023-07-09T21:43:06.189754+0000","last_clean":"2023-07-09T21:43:06.189754+0000","last_became_active":"2023-07-09T21:43:05.138460+0000","last_became_peered":"2023-07-09T21:43:05.138460+0000","last_unstale":"2023-07-09T21:43:06.189754+0000","last_undegraded":"2023-07-09T21:43:06.189754+0000","last_fullsized":"2023-07-09T21:43:06.189754+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:18.194199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189617+0000","last_change":"2023-07-09T21:43:04.105115+0000","last_active":"2023-07-09T21:43:06.189617+0000","last_peered":"2023-07-09T21:43:06.189617+0000","last_clean":"2023-07-09T21:43:06.189617+0000","last_became_active":"2023-07-09T21:43:04.104829+0000","last_became_peered":"2023-07-09T21:43:04.104829+0000","last_unstale":"2023-07-09T21:43:06.189617+0000","last_undegraded":"2023-07-09T21:43:06.189617+0000","last_fullsized":"2023-07-09T21:43:06.189617+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:51.058464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141217+0000","last_change":"2023-07-09T21:43:05.146619+0000","last_active":"2023-07-09T21:43:06.141217+0000","last_peered":"2023-07-09T21:43:06.141217+0000","last_clean":"2023-07-09T21:43:06.141217+0000","last_became_active":"2023-07-09T21:43:05.146337+0000","last_became_peered":"2023-07-09T21:43:05.146337+0000","last_unstale":"2023-07-09T21:43:06.141217+0000","last_undegraded":"2023-07-09T21:43:06.141217+0000","last_fullsized":"2023-07-09T21:43:06.141217+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:14.705020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135520+0000","last_change":"2023-07-09T21:43:04.108077+0000","last_active":"2023-07-09T21:43:06.135520+0000","last_peered":"2023-07-09T21:43:06.135520+0000","last_clean":"2023-07-09T21:43:06.135520+0000","last_became_active":"2023-07-09T21:43:04.107786+0000","last_became_peered":"2023-07-09T21:43:04.107786+0000","last_unstale":"2023-07-09T21:43:06.135520+0000","last_undegraded":"2023-07-09T21:43:06.135520+0000","last_fullsized":"2023-07-09T21:43:06.135520+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:25.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194069+0000","last_change":"2023-07-09T21:43:05.143544+0000","last_active":"2023-07-09T21:43:06.194069+0000","last_peered":"2023-07-09T21:43:06.194069+0000","last_clean":"2023-07-09T21:43:06.194069+0000","last_became_active":"2023-07-09T21:43:05.143285+0000","last_became_peered":"2023-07-09T21:43:05.143285+0000","last_unstale":"2023-07-09T21:43:06.194069+0000","last_undegraded":"2023-07-09T21:43:06.194069+0000","last_fullsized":"2023-07-09T21:43:06.194069+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:24.866032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140414+0000","last_change":"2023-07-09T21:43:04.120583+0000","last_active":"2023-07-09T21:43:06.140414+0000","last_peered":"2023-07-09T21:43:06.140414+0000","last_clean":"2023-07-09T21:43:06.140414+0000","last_became_active":"2023-07-09T21:43:04.120220+0000","last_became_peered":"2023-07-09T21:43:04.120220+0000","last_unstale":"2023-07-09T21:43:06.140414+0000","last_undegraded":"2023-07-09T21:43:06.140414+0000","last_fullsized":"2023-07-09T21:43:06.140414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:14:33.965074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'271","reported_seq":959,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139698+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:43:06.139698+0000","last_peered":"2023-07-09T21:43:06.139698+0000","last_clean":"2023-07-09T21:43:06.139698+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:43:06.139698+0000","last_undegraded":"2023-07-09T21:43:06.139698+0000","last_fullsized":"2023-07-09T21:43:06.139698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:11:06.981682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":298,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140367+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:43:06.140367+0000","last_peered":"2023-07-09T21:43:06.140367+0000","last_clean":"2023-07-09T21:43:06.140367+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:43:06.140367+0000","last_undegraded":"2023-07-09T21:43:06.140367+0000","last_fullsized":"2023-07-09T21:43:06.140367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:25:40.589779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141269+0000","last_change":"2023-07-09T21:43:05.140018+0000","last_active":"2023-07-09T21:43:06.141269+0000","last_peered":"2023-07-09T21:43:06.141269+0000","last_clean":"2023-07-09T21:43:06.141269+0000","last_became_active":"2023-07-09T21:43:05.139364+0000","last_became_peered":"2023-07-09T21:43:05.139364+0000","last_unstale":"2023-07-09T21:43:06.141269+0000","last_undegraded":"2023-07-09T21:43:06.141269+0000","last_fullsized":"2023-07-09T21:43:06.141269+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:47.453447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193646+0000","last_change":"2023-07-09T21:43:04.110688+0000","last_active":"2023-07-09T21:43:06.193646+0000","last_peered":"2023-07-09T21:43:06.193646+0000","last_clean":"2023-07-09T21:43:06.193646+0000","last_became_active":"2023-07-09T21:43:04.110287+0000","last_became_peered":"2023-07-09T21:43:04.110287+0000","last_unstale":"2023-07-09T21:43:06.193646+0000","last_undegraded":"2023-07-09T21:43:06.193646+0000","last_fullsized":"2023-07-09T21:43:06.193646+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:33:07.312546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":257,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139612+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:43:06.139612+0000","last_peered":"2023-07-09T21:43:06.139612+0000","last_clean":"2023-07-09T21:43:06.139612+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:43:06.139612+0000","last_undegraded":"2023-07-09T21:43:06.139612+0000","last_fullsized":"2023-07-09T21:43:06.139612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:36.551877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.136052+0000","last_change":"2023-07-09T21:43:05.133741+0000","last_active":"2023-07-09T21:43:06.136052+0000","last_peered":"2023-07-09T21:43:06.136052+0000","last_clean":"2023-07-09T21:43:06.136052+0000","last_became_active":"2023-07-09T21:43:05.133406+0000","last_became_peered":"2023-07-09T21:43:05.133406+0000","last_unstale":"2023-07-09T21:43:06.136052+0000","last_undegraded":"2023-07-09T21:43:06.136052+0000","last_fullsized":"2023-07-09T21:43:06.136052+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:09.225988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":21,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188897+0000","last_change":"2023-07-09T21:43:04.106029+0000","last_active":"2023-07-09T21:43:06.188897+0000","last_peered":"2023-07-09T21:43:06.188897+0000","last_clean":"2023-07-09T21:43:06.188897+0000","last_became_active":"2023-07-09T21:43:04.105760+0000","last_became_peered":"2023-07-09T21:43:04.105760+0000","last_unstale":"2023-07-09T21:43:06.188897+0000","last_undegraded":"2023-07-09T21:43:06.188897+0000","last_fullsized":"2023-07-09T21:43:06.188897+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:27.741448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188087+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:43:06.188087+0000","last_peered":"2023-07-09T21:43:06.188087+0000","last_clean":"2023-07-09T21:43:06.188087+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:43:06.188087+0000","last_undegraded":"2023-07-09T21:43:06.188087+0000","last_fullsized":"2023-07-09T21:43:06.188087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:20.135410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188896+0000","last_change":"2023-07-09T21:43:05.142611+0000","last_active":"2023-07-09T21:43:06.188896+0000","last_peered":"2023-07-09T21:43:06.188896+0000","last_clean":"2023-07-09T21:43:06.188896+0000","last_became_active":"2023-07-09T21:43:05.142329+0000","last_became_peered":"2023-07-09T21:43:05.142329+0000","last_unstale":"2023-07-09T21:43:06.188896+0000","last_undegraded":"2023-07-09T21:43:06.188896+0000","last_fullsized":"2023-07-09T21:43:06.188896+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:25.768013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188270+0000","last_change":"2023-07-09T21:43:04.113973+0000","last_active":"2023-07-09T21:43:06.188270+0000","last_peered":"2023-07-09T21:43:06.188270+0000","last_clean":"2023-07-09T21:43:06.188270+0000","last_became_active":"2023-07-09T21:43:04.113561+0000","last_became_peered":"2023-07-09T21:43:04.113561+0000","last_unstale":"2023-07-09T21:43:06.188270+0000","last_undegraded":"2023-07-09T21:43:06.188270+0000","last_fullsized":"2023-07-09T21:43:06.188270+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:08.356689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":298,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139914+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:43:06.139914+0000","last_peered":"2023-07-09T21:43:06.139914+0000","last_clean":"2023-07-09T21:43:06.139914+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:43:06.139914+0000","last_undegraded":"2023-07-09T21:43:06.139914+0000","last_fullsized":"2023-07-09T21:43:06.139914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:00:31.311637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193793+0000","last_change":"2023-07-09T21:43:05.137056+0000","last_active":"2023-07-09T21:43:06.193793+0000","last_peered":"2023-07-09T21:43:06.193793+0000","last_clean":"2023-07-09T21:43:06.193793+0000","last_became_active":"2023-07-09T21:43:05.136785+0000","last_became_peered":"2023-07-09T21:43:05.136785+0000","last_unstale":"2023-07-09T21:43:06.193793+0000","last_undegraded":"2023-07-09T21:43:06.193793+0000","last_fullsized":"2023-07-09T21:43:06.193793+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:25.667778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141131+0000","last_change":"2023-07-09T21:43:04.113801+0000","last_active":"2023-07-09T21:43:06.141131+0000","last_peered":"2023-07-09T21:43:06.141131+0000","last_clean":"2023-07-09T21:43:06.141131+0000","last_became_active":"2023-07-09T21:43:04.113490+0000","last_became_peered":"2023-07-09T21:43:04.113490+0000","last_unstale":"2023-07-09T21:43:06.141131+0000","last_undegraded":"2023-07-09T21:43:06.141131+0000","last_fullsized":"2023-07-09T21:43:06.141131+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:28.526813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189614+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:43:06.189614+0000","last_peered":"2023-07-09T21:43:06.189614+0000","last_clean":"2023-07-09T21:43:06.189614+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:43:06.189614+0000","last_undegraded":"2023-07-09T21:43:06.189614+0000","last_fullsized":"2023-07-09T21:43:06.189614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:00:18.121856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194398+0000","last_change":"2023-07-09T21:43:05.136037+0000","last_active":"2023-07-09T21:43:06.194398+0000","last_peered":"2023-07-09T21:43:06.194398+0000","last_clean":"2023-07-09T21:43:06.194398+0000","last_became_active":"2023-07-09T21:43:05.135709+0000","last_became_peered":"2023-07-09T21:43:05.135709+0000","last_unstale":"2023-07-09T21:43:06.194398+0000","last_undegraded":"2023-07-09T21:43:06.194398+0000","last_fullsized":"2023-07-09T21:43:06.194398+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.995263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":19,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140771+0000","last_change":"2023-07-09T21:43:04.112763+0000","last_active":"2023-07-09T21:43:06.140771+0000","last_peered":"2023-07-09T21:43:06.140771+0000","last_clean":"2023-07-09T21:43:06.140771+0000","last_became_active":"2023-07-09T21:43:04.112041+0000","last_became_peered":"2023-07-09T21:43:04.112041+0000","last_unstale":"2023-07-09T21:43:06.140771+0000","last_undegraded":"2023-07-09T21:43:06.140771+0000","last_fullsized":"2023-07-09T21:43:06.140771+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:25.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141195+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:43:06.141195+0000","last_peered":"2023-07-09T21:43:06.141195+0000","last_clean":"2023-07-09T21:43:06.141195+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:43:06.141195+0000","last_undegraded":"2023-07-09T21:43:06.141195+0000","last_fullsized":"2023-07-09T21:43:06.141195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:22.591033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.187947+0000","last_change":"2023-07-09T21:43:05.142086+0000","last_active":"2023-07-09T21:43:06.187947+0000","last_peered":"2023-07-09T21:43:06.187947+0000","last_clean":"2023-07-09T21:43:06.187947+0000","last_became_active":"2023-07-09T21:43:05.141775+0000","last_became_peered":"2023-07-09T21:43:05.141775+0000","last_unstale":"2023-07-09T21:43:06.187947+0000","last_undegraded":"2023-07-09T21:43:06.187947+0000","last_fullsized":"2023-07-09T21:43:06.187947+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:54:02.425477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140155+0000","last_change":"2023-07-09T21:43:04.098406+0000","last_active":"2023-07-09T21:43:06.140155+0000","last_peered":"2023-07-09T21:43:06.140155+0000","last_clean":"2023-07-09T21:43:06.140155+0000","last_became_active":"2023-07-09T21:43:04.098107+0000","last_became_peered":"2023-07-09T21:43:04.098107+0000","last_unstale":"2023-07-09T21:43:06.140155+0000","last_undegraded":"2023-07-09T21:43:06.140155+0000","last_fullsized":"2023-07-09T21:43:06.140155+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:46:35.303512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":252,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189872+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:43:06.189872+0000","last_peered":"2023-07-09T21:43:06.189872+0000","last_clean":"2023-07-09T21:43:06.189872+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:43:06.189872+0000","last_undegraded":"2023-07-09T21:43:06.189872+0000","last_fullsized":"2023-07-09T21:43:06.189872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:18.103723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189495+0000","last_change":"2023-07-09T21:43:05.138600+0000","last_active":"2023-07-09T21:43:06.189495+0000","last_peered":"2023-07-09T21:43:06.189495+0000","last_clean":"2023-07-09T21:43:06.189495+0000","last_became_active":"2023-07-09T21:43:05.132889+0000","last_became_peered":"2023-07-09T21:43:05.132889+0000","last_unstale":"2023-07-09T21:43:06.189495+0000","last_undegraded":"2023-07-09T21:43:06.189495+0000","last_fullsized":"2023-07-09T21:43:06.189495+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:42.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188974+0000","last_change":"2023-07-09T21:43:04.113066+0000","last_active":"2023-07-09T21:43:06.188974+0000","last_peered":"2023-07-09T21:43:06.188974+0000","last_clean":"2023-07-09T21:43:06.188974+0000","last_became_active":"2023-07-09T21:43:04.112294+0000","last_became_peered":"2023-07-09T21:43:04.112294+0000","last_unstale":"2023-07-09T21:43:06.188974+0000","last_undegraded":"2023-07-09T21:43:06.188974+0000","last_fullsized":"2023-07-09T21:43:06.188974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:58.357862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":260,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194643+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:43:06.194643+0000","last_peered":"2023-07-09T21:43:06.194643+0000","last_clean":"2023-07-09T21:43:06.194643+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:43:06.194643+0000","last_undegraded":"2023-07-09T21:43:06.194643+0000","last_fullsized":"2023-07-09T21:43:06.194643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575095,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59804,"kb_used_data":2516,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312036,"statfs":{"total":96636764160,"available":96575524864,"internally_reserved":0,"allocated":2576384,"data_stored":1595023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84999999999999998,"5min":1.03,"15min":1.03},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88300000000000001,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.77200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88600000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":1.754,"15min":1.754},"last":0.748},{"interface":"front","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96299999999999997,"5min":1.1140000000000001,"15min":1.129},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":1.232,"15min":1.232},"last":0.94299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.86799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575094,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1974272,"data_stored":1003673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.997,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.88900000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.746,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":1.0229999999999999,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.60399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.501,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.004,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.96199999999999997,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.70199999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76000000000000001,"15min":0.75900000000000001},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.48699999999999999},"max":{"1min":1.0660000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76100000000000001,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.84999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.69999999999999996,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":6.101,"15min":6.101},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.64600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73899999999999999,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90900000000000003,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":0.70099999999999996},"min":{"1min":0.53600000000000003,"5min":0.503,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44600000000000001},"max":{"1min":0.95399999999999996,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575093,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51020,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320820,"statfs":{"total":96636764160,"available":96584519680,"internally_reserved":0,"allocated":1970176,"data_stored":1003023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.371,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":1.006},"last":0.71299999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0409999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.02},"last":0.78800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.002,"15min":1.002},"last":0.67300000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94399999999999995,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.625},"min":{"1min":0.504,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.083,"15min":1.083},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.038},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.34399999999999997},"max":{"1min":1.1060000000000001,"5min":1.107,"15min":1.107},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575095,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1966080,"data_stored":1003001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66700000000000004,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.95299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.51400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.996,"15min":0.996},"last":0.66800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.97999999999999998,"5min":1.083,"15min":1.083},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.97999999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69299999999999995,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.26},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.034,"15min":1.05},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.024,"15min":1.024},"last":0.752},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91600000000000004,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.097,"15min":1.097},"last":0.92300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575094,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37080,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334760,"statfs":{"total":96636764160,"available":96598794240,"internally_reserved":0,"allocated":1982464,"data_stored":1004635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46700000000000003},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67500000000000004,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.497,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52200000000000002,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.47299999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.101,"15min":1.101},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80600000000000005,"5min":1.024,"15min":1.024},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.0529999999999999,"5min":1.111,"15min":1.3320000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.208},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.51},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97199999999999998,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.083,"15min":1.127},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.034,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575095,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55120,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316720,"statfs":{"total":96636764160,"available":96580321280,"internally_reserved":0,"allocated":1974272,"data_stored":1003617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.29499999999999998,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.68700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.498}]},{"osd":3,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":1.079,"15min":1.7050000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.45900000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.145,"15min":1.3360000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.53800000000000003,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":1.123,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":1.081,"5min":1.371,"15min":1.377},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.75800000000000001,"15min":0.80700000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.111,"5min":1.262,"15min":1.4590000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.82899999999999996},"min":{"1min":0.60599999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1639999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.45400000000000001},"max":{"1min":0.94599999999999995,"5min":1.3400000000000001,"15min":1.423},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76400000000000001,"15min":0.82099999999999995},"min":{"1min":0.60899999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93500000000000005,"5min":1.163,"15min":1.48},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.83499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46100000000000002},"max":{"1min":1.2,"5min":1.3999999999999999,"15min":1.496},"last":0.82999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575095,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1970176,"data_stored":1003071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.76800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.441}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.96999999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77500000000000002,"15min":1.3069999999999999},"last":0.501},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.89300000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.0169999999999999,"5min":1.129,"15min":1.155},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78100000000000003,"15min":0.81000000000000005},"min":{"1min":0.60599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.212},"last":0.92000000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96499999999999997,"5min":1.177,"15min":1.1839999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.56799999999999995,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.024,"5min":1.1160000000000001,"15min":1.149},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.038,"5min":1.2,"15min":1.2},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.0349999999999999,"5min":1.1699999999999999,"15min":1.258},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98799999999999999,"5min":1.107,"15min":1.173},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1899999999999999,"15min":1.2929999999999999},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575095,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37652,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334188,"statfs":{"total":96636764160,"available":96598208512,"internally_reserved":0,"allocated":2568192,"data_stored":1593425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60099999999999998,"5min":0.67600000000000005,"15min":0.753},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.629,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":1.657,"15min":1.657},"last":0.44}]},{"osd":3,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":1.835,"15min":1.835},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.726,"15min":1.726},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":1.615,"15min":1.615},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.76500000000000001,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90800000000000003,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"max":{"1min":0.85299999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":0.93200000000000005,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":1.883,"15min":1.883},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:43:13.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:43:14.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.007+0000 7f28c87d2640 1 Processor -- start 2023-07-09T21:43:14.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 -- start start 2023-07-09T21:43:14.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f28c00af830 0x7f28c00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28c00cbe90 con 0x7f28c00cc770 2023-07-09T21:43:14.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28c006d370 con 0x7f28c00af830 2023-07-09T21:43:14.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c87d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c00b0140 con 0x7f28c00cc320 2023-07-09T21:43:14.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c6d6f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28c00cc770 0x7f28c006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33700/0 (socket says 172.21.15.37:33700) 2023-07-09T21:43:14.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c6d6f640 1 -- 172.21.15.37:0/2924528300 learned_addr learned my addr 172.21.15.37:0/2924528300 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:14.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c5d6d640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c656e640 1 --2- 172.21.15.37:0/2924528300 >> v2:172.21.15.119:3300/0 conn(0x7f28c00af830 0x7f28c00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c556c640 1 -- 172.21.15.37:0/2924528300 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275084723 0 0) 0x7f28c00cbe90 con 0x7f28c00cc770 2023-07-09T21:43:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c556c640 1 -- 172.21.15.37:0/2924528300 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28ac003530 con 0x7f28c00cc770 2023-07-09T21:43:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c656e640 1 -- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 msgr2=0x7f28c006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c656e640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c006efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c656e640 1 -- 172.21.15.37:0/2924528300 >> v1:172.21.15.37:6789/0 conn(0x7f28c00cc770 legacy=0x7f28c006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.011+0000 7f28c656e640 1 -- 172.21.15.37:0/2924528300 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c0159bb0 con 0x7f28c00af830 2023-07-09T21:43:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c656e640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00af830 0x7f28c00afc00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097c0 tx=0x7f28bc01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c413b778c4990bf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c556c640 1 -- 172.21.15.37:0/2924528300 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0ab650 con 0x7f28c00af830 2023-07-09T21:43:14.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c556c640 1 -- 172.21.15.37:0/2924528300 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0ab7b0 con 0x7f28c00af830 2023-07-09T21:43:14.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c556c640 1 -- 172.21.15.37:0/2924528300 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0abb40 con 0x7f28c00af830 2023-07-09T21:43:14.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 -- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00af830 msgr2=0x7f28c00afc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00af830 0x7f28c00afc00 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0097c0 tx=0x7f28bc01c450 comp rx=0 tx=0).stop 2023-07-09T21:43:14.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 -- 172.21.15.37:0/2924528300 shutdown_connections 2023-07-09T21:43:14.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c006efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2924528300 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00af830 0x7f28c00afc00 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 -- 172.21.15.37:0/2924528300 >> 172.21.15.37:0/2924528300 conn(0x7f28c00ca830 msgr2=0x7f28c00cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 -- 172.21.15.37:0/2924528300 shutdown_connections 2023-07-09T21:43:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.015+0000 7f28c87d2640 1 -- 172.21.15.37:0/2924528300 wait complete. 2023-07-09T21:43:14.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 Processor -- start 2023-07-09T21:43:14.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- start start 2023-07-09T21:43:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c0150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00cc770 0x7f28c0156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0151880 con 0x7f28c00af830 2023-07-09T21:43:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28c014b000 con 0x7f28c00cc770 2023-07-09T21:43:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28c0150c70 con 0x7f28c00cc320 2023-07-09T21:43:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55226/0 (socket says 172.21.15.37:55226) 2023-07-09T21:43:14.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 -- 172.21.15.37:0/2267555827 learned_addr learned my addr 172.21.15.37:0/2267555827 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c5d6d640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c0150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c6d6f640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00cc770 0x7f28c0156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 -- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 msgr2=0x7f28c0150270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c0150270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 -- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00cc770 msgr2=0x7f28c0156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00cc770 0x7f28c0156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 -- 172.21.15.37:0/2267555827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc009420 con 0x7f28c00af830 2023-07-09T21:43:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c656e640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ad040 tx=0x7f28bc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0bf610 con 0x7f28c00af830 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28bc0bf7b0 con 0x7f28c00af830 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28c0150f50 con 0x7f28c00af830 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28bc0bfb60 con 0x7f28c00af830 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28c0151510 con 0x7f28c00af830 2023-07-09T21:43:14.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.019+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28c006b550 con 0x7f28c00af830 2023-07-09T21:43:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.023+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f28bc0b5400 con 0x7f28c00af830 2023-07-09T21:43:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.023+0000 7f28b6ffd640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 0x7f28a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.023+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f28bc11e990 con 0x7f28c00af830 2023-07-09T21:43:14.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.023+0000 7f28c5d6d640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 0x7f28a4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.023+0000 7f28c5d6d640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 0x7f28a4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28c0156e40 tx=0x7f28b0009190 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.027+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f28bc0ebd90 con 0x7f28c00af830 2023-07-09T21:43:14.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.175+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f28c00cbb20 con 0x7f28a40663a0 2023-07-09T21:43:14.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28b6ffd640 1 -- 172.21.15.37:0/2267555827 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311785 (secure 0 0 0) 0x7f28b0011a30 con 0x7f28a40663a0 2023-07-09T21:43:14.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:43:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 msgr2=0x7f28a4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 0x7f28a4068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28c0156e40 tx=0x7f28b0009190 comp rx=0 tx=0).stop 2023-07-09T21:43:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 msgr2=0x7f28c014aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f28bc0ad040 tx=0x7f28bc01ac90 comp rx=0 tx=0).stop 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 shutdown_connections 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f28a40663a0 0x7f28a4068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f28c00cc770 0x7f28c0156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f28c00cc320 0x7f28c0150270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 --2- 172.21.15.37:0/2267555827 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28c00af830 0x7f28c014aac0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 >> 172.21.15.37:0/2267555827 conn(0x7f28c00ca830 msgr2=0x7f28c0158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 shutdown_connections 2023-07-09T21:43:14.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.187+0000 7f28c87d2640 1 -- 172.21.15.37:0/2267555827 wait complete. 2023-07-09T21:43:14.210 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:43:12.770408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":484,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":347784,"kb_used_data":16584,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754626936,"statfs":{"total":773094113280,"available":772737982464,"internally_reserved":0,"allocated":16982016,"data_stored":9209468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002231"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189100+0000","last_change":"2023-07-09T21:43:05.134171+0000","last_active":"2023-07-09T21:43:06.189100+0000","last_peered":"2023-07-09T21:43:06.189100+0000","last_clean":"2023-07-09T21:43:06.189100+0000","last_became_active":"2023-07-09T21:43:05.133858+0000","last_became_peered":"2023-07-09T21:43:05.133858+0000","last_unstale":"2023-07-09T21:43:06.189100+0000","last_undegraded":"2023-07-09T21:43:06.189100+0000","last_fullsized":"2023-07-09T21:43:06.189100+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:44:43.897593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140551+0000","last_change":"2023-07-09T21:43:05.132799+0000","last_active":"2023-07-09T21:43:06.140551+0000","last_peered":"2023-07-09T21:43:06.140551+0000","last_clean":"2023-07-09T21:43:06.140551+0000","last_became_active":"2023-07-09T21:43:05.132518+0000","last_became_peered":"2023-07-09T21:43:05.132518+0000","last_unstale":"2023-07-09T21:43:06.140551+0000","last_undegraded":"2023-07-09T21:43:06.140551+0000","last_fullsized":"2023-07-09T21:43:06.140551+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:32:17.043376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193895+0000","last_change":"2023-07-09T21:43:05.144417+0000","last_active":"2023-07-09T21:43:06.193895+0000","last_peered":"2023-07-09T21:43:06.193895+0000","last_clean":"2023-07-09T21:43:06.193895+0000","last_became_active":"2023-07-09T21:43:05.142699+0000","last_became_peered":"2023-07-09T21:43:05.142699+0000","last_unstale":"2023-07-09T21:43:06.193895+0000","last_undegraded":"2023-07-09T21:43:06.193895+0000","last_fullsized":"2023-07-09T21:43:06.193895+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:48:59.420814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140138+0000","last_change":"2023-07-09T21:43:05.132709+0000","last_active":"2023-07-09T21:43:06.140138+0000","last_peered":"2023-07-09T21:43:06.140138+0000","last_clean":"2023-07-09T21:43:06.140138+0000","last_became_active":"2023-07-09T21:43:05.132386+0000","last_became_peered":"2023-07-09T21:43:05.132386+0000","last_unstale":"2023-07-09T21:43:06.140138+0000","last_undegraded":"2023-07-09T21:43:06.140138+0000","last_fullsized":"2023-07-09T21:43:06.140138+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:51.203743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135445+0000","last_change":"2023-07-09T21:43:05.129155+0000","last_active":"2023-07-09T21:43:06.135445+0000","last_peered":"2023-07-09T21:43:06.135445+0000","last_clean":"2023-07-09T21:43:06.135445+0000","last_became_active":"2023-07-09T21:43:05.128845+0000","last_became_peered":"2023-07-09T21:43:05.128845+0000","last_unstale":"2023-07-09T21:43:06.135445+0000","last_undegraded":"2023-07-09T21:43:06.135445+0000","last_fullsized":"2023-07-09T21:43:06.135445+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:26:11.120356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189260+0000","last_change":"2023-07-09T21:43:05.135509+0000","last_active":"2023-07-09T21:43:06.189260+0000","last_peered":"2023-07-09T21:43:06.189260+0000","last_clean":"2023-07-09T21:43:06.189260+0000","last_became_active":"2023-07-09T21:43:05.135223+0000","last_became_peered":"2023-07-09T21:43:05.135223+0000","last_unstale":"2023-07-09T21:43:06.189260+0000","last_undegraded":"2023-07-09T21:43:06.189260+0000","last_fullsized":"2023-07-09T21:43:06.189260+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:46:26.609589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139881+0000","last_change":"2023-07-09T21:43:05.145123+0000","last_active":"2023-07-09T21:43:06.139881+0000","last_peered":"2023-07-09T21:43:06.139881+0000","last_clean":"2023-07-09T21:43:06.139881+0000","last_became_active":"2023-07-09T21:43:05.144828+0000","last_became_peered":"2023-07-09T21:43:05.144828+0000","last_unstale":"2023-07-09T21:43:06.139881+0000","last_undegraded":"2023-07-09T21:43:06.139881+0000","last_fullsized":"2023-07-09T21:43:06.139881+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:40:35.391416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193434+0000","last_change":"2023-07-09T21:43:05.135847+0000","last_active":"2023-07-09T21:43:06.193434+0000","last_peered":"2023-07-09T21:43:06.193434+0000","last_clean":"2023-07-09T21:43:06.193434+0000","last_became_active":"2023-07-09T21:43:05.134268+0000","last_became_peered":"2023-07-09T21:43:05.134268+0000","last_unstale":"2023-07-09T21:43:06.193434+0000","last_undegraded":"2023-07-09T21:43:06.193434+0000","last_fullsized":"2023-07-09T21:43:06.193434+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:56:26.439217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.190042+0000","last_change":"2023-07-09T21:43:05.130704+0000","last_active":"2023-07-09T21:43:06.190042+0000","last_peered":"2023-07-09T21:43:06.190042+0000","last_clean":"2023-07-09T21:43:06.190042+0000","last_became_active":"2023-07-09T21:43:05.130395+0000","last_became_peered":"2023-07-09T21:43:05.130395+0000","last_unstale":"2023-07-09T21:43:06.190042+0000","last_undegraded":"2023-07-09T21:43:06.190042+0000","last_fullsized":"2023-07-09T21:43:06.190042+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:43:37.527637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189022+0000","last_change":"2023-07-09T21:43:05.129087+0000","last_active":"2023-07-09T21:43:06.189022+0000","last_peered":"2023-07-09T21:43:06.189022+0000","last_clean":"2023-07-09T21:43:06.189022+0000","last_became_active":"2023-07-09T21:43:05.128731+0000","last_became_peered":"2023-07-09T21:43:05.128731+0000","last_unstale":"2023-07-09T21:43:06.189022+0000","last_undegraded":"2023-07-09T21:43:06.189022+0000","last_fullsized":"2023-07-09T21:43:06.189022+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:28.748551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140258+0000","last_change":"2023-07-09T21:43:05.138194+0000","last_active":"2023-07-09T21:43:06.140258+0000","last_peered":"2023-07-09T21:43:06.140258+0000","last_clean":"2023-07-09T21:43:06.140258+0000","last_became_active":"2023-07-09T21:43:05.137935+0000","last_became_peered":"2023-07-09T21:43:05.137935+0000","last_unstale":"2023-07-09T21:43:06.140258+0000","last_undegraded":"2023-07-09T21:43:06.140258+0000","last_fullsized":"2023-07-09T21:43:06.140258+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:23:19.239341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188489+0000","last_change":"2023-07-09T21:43:05.134188+0000","last_active":"2023-07-09T21:43:06.188489+0000","last_peered":"2023-07-09T21:43:06.188489+0000","last_clean":"2023-07-09T21:43:06.188489+0000","last_became_active":"2023-07-09T21:43:05.133834+0000","last_became_peered":"2023-07-09T21:43:05.133834+0000","last_unstale":"2023-07-09T21:43:06.188489+0000","last_undegraded":"2023-07-09T21:43:06.188489+0000","last_fullsized":"2023-07-09T21:43:06.188489+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:07:46.934663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189624+0000","last_change":"2023-07-09T21:43:05.135524+0000","last_active":"2023-07-09T21:43:06.189624+0000","last_peered":"2023-07-09T21:43:06.189624+0000","last_clean":"2023-07-09T21:43:06.189624+0000","last_became_active":"2023-07-09T21:43:05.135063+0000","last_became_peered":"2023-07-09T21:43:05.135063+0000","last_unstale":"2023-07-09T21:43:06.189624+0000","last_undegraded":"2023-07-09T21:43:06.189624+0000","last_fullsized":"2023-07-09T21:43:06.189624+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:27.920576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188252+0000","last_change":"2023-07-09T21:43:05.134467+0000","last_active":"2023-07-09T21:43:06.188252+0000","last_peered":"2023-07-09T21:43:06.188252+0000","last_clean":"2023-07-09T21:43:06.188252+0000","last_became_active":"2023-07-09T21:43:05.133500+0000","last_became_peered":"2023-07-09T21:43:05.133500+0000","last_unstale":"2023-07-09T21:43:06.188252+0000","last_undegraded":"2023-07-09T21:43:06.188252+0000","last_fullsized":"2023-07-09T21:43:06.188252+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:56.786509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.187947+0000","last_change":"2023-07-09T21:43:05.142383+0000","last_active":"2023-07-09T21:43:06.187947+0000","last_peered":"2023-07-09T21:43:06.187947+0000","last_clean":"2023-07-09T21:43:06.187947+0000","last_became_active":"2023-07-09T21:43:05.142103+0000","last_became_peered":"2023-07-09T21:43:05.142103+0000","last_unstale":"2023-07-09T21:43:06.187947+0000","last_undegraded":"2023-07-09T21:43:06.187947+0000","last_fullsized":"2023-07-09T21:43:06.187947+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:08:16.068834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188668+0000","last_change":"2023-07-09T21:43:05.130275+0000","last_active":"2023-07-09T21:43:06.188668+0000","last_peered":"2023-07-09T21:43:06.188668+0000","last_clean":"2023-07-09T21:43:06.188668+0000","last_became_active":"2023-07-09T21:43:05.127729+0000","last_became_peered":"2023-07-09T21:43:05.127729+0000","last_unstale":"2023-07-09T21:43:06.188668+0000","last_undegraded":"2023-07-09T21:43:06.188668+0000","last_fullsized":"2023-07-09T21:43:06.188668+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:09.821775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.190105+0000","last_change":"2023-07-09T21:43:05.130241+0000","last_active":"2023-07-09T21:43:06.190105+0000","last_peered":"2023-07-09T21:43:06.190105+0000","last_clean":"2023-07-09T21:43:06.190105+0000","last_became_active":"2023-07-09T21:43:05.127706+0000","last_became_peered":"2023-07-09T21:43:05.127706+0000","last_unstale":"2023-07-09T21:43:06.190105+0000","last_undegraded":"2023-07-09T21:43:06.190105+0000","last_fullsized":"2023-07-09T21:43:06.190105+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:33:10.905060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135678+0000","last_change":"2023-07-09T21:43:05.128534+0000","last_active":"2023-07-09T21:43:06.135678+0000","last_peered":"2023-07-09T21:43:06.135678+0000","last_clean":"2023-07-09T21:43:06.135678+0000","last_became_active":"2023-07-09T21:43:05.128254+0000","last_became_peered":"2023-07-09T21:43:05.128254+0000","last_unstale":"2023-07-09T21:43:06.135678+0000","last_undegraded":"2023-07-09T21:43:06.135678+0000","last_fullsized":"2023-07-09T21:43:06.135678+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:26:17.713644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140900+0000","last_change":"2023-07-09T21:43:05.139959+0000","last_active":"2023-07-09T21:43:06.140900+0000","last_peered":"2023-07-09T21:43:06.140900+0000","last_clean":"2023-07-09T21:43:06.140900+0000","last_became_active":"2023-07-09T21:43:05.139445+0000","last_became_peered":"2023-07-09T21:43:05.139445+0000","last_unstale":"2023-07-09T21:43:06.140900+0000","last_undegraded":"2023-07-09T21:43:06.140900+0000","last_fullsized":"2023-07-09T21:43:06.140900+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:44:29.480802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135625+0000","last_change":"2023-07-09T21:43:05.130507+0000","last_active":"2023-07-09T21:43:06.135625+0000","last_peered":"2023-07-09T21:43:06.135625+0000","last_clean":"2023-07-09T21:43:06.135625+0000","last_became_active":"2023-07-09T21:43:05.130231+0000","last_became_peered":"2023-07-09T21:43:05.130231+0000","last_unstale":"2023-07-09T21:43:06.135625+0000","last_undegraded":"2023-07-09T21:43:06.135625+0000","last_fullsized":"2023-07-09T21:43:06.135625+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:23.192982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140074+0000","last_change":"2023-07-09T21:43:05.137749+0000","last_active":"2023-07-09T21:43:06.140074+0000","last_peered":"2023-07-09T21:43:06.140074+0000","last_clean":"2023-07-09T21:43:06.140074+0000","last_became_active":"2023-07-09T21:43:05.137405+0000","last_became_peered":"2023-07-09T21:43:05.137405+0000","last_unstale":"2023-07-09T21:43:06.140074+0000","last_undegraded":"2023-07-09T21:43:06.140074+0000","last_fullsized":"2023-07-09T21:43:06.140074+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:11.883329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188124+0000","last_change":"2023-07-09T21:43:05.133945+0000","last_active":"2023-07-09T21:43:06.188124+0000","last_peered":"2023-07-09T21:43:06.188124+0000","last_clean":"2023-07-09T21:43:06.188124+0000","last_became_active":"2023-07-09T21:43:05.133589+0000","last_became_peered":"2023-07-09T21:43:05.133589+0000","last_unstale":"2023-07-09T21:43:06.188124+0000","last_undegraded":"2023-07-09T21:43:06.188124+0000","last_fullsized":"2023-07-09T21:43:06.188124+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:12:37.127992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139404+0000","last_change":"2023-07-09T21:43:05.135315+0000","last_active":"2023-07-09T21:43:06.139404+0000","last_peered":"2023-07-09T21:43:06.139404+0000","last_clean":"2023-07-09T21:43:06.139404+0000","last_became_active":"2023-07-09T21:43:05.135052+0000","last_became_peered":"2023-07-09T21:43:05.135052+0000","last_unstale":"2023-07-09T21:43:06.139404+0000","last_undegraded":"2023-07-09T21:43:06.139404+0000","last_fullsized":"2023-07-09T21:43:06.139404+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:11:19.879211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188789+0000","last_change":"2023-07-09T21:43:05.131206+0000","last_active":"2023-07-09T21:43:06.188789+0000","last_peered":"2023-07-09T21:43:06.188789+0000","last_clean":"2023-07-09T21:43:06.188789+0000","last_became_active":"2023-07-09T21:43:05.130902+0000","last_became_peered":"2023-07-09T21:43:05.130902+0000","last_unstale":"2023-07-09T21:43:06.188789+0000","last_undegraded":"2023-07-09T21:43:06.188789+0000","last_fullsized":"2023-07-09T21:43:06.188789+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:25.768013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194581+0000","last_change":"2023-07-09T21:43:05.137950+0000","last_active":"2023-07-09T21:43:06.194581+0000","last_peered":"2023-07-09T21:43:06.194581+0000","last_clean":"2023-07-09T21:43:06.194581+0000","last_became_active":"2023-07-09T21:43:05.135641+0000","last_became_peered":"2023-07-09T21:43:05.135641+0000","last_unstale":"2023-07-09T21:43:06.194581+0000","last_undegraded":"2023-07-09T21:43:06.194581+0000","last_fullsized":"2023-07-09T21:43:06.194581+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:26.615246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194014+0000","last_change":"2023-07-09T21:43:05.145018+0000","last_active":"2023-07-09T21:43:06.194014+0000","last_peered":"2023-07-09T21:43:06.194014+0000","last_clean":"2023-07-09T21:43:06.194014+0000","last_became_active":"2023-07-09T21:43:05.144110+0000","last_became_peered":"2023-07-09T21:43:05.144110+0000","last_unstale":"2023-07-09T21:43:06.194014+0000","last_undegraded":"2023-07-09T21:43:06.194014+0000","last_fullsized":"2023-07-09T21:43:06.194014+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:19:40.800959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140977+0000","last_change":"2023-07-09T21:43:05.144561+0000","last_active":"2023-07-09T21:43:06.140977+0000","last_peered":"2023-07-09T21:43:06.140977+0000","last_clean":"2023-07-09T21:43:06.140977+0000","last_became_active":"2023-07-09T21:43:05.144297+0000","last_became_peered":"2023-07-09T21:43:05.144297+0000","last_unstale":"2023-07-09T21:43:06.140977+0000","last_undegraded":"2023-07-09T21:43:06.140977+0000","last_fullsized":"2023-07-09T21:43:06.140977+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:15:20.351566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188770+0000","last_change":"2023-07-09T21:43:05.130159+0000","last_active":"2023-07-09T21:43:06.188770+0000","last_peered":"2023-07-09T21:43:06.188770+0000","last_clean":"2023-07-09T21:43:06.188770+0000","last_became_active":"2023-07-09T21:43:05.128733+0000","last_became_peered":"2023-07-09T21:43:05.128733+0000","last_unstale":"2023-07-09T21:43:06.188770+0000","last_undegraded":"2023-07-09T21:43:06.188770+0000","last_fullsized":"2023-07-09T21:43:06.188770+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:33:09.821775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194298+0000","last_change":"2023-07-09T21:43:05.142982+0000","last_active":"2023-07-09T21:43:06.194298+0000","last_peered":"2023-07-09T21:43:06.194298+0000","last_clean":"2023-07-09T21:43:06.194298+0000","last_became_active":"2023-07-09T21:43:05.142616+0000","last_became_peered":"2023-07-09T21:43:05.142616+0000","last_unstale":"2023-07-09T21:43:06.194298+0000","last_undegraded":"2023-07-09T21:43:06.194298+0000","last_fullsized":"2023-07-09T21:43:06.194298+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:55:20.737823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194426+0000","last_change":"2023-07-09T21:43:05.135129+0000","last_active":"2023-07-09T21:43:06.194426+0000","last_peered":"2023-07-09T21:43:06.194426+0000","last_clean":"2023-07-09T21:43:06.194426+0000","last_became_active":"2023-07-09T21:43:05.133774+0000","last_became_peered":"2023-07-09T21:43:05.133774+0000","last_unstale":"2023-07-09T21:43:06.194426+0000","last_undegraded":"2023-07-09T21:43:06.194426+0000","last_fullsized":"2023-07-09T21:43:06.194426+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:28:15.050460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193430+0000","last_change":"2023-07-09T21:43:05.138355+0000","last_active":"2023-07-09T21:43:06.193430+0000","last_peered":"2023-07-09T21:43:06.193430+0000","last_clean":"2023-07-09T21:43:06.193430+0000","last_became_active":"2023-07-09T21:43:05.138059+0000","last_became_peered":"2023-07-09T21:43:05.138059+0000","last_unstale":"2023-07-09T21:43:06.193430+0000","last_undegraded":"2023-07-09T21:43:06.193430+0000","last_fullsized":"2023-07-09T21:43:06.193430+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:16:48.710055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188401+0000","last_change":"2023-07-09T21:43:05.132146+0000","last_active":"2023-07-09T21:43:06.188401+0000","last_peered":"2023-07-09T21:43:06.188401+0000","last_clean":"2023-07-09T21:43:06.188401+0000","last_became_active":"2023-07-09T21:43:05.131865+0000","last_became_peered":"2023-07-09T21:43:05.131865+0000","last_unstale":"2023-07-09T21:43:06.188401+0000","last_undegraded":"2023-07-09T21:43:06.188401+0000","last_fullsized":"2023-07-09T21:43:06.188401+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:20.089411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193603+0000","last_change":"2023-07-09T21:43:05.135181+0000","last_active":"2023-07-09T21:43:06.193603+0000","last_peered":"2023-07-09T21:43:06.193603+0000","last_clean":"2023-07-09T21:43:06.193603+0000","last_became_active":"2023-07-09T21:43:05.134519+0000","last_became_peered":"2023-07-09T21:43:05.134519+0000","last_unstale":"2023-07-09T21:43:06.193603+0000","last_undegraded":"2023-07-09T21:43:06.193603+0000","last_fullsized":"2023-07-09T21:43:06.193603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:36:02.919713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"157'4","reported_seq":17,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194566+0000","last_change":"2023-07-09T21:43:04.120316+0000","last_active":"2023-07-09T21:43:06.194566+0000","last_peered":"2023-07-09T21:43:06.194566+0000","last_clean":"2023-07-09T21:43:06.194566+0000","last_became_active":"2023-07-09T21:43:04.120005+0000","last_became_peered":"2023-07-09T21:43:04.120005+0000","last_unstale":"2023-07-09T21:43:06.194566+0000","last_undegraded":"2023-07-09T21:43:06.194566+0000","last_fullsized":"2023-07-09T21:43:06.194566+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:16:04.720773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188030+0000","last_change":"2023-07-09T21:43:05.141861+0000","last_active":"2023-07-09T21:43:06.188030+0000","last_peered":"2023-07-09T21:43:06.188030+0000","last_clean":"2023-07-09T21:43:06.188030+0000","last_became_active":"2023-07-09T21:43:05.141596+0000","last_became_peered":"2023-07-09T21:43:05.141596+0000","last_unstale":"2023-07-09T21:43:06.188030+0000","last_undegraded":"2023-07-09T21:43:06.188030+0000","last_fullsized":"2023-07-09T21:43:06.188030+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:36:03.158704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135984+0000","last_change":"2023-07-09T21:43:04.097685+0000","last_active":"2023-07-09T21:43:06.135984+0000","last_peered":"2023-07-09T21:43:06.135984+0000","last_clean":"2023-07-09T21:43:06.135984+0000","last_became_active":"2023-07-09T21:43:04.097353+0000","last_became_peered":"2023-07-09T21:43:04.097353+0000","last_unstale":"2023-07-09T21:43:06.135984+0000","last_undegraded":"2023-07-09T21:43:06.135984+0000","last_fullsized":"2023-07-09T21:43:06.135984+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:20.174298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139603+0000","last_change":"2023-07-09T21:43:05.137054+0000","last_active":"2023-07-09T21:43:06.139603+0000","last_peered":"2023-07-09T21:43:06.139603+0000","last_clean":"2023-07-09T21:43:06.139603+0000","last_became_active":"2023-07-09T21:43:05.136771+0000","last_became_peered":"2023-07-09T21:43:05.136771+0000","last_unstale":"2023-07-09T21:43:06.139603+0000","last_undegraded":"2023-07-09T21:43:06.139603+0000","last_fullsized":"2023-07-09T21:43:06.139603+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:59.626679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141061+0000","last_change":"2023-07-09T21:43:04.109765+0000","last_active":"2023-07-09T21:43:06.141061+0000","last_peered":"2023-07-09T21:43:06.141061+0000","last_clean":"2023-07-09T21:43:06.141061+0000","last_became_active":"2023-07-09T21:43:04.109464+0000","last_became_peered":"2023-07-09T21:43:04.109464+0000","last_unstale":"2023-07-09T21:43:06.141061+0000","last_undegraded":"2023-07-09T21:43:06.141061+0000","last_fullsized":"2023-07-09T21:43:06.141061+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:30:07.157638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188067+0000","last_change":"2023-07-09T21:43:05.135745+0000","last_active":"2023-07-09T21:43:06.188067+0000","last_peered":"2023-07-09T21:43:06.188067+0000","last_clean":"2023-07-09T21:43:06.188067+0000","last_became_active":"2023-07-09T21:43:05.135463+0000","last_became_peered":"2023-07-09T21:43:05.135463+0000","last_unstale":"2023-07-09T21:43:06.188067+0000","last_undegraded":"2023-07-09T21:43:06.188067+0000","last_fullsized":"2023-07-09T21:43:06.188067+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:56.981225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140742+0000","last_change":"2023-07-09T21:43:04.108354+0000","last_active":"2023-07-09T21:43:06.140742+0000","last_peered":"2023-07-09T21:43:06.140742+0000","last_clean":"2023-07-09T21:43:06.140742+0000","last_became_active":"2023-07-09T21:43:04.108047+0000","last_became_peered":"2023-07-09T21:43:04.108047+0000","last_unstale":"2023-07-09T21:43:06.140742+0000","last_undegraded":"2023-07-09T21:43:06.140742+0000","last_fullsized":"2023-07-09T21:43:06.140742+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:22:31.574911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193870+0000","last_change":"2023-07-09T21:43:05.137002+0000","last_active":"2023-07-09T21:43:06.193870+0000","last_peered":"2023-07-09T21:43:06.193870+0000","last_clean":"2023-07-09T21:43:06.193870+0000","last_became_active":"2023-07-09T21:43:05.136744+0000","last_became_peered":"2023-07-09T21:43:05.136744+0000","last_unstale":"2023-07-09T21:43:06.193870+0000","last_undegraded":"2023-07-09T21:43:06.193870+0000","last_fullsized":"2023-07-09T21:43:06.193870+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:08:26.854967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193890+0000","last_change":"2023-07-09T21:43:04.107762+0000","last_active":"2023-07-09T21:43:06.193890+0000","last_peered":"2023-07-09T21:43:06.193890+0000","last_clean":"2023-07-09T21:43:06.193890+0000","last_became_active":"2023-07-09T21:43:04.107396+0000","last_became_peered":"2023-07-09T21:43:04.107396+0000","last_unstale":"2023-07-09T21:43:06.193890+0000","last_undegraded":"2023-07-09T21:43:06.193890+0000","last_fullsized":"2023-07-09T21:43:06.193890+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:28.627907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194478+0000","last_change":"2023-07-09T21:43:05.134120+0000","last_active":"2023-07-09T21:43:06.194478+0000","last_peered":"2023-07-09T21:43:06.194478+0000","last_clean":"2023-07-09T21:43:06.194478+0000","last_became_active":"2023-07-09T21:43:05.133138+0000","last_became_peered":"2023-07-09T21:43:05.133138+0000","last_unstale":"2023-07-09T21:43:06.194478+0000","last_undegraded":"2023-07-09T21:43:06.194478+0000","last_fullsized":"2023-07-09T21:43:06.194478+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:44.529210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135413+0000","last_change":"2023-07-09T21:43:04.102572+0000","last_active":"2023-07-09T21:43:06.135413+0000","last_peered":"2023-07-09T21:43:06.135413+0000","last_clean":"2023-07-09T21:43:06.135413+0000","last_became_active":"2023-07-09T21:43:04.102251+0000","last_became_peered":"2023-07-09T21:43:04.102251+0000","last_unstale":"2023-07-09T21:43:06.135413+0000","last_undegraded":"2023-07-09T21:43:06.135413+0000","last_fullsized":"2023-07-09T21:43:06.135413+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:52:45.084287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135805+0000","last_change":"2023-07-09T21:43:05.136883+0000","last_active":"2023-07-09T21:43:06.135805+0000","last_peered":"2023-07-09T21:43:06.135805+0000","last_clean":"2023-07-09T21:43:06.135805+0000","last_became_active":"2023-07-09T21:43:05.136608+0000","last_became_peered":"2023-07-09T21:43:05.136608+0000","last_unstale":"2023-07-09T21:43:06.135805+0000","last_undegraded":"2023-07-09T21:43:06.135805+0000","last_fullsized":"2023-07-09T21:43:06.135805+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:35.030360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189348+0000","last_change":"2023-07-09T21:43:04.109982+0000","last_active":"2023-07-09T21:43:06.189348+0000","last_peered":"2023-07-09T21:43:06.189348+0000","last_clean":"2023-07-09T21:43:06.189348+0000","last_became_active":"2023-07-09T21:43:04.109679+0000","last_became_peered":"2023-07-09T21:43:04.109679+0000","last_unstale":"2023-07-09T21:43:06.189348+0000","last_undegraded":"2023-07-09T21:43:06.189348+0000","last_fullsized":"2023-07-09T21:43:06.189348+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:22.100991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141062+0000","last_change":"2023-07-09T21:43:05.144919+0000","last_active":"2023-07-09T21:43:06.141062+0000","last_peered":"2023-07-09T21:43:06.141062+0000","last_clean":"2023-07-09T21:43:06.141062+0000","last_became_active":"2023-07-09T21:43:05.143681+0000","last_became_peered":"2023-07-09T21:43:05.143681+0000","last_unstale":"2023-07-09T21:43:06.141062+0000","last_undegraded":"2023-07-09T21:43:06.141062+0000","last_fullsized":"2023-07-09T21:43:06.141062+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:26:57.136672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193855+0000","last_change":"2023-07-09T21:43:04.114995+0000","last_active":"2023-07-09T21:43:06.193855+0000","last_peered":"2023-07-09T21:43:06.193855+0000","last_clean":"2023-07-09T21:43:06.193855+0000","last_became_active":"2023-07-09T21:43:04.114707+0000","last_became_peered":"2023-07-09T21:43:04.114707+0000","last_unstale":"2023-07-09T21:43:06.193855+0000","last_undegraded":"2023-07-09T21:43:06.193855+0000","last_fullsized":"2023-07-09T21:43:06.193855+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:51.348870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193822+0000","last_change":"2023-07-09T21:43:05.133607+0000","last_active":"2023-07-09T21:43:06.193822+0000","last_peered":"2023-07-09T21:43:06.193822+0000","last_clean":"2023-07-09T21:43:06.193822+0000","last_became_active":"2023-07-09T21:43:05.133293+0000","last_became_peered":"2023-07-09T21:43:05.133293+0000","last_unstale":"2023-07-09T21:43:06.193822+0000","last_undegraded":"2023-07-09T21:43:06.193822+0000","last_fullsized":"2023-07-09T21:43:06.193822+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:04.079861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140682+0000","last_change":"2023-07-09T21:43:04.111388+0000","last_active":"2023-07-09T21:43:06.140682+0000","last_peered":"2023-07-09T21:43:06.140682+0000","last_clean":"2023-07-09T21:43:06.140682+0000","last_became_active":"2023-07-09T21:43:04.110970+0000","last_became_peered":"2023-07-09T21:43:04.110970+0000","last_unstale":"2023-07-09T21:43:06.140682+0000","last_undegraded":"2023-07-09T21:43:06.140682+0000","last_fullsized":"2023-07-09T21:43:06.140682+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:25:38.346286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139934+0000","last_change":"2023-07-09T21:43:05.139932+0000","last_active":"2023-07-09T21:43:06.139934+0000","last_peered":"2023-07-09T21:43:06.139934+0000","last_clean":"2023-07-09T21:43:06.139934+0000","last_became_active":"2023-07-09T21:43:05.139321+0000","last_became_peered":"2023-07-09T21:43:05.139321+0000","last_unstale":"2023-07-09T21:43:06.139934+0000","last_undegraded":"2023-07-09T21:43:06.139934+0000","last_fullsized":"2023-07-09T21:43:06.139934+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:14:24.549972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194161+0000","last_change":"2023-07-09T21:43:04.119311+0000","last_active":"2023-07-09T21:43:06.194161+0000","last_peered":"2023-07-09T21:43:06.194161+0000","last_clean":"2023-07-09T21:43:06.194161+0000","last_became_active":"2023-07-09T21:43:04.119040+0000","last_became_peered":"2023-07-09T21:43:04.119040+0000","last_unstale":"2023-07-09T21:43:06.194161+0000","last_undegraded":"2023-07-09T21:43:06.194161+0000","last_fullsized":"2023-07-09T21:43:06.194161+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:01:50.530497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140459+0000","last_change":"2023-07-09T21:43:05.140149+0000","last_active":"2023-07-09T21:43:06.140459+0000","last_peered":"2023-07-09T21:43:06.140459+0000","last_clean":"2023-07-09T21:43:06.140459+0000","last_became_active":"2023-07-09T21:43:05.139487+0000","last_became_peered":"2023-07-09T21:43:05.139487+0000","last_unstale":"2023-07-09T21:43:06.140459+0000","last_undegraded":"2023-07-09T21:43:06.140459+0000","last_fullsized":"2023-07-09T21:43:06.140459+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:18:25.286959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"157'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189891+0000","last_change":"2023-07-09T21:43:04.110053+0000","last_active":"2023-07-09T21:43:06.189891+0000","last_peered":"2023-07-09T21:43:06.189891+0000","last_clean":"2023-07-09T21:43:06.189891+0000","last_became_active":"2023-07-09T21:43:04.109787+0000","last_became_peered":"2023-07-09T21:43:04.109787+0000","last_unstale":"2023-07-09T21:43:06.189891+0000","last_undegraded":"2023-07-09T21:43:06.189891+0000","last_fullsized":"2023-07-09T21:43:06.189891+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:03:19.634808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188655+0000","last_change":"2023-07-09T21:43:05.137681+0000","last_active":"2023-07-09T21:43:06.188655+0000","last_peered":"2023-07-09T21:43:06.188655+0000","last_clean":"2023-07-09T21:43:06.188655+0000","last_became_active":"2023-07-09T21:43:05.136681+0000","last_became_peered":"2023-07-09T21:43:05.136681+0000","last_unstale":"2023-07-09T21:43:06.188655+0000","last_undegraded":"2023-07-09T21:43:06.188655+0000","last_fullsized":"2023-07-09T21:43:06.188655+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:56:51.259373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135749+0000","last_change":"2023-07-09T21:43:04.111581+0000","last_active":"2023-07-09T21:43:06.135749+0000","last_peered":"2023-07-09T21:43:06.135749+0000","last_clean":"2023-07-09T21:43:06.135749+0000","last_became_active":"2023-07-09T21:43:04.111287+0000","last_became_peered":"2023-07-09T21:43:04.111287+0000","last_unstale":"2023-07-09T21:43:06.135749+0000","last_undegraded":"2023-07-09T21:43:06.135749+0000","last_fullsized":"2023-07-09T21:43:06.135749+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:54:45.401555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135623+0000","last_change":"2023-07-09T21:43:05.143351+0000","last_active":"2023-07-09T21:43:06.135623+0000","last_peered":"2023-07-09T21:43:06.135623+0000","last_clean":"2023-07-09T21:43:06.135623+0000","last_became_active":"2023-07-09T21:43:05.143036+0000","last_became_peered":"2023-07-09T21:43:05.143036+0000","last_unstale":"2023-07-09T21:43:06.135623+0000","last_undegraded":"2023-07-09T21:43:06.135623+0000","last_fullsized":"2023-07-09T21:43:06.135623+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:58.038128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194046+0000","last_change":"2023-07-09T21:43:04.111715+0000","last_active":"2023-07-09T21:43:06.194046+0000","last_peered":"2023-07-09T21:43:06.194046+0000","last_clean":"2023-07-09T21:43:06.194046+0000","last_became_active":"2023-07-09T21:43:04.111369+0000","last_became_peered":"2023-07-09T21:43:04.111369+0000","last_unstale":"2023-07-09T21:43:06.194046+0000","last_undegraded":"2023-07-09T21:43:06.194046+0000","last_fullsized":"2023-07-09T21:43:06.194046+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:59:00.667994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188627+0000","last_change":"2023-07-09T21:43:05.142362+0000","last_active":"2023-07-09T21:43:06.188627+0000","last_peered":"2023-07-09T21:43:06.188627+0000","last_clean":"2023-07-09T21:43:06.188627+0000","last_became_active":"2023-07-09T21:43:05.142041+0000","last_became_peered":"2023-07-09T21:43:05.142041+0000","last_unstale":"2023-07-09T21:43:06.188627+0000","last_undegraded":"2023-07-09T21:43:06.188627+0000","last_fullsized":"2023-07-09T21:43:06.188627+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:27.222919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188365+0000","last_change":"2023-07-09T21:43:04.110623+0000","last_active":"2023-07-09T21:43:06.188365+0000","last_peered":"2023-07-09T21:43:06.188365+0000","last_clean":"2023-07-09T21:43:06.188365+0000","last_became_active":"2023-07-09T21:43:04.110329+0000","last_became_peered":"2023-07-09T21:43:04.110329+0000","last_unstale":"2023-07-09T21:43:06.188365+0000","last_undegraded":"2023-07-09T21:43:06.188365+0000","last_fullsized":"2023-07-09T21:43:06.188365+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:59.714973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135952+0000","last_change":"2023-07-09T21:43:05.134737+0000","last_active":"2023-07-09T21:43:06.135952+0000","last_peered":"2023-07-09T21:43:06.135952+0000","last_clean":"2023-07-09T21:43:06.135952+0000","last_became_active":"2023-07-09T21:43:05.134459+0000","last_became_peered":"2023-07-09T21:43:05.134459+0000","last_unstale":"2023-07-09T21:43:06.135952+0000","last_undegraded":"2023-07-09T21:43:06.135952+0000","last_fullsized":"2023-07-09T21:43:06.135952+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:19.928277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140023+0000","last_change":"2023-07-09T21:43:04.116122+0000","last_active":"2023-07-09T21:43:06.140023+0000","last_peered":"2023-07-09T21:43:06.140023+0000","last_clean":"2023-07-09T21:43:06.140023+0000","last_became_active":"2023-07-09T21:43:04.115798+0000","last_became_peered":"2023-07-09T21:43:04.115798+0000","last_unstale":"2023-07-09T21:43:06.140023+0000","last_undegraded":"2023-07-09T21:43:06.140023+0000","last_fullsized":"2023-07-09T21:43:06.140023+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:11:53.157556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140309+0000","last_change":"2023-07-09T21:43:05.139010+0000","last_active":"2023-07-09T21:43:06.140309+0000","last_peered":"2023-07-09T21:43:06.140309+0000","last_clean":"2023-07-09T21:43:06.140309+0000","last_became_active":"2023-07-09T21:43:05.138721+0000","last_became_peered":"2023-07-09T21:43:05.138721+0000","last_unstale":"2023-07-09T21:43:06.140309+0000","last_undegraded":"2023-07-09T21:43:06.140309+0000","last_fullsized":"2023-07-09T21:43:06.140309+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:53:13.175078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189005+0000","last_change":"2023-07-09T21:43:04.104644+0000","last_active":"2023-07-09T21:43:06.189005+0000","last_peered":"2023-07-09T21:43:06.189005+0000","last_clean":"2023-07-09T21:43:06.189005+0000","last_became_active":"2023-07-09T21:43:04.104004+0000","last_became_peered":"2023-07-09T21:43:04.104004+0000","last_unstale":"2023-07-09T21:43:06.189005+0000","last_undegraded":"2023-07-09T21:43:06.189005+0000","last_fullsized":"2023-07-09T21:43:06.189005+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:42.585253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135418+0000","last_change":"2023-07-09T21:43:05.136297+0000","last_active":"2023-07-09T21:43:06.135418+0000","last_peered":"2023-07-09T21:43:06.135418+0000","last_clean":"2023-07-09T21:43:06.135418+0000","last_became_active":"2023-07-09T21:43:05.136011+0000","last_became_peered":"2023-07-09T21:43:05.136011+0000","last_unstale":"2023-07-09T21:43:06.135418+0000","last_undegraded":"2023-07-09T21:43:06.135418+0000","last_fullsized":"2023-07-09T21:43:06.135418+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:01:04.416005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189153+0000","last_change":"2023-07-09T21:43:04.112265+0000","last_active":"2023-07-09T21:43:06.189153+0000","last_peered":"2023-07-09T21:43:06.189153+0000","last_clean":"2023-07-09T21:43:06.189153+0000","last_became_active":"2023-07-09T21:43:04.111982+0000","last_became_peered":"2023-07-09T21:43:04.111982+0000","last_unstale":"2023-07-09T21:43:06.189153+0000","last_undegraded":"2023-07-09T21:43:06.189153+0000","last_fullsized":"2023-07-09T21:43:06.189153+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:26.977295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194016+0000","last_change":"2023-07-09T21:43:05.135389+0000","last_active":"2023-07-09T21:43:06.194016+0000","last_peered":"2023-07-09T21:43:06.194016+0000","last_clean":"2023-07-09T21:43:06.194016+0000","last_became_active":"2023-07-09T21:43:05.133820+0000","last_became_peered":"2023-07-09T21:43:05.133820+0000","last_unstale":"2023-07-09T21:43:06.194016+0000","last_undegraded":"2023-07-09T21:43:06.194016+0000","last_fullsized":"2023-07-09T21:43:06.194016+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:38.041463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"158'1","reported_seq":14,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194377+0000","last_change":"2023-07-09T21:43:04.110528+0000","last_active":"2023-07-09T21:43:06.194377+0000","last_peered":"2023-07-09T21:43:06.194377+0000","last_clean":"2023-07-09T21:43:06.194377+0000","last_became_active":"2023-07-09T21:43:04.110266+0000","last_became_peered":"2023-07-09T21:43:04.110266+0000","last_unstale":"2023-07-09T21:43:06.194377+0000","last_undegraded":"2023-07-09T21:43:06.194377+0000","last_fullsized":"2023-07-09T21:43:06.194377+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:51:12.937563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140041+0000","last_change":"2023-07-09T21:43:05.146077+0000","last_active":"2023-07-09T21:43:06.140041+0000","last_peered":"2023-07-09T21:43:06.140041+0000","last_clean":"2023-07-09T21:43:06.140041+0000","last_became_active":"2023-07-09T21:43:05.145806+0000","last_became_peered":"2023-07-09T21:43:05.145806+0000","last_unstale":"2023-07-09T21:43:06.140041+0000","last_undegraded":"2023-07-09T21:43:06.140041+0000","last_fullsized":"2023-07-09T21:43:06.140041+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:48:03.988235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194108+0000","last_change":"2023-07-09T21:43:04.119204+0000","last_active":"2023-07-09T21:43:06.194108+0000","last_peered":"2023-07-09T21:43:06.194108+0000","last_clean":"2023-07-09T21:43:06.194108+0000","last_became_active":"2023-07-09T21:43:04.118925+0000","last_became_peered":"2023-07-09T21:43:04.118925+0000","last_unstale":"2023-07-09T21:43:06.194108+0000","last_undegraded":"2023-07-09T21:43:06.194108+0000","last_fullsized":"2023-07-09T21:43:06.194108+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:23:54.631823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188799+0000","last_change":"2023-07-09T21:43:05.129195+0000","last_active":"2023-07-09T21:43:06.188799+0000","last_peered":"2023-07-09T21:43:06.188799+0000","last_clean":"2023-07-09T21:43:06.188799+0000","last_became_active":"2023-07-09T21:43:05.128915+0000","last_became_peered":"2023-07-09T21:43:05.128915+0000","last_unstale":"2023-07-09T21:43:06.188799+0000","last_undegraded":"2023-07-09T21:43:06.188799+0000","last_fullsized":"2023-07-09T21:43:06.188799+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:05:43.592356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189502+0000","last_change":"2023-07-09T21:43:04.105009+0000","last_active":"2023-07-09T21:43:06.189502+0000","last_peered":"2023-07-09T21:43:06.189502+0000","last_clean":"2023-07-09T21:43:06.189502+0000","last_became_active":"2023-07-09T21:43:04.104702+0000","last_became_peered":"2023-07-09T21:43:04.104702+0000","last_unstale":"2023-07-09T21:43:06.189502+0000","last_undegraded":"2023-07-09T21:43:06.189502+0000","last_fullsized":"2023-07-09T21:43:06.189502+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:55:21.293310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189382+0000","last_change":"2023-07-09T21:43:05.144266+0000","last_active":"2023-07-09T21:43:06.189382+0000","last_peered":"2023-07-09T21:43:06.189382+0000","last_clean":"2023-07-09T21:43:06.189382+0000","last_became_active":"2023-07-09T21:43:05.144005+0000","last_became_peered":"2023-07-09T21:43:05.144005+0000","last_unstale":"2023-07-09T21:43:06.189382+0000","last_undegraded":"2023-07-09T21:43:06.189382+0000","last_fullsized":"2023-07-09T21:43:06.189382+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:05:19.732926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140233+0000","last_change":"2023-07-09T21:43:04.112867+0000","last_active":"2023-07-09T21:43:06.140233+0000","last_peered":"2023-07-09T21:43:06.140233+0000","last_clean":"2023-07-09T21:43:06.140233+0000","last_became_active":"2023-07-09T21:43:04.112599+0000","last_became_peered":"2023-07-09T21:43:04.112599+0000","last_unstale":"2023-07-09T21:43:06.140233+0000","last_undegraded":"2023-07-09T21:43:06.140233+0000","last_fullsized":"2023-07-09T21:43:06.140233+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:12.139903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189825+0000","last_change":"2023-07-09T21:43:05.143678+0000","last_active":"2023-07-09T21:43:06.189825+0000","last_peered":"2023-07-09T21:43:06.189825+0000","last_clean":"2023-07-09T21:43:06.189825+0000","last_became_active":"2023-07-09T21:43:05.143374+0000","last_became_peered":"2023-07-09T21:43:05.143374+0000","last_unstale":"2023-07-09T21:43:06.189825+0000","last_undegraded":"2023-07-09T21:43:06.189825+0000","last_fullsized":"2023-07-09T21:43:06.189825+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:46:05.439264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140552+0000","last_change":"2023-07-09T21:43:04.110316+0000","last_active":"2023-07-09T21:43:06.140552+0000","last_peered":"2023-07-09T21:43:06.140552+0000","last_clean":"2023-07-09T21:43:06.140552+0000","last_became_active":"2023-07-09T21:43:04.110028+0000","last_became_peered":"2023-07-09T21:43:04.110028+0000","last_unstale":"2023-07-09T21:43:06.140552+0000","last_undegraded":"2023-07-09T21:43:06.140552+0000","last_fullsized":"2023-07-09T21:43:06.140552+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:48:47.052243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189754+0000","last_change":"2023-07-09T21:43:05.138787+0000","last_active":"2023-07-09T21:43:06.189754+0000","last_peered":"2023-07-09T21:43:06.189754+0000","last_clean":"2023-07-09T21:43:06.189754+0000","last_became_active":"2023-07-09T21:43:05.138460+0000","last_became_peered":"2023-07-09T21:43:05.138460+0000","last_unstale":"2023-07-09T21:43:06.189754+0000","last_undegraded":"2023-07-09T21:43:06.189754+0000","last_fullsized":"2023-07-09T21:43:06.189754+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:18.194199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189617+0000","last_change":"2023-07-09T21:43:04.105115+0000","last_active":"2023-07-09T21:43:06.189617+0000","last_peered":"2023-07-09T21:43:06.189617+0000","last_clean":"2023-07-09T21:43:06.189617+0000","last_became_active":"2023-07-09T21:43:04.104829+0000","last_became_peered":"2023-07-09T21:43:04.104829+0000","last_unstale":"2023-07-09T21:43:06.189617+0000","last_undegraded":"2023-07-09T21:43:06.189617+0000","last_fullsized":"2023-07-09T21:43:06.189617+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:51.058464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141217+0000","last_change":"2023-07-09T21:43:05.146619+0000","last_active":"2023-07-09T21:43:06.141217+0000","last_peered":"2023-07-09T21:43:06.141217+0000","last_clean":"2023-07-09T21:43:06.141217+0000","last_became_active":"2023-07-09T21:43:05.146337+0000","last_became_peered":"2023-07-09T21:43:05.146337+0000","last_unstale":"2023-07-09T21:43:06.141217+0000","last_undegraded":"2023-07-09T21:43:06.141217+0000","last_fullsized":"2023-07-09T21:43:06.141217+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:14.705020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.135520+0000","last_change":"2023-07-09T21:43:04.108077+0000","last_active":"2023-07-09T21:43:06.135520+0000","last_peered":"2023-07-09T21:43:06.135520+0000","last_clean":"2023-07-09T21:43:06.135520+0000","last_became_active":"2023-07-09T21:43:04.107786+0000","last_became_peered":"2023-07-09T21:43:04.107786+0000","last_unstale":"2023-07-09T21:43:06.135520+0000","last_undegraded":"2023-07-09T21:43:06.135520+0000","last_fullsized":"2023-07-09T21:43:06.135520+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:42:25.943182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194069+0000","last_change":"2023-07-09T21:43:05.143544+0000","last_active":"2023-07-09T21:43:06.194069+0000","last_peered":"2023-07-09T21:43:06.194069+0000","last_clean":"2023-07-09T21:43:06.194069+0000","last_became_active":"2023-07-09T21:43:05.143285+0000","last_became_peered":"2023-07-09T21:43:05.143285+0000","last_unstale":"2023-07-09T21:43:06.194069+0000","last_undegraded":"2023-07-09T21:43:06.194069+0000","last_fullsized":"2023-07-09T21:43:06.194069+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:24.866032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140414+0000","last_change":"2023-07-09T21:43:04.120583+0000","last_active":"2023-07-09T21:43:06.140414+0000","last_peered":"2023-07-09T21:43:06.140414+0000","last_clean":"2023-07-09T21:43:06.140414+0000","last_became_active":"2023-07-09T21:43:04.120220+0000","last_became_peered":"2023-07-09T21:43:04.120220+0000","last_unstale":"2023-07-09T21:43:06.140414+0000","last_undegraded":"2023-07-09T21:43:06.140414+0000","last_fullsized":"2023-07-09T21:43:06.140414+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:14:33.965074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"146'271","reported_seq":959,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139698+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:43:06.139698+0000","last_peered":"2023-07-09T21:43:06.139698+0000","last_clean":"2023-07-09T21:43:06.139698+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:43:06.139698+0000","last_undegraded":"2023-07-09T21:43:06.139698+0000","last_fullsized":"2023-07-09T21:43:06.139698+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":271,"log_dups_size":0,"ondisk_log_size":271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:11:06.981682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":298,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140367+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:43:06.140367+0000","last_peered":"2023-07-09T21:43:06.140367+0000","last_clean":"2023-07-09T21:43:06.140367+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:43:06.140367+0000","last_undegraded":"2023-07-09T21:43:06.140367+0000","last_fullsized":"2023-07-09T21:43:06.140367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:25:40.589779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141269+0000","last_change":"2023-07-09T21:43:05.140018+0000","last_active":"2023-07-09T21:43:06.141269+0000","last_peered":"2023-07-09T21:43:06.141269+0000","last_clean":"2023-07-09T21:43:06.141269+0000","last_became_active":"2023-07-09T21:43:05.139364+0000","last_became_peered":"2023-07-09T21:43:05.139364+0000","last_unstale":"2023-07-09T21:43:06.141269+0000","last_undegraded":"2023-07-09T21:43:06.141269+0000","last_fullsized":"2023-07-09T21:43:06.141269+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:17:47.453447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193646+0000","last_change":"2023-07-09T21:43:04.110688+0000","last_active":"2023-07-09T21:43:06.193646+0000","last_peered":"2023-07-09T21:43:06.193646+0000","last_clean":"2023-07-09T21:43:06.193646+0000","last_became_active":"2023-07-09T21:43:04.110287+0000","last_became_peered":"2023-07-09T21:43:04.110287+0000","last_unstale":"2023-07-09T21:43:06.193646+0000","last_undegraded":"2023-07-09T21:43:06.193646+0000","last_fullsized":"2023-07-09T21:43:06.193646+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:33:07.312546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":257,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139612+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:43:06.139612+0000","last_peered":"2023-07-09T21:43:06.139612+0000","last_clean":"2023-07-09T21:43:06.139612+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:43:06.139612+0000","last_undegraded":"2023-07-09T21:43:06.139612+0000","last_fullsized":"2023-07-09T21:43:06.139612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:36.551877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.136052+0000","last_change":"2023-07-09T21:43:05.133741+0000","last_active":"2023-07-09T21:43:06.136052+0000","last_peered":"2023-07-09T21:43:06.136052+0000","last_clean":"2023-07-09T21:43:06.136052+0000","last_became_active":"2023-07-09T21:43:05.133406+0000","last_became_peered":"2023-07-09T21:43:05.133406+0000","last_unstale":"2023-07-09T21:43:06.136052+0000","last_undegraded":"2023-07-09T21:43:06.136052+0000","last_fullsized":"2023-07-09T21:43:06.136052+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:09.225988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"157'8","reported_seq":21,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188897+0000","last_change":"2023-07-09T21:43:04.106029+0000","last_active":"2023-07-09T21:43:06.188897+0000","last_peered":"2023-07-09T21:43:06.188897+0000","last_clean":"2023-07-09T21:43:06.188897+0000","last_became_active":"2023-07-09T21:43:04.105760+0000","last_became_peered":"2023-07-09T21:43:04.105760+0000","last_unstale":"2023-07-09T21:43:06.188897+0000","last_undegraded":"2023-07-09T21:43:06.188897+0000","last_fullsized":"2023-07-09T21:43:06.188897+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:27.741448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":252,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188087+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:43:06.188087+0000","last_peered":"2023-07-09T21:43:06.188087+0000","last_clean":"2023-07-09T21:43:06.188087+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:43:06.188087+0000","last_undegraded":"2023-07-09T21:43:06.188087+0000","last_fullsized":"2023-07-09T21:43:06.188087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:18:20.135410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188896+0000","last_change":"2023-07-09T21:43:05.142611+0000","last_active":"2023-07-09T21:43:06.188896+0000","last_peered":"2023-07-09T21:43:06.188896+0000","last_clean":"2023-07-09T21:43:06.188896+0000","last_became_active":"2023-07-09T21:43:05.142329+0000","last_became_peered":"2023-07-09T21:43:05.142329+0000","last_unstale":"2023-07-09T21:43:06.188896+0000","last_undegraded":"2023-07-09T21:43:06.188896+0000","last_fullsized":"2023-07-09T21:43:06.188896+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:34:25.768013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"157'2","reported_seq":15,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188270+0000","last_change":"2023-07-09T21:43:04.113973+0000","last_active":"2023-07-09T21:43:06.188270+0000","last_peered":"2023-07-09T21:43:06.188270+0000","last_clean":"2023-07-09T21:43:06.188270+0000","last_became_active":"2023-07-09T21:43:04.113561+0000","last_became_peered":"2023-07-09T21:43:04.113561+0000","last_unstale":"2023-07-09T21:43:06.188270+0000","last_undegraded":"2023-07-09T21:43:06.188270+0000","last_fullsized":"2023-07-09T21:43:06.188270+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:08.356689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":298,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.139914+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:43:06.139914+0000","last_peered":"2023-07-09T21:43:06.139914+0000","last_clean":"2023-07-09T21:43:06.139914+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:43:06.139914+0000","last_undegraded":"2023-07-09T21:43:06.139914+0000","last_fullsized":"2023-07-09T21:43:06.139914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:00:31.311637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.193793+0000","last_change":"2023-07-09T21:43:05.137056+0000","last_active":"2023-07-09T21:43:06.193793+0000","last_peered":"2023-07-09T21:43:06.193793+0000","last_clean":"2023-07-09T21:43:06.193793+0000","last_became_active":"2023-07-09T21:43:05.136785+0000","last_became_peered":"2023-07-09T21:43:05.136785+0000","last_unstale":"2023-07-09T21:43:06.193793+0000","last_undegraded":"2023-07-09T21:43:06.193793+0000","last_fullsized":"2023-07-09T21:43:06.193793+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:54:25.667778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"157'3","reported_seq":16,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141131+0000","last_change":"2023-07-09T21:43:04.113801+0000","last_active":"2023-07-09T21:43:06.141131+0000","last_peered":"2023-07-09T21:43:06.141131+0000","last_clean":"2023-07-09T21:43:06.141131+0000","last_became_active":"2023-07-09T21:43:04.113490+0000","last_became_peered":"2023-07-09T21:43:04.113490+0000","last_unstale":"2023-07-09T21:43:06.141131+0000","last_undegraded":"2023-07-09T21:43:06.141131+0000","last_fullsized":"2023-07-09T21:43:06.141131+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:28.526813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":250,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189614+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:43:06.189614+0000","last_peered":"2023-07-09T21:43:06.189614+0000","last_clean":"2023-07-09T21:43:06.189614+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:43:06.189614+0000","last_undegraded":"2023-07-09T21:43:06.189614+0000","last_fullsized":"2023-07-09T21:43:06.189614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:00:18.121856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194398+0000","last_change":"2023-07-09T21:43:05.136037+0000","last_active":"2023-07-09T21:43:06.194398+0000","last_peered":"2023-07-09T21:43:06.194398+0000","last_clean":"2023-07-09T21:43:06.194398+0000","last_became_active":"2023-07-09T21:43:05.135709+0000","last_became_peered":"2023-07-09T21:43:05.135709+0000","last_unstale":"2023-07-09T21:43:06.194398+0000","last_undegraded":"2023-07-09T21:43:06.194398+0000","last_fullsized":"2023-07-09T21:43:06.194398+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:05:28.995263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"157'6","reported_seq":19,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140771+0000","last_change":"2023-07-09T21:43:04.112763+0000","last_active":"2023-07-09T21:43:06.140771+0000","last_peered":"2023-07-09T21:43:06.140771+0000","last_clean":"2023-07-09T21:43:06.140771+0000","last_became_active":"2023-07-09T21:43:04.112041+0000","last_became_peered":"2023-07-09T21:43:04.112041+0000","last_unstale":"2023-07-09T21:43:06.140771+0000","last_undegraded":"2023-07-09T21:43:06.140771+0000","last_fullsized":"2023-07-09T21:43:06.140771+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:25.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":256,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.141195+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:43:06.141195+0000","last_peered":"2023-07-09T21:43:06.141195+0000","last_clean":"2023-07-09T21:43:06.141195+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:43:06.141195+0000","last_undegraded":"2023-07-09T21:43:06.141195+0000","last_fullsized":"2023-07-09T21:43:06.141195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:22.591033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.187947+0000","last_change":"2023-07-09T21:43:05.142086+0000","last_active":"2023-07-09T21:43:06.187947+0000","last_peered":"2023-07-09T21:43:06.187947+0000","last_clean":"2023-07-09T21:43:06.187947+0000","last_became_active":"2023-07-09T21:43:05.141775+0000","last_became_peered":"2023-07-09T21:43:05.141775+0000","last_unstale":"2023-07-09T21:43:06.187947+0000","last_undegraded":"2023-07-09T21:43:06.187947+0000","last_fullsized":"2023-07-09T21:43:06.187947+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:54:02.425477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.140155+0000","last_change":"2023-07-09T21:43:04.098406+0000","last_active":"2023-07-09T21:43:06.140155+0000","last_peered":"2023-07-09T21:43:06.140155+0000","last_clean":"2023-07-09T21:43:06.140155+0000","last_became_active":"2023-07-09T21:43:04.098107+0000","last_became_peered":"2023-07-09T21:43:04.098107+0000","last_unstale":"2023-07-09T21:43:06.140155+0000","last_undegraded":"2023-07-09T21:43:06.140155+0000","last_fullsized":"2023-07-09T21:43:06.140155+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:46:35.303512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":252,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189872+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:43:06.189872+0000","last_peered":"2023-07-09T21:43:06.189872+0000","last_clean":"2023-07-09T21:43:06.189872+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:43:06.189872+0000","last_undegraded":"2023-07-09T21:43:06.189872+0000","last_fullsized":"2023-07-09T21:43:06.189872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:48:18.103723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.189495+0000","last_change":"2023-07-09T21:43:05.138600+0000","last_active":"2023-07-09T21:43:06.189495+0000","last_peered":"2023-07-09T21:43:06.189495+0000","last_clean":"2023-07-09T21:43:06.189495+0000","last_became_active":"2023-07-09T21:43:05.132889+0000","last_became_peered":"2023-07-09T21:43:05.132889+0000","last_unstale":"2023-07-09T21:43:06.189495+0000","last_undegraded":"2023-07-09T21:43:06.189495+0000","last_fullsized":"2023-07-09T21:43:06.189495+0000","mapping_epoch":156,"log_start":"0'0","ondisk_log_start":"0'0","created":156,"last_epoch_clean":157,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:04.080967+0000","last_clean_scrub_stamp":"2023-07-09T21:43:04.080967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:42.407116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.188974+0000","last_change":"2023-07-09T21:43:04.113066+0000","last_active":"2023-07-09T21:43:06.188974+0000","last_peered":"2023-07-09T21:43:06.188974+0000","last_clean":"2023-07-09T21:43:06.188974+0000","last_became_active":"2023-07-09T21:43:04.112294+0000","last_became_peered":"2023-07-09T21:43:04.112294+0000","last_unstale":"2023-07-09T21:43:06.188974+0000","last_undegraded":"2023-07-09T21:43:06.188974+0000","last_fullsized":"2023-07-09T21:43:06.188974+0000","mapping_epoch":155,"log_start":"0'0","ondisk_log_start":"0'0","created":155,"last_epoch_clean":156,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:43:03.073865+0000","last_clean_scrub_stamp":"2023-07-09T21:43:03.073865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:58.357862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":260,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-07-09T21:43:06.194643+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:43:06.194643+0000","last_peered":"2023-07-09T21:43:06.194643+0000","last_clean":"2023-07-09T21:43:06.194643+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:43:06.194643+0000","last_undegraded":"2023-07-09T21:43:06.194643+0000","last_fullsized":"2023-07-09T21:43:06.194643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:36.720447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1460,"num_read_kb":2984,"num_write":439,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575095,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59804,"kb_used_data":2516,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312036,"statfs":{"total":96636764160,"available":96575524864,"internally_reserved":0,"allocated":2576384,"data_stored":1595023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.67900000000000005,"15min":0.70299999999999996},"min":{"1min":0.34100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.84999999999999998,"5min":1.03,"15min":1.03},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.71399999999999997,"15min":0.72499999999999998},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.88300000000000001,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":0.77200000000000002}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70699999999999996,"15min":0.72199999999999998},"min":{"1min":0.40600000000000003,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.88600000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73899999999999999,"15min":0.73499999999999999},"min":{"1min":0.48399999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84399999999999997,"5min":3.6389999999999998,"15min":3.6389999999999998},"last":0.54800000000000004}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.69899999999999995,"15min":0.71499999999999997},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":3.2149999999999999,"15min":3.2149999999999999},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.71499999999999997,"15min":0.73299999999999998},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":0.99099999999999999,"15min":1.0880000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.72199999999999998,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.90500000000000003,"5min":1.754,"15min":1.754},"last":0.748},{"interface":"front","average":{"1min":0.746,"5min":0.76100000000000001,"15min":0.77700000000000002},"min":{"1min":0.56200000000000006,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.96299999999999997,"5min":1.1140000000000001,"15min":1.129},"last":0.78900000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60299999999999998,"15min":0.59399999999999997},"min":{"1min":0.438,"5min":0.36199999999999999,"15min":0.36099999999999999},"max":{"1min":0.85599999999999998,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.61499999999999999,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.39600000000000002,"15min":0.35399999999999998},"max":{"1min":0.82999999999999996,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.80700000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.64900000000000002,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.379,"15min":0.34300000000000003},"max":{"1min":0.92400000000000004,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67500000000000004,"15min":0.66100000000000003},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.33100000000000002},"max":{"1min":0.86699999999999999,"5min":1.232,"15min":1.232},"last":0.94299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.70299999999999996,"15min":0.70799999999999996},"min":{"1min":0.497,"5min":0.48099999999999998,"15min":0.375},"max":{"1min":0.86799999999999999,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67600000000000005,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.40999999999999998},"max":{"1min":0.82899999999999996,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.86699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575094,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37072,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334768,"statfs":{"total":96636764160,"available":96598802432,"internally_reserved":0,"allocated":1974272,"data_stored":1003673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.69299999999999995,"15min":0.69899999999999995},"min":{"1min":0.46999999999999997,"5min":0.39300000000000002,"15min":0.33200000000000002},"max":{"1min":0.997,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72999999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.40300000000000002,"15min":0.33900000000000002},"max":{"1min":0.88900000000000001,"5min":1.9339999999999999,"15min":1.9339999999999999},"last":0.71699999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.746,"15min":0.748},"min":{"1min":0.47299999999999998,"5min":0.42499999999999999,"15min":0.33300000000000002},"max":{"1min":1.0229999999999999,"5min":4.0979999999999999,"15min":4.6360000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.60399999999999998,"5min":0.47399999999999998,"15min":0.379},"max":{"1min":0.94599999999999995,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73799999999999999},"min":{"1min":0.501,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.004,"5min":2.0430000000000001,"15min":2.0430000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.78900000000000003,"15min":0.76400000000000001},"min":{"1min":0.54000000000000004,"5min":0.44600000000000001,"15min":0.375},"max":{"1min":0.96199999999999997,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.70199999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.76000000000000001,"15min":0.75900000000000001},"min":{"1min":0.60599999999999998,"5min":0.53700000000000003,"15min":0.48699999999999999},"max":{"1min":1.0660000000000001,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76100000000000001,"15min":0.75800000000000001},"min":{"1min":0.496,"5min":0.49299999999999999,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.84999999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.69999999999999996,"15min":0.61599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39300000000000002,"15min":0.39100000000000001},"max":{"1min":0.84999999999999998,"5min":6.101,"15min":6.101},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.74099999999999999,"15min":0.64600000000000002},"min":{"1min":0.443,"5min":0.443,"15min":0.32500000000000001},"max":{"1min":0.86399999999999999,"5min":7.2910000000000004,"15min":7.2910000000000004},"last":0.59399999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73899999999999999,"15min":0.66200000000000003},"min":{"1min":0.48399999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.90900000000000003,"5min":4.7450000000000001,"15min":4.7450000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.73499999999999999,"15min":0.67100000000000004},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.39500000000000002},"max":{"1min":0.86799999999999999,"5min":5.1669999999999998,"15min":5.1669999999999998},"last":0.76100000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76200000000000001,"15min":0.70099999999999996},"min":{"1min":0.53600000000000003,"5min":0.503,"15min":0.38300000000000001},"max":{"1min":0.91400000000000003,"5min":3.4159999999999999,"15min":3.4159999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.746,"5min":0.82199999999999995,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.44600000000000001},"max":{"1min":0.95399999999999996,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.74099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575093,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51020,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":49088,"kb_avail":94320820,"statfs":{"total":96636764160,"available":96584519680,"internally_reserved":0,"allocated":1970176,"data_stored":1003023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":50266112},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69399999999999995,"15min":0.70499999999999996},"min":{"1min":0.42499999999999999,"5min":0.42099999999999999,"15min":0.34300000000000003},"max":{"1min":0.879,"5min":0.93500000000000005,"15min":0.98799999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69199999999999995,"15min":0.70599999999999996},"min":{"1min":0.371,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.96499999999999997,"5min":1.006,"15min":1.006},"last":0.71299999999999997}]},{"osd":1,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73199999999999998,"15min":0.73699999999999999},"min":{"1min":0.504,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.0409999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.68600000000000005,"15min":0.70299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.39700000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.02},"last":0.78800000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54300000000000004,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.89300000000000002,"5min":0.99299999999999999,"15min":0.999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.69699999999999995,"15min":0.71499999999999997},"min":{"1min":0.52600000000000002,"5min":0.44,"15min":0.38800000000000001},"max":{"1min":0.92900000000000005,"5min":1.002,"15min":1.002},"last":0.67300000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72499999999999998,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.749,"15min":0.749},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.94399999999999995,"5min":1.0229999999999999,"15min":1.0580000000000001},"last":0.69299999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.378,"5min":0.36599999999999999,"15min":0.311},"max":{"1min":0.83299999999999996,"5min":0.94899999999999995,"15min":0.96899999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64600000000000002,"15min":0.61899999999999999},"min":{"1min":0.45300000000000001,"5min":0.41699999999999998,"15min":0.36799999999999999},"max":{"1min":0.90900000000000003,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45400000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65700000000000003,"15min":0.625},"min":{"1min":0.504,"5min":0.442,"15min":0.33200000000000002},"max":{"1min":0.77000000000000002,"5min":1.083,"15min":1.083},"last":0.627},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.66600000000000004,"15min":0.64600000000000002},"min":{"1min":0.48499999999999999,"5min":0.40799999999999997,"15min":0.40699999999999997},"max":{"1min":0.96799999999999997,"5min":1.0249999999999999,"15min":1.038},"last":0.55600000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:42:56 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.51700000000000002,"5min":0.46800000000000003,"15min":0.34399999999999997},"max":{"1min":1.1060000000000001,"5min":1.107,"15min":1.107},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71799999999999997,"15min":0.69599999999999995},"min":{"1min":0.52300000000000002,"5min":0.44,"15min":0.39200000000000002},"max":{"1min":0.98899999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575095,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37064,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334776,"statfs":{"total":96636764160,"available":96598810624,"internally_reserved":0,"allocated":1966080,"data_stored":1003001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66700000000000004,"15min":0.70599999999999996},"min":{"1min":0.46400000000000002,"5min":0.42699999999999999,"15min":0.35299999999999998},"max":{"1min":0.88500000000000001,"5min":0.93600000000000005,"15min":0.95299999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66700000000000004,"15min":0.69599999999999995},"min":{"1min":0.51400000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.84899999999999998,"5min":0.996,"15min":0.996},"last":0.66800000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66900000000000004,"15min":0.71399999999999997},"min":{"1min":0.44900000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.85599999999999998,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70599999999999996,"15min":0.72399999999999998},"min":{"1min":0.55700000000000005,"5min":0.41299999999999998,"15min":0.39500000000000002},"max":{"1min":0.97999999999999998,"5min":1.083,"15min":1.083},"last":0.61599999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.70599999999999996,"15min":0.73199999999999998},"min":{"1min":0.49399999999999999,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.97999999999999998},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.71999999999999997,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.47299999999999998,"15min":0.40799999999999997},"max":{"1min":0.95099999999999996,"5min":1.1259999999999999,"15min":1.3979999999999999},"last":0.69899999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.69299999999999995,"15min":0.72499999999999998},"min":{"1min":0.45900000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93600000000000005,"5min":1.002,"15min":1.26},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.72499999999999998,"15min":0.752},"min":{"1min":0.502,"5min":0.502,"15min":0.45800000000000002},"max":{"1min":1.008,"5min":1.034,"15min":1.05},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.39700000000000002,"5min":0.378,"15min":0.35299999999999998},"max":{"1min":0.81799999999999995,"5min":1.024,"15min":1.024},"last":0.752},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.39900000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.90300000000000002,"5min":1.0760000000000001,"15min":1.3089999999999999},"last":0.80800000000000005}]},{"osd":6,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.61399999999999999,"15min":0.60999999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.91600000000000004,"5min":0.95099999999999996,"15min":0.96899999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68500000000000005,"15min":0.66800000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.93000000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:43:03 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66500000000000004,"15min":0.65900000000000003},"min":{"1min":0.47499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84399999999999997,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.73099999999999998,"15min":0.70499999999999996},"min":{"1min":0.45800000000000002,"5min":0.439,"15min":0.38400000000000001},"max":{"1min":0.93799999999999994,"5min":1.097,"15min":1.097},"last":0.92300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575094,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37080,"kb_used_data":1936,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334760,"statfs":{"total":96636764160,"available":96598794240,"internally_reserved":0,"allocated":1982464,"data_stored":1004635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.46700000000000003},"min":{"1min":0.26500000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67500000000000004,"5min":0.88600000000000001,"15min":1.3680000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.497,"15min":0.52900000000000003},"min":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.76200000000000001,"5min":0.85599999999999998,"15min":1.3500000000000001},"last":0.41899999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.438,"15min":0.46400000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.52200000000000002,"5min":0.71599999999999997,"15min":0.85099999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.501,"15min":0.51700000000000002},"min":{"1min":0.33300000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75900000000000001,"5min":0.81299999999999994,"15min":0.85399999999999998},"last":0.47299999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.54500000000000004,"15min":0.57599999999999996},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.33700000000000002},"max":{"1min":0.746,"5min":1.101,"15min":1.101},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.59799999999999998,"15min":0.626},"min":{"1min":0.44,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80600000000000005,"5min":1.024,"15min":1.024},"last":0.70599999999999996}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.746,"15min":0.77100000000000002},"min":{"1min":0.52400000000000002,"5min":0.46100000000000002,"15min":0.42099999999999999},"max":{"1min":1.0529999999999999,"5min":1.111,"15min":1.3320000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.52400000000000002},"max":{"1min":1.101,"5min":1.1419999999999999,"15min":1.2689999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.78300000000000003,"15min":0.81399999999999995},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.141,"5min":1.141,"15min":1.3109999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.76700000000000002,"15min":0.79400000000000004},"min":{"1min":0.57099999999999995,"5min":0.53900000000000003,"15min":0.52600000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.208},"last":0.59299999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.748,"15min":0.77700000000000002},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.51},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.74099999999999999,"15min":0.76300000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.46800000000000003},"max":{"1min":0.97199999999999998,"5min":1.1930000000000001,"15min":1.2629999999999999},"last":0.79700000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.78600000000000003},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91400000000000003,"5min":1.083,"15min":1.127},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76000000000000001,"15min":0.78200000000000003},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.034,"5min":1.1459999999999999,"15min":1.1910000000000001},"last":0.76200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575095,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55120,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316720,"statfs":{"total":96636764160,"available":96580321280,"internally_reserved":0,"allocated":1974272,"data_stored":1003617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.441,"15min":0.46500000000000002},"min":{"1min":0.29499999999999998,"5min":0.26800000000000002,"15min":0.24099999999999999},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49099999999999999,"15min":0.51800000000000002},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46600000000000003}]},{"osd":1,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45800000000000002,"15min":0.47099999999999997},"min":{"1min":0.309,"5min":0.30199999999999999,"15min":0.28199999999999997},"max":{"1min":0.68700000000000006,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.498}]},{"osd":3,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54400000000000004,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41599999999999998,"5min":0.375,"15min":0.29599999999999999},"max":{"1min":0.84999999999999998,"5min":1.079,"15min":1.7050000000000001},"last":0.51300000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.73999999999999999,"15min":0.78600000000000003},"min":{"1min":0.624,"5min":0.45900000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.145,"15min":1.3360000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.76900000000000002,"15min":0.80900000000000005},"min":{"1min":0.53800000000000003,"5min":0.496,"15min":0.48499999999999999},"max":{"1min":1.123,"5min":1.2989999999999999,"15min":1.5149999999999999},"last":0.92700000000000005}]},{"osd":5,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.77400000000000002,"15min":0.81399999999999995},"min":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.44500000000000001},"max":{"1min":1.081,"5min":1.371,"15min":1.377},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.75800000000000001,"15min":0.80700000000000005},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.111,"5min":1.262,"15min":1.4590000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.78300000000000003,"15min":0.82899999999999996},"min":{"1min":0.60599999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1639999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.751,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.52400000000000002,"15min":0.45400000000000001},"max":{"1min":0.94599999999999995,"5min":1.3400000000000001,"15min":1.423},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:43:04 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76400000000000001,"15min":0.82099999999999995},"min":{"1min":0.60899999999999999,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.93500000000000005,"5min":1.163,"15min":1.48},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.78400000000000003,"15min":0.83499999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.46100000000000002},"max":{"1min":1.2,"5min":1.3999999999999999,"15min":1.496},"last":0.82999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575095,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32972,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338868,"statfs":{"total":96636764160,"available":96603000832,"internally_reserved":0,"allocated":1970176,"data_stored":1003071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.29099999999999998,"5min":0.251,"15min":0.251},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.76800000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.5},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.746,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.441}]},{"osd":2,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47799999999999998,"15min":0.49099999999999999},"min":{"1min":0.33200000000000002,"5min":0.32000000000000001,"15min":0.29799999999999999},"max":{"1min":0.73599999999999999,"5min":0.86099999999999999,"15min":1.5129999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51100000000000001,"15min":0.54200000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.96999999999999997},"last":0.39900000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.39900000000000002,"15min":0.39300000000000002},"max":{"1min":0.72299999999999998,"5min":0.77500000000000002,"15min":1.3069999999999999},"last":0.501},{"interface":"front","average":{"1min":0.503,"5min":0.50900000000000001,"15min":0.54200000000000004},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.80500000000000005,"15min":0.89300000000000002},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.80100000000000005},"min":{"1min":0.57499999999999996,"5min":0.54300000000000004,"15min":0.504},"max":{"1min":1.0169999999999999,"5min":1.129,"15min":1.155},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78100000000000003,"15min":0.81000000000000005},"min":{"1min":0.60599999999999998,"5min":0.47599999999999998,"15min":0.46899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.212},"last":0.92000000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.77100000000000002,"15min":0.77000000000000002},"min":{"1min":0.57799999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.96499999999999997,"5min":1.177,"15min":1.1839999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.77100000000000002,"15min":0.78900000000000003},"min":{"1min":0.56799999999999995,"5min":0.52300000000000002,"15min":0.44800000000000001},"max":{"1min":1.024,"5min":1.1160000000000001,"15min":1.149},"last":0.85199999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.55300000000000005,"5min":0.51200000000000001,"15min":0.49299999999999999},"max":{"1min":1.038,"5min":1.2,"15min":1.2},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.63500000000000001,"5min":0.53000000000000003,"15min":0.46600000000000003},"max":{"1min":1.0349999999999999,"5min":1.1699999999999999,"15min":1.258},"last":0.76400000000000001}]},{"osd":7,"last update":"Sun Jul 9 21:42:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.77200000000000002,"15min":0.79600000000000004},"min":{"1min":0.61499999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.98799999999999999,"5min":1.107,"15min":1.173},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0389999999999999,"5min":1.1899999999999999,"15min":1.2929999999999999},"last":0.83799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575095,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37652,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334188,"statfs":{"total":96636764160,"available":96598208512,"internally_reserved":0,"allocated":2568192,"data_stored":1593425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.46899999999999997,"15min":0.47399999999999998},"min":{"1min":0.33600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60099999999999998,"5min":0.67600000000000005,"15min":0.753},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.53800000000000003,"15min":0.54700000000000004},"min":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.311},"max":{"1min":0.629,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.56499999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.51200000000000001,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69099999999999995,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.36799999999999999,"5min":0.318,"15min":0.30199999999999999},"max":{"1min":0.80200000000000005,"5min":1.657,"15min":1.657},"last":0.44}]},{"osd":3,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51100000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.79200000000000004,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57699999999999996,"15min":0.58199999999999996},"min":{"1min":0.432,"5min":0.39400000000000002,"15min":0.35999999999999999},"max":{"1min":0.748,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.77500000000000002,"15min":0.79300000000000004},"min":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.78200000000000003},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.42299999999999999},"max":{"1min":0.873,"5min":1.835,"15min":1.835},"last":0.58799999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.76400000000000001,"15min":0.79500000000000004},"min":{"1min":0.54000000000000004,"5min":0.51700000000000002,"15min":0.49299999999999999},"max":{"1min":0.89800000000000002,"5min":1.726,"15min":1.726},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.76900000000000002,"15min":0.78900000000000003},"min":{"1min":0.53000000000000003,"5min":0.52400000000000002,"15min":0.46800000000000003},"max":{"1min":0.90500000000000003,"5min":1.615,"15min":1.615},"last":0.72699999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.76500000000000001,"15min":0.79400000000000004},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.90800000000000003,"5min":1.7569999999999999,"15min":1.7569999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.78800000000000003,"15min":0.80900000000000005},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52200000000000002},"max":{"1min":0.85299999999999998,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 21:42:54 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.79600000000000004,"15min":0.81200000000000006},"min":{"1min":0.57699999999999996,"5min":0.54100000000000004,"15min":0.48699999999999999},"max":{"1min":0.93200000000000005,"5min":1.6970000000000001,"15min":1.6970000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.77900000000000003,"15min":0.80500000000000005},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.48799999999999999},"max":{"1min":0.875,"5min":1.883,"15min":1.883},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:43:14.217 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:43:14.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:43:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 Processor -- start 2023-07-09T21:43:14.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 -- start start 2023-07-09T21:43:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f603c0b7980 0x7f603c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c15bf80 con 0x7f603c0ceb80 2023-07-09T21:43:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c160570 con 0x7f603c0d0780 2023-07-09T21:43:14.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6040b9f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f603c0cd070 con 0x7f603c0b7980 2023-07-09T21:43:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f603a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f603c0b7980 0x7f603c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6039d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f603c0ceb80 0x7f603c0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33712/0 (socket says 172.21.15.37:33712) 2023-07-09T21:43:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f6039d9b640 1 -- 172.21.15.37:0/1794770923 learned_addr learned my addr 172.21.15.37:0/1794770923 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f603a59c640 1 -- 172.21.15.37:0/1794770923 >> v1:172.21.15.119:6789/0 conn(0x7f603c0d0780 legacy=0x7f603c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f603a59c640 1 -- 172.21.15.37:0/1794770923 >> v1:172.21.15.37:6789/0 conn(0x7f603c0ceb80 legacy=0x7f603c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f603959a640 1 -- 172.21.15.37:0/1794770923 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485167749 0 0) 0x7f6030001120 con 0x7f603c0ceb80 2023-07-09T21:43:14.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.403+0000 7f603a59c640 1 -- 172.21.15.37:0/1794770923 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c0d02f0 con 0x7f603c0b7980 2023-07-09T21:43:14.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f603a59c640 1 --2- 172.21.15.37:0/1794770923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0b7980 0x7f603c160030 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f602c0097c0 tx=0x7f602c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b9d61f404c16ac server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f603959a640 1 -- 172.21.15.37:0/1794770923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0ab600 con 0x7f603c0b7980 2023-07-09T21:43:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f603959a640 1 -- 172.21.15.37:0/1794770923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c0a7050 con 0x7f603c0b7980 2023-07-09T21:43:14.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f603959a640 1 -- 172.21.15.37:0/1794770923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0ab980 con 0x7f603c0b7980 2023-07-09T21:43:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 -- 172.21.15.37:0/1794770923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0b7980 msgr2=0x7f603c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 --2- 172.21.15.37:0/1794770923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0b7980 0x7f603c160030 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f602c0097c0 tx=0x7f602c01c480 comp rx=0 tx=0).stop 2023-07-09T21:43:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 -- 172.21.15.37:0/1794770923 shutdown_connections 2023-07-09T21:43:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 --2- 172.21.15.37:0/1794770923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0b7980 0x7f603c160030 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 -- 172.21.15.37:0/1794770923 >> 172.21.15.37:0/1794770923 conn(0x7f603c073090 msgr2=0x7f603c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 -- 172.21.15.37:0/1794770923 shutdown_connections 2023-07-09T21:43:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.407+0000 7f6040b9f640 1 -- 172.21.15.37:0/1794770923 wait complete. 2023-07-09T21:43:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 Processor -- start 2023-07-09T21:43:14.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- start start 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f603c0b7980 0x7f603c1505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f603c0d0780 0x7f603c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c153a70 con 0x7f603c0ceb80 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c152e60 con 0x7f603c0d0780 2023-07-09T21:43:14.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c153140 con 0x7f603c0b7980 2023-07-09T21:43:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55238/0 (socket says 172.21.15.37:55238) 2023-07-09T21:43:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 -- 172.21.15.37:0/2160497919 learned_addr learned my addr 172.21.15.37:0/2160497919 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f603a59c640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f603c0b7980 0x7f603c1505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f603ad9d640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f603c0d0780 0x7f603c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 -- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f603c0b7980 msgr2=0x7f603c1505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f603c0b7980 0x7f603c1505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 -- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f603c0d0780 msgr2=0x7f603c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f603c0d0780 0x7f603c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 -- 172.21.15.37:0/2160497919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c009420 con 0x7f603c0ceb80 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6039d9b640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f603000c780 tx=0x7f603000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300072d0 con 0x7f603c0ceb80 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6030007430 con 0x7f603c0ceb80 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c153420 con 0x7f603c0ceb80 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030001d20 con 0x7f603c0ceb80 2023-07-09T21:43:14.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c150b10 con 0x7f603c0ceb80 2023-07-09T21:43:14.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.411+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c153c20 con 0x7f603c0ceb80 2023-07-09T21:43:14.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.415+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f60300047f0 con 0x7f603c0ceb80 2023-07-09T21:43:14.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.415+0000 7f602affd640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 0x7f601c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.415+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f6030083230 con 0x7f603c0ceb80 2023-07-09T21:43:14.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.415+0000 7f603a59c640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 0x7f601c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.415+0000 7f603a59c640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 0x7f601c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602c0ad000 tx=0x7f602c0a6000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.419+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f603c153c20 con 0x7f603c0ceb80 2023-07-09T21:43:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.627+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f603c15bf80 con 0x7f603c0ceb80 2023-07-09T21:43:14.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f602affd640 1 -- 172.21.15.37:0/2160497919 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+147 (secure 0 0 0) 0x7f603c15bf80 con 0x7f603c0ceb80 2023-07-09T21:43:14.632 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:43:14.632 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:43:14.632 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:43:14.632 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:43:14.633 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:43:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 msgr2=0x7f601c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 0x7f601c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f602c0ad000 tx=0x7f602c0a6000 comp rx=0 tx=0).stop 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 msgr2=0x7f603c157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f603000c780 tx=0x7f603000cc40 comp rx=0 tx=0).stop 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 shutdown_connections 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f601c0663a0 0x7f601c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f603c0d0780 0x7f603c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f603c0ceb80 0x7f603c157620 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 --2- 172.21.15.37:0/2160497919 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f603c0b7980 0x7f603c1505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 >> 172.21.15.37:0/2160497919 conn(0x7f603c073090 msgr2=0x7f603c0b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 shutdown_connections 2023-07-09T21:43:14.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.631+0000 7f6040b9f640 1 -- 172.21.15.37:0/2160497919 wait complete. 2023-07-09T21:43:14.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:43:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 Processor -- start 2023-07-09T21:43:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 -- start start 2023-07-09T21:43:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86240cef80 0x7f862406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240b49f0 con 0x7f86240b7ab0 2023-07-09T21:43:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240cc8a0 con 0x7f86240b4340 2023-07-09T21:43:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8628d00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240b7e80 con 0x7f86240cef80 2023-07-09T21:43:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f862259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f86240b7ab0 0x7f86240b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33718/0 (socket says 172.21.15.37:33718) 2023-07-09T21:43:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f862259c640 1 -- 172.21.15.37:0/1758300529 learned_addr learned my addr 172.21.15.37:0/1758300529 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8622d9d640 1 --2- 172.21.15.37:0/1758300529 >> v2:172.21.15.37:3300/0 conn(0x7f86240cef80 0x7f862406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8622d9d640 1 -- 172.21.15.37:0/1758300529 >> v1:172.21.15.119:6789/0 conn(0x7f86240b4340 legacy=0x7f86240d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8622d9d640 1 -- 172.21.15.37:0/1758300529 >> v1:172.21.15.37:6789/0 conn(0x7f86240b7ab0 legacy=0x7f86240b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8622d9d640 1 -- 172.21.15.37:0/1758300529 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240ccb80 con 0x7f86240cef80 2023-07-09T21:43:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.795+0000 7f8621d9b640 1 -- 172.21.15.37:0/1758300529 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920972234 0 0) 0x7f86240b49f0 con 0x7f86240b7ab0 2023-07-09T21:43:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8622d9d640 1 --2- 172.21.15.37:0/1758300529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240cef80 0x7f862406aa50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31363f887c31ecbc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8621d9b640 1 -- 172.21.15.37:0/1758300529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0a59e0 con 0x7f86240cef80 2023-07-09T21:43:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8621d9b640 1 -- 172.21.15.37:0/1758300529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861c0a5b40 con 0x7f86240cef80 2023-07-09T21:43:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8621d9b640 1 -- 172.21.15.37:0/1758300529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861c0ad440 con 0x7f86240cef80 2023-07-09T21:43:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 -- 172.21.15.37:0/1758300529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240cef80 msgr2=0x7f862406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 --2- 172.21.15.37:0/1758300529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240cef80 0x7f862406aa50 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f861c009d90 tx=0x7f861c01c920 comp rx=0 tx=0).stop 2023-07-09T21:43:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 -- 172.21.15.37:0/1758300529 shutdown_connections 2023-07-09T21:43:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 --2- 172.21.15.37:0/1758300529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240cef80 0x7f862406aa50 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 -- 172.21.15.37:0/1758300529 >> 172.21.15.37:0/1758300529 conn(0x7f8624073090 msgr2=0x7f8624069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 -- 172.21.15.37:0/1758300529 shutdown_connections 2023-07-09T21:43:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.799+0000 7f8628d00640 1 -- 172.21.15.37:0/1758300529 wait complete. 2023-07-09T21:43:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 Processor -- start 2023-07-09T21:43:14.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- start start 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240b7ab0 0x7f8624156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240cef80 0x7f8624150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862414fd40 con 0x7f86240b4340 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8624155860 con 0x7f86240b7ab0 2023-07-09T21:43:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8624155b40 con 0x7f86240cef80 2023-07-09T21:43:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55256/0 (socket says 172.21.15.37:55256) 2023-07-09T21:43:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 -- 172.21.15.37:0/3676168913 learned_addr learned my addr 172.21.15.37:0/3676168913 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 -- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240cef80 msgr2=0x7f8624150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240cef80 0x7f8624150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 -- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240b7ab0 msgr2=0x7f8624156620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240b7ab0 0x7f8624156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 -- 172.21.15.37:0/3676168913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c009a70 con 0x7f86240b4340 2023-07-09T21:43:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f862259c640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f861400c4a0 tx=0x7f861400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86140074e0 con 0x7f86240b4340 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8614007640 con 0x7f86240b4340 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8614004a30 con 0x7f86240b4340 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8624155e20 con 0x7f86240b4340 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.803+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862414c0f0 con 0x7f86240b4340 2023-07-09T21:43:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862404d7d0 con 0x7f86240b4340 2023-07-09T21:43:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8614004b90 con 0x7f86240b4340 2023-07-09T21:43:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f861affd640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 0x7f8604068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8614083110 con 0x7f86240b4340 2023-07-09T21:43:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f861bfff640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 0x7f8604068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.807+0000 7f861bfff640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 0x7f8604068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f860c000f70 tx=0x7f860c0079c0 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:14.811+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8614050450 con 0x7f86240b4340 2023-07-09T21:43:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f862406a830 con 0x7f86240b4340 2023-07-09T21:43:15.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f861affd640 1 -- 172.21.15.37:0/3676168913 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f8614018090 con 0x7f86240b4340 2023-07-09T21:43:15.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:43:15.004 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:43:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:43:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 msgr2=0x7f8604068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 0x7f8604068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f860c000f70 tx=0x7f860c0079c0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 msgr2=0x7f862414bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f861400c4a0 tx=0x7f861400c960 comp rx=0 tx=0).stop 2023-07-09T21:43:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 shutdown_connections 2023-07-09T21:43:15.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f86040663a0 0x7f8604068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86240cef80 0x7f8624150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86240b7ab0 0x7f8624156620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 --2- 172.21.15.37:0/3676168913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86240b4340 0x7f862414bbb0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 >> 172.21.15.37:0/3676168913 conn(0x7f8624073090 msgr2=0x7f86240b2380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 shutdown_connections 2023-07-09T21:43:15.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.003+0000 7f8628d00640 1 -- 172.21.15.37:0/3676168913 wait complete. 2023-07-09T21:43:15.427 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:43:04.492463+0000', 'modified': '2023-07-09T21:43:08.146394+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9534}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9534': {'gid': 9534, 'name': 'a', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6834/2578510480', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 2578510480}, {'type': 'v1', 'addr': '172.21.15.37:6834', 'nonce': 2578510480}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:43:15.428 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:43:15.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T21:43:15.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 Processor -- start 2023-07-09T21:43:15.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 -- start start 2023-07-09T21:43:15.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda780b7a60 0x7fda780cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780cef80 con 0x7fda780b47a0 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda780cf260 con 0x7fda780b4310 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda80359640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda780cf540 con 0x7fda780b7a60 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7e0f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda780b7a60 0x7fda780cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7d8f4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda780b47a0 0x7fda780b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33726/0 (socket says 172.21.15.37:33726) 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7e0f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fda780b7a60 0x7fda780cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55262/0 (socket says 172.21.15.37:55262) 2023-07-09T21:43:15.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7d8f4640 1 -- 172.21.15.37:0/33471620 learned_addr learned my addr 172.21.15.37:0/33471620 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:15.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7e0f5640 1 -- 172.21.15.37:0/33471620 >> v1:172.21.15.119:6789/0 conn(0x7fda780b4310 legacy=0x7fda780d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7e0f5640 1 -- 172.21.15.37:0/33471620 >> v1:172.21.15.37:6789/0 conn(0x7fda780b47a0 legacy=0x7fda780b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.575+0000 7fda7e0f5640 1 -- 172.21.15.37:0/33471620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780cfdf0 con 0x7fda780b7a60 2023-07-09T21:43:15.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/33471620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780cc7d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fda740097c0 tx=0x7fda7401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19da963e5449ad2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda7d0f3640 1 -- 172.21.15.37:0/33471620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740ab600 con 0x7fda780b7a60 2023-07-09T21:43:15.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda7d0f3640 1 -- 172.21.15.37:0/33471620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda740a7050 con 0x7fda780b7a60 2023-07-09T21:43:15.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda7d0f3640 1 -- 172.21.15.37:0/33471620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740ab980 con 0x7fda780b7a60 2023-07-09T21:43:15.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 -- 172.21.15.37:0/33471620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 msgr2=0x7fda780cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 --2- 172.21.15.37:0/33471620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780cc7d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fda740097c0 tx=0x7fda7401c440 comp rx=0 tx=0).stop 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 -- 172.21.15.37:0/33471620 shutdown_connections 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 --2- 172.21.15.37:0/33471620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780cc7d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 -- 172.21.15.37:0/33471620 >> 172.21.15.37:0/33471620 conn(0x7fda78073050 msgr2=0x7fda78069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 -- 172.21.15.37:0/33471620 shutdown_connections 2023-07-09T21:43:15.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.579+0000 7fda80359640 1 -- 172.21.15.37:0/33471620 wait complete. 2023-07-09T21:43:15.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 Processor -- start 2023-07-09T21:43:15.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- start start 2023-07-09T21:43:15.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda780b4310 0x7fda780ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780b47a0 0x7fda780c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78156da0 con 0x7fda780b7a60 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda78156190 con 0x7fda780b47a0 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda78156470 con 0x7fda780b4310 2023-07-09T21:43:15.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e0f5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda780b4310 0x7fda780ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55276/0 (socket says 172.21.15.37:55276) 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 -- 172.21.15.37:0/2118154778 learned_addr learned my addr 172.21.15.37:0/2118154778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780b47a0 0x7fda780c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 -- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda780b4310 msgr2=0x7fda780ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda780b4310 0x7fda780ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 -- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780b47a0 msgr2=0x7fda780c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780b47a0 0x7fda780c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 -- 172.21.15.37:0/2118154778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74009420 con 0x7fda780b7a60 2023-07-09T21:43:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fda7000be30 tx=0x7fda7000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda6effd640 1 -- 172.21.15.37:0/2118154778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7000caf0 con 0x7fda780b7a60 2023-07-09T21:43:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda6effd640 1 -- 172.21.15.37:0/2118154778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7000cc50 con 0x7fda780b7a60 2023-07-09T21:43:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda6effd640 1 -- 172.21.15.37:0/2118154778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70014440 con 0x7fda780b7a60 2023-07-09T21:43:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda78156750 con 0x7fda780b7a60 2023-07-09T21:43:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.583+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78158440 con 0x7fda780b7a60 2023-07-09T21:43:15.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda6effd640 1 -- 172.21.15.37:0/2118154778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fda7001d3b0 con 0x7fda780b7a60 2023-07-09T21:43:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda6effd640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 0x7fda5c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda836dc000 1 Processor -- start 2023-07-09T21:43:15.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda6effd640 1 -- 172.21.15.37:0/2118154778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fda70083b00 con 0x7fda780b7a60 2023-07-09T21:43:15.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda836dc000 1 -- start start 2023-07-09T21:43:15.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.587+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 0x7fda5c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004bc5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b7ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004a42f80 con 0x55c004b7bf90 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00497cc60 con 0x55c004bc6110 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c0049d0700 con 0x55c004bc5800 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 0x7fda5c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda740ad000 tx=0x7fda740a6000 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7d8f4640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b7ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55290/0 (socket says 172.21.15.37:55290) 2023-07-09T21:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 -- 172.21.15.37:0/3403895350 learned_addr learned my addr 172.21.15.37:0/3403895350 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004bc5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 -- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 msgr2=0x55c004bc5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004bc5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 -- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 msgr2=0x55c004b7ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b7ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 -- 172.21.15.37:0/3403895350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0046c5890 con 0x55c004b7bf90 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fda7005c920 tx=0x7fda70058c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8935b2402750d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda5bfff640 1 -- 172.21.15.37:0/3403895350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70053010 con 0x55c004b7bf90 2023-07-09T21:43:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda5bfff640 1 -- 172.21.15.37:0/3403895350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7005c9c0 con 0x55c004b7bf90 2023-07-09T21:43:15.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda5bfff640 1 -- 172.21.15.37:0/3403895350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda700509a0 con 0x55c004b7bf90 2023-07-09T21:43:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- 172.21.15.37:0/3403895350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 msgr2=0x55c004b7c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7fda7005c920 tx=0x7fda70058c40 comp rx=0 tx=0).stop 2023-07-09T21:43:15.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- 172.21.15.37:0/3403895350 shutdown_connections 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b7c360 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b7ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 --2- 172.21.15.37:0/3403895350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004bc5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- 172.21.15.37:0/3403895350 >> 172.21.15.37:0/3403895350 conn(0x55c004a3ea70 msgr2=0x55c004b7a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- 172.21.15.37:0/3403895350 shutdown_connections 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- 172.21.15.37:0/3403895350 wait complete. 2023-07-09T21:43:15.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 -- start start 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.591+0000 7fda836dc000 1 Processor -- start 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004b87120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0049c97a0 con 0x55c004b7bf90 2023-07-09T21:43:15.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004985f00 con 0x55c004bc6110 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c004985ba0 con 0x55c004bc5800 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 10 client.0 _ll_register_callbacks cb 0x55c004b67930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55302/0 (socket says 172.21.15.37:55302) 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 -- 172.21.15.37:0/502275128 learned_addr learned my addr 172.21.15.37:0/502275128 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004b87120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 -- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 msgr2=0x55c004b87120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004b87120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 -- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 msgr2=0x55c004b87660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b87660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 -- 172.21.15.37:0/502275128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda780cef80 con 0x55c004b7bf90 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fda7401c920 tx=0x7fda7401ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731a2248a51ac0c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:43:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740b6c40 con 0x55c004b7bf90 2023-07-09T21:43:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fda740b6da0 con 0x55c004b7bf90 2023-07-09T21:43:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0049c80f0 con 0x55c004b7bf90 2023-07-09T21:43:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda740c3430 con 0x55c004b7bf90 2023-07-09T21:43:15.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 10 client.9720 fetch_fsmap learned FSMap version 69 2023-07-09T21:43:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x7fda78158440 con 0x55c004b7bf90 2023-07-09T21:43:15.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c0049c80f0 con 0x55c004b7bf90 2023-07-09T21:43:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fda740be070 con 0x55c004b7bf90 2023-07-09T21:43:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 10 client.9720 fetch_fsmap finished waiting for FSMap version 69 2023-07-09T21:43:15.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 10 client.9720 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:43:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 20 client.9720 populate_metadata read hostname 'smithi037' 2023-07-09T21:43:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bd4870 0x55c004bd6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 4 client.9720 mds_command: new command op to 9534 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:43:15.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 --> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c004990e40 con 0x55c004bd4870 2023-07-09T21:43:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bd4870 0x55c004bd6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bd4870 0x55c004bd6c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7399f599333049b2 server_cookie=72868ce3f4ffe8a in_seq=0 out_seq=0 2023-07-09T21:43:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.595+0000 7fda597fa640 10 client.9720 ms_handle_connect on v2:172.21.15.37:6832/2578510480 2023-07-09T21:43:15.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda597fa640 1 -- 172.21.15.37:0/502275128 <== mds.0 v2:172.21.15.37:6832/2578510480 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c004990e40 con 0x55c004bd4870 2023-07-09T21:43:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda597fa640 10 client.9720 handle_command_reply: tid=0 2023-07-09T21:43:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 client.9720 shutdown 2023-07-09T21:43:15.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 msgr2=0x55c004b86be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fda7401c920 tx=0x7fda7401ac80 comp rx=0 tx=0).stop 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 shutdown_connections 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bd4870 0x55c004bd6c50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc6110 0x55c004b87660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc5800 0x55c004b87120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda597fa640 0 client.9720 ms_handle_reset on v2:172.21.15.37:6832/2578510480 2023-07-09T21:43:15.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 --2- 172.21.15.37:0/502275128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004b86be0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 >> 172.21.15.37:0/502275128 conn(0x55c004a3ea70 msgr2=0x55c004b7aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 shutdown_connections 2023-07-09T21:43:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 1 -- 172.21.15.37:0/502275128 wait complete. 2023-07-09T21:43:15.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.599+0000 7fda836dc000 20 client.9720 trim_cache size 0 max 16384 2023-07-09T21:43:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 Processor -- start 2023-07-09T21:43:15.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- start start 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bd88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc6110 0x55c004bc05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004686940 con 0x55c004b7bf90 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004998740 con 0x55c004bc5800 2023-07-09T21:43:15.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c004b7bab0 con 0x55c004bc6110 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55318/0 (socket says 172.21.15.37:55318) 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 -- 172.21.15.37:0/787994076 learned_addr learned my addr 172.21.15.37:0/787994076 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bd88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc6110 0x55c004bc05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 -- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc6110 msgr2=0x55c004bc05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc6110 0x55c004bc05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 -- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 msgr2=0x55c004bd88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bd88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 -- 172.21.15.37:0/787994076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c00498e130 con 0x55c004b7bf90 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fda74000c10 tx=0x7fda740c5070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88948a09fd955c88 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda6cff9640 1 -- 172.21.15.37:0/787994076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740ab6e0 con 0x55c004b7bf90 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda6cff9640 1 -- 172.21.15.37:0/787994076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda740da070 con 0x55c004b7bf90 2023-07-09T21:43:15.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda6cff9640 1 -- 172.21.15.37:0/787994076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda740b6c40 con 0x55c004b7bf90 2023-07-09T21:43:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- 172.21.15.37:0/787994076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 msgr2=0x55c004bd8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fda74000c10 tx=0x7fda740c5070 comp rx=0 tx=0).stop 2023-07-09T21:43:15.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- 172.21.15.37:0/787994076 shutdown_connections 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004bc6110 0x55c004bc05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bd88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 --2- 172.21.15.37:0/787994076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004b7bf90 0x55c004bd8370 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- 172.21.15.37:0/787994076 >> 172.21.15.37:0/787994076 conn(0x55c004a3ea70 msgr2=0x55c004bd6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- 172.21.15.37:0/787994076 shutdown_connections 2023-07-09T21:43:15.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- 172.21.15.37:0/787994076 wait complete. 2023-07-09T21:43:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 -- start start 2023-07-09T21:43:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.615+0000 7fda836dc000 1 Processor -- start 2023-07-09T21:43:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004b7bf90 0x55c004c225d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bc3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c004a0cc80 con 0x55c004bc6110 2023-07-09T21:43:15.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0049c5110 con 0x55c004bc5800 2023-07-09T21:43:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c004b737a0 con 0x55c004b7bf90 2023-07-09T21:43:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 10 client.0 _ll_register_callbacks cb 0x55c004b484d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:43:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55330/0 (socket says 172.21.15.37:55330) 2023-07-09T21:43:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 -- 172.21.15.37:0/322392200 learned_addr learned my addr 172.21.15.37:0/322392200 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004b7bf90 0x55c004c225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7d8f4640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bc3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 -- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004b7bf90 msgr2=0x55c004c225d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004b7bf90 0x55c004c225d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 -- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 msgr2=0x55c004bc3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bc3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 -- 172.21.15.37:0/322392200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda78158440 con 0x55c004bc6110 2023-07-09T21:43:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e8f6640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fda7000f020 tx=0x7fda7005a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47153e006b19b36 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:43:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda70082010 con 0x55c004bc6110 2023-07-09T21:43:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7fda70080070 con 0x55c004bc6110 2023-07-09T21:43:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c004b7f8c0 con 0x55c004bc6110 2023-07-09T21:43:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda70053010 con 0x55c004bc6110 2023-07-09T21:43:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 10 client.9726 fetch_fsmap learned FSMap version 69 2023-07-09T21:43:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=2+}) v3 -- 0x55c0049743c0 con 0x55c004bc6110 2023-07-09T21:43:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda70076070 con 0x55c004bc6110 2023-07-09T21:43:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 69) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fda70058d20 con 0x55c004bc6110 2023-07-09T21:43:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 10 client.9726 fetch_fsmap finished waiting for FSMap version 69 2023-07-09T21:43:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 10 client.9726 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T21:43:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 20 client.9726 populate_metadata read hostname 'smithi037' 2023-07-09T21:43:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bc3ca0 0x55c004bc4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 4 client.9726 mds_command: new command op to 9534 tid=0[{"prefix": "status"}] 2023-07-09T21:43:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 --> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c0049826f0 con 0x55c004bc3ca0 2023-07-09T21:43:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bc3ca0 0x55c004bc4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda7e0f5640 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bc3ca0 0x55c004bc4070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45d42825bfe01990 server_cookie=d8b1a90f0ce0fa19 in_seq=0 out_seq=0 2023-07-09T21:43:15.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 10 client.9726 ms_handle_connect on v2:172.21.15.37:6832/2578510480 2023-07-09T21:43:15.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 1 -- 172.21.15.37:0/322392200 <== mds.0 v2:172.21.15.37:6832/2578510480 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55c0049826f0 con 0x55c004bc3ca0 2023-07-09T21:43:15.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda597fa640 10 client.9726 handle_command_reply: tid=0 2023-07-09T21:43:15.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 client.9726 shutdown 2023-07-09T21:43:15.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 msgr2=0x55c004bc3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.619+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fda7000f020 tx=0x7fda7005a040 comp rx=0 tx=0).stop 2023-07-09T21:43:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 shutdown_connections 2023-07-09T21:43:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:6832/2578510480,v1:172.21.15.37:6834/2578510480] conn(0x55c004bc3ca0 0x55c004bc4070 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c004bc6110 0x55c004bc3760 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55c004bc5800 0x55c004bc3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 --2- 172.21.15.37:0/322392200 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55c004b7bf90 0x55c004c225d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda597fa640 0 client.9726 ms_handle_reset on v2:172.21.15.37:6832/2578510480 2023-07-09T21:43:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 >> 172.21.15.37:0/322392200 conn(0x55c004a3ea70 msgr2=0x55c004bd74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 shutdown_connections 2023-07-09T21:43:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 1 -- 172.21.15.37:0/322392200 wait complete. 2023-07-09T21:43:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda836dc000 20 client.9726 trim_cache size 0 max 16384 2023-07-09T21:43:15.638 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:43:15.639 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:43:15.639 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:43:15.639 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9534, 2023-07-09T21:43:15.639 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:43:15.639 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:43:15.640 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:43:15.640 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.493132157, 2023-07-09T21:43:15.640 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 69, 2023-07-09T21:43:15.640 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 158, 2023-07-09T21:43:15.641 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 158, 2023-07-09T21:43:15.641 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.425350007999999 2023-07-09T21:43:15.641 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:43:15.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 msgr2=0x7fda5c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 0x7fda5c068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fda740ad000 tx=0x7fda740a6000 comp rx=0 tx=0).stop 2023-07-09T21:43:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 msgr2=0x7fda780c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7fda7000be30 tx=0x7fda7000bf20 comp rx=0 tx=0).stop 2023-07-09T21:43:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 shutdown_connections 2023-07-09T21:43:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7fda5c0663a0 0x7fda5c068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda780b7a60 0x7fda780c9790 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fda780b47a0 0x7fda780c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 --2- 172.21.15.37:0/2118154778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fda780b4310 0x7fda780ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 >> 172.21.15.37:0/2118154778 conn(0x7fda78073050 msgr2=0x7fda780b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 shutdown_connections 2023-07-09T21:43:15.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.623+0000 7fda80359640 1 -- 172.21.15.37:0/2118154778 wait complete. 2023-07-09T21:43:15.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:43:15.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 Processor -- start 2023-07-09T21:43:15.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 -- start start 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0cef80 0x7f1a6c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6c0b49f0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a6c0cc8a0 con 0x7f1a6c0b4340 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7378f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a6c0b7e80 con 0x7f1a6c0cef80 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7152b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a6c0b7ab0 0x7f1a6c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33732/0 (socket says 172.21.15.37:33732) 2023-07-09T21:43:15.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a7152b640 1 -- 172.21.15.37:0/3939606688 learned_addr learned my addr 172.21.15.37:0/3939606688 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a71d2c640 1 --2- 172.21.15.37:0/3939606688 >> v2:172.21.15.37:3300/0 conn(0x7f1a6c0cef80 0x7f1a6c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a63fff640 1 -- 172.21.15.37:0/3939606688 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016106824 0 0) 0x7f1a6c0b49f0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a71d2c640 1 -- 172.21.15.37:0/3939606688 >> v1:172.21.15.119:6789/0 conn(0x7f1a6c0b4340 legacy=0x7f1a6c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a71d2c640 1 -- 172.21.15.37:0/3939606688 >> v1:172.21.15.37:6789/0 conn(0x7f1a6c0b7ab0 legacy=0x7f1a6c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.787+0000 7f1a71d2c640 1 -- 172.21.15.37:0/3939606688 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0ccb80 con 0x7f1a6c0cef80 2023-07-09T21:43:15.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a71d2c640 1 --2- 172.21.15.37:0/3939606688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c06aa50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009d90 tx=0x7f1a6401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3a5c1231fdda78 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a63fff640 1 -- 172.21.15.37:0/3939606688 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640a59a0 con 0x7f1a6c0cef80 2023-07-09T21:43:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a63fff640 1 -- 172.21.15.37:0/3939606688 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a640a5b00 con 0x7f1a6c0cef80 2023-07-09T21:43:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a63fff640 1 -- 172.21.15.37:0/3939606688 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a640a5e90 con 0x7f1a6c0cef80 2023-07-09T21:43:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 -- 172.21.15.37:0/3939606688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0cef80 msgr2=0x7f1a6c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 --2- 172.21.15.37:0/3939606688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c06aa50 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f1a64009d90 tx=0x7f1a6401c8e0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 -- 172.21.15.37:0/3939606688 shutdown_connections 2023-07-09T21:43:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 --2- 172.21.15.37:0/3939606688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c06aa50 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 -- 172.21.15.37:0/3939606688 >> 172.21.15.37:0/3939606688 conn(0x7f1a6c073090 msgr2=0x7f1a6c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 -- 172.21.15.37:0/3939606688 shutdown_connections 2023-07-09T21:43:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.791+0000 7f1a7378f640 1 -- 172.21.15.37:0/3939606688 wait complete. 2023-07-09T21:43:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 Processor -- start 2023-07-09T21:43:15.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- start start 2023-07-09T21:43:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a6c0b4340 0x7f1a6c14c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0c75e0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c155bd0 con 0x7f1a6c0cef80 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c0c6960 con 0x7f1a6c0b4340 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55354/0 (socket says 172.21.15.37:55354) 2023-07-09T21:43:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 -- 172.21.15.37:0/1113922297 learned_addr learned my addr 172.21.15.37:0/1113922297 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7152b640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a6c0b4340 0x7f1a6c14c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a71d2c640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 -- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a6c0b4340 msgr2=0x7f1a6c14c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a6c0b4340 0x7f1a6c14c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 -- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a6c0cef80 msgr2=0x7f1a6c150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 -- 172.21.15.37:0/1113922297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64009a70 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a70d2a640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c410 tx=0x7f1a5c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c011790 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0118f0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c011ca0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c0c6c40 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.795+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c0c7200 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c0c7720 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1a5c01c460 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a61ffb640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 0x7f1a50068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:15.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f1a5c083cf0 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a7152b640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 0x7f1a50068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:15.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.799+0000 7f1a7152b640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 0x7f1a50068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f70 tx=0x7f1a68007b80 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.803+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1a6c0c7720 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1a6c0c7720 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a61ffb640 1 -- 172.21.15.37:0/1113922297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v69) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1a6c0c7720 con 0x7f1a6c0b7ab0 2023-07-09T21:43:15.996 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 msgr2=0x7f1a50068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 0x7f1a50068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1a68000f70 tx=0x7f1a68007b80 comp rx=0 tx=0).stop 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 msgr2=0x7f1a6c150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c00c410 tx=0x7f1a5c00c8d0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 shutdown_connections 2023-07-09T21:43:15.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f1a500663a0 0x7f1a50068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1a6c0cef80 0x7f1a6c150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a6c0b7ab0 0x7f1a6c150710 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 --2- 172.21.15.37:0/1113922297 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1a6c0b4340 0x7f1a6c14c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 >> 172.21.15.37:0/1113922297 conn(0x7f1a6c073090 msgr2=0x7f1a6c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 shutdown_connections 2023-07-09T21:43:15.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:15.995+0000 7f1a7378f640 1 -- 172.21.15.37:0/1113922297 wait complete. 2023-07-09T21:43:16.020 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:43:16.021 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:43:16.021 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:43:16.022 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:43:16.022 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:16.022 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:43:16.022 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:43:16.023 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:43:16.023 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:43:16.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.024 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:43:16.034 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:43:16.034 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:43:16.034 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:43:16.034 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:43:16.035 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.036 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:43:16.036 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:43:16.036 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.036 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:43:16.036 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 41207sec preferred_lft 41207sec 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:43:16.037 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.038 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.039 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:43:16.040 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:43:16.040 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:43:16.040 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:43:16.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.041 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:43:16.101 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:43:16.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.103 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:43:16.156 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:43:16.156 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:43:16.156 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:43:16.157 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:43:16.157 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:43:16.157 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:43:16.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.157 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:43:16.158 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:43:16.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:43:16.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:43:16.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:43:16.159 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:43:16.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.252 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:43:16.262 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:43:16.263 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:43:16.263 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:43:16.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:43:16.327 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:43:16.328 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:43:16.328 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:16.378 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:43:16.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:43:16.379 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:16.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:43:16.495 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:43:16.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:43:16.561 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:43:16.563 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:43:16.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.564 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:43:16.614 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:43:16.615 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:43:16.661 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:43:16.684 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:43:16.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:43:16.746 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:43:16.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:43:16.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:16.748 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:43:16.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:43:16.759+0000 7fe5b76d1580 -1 init, newargv = 0x5585e88ef4b0 newargc=15 2023-07-09T21:43:16.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[63108]: starting ceph client 2023-07-09T21:43:16.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[63108]: starting fuse 2023-07-09T21:43:16.771 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:43:16.771 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:43:16.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:43:16.772 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:43:16.772 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:43:16.773 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:43:16.773 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:43:16.773 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:43:16.773 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:43:16.774 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:43:16.774 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:43:16.774 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:43:16.775 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:43:16.775 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:43:16.775 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:43:16.776 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:43:16.776 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:43:16.776 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:43:16.776 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:43:16.777 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:43:16.777 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:43:16.777 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:43:16.778 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:43:16.778 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:43:16.778 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:43:16.779 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:43:16.779 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:43:16.779 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:43:16.779 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:43:16.900 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.63108.asok 2023-07-09T21:43:17.084 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.63108.asok 2023-07-09T21:43:17.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:17.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.63108.asok status 2023-07-09T21:43:17.264 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:43:17.264 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:43:17.264 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:43:17.264 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "63108", 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:17.265 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:43:17.266 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 9738, 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 9738 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:17.267 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 21673851 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:43:17.268 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 21673851 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.9738 192.168.0.1:0/21673851", 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/21673851", 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 69, 2023-07-09T21:43:17.269 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 158, 2023-07-09T21:43:17.270 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:43:17.270 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:43:17.270 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:43:17.270 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:43:17.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:17.279 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:43:17.279 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:17.289 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:43:17.289 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:17.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:17.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:43:17.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:43:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 Processor -- start 2023-07-09T21:43:17.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 -- start start 2023-07-09T21:43:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f74a8157c60 0x7f74a80700b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80b2760 con 0x7f74a80b1670 2023-07-09T21:43:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a806f010 con 0x7f74a806b740 2023-07-09T21:43:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.535+0000 7f74acc5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a806f2f0 con 0x7f74a8157c60 2023-07-09T21:43:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f74a80b1670 0x7f74a806b030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45142/0 (socket says 172.21.15.37:45142) 2023-07-09T21:43:17.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 -- 172.21.15.37:0/3321052103 learned_addr learned my addr 172.21.15.37:0/3321052103 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:17.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a659c640 1 --2- 172.21.15.37:0/3321052103 >> v2:172.21.15.119:3300/0 conn(0x7f74a8157c60 0x7f74a80700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601950240 0 0) 0x7f74a80b2760 con 0x7f74a80b1670 2023-07-09T21:43:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003530 con 0x7f74a80b1670 2023-07-09T21:43:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88823270 0 0) 0x7f7494003530 con 0x7f74a80b1670 2023-07-09T21:43:17.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 >> v2:172.21.15.119:3300/0 conn(0x7f74a8157c60 msgr2=0x7f74a80700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 --2- 172.21.15.37:0/3321052103 >> v2:172.21.15.119:3300/0 conn(0x7f74a8157c60 0x7f74a80700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 >> v1:172.21.15.119:6789/0 conn(0x7f74a806b740 legacy=0x7f74a8158030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a806f5d0 con 0x7f74a80b1670 2023-07-09T21:43:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7490001680 con 0x7f74a80b1670 2023-07-09T21:43:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a659c640 1 --2- 172.21.15.37:0/3321052103 >> v2:172.21.15.119:3300/0 conn(0x7f74a8157c60 0x7f74a80700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 >> v1:172.21.15.37:6789/0 conn(0x7f74a80b1670 legacy=0x7f74a806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7494003980 0x7f7494003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 0x7f7494004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940052a0 0x7f749400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a806f2f0 con 0x7f74940047d0 2023-07-09T21:43:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749400c1d0 con 0x7f74940052a0 2023-07-09T21:43:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749400e5a0 con 0x7f7494003980 2023-07-09T21:43:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 0x7f7494004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a659c640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7494003980 0x7f7494003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a6d9d640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940052a0 0x7f749400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 -- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7494003980 msgr2=0x7f7494003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7494003980 0x7f7494003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 -- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940052a0 msgr2=0x7f749400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940052a0 0x7f749400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f749ffff640 1 -- 172.21.15.37:0/3321052103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494003530 con 0x7f74940047d0 2023-07-09T21:43:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a6d9d640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940052a0 0x7f749400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:17.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.539+0000 7f74a6d9d640 1 -- 172.21.15.37:0/3321052103 reap_dead start 2023-07-09T21:43:17.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f749ffff640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 0x7f7494004c40 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f749000c190 tx=0x7f749001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e892622c22ab928 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490005ae0 con 0x7f74940047d0 2023-07-09T21:43:17.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490005c40 con 0x7f74940047d0 2023-07-09T21:43:17.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74a5d9b640 1 -- 172.21.15.37:0/3321052103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900a5af0 con 0x7f74940047d0 2023-07-09T21:43:17.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 msgr2=0x7f7494004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 0x7f7494004c40 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f749000c190 tx=0x7f749001cbd0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- 172.21.15.37:0/3321052103 shutdown_connections 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 --2- 172.21.15.37:0/3321052103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74940047d0 0x7f7494004c40 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- 172.21.15.37:0/3321052103 >> 172.21.15.37:0/3321052103 conn(0x7f74a80694c0 msgr2=0x7f74a80698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- 172.21.15.37:0/3321052103 shutdown_connections 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- 172.21.15.37:0/3321052103 wait complete. 2023-07-09T21:43:17.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 Processor -- start 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.543+0000 7f74acc5c640 1 -- start start 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 0x7f74a814c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74a813bf40 0x7f74a813c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a814df50 con 0x7f74a814d5a0 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80ab900 con 0x7f74940047d0 2023-07-09T21:43:17.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80abbe0 con 0x7f74a813bf40 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42872/0 (socket says 172.21.15.37:42872) 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 -- 172.21.15.37:0/481299461 learned_addr learned my addr 172.21.15.37:0/481299461 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74a659c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 0x7f74a814c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74a6d9d640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74a813bf40 0x7f74a813c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 -- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74a813bf40 msgr2=0x7f74a813c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74a813bf40 0x7f74a813c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 -- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 msgr2=0x7f74a814c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 0x7f74a814c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 -- 172.21.15.37:0/481299461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80abec0 con 0x7f74a814d5a0 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74a659c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 0x7f74a814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749ffff640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f749001ca00 tx=0x7f7494005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74900b4070 con 0x7f74a814d5a0 2023-07-09T21:43:17.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7490005db0 con 0x7f74a814d5a0 2023-07-09T21:43:17.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a80ac1a0 con 0x7f74a814d5a0 2023-07-09T21:43:17.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7490001680 con 0x7f74a814d5a0 2023-07-09T21:43:17.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a813c8f0 con 0x7f74a814d5a0 2023-07-09T21:43:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.547+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a804d7d0 con 0x7f74a814d5a0 2023-07-09T21:43:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.551+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f74900a58b0 con 0x7f74a814d5a0 2023-07-09T21:43:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.551+0000 7f749effd640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 0x7f7488068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.551+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f749011d8f0 con 0x7f74a814d5a0 2023-07-09T21:43:17.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.551+0000 7f74a659c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 0x7f7488068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.551+0000 7f74a659c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 0x7f7488068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7498009dd0 tx=0x7f7498008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.555+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f74900eaba0 con 0x7f74a814d5a0 2023-07-09T21:43:17.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.731+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a80b10a0 con 0x7f74880663d0 2023-07-09T21:43:17.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f749effd640 1 -- 172.21.15.37:0/481299461 <== mgr.8836 v2:172.21.15.119:6832/3801372437 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7498009a20 con 0x7f74880663d0 2023-07-09T21:43:17.734 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:43:17.735 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:43:17.735 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:43:17.735 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:43:17.735 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:43:17.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 msgr2=0x7f7488068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 0x7f7488068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7498009dd0 tx=0x7f7498008040 comp rx=0 tx=0).stop 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 msgr2=0x7f74a814da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f749001ca00 tx=0x7f7494005800 comp rx=0 tx=0).stop 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 shutdown_connections 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f74880663d0 0x7f7488068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f74a813bf40 0x7f74a813c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74a814d5a0 0x7f74a814da10 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 --2- 172.21.15.37:0/481299461 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f74940047d0 0x7f74a814c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 >> 172.21.15.37:0/481299461 conn(0x7f74a80694c0 msgr2=0x7f74a8158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 shutdown_connections 2023-07-09T21:43:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.735+0000 7f74acc5c640 1 -- 172.21.15.37:0/481299461 wait complete. 2023-07-09T21:43:17.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:43:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 Processor -- start 2023-07-09T21:43:17.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 -- start start 2023-07-09T21:43:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8afc0c42b0 0x7f8afc160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc0cbcd0 con 0x7f8afc0b0390 2023-07-09T21:43:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8afc0ca050 con 0x7f8afc0c47c0 2023-07-09T21:43:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b0347b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8afc0ca6d0 con 0x7f8afc0c42b0 2023-07-09T21:43:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b01217640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8afc0b0390 0x7f8afc0cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45154/0 (socket says 172.21.15.37:45154) 2023-07-09T21:43:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.899+0000 7f8b01217640 1 -- 172.21.15.37:0/245612332 learned_addr learned my addr 172.21.15.37:0/245612332 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 --2- 172.21.15.37:0/245612332 >> v2:172.21.15.119:3300/0 conn(0x7f8afc0c42b0 0x7f8afc160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3768011168 0 0) 0x7f8af8001120 con 0x7f8afc0b0390 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae8003530 con 0x7f8afc0b0390 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938267382 0 0) 0x7f8ae8003530 con 0x7f8afc0b0390 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 >> v2:172.21.15.119:3300/0 conn(0x7f8afc0c42b0 msgr2=0x7f8afc160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 --2- 172.21.15.37:0/245612332 >> v2:172.21.15.119:3300/0 conn(0x7f8afc0c42b0 0x7f8afc160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 >> v1:172.21.15.119:6789/0 conn(0x7f8afc0c47c0 legacy=0x7f8afc163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc06cb80 con 0x7f8afc0b0390 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f8af8001810 con 0x7f8afc0b0390 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 >> v1:172.21.15.37:6789/0 conn(0x7f8afc0b0390 legacy=0x7f8afc0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae8003980 0x7f8ae8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8ae8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae8005180 0x7f8ae800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0ca6d0 con 0x7f8ae80047d0 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae800c090 con 0x7f8ae8005180 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae800c250 con 0x7f8ae8003980 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8ae8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b01217640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae8003980 0x7f8ae8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b01a18640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae8005180 0x7f8ae800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 -- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae8003980 msgr2=0x7f8ae8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ae8003980 0x7f8ae8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 -- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae8005180 msgr2=0x7f8ae800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ae8005180 0x7f8ae800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b00a16640 1 -- 172.21.15.37:0/245612332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae8003530 con 0x7f8ae80047d0 2023-07-09T21:43:17.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.903+0000 7f8b01a18640 1 -- 172.21.15.37:0/245612332 reap_dead start 2023-07-09T21:43:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b00a16640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8ae8004c40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0c46b0 tx=0x7f8aec01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9eff23e0857e15 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0a5570 con 0x7f8ae80047d0 2023-07-09T21:43:17.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec0a56d0 con 0x7f8ae80047d0 2023-07-09T21:43:17.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8af3fff640 1 -- 172.21.15.37:0/245612332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec0a5a80 con 0x7f8ae80047d0 2023-07-09T21:43:17.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 msgr2=0x7f8ae8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8ae8004c40 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8afc0c46b0 tx=0x7f8aec01c9c0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- 172.21.15.37:0/245612332 shutdown_connections 2023-07-09T21:43:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 --2- 172.21.15.37:0/245612332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8ae8004c40 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- 172.21.15.37:0/245612332 >> 172.21.15.37:0/245612332 conn(0x7f8afc0cde40 msgr2=0x7f8afc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- 172.21.15.37:0/245612332 shutdown_connections 2023-07-09T21:43:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- 172.21.15.37:0/245612332 wait complete. 2023-07-09T21:43:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 Processor -- start 2023-07-09T21:43:17.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.907+0000 7f8b0347b640 1 -- start start 2023-07-09T21:43:17.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8afc0c8990 0x7f8afc14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 0x7f8afc0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0c7150 con 0x7f8ae80047d0 2023-07-09T21:43:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0c5dd0 con 0x7f8afc0c8990 2023-07-09T21:43:17.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc0c6080 con 0x7f8afc0c67a0 2023-07-09T21:43:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42890/0 (socket says 172.21.15.37:42890) 2023-07-09T21:43:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 -- 172.21.15.37:0/4144996372 learned_addr learned my addr 172.21.15.37:0/4144996372 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:17.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01a18640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 0x7f8afc0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b00a16640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8afc0c8990 0x7f8afc14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 -- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 msgr2=0x7f8afc0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 0x7f8afc0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 -- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8afc0c8990 msgr2=0x7f8afc14c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8afc0c8990 0x7f8afc14c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 -- 172.21.15.37:0/4144996372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8afc0b0e30 con 0x7f8ae80047d0 2023-07-09T21:43:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01a18640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 0x7f8afc0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:43:17.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b01217640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8af8007060 tx=0x7f8af8007150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8011580 con 0x7f8ae80047d0 2023-07-09T21:43:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af80116e0 con 0x7f8ae80047d0 2023-07-09T21:43:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af8011a90 con 0x7f8ae80047d0 2023-07-09T21:43:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc0b1110 con 0x7f8ae80047d0 2023-07-09T21:43:17.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc0c6360 con 0x7f8ae80047d0 2023-07-09T21:43:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc04d7d0 con 0x7f8ae80047d0 2023-07-09T21:43:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.911+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 66) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8af8011bf0 con 0x7f8ae80047d0 2023-07-09T21:43:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.915+0000 7f8af1ffb640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 0x7f8ae0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:17.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.915+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8af8083d90 con 0x7f8ae80047d0 2023-07-09T21:43:17.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.915+0000 7f8b00a16640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 0x7f8ae0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:17.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.915+0000 7f8b00a16640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 0x7f8ae0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0af000 tx=0x7f8aec008040 comp rx=0 tx=0).ready entity=mgr.8836 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:17.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:17.919+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8af8050fb0 con 0x7f8ae80047d0 2023-07-09T21:43:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.111+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f8afc0cbcd0 con 0x7f8ae80047d0 2023-07-09T21:43:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.839+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8af8051380 con 0x7f8ae80047d0 2023-07-09T21:43:18.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8af1ffb640 1 -- 172.21.15.37:0/4144996372 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v67) v1 ==== 92+0+0 (secure 0 0 0) 0x7f8af806dbf0 con 0x7f8ae80047d0 2023-07-09T21:43:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 msgr2=0x7f8ae0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 0x7f8ae0068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0af000 tx=0x7f8aec008040 comp rx=0 tx=0).stop 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 msgr2=0x7f8afc0c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8af8007060 tx=0x7f8af8007150 comp rx=0 tx=0).stop 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 shutdown_connections 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8ae00663a0 0x7f8ae0068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:18.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8afc0c67a0 0x7f8afc0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8afc0c8990 0x7f8afc14c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 --2- 172.21.15.37:0/4144996372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ae80047d0 0x7f8afc0c5890 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 >> 172.21.15.37:0/4144996372 conn(0x7f8afc0cde40 msgr2=0x7f8afc06ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.843+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 shutdown_connections 2023-07-09T21:43:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:18.847+0000 7f8b0347b640 1 -- 172.21.15.37:0/4144996372 wait complete. 2023-07-09T21:43:18.870 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:43:19.017 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:19.019+0000 7fa027e4e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:43:19.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 Processor -- start 2023-07-09T21:43:19.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 -- start start 2023-07-09T21:43:19.026 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f7939c3a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:43:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f477c0d0780 0x7f477c0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f477c15bf80 con 0x7f477c0b7980 2023-07-09T21:43:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0cd070 con 0x7f477c0d0780 2023-07-09T21:43:19.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.023+0000 7f478250d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f477c0cfd70 con 0x7f477c0cf290 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f477c0d0780 0x7f477c0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f477c0d0780 0x7f477c0d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42898/0 (socket says 172.21.15.37:42898) 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f477b7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 -- 172.21.15.37:0/3088234631 learned_addr learned my addr 172.21.15.37:0/3088234631 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 -- 172.21.15.37:0/3088234631 >> v2:172.21.15.119:3300/0 conn(0x7f477c0cf290 msgr2=0x7f477c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 --2- 172.21.15.37:0/3088234631 >> v2:172.21.15.119:3300/0 conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f477affd640 1 -- 172.21.15.37:0/3088234631 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963628475 0 0) 0x7f476c001120 con 0x7f477c0b7980 2023-07-09T21:43:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 -- 172.21.15.37:0/3088234631 >> v1:172.21.15.119:6789/0 conn(0x7f477c0b7980 legacy=0x7f477c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 -- 172.21.15.37:0/3088234631 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c160570 con 0x7f477c0d0780 2023-07-09T21:43:19.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f4780aaa640 1 --2- 172.21.15.37:0/3088234631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c0d0b80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b4cd0 tx=0x7f477401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101e404fa3a797aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f477affd640 1 -- 172.21.15.37:0/3088234631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740a5690 con 0x7f477c0d0780 2023-07-09T21:43:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f477affd640 1 -- 172.21.15.37:0/3088234631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47740a57f0 con 0x7f477c0d0780 2023-07-09T21:43:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.027+0000 7f477affd640 1 -- 172.21.15.37:0/3088234631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47740a5b80 con 0x7f477c0d0780 2023-07-09T21:43:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- 172.21.15.37:0/3088234631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 msgr2=0x7f477c0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- 172.21.15.37:0/3088234631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c0d0b80 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7f477c0b4cd0 tx=0x7f477401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- 172.21.15.37:0/3088234631 shutdown_connections 2023-07-09T21:43:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- 172.21.15.37:0/3088234631 >> v2:172.21.15.119:3300/0 conn(0x7f477c0cf290 0x7f477c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- 172.21.15.37:0/3088234631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0d0780 0x7f477c0d0b80 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- 172.21.15.37:0/3088234631 >> 172.21.15.37:0/3088234631 conn(0x7f477c073090 msgr2=0x7f477c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:19.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- 172.21.15.37:0/3088234631 shutdown_connections 2023-07-09T21:43:19.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- 172.21.15.37:0/3088234631 wait complete. 2023-07-09T21:43:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 Processor -- start 2023-07-09T21:43:19.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- start start 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0d0780 0x7f477c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c154250 con 0x7f477c0cf290 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f477c153800 con 0x7f477c0b7980 2023-07-09T21:43:19.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f478250d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477c153dc0 con 0x7f477c0d0780 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f477b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42908/0 (socket says 172.21.15.37:42908) 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f477b7fe640 1 -- 172.21.15.37:0/3896740786 learned_addr learned my addr 172.21.15.37:0/3896740786 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f4780aaa640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0d0780 0x7f477c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.031+0000 7f477bfff640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 -- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0d0780 msgr2=0x7f477c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0d0780 0x7f477c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 -- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 msgr2=0x7f477c154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 -- 172.21.15.37:0/3896740786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4774009b30 con 0x7f477c0cf290 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f477b7fe640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f477000e930 tx=0x7f477000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4770009690 con 0x7f477c0cf290 2023-07-09T21:43:19.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477000ca00 con 0x7f477c0cf290 2023-07-09T21:43:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477000cdb0 con 0x7f477c0cf290 2023-07-09T21:43:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f477c1511e0 con 0x7f477c0cf290 2023-07-09T21:43:19.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f477c1517a0 con 0x7f477c0cf290 2023-07-09T21:43:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f477c153f70 con 0x7f477c0cf290 2023-07-09T21:43:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4770013470 con 0x7f477c0cf290 2023-07-09T21:43:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.035+0000 7f4778ff9640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 0x7f47680688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.039+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f4770084040 con 0x7f477c0cf290 2023-07-09T21:43:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.039+0000 7f477bfff640 1 -- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 msgr2=0x7f47680688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:19.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.039+0000 7f477bfff640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 0x7f47680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:43:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.039+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f477c153f70 con 0x7f477c0cf290 2023-07-09T21:43:19.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.199+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f477c153f30 con 0x7f477c0cf290 2023-07-09T21:43:19.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f4778ff9640 1 -- 172.21.15.37:0/3896740786 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v53)=0 v53) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4770051500 con 0x7f477c0cf290 2023-07-09T21:43:19.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 msgr2=0x7f47680688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 0x7f47680688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 msgr2=0x7f477c0b5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f477000e930 tx=0x7f477000edf0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 shutdown_connections 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.203+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f47680663f0 0x7f47680688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f477c0d0780 0x7f477c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f477c0cf290 0x7f477c0b5230 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 --2- 172.21.15.37:0/3896740786 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f477c0b7980 0x7f477c154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 >> 172.21.15.37:0/3896740786 conn(0x7f477c073090 msgr2=0x7f477c1559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 shutdown_connections 2023-07-09T21:43:19.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.207+0000 7f478250d640 1 -- 172.21.15.37:0/3896740786 wait complete. 2023-07-09T21:43:19.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:43:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.371+0000 7f5c1359e640 1 Processor -- start 2023-07-09T21:43:19.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.371+0000 7f5c1359e640 1 -- start start 2023-07-09T21:43:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5c140b11a0 0x7f5c140b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c140b4010 0x7f5c14072400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c140ce970 con 0x7f5c140b4010 2023-07-09T21:43:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c140b4460 con 0x7f5c140b11a0 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1359e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1415bf00 con 0x7f5c1415bb30 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c140b4010 0x7f5c14072400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c1259c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5c140b4010 0x7f5c14072400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42922/0 (socket says 172.21.15.37:42922) 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 -- 172.21.15.37:0/885419872 learned_addr learned my addr 172.21.15.37:0/885419872 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c0bfff640 1 --2- 172.21.15.37:0/885419872 >> v2:172.21.15.119:3300/0 conn(0x7f5c140b11a0 0x7f5c140b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 -- 172.21.15.37:0/885419872 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 msgr2=0x7f5c140ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 --2- 172.21.15.37:0/885419872 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 -- 172.21.15.37:0/885419872 >> v2:172.21.15.119:3300/0 conn(0x7f5c140b11a0 msgr2=0x7f5c140b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 --2- 172.21.15.37:0/885419872 >> v2:172.21.15.119:3300/0 conn(0x7f5c140b11a0 0x7f5c140b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.375+0000 7f5c12d9d640 1 -- 172.21.15.37:0/885419872 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1415f6e0 con 0x7f5c140b4010 2023-07-09T21:43:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c12d9d640 1 --2- 172.21.15.37:0/885419872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c14072400 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5c14071bd0 tx=0x7f5c0c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235d32a869dd4422 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c11d9b640 1 -- 172.21.15.37:0/885419872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0a64e0 con 0x7f5c140b4010 2023-07-09T21:43:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c11d9b640 1 -- 172.21.15.37:0/885419872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0c0a6640 con 0x7f5c140b4010 2023-07-09T21:43:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c11d9b640 1 -- 172.21.15.37:0/885419872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0c0a69d0 con 0x7f5c140b4010 2023-07-09T21:43:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 -- 172.21.15.37:0/885419872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 msgr2=0x7f5c14072400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 --2- 172.21.15.37:0/885419872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c14072400 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f5c14071bd0 tx=0x7f5c0c01c650 comp rx=0 tx=0).stop 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 -- 172.21.15.37:0/885419872 shutdown_connections 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 --2- 172.21.15.37:0/885419872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c14072400 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 --2- 172.21.15.37:0/885419872 >> v2:172.21.15.119:3300/0 conn(0x7f5c140b11a0 0x7f5c140b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 --2- 172.21.15.37:0/885419872 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 -- 172.21.15.37:0/885419872 >> 172.21.15.37:0/885419872 conn(0x7f5c1406aac0 msgr2=0x7f5c140cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 -- 172.21.15.37:0/885419872 shutdown_connections 2023-07-09T21:43:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.379+0000 7f5c1359e640 1 -- 172.21.15.37:0/885419872 wait complete. 2023-07-09T21:43:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 Processor -- start 2023-07-09T21:43:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 -- start start 2023-07-09T21:43:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c140b11a0 0x7f5c141512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c140c5b80 con 0x7f5c140b4010 2023-07-09T21:43:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14150680 con 0x7f5c140b11a0 2023-07-09T21:43:19.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1359e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c14151950 con 0x7f5c1415bb30 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42928/0 (socket says 172.21.15.37:42928) 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c1259c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c140b11a0 0x7f5c141512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 -- 172.21.15.37:0/272329159 learned_addr learned my addr 172.21.15.37:0/272329159 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c12d9d640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 -- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 msgr2=0x7f5c140c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 -- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c140b11a0 msgr2=0x7f5c141512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c140b11a0 0x7f5c141512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 -- 172.21.15.37:0/272329159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c009b30 con 0x7f5c140b4010 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.383+0000 7f5c0bfff640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00e8b0 tx=0x7f5bfc00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00c940 con 0x7f5c140b4010 2023-07-09T21:43:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bfc00caa0 con 0x7f5c140b4010 2023-07-09T21:43:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c14151c30 con 0x7f5c140b4010 2023-07-09T21:43:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bfc00ce30 con 0x7f5c140b4010 2023-07-09T21:43:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c141521f0 con 0x7f5c140b4010 2023-07-09T21:43:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c14152410 con 0x7f5c140b4010 2023-07-09T21:43:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f5bfc013470 con 0x7f5c140b4010 2023-07-09T21:43:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 0x7f5bf40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f5bfc084150 con 0x7f5c140b4010 2023-07-09T21:43:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c1259c640 1 -- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 msgr2=0x7f5bf40688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.387+0000 7f5c1259c640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 0x7f5bf40688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:43:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.395+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5bfc051430 con 0x7f5c140b4010 2023-07-09T21:43:19.437 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:19.439+0000 7fa027e4e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:43:19.480 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:19.479+0000 7f7939c3a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:43:19.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.555+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f5c140b0dd0 con 0x7f5c140b4010 2023-07-09T21:43:19.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c0affd640 1 -- 172.21.15.37:0/272329159 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v54)=0 v54) v1 ==== 133+0+0 (secure 0 0 0) 0x7f5bfc054a50 con 0x7f5c140b4010 2023-07-09T21:43:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 msgr2=0x7f5bf40688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:43:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 0x7f5bf40688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 msgr2=0x7f5c140c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc00e8b0 tx=0x7f5bfc00ed70 comp rx=0 tx=0).stop 2023-07-09T21:43:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 shutdown_connections 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f5bf4066420 0x7f5bf40688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5c1415bb30 0x7f5c140c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c140b4010 0x7f5c140c5fd0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 --2- 172.21.15.37:0/272329159 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5c140b11a0 0x7f5c141512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 >> 172.21.15.37:0/272329159 conn(0x7f5c1406aac0 msgr2=0x7f5c1415cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 shutdown_connections 2023-07-09T21:43:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.559+0000 7f5c1359e640 1 -- 172.21.15.37:0/272329159 wait complete. 2023-07-09T21:43:19.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:19.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:43:19.588 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:19.591+0000 7fa027e4e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:43:19.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:43:19.597 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/test_restart) 2023-07-09T21:43:19.641 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:19.639+0000 7f7939c3a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:43:19.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-09T21:43:19.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 Processor -- start 2023-07-09T21:43:19.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 -- start start 2023-07-09T21:43:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f380b7980 0x7f8f38160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380d0780 0x7f8f380d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3815bf80 con 0x7f8f380ceb80 2023-07-09T21:43:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f380cd070 con 0x7f8f380b7980 2023-07-09T21:43:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3cde9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380cfd70 con 0x7f8f380d0780 2023-07-09T21:43:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f380b7980 0x7f8f38160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f380b7980 0x7f8f38160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42942/0 (socket says 172.21.15.37:42942) 2023-07-09T21:43:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 -- 172.21.15.37:0/1299236600 learned_addr learned my addr 172.21.15.37:0/1299236600 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f36d9d640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380d0780 0x7f8f380d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 -- 172.21.15.37:0/1299236600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380d0780 msgr2=0x7f8f380d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380d0780 0x7f8f380d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 -- 172.21.15.37:0/1299236600 >> v1:172.21.15.119:6789/0 conn(0x7f8f380ceb80 legacy=0x7f8f380cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.843+0000 7f8f3659c640 1 -- 172.21.15.37:0/1299236600 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f38160570 con 0x7f8f380b7980 2023-07-09T21:43:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.847+0000 7f8f3659c640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380b7980 0x7f8f38160030 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009870 tx=0x7f8f2801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acc00d423655811 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3559a640 1 -- 172.21.15.37:0/1299236600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280ab600 con 0x7f8f380b7980 2023-07-09T21:43:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3559a640 1 -- 172.21.15.37:0/1299236600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f280a7050 con 0x7f8f380b7980 2023-07-09T21:43:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3559a640 1 -- 172.21.15.37:0/1299236600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280ab980 con 0x7f8f380b7980 2023-07-09T21:43:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- 172.21.15.37:0/1299236600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380b7980 msgr2=0x7f8f38160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380b7980 0x7f8f38160030 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f8f28009870 tx=0x7f8f2801c540 comp rx=0 tx=0).stop 2023-07-09T21:43:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- 172.21.15.37:0/1299236600 shutdown_connections 2023-07-09T21:43:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380d0780 0x7f8f380d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 --2- 172.21.15.37:0/1299236600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380b7980 0x7f8f38160030 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- 172.21.15.37:0/1299236600 >> 172.21.15.37:0/1299236600 conn(0x7f8f38073090 msgr2=0x7f8f38069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- 172.21.15.37:0/1299236600 shutdown_connections 2023-07-09T21:43:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- 172.21.15.37:0/1299236600 wait complete. 2023-07-09T21:43:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 Processor -- start 2023-07-09T21:43:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.851+0000 7f8f3cde9640 1 -- start start 2023-07-09T21:43:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380b7980 0x7f8f380b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 0x7f8f38152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f380d0780 0x7f8f380b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f38152590 con 0x7f8f380ceb80 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b3480 con 0x7f8f380d0780 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380b3900 con 0x7f8f380b7980 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f35d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 0x7f8f38152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f35d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 0x7f8f38152050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42948/0 (socket says 172.21.15.37:42948) 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f35d9b640 1 -- 172.21.15.37:0/369592670 learned_addr learned my addr 172.21.15.37:0/369592670 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380b7980 0x7f8f380b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f36d9d640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f380d0780 0x7f8f380b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f380d0780 msgr2=0x7f8f380b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f380d0780 0x7f8f380b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 msgr2=0x7f8f38152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 0x7f8f38152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f280094d0 con 0x7f8f380b7980 2023-07-09T21:43:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f380ceb80 0x7f8f38152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:43:19.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3659c640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380b7980 0x7f8f380b46c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f3808ac80 tx=0x7f8f280192e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b3890 con 0x7f8f380b7980 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f280b3a10 con 0x7f8f380b7980 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f280b3dc0 con 0x7f8f380b7980 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380b3be0 con 0x7f8f380b7980 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f380b41a0 con 0x7f8f380b7980 2023-07-09T21:43:19.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f380737d0 con 0x7f8f380b7980 2023-07-09T21:43:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.855+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 67) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f8f280b2070 con 0x7f8f380b7980 2023-07-09T21:43:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.859+0000 7f8f26ffd640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.859+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 6090+0+0 (secure 0 0 0) 0x7f8f2811dff0 con 0x7f8f380b7980 2023-07-09T21:43:19.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.859+0000 7f8f35d9b640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 msgr2=0x7f8f180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.859+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:43:19.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:19.863+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f380737d0 con 0x7f8f380b7980 2023-07-09T21:43:20.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:20.035+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f380cff80 con 0x7f8f18066420 2023-07-09T21:43:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:20.063+0000 7f8f35d9b640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 msgr2=0x7f8f180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:20.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:20.063+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:43:20.069 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.071+0000 7fa027e4e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:43:20.129 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.131+0000 7fa027e4e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:43:20.154 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.151+0000 7f7939c3a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:43:20.185 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.187+0000 7fa027e4e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:43:20.216 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.215+0000 7f7939c3a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:43:20.272 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.275+0000 7fa027e4e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:43:20.274 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.275+0000 7f7939c3a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:43:20.331 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.331+0000 7fa027e4e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:43:20.366 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.363+0000 7f7939c3a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:43:20.414 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.415+0000 7fa027e4e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:43:20.426 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.423+0000 7f7939c3a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:43:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:20.467+0000 7f8f35d9b640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 msgr2=0x7f8f180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:20.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:20.467+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:43:20.470 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.471+0000 7fa027e4e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:43:20.514 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.511+0000 7f7939c3a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:43:20.575 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.575+0000 7f7939c3a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:43:20.612 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.611+0000 7fa027e4e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:43:20.669 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.671+0000 7fa027e4e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:43:20.724 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.723+0000 7f7939c3a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:43:20.785 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:20.783+0000 7f7939c3a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:43:20.908 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:43:20.909 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:43:20.909 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:43:20.917 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:20.919+0000 7fa027e4e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:43:21.035 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:43:21.035 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:43:21.035 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:43:21.043 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:21.043+0000 7f7939c3a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:43:21.050 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:21.051+0000 7fa027e4e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:43:21.177 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:21.179+0000 7fa027e4e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:43:21.187 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:21.187+0000 7f7939c3a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:43:21.248 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:21.251+0000 7fa027e4e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:43:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:21.271+0000 7f8f35d9b640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 msgr2=0x7f8f180688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/3801372437 2023-07-09T21:43:21.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:21.271+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:43:21.319 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:21.319+0000 7f7939c3a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:43:21.383 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:21.383+0000 7fa027e4e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:43:21.393 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:21.391+0000 7f7939c3a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:43:21.533 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:21.531+0000 7f7939c3a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:43:21.920 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:21.923+0000 7fa027e4e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:43:22.004 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.007+0000 7fa027e4e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:43:22.099 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.099+0000 7f7939c3a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:43:22.150 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.151+0000 7fa027e4e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:43:22.188 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.187+0000 7f7939c3a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:43:22.234 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.235+0000 7fa027e4e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:43:22.342 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.339+0000 7f7939c3a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:43:22.430 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.427+0000 7f7939c3a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:43:22.504 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.507+0000 7fa027e4e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:43:22.565 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.567+0000 7fa027e4e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:43:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:22.579+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mgrmap(e 68) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f8f2811c350 con 0x7f8f380b7980 2023-07-09T21:43:22.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:22.579+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 msgr2=0x7f8f180688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:43:22.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:22.579+0000 7f8f26ffd640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/3801372437,v1:172.21.15.119:6833/3801372437] conn(0x7f8f18066420 0x7f8f180688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:22.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9fa70a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9fa70a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9fa70a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9fa70a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.706 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9fa70a9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.706 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9faa0af640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.706 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9faa0af640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.706 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9faa0af640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.707 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9faa0af640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.707 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:43:22.707+0000 7f9faa0af640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:43:22.733 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.731+0000 7f7939c3a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:43:22.796 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:43:22.795+0000 7f7939c3a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:43:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.583+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mon.2 v2:172.21.15.119:3301/0 8 ==== mgrmap(e 69) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8f280eb670 con 0x7f8f380b7980 2023-07-09T21:43:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.583+0000 7f8f26ffd640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8f18033ee0 0x7f8f18070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.583+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 --> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f18008020 con 0x7f8f18033ee0 2023-07-09T21:43:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.583+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8f18033ee0 0x7f8f18070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.587+0000 7f8f35d9b640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8f18033ee0 0x7f8f18070950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f380b3760 tx=0x7f8f2c007ed0 comp rx=0 tx=0).ready entity=mgr.8039 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:23.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f26ffd640 1 -- 172.21.15.37:0/369592670 <== mgr.8039 v2:172.21.15.119:6832/444783310 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f8f18008020 con 0x7f8f18033ee0 2023-07-09T21:43:23.655 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path /snap_test_dir1/test_restart 2023-07-09T21:43:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8f18033ee0 msgr2=0x7f8f18070950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8f18033ee0 0x7f8f18070950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f8f380b3760 tx=0x7f8f2c007ed0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380b7980 msgr2=0x7f8f380b46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 --2- 172.21.15.37:0/369592670 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f380b7980 0x7f8f380b46c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8f3808ac80 tx=0x7f8f280192e0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f36d9d640 1 -- 172.21.15.37:0/369592670 reap_dead start 2023-07-09T21:43:23.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 shutdown_connections 2023-07-09T21:43:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 >> 172.21.15.37:0/369592670 conn(0x7f8f38073090 msgr2=0x7f8f3815dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 shutdown_connections 2023-07-09T21:43:23.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.655+0000 7f8f3cde9640 1 -- 172.21.15.37:0/369592670 wait complete. 2023-07-09T21:43:23.678 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/test_restart 2023-07-09T21:43:23.679 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-09T21:43:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.827+0000 7f8c95959640 1 Processor -- start 2023-07-09T21:43:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.827+0000 7f8c95959640 1 -- start start 2023-07-09T21:43:23.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c95959640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c900b76b0 0x7f8c900cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c95959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c900d0360 0x7f8c900cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c95959640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c900b3bb0 con 0x7f8c9015f130 2023-07-09T21:43:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c95959640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c900cccb0 con 0x7f8c900b76b0 2023-07-09T21:43:23.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c95959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900d07a0 con 0x7f8c900d0360 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c900b76b0 0x7f8c900cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c8f7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c900d0360 0x7f8c900cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8c900b76b0 0x7f8c900cfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:54354/0 (socket says 172.21.15.37:54354) 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 -- 172.21.15.37:0/3225964553 learned_addr learned my addr 172.21.15.37:0/3225964553 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 -- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c900d0360 msgr2=0x7f8c900cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 --2- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c900d0360 0x7f8c900cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 -- 172.21.15.37:0/3225964553 >> v1:172.21.15.119:6789/0 conn(0x7f8c9015f130 legacy=0x7f8c900b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 -- 172.21.15.37:0/3225964553 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c900b8100 con 0x7f8c900b76b0 2023-07-09T21:43:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.831+0000 7f8c87fff640 1 --2- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900b76b0 0x7f8c900cfe20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009870 tx=0x7f8c7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe2b5c0ba8a69652 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:23.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8e7fc640 1 -- 172.21.15.37:0/3225964553 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780ab680 con 0x7f8c900b76b0 2023-07-09T21:43:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8e7fc640 1 -- 172.21.15.37:0/3225964553 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c780ab7e0 con 0x7f8c900b76b0 2023-07-09T21:43:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8e7fc640 1 -- 172.21.15.37:0/3225964553 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c780abb70 con 0x7f8c900b76b0 2023-07-09T21:43:23.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900b76b0 msgr2=0x7f8c900cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900b76b0 0x7f8c900cfe20 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f8c78009870 tx=0x7f8c7801c480 comp rx=0 tx=0).stop 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- 172.21.15.37:0/3225964553 shutdown_connections 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c900d0360 0x7f8c900cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- 172.21.15.37:0/3225964553 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900b76b0 0x7f8c900cfe20 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- 172.21.15.37:0/3225964553 >> 172.21.15.37:0/3225964553 conn(0x7f8c90072d20 msgr2=0x7f8c900d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- 172.21.15.37:0/3225964553 shutdown_connections 2023-07-09T21:43:23.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- 172.21.15.37:0/3225964553 wait complete. 2023-07-09T21:43:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 Processor -- start 2023-07-09T21:43:23.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- start start 2023-07-09T21:43:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 0x7f8c900c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 0x7f8c9009cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c7360 con 0x7f8c900b76b0 2023-07-09T21:43:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c75b0 con 0x7f8c900d0360 2023-07-09T21:43:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c95959640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c900c7890 con 0x7f8c9015f130 2023-07-09T21:43:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42960/0 (socket says 172.21.15.37:42960) 2023-07-09T21:43:23.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.835+0000 7f8c8effd640 1 -- 172.21.15.37:0/2464587105 learned_addr learned my addr 172.21.15.37:0/2464587105 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:43:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8f7fe640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 0x7f8c9009cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c87fff640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 0x7f8c900c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 -- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 msgr2=0x7f8c9009cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 0x7f8c9009cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 -- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 msgr2=0x7f8c900c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 0x7f8c900c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 -- 172.21.15.37:0/2464587105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c780094d0 con 0x7f8c900b76b0 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8f7fe640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 0x7f8c9009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c87fff640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 0x7f8c900c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:43:23.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8effd640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c450 tx=0x7f8c8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800052d0 con 0x7f8c900b76b0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c80005450 con 0x7f8c900b76b0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80012870 con 0x7f8c900b76b0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c900c7b70 con 0x7f8c900b76b0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c9009e500 con 0x7f8c900b76b0 2023-07-09T21:43:23.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c900668f0 con 0x7f8c900b76b0 2023-07-09T21:43:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 69) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8c800129d0 con 0x7f8c900b76b0 2023-07-09T21:43:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.839+0000 7f8c8cff9640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 0x7f8c70068600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:43:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.843+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f8c80083700 con 0x7f8c900b76b0 2023-07-09T21:43:23.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.843+0000 7f8c87fff640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 0x7f8c70068600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:43:23.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.843+0000 7f8c87fff640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 0x7f8c70068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c780af000 tx=0x7f8c78008040 comp rx=0 tx=0).ready entity=mgr.8039 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:43:23.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:23.843+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8c80050c70 con 0x7f8c900b76b0 2023-07-09T21:43:24.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.019+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 --> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c900cc940 con 0x7f8c70066150 2023-07-09T21:43:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.063+0000 7f8c8cff9640 1 -- 172.21.15.37:0/2464587105 <== mgr.8039 v2:172.21.15.119:6832/444783310 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+57 (secure 0 0 0) 0x7f8c780bb0e0 con 0x7f8c70066150 2023-07-09T21:43:24.066 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule activated for path /snap_test_dir1/test_restart 2023-07-09T21:43:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 msgr2=0x7f8c70068600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 0x7f8c70068600 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8c780af000 tx=0x7f8c78008040 comp rx=0 tx=0).stop 2023-07-09T21:43:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 msgr2=0x7f8c90159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:43:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000c450 tx=0x7f8c8000c910 comp rx=0 tx=0).stop 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 shutdown_connections 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f8c70066150 0x7f8c70068600 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8c9015f130 0x7f8c9009cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8c900d0360 0x7f8c900c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 --2- 172.21.15.37:0/2464587105 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c900b76b0 0x7f8c90159d10 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 >> 172.21.15.37:0/2464587105 conn(0x7f8c90072d20 msgr2=0x7f8c9015e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 shutdown_connections 2023-07-09T21:43:24.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:43:24.067+0000 7f8c95959640 1 -- 172.21.15.37:0/2464587105 wait complete. 2023-07-09T21:43:24.087 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/test_restart 2023-07-09T21:43:32.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:43:32.025 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:44:00.078 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:44:00.083+0000 7f9f9908d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:44:00.078 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:44:00.083+0000 7f9f9908d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:44:00.078 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:44:00.083+0000 7f9f9908d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:44:00.078 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:44:00.083+0000 7f9f9908d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:44:00.079 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:44:00.083+0000 7f9f9908d640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:44:02.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:44:02.141 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:44:32.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:44:32.271 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:45:02.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:45:02.460 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:45:32.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:45:32.523 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:46:02.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:46:02.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:46:32.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:46:32.710 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:47:02.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:47:02.856 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:47:32.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:47:32.995 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:48:03.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:48:03.060 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:48:33.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:48:33.137 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:03.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:03.251 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:33.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:49:33.389 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:03.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:03.512 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:33.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:50:33.575 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:03.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:03.650 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:33.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:51:33.702 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:03.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:03.849 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:34.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:52:34.054 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:04.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:04.117 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:34.176 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:53:34.180 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:54:04.306 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:54:04.310 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:54:16.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:54:16.089 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-09T21:54:16.108 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_44_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_45_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_46_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_47_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_48_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_49_00_UTC 2023-07-09T21:54:16.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_50_00_UTC 2023-07-09T21:54:16.110 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_51_00_UTC 2023-07-09T21:54:16.110 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_52_00_UTC 2023-07-09T21:54:16.110 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_53_00_UTC 2023-07-09T21:54:16.110 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_54_00_UTC 2023-07-09T21:54:16.111 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_44_00_UTC', 'scheduled-2023-07-09-21_45_00_UTC', 'scheduled-2023-07-09-21_46_00_UTC', 'scheduled-2023-07-09-21_47_00_UTC', 'scheduled-2023-07-09-21_48_00_UTC', 'scheduled-2023-07-09-21_49_00_UTC', 'scheduled-2023-07-09-21_50_00_UTC', 'scheduled-2023-07-09-21_51_00_UTC', 'scheduled-2023-07-09-21_52_00_UTC', 'scheduled-2023-07-09-21_53_00_UTC', 'scheduled-2023-07-09-21_54_00_UTC'] 2023-07-09T21:54:16.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-09T21:54:16.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.309+0000 7fc33779f640 1 Processor -- start 2023-07-09T21:54:16.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.309+0000 7fc33779f640 1 -- start start 2023-07-09T21:54:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33779f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc33015bb90 0x7fc3300ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33779f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc33015f610 0x7fc33015fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33779f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33015bf60 con 0x7fc33006b9c0 2023-07-09T21:54:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33779f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3300cc530 con 0x7fc33015bb90 2023-07-09T21:54:16.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33779f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3301600d0 con 0x7fc33015f610 2023-07-09T21:54:16.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc33015bb90 0x7fc3300ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc33015bb90 0x7fc3300ccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54080/0 (socket says 172.21.15.37:54080) 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 -- 172.21.15.37:0/3690237102 learned_addr learned my addr 172.21.15.37:0/3690237102 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc335d3c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc33006b9c0 0x7fc33006a5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57730/0 (socket says 172.21.15.37:57730) 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc334d3a640 1 --2- 172.21.15.37:0/3690237102 >> v2:172.21.15.119:3300/0 conn(0x7fc33015f610 0x7fc33015fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 -- 172.21.15.37:0/3690237102 >> v2:172.21.15.119:3300/0 conn(0x7fc33015f610 msgr2=0x7fc33015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 --2- 172.21.15.37:0/3690237102 >> v2:172.21.15.119:3300/0 conn(0x7fc33015f610 0x7fc33015fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 -- 172.21.15.37:0/3690237102 >> v1:172.21.15.37:6789/0 conn(0x7fc33006b9c0 legacy=0x7fc33006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc327fff640 1 -- 172.21.15.37:0/3690237102 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193329953 0 0) 0x7fc33015bf60 con 0x7fc33006b9c0 2023-07-09T21:54:16.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.313+0000 7fc33553b640 1 -- 172.21.15.37:0/3690237102 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3301603b0 con 0x7fc33015bb90 2023-07-09T21:54:16.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33553b640 1 --2- 172.21.15.37:0/3690237102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300ccf40 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fc3300ce320 tx=0x7fc32c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a33b8020a1ea04b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc327fff640 1 -- 172.21.15.37:0/3690237102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c004230 con 0x7fc33015bb90 2023-07-09T21:54:16.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc327fff640 1 -- 172.21.15.37:0/3690237102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0a7050 con 0x7fc33015bb90 2023-07-09T21:54:16.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc327fff640 1 -- 172.21.15.37:0/3690237102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c003620 con 0x7fc33015bb90 2023-07-09T21:54:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- 172.21.15.37:0/3690237102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 msgr2=0x7fc3300ccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- 172.21.15.37:0/3690237102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300ccf40 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fc3300ce320 tx=0x7fc32c01c440 comp rx=0 tx=0).stop 2023-07-09T21:54:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- 172.21.15.37:0/3690237102 shutdown_connections 2023-07-09T21:54:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- 172.21.15.37:0/3690237102 >> v2:172.21.15.119:3300/0 conn(0x7fc33015f610 0x7fc33015fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- 172.21.15.37:0/3690237102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300ccf40 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- 172.21.15.37:0/3690237102 >> 172.21.15.37:0/3690237102 conn(0x7fc33006d230 msgr2=0x7fc33006d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:54:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- 172.21.15.37:0/3690237102 shutdown_connections 2023-07-09T21:54:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- 172.21.15.37:0/3690237102 wait complete. 2023-07-09T21:54:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 Processor -- start 2023-07-09T21:54:16.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 -- start start 2023-07-09T21:54:16.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 0x7fc3300c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.317+0000 7fc33779f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 0x7fc33014ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33014e030 con 0x7fc33015bb90 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3301534b0 con 0x7fc33015f610 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33014da70 con 0x7fc33006b9c0 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54088/0 (socket says 172.21.15.37:54088) 2023-07-09T21:54:16.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 -- 172.21.15.37:0/1777451954 learned_addr learned my addr 172.21.15.37:0/1777451954 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33553b640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 0x7fc3300c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc335d3c640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 0x7fc33014ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 -- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 msgr2=0x7fc3300c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 0x7fc3300c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 -- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 msgr2=0x7fc33014ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 0x7fc33014ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 -- 172.21.15.37:0/1777451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0094d0 con 0x7fc33015bb90 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33553b640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 0x7fc3300c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc335d3c640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 0x7fc33014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc334d3a640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc32000d800 tx=0x7fc32000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000b6c0 con 0x7fc33015bb90 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32000b820 con 0x7fc33015bb90 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32000bb90 con 0x7fc33015bb90 2023-07-09T21:54:16.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33014dd50 con 0x7fc33015bb90 2023-07-09T21:54:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc330153a30 con 0x7fc33015bb90 2023-07-09T21:54:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc330153310 con 0x7fc33015bb90 2023-07-09T21:54:16.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.321+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 72) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fc32000bcf0 con 0x7fc33015bb90 2023-07-09T21:54:16.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.325+0000 7fc325ffb640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 0x7fc3140688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.325+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6434+0+0 (secure 0 0 0) 0x7fc320084690 con 0x7fc33015bb90 2023-07-09T21:54:16.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.325+0000 7fc33553b640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 0x7fc3140688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.325+0000 7fc33553b640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 0x7fc3140688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ad000 tx=0x7fc32c0a6000 comp rx=0 tx=0).ready entity=mgr.8039 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.329+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc330153310 con 0x7fc33015bb90 2023-07-09T21:54:16.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.497+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 --> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc33006ef70 con 0x7fc3140663f0 2023-07-09T21:54:16.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.505+0000 7fc325ffb640 1 -- 172.21.15.37:0/1777451954 <== mgr.8039 v2:172.21.15.119:6832/444783310 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7fc32c004270 con 0x7fc3140663f0 2023-07-09T21:54:16.507 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:54:16.507 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:43:23", "first": "2023-07-09T21:44:00", "last": "2023-07-09T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-09T21:54:16.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 msgr2=0x7fc3140688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 0x7fc3140688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0ad000 tx=0x7fc32c0a6000 comp rx=0 tx=0).stop 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 msgr2=0x7fc3300cf070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc32000d800 tx=0x7fc32000dcc0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 shutdown_connections 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7fc3140663f0 0x7fc3140688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc33015f610 0x7fc33014ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc33015bb90 0x7fc3300cf070 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 --2- 172.21.15.37:0/1777451954 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc33006b9c0 0x7fc3300c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 >> 172.21.15.37:0/1777451954 conn(0x7fc33006d230 msgr2=0x7fc33006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:54:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 shutdown_connections 2023-07-09T21:54:16.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.509+0000 7fc33779f640 1 -- 172.21.15.37:0/1777451954 wait complete. 2023-07-09T21:54:16.527 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:43:23", "first": "2023-07-09T21:44:00", "last": "2023-07-09T21:54:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": true}] 2023-07-09T21:54:16.528 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:43:23', 'first': '2023-07-09T21:44:00', 'last': '2023-07-09T21:54:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': True} 2023-07-09T21:54:16.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-07-09T21:54:16.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.669+0000 7f80fcc9e640 1 Processor -- start 2023-07-09T21:54:16.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.669+0000 7f80fcc9e640 1 -- start start 2023-07-09T21:54:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80fcc9e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80f80b7ab0 0x7f80f806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80fcc9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80b4340 0x7f80f80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80fcc9e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f80b49f0 con 0x7f80f80cef80 2023-07-09T21:54:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80fcc9e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80f80b7e80 con 0x7f80f80b7ab0 2023-07-09T21:54:16.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80fcc9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80cc8a0 con 0x7f80f80b4340 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80f80b7ab0 0x7f80f806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f80f80b7ab0 0x7f80f806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54094/0 (socket says 172.21.15.37:54094) 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 -- 172.21.15.37:0/3045887791 learned_addr learned my addr 172.21.15.37:0/3045887791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f6d9d640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80b4340 0x7f80f80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 -- 172.21.15.37:0/3045887791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80b4340 msgr2=0x7f80f80d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80b4340 0x7f80f80d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 -- 172.21.15.37:0/3045887791 >> v1:172.21.15.119:6789/0 conn(0x7f80f80cef80 legacy=0x7f80f80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.673+0000 7f80f659c640 1 -- 172.21.15.37:0/3045887791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f80ccb80 con 0x7f80f80b7ab0 2023-07-09T21:54:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80f659c640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b7ab0 0x7f80f806aa50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009870 tx=0x7f80e801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ece251504c9951 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80f5d9b640 1 -- 172.21.15.37:0/3045887791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80aa670 con 0x7f80f80b7ab0 2023-07-09T21:54:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80f5d9b640 1 -- 172.21.15.37:0/3045887791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80aa7d0 con 0x7f80f80b7ab0 2023-07-09T21:54:16.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80f5d9b640 1 -- 172.21.15.37:0/3045887791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80aab60 con 0x7f80f80b7ab0 2023-07-09T21:54:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- 172.21.15.37:0/3045887791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b7ab0 msgr2=0x7f80f806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b7ab0 0x7f80f806aa50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009870 tx=0x7f80e801c510 comp rx=0 tx=0).stop 2023-07-09T21:54:16.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- 172.21.15.37:0/3045887791 shutdown_connections 2023-07-09T21:54:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80b4340 0x7f80f80d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/3045887791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b7ab0 0x7f80f806aa50 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- 172.21.15.37:0/3045887791 >> 172.21.15.37:0/3045887791 conn(0x7f80f8073090 msgr2=0x7f80f8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:54:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- 172.21.15.37:0/3045887791 shutdown_connections 2023-07-09T21:54:16.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- 172.21.15.37:0/3045887791 wait complete. 2023-07-09T21:54:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 Processor -- start 2023-07-09T21:54:16.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.677+0000 7f80fcc9e640 1 -- start start 2023-07-09T21:54:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80f80b7ab0 0x7f80f80c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80cef80 0x7f80f80b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80c8350 con 0x7f80f80b4340 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80c8630 con 0x7f80f80b7ab0 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f80b51a0 con 0x7f80f80cef80 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54108/0 (socket says 172.21.15.37:54108) 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 -- 172.21.15.37:0/905501645 learned_addr learned my addr 172.21.15.37:0/905501645 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:54:16.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80effff640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80f80b7ab0 0x7f80f80c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f6d9d640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80cef80 0x7f80f80b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 -- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80cef80 msgr2=0x7f80f80b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80cef80 0x7f80f80b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 -- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80f80b7ab0 msgr2=0x7f80f80c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80f80b7ab0 0x7f80f80c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 -- 172.21.15.37:0/905501645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80094d0 con 0x7f80f80b4340 2023-07-09T21:54:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80f659c640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ac040 tx=0x7f80e801ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80b3800 con 0x7f80f80b4340 2023-07-09T21:54:16.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80b3980 con 0x7f80f80b4340 2023-07-09T21:54:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f80b5480 con 0x7f80f80b4340 2023-07-09T21:54:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80b3d30 con 0x7f80f80b4340 2023-07-09T21:54:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f80c7f90 con 0x7f80f80b4340 2023-07-09T21:54:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f80b56c0 con 0x7f80f80b4340 2023-07-09T21:54:16.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.681+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 72) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f80e80c6390 con 0x7f80f80b4340 2023-07-09T21:54:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.685+0000 7f80eeffd640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 0x7f80d80688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:54:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.685+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6434+0+0 (secure 0 0 0) 0x7f80e811ef20 con 0x7f80f80b4340 2023-07-09T21:54:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.685+0000 7f80effff640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 0x7f80d80688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:54:16.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.685+0000 7f80effff640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 0x7f80d80688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80f81f7410 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.8039 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:54:16.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.689+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f80f80b56c0 con 0x7f80f80b4340 2023-07-09T21:54:16.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.881+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f80f80b56c0 con 0x7f80f80b4340 2023-07-09T21:54:16.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80eeffd640 1 -- 172.21.15.37:0/905501645 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v72) v1 ==== 74+0+164452 (secure 0 0 0) 0x7f80f80b56c0 con 0x7f80f80b4340 2023-07-09T21:54:16.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:54:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 msgr2=0x7f80d80688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 0x7f80d80688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f80f81f7410 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2023-07-09T21:54:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 msgr2=0x7f80f814d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:54:16.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f80e80ac040 tx=0x7f80e801ad50 comp rx=0 tx=0).stop 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 shutdown_connections 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:6832/444783310,v1:172.21.15.119:6833/444783310] conn(0x7f80d8066420 0x7f80d80688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f80f80cef80 0x7f80f80b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f80f80b7ab0 0x7f80f80c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 --2- 172.21.15.37:0/905501645 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80f80b4340 0x7f80f814d430 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 >> 172.21.15.37:0/905501645 conn(0x7f80f8073090 msgr2=0x7f80f80d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:54:16.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 shutdown_connections 2023-07-09T21:54:16.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:54:16.885+0000 7f80fcc9e640 1 -- 172.21.15.37:0/905501645 wait complete. 2023-07-09T21:54:16.906 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":72,"active_gid":8039,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6832","nonce":444783310},{"type":"v1","addr":"172.21.15.119:6833","nonce":444783310}]},"active_addr":"172.21.15.119:6833/444783310","active_change":"2023-07-09T21:43:22.569624+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":9765,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":159,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":3239411330}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":721897364}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":2405349511}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":537425844}]},{"name":"snap_schedule","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":1690687053}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.119:0","nonce":710378599}]}]} 2023-07-09T21:54:16.910 DEBUG:tasks.cephfs.test_snap_schedules:restarting active mgr: x 2023-07-09T21:54:16.911 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-07-09T21:54:16.911 INFO:tasks.ceph.mgr.x:Stopping old one... 2023-07-09T21:54:16.911 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-09T21:54:16.912 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:54:16.972 INFO:tasks.ceph.mgr.x:Stopped 2023-07-09T21:54:16.973 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-07-09T21:54:16.976 INFO:tasks.ceph.mgr.x:Started 2023-07-09T21:54:17.149 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:17.151+0000 7f414da30180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:54:17.563 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:17.563+0000 7f414da30180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:54:17.712 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:17.715+0000 7f414da30180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:54:18.187 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.187+0000 7f414da30180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:54:18.245 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.247+0000 7f414da30180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:54:18.300 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.303+0000 7f414da30180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:54:18.387 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.387+0000 7f414da30180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:54:18.444 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.447+0000 7f414da30180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:54:18.527 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.527+0000 7f414da30180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:54:18.583 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.583+0000 7f414da30180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:54:18.724 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.727+0000 7f414da30180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:54:18.781 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:18.783+0000 7f414da30180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:54:19.019 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:54:19.020 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:54:19.020 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:54:19.028 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:19.031+0000 7f414da30180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:54:19.159 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:19.159+0000 7f414da30180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:54:19.284 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:19.283+0000 7f414da30180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:54:19.352 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:19.355+0000 7f414da30180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:54:19.486 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:19.487+0000 7f414da30180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:54:20.019 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.019+0000 7f414da30180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:54:20.103 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.103+0000 7f414da30180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:54:20.248 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.251+0000 7f414da30180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:54:20.330 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.331+0000 7f414da30180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:54:20.600 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.603+0000 7f414da30180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:54:20.660 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.663+0000 7f414da30180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:54:20.829 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40cb011640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.829 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40cb011640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40cb011640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40cb011640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40cb011640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40ce017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40ce017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40ce017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.830 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40ce017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:20.831 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:54:20.831+0000 7f40ce017640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:54:34.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:54:34.366 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:55:00.825 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:55:00.826+0000 7f40d6027640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:55:00.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:55:00.826+0000 7f40d6027640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:55:00.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:55:00.826+0000 7f40d6027640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:55:00.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:55:00.826+0000 7f40d6027640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:55:00.826 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:55:00.826+0000 7f40d6027640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:55:04.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:55:04.538 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:55:34.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:55:34.604 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:56:04.685 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:56:04.690 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:56:34.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:56:34.753 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:57:04.882 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:57:04.886 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:57:35.087 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:57:35.092 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:58:05.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:58:05.188 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:58:35.264 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:58:35.268 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:59:05.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:59:05.397 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:59:16.977 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-09T21:59:17.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 Processor -- start 2023-07-09T21:59:17.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 -- start start 2023-07-09T21:59:17.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f693c15bbc0 0x7f693c06a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0cca70 con 0x7f693c06ab80 2023-07-09T21:59:17.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693c0ccd50 con 0x7f693c0cffc0 2023-07-09T21:59:17.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f6942b82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f693c0cd030 con 0x7f693c15bbc0 2023-07-09T21:59:17.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f694111f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f693c06ab80 0x7f693c0ca730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47512/0 (socket says 172.21.15.37:47512) 2023-07-09T21:59:17.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f694111f640 1 -- 172.21.15.37:0/2988188370 learned_addr learned my addr 172.21.15.37:0/2988188370 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:17.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693bfff640 1 --2- 172.21.15.37:0/2988188370 >> v2:172.21.15.119:3300/0 conn(0x7f693c15bbc0 0x7f693c06a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338034230 0 0) 0x7f693c0cca70 con 0x7f693c06ab80 2023-07-09T21:59:17.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f692c003530 con 0x7f693c06ab80 2023-07-09T21:59:17.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320623532 0 0) 0x7f692c003530 con 0x7f693c06ab80 2023-07-09T21:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693bfff640 1 -- 172.21.15.37:0/2988188370 >> v1:172.21.15.119:6789/0 conn(0x7f693c0cffc0 legacy=0x7f693c0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693bfff640 1 -- 172.21.15.37:0/2988188370 >> v1:172.21.15.37:6789/0 conn(0x7f693c06ab80 legacy=0x7f693c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.135+0000 7f693bfff640 1 -- 172.21.15.37:0/2988188370 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c0cd310 con 0x7f693c15bbc0 2023-07-09T21:59:17.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f693bfff640 1 --2- 172.21.15.37:0/2988188370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c15bbc0 0x7f693c06a640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f69280097c0 tx=0x7f692801c190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41af8cdb51d41247 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6934001a00 con 0x7f693c15bbc0 2023-07-09T21:59:17.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69280a7050 con 0x7f693c15bbc0 2023-07-09T21:59:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f693b7fe640 1 -- 172.21.15.37:0/2988188370 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69280ab400 con 0x7f693c15bbc0 2023-07-09T21:59:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 -- 172.21.15.37:0/2988188370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c15bbc0 msgr2=0x7f693c06a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 --2- 172.21.15.37:0/2988188370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c15bbc0 0x7f693c06a640 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f69280097c0 tx=0x7f692801c190 comp rx=0 tx=0).stop 2023-07-09T21:59:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 -- 172.21.15.37:0/2988188370 shutdown_connections 2023-07-09T21:59:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 --2- 172.21.15.37:0/2988188370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c15bbc0 0x7f693c06a640 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 -- 172.21.15.37:0/2988188370 >> 172.21.15.37:0/2988188370 conn(0x7f693c099320 msgr2=0x7f693c072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 -- 172.21.15.37:0/2988188370 shutdown_connections 2023-07-09T21:59:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.139+0000 7f6942b82640 1 -- 172.21.15.37:0/2988188370 wait complete. 2023-07-09T21:59:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 Processor -- start 2023-07-09T21:59:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- start start 2023-07-09T21:59:17.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 0x7f693c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f693c1578c0 0x7f693c141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0b2e80 con 0x7f693c06ab80 2023-07-09T21:59:17.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693c1551a0 con 0x7f693c0cffc0 2023-07-09T21:59:17.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693c0b30b0 con 0x7f693c1578c0 2023-07-09T21:59:17.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53890/0 (socket says 172.21.15.37:53890) 2023-07-09T21:59:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 -- 172.21.15.37:0/3621813823 learned_addr learned my addr 172.21.15.37:0/3621813823 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 -- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f693c1578c0 msgr2=0x7f693c141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f693c1578c0 0x7f693c141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f693bfff640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 0x7f693c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 -- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 msgr2=0x7f693c154c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 0x7f693c154c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 -- 172.21.15.37:0/3621813823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6928009420 con 0x7f693c06ab80 2023-07-09T21:59:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f693bfff640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 0x7f693c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f694091e640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f693000c780 tx=0x7f693000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6930005270 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69300053d0 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693000a880 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693c0c8c20 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.143+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693c0c91e0 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693c0d0fb0 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f693000a9e0 con 0x7f693c06ab80 2023-07-09T21:59:17.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f69397fa640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 0x7f69200688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f6930083950 con 0x7f693c06ab80 2023-07-09T21:59:17.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f693bfff640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 0x7f69200688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.147+0000 7f693bfff640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 0x7f69200688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69280ad000 tx=0x7f6928008040 comp rx=0 tx=0).ready entity=mgr.8117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.151+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6930050a10 con 0x7f693c06ab80 2023-07-09T21:59:17.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.323+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 --> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f693c0737a0 con 0x7f69200663f0 2023-07-09T21:59:17.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f69397fa640 1 -- 172.21.15.37:0/3621813823 <== mgr.8117 v2:172.21.15.119:6832/2345325658 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+59 (secure 0 0 0) 0x7f69280ab5e0 con 0x7f69200663f0 2023-07-09T21:59:17.393 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-09T21:59:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 msgr2=0x7f69200688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 0x7f69200688a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f69280ad000 tx=0x7f6928008040 comp rx=0 tx=0).stop 2023-07-09T21:59:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 msgr2=0x7f693c0c9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f693000c780 tx=0x7f693000cc40 comp rx=0 tx=0).stop 2023-07-09T21:59:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 shutdown_connections 2023-07-09T21:59:17.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f69200663f0 0x7f69200688a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f693c1578c0 0x7f693c141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f693c0cffc0 0x7f693c154c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 --2- 172.21.15.37:0/3621813823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f693c06ab80 0x7f693c0c9700 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 >> 172.21.15.37:0/3621813823 conn(0x7f693c099320 msgr2=0x7f693c159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 shutdown_connections 2023-07-09T21:59:17.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.391+0000 7f6942b82640 1 -- 172.21.15.37:0/3621813823 wait complete. 2023-07-09T21:59:17.414 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/test_restart 2023-07-09T21:59:17.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:17.415 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-09T21:59:17.429 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_44_00_UTC 2023-07-09T21:59:17.430 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_45_00_UTC 2023-07-09T21:59:17.430 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_46_00_UTC 2023-07-09T21:59:17.430 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_47_00_UTC 2023-07-09T21:59:17.430 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_48_00_UTC 2023-07-09T21:59:17.431 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_49_00_UTC 2023-07-09T21:59:17.431 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_50_00_UTC 2023-07-09T21:59:17.431 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_51_00_UTC 2023-07-09T21:59:17.432 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_52_00_UTC 2023-07-09T21:59:17.432 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_53_00_UTC 2023-07-09T21:59:17.432 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_54_00_UTC 2023-07-09T21:59:17.432 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_55_00_UTC 2023-07-09T21:59:17.433 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_56_00_UTC 2023-07-09T21:59:17.433 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_57_00_UTC 2023-07-09T21:59:17.433 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_58_00_UTC 2023-07-09T21:59:17.434 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_59_00_UTC 2023-07-09T21:59:17.435 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2023-07-09-21_44_00_UTC', 'scheduled-2023-07-09-21_45_00_UTC', 'scheduled-2023-07-09-21_46_00_UTC', 'scheduled-2023-07-09-21_47_00_UTC', 'scheduled-2023-07-09-21_48_00_UTC', 'scheduled-2023-07-09-21_49_00_UTC', 'scheduled-2023-07-09-21_50_00_UTC', 'scheduled-2023-07-09-21_51_00_UTC', 'scheduled-2023-07-09-21_52_00_UTC', 'scheduled-2023-07-09-21_53_00_UTC', 'scheduled-2023-07-09-21_54_00_UTC', 'scheduled-2023-07-09-21_55_00_UTC', 'scheduled-2023-07-09-21_56_00_UTC', 'scheduled-2023-07-09-21_57_00_UTC', 'scheduled-2023-07-09-21_58_00_UTC', 'scheduled-2023-07-09-21_59_00_UTC'] 2023-07-09T21:59:17.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --fs cephfs --format json /snap_test_dir1/test_restart 2023-07-09T21:59:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 Processor -- start 2023-07-09T21:59:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 -- start start 2023-07-09T21:59:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fed4c0b76b0 0x7fed4c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0b3bb0 con 0x7fed4c0d0360 2023-07-09T21:59:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0cccb0 con 0x7fed4c15f130 2023-07-09T21:59:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed51656640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0d07a0 con 0x7fed4c0b76b0 2023-07-09T21:59:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fed4c0d0360 0x7fed4c0cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38184/0 (socket says 172.21.15.37:38184) 2023-07-09T21:59:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4b7fe640 1 -- 172.21.15.37:0/2801077792 learned_addr learned my addr 172.21.15.37:0/2801077792 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed43fff640 1 --2- 172.21.15.37:0/2801077792 >> v2:172.21.15.119:3300/0 conn(0x7fed4c0b76b0 0x7fed4c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263308462 0 0) 0x7fed4c0b3bb0 con 0x7fed4c0d0360 2023-07-09T21:59:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed38003530 con 0x7fed4c0d0360 2023-07-09T21:59:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2421162494 0 0) 0x7fed38003530 con 0x7fed4c0d0360 2023-07-09T21:59:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 >> v2:172.21.15.119:3300/0 conn(0x7fed4c0b76b0 msgr2=0x7fed4c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 --2- 172.21.15.37:0/2801077792 >> v2:172.21.15.119:3300/0 conn(0x7fed4c0b76b0 0x7fed4c0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.619+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 >> v1:172.21.15.119:6789/0 conn(0x7fed4c15f130 legacy=0x7fed4c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0b8100 con 0x7fed4c0d0360 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fed44001a00 con 0x7fed4c0d0360 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 >> v1:172.21.15.37:6789/0 conn(0x7fed4c0d0360 legacy=0x7fed4c0cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0d07a0 con 0x7fed38005180 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800c090 con 0x7fed38003980 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3800c250 con 0x7fed380047d0 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4affd640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed43fff640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 -- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380047d0 msgr2=0x7fed38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed380047d0 0x7fed38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 -- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38003980 msgr2=0x7fed38003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed38003980 0x7fed38003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 -- 172.21.15.37:0/2801077792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed38003530 con 0x7fed38005180 2023-07-09T21:59:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 -- 172.21.15.37:0/2801077792 reap_dead start 2023-07-09T21:59:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed3800b990 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fed4400a820 tx=0x7fed4401fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b6f81071d4e1b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.623+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440aa6b0 con 0x7fed38005180 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440aa850 con 0x7fed38005180 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed4a7fc640 1 -- 172.21.15.37:0/2801077792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440aac00 con 0x7fed38005180 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 msgr2=0x7fed3800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed3800b990 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7fed4400a820 tx=0x7fed4401fa80 comp rx=0 tx=0).stop 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- 172.21.15.37:0/2801077792 shutdown_connections 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 --2- 172.21.15.37:0/2801077792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed3800b990 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- 172.21.15.37:0/2801077792 >> 172.21.15.37:0/2801077792 conn(0x7fed4c072d20 msgr2=0x7fed4c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- 172.21.15.37:0/2801077792 shutdown_connections 2023-07-09T21:59:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- 172.21.15.37:0/2801077792 wait complete. 2023-07-09T21:59:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 Processor -- start 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- start start 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed4c0c88d0 0x7fed4c0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed4c0cb3a0 0x7fed4c0cb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0cbd50 con 0x7fed38005180 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ca630 con 0x7fed4c0cb3a0 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed51656640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0ca910 con 0x7fed4c0c88d0 2023-07-09T21:59:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed4affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed4affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33964/0 (socket says 172.21.15.37:33964) 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.627+0000 7fed4affd640 1 -- 172.21.15.37:0/13532629 learned_addr learned my addr 172.21.15.37:0/13532629 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed43fff640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed4c0c88d0 0x7fed4c0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4b7fe640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed4c0cb3a0 0x7fed4c0cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 -- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed4c0c88d0 msgr2=0x7fed4c0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed4c0c88d0 0x7fed4c0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 -- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed4c0cb3a0 msgr2=0x7fed4c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed4c0cb3a0 0x7fed4c0cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 -- 172.21.15.37:0/13532629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0cabf0 con 0x7fed38005180 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed4affd640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00f7f0 tx=0x7fed3c00fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c0050d0 con 0x7fed38005180 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0c5cd0 con 0x7fed38005180 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c005230 con 0x7fed38005180 2023-07-09T21:59:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00d730 con 0x7fed38005180 2023-07-09T21:59:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c15d050 con 0x7fed38005180 2023-07-09T21:59:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c071720 con 0x7fed38005180 2023-07-09T21:59:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7fed3c00d890 con 0x7fed38005180 2023-07-09T21:59:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 0x7fed2c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.631+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6778+0+0 (secure 0 0 0) 0x7fed3c084150 con 0x7fed38005180 2023-07-09T21:59:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.635+0000 7fed43fff640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 0x7fed2c0688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.635+0000 7fed43fff640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 0x7fed2c0688d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b3430 tx=0x7fed34009190 comp rx=0 tx=0).ready entity=mgr.8117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.635+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed3c0510d0 con 0x7fed38005180 2023-07-09T21:59:17.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.807+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 --> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed4c0ca7a0 con 0x7fed2c066420 2023-07-09T21:59:17.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed437fe640 1 -- 172.21.15.37:0/13532629 <== mgr.8117 v2:172.21.15.119:6832/2345325658 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+361 (secure 0 0 0) 0x7fed4c0ca7a0 con 0x7fed2c066420 2023-07-09T21:59:17.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:17.819 INFO:teuthology.orchestra.run.smithi037.stdout:[{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:43:23", "first": "2023-07-09T21:44:00", "last": "2023-07-09T21:59:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-09T21:59:17.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 msgr2=0x7fed2c0688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 0x7fed2c0688d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0b3430 tx=0x7fed34009190 comp rx=0 tx=0).stop 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 msgr2=0x7fed4c15cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00f7f0 tx=0x7fed3c00fbf0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 shutdown_connections 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fed2c066420 0x7fed2c0688d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fed4c0cb3a0 0x7fed4c0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fed4c0c88d0 0x7fed4c0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 --2- 172.21.15.37:0/13532629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed38005180 0x7fed4c15cb10 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 >> 172.21.15.37:0/13532629 conn(0x7fed4c072d20 msgr2=0x7fed4c0cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 shutdown_connections 2023-07-09T21:59:17.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.815+0000 7fed51656640 1 -- 172.21.15.37:0/13532629 wait complete. 2023-07-09T21:59:17.840 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "path": "/snap_test_dir1/test_restart", "rel_path": "/snap_test_dir1/test_restart", "schedule": "1M", "retention": {}, "start": "2023-07-09T00:00:00", "created": "2023-07-09T21:43:23", "first": "2023-07-09T21:44:00", "last": "2023-07-09T21:59:00", "last_pruned": null, "created_count": 16, "pruned_count": 0, "active": false}] 2023-07-09T21:59:17.841 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'path': '/snap_test_dir1/test_restart', 'rel_path': '/snap_test_dir1/test_restart', 'schedule': '1M', 'retention': {}, 'start': '2023-07-09T00:00:00', 'created': '2023-07-09T21:43:23', 'first': '2023-07-09T21:44:00', 'last': '2023-07-09T21:59:00', 'last_pruned': None, 'created_count': 16, 'pruned_count': 0, 'active': False} 2023-07-09T21:59:17.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs /snap_test_dir1/test_restart 1M 2023-07-09T21:59:17.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 Processor -- start 2023-07-09T21:59:17.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 -- start start 2023-07-09T21:59:17.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 0x7f7cc0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cc00d0780 0x7f7cc00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc015bf80 con 0x7f7cc00ceb80 2023-07-09T21:59:17.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cd070 con 0x7f7cc00d0780 2023-07-09T21:59:17.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cc4aec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc00cfd70 con 0x7f7cc00b7980 2023-07-09T21:59:17.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cc00d0780 0x7f7cc00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7cc00d0780 0x7f7cc00d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33968/0 (socket says 172.21.15.37:33968) 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 -- 172.21.15.37:0/229050000 learned_addr learned my addr 172.21.15.37:0/229050000 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbdd9b640 1 --1- 172.21.15.37:0/229050000 >> v1:172.21.15.37:6789/0 conn(0x7f7cc00ceb80 0x7f7cc00cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38194/0 (socket says 172.21.15.37:38194) 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 -- 172.21.15.37:0/229050000 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 msgr2=0x7f7cc0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbe59c640 1 --2- 172.21.15.37:0/229050000 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 0x7f7cc0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 --2- 172.21.15.37:0/229050000 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 0x7f7cc0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 -- 172.21.15.37:0/229050000 >> v1:172.21.15.37:6789/0 conn(0x7f7cc00ceb80 legacy=0x7f7cc00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbed9d640 1 -- 172.21.15.37:0/229050000 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc0160570 con 0x7f7cc00d0780 2023-07-09T21:59:17.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbd59a640 1 -- 172.21.15.37:0/229050000 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084484340 0 0) 0x7f7cb4001120 con 0x7f7cc00ceb80 2023-07-09T21:59:17.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.987+0000 7f7cbe59c640 1 --2- 172.21.15.37:0/229050000 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 0x7f7cc0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:17.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cbed9d640 1 --2- 172.21.15.37:0/229050000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc00d0b80 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0069aa0 tx=0x7f7cb801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8280051942190 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:17.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cbd59a640 1 -- 172.21.15.37:0/229050000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80a5690 con 0x7f7cc00d0780 2023-07-09T21:59:17.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cbd59a640 1 -- 172.21.15.37:0/229050000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb80a57f0 con 0x7f7cc00d0780 2023-07-09T21:59:17.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cbd59a640 1 -- 172.21.15.37:0/229050000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80a5b80 con 0x7f7cc00d0780 2023-07-09T21:59:17.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 -- 172.21.15.37:0/229050000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 msgr2=0x7f7cc00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/229050000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc00d0b80 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0069aa0 tx=0x7f7cb801c9d0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 -- 172.21.15.37:0/229050000 shutdown_connections 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/229050000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc00d0b80 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/229050000 >> v2:172.21.15.119:3300/0 conn(0x7f7cc00b7980 0x7f7cc0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 -- 172.21.15.37:0/229050000 >> 172.21.15.37:0/229050000 conn(0x7f7cc0073090 msgr2=0x7f7cc0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 -- 172.21.15.37:0/229050000 shutdown_connections 2023-07-09T21:59:17.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.991+0000 7f7cc4aec640 1 -- 172.21.15.37:0/229050000 wait complete. 2023-07-09T21:59:17.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 Processor -- start 2023-07-09T21:59:17.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- start start 2023-07-09T21:59:17.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00b7980 0x7f7cc015e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00ceb80 0x7f7cc0152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc015ed50 con 0x7f7cc00d0780 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0157da0 con 0x7f7cc00ceb80 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc0157160 con 0x7f7cc00b7980 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33984/0 (socket says 172.21.15.37:33984) 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 -- 172.21.15.37:0/1154404997 learned_addr learned my addr 172.21.15.37:0/1154404997 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:17.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbe59c640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00b7980 0x7f7cc015e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:18.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbdd9b640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00ceb80 0x7f7cc0152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 -- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00b7980 msgr2=0x7f7cc015e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00b7980 0x7f7cc015e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 -- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00ceb80 msgr2=0x7f7cc0152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00ceb80 0x7f7cc0152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 -- 172.21.15.37:0/1154404997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb8009b30 con 0x7f7cc00d0780 2023-07-09T21:59:18.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cbed9d640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80195e0 tx=0x7f7cb8019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80b8880 con 0x7f7cc00d0780 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb80b89e0 con 0x7f7cc00d0780 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb80b8d90 con 0x7f7cc00d0780 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc015ea80 con 0x7f7cc00d0780 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.995+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc01576e0 con 0x7f7cc00d0780 2023-07-09T21:59:18.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc0157ee0 con 0x7f7cc00d0780 2023-07-09T21:59:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f7cb80b6440 con 0x7f7cc00d0780 2023-07-09T21:59:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7caeffd640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 0x7f7ca00688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f7cb811f870 con 0x7f7cc00d0780 2023-07-09T21:59:18.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7cbe59c640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 0x7f7ca00688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:18.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:17.999+0000 7f7cbe59c640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 0x7f7ca00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0006fd0 tx=0x7f7cb0008040 comp rx=0 tx=0).ready entity=mgr.8117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:18.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.003+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7cc0157ee0 con 0x7f7cc00d0780 2023-07-09T21:59:18.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.175+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 --> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "/snap_test_dir1/test_restart", "repeat": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cc00cff80 con 0x7f7ca00663f0 2023-07-09T21:59:18.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.243+0000 7f7caeffd640 1 -- 172.21.15.37:0/1154404997 <== mgr.8117 v2:172.21.15.119:6832/2345325658 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+55 (secure 0 0 0) 0x7f7cb000c040 con 0x7f7ca00663f0 2023-07-09T21:59:18.249 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path /snap_test_dir1/test_restart 2023-07-09T21:59:18.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 msgr2=0x7f7ca00688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:18.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 0x7f7ca00688a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7cb0006fd0 tx=0x7f7cb0008040 comp rx=0 tx=0).stop 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 msgr2=0x7f7cc0152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80195e0 tx=0x7f7cb8019770 comp rx=0 tx=0).stop 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 shutdown_connections 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f7ca00663f0 0x7f7ca00688a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7cc00d0780 0x7f7cc0152e30 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7cc00ceb80 0x7f7cc0152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 --2- 172.21.15.37:0/1154404997 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7cc00b7980 0x7f7cc015e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 >> 172.21.15.37:0/1154404997 conn(0x7f7cc0073090 msgr2=0x7f7cc015c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 shutdown_connections 2023-07-09T21:59:18.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:18.247+0000 7f7cc4aec640 1 -- 172.21.15.37:0/1154404997 wait complete. 2023-07-09T21:59:18.269 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/test_restart 2023-07-09T21:59:18.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.270 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/test_restart/.snap) 2023-07-09T21:59:18.284 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_44_00_UTC 2023-07-09T21:59:18.285 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_45_00_UTC 2023-07-09T21:59:18.285 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_46_00_UTC 2023-07-09T21:59:18.285 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_47_00_UTC 2023-07-09T21:59:18.285 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_48_00_UTC 2023-07-09T21:59:18.285 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_49_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_50_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_51_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_52_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_53_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_54_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_55_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_56_00_UTC 2023-07-09T21:59:18.286 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_57_00_UTC 2023-07-09T21:59:18.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_58_00_UTC 2023-07-09T21:59:18.287 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-21_59_00_UTC 2023-07-09T21:59:18.288 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_44_00_UTC 2023-07-09T21:59:18.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.288 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_44_00_UTC) 2023-07-09T21:59:18.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_45_00_UTC 2023-07-09T21:59:18.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.347 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_45_00_UTC) 2023-07-09T21:59:18.405 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_46_00_UTC 2023-07-09T21:59:18.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.406 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_46_00_UTC) 2023-07-09T21:59:18.470 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_47_00_UTC 2023-07-09T21:59:18.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.471 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_47_00_UTC) 2023-07-09T21:59:18.530 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_48_00_UTC 2023-07-09T21:59:18.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_48_00_UTC) 2023-07-09T21:59:18.589 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_49_00_UTC 2023-07-09T21:59:18.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.590 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_49_00_UTC) 2023-07-09T21:59:18.650 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_50_00_UTC 2023-07-09T21:59:18.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.651 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_50_00_UTC) 2023-07-09T21:59:18.710 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_51_00_UTC 2023-07-09T21:59:18.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.711 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_51_00_UTC) 2023-07-09T21:59:18.770 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_52_00_UTC 2023-07-09T21:59:18.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_52_00_UTC) 2023-07-09T21:59:18.830 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_53_00_UTC 2023-07-09T21:59:18.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.831 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_53_00_UTC) 2023-07-09T21:59:18.895 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_54_00_UTC 2023-07-09T21:59:18.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.896 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_54_00_UTC) 2023-07-09T21:59:18.954 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_55_00_UTC 2023-07-09T21:59:18.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:18.955 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_55_00_UTC) 2023-07-09T21:59:19.013 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_56_00_UTC 2023-07-09T21:59:19.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:19.016 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_56_00_UTC) 2023-07-09T21:59:19.077 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_57_00_UTC 2023-07-09T21:59:19.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:19.078 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_57_00_UTC) 2023-07-09T21:59:19.138 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_58_00_UTC 2023-07-09T21:59:19.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:19.139 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_58_00_UTC) 2023-07-09T21:59:19.197 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_59_00_UTC 2023-07-09T21:59:19.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:19.198 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart/.snap/scheduled-2023-07-09-21_59_00_UTC) 2023-07-09T21:59:19.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:19.258 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/test_restart) 2023-07-09T21:59:19.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T21:59:19.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.495+0000 7f8ffe53a640 1 Processor -- start 2023-07-09T21:59:19.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.495+0000 7f8ffe53a640 1 -- start start 2023-07-09T21:59:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffe53a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ff80b7980 0x7f8ff8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffe53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ff80ceb80 0x7f8ff80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffe53a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff815bf80 con 0x7f8ff80b3c20 2023-07-09T21:59:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffe53a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff80cd070 con 0x7f8ff80ceb80 2023-07-09T21:59:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffe53a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff80cfd70 con 0x7f8ff80b7980 2023-07-09T21:59:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ff80ceb80 0x7f8ff80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8ff80ceb80 0x7f8ff80cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33992/0 (socket says 172.21.15.37:33992) 2023-07-09T21:59:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ffcad7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8ff80b3c20 0x7f8ff80b4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38208/0 (socket says 172.21.15.37:38208) 2023-07-09T21:59:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 -- 172.21.15.37:0/2466158728 learned_addr learned my addr 172.21.15.37:0/2466158728 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff7fff640 1 --2- 172.21.15.37:0/2466158728 >> v2:172.21.15.119:3300/0 conn(0x7f8ff80b7980 0x7f8ff8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 -- 172.21.15.37:0/2466158728 >> v2:172.21.15.119:3300/0 conn(0x7f8ff80b7980 msgr2=0x7f8ff8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 --2- 172.21.15.37:0/2466158728 >> v2:172.21.15.119:3300/0 conn(0x7f8ff80b7980 0x7f8ff8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 -- 172.21.15.37:0/2466158728 >> v1:172.21.15.37:6789/0 conn(0x7f8ff80b3c20 legacy=0x7f8ff80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff77fe640 1 -- 172.21.15.37:0/2466158728 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff8160570 con 0x7f8ff80ceb80 2023-07-09T21:59:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.499+0000 7f8ff6ffd640 1 -- 172.21.15.37:0/2466158728 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714706231 0 0) 0x7f8ff00014a0 con 0x7f8ff80b3c20 2023-07-09T21:59:19.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ff77fe640 1 --2- 172.21.15.37:0/2466158728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cefc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8069aa0 tx=0x7f8fec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c26f2e3f19a85c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ff6ffd640 1 -- 172.21.15.37:0/2466158728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0ab600 con 0x7f8ff80ceb80 2023-07-09T21:59:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ff6ffd640 1 -- 172.21.15.37:0/2466158728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0a7050 con 0x7f8ff80ceb80 2023-07-09T21:59:19.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ff6ffd640 1 -- 172.21.15.37:0/2466158728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0ab980 con 0x7f8ff80ceb80 2023-07-09T21:59:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- 172.21.15.37:0/2466158728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80ceb80 msgr2=0x7f8ff80cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/2466158728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cefc0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f8ff8069aa0 tx=0x7f8fec01c500 comp rx=0 tx=0).stop 2023-07-09T21:59:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- 172.21.15.37:0/2466158728 shutdown_connections 2023-07-09T21:59:19.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/2466158728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cefc0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/2466158728 >> v2:172.21.15.119:3300/0 conn(0x7f8ff80b7980 0x7f8ff8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- 172.21.15.37:0/2466158728 >> 172.21.15.37:0/2466158728 conn(0x7f8ff8073090 msgr2=0x7f8ff8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- 172.21.15.37:0/2466158728 shutdown_connections 2023-07-09T21:59:19.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- 172.21.15.37:0/2466158728 wait complete. 2023-07-09T21:59:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 Processor -- start 2023-07-09T21:59:19.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.503+0000 7f8ffe53a640 1 -- start start 2023-07-09T21:59:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ff80b3c20 0x7f8ff8141790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff8141cd0 con 0x7f8ff80b7980 2023-07-09T21:59:19.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80cab10 con 0x7f8ff80ceb80 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff80cadf0 con 0x7f8ff80b3c20 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34006/0 (socket says 172.21.15.37:34006) 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 -- 172.21.15.37:0/4172291806 learned_addr learned my addr 172.21.15.37:0/4172291806 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff7fff640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ff80b3c20 0x7f8ff8141790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffcad7640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 -- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ff80b3c20 msgr2=0x7f8ff8141790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ff80b3c20 0x7f8ff8141790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 -- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ff80ceb80 msgr2=0x7f8ff80cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 -- 172.21.15.37:0/4172291806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0094d0 con 0x7f8ff80b7980 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff77fe640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8fec019110 tx=0x7f8fec0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b3890 con 0x7f8ff80b7980 2023-07-09T21:59:19.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fec0b39f0 con 0x7f8ff80b7980 2023-07-09T21:59:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0b3da0 con 0x7f8ff80b7980 2023-07-09T21:59:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff80cb0d0 con 0x7f8ff80b7980 2023-07-09T21:59:19.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff80cb690 con 0x7f8ff80b7980 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.507+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff804d7d0 con 0x7f8ff80b7980 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.511+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 77) v1 ==== 85789+0+0 (secure 0 0 0) 0x7f8fec0b2070 con 0x7f8ff80b7980 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.511+0000 7f8ff4ff9640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 0x7f8fe40688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.511+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f8fec11e310 con 0x7f8ff80b7980 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.511+0000 7f8ff7fff640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 0x7f8fe40688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:19.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.511+0000 7f8ff7fff640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 0x7f8fe40688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007a60 tx=0x7f8fe8008040 comp rx=0 tx=0).ready entity=mgr.8117 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:19.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.515+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fec0eb340 con 0x7f8ff80b7980 2023-07-09T21:59:19.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.703+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f8ff8160570 con 0x7f8ff80b7980 2023-07-09T21:59:19.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.839+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f8fec0eb710 con 0x7f8ff80b7980 2023-07-09T21:59:19.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ff4ff9640 1 -- 172.21.15.37:0/4172291806 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v78) v1 ==== 93+0+0 (secure 0 0 0) 0x7f8fec106340 con 0x7f8ff80b7980 2023-07-09T21:59:19.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 msgr2=0x7f8fe40688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 0x7f8fe40688d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8007a60 tx=0x7f8fe8008040 comp rx=0 tx=0).stop 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 msgr2=0x7f8ff8153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f8fec019110 tx=0x7f8fec0192a0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 shutdown_connections 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f8fe4066420 0x7f8fe40688d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ff80ceb80 0x7f8ff80cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ff80b7980 0x7f8ff8153ac0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 --2- 172.21.15.37:0/4172291806 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ff80b3c20 0x7f8ff8141790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 >> 172.21.15.37:0/4172291806 conn(0x7f8ff8073090 msgr2=0x7f8ff80b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 shutdown_connections 2023-07-09T21:59:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:19.843+0000 7f8ffe53a640 1 -- 172.21.15.37:0/4172291806 wait complete. 2023-07-09T21:59:19.878 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:59:19.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:59:19.940 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:59:20.003 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:59:20.004 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:59:20.005 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:20.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:20.049 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:20.047+0000 7f547b524180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:59:20.083 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:20.082+0000 7fe8ac22c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:59:20.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.203+0000 7fd6e32cb640 1 Processor -- start 2023-07-09T21:59:20.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.203+0000 7fd6e32cb640 1 -- start start 2023-07-09T21:59:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e32cb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd6dc0b7ab0 0x7fd6dc06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e32cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e32cb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc0b49f0 con 0x7fd6dc0b4170 2023-07-09T21:59:20.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e32cb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b7e80 con 0x7fd6dc0cef80 2023-07-09T21:59:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e32cb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc0b4610 con 0x7fd6dc0b7ab0 2023-07-09T21:59:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34046/0 (socket says 172.21.15.37:34046) 2023-07-09T21:59:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 -- 172.21.15.37:0/558119503 learned_addr learned my addr 172.21.15.37:0/558119503 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e1067640 1 --2- 172.21.15.37:0/558119503 >> v2:172.21.15.119:3300/0 conn(0x7fd6dc0b7ab0 0x7fd6dc06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 -- 172.21.15.37:0/558119503 >> v2:172.21.15.119:3300/0 conn(0x7fd6dc0b7ab0 msgr2=0x7fd6dc06aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 --2- 172.21.15.37:0/558119503 >> v2:172.21.15.119:3300/0 conn(0x7fd6dc0b7ab0 0x7fd6dc06aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 -- 172.21.15.37:0/558119503 >> v1:172.21.15.119:6789/0 conn(0x7fd6dc0b4170 legacy=0x7fd6dc15f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 -- 172.21.15.37:0/558119503 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0cc8a0 con 0x7fd6dc0cef80 2023-07-09T21:59:20.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.207+0000 7fd6e0866640 1 --2- 172.21.15.37:0/558119503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc06b360 tx=0x7fd6cc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bb8bd6f4c61d34 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6d3fff640 1 -- 172.21.15.37:0/558119503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0aa430 con 0x7fd6dc0cef80 2023-07-09T21:59:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6d3fff640 1 -- 172.21.15.37:0/558119503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0aa590 con 0x7fd6dc0cef80 2023-07-09T21:59:20.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6d3fff640 1 -- 172.21.15.37:0/558119503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0aa920 con 0x7fd6dc0cef80 2023-07-09T21:59:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- 172.21.15.37:0/558119503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 msgr2=0x7fd6dc0b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/558119503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc06b360 tx=0x7fd6cc01c4d0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- 172.21.15.37:0/558119503 shutdown_connections 2023-07-09T21:59:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/558119503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0b3c30 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/558119503 >> v2:172.21.15.119:3300/0 conn(0x7fd6dc0b7ab0 0x7fd6dc06aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- 172.21.15.37:0/558119503 >> 172.21.15.37:0/558119503 conn(0x7fd6dc073090 msgr2=0x7fd6dc069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- 172.21.15.37:0/558119503 shutdown_connections 2023-07-09T21:59:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- 172.21.15.37:0/558119503 wait complete. 2023-07-09T21:59:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 Processor -- start 2023-07-09T21:59:20.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- start start 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6dc0b4170 0x7fd6dc152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0b7ab0 0x7fd6dc0c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0c9420 con 0x7fd6dc0cef80 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0cbb50 con 0x7fd6dc0b7ab0 2023-07-09T21:59:20.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.211+0000 7fd6e32cb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc152ad0 con 0x7fd6dc0b4170 2023-07-09T21:59:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1067640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6dc0b4170 0x7fd6dc152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34060/0 (socket says 172.21.15.37:34060) 2023-07-09T21:59:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 -- 172.21.15.37:0/3074102487 learned_addr learned my addr 172.21.15.37:0/3074102487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:20.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e0866640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0b7ab0 0x7fd6dc0c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6dc0b4170 msgr2=0x7fd6dc152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6dc0b4170 0x7fd6dc152590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0b7ab0 msgr2=0x7fd6dc0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0b7ab0 0x7fd6dc0c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 -- 172.21.15.37:0/3074102487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc0094d0 con 0x7fd6dc0cef80 2023-07-09T21:59:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e1868640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c730 tx=0x7fd6d400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4003b80 con 0x7fd6dc0cef80 2023-07-09T21:59:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d4003ce0 con 0x7fd6dc0cef80 2023-07-09T21:59:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc0cc080 con 0x7fd6dc0cef80 2023-07-09T21:59:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400aa30 con 0x7fd6dc0cef80 2023-07-09T21:59:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0cbda0 con 0x7fd6dc0cef80 2023-07-09T21:59:20.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc0c9560 con 0x7fd6dc0cef80 2023-07-09T21:59:20.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.215+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd6d400ab90 con 0x7fd6dc0cef80 2023-07-09T21:59:20.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.219+0000 7fd6d1ffb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 0x7fd6c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.219+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6866+0+0 (secure 0 0 0) 0x7fd6d4083ee0 con 0x7fd6dc0cef80 2023-07-09T21:59:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.219+0000 7fd6e1067640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 msgr2=0x7fd6c0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:20.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.219+0000 7fd6e1067640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 0x7fd6c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:20.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.223+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd6dc0c9560 con 0x7fd6dc0cef80 2023-07-09T21:59:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.423+0000 7fd6e1067640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 msgr2=0x7fd6c0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.423+0000 7fd6e1067640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 0x7fd6c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:59:20.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.435+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6dc0c9560 con 0x7fd6dc0cef80 2023-07-09T21:59:20.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6d1ffb640 1 -- 172.21.15.37:0/3074102487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+19518 (secure 0 0 0) 0x7fd6dc0c9560 con 0x7fd6dc0cef80 2023-07-09T21:59:20.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:20.443 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":161,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:19.838034+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":31,"snap_epoch":161,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/537425844":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/721897364":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/3239411330":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/710378599":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1690687053":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/973847261":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1819254875":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/606687528":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1846219921":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4040833825":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/2405349511":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6833/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2207599633":"2023-07-10T21:43:22.569363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":14},{"begin":18,"length":14}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":2,"length":14},{"begin":18,"length":14}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:20.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 msgr2=0x7fd6c0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 0x7fd6c0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 msgr2=0x7fd6dc0c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c730 tx=0x7fd6d400cbf0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 shutdown_connections 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd6c00663a0 0x7fd6c0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd6dc0cef80 0x7fd6dc0c6220 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd6dc0b7ab0 0x7fd6dc0c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 --2- 172.21.15.37:0/3074102487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd6dc0b4170 0x7fd6dc152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 >> 172.21.15.37:0/3074102487 conn(0x7fd6dc073090 msgr2=0x7fd6dc155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 shutdown_connections 2023-07-09T21:59:20.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.439+0000 7fd6e32cb640 1 -- 172.21.15.37:0/3074102487 wait complete. 2023-07-09T21:59:20.465 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:43:02.619457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:43:03.483836+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '161', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 31, 'snap_epoch': 161, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:59:20.466 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:59:20.534 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:20.534+0000 7fe8ac22c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:59:20.566 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:20.563+0000 7f547b524180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:59:20.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 Processor -- start 2023-07-09T21:59:20.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 -- start start 2023-07-09T21:59:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be80b7980 0x7f0be8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0be80ceb80 0x7f0be80cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be815bf80 con 0x7f0be80b3c20 2023-07-09T21:59:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be80cd070 con 0x7f0be80b7980 2023-07-09T21:59:20.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bef293640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be80cfd70 con 0x7f0be80ceb80 2023-07-09T21:59:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be80b7980 0x7f0be8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be80b7980 0x7f0be8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34070/0 (socket says 172.21.15.37:34070) 2023-07-09T21:59:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 -- 172.21.15.37:0/3768503098 learned_addr learned my addr 172.21.15.37:0/3768503098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:20.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bec82e640 1 --2- 172.21.15.37:0/3768503098 >> v2:172.21.15.119:3300/0 conn(0x7f0be80ceb80 0x7f0be80cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 -- 172.21.15.37:0/3768503098 >> v2:172.21.15.119:3300/0 conn(0x7f0be80ceb80 msgr2=0x7f0be80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:20.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 --2- 172.21.15.37:0/3768503098 >> v2:172.21.15.119:3300/0 conn(0x7f0be80ceb80 0x7f0be80cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 -- 172.21.15.37:0/3768503098 >> v1:172.21.15.119:6789/0 conn(0x7f0be80b3c20 legacy=0x7f0be80b4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.615+0000 7f0bed02f640 1 -- 172.21.15.37:0/3768503098 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be8160570 con 0x7f0be80b7980 2023-07-09T21:59:20.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bed02f640 1 --2- 172.21.15.37:0/3768503098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be8160030 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0be80b4cd0 tx=0x7f0be401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f8042425d15c94 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bdffff640 1 -- 172.21.15.37:0/3768503098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40ab600 con 0x7f0be80b7980 2023-07-09T21:59:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bdffff640 1 -- 172.21.15.37:0/3768503098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40a7050 con 0x7f0be80b7980 2023-07-09T21:59:20.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bdffff640 1 -- 172.21.15.37:0/3768503098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40ab980 con 0x7f0be80b7980 2023-07-09T21:59:20.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 -- 172.21.15.37:0/3768503098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 msgr2=0x7f0be8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 --2- 172.21.15.37:0/3768503098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be8160030 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f0be80b4cd0 tx=0x7f0be401c500 comp rx=0 tx=0).stop 2023-07-09T21:59:20.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 -- 172.21.15.37:0/3768503098 shutdown_connections 2023-07-09T21:59:20.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 --2- 172.21.15.37:0/3768503098 >> v2:172.21.15.119:3300/0 conn(0x7f0be80ceb80 0x7f0be80cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 --2- 172.21.15.37:0/3768503098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be8160030 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 -- 172.21.15.37:0/3768503098 >> 172.21.15.37:0/3768503098 conn(0x7f0be8073090 msgr2=0x7f0be8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 -- 172.21.15.37:0/3768503098 shutdown_connections 2023-07-09T21:59:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.619+0000 7f0bef293640 1 -- 172.21.15.37:0/3768503098 wait complete. 2023-07-09T21:59:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 Processor -- start 2023-07-09T21:59:20.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- start start 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 0x7f0be81f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80ceb80 0x7f0be80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80ca750 con 0x7f0be80b7980 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80ca1c0 con 0x7f0be80b3c20 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81f5740 con 0x7f0be80ceb80 2023-07-09T21:59:20.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bec82e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 0x7f0be81f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bec82e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34074/0 (socket says 172.21.15.37:34074) 2023-07-09T21:59:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bec82e640 1 -- 172.21.15.37:0/2723081468 learned_addr learned my addr 172.21.15.37:0/2723081468 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:20.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed830640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80ceb80 0x7f0be80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 -- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80ceb80 msgr2=0x7f0be80c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80ceb80 0x7f0be80c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 -- 172.21.15.37:0/2723081468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 msgr2=0x7f0be81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 -- 172.21.15.37:0/2723081468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40094d0 con 0x7f0be80b3c20 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bec82e640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bed02f640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 0x7f0be81f47e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0be40ab000 tx=0x7f0be40192a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40b8070 con 0x7f0be80b3c20 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40b35d0 con 0x7f0be80b3c20 2023-07-09T21:59:20.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40b3960 con 0x7f0be80b3c20 2023-07-09T21:59:20.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be81f4ea0 con 0x7f0be80b3c20 2023-07-09T21:59:20.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.623+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be81f5460 con 0x7f0be80b3c20 2023-07-09T21:59:20.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be804d7d0 con 0x7f0be80b3c20 2023-07-09T21:59:20.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f0be40b2070 con 0x7f0be80b3c20 2023-07-09T21:59:20.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bddffb640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 0x7f0bcc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f0be411d9e0 con 0x7f0be80b3c20 2023-07-09T21:59:20.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bec82e640 1 -- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 msgr2=0x7f0bcc068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:20.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.627+0000 7f0bec82e640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 0x7f0bcc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:20.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.631+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0be40ea9b0 con 0x7f0be80b3c20 2023-07-09T21:59:20.712 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:20.710+0000 7fe8ac22c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:59:20.741 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:20.739+0000 7f547b524180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:59:20.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.807+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0be8160570 con 0x7f0be80b3c20 2023-07-09T21:59:20.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.807+0000 7f0bddffb640 1 -- 172.21.15.37:0/2723081468 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0be8160570 con 0x7f0be80b3c20 2023-07-09T21:59:20.812 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:59:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 msgr2=0x7f0bcc068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 0x7f0bcc068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 msgr2=0x7f0be81f47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 0x7f0be81f47e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f0be40ab000 tx=0x7f0be40192a0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 shutdown_connections 2023-07-09T21:59:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f0bcc0663a0 0x7f0bcc068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80ceb80 0x7f0be80c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b7980 0x7f0be81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 --2- 172.21.15.37:0/2723081468 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b3c20 0x7f0be81f47e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 >> 172.21.15.37:0/2723081468 conn(0x7f0be8073090 msgr2=0x7f0be8154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 shutdown_connections 2023-07-09T21:59:20.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.811+0000 7f0bef293640 1 -- 172.21.15.37:0/2723081468 wait complete. 2023-07-09T21:59:20.834 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:59:20.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.979+0000 7fc579174640 1 Processor -- start 2023-07-09T21:59:20.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.979+0000 7fc579174640 1 -- start start 2023-07-09T21:59:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc579174640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5740cf290 0x7fc574160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc579174640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc5740d0780 0x7fc5740d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc579174640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57415bf80 con 0x7fc5740b7980 2023-07-09T21:59:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc579174640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740cd070 con 0x7fc5740cf290 2023-07-09T21:59:20.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc579174640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740cfd70 con 0x7fc5740d0780 2023-07-09T21:59:20.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc56bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc5740cf290 0x7fc574160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc572d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc5740b7980 0x7fc5740ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38224/0 (socket says 172.21.15.37:38224) 2023-07-09T21:59:20.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc572d9d640 1 -- 172.21.15.37:0/123215152 learned_addr learned my addr 172.21.15.37:0/123215152 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:20.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc57359e640 1 --2- 172.21.15.37:0/123215152 >> v2:172.21.15.119:3300/0 conn(0x7fc5740d0780 0x7fc5740d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc56bfff640 1 -- 172.21.15.37:0/123215152 >> v2:172.21.15.119:3300/0 conn(0x7fc5740d0780 msgr2=0x7fc5740d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc56bfff640 1 --2- 172.21.15.37:0/123215152 >> v2:172.21.15.119:3300/0 conn(0x7fc5740d0780 0x7fc5740d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc56bfff640 1 -- 172.21.15.37:0/123215152 >> v1:172.21.15.37:6789/0 conn(0x7fc5740b7980 legacy=0x7fc5740ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.983+0000 7fc56bfff640 1 -- 172.21.15.37:0/123215152 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574160570 con 0x7fc5740cf290 2023-07-09T21:59:20.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc56bfff640 1 --2- 172.21.15.37:0/123215152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740cf290 0x7fc574160030 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b1240 tx=0x7fc55c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9c18fd95e9340d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc57259c640 1 -- 172.21.15.37:0/123215152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0ab600 con 0x7fc5740cf290 2023-07-09T21:59:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc57259c640 1 -- 172.21.15.37:0/123215152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c0a7050 con 0x7fc5740cf290 2023-07-09T21:59:20.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc57259c640 1 -- 172.21.15.37:0/123215152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0ab980 con 0x7fc5740cf290 2023-07-09T21:59:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 -- 172.21.15.37:0/123215152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740cf290 msgr2=0x7fc574160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 --2- 172.21.15.37:0/123215152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740cf290 0x7fc574160030 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fc5740b1240 tx=0x7fc55c01c460 comp rx=0 tx=0).stop 2023-07-09T21:59:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 -- 172.21.15.37:0/123215152 shutdown_connections 2023-07-09T21:59:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 --2- 172.21.15.37:0/123215152 >> v2:172.21.15.119:3300/0 conn(0x7fc5740d0780 0x7fc5740d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 --2- 172.21.15.37:0/123215152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740cf290 0x7fc574160030 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 -- 172.21.15.37:0/123215152 >> 172.21.15.37:0/123215152 conn(0x7fc574073090 msgr2=0x7fc574069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 -- 172.21.15.37:0/123215152 shutdown_connections 2023-07-09T21:59:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 -- 172.21.15.37:0/123215152 wait complete. 2023-07-09T21:59:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.987+0000 7fc579174640 1 Processor -- start 2023-07-09T21:59:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- start start 2023-07-09T21:59:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5740cf290 0x7fc5740b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5740d0780 0x7fc5740b56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740b3e30 con 0x7fc5740b7980 2023-07-09T21:59:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc574156bd0 con 0x7fc5740d0780 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc574156000 con 0x7fc5740cf290 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34102/0 (socket says 172.21.15.37:34102) 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 -- 172.21.15.37:0/2298273024 learned_addr learned my addr 172.21.15.37:0/2298273024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc57359e640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5740d0780 0x7fc5740b56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc56bfff640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5740cf290 0x7fc5740b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 -- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5740cf290 msgr2=0x7fc5740b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5740cf290 0x7fc5740b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 -- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5740d0780 msgr2=0x7fc5740b56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5740d0780 0x7fc5740b56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 -- 172.21.15.37:0/2298273024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c009420 con 0x7fc5740b7980 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc572d9d640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c500 tx=0x7fc56400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc564005cf0 con 0x7fc5740b7980 2023-07-09T21:59:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc564005e50 con 0x7fc5740b7980 2023-07-09T21:59:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5741562a0 con 0x7fc5740b7980 2023-07-09T21:59:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5640072f0 con 0x7fc5740b7980 2023-07-09T21:59:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc574156630 con 0x7fc5740b7980 2023-07-09T21:59:20.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.991+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57404d7d0 con 0x7fc5740b7980 2023-07-09T21:59:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.995+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fc564007450 con 0x7fc5740b7980 2023-07-09T21:59:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.995+0000 7fc56b7fe640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 0x7fc554068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.995+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7fc564083540 con 0x7fc5740b7980 2023-07-09T21:59:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.995+0000 7fc56bfff640 1 -- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 msgr2=0x7fc554068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.995+0000 7fc56bfff640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 0x7fc554068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:20.999+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc564050620 con 0x7fc5740b7980 2023-07-09T21:59:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.155+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc57415bf60 con 0x7fc5740b7980 2023-07-09T21:59:21.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.155+0000 7fc56b7fe640 1 -- 172.21.15.37:0/2298273024 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v162) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc564053c40 con 0x7fc5740b7980 2023-07-09T21:59:21.161 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:59:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 msgr2=0x7fc554068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:21.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 0x7fc554068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 msgr2=0x7fc5740c5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc56400c500 tx=0x7fc56400c9c0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 shutdown_connections 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fc5540663a0 0x7fc554068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc5740d0780 0x7fc5740b56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc5740cf290 0x7fc5740b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 --2- 172.21.15.37:0/2298273024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5740b7980 0x7fc5740c5cb0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 >> 172.21.15.37:0/2298273024 conn(0x7fc574073090 msgr2=0x7fc5740d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 shutdown_connections 2023-07-09T21:59:21.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.159+0000 7fc579174640 1 -- 172.21.15.37:0/2298273024 wait complete. 2023-07-09T21:59:21.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:59:21.200 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.198+0000 7fe8ac22c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:21.260 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.258+0000 7fe8ac22c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:59:21.271 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.267+0000 7f547b524180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:21.315 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.314+0000 7fe8ac22c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:59:21.336 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.331+0000 7f547b524180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:59:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 Processor -- start 2023-07-09T21:59:21.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 -- start start 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ccc160030 0x7f9ccc0d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc15bf80 con 0x7f9ccc0b7980 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ccc0d02f0 con 0x7f9ccc0cf290 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd300b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ccc0cd070 con 0x7f9ccc160030 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ccc160030 0x7f9ccc0d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ccc160030 0x7f9ccc0d0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34110/0 (socket says 172.21.15.37:34110) 2023-07-09T21:59:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd0da7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ccc0b7980 0x7f9ccc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38240/0 (socket says 172.21.15.37:38240) 2023-07-09T21:59:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 -- 172.21.15.37:0/1888524301 learned_addr learned my addr 172.21.15.37:0/1888524301 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:21.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 -- 172.21.15.37:0/1888524301 >> v1:172.21.15.119:6789/0 conn(0x7f9ccc0cf290 legacy=0x7f9ccc0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 -- 172.21.15.37:0/1888524301 >> v1:172.21.15.37:6789/0 conn(0x7f9ccc0b7980 legacy=0x7f9ccc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.335+0000 7f9cd15a8640 1 -- 172.21.15.37:0/1888524301 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc0cc7f0 con 0x7f9ccc160030 2023-07-09T21:59:21.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd15a8640 1 --2- 172.21.15.37:0/1888524301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc160030 0x7f9ccc0d0e90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009e50 tx=0x7f9cc401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62c2bdf633b2739 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:21.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9ccb7fe640 1 -- 172.21.15.37:0/1888524301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40a56e0 con 0x7f9ccc160030 2023-07-09T21:59:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9ccb7fe640 1 -- 172.21.15.37:0/1888524301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40a5840 con 0x7f9ccc160030 2023-07-09T21:59:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9ccb7fe640 1 -- 172.21.15.37:0/1888524301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40a5bd0 con 0x7f9ccc160030 2023-07-09T21:59:21.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 -- 172.21.15.37:0/1888524301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc160030 msgr2=0x7f9ccc0d0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 --2- 172.21.15.37:0/1888524301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc160030 0x7f9ccc0d0e90 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4009e50 tx=0x7f9cc401ca10 comp rx=0 tx=0).stop 2023-07-09T21:59:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 -- 172.21.15.37:0/1888524301 shutdown_connections 2023-07-09T21:59:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 --2- 172.21.15.37:0/1888524301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc160030 0x7f9ccc0d0e90 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 -- 172.21.15.37:0/1888524301 >> 172.21.15.37:0/1888524301 conn(0x7f9ccc073090 msgr2=0x7f9ccc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:21.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 -- 172.21.15.37:0/1888524301 shutdown_connections 2023-07-09T21:59:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.339+0000 7f9cd300b640 1 -- 172.21.15.37:0/1888524301 wait complete. 2023-07-09T21:59:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 Processor -- start 2023-07-09T21:59:21.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- start start 2023-07-09T21:59:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ccc0cf290 0x7f9ccc0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ccc160030 0x7f9ccc151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc0c7320 con 0x7f9ccc0b7980 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc0c78e0 con 0x7f9ccc0cf290 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1529c0 con 0x7f9ccc160030 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34122/0 (socket says 172.21.15.37:34122) 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 -- 172.21.15.37:0/2951075665 learned_addr learned my addr 172.21.15.37:0/2951075665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:21.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd15a8640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ccc160030 0x7f9ccc151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9ccbfff640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ccc0cf290 0x7f9ccc0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 -- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ccc160030 msgr2=0x7f9ccc151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ccc160030 0x7f9ccc151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 -- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ccc0cf290 msgr2=0x7f9ccc0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ccc0cf290 0x7f9ccc0c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 -- 172.21.15.37:0/2951075665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4009b30 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd0da7640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c490 tx=0x7f9cc000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0007480 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc00075e0 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0004a10 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc152ca0 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.343+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc150580 con 0x7f9ccc0b7980 2023-07-09T21:59:21.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ccc0c7b50 con 0x7f9ccc0b7980 2023-07-09T21:59:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f9cc0004b70 con 0x7f9ccc0b7980 2023-07-09T21:59:21.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9cc97fa640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 0x7f9cb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f9cc0083220 con 0x7f9ccc0b7980 2023-07-09T21:59:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9ccbfff640 1 -- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 msgr2=0x7f9cb0068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:21.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.347+0000 7f9ccbfff640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 0x7f9cb0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:21.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.351+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9cc0050270 con 0x7f9ccc0b7980 2023-07-09T21:59:21.401 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.399+0000 7f547b524180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:59:21.406 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.406+0000 7fe8ac22c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:59:21.462 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.462+0000 7fe8ac22c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:59:21.492 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.487+0000 7f547b524180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:59:21.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.511+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ccc15d0e0 con 0x7f9ccc0b7980 2023-07-09T21:59:21.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cc97fa640 1 -- 172.21.15.37:0/2951075665 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v162) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cc0053890 con 0x7f9ccc0b7980 2023-07-09T21:59:21.517 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 msgr2=0x7f9cb0068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 0x7f9cb0068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 msgr2=0x7f9ccc152000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c490 tx=0x7f9cc000c950 comp rx=0 tx=0).stop 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 shutdown_connections 2023-07-09T21:59:21.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f9cb00663a0 0x7f9cb0068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ccc160030 0x7f9ccc151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ccc0cf290 0x7f9ccc0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 --2- 172.21.15.37:0/2951075665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ccc0b7980 0x7f9ccc152000 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 >> 172.21.15.37:0/2951075665 conn(0x7f9ccc073090 msgr2=0x7f9ccc1544f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 shutdown_connections 2023-07-09T21:59:21.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.515+0000 7f9cd300b640 1 -- 172.21.15.37:0/2951075665 wait complete. 2023-07-09T21:59:21.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:59:21.545 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.546+0000 7fe8ac22c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:59:21.554 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.551+0000 7f547b524180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:59:21.600 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.598+0000 7fe8ac22c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:59:21.644 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.639+0000 7f547b524180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:59:21.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 Processor -- start 2023-07-09T21:59:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 -- start start 2023-07-09T21:59:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2980cf290 0x7fe298160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29815bf80 con 0x7fe2980b7980 2023-07-09T21:59:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe298160570 con 0x7fe2980d0780 2023-07-09T21:59:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29ef8f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2980cd070 con 0x7fe2980cf290 2023-07-09T21:59:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe297fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe2980cf290 0x7fe298160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29cd2b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe2980b7980 0x7fe2980ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38254/0 (socket says 172.21.15.37:38254) 2023-07-09T21:59:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe29cd2b640 1 -- 172.21.15.37:0/3384378821 learned_addr learned my addr 172.21.15.37:0/3384378821 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe297fff640 1 -- 172.21.15.37:0/3384378821 >> v1:172.21.15.119:6789/0 conn(0x7fe2980d0780 legacy=0x7fe2980d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe297fff640 1 -- 172.21.15.37:0/3384378821 >> v1:172.21.15.37:6789/0 conn(0x7fe2980b7980 legacy=0x7fe2980ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe297fff640 1 -- 172.21.15.37:0/3384378821 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980d02f0 con 0x7fe2980cf290 2023-07-09T21:59:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.683+0000 7fe2977fe640 1 -- 172.21.15.37:0/3384378821 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232245487 0 0) 0x7fe28c001120 con 0x7fe2980b7980 2023-07-09T21:59:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe297fff640 1 --2- 172.21.15.37:0/3384378821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980cf290 0x7fe298160030 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fe2840097c0 tx=0x7fe28401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f592b05f8caba823 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe2977fe640 1 -- 172.21.15.37:0/3384378821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840ab600 con 0x7fe2980cf290 2023-07-09T21:59:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe2977fe640 1 -- 172.21.15.37:0/3384378821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2840a7050 con 0x7fe2980cf290 2023-07-09T21:59:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe2977fe640 1 -- 172.21.15.37:0/3384378821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2840ab980 con 0x7fe2980cf290 2023-07-09T21:59:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 -- 172.21.15.37:0/3384378821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980cf290 msgr2=0x7fe298160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/3384378821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980cf290 0x7fe298160030 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fe2840097c0 tx=0x7fe28401c480 comp rx=0 tx=0).stop 2023-07-09T21:59:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 -- 172.21.15.37:0/3384378821 shutdown_connections 2023-07-09T21:59:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/3384378821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980cf290 0x7fe298160030 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 -- 172.21.15.37:0/3384378821 >> 172.21.15.37:0/3384378821 conn(0x7fe298073090 msgr2=0x7fe298069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 -- 172.21.15.37:0/3384378821 shutdown_connections 2023-07-09T21:59:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.687+0000 7fe29ef8f640 1 -- 172.21.15.37:0/3384378821 wait complete. 2023-07-09T21:59:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 Processor -- start 2023-07-09T21:59:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- start start 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2980cf290 0x7fe2980b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2980d0780 0x7fe2980b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b46d0 con 0x7fe2980b7980 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980cb2c0 con 0x7fe2980d0780 2023-07-09T21:59:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980b3ac0 con 0x7fe2980cf290 2023-07-09T21:59:21.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34138/0 (socket says 172.21.15.37:34138) 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 -- 172.21.15.37:0/2587579764 learned_addr learned my addr 172.21.15.37:0/2587579764 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe297fff640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2980cf290 0x7fe2980b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29d52c640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2980d0780 0x7fe2980b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 -- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2980cf290 msgr2=0x7fe2980b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2980cf290 0x7fe2980b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 -- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2980d0780 msgr2=0x7fe2980b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2980d0780 0x7fe2980b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 -- 172.21.15.37:0/2587579764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe284009420 con 0x7fe2980b7980 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29cd2b640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c780 tx=0x7fe28c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0072d0 con 0x7fe2980b7980 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c007430 con 0x7fe2980b7980 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2980b3da0 con 0x7fe2980b7980 2023-07-09T21:59:21.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c001d20 con 0x7fe2980b7980 2023-07-09T21:59:21.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.691+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980b4360 con 0x7fe2980b7980 2023-07-09T21:59:21.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29804d7d0 con 0x7fe2980b7980 2023-07-09T21:59:21.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe28c0047f0 con 0x7fe2980b7980 2023-07-09T21:59:21.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe2957fa640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 0x7fe27c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:21.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7fe28c083650 con 0x7fe2980b7980 2023-07-09T21:59:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe297fff640 1 -- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 msgr2=0x7fe27c068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:21.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.695+0000 7fe297fff640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 0x7fe27c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:21.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.699+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe28c0506b0 con 0x7fe2980b7980 2023-07-09T21:59:21.707 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.703+0000 7f547b524180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:59:21.742 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.742+0000 7fe8ac22c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:59:21.799 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:21.798+0000 7fe8ac22c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:59:21.859 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.855+0000 7f547b524180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:59:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe29815bf60 con 0x7fe2980b7980 2023-07-09T21:59:21.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe2957fa640 1 -- 172.21.15.37:0/2587579764 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v162) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe28c0180a0 con 0x7fe2980b7980 2023-07-09T21:59:21.863 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:59:21.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 msgr2=0x7fe27c068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:21.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 0x7fe27c068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 msgr2=0x7fe2980cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c780 tx=0x7fe28c00cc40 comp rx=0 tx=0).stop 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 shutdown_connections 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe27c0663a0 0x7fe27c068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe2980d0780 0x7fe2980b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe2980cf290 0x7fe2980b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 --2- 172.21.15.37:0/2587579764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe2980b7980 0x7fe2980cad80 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 >> 172.21.15.37:0/2587579764 conn(0x7fe298073090 msgr2=0x7fe2980ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 shutdown_connections 2023-07-09T21:59:21.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:21.859+0000 7fe29ef8f640 1 -- 172.21.15.37:0/2587579764 wait complete. 2023-07-09T21:59:21.885 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T21:59:21.923 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:21.919+0000 7f547b524180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:59:22.039 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:59:22.039 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:59:22.040 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:59:22.049 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:22.046+0000 7fe8ac22c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:59:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.063+0000 7f18d7619640 1 Processor -- start 2023-07-09T21:59:22.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.063+0000 7f18d7619640 1 -- start start 2023-07-09T21:59:22.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d7619640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f18d00b7a60 0x7f18d00cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d7619640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18d00b47a0 0x7f18d00b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d7619640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d00cef80 con 0x7f18d00b4140 2023-07-09T21:59:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d7619640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d00b45e0 con 0x7f18d00b47a0 2023-07-09T21:59:22.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d7619640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d00cf260 con 0x7f18d00b7a60 2023-07-09T21:59:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18d00b47a0 0x7f18d00b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18d00b47a0 0x7f18d00b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34154/0 (socket says 172.21.15.37:34154) 2023-07-09T21:59:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 -- 172.21.15.37:0/3364189666 learned_addr learned my addr 172.21.15.37:0/3364189666 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d53b5640 1 --2- 172.21.15.37:0/3364189666 >> v2:172.21.15.119:3300/0 conn(0x7f18d00b7a60 0x7f18d00cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 -- 172.21.15.37:0/3364189666 >> v2:172.21.15.119:3300/0 conn(0x7f18d00b7a60 msgr2=0x7f18d00cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 --2- 172.21.15.37:0/3364189666 >> v2:172.21.15.119:3300/0 conn(0x7f18d00b7a60 0x7f18d00cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 -- 172.21.15.37:0/3364189666 >> v1:172.21.15.119:6789/0 conn(0x7f18d00b4140 legacy=0x7f18d015f590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-09T21:59:22.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.067+0000 7f18d4bb4640 1 -- 172.21.15.37:0/3364189666 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d00cf540 con 0x7f18d00b47a0 2023-07-09T21:59:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d4bb4640 1 --2- 172.21.15.37:0/3364189666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b47a0 0x7f18d00b3c00 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f18d00cde60 tx=0x7f18c801c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6928b098b822c9b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:22.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18c7fff640 1 -- 172.21.15.37:0/3364189666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c80a5740 con 0x7f18d00b47a0 2023-07-09T21:59:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18c7fff640 1 -- 172.21.15.37:0/3364189666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c80a58a0 con 0x7f18d00b47a0 2023-07-09T21:59:22.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 -- 172.21.15.37:0/3364189666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b47a0 msgr2=0x7f18d00b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 --2- 172.21.15.37:0/3364189666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b47a0 0x7f18d00b3c00 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f18d00cde60 tx=0x7f18c801c990 comp rx=0 tx=0).stop 2023-07-09T21:59:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 -- 172.21.15.37:0/3364189666 shutdown_connections 2023-07-09T21:59:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 --2- 172.21.15.37:0/3364189666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b47a0 0x7f18d00b3c00 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 --2- 172.21.15.37:0/3364189666 >> v2:172.21.15.119:3300/0 conn(0x7f18d00b7a60 0x7f18d00cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 -- 172.21.15.37:0/3364189666 >> 172.21.15.37:0/3364189666 conn(0x7f18d0073050 msgr2=0x7f18d0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 -- 172.21.15.37:0/3364189666 shutdown_connections 2023-07-09T21:59:22.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.075+0000 7f18d7619640 1 -- 172.21.15.37:0/3364189666 wait complete. 2023-07-09T21:59:22.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.079+0000 7f18d7619640 1 Processor -- start 2023-07-09T21:59:22.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.079+0000 7f18d7619640 1 -- start start 2023-07-09T21:59:22.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 0x7f18d015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18d01543a0 0x7f18d0150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d015d180 con 0x7f18d00b7a60 2023-07-09T21:59:22.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d0153f10 con 0x7f18d01543a0 2023-07-09T21:59:22.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d015e880 con 0x7f18d00b4140 2023-07-09T21:59:22.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:55750/0 (socket says 172.21.15.37:55750) 2023-07-09T21:59:22.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 -- 172.21.15.37:0/363035090 learned_addr learned my addr 172.21.15.37:0/363035090 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d5bb6640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18d01543a0 0x7f18d0150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d4bb4640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 0x7f18d015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 -- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18d01543a0 msgr2=0x7f18d0150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18d01543a0 0x7f18d0150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 -- 172.21.15.37:0/363035090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 msgr2=0x7f18d015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 0x7f18d015ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 -- 172.21.15.37:0/363035090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8009b30 con 0x7f18d00b4140 2023-07-09T21:59:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d4bb4640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 0x7f18d015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:22.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d53b5640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e8e0 tx=0x7f18cc00eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc00ca00 con 0x7f18d00b4140 2023-07-09T21:59:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d015eb60 con 0x7f18d00b4140 2023-07-09T21:59:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d015e550 con 0x7f18d00b4140 2023-07-09T21:59:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc00cb60 con 0x7f18d00b4140 2023-07-09T21:59:22.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.083+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc013470 con 0x7f18d00b4140 2023-07-09T21:59:22.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.087+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f18cc0135d0 con 0x7f18d00b4140 2023-07-09T21:59:22.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.091+0000 7f18c5ffb640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 0x7f18b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.091+0000 7f18d4bb4640 1 -- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 msgr2=0x7f18b4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.091+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f18cc0844c0 con 0x7f18d00b4140 2023-07-09T21:59:22.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.091+0000 7f18d4bb4640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 0x7f18b4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.091+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0005260 con 0x7f18d00b4140 2023-07-09T21:59:22.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.095+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18cc051510 con 0x7f18d00b4140 2023-07-09T21:59:22.176 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:59:22.177 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:59:22.177 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:59:22.182 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:22.182+0000 7fe8ac22c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:22.185 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:22.183+0000 7f547b524180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:59:22.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f18b0005510 con 0x7f18d00b4140 2023-07-09T21:59:22.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18c5ffb640 1 -- 172.21.15.37:0/363035090 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v162) v1 ==== 81+0+949 (secure 0 0 0) 0x7f18cc021020 con 0x7f18d00b4140 2023-07-09T21:59:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/444783310 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/537425844 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/721897364 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3239411330 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/710378599 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1690687053 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/973847261 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1819254875 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/606687528 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.296 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1846219921 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4040833825 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/444783310 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2405349511 2023-07-10T21:54:20.664411+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/3801372437 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/3801372437 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.297 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2207599633 2023-07-10T21:43:22.569363+0000 2023-07-09T21:59:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:listed 16 entries 2023-07-09T21:59:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 msgr2=0x7f18b4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 0x7f18b4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 msgr2=0x7f18d015c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f18cc00e8e0 tx=0x7f18cc00eda0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 shutdown_connections 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f18b40663a0 0x7f18b4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18d01543a0 0x7f18d0150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18d00b7a60 0x7f18d015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 --2- 172.21.15.37:0/363035090 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18d00b4140 0x7f18d015c410 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 >> 172.21.15.37:0/363035090 conn(0x7f18d0073050 msgr2=0x7f18d015f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 shutdown_connections 2023-07-09T21:59:22.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.291+0000 7f18d7619640 1 -- 172.21.15.37:0/363035090 wait complete. 2023-07-09T21:59:22.305 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:22.302+0000 7fe8ac22c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:22.316 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T21:59:22.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:22.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:22.331 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:22.327+0000 7f547b524180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:22.340 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[63108]: fuse finished with error 0 and tester_r 0 2023-07-09T21:59:22.343 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:59:22.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:22.344 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T21:59:22.375 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:22.374+0000 7fe8ac22c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:59:22.464 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:22.459+0000 7f547b524180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:22.507 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:22.506+0000 7fe8ac22c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:22.515 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:59:22.516 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:22.526 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:59:22.526 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:59:22.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:22.527 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T21:59:22.539 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:22.535+0000 7f547b524180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:59:22.577 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T21:59:22.578 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:59:22.579 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:59:22.579 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:22.589 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:59:22.589 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T21:59:22.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:22.590 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T21:59:22.641 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T21:59:22.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:59:22.643 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:59:22.643 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:22.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:59:22.653 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T21:59:22.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:22.654 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T21:59:22.680 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:22.675+0000 7f547b524180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:22.705 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T21:59:22.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T21:59:22.706 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:22.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.847+0000 7f095eacb640 1 Processor -- start 2023-07-09T21:59:22.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.847+0000 7f095eacb640 1 -- start start 2023-07-09T21:59:22.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f09580b7ab0 0x7f095806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580cef80 0x7f09580b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09580b4170 0x7f095815f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580b7e80 con 0x7f09580b4170 2023-07-09T21:59:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580b4610 con 0x7f09580b7ab0 2023-07-09T21:59:22.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095eacb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580b49f0 con 0x7f09580cef80 2023-07-09T21:59:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09580b4170 0x7f095815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f09580b4170 0x7f095815f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34178/0 (socket says 172.21.15.37:34178) 2023-07-09T21:59:22.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 -- 172.21.15.37:0/1904578387 learned_addr learned my addr 172.21.15.37:0/1904578387 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f0957fff640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580cef80 0x7f09580b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095c867640 1 --2- 172.21.15.37:0/1904578387 >> v2:172.21.15.119:3300/0 conn(0x7f09580b7ab0 0x7f095806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 -- 172.21.15.37:0/1904578387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580cef80 msgr2=0x7f09580b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580cef80 0x7f09580b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 -- 172.21.15.37:0/1904578387 >> v2:172.21.15.119:3300/0 conn(0x7f09580b7ab0 msgr2=0x7f095806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 --2- 172.21.15.37:0/1904578387 >> v2:172.21.15.119:3300/0 conn(0x7f09580b7ab0 0x7f095806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.851+0000 7f095d068640 1 -- 172.21.15.37:0/1904578387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580cc8a0 con 0x7f09580b4170 2023-07-09T21:59:22.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f095d068640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815f490 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f095806b360 tx=0x7f095001c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de4c742fe1919a63 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f09577fe640 1 -- 172.21.15.37:0/1904578387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500a5560 con 0x7f09580b4170 2023-07-09T21:59:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f09577fe640 1 -- 172.21.15.37:0/1904578387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09500a56c0 con 0x7f09580b4170 2023-07-09T21:59:22.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f09577fe640 1 -- 172.21.15.37:0/1904578387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500a5a50 con 0x7f09580b4170 2023-07-09T21:59:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f095eacb640 1 -- 172.21.15.37:0/1904578387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 msgr2=0x7f095815f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.855+0000 7f095eacb640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815f490 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f095806b360 tx=0x7f095001c6e0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- 172.21.15.37:0/1904578387 shutdown_connections 2023-07-09T21:59:22.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815f490 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- 172.21.15.37:0/1904578387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580cef80 0x7f09580b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- 172.21.15.37:0/1904578387 >> v2:172.21.15.119:3300/0 conn(0x7f09580b7ab0 0x7f095806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- 172.21.15.37:0/1904578387 >> 172.21.15.37:0/1904578387 conn(0x7f0958073090 msgr2=0x7f0958069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- 172.21.15.37:0/1904578387 shutdown_connections 2023-07-09T21:59:22.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- 172.21.15.37:0/1904578387 wait complete. 2023-07-09T21:59:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 Processor -- start 2023-07-09T21:59:22.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- start start 2023-07-09T21:59:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 0x7f0958156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09580cef80 0x7f095815a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958159490 con 0x7f09580b4170 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095815b1c0 con 0x7f09580cef80 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095eacb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09581596e0 con 0x7f09580b7ab0 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34188/0 (socket says 172.21.15.37:34188) 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 -- 172.21.15.37:0/2526207797 learned_addr learned my addr 172.21.15.37:0/2526207797 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095d068640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09580cef80 0x7f095815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f0957fff640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 0x7f0958156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 -- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 msgr2=0x7f0958156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 0x7f0958156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 -- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09580cef80 msgr2=0x7f095815a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:22.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09580cef80 0x7f095815a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f095c867640 1 -- 172.21.15.37:0/2526207797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009b30 con 0x7f09580b4170 2023-07-09T21:59:22.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.859+0000 7f0957fff640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 0x7f0958156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f095c867640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f094c00e930 tx=0x7f094c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c009690 con 0x7f09580b4170 2023-07-09T21:59:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c00ca00 con 0x7f09580b4170 2023-07-09T21:59:22.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c00cd70 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09581599c0 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958157210 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095804d7d0 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7f094c013470 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 0x7f093c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7f094c084400 con 0x7f09580b4170 2023-07-09T21:59:22.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f0957fff640 1 -- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 msgr2=0x7f093c068880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:22.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.863+0000 7f0957fff640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 0x7f093c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:22.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:22.867+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f094c051510 con 0x7f09580b4170 2023-07-09T21:59:23.044 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.042+0000 7fe8ac22c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:59:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09580c5a60 con 0x7f09580b4170 2023-07-09T21:59:23.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f09557fa640 1 -- 172.21.15.37:0/2526207797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f094c054b30 con 0x7f09580b4170 2023-07-09T21:59:23.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:23.063 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:59:23.063 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:59:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 msgr2=0x7f093c068880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 0x7f093c068880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 msgr2=0x7f095815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.059+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f094c00e930 tx=0x7f094c00edf0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 shutdown_connections 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7f093c0663d0 0x7f093c068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f09580cef80 0x7f095815a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f09580b7ab0 0x7f0958156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 --2- 172.21.15.37:0/2526207797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09580b4170 0x7f095815a1c0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 >> 172.21.15.37:0/2526207797 conn(0x7f0958073090 msgr2=0x7f09580b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 shutdown_connections 2023-07-09T21:59:23.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.063+0000 7f095eacb640 1 -- 172.21.15.37:0/2526207797 wait complete. 2023-07-09T21:59:23.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:23.127 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.126+0000 7fe8ac22c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:59:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.223+0000 7fd1c6770640 1 Processor -- start 2023-07-09T21:59:23.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c6770640 1 -- start start 2023-07-09T21:59:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c6770640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c015bbf0 0x7fd1c00d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c6770640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c00d1380 con 0x7fd1c006bc30 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c6770640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c00b13e0 con 0x7fd1c00cf100 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c6770640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c002bbe0 con 0x7fd1c015bbf0 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c015bbf0 0x7fd1c00d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd1c015bbf0 0x7fd1c00d1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34192/0 (socket says 172.21.15.37:34192) 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 -- 172.21.15.37:0/4164049694 learned_addr learned my addr 172.21.15.37:0/4164049694 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:23.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c4f6d640 1 --1- 172.21.15.37:0/4164049694 >> v1:172.21.15.37:6789/0 conn(0x7fd1c006bc30 0x7fd1c00ce9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38270/0 (socket says 172.21.15.37:38270) 2023-07-09T21:59:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 -- 172.21.15.37:0/4164049694 >> v1:172.21.15.119:6789/0 conn(0x7fd1c00cf100 legacy=0x7fd1c00cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 -- 172.21.15.37:0/4164049694 >> v1:172.21.15.37:6789/0 conn(0x7fd1c006bc30 legacy=0x7fd1c00ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.227+0000 7fd1c576e640 1 -- 172.21.15.37:0/4164049694 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00b1100 con 0x7fd1c015bbf0 2023-07-09T21:59:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c576e640 1 --2- 172.21.15.37:0/4164049694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c015bbf0 0x7fd1c00d1810 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ee356b3a60cce server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1b7fff640 1 -- 172.21.15.37:0/4164049694 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0a7070 con 0x7fd1c015bbf0 2023-07-09T21:59:23.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1b7fff640 1 -- 172.21.15.37:0/4164049694 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0ab430 con 0x7fd1c015bbf0 2023-07-09T21:59:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1b7fff640 1 -- 172.21.15.37:0/4164049694 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0ab7c0 con 0x7fd1c015bbf0 2023-07-09T21:59:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 -- 172.21.15.37:0/4164049694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c015bbf0 msgr2=0x7fd1c00d1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 --2- 172.21.15.37:0/4164049694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c015bbf0 0x7fd1c00d1810 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009870 tx=0x7fd1bc01c510 comp rx=0 tx=0).stop 2023-07-09T21:59:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 -- 172.21.15.37:0/4164049694 shutdown_connections 2023-07-09T21:59:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 --2- 172.21.15.37:0/4164049694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c015bbf0 0x7fd1c00d1810 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 -- 172.21.15.37:0/4164049694 >> 172.21.15.37:0/4164049694 conn(0x7fd1c002b640 msgr2=0x7fd1c00d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 -- 172.21.15.37:0/4164049694 shutdown_connections 2023-07-09T21:59:23.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.231+0000 7fd1c6770640 1 -- 172.21.15.37:0/4164049694 wait complete. 2023-07-09T21:59:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 Processor -- start 2023-07-09T21:59:23.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- start start 2023-07-09T21:59:23.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c00cf100 0x7fd1c00b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 0x7fd1c00c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00cbd40 con 0x7fd1c006bc30 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c014dec0 con 0x7fd1c00cf100 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00b4840 con 0x7fd1c015bbf0 2023-07-09T21:59:23.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34204/0 (socket says 172.21.15.37:34204) 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 -- 172.21.15.37:0/1992564250 learned_addr learned my addr 172.21.15.37:0/1992564250 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c5f6f640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 0x7fd1c00c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c4f6d640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c00cf100 0x7fd1c00b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 -- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 msgr2=0x7fd1c00c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 0x7fd1c00c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 -- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c00cf100 msgr2=0x7fd1c00b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c00cf100 0x7fd1c00b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 -- 172.21.15.37:0/1992564250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc0094d0 con 0x7fd1c006bc30 2023-07-09T21:59:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c5f6f640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 0x7fd1c00c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:23.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c576e640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0ad040 tx=0x7fd1bc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0b4800 con 0x7fd1c006bc30 2023-07-09T21:59:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0b4980 con 0x7fd1c006bc30 2023-07-09T21:59:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c00b2600 con 0x7fd1c006bc30 2023-07-09T21:59:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0b4d30 con 0x7fd1c006bc30 2023-07-09T21:59:23.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c00b2bc0 con 0x7fd1c006bc30 2023-07-09T21:59:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.235+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c015a1d0 con 0x7fd1c006bc30 2023-07-09T21:59:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.239+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fd1bc0b3380 con 0x7fd1c006bc30 2023-07-09T21:59:23.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.239+0000 7fd1b5ffb640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 0x7fd1a4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.239+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7fd1bc11e500 con 0x7fd1c006bc30 2023-07-09T21:59:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.239+0000 7fd1c4f6d640 1 -- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 msgr2=0x7fd1a4068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:23.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.239+0000 7fd1c4f6d640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 0x7fd1a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:23.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.243+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1bc0eb390 con 0x7fd1c006bc30 2023-07-09T21:59:23.262 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.259+0000 7f547b524180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:59:23.273 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.274+0000 7fe8ac22c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:59:23.352 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.347+0000 7f547b524180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:59:23.355 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.354+0000 7fe8ac22c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:59:23.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1c004e020 con 0x7fd1c006bc30 2023-07-09T21:59:23.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1b5ffb640 1 -- 172.21.15.37:0/1992564250 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+19517 (secure 0 0 0) 0x7fd1bc0ee9b0 con 0x7fd1c006bc30 2023-07-09T21:59:23.407 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:23.407 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":162,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:20.852185+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":32,"snap_epoch":162,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/537425844":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/721897364":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/3239411330":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/710378599":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1690687053":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/973847261":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1819254875":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/606687528":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1846219921":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4040833825":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/2405349511":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6833/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2207599633":"2023-07-10T21:43:22.569363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":15},{"begin":18,"length":15}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":16,"length":1},{"begin":32,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 msgr2=0x7fd1a4068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 0x7fd1a4068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 msgr2=0x7fd1c014d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0ad040 tx=0x7fd1bc01ad50 comp rx=0 tx=0).stop 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 shutdown_connections 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fd1a40663a0 0x7fd1a4068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd1c015bbf0 0x7fd1c00c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd1c00cf100 0x7fd1c00b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 --2- 172.21.15.37:0/1992564250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd1c006bc30 0x7fd1c014d980 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.403+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 >> 172.21.15.37:0/1992564250 conn(0x7fd1c002b640 msgr2=0x7fd1c0159ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.407+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 shutdown_connections 2023-07-09T21:59:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.407+0000 7fd1c6770640 1 -- 172.21.15.37:0/1992564250 wait complete. 2023-07-09T21:59:23.428 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:43:02.619457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:43:03.483836+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 32, 'snap_epoch': 162, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:59:23.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:59:23.510 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.507+0000 7f547b524180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:59:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.571+0000 7fe4d269e640 1 Processor -- start 2023-07-09T21:59:23.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.571+0000 7fe4d269e640 1 -- start start 2023-07-09T21:59:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d269e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe4cc0b7980 0x7fe4cc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d269e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe4cc0d0780 0x7fe4cc0d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d269e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc15bf80 con 0x7fe4cc0ceb80 2023-07-09T21:59:23.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d269e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0cd070 con 0x7fe4cc0d0780 2023-07-09T21:59:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d269e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc0cfd70 con 0x7fe4cc0b7980 2023-07-09T21:59:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4cb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe4cc0ceb80 0x7fe4cc0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38284/0 (socket says 172.21.15.37:38284) 2023-07-09T21:59:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4cb7fe640 1 -- 172.21.15.37:0/4162319486 learned_addr learned my addr 172.21.15.37:0/4162319486 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/4162319486 >> v2:172.21.15.37:3300/0 conn(0x7fe4cc0d0780 0x7fe4cc0d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4cbfff640 1 --2- 172.21.15.37:0/4162319486 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc0b7980 0x7fe4cc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/4162319486 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc0b7980 msgr2=0x7fe4cc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/4162319486 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc0b7980 0x7fe4cc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/4162319486 >> v1:172.21.15.37:6789/0 conn(0x7fe4cc0ceb80 legacy=0x7fe4cc0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4caffd640 1 -- 172.21.15.37:0/4162319486 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305184207 0 0) 0x7fe4c0001120 con 0x7fe4cc0ceb80 2023-07-09T21:59:23.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.575+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/4162319486 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc160570 con 0x7fe4cc0d0780 2023-07-09T21:59:23.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/4162319486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc0d0b80 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc069aa0 tx=0x7fe4c401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb1a3d25c3175d4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4caffd640 1 -- 172.21.15.37:0/4162319486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40a57d0 con 0x7fe4cc0d0780 2023-07-09T21:59:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4caffd640 1 -- 172.21.15.37:0/4162319486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c40a5930 con 0x7fe4cc0d0780 2023-07-09T21:59:23.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4caffd640 1 -- 172.21.15.37:0/4162319486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40a5cc0 con 0x7fe4cc0d0780 2023-07-09T21:59:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 -- 172.21.15.37:0/4162319486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 msgr2=0x7fe4cc0d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 --2- 172.21.15.37:0/4162319486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc0d0b80 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc069aa0 tx=0x7fe4c401c910 comp rx=0 tx=0).stop 2023-07-09T21:59:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 -- 172.21.15.37:0/4162319486 shutdown_connections 2023-07-09T21:59:23.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 --2- 172.21.15.37:0/4162319486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc0d0b80 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 --2- 172.21.15.37:0/4162319486 >> v2:172.21.15.119:3300/0 conn(0x7fe4cc0b7980 0x7fe4cc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 -- 172.21.15.37:0/4162319486 >> 172.21.15.37:0/4162319486 conn(0x7fe4cc073090 msgr2=0x7fe4cc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 -- 172.21.15.37:0/4162319486 shutdown_connections 2023-07-09T21:59:23.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.579+0000 7fe4d269e640 1 -- 172.21.15.37:0/4162319486 wait complete. 2023-07-09T21:59:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 Processor -- start 2023-07-09T21:59:23.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 -- start start 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc0b7980 0x7fe4cc149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc0ceb80 0x7fe4cc15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14fdb0 con 0x7fe4cc0d0780 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc14fab0 con 0x7fe4cc0b7980 2023-07-09T21:59:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d269e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc149e90 con 0x7fe4cc0ceb80 2023-07-09T21:59:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4cb7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc0ceb80 0x7fe4cc15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34210/0 (socket says 172.21.15.37:34210) 2023-07-09T21:59:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/66312435 learned_addr learned my addr 172.21.15.37:0/66312435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4cbfff640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc0b7980 0x7fe4cc149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc0ceb80 msgr2=0x7fe4cc15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc0ceb80 0x7fe4cc15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc0b7980 msgr2=0x7fe4cc149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc0b7980 0x7fe4cc149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.583+0000 7fe4d0c3b640 1 -- 172.21.15.37:0/66312435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c4009a70 con 0x7fe4cc0d0780 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4d0c3b640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe4c401c950 tx=0x7fe4c40196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40bd070 con 0x7fe4cc0d0780 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c40ad650 con 0x7fe4cc0d0780 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40ada00 con 0x7fe4cc0d0780 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc14f170 con 0x7fe4cc0d0780 2023-07-09T21:59:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc14f730 con 0x7fe4cc0d0780 2023-07-09T21:59:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc04d7d0 con 0x7fe4cc0d0780 2023-07-09T21:59:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 78) v1 ==== 85772+0+0 (secure 0 0 0) 0x7fe4c40b4070 con 0x7fe4cc0d0780 2023-07-09T21:59:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 0x7fe4b8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6866+0+0 (secure 0 0 0) 0x7fe4c411e4f0 con 0x7fe4cc0d0780 2023-07-09T21:59:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4cbfff640 1 -- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 msgr2=0x7fe4b8068850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2345325658 2023-07-09T21:59:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.587+0000 7fe4cbfff640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 0x7fe4b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:23.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.591+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4c40eb540 con 0x7fe4cc0d0780 2023-07-09T21:59:23.603 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.599+0000 7f547b524180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:59:23.623 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.622+0000 7fe8ac22c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:59:23.683 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.682+0000 7fe8ac22c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:59:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.695+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fe4c40eb910 con 0x7fe4cc0d0780 2023-07-09T21:59:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.695+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 msgr2=0x7fe4b8068850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:23.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.695+0000 7fe4c8ff9640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 0x7fe4b8068850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4cc160570 con 0x7fe4cc0d0780 2023-07-09T21:59:23.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4c8ff9640 1 -- 172.21.15.37:0/66312435 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v163) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4cc160570 con 0x7fe4cc0d0780 2023-07-09T21:59:23.767 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:59:23.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 msgr2=0x7fe4cc150240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe4c401c950 tx=0x7fe4c40196b0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 shutdown_connections 2023-07-09T21:59:23.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:6832/2345325658,v1:172.21.15.119:6833/2345325658] conn(0x7fe4b80663a0 0x7fe4b8068850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4cc0d0780 0x7fe4cc150240 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4cc0ceb80 0x7fe4cc15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 --2- 172.21.15.37:0/66312435 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4cc0b7980 0x7fe4cc149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.763+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 >> 172.21.15.37:0/66312435 conn(0x7fe4cc073090 msgr2=0x7fe4cc0d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.767+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 shutdown_connections 2023-07-09T21:59:23.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.767+0000 7fe4d269e640 1 -- 172.21.15.37:0/66312435 wait complete. 2023-07-09T21:59:23.771 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.766+0000 7fe837390640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.766+0000 7fe837390640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.766+0000 7fe837390640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.766+0000 7fe837390640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.766+0000 7fe837390640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.770+0000 7fe832b87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.770+0000 7fe832b87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.772 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.770+0000 7fe832b87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.773 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.770+0000 7fe832b87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.773 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:23.770+0000 7fe832b87640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:23.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:59:23.909 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.907+0000 7f547b524180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:59:23.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 Processor -- start 2023-07-09T21:59:23.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 -- start start 2023-07-09T21:59:23.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c15bf80 con 0x7f763c0b7980 2023-07-09T21:59:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c0cd070 con 0x7f763c0d0780 2023-07-09T21:59:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7640aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0cfd70 con 0x7f763c0cf290 2023-07-09T21:59:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f763ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:55776/0 (socket says 172.21.15.37:55776) 2023-07-09T21:59:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 -- 172.21.15.37:0/3673454981 learned_addr learned my addr 172.21.15.37:0/3673454981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f763a59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f763c0b7980 0x7f763c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:41896/0 (socket says 172.21.15.37:41896) 2023-07-09T21:59:23.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f763ad9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:52082/0 (socket says 172.21.15.37:52082) 2023-07-09T21:59:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 -- 172.21.15.37:0/3673454981 >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 msgr2=0x7f763c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 --2- 172.21.15.37:0/3673454981 >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 -- 172.21.15.37:0/3673454981 >> v1:172.21.15.119:6789/0 conn(0x7f763c0b7980 legacy=0x7f763c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f7639d9b640 1 -- 172.21.15.37:0/3673454981 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c160570 con 0x7f763c0cf290 2023-07-09T21:59:23.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.935+0000 7f763ad9d640 1 --2- 172.21.15.37:0/3673454981 >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7639d9b640 1 --2- 172.21.15.37:0/3673454981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7630009870 tx=0x7f763001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72cbbadf72261 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f763959a640 1 -- 172.21.15.37:0/3673454981 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300ab600 con 0x7f763c0cf290 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f763959a640 1 -- 172.21.15.37:0/3673454981 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76300a7050 con 0x7f763c0cf290 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f763959a640 1 -- 172.21.15.37:0/3673454981 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76300ab980 con 0x7f763c0cf290 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 -- 172.21.15.37:0/3673454981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 msgr2=0x7f763c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 --2- 172.21.15.37:0/3673454981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7630009870 tx=0x7f763001c540 comp rx=0 tx=0).stop 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 -- 172.21.15.37:0/3673454981 shutdown_connections 2023-07-09T21:59:23.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 --2- 172.21.15.37:0/3673454981 >> v2:172.21.15.119:3300/0 conn(0x7f763c0d0780 0x7f763c0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 --2- 172.21.15.37:0/3673454981 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0cf290 0x7f763c160030 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 -- 172.21.15.37:0/3673454981 >> 172.21.15.37:0/3673454981 conn(0x7f763c073090 msgr2=0x7f763c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 -- 172.21.15.37:0/3673454981 shutdown_connections 2023-07-09T21:59:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.939+0000 7f7640aec640 1 -- 172.21.15.37:0/3673454981 wait complete. 2023-07-09T21:59:23.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 Processor -- start 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- start start 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0cf290 0x7f763c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0d0780 0x7f763c152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c0b3060 con 0x7f763c0b7980 2023-07-09T21:59:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15a630 con 0x7f763c0cf290 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c15a910 con 0x7f763c0d0780 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34226/0 (socket says 172.21.15.37:34226) 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 -- 172.21.15.37:0/268227070 learned_addr learned my addr 172.21.15.37:0/268227070 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763ad9d640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0d0780 0x7f763c152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7639d9b640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0cf290 0x7f763c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 -- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0d0780 msgr2=0x7f763c152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0d0780 0x7f763c152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 -- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0cf290 msgr2=0x7f763c0b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0cf290 0x7f763c0b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 -- 172.21.15.37:0/268227070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634009a70 con 0x7f763c0b7980 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f763a59c640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c430 tx=0x7f762c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c0074e0 con 0x7f763c0b7980 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762c007640 con 0x7f763c0b7980 2023-07-09T21:59:23.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76300094d0 con 0x7f763c0b7980 2023-07-09T21:59:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762c004a10 con 0x7f763c0b7980 2023-07-09T21:59:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.943+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c15aed0 con 0x7f763c0b7980 2023-07-09T21:59:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.947+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763c04d7d0 con 0x7f763c0b7980 2023-07-09T21:59:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.947+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f762c004b70 con 0x7f763c0b7980 2023-07-09T21:59:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.947+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7166+0+0 (secure 0 0 0) 0x7f762c083320 con 0x7f763c0b7980 2023-07-09T21:59:23.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:23.951+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f762c0507a0 con 0x7f763c0b7980 2023-07-09T21:59:23.975 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:23.971+0000 7f547b524180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:59:24.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f763c15bf60 con 0x7f763c0b7980 2023-07-09T21:59:24.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f762affd640 1 -- 172.21.15.37:0/268227070 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v163) v1 ==== 92+0+10 (secure 0 0 0) 0x7f762c053dc0 con 0x7f763c0b7980 2023-07-09T21:59:24.110 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:59:24.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 msgr2=0x7f763c159fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c430 tx=0x7f762c00c830 comp rx=0 tx=0).stop 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 shutdown_connections 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f763c0d0780 0x7f763c152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f763c0cf290 0x7f763c0b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 --2- 172.21.15.37:0/268227070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f763c0b7980 0x7f763c159fe0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 >> 172.21.15.37:0/268227070 conn(0x7f763c073090 msgr2=0x7f763c15f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 shutdown_connections 2023-07-09T21:59:24.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.107+0000 7f7640aec640 1 -- 172.21.15.37:0/268227070 wait complete. 2023-07-09T21:59:24.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T21:59:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 Processor -- start 2023-07-09T21:59:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 -- start start 2023-07-09T21:59:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8f400b7a80 0x7f8f400b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f4015bf80 con 0x7f8f400cc330 2023-07-09T21:59:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f400cf2e0 con 0x7f8f400cffb0 2023-07-09T21:59:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f48634640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f400b7e50 con 0x7f8f400b7a80 2023-07-09T21:59:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f45bcf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8f400cc330 0x7f8f400b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38290/0 (socket says 172.21.15.37:38290) 2023-07-09T21:59:24.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f45bcf640 1 -- 172.21.15.37:0/3239952371 learned_addr learned my addr 172.21.15.37:0/3239952371 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f463d0640 1 --2- 172.21.15.37:0/3239952371 >> v2:172.21.15.119:3300/0 conn(0x7f8f400b7a80 0x7f8f400b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085338817 0 0) 0x7f8f30001120 con 0x7f8f400cc330 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c003530 con 0x7f8f400cc330 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4244242688 0 0) 0x7f8f2c003530 con 0x7f8f400cc330 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f463d0640 1 -- 172.21.15.37:0/3239952371 >> v1:172.21.15.119:6789/0 conn(0x7f8f400cffb0 legacy=0x7f8f400d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f463d0640 1 -- 172.21.15.37:0/3239952371 >> v1:172.21.15.37:6789/0 conn(0x7f8f400cc330 legacy=0x7f8f400b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.275+0000 7f8f463d0640 1 -- 172.21.15.37:0/3239952371 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400cf5c0 con 0x7f8f400b7a80 2023-07-09T21:59:24.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f463d0640 1 --2- 172.21.15.37:0/3239952371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400b7a80 0x7f8f400b3c20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097c0 tx=0x7f8f3c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d2c18bf1f6995d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f30001810 con 0x7f8f400b7a80 2023-07-09T21:59:24.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c0a7050 con 0x7f8f400b7a80 2023-07-09T21:59:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f453ce640 1 -- 172.21.15.37:0/3239952371 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c0ab620 con 0x7f8f400b7a80 2023-07-09T21:59:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 -- 172.21.15.37:0/3239952371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400b7a80 msgr2=0x7f8f400b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 --2- 172.21.15.37:0/3239952371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400b7a80 0x7f8f400b3c20 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097c0 tx=0x7f8f3c01c370 comp rx=0 tx=0).stop 2023-07-09T21:59:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 -- 172.21.15.37:0/3239952371 shutdown_connections 2023-07-09T21:59:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 --2- 172.21.15.37:0/3239952371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400b7a80 0x7f8f400b3c20 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 -- 172.21.15.37:0/3239952371 >> 172.21.15.37:0/3239952371 conn(0x7f8f40073090 msgr2=0x7f8f40069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 -- 172.21.15.37:0/3239952371 shutdown_connections 2023-07-09T21:59:24.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.279+0000 7f8f48634640 1 -- 172.21.15.37:0/3239952371 wait complete. 2023-07-09T21:59:24.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 Processor -- start 2023-07-09T21:59:24.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- start start 2023-07-09T21:59:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f400cc330 0x7f8f401504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400cffb0 0x7f8f400b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40159830 con 0x7f8f400b7a80 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400c6f40 con 0x7f8f400cffb0 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400c6330 con 0x7f8f400cc330 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34238/0 (socket says 172.21.15.37:34238) 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 -- 172.21.15.37:0/3977004421 learned_addr learned my addr 172.21.15.37:0/3977004421 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f45bcf640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f400cc330 0x7f8f401504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f46bd1640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400cffb0 0x7f8f400b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 -- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f400cc330 msgr2=0x7f8f401504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f400cc330 0x7f8f401504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 -- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400cffb0 msgr2=0x7f8f400b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400cffb0 0x7f8f400b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 -- 172.21.15.37:0/3977004421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3c009420 con 0x7f8f400b7a80 2023-07-09T21:59:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f463d0640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097c0 tx=0x7f8f3c01abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c004020 con 0x7f8f400b7a80 2023-07-09T21:59:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f3c004180 con 0x7f8f400b7a80 2023-07-09T21:59:24.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c003620 con 0x7f8f400b7a80 2023-07-09T21:59:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f400c6610 con 0x7f8f400b7a80 2023-07-09T21:59:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.283+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f400c6bd0 con 0x7f8f400b7a80 2023-07-09T21:59:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.287+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4004e020 con 0x7f8f400b7a80 2023-07-09T21:59:24.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.287+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8f3c003780 con 0x7f8f400b7a80 2023-07-09T21:59:24.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.287+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7166+0+0 (secure 0 0 0) 0x7f8f3c11d490 con 0x7f8f400b7a80 2023-07-09T21:59:24.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.291+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f3c0ea8d0 con 0x7f8f400b7a80 2023-07-09T21:59:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.443+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8f400b1600 con 0x7f8f400b7a80 2023-07-09T21:59:24.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f36ffd640 1 -- 172.21.15.37:0/3977004421 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v163) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8f3c0edef0 con 0x7f8f400b7a80 2023-07-09T21:59:24.449 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T21:59:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 msgr2=0x7f8f400c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c0097c0 tx=0x7f8f3c01abb0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 shutdown_connections 2023-07-09T21:59:24.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8f400cffb0 0x7f8f400b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8f400cc330 0x7f8f401504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 --2- 172.21.15.37:0/3977004421 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f400b7a80 0x7f8f400c73d0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 >> 172.21.15.37:0/3977004421 conn(0x7f8f40073090 msgr2=0x7f8f400b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 shutdown_connections 2023-07-09T21:59:24.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.447+0000 7f8f48634640 1 -- 172.21.15.37:0/3977004421 wait complete. 2023-07-09T21:59:24.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T21:59:24.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 Processor -- start 2023-07-09T21:59:24.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 -- start start 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f41bc0cf290 0x7f41bc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41bc15bf80 con 0x7f41bc0b7980 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41bc0cd070 con 0x7f41bc0cf290 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c2ddb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0cfd70 con 0x7f41bc0d0780 2023-07-09T21:59:24.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c0b77640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f41bc0b7980 0x7f41bc0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38304/0 (socket says 172.21.15.37:38304) 2023-07-09T21:59:24.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c0b77640 1 -- 172.21.15.37:0/948836099 learned_addr learned my addr 172.21.15.37:0/948836099 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bbfff640 1 --2- 172.21.15.37:0/948836099 >> v2:172.21.15.119:3300/0 conn(0x7f41bc0cf290 0x7f41bc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41c1378640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288332474 0 0) 0x7f41b0001120 con 0x7f41bc0b7980 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41ac003530 con 0x7f41bc0b7980 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bbfff640 1 -- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 msgr2=0x7f41bc0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1728850468 0 0) 0x7f41ac003530 con 0x7f41bc0b7980 2023-07-09T21:59:24.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bbfff640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bbfff640 1 -- 172.21.15.37:0/948836099 >> v1:172.21.15.37:6789/0 conn(0x7f41bc0b7980 legacy=0x7f41bc0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.615+0000 7f41bbfff640 1 -- 172.21.15.37:0/948836099 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc160570 con 0x7f41bc0cf290 2023-07-09T21:59:24.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41bbfff640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0cf290 0x7f41bc160030 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f41a80097c0 tx=0x7f41a801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c49f81a7f577ccbd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b0001810 con 0x7f41bc0cf290 2023-07-09T21:59:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a80a7050 con 0x7f41bc0cf290 2023-07-09T21:59:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41bb7fe640 1 -- 172.21.15.37:0/948836099 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a80ab620 con 0x7f41bc0cf290 2023-07-09T21:59:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 -- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0cf290 msgr2=0x7f41bc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0cf290 0x7f41bc160030 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f41a80097c0 tx=0x7f41a801c3a0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 -- 172.21.15.37:0/948836099 shutdown_connections 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/948836099 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0cf290 0x7f41bc160030 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 -- 172.21.15.37:0/948836099 >> 172.21.15.37:0/948836099 conn(0x7f41bc073090 msgr2=0x7f41bc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 -- 172.21.15.37:0/948836099 shutdown_connections 2023-07-09T21:59:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.619+0000 7f41c2ddb640 1 -- 172.21.15.37:0/948836099 wait complete. 2023-07-09T21:59:24.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 Processor -- start 2023-07-09T21:59:24.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- start start 2023-07-09T21:59:24.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0b7980 0x7f41bc0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc1524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b37f0 con 0x7f41bc0cf290 2023-07-09T21:59:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b4b10 con 0x7f41bc0b7980 2023-07-09T21:59:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41bc0b3a70 con 0x7f41bc0d0780 2023-07-09T21:59:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34246/0 (socket says 172.21.15.37:34246) 2023-07-09T21:59:24.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 -- 172.21.15.37:0/3062879395 learned_addr learned my addr 172.21.15.37:0/3062879395 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c0b77640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0b7980 0x7f41bc0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c1378640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc1524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 -- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 msgr2=0x7f41bc1524b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc1524b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 -- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0b7980 msgr2=0x7f41bc0b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0b7980 0x7f41bc0b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 -- 172.21.15.37:0/3062879395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a8009420 con 0x7f41bc0cf290 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c1378640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41bbfff640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa50 tx=0x7f41a8019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a80bb070 con 0x7f41bc0cf290 2023-07-09T21:59:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a80b4400 con 0x7f41bc0cf290 2023-07-09T21:59:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41bc0b3d50 con 0x7f41bc0cf290 2023-07-09T21:59:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a80b47b0 con 0x7f41bc0cf290 2023-07-09T21:59:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.623+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41bc0b4310 con 0x7f41bc0cf290 2023-07-09T21:59:24.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.627+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41bc04d7d0 con 0x7f41bc0cf290 2023-07-09T21:59:24.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.627+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 79) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f41a80b2040 con 0x7f41bc0cf290 2023-07-09T21:59:24.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.627+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 7166+0+0 (secure 0 0 0) 0x7f41a811ce10 con 0x7f41bc0cf290 2023-07-09T21:59:24.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.631+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f41a8120030 con 0x7f41bc0cf290 2023-07-09T21:59:24.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.707+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f41a80e9c50 con 0x7f41bc0cf290 2023-07-09T21:59:24.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.707+0000 7f41b97fa640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 0x7f41a006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.715+0000 7f41c0b77640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 0x7f41a006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.715+0000 7f41c0b77640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 0x7f41a006e7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41b0001ec0 tx=0x7f41b0009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.795+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41bc160570 con 0x7f41bc0cf290 2023-07-09T21:59:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.795+0000 7f41b97fa640 1 -- 172.21.15.37:0/3062879395 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v164) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41bc160570 con 0x7f41bc0cf290 2023-07-09T21:59:24.801 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T21:59:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 msgr2=0x7f41a006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 0x7f41a006e7c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f41b0001ec0 tx=0x7f41b0009040 comp rx=0 tx=0).stop 2023-07-09T21:59:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 msgr2=0x7f41bc1543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f41a801aa50 tx=0x7f41a8019140 comp rx=0 tx=0).stop 2023-07-09T21:59:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 shutdown_connections 2023-07-09T21:59:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f41a006c3e0 0x7f41a006e7c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f41bc0d0780 0x7f41bc1524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41bc0cf290 0x7f41bc1543b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 --2- 172.21.15.37:0/3062879395 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f41bc0b7980 0x7f41bc0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 >> 172.21.15.37:0/3062879395 conn(0x7f41bc073090 msgr2=0x7f41bc0b59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 shutdown_connections 2023-07-09T21:59:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.799+0000 7f41c2ddb640 1 -- 172.21.15.37:0/3062879395 wait complete. 2023-07-09T21:59:24.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:24.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 Processor -- start 2023-07-09T21:59:24.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 -- start start 2023-07-09T21:59:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b1806c330 0x7f5b180b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1815bdf0 con 0x7f5b180cd0d0 2023-07-09T21:59:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180b2720 con 0x7f5b1815ba20 2023-07-09T21:59:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1ecd8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b1806b650 con 0x7f5b1806c330 2023-07-09T21:59:24.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b1806c330 0x7f5b180b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5b1806c330 0x7f5b180b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34250/0 (socket says 172.21.15.37:34250) 2023-07-09T21:59:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 -- 172.21.15.37:0/262754969 learned_addr learned my addr 172.21.15.37:0/262754969 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b17fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5b180cd0d0 0x7f5b180b1a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38310/0 (socket says 172.21.15.37:38310) 2023-07-09T21:59:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 -- 172.21.15.37:0/262754969 >> v1:172.21.15.119:6789/0 conn(0x7f5b1815ba20 legacy=0x7f5b180cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:24.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 -- 172.21.15.37:0/262754969 >> v1:172.21.15.37:6789/0 conn(0x7f5b180cd0d0 legacy=0x7f5b180b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.971+0000 7f5b1d275640 1 -- 172.21.15.37:0/262754969 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1806b850 con 0x7f5b1806c330 2023-07-09T21:59:24.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1d275640 1 --2- 172.21.15.37:0/262754969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b180b2140 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009e50 tx=0x7f5b1001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d3860e9abe7e9a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b177fe640 1 -- 172.21.15.37:0/262754969 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100a57d0 con 0x7f5b1806c330 2023-07-09T21:59:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b177fe640 1 -- 172.21.15.37:0/262754969 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b100a5930 con 0x7f5b1806c330 2023-07-09T21:59:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b177fe640 1 -- 172.21.15.37:0/262754969 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b100a5cc0 con 0x7f5b1806c330 2023-07-09T21:59:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/262754969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 msgr2=0x7f5b180b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/262754969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b180b2140 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5b10009e50 tx=0x7f5b1001c910 comp rx=0 tx=0).stop 2023-07-09T21:59:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/262754969 shutdown_connections 2023-07-09T21:59:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/262754969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b180b2140 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/262754969 >> 172.21.15.37:0/262754969 conn(0x7f5b18072400 msgr2=0x7f5b18072800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/262754969 shutdown_connections 2023-07-09T21:59:24.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.975+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/262754969 wait complete. 2023-07-09T21:59:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 Processor -- start 2023-07-09T21:59:24.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- start start 2023-07-09T21:59:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b180cd0d0 0x7f5b1814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 0x7f5b180b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180b3eb0 con 0x7f5b1806c330 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1814bbe0 con 0x7f5b180cd0d0 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180b3610 con 0x7f5b1815ba20 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34256/0 (socket says 172.21.15.37:34256) 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 -- 172.21.15.37:0/2762982486 learned_addr learned my addr 172.21.15.37:0/2762982486 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b17fff640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b180cd0d0 0x7f5b1814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1d275640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 0x7f5b180b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 -- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 msgr2=0x7f5b180b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 0x7f5b180b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 -- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b180cd0d0 msgr2=0x7f5b1814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b180cd0d0 0x7f5b1814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 -- 172.21.15.37:0/2762982486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b10009b30 con 0x7f5b1806c330 2023-07-09T21:59:24.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1d275640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 0x7f5b180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ca74640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b3e0 tx=0x7f5b0c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011830 con 0x7f5b1806c330 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c0119b0 con 0x7f5b1806c330 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0c011d60 con 0x7f5b1806c330 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b180b38f0 con 0x7f5b1806c330 2023-07-09T21:59:24.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.979+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b181526c0 con 0x7f5b1806c330 2023-07-09T21:59:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18152500 con 0x7f5b1806c330 2023-07-09T21:59:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f5b0c01a400 con 0x7f5b1806c330 2023-07-09T21:59:24.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b157fa640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 0x7f5afc068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f5b0c084040 con 0x7f5b1806c330 2023-07-09T21:59:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b17fff640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 0x7f5afc068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:24.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.983+0000 7f5b17fff640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 0x7f5afc068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1814f3c0 tx=0x7f5b04007e50 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:24.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:24.987+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5b0c0b4700 con 0x7f5b1806c330 2023-07-09T21:59:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b1804d7d0 con 0x7f5b1806c330 2023-07-09T21:59:25.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b157fa640 1 -- 172.21.15.37:0/2762982486 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f5b0c015070 con 0x7f5b1806c330 2023-07-09T21:59:25.183 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:25.183 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:59:25.183 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:59:25.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 msgr2=0x7f5afc068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 0x7f5afc068580 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5b1814f3c0 tx=0x7f5b04007e50 comp rx=0 tx=0).stop 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 msgr2=0x7f5b1814e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c00b3e0 tx=0x7f5b0c00b8a0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 shutdown_connections 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f5afc0660d0 0x7f5afc068580 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5b1815ba20 0x7f5b180b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5b180cd0d0 0x7f5b1814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 --2- 172.21.15.37:0/2762982486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b1806c330 0x7f5b1814e2f0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.179+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 >> 172.21.15.37:0/2762982486 conn(0x7f5b18072400 msgr2=0x7f5b1815fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.183+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 shutdown_connections 2023-07-09T21:59:25.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.183+0000 7f5b1ecd8640 1 -- 172.21.15.37:0/2762982486 wait complete. 2023-07-09T21:59:25.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 Processor -- start 2023-07-09T21:59:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 -- start start 2023-07-09T21:59:25.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80b7ab0 0x7f0eb806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0eb80b4340 0x7f0eb80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb80b49f0 con 0x7f0eb80cef80 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb80b7e80 con 0x7f0eb80b4340 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebe27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80cc8a0 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0eb77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0eb80cef80 0x7f0eb80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38314/0 (socket says 172.21.15.37:38314) 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0eb77fe640 1 -- 172.21.15.37:0/1501639934 learned_addr learned my addr 172.21.15.37:0/1501639934 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:25.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebc818640 1 --2- 172.21.15.37:0/1501639934 >> v2:172.21.15.37:3300/0 conn(0x7f0eb80b4340 0x7f0eb80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80b7ab0 0x7f0eb806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebc818640 1 -- 172.21.15.37:0/1501639934 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80b7ab0 msgr2=0x7f0eb806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:25.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebc818640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80b7ab0 0x7f0eb806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebc818640 1 -- 172.21.15.37:0/1501639934 >> v1:172.21.15.37:6789/0 conn(0x7f0eb80cef80 legacy=0x7f0eb80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0ebc818640 1 -- 172.21.15.37:0/1501639934 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80ccb80 con 0x7f0eb80b4340 2023-07-09T21:59:25.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.343+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/1501639934 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604259850 0 0) 0x7f0eb80b49f0 con 0x7f0eb80cef80 2023-07-09T21:59:25.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebc818640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b4340 0x7f0eb80d02a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009d90 tx=0x7f0eb001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcbe41eaeabe2451 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/1501639934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00a59e0 con 0x7f0eb80b4340 2023-07-09T21:59:25.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/1501639934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb00a5b40 con 0x7f0eb80b4340 2023-07-09T21:59:25.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0eb6ffd640 1 -- 172.21.15.37:0/1501639934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb00ad440 con 0x7f0eb80b4340 2023-07-09T21:59:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 -- 172.21.15.37:0/1501639934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b4340 msgr2=0x7f0eb80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b4340 0x7f0eb80d02a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f0eb0009d90 tx=0x7f0eb001c920 comp rx=0 tx=0).stop 2023-07-09T21:59:25.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 -- 172.21.15.37:0/1501639934 shutdown_connections 2023-07-09T21:59:25.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b4340 0x7f0eb80d02a0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/1501639934 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80b7ab0 0x7f0eb806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 -- 172.21.15.37:0/1501639934 >> 172.21.15.37:0/1501639934 conn(0x7f0eb8073090 msgr2=0x7f0eb8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:25.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 -- 172.21.15.37:0/1501639934 shutdown_connections 2023-07-09T21:59:25.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.347+0000 7f0ebe27b640 1 -- 172.21.15.37:0/1501639934 wait complete. 2023-07-09T21:59:25.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 Processor -- start 2023-07-09T21:59:25.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- start start 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eb80b4340 0x7f0eb8147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80cef80 0x7f0eb80c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c7590 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb8157550 con 0x7f0eb80b4340 2023-07-09T21:59:25.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb80c7e10 con 0x7f0eb80cef80 2023-07-09T21:59:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34272/0 (socket says 172.21.15.37:34272) 2023-07-09T21:59:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 -- 172.21.15.37:0/4074420192 learned_addr learned my addr 172.21.15.37:0/4074420192 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebc818640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80cef80 0x7f0eb80c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eb80b4340 0x7f0eb8147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 -- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80cef80 msgr2=0x7f0eb80c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80cef80 0x7f0eb80c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 -- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eb80b4340 msgr2=0x7f0eb8147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eb80b4340 0x7f0eb8147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 -- 172.21.15.37:0/4074420192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0009a70 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb77fe640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c4b0 tx=0x7f0eac00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0074e0 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac007660 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac004a30 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb8157270 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.351+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb80c7aa0 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb815f220 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0eac004b90 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0eb4ff9640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 0x7f0ea4068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f0eac082f90 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 0x7f0ea4068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.355+0000 7f0eb7fff640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 0x7f0ea4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009b60 tx=0x7f0ea8009190 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.359+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0eac0502c0 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.515+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0eb804d7d0 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.515+0000 7f0eb4ff9640 1 -- 172.21.15.37:0/4074420192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+20001 (secure 0 0 0) 0x7f0eac018020 con 0x7f0eb80b7ab0 2023-07-09T21:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":164,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:24.690316+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2840945067":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6833/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6832/2345325658":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/537425844":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/721897364":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1351330877":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/3239411330":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/710378599":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1690687053":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/973847261":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1819254875":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2212167637":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6833/2345325658":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/606687528":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4204405331":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/1846219921":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4040833825":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/2405349511":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6833/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2225335498":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6832/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/477849756":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/2207599633":"2023-07-10T21:43:22.569363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:25.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 msgr2=0x7f0ea4068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 0x7f0ea4068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009b60 tx=0x7f0ea8009190 comp rx=0 tx=0).stop 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 msgr2=0x7f0eb80c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00c4b0 tx=0x7f0eac00c970 comp rx=0 tx=0).stop 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 shutdown_connections 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0ea40660d0 0x7f0ea4068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0eb80cef80 0x7f0eb80c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eb80b7ab0 0x7f0eb80c5ce0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 --2- 172.21.15.37:0/4074420192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0eb80b4340 0x7f0eb8147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 >> 172.21.15.37:0/4074420192 conn(0x7f0eb8073090 msgr2=0x7f0eb80b6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:25.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 shutdown_connections 2023-07-09T21:59:25.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.519+0000 7f0ebe27b640 1 -- 172.21.15.37:0/4074420192 wait complete. 2023-07-09T21:59:25.542 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T21:59:25.543 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 Processor -- start 2023-07-09T21:59:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 -- start start 2023-07-09T21:59:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde280b7ab0 0x7fde2806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde280cef80 0x7fde280b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde2815f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280b7e80 con 0x7fde280b7ab0 2023-07-09T21:59:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde280b4610 con 0x7fde280cef80 2023-07-09T21:59:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2eb1f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280b49f0 con 0x7fde280b4170 2023-07-09T21:59:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde280b7ab0 0x7fde2806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde280b7ab0 0x7fde2806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34286/0 (socket says 172.21.15.37:34286) 2023-07-09T21:59:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2d0bc640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde2815f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde27fff640 1 --2- 172.21.15.37:0/1539491439 >> v2:172.21.15.119:3300/0 conn(0x7fde280cef80 0x7fde280b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 -- 172.21.15.37:0/1539491439 learned_addr learned my addr 172.21.15.37:0/1539491439 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 -- 172.21.15.37:0/1539491439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 msgr2=0x7fde2815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:25.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/1539491439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde2815f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 -- 172.21.15.37:0/1539491439 >> v2:172.21.15.119:3300/0 conn(0x7fde280cef80 msgr2=0x7fde280b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/1539491439 >> v2:172.21.15.119:3300/0 conn(0x7fde280cef80 0x7fde280b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.683+0000 7fde2c8bb640 1 -- 172.21.15.37:0/1539491439 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280cc8a0 con 0x7fde280b7ab0 2023-07-09T21:59:25.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/1539491439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2806aa50 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fde280b4d10 tx=0x7fde1c01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e9d35e84c3d46b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde277fe640 1 -- 172.21.15.37:0/1539491439 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ab600 con 0x7fde280b7ab0 2023-07-09T21:59:25.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde277fe640 1 -- 172.21.15.37:0/1539491439 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c0a7050 con 0x7fde280b7ab0 2023-07-09T21:59:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde277fe640 1 -- 172.21.15.37:0/1539491439 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0ab980 con 0x7fde280b7ab0 2023-07-09T21:59:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 -- 172.21.15.37:0/1539491439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 msgr2=0x7fde2806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/1539491439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2806aa50 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fde280b4d10 tx=0x7fde1c01c210 comp rx=0 tx=0).stop 2023-07-09T21:59:25.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 -- 172.21.15.37:0/1539491439 shutdown_connections 2023-07-09T21:59:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/1539491439 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde2815f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/1539491439 >> v2:172.21.15.119:3300/0 conn(0x7fde280cef80 0x7fde280b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/1539491439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2806aa50 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 -- 172.21.15.37:0/1539491439 >> 172.21.15.37:0/1539491439 conn(0x7fde28073090 msgr2=0x7fde28069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 -- 172.21.15.37:0/1539491439 shutdown_connections 2023-07-09T21:59:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.687+0000 7fde2eb1f640 1 -- 172.21.15.37:0/1539491439 wait complete. 2023-07-09T21:59:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 Processor -- start 2023-07-09T21:59:25.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- start start 2023-07-09T21:59:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde280cef80 0x7fde2814ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2814f130 con 0x7fde280b7ab0 2023-07-09T21:59:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde280b1ea0 con 0x7fde280cef80 2023-07-09T21:59:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde280b2740 con 0x7fde280b4170 2023-07-09T21:59:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2c8bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2c8bb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:55856/0 (socket says 172.21.15.37:55856) 2023-07-09T21:59:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2c8bb640 1 -- 172.21.15.37:0/581709730 learned_addr learned my addr 172.21.15.37:0/581709730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2d0bc640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde280cef80 0x7fde2814ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 -- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 msgr2=0x7fde280c6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 -- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde280cef80 msgr2=0x7fde2814ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde280cef80 0x7fde2814ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 -- 172.21.15.37:0/581709730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0094d0 con 0x7fde280b7ab0 2023-07-09T21:59:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde27fff640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2814f640 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e870 tx=0x7fde1400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400ee60 con 0x7fde280b7ab0 2023-07-09T21:59:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1400c940 con 0x7fde280b7ab0 2023-07-09T21:59:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400ccd0 con 0x7fde280b7ab0 2023-07-09T21:59:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde2814f360 con 0x7fde280b7ab0 2023-07-09T21:59:25.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.691+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde280b23d0 con 0x7fde280b7ab0 2023-07-09T21:59:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde280b0f40 con 0x7fde280b7ab0 2023-07-09T21:59:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fde14013470 con 0x7fde280b7ab0 2023-07-09T21:59:25.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde257fa640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 0x7fde0c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7fde14083d60 con 0x7fde280b7ab0 2023-07-09T21:59:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 0x7fde0c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.695+0000 7fde2c8bb640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 0x7fde0c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01c250 tx=0x7fde1c0a6000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:25.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.699+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde14051090 con 0x7fde280b7ab0 2023-07-09T21:59:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.891+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde280b28d0 con 0x7fde280b7ab0 2023-07-09T21:59:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.891+0000 7fde257fa640 1 -- 172.21.15.37:0/581709730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7fde140546b0 con 0x7fde280b7ab0 2023-07-09T21:59:25.897 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:25.897 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:59:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:59:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 msgr2=0x7fde0c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 0x7fde0c068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fde1c01c250 tx=0x7fde1c0a6000 comp rx=0 tx=0).stop 2023-07-09T21:59:25.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 msgr2=0x7fde2814f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:25.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2814f640 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fde1400e870 tx=0x7fde1400ed30 comp rx=0 tx=0).stop 2023-07-09T21:59:25.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 shutdown_connections 2023-07-09T21:59:25.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fde0c0660d0 0x7fde0c068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde280cef80 0x7fde2814ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde280b7ab0 0x7fde2814f640 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 --2- 172.21.15.37:0/581709730 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde280b4170 0x7fde280c6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 >> 172.21.15.37:0/581709730 conn(0x7fde28073090 msgr2=0x7fde280b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:25.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 shutdown_connections 2023-07-09T21:59:25.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:25.895+0000 7fde2eb1f640 1 -- 172.21.15.37:0/581709730 wait complete. 2023-07-09T21:59:25.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:26.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 Processor -- start 2023-07-09T21:59:26.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 -- start start 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e2c0b4340 0x7f7e2c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 0x7f7e2c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b49f0 con 0x7f7e2c0b7ab0 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b7e80 con 0x7f7e2c0b4340 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e30ad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0cc8a0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e2c0b4340 0x7f7e2c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e2a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e2c0b7ab0 0x7f7e2c0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38322/0 (socket says 172.21.15.37:38322) 2023-07-09T21:59:26.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e2c0b4340 0x7f7e2c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34292/0 (socket says 172.21.15.37:34292) 2023-07-09T21:59:26.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e2a59c640 1 -- 172.21.15.37:0/1257310911 learned_addr learned my addr 172.21.15.37:0/1257310911 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:26.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e2ad9d640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 0x7f7e2c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 -- 172.21.15.37:0/1257310911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 msgr2=0x7f7e2c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 0x7f7e2c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 -- 172.21.15.37:0/1257310911 >> v1:172.21.15.37:6789/0 conn(0x7f7e2c0b7ab0 legacy=0x7f7e2c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e29d9b640 1 -- 172.21.15.37:0/1257310911 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0ccb80 con 0x7f7e2c0b4340 2023-07-09T21:59:26.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.059+0000 7f7e2ad9d640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 0x7f7e2c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e29d9b640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c06aa50 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097c0 tx=0x7f7e2001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=193f4d0cb0ba484f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e2959a640 1 -- 172.21.15.37:0/1257310911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200ab650 con 0x7f7e2c0b4340 2023-07-09T21:59:26.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e2959a640 1 -- 172.21.15.37:0/1257310911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e200ab7b0 con 0x7f7e2c0b4340 2023-07-09T21:59:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e2959a640 1 -- 172.21.15.37:0/1257310911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e200abb40 con 0x7f7e2c0b4340 2023-07-09T21:59:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 -- 172.21.15.37:0/1257310911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0b4340 msgr2=0x7f7e2c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c06aa50 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f7e200097c0 tx=0x7f7e2001c450 comp rx=0 tx=0).stop 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 -- 172.21.15.37:0/1257310911 shutdown_connections 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0cef80 0x7f7e2c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/1257310911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c06aa50 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 -- 172.21.15.37:0/1257310911 >> 172.21.15.37:0/1257310911 conn(0x7f7e2c073090 msgr2=0x7f7e2c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 -- 172.21.15.37:0/1257310911 shutdown_connections 2023-07-09T21:59:26.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.063+0000 7f7e30ad8640 1 -- 172.21.15.37:0/1257310911 wait complete. 2023-07-09T21:59:26.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 Processor -- start 2023-07-09T21:59:26.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 -- start start 2023-07-09T21:59:26.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0b7ab0 0x7f7e2c15d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c9590 con 0x7f7e2c0cef80 2023-07-09T21:59:26.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0c9280 con 0x7f7e2c0b4340 2023-07-09T21:59:26.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c15d990 con 0x7f7e2c0b7ab0 2023-07-09T21:59:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34302/0 (socket says 172.21.15.37:34302) 2023-07-09T21:59:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 -- 172.21.15.37:0/3589316875 learned_addr learned my addr 172.21.15.37:0/3589316875 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e29d9b640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0b7ab0 0x7f7e2c15d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2a59c640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 -- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0b7ab0 msgr2=0x7f7e2c15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0b7ab0 0x7f7e2c15d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 -- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e2c0b4340 msgr2=0x7f7e2c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 -- 172.21.15.37:0/3589316875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e20009420 con 0x7f7e2c0cef80 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e2ad9d640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400cd80 tx=0x7f7e2400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400f680 con 0x7f7e2c0cef80 2023-07-09T21:59:26.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400f800 con 0x7f7e2c0cef80 2023-07-09T21:59:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c15dc00 con 0x7f7e2c0cef80 2023-07-09T21:59:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.067+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400fbb0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c15e1c0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c15e3b0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f7e2400b040 con 0x7f7e2c0cef80 2023-07-09T21:59:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e1affd640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 0x7f7e0c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f7e240846b0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e2a59c640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 0x7f7e0c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.071+0000 7f7e2a59c640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 0x7f7e0c068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c005890 tx=0x7f7e1c009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.075+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e240519e0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.259+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e2c04d7d0 con 0x7f7e2c0cef80 2023-07-09T21:59:26.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e1affd640 1 -- 172.21.15.37:0/3589316875 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4679 (secure 0 0 0) 0x7f7e24055000 con 0x7f7e2c0cef80 2023-07-09T21:59:26.265 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:26.266 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":69,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:43:04.492463+0000","modified":"2023-07-09T21:43:08.146394+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9534},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9534":{"gid":9534,"name":"a","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6834/2578510480","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2578510480},{"type":"v1","addr":"172.21.15.37:6834","nonce":2578510480}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-07-09T21:59:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 69 2023-07-09T21:59:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 msgr2=0x7f7e0c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 0x7f7e0c068580 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c005890 tx=0x7f7e1c009040 comp rx=0 tx=0).stop 2023-07-09T21:59:26.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 msgr2=0x7f7e2c1577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400cd80 tx=0x7f7e2400a650 comp rx=0 tx=0).stop 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 shutdown_connections 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7e0c0660d0 0x7f7e0c068580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e2c0cef80 0x7f7e2c1577e0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e2c0b7ab0 0x7f7e2c15d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 --2- 172.21.15.37:0/3589316875 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e2c0b4340 0x7f7e2c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 >> 172.21.15.37:0/3589316875 conn(0x7f7e2c073090 msgr2=0x7f7e2c0b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 shutdown_connections 2023-07-09T21:59:26.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.263+0000 7f7e30ad8640 1 -- 172.21.15.37:0/3589316875 wait complete. 2023-07-09T21:59:26.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 Processor -- start 2023-07-09T21:59:26.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 -- start start 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f842c0b7ab0 0x7f842c06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c0d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0b49f0 con 0x7f842c0cef80 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0b7e80 con 0x7f842c0b7ab0 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8432a7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cc8a0 con 0x7f842c0b4340 2023-07-09T21:59:26.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f842c0b7ab0 0x7f842c06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f842c0b7ab0 0x7f842c06aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34312/0 (socket says 172.21.15.37:34312) 2023-07-09T21:59:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 -- 172.21.15.37:0/475497904 learned_addr learned my addr 172.21.15.37:0/475497904 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:26.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8431018640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c0d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 -- 172.21.15.37:0/475497904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 msgr2=0x7f842c0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c0d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 -- 172.21.15.37:0/475497904 >> v1:172.21.15.119:6789/0 conn(0x7f842c0cef80 legacy=0x7f842c0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.427+0000 7f8430817640 1 -- 172.21.15.37:0/475497904 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0ccb80 con 0x7f842c0b7ab0 2023-07-09T21:59:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8430817640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c06aa50 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f8420009870 tx=0x7f842001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658a06b37b557ac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f842b7fe640 1 -- 172.21.15.37:0/475497904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200aa670 con 0x7f842c0b7ab0 2023-07-09T21:59:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f842b7fe640 1 -- 172.21.15.37:0/475497904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84200aa7d0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f842b7fe640 1 -- 172.21.15.37:0/475497904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84200aab60 con 0x7f842c0b7ab0 2023-07-09T21:59:26.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 -- 172.21.15.37:0/475497904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 msgr2=0x7f842c06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c06aa50 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f8420009870 tx=0x7f842001c510 comp rx=0 tx=0).stop 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 -- 172.21.15.37:0/475497904 shutdown_connections 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c0d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 --2- 172.21.15.37:0/475497904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c06aa50 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 -- 172.21.15.37:0/475497904 >> 172.21.15.37:0/475497904 conn(0x7f842c073090 msgr2=0x7f842c069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 -- 172.21.15.37:0/475497904 shutdown_connections 2023-07-09T21:59:26.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.431+0000 7f8432a7b640 1 -- 172.21.15.37:0/475497904 wait complete. 2023-07-09T21:59:26.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 Processor -- start 2023-07-09T21:59:26.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- start start 2023-07-09T21:59:26.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c14d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c0cef80 0x7f842c0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c8350 con 0x7f842c0b7ab0 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c8630 con 0x7f842c0cef80 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0b51a0 con 0x7f842c0b4340 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34324/0 (socket says 172.21.15.37:34324) 2023-07-09T21:59:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 -- 172.21.15.37:0/2575643911 learned_addr learned my addr 172.21.15.37:0/2575643911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8431018640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c0cef80 0x7f842c0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8430817640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c14d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 -- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 msgr2=0x7f842c14d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c14d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 -- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c0cef80 msgr2=0x7f842c0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c0cef80 0x7f842c0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 -- 172.21.15.37:0/2575643911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200094d0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f842bfff640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f841800c390 tx=0x7f841800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84180052d0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418005430 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418003820 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c0b5480 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c0c7f90 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.435+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c0b56c0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.439+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 80) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8418003980 con 0x7f842c0b7ab0 2023-07-09T21:59:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.439+0000 7f84297fa640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 0x7f84100685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.439+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f84180832a0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.439+0000 7f8430817640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 0x7f84100685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.439+0000 7f8430817640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 0x7f84100685b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84200ae000 tx=0x7f84200b5040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.443+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f842c0b56c0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.519+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f84180509a0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.599+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f842c0b56c0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.599+0000 7f84297fa640 1 -- 172.21.15.37:0/2575643911 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+20001 (secure 0 0 0) 0x7f842c0b56c0 con 0x7f842c0b7ab0 2023-07-09T21:59:26.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:26.605 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":164,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:24.690316+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:43:02.619457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-07-09T21:43:03.483836+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":33,"snap_epoch":164,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2840945067":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6833/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6832/2345325658":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/537425844":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/721897364":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1351330877":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/3239411330":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/710378599":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/1690687053":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/973847261":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/1819254875":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2212167637":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6833/2345325658":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/606687528":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4204405331":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/1846219921":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/4040833825":"2023-07-10T21:43:22.569363+0000","172.21.15.119:6832/444783310":"2023-07-10T21:54:20.664411+0000","172.21.15.119:0/2405349511":"2023-07-10T21:54:20.664411+0000","172.21.15.119:6833/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/2225335498":"2023-07-10T21:59:23.686257+0000","172.21.15.119:6832/3801372437":"2023-07-10T21:43:22.569363+0000","172.21.15.119:0/477849756":"2023-07-10T21:59:23.686257+0000","172.21.15.119:0/2207599633":"2023-07-10T21:43:22.569363+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[{"pool":20,"snaps":[{"begin":17,"length":1},{"begin":33,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 msgr2=0x7f84100685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 0x7f84100685b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f84200ae000 tx=0x7f84200b5040 comp rx=0 tx=0).stop 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 msgr2=0x7f842c0c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f841800c390 tx=0x7f841800c850 comp rx=0 tx=0).stop 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 shutdown_connections 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8410066100 0x7f84100685b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f842c0cef80 0x7f842c0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f842c0b7ab0 0x7f842c0c7a50 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 --2- 172.21.15.37:0/2575643911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f842c0b4340 0x7f842c14d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 >> 172.21.15.37:0/2575643911 conn(0x7f842c073090 msgr2=0x7f842c0d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 shutdown_connections 2023-07-09T21:59:26.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.603+0000 7f8432a7b640 1 -- 172.21.15.37:0/2575643911 wait complete. 2023-07-09T21:59:26.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T21:59:26.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 Processor -- start 2023-07-09T21:59:26.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 -- start start 2023-07-09T21:59:26.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88640b47a0 0x7f88640b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88640cef80 con 0x7f88640b7a60 2023-07-09T21:59:26.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88640ccee0 con 0x7f88640b47a0 2023-07-09T21:59:26.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8869d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88640b45b0 con 0x7f88640b4140 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8863fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8862ffd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f88640b47a0 0x7f88640b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8863fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:55906/0 (socket says 172.21.15.37:55906) 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.767+0000 7f8863fff640 1 -- 172.21.15.37:0/3358573961 learned_addr learned my addr 172.21.15.37:0/3358573961 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f8863fff640 1 -- 172.21.15.37:0/3358573961 >> v2:172.21.15.119:3300/0 conn(0x7f88640b47a0 msgr2=0x7f88640b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:26.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f8863fff640 1 --2- 172.21.15.37:0/3358573961 >> v2:172.21.15.119:3300/0 conn(0x7f88640b47a0 0x7f88640b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f8863fff640 1 -- 172.21.15.37:0/3358573961 >> v1:172.21.15.119:6789/0 conn(0x7f88640b7a60 legacy=0x7f88640cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f8863fff640 1 -- 172.21.15.37:0/3358573961 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640cf260 con 0x7f88640b4140 2023-07-09T21:59:26.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f8863fff640 1 --2- 172.21.15.37:0/3358573961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e50 tx=0x7f885c01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55edd7280bdb084d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f88627fc640 1 -- 172.21.15.37:0/3358573961 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a57d0 con 0x7f88640b4140 2023-07-09T21:59:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f88627fc640 1 -- 172.21.15.37:0/3358573961 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c0a5930 con 0x7f88640b4140 2023-07-09T21:59:26.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.771+0000 7f88627fc640 1 -- 172.21.15.37:0/3358573961 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c0a5cc0 con 0x7f88640b4140 2023-07-09T21:59:26.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- 172.21.15.37:0/3358573961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 msgr2=0x7f88640d05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- 172.21.15.37:0/3358573961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f885c009e50 tx=0x7f885c01ca10 comp rx=0 tx=0).stop 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- 172.21.15.37:0/3358573961 shutdown_connections 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- 172.21.15.37:0/3358573961 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88640d05f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- 172.21.15.37:0/3358573961 >> v2:172.21.15.119:3300/0 conn(0x7f88640b47a0 0x7f88640b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- 172.21.15.37:0/3358573961 >> 172.21.15.37:0/3358573961 conn(0x7f8864073050 msgr2=0x7f8864069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- 172.21.15.37:0/3358573961 shutdown_connections 2023-07-09T21:59:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- 172.21.15.37:0/3358573961 wait complete. 2023-07-09T21:59:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 Processor -- start 2023-07-09T21:59:26.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- start start 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88641534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88640b7a60 0x7f88641577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864158260 con 0x7f88640b47a0 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8864158540 con 0x7f88640b7a60 2023-07-09T21:59:26.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8869d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8864155e60 con 0x7f88640b4140 2023-07-09T21:59:26.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34334/0 (socket says 172.21.15.37:34334) 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 -- 172.21.15.37:0/1591164691 learned_addr learned my addr 172.21.15.37:0/1591164691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8863fff640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88640b7a60 0x7f88641577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f88637fe640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88641534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 -- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 msgr2=0x7f88641534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88641534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 -- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88640b7a60 msgr2=0x7f88641577a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88640b7a60 0x7f88641577a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 -- 172.21.15.37:0/1591164691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c009b30 con 0x7f88640b47a0 2023-07-09T21:59:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f88637fe640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88641534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.775+0000 7f8862ffd640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f885800e930 tx=0x7f885800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858009690 con 0x7f88640b47a0 2023-07-09T21:59:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800ca00 con 0x7f88640b47a0 2023-07-09T21:59:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885800cd70 con 0x7f88640b47a0 2023-07-09T21:59:26.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8864156140 con 0x7f88640b47a0 2023-07-09T21:59:26.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88641554d0 con 0x7f88640b47a0 2023-07-09T21:59:26.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88640cdaa0 con 0x7f88640b47a0 2023-07-09T21:59:26.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8858013470 con 0x7f88640b47a0 2023-07-09T21:59:26.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 0x7f8850068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:26.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.779+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 7194+0+0 (secure 0 0 0) 0x7f8858084490 con 0x7f88640b47a0 2023-07-09T21:59:26.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.783+0000 7f88637fe640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 0x7f8850068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:26.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.783+0000 7f88637fe640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 0x7f8850068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88640cc2e0 tx=0x7f8854009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:26.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.783+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8858051440 con 0x7f88640b47a0 2023-07-09T21:59:26.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.975+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f886404d7d0 con 0x7f88640b47a0 2023-07-09T21:59:26.978 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T21:59:26.975+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T21:59:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.979+0000 7f884bfff640 1 -- 172.21.15.37:0/1591164691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8858054a60 con 0x7f88640b47a0 2023-07-09T21:59:26.983 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T21:59:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 msgr2=0x7f8850068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 0x7f8850068880 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f88640cc2e0 tx=0x7f8854009040 comp rx=0 tx=0).stop 2023-07-09T21:59:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 msgr2=0x7f8864153dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f885800e930 tx=0x7f885800edf0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 shutdown_connections 2023-07-09T21:59:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f88500663d0 0x7f8850068880 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f88640b7a60 0x7f88641577a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88640b47a0 0x7f8864153dc0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 --2- 172.21.15.37:0/1591164691 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f88640b4140 0x7f88641534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 >> 172.21.15.37:0/1591164691 conn(0x7f8864073050 msgr2=0x7f88640b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 shutdown_connections 2023-07-09T21:59:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:26.983+0000 7f8869d40640 1 -- 172.21.15.37:0/1591164691 wait complete. 2023-07-09T21:59:27.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T21:59:27.048 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:59:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 Processor -- start 2023-07-09T21:59:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 -- start start 2023-07-09T21:59:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6dd80b7980 0x7f6dd8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6dd80d0780 0x7f6dd80d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd815bf80 con 0x7f6dd80ceb80 2023-07-09T21:59:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80cd070 con 0x7f6dd80d0780 2023-07-09T21:59:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddfd00640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80cfd70 con 0x7f6dd80b7980 2023-07-09T21:59:27.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6dde29d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6dd80d0780 0x7f6dd80d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddd29b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6dd80ceb80 0x7f6dd80cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38324/0 (socket says 172.21.15.37:38324) 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddd29b640 1 -- 172.21.15.37:0/823740052 learned_addr learned my addr 172.21.15.37:0/823740052 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddda9c640 1 --2- 172.21.15.37:0/823740052 >> v2:172.21.15.119:3300/0 conn(0x7f6dd80b7980 0x7f6dd8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6dde29d640 1 -- 172.21.15.37:0/823740052 >> v2:172.21.15.119:3300/0 conn(0x7f6dd80b7980 msgr2=0x7f6dd8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6dde29d640 1 --2- 172.21.15.37:0/823740052 >> v2:172.21.15.119:3300/0 conn(0x7f6dd80b7980 0x7f6dd8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6dde29d640 1 -- 172.21.15.37:0/823740052 >> v1:172.21.15.37:6789/0 conn(0x7f6dd80ceb80 legacy=0x7f6dd80cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6dde29d640 1 -- 172.21.15.37:0/823740052 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8160570 con 0x7f6dd80d0780 2023-07-09T21:59:27.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.155+0000 7f6ddca9a640 1 -- 172.21.15.37:0/823740052 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3892667188 0 0) 0x7f6dc8001120 con 0x7f6dd80ceb80 2023-07-09T21:59:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6dde29d640 1 --2- 172.21.15.37:0/823740052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80d0780 0x7f6dd80d0b80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8069aa0 tx=0x7f6dd001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d1896447e2690 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddca9a640 1 -- 172.21.15.37:0/823740052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00a57d0 con 0x7f6dd80d0780 2023-07-09T21:59:27.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddca9a640 1 -- 172.21.15.37:0/823740052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd00a5930 con 0x7f6dd80d0780 2023-07-09T21:59:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddca9a640 1 -- 172.21.15.37:0/823740052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00a5cc0 con 0x7f6dd80d0780 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 -- 172.21.15.37:0/823740052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80d0780 msgr2=0x7f6dd80d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/823740052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80d0780 0x7f6dd80d0b80 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8069aa0 tx=0x7f6dd001c910 comp rx=0 tx=0).stop 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 -- 172.21.15.37:0/823740052 shutdown_connections 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/823740052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80d0780 0x7f6dd80d0b80 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/823740052 >> v2:172.21.15.119:3300/0 conn(0x7f6dd80b7980 0x7f6dd8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 -- 172.21.15.37:0/823740052 >> 172.21.15.37:0/823740052 conn(0x7f6dd8073090 msgr2=0x7f6dd8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 -- 172.21.15.37:0/823740052 shutdown_connections 2023-07-09T21:59:27.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.159+0000 7f6ddfd00640 1 -- 172.21.15.37:0/823740052 wait complete. 2023-07-09T21:59:27.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 Processor -- start 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- start start 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd80b7980 0x7f6dd815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd80d0780 0x7f6dd80b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b5e90 con 0x7f6dd80ceb80 2023-07-09T21:59:27.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd815ed10 con 0x7f6dd80b7980 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd815e340 con 0x7f6dd80d0780 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34364/0 (socket says 172.21.15.37:34364) 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 -- 172.21.15.37:0/278308423 learned_addr learned my addr 172.21.15.37:0/278308423 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6dde29d640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd80d0780 0x7f6dd80b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddda9c640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd80b7980 0x7f6dd815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 -- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd80d0780 msgr2=0x7f6dd80b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd80d0780 0x7f6dd80b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 -- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd80b7980 msgr2=0x7f6dd815e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd80b7980 0x7f6dd815e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 -- 172.21.15.37:0/278308423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009a70 con 0x7f6dd80ceb80 2023-07-09T21:59:27.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddd29b640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c7b0 tx=0x7f6dc800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80072d0 con 0x7f6dd80ceb80 2023-07-09T21:59:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc8007450 con 0x7f6dd80ceb80 2023-07-09T21:59:27.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80047f0 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd8153ca0 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd815dcf0 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.163+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd815db50 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.167+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6dc8004950 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.167+0000 7f6dce7fc640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 0x7f6dbc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.167+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7236+0+0 (secure 0 0 0) 0x7f6dc8083410 con 0x7f6dd80ceb80 2023-07-09T21:59:27.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.167+0000 7f6ddda9c640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 0x7f6dbc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:27.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.167+0000 7f6ddda9c640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 0x7f6dbc068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009b60 tx=0x7f6dd4009190 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:27.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.171+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6dd815db50 con 0x7f6dd80ceb80 2023-07-09T21:59:27.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.355+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6dd815db50 con 0x7f6dd80ceb80 2023-07-09T21:59:27.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.991+0000 7f6dce7fc640 1 -- 172.21.15.37:0/278308423 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6dd815db50 con 0x7f6dd80ceb80 2023-07-09T21:59:27.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 msgr2=0x7f6dbc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 0x7f6dbc068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4009b60 tx=0x7f6dd4009190 comp rx=0 tx=0).stop 2023-07-09T21:59:27.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 msgr2=0x7f6dd8157de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:27.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c7b0 tx=0x7f6dc800cc70 comp rx=0 tx=0).stop 2023-07-09T21:59:27.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 shutdown_connections 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f6dbc0663a0 0x7f6dbc068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6dd80d0780 0x7f6dd80b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dd80ceb80 0x7f6dd8157de0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 --2- 172.21.15.37:0/278308423 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6dd80b7980 0x7f6dd815e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 >> 172.21.15.37:0/278308423 conn(0x7f6dd8073090 msgr2=0x7f6dd8158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:27.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 shutdown_connections 2023-07-09T21:59:28.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:27.995+0000 7f6ddfd00640 1 -- 172.21.15.37:0/278308423 wait complete. 2023-07-09T21:59:28.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T21:59:28.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.211+0000 7fe99fa5c640 1 Processor -- start 2023-07-09T21:59:28.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 -- start start 2023-07-09T21:59:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9980cf290 0x7fe998160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe9980d0780 0x7fe9980d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99815bf80 con 0x7fe9980b7980 2023-07-09T21:59:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980cd070 con 0x7fe9980cf290 2023-07-09T21:59:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99fa5c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9980cfd70 con 0x7fe9980d0780 2023-07-09T21:59:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99cff7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe9980cf290 0x7fe998160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99d7f8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe9980b7980 0x7fe9980ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46870/0 (socket says 172.21.15.37:46870) 2023-07-09T21:59:28.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99d7f8640 1 -- 172.21.15.37:0/1541423114 learned_addr learned my addr 172.21.15.37:0/1541423114 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99dff9640 1 --2- 172.21.15.37:0/1541423114 >> v2:172.21.15.119:3300/0 conn(0x7fe9980d0780 0x7fe9980d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99cff7640 1 -- 172.21.15.37:0/1541423114 >> v2:172.21.15.119:3300/0 conn(0x7fe9980d0780 msgr2=0x7fe9980d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:28.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99cff7640 1 --2- 172.21.15.37:0/1541423114 >> v2:172.21.15.119:3300/0 conn(0x7fe9980d0780 0x7fe9980d0b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99cff7640 1 -- 172.21.15.37:0/1541423114 >> v1:172.21.15.37:6789/0 conn(0x7fe9980b7980 legacy=0x7fe9980ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.215+0000 7fe99cff7640 1 -- 172.21.15.37:0/1541423114 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe998160570 con 0x7fe9980cf290 2023-07-09T21:59:28.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99cff7640 1 --2- 172.21.15.37:0/1541423114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980cf290 0x7fe998160030 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b1240 tx=0x7fe98801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2254acd540eb9b15 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe98ffff640 1 -- 172.21.15.37:0/1541423114 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880ab600 con 0x7fe9980cf290 2023-07-09T21:59:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe98ffff640 1 -- 172.21.15.37:0/1541423114 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9880a7050 con 0x7fe9980cf290 2023-07-09T21:59:28.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe98ffff640 1 -- 172.21.15.37:0/1541423114 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880ab980 con 0x7fe9980cf290 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- 172.21.15.37:0/1541423114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980cf290 msgr2=0x7fe998160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/1541423114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980cf290 0x7fe998160030 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fe9980b1240 tx=0x7fe98801c460 comp rx=0 tx=0).stop 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- 172.21.15.37:0/1541423114 shutdown_connections 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/1541423114 >> v2:172.21.15.119:3300/0 conn(0x7fe9980d0780 0x7fe9980d0b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/1541423114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980cf290 0x7fe998160030 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:28.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- 172.21.15.37:0/1541423114 >> 172.21.15.37:0/1541423114 conn(0x7fe998073090 msgr2=0x7fe998069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- 172.21.15.37:0/1541423114 shutdown_connections 2023-07-09T21:59:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- 172.21.15.37:0/1541423114 wait complete. 2023-07-09T21:59:28.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 Processor -- start 2023-07-09T21:59:28.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.219+0000 7fe99fa5c640 1 -- start start 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9980cf290 0x7fe9981557f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 0x7fe998153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980c7860 con 0x7fe9980b7980 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980c8100 con 0x7fe9980d0780 2023-07-09T21:59:28.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9980c74d0 con 0x7fe9980cf290 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42526/0 (socket says 172.21.15.37:42526) 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 -- 172.21.15.37:0/341899802 learned_addr learned my addr 172.21.15.37:0/341899802 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99cff7640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9980cf290 0x7fe9981557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99dff9640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 0x7fe998153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 -- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9980cf290 msgr2=0x7fe9981557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9980cf290 0x7fe9981557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:28.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 -- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 msgr2=0x7fe998153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 0x7fe998153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 -- 172.21.15.37:0/341899802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe988009420 con 0x7fe9980b7980 2023-07-09T21:59:28.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99dff9640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 0x7fe998153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:28.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99d7f8640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c530 tx=0x7fe99400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:28.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994005cf0 con 0x7fe9980b7980 2023-07-09T21:59:28.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994005e50 con 0x7fe9980b7980 2023-07-09T21:59:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe994007270 con 0x7fe9980b7980 2023-07-09T21:59:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980c7ab0 con 0x7fe9980b7980 2023-07-09T21:59:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe998154040 con 0x7fe9980b7980 2023-07-09T21:59:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99804d7d0 con 0x7fe9980b7980 2023-07-09T21:59:28.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.223+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe9940073d0 con 0x7fe9980b7980 2023-07-09T21:59:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.227+0000 7fe98dffb640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 0x7fe97c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.227+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 7236+0+0 (secure 0 0 0) 0x7fe9940835b0 con 0x7fe9980b7980 2023-07-09T21:59:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.227+0000 7fe99cff7640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 0x7fe97c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:28.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.227+0000 7fe99cff7640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 0x7fe97c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe9880ad000 tx=0x7fe988008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:28.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.231+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe994050520 con 0x7fe9980b7980 2023-07-09T21:59:28.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.383+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe9980b1600 con 0x7fe9980b7980 2023-07-09T21:59:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.995+0000 7fe98dffb640 1 -- 172.21.15.37:0/341899802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe994053b40 con 0x7fe9980b7980 2023-07-09T21:59:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T21:59:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 msgr2=0x7fe97c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 0x7fe97c068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe9880ad000 tx=0x7fe988008040 comp rx=0 tx=0).stop 2023-07-09T21:59:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 msgr2=0x7fe9980c6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7fe99400c530 tx=0x7fe99400c9f0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 shutdown_connections 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe97c0663a0 0x7fe97c068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe9980d0780 0x7fe998153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe9980cf290 0x7fe9981557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 --2- 172.21.15.37:0/341899802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9980b7980 0x7fe9980c6ef0 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 >> 172.21.15.37:0/341899802 conn(0x7fe998073090 msgr2=0x7fe99815b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:29.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 shutdown_connections 2023-07-09T21:59:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:28.999+0000 7fe99fa5c640 1 -- 172.21.15.37:0/341899802 wait complete. 2023-07-09T21:59:29.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T21:59:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.171+0000 7f1f4b19f640 1 Processor -- start 2023-07-09T21:59:29.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.171+0000 7f1f4b19f640 1 -- start start 2023-07-09T21:59:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f4b19f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f4b19f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f4406b970 0x7f1f440c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f4b19f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440c9090 con 0x7f1f440c4350 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f4b19f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f440c47f0 con 0x7f1f4406b970 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f4b19f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440cbf40 con 0x7f1f441585b0 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56222/0 (socket says 172.21.15.37:56222) 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 -- 172.21.15.37:0/3402822330 learned_addr learned my addr 172.21.15.37:0/3402822330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:29.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f43fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f4406b970 0x7f1f440c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 -- 172.21.15.37:0/3402822330 >> v2:172.21.15.119:3300/0 conn(0x7f1f4406b970 msgr2=0x7f1f440c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 --2- 172.21.15.37:0/3402822330 >> v2:172.21.15.119:3300/0 conn(0x7f1f4406b970 0x7f1f440c3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 -- 172.21.15.37:0/3402822330 >> v1:172.21.15.119:6789/0 conn(0x7f1f440c4350 legacy=0x7f1f4415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.175+0000 7f1f48f3b640 1 -- 172.21.15.37:0/3402822330 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440c8a60 con 0x7f1f441585b0 2023-07-09T21:59:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f48f3b640 1 --2- 172.21.15.37:0/3402822330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f3801e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aadef30cfad4a538 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f437fe640 1 -- 172.21.15.37:0/3402822330 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380a86f0 con 0x7f1f441585b0 2023-07-09T21:59:29.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f437fe640 1 -- 172.21.15.37:0/3402822330 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f380a8850 con 0x7f1f441585b0 2023-07-09T21:59:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f437fe640 1 -- 172.21.15.37:0/3402822330 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f380a8be0 con 0x7f1f441585b0 2023-07-09T21:59:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- 172.21.15.37:0/3402822330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 msgr2=0x7f1f4406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/3402822330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f3801e720 comp rx=0 tx=0).stop 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- 172.21.15.37:0/3402822330 shutdown_connections 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/3402822330 >> v2:172.21.15.119:3300/0 conn(0x7f1f4406b970 0x7f1f440c3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/3402822330 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f441585b0 0x7f1f4406b430 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- 172.21.15.37:0/3402822330 >> 172.21.15.37:0/3402822330 conn(0x7f1f440cde40 msgr2=0x7f1f440ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- 172.21.15.37:0/3402822330 shutdown_connections 2023-07-09T21:59:29.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- 172.21.15.37:0/3402822330 wait complete. 2023-07-09T21:59:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 Processor -- start 2023-07-09T21:59:29.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.179+0000 7f1f4b19f640 1 -- start start 2023-07-09T21:59:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f4406b970 0x7f1f4415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440afe90 con 0x7f1f441585b0 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440afbb0 con 0x7f1f440c4350 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4415ab00 con 0x7f1f4406b970 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4973c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:38218/0 (socket says 172.21.15.37:38218) 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 -- 172.21.15.37:0/1547144151 learned_addr learned my addr 172.21.15.37:0/1547144151 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f48f3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f4406b970 0x7f1f4415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4973c640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42538/0 (socket says 172.21.15.37:42538) 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 -- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f4406b970 msgr2=0x7f1f4415b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f4406b970 0x7f1f4415b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 -- 172.21.15.37:0/1547144151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 msgr2=0x7f1f4414af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:29.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 -- 172.21.15.37:0/1547144151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380094d0 con 0x7f1f440c4350 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4973c640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f43fff640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e930 tx=0x7f1f3000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30009690 con 0x7f1f440c4350 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3000ca00 con 0x7f1f440c4350 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f4415ade0 con 0x7f1f440c4350 2023-07-09T21:59:29.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3000cd70 con 0x7f1f440c4350 2023-07-09T21:59:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440aee50 con 0x7f1f440c4350 2023-07-09T21:59:29.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.183+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4404d7d0 con 0x7f1f440c4350 2023-07-09T21:59:29.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.187+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1f300059a0 con 0x7f1f440c4350 2023-07-09T21:59:29.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.187+0000 7f1f417fa640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:29.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.187+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6798+0+0 (secure 0 0 0) 0x7f1f30084910 con 0x7f1f440c4350 2023-07-09T21:59:29.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.187+0000 7f1f48f3b640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:29.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.187+0000 7f1f48f3b640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 0x7f1f28068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f380a9000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:29.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.191+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f30051b80 con 0x7f1f440c4350 2023-07-09T21:59:29.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:29.359+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f4406b210 con 0x7f1f440c4350 2023-07-09T21:59:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.007+0000 7f1f417fa640 1 -- 172.21.15.37:0/1547144151 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v167) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1f30017020 con 0x7f1f440c4350 2023-07-09T21:59:30.012 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T21:59:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 msgr2=0x7f1f28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 0x7f1f28068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f380a9000 comp rx=0 tx=0).stop 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 msgr2=0x7f1f4414a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f1f3000e930 tx=0x7f1f3000edf0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 shutdown_connections 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f441585b0 0x7f1f4414af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f440c4350 0x7f1f4414a9e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 --2- 172.21.15.37:0/1547144151 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f4406b970 0x7f1f4415b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 >> 172.21.15.37:0/1547144151 conn(0x7f1f440cde40 msgr2=0x7f1f4406bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 shutdown_connections 2023-07-09T21:59:30.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.011+0000 7f1f4b19f640 1 -- 172.21.15.37:0/1547144151 wait complete. 2023-07-09T21:59:30.038 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T21:59:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 Processor -- start 2023-07-09T21:59:30.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 -- start start 2023-07-09T21:59:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c1595c0 0x7f925c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f925c0c99e0 0x7f925c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0c4c90 con 0x7f925c159990 2023-07-09T21:59:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0ca730 con 0x7f925c0c99e0 2023-07-09T21:59:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f92610d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0ca170 con 0x7f925c1595c0 2023-07-09T21:59:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f925c0c99e0 0x7f925c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f925c0c99e0 0x7f925c0cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42542/0 (socket says 172.21.15.37:42542) 2023-07-09T21:59:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 -- 172.21.15.37:0/3318840328 learned_addr learned my addr 172.21.15.37:0/3318840328 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925ad9d640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c1595c0 0x7f925c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 -- 172.21.15.37:0/3318840328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c1595c0 msgr2=0x7f925c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c1595c0 0x7f925c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 -- 172.21.15.37:0/3318840328 >> v1:172.21.15.119:6789/0 conn(0x7f925c159990 legacy=0x7f925c15dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.183+0000 7f925b59e640 1 -- 172.21.15.37:0/3318840328 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0ca450 con 0x7f925c0c99e0 2023-07-09T21:59:30.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f925b59e640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c0c99e0 0x7f925c0cd300 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9254009e50 tx=0x7f925401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e1aa2a59505cd6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f925a59c640 1 -- 172.21.15.37:0/3318840328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540a5730 con 0x7f925c0c99e0 2023-07-09T21:59:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f925a59c640 1 -- 172.21.15.37:0/3318840328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92540a5890 con 0x7f925c0c99e0 2023-07-09T21:59:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f925a59c640 1 -- 172.21.15.37:0/3318840328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540a5c20 con 0x7f925c0c99e0 2023-07-09T21:59:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 -- 172.21.15.37:0/3318840328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c0c99e0 msgr2=0x7f925c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c0c99e0 0x7f925c0cd300 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9254009e50 tx=0x7f925401c9a0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 -- 172.21.15.37:0/3318840328 shutdown_connections 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c0c99e0 0x7f925c0cd300 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 --2- 172.21.15.37:0/3318840328 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c1595c0 0x7f925c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 -- 172.21.15.37:0/3318840328 >> 172.21.15.37:0/3318840328 conn(0x7f925c0cde40 msgr2=0x7f925c0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 -- 172.21.15.37:0/3318840328 shutdown_connections 2023-07-09T21:59:30.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.187+0000 7f92610d8640 1 -- 172.21.15.37:0/3318840328 wait complete. 2023-07-09T21:59:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 Processor -- start 2023-07-09T21:59:30.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- start start 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c0c99e0 0x7f925c150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925c1595c0 0x7f925c0b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0b12d0 con 0x7f925c159990 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c15b010 con 0x7f925c1595c0 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c15b2f0 con 0x7f925c0c99e0 2023-07-09T21:59:30.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42544/0 (socket says 172.21.15.37:42544) 2023-07-09T21:59:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 -- 172.21.15.37:0/3857431539 learned_addr learned my addr 172.21.15.37:0/3857431539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925ad9d640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c0c99e0 0x7f925c150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f9253fff640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925c1595c0 0x7f925c0b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 -- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c0c99e0 msgr2=0x7f925c150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c0c99e0 0x7f925c150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 -- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925c1595c0 msgr2=0x7f925c0b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925c1595c0 0x7f925c0b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 -- 172.21.15.37:0/3857431539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9254009b30 con 0x7f925c159990 2023-07-09T21:59:30.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f925b59e640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f925401b050 tx=0x7f9254019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540b8670 con 0x7f925c159990 2023-07-09T21:59:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92540b87d0 con 0x7f925c159990 2023-07-09T21:59:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92540b8b80 con 0x7f925c159990 2023-07-09T21:59:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c15b5d0 con 0x7f925c159990 2023-07-09T21:59:30.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.191+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c15bb90 con 0x7f925c159990 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c04d7d0 con 0x7f925c159990 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92540b8ce0 con 0x7f925c159990 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f92537fe640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 0x7f923c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f925411f360 con 0x7f925c159990 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f925ad9d640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 0x7f923c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.195+0000 7f925ad9d640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 0x7f923c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f925c0afc80 tx=0x7f924c008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.199+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92540ec6e0 con 0x7f925c159990 2023-07-09T21:59:30.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.355+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f925c0c4c90 con 0x7f925c159990 2023-07-09T21:59:30.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.359+0000 7f92537fe640 1 -- 172.21.15.37:0/3857431539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f925c0c4c90 con 0x7f925c159990 2023-07-09T21:59:30.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 msgr2=0x7f923c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 0x7f923c068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f925c0afc80 tx=0x7f924c008040 comp rx=0 tx=0).stop 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 msgr2=0x7f925c14fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f925401b050 tx=0x7f9254019740 comp rx=0 tx=0).stop 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 shutdown_connections 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f923c0663a0 0x7f923c068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f925c159990 0x7f925c14fae0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f925c1595c0 0x7f925c0b0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 --2- 172.21.15.37:0/3857431539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f925c0c99e0 0x7f925c150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 >> 172.21.15.37:0/3857431539 conn(0x7f925c0cde40 msgr2=0x7f925c157db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 shutdown_connections 2023-07-09T21:59:30.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.363+0000 7f92610d8640 1 -- 172.21.15.37:0/3857431539 wait complete. 2023-07-09T21:59:30.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T21:59:30.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.527+0000 7f7f170d8640 1 Processor -- start 2023-07-09T21:59:30.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.527+0000 7f7f170d8640 1 -- start start 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f170d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7f100cf290 0x7f7f10160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f170d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1015bf80 con 0x7f7f100b7980 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f170d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f10160570 con 0x7f7f100d0780 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f170d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f100cd070 con 0x7f7f100cf290 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f14e74640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7f100b7980 0x7f7f100ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46886/0 (socket says 172.21.15.37:46886) 2023-07-09T21:59:30.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f14e74640 1 -- 172.21.15.37:0/2948706828 learned_addr learned my addr 172.21.15.37:0/2948706828 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0ffff640 1 --2- 172.21.15.37:0/2948706828 >> v2:172.21.15.119:3300/0 conn(0x7f7f100cf290 0x7f7f10160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979016266 0 0) 0x7f7f04001120 con 0x7f7f100b7980 2023-07-09T21:59:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f00003530 con 0x7f7f100b7980 2023-07-09T21:59:30.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 760662415 0 0) 0x7f7f00003530 con 0x7f7f100b7980 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 >> v2:172.21.15.119:3300/0 conn(0x7f7f100cf290 msgr2=0x7f7f10160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 --2- 172.21.15.37:0/2948706828 >> v2:172.21.15.119:3300/0 conn(0x7f7f100cf290 0x7f7f10160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 >> v1:172.21.15.119:6789/0 conn(0x7f7f100d0780 legacy=0x7f7f100d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100d02f0 con 0x7f7f100b7980 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7f04001810 con 0x7f7f100b7980 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 >> v1:172.21.15.37:6789/0 conn(0x7f7f100b7980 legacy=0x7f7f100ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f00003980 0x7f7f00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f000047d0 0x7f7f00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 0x7f7f0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100cd070 con 0x7f7f00005180 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0000c000 con 0x7f7f00003980 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0000c1c0 con 0x7f7f000047d0 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 0x7f7f0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f14e74640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f00003980 0x7f7f00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f0ffff640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f000047d0 0x7f7f00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 -- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f000047d0 msgr2=0x7f7f00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f000047d0 0x7f7f00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 -- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f00003980 msgr2=0x7f7f00003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f00003980 0x7f7f00003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.531+0000 7f7f15675640 1 -- 172.21.15.37:0/2948706828 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00003530 con 0x7f7f00005180 2023-07-09T21:59:30.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f15675640 1 -- 172.21.15.37:0/2948706828 reap_dead start 2023-07-09T21:59:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f15675640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 0x7f7f0000b990 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7f08001cd0 tx=0x7f7f0801c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48db5f2cd11e99b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08003b80 con 0x7f7f00005180 2023-07-09T21:59:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08003d00 con 0x7f7f00005180 2023-07-09T21:59:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f0f7fe640 1 -- 172.21.15.37:0/2948706828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08005310 con 0x7f7f00005180 2023-07-09T21:59:30.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 -- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 msgr2=0x7f7f0000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 0x7f7f0000b990 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f7f08001cd0 tx=0x7f7f0801c5c0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 -- 172.21.15.37:0/2948706828 shutdown_connections 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2948706828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f00005180 0x7f7f0000b990 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 -- 172.21.15.37:0/2948706828 >> 172.21.15.37:0/2948706828 conn(0x7f7f10073090 msgr2=0x7f7f10069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 -- 172.21.15.37:0/2948706828 shutdown_connections 2023-07-09T21:59:30.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.535+0000 7f7f170d8640 1 -- 172.21.15.37:0/2948706828 wait complete. 2023-07-09T21:59:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 Processor -- start 2023-07-09T21:59:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- start start 2023-07-09T21:59:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f00005180 0x7f7f100c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f100b32d0 0x7f7f100b3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1015d8e0 con 0x7f7f1015c6b0 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100b3c80 con 0x7f7f100b32d0 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100c6e30 con 0x7f7f00005180 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42558/0 (socket says 172.21.15.37:42558) 2023-07-09T21:59:30.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 -- 172.21.15.37:0/2783144160 learned_addr learned my addr 172.21.15.37:0/2783144160 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f14e74640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f00005180 0x7f7f100c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f0ffff640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f100b32d0 0x7f7f100b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 -- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f00005180 msgr2=0x7f7f100c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f00005180 0x7f7f100c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 -- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f100b32d0 msgr2=0x7f7f100b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f100b32d0 0x7f7f100b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 -- 172.21.15.37:0/2783144160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100c7110 con 0x7f7f1015c6b0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f15675640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7f0801caa0 tx=0x7f7f00005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08006d60 con 0x7f7f1015c6b0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08003b90 con 0x7f7f1015c6b0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08007250 con 0x7f7f1015c6b0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f100c73f0 con 0x7f7f1015c6b0 2023-07-09T21:59:30.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1015d060 con 0x7f7f1015c6b0 2023-07-09T21:59:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.539+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f100c75e0 con 0x7f7f1015c6b0 2023-07-09T21:59:30.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.543+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7f080073b0 con 0x7f7f1015c6b0 2023-07-09T21:59:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.543+0000 7f7f0d7fa640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 0x7f7ef4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.543+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f7f080a6040 con 0x7f7f1015c6b0 2023-07-09T21:59:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.543+0000 7f7f14e74640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 0x7f7ef4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.543+0000 7f7f14e74640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 0x7f7ef4068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7f04001280 tx=0x7f7f04009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.547+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f080eabd0 con 0x7f7f1015c6b0 2023-07-09T21:59:30.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.715+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f7f10160570 con 0x7f7f1015c6b0 2023-07-09T21:59:30.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f0d7fa640 1 -- 172.21.15.37:0/2783144160 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v56) v1 ==== 120+0+0 (secure 0 0 0) 0x7f7f10160570 con 0x7f7f1015c6b0 2023-07-09T21:59:30.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 msgr2=0x7f7ef4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 0x7f7ef4068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7f04001280 tx=0x7f7f04009040 comp rx=0 tx=0).stop 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 msgr2=0x7f7f1015cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f7f0801caa0 tx=0x7f7f00005800 comp rx=0 tx=0).stop 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 shutdown_connections 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ef40663a0 0x7f7ef4068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f1015c6b0 0x7f7f1015cb20 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7f100b32d0 0x7f7f100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 --2- 172.21.15.37:0/2783144160 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7f00005180 0x7f7f100c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 >> 172.21.15.37:0/2783144160 conn(0x7f7f10073090 msgr2=0x7f7f100d26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 shutdown_connections 2023-07-09T21:59:30.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.719+0000 7f7f170d8640 1 -- 172.21.15.37:0/2783144160 wait complete. 2023-07-09T21:59:30.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T21:59:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.883+0000 7f861219f640 1 Processor -- start 2023-07-09T21:59:30.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 -- start start 2023-07-09T21:59:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 0x7f860c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f860c0ceb80 0x7f860c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c15bf80 con 0x7f860c0b3c20 2023-07-09T21:59:30.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0cd070 con 0x7f860c0ceb80 2023-07-09T21:59:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f861219f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0cfd70 con 0x7f860c0b7980 2023-07-09T21:59:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f860c0ceb80 0x7f860c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f860c0ceb80 0x7f860c0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42562/0 (socket says 172.21.15.37:42562) 2023-07-09T21:59:30.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 -- 172.21.15.37:0/2648145858 learned_addr learned my addr 172.21.15.37:0/2648145858 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860b7fe640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 0x7f860c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 -- 172.21.15.37:0/2648145858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 msgr2=0x7f860c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 0x7f860c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 -- 172.21.15.37:0/2648145858 >> v1:172.21.15.119:6789/0 conn(0x7f860c0b3c20 legacy=0x7f860c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860affd640 1 -- 172.21.15.37:0/2648145858 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c160570 con 0x7f860c0ceb80 2023-07-09T21:59:30.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.887+0000 7f860b7fe640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 0x7f860c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f860affd640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0ceb80 0x7f860c0cef90 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bfc3d8a8a6a04ab server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f860a7fc640 1 -- 172.21.15.37:0/2648145858 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ab600 con 0x7f860c0ceb80 2023-07-09T21:59:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f860a7fc640 1 -- 172.21.15.37:0/2648145858 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000a7050 con 0x7f860c0ceb80 2023-07-09T21:59:30.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f860a7fc640 1 -- 172.21.15.37:0/2648145858 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ab980 con 0x7f860c0ceb80 2023-07-09T21:59:30.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- 172.21.15.37:0/2648145858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0ceb80 msgr2=0x7f860c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0ceb80 0x7f860c0cef90 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f8600009870 tx=0x7f860001c500 comp rx=0 tx=0).stop 2023-07-09T21:59:30.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- 172.21.15.37:0/2648145858 shutdown_connections 2023-07-09T21:59:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0ceb80 0x7f860c0cef90 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 --2- 172.21.15.37:0/2648145858 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0b7980 0x7f860c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- 172.21.15.37:0/2648145858 >> 172.21.15.37:0/2648145858 conn(0x7f860c073090 msgr2=0x7f860c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- 172.21.15.37:0/2648145858 shutdown_connections 2023-07-09T21:59:30.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- 172.21.15.37:0/2648145858 wait complete. 2023-07-09T21:59:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 Processor -- start 2023-07-09T21:59:30.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.891+0000 7f861219f640 1 -- start start 2023-07-09T21:59:30.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 0x7f860c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0ceb80 0x7f860c0b3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c15bc60 con 0x7f860c0b7980 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c152fc0 con 0x7f860c0b3c20 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c1532a0 con 0x7f860c0ceb80 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 0x7f860c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42570/0 (socket says 172.21.15.37:42570) 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860b7fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 0x7f860c15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:38260/0 (socket says 172.21.15.37:38260) 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 -- 172.21.15.37:0/1497825795 learned_addr learned my addr 172.21.15.37:0/1497825795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860bfff640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0ceb80 0x7f860c0b3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 -- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0ceb80 msgr2=0x7f860c0b3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0ceb80 0x7f860c0b3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 -- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 msgr2=0x7f860c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:30.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 0x7f860c15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:30.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 -- 172.21.15.37:0/1497825795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000094d0 con 0x7f860c0b7980 2023-07-09T21:59:30.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f860affd640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f86000ae040 tx=0x7f86000192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000ba070 con 0x7f860c0b7980 2023-07-09T21:59:30.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86000ac240 con 0x7f860c0b7980 2023-07-09T21:59:30.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86000b6680 con 0x7f860c0b7980 2023-07-09T21:59:30.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c153580 con 0x7f860c0b7980 2023-07-09T21:59:30.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c15c120 con 0x7f860c0b7980 2023-07-09T21:59:30.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.895+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c04d7d0 con 0x7f860c0b7980 2023-07-09T21:59:30.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.899+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f86000b2040 con 0x7f860c0b7980 2023-07-09T21:59:30.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.899+0000 7f85f3fff640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 0x7f85f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:30.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.899+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f860011dab0 con 0x7f860c0b7980 2023-07-09T21:59:30.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.899+0000 7f860b7fe640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 0x7f85f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:30.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.899+0000 7f860b7fe640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 0x7f85f8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00ab60 tx=0x7f85fc008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:30.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:30.903+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86000ead10 con 0x7f860c0b7980 2023-07-09T21:59:31.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.059+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f860c15bf80 con 0x7f860c0b7980 2023-07-09T21:59:31.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.063+0000 7f85f3fff640 1 -- 172.21.15.37:0/1497825795 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v57) v1 ==== 115+0+0 (secure 0 0 0) 0x7f860c15bf80 con 0x7f860c0b7980 2023-07-09T21:59:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 msgr2=0x7f85f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 0x7f85f8068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f85fc00ab60 tx=0x7f85fc008040 comp rx=0 tx=0).stop 2023-07-09T21:59:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 msgr2=0x7f860c0b2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:31.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f86000ae040 tx=0x7f86000192a0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 shutdown_connections 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85f80663a0 0x7f85f8068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f860c0ceb80 0x7f860c0b3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f860c0b7980 0x7f860c0b2c50 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 --2- 172.21.15.37:0/1497825795 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f860c0b3c20 0x7f860c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 >> 172.21.15.37:0/1497825795 conn(0x7f860c073090 msgr2=0x7f860c158500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 shutdown_connections 2023-07-09T21:59:31.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.067+0000 7f861219f640 1 -- 172.21.15.37:0/1497825795 wait complete. 2023-07-09T21:59:31.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart' 2023-07-09T21:59:31.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.227+0000 7f96a9834640 1 Processor -- start 2023-07-09T21:59:31.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.227+0000 7f96a9834640 1 -- start start 2023-07-09T21:59:31.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a9834640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96a40b7ab0 0x7f96a406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a9834640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f96a40cef80 0x7f96a40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a9834640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a40b49f0 con 0x7f96a40b4170 2023-07-09T21:59:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a9834640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40b7e80 con 0x7f96a40b7ab0 2023-07-09T21:59:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a9834640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40b4610 con 0x7f96a40cef80 2023-07-09T21:59:31.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96a40b7ab0 0x7f96a406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f96a40b7ab0 0x7f96a406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42586/0 (socket says 172.21.15.37:42586) 2023-07-09T21:59:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 -- 172.21.15.37:0/4289977315 learned_addr learned my addr 172.21.15.37:0/4289977315 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f969bfff640 1 --2- 172.21.15.37:0/4289977315 >> v2:172.21.15.119:3300/0 conn(0x7f96a40cef80 0x7f96a40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 -- 172.21.15.37:0/4289977315 >> v2:172.21.15.119:3300/0 conn(0x7f96a40cef80 msgr2=0x7f96a40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:31.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 --2- 172.21.15.37:0/4289977315 >> v2:172.21.15.119:3300/0 conn(0x7f96a40cef80 0x7f96a40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 -- 172.21.15.37:0/4289977315 >> v1:172.21.15.119:6789/0 conn(0x7f96a40b4170 legacy=0x7f96a415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:31.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.231+0000 7f96a2ffd640 1 -- 172.21.15.37:0/4289977315 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40cc8a0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a2ffd640 1 --2- 172.21.15.37:0/4289977315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a406aa50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b4d10 tx=0x7f969401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b071abe6abd5664e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a27fc640 1 -- 172.21.15.37:0/4289977315 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940aa5f0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a27fc640 1 -- 172.21.15.37:0/4289977315 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96940aa750 con 0x7f96a40b7ab0 2023-07-09T21:59:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a27fc640 1 -- 172.21.15.37:0/4289977315 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96940aaae0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- 172.21.15.37:0/4289977315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 msgr2=0x7f96a406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 --2- 172.21.15.37:0/4289977315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a406aa50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b4d10 tx=0x7f969401c490 comp rx=0 tx=0).stop 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- 172.21.15.37:0/4289977315 shutdown_connections 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 --2- 172.21.15.37:0/4289977315 >> v2:172.21.15.119:3300/0 conn(0x7f96a40cef80 0x7f96a40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 --2- 172.21.15.37:0/4289977315 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a406aa50 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- 172.21.15.37:0/4289977315 >> 172.21.15.37:0/4289977315 conn(0x7f96a4073090 msgr2=0x7f96a4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- 172.21.15.37:0/4289977315 shutdown_connections 2023-07-09T21:59:31.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- 172.21.15.37:0/4289977315 wait complete. 2023-07-09T21:59:31.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 Processor -- start 2023-07-09T21:59:31.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.235+0000 7f96a9834640 1 -- start start 2023-07-09T21:59:31.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40b4170 0x7f96a41518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 0x7f96a40cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b5330 con 0x7f96a40b7ab0 2023-07-09T21:59:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b6c60 con 0x7f96a40b4170 2023-07-09T21:59:31.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40c5ce0 con 0x7f96a40cef80 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42588/0 (socket says 172.21.15.37:42588) 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 -- 172.21.15.37:0/4174825469 learned_addr learned my addr 172.21.15.37:0/4174825469 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a2ffd640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40b4170 0x7f96a41518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a37fe640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 0x7f96a40cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 -- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 msgr2=0x7f96a40cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 0x7f96a40cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 -- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40b4170 msgr2=0x7f96a41518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40b4170 0x7f96a41518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 -- 172.21.15.37:0/4174825469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96940094d0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a37fe640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 0x7f96a40cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f969bfff640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d800 tx=0x7f968c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:31.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c018070 con 0x7f96a40b7ab0 2023-07-09T21:59:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f968c004020 con 0x7f96a40b7ab0 2023-07-09T21:59:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f968c0041d0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a40cc480 con 0x7f96a40b7ab0 2023-07-09T21:59:31.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a40b7190 con 0x7f96a40b7ab0 2023-07-09T21:59:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.239+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a404d7d0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.243+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f968c004330 con 0x7f96a40b7ab0 2023-07-09T21:59:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.243+0000 7f96a0ff9640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 0x7f9684068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.243+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7f968c083d10 con 0x7f96a40b7ab0 2023-07-09T21:59:31.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.243+0000 7f96a2ffd640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 0x7f9684068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:31.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.243+0000 7f96a2ffd640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 0x7f9684068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96940ae000 tx=0x7f96940b5040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:31.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.247+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f968c050fd0 con 0x7f96a40b7ab0 2023-07-09T21:59:31.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:31.455+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]} v 0) v1 -- 0x7f96a40d1e30 con 0x7f96a40b7ab0 2023-07-09T21:59:32.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a0ff9640 1 -- 172.21.15.37:0/4174825469 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_mgr_restart"]}]=0 v1312) v1 ==== 165+0+0 (secure 0 0 0) 0x7f968c0545f0 con 0x7f96a40b7ab0 2023-07-09T21:59:32.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 msgr2=0x7f9684068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 0x7f9684068880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f96940ae000 tx=0x7f96940b5040 comp rx=0 tx=0).stop 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 msgr2=0x7f96a40cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f968c00d800 tx=0x7f968c00dcc0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 shutdown_connections 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f96840663d0 0x7f9684068880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f96a40cef80 0x7f96a40cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96a40b7ab0 0x7f96a40cba00 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 --2- 172.21.15.37:0/4174825469 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f96a40b4170 0x7f96a41518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 >> 172.21.15.37:0/4174825469 conn(0x7f96a4073090 msgr2=0x7f96a40ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:32.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 shutdown_connections 2023-07-09T21:59:32.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.011+0000 7f96a9834640 1 -- 172.21.15.37:0/4174825469 wait complete. 2023-07-09T21:59:32.038 INFO:tasks.cephfs_test_runner:Test that snap schedule is resumed after mgr restart ... ok 2023-07-09T21:59:32.039 INFO:tasks.cephfs_test_runner:Starting test: test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test scheduled snapshots along with rentention policy 2023-07-09T21:59:32.039 INFO:tasks.cephfs_test_runner:test_snap_schedule_with_retention (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2023-07-09T21:59:32.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-09T21:59:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 Processor -- start 2023-07-09T21:59:32.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 -- start start 2023-07-09T21:59:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 0x7fc9c806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9c80cef80 0x7fc9c80b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c80b49f0 con 0x7fc9c80b4170 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80b7e80 con 0x7fc9c80cef80 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9ceabd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80b45f0 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9c80cef80 0x7fc9c80b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc9c80cef80 0x7fc9c80b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42592/0 (socket says 172.21.15.37:42592) 2023-07-09T21:59:32.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 -- 172.21.15.37:0/1321586551 learned_addr learned my addr 172.21.15.37:0/1321586551 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9cc859640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 0x7fc9c806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 -- 172.21.15.37:0/1321586551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 msgr2=0x7fc9c806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 0x7fc9c806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 -- 172.21.15.37:0/1321586551 >> v1:172.21.15.119:6789/0 conn(0x7fc9c80b4170 legacy=0x7fc9c815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9c7fff640 1 -- 172.21.15.37:0/1321586551 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80cc8a0 con 0x7fc9c80cef80 2023-07-09T21:59:32.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.183+0000 7fc9cc859640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 0x7fc9c806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9c7fff640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80cef80 0x7fc9c80b3c30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99f5f4b75d85c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9c77fe640 1 -- 172.21.15.37:0/1321586551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40aa670 con 0x7fc9c80cef80 2023-07-09T21:59:32.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9c77fe640 1 -- 172.21.15.37:0/1321586551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40aa7d0 con 0x7fc9c80cef80 2023-07-09T21:59:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9c77fe640 1 -- 172.21.15.37:0/1321586551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40aab60 con 0x7fc9c80cef80 2023-07-09T21:59:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 -- 172.21.15.37:0/1321586551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80cef80 msgr2=0x7fc9c80b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80cef80 0x7fc9c80b3c30 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4009870 tx=0x7fc9b401c510 comp rx=0 tx=0).stop 2023-07-09T21:59:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 -- 172.21.15.37:0/1321586551 shutdown_connections 2023-07-09T21:59:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80cef80 0x7fc9c80b3c30 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/1321586551 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b7ab0 0x7fc9c806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 -- 172.21.15.37:0/1321586551 >> 172.21.15.37:0/1321586551 conn(0x7fc9c8073090 msgr2=0x7fc9c8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 -- 172.21.15.37:0/1321586551 shutdown_connections 2023-07-09T21:59:32.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.187+0000 7fc9ceabd640 1 -- 172.21.15.37:0/1321586551 wait complete. 2023-07-09T21:59:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 Processor -- start 2023-07-09T21:59:32.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- start start 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 0x7fc9c80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 0x7fc9c8154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80cbc10 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c8154670 con 0x7fc9c80cef80 2023-07-09T21:59:32.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80cbe20 con 0x7fc9c80b4170 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42608/0 (socket says 172.21.15.37:42608) 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 -- 172.21.15.37:0/2359017675 learned_addr learned my addr 172.21.15.37:0/2359017675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9cc859640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 0x7fc9c80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9cd05a640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 0x7fc9c8154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 -- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 msgr2=0x7fc9c80c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 0x7fc9c80c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 -- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 msgr2=0x7fc9c8154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 0x7fc9c8154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 -- 172.21.15.37:0/2359017675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b40094d0 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9cd05a640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 0x7fc9c8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9cc859640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 0x7fc9c80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:32.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c7fff640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401a140 tx=0x7fc9b401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40b3800 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b40b3960 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b40b3d10 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c80cc100 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.191+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c80c9560 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c804d7d0 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc9b40b2380 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9c57fa640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 0x7fc9ac068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:32.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fc9b411e980 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9cc859640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 0x7fc9ac068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:32.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.195+0000 7fc9cc859640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 0x7fc9ac068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009970 tx=0x7fc9bc008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:32.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.199+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9b40ebad0 con 0x7fc9c80b7ab0 2023-07-09T21:59:32.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:32.411+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7fc9c80d2d70 con 0x7fc9c80b7ab0 2023-07-09T21:59:33.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.011+0000 7fc9c57fa640 1 -- 172.21.15.37:0/2359017675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1313) v1 ==== 166+0+0 (secure 0 0 0) 0x7fc9b40ef0f0 con 0x7fc9c80b7ab0 2023-07-09T21:59:33.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 msgr2=0x7fc9ac068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 0x7fc9ac068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc009970 tx=0x7fc9bc008040 comp rx=0 tx=0).stop 2023-07-09T21:59:33.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 msgr2=0x7fc9c8153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fc9b401a140 tx=0x7fc9b401ad50 comp rx=0 tx=0).stop 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 shutdown_connections 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc9ac0663a0 0x7fc9ac068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc9c80cef80 0x7fc9c8154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9c80b7ab0 0x7fc9c8153bf0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 --2- 172.21.15.37:0/2359017675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc9c80b4170 0x7fc9c80c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 >> 172.21.15.37:0/2359017675 conn(0x7fc9c8073090 msgr2=0x7fc9c80b1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 shutdown_connections 2023-07-09T21:59:33.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.015+0000 7fc9ceabd640 1 -- 172.21.15.37:0/2359017675 wait complete. 2023-07-09T21:59:33.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T21:59:33.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 Processor -- start 2023-07-09T21:59:33.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 -- start start 2023-07-09T21:59:33.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc1585b0 0x7fa0dc06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0dc06b970 0x7fa0dc0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0dc0c9090 con 0x7fa0dc0c4350 2023-07-09T21:59:33.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0dc0c47f0 con 0x7fa0dc06b970 2023-07-09T21:59:33.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e30bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc0cbf40 con 0x7fa0dc1585b0 2023-07-09T21:59:33.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0dbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa0dc06b970 0x7fa0dc0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e165a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa0dc0c4350 0x7fa0dc15c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46900/0 (socket says 172.21.15.37:46900) 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e165a640 1 -- 172.21.15.37:0/3689577591 learned_addr learned my addr 172.21.15.37:0/3689577591 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.187+0000 7fa0e0e59640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc1585b0 0x7fa0dc06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0db7fe640 1 -- 172.21.15.37:0/3689577591 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251972647 0 0) 0x7fa0dc0c9090 con 0x7fa0dc0c4350 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0db7fe640 1 -- 172.21.15.37:0/3689577591 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0cc003530 con 0x7fa0dc0c4350 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0dbfff640 1 -- 172.21.15.37:0/3689577591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc1585b0 msgr2=0x7fa0dc06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0dbfff640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc1585b0 0x7fa0dc06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0dbfff640 1 -- 172.21.15.37:0/3689577591 >> v1:172.21.15.37:6789/0 conn(0x7fa0dc0c4350 legacy=0x7fa0dc15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0dbfff640 1 -- 172.21.15.37:0/3689577591 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0dc0c8a60 con 0x7fa0dc06b970 2023-07-09T21:59:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0dbfff640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc06b970 0x7fa0dc0c3e10 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097f0 tx=0x7fa0c801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59496dcde26b89bb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0db7fe640 1 -- 172.21.15.37:0/3689577591 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80ab650 con 0x7fa0dc06b970 2023-07-09T21:59:33.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0db7fe640 1 -- 172.21.15.37:0/3689577591 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80ab7b0 con 0x7fa0dc06b970 2023-07-09T21:59:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.191+0000 7fa0db7fe640 1 -- 172.21.15.37:0/3689577591 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80abb40 con 0x7fa0dc06b970 2023-07-09T21:59:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- 172.21.15.37:0/3689577591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc06b970 msgr2=0x7fa0dc0c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc06b970 0x7fa0dc0c3e10 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097f0 tx=0x7fa0c801c450 comp rx=0 tx=0).stop 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- 172.21.15.37:0/3689577591 shutdown_connections 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc06b970 0x7fa0dc0c3e10 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/3689577591 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc1585b0 0x7fa0dc06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- 172.21.15.37:0/3689577591 >> 172.21.15.37:0/3689577591 conn(0x7fa0dc0cde40 msgr2=0x7fa0dc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- 172.21.15.37:0/3689577591 shutdown_connections 2023-07-09T21:59:33.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- 172.21.15.37:0/3689577591 wait complete. 2023-07-09T21:59:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 Processor -- start 2023-07-09T21:59:33.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- start start 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc06b970 0x7fa0dc1510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 0x7fa0dc14b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc1515f0 con 0x7fa0dc1585b0 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc150010 con 0x7fa0dc06b970 2023-07-09T21:59:33.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e30bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc1502f0 con 0x7fa0dc0c4350 2023-07-09T21:59:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42622/0 (socket says 172.21.15.37:42622) 2023-07-09T21:59:33.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 -- 172.21.15.37:0/213612314 learned_addr learned my addr 172.21.15.37:0/213612314 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0dbfff640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 0x7fa0dc14b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e0e59640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc06b970 0x7fa0dc1510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 -- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 msgr2=0x7fa0dc14b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 0x7fa0dc14b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 -- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc06b970 msgr2=0x7fa0dc1510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc06b970 0x7fa0dc1510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0e165a640 1 -- 172.21.15.37:0/213612314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0c8009420 con 0x7fa0dc1585b0 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.195+0000 7fa0dbfff640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 0x7fa0dc14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0e165a640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400cb40 tx=0x7fa0d400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d400aca0 con 0x7fa0dc1585b0 2023-07-09T21:59:33.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d400ae00 con 0x7fa0dc1585b0 2023-07-09T21:59:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc1505d0 con 0x7fa0dc1585b0 2023-07-09T21:59:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4012620 con 0x7fa0dc1585b0 2023-07-09T21:59:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc150b90 con 0x7fa0dc1585b0 2023-07-09T21:59:33.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0dc150d80 con 0x7fa0dc1585b0 2023-07-09T21:59:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa0d4007070 con 0x7fa0dc1585b0 2023-07-09T21:59:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 0x7fa0c0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.199+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fa0d4084020 con 0x7fa0dc1585b0 2023-07-09T21:59:33.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.203+0000 7fa0e0e59640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 0x7fa0c0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.203+0000 7fa0e0e59640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 0x7fa0c0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009a50 tx=0x7fa0d0008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.203+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0d4051250 con 0x7fa0dc1585b0 2023-07-09T21:59:33.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.359+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa0dc04d7d0 con 0x7fa0dc1585b0 2023-07-09T21:59:33.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.363+0000 7fa0d97fa640 1 -- 172.21.15.37:0/213612314 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v58)=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa0d40170c0 con 0x7fa0dc1585b0 2023-07-09T21:59:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 msgr2=0x7fa0c0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 0x7fa0c0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009a50 tx=0x7fa0d0008040 comp rx=0 tx=0).stop 2023-07-09T21:59:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 msgr2=0x7fa0dc159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400cb40 tx=0x7fa0d400a060 comp rx=0 tx=0).stop 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 shutdown_connections 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa0c00663a0 0x7fa0c0068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0dc1585b0 0x7fa0dc159570 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa0dc0c4350 0x7fa0dc14b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 --2- 172.21.15.37:0/213612314 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa0dc06b970 0x7fa0dc1510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 >> 172.21.15.37:0/213612314 conn(0x7fa0dc0cde40 msgr2=0x7fa0dc0cc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 shutdown_connections 2023-07-09T21:59:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.367+0000 7fa0e30bd640 1 -- 172.21.15.37:0/213612314 wait complete. 2023-07-09T21:59:33.389 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T21:59:33.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:59:33.451 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T21:59:33.511 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T21:59:33.512 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:59:33.512 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:33.521 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:59:33.522 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:59:33.522 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:33.532 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:59:33.532 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T21:59:33.533 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:33.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T21:59:33.578 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T21:59:33.578 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T21:59:33.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T21:59:33.588 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T21:59:33.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 Processor -- start 2023-07-09T21:59:33.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 -- start start 2023-07-09T21:59:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fee8c0c94a0 0x7fee8c070d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee8c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee8c0cbb20 con 0x7fee8c157e90 2023-07-09T21:59:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee8c071330 con 0x7fee8c0c94a0 2023-07-09T21:59:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee920ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c06b6f0 con 0x7fee8c0cc8e0 2023-07-09T21:59:33.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee8c157e90 0x7fee8c06afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46904/0 (socket says 172.21.15.37:46904) 2023-07-09T21:59:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8b7fe640 1 -- 172.21.15.37:0/2398373972 learned_addr learned my addr 172.21.15.37:0/2398373972 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8affd640 1 --2- 172.21.15.37:0/2398373972 >> v2:172.21.15.119:3300/0 conn(0x7fee8c0c94a0 0x7fee8c070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee8c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058514201 0 0) 0x7fee8c0cbb20 con 0x7fee8c157e90 2023-07-09T21:59:33.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.759+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee74003530 con 0x7fee8c157e90 2023-07-09T21:59:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2029123766 0 0) 0x7fee74003530 con 0x7fee8c157e90 2023-07-09T21:59:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 msgr2=0x7fee8c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee8c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 >> v2:172.21.15.119:3300/0 conn(0x7fee8c0c94a0 msgr2=0x7fee8c070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 --2- 172.21.15.37:0/2398373972 >> v2:172.21.15.119:3300/0 conn(0x7fee8c0c94a0 0x7fee8c070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0cbe00 con 0x7fee8c157e90 2023-07-09T21:59:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fee7c001680 con 0x7fee8c157e90 2023-07-09T21:59:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8affd640 1 --2- 172.21.15.37:0/2398373972 >> v2:172.21.15.119:3300/0 conn(0x7fee8c0c94a0 0x7fee8c070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:33.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 >> v1:172.21.15.37:6789/0 conn(0x7fee8c157e90 legacy=0x7fee8c06afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee74003980 0x7fee74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee740047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee74004d10 0x7fee74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c071330 con 0x7fee74004d10 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c06b6f0 con 0x7fee74003980 2023-07-09T21:59:33.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7400b990 con 0x7fee8c0cc8e0 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee74004d10 0x7fee74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8b7fe640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee74003980 0x7fee74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8affd640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee740047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 -- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 msgr2=0x7fee740047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee8c0cc8e0 0x7fee740047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 -- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee74003980 msgr2=0x7fee74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee74003980 0x7fee74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 -- 172.21.15.37:0/2398373972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee74003530 con 0x7fee74004d10 2023-07-09T21:59:33.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.763+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee74004d10 0x7fee74005180 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fee84009fc0 tx=0x7fee8401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aa9cf865a752eb server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840a5c70 con 0x7fee74004d10 2023-07-09T21:59:33.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400f040 con 0x7fee74004d10 2023-07-09T21:59:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8a7fc640 1 -- 172.21.15.37:0/2398373972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840ad440 con 0x7fee74004d10 2023-07-09T21:59:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- 172.21.15.37:0/2398373972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee74004d10 msgr2=0x7fee74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 --2- 172.21.15.37:0/2398373972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee74004d10 0x7fee74005180 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7fee84009fc0 tx=0x7fee8401cc00 comp rx=0 tx=0).stop 2023-07-09T21:59:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8bfff640 1 -- 172.21.15.37:0/2398373972 reap_dead start 2023-07-09T21:59:33.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- 172.21.15.37:0/2398373972 shutdown_connections 2023-07-09T21:59:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- 172.21.15.37:0/2398373972 >> 172.21.15.37:0/2398373972 conn(0x7fee8c0ca830 msgr2=0x7fee8c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- 172.21.15.37:0/2398373972 shutdown_connections 2023-07-09T21:59:33.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- 172.21.15.37:0/2398373972 wait complete. 2023-07-09T21:59:33.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 Processor -- start 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- start start 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee74004d10 0x7fee8c0c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee8c0c8400 0x7fee8c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c159510 con 0x7fee8c0c6c80 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0c53c0 con 0x7fee8c0c8400 2023-07-09T21:59:33.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee920ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee8c0c8870 con 0x7fee74004d10 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42648/0 (socket says 172.21.15.37:42648) 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8bfff640 1 -- 172.21.15.37:0/2746131418 learned_addr learned my addr 172.21.15.37:0/2746131418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8affd640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee8c0c8400 0x7fee8c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.767+0000 7fee8b7fe640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee74004d10 0x7fee8c0c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 -- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee74004d10 msgr2=0x7fee8c0c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee74004d10 0x7fee8c0c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 -- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee8c0c8400 msgr2=0x7fee8c0c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee8c0c8400 0x7fee8c0c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 -- 172.21.15.37:0/2746131418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee8c0c8b50 con 0x7fee8c0c6c80 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee8bfff640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fee8401c670 tx=0x7fee84009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840039f0 con 0x7fee8c0c6c80 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84003b70 con 0x7fee8c0c6c80 2023-07-09T21:59:33.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840ae890 con 0x7fee8c0c6c80 2023-07-09T21:59:33.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c0c8e30 con 0x7fee8c0c6c80 2023-07-09T21:59:33.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8c1ec280 con 0x7fee8c0c6c80 2023-07-09T21:59:33.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee8c0c92e0 con 0x7fee8c0c6c80 2023-07-09T21:59:33.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fee840b4040 con 0x7fee8c0c6c80 2023-07-09T21:59:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 0x7fee78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.771+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fee8411de60 con 0x7fee8c0c6c80 2023-07-09T21:59:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.775+0000 7fee8b7fe640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 0x7fee78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.775+0000 7fee8b7fe640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 0x7fee78068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee7c000c10 tx=0x7fee7c007900 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:33.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.775+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee840eb0c0 con 0x7fee8c0c6c80 2023-07-09T21:59:33.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee8c04d7d0 con 0x7fee8c0c6c80 2023-07-09T21:59:33.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee73fff640 1 -- 172.21.15.37:0/2746131418 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+3533 (secure 0 0 0) 0x7fee840b2090 con 0x7fee8c0c6c80 2023-07-09T21:59:33.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:33.968 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":71,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7898,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3481607490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3481607490},{"type":"v1","addr":"172.21.15.119:6836","nonce":3481607490}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9073,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1896613141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6833","nonce":1896613141},{"type":"v1","addr":"172.21.15.37:6835","nonce":1896613141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":9079,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3137674595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":3137674595},{"type":"v1","addr":"172.21.15.119:6837","nonce":3137674595}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":10107,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6834/241600367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":241600367},{"type":"v1","addr":"172.21.15.37:6834","nonce":241600367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[]} 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 71 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 msgr2=0x7fee78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 0x7fee78068850 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee7c000c10 tx=0x7fee7c007900 comp rx=0 tx=0).stop 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 msgr2=0x7fee8c1ebd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fee8401c670 tx=0x7fee84009750 comp rx=0 tx=0).stop 2023-07-09T21:59:33.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 shutdown_connections 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fee780663a0 0x7fee78068850 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee8c0c6c80 0x7fee8c1ebd40 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fee8c0c8400 0x7fee8c0c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 --2- 172.21.15.37:0/2746131418 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fee74004d10 0x7fee8c0c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.963+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 >> 172.21.15.37:0/2746131418 conn(0x7fee8c0ca830 msgr2=0x7fee8c06f840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.967+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 shutdown_connections 2023-07-09T21:59:33.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:33.967+0000 7fee920ec640 1 -- 172.21.15.37:0/2746131418 wait complete. 2023-07-09T21:59:33.988 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T21:59:33.989 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T21:59:33.989 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T21:59:33.989 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:59:33.989 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T21:59:33.990 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T21:59:33.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T21:59:33.990 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:59:33.991 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T21:59:33.991 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T21:59:33.991 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T21:59:33.991 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:59:33.992 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T21:59:33.992 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T21:59:33.992 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T21:59:33.993 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T21:59:34.002 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T21:59:34.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T21:59:34.003 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T21:59:34.003 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T21:59:34.007 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T21:59:34.007 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T21:59:34.009 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T21:59:34.009 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T21:59:34.047 INFO:tasks.ceph.mds.a:Started 2023-07-09T21:59:34.048 DEBUG:teuthology.parallel:result is None 2023-07-09T21:59:34.049 INFO:tasks.ceph.mds.c:Started 2023-07-09T21:59:34.050 DEBUG:teuthology.parallel:result is None 2023-07-09T21:59:34.055 INFO:tasks.ceph.mds.b:Started 2023-07-09T21:59:34.055 DEBUG:teuthology.parallel:result is None 2023-07-09T21:59:34.057 INFO:tasks.ceph.mds.d:Started 2023-07-09T21:59:34.058 DEBUG:teuthology.parallel:result is None 2023-07-09T21:59:34.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T21:59:34.136 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T21:59:34.137 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T21:59:34.145 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T21:59:34.147 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T21:59:34.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.203+0000 7fa8972ca640 1 Processor -- start 2023-07-09T21:59:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.203+0000 7fa8972ca640 1 -- start start 2023-07-09T21:59:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa8972ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa89006bf20 0x7fa8900cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa8972ca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8901592f0 con 0x7fa890156320 2023-07-09T21:59:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa8972ca640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa890159bb0 con 0x7fa890159780 2023-07-09T21:59:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa8972ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8901566f0 con 0x7fa89006bf20 2023-07-09T21:59:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895066640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa890156320 0x7fa890070120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46908/0 (socket says 172.21.15.37:46908) 2023-07-09T21:59:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895066640 1 -- 172.21.15.37:0/2259636827 learned_addr learned my addr 172.21.15.37:0/2259636827 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895867640 1 --2- 172.21.15.37:0/2259636827 >> v2:172.21.15.119:3300/0 conn(0x7fa89006bf20 0x7fa8900cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821820835 0 0) 0x7fa8901592f0 con 0x7fa890156320 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa87c003530 con 0x7fa890156320 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4019314036 0 0) 0x7fa87c003530 con 0x7fa890156320 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895867640 1 -- 172.21.15.37:0/2259636827 >> v1:172.21.15.119:6789/0 conn(0x7fa890159780 legacy=0x7fa89006b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895867640 1 -- 172.21.15.37:0/2259636827 >> v1:172.21.15.37:6789/0 conn(0x7fa890156320 legacy=0x7fa890070120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.207+0000 7fa895867640 1 -- 172.21.15.37:0/2259636827 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890070b50 con 0x7fa89006bf20 2023-07-09T21:59:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa895867640 1 --2- 172.21.15.37:0/2259636827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa89006bf20 0x7fa8900cd620 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa888009d90 tx=0x7fa88801c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ca34aeaf68a9a04 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900ce370 con 0x7fa89006bf20 2023-07-09T21:59:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8880a5680 con 0x7fa89006bf20 2023-07-09T21:59:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa887fff640 1 -- 172.21.15.37:0/2259636827 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c001800 con 0x7fa89006bf20 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- 172.21.15.37:0/2259636827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa89006bf20 msgr2=0x7fa8900cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 --2- 172.21.15.37:0/2259636827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa89006bf20 0x7fa8900cd620 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa888009d90 tx=0x7fa88801c840 comp rx=0 tx=0).stop 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- 172.21.15.37:0/2259636827 shutdown_connections 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 --2- 172.21.15.37:0/2259636827 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa89006bf20 0x7fa8900cd620 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- 172.21.15.37:0/2259636827 >> 172.21.15.37:0/2259636827 conn(0x7fa8900694c0 msgr2=0x7fa8900698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- 172.21.15.37:0/2259636827 shutdown_connections 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- 172.21.15.37:0/2259636827 wait complete. 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 Processor -- start 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.211+0000 7fa8972ca640 1 -- start start 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 0x7fa8900cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:34.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa890159780 0x7fa890149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa890140740 con 0x7fa89006bf20 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900cc690 con 0x7fa890156320 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8900cc970 con 0x7fa890159780 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42690/0 (socket says 172.21.15.37:42690) 2023-07-09T21:59:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 -- 172.21.15.37:0/805344438 learned_addr learned my addr 172.21.15.37:0/805344438 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895867640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa890159780 0x7fa890149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa894865640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 0x7fa8900cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 -- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa890159780 msgr2=0x7fa890149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa890159780 0x7fa890149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 -- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 msgr2=0x7fa8900cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 0x7fa8900cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 -- 172.21.15.37:0/805344438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa888009a70 con 0x7fa89006bf20 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa894865640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 0x7fa8900cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa895066640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c780 tx=0x7fa88c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c007270 con 0x7fa89006bf20 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa88c007410 con 0x7fa89006bf20 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa88c0057b0 con 0x7fa89006bf20 2023-07-09T21:59:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8900cc200 con 0x7fa89006bf20 2023-07-09T21:59:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8901495a0 con 0x7fa89006bf20 2023-07-09T21:59:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.215+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8900cb600 con 0x7fa89006bf20 2023-07-09T21:59:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.219+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa88c005930 con 0x7fa89006bf20 2023-07-09T21:59:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.219+0000 7fa885ffb640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.219+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 6384+0+0 (secure 0 0 0) 0x7fa88c0835c0 con 0x7fa89006bf20 2023-07-09T21:59:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.219+0000 7fa894865640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.219+0000 7fa894865640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa89014ac80 tx=0x7fa880009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:34.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.223+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8900cb600 con 0x7fa89006bf20 2023-07-09T21:59:34.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:34.391+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa8900cb600 con 0x7fa89006bf20 2023-07-09T21:59:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.383+0000 7fa885ffb640 1 -- 172.21.15.37:0/805344438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v172) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa8900cb600 con 0x7fa89006bf20 2023-07-09T21:59:35.389 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T21:59:35.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 msgr2=0x7fa874068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 0x7fa874068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa89014ac80 tx=0x7fa880009040 comp rx=0 tx=0).stop 2023-07-09T21:59:35.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 msgr2=0x7fa8901412b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fa88c00c780 tx=0x7fa88c00cc40 comp rx=0 tx=0).stop 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 shutdown_connections 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fa8740663a0 0x7fa874068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa890159780 0x7fa890149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa890156320 0x7fa8900cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 --2- 172.21.15.37:0/805344438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa89006bf20 0x7fa8901412b0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 >> 172.21.15.37:0/805344438 conn(0x7fa8900694c0 msgr2=0x7fa89006ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:35.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 shutdown_connections 2023-07-09T21:59:35.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.387+0000 7fa8972ca640 1 -- 172.21.15.37:0/805344438 wait complete. 2023-07-09T21:59:35.416 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T21:59:35.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:59:35.545 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T21:59:35.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 Processor -- start 2023-07-09T21:59:35.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 -- start start 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58dc0c9a10 0x7f58dc0af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc15be00 0x7f58dc0afd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc0cbcd0 con 0x7f58dc06b8a0 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58dc0ca2b0 con 0x7f58dc0c9a10 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58e1618640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc15c2d0 con 0x7f58dc15be00 2023-07-09T21:59:35.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58dc0c9a10 0x7f58dc0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f58dc0c9a10 0x7f58dc0af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42696/0 (socket says 172.21.15.37:42696) 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 -- 172.21.15.37:0/618712468 learned_addr learned my addr 172.21.15.37:0/618712468 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58d3fff640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc15be00 0x7f58dc0afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 -- 172.21.15.37:0/618712468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc15be00 msgr2=0x7f58dc0afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc15be00 0x7f58dc0afd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 -- 172.21.15.37:0/618712468 >> v1:172.21.15.37:6789/0 conn(0x7f58dc06b8a0 legacy=0x7f58dc15f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58daffd640 1 -- 172.21.15.37:0/618712468 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc15c5b0 con 0x7f58dc0c9a10 2023-07-09T21:59:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.563+0000 7f58da7fc640 1 -- 172.21.15.37:0/618712468 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629028081 0 0) 0x7f58dc0cbcd0 con 0x7f58dc06b8a0 2023-07-09T21:59:35.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58daffd640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0af830 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44f83590f35ecfe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58da7fc640 1 -- 172.21.15.37:0/618712468 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0aa670 con 0x7f58dc0c9a10 2023-07-09T21:59:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58da7fc640 1 -- 172.21.15.37:0/618712468 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0aa7d0 con 0x7f58dc0c9a10 2023-07-09T21:59:35.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58da7fc640 1 -- 172.21.15.37:0/618712468 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0aab60 con 0x7f58dc0c9a10 2023-07-09T21:59:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 -- 172.21.15.37:0/618712468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc0c9a10 msgr2=0x7f58dc0af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0af830 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f58cc009870 tx=0x7f58cc01c510 comp rx=0 tx=0).stop 2023-07-09T21:59:35.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 -- 172.21.15.37:0/618712468 shutdown_connections 2023-07-09T21:59:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc15be00 0x7f58dc0afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 --2- 172.21.15.37:0/618712468 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0af830 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 -- 172.21.15.37:0/618712468 >> 172.21.15.37:0/618712468 conn(0x7f58dc0694c0 msgr2=0x7f58dc0698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 -- 172.21.15.37:0/618712468 shutdown_connections 2023-07-09T21:59:35.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.567+0000 7f58e1618640 1 -- 172.21.15.37:0/618712468 wait complete. 2023-07-09T21:59:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 Processor -- start 2023-07-09T21:59:35.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- start start 2023-07-09T21:59:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc06b8a0 0x7f58dc146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0b2c50 con 0x7f58dc15be00 2023-07-09T21:59:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc1550f0 con 0x7f58dc0c9a10 2023-07-09T21:59:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc1553d0 con 0x7f58dc06b8a0 2023-07-09T21:59:35.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42704/0 (socket says 172.21.15.37:42704) 2023-07-09T21:59:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 -- 172.21.15.37:0/1994531892 learned_addr learned my addr 172.21.15.37:0/1994531892 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58daffd640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc06b8a0 0x7f58dc146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58d3fff640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 -- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc06b8a0 msgr2=0x7f58dc146130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc06b8a0 0x7f58dc146130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 -- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 msgr2=0x7f58dc0c50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0c50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 -- 172.21.15.37:0/1994531892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0094d0 con 0x7f58dc15be00 2023-07-09T21:59:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58d3fff640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:35.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58db7fe640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f58d4007fd0 tx=0x7f58d400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4003e00 con 0x7f58dc15be00 2023-07-09T21:59:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4005070 con 0x7f58dc15be00 2023-07-09T21:59:35.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc0b28e0 con 0x7f58dc15be00 2023-07-09T21:59:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4005460 con 0x7f58dc15be00 2023-07-09T21:59:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc0b2590 con 0x7f58dc15be00 2023-07-09T21:59:35.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.571+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc0b2a70 con 0x7f58dc15be00 2023-07-09T21:59:35.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.575+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f58d40055c0 con 0x7f58dc15be00 2023-07-09T21:59:35.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.575+0000 7f58d37fe640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 0x7f58bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.575+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f58d4083330 con 0x7f58dc15be00 2023-07-09T21:59:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.575+0000 7f58daffd640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 0x7f58bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.575+0000 7f58daffd640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 0x7f58bc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0ae000 tx=0x7f58cc0b5040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.579+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58d4050a50 con 0x7f58dc15be00 2023-07-09T21:59:35.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.787+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f58dc04d7d0 con 0x7f58dc15be00 2023-07-09T21:59:35.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.787+0000 7f58d37fe640 1 -- 172.21.15.37:0/1994531892 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f58d4005870 con 0x7f58dc15be00 2023-07-09T21:59:35.793 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:35.793 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:59:35.793 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T21:59:35.793 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.793 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.794 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.795 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.796 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T21:59:35.797 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T21:59:35.797 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.797 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.797 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:59:35.797 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:59:35.799 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.799 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.800 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.800 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.800 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T21:59:35.800 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T21:59:35.801 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.801 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.801 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:59:35.801 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:59:35.802 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.802 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.802 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.802 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.802 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T21:59:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T21:59:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.803 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.804 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T21:59:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T21:59:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.805 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.806 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T21:59:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T21:59:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.807 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.808 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T21:59:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T21:59:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.809 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.810 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.811 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.812 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.813 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.814 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T21:59:35.815 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T21:59:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.816 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T21:59:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T21:59:35.817 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T21:59:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T21:59:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.819 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T21:59:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T21:59:35.820 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:59:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:59:35.821 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:59:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.822 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T21:59:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T21:59:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.823 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.824 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:59:35.824 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:59:35.824 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:59:35.824 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.825 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.825 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.825 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T21:59:35.825 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T21:59:35.825 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T21:59:35.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T21:59:35.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T21:59:35.827 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T21:59:35.827 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.827 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.827 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.827 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.828 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:59:35.829 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T21:59:35.830 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T21:59:35.831 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:59:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 msgr2=0x7f58bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 0x7f58bc068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0ae000 tx=0x7f58cc0b5040 comp rx=0 tx=0).stop 2023-07-09T21:59:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 msgr2=0x7f58dc15a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f58d4007fd0 tx=0x7f58d400cc70 comp rx=0 tx=0).stop 2023-07-09T21:59:35.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 shutdown_connections 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f58bc0663a0 0x7f58bc068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58dc15be00 0x7f58dc15a4f0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f58dc0c9a10 0x7f58dc0c50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 --2- 172.21.15.37:0/1994531892 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f58dc06b8a0 0x7f58dc146130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 >> 172.21.15.37:0/1994531892 conn(0x7f58dc0694c0 msgr2=0x7f58dc06f080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 shutdown_connections 2023-07-09T21:59:35.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.791+0000 7f58e1618640 1 -- 172.21.15.37:0/1994531892 wait complete. 2023-07-09T21:59:35.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:35.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 Processor -- start 2023-07-09T21:59:35.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 -- start start 2023-07-09T21:59:35.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3180b7ab0 0x7fe31806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180b4340 0x7fe3180d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3180b49f0 con 0x7fe3180cef80 2023-07-09T21:59:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3180b7e80 con 0x7fe3180b7ab0 2023-07-09T21:59:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe31d69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180cc8a0 con 0x7fe3180b4340 2023-07-09T21:59:35.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.975+0000 7fe316ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3180b7ab0 0x7fe31806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3180b7ab0 0x7fe31806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42720/0 (socket says 172.21.15.37:42720) 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 -- 172.21.15.37:0/2778781264 learned_addr learned my addr 172.21.15.37:0/2778781264 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe3177fe640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180b4340 0x7fe3180d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 -- 172.21.15.37:0/2778781264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180b4340 msgr2=0x7fe3180d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180b4340 0x7fe3180d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 -- 172.21.15.37:0/2778781264 >> v1:172.21.15.119:6789/0 conn(0x7fe3180cef80 legacy=0x7fe3180b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 -- 172.21.15.37:0/2778781264 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180ccb80 con 0x7fe3180b7ab0 2023-07-09T21:59:35.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe316ffd640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe31806aa50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe308009870 tx=0x7fe30801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0f11f03c8bbe14 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe3167fc640 1 -- 172.21.15.37:0/2778781264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080aa670 con 0x7fe3180b7ab0 2023-07-09T21:59:35.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe3167fc640 1 -- 172.21.15.37:0/2778781264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3080aa7d0 con 0x7fe3180b7ab0 2023-07-09T21:59:35.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.979+0000 7fe3167fc640 1 -- 172.21.15.37:0/2778781264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080aab60 con 0x7fe3180b7ab0 2023-07-09T21:59:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- 172.21.15.37:0/2778781264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 msgr2=0x7fe31806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe31806aa50 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fe308009870 tx=0x7fe30801c510 comp rx=0 tx=0).stop 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- 172.21.15.37:0/2778781264 shutdown_connections 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180b4340 0x7fe3180d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2778781264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe31806aa50 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- 172.21.15.37:0/2778781264 >> 172.21.15.37:0/2778781264 conn(0x7fe318073090 msgr2=0x7fe318069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- 172.21.15.37:0/2778781264 shutdown_connections 2023-07-09T21:59:35.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- 172.21.15.37:0/2778781264 wait complete. 2023-07-09T21:59:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 Processor -- start 2023-07-09T21:59:35.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- start start 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3180b4340 0x7fe31814d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180cef80 0x7fe3180b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180c8350 con 0x7fe3180b7ab0 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180c8630 con 0x7fe3180b4340 2023-07-09T21:59:35.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe31d69e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180b51a0 con 0x7fe3180cef80 2023-07-09T21:59:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42724/0 (socket says 172.21.15.37:42724) 2023-07-09T21:59:35.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 -- 172.21.15.37:0/2634914805 learned_addr learned my addr 172.21.15.37:0/2634914805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe316ffd640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3180b4340 0x7fe31814d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe3177fe640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180cef80 0x7fe3180b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 -- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180cef80 msgr2=0x7fe3180b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180cef80 0x7fe3180b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 -- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3180b4340 msgr2=0x7fe31814d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3180b4340 0x7fe31814d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.983+0000 7fe30ffff640 1 -- 172.21.15.37:0/2634914805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3080094d0 con 0x7fe3180b7ab0 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30ffff640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c390 tx=0x7fe30000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3000052d0 con 0x7fe3180b7ab0 2023-07-09T21:59:35.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe300005430 con 0x7fe3180b7ab0 2023-07-09T21:59:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3180b5480 con 0x7fe3180b7ab0 2023-07-09T21:59:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300003820 con 0x7fe3180b7ab0 2023-07-09T21:59:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3180c7f90 con 0x7fe3180b7ab0 2023-07-09T21:59:35.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3180b4fe0 con 0x7fe3180b7ab0 2023-07-09T21:59:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe300003980 con 0x7fe3180b7ab0 2023-07-09T21:59:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 0x7fe2f8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7fe300082fe0 con 0x7fe3180b7ab0 2023-07-09T21:59:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.987+0000 7fe316ffd640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 0x7fe2f8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:35.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.991+0000 7fe316ffd640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 0x7fe2f8068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe3080ae000 tx=0x7fe3080a7000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:35.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:35.991+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3000506b0 con 0x7fe3180b7ab0 2023-07-09T21:59:36.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3180b5670 con 0x7fe3180b7ab0 2023-07-09T21:59:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe30f7fe640 1 -- 172.21.15.37:0/2634914805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v172) v1 ==== 74+0+14727 (secure 0 0 0) 0x7fe300053cd0 con 0x7fe3180b7ab0 2023-07-09T21:59:36.155 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:36.155 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":172,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:35.383111+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":156,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 msgr2=0x7fe2f8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 0x7fe2f8068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe3080ae000 tx=0x7fe3080a7000 comp rx=0 tx=0).stop 2023-07-09T21:59:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 msgr2=0x7fe3180c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fe30000c390 tx=0x7fe30000c850 comp rx=0 tx=0).stop 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 shutdown_connections 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe2f80663d0 0x7fe2f8068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3180cef80 0x7fe3180b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3180b7ab0 0x7fe3180c7a50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 --2- 172.21.15.37:0/2634914805 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3180b4340 0x7fe31814d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 >> 172.21.15.37:0/2634914805 conn(0x7fe318073090 msgr2=0x7fe3180d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 shutdown_connections 2023-07-09T21:59:36.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.151+0000 7fe31d69e640 1 -- 172.21.15.37:0/2634914805 wait complete. 2023-07-09T21:59:36.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T21:59:36.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T21:59:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 Processor -- start 2023-07-09T21:59:36.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 -- start start 2023-07-09T21:59:36.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe4a00c3e10 0x7fe4a00c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a015c200 0x7fe4a015c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a00c9090 con 0x7fe4a01585b0 2023-07-09T21:59:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a00cbf40 con 0x7fe4a00c3e10 2023-07-09T21:59:36.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a678f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a00c47d0 con 0x7fe4a015c200 2023-07-09T21:59:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe4a4d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a015c200 0x7fe4a015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49f7fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe4a00c3e10 0x7fe4a00c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49ffff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe4a01585b0 0x7fe4a006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:47114/0 (socket says 172.21.15.37:47114) 2023-07-09T21:59:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49ffff640 1 -- 172.21.15.37:0/3002309153 learned_addr learned my addr 172.21.15.37:0/3002309153 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49f7fe640 1 -- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a015c200 msgr2=0x7fe4a015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:36.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49f7fe640 1 --2- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a015c200 0x7fe4a015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49f7fe640 1 -- 172.21.15.37:0/3002309153 >> v1:172.21.15.119:6789/0 conn(0x7fe4a01585b0 legacy=0x7fe4a006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49f7fe640 1 -- 172.21.15.37:0/3002309153 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a015cbc0 con 0x7fe4a00c3e10 2023-07-09T21:59:36.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.319+0000 7fe49effd640 1 -- 172.21.15.37:0/3002309153 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342720289 0 0) 0x7fe4a00c9090 con 0x7fe4a01585b0 2023-07-09T21:59:36.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe49f7fe640 1 --2- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a00c3e10 0x7fe4a00c4290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe4940097c0 tx=0x7fe49401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7088768c5c1de5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe49effd640 1 -- 172.21.15.37:0/3002309153 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940a6040 con 0x7fe4a00c3e10 2023-07-09T21:59:36.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe49effd640 1 -- 172.21.15.37:0/3002309153 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4940aa600 con 0x7fe4a00c3e10 2023-07-09T21:59:36.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe49effd640 1 -- 172.21.15.37:0/3002309153 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940aa990 con 0x7fe4a00c3e10 2023-07-09T21:59:36.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 -- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a00c3e10 msgr2=0x7fe4a00c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 --2- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a00c3e10 0x7fe4a00c4290 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe4940097c0 tx=0x7fe49401c480 comp rx=0 tx=0).stop 2023-07-09T21:59:36.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 -- 172.21.15.37:0/3002309153 shutdown_connections 2023-07-09T21:59:36.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 --2- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a015c200 0x7fe4a015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 --2- 172.21.15.37:0/3002309153 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a00c3e10 0x7fe4a00c4290 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 -- 172.21.15.37:0/3002309153 >> 172.21.15.37:0/3002309153 conn(0x7fe4a00cde40 msgr2=0x7fe4a00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:36.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 -- 172.21.15.37:0/3002309153 shutdown_connections 2023-07-09T21:59:36.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.323+0000 7fe4a678f640 1 -- 172.21.15.37:0/3002309153 wait complete. 2023-07-09T21:59:36.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 Processor -- start 2023-07-09T21:59:36.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 -- start start 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a00c3e10 0x7fe4a014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a015c200 0x7fe4a0149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014cb40 con 0x7fe4a01585b0 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014ea20 con 0x7fe4a015c200 2023-07-09T21:59:36.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a678f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a014d530 con 0x7fe4a00c3e10 2023-07-09T21:59:36.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42736/0 (socket says 172.21.15.37:42736) 2023-07-09T21:59:36.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 -- 172.21.15.37:0/651090841 learned_addr learned my addr 172.21.15.37:0/651090841 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:36.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49ffff640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a00c3e10 0x7fe4a014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe4a4d2c640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a015c200 0x7fe4a0149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 -- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a00c3e10 msgr2=0x7fe4a014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a00c3e10 0x7fe4a014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 -- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a015c200 msgr2=0x7fe4a0149330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a015c200 0x7fe4a0149330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 -- 172.21.15.37:0/651090841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494009420 con 0x7fe4a01585b0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.327+0000 7fe49f7fe640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe49401a0b0 tx=0x7fe49401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940b18d0 con 0x7fe4a01585b0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4940b1a30 con 0x7fe4a01585b0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4940b1dc0 con 0x7fe4a01585b0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a014d810 con 0x7fe4a01585b0 2023-07-09T21:59:36.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a013fe80 con 0x7fe4a01585b0 2023-07-09T21:59:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a015d0b0 con 0x7fe4a01585b0 2023-07-09T21:59:36.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe4940b33f0 con 0x7fe4a01585b0 2023-07-09T21:59:36.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 0x7fe48c06cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7fe49411e180 con 0x7fe4a01585b0 2023-07-09T21:59:36.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.331+0000 7fe49ffff640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 0x7fe48c06cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.335+0000 7fe49ffff640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 0x7fe48c06cc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe490007fd0 tx=0x7fe490007d60 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.335+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4940eb700 con 0x7fe4a01585b0 2023-07-09T21:59:36.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.491+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4a004d7d0 con 0x7fe4a01585b0 2023-07-09T21:59:36.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.491+0000 7fe49cff9640 1 -- 172.21.15.37:0/651090841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v172) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe4940eed20 con 0x7fe4a01585b0 2023-07-09T21:59:36.496 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 msgr2=0x7fe48c06cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 0x7fe48c06cc90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe490007fd0 tx=0x7fe490007d60 comp rx=0 tx=0).stop 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 msgr2=0x7fe4a014b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fe49401a0b0 tx=0x7fe49401acc0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 shutdown_connections 2023-07-09T21:59:36.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe48c06a7e0 0x7fe48c06cc90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe4a015c200 0x7fe4a0149330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4a01585b0 0x7fe4a014b9e0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 --2- 172.21.15.37:0/651090841 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe4a00c3e10 0x7fe4a014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 >> 172.21.15.37:0/651090841 conn(0x7fe4a00cde40 msgr2=0x7fe4a00709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 shutdown_connections 2023-07-09T21:59:36.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.495+0000 7fe4a678f640 1 -- 172.21.15.37:0/651090841 wait complete. 2023-07-09T21:59:36.517 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T21:59:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.659+0000 7f9ca6382640 1 Processor -- start 2023-07-09T21:59:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.659+0000 7f9ca6382640 1 -- start start 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.659+0000 7f9ca6382640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 0x7f9ca006b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.659+0000 7f9ca6382640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ca006b970 0x7f9ca00c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.659+0000 7f9ca6382640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca00c9090 con 0x7f9ca00c4350 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9ca6382640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca00cbf40 con 0x7f9ca006b970 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9ca6382640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca00c4780 con 0x7f9ca01585b0 2023-07-09T21:59:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ca006b970 0x7f9ca00c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ca006b970 0x7f9ca00c3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42738/0 (socket says 172.21.15.37:42738) 2023-07-09T21:59:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/224848815 learned_addr learned my addr 172.21.15.37:0/224848815 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9ffff640 1 --2- 172.21.15.37:0/224848815 >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 0x7f9ca006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/224848815 >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 msgr2=0x7f9ca006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 --2- 172.21.15.37:0/224848815 >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 0x7f9ca006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/224848815 >> v1:172.21.15.119:6789/0 conn(0x7f9ca00c4350 legacy=0x7f9ca015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/224848815 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00c8a60 con 0x7f9ca006b970 2023-07-09T21:59:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9ffff640 1 --2- 172.21.15.37:0/224848815 >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 0x7f9ca006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9f7fe640 1 --2- 172.21.15.37:0/224848815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca006b970 0x7f9ca00c3e10 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00c4ce0 tx=0x7f9c9401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a110371bdae5b2d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9effd640 1 -- 172.21.15.37:0/224848815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940a7c30 con 0x7f9ca006b970 2023-07-09T21:59:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9effd640 1 -- 172.21.15.37:0/224848815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940a7d90 con 0x7f9ca006b970 2023-07-09T21:59:36.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.663+0000 7f9c9effd640 1 -- 172.21.15.37:0/224848815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940af660 con 0x7f9ca006b970 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- 172.21.15.37:0/224848815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca006b970 msgr2=0x7f9ca00c3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- 172.21.15.37:0/224848815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca006b970 0x7f9ca00c3e10 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00c4ce0 tx=0x7f9c9401eb60 comp rx=0 tx=0).stop 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- 172.21.15.37:0/224848815 shutdown_connections 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- 172.21.15.37:0/224848815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca006b970 0x7f9ca00c3e10 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- 172.21.15.37:0/224848815 >> v2:172.21.15.119:3300/0 conn(0x7f9ca01585b0 0x7f9ca006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- 172.21.15.37:0/224848815 >> 172.21.15.37:0/224848815 conn(0x7f9ca00cde40 msgr2=0x7f9ca00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- 172.21.15.37:0/224848815 shutdown_connections 2023-07-09T21:59:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- 172.21.15.37:0/224848815 wait complete. 2023-07-09T21:59:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 Processor -- start 2023-07-09T21:59:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- start start 2023-07-09T21:59:36.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ca006b970 0x7f9ca00af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ca01585b0 0x7f9ca01430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0142380 con 0x7f9ca00c4350 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00afb40 con 0x7f9ca006b970 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca6382640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0142160 con 0x7f9ca01585b0 2023-07-09T21:59:36.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9c9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9c9f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42740/0 (socket says 172.21.15.37:42740) 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/3179085904 learned_addr learned my addr 172.21.15.37:0/3179085904 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9c9ffff640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ca006b970 0x7f9ca00af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.667+0000 7f9ca491f640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ca01585b0 0x7f9ca01430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ca01585b0 msgr2=0x7f9ca01430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ca01585b0 0x7f9ca01430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ca006b970 msgr2=0x7f9ca00af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ca006b970 0x7f9ca00af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 -- 172.21.15.37:0/3179085904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9400b770 con 0x7f9ca00c4350 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9f7fe640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b2c0 tx=0x7f9c9401b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940afb40 con 0x7f9ca00c4350 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940afca0 con 0x7f9ca00c4350 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940ba680 con 0x7f9ca00c4350 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca00afdc0 con 0x7f9ca00c4350 2023-07-09T21:59:36.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca01428b0 con 0x7f9ca00c4350 2023-07-09T21:59:36.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca004d7d0 con 0x7f9ca00c4350 2023-07-09T21:59:36.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9c940b93e0 con 0x7f9ca00c4350 2023-07-09T21:59:36.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.671+0000 7f9c9cff9640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 0x7f9c8c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:36.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.675+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f9c9411e0d0 con 0x7f9ca00c4350 2023-07-09T21:59:36.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.675+0000 7f9c9ffff640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 0x7f9c8c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:36.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.675+0000 7f9c9ffff640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 0x7f9c8c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:36.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.675+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9c940eb760 con 0x7f9ca00c4350 2023-07-09T21:59:36.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.831+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ca006b210 con 0x7f9ca00c4350 2023-07-09T21:59:36.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.831+0000 7f9c9cff9640 1 -- 172.21.15.37:0/3179085904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v172) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9c940eed80 con 0x7f9ca00c4350 2023-07-09T21:59:36.836 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T21:59:36.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 msgr2=0x7f9c8c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 0x7f9c8c068880 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9c90006fd0 tx=0x7f9c90008040 comp rx=0 tx=0).stop 2023-07-09T21:59:36.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 msgr2=0x7f9ca0141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400b2c0 tx=0x7f9c9401b900 comp rx=0 tx=0).stop 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 shutdown_connections 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f9c8c0663d0 0x7f9c8c068880 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ca01585b0 0x7f9ca01430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ca00c4350 0x7f9ca0141c20 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 --2- 172.21.15.37:0/3179085904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ca006b970 0x7f9ca00af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 >> 172.21.15.37:0/3179085904 conn(0x7f9ca00cde40 msgr2=0x7f9ca006ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:36.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 shutdown_connections 2023-07-09T21:59:36.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.835+0000 7f9ca6382640 1 -- 172.21.15.37:0/3179085904 wait complete. 2023-07-09T21:59:36.856 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T21:59:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 Processor -- start 2023-07-09T21:59:36.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 -- start start 2023-07-09T21:59:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef40b4340 0x7f7ef406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7ef40cef80 0x7f7ef40d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40b49f0 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef40b7e80 con 0x7f7ef40cef80 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef97fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40cc8a0 con 0x7f7ef40b4340 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ef40b7ab0 0x7f7ef40b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:46924/0 (socket says 172.21.15.37:46924) 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef2ffd640 1 -- 172.21.15.37:0/1210002927 learned_addr learned my addr 172.21.15.37:0/1210002927 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7eebfff640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef40b4340 0x7f7ef406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/1210002927 >> v2:172.21.15.119:3300/0 conn(0x7f7ef40cef80 0x7f7ef40d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205743764 0 0) 0x7f7ef40b49f0 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.995+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ee0003530 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3818009224 0 0) 0x7f7ee0003530 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef40b4340 msgr2=0x7f7ef406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef40b4340 0x7f7ef406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 >> v2:172.21.15.119:3300/0 conn(0x7f7ef40cef80 msgr2=0x7f7ef40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:37.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/1210002927 >> v2:172.21.15.119:3300/0 conn(0x7f7ef40cef80 0x7f7ef40d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef40ccb80 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7ee4001680 con 0x7f7ef40b7ab0 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 >> v1:172.21.15.37:6789/0 conn(0x7f7ef40b7ab0 legacy=0x7f7ef40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ee0003980 0x7f7ee0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee0004360 0x7f7ee0004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004ea0 0x7f7ee000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40cc8a0 con 0x7f7ee0004360 2023-07-09T21:59:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000bed0 con 0x7f7ee0004ea0 2023-07-09T21:59:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee000c010 con 0x7f7ee0003980 2023-07-09T21:59:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee0004360 0x7f7ee0004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef2ffd640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ee0003980 0x7f7ee0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004ea0 0x7f7ee000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 -- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ee0003980 msgr2=0x7f7ee0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ee0003980 0x7f7ee0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 -- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004ea0 msgr2=0x7f7ee000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004ea0 0x7f7ee000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7eebfff640 1 -- 172.21.15.37:0/1210002927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0003530 con 0x7f7ee0004360 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:36.999+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004ea0 0x7f7ee000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:37.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7eebfff640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee0004360 0x7f7ee0004830 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b8300 tx=0x7f7edc01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5279fde2445972e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0ab400 con 0x7f7ee0004360 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc0a7050 con 0x7f7ee0004360 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef27fc640 1 -- 172.21.15.37:0/1210002927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7edc0ab7e0 con 0x7f7ee0004360 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- 172.21.15.37:0/1210002927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee0004360 msgr2=0x7f7ee0004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/1210002927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ee0004360 0x7f7ee0004830 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40b8300 tx=0x7f7edc01c8d0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef37fe640 1 -- 172.21.15.37:0/1210002927 reap_dead start 2023-07-09T21:59:37.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- 172.21.15.37:0/1210002927 shutdown_connections 2023-07-09T21:59:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- 172.21.15.37:0/1210002927 >> 172.21.15.37:0/1210002927 conn(0x7f7ef4073090 msgr2=0x7f7ef4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- 172.21.15.37:0/1210002927 shutdown_connections 2023-07-09T21:59:37.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- 172.21.15.37:0/1210002927 wait complete. 2023-07-09T21:59:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 Processor -- start 2023-07-09T21:59:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- start start 2023-07-09T21:59:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004360 0x7f7ef40c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef4157ae0 0x7f7ef40c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4145e30 con 0x7f7ef41f0380 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4158330 con 0x7f7ee0004360 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.003+0000 7f7ef97fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef4158610 con 0x7f7ef4157ae0 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42750/0 (socket says 172.21.15.37:42750) 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 -- 172.21.15.37:0/4153864231 learned_addr learned my addr 172.21.15.37:0/4153864231 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:37.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7eebfff640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef4157ae0 0x7f7ef40c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef2ffd640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004360 0x7f7ef40c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 -- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef4157ae0 msgr2=0x7f7ef40c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef4157ae0 0x7f7ef40c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 -- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004360 msgr2=0x7f7ef40c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004360 0x7f7ef40c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 -- 172.21.15.37:0/4153864231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef41588f0 con 0x7f7ef41f0380 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef37fe640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40716a0 tx=0x7f7eec011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec01c070 con 0x7f7ef41f0380 2023-07-09T21:59:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00f040 con 0x7f7ef41f0380 2023-07-09T21:59:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00e040 con 0x7f7ef41f0380 2023-07-09T21:59:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef41460d0 con 0x7f7ef41f0380 2023-07-09T21:59:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef4157f30 con 0x7f7ef41f0380 2023-07-09T21:59:37.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef404d7d0 con 0x7f7ef41f0380 2023-07-09T21:59:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.007+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7eec015640 con 0x7f7ef41f0380 2023-07-09T21:59:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.011+0000 7f7eeb7fe640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 0x7f7ed4068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.011+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f7eec083570 con 0x7f7ef41f0380 2023-07-09T21:59:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.011+0000 7f7ef2ffd640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 0x7f7ed4068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.011+0000 7f7ef2ffd640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 0x7f7ed4068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000c10 tx=0x7f7ee4007900 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.011+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7eec0544d0 con 0x7f7ef41f0380 2023-07-09T21:59:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7ef406a830 con 0x7f7ef41f0380 2023-07-09T21:59:37.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7eeb7fe640 1 -- 172.21.15.37:0/4153864231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v172) v1 ==== 84+0+126 (secure 0 0 0) 0x7f7eec054060 con 0x7f7ef41f0380 2023-07-09T21:59:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:37.175 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:59:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T21:59:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:37.176 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:59:37.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 msgr2=0x7f7ed4068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 0x7f7ed4068880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4000c10 tx=0x7f7ee4007900 comp rx=0 tx=0).stop 2023-07-09T21:59:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 msgr2=0x7f7ef41f07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40716a0 tx=0x7f7eec011e00 comp rx=0 tx=0).stop 2023-07-09T21:59:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 shutdown_connections 2023-07-09T21:59:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f7ed40663d0 0x7f7ed4068880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ef41f0380 0x7f7ef41f07f0 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7ef4157ae0 0x7f7ef40c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 --2- 172.21.15.37:0/4153864231 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7ee0004360 0x7f7ef40c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 >> 172.21.15.37:0/4153864231 conn(0x7f7ef4073090 msgr2=0x7f7ef40b3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 shutdown_connections 2023-07-09T21:59:37.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.171+0000 7f7ef97fa640 1 -- 172.21.15.37:0/4153864231 wait complete. 2023-07-09T21:59:37.196 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T21:59:37.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T21:59:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.339+0000 7fc0797e9640 1 Processor -- start 2023-07-09T21:59:37.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.339+0000 7fc0797e9640 1 -- start start 2023-07-09T21:59:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc0797e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0740b7980 0x7fc074160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc0797e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 0x7fc0740cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc0797e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07415bf80 con 0x7fc0740b3c20 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc0797e9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0740cd070 con 0x7fc0740b7980 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc0797e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740cfd70 con 0x7fc0740ceb80 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0740b7980 0x7fc074160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc0740b7980 0x7fc074160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51700/0 (socket says 172.21.15.37:51700) 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 -- 172.21.15.37:0/1700641746 learned_addr learned my addr 172.21.15.37:0/1700641746 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:37.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc06bfff640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 0x7fc0740cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 -- 172.21.15.37:0/1700641746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 msgr2=0x7fc0740cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 0x7fc0740cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 -- 172.21.15.37:0/1700641746 >> v1:172.21.15.119:6789/0 conn(0x7fc0740b3c20 legacy=0x7fc0740b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 -- 172.21.15.37:0/1700641746 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074160570 con 0x7fc0740b7980 2023-07-09T21:59:37.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc06bfff640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 0x7fc0740cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:37.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.343+0000 7fc072ffd640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc074160030 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc06401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69867fa654344ae server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0727fc640 1 -- 172.21.15.37:0/1700641746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640ab600 con 0x7fc0740b7980 2023-07-09T21:59:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0727fc640 1 -- 172.21.15.37:0/1700641746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0640a7050 con 0x7fc0740b7980 2023-07-09T21:59:37.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0727fc640 1 -- 172.21.15.37:0/1700641746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0640ab980 con 0x7fc0740b7980 2023-07-09T21:59:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- 172.21.15.37:0/1700641746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 msgr2=0x7fc074160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc074160030 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fc064009870 tx=0x7fc06401c540 comp rx=0 tx=0).stop 2023-07-09T21:59:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- 172.21.15.37:0/1700641746 shutdown_connections 2023-07-09T21:59:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740ceb80 0x7fc0740cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- 172.21.15.37:0/1700641746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc074160030 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- 172.21.15.37:0/1700641746 >> 172.21.15.37:0/1700641746 conn(0x7fc074073090 msgr2=0x7fc074069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- 172.21.15.37:0/1700641746 shutdown_connections 2023-07-09T21:59:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- 172.21.15.37:0/1700641746 wait complete. 2023-07-09T21:59:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 Processor -- start 2023-07-09T21:59:37.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- start start 2023-07-09T21:59:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740b3c20 0x7fc0740c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 0x7fc0740c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740c84f0 con 0x7fc0740b7980 2023-07-09T21:59:37.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740c9de0 con 0x7fc0740ceb80 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc0797e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0740ca0c0 con 0x7fc0740b3c20 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc06bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51704/0 (socket says 172.21.15.37:51704) 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.347+0000 7fc06bfff640 1 -- 172.21.15.37:0/3964639974 learned_addr learned my addr 172.21.15.37:0/3964639974 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc072ffd640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740b3c20 0x7fc0740c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc0737fe640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 0x7fc0740c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 -- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740b3c20 msgr2=0x7fc0740c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740b3c20 0x7fc0740c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 -- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 msgr2=0x7fc0740c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 0x7fc0740c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 -- 172.21.15.37:0/3964639974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640094d0 con 0x7fc0740b7980 2023-07-09T21:59:37.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc0737fe640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 0x7fc0740c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06bfff640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e810 tx=0x7fc05c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00c8d0 con 0x7fc0740b7980 2023-07-09T21:59:37.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c00ca30 con 0x7fc0740b7980 2023-07-09T21:59:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00cde0 con 0x7fc0740b7980 2023-07-09T21:59:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0740ca3a0 con 0x7fc0740b7980 2023-07-09T21:59:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0740ca960 con 0x7fc0740b7980 2023-07-09T21:59:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07404d7d0 con 0x7fc0740b7980 2023-07-09T21:59:37.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.351+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc05c013410 con 0x7fc0740b7980 2023-07-09T21:59:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.355+0000 7fc06b7fe640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 0x7fc054068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.355+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 5266+0+0 (secure 0 0 0) 0x7fc05c083aa0 con 0x7fc0740b7980 2023-07-09T21:59:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.355+0000 7fc072ffd640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 0x7fc054068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:37.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.355+0000 7fc072ffd640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 0x7fc054068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc07408ad30 tx=0x7fc064008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:37.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.355+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc05c051020 con 0x7fc0740b7980 2023-07-09T21:59:37.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:37.511+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc07406a800 con 0x7fc0740b7980 2023-07-09T21:59:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.031+0000 7fc06b7fe640 1 -- 172.21.15.37:0/3964639974 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v173) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc05c054640 con 0x7fc0740b7980 2023-07-09T21:59:38.035 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T21:59:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 msgr2=0x7fc054068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 0x7fc054068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc07408ad30 tx=0x7fc064008040 comp rx=0 tx=0).stop 2023-07-09T21:59:38.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 msgr2=0x7fc0740c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00e810 tx=0x7fc05c00ecd0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 shutdown_connections 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fc0540663a0 0x7fc054068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc0740ceb80 0x7fc0740c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0740b7980 0x7fc0740c9270 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 --2- 172.21.15.37:0/3964639974 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc0740b3c20 0x7fc0740c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 >> 172.21.15.37:0/3964639974 conn(0x7fc074073090 msgr2=0x7fc07415b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:38.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 shutdown_connections 2023-07-09T21:59:38.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.035+0000 7fc0797e9640 1 -- 172.21.15.37:0/3964639974 wait complete. 2023-07-09T21:59:38.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T21:59:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 Processor -- start 2023-07-09T21:59:38.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 -- start start 2023-07-09T21:59:38.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3280b7980 0x7fe328160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe3280ceb80 0x7fe3280cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280cd070 con 0x7fe3280b7980 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3280cfd70 con 0x7fe3280ceb80 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe32d3d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32815bf80 con 0x7fe3280b3c20 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3280b7980 0x7fe328160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe3280b7980 0x7fe328160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51714/0 (socket says 172.21.15.37:51714) 2023-07-09T21:59:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 -- 172.21.15.37:0/711132948 learned_addr learned my addr 172.21.15.37:0/711132948 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 -- 172.21.15.37:0/711132948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 msgr2=0x7fe3280b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:38.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 --2- 172.21.15.37:0/711132948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 -- 172.21.15.37:0/711132948 >> v2:172.21.15.119:3300/0 conn(0x7fe3280ceb80 msgr2=0x7fe3280cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe31ffff640 1 --2- 172.21.15.37:0/711132948 >> v2:172.21.15.119:3300/0 conn(0x7fe3280ceb80 0x7fe3280cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 --2- 172.21.15.37:0/711132948 >> v2:172.21.15.119:3300/0 conn(0x7fe3280ceb80 0x7fe3280cefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.211+0000 7fe326ffd640 1 -- 172.21.15.37:0/711132948 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328160570 con 0x7fe3280b7980 2023-07-09T21:59:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe326ffd640 1 --2- 172.21.15.37:0/711132948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe328160030 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b4cd0 tx=0x7fe31801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1f160b934752a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe3267fc640 1 -- 172.21.15.37:0/711132948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180ab600 con 0x7fe3280b7980 2023-07-09T21:59:38.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe3267fc640 1 -- 172.21.15.37:0/711132948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3180a7050 con 0x7fe3280b7980 2023-07-09T21:59:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe3267fc640 1 -- 172.21.15.37:0/711132948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180ab980 con 0x7fe3280b7980 2023-07-09T21:59:38.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 -- 172.21.15.37:0/711132948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 msgr2=0x7fe328160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/711132948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe328160030 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fe3280b4cd0 tx=0x7fe31801c500 comp rx=0 tx=0).stop 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 -- 172.21.15.37:0/711132948 shutdown_connections 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/711132948 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/711132948 >> v2:172.21.15.119:3300/0 conn(0x7fe3280ceb80 0x7fe3280cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/711132948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe328160030 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 -- 172.21.15.37:0/711132948 >> 172.21.15.37:0/711132948 conn(0x7fe328073090 msgr2=0x7fe328069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 -- 172.21.15.37:0/711132948 shutdown_connections 2023-07-09T21:59:38.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.215+0000 7fe32d3d5640 1 -- 172.21.15.37:0/711132948 wait complete. 2023-07-09T21:59:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 Processor -- start 2023-07-09T21:59:38.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- start start 2023-07-09T21:59:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3280ceb80 0x7fe32815a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32815a520 con 0x7fe3280b7980 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c5990 con 0x7fe3280ceb80 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3280c56b0 con 0x7fe3280b3c20 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51728/0 (socket says 172.21.15.37:51728) 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 -- 172.21.15.37:0/2885845771 learned_addr learned my addr 172.21.15.37:0/2885845771 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:38.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe326ffd640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe3277fe640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3280ceb80 0x7fe32815a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 -- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 msgr2=0x7fe3280c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 -- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3280ceb80 msgr2=0x7fe32815a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3280ceb80 0x7fe32815a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 -- 172.21.15.37:0/2885845771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180094d0 con 0x7fe3280b7980 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31ffff640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fe31000c820 tx=0x7fe31000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:38.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310004220 con 0x7fe3280b7980 2023-07-09T21:59:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3100043a0 con 0x7fe3280b7980 2023-07-09T21:59:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310004510 con 0x7fe3280b7980 2023-07-09T21:59:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe328159e60 con 0x7fe3280b7980 2023-07-09T21:59:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.219+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe328152ff0 con 0x7fe3280b7980 2023-07-09T21:59:38.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.223+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe328159cc0 con 0x7fe3280b7980 2023-07-09T21:59:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.223+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe310007a70 con 0x7fe3280b7980 2023-07-09T21:59:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.223+0000 7fe31f7fe640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:38.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.223+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5636+0+0 (secure 0 0 0) 0x7fe310083e30 con 0x7fe3280b7980 2023-07-09T21:59:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.223+0000 7fe326ffd640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:38.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.227+0000 7fe326ffd640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 0x7fe308068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:38.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.227+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe3100512c0 con 0x7fe3280b7980 2023-07-09T21:59:38.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:38.379+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe328159cc0 con 0x7fe3280b7980 2023-07-09T21:59:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.035+0000 7fe31f7fe640 1 -- 172.21.15.37:0/2885845771 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v174) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe328159cc0 con 0x7fe3280b7980 2023-07-09T21:59:39.041 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T21:59:39.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 msgr2=0x7fe308068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 0x7fe308068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3180ad000 tx=0x7fe318008040 comp rx=0 tx=0).stop 2023-07-09T21:59:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 msgr2=0x7fe32815d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fe31000c820 tx=0x7fe31000cce0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 shutdown_connections 2023-07-09T21:59:39.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe3080663a0 0x7fe308068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe3280ceb80 0x7fe32815a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3280b7980 0x7fe32815d0b0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 --2- 172.21.15.37:0/2885845771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe3280b3c20 0x7fe3280c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 >> 172.21.15.37:0/2885845771 conn(0x7fe328073090 msgr2=0x7fe3280d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 shutdown_connections 2023-07-09T21:59:39.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.047+0000 7fe32d3d5640 1 -- 172.21.15.37:0/2885845771 wait complete. 2023-07-09T21:59:39.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T21:59:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 Processor -- start 2023-07-09T21:59:39.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 -- start start 2023-07-09T21:59:39.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0cb740 0x7ffbcc06ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:39.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0cca70 con 0x7ffbcc15bbc0 2023-07-09T21:59:39.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbcc0ccd50 con 0x7ffbcc0cffc0 2023-07-09T21:59:39.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd3940640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cd030 con 0x7ffbcc0cb740 2023-07-09T21:59:39.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd0edb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffbcc15bbc0 0x7ffbcc06a640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43262/0 (socket says 172.21.15.37:43262) 2023-07-09T21:59:39.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.227+0000 7ffbd0edb640 1 -- 172.21.15.37:0/3639966161 learned_addr learned my addr 172.21.15.37:0/3639966161 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbd1edd640 1 --2- 172.21.15.37:0/3639966161 >> v2:172.21.15.119:3300/0 conn(0x7ffbcc0cb740 0x7ffbcc06ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877251962 0 0) 0x7ffbcc0cca70 con 0x7ffbcc15bbc0 2023-07-09T21:59:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbb8003530 con 0x7ffbcc15bbc0 2023-07-09T21:59:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbd1edd640 1 -- 172.21.15.37:0/3639966161 >> v1:172.21.15.119:6789/0 conn(0x7ffbcc0cffc0 legacy=0x7ffbcc0d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1019567726 0 0) 0x7ffbb8003530 con 0x7ffbcc15bbc0 2023-07-09T21:59:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbd1edd640 1 -- 172.21.15.37:0/3639966161 >> v1:172.21.15.37:6789/0 conn(0x7ffbcc15bbc0 legacy=0x7ffbcc06a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbd1edd640 1 -- 172.21.15.37:0/3639966161 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0cd310 con 0x7ffbcc0cb740 2023-07-09T21:59:39.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbd1edd640 1 --2- 172.21.15.37:0/3639966161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc06ad50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009d90 tx=0x7ffbc401c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af1fb33fd7e65153 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbbc001680 con 0x7ffbcc0cb740 2023-07-09T21:59:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc40a5610 con 0x7ffbcc0cb740 2023-07-09T21:59:39.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.231+0000 7ffbc3fff640 1 -- 172.21.15.37:0/3639966161 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40a59a0 con 0x7ffbcc0cb740 2023-07-09T21:59:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- 172.21.15.37:0/3639966161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc0cb740 msgr2=0x7ffbcc06ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 --2- 172.21.15.37:0/3639966161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc06ad50 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ffbc4009d90 tx=0x7ffbc401c7b0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- 172.21.15.37:0/3639966161 shutdown_connections 2023-07-09T21:59:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 --2- 172.21.15.37:0/3639966161 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc06ad50 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- 172.21.15.37:0/3639966161 >> 172.21.15.37:0/3639966161 conn(0x7ffbcc099320 msgr2=0x7ffbcc072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- 172.21.15.37:0/3639966161 shutdown_connections 2023-07-09T21:59:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- 172.21.15.37:0/3639966161 wait complete. 2023-07-09T21:59:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 Processor -- start 2023-07-09T21:59:39.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- start start 2023-07-09T21:59:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:39.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc0cffc0 0x7ffbcc15d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15da50 0x7ffbcc0c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc15def0 con 0x7ffbcc0cb740 2023-07-09T21:59:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0ced80 con 0x7ffbcc15da50 2023-07-09T21:59:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd3940640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbcc0cf060 con 0x7ffbcc0cffc0 2023-07-09T21:59:39.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd16dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd16dc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51740/0 (socket says 172.21.15.37:51740) 2023-07-09T21:59:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd16dc640 1 -- 172.21.15.37:0/2899559371 learned_addr learned my addr 172.21.15.37:0/2899559371 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd0edb640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc0cffc0 0x7ffbcc15d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:39.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.235+0000 7ffbd1edd640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15da50 0x7ffbcc0c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 -- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc0cffc0 msgr2=0x7ffbcc15d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc0cffc0 0x7ffbcc15d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 -- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15da50 msgr2=0x7ffbcc0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15da50 0x7ffbcc0c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 -- 172.21.15.37:0/2899559371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc4009a70 con 0x7ffbcc0cb740 2023-07-09T21:59:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd16dc640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c500 tx=0x7ffbc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8005220 con 0x7ffbcc0cb740 2023-07-09T21:59:39.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc8005380 con 0x7ffbcc0cb740 2023-07-09T21:59:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc8007270 con 0x7ffbcc0cb740 2023-07-09T21:59:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbcc0cf340 con 0x7ffbcc0cb740 2023-07-09T21:59:39.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc155a60 con 0x7ffbcc0cb740 2023-07-09T21:59:39.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc0d0fb0 con 0x7ffbcc0cb740 2023-07-09T21:59:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.239+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffbc80073d0 con 0x7ffbcc0cb740 2023-07-09T21:59:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.243+0000 7ffbc1ffb640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 0x7ffbb0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.243+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6018+0+0 (secure 0 0 0) 0x7ffbc80845c0 con 0x7ffbcc0cb740 2023-07-09T21:59:39.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.243+0000 7ffbd0edb640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 0x7ffbb0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.243+0000 7ffbd0edb640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 0x7ffbb0068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0cf990 tx=0x7ffbbc009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:39.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.243+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffbc8051940 con 0x7ffbcc0cb740 2023-07-09T21:59:39.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:39.431+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffbcc04d7d0 con 0x7ffbcc0cb740 2023-07-09T21:59:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.075+0000 7ffbc1ffb640 1 -- 172.21.15.37:0/2899559371 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v73) v1 ==== 174+0+0 (secure 0 0 0) 0x7ffbc8054f60 con 0x7ffbcc0cb740 2023-07-09T21:59:40.079 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 21 and data pool 22 2023-07-09T21:59:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.091+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 msgr2=0x7ffbb0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.091+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 0x7ffbb0068880 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0cf990 tx=0x7ffbbc009040 comp rx=0 tx=0).stop 2023-07-09T21:59:40.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.091+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 msgr2=0x7ffbcc0ce520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.091+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7ffbc800c500 tx=0x7ffbc800c9c0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 shutdown_connections 2023-07-09T21:59:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ffbb00663d0 0x7ffbb0068880 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffbcc15da50 0x7ffbcc0c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffbcc0cffc0 0x7ffbcc15d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 --2- 172.21.15.37:0/2899559371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbcc0cb740 0x7ffbcc0ce520 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 >> 172.21.15.37:0/2899559371 conn(0x7ffbcc099320 msgr2=0x7ffbcc06d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 shutdown_connections 2023-07-09T21:59:40.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.095+0000 7ffbd3940640 1 -- 172.21.15.37:0/2899559371 wait complete. 2023-07-09T21:59:40.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 Processor -- start 2023-07-09T21:59:40.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 -- start start 2023-07-09T21:59:40.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57700b7ab0 0x7f577006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 0x7f57700b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 0x7f577015f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700b7e80 con 0x7f57700b7ab0 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57700b4610 con 0x7f57700cef80 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f577620b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57700b49f0 con 0x7f57700b4170 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57700b7ab0 0x7f577006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57700b7ab0 0x7f577006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51754/0 (socket says 172.21.15.37:51754) 2023-07-09T21:59:40.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 -- 172.21.15.37:0/1165384458 learned_addr learned my addr 172.21.15.37:0/1165384458 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:40.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f5767fff640 1 --2- 172.21.15.37:0/1165384458 >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 0x7f57700b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576ffff640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 0x7f577015f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 -- 172.21.15.37:0/1165384458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 msgr2=0x7f577015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 0x7f577015f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 -- 172.21.15.37:0/1165384458 >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 msgr2=0x7f57700b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 --2- 172.21.15.37:0/1165384458 >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 0x7f57700b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576f7fe640 1 -- 172.21.15.37:0/1165384458 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700cc8a0 con 0x7f57700b7ab0 2023-07-09T21:59:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f5767fff640 1 --2- 172.21.15.37:0/1165384458 >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 0x7f57700b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.263+0000 7f576ffff640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 0x7f577015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:40.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f576f7fe640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700b7ab0 0x7f577006aa50 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f57700b4d10 tx=0x7f576001c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bf3a24320aa104 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f576effd640 1 -- 172.21.15.37:0/1165384458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600ab600 con 0x7f57700b7ab0 2023-07-09T21:59:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f576effd640 1 -- 172.21.15.37:0/1165384458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57600a7050 con 0x7f57700b7ab0 2023-07-09T21:59:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f576effd640 1 -- 172.21.15.37:0/1165384458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57600ab980 con 0x7f57700b7ab0 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 -- 172.21.15.37:0/1165384458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700b7ab0 msgr2=0x7f577006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700b7ab0 0x7f577006aa50 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f57700b4d10 tx=0x7f576001c210 comp rx=0 tx=0).stop 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 -- 172.21.15.37:0/1165384458 shutdown_connections 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b4170 0x7f577015f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 --2- 172.21.15.37:0/1165384458 >> v2:172.21.15.119:3300/0 conn(0x7f57700cef80 0x7f57700b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 --2- 172.21.15.37:0/1165384458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700b7ab0 0x7f577006aa50 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 -- 172.21.15.37:0/1165384458 >> 172.21.15.37:0/1165384458 conn(0x7f5770073090 msgr2=0x7f5770069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 -- 172.21.15.37:0/1165384458 shutdown_connections 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.267+0000 7f577620b640 1 -- 172.21.15.37:0/1165384458 wait complete. 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 Processor -- start 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- start start 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b4170 0x7f577014b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b7ab0 0x7f57700b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577014bc50 con 0x7f57700cef80 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5770157630 con 0x7f57700b4170 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5770157910 con 0x7f57700b7ab0 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51756/0 (socket says 172.21.15.37:51756) 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 -- 172.21.15.37:0/2865907628 learned_addr learned my addr 172.21.15.37:0/2865907628 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:40.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f5767fff640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b7ab0 0x7f57700b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576f7fe640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b4170 0x7f577014b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 -- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b7ab0 msgr2=0x7f57700b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b7ab0 0x7f57700b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 -- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b4170 msgr2=0x7f577014b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b4170 0x7f577014b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 -- 172.21.15.37:0/2865907628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57600094d0 con 0x7f57700cef80 2023-07-09T21:59:40.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576ffff640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f5768007e10 tx=0x7f576800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768003ba0 con 0x7f57700cef80 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576800f040 con 0x7f57700cef80 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576800de80 con 0x7f57700cef80 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5770157bf0 con 0x7f57700cef80 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.271+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57700b32f0 con 0x7f57700cef80 2023-07-09T21:59:40.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f577014bdc0 con 0x7f57700cef80 2023-07-09T21:59:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5768004030 con 0x7f57700cef80 2023-07-09T21:59:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f576cff9640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 0x7f5750068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f5768084330 con 0x7f57700cef80 2023-07-09T21:59:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f576f7fe640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 0x7f5750068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.275+0000 7f576f7fe640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 0x7f5750068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f57600a6000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.279+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f577014bdc0 con 0x7f57700cef80 2023-07-09T21:59:40.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.435+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f577014bd90 con 0x7f57700cef80 2023-07-09T21:59:40.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f576cff9640 1 -- 172.21.15.37:0/2865907628 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18392 (secure 0 0 0) 0x7f5768051560 con 0x7f57700cef80 2023-07-09T21:59:40.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:40.442 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":175,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:39.435376+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:40.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 msgr2=0x7f5750068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 0x7f5750068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f57600ad000 tx=0x7f57600a6000 comp rx=0 tx=0).stop 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 msgr2=0x7f57700b61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f5768007e10 tx=0x7f576800d4a0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 shutdown_connections 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f57500663a0 0x7f5750068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57700cef80 0x7f57700b61a0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f57700b7ab0 0x7f57700b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 --2- 172.21.15.37:0/2865907628 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f57700b4170 0x7f577014b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 >> 172.21.15.37:0/2865907628 conn(0x7f5770073090 msgr2=0x7f57700b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 shutdown_connections 2023-07-09T21:59:40.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.439+0000 7f577620b640 1 -- 172.21.15.37:0/2865907628 wait complete. 2023-07-09T21:59:40.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:40.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 Processor -- start 2023-07-09T21:59:40.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 -- start start 2023-07-09T21:59:40.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea081600b0 0x7fea080c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 0x7fea08163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080cd080 con 0x7fea0815fce0 2023-07-09T21:59:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea080cd920 con 0x7fea081600b0 2023-07-09T21:59:40.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.603+0000 7fea0f49e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080ca2f0 con 0x7fea080aff40 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fea081600b0 0x7fea080c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0da3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 0x7fea08163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0da3b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 0x7fea08163990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:36750/0 (socket says 172.21.15.37:36750) 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0da3b640 1 -- 172.21.15.37:0/1777907352 learned_addr learned my addr 172.21.15.37:0/1777907352 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0d23a640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fea0815fce0 0x7fea080af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:53392/0 (socket says 172.21.15.37:53392) 2023-07-09T21:59:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 -- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 msgr2=0x7fea08163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 --2- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 0x7fea08163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 -- 172.21.15.37:0/1777907352 >> v1:172.21.15.119:6789/0 conn(0x7fea0815fce0 legacy=0x7fea080af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 -- 172.21.15.37:0/1777907352 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080cd2d0 con 0x7fea081600b0 2023-07-09T21:59:40.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.607+0000 7fea0ca39640 1 --2- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea081600b0 0x7fea080c9620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80097c0 tx=0x7fe9f801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=301b815bfb262d3d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fe9fffff640 1 -- 172.21.15.37:0/1777907352 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80ac640 con 0x7fea081600b0 2023-07-09T21:59:40.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fe9fffff640 1 -- 172.21.15.37:0/1777907352 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f80ac7a0 con 0x7fea081600b0 2023-07-09T21:59:40.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fe9fffff640 1 -- 172.21.15.37:0/1777907352 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80acb30 con 0x7fea081600b0 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea081600b0 msgr2=0x7fea080c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea081600b0 0x7fea080c9620 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80097c0 tx=0x7fe9f801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- 172.21.15.37:0/1777907352 shutdown_connections 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea080aff40 0x7fea08163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- 172.21.15.37:0/1777907352 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea081600b0 0x7fea080c9620 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- 172.21.15.37:0/1777907352 >> 172.21.15.37:0/1777907352 conn(0x7fea080ca830 msgr2=0x7fea080cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- 172.21.15.37:0/1777907352 shutdown_connections 2023-07-09T21:59:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- 172.21.15.37:0/1777907352 wait complete. 2023-07-09T21:59:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 Processor -- start 2023-07-09T21:59:40.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- start start 2023-07-09T21:59:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea080aff40 0x7fea080c4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0815fce0 0x7fea080c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea081621e0 con 0x7fea08156bb0 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08161610 con 0x7fea080aff40 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0f49e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea081618b0 con 0x7fea0815fce0 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0da3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0da3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51768/0 (socket says 172.21.15.37:51768) 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0da3b640 1 -- 172.21.15.37:0/63710927 learned_addr learned my addr 172.21.15.37:0/63710927 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:40.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0ca39640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0815fce0 0x7fea080c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.611+0000 7fea0d23a640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea080aff40 0x7fea080c4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 -- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0815fce0 msgr2=0x7fea080c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0815fce0 0x7fea080c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 -- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea080aff40 msgr2=0x7fea080c4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea080aff40 0x7fea080c4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 -- 172.21.15.37:0/63710927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009420 con 0x7fea08156bb0 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0da3b640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fea0000efc0 tx=0x7fea0000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000cd20 con 0x7fea08156bb0 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0000f040 con 0x7fea08156bb0 2023-07-09T21:59:40.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00003c30 con 0x7fea08156bb0 2023-07-09T21:59:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea08161b90 con 0x7fea08156bb0 2023-07-09T21:59:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea080c1c30 con 0x7fea08156bb0 2023-07-09T21:59:40.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea08162390 con 0x7fea08156bb0 2023-07-09T21:59:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fea00004030 con 0x7fea08156bb0 2023-07-09T21:59:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.615+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fea00084400 con 0x7fea08156bb0 2023-07-09T21:59:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.619+0000 7fea0d23a640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.619+0000 7fea0d23a640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 0x7fe9ec068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea04000f70 tx=0x7fea04007e90 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.619+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fea08162390 con 0x7fea08156bb0 2023-07-09T21:59:40.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.775+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea08162390 con 0x7fea08156bb0 2023-07-09T21:59:40.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fe9fdffb640 1 -- 172.21.15.37:0/63710927 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+18392 (secure 0 0 0) 0x7fea08162390 con 0x7fea08156bb0 2023-07-09T21:59:40.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:40.781 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":175,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:39.435376+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 msgr2=0x7fe9ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 0x7fe9ec068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea04000f70 tx=0x7fea04007e90 comp rx=0 tx=0).stop 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 msgr2=0x7fea08162670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fea0000efc0 tx=0x7fea0000c490 comp rx=0 tx=0).stop 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 shutdown_connections 2023-07-09T21:59:40.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe9ec0663a0 0x7fe9ec068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea08156bb0 0x7fea08162670 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fea0815fce0 0x7fea080c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 --2- 172.21.15.37:0/63710927 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fea080aff40 0x7fea080c4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 >> 172.21.15.37:0/63710927 conn(0x7fea080ca830 msgr2=0x7fea080ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 shutdown_connections 2023-07-09T21:59:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.779+0000 7fea0f49e640 1 -- 172.21.15.37:0/63710927 wait complete. 2023-07-09T21:59:40.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T21:59:40.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.943+0000 7f1465f8f640 1 Processor -- start 2023-07-09T21:59:40.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1465f8f640 1 -- start start 2023-07-09T21:59:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1465f8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1460160030 0x7f14600d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1465f8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146015bf80 con 0x7f14600b7980 2023-07-09T21:59:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1465f8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14600d02f0 con 0x7f14600cf290 2023-07-09T21:59:40.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1465f8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14600cd070 con 0x7f1460160030 2023-07-09T21:59:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14600b7980 0x7f14600ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43266/0 (socket says 172.21.15.37:43266) 2023-07-09T21:59:40.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145f7fe640 1 -- 172.21.15.37:0/3343809766 learned_addr learned my addr 172.21.15.37:0/3343809766 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:40.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> v2:172.21.15.119:3300/0 conn(0x7f1460160030 0x7f14600d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845171963 0 0) 0x7f1450001120 con 0x7f14600b7980 2023-07-09T21:59:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c003530 con 0x7f14600b7980 2023-07-09T21:59:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2506349998 0 0) 0x7f144c003530 con 0x7f14600b7980 2023-07-09T21:59:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 >> v2:172.21.15.119:3300/0 conn(0x7f1460160030 msgr2=0x7f14600d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 --2- 172.21.15.37:0/3343809766 >> v2:172.21.15.119:3300/0 conn(0x7f1460160030 0x7f14600d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 >> v1:172.21.15.119:6789/0 conn(0x7f14600cf290 legacy=0x7f14600d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600cc7f0 con 0x7f14600b7980 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1450001810 con 0x7f14600b7980 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 >> v1:172.21.15.37:6789/0 conn(0x7f14600b7980 legacy=0x7f14600ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c0047d0 0x7f144c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 0x7f144c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600cd070 con 0x7f144c005180 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144c00c000 con 0x7f144c0047d0 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f144c00c1c0 con 0x7f144c003980 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> v2:172.21.15.119:3300/0 conn(0x7f1460160030 0x7f14600d0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:40.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f1457fff640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c0047d0 0x7f144c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145f7fe640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 0x7f144c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 -- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f144c003980 msgr2=0x7f144c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f144c003980 0x7f144c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 -- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c0047d0 msgr2=0x7f144c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:40.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c0047d0 0x7f144c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.947+0000 7f145ffff640 1 -- 172.21.15.37:0/3343809766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f144c003530 con 0x7f144c005180 2023-07-09T21:59:40.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f145ffff640 1 -- 172.21.15.37:0/3343809766 reap_dead start 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f145ffff640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 0x7f144c00b990 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f145800e350 tx=0x7f145801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4499c01301bc8b75 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14580a5e50 con 0x7f144c005180 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145800f040 con 0x7f144c005180 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f145effd640 1 -- 172.21.15.37:0/3343809766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1458003bc0 con 0x7f144c005180 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 -- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 msgr2=0x7f144c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 0x7f144c00b990 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f145800e350 tx=0x7f145801ce40 comp rx=0 tx=0).stop 2023-07-09T21:59:40.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 -- 172.21.15.37:0/3343809766 shutdown_connections 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 --2- 172.21.15.37:0/3343809766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f144c005180 0x7f144c00b990 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 -- 172.21.15.37:0/3343809766 >> 172.21.15.37:0/3343809766 conn(0x7f1460073090 msgr2=0x7f1460069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 -- 172.21.15.37:0/3343809766 shutdown_connections 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.951+0000 7f1465f8f640 1 -- 172.21.15.37:0/3343809766 wait complete. 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 Processor -- start 2023-07-09T21:59:40.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- start start 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c005180 0x7f14600c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14601f1140 0x7f14601f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14601f1eb0 con 0x7f14600c8060 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14601f2ba0 con 0x7f144c005180 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14601f2200 con 0x7f14601f1140 2023-07-09T21:59:40.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51790/0 (socket says 172.21.15.37:51790) 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 -- 172.21.15.37:0/2760955568 learned_addr learned my addr 172.21.15.37:0/2760955568 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f145f7fe640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c005180 0x7f14600c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f145ffff640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14601f1140 0x7f14601f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 -- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14601f1140 msgr2=0x7f14601f15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14601f1140 0x7f14601f15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 -- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c005180 msgr2=0x7f14600c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c005180 0x7f14600c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 -- 172.21.15.37:0/2760955568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14601f24e0 con 0x7f14600c8060 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1457fff640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f144800f5f0 tx=0x7f144800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480052e0 con 0x7f14600c8060 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448005440 con 0x7f14600c8060 2023-07-09T21:59:40.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448003820 con 0x7f14600c8060 2023-07-09T21:59:40.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14601f27c0 con 0x7f14600c8060 2023-07-09T21:59:40.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.955+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14600c8a10 con 0x7f14600c8060 2023-07-09T21:59:40.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146004d7d0 con 0x7f14600c8060 2023-07-09T21:59:40.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1448003980 con 0x7f14600c8060 2023-07-09T21:59:40.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f145cff9640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 0x7f1440068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:40.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1448083dc0 con 0x7f14600c8060 2023-07-09T21:59:40.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f145f7fe640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 0x7f1440068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:40.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.959+0000 7f145f7fe640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 0x7f1440068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1450001060 tx=0x7f1450009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:40.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:40.963+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14480510e0 con 0x7f14600c8060 2023-07-09T21:59:41.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:41.155+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f146006a800 con 0x7f14600c8060 2023-07-09T21:59:42.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.087+0000 7f145cff9640 1 -- 172.21.15.37:0/2760955568 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) v1 ==== 118+0+0 (secure 0 0 0) 0x7f144801a310 con 0x7f14600c8060 2023-07-09T21:59:42.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.087+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 msgr2=0x7f1440068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.087+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 0x7f1440068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1450001060 tx=0x7f1450009040 comp rx=0 tx=0).stop 2023-07-09T21:59:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 msgr2=0x7f14600c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:42.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f144800f5f0 tx=0x7f144800fab0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 shutdown_connections 2023-07-09T21:59:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f14400663d0 0x7f1440068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14601f1140 0x7f14601f15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14600c8060 0x7f14600c84d0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 --2- 172.21.15.37:0/2760955568 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f144c005180 0x7f14600c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 >> 172.21.15.37:0/2760955568 conn(0x7f1460073090 msgr2=0x7f14600b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 shutdown_connections 2023-07-09T21:59:42.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.091+0000 7f1465f8f640 1 -- 172.21.15.37:0/2760955568 wait complete. 2023-07-09T21:59:42.116 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T21:59:42.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T21:59:42.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 Processor -- start 2023-07-09T21:59:42.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 -- start start 2023-07-09T21:59:42.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 0x7f27d8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27d80ceb80 0x7f27d80cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d815bf80 con 0x7f27d80b3c20 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d80cd070 con 0x7f27d80ceb80 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27e0256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80cfd70 con 0x7f27d80b7980 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27d80ceb80 0x7f27d80cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f27d80ceb80 0x7f27d80cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51806/0 (socket says 172.21.15.37:51806) 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 -- 172.21.15.37:0/2076989957 learned_addr learned my addr 172.21.15.37:0/2076989957 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27ddff2640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 0x7f27d8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 -- 172.21.15.37:0/2076989957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 msgr2=0x7f27d8160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 0x7f27d8160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 -- 172.21.15.37:0/2076989957 >> v1:172.21.15.119:6789/0 conn(0x7f27d80b3c20 legacy=0x7f27d80b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27dd7f1640 1 -- 172.21.15.37:0/2076989957 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8160570 con 0x7f27d80ceb80 2023-07-09T21:59:42.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.263+0000 7f27ddff2640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 0x7f27d8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:42.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27dd7f1640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80ceb80 0x7f27d80cef90 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c30e7264c6bf39c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:42.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27dcff0640 1 -- 172.21.15.37:0/2076989957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80ab600 con 0x7f27d80ceb80 2023-07-09T21:59:42.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27dcff0640 1 -- 172.21.15.37:0/2076989957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80a7050 con 0x7f27d80ceb80 2023-07-09T21:59:42.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27dcff0640 1 -- 172.21.15.37:0/2076989957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80ab980 con 0x7f27d80ceb80 2023-07-09T21:59:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 -- 172.21.15.37:0/2076989957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80ceb80 msgr2=0x7f27d80cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80ceb80 0x7f27d80cef90 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009870 tx=0x7f27c801c500 comp rx=0 tx=0).stop 2023-07-09T21:59:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 -- 172.21.15.37:0/2076989957 shutdown_connections 2023-07-09T21:59:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80ceb80 0x7f27d80cef90 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 --2- 172.21.15.37:0/2076989957 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80b7980 0x7f27d8160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 -- 172.21.15.37:0/2076989957 >> 172.21.15.37:0/2076989957 conn(0x7f27d8073090 msgr2=0x7f27d8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 -- 172.21.15.37:0/2076989957 shutdown_connections 2023-07-09T21:59:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.267+0000 7f27e0256640 1 -- 172.21.15.37:0/2076989957 wait complete. 2023-07-09T21:59:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 Processor -- start 2023-07-09T21:59:42.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- start start 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 0x7f27d8152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80ceb80 0x7f27d81539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d815bcf0 con 0x7f27d80b7980 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d815d320 con 0x7f27d80b3c20 2023-07-09T21:59:42.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d815b770 con 0x7f27d80ceb80 2023-07-09T21:59:42.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:42.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51808/0 (socket says 172.21.15.37:51808) 2023-07-09T21:59:42.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 -- 172.21.15.37:0/736961993 learned_addr learned my addr 172.21.15.37:0/736961993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:42.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 -- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80ceb80 msgr2=0x7f27d81539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:42.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80ceb80 0x7f27d81539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 -- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 msgr2=0x7f27d8152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27ddff2640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 0x7f27d8152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 0x7f27d8152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 -- 172.21.15.37:0/736961993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c80094d0 con 0x7f27d80b7980 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27ddff2640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 0x7f27d8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27dd7f1640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f27c80ae040 tx=0x7f27c80192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80ba070 con 0x7f27d80b7980 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80ac240 con 0x7f27d80b7980 2023-07-09T21:59:42.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80b6680 con 0x7f27d80b7980 2023-07-09T21:59:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d815ba10 con 0x7f27d80b7980 2023-07-09T21:59:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.271+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d815cfb0 con 0x7f27d80b7980 2023-07-09T21:59:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d815cb30 con 0x7f27d80b7980 2023-07-09T21:59:42.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27c80b2040 con 0x7f27d80b7980 2023-07-09T21:59:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27ce7fc640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 0x7f27bc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f27c811dc90 con 0x7f27d80b7980 2023-07-09T21:59:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27ddff2640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 0x7f27bc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:42.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.275+0000 7f27ddff2640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 0x7f27bc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f27d4008930 tx=0x7f27d4008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:42.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.279+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27d815cb30 con 0x7f27d80b7980 2023-07-09T21:59:42.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:42.467+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f27d8160570 con 0x7f27d80b7980 2023-07-09T21:59:43.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27ce7fc640 1 -- 172.21.15.37:0/736961993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27d8160570 con 0x7f27d80b7980 2023-07-09T21:59:43.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 msgr2=0x7f27bc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 0x7f27bc068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f27d4008930 tx=0x7f27d4008040 comp rx=0 tx=0).stop 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 msgr2=0x7f27d81534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f27c80ae040 tx=0x7f27c80192a0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 shutdown_connections 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f27bc0663a0 0x7f27bc068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f27d80ceb80 0x7f27d81539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f27d80b7980 0x7f27d81534a0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 --2- 172.21.15.37:0/736961993 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f27d80b3c20 0x7f27d8152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 >> 172.21.15.37:0/736961993 conn(0x7f27d8073090 msgr2=0x7f27d80d1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 shutdown_connections 2023-07-09T21:59:43.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.091+0000 7f27e0256640 1 -- 172.21.15.37:0/736961993 wait complete. 2023-07-09T21:59:43.117 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T21:59:43.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:43.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.259+0000 7f563ce56640 1 Processor -- start 2023-07-09T21:59:43.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563ce56640 1 -- start start 2023-07-09T21:59:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563ce56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5638158670 0x7f56380ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563ce56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563806efc0 con 0x7f563806b120 2023-07-09T21:59:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563ce56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563806f4f0 con 0x7f56380aff40 2023-07-09T21:59:43.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563ce56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f563806d390 con 0x7f5638158670 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5638158670 0x7f56380ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f562ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f563806b120 0x7f56380af830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43274/0 (socket says 172.21.15.37:43274) 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f562ffff640 1 -- 172.21.15.37:0/2149673930 learned_addr learned my addr 172.21.15.37:0/2149673930 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563659c640 1 -- 172.21.15.37:0/2149673930 >> v1:172.21.15.119:6789/0 conn(0x7f56380aff40 legacy=0x7f563815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563659c640 1 -- 172.21.15.37:0/2149673930 >> v1:172.21.15.37:6789/0 conn(0x7f563806b120 legacy=0x7f56380af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f563659c640 1 -- 172.21.15.37:0/2149673930 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563806fe90 con 0x7f5638158670 2023-07-09T21:59:43.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.263+0000 7f5635d9b640 1 -- 172.21.15.37:0/2149673930 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134115027 0 0) 0x7f563806efc0 con 0x7f563806b120 2023-07-09T21:59:43.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563659c640 1 --2- 172.21.15.37:0/2149673930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5638158670 0x7f56380ca2f0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f56280097f0 tx=0x7f562801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9158a896633165 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f5635d9b640 1 -- 172.21.15.37:0/2149673930 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280ac620 con 0x7f5638158670 2023-07-09T21:59:43.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f5635d9b640 1 -- 172.21.15.37:0/2149673930 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280ac780 con 0x7f5638158670 2023-07-09T21:59:43.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f5635d9b640 1 -- 172.21.15.37:0/2149673930 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280acb10 con 0x7f5638158670 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- 172.21.15.37:0/2149673930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5638158670 msgr2=0x7f56380ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 --2- 172.21.15.37:0/2149673930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5638158670 0x7f56380ca2f0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f56280097f0 tx=0x7f562801c3c0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- 172.21.15.37:0/2149673930 shutdown_connections 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 --2- 172.21.15.37:0/2149673930 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5638158670 0x7f56380ca2f0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- 172.21.15.37:0/2149673930 >> 172.21.15.37:0/2149673930 conn(0x7f56380ca830 msgr2=0x7f56380cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- 172.21.15.37:0/2149673930 shutdown_connections 2023-07-09T21:59:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- 172.21.15.37:0/2149673930 wait complete. 2023-07-09T21:59:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 Processor -- start 2023-07-09T21:59:43.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.267+0000 7f563ce56640 1 -- start start 2023-07-09T21:59:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 0x7f56380b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5638158670 0x7f56380b1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c3ca0 con 0x7f56380aff40 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c3120 con 0x7f563806b120 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380c3400 con 0x7f5638158670 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51822/0 (socket says 172.21.15.37:51822) 2023-07-09T21:59:43.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 -- 172.21.15.37:0/4157227876 learned_addr learned my addr 172.21.15.37:0/4157227876 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:43.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563659c640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 0x7f56380b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f5636d9d640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5638158670 0x7f56380b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 -- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5638158670 msgr2=0x7f56380b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5638158670 0x7f56380b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 -- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 msgr2=0x7f56380b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 0x7f56380b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 -- 172.21.15.37:0/4157227876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009420 con 0x7f56380aff40 2023-07-09T21:59:43.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563659c640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 0x7f56380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:43.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562ffff640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f562000c4a0 tx=0x7f562000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56200074e0 con 0x7f56380aff40 2023-07-09T21:59:43.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5620007640 con 0x7f56380aff40 2023-07-09T21:59:43.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620004a30 con 0x7f56380aff40 2023-07-09T21:59:43.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56380c36e0 con 0x7f56380aff40 2023-07-09T21:59:43.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56380c23b0 con 0x7f56380aff40 2023-07-09T21:59:43.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563815bfd0 con 0x7f56380aff40 2023-07-09T21:59:43.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.271+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5620004b90 con 0x7f56380aff40 2023-07-09T21:59:43.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.275+0000 7f562effd640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 0x7f5618068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.275+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f56200830b0 con 0x7f56380aff40 2023-07-09T21:59:43.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.275+0000 7f563659c640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 0x7f5618068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.275+0000 7f563659c640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 0x7f5618068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae000 tx=0x7f56280a7000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.279+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5620050470 con 0x7f56380aff40 2023-07-09T21:59:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56380b0410 con 0x7f56380aff40 2023-07-09T21:59:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f562effd640 1 -- 172.21.15.37:0/4157227876 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f5620053a90 con 0x7f56380aff40 2023-07-09T21:59:43.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:43.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T21:59:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T21:59:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 msgr2=0x7f5618068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 0x7f5618068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae000 tx=0x7f56280a7000 comp rx=0 tx=0).stop 2023-07-09T21:59:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 msgr2=0x7f56380b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f562000c4a0 tx=0x7f562000c960 comp rx=0 tx=0).stop 2023-07-09T21:59:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 shutdown_connections 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f56180663a0 0x7f5618068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5638158670 0x7f56380b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56380aff40 0x7f56380b0e10 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 --2- 172.21.15.37:0/4157227876 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f563806b120 0x7f56380b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 >> 172.21.15.37:0/4157227876 conn(0x7f56380ca830 msgr2=0x7f56381539d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 shutdown_connections 2023-07-09T21:59:43.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.467+0000 7f563ce56640 1 -- 172.21.15.37:0/4157227876 wait complete. 2023-07-09T21:59:43.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T21:59:43.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 Processor -- start 2023-07-09T21:59:43.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 -- start start 2023-07-09T21:59:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e00b4340 0x7f85e006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00b49f0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e00cc8a0 con 0x7f85e00cef80 2023-07-09T21:59:43.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e7f11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e00b7e80 con 0x7f85e00b4340 2023-07-09T21:59:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e54ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85e00b4340 0x7f85e006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e5cad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f85e00b7ab0 0x7f85e00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43284/0 (socket says 172.21.15.37:43284) 2023-07-09T21:59:43.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e5cad640 1 -- 172.21.15.37:0/3584123737 learned_addr learned my addr 172.21.15.37:0/3584123737 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e4cab640 1 -- 172.21.15.37:0/3584123737 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892158154 0 0) 0x7f85e00b49f0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e4cab640 1 -- 172.21.15.37:0/3584123737 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85cc003530 con 0x7f85e00b7ab0 2023-07-09T21:59:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e54ac640 1 -- 172.21.15.37:0/3584123737 >> v1:172.21.15.119:6789/0 conn(0x7f85e00cef80 legacy=0x7f85e00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e54ac640 1 -- 172.21.15.37:0/3584123737 >> v1:172.21.15.37:6789/0 conn(0x7f85e00b7ab0 legacy=0x7f85e00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.631+0000 7f85e54ac640 1 -- 172.21.15.37:0/3584123737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00ccb80 con 0x7f85e00b4340 2023-07-09T21:59:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e54ac640 1 --2- 172.21.15.37:0/3584123737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b4340 0x7f85e006aa50 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cdc546b970d124 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e4cab640 1 -- 172.21.15.37:0/3584123737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00ab650 con 0x7f85e00b4340 2023-07-09T21:59:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e4cab640 1 -- 172.21.15.37:0/3584123737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d00ab7b0 con 0x7f85e00b4340 2023-07-09T21:59:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e4cab640 1 -- 172.21.15.37:0/3584123737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00abb40 con 0x7f85e00b4340 2023-07-09T21:59:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 -- 172.21.15.37:0/3584123737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b4340 msgr2=0x7f85e006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 --2- 172.21.15.37:0/3584123737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b4340 0x7f85e006aa50 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c450 comp rx=0 tx=0).stop 2023-07-09T21:59:43.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 -- 172.21.15.37:0/3584123737 shutdown_connections 2023-07-09T21:59:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 --2- 172.21.15.37:0/3584123737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b4340 0x7f85e006aa50 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 -- 172.21.15.37:0/3584123737 >> 172.21.15.37:0/3584123737 conn(0x7f85e0073090 msgr2=0x7f85e0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 -- 172.21.15.37:0/3584123737 shutdown_connections 2023-07-09T21:59:43.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.635+0000 7f85e7f11640 1 -- 172.21.15.37:0/3584123737 wait complete. 2023-07-09T21:59:43.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 Processor -- start 2023-07-09T21:59:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- start start 2023-07-09T21:59:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e00b4340 0x7f85e01f6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e00cef80 0x7f85e01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014ead0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014dec0 con 0x7f85e00b4340 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e014e1a0 con 0x7f85e00cef80 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51848/0 (socket says 172.21.15.37:51848) 2023-07-09T21:59:43.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 -- 172.21.15.37:0/2132593810 learned_addr learned my addr 172.21.15.37:0/2132593810 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e64ae640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e00cef80 0x7f85e01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e5cad640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e00b4340 0x7f85e01f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 -- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e00cef80 msgr2=0x7f85e01542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e00cef80 0x7f85e01542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 -- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e00b4340 msgr2=0x7f85e01f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e00b4340 0x7f85e01f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 -- 172.21.15.37:0/2132593810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0009420 con 0x7f85e00b7ab0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e54ac640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ad040 tx=0x7f85d001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00b5810 con 0x7f85e00b7ab0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d00b5990 con 0x7f85e00b7ab0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00b5d40 con 0x7f85e00b7ab0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e014e480 con 0x7f85e00b7ab0 2023-07-09T21:59:43.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.639+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e01f6ed0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e004d7d0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f85d00b4390 con 0x7f85e00b7ab0 2023-07-09T21:59:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85d67fc640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 0x7f85c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f85d011e9f0 con 0x7f85e00b7ab0 2023-07-09T21:59:43.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85e5cad640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 0x7f85c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.643+0000 7f85e5cad640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 0x7f85c4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0011f0 tx=0x7f85dc009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.647+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85d00ebc80 con 0x7f85e00b7ab0 2023-07-09T21:59:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85e006a830 con 0x7f85e00b7ab0 2023-07-09T21:59:43.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85d67fc640 1 -- 172.21.15.37:0/2132593810 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+18379 (secure 0 0 0) 0x7f85d00ab610 con 0x7f85e00b7ab0 2023-07-09T21:59:43.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:43.812 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":176,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T21:59:41.067980+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T21:59:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 msgr2=0x7f85c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 0x7f85c4068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0011f0 tx=0x7f85dc009040 comp rx=0 tx=0).stop 2023-07-09T21:59:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 msgr2=0x7f85e0153d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.807+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7f85d00ad040 tx=0x7f85d001ac90 comp rx=0 tx=0).stop 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 shutdown_connections 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f85c40663a0 0x7f85c4068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85e00cef80 0x7f85e01542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85e00b7ab0 0x7f85e0153d90 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 --2- 172.21.15.37:0/2132593810 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85e00b4340 0x7f85e01f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 >> 172.21.15.37:0/2132593810 conn(0x7f85e0073090 msgr2=0x7f85e0069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 shutdown_connections 2023-07-09T21:59:43.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.811+0000 7f85e7f11640 1 -- 172.21.15.37:0/2132593810 wait complete. 2023-07-09T21:59:43.832 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T21:59:43.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:59:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 Processor -- start 2023-07-09T21:59:43.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 -- start start 2023-07-09T21:59:43.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d200b7ab0 0x7f1d2006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 0x7f1d200b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d200b49f0 con 0x7f1d200b4170 2023-07-09T21:59:43.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200b7e80 con 0x7f1d200b7ab0 2023-07-09T21:59:43.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d27e56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200b4610 con 0x7f1d200cef80 2023-07-09T21:59:43.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d25bf2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d200b7ab0 0x7f1d2006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d263f3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d200b4170 0x7f1d2015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43288/0 (socket says 172.21.15.37:43288) 2023-07-09T21:59:43.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.971+0000 7f1d263f3640 1 -- 172.21.15.37:0/1078528675 learned_addr learned my addr 172.21.15.37:0/1078528675 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:43.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d253f1640 1 --2- 172.21.15.37:0/1078528675 >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 0x7f1d200b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d25bf2640 1 -- 172.21.15.37:0/1078528675 >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 msgr2=0x7f1d200b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d25bf2640 1 --2- 172.21.15.37:0/1078528675 >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 0x7f1d200b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d25bf2640 1 -- 172.21.15.37:0/1078528675 >> v1:172.21.15.37:6789/0 conn(0x7f1d200b4170 legacy=0x7f1d2015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d24bf0640 1 -- 172.21.15.37:0/1078528675 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104669857 0 0) 0x7f1d200b49f0 con 0x7f1d200b4170 2023-07-09T21:59:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d25bf2640 1 -- 172.21.15.37:0/1078528675 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200cc8a0 con 0x7f1d200b7ab0 2023-07-09T21:59:43.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d253f1640 1 --2- 172.21.15.37:0/1078528675 >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 0x7f1d200b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d25bf2640 1 --2- 172.21.15.37:0/1078528675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200b7ab0 0x7f1d2006aa50 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f1d200b4d10 tx=0x7f1d1c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a3bae687f9adb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d24bf0640 1 -- 172.21.15.37:0/1078528675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0a7070 con 0x7f1d200b7ab0 2023-07-09T21:59:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d24bf0640 1 -- 172.21.15.37:0/1078528675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1c0ab430 con 0x7f1d200b7ab0 2023-07-09T21:59:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.975+0000 7f1d24bf0640 1 -- 172.21.15.37:0/1078528675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0ab7c0 con 0x7f1d200b7ab0 2023-07-09T21:59:43.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- 172.21.15.37:0/1078528675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200b7ab0 msgr2=0x7f1d2006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1078528675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200b7ab0 0x7f1d2006aa50 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f1d200b4d10 tx=0x7f1d1c01c430 comp rx=0 tx=0).stop 2023-07-09T21:59:43.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- 172.21.15.37:0/1078528675 shutdown_connections 2023-07-09T21:59:43.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1078528675 >> v2:172.21.15.119:3300/0 conn(0x7f1d200cef80 0x7f1d200b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1078528675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200b7ab0 0x7f1d2006aa50 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- 172.21.15.37:0/1078528675 >> 172.21.15.37:0/1078528675 conn(0x7f1d20073090 msgr2=0x7f1d20069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:43.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- 172.21.15.37:0/1078528675 shutdown_connections 2023-07-09T21:59:43.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- 172.21.15.37:0/1078528675 wait complete. 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 Processor -- start 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- start start 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 0x7f1d200b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d200b7ab0 0x7f1d20155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200c80b0 con 0x7f1d200cef80 2023-07-09T21:59:43.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200c8390 con 0x7f1d200b4170 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d27e56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d200c8670 con 0x7f1d200b7ab0 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d263f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d25bf2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 0x7f1d200b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d263f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51876/0 (socket says 172.21.15.37:51876) 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d263f3640 1 -- 172.21.15.37:0/1365536430 learned_addr learned my addr 172.21.15.37:0/1365536430 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:43.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.979+0000 7f1d253f1640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d200b7ab0 0x7f1d20155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 -- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d200b7ab0 msgr2=0x7f1d20155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d200b7ab0 0x7f1d20155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 -- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 msgr2=0x7f1d200b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 0x7f1d200b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:43.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 -- 172.21.15.37:0/1365536430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009420 con 0x7f1d200cef80 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d25bf2640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 0x7f1d200b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d263f3640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f1d18001570 tx=0x7f1d1800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800a640 con 0x7f1d200cef80 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1800a7c0 con 0x7f1d200cef80 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800ab70 con 0x7f1d200cef80 2023-07-09T21:59:43.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d200c8950 con 0x7f1d200cef80 2023-07-09T21:59:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d200c72c0 con 0x7f1d200cef80 2023-07-09T21:59:43.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d200c8b70 con 0x7f1d200cef80 2023-07-09T21:59:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1d1800acd0 con 0x7f1d200cef80 2023-07-09T21:59:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 0x7f1d04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.983+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1d180833e0 con 0x7f1d200cef80 2023-07-09T21:59:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.987+0000 7f1d25bf2640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 0x7f1d04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:43.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.987+0000 7f1d25bf2640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 0x7f1d04068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0af000 tx=0x7f1d1c0a7000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:43.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:43.987+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1d180507c0 con 0x7f1d200cef80 2023-07-09T21:59:44.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.143+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1d200c8500 con 0x7f1d040663a0 2023-07-09T21:59:44.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.155+0000 7f1d167fc640 1 -- 172.21.15.37:0/1365536430 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306237 (secure 0 0 0) 0x7f1d200c8500 con 0x7f1d040663a0 2023-07-09T21:59:44.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:59:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 msgr2=0x7f1d04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 0x7f1d04068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0af000 tx=0x7f1d1c0a7000 comp rx=0 tx=0).stop 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 msgr2=0x7f1d20156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f1d18001570 tx=0x7f1d1800cca0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 shutdown_connections 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f1d040663a0 0x7f1d04068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d200cef80 0x7f1d20156380 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1d200b7ab0 0x7f1d20155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 --2- 172.21.15.37:0/1365536430 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1d200b4170 0x7f1d200b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 >> 172.21.15.37:0/1365536430 conn(0x7f1d20073090 msgr2=0x7f1d200b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 shutdown_connections 2023-07-09T21:59:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.159+0000 7f1d27e56640 1 -- 172.21.15.37:0/1365536430 wait complete. 2023-07-09T21:59:44.180 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:59:43.718537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":345188,"kb_used_data":18084,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754629532,"statfs":{"total":773094113280,"available":772740640768,"internally_reserved":0,"allocated":18518016,"data_stored":10084172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.679600"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051204+0000","last_change":"2023-07-09T21:59:39.051204+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051204+0000","last_undegraded":"2023-07-09T21:59:39.051204+0000","last_fullsized":"2023-07-09T21:59:39.051204+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044926+0000","last_change":"2023-07-09T21:59:39.044926+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044926+0000","last_undegraded":"2023-07-09T21:59:39.044926+0000","last_fullsized":"2023-07-09T21:59:39.044926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047466+0000","last_change":"2023-07-09T21:59:39.047466+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047466+0000","last_undegraded":"2023-07-09T21:59:39.047466+0000","last_fullsized":"2023-07-09T21:59:39.047466+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049990+0000","last_change":"2023-07-09T21:59:39.049990+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049990+0000","last_undegraded":"2023-07-09T21:59:39.049990+0000","last_fullsized":"2023-07-09T21:59:39.049990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050389+0000","last_change":"2023-07-09T21:59:39.050389+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050389+0000","last_undegraded":"2023-07-09T21:59:39.050389+0000","last_fullsized":"2023-07-09T21:59:39.050389+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050390+0000","last_change":"2023-07-09T21:59:39.050390+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050390+0000","last_undegraded":"2023-07-09T21:59:39.050390+0000","last_fullsized":"2023-07-09T21:59:39.050390+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.048313+0000","last_change":"2023-07-09T21:59:39.048313+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.048313+0000","last_undegraded":"2023-07-09T21:59:39.048313+0000","last_fullsized":"2023-07-09T21:59:39.048313+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055446+0000","last_change":"2023-07-09T21:59:39.055446+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055446+0000","last_undegraded":"2023-07-09T21:59:39.055446+0000","last_fullsized":"2023-07-09T21:59:39.055446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051289+0000","last_change":"2023-07-09T21:59:39.051289+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051289+0000","last_undegraded":"2023-07-09T21:59:39.051289+0000","last_fullsized":"2023-07-09T21:59:39.051289+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049044+0000","last_change":"2023-07-09T21:59:39.049044+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049044+0000","last_undegraded":"2023-07-09T21:59:39.049044+0000","last_fullsized":"2023-07-09T21:59:39.049044+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044468+0000","last_change":"2023-07-09T21:59:39.044468+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044468+0000","last_undegraded":"2023-07-09T21:59:39.044468+0000","last_fullsized":"2023-07-09T21:59:39.044468+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049553+0000","last_change":"2023-07-09T21:59:39.049553+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049553+0000","last_undegraded":"2023-07-09T21:59:39.049553+0000","last_fullsized":"2023-07-09T21:59:39.049553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051485+0000","last_change":"2023-07-09T21:59:39.051485+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051485+0000","last_undegraded":"2023-07-09T21:59:39.051485+0000","last_fullsized":"2023-07-09T21:59:39.051485+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047632+0000","last_change":"2023-07-09T21:59:39.047632+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047632+0000","last_undegraded":"2023-07-09T21:59:39.047632+0000","last_fullsized":"2023-07-09T21:59:39.047632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047944+0000","last_change":"2023-07-09T21:59:39.047944+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047944+0000","last_undegraded":"2023-07-09T21:59:39.047944+0000","last_fullsized":"2023-07-09T21:59:39.047944+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045066+0000","last_change":"2023-07-09T21:59:39.045066+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045066+0000","last_undegraded":"2023-07-09T21:59:39.045066+0000","last_fullsized":"2023-07-09T21:59:39.045066+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055240+0000","last_change":"2023-07-09T21:59:39.055240+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055240+0000","last_undegraded":"2023-07-09T21:59:39.055240+0000","last_fullsized":"2023-07-09T21:59:39.055240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043539+0000","last_change":"2023-07-09T21:59:39.043539+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043539+0000","last_undegraded":"2023-07-09T21:59:39.043539+0000","last_fullsized":"2023-07-09T21:59:39.043539+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050998+0000","last_change":"2023-07-09T21:59:39.050998+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050998+0000","last_undegraded":"2023-07-09T21:59:39.050998+0000","last_fullsized":"2023-07-09T21:59:39.050998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046987+0000","last_change":"2023-07-09T21:59:39.046987+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046987+0000","last_undegraded":"2023-07-09T21:59:39.046987+0000","last_fullsized":"2023-07-09T21:59:39.046987+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050743+0000","last_change":"2023-07-09T21:59:39.050743+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050743+0000","last_undegraded":"2023-07-09T21:59:39.050743+0000","last_fullsized":"2023-07-09T21:59:39.050743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044352+0000","last_change":"2023-07-09T21:59:39.044352+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044352+0000","last_undegraded":"2023-07-09T21:59:39.044352+0000","last_fullsized":"2023-07-09T21:59:39.044352+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050746+0000","last_change":"2023-07-09T21:59:39.050746+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050746+0000","last_undegraded":"2023-07-09T21:59:39.050746+0000","last_fullsized":"2023-07-09T21:59:39.050746+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054941+0000","last_change":"2023-07-09T21:59:39.054941+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054941+0000","last_undegraded":"2023-07-09T21:59:39.054941+0000","last_fullsized":"2023-07-09T21:59:39.054941+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049001+0000","last_change":"2023-07-09T21:59:39.049001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049001+0000","last_undegraded":"2023-07-09T21:59:39.049001+0000","last_fullsized":"2023-07-09T21:59:39.049001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044451+0000","last_change":"2023-07-09T21:59:39.044451+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044451+0000","last_undegraded":"2023-07-09T21:59:39.044451+0000","last_fullsized":"2023-07-09T21:59:39.044451+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057788+0000","last_change":"2023-07-09T21:59:39.057788+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057788+0000","last_undegraded":"2023-07-09T21:59:39.057788+0000","last_fullsized":"2023-07-09T21:59:39.057788+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044984+0000","last_change":"2023-07-09T21:59:39.044984+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044984+0000","last_undegraded":"2023-07-09T21:59:39.044984+0000","last_fullsized":"2023-07-09T21:59:39.044984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049355+0000","last_change":"2023-07-09T21:59:39.049355+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049355+0000","last_undegraded":"2023-07-09T21:59:39.049355+0000","last_fullsized":"2023-07-09T21:59:39.049355+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054598+0000","last_change":"2023-07-09T21:59:39.054598+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054598+0000","last_undegraded":"2023-07-09T21:59:39.054598+0000","last_fullsized":"2023-07-09T21:59:39.054598+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044040+0000","last_change":"2023-07-09T21:59:39.044040+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044040+0000","last_undegraded":"2023-07-09T21:59:39.044040+0000","last_fullsized":"2023-07-09T21:59:39.044040+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061144+0000","last_change":"2023-07-09T21:59:39.056361+0000","last_active":"2023-07-09T21:59:39.061144+0000","last_peered":"2023-07-09T21:59:39.061144+0000","last_clean":"2023-07-09T21:59:39.061144+0000","last_became_active":"2023-07-09T21:59:39.056052+0000","last_became_peered":"2023-07-09T21:59:39.056052+0000","last_unstale":"2023-07-09T21:59:39.061144+0000","last_undegraded":"2023-07-09T21:59:39.061144+0000","last_fullsized":"2023-07-09T21:59:39.061144+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047014+0000","last_change":"2023-07-09T21:59:39.047014+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047014+0000","last_undegraded":"2023-07-09T21:59:39.047014+0000","last_fullsized":"2023-07-09T21:59:39.047014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072372+0000","last_change":"2023-07-09T21:59:39.069622+0000","last_active":"2023-07-09T21:59:39.072372+0000","last_peered":"2023-07-09T21:59:39.072372+0000","last_clean":"2023-07-09T21:59:39.072372+0000","last_became_active":"2023-07-09T21:59:39.069069+0000","last_became_peered":"2023-07-09T21:59:39.069069+0000","last_unstale":"2023-07-09T21:59:39.072372+0000","last_undegraded":"2023-07-09T21:59:39.072372+0000","last_fullsized":"2023-07-09T21:59:39.072372+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:38.835390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056293+0000","last_change":"2023-07-09T21:59:39.056293+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056293+0000","last_undegraded":"2023-07-09T21:59:39.056293+0000","last_fullsized":"2023-07-09T21:59:39.056293+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071420+0000","last_change":"2023-07-09T21:59:39.068983+0000","last_active":"2023-07-09T21:59:39.071420+0000","last_peered":"2023-07-09T21:59:39.071420+0000","last_clean":"2023-07-09T21:59:39.071420+0000","last_became_active":"2023-07-09T21:59:39.068685+0000","last_became_peered":"2023-07-09T21:59:39.068685+0000","last_unstale":"2023-07-09T21:59:39.071420+0000","last_undegraded":"2023-07-09T21:59:39.071420+0000","last_fullsized":"2023-07-09T21:59:39.071420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:39.695550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054604+0000","last_change":"2023-07-09T21:59:39.054604+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054604+0000","last_undegraded":"2023-07-09T21:59:39.054604+0000","last_fullsized":"2023-07-09T21:59:39.054604+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067046+0000","last_change":"2023-07-09T21:59:39.065490+0000","last_active":"2023-07-09T21:59:39.067046+0000","last_peered":"2023-07-09T21:59:39.067046+0000","last_clean":"2023-07-09T21:59:39.067046+0000","last_became_active":"2023-07-09T21:59:39.065180+0000","last_became_peered":"2023-07-09T21:59:39.065180+0000","last_unstale":"2023-07-09T21:59:39.067046+0000","last_undegraded":"2023-07-09T21:59:39.067046+0000","last_fullsized":"2023-07-09T21:59:39.067046+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:55.007372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044765+0000","last_change":"2023-07-09T21:59:39.044765+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044765+0000","last_undegraded":"2023-07-09T21:59:39.044765+0000","last_fullsized":"2023-07-09T21:59:39.044765+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067016+0000","last_change":"2023-07-09T21:59:39.061460+0000","last_active":"2023-07-09T21:59:39.067016+0000","last_peered":"2023-07-09T21:59:39.067016+0000","last_clean":"2023-07-09T21:59:39.067016+0000","last_became_active":"2023-07-09T21:59:39.061102+0000","last_became_peered":"2023-07-09T21:59:39.061102+0000","last_unstale":"2023-07-09T21:59:39.067016+0000","last_undegraded":"2023-07-09T21:59:39.067016+0000","last_fullsized":"2023-07-09T21:59:39.067016+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:34.197028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047622+0000","last_change":"2023-07-09T21:59:39.047622+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047622+0000","last_undegraded":"2023-07-09T21:59:39.047622+0000","last_fullsized":"2023-07-09T21:59:39.047622+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062093+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.062093+0000","last_peered":"2023-07-09T21:59:39.062093+0000","last_clean":"2023-07-09T21:59:39.062093+0000","last_became_active":"2023-07-09T21:59:39.059606+0000","last_became_peered":"2023-07-09T21:59:39.059606+0000","last_unstale":"2023-07-09T21:59:39.062093+0000","last_undegraded":"2023-07-09T21:59:39.062093+0000","last_fullsized":"2023-07-09T21:59:39.062093+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046125+0000","last_change":"2023-07-09T21:59:39.046125+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046125+0000","last_undegraded":"2023-07-09T21:59:39.046125+0000","last_fullsized":"2023-07-09T21:59:39.046125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064752+0000","last_change":"2023-07-09T21:59:39.059613+0000","last_active":"2023-07-09T21:59:39.064752+0000","last_peered":"2023-07-09T21:59:39.064752+0000","last_clean":"2023-07-09T21:59:39.064752+0000","last_became_active":"2023-07-09T21:59:39.059312+0000","last_became_peered":"2023-07-09T21:59:39.059312+0000","last_unstale":"2023-07-09T21:59:39.064752+0000","last_undegraded":"2023-07-09T21:59:39.064752+0000","last_fullsized":"2023-07-09T21:59:39.064752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:00:45.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049672+0000","last_change":"2023-07-09T21:59:39.049672+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049672+0000","last_undegraded":"2023-07-09T21:59:39.049672+0000","last_fullsized":"2023-07-09T21:59:39.049672+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062065+0000","last_change":"2023-07-09T21:59:39.058431+0000","last_active":"2023-07-09T21:59:39.062065+0000","last_peered":"2023-07-09T21:59:39.062065+0000","last_clean":"2023-07-09T21:59:39.062065+0000","last_became_active":"2023-07-09T21:59:39.058114+0000","last_became_peered":"2023-07-09T21:59:39.058114+0000","last_unstale":"2023-07-09T21:59:39.062065+0000","last_undegraded":"2023-07-09T21:59:39.062065+0000","last_fullsized":"2023-07-09T21:59:39.062065+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053001+0000","last_change":"2023-07-09T21:59:39.053001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053001+0000","last_undegraded":"2023-07-09T21:59:39.053001+0000","last_fullsized":"2023-07-09T21:59:39.053001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.069649+0000","last_change":"2023-07-09T21:59:39.068870+0000","last_active":"2023-07-09T21:59:39.069649+0000","last_peered":"2023-07-09T21:59:39.069649+0000","last_clean":"2023-07-09T21:59:39.069649+0000","last_became_active":"2023-07-09T21:59:39.068548+0000","last_became_peered":"2023-07-09T21:59:39.068548+0000","last_unstale":"2023-07-09T21:59:39.069649+0000","last_undegraded":"2023-07-09T21:59:39.069649+0000","last_fullsized":"2023-07-09T21:59:39.069649+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:58.022306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055728+0000","last_change":"2023-07-09T21:59:39.055728+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055728+0000","last_undegraded":"2023-07-09T21:59:39.055728+0000","last_fullsized":"2023-07-09T21:59:39.055728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072354+0000","last_change":"2023-07-09T21:59:39.070672+0000","last_active":"2023-07-09T21:59:39.072354+0000","last_peered":"2023-07-09T21:59:39.072354+0000","last_clean":"2023-07-09T21:59:39.072354+0000","last_became_active":"2023-07-09T21:59:39.069356+0000","last_became_peered":"2023-07-09T21:59:39.069356+0000","last_unstale":"2023-07-09T21:59:39.072354+0000","last_undegraded":"2023-07-09T21:59:39.072354+0000","last_fullsized":"2023-07-09T21:59:39.072354+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:18:59.193761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054492+0000","last_change":"2023-07-09T21:59:39.054492+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054492+0000","last_undegraded":"2023-07-09T21:59:39.054492+0000","last_fullsized":"2023-07-09T21:59:39.054492+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.056455+0000","last_change":"2023-07-09T21:59:39.054129+0000","last_active":"2023-07-09T21:59:39.056455+0000","last_peered":"2023-07-09T21:59:39.056455+0000","last_clean":"2023-07-09T21:59:39.056455+0000","last_became_active":"2023-07-09T21:59:39.053847+0000","last_became_peered":"2023-07-09T21:59:39.053847+0000","last_unstale":"2023-07-09T21:59:39.056455+0000","last_undegraded":"2023-07-09T21:59:39.056455+0000","last_fullsized":"2023-07-09T21:59:39.056455+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:56.842044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050228+0000","last_change":"2023-07-09T21:59:39.050228+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050228+0000","last_undegraded":"2023-07-09T21:59:39.050228+0000","last_fullsized":"2023-07-09T21:59:39.050228+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068179+0000","last_change":"2023-07-09T21:59:39.066598+0000","last_active":"2023-07-09T21:59:39.068179+0000","last_peered":"2023-07-09T21:59:39.068179+0000","last_clean":"2023-07-09T21:59:39.068179+0000","last_became_active":"2023-07-09T21:59:39.066274+0000","last_became_peered":"2023-07-09T21:59:39.066274+0000","last_unstale":"2023-07-09T21:59:39.068179+0000","last_undegraded":"2023-07-09T21:59:39.068179+0000","last_fullsized":"2023-07-09T21:59:39.068179+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053525+0000","last_change":"2023-07-09T21:59:39.053525+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053525+0000","last_undegraded":"2023-07-09T21:59:39.053525+0000","last_fullsized":"2023-07-09T21:59:39.053525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067438+0000","last_change":"2023-07-09T21:59:39.065915+0000","last_active":"2023-07-09T21:59:39.067438+0000","last_peered":"2023-07-09T21:59:39.067438+0000","last_clean":"2023-07-09T21:59:39.067438+0000","last_became_active":"2023-07-09T21:59:39.065564+0000","last_became_peered":"2023-07-09T21:59:39.065564+0000","last_unstale":"2023-07-09T21:59:39.067438+0000","last_undegraded":"2023-07-09T21:59:39.067438+0000","last_fullsized":"2023-07-09T21:59:39.067438+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:11.953775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046704+0000","last_change":"2023-07-09T21:59:39.046704+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046704+0000","last_undegraded":"2023-07-09T21:59:39.046704+0000","last_fullsized":"2023-07-09T21:59:39.046704+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067044+0000","last_change":"2023-07-09T21:59:39.061507+0000","last_active":"2023-07-09T21:59:39.067044+0000","last_peered":"2023-07-09T21:59:39.067044+0000","last_clean":"2023-07-09T21:59:39.067044+0000","last_became_active":"2023-07-09T21:59:39.061215+0000","last_became_peered":"2023-07-09T21:59:39.061215+0000","last_unstale":"2023-07-09T21:59:39.067044+0000","last_undegraded":"2023-07-09T21:59:39.067044+0000","last_fullsized":"2023-07-09T21:59:39.067044+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:53.074688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052633+0000","last_change":"2023-07-09T21:59:39.052633+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052633+0000","last_undegraded":"2023-07-09T21:59:39.052633+0000","last_fullsized":"2023-07-09T21:59:39.052633+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062263+0000","last_change":"2023-07-09T21:59:39.059503+0000","last_active":"2023-07-09T21:59:39.062263+0000","last_peered":"2023-07-09T21:59:39.062263+0000","last_clean":"2023-07-09T21:59:39.062263+0000","last_became_active":"2023-07-09T21:59:39.059214+0000","last_became_peered":"2023-07-09T21:59:39.059214+0000","last_unstale":"2023-07-09T21:59:39.062263+0000","last_undegraded":"2023-07-09T21:59:39.062263+0000","last_fullsized":"2023-07-09T21:59:39.062263+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:26.091057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043741+0000","last_change":"2023-07-09T21:59:39.043741+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043741+0000","last_undegraded":"2023-07-09T21:59:39.043741+0000","last_fullsized":"2023-07-09T21:59:39.043741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066968+0000","last_change":"2023-07-09T21:59:39.061861+0000","last_active":"2023-07-09T21:59:39.066968+0000","last_peered":"2023-07-09T21:59:39.066968+0000","last_clean":"2023-07-09T21:59:39.066968+0000","last_became_active":"2023-07-09T21:59:39.061558+0000","last_became_peered":"2023-07-09T21:59:39.061558+0000","last_unstale":"2023-07-09T21:59:39.066968+0000","last_undegraded":"2023-07-09T21:59:39.066968+0000","last_fullsized":"2023-07-09T21:59:39.066968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:18.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051227+0000","last_change":"2023-07-09T21:59:39.051227+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051227+0000","last_undegraded":"2023-07-09T21:59:39.051227+0000","last_fullsized":"2023-07-09T21:59:39.051227+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066358+0000","last_change":"2023-07-09T21:59:39.064293+0000","last_active":"2023-07-09T21:59:39.066358+0000","last_peered":"2023-07-09T21:59:39.066358+0000","last_clean":"2023-07-09T21:59:39.066358+0000","last_became_active":"2023-07-09T21:59:39.064014+0000","last_became_peered":"2023-07-09T21:59:39.064014+0000","last_unstale":"2023-07-09T21:59:39.066358+0000","last_undegraded":"2023-07-09T21:59:39.066358+0000","last_fullsized":"2023-07-09T21:59:39.066358+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046973+0000","last_change":"2023-07-09T21:59:39.046973+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046973+0000","last_undegraded":"2023-07-09T21:59:39.046973+0000","last_fullsized":"2023-07-09T21:59:39.046973+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064798+0000","last_change":"2023-07-09T21:59:39.062851+0000","last_active":"2023-07-09T21:59:39.064798+0000","last_peered":"2023-07-09T21:59:39.064798+0000","last_clean":"2023-07-09T21:59:39.064798+0000","last_became_active":"2023-07-09T21:59:39.062560+0000","last_became_peered":"2023-07-09T21:59:39.062560+0000","last_unstale":"2023-07-09T21:59:39.064798+0000","last_undegraded":"2023-07-09T21:59:39.064798+0000","last_fullsized":"2023-07-09T21:59:39.064798+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:41.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052025+0000","last_change":"2023-07-09T21:59:39.052025+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052025+0000","last_undegraded":"2023-07-09T21:59:39.052025+0000","last_fullsized":"2023-07-09T21:59:39.052025+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062225+0000","last_change":"2023-07-09T21:59:39.060698+0000","last_active":"2023-07-09T21:59:39.062225+0000","last_peered":"2023-07-09T21:59:39.062225+0000","last_clean":"2023-07-09T21:59:39.062225+0000","last_became_active":"2023-07-09T21:59:39.060367+0000","last_became_peered":"2023-07-09T21:59:39.060367+0000","last_unstale":"2023-07-09T21:59:39.062225+0000","last_undegraded":"2023-07-09T21:59:39.062225+0000","last_fullsized":"2023-07-09T21:59:39.062225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:57.917936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050803+0000","last_change":"2023-07-09T21:59:39.050803+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050803+0000","last_undegraded":"2023-07-09T21:59:39.050803+0000","last_fullsized":"2023-07-09T21:59:39.050803+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067026+0000","last_change":"2023-07-09T21:59:39.066091+0000","last_active":"2023-07-09T21:59:39.067026+0000","last_peered":"2023-07-09T21:59:39.067026+0000","last_clean":"2023-07-09T21:59:39.067026+0000","last_became_active":"2023-07-09T21:59:39.065700+0000","last_became_peered":"2023-07-09T21:59:39.065700+0000","last_unstale":"2023-07-09T21:59:39.067026+0000","last_undegraded":"2023-07-09T21:59:39.067026+0000","last_fullsized":"2023-07-09T21:59:39.067026+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:17.268000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050309+0000","last_change":"2023-07-09T21:59:39.050309+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050309+0000","last_undegraded":"2023-07-09T21:59:39.050309+0000","last_fullsized":"2023-07-09T21:59:39.050309+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064871+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.064871+0000","last_peered":"2023-07-09T21:59:39.064871+0000","last_clean":"2023-07-09T21:59:39.064871+0000","last_became_active":"2023-07-09T21:59:39.059591+0000","last_became_peered":"2023-07-09T21:59:39.059591+0000","last_unstale":"2023-07-09T21:59:39.064871+0000","last_undegraded":"2023-07-09T21:59:39.064871+0000","last_fullsized":"2023-07-09T21:59:39.064871+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:19.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046315+0000","last_change":"2023-07-09T21:59:39.046315+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046315+0000","last_undegraded":"2023-07-09T21:59:39.046315+0000","last_fullsized":"2023-07-09T21:59:39.046315+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063750+0000","last_change":"2023-07-09T21:59:39.062994+0000","last_active":"2023-07-09T21:59:39.063750+0000","last_peered":"2023-07-09T21:59:39.063750+0000","last_clean":"2023-07-09T21:59:39.063750+0000","last_became_active":"2023-07-09T21:59:39.062749+0000","last_became_peered":"2023-07-09T21:59:39.062749+0000","last_unstale":"2023-07-09T21:59:39.063750+0000","last_undegraded":"2023-07-09T21:59:39.063750+0000","last_fullsized":"2023-07-09T21:59:39.063750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:14.365863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045643+0000","last_change":"2023-07-09T21:59:39.045643+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045643+0000","last_undegraded":"2023-07-09T21:59:39.045643+0000","last_fullsized":"2023-07-09T21:59:39.045643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062060+0000","last_change":"2023-07-09T21:59:39.059053+0000","last_active":"2023-07-09T21:59:39.062060+0000","last_peered":"2023-07-09T21:59:39.062060+0000","last_clean":"2023-07-09T21:59:39.062060+0000","last_became_active":"2023-07-09T21:59:39.058548+0000","last_became_peered":"2023-07-09T21:59:39.058548+0000","last_unstale":"2023-07-09T21:59:39.062060+0000","last_undegraded":"2023-07-09T21:59:39.062060+0000","last_fullsized":"2023-07-09T21:59:39.062060+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:44.390037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.058801+0000","last_change":"2023-07-09T21:59:39.058801+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.058801+0000","last_undegraded":"2023-07-09T21:59:39.058801+0000","last_fullsized":"2023-07-09T21:59:39.058801+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071379+0000","last_change":"2023-07-09T21:59:39.068790+0000","last_active":"2023-07-09T21:59:39.071379+0000","last_peered":"2023-07-09T21:59:39.071379+0000","last_clean":"2023-07-09T21:59:39.071379+0000","last_became_active":"2023-07-09T21:59:39.068499+0000","last_became_peered":"2023-07-09T21:59:39.068499+0000","last_unstale":"2023-07-09T21:59:39.071379+0000","last_undegraded":"2023-07-09T21:59:39.071379+0000","last_fullsized":"2023-07-09T21:59:39.071379+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:53.381383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056173+0000","last_change":"2023-07-09T21:59:39.056173+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056173+0000","last_undegraded":"2023-07-09T21:59:39.056173+0000","last_fullsized":"2023-07-09T21:59:39.056173+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065120+0000","last_change":"2023-07-09T21:59:39.064156+0000","last_active":"2023-07-09T21:59:39.065120+0000","last_peered":"2023-07-09T21:59:39.065120+0000","last_clean":"2023-07-09T21:59:39.065120+0000","last_became_active":"2023-07-09T21:59:39.063822+0000","last_became_peered":"2023-07-09T21:59:39.063822+0000","last_unstale":"2023-07-09T21:59:39.065120+0000","last_undegraded":"2023-07-09T21:59:39.065120+0000","last_fullsized":"2023-07-09T21:59:39.065120+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:31.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"163'304","reported_seq":1112,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055522+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:59:39.055522+0000","last_peered":"2023-07-09T21:59:39.055522+0000","last_clean":"2023-07-09T21:59:39.055522+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:59:39.055522+0000","last_undegraded":"2023-07-09T21:59:39.055522+0000","last_fullsized":"2023-07-09T21:59:39.055522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:06.741743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.053201+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:59:39.053201+0000","last_peered":"2023-07-09T21:59:39.053201+0000","last_clean":"2023-07-09T21:59:39.053201+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:59:39.053201+0000","last_undegraded":"2023-07-09T21:59:39.053201+0000","last_fullsized":"2023-07-09T21:59:39.053201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:58.480464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057873+0000","last_change":"2023-07-09T21:59:39.057873+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057873+0000","last_undegraded":"2023-07-09T21:59:39.057873+0000","last_fullsized":"2023-07-09T21:59:39.057873+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072322+0000","last_change":"2023-07-09T21:59:39.070215+0000","last_active":"2023-07-09T21:59:39.072322+0000","last_peered":"2023-07-09T21:59:39.072322+0000","last_clean":"2023-07-09T21:59:39.072322+0000","last_became_active":"2023-07-09T21:59:39.069951+0000","last_became_peered":"2023-07-09T21:59:39.069951+0000","last_unstale":"2023-07-09T21:59:39.072322+0000","last_undegraded":"2023-07-09T21:59:39.072322+0000","last_fullsized":"2023-07-09T21:59:39.072322+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:35.819224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":293,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055395+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:59:39.055395+0000","last_peered":"2023-07-09T21:59:39.055395+0000","last_clean":"2023-07-09T21:59:39.055395+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:59:39.055395+0000","last_undegraded":"2023-07-09T21:59:39.055395+0000","last_fullsized":"2023-07-09T21:59:39.055395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:09:27.333574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043386+0000","last_change":"2023-07-09T21:59:39.043386+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043386+0000","last_undegraded":"2023-07-09T21:59:39.043386+0000","last_fullsized":"2023-07-09T21:59:39.043386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062745+0000","last_change":"2023-07-09T21:59:39.058851+0000","last_active":"2023-07-09T21:59:39.062745+0000","last_peered":"2023-07-09T21:59:39.062745+0000","last_clean":"2023-07-09T21:59:39.062745+0000","last_became_active":"2023-07-09T21:59:39.058567+0000","last_became_peered":"2023-07-09T21:59:39.058567+0000","last_unstale":"2023-07-09T21:59:39.062745+0000","last_undegraded":"2023-07-09T21:59:39.062745+0000","last_fullsized":"2023-07-09T21:59:39.062745+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:02.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.038283+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:59:39.038283+0000","last_peered":"2023-07-09T21:59:39.038283+0000","last_clean":"2023-07-09T21:59:39.038283+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:59:39.038283+0000","last_undegraded":"2023-07-09T21:59:39.038283+0000","last_fullsized":"2023-07-09T21:59:39.038283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:30:47.231350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044627+0000","last_change":"2023-07-09T21:59:39.044627+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044627+0000","last_undegraded":"2023-07-09T21:59:39.044627+0000","last_fullsized":"2023-07-09T21:59:39.044627+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055090+0000","last_change":"2023-07-09T21:59:39.048558+0000","last_active":"2023-07-09T21:59:39.055090+0000","last_peered":"2023-07-09T21:59:39.055090+0000","last_clean":"2023-07-09T21:59:39.055090+0000","last_became_active":"2023-07-09T21:59:39.048275+0000","last_became_peered":"2023-07-09T21:59:39.048275+0000","last_unstale":"2023-07-09T21:59:39.055090+0000","last_undegraded":"2023-07-09T21:59:39.055090+0000","last_fullsized":"2023-07-09T21:59:39.055090+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:15.911625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.051690+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:59:39.051690+0000","last_peered":"2023-07-09T21:59:39.051690+0000","last_clean":"2023-07-09T21:59:39.051690+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:59:39.051690+0000","last_undegraded":"2023-07-09T21:59:39.051690+0000","last_fullsized":"2023-07-09T21:59:39.051690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:13:06.666361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050862+0000","last_change":"2023-07-09T21:59:39.050862+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050862+0000","last_undegraded":"2023-07-09T21:59:39.050862+0000","last_fullsized":"2023-07-09T21:59:39.050862+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061139+0000","last_change":"2023-07-09T21:59:39.056568+0000","last_active":"2023-07-09T21:59:39.061139+0000","last_peered":"2023-07-09T21:59:39.061139+0000","last_clean":"2023-07-09T21:59:39.061139+0000","last_became_active":"2023-07-09T21:59:39.056167+0000","last_became_peered":"2023-07-09T21:59:39.056167+0000","last_unstale":"2023-07-09T21:59:39.061139+0000","last_undegraded":"2023-07-09T21:59:39.061139+0000","last_fullsized":"2023-07-09T21:59:39.061139+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":284,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047976+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:59:39.047976+0000","last_peered":"2023-07-09T21:59:39.047976+0000","last_clean":"2023-07-09T21:59:39.047976+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:59:39.047976+0000","last_undegraded":"2023-07-09T21:59:39.047976+0000","last_fullsized":"2023-07-09T21:59:39.047976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:45.996233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047192+0000","last_change":"2023-07-09T21:59:39.047192+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047192+0000","last_undegraded":"2023-07-09T21:59:39.047192+0000","last_fullsized":"2023-07-09T21:59:39.047192+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068192+0000","last_change":"2023-07-09T21:59:39.066863+0000","last_active":"2023-07-09T21:59:39.068192+0000","last_peered":"2023-07-09T21:59:39.068192+0000","last_clean":"2023-07-09T21:59:39.068192+0000","last_became_active":"2023-07-09T21:59:39.066027+0000","last_became_peered":"2023-07-09T21:59:39.066027+0000","last_unstale":"2023-07-09T21:59:39.068192+0000","last_undegraded":"2023-07-09T21:59:39.068192+0000","last_fullsized":"2023-07-09T21:59:39.068192+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":292,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.058009+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:59:39.058009+0000","last_peered":"2023-07-09T21:59:39.058009+0000","last_clean":"2023-07-09T21:59:39.058009+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:59:39.058009+0000","last_undegraded":"2023-07-09T21:59:39.058009+0000","last_fullsized":"2023-07-09T21:59:39.058009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:17.234873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049965+0000","last_change":"2023-07-09T21:59:39.049965+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049965+0000","last_undegraded":"2023-07-09T21:59:39.049965+0000","last_fullsized":"2023-07-09T21:59:39.049965+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063009+0000","last_change":"2023-07-09T21:59:39.059472+0000","last_active":"2023-07-09T21:59:39.063009+0000","last_peered":"2023-07-09T21:59:39.063009+0000","last_clean":"2023-07-09T21:59:39.063009+0000","last_became_active":"2023-07-09T21:59:39.059185+0000","last_became_peered":"2023-07-09T21:59:39.059185+0000","last_unstale":"2023-07-09T21:59:39.063009+0000","last_undegraded":"2023-07-09T21:59:39.063009+0000","last_fullsized":"2023-07-09T21:59:39.063009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.045200+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:59:39.045200+0000","last_peered":"2023-07-09T21:59:39.045200+0000","last_clean":"2023-07-09T21:59:39.045200+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:59:39.045200+0000","last_undegraded":"2023-07-09T21:59:39.045200+0000","last_fullsized":"2023-07-09T21:59:39.045200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:15.213940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044300+0000","last_change":"2023-07-09T21:59:39.044300+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044300+0000","last_undegraded":"2023-07-09T21:59:39.044300+0000","last_fullsized":"2023-07-09T21:59:39.044300+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065484+0000","last_change":"2023-07-09T21:59:39.062972+0000","last_active":"2023-07-09T21:59:39.065484+0000","last_peered":"2023-07-09T21:59:39.065484+0000","last_clean":"2023-07-09T21:59:39.065484+0000","last_became_active":"2023-07-09T21:59:39.062692+0000","last_became_peered":"2023-07-09T21:59:39.062692+0000","last_unstale":"2023-07-09T21:59:39.065484+0000","last_undegraded":"2023-07-09T21:59:39.065484+0000","last_fullsized":"2023-07-09T21:59:39.065484+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:08.036755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":300,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:59:39.047584+0000","last_peered":"2023-07-09T21:59:39.047584+0000","last_clean":"2023-07-09T21:59:39.047584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:59:39.047584+0000","last_undegraded":"2023-07-09T21:59:39.047584+0000","last_fullsized":"2023-07-09T21:59:39.047584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:04.016376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2752512,"data_stored":1699120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.41599999999999998},"max":{"1min":0.98699999999999999,"5min":0.99299999999999999,"15min":1.0169999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96499999999999997,"5min":1.028,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":1.04,"15min":1.0660000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0740000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.621,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.004,"5min":1.0289999999999999,"15min":1.038},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.84299999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.077},"last":0.624},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.075,"15min":1.075},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.04},"last":0.624}]},{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89600000000000002,"5min":0.98199999999999998,"15min":1.177},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":1.1200000000000001,"15min":1.1890000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.50600000000000001,"15min":0.503},"max":{"1min":0.96499999999999997,"5min":1.504,"15min":1.504},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.436},"max":{"1min":0.878,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.52200000000000002,"15min":0.51400000000000001},"max":{"1min":0.90800000000000003,"5min":1.02,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54000000000000004},"max":{"1min":1.0049999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":1.161,"15min":1.161},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.05,"15min":1.099},"last":0.71199999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.95899999999999996,"15min":1.052},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.077},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316528,"statfs":{"total":96636764160,"available":96580124672,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.012,"15min":1.012},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.97999999999999998,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82199999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":1.05},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.046,"5min":1.095,"15min":1.095},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.49299999999999999},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.034},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.379},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.504},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.41799999999999998},"max":{"1min":1.056,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":0.93400000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.745},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.996,"15min":1.075},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":0.95499999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.044,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":0.998,"15min":1.119},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.49199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":1.03,"15min":1.0669999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76200000000000001,"15min":0.74399999999999999},"min":{"1min":0.67500000000000004,"5min":0.57999999999999996,"15min":0.48999999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.61899999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0289999999999999,"5min":1.038,"15min":1.1599999999999999},"last":0.745}]},{"osd":5,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":0.91600000000000004,"5min":1.05,"15min":1.079},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.627,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.92400000000000004,"5min":1.016,"15min":1.016},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96499999999999997,"15min":1.018},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.54900000000000004,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.97199999999999998,"5min":1.069,"15min":1.069},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.57699999999999996,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72499999999999998},"min":{"1min":0.60499999999999998,"5min":0.501,"15min":0.46100000000000002},"max":{"1min":1.0109999999999999,"5min":1.0389999999999999,"15min":1.044},"last":0.871}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.0860000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.315},"max":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":1.113},"last":0.438}]},{"osd":1,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":1.133},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":1.0149999999999999,"15min":1.194},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.135,"5min":1.1379999999999999,"15min":1.5429999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.5649999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1479999999999999,"15min":1.302},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.101,"5min":1.1879999999999999,"15min":1.262},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.161,"15min":1.363},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.2070000000000001,"15min":1.601},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.61299999999999999,"5min":0.72199999999999998,"15min":0.96499999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.85099999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":0.77200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.65600000000000003,"5min":0.76300000000000001,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":1.016},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.2290000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.117,"15min":1.337},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.69899999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.306},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.66500000000000004,"5min":0.624,"15min":0.57699999999999996},"max":{"1min":1.276,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.56799999999999995,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.1739999999999999,"15min":1.375},"last":0.79700000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.2529999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.294},"last":0.82399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.115,"5min":1.2809999999999999,"15min":1.298},"last":0.623},{"interface":"front","average":{"1min":0.87,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.746,"5min":0.624,"15min":0.61399999999999999},"max":{"1min":1.1180000000000001,"5min":1.196,"15min":1.256},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80600000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.63100000000000001,"5min":0.72599999999999998,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"max":{"1min":1.024,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.70899999999999996,"5min":0.56000000000000005,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.2769999999999999,"15min":1.337},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55100000000000005,"15min":0.48899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1160000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.099,"5min":1.157,"15min":1.1659999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93300000000000005,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.0640000000000001,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575291,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41940,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329900,"statfs":{"total":96636764160,"available":96593817600,"internally_reserved":0,"allocated":2764800,"data_stored":1705804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.73599999999999999,"15min":0.89300000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65400000000000003,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.81100000000000005,"15min":0.80400000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91000000000000003,"5min":1.306,"15min":1.306},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88600000000000001,"5min":1.1839999999999999,"15min":1.3600000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.81200000000000006},"min":{"1min":0.624,"5min":0.503,"15min":0.503},"max":{"1min":0.93200000000000005,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.82399999999999995},"min":{"1min":0.65500000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":0.92400000000000004,"5min":1.3260000000000001,"15min":1.381},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.67700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.1739999999999999,"15min":1.1990000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"max":{"1min":0.873,"5min":1.2470000000000001,"15min":1.3400000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.397,"15min":1.397},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:59:44.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:59:44.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 Processor -- start 2023-07-09T21:59:44.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 -- start start 2023-07-09T21:59:44.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 0x7efc0006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 0x7efc000b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc000b49f0 con 0x7efc000b4170 2023-07-09T21:59:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc000b7e80 con 0x7efc000cef80 2023-07-09T21:59:44.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efc05419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc000b45f0 con 0x7efc000b7ab0 2023-07-09T21:59:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efbff7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc000b4170 0x7efc0015f490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43300/0 (socket says 172.21.15.37:43300) 2023-07-09T21:59:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efbff7fe640 1 -- 172.21.15.37:0/1495168310 learned_addr learned my addr 172.21.15.37:0/1495168310 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:44.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efbf7fff640 1 --2- 172.21.15.37:0/1495168310 >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 0x7efc000b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.363+0000 7efbfeffd640 1 --2- 172.21.15.37:0/1495168310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 0x7efc0006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfe7fc640 1 -- 172.21.15.37:0/1495168310 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804202687 0 0) 0x7efc000b49f0 con 0x7efc000b4170 2023-07-09T21:59:44.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfe7fc640 1 -- 172.21.15.37:0/1495168310 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbec003530 con 0x7efc000b4170 2023-07-09T21:59:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfeffd640 1 -- 172.21.15.37:0/1495168310 >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 msgr2=0x7efc000b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfeffd640 1 --2- 172.21.15.37:0/1495168310 >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 0x7efc000b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfeffd640 1 -- 172.21.15.37:0/1495168310 >> v1:172.21.15.37:6789/0 conn(0x7efc000b4170 legacy=0x7efc0015f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfeffd640 1 -- 172.21.15.37:0/1495168310 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc000cc8a0 con 0x7efc000b7ab0 2023-07-09T21:59:44.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbf7fff640 1 --2- 172.21.15.37:0/1495168310 >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 0x7efc000b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfeffd640 1 --2- 172.21.15.37:0/1495168310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 0x7efc0006aa50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efbf00097c0 tx=0x7efbf001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=931985469495fc4f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfe7fc640 1 -- 172.21.15.37:0/1495168310 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00ab650 con 0x7efc000b7ab0 2023-07-09T21:59:44.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfe7fc640 1 -- 172.21.15.37:0/1495168310 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf00ab7b0 con 0x7efc000b7ab0 2023-07-09T21:59:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.367+0000 7efbfe7fc640 1 -- 172.21.15.37:0/1495168310 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf00abb40 con 0x7efc000b7ab0 2023-07-09T21:59:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- 172.21.15.37:0/1495168310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 msgr2=0x7efc0006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- 172.21.15.37:0/1495168310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 0x7efc0006aa50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efbf00097c0 tx=0x7efbf001c450 comp rx=0 tx=0).stop 2023-07-09T21:59:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- 172.21.15.37:0/1495168310 shutdown_connections 2023-07-09T21:59:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- 172.21.15.37:0/1495168310 >> v2:172.21.15.119:3300/0 conn(0x7efc000cef80 0x7efc000b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- 172.21.15.37:0/1495168310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b7ab0 0x7efc0006aa50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- 172.21.15.37:0/1495168310 >> 172.21.15.37:0/1495168310 conn(0x7efc00073090 msgr2=0x7efc00069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:44.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- 172.21.15.37:0/1495168310 shutdown_connections 2023-07-09T21:59:44.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- 172.21.15.37:0/1495168310 wait complete. 2023-07-09T21:59:44.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 Processor -- start 2023-07-09T21:59:44.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- start start 2023-07-09T21:59:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b4170 0x7efc00156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 0x7efc000c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0015c1d0 con 0x7efc000b7ab0 2023-07-09T21:59:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc001f8050 con 0x7efc000cef80 2023-07-09T21:59:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efc05419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc001f8330 con 0x7efc000b4170 2023-07-09T21:59:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51882/0 (socket says 172.21.15.37:51882) 2023-07-09T21:59:44.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 -- 172.21.15.37:0/2747218911 learned_addr learned my addr 172.21.15.37:0/2747218911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:44.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbfeffd640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b4170 0x7efc00156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbff7fe640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 0x7efc000c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 -- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b4170 msgr2=0x7efc00156ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b4170 0x7efc00156ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 -- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 msgr2=0x7efc000c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 0x7efc000c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 -- 172.21.15.37:0/2747218911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbe8009420 con 0x7efc000b7ab0 2023-07-09T21:59:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbff7fe640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 0x7efc000c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.371+0000 7efbf7fff640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7efbe800ebe0 tx=0x7efbe800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe800eee0 con 0x7efc000b7ab0 2023-07-09T21:59:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbe800cc30 con 0x7efc000b7ab0 2023-07-09T21:59:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbe8013470 con 0x7efc000b7ab0 2023-07-09T21:59:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efbf0009420 con 0x7efc000b7ab0 2023-07-09T21:59:44.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0015c6c0 con 0x7efc000b7ab0 2023-07-09T21:59:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc001f84f0 con 0x7efc000b7ab0 2023-07-09T21:59:44.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efbe80135d0 con 0x7efc000b7ab0 2023-07-09T21:59:44.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 0x7efbe0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7efbe80840d0 con 0x7efc000b7ab0 2023-07-09T21:59:44.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.375+0000 7efbfeffd640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 0x7efbe0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.379+0000 7efbfeffd640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 0x7efbe0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efbf00af000 tx=0x7efbf00a7000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.379+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efbe8054fd0 con 0x7efc000b7ab0 2023-07-09T21:59:44.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.531+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc000cf4d0 con 0x7efbe00663a0 2023-07-09T21:59:44.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.539+0000 7efbf77fe640 1 -- 172.21.15.37:0/2747218911 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306237 (secure 0 0 0) 0x7efbf00ab5f0 con 0x7efbe00663a0 2023-07-09T21:59:44.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:44.548 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:59:44.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 msgr2=0x7efbe0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 0x7efbe0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efbf00af000 tx=0x7efbf00a7000 comp rx=0 tx=0).stop 2023-07-09T21:59:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 msgr2=0x7efc001f7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7efbe800ebe0 tx=0x7efbe800c520 comp rx=0 tx=0).stop 2023-07-09T21:59:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 shutdown_connections 2023-07-09T21:59:44.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7efbe00663a0 0x7efbe0068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc000cef80 0x7efc000c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc000b7ab0 0x7efc001f7590 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 --2- 172.21.15.37:0/2747218911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc000b4170 0x7efc00156ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 >> 172.21.15.37:0/2747218911 conn(0x7efc00073090 msgr2=0x7efc000b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 shutdown_connections 2023-07-09T21:59:44.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.543+0000 7efc05419640 1 -- 172.21.15.37:0/2747218911 wait complete. 2023-07-09T21:59:44.567 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:59:43.718537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":345188,"kb_used_data":18084,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754629532,"statfs":{"total":773094113280,"available":772740640768,"internally_reserved":0,"allocated":18518016,"data_stored":10084172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.679600"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051204+0000","last_change":"2023-07-09T21:59:39.051204+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051204+0000","last_undegraded":"2023-07-09T21:59:39.051204+0000","last_fullsized":"2023-07-09T21:59:39.051204+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044926+0000","last_change":"2023-07-09T21:59:39.044926+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044926+0000","last_undegraded":"2023-07-09T21:59:39.044926+0000","last_fullsized":"2023-07-09T21:59:39.044926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047466+0000","last_change":"2023-07-09T21:59:39.047466+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047466+0000","last_undegraded":"2023-07-09T21:59:39.047466+0000","last_fullsized":"2023-07-09T21:59:39.047466+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049990+0000","last_change":"2023-07-09T21:59:39.049990+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049990+0000","last_undegraded":"2023-07-09T21:59:39.049990+0000","last_fullsized":"2023-07-09T21:59:39.049990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050389+0000","last_change":"2023-07-09T21:59:39.050389+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050389+0000","last_undegraded":"2023-07-09T21:59:39.050389+0000","last_fullsized":"2023-07-09T21:59:39.050389+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050390+0000","last_change":"2023-07-09T21:59:39.050390+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050390+0000","last_undegraded":"2023-07-09T21:59:39.050390+0000","last_fullsized":"2023-07-09T21:59:39.050390+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.048313+0000","last_change":"2023-07-09T21:59:39.048313+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.048313+0000","last_undegraded":"2023-07-09T21:59:39.048313+0000","last_fullsized":"2023-07-09T21:59:39.048313+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055446+0000","last_change":"2023-07-09T21:59:39.055446+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055446+0000","last_undegraded":"2023-07-09T21:59:39.055446+0000","last_fullsized":"2023-07-09T21:59:39.055446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051289+0000","last_change":"2023-07-09T21:59:39.051289+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051289+0000","last_undegraded":"2023-07-09T21:59:39.051289+0000","last_fullsized":"2023-07-09T21:59:39.051289+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049044+0000","last_change":"2023-07-09T21:59:39.049044+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049044+0000","last_undegraded":"2023-07-09T21:59:39.049044+0000","last_fullsized":"2023-07-09T21:59:39.049044+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044468+0000","last_change":"2023-07-09T21:59:39.044468+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044468+0000","last_undegraded":"2023-07-09T21:59:39.044468+0000","last_fullsized":"2023-07-09T21:59:39.044468+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049553+0000","last_change":"2023-07-09T21:59:39.049553+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049553+0000","last_undegraded":"2023-07-09T21:59:39.049553+0000","last_fullsized":"2023-07-09T21:59:39.049553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051485+0000","last_change":"2023-07-09T21:59:39.051485+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051485+0000","last_undegraded":"2023-07-09T21:59:39.051485+0000","last_fullsized":"2023-07-09T21:59:39.051485+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047632+0000","last_change":"2023-07-09T21:59:39.047632+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047632+0000","last_undegraded":"2023-07-09T21:59:39.047632+0000","last_fullsized":"2023-07-09T21:59:39.047632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047944+0000","last_change":"2023-07-09T21:59:39.047944+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047944+0000","last_undegraded":"2023-07-09T21:59:39.047944+0000","last_fullsized":"2023-07-09T21:59:39.047944+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045066+0000","last_change":"2023-07-09T21:59:39.045066+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045066+0000","last_undegraded":"2023-07-09T21:59:39.045066+0000","last_fullsized":"2023-07-09T21:59:39.045066+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055240+0000","last_change":"2023-07-09T21:59:39.055240+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055240+0000","last_undegraded":"2023-07-09T21:59:39.055240+0000","last_fullsized":"2023-07-09T21:59:39.055240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043539+0000","last_change":"2023-07-09T21:59:39.043539+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043539+0000","last_undegraded":"2023-07-09T21:59:39.043539+0000","last_fullsized":"2023-07-09T21:59:39.043539+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050998+0000","last_change":"2023-07-09T21:59:39.050998+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050998+0000","last_undegraded":"2023-07-09T21:59:39.050998+0000","last_fullsized":"2023-07-09T21:59:39.050998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046987+0000","last_change":"2023-07-09T21:59:39.046987+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046987+0000","last_undegraded":"2023-07-09T21:59:39.046987+0000","last_fullsized":"2023-07-09T21:59:39.046987+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050743+0000","last_change":"2023-07-09T21:59:39.050743+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050743+0000","last_undegraded":"2023-07-09T21:59:39.050743+0000","last_fullsized":"2023-07-09T21:59:39.050743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044352+0000","last_change":"2023-07-09T21:59:39.044352+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044352+0000","last_undegraded":"2023-07-09T21:59:39.044352+0000","last_fullsized":"2023-07-09T21:59:39.044352+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050746+0000","last_change":"2023-07-09T21:59:39.050746+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050746+0000","last_undegraded":"2023-07-09T21:59:39.050746+0000","last_fullsized":"2023-07-09T21:59:39.050746+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054941+0000","last_change":"2023-07-09T21:59:39.054941+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054941+0000","last_undegraded":"2023-07-09T21:59:39.054941+0000","last_fullsized":"2023-07-09T21:59:39.054941+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049001+0000","last_change":"2023-07-09T21:59:39.049001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049001+0000","last_undegraded":"2023-07-09T21:59:39.049001+0000","last_fullsized":"2023-07-09T21:59:39.049001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044451+0000","last_change":"2023-07-09T21:59:39.044451+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044451+0000","last_undegraded":"2023-07-09T21:59:39.044451+0000","last_fullsized":"2023-07-09T21:59:39.044451+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057788+0000","last_change":"2023-07-09T21:59:39.057788+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057788+0000","last_undegraded":"2023-07-09T21:59:39.057788+0000","last_fullsized":"2023-07-09T21:59:39.057788+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044984+0000","last_change":"2023-07-09T21:59:39.044984+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044984+0000","last_undegraded":"2023-07-09T21:59:39.044984+0000","last_fullsized":"2023-07-09T21:59:39.044984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049355+0000","last_change":"2023-07-09T21:59:39.049355+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049355+0000","last_undegraded":"2023-07-09T21:59:39.049355+0000","last_fullsized":"2023-07-09T21:59:39.049355+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054598+0000","last_change":"2023-07-09T21:59:39.054598+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054598+0000","last_undegraded":"2023-07-09T21:59:39.054598+0000","last_fullsized":"2023-07-09T21:59:39.054598+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044040+0000","last_change":"2023-07-09T21:59:39.044040+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044040+0000","last_undegraded":"2023-07-09T21:59:39.044040+0000","last_fullsized":"2023-07-09T21:59:39.044040+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061144+0000","last_change":"2023-07-09T21:59:39.056361+0000","last_active":"2023-07-09T21:59:39.061144+0000","last_peered":"2023-07-09T21:59:39.061144+0000","last_clean":"2023-07-09T21:59:39.061144+0000","last_became_active":"2023-07-09T21:59:39.056052+0000","last_became_peered":"2023-07-09T21:59:39.056052+0000","last_unstale":"2023-07-09T21:59:39.061144+0000","last_undegraded":"2023-07-09T21:59:39.061144+0000","last_fullsized":"2023-07-09T21:59:39.061144+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047014+0000","last_change":"2023-07-09T21:59:39.047014+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047014+0000","last_undegraded":"2023-07-09T21:59:39.047014+0000","last_fullsized":"2023-07-09T21:59:39.047014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072372+0000","last_change":"2023-07-09T21:59:39.069622+0000","last_active":"2023-07-09T21:59:39.072372+0000","last_peered":"2023-07-09T21:59:39.072372+0000","last_clean":"2023-07-09T21:59:39.072372+0000","last_became_active":"2023-07-09T21:59:39.069069+0000","last_became_peered":"2023-07-09T21:59:39.069069+0000","last_unstale":"2023-07-09T21:59:39.072372+0000","last_undegraded":"2023-07-09T21:59:39.072372+0000","last_fullsized":"2023-07-09T21:59:39.072372+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:38.835390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056293+0000","last_change":"2023-07-09T21:59:39.056293+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056293+0000","last_undegraded":"2023-07-09T21:59:39.056293+0000","last_fullsized":"2023-07-09T21:59:39.056293+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071420+0000","last_change":"2023-07-09T21:59:39.068983+0000","last_active":"2023-07-09T21:59:39.071420+0000","last_peered":"2023-07-09T21:59:39.071420+0000","last_clean":"2023-07-09T21:59:39.071420+0000","last_became_active":"2023-07-09T21:59:39.068685+0000","last_became_peered":"2023-07-09T21:59:39.068685+0000","last_unstale":"2023-07-09T21:59:39.071420+0000","last_undegraded":"2023-07-09T21:59:39.071420+0000","last_fullsized":"2023-07-09T21:59:39.071420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:39.695550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054604+0000","last_change":"2023-07-09T21:59:39.054604+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054604+0000","last_undegraded":"2023-07-09T21:59:39.054604+0000","last_fullsized":"2023-07-09T21:59:39.054604+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067046+0000","last_change":"2023-07-09T21:59:39.065490+0000","last_active":"2023-07-09T21:59:39.067046+0000","last_peered":"2023-07-09T21:59:39.067046+0000","last_clean":"2023-07-09T21:59:39.067046+0000","last_became_active":"2023-07-09T21:59:39.065180+0000","last_became_peered":"2023-07-09T21:59:39.065180+0000","last_unstale":"2023-07-09T21:59:39.067046+0000","last_undegraded":"2023-07-09T21:59:39.067046+0000","last_fullsized":"2023-07-09T21:59:39.067046+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:55.007372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044765+0000","last_change":"2023-07-09T21:59:39.044765+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044765+0000","last_undegraded":"2023-07-09T21:59:39.044765+0000","last_fullsized":"2023-07-09T21:59:39.044765+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067016+0000","last_change":"2023-07-09T21:59:39.061460+0000","last_active":"2023-07-09T21:59:39.067016+0000","last_peered":"2023-07-09T21:59:39.067016+0000","last_clean":"2023-07-09T21:59:39.067016+0000","last_became_active":"2023-07-09T21:59:39.061102+0000","last_became_peered":"2023-07-09T21:59:39.061102+0000","last_unstale":"2023-07-09T21:59:39.067016+0000","last_undegraded":"2023-07-09T21:59:39.067016+0000","last_fullsized":"2023-07-09T21:59:39.067016+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:34.197028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047622+0000","last_change":"2023-07-09T21:59:39.047622+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047622+0000","last_undegraded":"2023-07-09T21:59:39.047622+0000","last_fullsized":"2023-07-09T21:59:39.047622+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062093+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.062093+0000","last_peered":"2023-07-09T21:59:39.062093+0000","last_clean":"2023-07-09T21:59:39.062093+0000","last_became_active":"2023-07-09T21:59:39.059606+0000","last_became_peered":"2023-07-09T21:59:39.059606+0000","last_unstale":"2023-07-09T21:59:39.062093+0000","last_undegraded":"2023-07-09T21:59:39.062093+0000","last_fullsized":"2023-07-09T21:59:39.062093+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046125+0000","last_change":"2023-07-09T21:59:39.046125+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046125+0000","last_undegraded":"2023-07-09T21:59:39.046125+0000","last_fullsized":"2023-07-09T21:59:39.046125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064752+0000","last_change":"2023-07-09T21:59:39.059613+0000","last_active":"2023-07-09T21:59:39.064752+0000","last_peered":"2023-07-09T21:59:39.064752+0000","last_clean":"2023-07-09T21:59:39.064752+0000","last_became_active":"2023-07-09T21:59:39.059312+0000","last_became_peered":"2023-07-09T21:59:39.059312+0000","last_unstale":"2023-07-09T21:59:39.064752+0000","last_undegraded":"2023-07-09T21:59:39.064752+0000","last_fullsized":"2023-07-09T21:59:39.064752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:00:45.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049672+0000","last_change":"2023-07-09T21:59:39.049672+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049672+0000","last_undegraded":"2023-07-09T21:59:39.049672+0000","last_fullsized":"2023-07-09T21:59:39.049672+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062065+0000","last_change":"2023-07-09T21:59:39.058431+0000","last_active":"2023-07-09T21:59:39.062065+0000","last_peered":"2023-07-09T21:59:39.062065+0000","last_clean":"2023-07-09T21:59:39.062065+0000","last_became_active":"2023-07-09T21:59:39.058114+0000","last_became_peered":"2023-07-09T21:59:39.058114+0000","last_unstale":"2023-07-09T21:59:39.062065+0000","last_undegraded":"2023-07-09T21:59:39.062065+0000","last_fullsized":"2023-07-09T21:59:39.062065+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053001+0000","last_change":"2023-07-09T21:59:39.053001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053001+0000","last_undegraded":"2023-07-09T21:59:39.053001+0000","last_fullsized":"2023-07-09T21:59:39.053001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.069649+0000","last_change":"2023-07-09T21:59:39.068870+0000","last_active":"2023-07-09T21:59:39.069649+0000","last_peered":"2023-07-09T21:59:39.069649+0000","last_clean":"2023-07-09T21:59:39.069649+0000","last_became_active":"2023-07-09T21:59:39.068548+0000","last_became_peered":"2023-07-09T21:59:39.068548+0000","last_unstale":"2023-07-09T21:59:39.069649+0000","last_undegraded":"2023-07-09T21:59:39.069649+0000","last_fullsized":"2023-07-09T21:59:39.069649+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:58.022306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055728+0000","last_change":"2023-07-09T21:59:39.055728+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055728+0000","last_undegraded":"2023-07-09T21:59:39.055728+0000","last_fullsized":"2023-07-09T21:59:39.055728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072354+0000","last_change":"2023-07-09T21:59:39.070672+0000","last_active":"2023-07-09T21:59:39.072354+0000","last_peered":"2023-07-09T21:59:39.072354+0000","last_clean":"2023-07-09T21:59:39.072354+0000","last_became_active":"2023-07-09T21:59:39.069356+0000","last_became_peered":"2023-07-09T21:59:39.069356+0000","last_unstale":"2023-07-09T21:59:39.072354+0000","last_undegraded":"2023-07-09T21:59:39.072354+0000","last_fullsized":"2023-07-09T21:59:39.072354+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:18:59.193761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054492+0000","last_change":"2023-07-09T21:59:39.054492+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054492+0000","last_undegraded":"2023-07-09T21:59:39.054492+0000","last_fullsized":"2023-07-09T21:59:39.054492+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.056455+0000","last_change":"2023-07-09T21:59:39.054129+0000","last_active":"2023-07-09T21:59:39.056455+0000","last_peered":"2023-07-09T21:59:39.056455+0000","last_clean":"2023-07-09T21:59:39.056455+0000","last_became_active":"2023-07-09T21:59:39.053847+0000","last_became_peered":"2023-07-09T21:59:39.053847+0000","last_unstale":"2023-07-09T21:59:39.056455+0000","last_undegraded":"2023-07-09T21:59:39.056455+0000","last_fullsized":"2023-07-09T21:59:39.056455+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:56.842044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050228+0000","last_change":"2023-07-09T21:59:39.050228+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050228+0000","last_undegraded":"2023-07-09T21:59:39.050228+0000","last_fullsized":"2023-07-09T21:59:39.050228+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068179+0000","last_change":"2023-07-09T21:59:39.066598+0000","last_active":"2023-07-09T21:59:39.068179+0000","last_peered":"2023-07-09T21:59:39.068179+0000","last_clean":"2023-07-09T21:59:39.068179+0000","last_became_active":"2023-07-09T21:59:39.066274+0000","last_became_peered":"2023-07-09T21:59:39.066274+0000","last_unstale":"2023-07-09T21:59:39.068179+0000","last_undegraded":"2023-07-09T21:59:39.068179+0000","last_fullsized":"2023-07-09T21:59:39.068179+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053525+0000","last_change":"2023-07-09T21:59:39.053525+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053525+0000","last_undegraded":"2023-07-09T21:59:39.053525+0000","last_fullsized":"2023-07-09T21:59:39.053525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067438+0000","last_change":"2023-07-09T21:59:39.065915+0000","last_active":"2023-07-09T21:59:39.067438+0000","last_peered":"2023-07-09T21:59:39.067438+0000","last_clean":"2023-07-09T21:59:39.067438+0000","last_became_active":"2023-07-09T21:59:39.065564+0000","last_became_peered":"2023-07-09T21:59:39.065564+0000","last_unstale":"2023-07-09T21:59:39.067438+0000","last_undegraded":"2023-07-09T21:59:39.067438+0000","last_fullsized":"2023-07-09T21:59:39.067438+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:11.953775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046704+0000","last_change":"2023-07-09T21:59:39.046704+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046704+0000","last_undegraded":"2023-07-09T21:59:39.046704+0000","last_fullsized":"2023-07-09T21:59:39.046704+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067044+0000","last_change":"2023-07-09T21:59:39.061507+0000","last_active":"2023-07-09T21:59:39.067044+0000","last_peered":"2023-07-09T21:59:39.067044+0000","last_clean":"2023-07-09T21:59:39.067044+0000","last_became_active":"2023-07-09T21:59:39.061215+0000","last_became_peered":"2023-07-09T21:59:39.061215+0000","last_unstale":"2023-07-09T21:59:39.067044+0000","last_undegraded":"2023-07-09T21:59:39.067044+0000","last_fullsized":"2023-07-09T21:59:39.067044+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:53.074688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052633+0000","last_change":"2023-07-09T21:59:39.052633+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052633+0000","last_undegraded":"2023-07-09T21:59:39.052633+0000","last_fullsized":"2023-07-09T21:59:39.052633+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062263+0000","last_change":"2023-07-09T21:59:39.059503+0000","last_active":"2023-07-09T21:59:39.062263+0000","last_peered":"2023-07-09T21:59:39.062263+0000","last_clean":"2023-07-09T21:59:39.062263+0000","last_became_active":"2023-07-09T21:59:39.059214+0000","last_became_peered":"2023-07-09T21:59:39.059214+0000","last_unstale":"2023-07-09T21:59:39.062263+0000","last_undegraded":"2023-07-09T21:59:39.062263+0000","last_fullsized":"2023-07-09T21:59:39.062263+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:26.091057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043741+0000","last_change":"2023-07-09T21:59:39.043741+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043741+0000","last_undegraded":"2023-07-09T21:59:39.043741+0000","last_fullsized":"2023-07-09T21:59:39.043741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066968+0000","last_change":"2023-07-09T21:59:39.061861+0000","last_active":"2023-07-09T21:59:39.066968+0000","last_peered":"2023-07-09T21:59:39.066968+0000","last_clean":"2023-07-09T21:59:39.066968+0000","last_became_active":"2023-07-09T21:59:39.061558+0000","last_became_peered":"2023-07-09T21:59:39.061558+0000","last_unstale":"2023-07-09T21:59:39.066968+0000","last_undegraded":"2023-07-09T21:59:39.066968+0000","last_fullsized":"2023-07-09T21:59:39.066968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:18.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051227+0000","last_change":"2023-07-09T21:59:39.051227+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051227+0000","last_undegraded":"2023-07-09T21:59:39.051227+0000","last_fullsized":"2023-07-09T21:59:39.051227+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066358+0000","last_change":"2023-07-09T21:59:39.064293+0000","last_active":"2023-07-09T21:59:39.066358+0000","last_peered":"2023-07-09T21:59:39.066358+0000","last_clean":"2023-07-09T21:59:39.066358+0000","last_became_active":"2023-07-09T21:59:39.064014+0000","last_became_peered":"2023-07-09T21:59:39.064014+0000","last_unstale":"2023-07-09T21:59:39.066358+0000","last_undegraded":"2023-07-09T21:59:39.066358+0000","last_fullsized":"2023-07-09T21:59:39.066358+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046973+0000","last_change":"2023-07-09T21:59:39.046973+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046973+0000","last_undegraded":"2023-07-09T21:59:39.046973+0000","last_fullsized":"2023-07-09T21:59:39.046973+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064798+0000","last_change":"2023-07-09T21:59:39.062851+0000","last_active":"2023-07-09T21:59:39.064798+0000","last_peered":"2023-07-09T21:59:39.064798+0000","last_clean":"2023-07-09T21:59:39.064798+0000","last_became_active":"2023-07-09T21:59:39.062560+0000","last_became_peered":"2023-07-09T21:59:39.062560+0000","last_unstale":"2023-07-09T21:59:39.064798+0000","last_undegraded":"2023-07-09T21:59:39.064798+0000","last_fullsized":"2023-07-09T21:59:39.064798+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:41.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052025+0000","last_change":"2023-07-09T21:59:39.052025+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052025+0000","last_undegraded":"2023-07-09T21:59:39.052025+0000","last_fullsized":"2023-07-09T21:59:39.052025+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062225+0000","last_change":"2023-07-09T21:59:39.060698+0000","last_active":"2023-07-09T21:59:39.062225+0000","last_peered":"2023-07-09T21:59:39.062225+0000","last_clean":"2023-07-09T21:59:39.062225+0000","last_became_active":"2023-07-09T21:59:39.060367+0000","last_became_peered":"2023-07-09T21:59:39.060367+0000","last_unstale":"2023-07-09T21:59:39.062225+0000","last_undegraded":"2023-07-09T21:59:39.062225+0000","last_fullsized":"2023-07-09T21:59:39.062225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:57.917936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050803+0000","last_change":"2023-07-09T21:59:39.050803+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050803+0000","last_undegraded":"2023-07-09T21:59:39.050803+0000","last_fullsized":"2023-07-09T21:59:39.050803+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067026+0000","last_change":"2023-07-09T21:59:39.066091+0000","last_active":"2023-07-09T21:59:39.067026+0000","last_peered":"2023-07-09T21:59:39.067026+0000","last_clean":"2023-07-09T21:59:39.067026+0000","last_became_active":"2023-07-09T21:59:39.065700+0000","last_became_peered":"2023-07-09T21:59:39.065700+0000","last_unstale":"2023-07-09T21:59:39.067026+0000","last_undegraded":"2023-07-09T21:59:39.067026+0000","last_fullsized":"2023-07-09T21:59:39.067026+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:17.268000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050309+0000","last_change":"2023-07-09T21:59:39.050309+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050309+0000","last_undegraded":"2023-07-09T21:59:39.050309+0000","last_fullsized":"2023-07-09T21:59:39.050309+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064871+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.064871+0000","last_peered":"2023-07-09T21:59:39.064871+0000","last_clean":"2023-07-09T21:59:39.064871+0000","last_became_active":"2023-07-09T21:59:39.059591+0000","last_became_peered":"2023-07-09T21:59:39.059591+0000","last_unstale":"2023-07-09T21:59:39.064871+0000","last_undegraded":"2023-07-09T21:59:39.064871+0000","last_fullsized":"2023-07-09T21:59:39.064871+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:19.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046315+0000","last_change":"2023-07-09T21:59:39.046315+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046315+0000","last_undegraded":"2023-07-09T21:59:39.046315+0000","last_fullsized":"2023-07-09T21:59:39.046315+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063750+0000","last_change":"2023-07-09T21:59:39.062994+0000","last_active":"2023-07-09T21:59:39.063750+0000","last_peered":"2023-07-09T21:59:39.063750+0000","last_clean":"2023-07-09T21:59:39.063750+0000","last_became_active":"2023-07-09T21:59:39.062749+0000","last_became_peered":"2023-07-09T21:59:39.062749+0000","last_unstale":"2023-07-09T21:59:39.063750+0000","last_undegraded":"2023-07-09T21:59:39.063750+0000","last_fullsized":"2023-07-09T21:59:39.063750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:14.365863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045643+0000","last_change":"2023-07-09T21:59:39.045643+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045643+0000","last_undegraded":"2023-07-09T21:59:39.045643+0000","last_fullsized":"2023-07-09T21:59:39.045643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062060+0000","last_change":"2023-07-09T21:59:39.059053+0000","last_active":"2023-07-09T21:59:39.062060+0000","last_peered":"2023-07-09T21:59:39.062060+0000","last_clean":"2023-07-09T21:59:39.062060+0000","last_became_active":"2023-07-09T21:59:39.058548+0000","last_became_peered":"2023-07-09T21:59:39.058548+0000","last_unstale":"2023-07-09T21:59:39.062060+0000","last_undegraded":"2023-07-09T21:59:39.062060+0000","last_fullsized":"2023-07-09T21:59:39.062060+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:44.390037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.058801+0000","last_change":"2023-07-09T21:59:39.058801+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.058801+0000","last_undegraded":"2023-07-09T21:59:39.058801+0000","last_fullsized":"2023-07-09T21:59:39.058801+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071379+0000","last_change":"2023-07-09T21:59:39.068790+0000","last_active":"2023-07-09T21:59:39.071379+0000","last_peered":"2023-07-09T21:59:39.071379+0000","last_clean":"2023-07-09T21:59:39.071379+0000","last_became_active":"2023-07-09T21:59:39.068499+0000","last_became_peered":"2023-07-09T21:59:39.068499+0000","last_unstale":"2023-07-09T21:59:39.071379+0000","last_undegraded":"2023-07-09T21:59:39.071379+0000","last_fullsized":"2023-07-09T21:59:39.071379+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:53.381383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056173+0000","last_change":"2023-07-09T21:59:39.056173+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056173+0000","last_undegraded":"2023-07-09T21:59:39.056173+0000","last_fullsized":"2023-07-09T21:59:39.056173+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065120+0000","last_change":"2023-07-09T21:59:39.064156+0000","last_active":"2023-07-09T21:59:39.065120+0000","last_peered":"2023-07-09T21:59:39.065120+0000","last_clean":"2023-07-09T21:59:39.065120+0000","last_became_active":"2023-07-09T21:59:39.063822+0000","last_became_peered":"2023-07-09T21:59:39.063822+0000","last_unstale":"2023-07-09T21:59:39.065120+0000","last_undegraded":"2023-07-09T21:59:39.065120+0000","last_fullsized":"2023-07-09T21:59:39.065120+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:31.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"163'304","reported_seq":1112,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055522+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:59:39.055522+0000","last_peered":"2023-07-09T21:59:39.055522+0000","last_clean":"2023-07-09T21:59:39.055522+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:59:39.055522+0000","last_undegraded":"2023-07-09T21:59:39.055522+0000","last_fullsized":"2023-07-09T21:59:39.055522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:06.741743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.053201+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:59:39.053201+0000","last_peered":"2023-07-09T21:59:39.053201+0000","last_clean":"2023-07-09T21:59:39.053201+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:59:39.053201+0000","last_undegraded":"2023-07-09T21:59:39.053201+0000","last_fullsized":"2023-07-09T21:59:39.053201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:58.480464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057873+0000","last_change":"2023-07-09T21:59:39.057873+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057873+0000","last_undegraded":"2023-07-09T21:59:39.057873+0000","last_fullsized":"2023-07-09T21:59:39.057873+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072322+0000","last_change":"2023-07-09T21:59:39.070215+0000","last_active":"2023-07-09T21:59:39.072322+0000","last_peered":"2023-07-09T21:59:39.072322+0000","last_clean":"2023-07-09T21:59:39.072322+0000","last_became_active":"2023-07-09T21:59:39.069951+0000","last_became_peered":"2023-07-09T21:59:39.069951+0000","last_unstale":"2023-07-09T21:59:39.072322+0000","last_undegraded":"2023-07-09T21:59:39.072322+0000","last_fullsized":"2023-07-09T21:59:39.072322+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:35.819224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":293,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055395+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:59:39.055395+0000","last_peered":"2023-07-09T21:59:39.055395+0000","last_clean":"2023-07-09T21:59:39.055395+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:59:39.055395+0000","last_undegraded":"2023-07-09T21:59:39.055395+0000","last_fullsized":"2023-07-09T21:59:39.055395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:09:27.333574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043386+0000","last_change":"2023-07-09T21:59:39.043386+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043386+0000","last_undegraded":"2023-07-09T21:59:39.043386+0000","last_fullsized":"2023-07-09T21:59:39.043386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062745+0000","last_change":"2023-07-09T21:59:39.058851+0000","last_active":"2023-07-09T21:59:39.062745+0000","last_peered":"2023-07-09T21:59:39.062745+0000","last_clean":"2023-07-09T21:59:39.062745+0000","last_became_active":"2023-07-09T21:59:39.058567+0000","last_became_peered":"2023-07-09T21:59:39.058567+0000","last_unstale":"2023-07-09T21:59:39.062745+0000","last_undegraded":"2023-07-09T21:59:39.062745+0000","last_fullsized":"2023-07-09T21:59:39.062745+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:02.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.038283+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:59:39.038283+0000","last_peered":"2023-07-09T21:59:39.038283+0000","last_clean":"2023-07-09T21:59:39.038283+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:59:39.038283+0000","last_undegraded":"2023-07-09T21:59:39.038283+0000","last_fullsized":"2023-07-09T21:59:39.038283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:30:47.231350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044627+0000","last_change":"2023-07-09T21:59:39.044627+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044627+0000","last_undegraded":"2023-07-09T21:59:39.044627+0000","last_fullsized":"2023-07-09T21:59:39.044627+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055090+0000","last_change":"2023-07-09T21:59:39.048558+0000","last_active":"2023-07-09T21:59:39.055090+0000","last_peered":"2023-07-09T21:59:39.055090+0000","last_clean":"2023-07-09T21:59:39.055090+0000","last_became_active":"2023-07-09T21:59:39.048275+0000","last_became_peered":"2023-07-09T21:59:39.048275+0000","last_unstale":"2023-07-09T21:59:39.055090+0000","last_undegraded":"2023-07-09T21:59:39.055090+0000","last_fullsized":"2023-07-09T21:59:39.055090+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:15.911625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.051690+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:59:39.051690+0000","last_peered":"2023-07-09T21:59:39.051690+0000","last_clean":"2023-07-09T21:59:39.051690+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:59:39.051690+0000","last_undegraded":"2023-07-09T21:59:39.051690+0000","last_fullsized":"2023-07-09T21:59:39.051690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:13:06.666361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050862+0000","last_change":"2023-07-09T21:59:39.050862+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050862+0000","last_undegraded":"2023-07-09T21:59:39.050862+0000","last_fullsized":"2023-07-09T21:59:39.050862+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061139+0000","last_change":"2023-07-09T21:59:39.056568+0000","last_active":"2023-07-09T21:59:39.061139+0000","last_peered":"2023-07-09T21:59:39.061139+0000","last_clean":"2023-07-09T21:59:39.061139+0000","last_became_active":"2023-07-09T21:59:39.056167+0000","last_became_peered":"2023-07-09T21:59:39.056167+0000","last_unstale":"2023-07-09T21:59:39.061139+0000","last_undegraded":"2023-07-09T21:59:39.061139+0000","last_fullsized":"2023-07-09T21:59:39.061139+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":284,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047976+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:59:39.047976+0000","last_peered":"2023-07-09T21:59:39.047976+0000","last_clean":"2023-07-09T21:59:39.047976+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:59:39.047976+0000","last_undegraded":"2023-07-09T21:59:39.047976+0000","last_fullsized":"2023-07-09T21:59:39.047976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:45.996233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047192+0000","last_change":"2023-07-09T21:59:39.047192+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047192+0000","last_undegraded":"2023-07-09T21:59:39.047192+0000","last_fullsized":"2023-07-09T21:59:39.047192+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068192+0000","last_change":"2023-07-09T21:59:39.066863+0000","last_active":"2023-07-09T21:59:39.068192+0000","last_peered":"2023-07-09T21:59:39.068192+0000","last_clean":"2023-07-09T21:59:39.068192+0000","last_became_active":"2023-07-09T21:59:39.066027+0000","last_became_peered":"2023-07-09T21:59:39.066027+0000","last_unstale":"2023-07-09T21:59:39.068192+0000","last_undegraded":"2023-07-09T21:59:39.068192+0000","last_fullsized":"2023-07-09T21:59:39.068192+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":292,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.058009+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:59:39.058009+0000","last_peered":"2023-07-09T21:59:39.058009+0000","last_clean":"2023-07-09T21:59:39.058009+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:59:39.058009+0000","last_undegraded":"2023-07-09T21:59:39.058009+0000","last_fullsized":"2023-07-09T21:59:39.058009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:17.234873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049965+0000","last_change":"2023-07-09T21:59:39.049965+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049965+0000","last_undegraded":"2023-07-09T21:59:39.049965+0000","last_fullsized":"2023-07-09T21:59:39.049965+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063009+0000","last_change":"2023-07-09T21:59:39.059472+0000","last_active":"2023-07-09T21:59:39.063009+0000","last_peered":"2023-07-09T21:59:39.063009+0000","last_clean":"2023-07-09T21:59:39.063009+0000","last_became_active":"2023-07-09T21:59:39.059185+0000","last_became_peered":"2023-07-09T21:59:39.059185+0000","last_unstale":"2023-07-09T21:59:39.063009+0000","last_undegraded":"2023-07-09T21:59:39.063009+0000","last_fullsized":"2023-07-09T21:59:39.063009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.045200+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:59:39.045200+0000","last_peered":"2023-07-09T21:59:39.045200+0000","last_clean":"2023-07-09T21:59:39.045200+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:59:39.045200+0000","last_undegraded":"2023-07-09T21:59:39.045200+0000","last_fullsized":"2023-07-09T21:59:39.045200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:15.213940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044300+0000","last_change":"2023-07-09T21:59:39.044300+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044300+0000","last_undegraded":"2023-07-09T21:59:39.044300+0000","last_fullsized":"2023-07-09T21:59:39.044300+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065484+0000","last_change":"2023-07-09T21:59:39.062972+0000","last_active":"2023-07-09T21:59:39.065484+0000","last_peered":"2023-07-09T21:59:39.065484+0000","last_clean":"2023-07-09T21:59:39.065484+0000","last_became_active":"2023-07-09T21:59:39.062692+0000","last_became_peered":"2023-07-09T21:59:39.062692+0000","last_unstale":"2023-07-09T21:59:39.065484+0000","last_undegraded":"2023-07-09T21:59:39.065484+0000","last_fullsized":"2023-07-09T21:59:39.065484+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:08.036755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":300,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:59:39.047584+0000","last_peered":"2023-07-09T21:59:39.047584+0000","last_clean":"2023-07-09T21:59:39.047584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:59:39.047584+0000","last_undegraded":"2023-07-09T21:59:39.047584+0000","last_fullsized":"2023-07-09T21:59:39.047584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:04.016376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2752512,"data_stored":1699120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.41599999999999998},"max":{"1min":0.98699999999999999,"5min":0.99299999999999999,"15min":1.0169999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96499999999999997,"5min":1.028,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":1.04,"15min":1.0660000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0740000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.621,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.004,"5min":1.0289999999999999,"15min":1.038},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.84299999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.077},"last":0.624},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.075,"15min":1.075},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.04},"last":0.624}]},{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89600000000000002,"5min":0.98199999999999998,"15min":1.177},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":1.1200000000000001,"15min":1.1890000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.50600000000000001,"15min":0.503},"max":{"1min":0.96499999999999997,"5min":1.504,"15min":1.504},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.436},"max":{"1min":0.878,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.52200000000000002,"15min":0.51400000000000001},"max":{"1min":0.90800000000000003,"5min":1.02,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54000000000000004},"max":{"1min":1.0049999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":1.161,"15min":1.161},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.05,"15min":1.099},"last":0.71199999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.95899999999999996,"15min":1.052},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.077},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316528,"statfs":{"total":96636764160,"available":96580124672,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.012,"15min":1.012},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.97999999999999998,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82199999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":1.05},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.046,"5min":1.095,"15min":1.095},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.49299999999999999},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.034},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.379},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.504},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.41799999999999998},"max":{"1min":1.056,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":0.93400000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.745},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.996,"15min":1.075},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":0.95499999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.044,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":0.998,"15min":1.119},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.49199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":1.03,"15min":1.0669999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76200000000000001,"15min":0.74399999999999999},"min":{"1min":0.67500000000000004,"5min":0.57999999999999996,"15min":0.48999999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.61899999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0289999999999999,"5min":1.038,"15min":1.1599999999999999},"last":0.745}]},{"osd":5,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":0.91600000000000004,"5min":1.05,"15min":1.079},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.627,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.92400000000000004,"5min":1.016,"15min":1.016},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96499999999999997,"15min":1.018},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.54900000000000004,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.97199999999999998,"5min":1.069,"15min":1.069},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.57699999999999996,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72499999999999998},"min":{"1min":0.60499999999999998,"5min":0.501,"15min":0.46100000000000002},"max":{"1min":1.0109999999999999,"5min":1.0389999999999999,"15min":1.044},"last":0.871}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.0860000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.315},"max":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":1.113},"last":0.438}]},{"osd":1,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":1.133},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":1.0149999999999999,"15min":1.194},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.135,"5min":1.1379999999999999,"15min":1.5429999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.5649999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1479999999999999,"15min":1.302},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.101,"5min":1.1879999999999999,"15min":1.262},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.161,"15min":1.363},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.2070000000000001,"15min":1.601},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.61299999999999999,"5min":0.72199999999999998,"15min":0.96499999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.85099999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":0.77200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.65600000000000003,"5min":0.76300000000000001,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":1.016},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.2290000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.117,"15min":1.337},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.69899999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.306},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.66500000000000004,"5min":0.624,"15min":0.57699999999999996},"max":{"1min":1.276,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.56799999999999995,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.1739999999999999,"15min":1.375},"last":0.79700000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.2529999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.294},"last":0.82399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.115,"5min":1.2809999999999999,"15min":1.298},"last":0.623},{"interface":"front","average":{"1min":0.87,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.746,"5min":0.624,"15min":0.61399999999999999},"max":{"1min":1.1180000000000001,"5min":1.196,"15min":1.256},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80600000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.63100000000000001,"5min":0.72599999999999998,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"max":{"1min":1.024,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.70899999999999996,"5min":0.56000000000000005,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.2769999999999999,"15min":1.337},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55100000000000005,"15min":0.48899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1160000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.099,"5min":1.157,"15min":1.1659999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93300000000000005,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.0640000000000001,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575291,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41940,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329900,"statfs":{"total":96636764160,"available":96593817600,"internally_reserved":0,"allocated":2764800,"data_stored":1705804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.73599999999999999,"15min":0.89300000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65400000000000003,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.81100000000000005,"15min":0.80400000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91000000000000003,"5min":1.306,"15min":1.306},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88600000000000001,"5min":1.1839999999999999,"15min":1.3600000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.81200000000000006},"min":{"1min":0.624,"5min":0.503,"15min":0.503},"max":{"1min":0.93200000000000005,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.82399999999999995},"min":{"1min":0.65500000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":0.92400000000000004,"5min":1.3260000000000001,"15min":1.381},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.67700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.1739999999999999,"15min":1.1990000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"max":{"1min":0.873,"5min":1.2470000000000001,"15min":1.3400000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.397,"15min":1.397},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:59:44.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:59:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 Processor -- start 2023-07-09T21:59:44.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 -- start start 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0bd00cef80 0x7f0bd006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00b49f0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd00cc8a0 con 0x7f0bd00b4340 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd7c34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b7e80 con 0x7f0bd00cef80 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd59d0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0bd00b7ab0 0x7f0bd00b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43306/0 (socket says 172.21.15.37:43306) 2023-07-09T21:59:44.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd59d0640 1 -- 172.21.15.37:0/390631400 learned_addr learned my addr 172.21.15.37:0/390631400 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd61d1640 1 --2- 172.21.15.37:0/390631400 >> v2:172.21.15.37:3300/0 conn(0x7f0bd00cef80 0x7f0bd006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd49ce640 1 -- 172.21.15.37:0/390631400 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078993606 0 0) 0x7f0bd00b49f0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd49ce640 1 -- 172.21.15.37:0/390631400 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bbc003530 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd61d1640 1 -- 172.21.15.37:0/390631400 >> v1:172.21.15.119:6789/0 conn(0x7f0bd00b4340 legacy=0x7f0bd00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd61d1640 1 -- 172.21.15.37:0/390631400 >> v1:172.21.15.37:6789/0 conn(0x7f0bd00b7ab0 legacy=0x7f0bd00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.747+0000 7f0bd61d1640 1 -- 172.21.15.37:0/390631400 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd00ccb80 con 0x7f0bd00cef80 2023-07-09T21:59:44.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd61d1640 1 --2- 172.21.15.37:0/390631400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00cef80 0x7f0bd006aa50 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009d90 tx=0x7f0bc801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39abae3805c7c2a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd49ce640 1 -- 172.21.15.37:0/390631400 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80a59e0 con 0x7f0bd00cef80 2023-07-09T21:59:44.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd49ce640 1 -- 172.21.15.37:0/390631400 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc80a5b40 con 0x7f0bd00cef80 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd49ce640 1 -- 172.21.15.37:0/390631400 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc80ad440 con 0x7f0bd00cef80 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 -- 172.21.15.37:0/390631400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00cef80 msgr2=0x7f0bd006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/390631400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00cef80 0x7f0bd006aa50 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8009d90 tx=0x7f0bc801c920 comp rx=0 tx=0).stop 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 -- 172.21.15.37:0/390631400 shutdown_connections 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/390631400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00cef80 0x7f0bd006aa50 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 -- 172.21.15.37:0/390631400 >> 172.21.15.37:0/390631400 conn(0x7f0bd0073090 msgr2=0x7f0bd0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:44.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 -- 172.21.15.37:0/390631400 shutdown_connections 2023-07-09T21:59:44.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.751+0000 7f0bd7c34640 1 -- 172.21.15.37:0/390631400 wait complete. 2023-07-09T21:59:44.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 Processor -- start 2023-07-09T21:59:44.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- start start 2023-07-09T21:59:44.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 0x7f0bd01549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 0x7f0bd014cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd014ef60 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd014f240 con 0x7f0bd00b4340 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd014f520 con 0x7f0bd00cef80 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51898/0 (socket says 172.21.15.37:51898) 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 -- 172.21.15.37:0/168513669 learned_addr learned my addr 172.21.15.37:0/168513669 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd59d0640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 0x7f0bd01549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd61d1640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 0x7f0bd014cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 -- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 msgr2=0x7f0bd014cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 0x7f0bd014cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 -- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 msgr2=0x7f0bd01549b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 0x7f0bd01549b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 -- 172.21.15.37:0/168513669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009a70 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd59d0640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 0x7f0bd01549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd61d1640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 0x7f0bd014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd51cf640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c4d0 tx=0x7f0bc000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00052d0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc0005430 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd00c79e0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc0012830 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.755+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd0154ef0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00c7c20 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0bc0012990 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bc67fc640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 0x7f0bb4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f0bc0083aa0 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bd59d0640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 0x7f0bb4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:44.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.759+0000 7f0bd59d0640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 0x7f0bb4068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0011f0 tx=0x7f0bcc009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:44.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.763+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0bd00c7c20 con 0x7f0bd00b7ab0 2023-07-09T21:59:44.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.915+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bd00c7870 con 0x7f0bb40663a0 2023-07-09T21:59:44.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.923+0000 7f0bc67fc640 1 -- 172.21.15.37:0/168513669 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306237 (secure 0 0 0) 0x7f0bd00c7870 con 0x7f0bb40663a0 2023-07-09T21:59:44.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:59:44.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 msgr2=0x7f0bb4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 0x7f0bb4068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc0011f0 tx=0x7f0bcc009040 comp rx=0 tx=0).stop 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 msgr2=0x7f0bd014c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000c4d0 tx=0x7f0bc000c990 comp rx=0 tx=0).stop 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 shutdown_connections 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f0bb40663a0 0x7f0bb4068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0bd00cef80 0x7f0bd014cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0bd00b7ab0 0x7f0bd014c5f0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 --2- 172.21.15.37:0/168513669 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0bd00b4340 0x7f0bd01549b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:44.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 >> 172.21.15.37:0/168513669 conn(0x7f0bd0073090 msgr2=0x7f0bd0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:44.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 shutdown_connections 2023-07-09T21:59:44.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:44.927+0000 7f0bd7c34640 1 -- 172.21.15.37:0/168513669 wait complete. 2023-07-09T21:59:44.951 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T21:59:43.718537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":33,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":345188,"kb_used_data":18084,"kb_used_omap":0,"kb_used_meta":327040,"kb_avail":754629532,"statfs":{"total":773094113280,"available":772740640768,"internally_reserved":0,"allocated":18518016,"data_stored":10084172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":334888960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.679600"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051204+0000","last_change":"2023-07-09T21:59:39.051204+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051204+0000","last_undegraded":"2023-07-09T21:59:39.051204+0000","last_fullsized":"2023-07-09T21:59:39.051204+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044926+0000","last_change":"2023-07-09T21:59:39.044926+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044926+0000","last_undegraded":"2023-07-09T21:59:39.044926+0000","last_fullsized":"2023-07-09T21:59:39.044926+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047466+0000","last_change":"2023-07-09T21:59:39.047466+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047466+0000","last_undegraded":"2023-07-09T21:59:39.047466+0000","last_fullsized":"2023-07-09T21:59:39.047466+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049990+0000","last_change":"2023-07-09T21:59:39.049990+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049990+0000","last_undegraded":"2023-07-09T21:59:39.049990+0000","last_fullsized":"2023-07-09T21:59:39.049990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050389+0000","last_change":"2023-07-09T21:59:39.050389+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050389+0000","last_undegraded":"2023-07-09T21:59:39.050389+0000","last_fullsized":"2023-07-09T21:59:39.050389+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050390+0000","last_change":"2023-07-09T21:59:39.050390+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050390+0000","last_undegraded":"2023-07-09T21:59:39.050390+0000","last_fullsized":"2023-07-09T21:59:39.050390+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.048313+0000","last_change":"2023-07-09T21:59:39.048313+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.048313+0000","last_undegraded":"2023-07-09T21:59:39.048313+0000","last_fullsized":"2023-07-09T21:59:39.048313+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055446+0000","last_change":"2023-07-09T21:59:39.055446+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055446+0000","last_undegraded":"2023-07-09T21:59:39.055446+0000","last_fullsized":"2023-07-09T21:59:39.055446+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051289+0000","last_change":"2023-07-09T21:59:39.051289+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051289+0000","last_undegraded":"2023-07-09T21:59:39.051289+0000","last_fullsized":"2023-07-09T21:59:39.051289+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049044+0000","last_change":"2023-07-09T21:59:39.049044+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049044+0000","last_undegraded":"2023-07-09T21:59:39.049044+0000","last_fullsized":"2023-07-09T21:59:39.049044+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044468+0000","last_change":"2023-07-09T21:59:39.044468+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044468+0000","last_undegraded":"2023-07-09T21:59:39.044468+0000","last_fullsized":"2023-07-09T21:59:39.044468+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049553+0000","last_change":"2023-07-09T21:59:39.049553+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049553+0000","last_undegraded":"2023-07-09T21:59:39.049553+0000","last_fullsized":"2023-07-09T21:59:39.049553+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051485+0000","last_change":"2023-07-09T21:59:39.051485+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051485+0000","last_undegraded":"2023-07-09T21:59:39.051485+0000","last_fullsized":"2023-07-09T21:59:39.051485+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047632+0000","last_change":"2023-07-09T21:59:39.047632+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047632+0000","last_undegraded":"2023-07-09T21:59:39.047632+0000","last_fullsized":"2023-07-09T21:59:39.047632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049176+0000","last_change":"2023-07-09T21:59:39.049176+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049176+0000","last_undegraded":"2023-07-09T21:59:39.049176+0000","last_fullsized":"2023-07-09T21:59:39.049176+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047944+0000","last_change":"2023-07-09T21:59:39.047944+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047944+0000","last_undegraded":"2023-07-09T21:59:39.047944+0000","last_fullsized":"2023-07-09T21:59:39.047944+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045066+0000","last_change":"2023-07-09T21:59:39.045066+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045066+0000","last_undegraded":"2023-07-09T21:59:39.045066+0000","last_fullsized":"2023-07-09T21:59:39.045066+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055240+0000","last_change":"2023-07-09T21:59:39.055240+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055240+0000","last_undegraded":"2023-07-09T21:59:39.055240+0000","last_fullsized":"2023-07-09T21:59:39.055240+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043539+0000","last_change":"2023-07-09T21:59:39.043539+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043539+0000","last_undegraded":"2023-07-09T21:59:39.043539+0000","last_fullsized":"2023-07-09T21:59:39.043539+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050998+0000","last_change":"2023-07-09T21:59:39.050998+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050998+0000","last_undegraded":"2023-07-09T21:59:39.050998+0000","last_fullsized":"2023-07-09T21:59:39.050998+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046987+0000","last_change":"2023-07-09T21:59:39.046987+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046987+0000","last_undegraded":"2023-07-09T21:59:39.046987+0000","last_fullsized":"2023-07-09T21:59:39.046987+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050743+0000","last_change":"2023-07-09T21:59:39.050743+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050743+0000","last_undegraded":"2023-07-09T21:59:39.050743+0000","last_fullsized":"2023-07-09T21:59:39.050743+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044352+0000","last_change":"2023-07-09T21:59:39.044352+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044352+0000","last_undegraded":"2023-07-09T21:59:39.044352+0000","last_fullsized":"2023-07-09T21:59:39.044352+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050746+0000","last_change":"2023-07-09T21:59:39.050746+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050746+0000","last_undegraded":"2023-07-09T21:59:39.050746+0000","last_fullsized":"2023-07-09T21:59:39.050746+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054941+0000","last_change":"2023-07-09T21:59:39.054941+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054941+0000","last_undegraded":"2023-07-09T21:59:39.054941+0000","last_fullsized":"2023-07-09T21:59:39.054941+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049001+0000","last_change":"2023-07-09T21:59:39.049001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049001+0000","last_undegraded":"2023-07-09T21:59:39.049001+0000","last_fullsized":"2023-07-09T21:59:39.049001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044451+0000","last_change":"2023-07-09T21:59:39.044451+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044451+0000","last_undegraded":"2023-07-09T21:59:39.044451+0000","last_fullsized":"2023-07-09T21:59:39.044451+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057788+0000","last_change":"2023-07-09T21:59:39.057788+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057788+0000","last_undegraded":"2023-07-09T21:59:39.057788+0000","last_fullsized":"2023-07-09T21:59:39.057788+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044984+0000","last_change":"2023-07-09T21:59:39.044984+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044984+0000","last_undegraded":"2023-07-09T21:59:39.044984+0000","last_fullsized":"2023-07-09T21:59:39.044984+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049355+0000","last_change":"2023-07-09T21:59:39.049355+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049355+0000","last_undegraded":"2023-07-09T21:59:39.049355+0000","last_fullsized":"2023-07-09T21:59:39.049355+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054598+0000","last_change":"2023-07-09T21:59:39.054598+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054598+0000","last_undegraded":"2023-07-09T21:59:39.054598+0000","last_fullsized":"2023-07-09T21:59:39.054598+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044040+0000","last_change":"2023-07-09T21:59:39.044040+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044040+0000","last_undegraded":"2023-07-09T21:59:39.044040+0000","last_fullsized":"2023-07-09T21:59:39.044040+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061144+0000","last_change":"2023-07-09T21:59:39.056361+0000","last_active":"2023-07-09T21:59:39.061144+0000","last_peered":"2023-07-09T21:59:39.061144+0000","last_clean":"2023-07-09T21:59:39.061144+0000","last_became_active":"2023-07-09T21:59:39.056052+0000","last_became_peered":"2023-07-09T21:59:39.056052+0000","last_unstale":"2023-07-09T21:59:39.061144+0000","last_undegraded":"2023-07-09T21:59:39.061144+0000","last_fullsized":"2023-07-09T21:59:39.061144+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047014+0000","last_change":"2023-07-09T21:59:39.047014+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047014+0000","last_undegraded":"2023-07-09T21:59:39.047014+0000","last_fullsized":"2023-07-09T21:59:39.047014+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072372+0000","last_change":"2023-07-09T21:59:39.069622+0000","last_active":"2023-07-09T21:59:39.072372+0000","last_peered":"2023-07-09T21:59:39.072372+0000","last_clean":"2023-07-09T21:59:39.072372+0000","last_became_active":"2023-07-09T21:59:39.069069+0000","last_became_peered":"2023-07-09T21:59:39.069069+0000","last_unstale":"2023-07-09T21:59:39.072372+0000","last_undegraded":"2023-07-09T21:59:39.072372+0000","last_fullsized":"2023-07-09T21:59:39.072372+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:38:38.835390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056293+0000","last_change":"2023-07-09T21:59:39.056293+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056293+0000","last_undegraded":"2023-07-09T21:59:39.056293+0000","last_fullsized":"2023-07-09T21:59:39.056293+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071420+0000","last_change":"2023-07-09T21:59:39.068983+0000","last_active":"2023-07-09T21:59:39.071420+0000","last_peered":"2023-07-09T21:59:39.071420+0000","last_clean":"2023-07-09T21:59:39.071420+0000","last_became_active":"2023-07-09T21:59:39.068685+0000","last_became_peered":"2023-07-09T21:59:39.068685+0000","last_unstale":"2023-07-09T21:59:39.071420+0000","last_undegraded":"2023-07-09T21:59:39.071420+0000","last_fullsized":"2023-07-09T21:59:39.071420+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:48:39.695550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054604+0000","last_change":"2023-07-09T21:59:39.054604+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054604+0000","last_undegraded":"2023-07-09T21:59:39.054604+0000","last_fullsized":"2023-07-09T21:59:39.054604+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067046+0000","last_change":"2023-07-09T21:59:39.065490+0000","last_active":"2023-07-09T21:59:39.067046+0000","last_peered":"2023-07-09T21:59:39.067046+0000","last_clean":"2023-07-09T21:59:39.067046+0000","last_became_active":"2023-07-09T21:59:39.065180+0000","last_became_peered":"2023-07-09T21:59:39.065180+0000","last_unstale":"2023-07-09T21:59:39.067046+0000","last_undegraded":"2023-07-09T21:59:39.067046+0000","last_fullsized":"2023-07-09T21:59:39.067046+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:55.007372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044765+0000","last_change":"2023-07-09T21:59:39.044765+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044765+0000","last_undegraded":"2023-07-09T21:59:39.044765+0000","last_fullsized":"2023-07-09T21:59:39.044765+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067016+0000","last_change":"2023-07-09T21:59:39.061460+0000","last_active":"2023-07-09T21:59:39.067016+0000","last_peered":"2023-07-09T21:59:39.067016+0000","last_clean":"2023-07-09T21:59:39.067016+0000","last_became_active":"2023-07-09T21:59:39.061102+0000","last_became_peered":"2023-07-09T21:59:39.061102+0000","last_unstale":"2023-07-09T21:59:39.067016+0000","last_undegraded":"2023-07-09T21:59:39.067016+0000","last_fullsized":"2023-07-09T21:59:39.067016+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:34.197028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047622+0000","last_change":"2023-07-09T21:59:39.047622+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047622+0000","last_undegraded":"2023-07-09T21:59:39.047622+0000","last_fullsized":"2023-07-09T21:59:39.047622+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062093+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.062093+0000","last_peered":"2023-07-09T21:59:39.062093+0000","last_clean":"2023-07-09T21:59:39.062093+0000","last_became_active":"2023-07-09T21:59:39.059606+0000","last_became_peered":"2023-07-09T21:59:39.059606+0000","last_unstale":"2023-07-09T21:59:39.062093+0000","last_undegraded":"2023-07-09T21:59:39.062093+0000","last_fullsized":"2023-07-09T21:59:39.062093+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046125+0000","last_change":"2023-07-09T21:59:39.046125+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046125+0000","last_undegraded":"2023-07-09T21:59:39.046125+0000","last_fullsized":"2023-07-09T21:59:39.046125+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064752+0000","last_change":"2023-07-09T21:59:39.059613+0000","last_active":"2023-07-09T21:59:39.064752+0000","last_peered":"2023-07-09T21:59:39.064752+0000","last_clean":"2023-07-09T21:59:39.064752+0000","last_became_active":"2023-07-09T21:59:39.059312+0000","last_became_peered":"2023-07-09T21:59:39.059312+0000","last_unstale":"2023-07-09T21:59:39.064752+0000","last_undegraded":"2023-07-09T21:59:39.064752+0000","last_fullsized":"2023-07-09T21:59:39.064752+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:00:45.461208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049672+0000","last_change":"2023-07-09T21:59:39.049672+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049672+0000","last_undegraded":"2023-07-09T21:59:39.049672+0000","last_fullsized":"2023-07-09T21:59:39.049672+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062065+0000","last_change":"2023-07-09T21:59:39.058431+0000","last_active":"2023-07-09T21:59:39.062065+0000","last_peered":"2023-07-09T21:59:39.062065+0000","last_clean":"2023-07-09T21:59:39.062065+0000","last_became_active":"2023-07-09T21:59:39.058114+0000","last_became_peered":"2023-07-09T21:59:39.058114+0000","last_unstale":"2023-07-09T21:59:39.062065+0000","last_undegraded":"2023-07-09T21:59:39.062065+0000","last_fullsized":"2023-07-09T21:59:39.062065+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053001+0000","last_change":"2023-07-09T21:59:39.053001+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053001+0000","last_undegraded":"2023-07-09T21:59:39.053001+0000","last_fullsized":"2023-07-09T21:59:39.053001+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.069649+0000","last_change":"2023-07-09T21:59:39.068870+0000","last_active":"2023-07-09T21:59:39.069649+0000","last_peered":"2023-07-09T21:59:39.069649+0000","last_clean":"2023-07-09T21:59:39.069649+0000","last_became_active":"2023-07-09T21:59:39.068548+0000","last_became_peered":"2023-07-09T21:59:39.068548+0000","last_unstale":"2023-07-09T21:59:39.069649+0000","last_undegraded":"2023-07-09T21:59:39.069649+0000","last_fullsized":"2023-07-09T21:59:39.069649+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:40:58.022306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.055728+0000","last_change":"2023-07-09T21:59:39.055728+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.055728+0000","last_undegraded":"2023-07-09T21:59:39.055728+0000","last_fullsized":"2023-07-09T21:59:39.055728+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072354+0000","last_change":"2023-07-09T21:59:39.070672+0000","last_active":"2023-07-09T21:59:39.072354+0000","last_peered":"2023-07-09T21:59:39.072354+0000","last_clean":"2023-07-09T21:59:39.072354+0000","last_became_active":"2023-07-09T21:59:39.069356+0000","last_became_peered":"2023-07-09T21:59:39.069356+0000","last_unstale":"2023-07-09T21:59:39.072354+0000","last_undegraded":"2023-07-09T21:59:39.072354+0000","last_fullsized":"2023-07-09T21:59:39.072354+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:18:59.193761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.054492+0000","last_change":"2023-07-09T21:59:39.054492+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.054492+0000","last_undegraded":"2023-07-09T21:59:39.054492+0000","last_fullsized":"2023-07-09T21:59:39.054492+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.056455+0000","last_change":"2023-07-09T21:59:39.054129+0000","last_active":"2023-07-09T21:59:39.056455+0000","last_peered":"2023-07-09T21:59:39.056455+0000","last_clean":"2023-07-09T21:59:39.056455+0000","last_became_active":"2023-07-09T21:59:39.053847+0000","last_became_peered":"2023-07-09T21:59:39.053847+0000","last_unstale":"2023-07-09T21:59:39.056455+0000","last_undegraded":"2023-07-09T21:59:39.056455+0000","last_fullsized":"2023-07-09T21:59:39.056455+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:56.842044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050228+0000","last_change":"2023-07-09T21:59:39.050228+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050228+0000","last_undegraded":"2023-07-09T21:59:39.050228+0000","last_fullsized":"2023-07-09T21:59:39.050228+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068179+0000","last_change":"2023-07-09T21:59:39.066598+0000","last_active":"2023-07-09T21:59:39.068179+0000","last_peered":"2023-07-09T21:59:39.068179+0000","last_clean":"2023-07-09T21:59:39.068179+0000","last_became_active":"2023-07-09T21:59:39.066274+0000","last_became_peered":"2023-07-09T21:59:39.066274+0000","last_unstale":"2023-07-09T21:59:39.068179+0000","last_undegraded":"2023-07-09T21:59:39.068179+0000","last_fullsized":"2023-07-09T21:59:39.068179+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.053525+0000","last_change":"2023-07-09T21:59:39.053525+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.053525+0000","last_undegraded":"2023-07-09T21:59:39.053525+0000","last_fullsized":"2023-07-09T21:59:39.053525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067438+0000","last_change":"2023-07-09T21:59:39.065915+0000","last_active":"2023-07-09T21:59:39.067438+0000","last_peered":"2023-07-09T21:59:39.067438+0000","last_clean":"2023-07-09T21:59:39.067438+0000","last_became_active":"2023-07-09T21:59:39.065564+0000","last_became_peered":"2023-07-09T21:59:39.065564+0000","last_unstale":"2023-07-09T21:59:39.067438+0000","last_undegraded":"2023-07-09T21:59:39.067438+0000","last_fullsized":"2023-07-09T21:59:39.067438+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:11.953775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046704+0000","last_change":"2023-07-09T21:59:39.046704+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046704+0000","last_undegraded":"2023-07-09T21:59:39.046704+0000","last_fullsized":"2023-07-09T21:59:39.046704+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067044+0000","last_change":"2023-07-09T21:59:39.061507+0000","last_active":"2023-07-09T21:59:39.067044+0000","last_peered":"2023-07-09T21:59:39.067044+0000","last_clean":"2023-07-09T21:59:39.067044+0000","last_became_active":"2023-07-09T21:59:39.061215+0000","last_became_peered":"2023-07-09T21:59:39.061215+0000","last_unstale":"2023-07-09T21:59:39.067044+0000","last_undegraded":"2023-07-09T21:59:39.067044+0000","last_fullsized":"2023-07-09T21:59:39.067044+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:53.074688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052633+0000","last_change":"2023-07-09T21:59:39.052633+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052633+0000","last_undegraded":"2023-07-09T21:59:39.052633+0000","last_fullsized":"2023-07-09T21:59:39.052633+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062263+0000","last_change":"2023-07-09T21:59:39.059503+0000","last_active":"2023-07-09T21:59:39.062263+0000","last_peered":"2023-07-09T21:59:39.062263+0000","last_clean":"2023-07-09T21:59:39.062263+0000","last_became_active":"2023-07-09T21:59:39.059214+0000","last_became_peered":"2023-07-09T21:59:39.059214+0000","last_unstale":"2023-07-09T21:59:39.062263+0000","last_undegraded":"2023-07-09T21:59:39.062263+0000","last_fullsized":"2023-07-09T21:59:39.062263+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:26.091057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043741+0000","last_change":"2023-07-09T21:59:39.043741+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043741+0000","last_undegraded":"2023-07-09T21:59:39.043741+0000","last_fullsized":"2023-07-09T21:59:39.043741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066968+0000","last_change":"2023-07-09T21:59:39.061861+0000","last_active":"2023-07-09T21:59:39.066968+0000","last_peered":"2023-07-09T21:59:39.066968+0000","last_clean":"2023-07-09T21:59:39.066968+0000","last_became_active":"2023-07-09T21:59:39.061558+0000","last_became_peered":"2023-07-09T21:59:39.061558+0000","last_unstale":"2023-07-09T21:59:39.066968+0000","last_undegraded":"2023-07-09T21:59:39.066968+0000","last_fullsized":"2023-07-09T21:59:39.066968+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:38:18.256392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.051227+0000","last_change":"2023-07-09T21:59:39.051227+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.051227+0000","last_undegraded":"2023-07-09T21:59:39.051227+0000","last_fullsized":"2023-07-09T21:59:39.051227+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.066358+0000","last_change":"2023-07-09T21:59:39.064293+0000","last_active":"2023-07-09T21:59:39.066358+0000","last_peered":"2023-07-09T21:59:39.066358+0000","last_clean":"2023-07-09T21:59:39.066358+0000","last_became_active":"2023-07-09T21:59:39.064014+0000","last_became_peered":"2023-07-09T21:59:39.064014+0000","last_unstale":"2023-07-09T21:59:39.066358+0000","last_undegraded":"2023-07-09T21:59:39.066358+0000","last_fullsized":"2023-07-09T21:59:39.066358+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:45.133692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046973+0000","last_change":"2023-07-09T21:59:39.046973+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046973+0000","last_undegraded":"2023-07-09T21:59:39.046973+0000","last_fullsized":"2023-07-09T21:59:39.046973+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064798+0000","last_change":"2023-07-09T21:59:39.062851+0000","last_active":"2023-07-09T21:59:39.064798+0000","last_peered":"2023-07-09T21:59:39.064798+0000","last_clean":"2023-07-09T21:59:39.064798+0000","last_became_active":"2023-07-09T21:59:39.062560+0000","last_became_peered":"2023-07-09T21:59:39.062560+0000","last_unstale":"2023-07-09T21:59:39.064798+0000","last_undegraded":"2023-07-09T21:59:39.064798+0000","last_fullsized":"2023-07-09T21:59:39.064798+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:21:41.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.052025+0000","last_change":"2023-07-09T21:59:39.052025+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.052025+0000","last_undegraded":"2023-07-09T21:59:39.052025+0000","last_fullsized":"2023-07-09T21:59:39.052025+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062225+0000","last_change":"2023-07-09T21:59:39.060698+0000","last_active":"2023-07-09T21:59:39.062225+0000","last_peered":"2023-07-09T21:59:39.062225+0000","last_clean":"2023-07-09T21:59:39.062225+0000","last_became_active":"2023-07-09T21:59:39.060367+0000","last_became_peered":"2023-07-09T21:59:39.060367+0000","last_unstale":"2023-07-09T21:59:39.062225+0000","last_undegraded":"2023-07-09T21:59:39.062225+0000","last_fullsized":"2023-07-09T21:59:39.062225+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:57.917936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050803+0000","last_change":"2023-07-09T21:59:39.050803+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050803+0000","last_undegraded":"2023-07-09T21:59:39.050803+0000","last_fullsized":"2023-07-09T21:59:39.050803+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.067026+0000","last_change":"2023-07-09T21:59:39.066091+0000","last_active":"2023-07-09T21:59:39.067026+0000","last_peered":"2023-07-09T21:59:39.067026+0000","last_clean":"2023-07-09T21:59:39.067026+0000","last_became_active":"2023-07-09T21:59:39.065700+0000","last_became_peered":"2023-07-09T21:59:39.065700+0000","last_unstale":"2023-07-09T21:59:39.067026+0000","last_undegraded":"2023-07-09T21:59:39.067026+0000","last_fullsized":"2023-07-09T21:59:39.067026+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:40:17.268000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050309+0000","last_change":"2023-07-09T21:59:39.050309+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050309+0000","last_undegraded":"2023-07-09T21:59:39.050309+0000","last_fullsized":"2023-07-09T21:59:39.050309+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.064871+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:39.064871+0000","last_peered":"2023-07-09T21:59:39.064871+0000","last_clean":"2023-07-09T21:59:39.064871+0000","last_became_active":"2023-07-09T21:59:39.059591+0000","last_became_peered":"2023-07-09T21:59:39.059591+0000","last_unstale":"2023-07-09T21:59:39.064871+0000","last_undegraded":"2023-07-09T21:59:39.064871+0000","last_fullsized":"2023-07-09T21:59:39.064871+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:54:19.581581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.046315+0000","last_change":"2023-07-09T21:59:39.046315+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.046315+0000","last_undegraded":"2023-07-09T21:59:39.046315+0000","last_fullsized":"2023-07-09T21:59:39.046315+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063750+0000","last_change":"2023-07-09T21:59:39.062994+0000","last_active":"2023-07-09T21:59:39.063750+0000","last_peered":"2023-07-09T21:59:39.063750+0000","last_clean":"2023-07-09T21:59:39.063750+0000","last_became_active":"2023-07-09T21:59:39.062749+0000","last_became_peered":"2023-07-09T21:59:39.062749+0000","last_unstale":"2023-07-09T21:59:39.063750+0000","last_undegraded":"2023-07-09T21:59:39.063750+0000","last_fullsized":"2023-07-09T21:59:39.063750+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:21:14.365863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.045643+0000","last_change":"2023-07-09T21:59:39.045643+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.045643+0000","last_undegraded":"2023-07-09T21:59:39.045643+0000","last_fullsized":"2023-07-09T21:59:39.045643+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062060+0000","last_change":"2023-07-09T21:59:39.059053+0000","last_active":"2023-07-09T21:59:39.062060+0000","last_peered":"2023-07-09T21:59:39.062060+0000","last_clean":"2023-07-09T21:59:39.062060+0000","last_became_active":"2023-07-09T21:59:39.058548+0000","last_became_peered":"2023-07-09T21:59:39.058548+0000","last_unstale":"2023-07-09T21:59:39.062060+0000","last_undegraded":"2023-07-09T21:59:39.062060+0000","last_fullsized":"2023-07-09T21:59:39.062060+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:37:44.390037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.058801+0000","last_change":"2023-07-09T21:59:39.058801+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.058801+0000","last_undegraded":"2023-07-09T21:59:39.058801+0000","last_fullsized":"2023-07-09T21:59:39.058801+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.071379+0000","last_change":"2023-07-09T21:59:39.068790+0000","last_active":"2023-07-09T21:59:39.071379+0000","last_peered":"2023-07-09T21:59:39.071379+0000","last_clean":"2023-07-09T21:59:39.071379+0000","last_became_active":"2023-07-09T21:59:39.068499+0000","last_became_peered":"2023-07-09T21:59:39.068499+0000","last_unstale":"2023-07-09T21:59:39.071379+0000","last_undegraded":"2023-07-09T21:59:39.071379+0000","last_fullsized":"2023-07-09T21:59:39.071379+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:37:53.381383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.056173+0000","last_change":"2023-07-09T21:59:39.056173+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.056173+0000","last_undegraded":"2023-07-09T21:59:39.056173+0000","last_fullsized":"2023-07-09T21:59:39.056173+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065120+0000","last_change":"2023-07-09T21:59:39.064156+0000","last_active":"2023-07-09T21:59:39.065120+0000","last_peered":"2023-07-09T21:59:39.065120+0000","last_clean":"2023-07-09T21:59:39.065120+0000","last_became_active":"2023-07-09T21:59:39.063822+0000","last_became_peered":"2023-07-09T21:59:39.063822+0000","last_unstale":"2023-07-09T21:59:39.065120+0000","last_undegraded":"2023-07-09T21:59:39.065120+0000","last_fullsized":"2023-07-09T21:59:39.065120+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:36:31.451118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"163'304","reported_seq":1112,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055522+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:59:39.055522+0000","last_peered":"2023-07-09T21:59:39.055522+0000","last_clean":"2023-07-09T21:59:39.055522+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:59:39.055522+0000","last_undegraded":"2023-07-09T21:59:39.055522+0000","last_fullsized":"2023-07-09T21:59:39.055522+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:06:06.741743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.053201+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:59:39.053201+0000","last_peered":"2023-07-09T21:59:39.053201+0000","last_clean":"2023-07-09T21:59:39.053201+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:59:39.053201+0000","last_undegraded":"2023-07-09T21:59:39.053201+0000","last_fullsized":"2023-07-09T21:59:39.053201+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:39:58.480464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.057873+0000","last_change":"2023-07-09T21:59:39.057873+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.057873+0000","last_undegraded":"2023-07-09T21:59:39.057873+0000","last_fullsized":"2023-07-09T21:59:39.057873+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.072322+0000","last_change":"2023-07-09T21:59:39.070215+0000","last_active":"2023-07-09T21:59:39.072322+0000","last_peered":"2023-07-09T21:59:39.072322+0000","last_clean":"2023-07-09T21:59:39.072322+0000","last_became_active":"2023-07-09T21:59:39.069951+0000","last_became_peered":"2023-07-09T21:59:39.069951+0000","last_unstale":"2023-07-09T21:59:39.072322+0000","last_undegraded":"2023-07-09T21:59:39.072322+0000","last_fullsized":"2023-07-09T21:59:39.072322+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:13:35.819224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":293,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055395+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:59:39.055395+0000","last_peered":"2023-07-09T21:59:39.055395+0000","last_clean":"2023-07-09T21:59:39.055395+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:59:39.055395+0000","last_undegraded":"2023-07-09T21:59:39.055395+0000","last_fullsized":"2023-07-09T21:59:39.055395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:09:27.333574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.043386+0000","last_change":"2023-07-09T21:59:39.043386+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.043386+0000","last_undegraded":"2023-07-09T21:59:39.043386+0000","last_fullsized":"2023-07-09T21:59:39.043386+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.062745+0000","last_change":"2023-07-09T21:59:39.058851+0000","last_active":"2023-07-09T21:59:39.062745+0000","last_peered":"2023-07-09T21:59:39.062745+0000","last_clean":"2023-07-09T21:59:39.062745+0000","last_became_active":"2023-07-09T21:59:39.058567+0000","last_became_peered":"2023-07-09T21:59:39.058567+0000","last_unstale":"2023-07-09T21:59:39.062745+0000","last_undegraded":"2023-07-09T21:59:39.062745+0000","last_fullsized":"2023-07-09T21:59:39.062745+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:24:02.680011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.038283+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:59:39.038283+0000","last_peered":"2023-07-09T21:59:39.038283+0000","last_clean":"2023-07-09T21:59:39.038283+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:59:39.038283+0000","last_undegraded":"2023-07-09T21:59:39.038283+0000","last_fullsized":"2023-07-09T21:59:39.038283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:30:47.231350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044627+0000","last_change":"2023-07-09T21:59:39.044627+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044627+0000","last_undegraded":"2023-07-09T21:59:39.044627+0000","last_fullsized":"2023-07-09T21:59:39.044627+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.055090+0000","last_change":"2023-07-09T21:59:39.048558+0000","last_active":"2023-07-09T21:59:39.055090+0000","last_peered":"2023-07-09T21:59:39.055090+0000","last_clean":"2023-07-09T21:59:39.055090+0000","last_became_active":"2023-07-09T21:59:39.048275+0000","last_became_peered":"2023-07-09T21:59:39.048275+0000","last_unstale":"2023-07-09T21:59:39.055090+0000","last_undegraded":"2023-07-09T21:59:39.055090+0000","last_fullsized":"2023-07-09T21:59:39.055090+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:15.911625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":338,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.051690+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:59:39.051690+0000","last_peered":"2023-07-09T21:59:39.051690+0000","last_clean":"2023-07-09T21:59:39.051690+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:59:39.051690+0000","last_undegraded":"2023-07-09T21:59:39.051690+0000","last_fullsized":"2023-07-09T21:59:39.051690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:13:06.666361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.050862+0000","last_change":"2023-07-09T21:59:39.050862+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.050862+0000","last_undegraded":"2023-07-09T21:59:39.050862+0000","last_fullsized":"2023-07-09T21:59:39.050862+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.061139+0000","last_change":"2023-07-09T21:59:39.056568+0000","last_active":"2023-07-09T21:59:39.061139+0000","last_peered":"2023-07-09T21:59:39.061139+0000","last_clean":"2023-07-09T21:59:39.061139+0000","last_became_active":"2023-07-09T21:59:39.056167+0000","last_became_peered":"2023-07-09T21:59:39.056167+0000","last_unstale":"2023-07-09T21:59:39.061139+0000","last_undegraded":"2023-07-09T21:59:39.061139+0000","last_fullsized":"2023-07-09T21:59:39.061139+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:46.454097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":284,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047976+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:59:39.047976+0000","last_peered":"2023-07-09T21:59:39.047976+0000","last_clean":"2023-07-09T21:59:39.047976+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:59:39.047976+0000","last_undegraded":"2023-07-09T21:59:39.047976+0000","last_fullsized":"2023-07-09T21:59:39.047976+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:10:45.996233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.047192+0000","last_change":"2023-07-09T21:59:39.047192+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.047192+0000","last_undegraded":"2023-07-09T21:59:39.047192+0000","last_fullsized":"2023-07-09T21:59:39.047192+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.068192+0000","last_change":"2023-07-09T21:59:39.066863+0000","last_active":"2023-07-09T21:59:39.068192+0000","last_peered":"2023-07-09T21:59:39.068192+0000","last_clean":"2023-07-09T21:59:39.068192+0000","last_became_active":"2023-07-09T21:59:39.066027+0000","last_became_peered":"2023-07-09T21:59:39.066027+0000","last_unstale":"2023-07-09T21:59:39.068192+0000","last_undegraded":"2023-07-09T21:59:39.068192+0000","last_fullsized":"2023-07-09T21:59:39.068192+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:44:06.553565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":292,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.058009+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:59:39.058009+0000","last_peered":"2023-07-09T21:59:39.058009+0000","last_clean":"2023-07-09T21:59:39.058009+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:59:39.058009+0000","last_undegraded":"2023-07-09T21:59:39.058009+0000","last_fullsized":"2023-07-09T21:59:39.058009+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:42:17.234873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.049965+0000","last_change":"2023-07-09T21:59:39.049965+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.049965+0000","last_undegraded":"2023-07-09T21:59:39.049965+0000","last_fullsized":"2023-07-09T21:59:39.049965+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.063009+0000","last_change":"2023-07-09T21:59:39.059472+0000","last_active":"2023-07-09T21:59:39.063009+0000","last_peered":"2023-07-09T21:59:39.063009+0000","last_clean":"2023-07-09T21:59:39.063009+0000","last_became_active":"2023-07-09T21:59:39.059185+0000","last_became_peered":"2023-07-09T21:59:39.059185+0000","last_unstale":"2023-07-09T21:59:39.063009+0000","last_undegraded":"2023-07-09T21:59:39.063009+0000","last_fullsized":"2023-07-09T21:59:39.063009+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:38:06.284996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":286,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.045200+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:59:39.045200+0000","last_peered":"2023-07-09T21:59:39.045200+0000","last_clean":"2023-07-09T21:59:39.045200+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:59:39.045200+0000","last_undegraded":"2023-07-09T21:59:39.045200+0000","last_fullsized":"2023-07-09T21:59:39.045200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:15.213940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":1,"reported_epoch":174,"state":"creating+peering","last_fresh":"2023-07-09T21:59:39.044300+0000","last_change":"2023-07-09T21:59:39.044300+0000","last_active":"2023-07-09T21:59:39.032089+0000","last_peered":"2023-07-09T21:59:39.032089+0000","last_clean":"2023-07-09T21:59:39.032089+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T21:59:39.044300+0000","last_undegraded":"2023-07-09T21:59:39.044300+0000","last_fullsized":"2023-07-09T21:59:39.044300+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.065484+0000","last_change":"2023-07-09T21:59:39.062972+0000","last_active":"2023-07-09T21:59:39.065484+0000","last_peered":"2023-07-09T21:59:39.065484+0000","last_clean":"2023-07-09T21:59:39.065484+0000","last_became_active":"2023-07-09T21:59:39.062692+0000","last_became_peered":"2023-07-09T21:59:39.062692+0000","last_unstale":"2023-07-09T21:59:39.065484+0000","last_undegraded":"2023-07-09T21:59:39.065484+0000","last_fullsized":"2023-07-09T21:59:39.065484+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:54:08.036755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":300,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-07-09T21:59:39.047584+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:59:39.047584+0000","last_peered":"2023-07-09T21:59:39.047584+0000","last_clean":"2023-07-09T21:59:39.047584+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:59:39.047584+0000","last_undegraded":"2023-07-09T21:59:39.047584+0000","last_fullsized":"2023-07-09T21:59:39.047584+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:04.016376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47688,"kb_used_data":2688,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94324152,"statfs":{"total":96636764160,"available":96587931648,"internally_reserved":0,"allocated":2752512,"data_stored":1699120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.41599999999999998},"max":{"1min":0.98699999999999999,"5min":0.99299999999999999,"15min":1.0169999999999999},"last":0.64000000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96499999999999997,"5min":1.028,"15min":1.0309999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":1.04,"15min":1.0660000000000001},"last":0.68100000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0740000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.621,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.004,"5min":1.0289999999999999,"15min":1.038},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.69599999999999995}]},{"osd":4,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.84299999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.077},"last":0.624},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.79200000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575290,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.075,"15min":1.075},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.04},"last":0.624}]},{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89600000000000002,"5min":0.98199999999999998,"15min":1.177},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":1.1200000000000001,"15min":1.1890000000000001},"last":0.67700000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.50600000000000001,"15min":0.503},"max":{"1min":0.96499999999999997,"5min":1.504,"15min":1.504},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.436},"max":{"1min":0.878,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.69099999999999995}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.52200000000000002,"15min":0.51400000000000001},"max":{"1min":0.90800000000000003,"5min":1.02,"15min":1.026},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54000000000000004},"max":{"1min":1.0049999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.66600000000000004}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":1.161,"15min":1.161},"last":0.496},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.05,"15min":1.099},"last":0.71199999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.95899999999999996,"15min":1.052},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.077},"last":0.78000000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575289,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55312,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316528,"statfs":{"total":96636764160,"available":96580124672,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.012,"15min":1.012},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.97999999999999998,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82199999999999995}]},{"osd":1,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":1.05},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.45900000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.046,"5min":1.095,"15min":1.095},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.67100000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.49299999999999999},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.034},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.379},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.504},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.71099999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.41799999999999998},"max":{"1min":1.056,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":0.93400000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575291,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37252,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334588,"statfs":{"total":96636764160,"available":96598618112,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.747,"15min":0.745},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.40000000000000002},"max":{"1min":0.92600000000000005,"5min":0.996,"15min":1.075},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.73299999999999998,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.499,"15min":0.42999999999999999},"max":{"1min":0.95499999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.72799999999999998}]},{"osd":1,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.76000000000000001,"15min":0.75700000000000001},"min":{"1min":0.54300000000000004,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.044,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.76100000000000001,"15min":0.753},"min":{"1min":0.56899999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.97899999999999998,"5min":0.998,"15min":1.119},"last":0.68000000000000005}]},{"osd":2,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75800000000000001,"15min":0.755},"min":{"1min":0.60399999999999998,"5min":0.51600000000000001,"15min":0.49199999999999999},"max":{"1min":0.98199999999999998,"5min":1.0800000000000001,"15min":1.2},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.77800000000000002,"15min":0.77200000000000002},"min":{"1min":0.58599999999999997,"5min":0.51700000000000002,"15min":0.49399999999999999},"max":{"1min":0.95399999999999996,"5min":1.03,"15min":1.0669999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.76200000000000001,"15min":0.74399999999999999},"min":{"1min":0.67500000000000004,"5min":0.57999999999999996,"15min":0.48999999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78200000000000003,"15min":0.77700000000000002},"min":{"1min":0.61899999999999999,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.0289999999999999,"5min":1.038,"15min":1.1599999999999999},"last":0.745}]},{"osd":5,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63400000000000001,"15min":0.60799999999999998},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.36799999999999999},"max":{"1min":0.91600000000000004,"5min":1.05,"15min":1.079},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.627,"15min":0.60999999999999999},"min":{"1min":0.49199999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.92400000000000004,"5min":1.016,"15min":1.016},"last":0.65200000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.64900000000000002,"15min":0.63700000000000001},"min":{"1min":0.504,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.96099999999999997,"5min":0.96499999999999997,"15min":1.018},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.70399999999999996,"15min":0.67600000000000005},"min":{"1min":0.54900000000000004,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.97199999999999998,"5min":1.069,"15min":1.069},"last":0.85199999999999998}]},{"osd":7,"last update":"Sun Jul 9 21:58:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.57699999999999996,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.93100000000000005,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.75900000000000001,"15min":0.72499999999999998},"min":{"1min":0.60499999999999998,"5min":0.501,"15min":0.46100000000000002},"max":{"1min":1.0109999999999999,"5min":1.0389999999999999,"15min":1.044},"last":0.871}]}]},{"osd":3,"up_from":13,"seq":55834575290,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37264,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334576,"statfs":{"total":96636764160,"available":96598605824,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.0860000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.315},"max":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":1.113},"last":0.438}]},{"osd":1,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":1.133},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.46400000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":1.0149999999999999,"15min":1.194},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.59399999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.135,"5min":1.1379999999999999,"15min":1.5429999999999999},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.5649999999999999},"last":0.67500000000000004}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1479999999999999,"15min":1.302},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.101,"5min":1.1879999999999999,"15min":1.262},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.161,"15min":1.363},"last":0.53600000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.2070000000000001,"15min":1.601},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575291,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55300,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316540,"statfs":{"total":96636764160,"available":96580136960,"internally_reserved":0,"allocated":2158592,"data_stored":1108752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.61299999999999999,"5min":0.72199999999999998,"15min":0.96499999999999997},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.85099999999999998},"last":0.42499999999999999}]},{"osd":1,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":0.77200000000000002},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.65600000000000003,"5min":0.76300000000000001,"15min":0.99399999999999999},"last":0.53400000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":1.016},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.2290000000000001},"last":0.71799999999999997}]},{"osd":4,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.117,"15min":1.337},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.69899999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.306},"last":0.74299999999999999}]},{"osd":5,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.66500000000000004,"5min":0.624,"15min":0.57699999999999996},"max":{"1min":1.276,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.56799999999999995,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.1739999999999999,"15min":1.375},"last":0.79700000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.2529999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.294},"last":0.82399999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.115,"5min":1.2809999999999999,"15min":1.298},"last":0.623},{"interface":"front","average":{"1min":0.87,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.746,"5min":0.624,"15min":0.61399999999999999},"max":{"1min":1.1180000000000001,"5min":1.196,"15min":1.256},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575291,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2170880,"data_stored":1115436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80600000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.32400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.63100000000000001,"5min":0.72599999999999998,"15min":0.81799999999999995},"last":0.434},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41299999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.46700000000000003}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"max":{"1min":1.024,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.871,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.70899999999999996,"5min":0.56000000000000005,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.2769999999999999,"15min":1.337},"last":0.72699999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.57299999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55100000000000005,"15min":0.48899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1160000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.099,"5min":1.157,"15min":1.1659999999999999},"last":0.55200000000000005}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93300000000000005,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.0640000000000001,"5min":1.321,"15min":1.321},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575291,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41940,"kb_used_data":2700,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329900,"statfs":{"total":96636764160,"available":96593817600,"internally_reserved":0,"allocated":2764800,"data_stored":1705804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.73599999999999999,"15min":0.89300000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.53600000000000003}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65400000000000003,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.48199999999999998}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.81100000000000005,"15min":0.80400000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91000000000000003,"5min":1.306,"15min":1.306},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88600000000000001,"5min":1.1839999999999999,"15min":1.3600000000000001},"last":0.72599999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.81200000000000006},"min":{"1min":0.624,"5min":0.503,"15min":0.503},"max":{"1min":0.93200000000000005,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.627},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.82399999999999995},"min":{"1min":0.65500000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.65300000000000002}]},{"osd":6,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":0.92400000000000004,"5min":1.3260000000000001,"15min":1.381},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.67700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.1739999999999999,"15min":1.1990000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"max":{"1min":0.873,"5min":1.2470000000000001,"15min":1.3400000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.397,"15min":1.397},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:59:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3f is not active+clean 2023-07-09T21:59:44.961 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.051204+0000', 'last_change': '2023-07-09T21:59:39.051204+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.051204+0000', 'last_undegraded': '2023-07-09T21:59:39.051204+0000', 'last_fullsized': '2023-07-09T21:59:39.051204+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.962 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-07-09T21:59:44.962 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044926+0000', 'last_change': '2023-07-09T21:59:39.044926+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044926+0000', 'last_undegraded': '2023-07-09T21:59:39.044926+0000', 'last_fullsized': '2023-07-09T21:59:39.044926+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.963 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-07-09T21:59:44.963 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047466+0000', 'last_change': '2023-07-09T21:59:39.047466+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047466+0000', 'last_undegraded': '2023-07-09T21:59:39.047466+0000', 'last_fullsized': '2023-07-09T21:59:39.047466+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.964 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-07-09T21:59:44.964 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049990+0000', 'last_change': '2023-07-09T21:59:39.049990+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049990+0000', 'last_undegraded': '2023-07-09T21:59:39.049990+0000', 'last_fullsized': '2023-07-09T21:59:39.049990+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:44.965 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3b is not active+clean 2023-07-09T21:59:44.965 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050389+0000', 'last_change': '2023-07-09T21:59:39.050389+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050389+0000', 'last_undegraded': '2023-07-09T21:59:39.050389+0000', 'last_fullsized': '2023-07-09T21:59:39.050389+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.966 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3a is not active+clean 2023-07-09T21:59:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050390+0000', 'last_change': '2023-07-09T21:59:39.050390+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050390+0000', 'last_undegraded': '2023-07-09T21:59:39.050390+0000', 'last_fullsized': '2023-07-09T21:59:39.050390+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.967 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.39 is not active+clean 2023-07-09T21:59:44.968 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.048313+0000', 'last_change': '2023-07-09T21:59:39.048313+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.048313+0000', 'last_undegraded': '2023-07-09T21:59:39.048313+0000', 'last_fullsized': '2023-07-09T21:59:39.048313+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.969 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-07-09T21:59:44.969 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.055446+0000', 'last_change': '2023-07-09T21:59:39.055446+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.055446+0000', 'last_undegraded': '2023-07-09T21:59:39.055446+0000', 'last_fullsized': '2023-07-09T21:59:39.055446+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:44.970 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.37 is not active+clean 2023-07-09T21:59:44.971 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.051289+0000', 'last_change': '2023-07-09T21:59:39.051289+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.051289+0000', 'last_undegraded': '2023-07-09T21:59:39.051289+0000', 'last_fullsized': '2023-07-09T21:59:39.051289+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.971 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.36 is not active+clean 2023-07-09T21:59:44.972 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049044+0000', 'last_change': '2023-07-09T21:59:39.049044+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049044+0000', 'last_undegraded': '2023-07-09T21:59:39.049044+0000', 'last_fullsized': '2023-07-09T21:59:39.049044+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.972 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.35 is not active+clean 2023-07-09T21:59:44.973 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044468+0000', 'last_change': '2023-07-09T21:59:39.044468+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044468+0000', 'last_undegraded': '2023-07-09T21:59:39.044468+0000', 'last_fullsized': '2023-07-09T21:59:39.044468+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:44.974 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-07-09T21:59:44.974 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049553+0000', 'last_change': '2023-07-09T21:59:39.049553+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049553+0000', 'last_undegraded': '2023-07-09T21:59:39.049553+0000', 'last_fullsized': '2023-07-09T21:59:39.049553+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:44.975 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.33 is not active+clean 2023-07-09T21:59:44.976 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.051485+0000', 'last_change': '2023-07-09T21:59:39.051485+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.051485+0000', 'last_undegraded': '2023-07-09T21:59:39.051485+0000', 'last_fullsized': '2023-07-09T21:59:39.051485+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-07-09T21:59:44.977 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049176+0000', 'last_change': '2023-07-09T21:59:39.049176+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049176+0000', 'last_undegraded': '2023-07-09T21:59:39.049176+0000', 'last_fullsized': '2023-07-09T21:59:39.049176+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:44.978 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-07-09T21:59:44.979 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047632+0000', 'last_change': '2023-07-09T21:59:39.047632+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047632+0000', 'last_undegraded': '2023-07-09T21:59:39.047632+0000', 'last_fullsized': '2023-07-09T21:59:39.047632+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.979 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.30 is not active+clean 2023-07-09T21:59:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049176+0000', 'last_change': '2023-07-09T21:59:39.049176+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049176+0000', 'last_undegraded': '2023-07-09T21:59:39.049176+0000', 'last_fullsized': '2023-07-09T21:59:39.049176+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-07-09T21:59:44.980 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047944+0000', 'last_change': '2023-07-09T21:59:39.047944+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047944+0000', 'last_undegraded': '2023-07-09T21:59:39.047944+0000', 'last_fullsized': '2023-07-09T21:59:39.047944+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2e is not active+clean 2023-07-09T21:59:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.045066+0000', 'last_change': '2023-07-09T21:59:39.045066+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.045066+0000', 'last_undegraded': '2023-07-09T21:59:39.045066+0000', 'last_fullsized': '2023-07-09T21:59:39.045066+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:44.981 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2d is not active+clean 2023-07-09T21:59:44.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.055240+0000', 'last_change': '2023-07-09T21:59:39.055240+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.055240+0000', 'last_undegraded': '2023-07-09T21:59:39.055240+0000', 'last_fullsized': '2023-07-09T21:59:39.055240+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:44.982 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2c is not active+clean 2023-07-09T21:59:44.982 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.043539+0000', 'last_change': '2023-07-09T21:59:39.043539+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.043539+0000', 'last_undegraded': '2023-07-09T21:59:39.043539+0000', 'last_fullsized': '2023-07-09T21:59:39.043539+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:59:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2b is not active+clean 2023-07-09T21:59:44.983 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050998+0000', 'last_change': '2023-07-09T21:59:39.050998+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050998+0000', 'last_undegraded': '2023-07-09T21:59:39.050998+0000', 'last_fullsized': '2023-07-09T21:59:39.050998+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2a is not active+clean 2023-07-09T21:59:44.984 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.046987+0000', 'last_change': '2023-07-09T21:59:39.046987+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.046987+0000', 'last_undegraded': '2023-07-09T21:59:39.046987+0000', 'last_fullsized': '2023-07-09T21:59:39.046987+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.984 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-07-09T21:59:44.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050743+0000', 'last_change': '2023-07-09T21:59:39.050743+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050743+0000', 'last_undegraded': '2023-07-09T21:59:39.050743+0000', 'last_fullsized': '2023-07-09T21:59:39.050743+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:44.985 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.28 is not active+clean 2023-07-09T21:59:44.985 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044352+0000', 'last_change': '2023-07-09T21:59:39.044352+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044352+0000', 'last_undegraded': '2023-07-09T21:59:39.044352+0000', 'last_fullsized': '2023-07-09T21:59:39.044352+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:44.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.27 is not active+clean 2023-07-09T21:59:44.986 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050746+0000', 'last_change': '2023-07-09T21:59:39.050746+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050746+0000', 'last_undegraded': '2023-07-09T21:59:39.050746+0000', 'last_fullsized': '2023-07-09T21:59:39.050746+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.986 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.26 is not active+clean 2023-07-09T21:59:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.054941+0000', 'last_change': '2023-07-09T21:59:39.054941+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.054941+0000', 'last_undegraded': '2023-07-09T21:59:39.054941+0000', 'last_fullsized': '2023-07-09T21:59:39.054941+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.25 is not active+clean 2023-07-09T21:59:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049001+0000', 'last_change': '2023-07-09T21:59:39.049001+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049001+0000', 'last_undegraded': '2023-07-09T21:59:39.049001+0000', 'last_fullsized': '2023-07-09T21:59:39.049001+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.987 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.24 is not active+clean 2023-07-09T21:59:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044451+0000', 'last_change': '2023-07-09T21:59:39.044451+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044451+0000', 'last_undegraded': '2023-07-09T21:59:39.044451+0000', 'last_fullsized': '2023-07-09T21:59:39.044451+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-07-09T21:59:44.988 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.057788+0000', 'last_change': '2023-07-09T21:59:39.057788+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.057788+0000', 'last_undegraded': '2023-07-09T21:59:39.057788+0000', 'last_fullsized': '2023-07-09T21:59:39.057788+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:44.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.22 is not active+clean 2023-07-09T21:59:44.989 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044984+0000', 'last_change': '2023-07-09T21:59:39.044984+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044984+0000', 'last_undegraded': '2023-07-09T21:59:39.044984+0000', 'last_fullsized': '2023-07-09T21:59:39.044984+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:44.989 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.21 is not active+clean 2023-07-09T21:59:44.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049355+0000', 'last_change': '2023-07-09T21:59:39.049355+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049355+0000', 'last_undegraded': '2023-07-09T21:59:39.049355+0000', 'last_fullsized': '2023-07-09T21:59:39.049355+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:44.990 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-07-09T21:59:44.990 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.054598+0000', 'last_change': '2023-07-09T21:59:39.054598+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.054598+0000', 'last_undegraded': '2023-07-09T21:59:39.054598+0000', 'last_fullsized': '2023-07-09T21:59:39.054598+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-07-09T21:59:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044040+0000', 'last_change': '2023-07-09T21:59:39.044040+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044040+0000', 'last_undegraded': '2023-07-09T21:59:39.044040+0000', 'last_fullsized': '2023-07-09T21:59:39.044040+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-07-09T21:59:44.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047014+0000', 'last_change': '2023-07-09T21:59:39.047014+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047014+0000', 'last_undegraded': '2023-07-09T21:59:39.047014+0000', 'last_fullsized': '2023-07-09T21:59:39.047014+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.992 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-07-09T21:59:44.992 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.056293+0000', 'last_change': '2023-07-09T21:59:39.056293+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.056293+0000', 'last_undegraded': '2023-07-09T21:59:39.056293+0000', 'last_fullsized': '2023-07-09T21:59:39.056293+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1f is not active+clean 2023-07-09T21:59:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.054604+0000', 'last_change': '2023-07-09T21:59:39.054604+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.054604+0000', 'last_undegraded': '2023-07-09T21:59:39.054604+0000', 'last_fullsized': '2023-07-09T21:59:39.054604+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:44.993 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.18 is not active+clean 2023-07-09T21:59:44.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044765+0000', 'last_change': '2023-07-09T21:59:39.044765+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044765+0000', 'last_undegraded': '2023-07-09T21:59:39.044765+0000', 'last_fullsized': '2023-07-09T21:59:39.044765+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T21:59:44.994 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-07-09T21:59:44.994 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047622+0000', 'last_change': '2023-07-09T21:59:39.047622+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047622+0000', 'last_undegraded': '2023-07-09T21:59:39.047622+0000', 'last_fullsized': '2023-07-09T21:59:39.047622+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-07-09T21:59:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.046125+0000', 'last_change': '2023-07-09T21:59:39.046125+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.046125+0000', 'last_undegraded': '2023-07-09T21:59:39.046125+0000', 'last_fullsized': '2023-07-09T21:59:39.046125+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:44.995 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1b is not active+clean 2023-07-09T21:59:44.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049672+0000', 'last_change': '2023-07-09T21:59:39.049672+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049672+0000', 'last_undegraded': '2023-07-09T21:59:39.049672+0000', 'last_fullsized': '2023-07-09T21:59:39.049672+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.996 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.c is not active+clean 2023-07-09T21:59:44.996 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.053001+0000', 'last_change': '2023-07-09T21:59:39.053001+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.053001+0000', 'last_undegraded': '2023-07-09T21:59:39.053001+0000', 'last_fullsized': '2023-07-09T21:59:39.053001+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.d is not active+clean 2023-07-09T21:59:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.055728+0000', 'last_change': '2023-07-09T21:59:39.055728+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.055728+0000', 'last_undegraded': '2023-07-09T21:59:39.055728+0000', 'last_fullsized': '2023-07-09T21:59:39.055728+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:44.997 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.e is not active+clean 2023-07-09T21:59:44.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.054492+0000', 'last_change': '2023-07-09T21:59:39.054492+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.054492+0000', 'last_undegraded': '2023-07-09T21:59:39.054492+0000', 'last_fullsized': '2023-07-09T21:59:39.054492+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.998 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.f is not active+clean 2023-07-09T21:59:44.998 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050228+0000', 'last_change': '2023-07-09T21:59:39.050228+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050228+0000', 'last_undegraded': '2023-07-09T21:59:39.050228+0000', 'last_fullsized': '2023-07-09T21:59:39.050228+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.8 is not active+clean 2023-07-09T21:59:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.053525+0000', 'last_change': '2023-07-09T21:59:39.053525+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.053525+0000', 'last_undegraded': '2023-07-09T21:59:39.053525+0000', 'last_fullsized': '2023-07-09T21:59:39.053525+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-07-09T21:59:44.999 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.046704+0000', 'last_change': '2023-07-09T21:59:39.046704+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.046704+0000', 'last_undegraded': '2023-07-09T21:59:39.046704+0000', 'last_fullsized': '2023-07-09T21:59:39.046704+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:45.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.a is not active+clean 2023-07-09T21:59:45.000 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.052633+0000', 'last_change': '2023-07-09T21:59:39.052633+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.052633+0000', 'last_undegraded': '2023-07-09T21:59:39.052633+0000', 'last_fullsized': '2023-07-09T21:59:39.052633+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T21:59:45.000 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-07-09T21:59:45.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.043741+0000', 'last_change': '2023-07-09T21:59:39.043741+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.043741+0000', 'last_undegraded': '2023-07-09T21:59:39.043741+0000', 'last_fullsized': '2023-07-09T21:59:39.043741+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:45.001 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.4 is not active+clean 2023-07-09T21:59:45.001 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.051227+0000', 'last_change': '2023-07-09T21:59:39.051227+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.051227+0000', 'last_undegraded': '2023-07-09T21:59:39.051227+0000', 'last_fullsized': '2023-07-09T21:59:39.051227+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-07-09T21:59:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.046973+0000', 'last_change': '2023-07-09T21:59:39.046973+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.046973+0000', 'last_undegraded': '2023-07-09T21:59:39.046973+0000', 'last_fullsized': '2023-07-09T21:59:39.046973+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:45.002 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.6 is not active+clean 2023-07-09T21:59:45.003 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.052025+0000', 'last_change': '2023-07-09T21:59:39.052025+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.052025+0000', 'last_undegraded': '2023-07-09T21:59:39.052025+0000', 'last_fullsized': '2023-07-09T21:59:39.052025+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T21:59:45.003 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.7 is not active+clean 2023-07-09T21:59:45.004 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050803+0000', 'last_change': '2023-07-09T21:59:39.050803+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050803+0000', 'last_undegraded': '2023-07-09T21:59:39.050803+0000', 'last_fullsized': '2023-07-09T21:59:39.050803+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:45.004 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-07-09T21:59:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050309+0000', 'last_change': '2023-07-09T21:59:39.050309+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050309+0000', 'last_undegraded': '2023-07-09T21:59:39.050309+0000', 'last_fullsized': '2023-07-09T21:59:39.050309+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-07-09T21:59:45.005 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.046315+0000', 'last_change': '2023-07-09T21:59:39.046315+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.046315+0000', 'last_undegraded': '2023-07-09T21:59:39.046315+0000', 'last_fullsized': '2023-07-09T21:59:39.046315+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T21:59:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-07-09T21:59:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.045643+0000', 'last_change': '2023-07-09T21:59:39.045643+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.045643+0000', 'last_undegraded': '2023-07-09T21:59:39.045643+0000', 'last_fullsized': '2023-07-09T21:59:39.045643+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:45.006 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-07-09T21:59:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.058801+0000', 'last_change': '2023-07-09T21:59:39.058801+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.058801+0000', 'last_undegraded': '2023-07-09T21:59:39.058801+0000', 'last_fullsized': '2023-07-09T21:59:39.058801+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-07-09T21:59:45.007 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.056173+0000', 'last_change': '2023-07-09T21:59:39.056173+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.056173+0000', 'last_undegraded': '2023-07-09T21:59:39.056173+0000', 'last_fullsized': '2023-07-09T21:59:39.056173+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:45.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-07-09T21:59:45.008 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.057873+0000', 'last_change': '2023-07-09T21:59:39.057873+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.057873+0000', 'last_undegraded': '2023-07-09T21:59:39.057873+0000', 'last_fullsized': '2023-07-09T21:59:39.057873+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:45.008 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.15 is not active+clean 2023-07-09T21:59:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.043386+0000', 'last_change': '2023-07-09T21:59:39.043386+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.043386+0000', 'last_undegraded': '2023-07-09T21:59:39.043386+0000', 'last_fullsized': '2023-07-09T21:59:39.043386+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.16 is not active+clean 2023-07-09T21:59:45.009 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044627+0000', 'last_change': '2023-07-09T21:59:39.044627+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044627+0000', 'last_undegraded': '2023-07-09T21:59:39.044627+0000', 'last_fullsized': '2023-07-09T21:59:39.044627+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T21:59:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-07-09T21:59:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.050862+0000', 'last_change': '2023-07-09T21:59:39.050862+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.050862+0000', 'last_undegraded': '2023-07-09T21:59:39.050862+0000', 'last_fullsized': '2023-07-09T21:59:39.050862+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T21:59:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-07-09T21:59:45.010 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.047192+0000', 'last_change': '2023-07-09T21:59:39.047192+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.047192+0000', 'last_undegraded': '2023-07-09T21:59:39.047192+0000', 'last_fullsized': '2023-07-09T21:59:39.047192+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.12 is not active+clean 2023-07-09T21:59:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.049965+0000', 'last_change': '2023-07-09T21:59:39.049965+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.049965+0000', 'last_undegraded': '2023-07-09T21:59:39.049965+0000', 'last_fullsized': '2023-07-09T21:59:39.049965+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T21:59:45.011 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-07-09T21:59:45.012 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 174, 'state': 'creating+peering', 'last_fresh': '2023-07-09T21:59:39.044300+0000', 'last_change': '2023-07-09T21:59:39.044300+0000', 'last_active': '2023-07-09T21:59:39.032089+0000', 'last_peered': '2023-07-09T21:59:39.032089+0000', 'last_clean': '2023-07-09T21:59:39.032089+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T21:59:39.044300+0000', 'last_undegraded': '2023-07-09T21:59:39.044300+0000', 'last_fullsized': '2023-07-09T21:59:39.044300+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'last_clean_scrub_stamp': '2023-07-09T21:59:39.032089+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T21:59:45.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T21:59:45.028 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-07-09T21:59:45.023+0000 7f15c6dbf640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T21:59:45.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 Processor -- start 2023-07-09T21:59:45.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 -- start start 2023-07-09T21:59:45.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8b18070700 0x7f8b1815fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180cd610 con 0x7f8b180af830 2023-07-09T21:59:45.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b180cd8f0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1e8d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b180cdbd0 con 0x7f8b18070700 2023-07-09T21:59:45.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1ce75640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8b180af830 0x7f8b1806efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43312/0 (socket says 172.21.15.37:43312) 2023-07-09T21:59:45.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b1ce75640 1 -- 172.21.15.37:0/1845411917 learned_addr learned my addr 172.21.15.37:0/1845411917 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.151+0000 7f8b17fff640 1 --2- 172.21.15.37:0/1845411917 >> v2:172.21.15.119:3300/0 conn(0x7f8b18070700 0x7f8b1815fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b16ffd640 1 -- 172.21.15.37:0/1845411917 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868506061 0 0) 0x7f8b180cd610 con 0x7f8b180af830 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b16ffd640 1 -- 172.21.15.37:0/1845411917 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b00003530 con 0x7f8b180af830 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b17fff640 1 -- 172.21.15.37:0/1845411917 >> v1:172.21.15.119:6789/0 conn(0x7f8b180cb9f0 legacy=0x7f8b1815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b17fff640 1 -- 172.21.15.37:0/1845411917 >> v1:172.21.15.37:6789/0 conn(0x7f8b180af830 legacy=0x7f8b1806efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b17fff640 1 -- 172.21.15.37:0/1845411917 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b1815c0e0 con 0x7f8b18070700 2023-07-09T21:59:45.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b17fff640 1 --2- 172.21.15.37:0/1845411917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b18070700 0x7f8b1815fed0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097f0 tx=0x7f8b0801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73eea9b3a3d5a78c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b16ffd640 1 -- 172.21.15.37:0/1845411917 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080ab600 con 0x7f8b18070700 2023-07-09T21:59:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b16ffd640 1 -- 172.21.15.37:0/1845411917 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b080a7050 con 0x7f8b18070700 2023-07-09T21:59:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.155+0000 7f8b16ffd640 1 -- 172.21.15.37:0/1845411917 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b080ab980 con 0x7f8b18070700 2023-07-09T21:59:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/1845411917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b18070700 msgr2=0x7f8b1815fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/1845411917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b18070700 0x7f8b1815fed0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8b080097f0 tx=0x7f8b0801c3f0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/1845411917 shutdown_connections 2023-07-09T21:59:45.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/1845411917 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b18070700 0x7f8b1815fed0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/1845411917 >> 172.21.15.37:0/1845411917 conn(0x7f8b180ca830 msgr2=0x7f8b180cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:45.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/1845411917 shutdown_connections 2023-07-09T21:59:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/1845411917 wait complete. 2023-07-09T21:59:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 Processor -- start 2023-07-09T21:59:45.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- start start 2023-07-09T21:59:45.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b18070700 0x7f8b181584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b180af830 0x7f8b1814a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180b1d80 con 0x7f8b180cb9f0 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b18153090 con 0x7f8b180af830 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1e8d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b180b1450 con 0x7f8b18070700 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1ce75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1ce75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51910/0 (socket says 172.21.15.37:51910) 2023-07-09T21:59:45.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b1ce75640 1 -- 172.21.15.37:0/3111368804 learned_addr learned my addr 172.21.15.37:0/3111368804 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b177fe640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b180af830 0x7f8b1814a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.159+0000 7f8b17fff640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b18070700 0x7f8b181584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 -- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b18070700 msgr2=0x7f8b181584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b18070700 0x7f8b181584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 -- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b180af830 msgr2=0x7f8b1814a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b180af830 0x7f8b1814a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 -- 172.21.15.37:0/3111368804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b08009420 con 0x7f8b180cb9f0 2023-07-09T21:59:45.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1ce75640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8b100014c0 tx=0x7f8b1000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000ad40 con 0x7f8b180cb9f0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b10012400 con 0x7f8b180cb9f0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b180b1730 con 0x7f8b180cb9f0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1000aea0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b181589f0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b180b1ef0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8b1001b3b0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 0x7f8b04068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.163+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f8b10083de0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.167+0000 7f8b17fff640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 0x7f8b04068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.167+0000 7f8b17fff640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 0x7f8b04068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b080ad000 tx=0x7f8b080a6000 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.167+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8b100511b0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.375+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8b1804d7d0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.375+0000 7f8b14ff9640 1 -- 172.21.15.37:0/3111368804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3235 (secure 0 0 0) 0x7f8b10017cc0 con 0x7f8b180cb9f0 2023-07-09T21:59:45.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:45.381 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2260,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":176,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":353472512,"bytes_avail":772740640768,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":76,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":10194}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-07-09T21:59:27.714708+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T21:59:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 msgr2=0x7f8b04068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 0x7f8b04068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8b080ad000 tx=0x7f8b080a6000 comp rx=0 tx=0).stop 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 msgr2=0x7f8b1814a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f8b100014c0 tx=0x7f8b1000a430 comp rx=0 tx=0).stop 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 shutdown_connections 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f8b040663a0 0x7f8b04068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b180cb9f0 0x7f8b1814a5e0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8b180af830 0x7f8b1814a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 --2- 172.21.15.37:0/3111368804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8b18070700 0x7f8b181584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 >> 172.21.15.37:0/3111368804 conn(0x7f8b180ca830 msgr2=0x7f8b18154520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 shutdown_connections 2023-07-09T21:59:45.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.379+0000 7f8b1e8d8640 1 -- 172.21.15.37:0/3111368804 wait complete. 2023-07-09T21:59:45.402 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T21:59:45.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:59:45.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 Processor -- start 2023-07-09T21:59:45.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 -- start start 2023-07-09T21:59:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e80b4340 0x7fd7e80d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e80b49f0 con 0x7fd7e80cef80 2023-07-09T21:59:45.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e80b7e80 con 0x7fd7e80b4340 2023-07-09T21:59:45.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7f039f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80cc8a0 con 0x7fd7e80b7ab0 2023-07-09T21:59:45.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7ee93c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd7e80b4340 0x7fd7e80d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7ed93a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd7e80cef80 0x7fd7e80b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43314/0 (socket says 172.21.15.37:43314) 2023-07-09T21:59:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.583+0000 7fd7ed93a640 1 -- 172.21.15.37:0/1277256055 learned_addr learned my addr 172.21.15.37:0/1277256055 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee93c640 1 -- 172.21.15.37:0/1277256055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 msgr2=0x7fd7e806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:45.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee93c640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee93c640 1 -- 172.21.15.37:0/1277256055 >> v1:172.21.15.37:6789/0 conn(0x7fd7e80cef80 legacy=0x7fd7e80b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee93c640 1 -- 172.21.15.37:0/1277256055 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80ccb80 con 0x7fd7e80b4340 2023-07-09T21:59:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ed139640 1 -- 172.21.15.37:0/1277256055 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035752492 0 0) 0x7fd7e80b49f0 con 0x7fd7e80cef80 2023-07-09T21:59:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ee93c640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80b4340 0x7fd7e80d02a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f702d550d9fdebec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ed139640 1 -- 172.21.15.37:0/1277256055 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00a59e0 con 0x7fd7e80b4340 2023-07-09T21:59:45.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ed139640 1 -- 172.21.15.37:0/1277256055 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e00a5b40 con 0x7fd7e80b4340 2023-07-09T21:59:45.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7ed139640 1 -- 172.21.15.37:0/1277256055 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00ad440 con 0x7fd7e80b4340 2023-07-09T21:59:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7f039f640 1 -- 172.21.15.37:0/1277256055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80b4340 msgr2=0x7fd7e80d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.587+0000 7fd7f039f640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80b4340 0x7fd7e80d02a0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0009d90 tx=0x7fd7e001c920 comp rx=0 tx=0).stop 2023-07-09T21:59:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- 172.21.15.37:0/1277256055 shutdown_connections 2023-07-09T21:59:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80b4340 0x7fd7e80d02a0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 --2- 172.21.15.37:0/1277256055 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- 172.21.15.37:0/1277256055 >> 172.21.15.37:0/1277256055 conn(0x7fd7e8073090 msgr2=0x7fd7e8069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- 172.21.15.37:0/1277256055 shutdown_connections 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- 172.21.15.37:0/1277256055 wait complete. 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 Processor -- start 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- start start 2023-07-09T21:59:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 0x7fd7e80cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e80cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e81f3db0 con 0x7fd7e80cef80 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c8580 con 0x7fd7e80b4340 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7f039f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80c7970 con 0x7fd7e80b7ab0 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51926/0 (socket says 172.21.15.37:51926) 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 -- 172.21.15.37:0/3548015658 learned_addr learned my addr 172.21.15.37:0/3548015658 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ed93a640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e80cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 0x7fd7e80cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 -- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 msgr2=0x7fd7e80cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e80cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 -- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 msgr2=0x7fd7e80cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 0x7fd7e80cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 -- 172.21.15.37:0/3548015658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0009a70 con 0x7fd7e80cef80 2023-07-09T21:59:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 0x7fd7e80cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ed93a640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.591+0000 7fd7ee93c640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b0040 tx=0x7fd7e00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00ade40 con 0x7fd7e80cef80 2023-07-09T21:59:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0009450 con 0x7fd7e80cef80 2023-07-09T21:59:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00b7630 con 0x7fd7e80cef80 2023-07-09T21:59:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e80c7c50 con 0x7fd7e80cef80 2023-07-09T21:59:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e80c8210 con 0x7fd7e80cef80 2023-07-09T21:59:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e80c86f0 con 0x7fd7e80cef80 2023-07-09T21:59:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd7e00b4050 con 0x7fd7e80cef80 2023-07-09T21:59:45.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 0x7fd7cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fd7e011f1b0 con 0x7fd7e80cef80 2023-07-09T21:59:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.595+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 0x7fd7cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:45.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.599+0000 7fd7ee13b640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 0x7fd7cc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009980 tx=0x7fd7e4008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:45.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.599+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd7e00ec4e0 con 0x7fd7e80cef80 2023-07-09T21:59:45.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.751+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd7e80cf4d0 con 0x7fd7cc0663a0 2023-07-09T21:59:45.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.759+0000 7fd7deffd640 1 -- 172.21.15.37:0/3548015658 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311552 (secure 0 0 0) 0x7fd7e400f860 con 0x7fd7cc0663a0 2023-07-09T21:59:45.766 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:59:45.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 msgr2=0x7fd7cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 0x7fd7cc068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd7e4009980 tx=0x7fd7e4008040 comp rx=0 tx=0).stop 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 msgr2=0x7fd7e81568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b0040 tx=0x7fd7e00196c0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 shutdown_connections 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fd7cc0663a0 0x7fd7cc068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7e80cef80 0x7fd7e81568f0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd7e80b7ab0 0x7fd7e80cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 --2- 172.21.15.37:0/3548015658 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd7e80b4340 0x7fd7e80cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 >> 172.21.15.37:0/3548015658 conn(0x7fd7e8073090 msgr2=0x7fd7e80b6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 shutdown_connections 2023-07-09T21:59:45.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:45.763+0000 7fd7f039f640 1 -- 172.21.15.37:0/3548015658 wait complete. 2023-07-09T21:59:45.786 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T21:59:45.718957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":544,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349576,"kb_used_data":18376,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754625144,"statfs":{"total":773094113280,"available":772736147456,"internally_reserved":0,"allocated":18817024,"data_stored":10220092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.673843"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078133+0000","last_change":"2023-07-09T21:59:40.071887+0000","last_active":"2023-07-09T21:59:41.078133+0000","last_peered":"2023-07-09T21:59:41.078133+0000","last_clean":"2023-07-09T21:59:41.078133+0000","last_became_active":"2023-07-09T21:59:40.071533+0000","last_became_peered":"2023-07-09T21:59:40.071533+0000","last_unstale":"2023-07-09T21:59:41.078133+0000","last_undegraded":"2023-07-09T21:59:41.078133+0000","last_fullsized":"2023-07-09T21:59:41.078133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:41.284850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801681+0000","last_change":"2023-07-09T21:59:40.087309+0000","last_active":"2023-07-09T21:59:41.801681+0000","last_peered":"2023-07-09T21:59:41.801681+0000","last_clean":"2023-07-09T21:59:41.801681+0000","last_became_active":"2023-07-09T21:59:40.087014+0000","last_became_peered":"2023-07-09T21:59:40.087014+0000","last_unstale":"2023-07-09T21:59:41.801681+0000","last_undegraded":"2023-07-09T21:59:41.801681+0000","last_fullsized":"2023-07-09T21:59:41.801681+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:04.985695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801633+0000","last_change":"2023-07-09T21:59:40.091651+0000","last_active":"2023-07-09T21:59:41.801633+0000","last_peered":"2023-07-09T21:59:41.801633+0000","last_clean":"2023-07-09T21:59:41.801633+0000","last_became_active":"2023-07-09T21:59:40.091316+0000","last_became_peered":"2023-07-09T21:59:40.091316+0000","last_unstale":"2023-07-09T21:59:41.801633+0000","last_undegraded":"2023-07-09T21:59:41.801633+0000","last_fullsized":"2023-07-09T21:59:41.801633+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:45.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076290+0000","last_change":"2023-07-09T21:59:40.095215+0000","last_active":"2023-07-09T21:59:41.076290+0000","last_peered":"2023-07-09T21:59:41.076290+0000","last_clean":"2023-07-09T21:59:41.076290+0000","last_became_active":"2023-07-09T21:59:40.094900+0000","last_became_peered":"2023-07-09T21:59:40.094900+0000","last_unstale":"2023-07-09T21:59:41.076290+0000","last_undegraded":"2023-07-09T21:59:41.076290+0000","last_fullsized":"2023-07-09T21:59:41.076290+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:44.562841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802868+0000","last_change":"2023-07-09T21:59:40.088989+0000","last_active":"2023-07-09T21:59:41.802868+0000","last_peered":"2023-07-09T21:59:41.802868+0000","last_clean":"2023-07-09T21:59:41.802868+0000","last_became_active":"2023-07-09T21:59:40.088669+0000","last_became_peered":"2023-07-09T21:59:40.088669+0000","last_unstale":"2023-07-09T21:59:41.802868+0000","last_undegraded":"2023-07-09T21:59:41.802868+0000","last_fullsized":"2023-07-09T21:59:41.802868+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:55.612186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802256+0000","last_change":"2023-07-09T21:59:40.093751+0000","last_active":"2023-07-09T21:59:41.802256+0000","last_peered":"2023-07-09T21:59:41.802256+0000","last_clean":"2023-07-09T21:59:41.802256+0000","last_became_active":"2023-07-09T21:59:40.093232+0000","last_became_peered":"2023-07-09T21:59:40.093232+0000","last_unstale":"2023-07-09T21:59:41.802256+0000","last_undegraded":"2023-07-09T21:59:41.802256+0000","last_fullsized":"2023-07-09T21:59:41.802256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:46.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078082+0000","last_change":"2023-07-09T21:59:40.080695+0000","last_active":"2023-07-09T21:59:41.078082+0000","last_peered":"2023-07-09T21:59:41.078082+0000","last_clean":"2023-07-09T21:59:41.078082+0000","last_became_active":"2023-07-09T21:59:40.077426+0000","last_became_peered":"2023-07-09T21:59:40.077426+0000","last_unstale":"2023-07-09T21:59:41.078082+0000","last_undegraded":"2023-07-09T21:59:41.078082+0000","last_fullsized":"2023-07-09T21:59:41.078082+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:45.017945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076469+0000","last_change":"2023-07-09T21:59:40.079999+0000","last_active":"2023-07-09T21:59:41.076469+0000","last_peered":"2023-07-09T21:59:41.076469+0000","last_clean":"2023-07-09T21:59:41.076469+0000","last_became_active":"2023-07-09T21:59:40.079313+0000","last_became_peered":"2023-07-09T21:59:40.079313+0000","last_unstale":"2023-07-09T21:59:41.076469+0000","last_undegraded":"2023-07-09T21:59:41.076469+0000","last_fullsized":"2023-07-09T21:59:41.076469+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:15.420945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802016+0000","last_change":"2023-07-09T21:59:40.089749+0000","last_active":"2023-07-09T21:59:41.802016+0000","last_peered":"2023-07-09T21:59:41.802016+0000","last_clean":"2023-07-09T21:59:41.802016+0000","last_became_active":"2023-07-09T21:59:40.089015+0000","last_became_peered":"2023-07-09T21:59:40.089015+0000","last_unstale":"2023-07-09T21:59:41.802016+0000","last_undegraded":"2023-07-09T21:59:41.802016+0000","last_fullsized":"2023-07-09T21:59:41.802016+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:44.562841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802621+0000","last_change":"2023-07-09T21:59:40.085468+0000","last_active":"2023-07-09T21:59:41.802621+0000","last_peered":"2023-07-09T21:59:41.802621+0000","last_clean":"2023-07-09T21:59:41.802621+0000","last_became_active":"2023-07-09T21:59:40.084456+0000","last_became_peered":"2023-07-09T21:59:40.084456+0000","last_unstale":"2023-07-09T21:59:41.802621+0000","last_undegraded":"2023-07-09T21:59:41.802621+0000","last_fullsized":"2023-07-09T21:59:41.802621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:28.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356199+0000","last_change":"2023-07-09T21:59:40.084388+0000","last_active":"2023-07-09T21:59:41.356199+0000","last_peered":"2023-07-09T21:59:41.356199+0000","last_clean":"2023-07-09T21:59:41.356199+0000","last_became_active":"2023-07-09T21:59:40.084065+0000","last_became_peered":"2023-07-09T21:59:40.084065+0000","last_unstale":"2023-07-09T21:59:41.356199+0000","last_undegraded":"2023-07-09T21:59:41.356199+0000","last_fullsized":"2023-07-09T21:59:41.356199+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:37.260955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076440+0000","last_change":"2023-07-09T21:59:40.092566+0000","last_active":"2023-07-09T21:59:41.076440+0000","last_peered":"2023-07-09T21:59:41.076440+0000","last_clean":"2023-07-09T21:59:41.076440+0000","last_became_active":"2023-07-09T21:59:40.092246+0000","last_became_peered":"2023-07-09T21:59:40.092246+0000","last_unstale":"2023-07-09T21:59:41.076440+0000","last_undegraded":"2023-07-09T21:59:41.076440+0000","last_fullsized":"2023-07-09T21:59:41.076440+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:21.051819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802741+0000","last_change":"2023-07-09T21:59:40.089660+0000","last_active":"2023-07-09T21:59:41.802741+0000","last_peered":"2023-07-09T21:59:41.802741+0000","last_clean":"2023-07-09T21:59:41.802741+0000","last_became_active":"2023-07-09T21:59:40.089198+0000","last_became_peered":"2023-07-09T21:59:40.089198+0000","last_unstale":"2023-07-09T21:59:41.802741+0000","last_undegraded":"2023-07-09T21:59:41.802741+0000","last_fullsized":"2023-07-09T21:59:41.802741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:09.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076103+0000","last_change":"2023-07-09T21:59:40.097661+0000","last_active":"2023-07-09T21:59:41.076103+0000","last_peered":"2023-07-09T21:59:41.076103+0000","last_clean":"2023-07-09T21:59:41.076103+0000","last_became_active":"2023-07-09T21:59:40.097053+0000","last_became_peered":"2023-07-09T21:59:40.097053+0000","last_unstale":"2023-07-09T21:59:41.076103+0000","last_undegraded":"2023-07-09T21:59:41.076103+0000","last_fullsized":"2023-07-09T21:59:41.076103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:33.694772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801283+0000","last_change":"2023-07-09T21:59:40.089629+0000","last_active":"2023-07-09T21:59:41.801283+0000","last_peered":"2023-07-09T21:59:41.801283+0000","last_clean":"2023-07-09T21:59:41.801283+0000","last_became_active":"2023-07-09T21:59:40.089356+0000","last_became_peered":"2023-07-09T21:59:40.089356+0000","last_unstale":"2023-07-09T21:59:41.801283+0000","last_undegraded":"2023-07-09T21:59:41.801283+0000","last_fullsized":"2023-07-09T21:59:41.801283+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:52:10.961423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802050+0000","last_change":"2023-07-09T21:59:40.083853+0000","last_active":"2023-07-09T21:59:41.802050+0000","last_peered":"2023-07-09T21:59:41.802050+0000","last_clean":"2023-07-09T21:59:41.802050+0000","last_became_active":"2023-07-09T21:59:40.083433+0000","last_became_peered":"2023-07-09T21:59:40.083433+0000","last_unstale":"2023-07-09T21:59:41.802050+0000","last_undegraded":"2023-07-09T21:59:41.802050+0000","last_fullsized":"2023-07-09T21:59:41.802050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:21.051819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076785+0000","last_change":"2023-07-09T21:59:40.083062+0000","last_active":"2023-07-09T21:59:41.076785+0000","last_peered":"2023-07-09T21:59:41.076785+0000","last_clean":"2023-07-09T21:59:41.076785+0000","last_became_active":"2023-07-09T21:59:40.082520+0000","last_became_peered":"2023-07-09T21:59:40.082520+0000","last_unstale":"2023-07-09T21:59:41.076785+0000","last_undegraded":"2023-07-09T21:59:41.076785+0000","last_fullsized":"2023-07-09T21:59:41.076785+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:46.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356174+0000","last_change":"2023-07-09T21:59:40.071795+0000","last_active":"2023-07-09T21:59:41.356174+0000","last_peered":"2023-07-09T21:59:41.356174+0000","last_clean":"2023-07-09T21:59:41.356174+0000","last_became_active":"2023-07-09T21:59:40.071149+0000","last_became_peered":"2023-07-09T21:59:40.071149+0000","last_unstale":"2023-07-09T21:59:41.356174+0000","last_undegraded":"2023-07-09T21:59:41.356174+0000","last_fullsized":"2023-07-09T21:59:41.356174+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:52.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751194+0000","last_change":"2023-07-09T21:59:40.095505+0000","last_active":"2023-07-09T21:59:41.751194+0000","last_peered":"2023-07-09T21:59:41.751194+0000","last_clean":"2023-07-09T21:59:41.751194+0000","last_became_active":"2023-07-09T21:59:40.095210+0000","last_became_peered":"2023-07-09T21:59:40.095210+0000","last_unstale":"2023-07-09T21:59:41.751194+0000","last_undegraded":"2023-07-09T21:59:41.751194+0000","last_fullsized":"2023-07-09T21:59:41.751194+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:29.919608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802480+0000","last_change":"2023-07-09T21:59:40.078869+0000","last_active":"2023-07-09T21:59:41.802480+0000","last_peered":"2023-07-09T21:59:41.802480+0000","last_clean":"2023-07-09T21:59:41.802480+0000","last_became_active":"2023-07-09T21:59:40.078557+0000","last_became_peered":"2023-07-09T21:59:40.078557+0000","last_unstale":"2023-07-09T21:59:41.802480+0000","last_undegraded":"2023-07-09T21:59:41.802480+0000","last_fullsized":"2023-07-09T21:59:41.802480+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:32:52.412005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802816+0000","last_change":"2023-07-09T21:59:40.089249+0000","last_active":"2023-07-09T21:59:41.802816+0000","last_peered":"2023-07-09T21:59:41.802816+0000","last_clean":"2023-07-09T21:59:41.802816+0000","last_became_active":"2023-07-09T21:59:40.088813+0000","last_became_peered":"2023-07-09T21:59:40.088813+0000","last_unstale":"2023-07-09T21:59:41.802816+0000","last_undegraded":"2023-07-09T21:59:41.802816+0000","last_fullsized":"2023-07-09T21:59:41.802816+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:33.958963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077784+0000","last_change":"2023-07-09T21:59:40.080894+0000","last_active":"2023-07-09T21:59:41.077784+0000","last_peered":"2023-07-09T21:59:41.077784+0000","last_clean":"2023-07-09T21:59:41.077784+0000","last_became_active":"2023-07-09T21:59:40.080081+0000","last_became_peered":"2023-07-09T21:59:40.080081+0000","last_unstale":"2023-07-09T21:59:41.077784+0000","last_undegraded":"2023-07-09T21:59:41.077784+0000","last_fullsized":"2023-07-09T21:59:41.077784+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:46.743994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076507+0000","last_change":"2023-07-09T21:59:40.078906+0000","last_active":"2023-07-09T21:59:41.076507+0000","last_peered":"2023-07-09T21:59:41.076507+0000","last_clean":"2023-07-09T21:59:41.076507+0000","last_became_active":"2023-07-09T21:59:40.078595+0000","last_became_peered":"2023-07-09T21:59:40.078595+0000","last_unstale":"2023-07-09T21:59:41.076507+0000","last_undegraded":"2023-07-09T21:59:41.076507+0000","last_fullsized":"2023-07-09T21:59:41.076507+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:18.527305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356167+0000","last_change":"2023-07-09T21:59:40.087722+0000","last_active":"2023-07-09T21:59:41.356167+0000","last_peered":"2023-07-09T21:59:41.356167+0000","last_clean":"2023-07-09T21:59:41.356167+0000","last_became_active":"2023-07-09T21:59:40.087448+0000","last_became_peered":"2023-07-09T21:59:40.087448+0000","last_unstale":"2023-07-09T21:59:41.356167+0000","last_undegraded":"2023-07-09T21:59:41.356167+0000","last_fullsized":"2023-07-09T21:59:41.356167+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:30:41.091609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078275+0000","last_change":"2023-07-09T21:59:40.073377+0000","last_active":"2023-07-09T21:59:41.078275+0000","last_peered":"2023-07-09T21:59:41.078275+0000","last_clean":"2023-07-09T21:59:41.078275+0000","last_became_active":"2023-07-09T21:59:40.073089+0000","last_became_peered":"2023-07-09T21:59:40.073089+0000","last_unstale":"2023-07-09T21:59:41.078275+0000","last_undegraded":"2023-07-09T21:59:41.078275+0000","last_fullsized":"2023-07-09T21:59:41.078275+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:35.001312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078422+0000","last_change":"2023-07-09T21:59:40.076986+0000","last_active":"2023-07-09T21:59:41.078422+0000","last_peered":"2023-07-09T21:59:41.078422+0000","last_clean":"2023-07-09T21:59:41.078422+0000","last_became_active":"2023-07-09T21:59:40.076311+0000","last_became_peered":"2023-07-09T21:59:40.076311+0000","last_unstale":"2023-07-09T21:59:41.078422+0000","last_undegraded":"2023-07-09T21:59:41.078422+0000","last_fullsized":"2023-07-09T21:59:41.078422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:41:58.387830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802299+0000","last_change":"2023-07-09T21:59:40.085922+0000","last_active":"2023-07-09T21:59:41.802299+0000","last_peered":"2023-07-09T21:59:41.802299+0000","last_clean":"2023-07-09T21:59:41.802299+0000","last_became_active":"2023-07-09T21:59:40.085582+0000","last_became_peered":"2023-07-09T21:59:40.085582+0000","last_unstale":"2023-07-09T21:59:41.802299+0000","last_undegraded":"2023-07-09T21:59:41.802299+0000","last_fullsized":"2023-07-09T21:59:41.802299+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:12:30.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356101+0000","last_change":"2023-07-09T21:59:40.077954+0000","last_active":"2023-07-09T21:59:41.356101+0000","last_peered":"2023-07-09T21:59:41.356101+0000","last_clean":"2023-07-09T21:59:41.356101+0000","last_became_active":"2023-07-09T21:59:40.077635+0000","last_became_peered":"2023-07-09T21:59:40.077635+0000","last_unstale":"2023-07-09T21:59:41.356101+0000","last_undegraded":"2023-07-09T21:59:41.356101+0000","last_fullsized":"2023-07-09T21:59:41.356101+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:46.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077301+0000","last_change":"2023-07-09T21:59:40.093737+0000","last_active":"2023-07-09T21:59:41.077301+0000","last_peered":"2023-07-09T21:59:41.077301+0000","last_clean":"2023-07-09T21:59:41.077301+0000","last_became_active":"2023-07-09T21:59:40.093205+0000","last_became_peered":"2023-07-09T21:59:40.093205+0000","last_unstale":"2023-07-09T21:59:41.077301+0000","last_undegraded":"2023-07-09T21:59:41.077301+0000","last_fullsized":"2023-07-09T21:59:41.077301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:30.392403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356003+0000","last_change":"2023-07-09T21:59:40.073941+0000","last_active":"2023-07-09T21:59:41.356003+0000","last_peered":"2023-07-09T21:59:41.356003+0000","last_clean":"2023-07-09T21:59:41.356003+0000","last_became_active":"2023-07-09T21:59:40.073642+0000","last_became_peered":"2023-07-09T21:59:40.073642+0000","last_unstale":"2023-07-09T21:59:41.356003+0000","last_undegraded":"2023-07-09T21:59:41.356003+0000","last_fullsized":"2023-07-09T21:59:41.356003+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:54.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802157+0000","last_change":"2023-07-09T21:59:40.083928+0000","last_active":"2023-07-09T21:59:41.802157+0000","last_peered":"2023-07-09T21:59:41.802157+0000","last_clean":"2023-07-09T21:59:41.802157+0000","last_became_active":"2023-07-09T21:59:40.083624+0000","last_became_peered":"2023-07-09T21:59:40.083624+0000","last_unstale":"2023-07-09T21:59:41.802157+0000","last_undegraded":"2023-07-09T21:59:41.802157+0000","last_fullsized":"2023-07-09T21:59:41.802157+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:02.109279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076614+0000","last_change":"2023-07-09T21:59:40.078169+0000","last_active":"2023-07-09T21:59:41.076614+0000","last_peered":"2023-07-09T21:59:41.076614+0000","last_clean":"2023-07-09T21:59:41.076614+0000","last_became_active":"2023-07-09T21:59:40.076897+0000","last_became_peered":"2023-07-09T21:59:40.076897+0000","last_unstale":"2023-07-09T21:59:41.076614+0000","last_undegraded":"2023-07-09T21:59:41.076614+0000","last_fullsized":"2023-07-09T21:59:41.076614+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:55.857703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801674+0000","last_change":"2023-07-09T21:59:40.090616+0000","last_active":"2023-07-09T21:59:41.801674+0000","last_peered":"2023-07-09T21:59:41.801674+0000","last_clean":"2023-07-09T21:59:41.801674+0000","last_became_active":"2023-07-09T21:59:40.090315+0000","last_became_peered":"2023-07-09T21:59:40.090315+0000","last_unstale":"2023-07-09T21:59:41.801674+0000","last_undegraded":"2023-07-09T21:59:41.801674+0000","last_fullsized":"2023-07-09T21:59:41.801674+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:13:57.978245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"175'4","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802418+0000","last_change":"2023-07-09T21:59:39.056361+0000","last_active":"2023-07-09T21:59:41.802418+0000","last_peered":"2023-07-09T21:59:41.802418+0000","last_clean":"2023-07-09T21:59:41.802418+0000","last_became_active":"2023-07-09T21:59:39.056052+0000","last_became_peered":"2023-07-09T21:59:39.056052+0000","last_unstale":"2023-07-09T21:59:41.802418+0000","last_undegraded":"2023-07-09T21:59:41.802418+0000","last_fullsized":"2023-07-09T21:59:41.802418+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:34:36.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801730+0000","last_change":"2023-07-09T21:59:40.087196+0000","last_active":"2023-07-09T21:59:41.801730+0000","last_peered":"2023-07-09T21:59:41.801730+0000","last_clean":"2023-07-09T21:59:41.801730+0000","last_became_active":"2023-07-09T21:59:40.086888+0000","last_became_peered":"2023-07-09T21:59:40.086888+0000","last_unstale":"2023-07-09T21:59:41.801730+0000","last_undegraded":"2023-07-09T21:59:41.801730+0000","last_fullsized":"2023-07-09T21:59:41.801730+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:03.713580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750817+0000","last_change":"2023-07-09T21:59:39.069622+0000","last_active":"2023-07-09T21:59:41.750817+0000","last_peered":"2023-07-09T21:59:41.750817+0000","last_clean":"2023-07-09T21:59:41.750817+0000","last_became_active":"2023-07-09T21:59:39.069069+0000","last_became_peered":"2023-07-09T21:59:39.069069+0000","last_unstale":"2023-07-09T21:59:41.750817+0000","last_undegraded":"2023-07-09T21:59:41.750817+0000","last_fullsized":"2023-07-09T21:59:41.750817+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:00:57.954431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077639+0000","last_change":"2023-07-09T21:59:40.075171+0000","last_active":"2023-07-09T21:59:41.077639+0000","last_peered":"2023-07-09T21:59:41.077639+0000","last_clean":"2023-07-09T21:59:41.077639+0000","last_became_active":"2023-07-09T21:59:40.074902+0000","last_became_peered":"2023-07-09T21:59:40.074902+0000","last_unstale":"2023-07-09T21:59:41.077639+0000","last_undegraded":"2023-07-09T21:59:41.077639+0000","last_fullsized":"2023-07-09T21:59:41.077639+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:56.029837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751060+0000","last_change":"2023-07-09T21:59:39.068983+0000","last_active":"2023-07-09T21:59:41.751060+0000","last_peered":"2023-07-09T21:59:41.751060+0000","last_clean":"2023-07-09T21:59:41.751060+0000","last_became_active":"2023-07-09T21:59:39.068685+0000","last_became_peered":"2023-07-09T21:59:39.068685+0000","last_unstale":"2023-07-09T21:59:41.751060+0000","last_undegraded":"2023-07-09T21:59:41.751060+0000","last_fullsized":"2023-07-09T21:59:41.751060+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:38.787737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750990+0000","last_change":"2023-07-09T21:59:40.085231+0000","last_active":"2023-07-09T21:59:41.750990+0000","last_peered":"2023-07-09T21:59:41.750990+0000","last_clean":"2023-07-09T21:59:41.750990+0000","last_became_active":"2023-07-09T21:59:40.084589+0000","last_became_peered":"2023-07-09T21:59:40.084589+0000","last_unstale":"2023-07-09T21:59:41.750990+0000","last_undegraded":"2023-07-09T21:59:41.750990+0000","last_fullsized":"2023-07-09T21:59:41.750990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:17.630444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802215+0000","last_change":"2023-07-09T21:59:39.065490+0000","last_active":"2023-07-09T21:59:41.802215+0000","last_peered":"2023-07-09T21:59:41.802215+0000","last_clean":"2023-07-09T21:59:41.802215+0000","last_became_active":"2023-07-09T21:59:39.065180+0000","last_became_peered":"2023-07-09T21:59:39.065180+0000","last_unstale":"2023-07-09T21:59:41.802215+0000","last_undegraded":"2023-07-09T21:59:41.802215+0000","last_fullsized":"2023-07-09T21:59:41.802215+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:35:49.675112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801908+0000","last_change":"2023-07-09T21:59:40.071026+0000","last_active":"2023-07-09T21:59:41.801908+0000","last_peered":"2023-07-09T21:59:41.801908+0000","last_clean":"2023-07-09T21:59:41.801908+0000","last_became_active":"2023-07-09T21:59:40.070745+0000","last_became_peered":"2023-07-09T21:59:40.070745+0000","last_unstale":"2023-07-09T21:59:41.801908+0000","last_undegraded":"2023-07-09T21:59:41.801908+0000","last_fullsized":"2023-07-09T21:59:41.801908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:08:15.089129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077397+0000","last_change":"2023-07-09T21:59:39.061460+0000","last_active":"2023-07-09T21:59:41.077397+0000","last_peered":"2023-07-09T21:59:41.077397+0000","last_clean":"2023-07-09T21:59:41.077397+0000","last_became_active":"2023-07-09T21:59:39.061102+0000","last_became_peered":"2023-07-09T21:59:39.061102+0000","last_unstale":"2023-07-09T21:59:41.077397+0000","last_undegraded":"2023-07-09T21:59:41.077397+0000","last_fullsized":"2023-07-09T21:59:41.077397+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:20.668622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.075826+0000","last_change":"2023-07-09T21:59:40.083056+0000","last_active":"2023-07-09T21:59:41.075826+0000","last_peered":"2023-07-09T21:59:41.075826+0000","last_clean":"2023-07-09T21:59:41.075826+0000","last_became_active":"2023-07-09T21:59:40.082647+0000","last_became_peered":"2023-07-09T21:59:40.082647+0000","last_unstale":"2023-07-09T21:59:41.075826+0000","last_undegraded":"2023-07-09T21:59:41.075826+0000","last_fullsized":"2023-07-09T21:59:41.075826+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:37.636637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802381+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:41.802381+0000","last_peered":"2023-07-09T21:59:41.802381+0000","last_clean":"2023-07-09T21:59:41.802381+0000","last_became_active":"2023-07-09T21:59:39.059606+0000","last_became_peered":"2023-07-09T21:59:39.059606+0000","last_unstale":"2023-07-09T21:59:41.802381+0000","last_undegraded":"2023-07-09T21:59:41.802381+0000","last_fullsized":"2023-07-09T21:59:41.802381+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:54.021043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801366+0000","last_change":"2023-07-09T21:59:40.077379+0000","last_active":"2023-07-09T21:59:41.801366+0000","last_peered":"2023-07-09T21:59:41.801366+0000","last_clean":"2023-07-09T21:59:41.801366+0000","last_became_active":"2023-07-09T21:59:40.077081+0000","last_became_peered":"2023-07-09T21:59:40.077081+0000","last_unstale":"2023-07-09T21:59:41.801366+0000","last_undegraded":"2023-07-09T21:59:41.801366+0000","last_fullsized":"2023-07-09T21:59:41.801366+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:18:29.010026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078318+0000","last_change":"2023-07-09T21:59:39.059613+0000","last_active":"2023-07-09T21:59:41.078318+0000","last_peered":"2023-07-09T21:59:41.078318+0000","last_clean":"2023-07-09T21:59:41.078318+0000","last_became_active":"2023-07-09T21:59:39.059312+0000","last_became_peered":"2023-07-09T21:59:39.059312+0000","last_unstale":"2023-07-09T21:59:41.078318+0000","last_undegraded":"2023-07-09T21:59:41.078318+0000","last_fullsized":"2023-07-09T21:59:41.078318+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:27:47.817632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078097+0000","last_change":"2023-07-09T21:59:40.072456+0000","last_active":"2023-07-09T21:59:41.078097+0000","last_peered":"2023-07-09T21:59:41.078097+0000","last_clean":"2023-07-09T21:59:41.078097+0000","last_became_active":"2023-07-09T21:59:40.072190+0000","last_became_peered":"2023-07-09T21:59:40.072190+0000","last_unstale":"2023-07-09T21:59:41.078097+0000","last_undegraded":"2023-07-09T21:59:41.078097+0000","last_fullsized":"2023-07-09T21:59:41.078097+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:44.926529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802133+0000","last_change":"2023-07-09T21:59:39.058431+0000","last_active":"2023-07-09T21:59:41.802133+0000","last_peered":"2023-07-09T21:59:41.802133+0000","last_clean":"2023-07-09T21:59:41.802133+0000","last_became_active":"2023-07-09T21:59:39.058114+0000","last_became_peered":"2023-07-09T21:59:39.058114+0000","last_unstale":"2023-07-09T21:59:41.802133+0000","last_undegraded":"2023-07-09T21:59:41.802133+0000","last_fullsized":"2023-07-09T21:59:41.802133+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:39.063500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750771+0000","last_change":"2023-07-09T21:59:40.089115+0000","last_active":"2023-07-09T21:59:41.750771+0000","last_peered":"2023-07-09T21:59:41.750771+0000","last_clean":"2023-07-09T21:59:41.750771+0000","last_became_active":"2023-07-09T21:59:40.088770+0000","last_became_peered":"2023-07-09T21:59:40.088770+0000","last_unstale":"2023-07-09T21:59:41.750771+0000","last_undegraded":"2023-07-09T21:59:41.750771+0000","last_fullsized":"2023-07-09T21:59:41.750771+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:31.315658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356052+0000","last_change":"2023-07-09T21:59:39.068870+0000","last_active":"2023-07-09T21:59:41.356052+0000","last_peered":"2023-07-09T21:59:41.356052+0000","last_clean":"2023-07-09T21:59:41.356052+0000","last_became_active":"2023-07-09T21:59:39.068548+0000","last_became_peered":"2023-07-09T21:59:39.068548+0000","last_unstale":"2023-07-09T21:59:41.356052+0000","last_undegraded":"2023-07-09T21:59:41.356052+0000","last_fullsized":"2023-07-09T21:59:41.356052+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:34.197028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751046+0000","last_change":"2023-07-09T21:59:40.095351+0000","last_active":"2023-07-09T21:59:41.751046+0000","last_peered":"2023-07-09T21:59:41.751046+0000","last_clean":"2023-07-09T21:59:41.751046+0000","last_became_active":"2023-07-09T21:59:40.095033+0000","last_became_peered":"2023-07-09T21:59:40.095033+0000","last_unstale":"2023-07-09T21:59:41.751046+0000","last_undegraded":"2023-07-09T21:59:41.751046+0000","last_fullsized":"2023-07-09T21:59:41.751046+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:16:32.125716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750839+0000","last_change":"2023-07-09T21:59:39.070672+0000","last_active":"2023-07-09T21:59:41.750839+0000","last_peered":"2023-07-09T21:59:41.750839+0000","last_clean":"2023-07-09T21:59:41.750839+0000","last_became_active":"2023-07-09T21:59:39.069356+0000","last_became_peered":"2023-07-09T21:59:39.069356+0000","last_unstale":"2023-07-09T21:59:41.750839+0000","last_undegraded":"2023-07-09T21:59:41.750839+0000","last_fullsized":"2023-07-09T21:59:41.750839+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:20:14.953468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078423+0000","last_change":"2023-07-09T21:59:40.089184+0000","last_active":"2023-07-09T21:59:41.078423+0000","last_peered":"2023-07-09T21:59:41.078423+0000","last_clean":"2023-07-09T21:59:41.078423+0000","last_became_active":"2023-07-09T21:59:40.088916+0000","last_became_peered":"2023-07-09T21:59:40.088916+0000","last_unstale":"2023-07-09T21:59:41.078423+0000","last_undegraded":"2023-07-09T21:59:41.078423+0000","last_fullsized":"2023-07-09T21:59:41.078423+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:39:17.103384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801861+0000","last_change":"2023-07-09T21:59:39.054129+0000","last_active":"2023-07-09T21:59:41.801861+0000","last_peered":"2023-07-09T21:59:41.801861+0000","last_clean":"2023-07-09T21:59:41.801861+0000","last_became_active":"2023-07-09T21:59:39.053847+0000","last_became_peered":"2023-07-09T21:59:39.053847+0000","last_unstale":"2023-07-09T21:59:41.801861+0000","last_undegraded":"2023-07-09T21:59:41.801861+0000","last_fullsized":"2023-07-09T21:59:41.801861+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:08:47.085699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078319+0000","last_change":"2023-07-09T21:59:40.080190+0000","last_active":"2023-07-09T21:59:41.078319+0000","last_peered":"2023-07-09T21:59:41.078319+0000","last_clean":"2023-07-09T21:59:41.078319+0000","last_became_active":"2023-07-09T21:59:40.077479+0000","last_became_peered":"2023-07-09T21:59:40.077479+0000","last_unstale":"2023-07-09T21:59:41.078319+0000","last_undegraded":"2023-07-09T21:59:41.078319+0000","last_fullsized":"2023-07-09T21:59:41.078319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:14.991606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076582+0000","last_change":"2023-07-09T21:59:39.066598+0000","last_active":"2023-07-09T21:59:41.076582+0000","last_peered":"2023-07-09T21:59:41.076582+0000","last_clean":"2023-07-09T21:59:41.076582+0000","last_became_active":"2023-07-09T21:59:39.066274+0000","last_became_peered":"2023-07-09T21:59:39.066274+0000","last_unstale":"2023-07-09T21:59:41.076582+0000","last_undegraded":"2023-07-09T21:59:41.076582+0000","last_fullsized":"2023-07-09T21:59:41.076582+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:01.102521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750458+0000","last_change":"2023-07-09T21:59:40.095937+0000","last_active":"2023-07-09T21:59:41.750458+0000","last_peered":"2023-07-09T21:59:41.750458+0000","last_clean":"2023-07-09T21:59:41.750458+0000","last_became_active":"2023-07-09T21:59:40.095129+0000","last_became_peered":"2023-07-09T21:59:40.095129+0000","last_unstale":"2023-07-09T21:59:41.750458+0000","last_undegraded":"2023-07-09T21:59:41.750458+0000","last_fullsized":"2023-07-09T21:59:41.750458+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:15.335993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801616+0000","last_change":"2023-07-09T21:59:39.065915+0000","last_active":"2023-07-09T21:59:41.801616+0000","last_peered":"2023-07-09T21:59:41.801616+0000","last_clean":"2023-07-09T21:59:41.801616+0000","last_became_active":"2023-07-09T21:59:39.065564+0000","last_became_peered":"2023-07-09T21:59:39.065564+0000","last_unstale":"2023-07-09T21:59:41.801616+0000","last_undegraded":"2023-07-09T21:59:41.801616+0000","last_fullsized":"2023-07-09T21:59:41.801616+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:25.849348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801433+0000","last_change":"2023-07-09T21:59:40.082551+0000","last_active":"2023-07-09T21:59:41.801433+0000","last_peered":"2023-07-09T21:59:41.801433+0000","last_clean":"2023-07-09T21:59:41.801433+0000","last_became_active":"2023-07-09T21:59:40.082288+0000","last_became_peered":"2023-07-09T21:59:40.082288+0000","last_unstale":"2023-07-09T21:59:41.801433+0000","last_undegraded":"2023-07-09T21:59:41.801433+0000","last_fullsized":"2023-07-09T21:59:41.801433+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:15.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077154+0000","last_change":"2023-07-09T21:59:39.061507+0000","last_active":"2023-07-09T21:59:41.077154+0000","last_peered":"2023-07-09T21:59:41.077154+0000","last_clean":"2023-07-09T21:59:41.077154+0000","last_became_active":"2023-07-09T21:59:39.061215+0000","last_became_peered":"2023-07-09T21:59:39.061215+0000","last_unstale":"2023-07-09T21:59:41.077154+0000","last_undegraded":"2023-07-09T21:59:41.077154+0000","last_fullsized":"2023-07-09T21:59:41.077154+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:29.268806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750664+0000","last_change":"2023-07-09T21:59:40.083566+0000","last_active":"2023-07-09T21:59:41.750664+0000","last_peered":"2023-07-09T21:59:41.750664+0000","last_clean":"2023-07-09T21:59:41.750664+0000","last_became_active":"2023-07-09T21:59:40.080378+0000","last_became_peered":"2023-07-09T21:59:40.080378+0000","last_unstale":"2023-07-09T21:59:41.750664+0000","last_undegraded":"2023-07-09T21:59:41.750664+0000","last_fullsized":"2023-07-09T21:59:41.750664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:45.674890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802282+0000","last_change":"2023-07-09T21:59:39.059503+0000","last_active":"2023-07-09T21:59:41.802282+0000","last_peered":"2023-07-09T21:59:41.802282+0000","last_clean":"2023-07-09T21:59:41.802282+0000","last_became_active":"2023-07-09T21:59:39.059214+0000","last_became_peered":"2023-07-09T21:59:39.059214+0000","last_unstale":"2023-07-09T21:59:41.802282+0000","last_undegraded":"2023-07-09T21:59:41.802282+0000","last_fullsized":"2023-07-09T21:59:41.802282+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:44.633879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801826+0000","last_change":"2023-07-09T21:59:40.087815+0000","last_active":"2023-07-09T21:59:41.801826+0000","last_peered":"2023-07-09T21:59:41.801826+0000","last_clean":"2023-07-09T21:59:41.801826+0000","last_became_active":"2023-07-09T21:59:40.087551+0000","last_became_peered":"2023-07-09T21:59:40.087551+0000","last_unstale":"2023-07-09T21:59:41.801826+0000","last_undegraded":"2023-07-09T21:59:41.801826+0000","last_fullsized":"2023-07-09T21:59:41.801826+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:26.208221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076981+0000","last_change":"2023-07-09T21:59:39.061861+0000","last_active":"2023-07-09T21:59:41.076981+0000","last_peered":"2023-07-09T21:59:41.076981+0000","last_clean":"2023-07-09T21:59:41.076981+0000","last_became_active":"2023-07-09T21:59:39.061558+0000","last_became_peered":"2023-07-09T21:59:39.061558+0000","last_unstale":"2023-07-09T21:59:41.076981+0000","last_undegraded":"2023-07-09T21:59:41.076981+0000","last_fullsized":"2023-07-09T21:59:41.076981+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:19.741367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802656+0000","last_change":"2023-07-09T21:59:40.085404+0000","last_active":"2023-07-09T21:59:41.802656+0000","last_peered":"2023-07-09T21:59:41.802656+0000","last_clean":"2023-07-09T21:59:41.802656+0000","last_became_active":"2023-07-09T21:59:40.084305+0000","last_became_peered":"2023-07-09T21:59:40.084305+0000","last_unstale":"2023-07-09T21:59:41.802656+0000","last_undegraded":"2023-07-09T21:59:41.802656+0000","last_fullsized":"2023-07-09T21:59:41.802656+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:08:56.600006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076784+0000","last_change":"2023-07-09T21:59:39.064293+0000","last_active":"2023-07-09T21:59:41.076784+0000","last_peered":"2023-07-09T21:59:41.076784+0000","last_clean":"2023-07-09T21:59:41.076784+0000","last_became_active":"2023-07-09T21:59:39.064014+0000","last_became_peered":"2023-07-09T21:59:39.064014+0000","last_unstale":"2023-07-09T21:59:41.076784+0000","last_undegraded":"2023-07-09T21:59:41.076784+0000","last_fullsized":"2023-07-09T21:59:41.076784+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:19.574875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076534+0000","last_change":"2023-07-09T21:59:40.087825+0000","last_active":"2023-07-09T21:59:41.076534+0000","last_peered":"2023-07-09T21:59:41.076534+0000","last_clean":"2023-07-09T21:59:41.076534+0000","last_became_active":"2023-07-09T21:59:40.087311+0000","last_became_peered":"2023-07-09T21:59:40.087311+0000","last_unstale":"2023-07-09T21:59:41.076534+0000","last_undegraded":"2023-07-09T21:59:41.076534+0000","last_fullsized":"2023-07-09T21:59:41.076534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:40.070257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078623+0000","last_change":"2023-07-09T21:59:39.062851+0000","last_active":"2023-07-09T21:59:41.078623+0000","last_peered":"2023-07-09T21:59:41.078623+0000","last_clean":"2023-07-09T21:59:41.078623+0000","last_became_active":"2023-07-09T21:59:39.062560+0000","last_became_peered":"2023-07-09T21:59:39.062560+0000","last_unstale":"2023-07-09T21:59:41.078623+0000","last_undegraded":"2023-07-09T21:59:41.078623+0000","last_fullsized":"2023-07-09T21:59:41.078623+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:59:45.877088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078597+0000","last_change":"2023-07-09T21:59:40.071571+0000","last_active":"2023-07-09T21:59:41.078597+0000","last_peered":"2023-07-09T21:59:41.078597+0000","last_clean":"2023-07-09T21:59:41.078597+0000","last_became_active":"2023-07-09T21:59:40.070482+0000","last_became_peered":"2023-07-09T21:59:40.070482+0000","last_unstale":"2023-07-09T21:59:41.078597+0000","last_undegraded":"2023-07-09T21:59:41.078597+0000","last_fullsized":"2023-07-09T21:59:41.078597+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:08.289643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801967+0000","last_change":"2023-07-09T21:59:39.060698+0000","last_active":"2023-07-09T21:59:41.801967+0000","last_peered":"2023-07-09T21:59:41.801967+0000","last_clean":"2023-07-09T21:59:41.801967+0000","last_became_active":"2023-07-09T21:59:39.060367+0000","last_became_peered":"2023-07-09T21:59:39.060367+0000","last_unstale":"2023-07-09T21:59:41.801967+0000","last_undegraded":"2023-07-09T21:59:41.801967+0000","last_fullsized":"2023-07-09T21:59:41.801967+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:11:35.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802200+0000","last_change":"2023-07-09T21:59:40.088088+0000","last_active":"2023-07-09T21:59:41.802200+0000","last_peered":"2023-07-09T21:59:41.802200+0000","last_clean":"2023-07-09T21:59:41.802200+0000","last_became_active":"2023-07-09T21:59:40.087808+0000","last_became_peered":"2023-07-09T21:59:40.087808+0000","last_unstale":"2023-07-09T21:59:41.802200+0000","last_undegraded":"2023-07-09T21:59:41.802200+0000","last_fullsized":"2023-07-09T21:59:41.802200+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:20.581633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802673+0000","last_change":"2023-07-09T21:59:39.066091+0000","last_active":"2023-07-09T21:59:41.802673+0000","last_peered":"2023-07-09T21:59:41.802673+0000","last_clean":"2023-07-09T21:59:41.802673+0000","last_became_active":"2023-07-09T21:59:39.065700+0000","last_became_peered":"2023-07-09T21:59:39.065700+0000","last_unstale":"2023-07-09T21:59:41.802673+0000","last_undegraded":"2023-07-09T21:59:41.802673+0000","last_fullsized":"2023-07-09T21:59:41.802673+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:59:39.343689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076877+0000","last_change":"2023-07-09T21:59:40.072644+0000","last_active":"2023-07-09T21:59:41.076877+0000","last_peered":"2023-07-09T21:59:41.076877+0000","last_clean":"2023-07-09T21:59:41.076877+0000","last_became_active":"2023-07-09T21:59:40.072377+0000","last_became_peered":"2023-07-09T21:59:40.072377+0000","last_unstale":"2023-07-09T21:59:41.076877+0000","last_undegraded":"2023-07-09T21:59:41.076877+0000","last_fullsized":"2023-07-09T21:59:41.076877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:07.167578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077803+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:41.077803+0000","last_peered":"2023-07-09T21:59:41.077803+0000","last_clean":"2023-07-09T21:59:41.077803+0000","last_became_active":"2023-07-09T21:59:39.059591+0000","last_became_peered":"2023-07-09T21:59:39.059591+0000","last_unstale":"2023-07-09T21:59:41.077803+0000","last_undegraded":"2023-07-09T21:59:41.077803+0000","last_fullsized":"2023-07-09T21:59:41.077803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:04:36.575312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.075906+0000","last_change":"2023-07-09T21:59:40.087587+0000","last_active":"2023-07-09T21:59:41.075906+0000","last_peered":"2023-07-09T21:59:41.075906+0000","last_clean":"2023-07-09T21:59:41.075906+0000","last_became_active":"2023-07-09T21:59:40.087263+0000","last_became_peered":"2023-07-09T21:59:40.087263+0000","last_unstale":"2023-07-09T21:59:41.075906+0000","last_undegraded":"2023-07-09T21:59:41.075906+0000","last_fullsized":"2023-07-09T21:59:41.075906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:34:23.416680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356205+0000","last_change":"2023-07-09T21:59:39.062994+0000","last_active":"2023-07-09T21:59:41.356205+0000","last_peered":"2023-07-09T21:59:41.356205+0000","last_clean":"2023-07-09T21:59:41.356205+0000","last_became_active":"2023-07-09T21:59:39.062749+0000","last_became_peered":"2023-07-09T21:59:39.062749+0000","last_unstale":"2023-07-09T21:59:41.356205+0000","last_undegraded":"2023-07-09T21:59:41.356205+0000","last_fullsized":"2023-07-09T21:59:41.356205+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:11:53.949787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801514+0000","last_change":"2023-07-09T21:59:40.092092+0000","last_active":"2023-07-09T21:59:41.801514+0000","last_peered":"2023-07-09T21:59:41.801514+0000","last_clean":"2023-07-09T21:59:41.801514+0000","last_became_active":"2023-07-09T21:59:40.091742+0000","last_became_peered":"2023-07-09T21:59:40.091742+0000","last_unstale":"2023-07-09T21:59:41.801514+0000","last_undegraded":"2023-07-09T21:59:41.801514+0000","last_fullsized":"2023-07-09T21:59:41.801514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:27:40.996205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078469+0000","last_change":"2023-07-09T21:59:39.059053+0000","last_active":"2023-07-09T21:59:41.078469+0000","last_peered":"2023-07-09T21:59:41.078469+0000","last_clean":"2023-07-09T21:59:41.078469+0000","last_became_active":"2023-07-09T21:59:39.058548+0000","last_became_peered":"2023-07-09T21:59:39.058548+0000","last_unstale":"2023-07-09T21:59:41.078469+0000","last_undegraded":"2023-07-09T21:59:41.078469+0000","last_fullsized":"2023-07-09T21:59:41.078469+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:07.468486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077245+0000","last_change":"2023-07-09T21:59:40.093513+0000","last_active":"2023-07-09T21:59:41.077245+0000","last_peered":"2023-07-09T21:59:41.077245+0000","last_clean":"2023-07-09T21:59:41.077245+0000","last_became_active":"2023-07-09T21:59:40.092818+0000","last_became_peered":"2023-07-09T21:59:40.092818+0000","last_unstale":"2023-07-09T21:59:41.077245+0000","last_undegraded":"2023-07-09T21:59:41.077245+0000","last_fullsized":"2023-07-09T21:59:41.077245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:55.948174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750774+0000","last_change":"2023-07-09T21:59:39.068790+0000","last_active":"2023-07-09T21:59:41.750774+0000","last_peered":"2023-07-09T21:59:41.750774+0000","last_clean":"2023-07-09T21:59:41.750774+0000","last_became_active":"2023-07-09T21:59:39.068499+0000","last_became_peered":"2023-07-09T21:59:39.068499+0000","last_unstale":"2023-07-09T21:59:41.750774+0000","last_undegraded":"2023-07-09T21:59:41.750774+0000","last_fullsized":"2023-07-09T21:59:41.750774+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:27.749034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077794+0000","last_change":"2023-07-09T21:59:40.081677+0000","last_active":"2023-07-09T21:59:41.077794+0000","last_peered":"2023-07-09T21:59:41.077794+0000","last_clean":"2023-07-09T21:59:41.077794+0000","last_became_active":"2023-07-09T21:59:40.081350+0000","last_became_peered":"2023-07-09T21:59:40.081350+0000","last_unstale":"2023-07-09T21:59:41.077794+0000","last_undegraded":"2023-07-09T21:59:41.077794+0000","last_fullsized":"2023-07-09T21:59:41.077794+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:01.906420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"175'6","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802340+0000","last_change":"2023-07-09T21:59:39.064156+0000","last_active":"2023-07-09T21:59:41.802340+0000","last_peered":"2023-07-09T21:59:41.802340+0000","last_clean":"2023-07-09T21:59:41.802340+0000","last_became_active":"2023-07-09T21:59:39.063822+0000","last_became_peered":"2023-07-09T21:59:39.063822+0000","last_unstale":"2023-07-09T21:59:41.802340+0000","last_undegraded":"2023-07-09T21:59:41.802340+0000","last_fullsized":"2023-07-09T21:59:41.802340+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:36.607763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"163'304","reported_seq":1116,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750941+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:59:41.750941+0000","last_peered":"2023-07-09T21:59:41.750941+0000","last_clean":"2023-07-09T21:59:41.750941+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:59:41.750941+0000","last_undegraded":"2023-07-09T21:59:41.750941+0000","last_fullsized":"2023-07-09T21:59:41.750941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:07:26.670822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":342,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077942+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:59:41.077942+0000","last_peered":"2023-07-09T21:59:41.077942+0000","last_clean":"2023-07-09T21:59:41.077942+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:59:41.077942+0000","last_undegraded":"2023-07-09T21:59:41.077942+0000","last_fullsized":"2023-07-09T21:59:41.077942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:13:38.850298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077411+0000","last_change":"2023-07-09T21:59:40.080635+0000","last_active":"2023-07-09T21:59:41.077411+0000","last_peered":"2023-07-09T21:59:41.077411+0000","last_clean":"2023-07-09T21:59:41.077411+0000","last_became_active":"2023-07-09T21:59:40.080360+0000","last_became_peered":"2023-07-09T21:59:40.080360+0000","last_unstale":"2023-07-09T21:59:41.077411+0000","last_undegraded":"2023-07-09T21:59:41.077411+0000","last_fullsized":"2023-07-09T21:59:41.077411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:55.655884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751105+0000","last_change":"2023-07-09T21:59:39.070215+0000","last_active":"2023-07-09T21:59:41.751105+0000","last_peered":"2023-07-09T21:59:41.751105+0000","last_clean":"2023-07-09T21:59:41.751105+0000","last_became_active":"2023-07-09T21:59:39.069951+0000","last_became_peered":"2023-07-09T21:59:39.069951+0000","last_unstale":"2023-07-09T21:59:41.751105+0000","last_undegraded":"2023-07-09T21:59:41.751105+0000","last_fullsized":"2023-07-09T21:59:41.751105+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:28:37.792116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":297,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750728+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:59:41.750728+0000","last_peered":"2023-07-09T21:59:41.750728+0000","last_clean":"2023-07-09T21:59:41.750728+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:59:41.750728+0000","last_undegraded":"2023-07-09T21:59:41.750728+0000","last_fullsized":"2023-07-09T21:59:41.750728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:04:46.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356195+0000","last_change":"2023-07-09T21:59:40.077013+0000","last_active":"2023-07-09T21:59:41.356195+0000","last_peered":"2023-07-09T21:59:41.356195+0000","last_clean":"2023-07-09T21:59:41.356195+0000","last_became_active":"2023-07-09T21:59:40.076727+0000","last_became_peered":"2023-07-09T21:59:40.076727+0000","last_unstale":"2023-07-09T21:59:41.356195+0000","last_undegraded":"2023-07-09T21:59:41.356195+0000","last_fullsized":"2023-07-09T21:59:41.356195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:26.427664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078697+0000","last_change":"2023-07-09T21:59:39.058851+0000","last_active":"2023-07-09T21:59:41.078697+0000","last_peered":"2023-07-09T21:59:41.078697+0000","last_clean":"2023-07-09T21:59:41.078697+0000","last_became_active":"2023-07-09T21:59:39.058567+0000","last_became_peered":"2023-07-09T21:59:39.058567+0000","last_unstale":"2023-07-09T21:59:41.078697+0000","last_undegraded":"2023-07-09T21:59:41.078697+0000","last_fullsized":"2023-07-09T21:59:41.078697+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:19.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":290,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.355952+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:59:41.355952+0000","last_peered":"2023-07-09T21:59:41.355952+0000","last_clean":"2023-07-09T21:59:41.355952+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:59:41.355952+0000","last_undegraded":"2023-07-09T21:59:41.355952+0000","last_fullsized":"2023-07-09T21:59:41.355952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:05.004769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356237+0000","last_change":"2023-07-09T21:59:40.071980+0000","last_active":"2023-07-09T21:59:41.356237+0000","last_peered":"2023-07-09T21:59:41.356237+0000","last_clean":"2023-07-09T21:59:41.356237+0000","last_became_active":"2023-07-09T21:59:40.071435+0000","last_became_peered":"2023-07-09T21:59:40.071435+0000","last_unstale":"2023-07-09T21:59:41.356237+0000","last_undegraded":"2023-07-09T21:59:41.356237+0000","last_fullsized":"2023-07-09T21:59:41.356237+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:43.236238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"175'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356314+0000","last_change":"2023-07-09T21:59:39.048558+0000","last_active":"2023-07-09T21:59:41.356314+0000","last_peered":"2023-07-09T21:59:41.356314+0000","last_clean":"2023-07-09T21:59:41.356314+0000","last_became_active":"2023-07-09T21:59:39.048275+0000","last_became_peered":"2023-07-09T21:59:39.048275+0000","last_unstale":"2023-07-09T21:59:41.356314+0000","last_undegraded":"2023-07-09T21:59:41.356314+0000","last_fullsized":"2023-07-09T21:59:41.356314+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:54:53.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":342,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077817+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:59:41.077817+0000","last_peered":"2023-07-09T21:59:41.077817+0000","last_clean":"2023-07-09T21:59:41.077817+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:59:41.077817+0000","last_undegraded":"2023-07-09T21:59:41.077817+0000","last_fullsized":"2023-07-09T21:59:41.077817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:02.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076744+0000","last_change":"2023-07-09T21:59:40.079761+0000","last_active":"2023-07-09T21:59:41.076744+0000","last_peered":"2023-07-09T21:59:41.076744+0000","last_clean":"2023-07-09T21:59:41.076744+0000","last_became_active":"2023-07-09T21:59:40.077817+0000","last_became_peered":"2023-07-09T21:59:40.077817+0000","last_unstale":"2023-07-09T21:59:41.076744+0000","last_undegraded":"2023-07-09T21:59:41.076744+0000","last_fullsized":"2023-07-09T21:59:41.076744+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:41:50.001117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802938+0000","last_change":"2023-07-09T21:59:39.056568+0000","last_active":"2023-07-09T21:59:41.802938+0000","last_peered":"2023-07-09T21:59:41.802938+0000","last_clean":"2023-07-09T21:59:41.802938+0000","last_became_active":"2023-07-09T21:59:39.056167+0000","last_became_peered":"2023-07-09T21:59:39.056167+0000","last_unstale":"2023-07-09T21:59:41.802938+0000","last_undegraded":"2023-07-09T21:59:41.802938+0000","last_fullsized":"2023-07-09T21:59:41.802938+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:09.053047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801919+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:59:41.801919+0000","last_peered":"2023-07-09T21:59:41.801919+0000","last_clean":"2023-07-09T21:59:41.801919+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:59:41.801919+0000","last_undegraded":"2023-07-09T21:59:41.801919+0000","last_fullsized":"2023-07-09T21:59:41.801919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:33:57.949327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801277+0000","last_change":"2023-07-09T21:59:40.088379+0000","last_active":"2023-07-09T21:59:41.801277+0000","last_peered":"2023-07-09T21:59:41.801277+0000","last_clean":"2023-07-09T21:59:41.801277+0000","last_became_active":"2023-07-09T21:59:40.088112+0000","last_became_peered":"2023-07-09T21:59:40.088112+0000","last_unstale":"2023-07-09T21:59:41.801277+0000","last_undegraded":"2023-07-09T21:59:41.801277+0000","last_fullsized":"2023-07-09T21:59:41.801277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:59.570055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076229+0000","last_change":"2023-07-09T21:59:39.066863+0000","last_active":"2023-07-09T21:59:41.076229+0000","last_peered":"2023-07-09T21:59:41.076229+0000","last_clean":"2023-07-09T21:59:41.076229+0000","last_became_active":"2023-07-09T21:59:39.066027+0000","last_became_peered":"2023-07-09T21:59:39.066027+0000","last_unstale":"2023-07-09T21:59:41.076229+0000","last_undegraded":"2023-07-09T21:59:41.076229+0000","last_fullsized":"2023-07-09T21:59:41.076229+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:36:23.465660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":296,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751188+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:59:41.751188+0000","last_peered":"2023-07-09T21:59:41.751188+0000","last_clean":"2023-07-09T21:59:41.751188+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:59:41.751188+0000","last_undegraded":"2023-07-09T21:59:41.751188+0000","last_fullsized":"2023-07-09T21:59:41.751188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:18.451690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802375+0000","last_change":"2023-07-09T21:59:40.093570+0000","last_active":"2023-07-09T21:59:41.802375+0000","last_peered":"2023-07-09T21:59:41.802375+0000","last_clean":"2023-07-09T21:59:41.802375+0000","last_became_active":"2023-07-09T21:59:40.092915+0000","last_became_peered":"2023-07-09T21:59:40.092915+0000","last_unstale":"2023-07-09T21:59:41.802375+0000","last_undegraded":"2023-07-09T21:59:41.802375+0000","last_fullsized":"2023-07-09T21:59:41.802375+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:33:49.109846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076006+0000","last_change":"2023-07-09T21:59:39.059472+0000","last_active":"2023-07-09T21:59:41.076006+0000","last_peered":"2023-07-09T21:59:41.076006+0000","last_clean":"2023-07-09T21:59:41.076006+0000","last_became_active":"2023-07-09T21:59:39.059185+0000","last_became_peered":"2023-07-09T21:59:39.059185+0000","last_unstale":"2023-07-09T21:59:41.076006+0000","last_undegraded":"2023-07-09T21:59:41.076006+0000","last_fullsized":"2023-07-09T21:59:41.076006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:38:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":290,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801813+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:59:41.801813+0000","last_peered":"2023-07-09T21:59:41.801813+0000","last_clean":"2023-07-09T21:59:41.801813+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:59:41.801813+0000","last_undegraded":"2023-07-09T21:59:41.801813+0000","last_fullsized":"2023-07-09T21:59:41.801813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:34.160096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801647+0000","last_change":"2023-07-09T21:59:40.092762+0000","last_active":"2023-07-09T21:59:41.801647+0000","last_peered":"2023-07-09T21:59:41.801647+0000","last_clean":"2023-07-09T21:59:41.801647+0000","last_became_active":"2023-07-09T21:59:40.092431+0000","last_became_peered":"2023-07-09T21:59:40.092431+0000","last_unstale":"2023-07-09T21:59:41.801647+0000","last_undegraded":"2023-07-09T21:59:41.801647+0000","last_fullsized":"2023-07-09T21:59:41.801647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:44.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"175'8","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077042+0000","last_change":"2023-07-09T21:59:39.062972+0000","last_active":"2023-07-09T21:59:41.077042+0000","last_peered":"2023-07-09T21:59:41.077042+0000","last_clean":"2023-07-09T21:59:41.077042+0000","last_became_active":"2023-07-09T21:59:39.062692+0000","last_became_peered":"2023-07-09T21:59:39.062692+0000","last_unstale":"2023-07-09T21:59:41.077042+0000","last_undegraded":"2023-07-09T21:59:41.077042+0000","last_fullsized":"2023-07-09T21:59:41.077042+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:34.067163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076863+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:59:41.076863+0000","last_peered":"2023-07-09T21:59:41.076863+0000","last_clean":"2023-07-09T21:59:41.076863+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:59:41.076863+0000","last_undegraded":"2023-07-09T21:59:41.076863+0000","last_fullsized":"2023-07-09T21:59:41.076863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:16.110542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575292,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47728,"kb_used_data":2728,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94324112,"statfs":{"total":96636764160,"available":96587890688,"internally_reserved":0,"allocated":2793472,"data_stored":1719719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.41599999999999998},"max":{"1min":0.98699999999999999,"5min":0.99299999999999999,"15min":1.0169999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96499999999999997,"5min":1.028,"15min":1.0309999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":1.04,"15min":1.0660000000000001},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0740000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.621,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.004,"5min":1.0289999999999999,"15min":1.038},"last":0.623},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.63700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.78400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.077},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.749},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834575291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2199552,"data_stored":1129399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.075,"15min":1.075},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.04},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89600000000000002,"5min":0.98199999999999998,"15min":1.177},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":1.1200000000000001,"15min":1.1890000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.50600000000000001,"15min":0.503},"max":{"1min":0.96499999999999997,"5min":1.504,"15min":1.504},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.436},"max":{"1min":0.878,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.52200000000000002,"15min":0.51400000000000001},"max":{"1min":0.90800000000000003,"5min":1.02,"15min":1.026},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54000000000000004},"max":{"1min":1.0049999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":1.161,"15min":1.161},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.05,"15min":1.099},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.95899999999999996,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.077},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2195456,"data_stored":1129329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.012,"15min":1.012},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.97999999999999998,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":1.05},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.046,"5min":1.095,"15min":1.095},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.49299999999999999},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.034},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.379},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.748}]},{"osd":7,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.41799999999999998},"max":{"1min":1.056,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":0.93400000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575292,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37300,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334540,"statfs":{"total":96636764160,"available":96598568960,"internally_reserved":0,"allocated":2207744,"data_stored":1130893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.745,"15min":0.747},"min":{"1min":0.61199999999999999,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.499,"15min":0.43099999999999999},"max":{"1min":0.86499999999999999,"5min":0.95499999999999996,"15min":0.98299999999999998},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89900000000000002,"5min":0.998,"15min":1.119},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.91400000000000003,"5min":1.0800000000000001,"15min":1.2},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":0.93999999999999995,"5min":1.03,"15min":1.0669999999999999},"last":0.876}]},{"osd":3,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51300000000000001},"max":{"1min":0.92700000000000005,"5min":1.016,"15min":1.016},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.006,"5min":1.038,"15min":1.1599999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.079},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73599999999999999,"5min":0.96499999999999997,"15min":1.018},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.97699999999999998,"5min":1.069,"15min":1.069},"last":0.91300000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":1.028,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.91200000000000003,"5min":1.0389999999999999,"15min":1.044},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575291,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37296,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334544,"statfs":{"total":96636764160,"available":96598573056,"internally_reserved":0,"allocated":2203648,"data_stored":1129945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.315},"max":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":1.113},"last":0.495}]},{"osd":1,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":1.133},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":1.0149999999999999,"15min":1.194},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.135,"5min":1.1379999999999999,"15min":1.5429999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.5649999999999999},"last":0.747}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1479999999999999,"15min":1.302},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.101,"5min":1.1879999999999999,"15min":1.262},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.161,"15min":1.363},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.2070000000000001,"15min":1.601},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575292,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316496,"statfs":{"total":96636764160,"available":96580091904,"internally_reserved":0,"allocated":2203648,"data_stored":1129441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.61299999999999999,"5min":0.72199999999999998,"15min":0.96499999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.85099999999999998},"last":0.68000000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":0.77200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.65600000000000003,"5min":0.76300000000000001,"15min":0.99399999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":1.016},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.2290000000000001},"last":0.72599999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.117,"15min":1.337},"last":1.022},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.69899999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.306},"last":0.88200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.66500000000000004,"5min":0.624,"15min":0.57699999999999996},"max":{"1min":1.276,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.56799999999999995,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.1739999999999999,"15min":1.375},"last":0.94699999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.2529999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.294},"last":1.0669999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.115,"5min":1.2809999999999999,"15min":1.298},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.746,"5min":0.624,"15min":0.61399999999999999},"max":{"1min":1.1180000000000001,"5min":1.196,"15min":1.256},"last":1.0549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575292,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2199552,"data_stored":1129399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80600000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.63100000000000001,"5min":0.72599999999999998,"15min":0.81799999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"max":{"1min":1.024,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.70899999999999996,"5min":0.56000000000000005,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.2769999999999999,"15min":1.337},"last":0.85299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55100000000000005,"15min":0.48899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1160000000000001},"last":0.754},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.099,"5min":1.157,"15min":1.1659999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93300000000000005,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.0640000000000001,"5min":1.321,"15min":1.321},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41988,"kb_used_data":2748,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329852,"statfs":{"total":96636764160,"available":96593768448,"internally_reserved":0,"allocated":2813952,"data_stored":1721967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.73599999999999999,"15min":0.89300000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65400000000000003,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.627}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.81100000000000005,"15min":0.80400000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91000000000000003,"5min":1.306,"15min":1.306},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88600000000000001,"5min":1.1839999999999999,"15min":1.3600000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.81200000000000006},"min":{"1min":0.624,"5min":0.503,"15min":0.503},"max":{"1min":0.93200000000000005,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.82399999999999995},"min":{"1min":0.65500000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.879}]},{"osd":6,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":0.92400000000000004,"5min":1.3260000000000001,"15min":1.381},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.67700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.1739999999999999,"15min":1.1990000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"max":{"1min":0.873,"5min":1.2470000000000001,"15min":1.3400000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.397,"15min":1.397},"last":0.94699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:59:48.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T21:59:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.947+0000 7fefeabdb640 1 Processor -- start 2023-07-09T21:59:48.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.947+0000 7fefeabdb640 1 -- start start 2023-07-09T21:59:48.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefeabdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fefe40cef80 0x7fefe406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefeabdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40b49f0 con 0x7fefe40b4340 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefeabdb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40cc8a0 con 0x7fefe40b7ab0 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefeabdb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40b7e80 con 0x7fefe40cef80 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fefe40b4340 0x7fefe40d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54754/0 (socket says 172.21.15.37:54754) 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe3fff640 1 -- 172.21.15.37:0/3552271230 learned_addr learned my addr 172.21.15.37:0/3552271230 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:48.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe9178640 1 --2- 172.21.15.37:0/3552271230 >> v2:172.21.15.37:3300/0 conn(0x7fefe40cef80 0x7fefe406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe37fe640 1 -- 172.21.15.37:0/3552271230 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 837100720 0 0) 0x7fefe40b49f0 con 0x7fefe40b4340 2023-07-09T21:59:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe37fe640 1 -- 172.21.15.37:0/3552271230 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd4003530 con 0x7fefe40b4340 2023-07-09T21:59:48.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe9178640 1 -- 172.21.15.37:0/3552271230 >> v1:172.21.15.119:6789/0 conn(0x7fefe40b7ab0 legacy=0x7fefe40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe9178640 1 -- 172.21.15.37:0/3552271230 >> v1:172.21.15.37:6789/0 conn(0x7fefe40b4340 legacy=0x7fefe40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:48.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.951+0000 7fefe9178640 1 -- 172.21.15.37:0/3552271230 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40ccb80 con 0x7fefe40cef80 2023-07-09T21:59:48.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefe9178640 1 --2- 172.21.15.37:0/3552271230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40cef80 0x7fefe406aa50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009d90 tx=0x7fefdc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c626cb26a12ec85f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefe37fe640 1 -- 172.21.15.37:0/3552271230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0a59e0 con 0x7fefe40cef80 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefe37fe640 1 -- 172.21.15.37:0/3552271230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc0a5b40 con 0x7fefe40cef80 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefe37fe640 1 -- 172.21.15.37:0/3552271230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0ad440 con 0x7fefe40cef80 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- 172.21.15.37:0/3552271230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40cef80 msgr2=0x7fefe406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 --2- 172.21.15.37:0/3552271230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40cef80 0x7fefe406aa50 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fefdc009d90 tx=0x7fefdc01c920 comp rx=0 tx=0).stop 2023-07-09T21:59:48.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- 172.21.15.37:0/3552271230 shutdown_connections 2023-07-09T21:59:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 --2- 172.21.15.37:0/3552271230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40cef80 0x7fefe406aa50 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- 172.21.15.37:0/3552271230 >> 172.21.15.37:0/3552271230 conn(0x7fefe4073090 msgr2=0x7fefe4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- 172.21.15.37:0/3552271230 shutdown_connections 2023-07-09T21:59:48.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- 172.21.15.37:0/3552271230 wait complete. 2023-07-09T21:59:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 Processor -- start 2023-07-09T21:59:48.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.955+0000 7fefeabdb640 1 -- start start 2023-07-09T21:59:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 0x7fefe40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 0x7fefe414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:48.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c9320 con 0x7fefe40b7ab0 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe414c780 con 0x7fefe40cef80 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe41f4b20 con 0x7fefe40b4340 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46602/0 (socket says 172.21.15.37:46602) 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 -- 172.21.15.37:0/2006216053 learned_addr learned my addr 172.21.15.37:0/2006216053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe8977640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 0x7fefe40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:48.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe9178640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 0x7fefe414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 -- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 msgr2=0x7fefe40b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 0x7fefe40b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 -- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 msgr2=0x7fefe414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 0x7fefe414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 -- 172.21.15.37:0/2006216053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefdc009a70 con 0x7fefe40b7ab0 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe8977640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 0x7fefe40b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:48.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe9178640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 0x7fefe414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe3fff640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001ec0 tx=0x7fefd000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0005d50 con 0x7fefe40b7ab0 2023-07-09T21:59:48.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0007070 con 0x7fefe40b7ab0 2023-07-09T21:59:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0007420 con 0x7fefe40b7ab0 2023-07-09T21:59:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40c95c0 con 0x7fefe40b7ab0 2023-07-09T21:59:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe41f4e00 con 0x7fefe40b7ab0 2023-07-09T21:59:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40c9ae0 con 0x7fefe40b7ab0 2023-07-09T21:59:48.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.959+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fefd0007580 con 0x7fefe40b7ab0 2023-07-09T21:59:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.963+0000 7fefe17fa640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 0x7fefc8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.963+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fefd0082ff0 con 0x7fefe40b7ab0 2023-07-09T21:59:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.963+0000 7fefe8977640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 0x7fefc8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:48.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.963+0000 7fefe8977640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 0x7fefc8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000f70 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:48.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:48.967+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fefd00b3700 con 0x7fefe40b7ab0 2023-07-09T21:59:49.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.119+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefe40b41d0 con 0x7fefc80663a0 2023-07-09T21:59:49.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.131+0000 7fefe17fa640 1 -- 172.21.15.37:0/2006216053 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311552 (secure 0 0 0) 0x7fefe40b41d0 con 0x7fefc80663a0 2023-07-09T21:59:49.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:49.138 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T21:59:49.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 msgr2=0x7fefc8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 0x7fefc8068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000f70 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2023-07-09T21:59:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 msgr2=0x7fefe414bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fefd0001ec0 tx=0x7fefd000c960 comp rx=0 tx=0).stop 2023-07-09T21:59:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 shutdown_connections 2023-07-09T21:59:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fefc80663a0 0x7fefc8068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fefe40cef80 0x7fefe414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefe40b7ab0 0x7fefe414bd00 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 --2- 172.21.15.37:0/2006216053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fefe40b4340 0x7fefe40b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 >> 172.21.15.37:0/2006216053 conn(0x7fefe4073090 msgr2=0x7fefe40d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 shutdown_connections 2023-07-09T21:59:49.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.135+0000 7fefeabdb640 1 -- 172.21.15.37:0/2006216053 wait complete. 2023-07-09T21:59:49.157 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T21:59:47.719824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":544,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":343,"ondisk_log_size":343,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":349576,"kb_used_data":18376,"kb_used_omap":0,"kb_used_meta":331136,"kb_avail":754625144,"statfs":{"total":773094113280,"available":772736147456,"internally_reserved":0,"allocated":18817024,"data_stored":10220092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":339083264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002318"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078133+0000","last_change":"2023-07-09T21:59:40.071887+0000","last_active":"2023-07-09T21:59:41.078133+0000","last_peered":"2023-07-09T21:59:41.078133+0000","last_clean":"2023-07-09T21:59:41.078133+0000","last_became_active":"2023-07-09T21:59:40.071533+0000","last_became_peered":"2023-07-09T21:59:40.071533+0000","last_unstale":"2023-07-09T21:59:41.078133+0000","last_undegraded":"2023-07-09T21:59:41.078133+0000","last_fullsized":"2023-07-09T21:59:41.078133+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:13:41.284850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801681+0000","last_change":"2023-07-09T21:59:40.087309+0000","last_active":"2023-07-09T21:59:41.801681+0000","last_peered":"2023-07-09T21:59:41.801681+0000","last_clean":"2023-07-09T21:59:41.801681+0000","last_became_active":"2023-07-09T21:59:40.087014+0000","last_became_peered":"2023-07-09T21:59:40.087014+0000","last_unstale":"2023-07-09T21:59:41.801681+0000","last_undegraded":"2023-07-09T21:59:41.801681+0000","last_fullsized":"2023-07-09T21:59:41.801681+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:04.985695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801633+0000","last_change":"2023-07-09T21:59:40.091651+0000","last_active":"2023-07-09T21:59:41.801633+0000","last_peered":"2023-07-09T21:59:41.801633+0000","last_clean":"2023-07-09T21:59:41.801633+0000","last_became_active":"2023-07-09T21:59:40.091316+0000","last_became_peered":"2023-07-09T21:59:40.091316+0000","last_unstale":"2023-07-09T21:59:41.801633+0000","last_undegraded":"2023-07-09T21:59:41.801633+0000","last_fullsized":"2023-07-09T21:59:41.801633+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:28:45.093111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076290+0000","last_change":"2023-07-09T21:59:40.095215+0000","last_active":"2023-07-09T21:59:41.076290+0000","last_peered":"2023-07-09T21:59:41.076290+0000","last_clean":"2023-07-09T21:59:41.076290+0000","last_became_active":"2023-07-09T21:59:40.094900+0000","last_became_peered":"2023-07-09T21:59:40.094900+0000","last_unstale":"2023-07-09T21:59:41.076290+0000","last_undegraded":"2023-07-09T21:59:41.076290+0000","last_fullsized":"2023-07-09T21:59:41.076290+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:44.562841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802868+0000","last_change":"2023-07-09T21:59:40.088989+0000","last_active":"2023-07-09T21:59:41.802868+0000","last_peered":"2023-07-09T21:59:41.802868+0000","last_clean":"2023-07-09T21:59:41.802868+0000","last_became_active":"2023-07-09T21:59:40.088669+0000","last_became_peered":"2023-07-09T21:59:40.088669+0000","last_unstale":"2023-07-09T21:59:41.802868+0000","last_undegraded":"2023-07-09T21:59:41.802868+0000","last_fullsized":"2023-07-09T21:59:41.802868+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:55.612186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802256+0000","last_change":"2023-07-09T21:59:40.093751+0000","last_active":"2023-07-09T21:59:41.802256+0000","last_peered":"2023-07-09T21:59:41.802256+0000","last_clean":"2023-07-09T21:59:41.802256+0000","last_became_active":"2023-07-09T21:59:40.093232+0000","last_became_peered":"2023-07-09T21:59:40.093232+0000","last_unstale":"2023-07-09T21:59:41.802256+0000","last_undegraded":"2023-07-09T21:59:41.802256+0000","last_fullsized":"2023-07-09T21:59:41.802256+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:46.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078082+0000","last_change":"2023-07-09T21:59:40.080695+0000","last_active":"2023-07-09T21:59:41.078082+0000","last_peered":"2023-07-09T21:59:41.078082+0000","last_clean":"2023-07-09T21:59:41.078082+0000","last_became_active":"2023-07-09T21:59:40.077426+0000","last_became_peered":"2023-07-09T21:59:40.077426+0000","last_unstale":"2023-07-09T21:59:41.078082+0000","last_undegraded":"2023-07-09T21:59:41.078082+0000","last_fullsized":"2023-07-09T21:59:41.078082+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:45.017945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076469+0000","last_change":"2023-07-09T21:59:40.079999+0000","last_active":"2023-07-09T21:59:41.076469+0000","last_peered":"2023-07-09T21:59:41.076469+0000","last_clean":"2023-07-09T21:59:41.076469+0000","last_became_active":"2023-07-09T21:59:40.079313+0000","last_became_peered":"2023-07-09T21:59:40.079313+0000","last_unstale":"2023-07-09T21:59:41.076469+0000","last_undegraded":"2023-07-09T21:59:41.076469+0000","last_fullsized":"2023-07-09T21:59:41.076469+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:15.420945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802016+0000","last_change":"2023-07-09T21:59:40.089749+0000","last_active":"2023-07-09T21:59:41.802016+0000","last_peered":"2023-07-09T21:59:41.802016+0000","last_clean":"2023-07-09T21:59:41.802016+0000","last_became_active":"2023-07-09T21:59:40.089015+0000","last_became_peered":"2023-07-09T21:59:40.089015+0000","last_unstale":"2023-07-09T21:59:41.802016+0000","last_undegraded":"2023-07-09T21:59:41.802016+0000","last_fullsized":"2023-07-09T21:59:41.802016+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:48:44.562841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802621+0000","last_change":"2023-07-09T21:59:40.085468+0000","last_active":"2023-07-09T21:59:41.802621+0000","last_peered":"2023-07-09T21:59:41.802621+0000","last_clean":"2023-07-09T21:59:41.802621+0000","last_became_active":"2023-07-09T21:59:40.084456+0000","last_became_peered":"2023-07-09T21:59:40.084456+0000","last_unstale":"2023-07-09T21:59:41.802621+0000","last_undegraded":"2023-07-09T21:59:41.802621+0000","last_fullsized":"2023-07-09T21:59:41.802621+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:14:28.352514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356199+0000","last_change":"2023-07-09T21:59:40.084388+0000","last_active":"2023-07-09T21:59:41.356199+0000","last_peered":"2023-07-09T21:59:41.356199+0000","last_clean":"2023-07-09T21:59:41.356199+0000","last_became_active":"2023-07-09T21:59:40.084065+0000","last_became_peered":"2023-07-09T21:59:40.084065+0000","last_unstale":"2023-07-09T21:59:41.356199+0000","last_undegraded":"2023-07-09T21:59:41.356199+0000","last_fullsized":"2023-07-09T21:59:41.356199+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:37.260955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076440+0000","last_change":"2023-07-09T21:59:40.092566+0000","last_active":"2023-07-09T21:59:41.076440+0000","last_peered":"2023-07-09T21:59:41.076440+0000","last_clean":"2023-07-09T21:59:41.076440+0000","last_became_active":"2023-07-09T21:59:40.092246+0000","last_became_peered":"2023-07-09T21:59:40.092246+0000","last_unstale":"2023-07-09T21:59:41.076440+0000","last_undegraded":"2023-07-09T21:59:41.076440+0000","last_fullsized":"2023-07-09T21:59:41.076440+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:21.051819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802741+0000","last_change":"2023-07-09T21:59:40.089660+0000","last_active":"2023-07-09T21:59:41.802741+0000","last_peered":"2023-07-09T21:59:41.802741+0000","last_clean":"2023-07-09T21:59:41.802741+0000","last_became_active":"2023-07-09T21:59:40.089198+0000","last_became_peered":"2023-07-09T21:59:40.089198+0000","last_unstale":"2023-07-09T21:59:41.802741+0000","last_undegraded":"2023-07-09T21:59:41.802741+0000","last_fullsized":"2023-07-09T21:59:41.802741+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:56:09.669910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076103+0000","last_change":"2023-07-09T21:59:40.097661+0000","last_active":"2023-07-09T21:59:41.076103+0000","last_peered":"2023-07-09T21:59:41.076103+0000","last_clean":"2023-07-09T21:59:41.076103+0000","last_became_active":"2023-07-09T21:59:40.097053+0000","last_became_peered":"2023-07-09T21:59:40.097053+0000","last_unstale":"2023-07-09T21:59:41.076103+0000","last_undegraded":"2023-07-09T21:59:41.076103+0000","last_fullsized":"2023-07-09T21:59:41.076103+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:33.694772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801283+0000","last_change":"2023-07-09T21:59:40.089629+0000","last_active":"2023-07-09T21:59:41.801283+0000","last_peered":"2023-07-09T21:59:41.801283+0000","last_clean":"2023-07-09T21:59:41.801283+0000","last_became_active":"2023-07-09T21:59:40.089356+0000","last_became_peered":"2023-07-09T21:59:40.089356+0000","last_unstale":"2023-07-09T21:59:41.801283+0000","last_undegraded":"2023-07-09T21:59:41.801283+0000","last_fullsized":"2023-07-09T21:59:41.801283+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:52:10.961423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802050+0000","last_change":"2023-07-09T21:59:40.083853+0000","last_active":"2023-07-09T21:59:41.802050+0000","last_peered":"2023-07-09T21:59:41.802050+0000","last_clean":"2023-07-09T21:59:41.802050+0000","last_became_active":"2023-07-09T21:59:40.083433+0000","last_became_peered":"2023-07-09T21:59:40.083433+0000","last_unstale":"2023-07-09T21:59:41.802050+0000","last_undegraded":"2023-07-09T21:59:41.802050+0000","last_fullsized":"2023-07-09T21:59:41.802050+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:03:21.051819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076785+0000","last_change":"2023-07-09T21:59:40.083062+0000","last_active":"2023-07-09T21:59:41.076785+0000","last_peered":"2023-07-09T21:59:41.076785+0000","last_clean":"2023-07-09T21:59:41.076785+0000","last_became_active":"2023-07-09T21:59:40.082520+0000","last_became_peered":"2023-07-09T21:59:40.082520+0000","last_unstale":"2023-07-09T21:59:41.076785+0000","last_undegraded":"2023-07-09T21:59:41.076785+0000","last_fullsized":"2023-07-09T21:59:41.076785+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:46.599035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356174+0000","last_change":"2023-07-09T21:59:40.071795+0000","last_active":"2023-07-09T21:59:41.356174+0000","last_peered":"2023-07-09T21:59:41.356174+0000","last_clean":"2023-07-09T21:59:41.356174+0000","last_became_active":"2023-07-09T21:59:40.071149+0000","last_became_peered":"2023-07-09T21:59:40.071149+0000","last_unstale":"2023-07-09T21:59:41.356174+0000","last_undegraded":"2023-07-09T21:59:41.356174+0000","last_fullsized":"2023-07-09T21:59:41.356174+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:39:52.847481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751194+0000","last_change":"2023-07-09T21:59:40.095505+0000","last_active":"2023-07-09T21:59:41.751194+0000","last_peered":"2023-07-09T21:59:41.751194+0000","last_clean":"2023-07-09T21:59:41.751194+0000","last_became_active":"2023-07-09T21:59:40.095210+0000","last_became_peered":"2023-07-09T21:59:40.095210+0000","last_unstale":"2023-07-09T21:59:41.751194+0000","last_undegraded":"2023-07-09T21:59:41.751194+0000","last_fullsized":"2023-07-09T21:59:41.751194+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:30:29.919608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802480+0000","last_change":"2023-07-09T21:59:40.078869+0000","last_active":"2023-07-09T21:59:41.802480+0000","last_peered":"2023-07-09T21:59:41.802480+0000","last_clean":"2023-07-09T21:59:41.802480+0000","last_became_active":"2023-07-09T21:59:40.078557+0000","last_became_peered":"2023-07-09T21:59:40.078557+0000","last_unstale":"2023-07-09T21:59:41.802480+0000","last_undegraded":"2023-07-09T21:59:41.802480+0000","last_fullsized":"2023-07-09T21:59:41.802480+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:32:52.412005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802816+0000","last_change":"2023-07-09T21:59:40.089249+0000","last_active":"2023-07-09T21:59:41.802816+0000","last_peered":"2023-07-09T21:59:41.802816+0000","last_clean":"2023-07-09T21:59:41.802816+0000","last_became_active":"2023-07-09T21:59:40.088813+0000","last_became_peered":"2023-07-09T21:59:40.088813+0000","last_unstale":"2023-07-09T21:59:41.802816+0000","last_undegraded":"2023-07-09T21:59:41.802816+0000","last_fullsized":"2023-07-09T21:59:41.802816+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:02:33.958963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077784+0000","last_change":"2023-07-09T21:59:40.080894+0000","last_active":"2023-07-09T21:59:41.077784+0000","last_peered":"2023-07-09T21:59:41.077784+0000","last_clean":"2023-07-09T21:59:41.077784+0000","last_became_active":"2023-07-09T21:59:40.080081+0000","last_became_peered":"2023-07-09T21:59:40.080081+0000","last_unstale":"2023-07-09T21:59:41.077784+0000","last_undegraded":"2023-07-09T21:59:41.077784+0000","last_fullsized":"2023-07-09T21:59:41.077784+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:12:46.743994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076507+0000","last_change":"2023-07-09T21:59:40.078906+0000","last_active":"2023-07-09T21:59:41.076507+0000","last_peered":"2023-07-09T21:59:41.076507+0000","last_clean":"2023-07-09T21:59:41.076507+0000","last_became_active":"2023-07-09T21:59:40.078595+0000","last_became_peered":"2023-07-09T21:59:40.078595+0000","last_unstale":"2023-07-09T21:59:41.076507+0000","last_undegraded":"2023-07-09T21:59:41.076507+0000","last_fullsized":"2023-07-09T21:59:41.076507+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:17:18.527305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356167+0000","last_change":"2023-07-09T21:59:40.087722+0000","last_active":"2023-07-09T21:59:41.356167+0000","last_peered":"2023-07-09T21:59:41.356167+0000","last_clean":"2023-07-09T21:59:41.356167+0000","last_became_active":"2023-07-09T21:59:40.087448+0000","last_became_peered":"2023-07-09T21:59:40.087448+0000","last_unstale":"2023-07-09T21:59:41.356167+0000","last_undegraded":"2023-07-09T21:59:41.356167+0000","last_fullsized":"2023-07-09T21:59:41.356167+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:30:41.091609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078275+0000","last_change":"2023-07-09T21:59:40.073377+0000","last_active":"2023-07-09T21:59:41.078275+0000","last_peered":"2023-07-09T21:59:41.078275+0000","last_clean":"2023-07-09T21:59:41.078275+0000","last_became_active":"2023-07-09T21:59:40.073089+0000","last_became_peered":"2023-07-09T21:59:40.073089+0000","last_unstale":"2023-07-09T21:59:41.078275+0000","last_undegraded":"2023-07-09T21:59:41.078275+0000","last_fullsized":"2023-07-09T21:59:41.078275+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:41:35.001312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078422+0000","last_change":"2023-07-09T21:59:40.076986+0000","last_active":"2023-07-09T21:59:41.078422+0000","last_peered":"2023-07-09T21:59:41.078422+0000","last_clean":"2023-07-09T21:59:41.078422+0000","last_became_active":"2023-07-09T21:59:40.076311+0000","last_became_peered":"2023-07-09T21:59:40.076311+0000","last_unstale":"2023-07-09T21:59:41.078422+0000","last_undegraded":"2023-07-09T21:59:41.078422+0000","last_fullsized":"2023-07-09T21:59:41.078422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:41:58.387830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802299+0000","last_change":"2023-07-09T21:59:40.085922+0000","last_active":"2023-07-09T21:59:41.802299+0000","last_peered":"2023-07-09T21:59:41.802299+0000","last_clean":"2023-07-09T21:59:41.802299+0000","last_became_active":"2023-07-09T21:59:40.085582+0000","last_became_peered":"2023-07-09T21:59:40.085582+0000","last_unstale":"2023-07-09T21:59:41.802299+0000","last_undegraded":"2023-07-09T21:59:41.802299+0000","last_fullsized":"2023-07-09T21:59:41.802299+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:12:30.368923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356101+0000","last_change":"2023-07-09T21:59:40.077954+0000","last_active":"2023-07-09T21:59:41.356101+0000","last_peered":"2023-07-09T21:59:41.356101+0000","last_clean":"2023-07-09T21:59:41.356101+0000","last_became_active":"2023-07-09T21:59:40.077635+0000","last_became_peered":"2023-07-09T21:59:40.077635+0000","last_unstale":"2023-07-09T21:59:41.356101+0000","last_undegraded":"2023-07-09T21:59:41.356101+0000","last_fullsized":"2023-07-09T21:59:41.356101+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:05:46.192853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077301+0000","last_change":"2023-07-09T21:59:40.093737+0000","last_active":"2023-07-09T21:59:41.077301+0000","last_peered":"2023-07-09T21:59:41.077301+0000","last_clean":"2023-07-09T21:59:41.077301+0000","last_became_active":"2023-07-09T21:59:40.093205+0000","last_became_peered":"2023-07-09T21:59:40.093205+0000","last_unstale":"2023-07-09T21:59:41.077301+0000","last_undegraded":"2023-07-09T21:59:41.077301+0000","last_fullsized":"2023-07-09T21:59:41.077301+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:04:30.392403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356003+0000","last_change":"2023-07-09T21:59:40.073941+0000","last_active":"2023-07-09T21:59:41.356003+0000","last_peered":"2023-07-09T21:59:41.356003+0000","last_clean":"2023-07-09T21:59:41.356003+0000","last_became_active":"2023-07-09T21:59:40.073642+0000","last_became_peered":"2023-07-09T21:59:40.073642+0000","last_unstale":"2023-07-09T21:59:41.356003+0000","last_undegraded":"2023-07-09T21:59:41.356003+0000","last_fullsized":"2023-07-09T21:59:41.356003+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:58:54.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802157+0000","last_change":"2023-07-09T21:59:40.083928+0000","last_active":"2023-07-09T21:59:41.802157+0000","last_peered":"2023-07-09T21:59:41.802157+0000","last_clean":"2023-07-09T21:59:41.802157+0000","last_became_active":"2023-07-09T21:59:40.083624+0000","last_became_peered":"2023-07-09T21:59:40.083624+0000","last_unstale":"2023-07-09T21:59:41.802157+0000","last_undegraded":"2023-07-09T21:59:41.802157+0000","last_fullsized":"2023-07-09T21:59:41.802157+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:02.109279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076614+0000","last_change":"2023-07-09T21:59:40.078169+0000","last_active":"2023-07-09T21:59:41.076614+0000","last_peered":"2023-07-09T21:59:41.076614+0000","last_clean":"2023-07-09T21:59:41.076614+0000","last_became_active":"2023-07-09T21:59:40.076897+0000","last_became_peered":"2023-07-09T21:59:40.076897+0000","last_unstale":"2023-07-09T21:59:41.076614+0000","last_undegraded":"2023-07-09T21:59:41.076614+0000","last_fullsized":"2023-07-09T21:59:41.076614+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:45:55.857703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801674+0000","last_change":"2023-07-09T21:59:40.090616+0000","last_active":"2023-07-09T21:59:41.801674+0000","last_peered":"2023-07-09T21:59:41.801674+0000","last_clean":"2023-07-09T21:59:41.801674+0000","last_became_active":"2023-07-09T21:59:40.090315+0000","last_became_peered":"2023-07-09T21:59:40.090315+0000","last_unstale":"2023-07-09T21:59:41.801674+0000","last_undegraded":"2023-07-09T21:59:41.801674+0000","last_fullsized":"2023-07-09T21:59:41.801674+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:13:57.978245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"175'4","reported_seq":17,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802418+0000","last_change":"2023-07-09T21:59:39.056361+0000","last_active":"2023-07-09T21:59:41.802418+0000","last_peered":"2023-07-09T21:59:41.802418+0000","last_clean":"2023-07-09T21:59:41.802418+0000","last_became_active":"2023-07-09T21:59:39.056052+0000","last_became_peered":"2023-07-09T21:59:39.056052+0000","last_unstale":"2023-07-09T21:59:41.802418+0000","last_undegraded":"2023-07-09T21:59:41.802418+0000","last_fullsized":"2023-07-09T21:59:41.802418+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:34:36.470527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801730+0000","last_change":"2023-07-09T21:59:40.087196+0000","last_active":"2023-07-09T21:59:41.801730+0000","last_peered":"2023-07-09T21:59:41.801730+0000","last_clean":"2023-07-09T21:59:41.801730+0000","last_became_active":"2023-07-09T21:59:40.086888+0000","last_became_peered":"2023-07-09T21:59:40.086888+0000","last_unstale":"2023-07-09T21:59:41.801730+0000","last_undegraded":"2023-07-09T21:59:41.801730+0000","last_fullsized":"2023-07-09T21:59:41.801730+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:03.713580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750817+0000","last_change":"2023-07-09T21:59:39.069622+0000","last_active":"2023-07-09T21:59:41.750817+0000","last_peered":"2023-07-09T21:59:41.750817+0000","last_clean":"2023-07-09T21:59:41.750817+0000","last_became_active":"2023-07-09T21:59:39.069069+0000","last_became_peered":"2023-07-09T21:59:39.069069+0000","last_unstale":"2023-07-09T21:59:41.750817+0000","last_undegraded":"2023-07-09T21:59:41.750817+0000","last_fullsized":"2023-07-09T21:59:41.750817+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:00:57.954431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077639+0000","last_change":"2023-07-09T21:59:40.075171+0000","last_active":"2023-07-09T21:59:41.077639+0000","last_peered":"2023-07-09T21:59:41.077639+0000","last_clean":"2023-07-09T21:59:41.077639+0000","last_became_active":"2023-07-09T21:59:40.074902+0000","last_became_peered":"2023-07-09T21:59:40.074902+0000","last_unstale":"2023-07-09T21:59:41.077639+0000","last_undegraded":"2023-07-09T21:59:41.077639+0000","last_fullsized":"2023-07-09T21:59:41.077639+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:44:56.029837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751060+0000","last_change":"2023-07-09T21:59:39.068983+0000","last_active":"2023-07-09T21:59:41.751060+0000","last_peered":"2023-07-09T21:59:41.751060+0000","last_clean":"2023-07-09T21:59:41.751060+0000","last_became_active":"2023-07-09T21:59:39.068685+0000","last_became_peered":"2023-07-09T21:59:39.068685+0000","last_unstale":"2023-07-09T21:59:41.751060+0000","last_undegraded":"2023-07-09T21:59:41.751060+0000","last_fullsized":"2023-07-09T21:59:41.751060+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:04:38.787737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750990+0000","last_change":"2023-07-09T21:59:40.085231+0000","last_active":"2023-07-09T21:59:41.750990+0000","last_peered":"2023-07-09T21:59:41.750990+0000","last_clean":"2023-07-09T21:59:41.750990+0000","last_became_active":"2023-07-09T21:59:40.084589+0000","last_became_peered":"2023-07-09T21:59:40.084589+0000","last_unstale":"2023-07-09T21:59:41.750990+0000","last_undegraded":"2023-07-09T21:59:41.750990+0000","last_fullsized":"2023-07-09T21:59:41.750990+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:17.630444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802215+0000","last_change":"2023-07-09T21:59:39.065490+0000","last_active":"2023-07-09T21:59:41.802215+0000","last_peered":"2023-07-09T21:59:41.802215+0000","last_clean":"2023-07-09T21:59:41.802215+0000","last_became_active":"2023-07-09T21:59:39.065180+0000","last_became_peered":"2023-07-09T21:59:39.065180+0000","last_unstale":"2023-07-09T21:59:41.802215+0000","last_undegraded":"2023-07-09T21:59:41.802215+0000","last_fullsized":"2023-07-09T21:59:41.802215+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:35:49.675112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801908+0000","last_change":"2023-07-09T21:59:40.071026+0000","last_active":"2023-07-09T21:59:41.801908+0000","last_peered":"2023-07-09T21:59:41.801908+0000","last_clean":"2023-07-09T21:59:41.801908+0000","last_became_active":"2023-07-09T21:59:40.070745+0000","last_became_peered":"2023-07-09T21:59:40.070745+0000","last_unstale":"2023-07-09T21:59:41.801908+0000","last_undegraded":"2023-07-09T21:59:41.801908+0000","last_fullsized":"2023-07-09T21:59:41.801908+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:08:15.089129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077397+0000","last_change":"2023-07-09T21:59:39.061460+0000","last_active":"2023-07-09T21:59:41.077397+0000","last_peered":"2023-07-09T21:59:41.077397+0000","last_clean":"2023-07-09T21:59:41.077397+0000","last_became_active":"2023-07-09T21:59:39.061102+0000","last_became_peered":"2023-07-09T21:59:39.061102+0000","last_unstale":"2023-07-09T21:59:41.077397+0000","last_undegraded":"2023-07-09T21:59:41.077397+0000","last_fullsized":"2023-07-09T21:59:41.077397+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:14:20.668622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.075826+0000","last_change":"2023-07-09T21:59:40.083056+0000","last_active":"2023-07-09T21:59:41.075826+0000","last_peered":"2023-07-09T21:59:41.075826+0000","last_clean":"2023-07-09T21:59:41.075826+0000","last_became_active":"2023-07-09T21:59:40.082647+0000","last_became_peered":"2023-07-09T21:59:40.082647+0000","last_unstale":"2023-07-09T21:59:41.075826+0000","last_undegraded":"2023-07-09T21:59:41.075826+0000","last_fullsized":"2023-07-09T21:59:41.075826+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:37.636637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802381+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:41.802381+0000","last_peered":"2023-07-09T21:59:41.802381+0000","last_clean":"2023-07-09T21:59:41.802381+0000","last_became_active":"2023-07-09T21:59:39.059606+0000","last_became_peered":"2023-07-09T21:59:39.059606+0000","last_unstale":"2023-07-09T21:59:41.802381+0000","last_undegraded":"2023-07-09T21:59:41.802381+0000","last_fullsized":"2023-07-09T21:59:41.802381+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:45:54.021043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801366+0000","last_change":"2023-07-09T21:59:40.077379+0000","last_active":"2023-07-09T21:59:41.801366+0000","last_peered":"2023-07-09T21:59:41.801366+0000","last_clean":"2023-07-09T21:59:41.801366+0000","last_became_active":"2023-07-09T21:59:40.077081+0000","last_became_peered":"2023-07-09T21:59:40.077081+0000","last_unstale":"2023-07-09T21:59:41.801366+0000","last_undegraded":"2023-07-09T21:59:41.801366+0000","last_fullsized":"2023-07-09T21:59:41.801366+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:18:29.010026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078318+0000","last_change":"2023-07-09T21:59:39.059613+0000","last_active":"2023-07-09T21:59:41.078318+0000","last_peered":"2023-07-09T21:59:41.078318+0000","last_clean":"2023-07-09T21:59:41.078318+0000","last_became_active":"2023-07-09T21:59:39.059312+0000","last_became_peered":"2023-07-09T21:59:39.059312+0000","last_unstale":"2023-07-09T21:59:41.078318+0000","last_undegraded":"2023-07-09T21:59:41.078318+0000","last_fullsized":"2023-07-09T21:59:41.078318+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:27:47.817632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078097+0000","last_change":"2023-07-09T21:59:40.072456+0000","last_active":"2023-07-09T21:59:41.078097+0000","last_peered":"2023-07-09T21:59:41.078097+0000","last_clean":"2023-07-09T21:59:41.078097+0000","last_became_active":"2023-07-09T21:59:40.072190+0000","last_became_peered":"2023-07-09T21:59:40.072190+0000","last_unstale":"2023-07-09T21:59:41.078097+0000","last_undegraded":"2023-07-09T21:59:41.078097+0000","last_fullsized":"2023-07-09T21:59:41.078097+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:53:44.926529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802133+0000","last_change":"2023-07-09T21:59:39.058431+0000","last_active":"2023-07-09T21:59:41.802133+0000","last_peered":"2023-07-09T21:59:41.802133+0000","last_clean":"2023-07-09T21:59:41.802133+0000","last_became_active":"2023-07-09T21:59:39.058114+0000","last_became_peered":"2023-07-09T21:59:39.058114+0000","last_unstale":"2023-07-09T21:59:41.802133+0000","last_undegraded":"2023-07-09T21:59:41.802133+0000","last_fullsized":"2023-07-09T21:59:41.802133+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:39.063500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750771+0000","last_change":"2023-07-09T21:59:40.089115+0000","last_active":"2023-07-09T21:59:41.750771+0000","last_peered":"2023-07-09T21:59:41.750771+0000","last_clean":"2023-07-09T21:59:41.750771+0000","last_became_active":"2023-07-09T21:59:40.088770+0000","last_became_peered":"2023-07-09T21:59:40.088770+0000","last_unstale":"2023-07-09T21:59:41.750771+0000","last_undegraded":"2023-07-09T21:59:41.750771+0000","last_fullsized":"2023-07-09T21:59:41.750771+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:31.315658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356052+0000","last_change":"2023-07-09T21:59:39.068870+0000","last_active":"2023-07-09T21:59:41.356052+0000","last_peered":"2023-07-09T21:59:41.356052+0000","last_clean":"2023-07-09T21:59:41.356052+0000","last_became_active":"2023-07-09T21:59:39.068548+0000","last_became_peered":"2023-07-09T21:59:39.068548+0000","last_unstale":"2023-07-09T21:59:41.356052+0000","last_undegraded":"2023-07-09T21:59:41.356052+0000","last_fullsized":"2023-07-09T21:59:41.356052+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:50:34.197028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751046+0000","last_change":"2023-07-09T21:59:40.095351+0000","last_active":"2023-07-09T21:59:41.751046+0000","last_peered":"2023-07-09T21:59:41.751046+0000","last_clean":"2023-07-09T21:59:41.751046+0000","last_became_active":"2023-07-09T21:59:40.095033+0000","last_became_peered":"2023-07-09T21:59:40.095033+0000","last_unstale":"2023-07-09T21:59:41.751046+0000","last_undegraded":"2023-07-09T21:59:41.751046+0000","last_fullsized":"2023-07-09T21:59:41.751046+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:16:32.125716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750839+0000","last_change":"2023-07-09T21:59:39.070672+0000","last_active":"2023-07-09T21:59:41.750839+0000","last_peered":"2023-07-09T21:59:41.750839+0000","last_clean":"2023-07-09T21:59:41.750839+0000","last_became_active":"2023-07-09T21:59:39.069356+0000","last_became_peered":"2023-07-09T21:59:39.069356+0000","last_unstale":"2023-07-09T21:59:41.750839+0000","last_undegraded":"2023-07-09T21:59:41.750839+0000","last_fullsized":"2023-07-09T21:59:41.750839+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:20:14.953468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078423+0000","last_change":"2023-07-09T21:59:40.089184+0000","last_active":"2023-07-09T21:59:41.078423+0000","last_peered":"2023-07-09T21:59:41.078423+0000","last_clean":"2023-07-09T21:59:41.078423+0000","last_became_active":"2023-07-09T21:59:40.088916+0000","last_became_peered":"2023-07-09T21:59:40.088916+0000","last_unstale":"2023-07-09T21:59:41.078423+0000","last_undegraded":"2023-07-09T21:59:41.078423+0000","last_fullsized":"2023-07-09T21:59:41.078423+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:39:17.103384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"175'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801861+0000","last_change":"2023-07-09T21:59:39.054129+0000","last_active":"2023-07-09T21:59:41.801861+0000","last_peered":"2023-07-09T21:59:41.801861+0000","last_clean":"2023-07-09T21:59:41.801861+0000","last_became_active":"2023-07-09T21:59:39.053847+0000","last_became_peered":"2023-07-09T21:59:39.053847+0000","last_unstale":"2023-07-09T21:59:41.801861+0000","last_undegraded":"2023-07-09T21:59:41.801861+0000","last_fullsized":"2023-07-09T21:59:41.801861+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:08:47.085699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078319+0000","last_change":"2023-07-09T21:59:40.080190+0000","last_active":"2023-07-09T21:59:41.078319+0000","last_peered":"2023-07-09T21:59:41.078319+0000","last_clean":"2023-07-09T21:59:41.078319+0000","last_became_active":"2023-07-09T21:59:40.077479+0000","last_became_peered":"2023-07-09T21:59:40.077479+0000","last_unstale":"2023-07-09T21:59:41.078319+0000","last_undegraded":"2023-07-09T21:59:41.078319+0000","last_fullsized":"2023-07-09T21:59:41.078319+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:31:14.991606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076582+0000","last_change":"2023-07-09T21:59:39.066598+0000","last_active":"2023-07-09T21:59:41.076582+0000","last_peered":"2023-07-09T21:59:41.076582+0000","last_clean":"2023-07-09T21:59:41.076582+0000","last_became_active":"2023-07-09T21:59:39.066274+0000","last_became_peered":"2023-07-09T21:59:39.066274+0000","last_unstale":"2023-07-09T21:59:41.076582+0000","last_undegraded":"2023-07-09T21:59:41.076582+0000","last_fullsized":"2023-07-09T21:59:41.076582+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:34:01.102521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750458+0000","last_change":"2023-07-09T21:59:40.095937+0000","last_active":"2023-07-09T21:59:41.750458+0000","last_peered":"2023-07-09T21:59:41.750458+0000","last_clean":"2023-07-09T21:59:41.750458+0000","last_became_active":"2023-07-09T21:59:40.095129+0000","last_became_peered":"2023-07-09T21:59:40.095129+0000","last_unstale":"2023-07-09T21:59:41.750458+0000","last_undegraded":"2023-07-09T21:59:41.750458+0000","last_fullsized":"2023-07-09T21:59:41.750458+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:03:15.335993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801616+0000","last_change":"2023-07-09T21:59:39.065915+0000","last_active":"2023-07-09T21:59:41.801616+0000","last_peered":"2023-07-09T21:59:41.801616+0000","last_clean":"2023-07-09T21:59:41.801616+0000","last_became_active":"2023-07-09T21:59:39.065564+0000","last_became_peered":"2023-07-09T21:59:39.065564+0000","last_unstale":"2023-07-09T21:59:41.801616+0000","last_undegraded":"2023-07-09T21:59:41.801616+0000","last_fullsized":"2023-07-09T21:59:41.801616+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:01:25.849348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801433+0000","last_change":"2023-07-09T21:59:40.082551+0000","last_active":"2023-07-09T21:59:41.801433+0000","last_peered":"2023-07-09T21:59:41.801433+0000","last_clean":"2023-07-09T21:59:41.801433+0000","last_became_active":"2023-07-09T21:59:40.082288+0000","last_became_peered":"2023-07-09T21:59:40.082288+0000","last_unstale":"2023-07-09T21:59:41.801433+0000","last_undegraded":"2023-07-09T21:59:41.801433+0000","last_fullsized":"2023-07-09T21:59:41.801433+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:25:15.901761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077154+0000","last_change":"2023-07-09T21:59:39.061507+0000","last_active":"2023-07-09T21:59:41.077154+0000","last_peered":"2023-07-09T21:59:41.077154+0000","last_clean":"2023-07-09T21:59:41.077154+0000","last_became_active":"2023-07-09T21:59:39.061215+0000","last_became_peered":"2023-07-09T21:59:39.061215+0000","last_unstale":"2023-07-09T21:59:41.077154+0000","last_undegraded":"2023-07-09T21:59:41.077154+0000","last_fullsized":"2023-07-09T21:59:41.077154+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:17:29.268806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750664+0000","last_change":"2023-07-09T21:59:40.083566+0000","last_active":"2023-07-09T21:59:41.750664+0000","last_peered":"2023-07-09T21:59:41.750664+0000","last_clean":"2023-07-09T21:59:41.750664+0000","last_became_active":"2023-07-09T21:59:40.080378+0000","last_became_peered":"2023-07-09T21:59:40.080378+0000","last_unstale":"2023-07-09T21:59:41.750664+0000","last_undegraded":"2023-07-09T21:59:41.750664+0000","last_fullsized":"2023-07-09T21:59:41.750664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:45.674890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802282+0000","last_change":"2023-07-09T21:59:39.059503+0000","last_active":"2023-07-09T21:59:41.802282+0000","last_peered":"2023-07-09T21:59:41.802282+0000","last_clean":"2023-07-09T21:59:41.802282+0000","last_became_active":"2023-07-09T21:59:39.059214+0000","last_became_peered":"2023-07-09T21:59:39.059214+0000","last_unstale":"2023-07-09T21:59:41.802282+0000","last_undegraded":"2023-07-09T21:59:41.802282+0000","last_fullsized":"2023-07-09T21:59:41.802282+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:21:44.633879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801826+0000","last_change":"2023-07-09T21:59:40.087815+0000","last_active":"2023-07-09T21:59:41.801826+0000","last_peered":"2023-07-09T21:59:41.801826+0000","last_clean":"2023-07-09T21:59:41.801826+0000","last_became_active":"2023-07-09T21:59:40.087551+0000","last_became_peered":"2023-07-09T21:59:40.087551+0000","last_unstale":"2023-07-09T21:59:41.801826+0000","last_undegraded":"2023-07-09T21:59:41.801826+0000","last_fullsized":"2023-07-09T21:59:41.801826+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:11:26.208221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076981+0000","last_change":"2023-07-09T21:59:39.061861+0000","last_active":"2023-07-09T21:59:41.076981+0000","last_peered":"2023-07-09T21:59:41.076981+0000","last_clean":"2023-07-09T21:59:41.076981+0000","last_became_active":"2023-07-09T21:59:39.061558+0000","last_became_peered":"2023-07-09T21:59:39.061558+0000","last_unstale":"2023-07-09T21:59:41.076981+0000","last_undegraded":"2023-07-09T21:59:41.076981+0000","last_fullsized":"2023-07-09T21:59:41.076981+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:19.741367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802656+0000","last_change":"2023-07-09T21:59:40.085404+0000","last_active":"2023-07-09T21:59:41.802656+0000","last_peered":"2023-07-09T21:59:41.802656+0000","last_clean":"2023-07-09T21:59:41.802656+0000","last_became_active":"2023-07-09T21:59:40.084305+0000","last_became_peered":"2023-07-09T21:59:40.084305+0000","last_unstale":"2023-07-09T21:59:41.802656+0000","last_undegraded":"2023-07-09T21:59:41.802656+0000","last_fullsized":"2023-07-09T21:59:41.802656+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:08:56.600006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076784+0000","last_change":"2023-07-09T21:59:39.064293+0000","last_active":"2023-07-09T21:59:41.076784+0000","last_peered":"2023-07-09T21:59:41.076784+0000","last_clean":"2023-07-09T21:59:41.076784+0000","last_became_active":"2023-07-09T21:59:39.064014+0000","last_became_peered":"2023-07-09T21:59:39.064014+0000","last_unstale":"2023-07-09T21:59:41.076784+0000","last_undegraded":"2023-07-09T21:59:41.076784+0000","last_fullsized":"2023-07-09T21:59:41.076784+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:19.574875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076534+0000","last_change":"2023-07-09T21:59:40.087825+0000","last_active":"2023-07-09T21:59:41.076534+0000","last_peered":"2023-07-09T21:59:41.076534+0000","last_clean":"2023-07-09T21:59:41.076534+0000","last_became_active":"2023-07-09T21:59:40.087311+0000","last_became_peered":"2023-07-09T21:59:40.087311+0000","last_unstale":"2023-07-09T21:59:41.076534+0000","last_undegraded":"2023-07-09T21:59:41.076534+0000","last_fullsized":"2023-07-09T21:59:41.076534+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:40.070257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"176'1","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078623+0000","last_change":"2023-07-09T21:59:39.062851+0000","last_active":"2023-07-09T21:59:41.078623+0000","last_peered":"2023-07-09T21:59:41.078623+0000","last_clean":"2023-07-09T21:59:41.078623+0000","last_became_active":"2023-07-09T21:59:39.062560+0000","last_became_peered":"2023-07-09T21:59:39.062560+0000","last_unstale":"2023-07-09T21:59:41.078623+0000","last_undegraded":"2023-07-09T21:59:41.078623+0000","last_fullsized":"2023-07-09T21:59:41.078623+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:59:45.877088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078597+0000","last_change":"2023-07-09T21:59:40.071571+0000","last_active":"2023-07-09T21:59:41.078597+0000","last_peered":"2023-07-09T21:59:41.078597+0000","last_clean":"2023-07-09T21:59:41.078597+0000","last_became_active":"2023-07-09T21:59:40.070482+0000","last_became_peered":"2023-07-09T21:59:40.070482+0000","last_unstale":"2023-07-09T21:59:41.078597+0000","last_undegraded":"2023-07-09T21:59:41.078597+0000","last_fullsized":"2023-07-09T21:59:41.078597+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:33:08.289643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801967+0000","last_change":"2023-07-09T21:59:39.060698+0000","last_active":"2023-07-09T21:59:41.801967+0000","last_peered":"2023-07-09T21:59:41.801967+0000","last_clean":"2023-07-09T21:59:41.801967+0000","last_became_active":"2023-07-09T21:59:39.060367+0000","last_became_peered":"2023-07-09T21:59:39.060367+0000","last_unstale":"2023-07-09T21:59:41.801967+0000","last_undegraded":"2023-07-09T21:59:41.801967+0000","last_fullsized":"2023-07-09T21:59:41.801967+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:11:35.225354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802200+0000","last_change":"2023-07-09T21:59:40.088088+0000","last_active":"2023-07-09T21:59:41.802200+0000","last_peered":"2023-07-09T21:59:41.802200+0000","last_clean":"2023-07-09T21:59:41.802200+0000","last_became_active":"2023-07-09T21:59:40.087808+0000","last_became_peered":"2023-07-09T21:59:40.087808+0000","last_unstale":"2023-07-09T21:59:41.802200+0000","last_undegraded":"2023-07-09T21:59:41.802200+0000","last_fullsized":"2023-07-09T21:59:41.802200+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:20.581633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802673+0000","last_change":"2023-07-09T21:59:39.066091+0000","last_active":"2023-07-09T21:59:41.802673+0000","last_peered":"2023-07-09T21:59:41.802673+0000","last_clean":"2023-07-09T21:59:41.802673+0000","last_became_active":"2023-07-09T21:59:39.065700+0000","last_became_peered":"2023-07-09T21:59:39.065700+0000","last_unstale":"2023-07-09T21:59:41.802673+0000","last_undegraded":"2023-07-09T21:59:41.802673+0000","last_fullsized":"2023-07-09T21:59:41.802673+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:59:39.343689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076877+0000","last_change":"2023-07-09T21:59:40.072644+0000","last_active":"2023-07-09T21:59:41.076877+0000","last_peered":"2023-07-09T21:59:41.076877+0000","last_clean":"2023-07-09T21:59:41.076877+0000","last_became_active":"2023-07-09T21:59:40.072377+0000","last_became_peered":"2023-07-09T21:59:40.072377+0000","last_unstale":"2023-07-09T21:59:41.076877+0000","last_undegraded":"2023-07-09T21:59:41.076877+0000","last_fullsized":"2023-07-09T21:59:41.076877+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:50:07.167578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077803+0000","last_change":"2023-07-09T21:59:39.059949+0000","last_active":"2023-07-09T21:59:41.077803+0000","last_peered":"2023-07-09T21:59:41.077803+0000","last_clean":"2023-07-09T21:59:41.077803+0000","last_became_active":"2023-07-09T21:59:39.059591+0000","last_became_peered":"2023-07-09T21:59:39.059591+0000","last_unstale":"2023-07-09T21:59:41.077803+0000","last_undegraded":"2023-07-09T21:59:41.077803+0000","last_fullsized":"2023-07-09T21:59:41.077803+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:04:36.575312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.075906+0000","last_change":"2023-07-09T21:59:40.087587+0000","last_active":"2023-07-09T21:59:41.075906+0000","last_peered":"2023-07-09T21:59:41.075906+0000","last_clean":"2023-07-09T21:59:41.075906+0000","last_became_active":"2023-07-09T21:59:40.087263+0000","last_became_peered":"2023-07-09T21:59:40.087263+0000","last_unstale":"2023-07-09T21:59:41.075906+0000","last_undegraded":"2023-07-09T21:59:41.075906+0000","last_fullsized":"2023-07-09T21:59:41.075906+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:34:23.416680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356205+0000","last_change":"2023-07-09T21:59:39.062994+0000","last_active":"2023-07-09T21:59:41.356205+0000","last_peered":"2023-07-09T21:59:41.356205+0000","last_clean":"2023-07-09T21:59:41.356205+0000","last_became_active":"2023-07-09T21:59:39.062749+0000","last_became_peered":"2023-07-09T21:59:39.062749+0000","last_unstale":"2023-07-09T21:59:41.356205+0000","last_undegraded":"2023-07-09T21:59:41.356205+0000","last_fullsized":"2023-07-09T21:59:41.356205+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:11:53.949787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801514+0000","last_change":"2023-07-09T21:59:40.092092+0000","last_active":"2023-07-09T21:59:41.801514+0000","last_peered":"2023-07-09T21:59:41.801514+0000","last_clean":"2023-07-09T21:59:41.801514+0000","last_became_active":"2023-07-09T21:59:40.091742+0000","last_became_peered":"2023-07-09T21:59:40.091742+0000","last_unstale":"2023-07-09T21:59:41.801514+0000","last_undegraded":"2023-07-09T21:59:41.801514+0000","last_fullsized":"2023-07-09T21:59:41.801514+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:27:40.996205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078469+0000","last_change":"2023-07-09T21:59:39.059053+0000","last_active":"2023-07-09T21:59:41.078469+0000","last_peered":"2023-07-09T21:59:41.078469+0000","last_clean":"2023-07-09T21:59:41.078469+0000","last_became_active":"2023-07-09T21:59:39.058548+0000","last_became_peered":"2023-07-09T21:59:39.058548+0000","last_unstale":"2023-07-09T21:59:41.078469+0000","last_undegraded":"2023-07-09T21:59:41.078469+0000","last_fullsized":"2023-07-09T21:59:41.078469+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:07.468486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077245+0000","last_change":"2023-07-09T21:59:40.093513+0000","last_active":"2023-07-09T21:59:41.077245+0000","last_peered":"2023-07-09T21:59:41.077245+0000","last_clean":"2023-07-09T21:59:41.077245+0000","last_became_active":"2023-07-09T21:59:40.092818+0000","last_became_peered":"2023-07-09T21:59:40.092818+0000","last_unstale":"2023-07-09T21:59:41.077245+0000","last_undegraded":"2023-07-09T21:59:41.077245+0000","last_fullsized":"2023-07-09T21:59:41.077245+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:55.948174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750774+0000","last_change":"2023-07-09T21:59:39.068790+0000","last_active":"2023-07-09T21:59:41.750774+0000","last_peered":"2023-07-09T21:59:41.750774+0000","last_clean":"2023-07-09T21:59:41.750774+0000","last_became_active":"2023-07-09T21:59:39.068499+0000","last_became_peered":"2023-07-09T21:59:39.068499+0000","last_unstale":"2023-07-09T21:59:41.750774+0000","last_undegraded":"2023-07-09T21:59:41.750774+0000","last_fullsized":"2023-07-09T21:59:41.750774+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:50:27.749034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077794+0000","last_change":"2023-07-09T21:59:40.081677+0000","last_active":"2023-07-09T21:59:41.077794+0000","last_peered":"2023-07-09T21:59:41.077794+0000","last_clean":"2023-07-09T21:59:41.077794+0000","last_became_active":"2023-07-09T21:59:40.081350+0000","last_became_peered":"2023-07-09T21:59:40.081350+0000","last_unstale":"2023-07-09T21:59:41.077794+0000","last_undegraded":"2023-07-09T21:59:41.077794+0000","last_fullsized":"2023-07-09T21:59:41.077794+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:53:01.906420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"175'6","reported_seq":19,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802340+0000","last_change":"2023-07-09T21:59:39.064156+0000","last_active":"2023-07-09T21:59:41.802340+0000","last_peered":"2023-07-09T21:59:41.802340+0000","last_clean":"2023-07-09T21:59:41.802340+0000","last_became_active":"2023-07-09T21:59:39.063822+0000","last_became_peered":"2023-07-09T21:59:39.063822+0000","last_unstale":"2023-07-09T21:59:41.802340+0000","last_undegraded":"2023-07-09T21:59:41.802340+0000","last_fullsized":"2023-07-09T21:59:41.802340+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:38:36.607763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"163'304","reported_seq":1116,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750941+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T21:59:41.750941+0000","last_peered":"2023-07-09T21:59:41.750941+0000","last_clean":"2023-07-09T21:59:41.750941+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T21:59:41.750941+0000","last_undegraded":"2023-07-09T21:59:41.750941+0000","last_fullsized":"2023-07-09T21:59:41.750941+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":304,"log_dups_size":0,"ondisk_log_size":304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:07:26.670822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":342,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077942+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T21:59:41.077942+0000","last_peered":"2023-07-09T21:59:41.077942+0000","last_clean":"2023-07-09T21:59:41.077942+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T21:59:41.077942+0000","last_undegraded":"2023-07-09T21:59:41.077942+0000","last_fullsized":"2023-07-09T21:59:41.077942+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:13:38.850298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077411+0000","last_change":"2023-07-09T21:59:40.080635+0000","last_active":"2023-07-09T21:59:41.077411+0000","last_peered":"2023-07-09T21:59:41.077411+0000","last_clean":"2023-07-09T21:59:41.077411+0000","last_became_active":"2023-07-09T21:59:40.080360+0000","last_became_peered":"2023-07-09T21:59:40.080360+0000","last_unstale":"2023-07-09T21:59:41.077411+0000","last_undegraded":"2023-07-09T21:59:41.077411+0000","last_fullsized":"2023-07-09T21:59:41.077411+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:22:55.655884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751105+0000","last_change":"2023-07-09T21:59:39.070215+0000","last_active":"2023-07-09T21:59:41.751105+0000","last_peered":"2023-07-09T21:59:41.751105+0000","last_clean":"2023-07-09T21:59:41.751105+0000","last_became_active":"2023-07-09T21:59:39.069951+0000","last_became_peered":"2023-07-09T21:59:39.069951+0000","last_unstale":"2023-07-09T21:59:41.751105+0000","last_undegraded":"2023-07-09T21:59:41.751105+0000","last_fullsized":"2023-07-09T21:59:41.751105+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:28:37.792116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":297,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.750728+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T21:59:41.750728+0000","last_peered":"2023-07-09T21:59:41.750728+0000","last_clean":"2023-07-09T21:59:41.750728+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T21:59:41.750728+0000","last_undegraded":"2023-07-09T21:59:41.750728+0000","last_fullsized":"2023-07-09T21:59:41.750728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:04:46.345813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356195+0000","last_change":"2023-07-09T21:59:40.077013+0000","last_active":"2023-07-09T21:59:41.356195+0000","last_peered":"2023-07-09T21:59:41.356195+0000","last_clean":"2023-07-09T21:59:41.356195+0000","last_became_active":"2023-07-09T21:59:40.076727+0000","last_became_peered":"2023-07-09T21:59:40.076727+0000","last_unstale":"2023-07-09T21:59:41.356195+0000","last_undegraded":"2023-07-09T21:59:41.356195+0000","last_fullsized":"2023-07-09T21:59:41.356195+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:28:26.427664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.078697+0000","last_change":"2023-07-09T21:59:39.058851+0000","last_active":"2023-07-09T21:59:41.078697+0000","last_peered":"2023-07-09T21:59:41.078697+0000","last_clean":"2023-07-09T21:59:41.078697+0000","last_became_active":"2023-07-09T21:59:39.058567+0000","last_became_peered":"2023-07-09T21:59:39.058567+0000","last_unstale":"2023-07-09T21:59:41.078697+0000","last_undegraded":"2023-07-09T21:59:41.078697+0000","last_fullsized":"2023-07-09T21:59:41.078697+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:59:19.759892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":290,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.355952+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T21:59:41.355952+0000","last_peered":"2023-07-09T21:59:41.355952+0000","last_clean":"2023-07-09T21:59:41.355952+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T21:59:41.355952+0000","last_undegraded":"2023-07-09T21:59:41.355952+0000","last_fullsized":"2023-07-09T21:59:41.355952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:01:05.004769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356237+0000","last_change":"2023-07-09T21:59:40.071980+0000","last_active":"2023-07-09T21:59:41.356237+0000","last_peered":"2023-07-09T21:59:41.356237+0000","last_clean":"2023-07-09T21:59:41.356237+0000","last_became_active":"2023-07-09T21:59:40.071435+0000","last_became_peered":"2023-07-09T21:59:40.071435+0000","last_unstale":"2023-07-09T21:59:41.356237+0000","last_undegraded":"2023-07-09T21:59:41.356237+0000","last_fullsized":"2023-07-09T21:59:41.356237+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:43.236238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"175'3","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.356314+0000","last_change":"2023-07-09T21:59:39.048558+0000","last_active":"2023-07-09T21:59:41.356314+0000","last_peered":"2023-07-09T21:59:41.356314+0000","last_clean":"2023-07-09T21:59:41.356314+0000","last_became_active":"2023-07-09T21:59:39.048275+0000","last_became_peered":"2023-07-09T21:59:39.048275+0000","last_unstale":"2023-07-09T21:59:41.356314+0000","last_undegraded":"2023-07-09T21:59:41.356314+0000","last_fullsized":"2023-07-09T21:59:41.356314+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:54:53.818573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":342,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077817+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T21:59:41.077817+0000","last_peered":"2023-07-09T21:59:41.077817+0000","last_clean":"2023-07-09T21:59:41.077817+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T21:59:41.077817+0000","last_undegraded":"2023-07-09T21:59:41.077817+0000","last_fullsized":"2023-07-09T21:59:41.077817+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:12:02.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076744+0000","last_change":"2023-07-09T21:59:40.079761+0000","last_active":"2023-07-09T21:59:41.076744+0000","last_peered":"2023-07-09T21:59:41.076744+0000","last_clean":"2023-07-09T21:59:41.076744+0000","last_became_active":"2023-07-09T21:59:40.077817+0000","last_became_peered":"2023-07-09T21:59:40.077817+0000","last_unstale":"2023-07-09T21:59:41.076744+0000","last_undegraded":"2023-07-09T21:59:41.076744+0000","last_fullsized":"2023-07-09T21:59:41.076744+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:41:50.001117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"175'2","reported_seq":15,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802938+0000","last_change":"2023-07-09T21:59:39.056568+0000","last_active":"2023-07-09T21:59:41.802938+0000","last_peered":"2023-07-09T21:59:41.802938+0000","last_clean":"2023-07-09T21:59:41.802938+0000","last_became_active":"2023-07-09T21:59:39.056167+0000","last_became_peered":"2023-07-09T21:59:39.056167+0000","last_unstale":"2023-07-09T21:59:41.802938+0000","last_undegraded":"2023-07-09T21:59:41.802938+0000","last_fullsized":"2023-07-09T21:59:41.802938+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:24:09.053047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801919+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T21:59:41.801919+0000","last_peered":"2023-07-09T21:59:41.801919+0000","last_clean":"2023-07-09T21:59:41.801919+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T21:59:41.801919+0000","last_undegraded":"2023-07-09T21:59:41.801919+0000","last_fullsized":"2023-07-09T21:59:41.801919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:33:57.949327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801277+0000","last_change":"2023-07-09T21:59:40.088379+0000","last_active":"2023-07-09T21:59:41.801277+0000","last_peered":"2023-07-09T21:59:41.801277+0000","last_clean":"2023-07-09T21:59:41.801277+0000","last_became_active":"2023-07-09T21:59:40.088112+0000","last_became_peered":"2023-07-09T21:59:40.088112+0000","last_unstale":"2023-07-09T21:59:41.801277+0000","last_undegraded":"2023-07-09T21:59:41.801277+0000","last_fullsized":"2023-07-09T21:59:41.801277+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:59.570055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076229+0000","last_change":"2023-07-09T21:59:39.066863+0000","last_active":"2023-07-09T21:59:41.076229+0000","last_peered":"2023-07-09T21:59:41.076229+0000","last_clean":"2023-07-09T21:59:41.076229+0000","last_became_active":"2023-07-09T21:59:39.066027+0000","last_became_peered":"2023-07-09T21:59:39.066027+0000","last_unstale":"2023-07-09T21:59:41.076229+0000","last_undegraded":"2023-07-09T21:59:41.076229+0000","last_fullsized":"2023-07-09T21:59:41.076229+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:36:23.465660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":296,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.751188+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T21:59:41.751188+0000","last_peered":"2023-07-09T21:59:41.751188+0000","last_clean":"2023-07-09T21:59:41.751188+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T21:59:41.751188+0000","last_undegraded":"2023-07-09T21:59:41.751188+0000","last_fullsized":"2023-07-09T21:59:41.751188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:53:18.451690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.802375+0000","last_change":"2023-07-09T21:59:40.093570+0000","last_active":"2023-07-09T21:59:41.802375+0000","last_peered":"2023-07-09T21:59:41.802375+0000","last_clean":"2023-07-09T21:59:41.802375+0000","last_became_active":"2023-07-09T21:59:40.092915+0000","last_became_peered":"2023-07-09T21:59:40.092915+0000","last_unstale":"2023-07-09T21:59:41.802375+0000","last_undegraded":"2023-07-09T21:59:41.802375+0000","last_fullsized":"2023-07-09T21:59:41.802375+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:33:49.109846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076006+0000","last_change":"2023-07-09T21:59:39.059472+0000","last_active":"2023-07-09T21:59:41.076006+0000","last_peered":"2023-07-09T21:59:41.076006+0000","last_clean":"2023-07-09T21:59:41.076006+0000","last_became_active":"2023-07-09T21:59:39.059185+0000","last_became_peered":"2023-07-09T21:59:39.059185+0000","last_unstale":"2023-07-09T21:59:41.076006+0000","last_undegraded":"2023-07-09T21:59:41.076006+0000","last_fullsized":"2023-07-09T21:59:41.076006+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:38:57.227697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":290,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801813+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T21:59:41.801813+0000","last_peered":"2023-07-09T21:59:41.801813+0000","last_clean":"2023-07-09T21:59:41.801813+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T21:59:41.801813+0000","last_undegraded":"2023-07-09T21:59:41.801813+0000","last_fullsized":"2023-07-09T21:59:41.801813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:53:34.160096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.801647+0000","last_change":"2023-07-09T21:59:40.092762+0000","last_active":"2023-07-09T21:59:41.801647+0000","last_peered":"2023-07-09T21:59:41.801647+0000","last_clean":"2023-07-09T21:59:41.801647+0000","last_became_active":"2023-07-09T21:59:40.092431+0000","last_became_peered":"2023-07-09T21:59:40.092431+0000","last_unstale":"2023-07-09T21:59:41.801647+0000","last_undegraded":"2023-07-09T21:59:41.801647+0000","last_fullsized":"2023-07-09T21:59:41.801647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:39.032089+0000","last_clean_scrub_stamp":"2023-07-09T21:59:39.032089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:13:44.896887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"175'8","reported_seq":21,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.077042+0000","last_change":"2023-07-09T21:59:39.062972+0000","last_active":"2023-07-09T21:59:41.077042+0000","last_peered":"2023-07-09T21:59:41.077042+0000","last_clean":"2023-07-09T21:59:41.077042+0000","last_became_active":"2023-07-09T21:59:39.062692+0000","last_became_peered":"2023-07-09T21:59:39.062692+0000","last_unstale":"2023-07-09T21:59:41.077042+0000","last_undegraded":"2023-07-09T21:59:41.077042+0000","last_fullsized":"2023-07-09T21:59:41.077042+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":173,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:59:38.025331+0000","last_clean_scrub_stamp":"2023-07-09T21:59:38.025331+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:54:34.067163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":304,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-07-09T21:59:41.076863+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T21:59:41.076863+0000","last_peered":"2023-07-09T21:59:41.076863+0000","last_clean":"2023-07-09T21:59:41.076863+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T21:59:41.076863+0000","last_undegraded":"2023-07-09T21:59:41.076863+0000","last_fullsized":"2023-07-09T21:59:41.076863+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:35:16.110542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1748,"num_read_kb":3602,"num_write":499,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":304,"ondisk_log_size":304,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575292,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47728,"kb_used_data":2728,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94324112,"statfs":{"total":96636764160,"available":96587890688,"internally_reserved":0,"allocated":2793472,"data_stored":1719719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.55600000000000005,"5min":0.51700000000000002,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75600000000000001,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.41599999999999998},"max":{"1min":0.98699999999999999,"5min":0.99299999999999999,"15min":1.0169999999999999},"last":0.67900000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.749},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.96499999999999997,"5min":1.028,"15min":1.0309999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58699999999999997,"5min":0.53600000000000003,"15min":0.47999999999999998},"max":{"1min":0.94599999999999995,"5min":1.04,"15min":1.0660000000000001},"last":0.49099999999999999}]},{"osd":2,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74299999999999999,"15min":0.73599999999999999},"min":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.77300000000000002,"15min":0.76400000000000001},"min":{"1min":0.503,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0740000000000001},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77800000000000002,"15min":0.78000000000000003},"min":{"1min":0.621,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.004,"5min":1.0289999999999999,"15min":1.038},"last":0.623},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.60599999999999998,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.63700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.60299999999999998},"min":{"1min":0.46500000000000002,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.98199999999999998},"last":0.78400000000000003}]},{"osd":5,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64100000000000001,"15min":0.627},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.077},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Sun Jul 9 21:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.55500000000000005,"5min":0.51900000000000002,"15min":0.46100000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.749},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.68700000000000006,"15min":0.68300000000000005},"min":{"1min":0.52500000000000002,"5min":0.46500000000000002,"15min":0.45700000000000002},"max":{"1min":1,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834575291,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2199552,"data_stored":1129399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.72999999999999998,"15min":0.73899999999999999},"min":{"1min":0.51100000000000001,"5min":0.46800000000000003,"15min":0.46700000000000003},"max":{"1min":0.97099999999999997,"5min":1.075,"15min":1.075},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.753,"15min":0.75600000000000001},"min":{"1min":0.61299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.91800000000000004,"5min":0.96899999999999997,"15min":1.04},"last":0.50900000000000001}]},{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.75700000000000001},"min":{"1min":0.49399999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.89600000000000002,"5min":0.98199999999999998,"15min":1.177},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.746,"15min":0.753},"min":{"1min":0.54800000000000004,"5min":0.52300000000000002,"15min":0.41799999999999998},"max":{"1min":0.93100000000000005,"5min":1.1200000000000001,"15min":1.1890000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.56699999999999995,"5min":0.50600000000000001,"15min":0.503},"max":{"1min":0.96499999999999997,"5min":1.504,"15min":1.504},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76400000000000001,"15min":0.77000000000000002},"min":{"1min":0.55100000000000005,"5min":0.52900000000000003,"15min":0.436},"max":{"1min":0.878,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68000000000000005}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.755,"15min":0.77700000000000002},"min":{"1min":0.58399999999999996,"5min":0.52200000000000002,"15min":0.51400000000000001},"max":{"1min":0.90800000000000003,"5min":1.02,"15min":1.026},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76800000000000002,"15min":0.77600000000000002},"min":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.54000000000000004},"max":{"1min":1.0049999999999999,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.75700000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.77300000000000002,"5min":1.161,"15min":1.161},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.61299999999999999,"15min":0.61599999999999999},"min":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.41099999999999998},"max":{"1min":0.88,"5min":1.05,"15min":1.099},"last":0.58599999999999997}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.621,"15min":0.63200000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85999999999999999,"5min":0.95899999999999996,"15min":1.052},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.85299999999999998,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.67200000000000004,"15min":0.68799999999999994},"min":{"1min":0.499,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.90600000000000003,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69299999999999995,"15min":0.71199999999999997},"min":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":1.077},"last":0.89100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575290,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55336,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316504,"statfs":{"total":96636764160,"available":96580100096,"internally_reserved":0,"allocated":2195456,"data_stored":1129329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.47699999999999998,"5min":0.42599999999999999,"15min":0.41099999999999998},"max":{"1min":0.92900000000000005,"5min":1.012,"15min":1.012},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73799999999999999,"15min":0.752},"min":{"1min":0.45300000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.97999999999999998,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76400000000000001,"15min":0.76300000000000001},"min":{"1min":0.55300000000000005,"5min":0.52300000000000002,"15min":0.48499999999999999},"max":{"1min":0.98199999999999998,"5min":0.99399999999999999,"15min":1.05},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.73799999999999999,"15min":0.747},"min":{"1min":0.45900000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.76400000000000001}]},{"osd":2,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.76400000000000001,"15min":0.76600000000000001},"min":{"1min":0.60499999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.046,"5min":1.095,"15min":1.095},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.73399999999999999,"15min":0.73699999999999999},"min":{"1min":0.45800000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93600000000000005,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.75900000000000001,"15min":0.76900000000000002},"min":{"1min":0.504,"5min":0.496,"15min":0.49299999999999999},"max":{"1min":0.98399999999999999,"5min":1.008,"15min":1.034},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.75,"5min":0.76800000000000002,"15min":0.77300000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96499999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.64000000000000001}]},{"osd":4,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57299999999999995,"15min":0.56699999999999995},"min":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.61399999999999999},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.379},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.623,"15min":0.626},"min":{"1min":0.41699999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.748}]},{"osd":7,"last update":"Sun Jul 9 21:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.49199999999999999,"5min":0.46800000000000003,"15min":0.41799999999999998},"max":{"1min":1.056,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.68300000000000005,"15min":0.69899999999999995},"min":{"1min":0.48999999999999999,"5min":0.47399999999999998,"15min":0.41099999999999998},"max":{"1min":0.93400000000000005,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.81499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575292,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37300,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334540,"statfs":{"total":96636764160,"available":96598568960,"internally_reserved":0,"allocated":2207744,"data_stored":1130893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.745,"15min":0.747},"min":{"1min":0.61199999999999999,"5min":0.48999999999999999,"15min":0.41899999999999998},"max":{"1min":0.95199999999999996,"5min":0.996,"15min":1.075},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.73299999999999998,"15min":0.72799999999999998},"min":{"1min":0.57199999999999995,"5min":0.499,"15min":0.43099999999999999},"max":{"1min":0.86499999999999999,"5min":0.95499999999999996,"15min":0.98299999999999998},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.755,"15min":0.75600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95799999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.75900000000000001,"15min":0.753},"min":{"1min":0.54300000000000004,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.89900000000000002,"5min":0.998,"15min":1.119},"last":0.82099999999999995}]},{"osd":2,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.75,"15min":0.752},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.91400000000000003,"5min":1.0800000000000001,"15min":1.2},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.77700000000000002,"15min":0.77200000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":0.93999999999999995,"5min":1.03,"15min":1.0669999999999999},"last":0.876}]},{"osd":3,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.75900000000000001,"15min":0.74299999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.51300000000000001},"max":{"1min":0.92700000000000005,"5min":1.016,"15min":1.016},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.77700000000000002,"15min":0.77400000000000002},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.006,"5min":1.038,"15min":1.1599999999999999},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.41599999999999998,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.94299999999999995,"5min":1.05,"15min":1.079},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.624,"15min":0.60799999999999998},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.016,"15min":1.016},"last":0.76300000000000001}]},{"osd":6,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.63500000000000001,"15min":0.63400000000000001},"min":{"1min":0.498,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73599999999999999,"5min":0.96499999999999997,"15min":1.018},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.70999999999999996,"15min":0.67500000000000004},"min":{"1min":0.50700000000000001,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.97699999999999998,"5min":1.069,"15min":1.069},"last":0.91300000000000003}]},{"osd":7,"last update":"Sun Jul 9 21:59:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.49099999999999999,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":1.028,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.755,"15min":0.72399999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.91200000000000003,"5min":1.0389999999999999,"15min":1.044},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834575291,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37296,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334544,"statfs":{"total":96636764160,"available":96598573056,"internally_reserved":0,"allocated":2203648,"data_stored":1129945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48099999999999998,"15min":0.47699999999999998},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55300000000000005,"15min":0.55800000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.315},"max":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":1.113},"last":0.495}]},{"osd":1,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48799999999999999,"15min":0.48199999999999998},"min":{"1min":0.33300000000000002,"5min":0.32700000000000001,"15min":0.311},"max":{"1min":0.68200000000000005,"5min":0.73799999999999999,"15min":1.133},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54100000000000004,"15min":0.53300000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.45600000000000002}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60799999999999998,"15min":0.60399999999999998},"min":{"1min":0.42899999999999999,"5min":0.40200000000000002,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":1.0149999999999999,"15min":1.194},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.51300000000000001,"5min":0.49299999999999999,"15min":0.39600000000000002},"max":{"1min":0.89500000000000002,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.79800000000000004,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.135,"5min":1.1379999999999999,"15min":1.5429999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.85699999999999998,"15min":0.85599999999999998},"min":{"1min":0.624,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.133,"15min":1.5649999999999999},"last":0.747}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.1060000000000001,"5min":1.1479999999999999,"15min":1.302},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.82599999999999996,"15min":0.82199999999999995},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0660000000000001,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79800000000000004,"15min":0.80100000000000005},"min":{"1min":0.57699999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.101,"5min":1.1879999999999999,"15min":1.262},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.80100000000000005,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.079,"5min":1.161,"15min":1.363},"last":0.71699999999999997}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.80400000000000005,"15min":0.81299999999999994},"min":{"1min":0.55600000000000005,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.1779999999999999,"5min":1.2070000000000001,"15min":1.601},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.81399999999999995,"15min":0.81899999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.67300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575292,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55344,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316496,"statfs":{"total":96636764160,"available":96580091904,"internally_reserved":0,"allocated":2203648,"data_stored":1129441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.441,"15min":0.45800000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.61299999999999999,"5min":0.72199999999999998,"15min":0.96499999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54300000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.73499999999999999,"5min":0.79100000000000004,"15min":0.85099999999999998},"last":0.68000000000000005}]},{"osd":1,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.61099999999999999,"5min":0.748,"15min":0.77200000000000002},"last":0.629},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.437,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.65600000000000003,"5min":0.76300000000000001,"15min":0.99399999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57199999999999995,"15min":0.59299999999999997},"min":{"1min":0.45600000000000002,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.70399999999999996,"5min":0.78400000000000003,"15min":1.016},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.376,"5min":0.371,"15min":0.371},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":1.2290000000000001},"last":0.72599999999999998}]},{"osd":4,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.58999999999999997,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.022,"5min":1.117,"15min":1.337},"last":1.022},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.83099999999999996,"15min":0.82599999999999996},"min":{"1min":0.69899999999999995,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.306},"last":0.88200000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.85799999999999998,"15min":0.84299999999999997},"min":{"1min":0.66500000000000004,"5min":0.624,"15min":0.57699999999999996},"max":{"1min":1.276,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.64300000000000002,"5min":0.56799999999999995,"15min":0.52200000000000002},"max":{"1min":1.004,"5min":1.1739999999999999,"15min":1.375},"last":0.94699999999999995}]},{"osd":6,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83399999999999996,"15min":0.83499999999999996},"min":{"1min":0.63600000000000001,"5min":0.58799999999999997,"15min":0.57099999999999995},"max":{"1min":1.0589999999999999,"5min":1.1990000000000001,"15min":1.2529999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.83099999999999996},"min":{"1min":0.59499999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.294},"last":1.0669999999999999}]},{"osd":7,"last update":"Sun Jul 9 21:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.81899999999999995,"15min":0.82999999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.115,"5min":1.2809999999999999,"15min":1.298},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.87,"5min":0.85899999999999999,"15min":0.86199999999999999},"min":{"1min":0.746,"5min":0.624,"15min":0.61399999999999999},"max":{"1min":1.1180000000000001,"5min":1.196,"15min":1.256},"last":1.0549999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575292,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37292,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334548,"statfs":{"total":96636764160,"available":96598577152,"internally_reserved":0,"allocated":2199552,"data_stored":1129399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.32700000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65100000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.54100000000000004,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80600000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.497,"15min":0.48899999999999999},"min":{"1min":0.34200000000000003,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.63100000000000001,"5min":0.72599999999999998,"15min":0.81799999999999995},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56399999999999995},"min":{"1min":0.42399999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76600000000000001,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45900000000000002}]},{"osd":3,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.628,"15min":0.61299999999999999},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.73299999999999998,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82899999999999996,"15min":0.83099999999999996},"min":{"1min":0.60199999999999998,"5min":0.58599999999999997,"15min":0.53800000000000003},"max":{"1min":1.024,"5min":1.1180000000000001,"15min":1.1890000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.871,"5min":0.85399999999999998,"15min":0.84299999999999997},"min":{"1min":0.70899999999999996,"5min":0.56000000000000005,"15min":0.42699999999999999},"max":{"1min":1.101,"5min":1.2769999999999999,"15min":1.337},"last":0.85299999999999998}]},{"osd":5,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81899999999999995,"15min":0.81499999999999995},"min":{"1min":0.64800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.97099999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.67200000000000004}]},{"osd":6,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79400000000000004,"15min":0.79300000000000004},"min":{"1min":0.66200000000000003,"5min":0.55100000000000005,"15min":0.48899999999999999},"max":{"1min":1.071,"5min":1.071,"15min":1.1160000000000001},"last":0.754},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.66700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.099,"5min":1.157,"15min":1.1659999999999999},"last":0.81799999999999995}]},{"osd":7,"last update":"Sun Jul 9 21:59:24 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.82399999999999995},"min":{"1min":0.69399999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93300000000000005,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.83299999999999996,"15min":0.83399999999999996},"min":{"1min":0.62,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":1.0640000000000001,"5min":1.321,"15min":1.321},"last":0.71399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575292,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41988,"kb_used_data":2748,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329852,"statfs":{"total":96636764160,"available":96593768448,"internally_reserved":0,"allocated":2813952,"data_stored":1721967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.57099999999999995,"5min":0.73599999999999999,"15min":0.89300000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.63700000000000001,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59099999999999997}]},{"osd":2,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.53500000000000003,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83099999999999996,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56599999999999995,"15min":0.56399999999999995},"min":{"1min":0.379,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65400000000000003,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.54600000000000004}]},{"osd":3,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.52200000000000002,"15min":0.52000000000000002},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.69099999999999995,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.629,"15min":0.61299999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.75700000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.627}]},{"osd":4,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.81100000000000005,"15min":0.80400000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.91000000000000003,"5min":1.306,"15min":1.306},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.80300000000000005,"15min":0.80700000000000005},"min":{"1min":0.58899999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.88600000000000001,"5min":1.1839999999999999,"15min":1.3600000000000001},"last":0.76000000000000001}]},{"osd":5,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.82099999999999995,"15min":0.81200000000000006},"min":{"1min":0.624,"5min":0.503,"15min":0.503},"max":{"1min":0.93200000000000005,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.83499999999999996,"15min":0.82399999999999995},"min":{"1min":0.65500000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94199999999999995,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.879}]},{"osd":6,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.81299999999999994,"15min":0.81000000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.50700000000000001},"max":{"1min":0.92400000000000004,"5min":1.3260000000000001,"15min":1.381},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.83399999999999996,"15min":0.82499999999999996},"min":{"1min":0.67700000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.95999999999999996,"5min":1.1739999999999999,"15min":1.1990000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Sun Jul 9 21:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.85099999999999998,"15min":0.84299999999999997},"min":{"1min":0.64800000000000002,"5min":0.63900000000000001,"15min":0.55000000000000004},"max":{"1min":0.873,"5min":1.2470000000000001,"15min":1.3400000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.59199999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.98399999999999999,"5min":1.397,"15min":1.397},"last":0.94699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T21:59:49.166 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T21:59:49.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T21:59:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 Processor -- start 2023-07-09T21:59:49.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 -- start start 2023-07-09T21:59:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f945c0b7980 0x7f945c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c15bf80 con 0x7f945c0d0780 2023-07-09T21:59:49.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945c160570 con 0x7f945c0ceb80 2023-07-09T21:59:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f94623ac640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945c0cd070 con 0x7f945c0b7980 2023-07-09T21:59:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f945c0d0780 0x7f945c0d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54762/0 (socket says 172.21.15.37:54762) 2023-07-09T21:59:49.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 -- 172.21.15.37:0/3688917890 learned_addr learned my addr 172.21.15.37:0/3688917890 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:49.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945bfff640 1 --2- 172.21.15.37:0/3688917890 >> v2:172.21.15.119:3300/0 conn(0x7f945c0b7980 0x7f945c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126635708 0 0) 0x7f94540014a0 con 0x7f945c0d0780 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9448003530 con 0x7f945c0d0780 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2358197137 0 0) 0x7f9448003530 con 0x7f945c0d0780 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 >> v2:172.21.15.119:3300/0 conn(0x7f945c0b7980 msgr2=0x7f945c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 --2- 172.21.15.37:0/3688917890 >> v2:172.21.15.119:3300/0 conn(0x7f945c0b7980 0x7f945c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 >> v1:172.21.15.119:6789/0 conn(0x7f945c0ceb80 legacy=0x7f945c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0d02f0 con 0x7f945c0d0780 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f9454001b90 con 0x7f945c0d0780 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 >> v1:172.21.15.37:6789/0 conn(0x7f945c0d0780 legacy=0x7f945c0d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448003980 0x7f9448003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480047d0 0x7f9448004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 0x7f944800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0cd070 con 0x7f9448005180 2023-07-09T21:59:49.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f944800c000 con 0x7f9448003980 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f944800c1c0 con 0x7f94480047d0 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 0x7f944800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f945bfff640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448003980 0x7f9448003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9453fff640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480047d0 0x7f9448004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 -- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480047d0 msgr2=0x7f9448004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f94480047d0 0x7f9448004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 -- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448003980 msgr2=0x7f9448003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9448003980 0x7f9448003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.347+0000 7f9460949640 1 -- 172.21.15.37:0/3688917890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9448003530 con 0x7f9448005180 2023-07-09T21:59:49.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f9460949640 1 -- 172.21.15.37:0/3688917890 reap_dead start 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f9460949640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 0x7f944800b990 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f945400a830 tx=0x7f945401d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398390b6f316384 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ad630 con 0x7f9448005180 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540a8070 con 0x7f9448005180 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f945b7fe640 1 -- 172.21.15.37:0/3688917890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ad9f0 con 0x7f9448005180 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 -- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 msgr2=0x7f944800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 0x7f944800b990 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f945400a830 tx=0x7f945401d340 comp rx=0 tx=0).stop 2023-07-09T21:59:49.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 -- 172.21.15.37:0/3688917890 shutdown_connections 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 --2- 172.21.15.37:0/3688917890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9448005180 0x7f944800b990 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 -- 172.21.15.37:0/3688917890 >> 172.21.15.37:0/3688917890 conn(0x7f945c073090 msgr2=0x7f945c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 -- 172.21.15.37:0/3688917890 shutdown_connections 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.351+0000 7f94623ac640 1 -- 172.21.15.37:0/3688917890 wait complete. 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 Processor -- start 2023-07-09T21:59:49.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- start start 2023-07-09T21:59:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448005180 0x7f945c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f945c156790 0x7f945c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c14caa0 con 0x7f945c15c120 2023-07-09T21:59:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c6f80 con 0x7f945c156790 2023-07-09T21:59:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945c0c7260 con 0x7f9448005180 2023-07-09T21:59:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46614/0 (socket says 172.21.15.37:46614) 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 -- 172.21.15.37:0/1497497539 learned_addr learned my addr 172.21.15.37:0/1497497539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 -- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448005180 msgr2=0x7f945c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448005180 0x7f945c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 -- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f945c156790 msgr2=0x7f945c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f945c156790 0x7f945c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 -- 172.21.15.37:0/1497497539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945c0c7540 con 0x7f945c15c120 2023-07-09T21:59:49.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f9460949640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f945401dbe0 tx=0x7f9448005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ad430 con 0x7f945c15c120 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540ad590 con 0x7f945c15c120 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945c14caa0 con 0x7f945c15c120 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ad900 con 0x7f945c15c120 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945c0c7b00 con 0x7f945c15c120 2023-07-09T21:59:49.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.355+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945c0ce720 con 0x7f945c15c120 2023-07-09T21:59:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.359+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f94540aa030 con 0x7f945c15c120 2023-07-09T21:59:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.359+0000 7f94597fa640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 0x7f943c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.359+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f945411dff0 con 0x7f945c15c120 2023-07-09T21:59:49.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.359+0000 7f945bfff640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 0x7f943c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.359+0000 7f945bfff640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 0x7f943c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f944c009490 tx=0x7f944c009340 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.363+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94540eb220 con 0x7f945c15c120 2023-07-09T21:59:49.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.575+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f945c15bf80 con 0x7f945c15c120 2023-07-09T21:59:49.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94597fa640 1 -- 172.21.15.37:0/1497497539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v31) v1 ==== 190+0+147 (secure 0 0 0) 0x7f945c15bf80 con 0x7f945c15c120 2023-07-09T21:59:49.585 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T21:59:49.586 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T21:59:49.586 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T21:59:49.586 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T21:59:49.586 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T21:59:49.586 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T21:59:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 msgr2=0x7f943c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 0x7f943c068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f944c009490 tx=0x7f944c009340 comp rx=0 tx=0).stop 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 msgr2=0x7f945c15a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f945401dbe0 tx=0x7f9448005800 comp rx=0 tx=0).stop 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 shutdown_connections 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f943c0663a0 0x7f943c068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f945c15c120 0x7f945c15a070 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f945c156790 0x7f945c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 --2- 172.21.15.37:0/1497497539 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9448005180 0x7f945c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 >> 172.21.15.37:0/1497497539 conn(0x7f945c073090 msgr2=0x7f945c0d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:49.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 shutdown_connections 2023-07-09T21:59:49.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.583+0000 7f94623ac640 1 -- 172.21.15.37:0/1497497539 wait complete. 2023-07-09T21:59:49.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T21:59:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 Processor -- start 2023-07-09T21:59:49.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 -- start start 2023-07-09T21:59:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fde0406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fde040cef80 0x7fde040d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde040b49f0 con 0x7fde040b7ab0 2023-07-09T21:59:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde040b7e80 con 0x7fde040cef80 2023-07-09T21:59:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0c3e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cc8a0 con 0x7fde040b4340 2023-07-09T21:59:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0a185640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fde040b7ab0 0x7fde040b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54778/0 (socket says 172.21.15.37:54778) 2023-07-09T21:59:49.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0a185640 1 -- 172.21.15.37:0/741752937 learned_addr learned my addr 172.21.15.37:0/741752937 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631096139 0 0) 0x7fde040b49f0 con 0x7fde040b7ab0 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09984640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fde0406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde0a986640 1 --2- 172.21.15.37:0/741752937 >> v2:172.21.15.119:3300/0 conn(0x7fde040cef80 0x7fde040d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003530 con 0x7fde040b7ab0 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3094354463 0 0) 0x7fddf0003530 con 0x7fde040b7ab0 2023-07-09T21:59:49.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 msgr2=0x7fde0406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fde0406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 >> v2:172.21.15.119:3300/0 conn(0x7fde040cef80 msgr2=0x7fde040d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 --2- 172.21.15.37:0/741752937 >> v2:172.21.15.119:3300/0 conn(0x7fde040cef80 0x7fde040d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040ccb80 con 0x7fde040b7ab0 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fde00001680 con 0x7fde040b7ab0 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 >> v1:172.21.15.37:6789/0 conn(0x7fde040b7ab0 legacy=0x7fde040b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.747+0000 7fde09183640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0003980 0x7fddf0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf0004320 0x7fddf00047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fddf0004ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040cc8a0 con 0x7fddf0004320 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf0005600 con 0x7fddf0003980 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf000b990 con 0x7fde040b4340 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf0004320 0x7fddf00047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde0a986640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fddf0004ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde0a185640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0003980 0x7fddf0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 -- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 msgr2=0x7fddf0004ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde040b4340 0x7fddf0004ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 -- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0003980 msgr2=0x7fddf0003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0003980 0x7fddf0003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 -- 172.21.15.37:0/741752937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0003530 con 0x7fddf0004320 2023-07-09T21:59:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09984640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf0004320 0x7fddf00047f0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fde0406af90 tx=0x7fddf401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ddfb7995dd685 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40a64e0 con 0x7fddf0004320 2023-07-09T21:59:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40a6640 con 0x7fddf0004320 2023-07-09T21:59:49.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.751+0000 7fde09183640 1 -- 172.21.15.37:0/741752937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40a69b0 con 0x7fddf0004320 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- 172.21.15.37:0/741752937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf0004320 msgr2=0x7fddf00047f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/741752937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fddf0004320 0x7fddf00047f0 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fde0406af90 tx=0x7fddf401c9f0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0a986640 1 -- 172.21.15.37:0/741752937 reap_dead start 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- 172.21.15.37:0/741752937 shutdown_connections 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- 172.21.15.37:0/741752937 >> 172.21.15.37:0/741752937 conn(0x7fde04073090 msgr2=0x7fde04069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- 172.21.15.37:0/741752937 shutdown_connections 2023-07-09T21:59:49.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- 172.21.15.37:0/741752937 wait complete. 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 Processor -- start 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- start start 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0004320 0x7fde04158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde0415d4c0 0x7fde0415d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c79e0 con 0x7fde040c60b0 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c6e60 con 0x7fddf0004320 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0c3e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde040c7140 con 0x7fde0415d4c0 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde09984640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde09984640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46630/0 (socket says 172.21.15.37:46630) 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde09984640 1 -- 172.21.15.37:0/419600831 learned_addr learned my addr 172.21.15.37:0/419600831 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0a986640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde0415d4c0 0x7fde0415d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.755+0000 7fde0a185640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0004320 0x7fde04158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 -- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde0415d4c0 msgr2=0x7fde0415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde0415d4c0 0x7fde0415d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 -- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0004320 msgr2=0x7fde04158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0004320 0x7fde04158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 -- 172.21.15.37:0/419600831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde040c7420 con 0x7fde040c60b0 2023-07-09T21:59:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde09984640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fddf40b0040 tx=0x7fddf0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf40a6c80 con 0x7fde040c60b0 2023-07-09T21:59:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf40a6e00 con 0x7fde040c60b0 2023-07-09T21:59:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf4006280 con 0x7fde040c60b0 2023-07-09T21:59:49.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde040c7700 con 0x7fde040c60b0 2023-07-09T21:59:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde040c6a60 con 0x7fde040c60b0 2023-07-09T21:59:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0415d130 con 0x7fde040c60b0 2023-07-09T21:59:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fddf40063e0 con 0x7fde040c60b0 2023-07-09T21:59:49.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 0x7fdde8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.759+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fddf40aa070 con 0x7fde040c60b0 2023-07-09T21:59:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.763+0000 7fde0a185640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 0x7fdde8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:49.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.763+0000 7fde0a185640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 0x7fdde8068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde00008ad0 tx=0x7fde00008cb0 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:49.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.763+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fddf40ec330 con 0x7fde040c60b0 2023-07-09T21:59:49.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde0404d7d0 con 0x7fde040c60b0 2023-07-09T21:59:49.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fddfaffd640 1 -- 172.21.15.37:0/419600831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7fddf40ef950 con 0x7fde040c60b0 2023-07-09T21:59:49.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:49.956 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T21:59:49.956 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 msgr2=0x7fdde8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 0x7fdde8068880 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde00008ad0 tx=0x7fde00008cb0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 msgr2=0x7fde040c6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fddf40b0040 tx=0x7fddf0005800 comp rx=0 tx=0).stop 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 shutdown_connections 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fdde80663d0 0x7fdde8068880 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde0415d4c0 0x7fde0415d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde040c60b0 0x7fde040c6520 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 --2- 172.21.15.37:0/419600831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fddf0004320 0x7fde04158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 >> 172.21.15.37:0/419600831 conn(0x7fde04073090 msgr2=0x7fde040b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 shutdown_connections 2023-07-09T21:59:49.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:49.951+0000 7fde0c3e9640 1 -- 172.21.15.37:0/419600831 wait complete. 2023-07-09T21:59:50.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T21:59:39.435714+0000', 'modified': '2023-07-09T21:59:43.088709+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10194}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10194': {'gid': 10194, 'name': 'c', 'rank': 0, 'incarnation': 73, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/649009446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 649009446}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 649009446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T21:59:50.378 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T21:59:50.379 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-07-09T21:59:50.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.519+0000 7fe1030d8640 1 Processor -- start 2023-07-09T21:59:50.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.519+0000 7fe1030d8640 1 -- start start 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b7a60 0x7fe0fc0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe0fc0b4140 0x7fe0fc15f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0b45b0 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0fc0cef80 con 0x7fe0fc0b4140 2023-07-09T21:59:50.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe1030d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0cf260 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46634/0 (socket says 172.21.15.37:46634) 2023-07-09T21:59:50.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2202535059 learned_addr learned my addr 172.21.15.37:0/2202535059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe101675640 1 --2- 172.21.15.37:0/2202535059 >> v2:172.21.15.119:3300/0 conn(0x7fe0fc0b4140 0x7fe0fc15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe100e74640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b7a60 0x7fe0fc0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2202535059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b7a60 msgr2=0x7fe0fc0cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b7a60 0x7fe0fc0cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2202535059 >> v2:172.21.15.119:3300/0 conn(0x7fe0fc0b4140 msgr2=0x7fe0fc15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2202535059 >> v2:172.21.15.119:3300/0 conn(0x7fe0fc0b4140 0x7fe0fc15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.523+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2202535059 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0fc0cf540 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc160650 tx=0x7fe0e801c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7cf073ab2c5030 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe0fb7fe640 1 -- 172.21.15.37:0/2202535059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80ab600 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe0fb7fe640 1 -- 172.21.15.37:0/2202535059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e80a7050 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe0fb7fe640 1 -- 172.21.15.37:0/2202535059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80ab980 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- 172.21.15.37:0/2202535059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b47a0 msgr2=0x7fe0fc0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe0fc160650 tx=0x7fe0e801c240 comp rx=0 tx=0).stop 2023-07-09T21:59:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- 172.21.15.37:0/2202535059 shutdown_connections 2023-07-09T21:59:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0b3c00 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2202535059 >> v2:172.21.15.119:3300/0 conn(0x7fe0fc0b4140 0x7fe0fc15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2202535059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b7a60 0x7fe0fc0cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- 172.21.15.37:0/2202535059 >> 172.21.15.37:0/2202535059 conn(0x7fe0fc073050 msgr2=0x7fe0fc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- 172.21.15.37:0/2202535059 shutdown_connections 2023-07-09T21:59:50.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- 172.21.15.37:0/2202535059 wait complete. 2023-07-09T21:59:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 Processor -- start 2023-07-09T21:59:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.527+0000 7fe1030d8640 1 -- start start 2023-07-09T21:59:50.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b4140 0x7fe0fc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc15c5b0 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0cc420 con 0x7fe0fc0b47a0 2023-07-09T21:59:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0fc0cbc20 con 0x7fe0fc0b4140 2023-07-09T21:59:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46648/0 (socket says 172.21.15.37:46648) 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 -- 172.21.15.37:0/2841286245 learned_addr learned my addr 172.21.15.37:0/2841286245 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe100e74640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b4140 0x7fe0fc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 -- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b4140 msgr2=0x7fe0fc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b4140 0x7fe0fc15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 -- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc0b47a0 msgr2=0x7fe0fc0ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 -- 172.21.15.37:0/2841286245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e80094d0 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe101675640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e850 tx=0x7fe0f400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe0f97fa640 1 -- 172.21.15.37:0/2841286245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4009630 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe0f97fa640 1 -- 172.21.15.37:0/2841286245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f400c940 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0fc0cc6c0 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe0f97fa640 1 -- 172.21.15.37:0/2841286245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400ccd0 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.531+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0cbf00 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0f97fa640 1 -- 172.21.15.37:0/2841286245 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe0f4013470 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0f97fa640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 0x7fe0e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0f97fa640 1 -- 172.21.15.37:0/2841286245 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fe0f4083ff0 con 0x7fe0fc0b7a60 2023-07-09T21:59:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe100e74640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 0x7fe0e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 Processor -- start 2023-07-09T21:59:50.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 -- start start 2023-07-09T21:59:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe100e74640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 0x7fe0e0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0011340 tx=0x7fe0f000b040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c76f800 0x55d17c76fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c770110 0x55d17c725a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c5ecf80 con 0x55d17c725f90 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c526c60 con 0x55d17c76f800 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d17c57a700 con 0x55d17c770110 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe100e74640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c76f800 0x55d17c76fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46654/0 (socket says 172.21.15.37:46654) 2023-07-09T21:59:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 -- 172.21.15.37:0/2300298208 learned_addr learned my addr 172.21.15.37:0/2300298208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c770110 0x55d17c725a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 -- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c770110 msgr2=0x55d17c725a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c770110 0x55d17c725a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 -- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c76f800 msgr2=0x55d17c76fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c76f800 0x55d17c76fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 -- 172.21.15.37:0/2300298208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d17c26f890 con 0x55d17c725f90 2023-07-09T21:59:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe101675640 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe0f405ce10 tx=0x7fe0f4059130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90cd6a18f8f042 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0e67fc640 1 -- 172.21.15.37:0/2300298208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40822f0 con 0x55d17c725f90 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0e67fc640 1 -- 172.21.15.37:0/2300298208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f4082450 con 0x55d17c725f90 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.535+0000 7fe0e67fc640 1 -- 172.21.15.37:0/2300298208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4050e90 con 0x55d17c725f90 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2300298208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 msgr2=0x55d17c726360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fe0f405ce10 tx=0x7fe0f4059130 comp rx=0 tx=0).stop 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2300298208 shutdown_connections 2023-07-09T21:59:50.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c726360 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c770110 0x55d17c725a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- 172.21.15.37:0/2300298208 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c76f800 0x55d17c76fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2300298208 >> 172.21.15.37:0/2300298208 conn(0x55d17c5e8a70 msgr2=0x55d17c724330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2300298208 shutdown_connections 2023-07-09T21:59:50.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2300298208 wait complete. 2023-07-09T21:59:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- start start 2023-07-09T21:59:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 Processor -- start 2023-07-09T21:59:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c731510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c731a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c5737a0 con 0x55d17c725f90 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c52ff00 con 0x55d17c770110 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d17c52fba0 con 0x55d17c76f800 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 10 client.0 _ll_register_callbacks cb 0x55d17c711930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:59:50.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46670/0 (socket says 172.21.15.37:46670) 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 -- 172.21.15.37:0/2864059417 learned_addr learned my addr 172.21.15.37:0/2864059417 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c731510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe101675640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c731a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 -- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 msgr2=0x55d17c731510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c731510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 -- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 msgr2=0x55d17c731a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c731a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 -- 172.21.15.37:0/2864059417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0fc0cbf00 con 0x55d17c725f90 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe100e74640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00045f0 tx=0x7fe0f0004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e9ef27a102abcc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe0db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f001c040 con 0x55d17c725f90 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fe0f0023420 con 0x55d17c725f90 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.539+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d17c5720f0 con 0x55d17c725f90 2023-07-09T21:59:50.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0f000e040 con 0x55d17c725f90 2023-07-09T21:59:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 10 client.10365 fetch_fsmap learned FSMap version 76 2023-07-09T21:59:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55d17c538130 con 0x55d17c725f90 2023-07-09T21:59:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d17c5720f0 con 0x55d17c725f90 2023-07-09T21:59:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe0f00235e0 con 0x55d17c725f90 2023-07-09T21:59:50.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 10 client.10365 fetch_fsmap finished waiting for FSMap version 76 2023-07-09T21:59:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 10 client.10365 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:59:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 20 client.10365 populate_metadata read hostname 'smithi037' 2023-07-09T21:59:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7322f0 0x55d17c780d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 4 client.10365 mds_command: new command op to 10194 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T21:59:50.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 --> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d17c53ae40 con 0x55d17c7322f0 2023-07-09T21:59:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7322f0 0x55d17c780d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7322f0 0x55d17c780d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1cfaa12120e71790 server_cookie=6bb0be5a9282965 in_seq=0 out_seq=0 2023-07-09T21:59:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 10 client.10365 ms_handle_connect on v2:172.21.15.37:6834/649009446 2023-07-09T21:59:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2864059417 <== mds.0 v2:172.21.15.37:6834/649009446 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d17c53ae40 con 0x55d17c7322f0 2023-07-09T21:59:50.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 10 client.10365 handle_command_reply: tid=0 2023-07-09T21:59:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 client.10365 shutdown 2023-07-09T21:59:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 msgr2=0x55d17c730fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fe0f00045f0 tx=0x7fe0f0004a50 comp rx=0 tx=0).stop 2023-07-09T21:59:50.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 shutdown_connections 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c731a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c731510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7322f0 0x55d17c780d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 --2- 172.21.15.37:0/2864059417 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c725f90 0x55d17c730fd0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 >> 172.21.15.37:0/2864059417 conn(0x55d17c5e8a70 msgr2=0x55d17c724a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe0db7fe640 0 client.10365 ms_handle_reset on v2:172.21.15.37:6834/649009446 2023-07-09T21:59:50.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 shutdown_connections 2023-07-09T21:59:50.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 1 -- 172.21.15.37:0/2864059417 wait complete. 2023-07-09T21:59:50.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.543+0000 7fe106450000 20 client.10365 trim_cache size 0 max 16384 2023-07-09T21:59:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 Processor -- start 2023-07-09T21:59:50.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 -- start start 2023-07-09T21:59:50.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c725f90 0x55d17c782470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c7829b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c230940 con 0x55d17c770110 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c72a510 con 0x55d17c725f90 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d17c542230 con 0x55d17c76f800 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46674/0 (socket says 172.21.15.37:46674) 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 -- 172.21.15.37:0/598647092 learned_addr learned my addr 172.21.15.37:0/598647092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c7829b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe100e74640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c725f90 0x55d17c782470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 -- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 msgr2=0x55d17c7829b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c7829b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 -- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c725f90 msgr2=0x55d17c782470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c725f90 0x55d17c782470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe101675640 1 -- 172.21.15.37:0/598647092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d17c51e3c0 con 0x55d17c770110 2023-07-09T21:59:50.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.559+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c7829b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe101675640 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c520 tx=0x7fe0f401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b646ad02daf95407 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0e6ffd640 1 -- 172.21.15.37:0/598647092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4054e70 con 0x55d17c770110 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0e6ffd640 1 -- 172.21.15.37:0/598647092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f40517b0 con 0x55d17c770110 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0e6ffd640 1 -- 172.21.15.37:0/598647092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f4051920 con 0x55d17c770110 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- 172.21.15.37:0/598647092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 msgr2=0x55d17c76a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400c520 tx=0x7fe0f401d000 comp rx=0 tx=0).stop 2023-07-09T21:59:50.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- 172.21.15.37:0/598647092 shutdown_connections 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c770110 0x55d17c76a880 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c76f800 0x55d17c7829b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- 172.21.15.37:0/598647092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c725f90 0x55d17c782470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- 172.21.15.37:0/598647092 >> 172.21.15.37:0/598647092 conn(0x55d17c5e8a70 msgr2=0x55d17c780d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- 172.21.15.37:0/598647092 shutdown_connections 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- 172.21.15.37:0/598647092 wait complete. 2023-07-09T21:59:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- start start 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 Processor -- start 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 0x55d17c7cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c76d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c510ea0 con 0x55d17c76f800 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d17c542740 con 0x55d17c770110 2023-07-09T21:59:50.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d17c643db0 con 0x55d17c725f90 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe106450000 10 client.0 _ll_register_callbacks cb 0x55d17c6f24d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46678/0 (socket says 172.21.15.37:46678) 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2166618824 learned_addr learned my addr 172.21.15.37:0/2166618824 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe101675640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c76d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe100e74640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 0x55d17c7cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 msgr2=0x55d17c7cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 0x55d17c7cd200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 msgr2=0x55d17c76d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c76d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 -- 172.21.15.37:0/2166618824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d17c26f890 con 0x55d17c76f800 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe100e74640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 0x55d17c7cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0fbfff640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fe0e801a8f0 tx=0x7fe0e801aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562937147f1ac867 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.563+0000 7fe0db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e80bc040 con 0x55d17c76f800 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d17c7298e0 con 0x55d17c76f800 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fe0e8004140 con 0x55d17c76f800 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe0e8004340 con 0x55d17c76f800 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 10 client.10371 fetch_fsmap learned FSMap version 76 2023-07-09T21:59:50.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) v3 -- 0x55d17c26fcc0 con 0x55d17c76f800 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d17c7298e0 con 0x55d17c76f800 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 76) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe0e80bf870 con 0x55d17c76f800 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 10 client.10371 fetch_fsmap finished waiting for FSMap version 76 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 10 client.10371 resolve_mds: resolved name 'c' to daemon mds.c 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 20 client.10371 populate_metadata read hostname 'smithi037' 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7d4060 0x55d17c7d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 4 client.10371 mds_command: new command op to 10194 tid=0[{"prefix": "status"}] 2023-07-09T21:59:50.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 --> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d17c52c6f0 con 0x55d17c7d4060 2023-07-09T21:59:50.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe100e74640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7d4060 0x55d17c7d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe100e74640 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7d4060 0x55d17c7d6440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f889c207561fbdbe server_cookie=270b8f6333b7c6f7 in_seq=0 out_seq=0 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 10 client.10371 ms_handle_connect on v2:172.21.15.37:6834/649009446 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 1 -- 172.21.15.37:0/2166618824 <== mds.0 v2:172.21.15.37:6834/649009446 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55d17c52c6f0 con 0x55d17c7d4060 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 10 client.10371 handle_command_reply: tid=0 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 client.10371 shutdown 2023-07-09T21:59:50.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 msgr2=0x55d17c7cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fe0e801a8f0 tx=0x7fe0e801aa80 comp rx=0 tx=0).stop 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 shutdown_connections 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x55d17c770110 0x55d17c76d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:6834/649009446,v1:172.21.15.37:6835/649009446] conn(0x55d17c7d4060 0x55d17c7d6440 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d17c76f800 0x55d17c7cd740 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 --2- 172.21.15.37:0/2166618824 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x55d17c725f90 0x55d17c7cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 >> 172.21.15.37:0/2166618824 conn(0x55d17c5e8a70 msgr2=0x55d17c7815e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe0db7fe640 0 client.10371 ms_handle_reset on v2:172.21.15.37:6834/649009446 2023-07-09T21:59:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 shutdown_connections 2023-07-09T21:59:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 1 -- 172.21.15.37:0/2166618824 wait complete. 2023-07-09T21:59:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe106450000 20 client.10371 trim_cache size 0 max 16384 2023-07-09T21:59:50.582 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:59:50.582 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T21:59:50.582 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T21:59:50.582 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 10194, 2023-07-09T21:59:50.582 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.500376041000001, 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 76, 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 176, 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 176, 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.428070380000001 2023-07-09T21:59:50.583 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:59:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 msgr2=0x7fe0e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 0x7fe0e0068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe0f0011340 tx=0x7fe0f000b040 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 msgr2=0x7fe0fc0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400e850 tx=0x7fe0f400ed10 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 shutdown_connections 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe0e00663a0 0x7fe0e0068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0fc0b7a60 0x7fe0fc0caad0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe0fc0b47a0 0x7fe0fc0ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 --2- 172.21.15.37:0/2841286245 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe0fc0b4140 0x7fe0fc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 >> 172.21.15.37:0/2841286245 conn(0x7fe0fc073050 msgr2=0x7fe0fc0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 shutdown_connections 2023-07-09T21:59:50.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.567+0000 7fe1030d8640 1 -- 172.21.15.37:0/2841286245 wait complete. 2023-07-09T21:59:50.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T21:59:50.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 Processor -- start 2023-07-09T21:59:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 -- start start 2023-07-09T21:59:50.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac900ce1a0 0x7fac90069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac900ccd40 con 0x7fac900b7810 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9006a680 con 0x7fac9006a280 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac95ef7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac900cc5a0 con 0x7fac900ce1a0 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac8ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac900ce1a0 0x7fac90069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac94ef5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac900b7810 0x7fac9015fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54790/0 (socket says 172.21.15.37:54790) 2023-07-09T21:59:50.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac94ef5640 1 -- 172.21.15.37:0/1144814094 learned_addr learned my addr 172.21.15.37:0/1144814094 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:50.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac8ffff640 1 -- 172.21.15.37:0/1144814094 >> v1:172.21.15.119:6789/0 conn(0x7fac9006a280 legacy=0x7fac900cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac8ffff640 1 -- 172.21.15.37:0/1144814094 >> v1:172.21.15.37:6789/0 conn(0x7fac900b7810 legacy=0x7fac9015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac8ffff640 1 -- 172.21.15.37:0/1144814094 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac900ce680 con 0x7fac900ce1a0 2023-07-09T21:59:50.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.731+0000 7fac8f7fe640 1 -- 172.21.15.37:0/1144814094 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865833361 0 0) 0x7fac900ccd40 con 0x7fac900b7810 2023-07-09T21:59:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac8ffff640 1 --2- 172.21.15.37:0/1144814094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900ce1a0 0x7fac90069d40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0097c0 tx=0x7fac7c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abba0738d57afed1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac8f7fe640 1 -- 172.21.15.37:0/1144814094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0ab650 con 0x7fac900ce1a0 2023-07-09T21:59:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac8f7fe640 1 -- 172.21.15.37:0/1144814094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0ab7b0 con 0x7fac900ce1a0 2023-07-09T21:59:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac8f7fe640 1 -- 172.21.15.37:0/1144814094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0abb40 con 0x7fac900ce1a0 2023-07-09T21:59:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 -- 172.21.15.37:0/1144814094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900ce1a0 msgr2=0x7fac90069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 --2- 172.21.15.37:0/1144814094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900ce1a0 0x7fac90069d40 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0097c0 tx=0x7fac7c01c450 comp rx=0 tx=0).stop 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 -- 172.21.15.37:0/1144814094 shutdown_connections 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 --2- 172.21.15.37:0/1144814094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900ce1a0 0x7fac90069d40 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 -- 172.21.15.37:0/1144814094 >> 172.21.15.37:0/1144814094 conn(0x7fac900cea60 msgr2=0x7fac900cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 -- 172.21.15.37:0/1144814094 shutdown_connections 2023-07-09T21:59:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.735+0000 7fac95ef7640 1 -- 172.21.15.37:0/1144814094 wait complete. 2023-07-09T21:59:50.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 Processor -- start 2023-07-09T21:59:50.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- start start 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 0x7fac901f38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 0x7fac900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac901f6e60 con 0x7fac900b7810 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac901f7100 con 0x7fac900ce1a0 2023-07-09T21:59:50.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac901f73e0 con 0x7fac9006a280 2023-07-09T21:59:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46708/0 (socket says 172.21.15.37:46708) 2023-07-09T21:59:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 -- 172.21.15.37:0/2230433454 learned_addr learned my addr 172.21.15.37:0/2230433454 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac94ef5640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 0x7fac901f38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac956f6640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 0x7fac900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 -- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 msgr2=0x7fac901f38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 0x7fac901f38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 -- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 msgr2=0x7fac900b4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 0x7fac900b4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 -- 172.21.15.37:0/2230433454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009420 con 0x7fac900b7810 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac956f6640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 0x7fac900b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac94ef5640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 0x7fac901f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8ffff640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0ad040 tx=0x7fac7c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0b5810 con 0x7fac900b7810 2023-07-09T21:59:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0b5970 con 0x7fac900b7810 2023-07-09T21:59:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac901f76c0 con 0x7fac900b7810 2023-07-09T21:59:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c0b5d20 con 0x7fac900b7810 2023-07-09T21:59:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac901f7c80 con 0x7fac900b7810 2023-07-09T21:59:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.739+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9004e020 con 0x7fac900b7810 2023-07-09T21:59:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.743+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac7c0bf410 con 0x7fac900b7810 2023-07-09T21:59:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.743+0000 7fac8d7fa640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 0x7fac74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.743+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fac7c11efd0 con 0x7fac900b7810 2023-07-09T21:59:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.743+0000 7fac94ef5640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 0x7fac74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.743+0000 7fac94ef5640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 0x7fac74068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac84000f70 tx=0x7fac84009040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.747+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac7c0ec4b0 con 0x7fac900b7810 2023-07-09T21:59:50.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.931+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac9006bfa0 con 0x7fac900b7810 2023-07-09T21:59:50.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac8d7fa640 1 -- 172.21.15.37:0/2230433454 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac7c0efad0 con 0x7fac900b7810 2023-07-09T21:59:50.937 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T21:59:50.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 msgr2=0x7fac74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 0x7fac74068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fac84000f70 tx=0x7fac84009040 comp rx=0 tx=0).stop 2023-07-09T21:59:50.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 msgr2=0x7fac901451b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:50.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0ad040 tx=0x7fac7c01ac90 comp rx=0 tx=0).stop 2023-07-09T21:59:50.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 shutdown_connections 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fac740663a0 0x7fac74068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac900ce1a0 0x7fac900b4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac900b7810 0x7fac901451b0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 --2- 172.21.15.37:0/2230433454 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac9006a280 0x7fac901f38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 >> 172.21.15.37:0/2230433454 conn(0x7fac900cea60 msgr2=0x7fac900b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 shutdown_connections 2023-07-09T21:59:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:50.935+0000 7fac95ef7640 1 -- 172.21.15.37:0/2230433454 wait complete. 2023-07-09T21:59:50.958 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T21:59:50.959 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T21:59:50.960 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T21:59:50.960 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T21:59:50.961 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:50.961 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T21:59:50.961 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T21:59:50.962 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T21:59:50.962 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:59:50.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:50.963 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T21:59:50.972 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.973 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T21:59:50.974 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 40212sec preferred_lft 40212sec 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.975 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.976 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:59:50.977 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T21:59:50.978 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T21:59:50.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:50.979 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T21:59:51.035 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T21:59:51.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.038 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T21:59:51.093 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T21:59:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T21:59:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T21:59:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T21:59:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T21:59:51.094 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T21:59:51.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.095 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T21:59:51.095 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T21:59:51.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T21:59:51.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T21:59:51.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T21:59:51.097 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T21:59:51.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.191 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T21:59:51.201 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T21:59:51.201 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T21:59:51.202 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:59:51.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T21:59:51.265 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T21:59:51.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:59:51.266 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:51.316 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T21:59:51.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T21:59:51.317 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:51.369 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:59:51.435 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:59:51.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:59:51.495 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:59:51.497 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:59:51.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.498 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:59:51.549 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T21:59:51.549 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T21:59:51.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T21:59:51.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T21:59:51.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T21:59:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T21:59:51.682 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T21:59:51.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:51.684 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T21:59:51.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T21:59:51.691+0000 7fc561a47580 -1 init, newargv = 0x562fbae4d160 newargc=15 2023-07-09T21:59:51.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[65206]: starting ceph client 2023-07-09T21:59:51.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[65206]: starting fuse 2023-07-09T21:59:51.702 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T21:59:51.703 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T21:59:51.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T21:59:51.704 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T21:59:51.704 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T21:59:51.704 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T21:59:51.705 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T21:59:51.705 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:59:51.705 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T21:59:51.705 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T21:59:51.706 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T21:59:51.706 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T21:59:51.706 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:59:51.707 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T21:59:51.707 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T21:59:51.707 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T21:59:51.708 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T21:59:51.708 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:59:51.708 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T21:59:51.709 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T21:59:51.709 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T21:59:51.709 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T21:59:51.709 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T21:59:51.710 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T21:59:51.710 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T21:59:51.710 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T21:59:51.711 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T21:59:51.711 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T21:59:51.711 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T21:59:51.827 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.65206.asok 2023-07-09T21:59:52.011 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.65206.asok 2023-07-09T21:59:52.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:52.012 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.65206.asok status 2023-07-09T21:59:52.189 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T21:59:52.189 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "65206", 2023-07-09T21:59:52.190 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 10386, 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T21:59:52.191 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 10386 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2444032210 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:52.192 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "172.21.15.37:0", 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2444032210 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.10386 172.21.15.37:0/2444032210", 2023-07-09T21:59:52.193 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "172.21.15.37:0/2444032210", 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 76, 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 176, 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T21:59:52.194 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T21:59:52.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:52.206 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T21:59:52.206 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:52.216 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T21:59:52.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:52.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:52.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T21:59:52.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T21:59:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 Processor -- start 2023-07-09T21:59:52.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 -- start start 2023-07-09T21:59:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 0x7f46300cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46300b47a0 0x7f46300b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46300cef80 con 0x7f46300b4140 2023-07-09T21:59:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46300b45b0 con 0x7f46300b47a0 2023-07-09T21:59:52.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f46374ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46300cf260 con 0x7f46300b7a60 2023-07-09T21:59:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f4634a87640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46300b47a0 0x7f46300b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f4634a87640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46300b47a0 0x7f46300b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46714/0 (socket says 172.21.15.37:46714) 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f4634a87640 1 -- 172.21.15.37:0/2873777039 learned_addr learned my addr 172.21.15.37:0/2873777039 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.463+0000 7f4635288640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 0x7f46300cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4634a87640 1 -- 172.21.15.37:0/2873777039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 msgr2=0x7f46300cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4634a87640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 0x7f46300cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4634a87640 1 -- 172.21.15.37:0/2873777039 >> v1:172.21.15.119:6789/0 conn(0x7f46300b4140 legacy=0x7f463015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4634a87640 1 -- 172.21.15.37:0/2873777039 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46300cf540 con 0x7f46300b47a0 2023-07-09T21:59:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4635288640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 0x7f46300cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4634a87640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f46300b3c00 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4620009870 tx=0x7f462001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b914d8362aad2e4b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4627fff640 1 -- 172.21.15.37:0/2873777039 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200a7070 con 0x7f46300b47a0 2023-07-09T21:59:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4627fff640 1 -- 172.21.15.37:0/2873777039 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200ab430 con 0x7f46300b47a0 2023-07-09T21:59:52.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f4627fff640 1 -- 172.21.15.37:0/2873777039 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200ab7c0 con 0x7f46300b47a0 2023-07-09T21:59:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 -- 172.21.15.37:0/2873777039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 msgr2=0x7f46300b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f46300b3c00 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f4620009870 tx=0x7f462001c540 comp rx=0 tx=0).stop 2023-07-09T21:59:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 -- 172.21.15.37:0/2873777039 shutdown_connections 2023-07-09T21:59:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f46300b3c00 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 --2- 172.21.15.37:0/2873777039 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b7a60 0x7f46300cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.467+0000 7f46374ec640 1 -- 172.21.15.37:0/2873777039 >> 172.21.15.37:0/2873777039 conn(0x7f4630073050 msgr2=0x7f4630069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- 172.21.15.37:0/2873777039 shutdown_connections 2023-07-09T21:59:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- 172.21.15.37:0/2873777039 wait complete. 2023-07-09T21:59:52.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 Processor -- start 2023-07-09T21:59:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- start start 2023-07-09T21:59:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b4140 0x7f4630151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46300b7a60 0x7f46300b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463015b2a0 con 0x7f46300b47a0 2023-07-09T21:59:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463015b4f0 con 0x7f46300b7a60 2023-07-09T21:59:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f46374ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463015b7d0 con 0x7f46300b4140 2023-07-09T21:59:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46730/0 (socket says 172.21.15.37:46730) 2023-07-09T21:59:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 -- 172.21.15.37:0/388793998 learned_addr learned my addr 172.21.15.37:0/388793998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4635288640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b4140 0x7f4630151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4635a89640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46300b7a60 0x7f46300b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 -- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b4140 msgr2=0x7f4630151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b4140 0x7f4630151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 -- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46300b7a60 msgr2=0x7f46300b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46300b7a60 0x7f46300b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 -- 172.21.15.37:0/388793998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46200094d0 con 0x7f46300b47a0 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4634a87640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f462001a170 tx=0x7f46200192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200ba070 con 0x7f46300b47a0 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.471+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46200abe30 con 0x7f46300b47a0 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200b4870 con 0x7f46300b47a0 2023-07-09T21:59:52.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463015bab0 con 0x7f46300b47a0 2023-07-09T21:59:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4630151ab0 con 0x7f46300b47a0 2023-07-09T21:59:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46300cdaa0 con 0x7f46300b47a0 2023-07-09T21:59:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f46200b49d0 con 0x7f46300b47a0 2023-07-09T21:59:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f4625ffb640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 0x7f4614068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f462011d950 con 0x7f46300b47a0 2023-07-09T21:59:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.475+0000 7f4635288640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 0x7f4614068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.479+0000 7f4635288640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 0x7f4614068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f462c009950 tx=0x7f462c008040 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.479+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46200eac10 con 0x7f46300b47a0 2023-07-09T21:59:52.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.651+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f46301688d0 con 0x7f46140663a0 2023-07-09T21:59:52.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f4625ffb640 1 -- 172.21.15.37:0/388793998 <== mgr.8183 v2:172.21.15.119:6832/801119985 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f462c004040 con 0x7f46140663a0 2023-07-09T21:59:52.658 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T21:59:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T21:59:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T21:59:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T21:59:52.659 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T21:59:52.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 msgr2=0x7f4614068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 0x7f4614068850 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f462c009950 tx=0x7f462c008040 comp rx=0 tx=0).stop 2023-07-09T21:59:52.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 msgr2=0x7f463015a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f462001a170 tx=0x7f46200192e0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 shutdown_connections 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f46140663a0 0x7f4614068850 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46300b7a60 0x7f46300b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46300b47a0 0x7f463015a370 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 --2- 172.21.15.37:0/388793998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46300b4140 0x7f4630151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 >> 172.21.15.37:0/388793998 conn(0x7f4630073050 msgr2=0x7f46300b5090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 shutdown_connections 2023-07-09T21:59:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.655+0000 7f46374ec640 1 -- 172.21.15.37:0/388793998 wait complete. 2023-07-09T21:59:52.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T21:59:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 Processor -- start 2023-07-09T21:59:52.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 -- start start 2023-07-09T21:59:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 0x7fe564160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe5640d0780 0x7fe5640d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56415bf80 con 0x7fe5640b7980 2023-07-09T21:59:52.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5640cd070 con 0x7fe5640d0780 2023-07-09T21:59:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56c4bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640cfd70 con 0x7fe5640cf290 2023-07-09T21:59:52.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe569a58640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 0x7fe564160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56a259640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fe5640b7980 0x7fe5640ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:57226/0 (socket says 172.21.15.37:57226) 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56a259640 1 -- 172.21.15.37:0/3000955774 learned_addr learned my addr 172.21.15.37:0/3000955774 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.819+0000 7fe56aa5a640 1 --2- 172.21.15.37:0/3000955774 >> v2:172.21.15.119:3300/0 conn(0x7fe5640d0780 0x7fe5640d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569a58640 1 -- 172.21.15.37:0/3000955774 >> v2:172.21.15.119:3300/0 conn(0x7fe5640d0780 msgr2=0x7fe5640d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569a58640 1 --2- 172.21.15.37:0/3000955774 >> v2:172.21.15.119:3300/0 conn(0x7fe5640d0780 0x7fe5640d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569a58640 1 -- 172.21.15.37:0/3000955774 >> v1:172.21.15.119:6789/0 conn(0x7fe5640b7980 legacy=0x7fe5640ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569257640 1 -- 172.21.15.37:0/3000955774 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384980108 0 0) 0x7fe560001120 con 0x7fe5640b7980 2023-07-09T21:59:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569a58640 1 -- 172.21.15.37:0/3000955774 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe564160570 con 0x7fe5640cf290 2023-07-09T21:59:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569a58640 1 --2- 172.21.15.37:0/3000955774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 0x7fe564160030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe5540097c0 tx=0x7fe55401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3745a6149e57e7c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569257640 1 -- 172.21.15.37:0/3000955774 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540ab600 con 0x7fe5640cf290 2023-07-09T21:59:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569257640 1 -- 172.21.15.37:0/3000955774 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540a7050 con 0x7fe5640cf290 2023-07-09T21:59:52.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe569257640 1 -- 172.21.15.37:0/3000955774 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5540ab980 con 0x7fe5640cf290 2023-07-09T21:59:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.823+0000 7fe56c4bd640 1 -- 172.21.15.37:0/3000955774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 msgr2=0x7fe564160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/3000955774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 0x7fe564160030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe5540097c0 tx=0x7fe55401c480 comp rx=0 tx=0).stop 2023-07-09T21:59:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- 172.21.15.37:0/3000955774 shutdown_connections 2023-07-09T21:59:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/3000955774 >> v2:172.21.15.119:3300/0 conn(0x7fe5640d0780 0x7fe5640d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/3000955774 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640cf290 0x7fe564160030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- 172.21.15.37:0/3000955774 >> 172.21.15.37:0/3000955774 conn(0x7fe564073090 msgr2=0x7fe564069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- 172.21.15.37:0/3000955774 shutdown_connections 2023-07-09T21:59:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- 172.21.15.37:0/3000955774 wait complete. 2023-07-09T21:59:52.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 Processor -- start 2023-07-09T21:59:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- start start 2023-07-09T21:59:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640b7980 0x7fe56415ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5640cf290 0x7fe564154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe564159350 con 0x7fe5640d0780 2023-07-09T21:59:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640b1d10 con 0x7fe5640cf290 2023-07-09T21:59:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56c4bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640b1ff0 con 0x7fe5640b7980 2023-07-09T21:59:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46742/0 (socket says 172.21.15.37:46742) 2023-07-09T21:59:52.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 -- 172.21.15.37:0/2613655249 learned_addr learned my addr 172.21.15.37:0/2613655249 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56a259640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640b7980 0x7fe56415ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe569a58640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5640cf290 0x7fe564154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 -- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640b7980 msgr2=0x7fe56415ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640b7980 0x7fe56415ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 -- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5640cf290 msgr2=0x7fe564154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5640cf290 0x7fe564154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.827+0000 7fe56aa5a640 1 -- 172.21.15.37:0/2613655249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe554009420 con 0x7fe5640d0780 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe56aa5a640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00efc0 tx=0x7fe55c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c014480 con 0x7fe5640d0780 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c00f040 con 0x7fe5640d0780 2023-07-09T21:59:52.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c014820 con 0x7fe5640d0780 2023-07-09T21:59:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5640b22d0 con 0x7fe5640d0780 2023-07-09T21:59:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5640b2890 con 0x7fe5640d0780 2023-07-09T21:59:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5640b2a80 con 0x7fe5640d0780 2023-07-09T21:59:52.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 81) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe55c014980 con 0x7fe5640d0780 2023-07-09T21:59:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 0x7fe548068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fe55c084a20 con 0x7fe5640d0780 2023-07-09T21:59:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.831+0000 7fe56a259640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 0x7fe548068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:52.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.835+0000 7fe56a259640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 0x7fe548068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe560000f70 tx=0x7fe560007df0 comp rx=0 tx=0).ready entity=mgr.8183 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:52.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:52.835+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe55c051ce0 con 0x7fe5640d0780 2023-07-09T21:59:53.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.027+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fe56404d7d0 con 0x7fe5640d0780 2023-07-09T21:59:53.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.795+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fe55c0520b0 con 0x7fe5640d0780 2023-07-09T21:59:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.799+0000 7fe55affd640 1 -- 172.21.15.37:0/2613655249 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v82) v1 ==== 92+0+0 (secure 0 0 0) 0x7fe55c06f5a0 con 0x7fe5640d0780 2023-07-09T21:59:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 msgr2=0x7fe548068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 0x7fe548068850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe560000f70 tx=0x7fe560007df0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 msgr2=0x7fe564154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00efc0 tx=0x7fe55c00c490 comp rx=0 tx=0).stop 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 shutdown_connections 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fe5480663a0 0x7fe548068850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe5640d0780 0x7fe564154890 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe5640cf290 0x7fe564154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 --2- 172.21.15.37:0/2613655249 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe5640b7980 0x7fe56415ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 >> 172.21.15.37:0/2613655249 conn(0x7fe564073090 msgr2=0x7fe56415c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:53.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 shutdown_connections 2023-07-09T21:59:53.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.803+0000 7fe56c4bd640 1 -- 172.21.15.37:0/2613655249 wait complete. 2023-07-09T21:59:53.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T21:59:53.979 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:53.978+0000 7f6b32399180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:59:53.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.979+0000 7ff92ff1e640 1 Processor -- start 2023-07-09T21:59:53.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.979+0000 7ff92ff1e640 1 -- start start 2023-07-09T21:59:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92ff1e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9280b7980 0x7ff928160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92ff1e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280d0780 0x7ff9280d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92ff1e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff92815bf80 con 0x7ff9280ceb80 2023-07-09T21:59:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92ff1e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9280cd070 con 0x7ff9280b7980 2023-07-09T21:59:53.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92ff1e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280cfd70 con 0x7ff9280d0780 2023-07-09T21:59:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9280b7980 0x7ff928160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9280b7980 0x7ff928160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46770/0 (socket says 172.21.15.37:46770) 2023-07-09T21:59:53.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 -- 172.21.15.37:0/979382758 learned_addr learned my addr 172.21.15.37:0/979382758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92e4bb640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280d0780 0x7ff9280d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 -- 172.21.15.37:0/979382758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280d0780 msgr2=0x7ff9280d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280d0780 0x7ff9280d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 -- 172.21.15.37:0/979382758 >> v1:172.21.15.119:6789/0 conn(0x7ff9280ceb80 legacy=0x7ff9280cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 -- 172.21.15.37:0/979382758 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff928160570 con 0x7ff9280b7980 2023-07-09T21:59:53.987 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:53.983+0000 7f19c2324180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T21:59:53.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.983+0000 7ff92dcba640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280b7980 0x7ff928160030 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff924009870 tx=0x7ff92401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bab075efc35eb410 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ccb8640 1 -- 172.21.15.37:0/979382758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab600 con 0x7ff9280b7980 2023-07-09T21:59:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ccb8640 1 -- 172.21.15.37:0/979382758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9240a7050 con 0x7ff9280b7980 2023-07-09T21:59:53.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ccb8640 1 -- 172.21.15.37:0/979382758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9240ab980 con 0x7ff9280b7980 2023-07-09T21:59:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- 172.21.15.37:0/979382758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280b7980 msgr2=0x7ff928160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280b7980 0x7ff928160030 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff924009870 tx=0x7ff92401c540 comp rx=0 tx=0).stop 2023-07-09T21:59:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- 172.21.15.37:0/979382758 shutdown_connections 2023-07-09T21:59:53.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280d0780 0x7ff9280d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/979382758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280b7980 0x7ff928160030 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- 172.21.15.37:0/979382758 >> 172.21.15.37:0/979382758 conn(0x7ff928073090 msgr2=0x7ff928069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- 172.21.15.37:0/979382758 shutdown_connections 2023-07-09T21:59:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- 172.21.15.37:0/979382758 wait complete. 2023-07-09T21:59:53.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 Processor -- start 2023-07-09T21:59:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 -- start start 2023-07-09T21:59:53.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 0x7ff9280b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 0x7ff928152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.987+0000 7ff92ff1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff928152590 con 0x7ff9280d0780 2023-07-09T21:59:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280b3480 con 0x7ff9280b7980 2023-07-09T21:59:53.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280b3900 con 0x7ff9280ceb80 2023-07-09T21:59:53.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92d4b9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 0x7ff928152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92dcba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 0x7ff9280b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46780/0 (socket says 172.21.15.37:46780) 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 -- 172.21.15.37:0/3336901697 learned_addr learned my addr 172.21.15.37:0/3336901697 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 -- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 msgr2=0x7ff928152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 0x7ff928152050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 -- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 msgr2=0x7ff9280b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 0x7ff9280b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 -- 172.21.15.37:0/3336901697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9240094d0 con 0x7ff9280d0780 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92d4b9640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 0x7ff928152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92dcba640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 0x7ff9280b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92e4bb640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff92000efc0 tx=0x7ff92000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920009ba0 con 0x7ff9280d0780 2023-07-09T21:59:53.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92000f040 con 0x7ff9280d0780 2023-07-09T21:59:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200146c0 con 0x7ff9280d0780 2023-07-09T21:59:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9280b3be0 con 0x7ff9280d0780 2023-07-09T21:59:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9280b41a0 con 0x7ff9280d0780 2023-07-09T21:59:53.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9280b43c0 con 0x7ff9280d0780 2023-07-09T21:59:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.991+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7ff920014820 con 0x7ff9280d0780 2023-07-09T21:59:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.995+0000 7ff91e7fc640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 0x7ff90c0688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.995+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff920084a30 con 0x7ff9280d0780 2023-07-09T21:59:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.995+0000 7ff92dcba640 1 -- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 msgr2=0x7ff90c0688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:53.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.995+0000 7ff92dcba640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 0x7ff90c0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:54.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:53.999+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff920051c60 con 0x7ff9280d0780 2023-07-09T21:59:54.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.155+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7ff92804d7d0 con 0x7ff9280d0780 2023-07-09T21:59:54.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff91e7fc640 1 -- 172.21.15.37:0/3336901697 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v59)=0 v59) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9200180d0 con 0x7ff9280d0780 2023-07-09T21:59:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 msgr2=0x7ff90c0688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 0x7ff90c0688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 msgr2=0x7ff9280b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff92000efc0 tx=0x7ff92000c490 comp rx=0 tx=0).stop 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 shutdown_connections 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7ff90c066420 0x7ff90c0688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9280d0780 0x7ff9280b5480 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff9280ceb80 0x7ff928152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 --2- 172.21.15.37:0/3336901697 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff9280b7980 0x7ff9280b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 >> 172.21.15.37:0/3336901697 conn(0x7ff928073090 msgr2=0x7ff92815dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 shutdown_connections 2023-07-09T21:59:54.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.163+0000 7ff92ff1e640 1 -- 172.21.15.37:0/3336901697 wait complete. 2023-07-09T21:59:54.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T21:59:54.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 Processor -- start 2023-07-09T21:59:54.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 -- start start 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fecd415f130 0x7fecd40b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40b3bb0 con 0x7fecd40d0530 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40cccb0 con 0x7fecd40b74e0 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecdbfc5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40b7960 con 0x7fecd415f130 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecda562640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fecd40d0530 0x7fecd40cd140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54816/0 (socket says 172.21.15.37:54816) 2023-07-09T21:59:54.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecda562640 1 -- 172.21.15.37:0/1703375564 learned_addr learned my addr 172.21.15.37:0/1703375564 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd9d61640 1 --2- 172.21.15.37:0/1703375564 >> v2:172.21.15.119:3300/0 conn(0x7fecd415f130 0x7fecd40b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd8d5f640 1 -- 172.21.15.37:0/1703375564 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974315054 0 0) 0x7fecd40b3bb0 con 0x7fecd40d0530 2023-07-09T21:59:54.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd8d5f640 1 -- 172.21.15.37:0/1703375564 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc0003530 con 0x7fecd40d0530 2023-07-09T21:59:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd9d61640 1 -- 172.21.15.37:0/1703375564 >> v1:172.21.15.119:6789/0 conn(0x7fecd40b74e0 legacy=0x7fecd40cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd9d61640 1 -- 172.21.15.37:0/1703375564 >> v1:172.21.15.37:6789/0 conn(0x7fecd40d0530 legacy=0x7fecd40cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.331+0000 7fecd9d61640 1 -- 172.21.15.37:0/1703375564 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40b8100 con 0x7fecd415f130 2023-07-09T21:59:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecd9d61640 1 --2- 172.21.15.37:0/1703375564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40b6fa0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097c0 tx=0x7fecd001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de68e665f845fec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecd8d5f640 1 -- 172.21.15.37:0/1703375564 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00ac620 con 0x7fecd415f130 2023-07-09T21:59:54.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecd8d5f640 1 -- 172.21.15.37:0/1703375564 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00ac780 con 0x7fecd415f130 2023-07-09T21:59:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecd8d5f640 1 -- 172.21.15.37:0/1703375564 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00acb10 con 0x7fecd415f130 2023-07-09T21:59:54.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 -- 172.21.15.37:0/1703375564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 msgr2=0x7fecd40b6fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/1703375564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40b6fa0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097c0 tx=0x7fecd001c3c0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 -- 172.21.15.37:0/1703375564 shutdown_connections 2023-07-09T21:59:54.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/1703375564 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40b6fa0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 -- 172.21.15.37:0/1703375564 >> 172.21.15.37:0/1703375564 conn(0x7fecd4072d20 msgr2=0x7fecd40d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 -- 172.21.15.37:0/1703375564 shutdown_connections 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.335+0000 7fecdbfc5640 1 -- 172.21.15.37:0/1703375564 wait complete. 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 Processor -- start 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- start start 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd40b74e0 0x7fecd406b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd409d3b0 con 0x7fecd40d0530 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd406bda0 con 0x7fecd415f130 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd40b2ca0 con 0x7fecd40b74e0 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46796/0 (socket says 172.21.15.37:46796) 2023-07-09T21:59:54.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 -- 172.21.15.37:0/386554086 learned_addr learned my addr 172.21.15.37:0/386554086 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9d61640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd40b74e0 0x7fecd406b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecda562640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 -- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd40b74e0 msgr2=0x7fecd406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd40b74e0 0x7fecd406b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 -- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 msgr2=0x7fecd40d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 -- 172.21.15.37:0/386554086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd0009420 con 0x7fecd40d0530 2023-07-09T21:59:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecd9560640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c3c0 tx=0x7fecc400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:54.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc40052d0 con 0x7fecd40d0530 2023-07-09T21:59:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc4005430 con 0x7fecd40d0530 2023-07-09T21:59:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd40b2f80 con 0x7fecd40d0530 2023-07-09T21:59:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc4003840 con 0x7fecd40d0530 2023-07-09T21:59:54.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.339+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd409d040 con 0x7fecd40d0530 2023-07-09T21:59:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd409d520 con 0x7fecd40d0530 2023-07-09T21:59:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fecc40039a0 con 0x7fecd40d0530 2023-07-09T21:59:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecca7fc640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 0x7fecb80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fecc4083470 con 0x7fecd40d0530 2023-07-09T21:59:54.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecd9d61640 1 -- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 msgr2=0x7fecb80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:54.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.343+0000 7fecd9d61640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 0x7fecb80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:54.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.347+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fecc40507b0 con 0x7fecd40d0530 2023-07-09T21:59:54.396 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:54.394+0000 7f6b32399180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:59:54.437 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:54.431+0000 7f19c2324180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T21:59:54.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.507+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7fecd40668f0 con 0x7fecd40d0530 2023-07-09T21:59:54.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.511+0000 7fecca7fc640 1 -- 172.21.15.37:0/386554086 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v60)=0 v60) v1 ==== 133+0+0 (secure 0 0 0) 0x7fecc4053dd0 con 0x7fecd40d0530 2023-07-09T21:59:54.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 msgr2=0x7fecb80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 0x7fecb80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 msgr2=0x7fecd4156460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7fecc400c3c0 tx=0x7fecc400c880 comp rx=0 tx=0).stop 2023-07-09T21:59:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 shutdown_connections 2023-07-09T21:59:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7fecb80663f0 0x7fecb80688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fecd415f130 0x7fecd40d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fecd40d0530 0x7fecd4156460 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 --2- 172.21.15.37:0/386554086 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fecd40b74e0 0x7fecd406b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 >> 172.21.15.37:0/386554086 conn(0x7fecd4072d20 msgr2=0x7fecd40ce900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 shutdown_connections 2023-07-09T21:59:54.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.515+0000 7fecdbfc5640 1 -- 172.21.15.37:0/386554086 wait complete. 2023-07-09T21:59:54.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:54.538 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T21:59:54.547 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:54.546+0000 7f6b32399180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:59:54.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-09T21:59:54.597 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:54.591+0000 7f19c2324180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T21:59:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 Processor -- start 2023-07-09T21:59:54.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 -- start start 2023-07-09T21:59:54.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f4fbc0b7980 0x7f4fbc160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0ceb80 0x7f4fbc0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0cd070 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fbc0cfd70 con 0x7f4fbc0b7980 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fc1ebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc15bf80 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46798/0 (socket says 172.21.15.37:46798) 2023-07-09T21:59:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 -- 172.21.15.37:0/1931402450 learned_addr learned my addr 172.21.15.37:0/1931402450 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbaffd640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0ceb80 0x7f4fbc0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/1931402450 >> v2:172.21.15.119:3300/0 conn(0x7f4fbc0b7980 0x7f4fbc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 -- 172.21.15.37:0/1931402450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0ceb80 msgr2=0x7f4fbc0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:54.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0ceb80 0x7f4fbc0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 -- 172.21.15.37:0/1931402450 >> v2:172.21.15.119:3300/0 conn(0x7f4fbc0b7980 msgr2=0x7f4fbc160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:54.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/1931402450 >> v2:172.21.15.119:3300/0 conn(0x7f4fbc0b7980 0x7f4fbc160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.739+0000 7f4fbbfff640 1 -- 172.21.15.37:0/1931402450 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fbc160570 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc069aa0 tx=0x7f4fb401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2864ba9e389d7867 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:54.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fba7fc640 1 -- 172.21.15.37:0/1931402450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a5650 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fba7fc640 1 -- 172.21.15.37:0/1931402450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40a57b0 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fba7fc640 1 -- 172.21.15.37:0/1931402450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a5b40 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/1931402450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0b3c20 msgr2=0x7f4fbc0b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc069aa0 tx=0x7f4fb401c9d0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/1931402450 shutdown_connections 2023-07-09T21:59:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0b4080 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/1931402450 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0ceb80 0x7f4fbc0cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/1931402450 >> v2:172.21.15.119:3300/0 conn(0x7f4fbc0b7980 0x7f4fbc160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/1931402450 >> 172.21.15.37:0/1931402450 conn(0x7f4fbc073090 msgr2=0x7f4fbc069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/1931402450 shutdown_connections 2023-07-09T21:59:54.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.743+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/1931402450 wait complete. 2023-07-09T21:59:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 Processor -- start 2023-07-09T21:59:54.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 -- start start 2023-07-09T21:59:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0b7980 0x7f4fbc0d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 0x7f4fbc151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0d2640 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0d1a30 con 0x7f4fbc0b3c20 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fc1ebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fbc0d1d10 con 0x7f4fbc0b7980 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 0x7f4fbc151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 0x7f4fbc151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46814/0 (socket says 172.21.15.37:46814) 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 -- 172.21.15.37:0/904073162 learned_addr learned my addr 172.21.15.37:0/904073162 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbaffd640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0b7980 0x7f4fbc0d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:54.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0b7980 msgr2=0x7f4fbc0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4fbc0b7980 0x7f4fbc0d0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fbc0b3c20 msgr2=0x7f4fbc0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbbfff640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb4009b30 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.747+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4fbc0b3c20 0x7f4fbc0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:54.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fbbfff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 0x7f4fbc151e20 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40af040 tx=0x7f4fb4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40a5650 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb40b8880 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fbc0d1ff0 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40b8c30 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fbc153560 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fbc0d27b0 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.751+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 82) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f4fb40c3460 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.755+0000 7f4fa3fff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:54.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.755+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f4fb411f270 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.755+0000 7f4fbb7fe640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 msgr2=0x7f4fa80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:54.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.755+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T21:59:54.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.755+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4fb40ec6b0 con 0x7f4fbc0ceb80 2023-07-09T21:59:54.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.927+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fbc0ccd90 con 0x7f4fa80663f0 2023-07-09T21:59:54.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.959+0000 7f4fbb7fe640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 msgr2=0x7f4fa80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:54.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:54.959+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T21:59:55.024 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.022+0000 7f6b32399180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:55.085 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.086+0000 7f6b32399180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:59:55.113 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.111+0000 7f19c2324180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:55.141 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.138+0000 7f6b32399180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:59:55.175 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.171+0000 7f19c2324180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T21:59:55.225 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.226+0000 7f6b32399180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:59:55.233 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.231+0000 7f19c2324180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T21:59:55.283 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.282+0000 7f6b32399180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:59:55.324 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.319+0000 7f19c2324180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T21:59:55.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:55.363+0000 7f4fbb7fe640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 msgr2=0x7f4fa80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:55.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:55.363+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T21:59:55.367 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.366+0000 7f6b32399180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:59:55.383 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.379+0000 7f19c2324180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T21:59:55.423 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.422+0000 7f6b32399180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:59:55.472 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.467+0000 7f19c2324180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T21:59:55.532 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.527+0000 7f19c2324180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T21:59:55.564 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.562+0000 7f6b32399180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:59:55.622 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.622+0000 7f6b32399180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:59:55.682 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.679+0000 7f19c2324180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T21:59:55.743 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.739+0000 7f19c2324180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T21:59:55.862 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:59:55.862 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:59:55.862 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:59:55.870 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:55.870+0000 7f6b32399180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:59:55.994 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T21:59:55.994 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T21:59:55.994 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T21:59:56.002 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:55.999+0000 7f19c2324180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T21:59:56.003 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.002+0000 7f6b32399180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:56.131 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.130+0000 7f6b32399180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:56.146 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:56.143+0000 7f19c2324180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:56.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:56.167+0000 7f4fbb7fe640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 msgr2=0x7f4fa80688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/801119985 2023-07-09T21:59:56.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:56.167+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T21:59:56.201 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.198+0000 7f6b32399180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:59:56.277 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:56.275+0000 7f19c2324180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T21:59:56.333 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.334+0000 7f6b32399180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:56.351 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:56.347+0000 7f19c2324180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T21:59:56.493 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:56.491+0000 7f19c2324180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T21:59:56.867 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.866+0000 7f6b32399180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:59:56.952 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:56.950+0000 7f6b32399180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:59:57.059 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.055+0000 7f19c2324180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T21:59:57.097 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.098+0000 7f6b32399180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:59:57.147 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.143+0000 7f19c2324180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T21:59:57.180 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.178+0000 7f6b32399180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:59:57.301 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.299+0000 7f19c2324180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T21:59:57.389 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.387+0000 7f19c2324180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T21:59:57.447 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.446+0000 7f6b32399180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:59:57.507 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.506+0000 7f6b32399180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:59:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:57.515+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 83) v1 ==== 85386+0+0 (secure 0 0 0) 0x7f4fb40eca80 con 0x7f4fbc0ceb80 2023-07-09T21:59:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:57.515+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 msgr2=0x7f4fa80688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T21:59:57.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:57.515+0000 7f4fa3fff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/801119985,v1:172.21.15.119:6833/801119985] conn(0x7f4fa80663f0 0x7f4fa80688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:57.640 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab450b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.640 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab450b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.640 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab450b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab450b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab450b640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab1505640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab1505640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab1505640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab1505640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T21:59:57.638+0000 7f6ab1505640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T21:59:57.697 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.695+0000 7f19c2324180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T21:59:57.760 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T21:59:57.755+0000 7f19c2324180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T21:59:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.523+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f4fb411d550 con 0x7f4fbc0ceb80 2023-07-09T21:59:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.523+0000 7f4fa3fff640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f4fa8033e70 0x7f4fa8070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.523+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 --> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fa8034240 con 0x7f4fa8033e70 2023-07-09T21:59:58.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.527+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f4fa8033e70 0x7f4fa8070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.527+0000 7f4fbb7fe640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f4fa8033e70 0x7f4fa8070980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0093a0 tx=0x7f4fac009190 comp rx=0 tx=0).ready entity=mgr.8480 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:58.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.595+0000 7f4fa3fff640 1 -- 172.21.15.37:0/904073162 <== mgr.8480 v2:172.21.15.119:6832/4130882000 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4fa8034240 con 0x7f4fa8033e70 2023-07-09T21:59:58.600 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T21:59:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f4fa8033e70 msgr2=0x7f4fa8070980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f4fa8033e70 0x7f4fa8070980 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0093a0 tx=0x7f4fac009190 comp rx=0 tx=0).stop 2023-07-09T21:59:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 msgr2=0x7f4fbc151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 --2- 172.21.15.37:0/904073162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4fbc0ceb80 0x7f4fbc151e20 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40af040 tx=0x7f4fb4019770 comp rx=0 tx=0).stop 2023-07-09T21:59:58.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fbbfff640 1 -- 172.21.15.37:0/904073162 reap_dead start 2023-07-09T21:59:58.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 shutdown_connections 2023-07-09T21:59:58.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 >> 172.21.15.37:0/904073162 conn(0x7f4fbc073090 msgr2=0x7f4fbc1551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:58.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 shutdown_connections 2023-07-09T21:59:58.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.599+0000 7f4fc1ebd640 1 -- 172.21.15.37:0/904073162 wait complete. 2023-07-09T21:59:58.624 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T21:59:58.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-09T21:59:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.771+0000 7fb652e19640 1 Processor -- start 2023-07-09T21:59:58.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.771+0000 7fb652e19640 1 -- start start 2023-07-09T21:59:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb652e19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb64c0b7980 0x7fb64c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb652e19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0d0780 0x7fb64c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb652e19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64c15bf80 con 0x7fb64c0ceb80 2023-07-09T21:59:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb652e19640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64c0cd070 con 0x7fb64c0b7980 2023-07-09T21:59:58.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb652e19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0cfd70 con 0x7fb64c0d0780 2023-07-09T21:59:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb650bb5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb64c0b7980 0x7fb64c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb64bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb64c0ceb80 0x7fb64c0cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38860/0 (socket says 172.21.15.37:38860) 2023-07-09T21:59:58.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb64bfff640 1 -- 172.21.15.37:0/591587612 learned_addr learned my addr 172.21.15.37:0/591587612 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T21:59:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb6513b6640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0d0780 0x7fb64c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb650bb5640 1 -- 172.21.15.37:0/591587612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0d0780 msgr2=0x7fb64c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb650bb5640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0d0780 0x7fb64c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:58.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb650bb5640 1 -- 172.21.15.37:0/591587612 >> v1:172.21.15.37:6789/0 conn(0x7fb64c0ceb80 legacy=0x7fb64c0cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb650bb5640 1 -- 172.21.15.37:0/591587612 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64c160570 con 0x7fb64c0b7980 2023-07-09T21:59:58.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.775+0000 7fb64b7fe640 1 -- 172.21.15.37:0/591587612 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214280537 0 0) 0x7fb638001120 con 0x7fb64c0ceb80 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb650bb5640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0b7980 0x7fb64c160030 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fb6400097c0 tx=0x7fb64001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56704e2ff47a8923 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb64b7fe640 1 -- 172.21.15.37:0/591587612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400ab600 con 0x7fb64c0b7980 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb64b7fe640 1 -- 172.21.15.37:0/591587612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6400a7050 con 0x7fb64c0b7980 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb64b7fe640 1 -- 172.21.15.37:0/591587612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6400ab980 con 0x7fb64c0b7980 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- 172.21.15.37:0/591587612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0b7980 msgr2=0x7fb64c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0b7980 0x7fb64c160030 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fb6400097c0 tx=0x7fb64001c480 comp rx=0 tx=0).stop 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- 172.21.15.37:0/591587612 shutdown_connections 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0d0780 0x7fb64c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- 172.21.15.37:0/591587612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0b7980 0x7fb64c160030 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- 172.21.15.37:0/591587612 >> 172.21.15.37:0/591587612 conn(0x7fb64c073090 msgr2=0x7fb64c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- 172.21.15.37:0/591587612 shutdown_connections 2023-07-09T21:59:58.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- 172.21.15.37:0/591587612 wait complete. 2023-07-09T21:59:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 Processor -- start 2023-07-09T21:59:58.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- start start 2023-07-09T21:59:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0b7980 0x7fb64c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb64c0d0780 0x7fb64c14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c15bb30 con 0x7fb64c0ceb80 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c0ca9d0 con 0x7fb64c0d0780 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.779+0000 7fb652e19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c15aa90 con 0x7fb64c0b7980 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb650bb5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0b7980 0x7fb64c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35216/0 (socket says 172.21.15.37:35216) 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 -- 172.21.15.37:0/3421748464 learned_addr learned my addr 172.21.15.37:0/3421748464 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:58.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6513b6640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb64c0d0780 0x7fb64c14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 -- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0b7980 msgr2=0x7fb64c153d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0b7980 0x7fb64c153d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 -- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb64c0d0780 msgr2=0x7fb64c14ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb64c0d0780 0x7fb64c14ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:58.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 -- 172.21.15.37:0/3421748464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640009420 con 0x7fb64c0ceb80 2023-07-09T21:59:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb64bfff640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c780 tx=0x7fb63800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380072d0 con 0x7fb64c0ceb80 2023-07-09T21:59:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638007450 con 0x7fb64c0ceb80 2023-07-09T21:59:58.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c15ad70 con 0x7fb64c0ceb80 2023-07-09T21:59:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380047f0 con 0x7fb64c0ceb80 2023-07-09T21:59:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c15b330 con 0x7fb64c0ceb80 2023-07-09T21:59:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64c04d7d0 con 0x7fb64c0ceb80 2023-07-09T21:59:58.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fb638004950 con 0x7fb64c0ceb80 2023-07-09T21:59:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 0x7fb6300685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.783+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fb638082f40 con 0x7fb64c0ceb80 2023-07-09T21:59:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.787+0000 7fb650bb5640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 0x7fb6300685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:58.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.787+0000 7fb650bb5640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 0x7fb6300685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ad000 tx=0x7fb6400a6000 comp rx=0 tx=0).ready entity=mgr.8480 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:58.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.787+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb638050550 con 0x7fb64c0ceb80 2023-07-09T21:59:58.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:58.963+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 --> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fb64c0cff80 con 0x7fb630066120 2023-07-09T21:59:59.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.019+0000 7fb6497fa640 1 -- 172.21.15.37:0/3421748464 <== mgr.8480 v2:172.21.15.119:6832/4130882000 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7fb6400ab760 con 0x7fb630066120 2023-07-09T21:59:59.023 INFO:teuthology.orchestra.run.smithi037.stdout:Retention added to path snap_test_dir1 2023-07-09T21:59:59.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 msgr2=0x7fb6300685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 0x7fb6300685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6400ad000 tx=0x7fb6400a6000 comp rx=0 tx=0).stop 2023-07-09T21:59:59.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 msgr2=0x7fb64c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c780 tx=0x7fb63800cc40 comp rx=0 tx=0).stop 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 shutdown_connections 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb630066120 0x7fb6300685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb64c0d0780 0x7fb64c14ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb64c0ceb80 0x7fb64c15a0f0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 --2- 172.21.15.37:0/3421748464 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb64c0b7980 0x7fb64c153d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 >> 172.21.15.37:0/3421748464 conn(0x7fb64c073090 msgr2=0x7fb64c0cefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 shutdown_connections 2023-07-09T21:59:59.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.023+0000 7fb652e19640 1 -- 172.21.15.37:0/3421748464 wait complete. 2023-07-09T21:59:59.045 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-09T21:59:59.045 DEBUG:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-09-22_00_00 in ~1s... 2023-07-09T21:59:59.046 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-09T21:59:59.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-09T21:59:59.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 Processor -- start 2023-07-09T21:59:59.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 -- start start 2023-07-09T21:59:59.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f0c15f610 0x7f0f0c15fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 0x7f0f0c06be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c15bf60 con 0x7f0f0c15bb90 2023-07-09T21:59:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c0cc530 con 0x7f0f0c15f610 2023-07-09T21:59:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f13207640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c06c380 con 0x7f0f0c06b9c0 2023-07-09T21:59:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f0c15f610 0x7f0f0c15fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f117a4640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 0x7f0f0c06be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0f0c15f610 0x7f0f0c15fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:49188/0 (socket says 172.21.15.37:49188) 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 -- 172.21.15.37:0/1946831109 learned_addr learned my addr 172.21.15.37:0/1946831109 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f10fa3640 1 --1- 172.21.15.37:0/1946831109 >> v1:172.21.15.119:6789/0 conn(0x7f0f0c15bb90 0x7f0f0c0ccf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:60120/0 (socket says 172.21.15.37:60120) 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 -- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 msgr2=0x7f0f0c06be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T21:59:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 0x7f0f0c06be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 -- 172.21.15.37:0/1946831109 >> v1:172.21.15.119:6789/0 conn(0x7f0f0c15bb90 legacy=0x7f0f0c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0bfff640 1 -- 172.21.15.37:0/1946831109 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c1600d0 con 0x7f0f0c15f610 2023-07-09T21:59:59.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f0b7fe640 1 -- 172.21.15.37:0/1946831109 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813973257 0 0) 0x7f0f0c15bf60 con 0x7f0f0c15bb90 2023-07-09T21:59:59.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.191+0000 7f0f117a4640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 0x7f0f0c06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T21:59:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f0bfff640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c15f610 0x7f0f0c15fa60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009870 tx=0x7f0ef801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2823090387ebf91 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f0b7fe640 1 -- 172.21.15.37:0/1946831109 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80ab680 con 0x7f0f0c15f610 2023-07-09T21:59:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f0b7fe640 1 -- 172.21.15.37:0/1946831109 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80ab7e0 con 0x7f0f0c15f610 2023-07-09T21:59:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f0b7fe640 1 -- 172.21.15.37:0/1946831109 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80abb70 con 0x7f0f0c15f610 2023-07-09T21:59:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 -- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c15f610 msgr2=0x7f0f0c15fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c15f610 0x7f0f0c15fa60 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f0ef8009870 tx=0x7f0ef801c480 comp rx=0 tx=0).stop 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 -- 172.21.15.37:0/1946831109 shutdown_connections 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c06b9c0 0x7f0f0c06be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 --2- 172.21.15.37:0/1946831109 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c15f610 0x7f0f0c15fa60 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 -- 172.21.15.37:0/1946831109 >> 172.21.15.37:0/1946831109 conn(0x7f0f0c06d230 msgr2=0x7f0f0c06d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 -- 172.21.15.37:0/1946831109 shutdown_connections 2023-07-09T21:59:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 -- 172.21.15.37:0/1946831109 wait complete. 2023-07-09T21:59:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.195+0000 7f0f13207640 1 Processor -- start 2023-07-09T21:59:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- start start 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c06b9c0 0x7f0f0c0cf070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 0x7f0f0c15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c9580 con 0x7f0f0c15bb90 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c153cc0 con 0x7f0f0c06b9c0 2023-07-09T21:59:59.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c8800 con 0x7f0f0c15f610 2023-07-09T21:59:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35228/0 (socket says 172.21.15.37:35228) 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 -- 172.21.15.37:0/2332213626 learned_addr learned my addr 172.21.15.37:0/2332213626 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f10fa3640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c06b9c0 0x7f0f0c0cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f117a4640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 0x7f0f0c15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 -- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 msgr2=0x7f0f0c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 0x7f0f0c15e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 -- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c06b9c0 msgr2=0x7f0f0c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c06b9c0 0x7f0f0c0cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 -- 172.21.15.37:0/2332213626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f04009a70 con 0x7f0f0c15bb90 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f117a4640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 0x7f0f0c15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f0bfff640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801a0b0 tx=0x7f0ef801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80b4800 con 0x7f0f0c15bb90 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef80b4980 con 0x7f0f0c15bb90 2023-07-09T21:59:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef80b4d30 con 0x7f0f0c15bb90 2023-07-09T21:59:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef80094d0 con 0x7f0f0c15bb90 2023-07-09T21:59:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c0c8d80 con 0x7f0f0c15bb90 2023-07-09T21:59:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.199+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04d7d0 con 0x7f0f0c15bb90 2023-07-09T21:59:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.203+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 84) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f0ef80c7440 con 0x7f0f0c15bb90 2023-07-09T21:59:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.203+0000 7f0f097fa640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 0x7f0ef00685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T21:59:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.203+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f0ef811e9c0 con 0x7f0f0c15bb90 2023-07-09T21:59:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.203+0000 7f0f10fa3640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 0x7f0ef00685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T21:59:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.203+0000 7f0f10fa3640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 0x7f0ef00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000f70 tx=0x7f0f00007b60 comp rx=0 tx=0).ready entity=mgr.8480 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T21:59:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.207+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ef80ebf20 con 0x7f0f0c15bb90 2023-07-09T21:59:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.383+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 --> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f0c06ef70 con 0x7f0ef0066120 2023-07-09T21:59:59.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f097fa640 1 -- 172.21.15.37:0/2332213626 <== mgr.8480 v2:172.21.15.119:6832/4130882000 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f0f000071f0 con 0x7f0ef0066120 2023-07-09T21:59:59.394 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T21:59:59.394 INFO:teuthology.orchestra.run.smithi037.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-09T21:59:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 msgr2=0x7f0ef00685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 0x7f0ef00685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000f70 tx=0x7f0f00007b60 comp rx=0 tx=0).stop 2023-07-09T21:59:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 msgr2=0x7f0f0c15e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T21:59:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f0ef801a0b0 tx=0x7f0ef801acc0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 shutdown_connections 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0f0c15f610 0x7f0f0c15e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c15bb90 0x7f0f0c15e2e0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0ef0066120 0x7f0ef00685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 --2- 172.21.15.37:0/2332213626 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0f0c06b9c0 0x7f0f0c0cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 >> 172.21.15.37:0/2332213626 conn(0x7f0f0c06d230 msgr2=0x7f0f0c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 shutdown_connections 2023-07-09T21:59:59.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T21:59:59.391+0000 7f0f13207640 1 -- 172.21.15.37:0/2332213626 wait complete. 2023-07-09T21:59:59.415 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-09T21:59:59.416 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-09T21:59:59.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T21:59:59.417 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T21:59:59.432 INFO:tasks.cephfs.test_snap_schedules:snapshots: set() 2023-07-09T21:59:59.433 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T21:59:59.433 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:00.034 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:00:00.034+0000 7f6aa34e9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:00:00.034 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:00:00.034+0000 7f6aa34e9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:00:00.034 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:00:00.034+0000 7f6aa34e9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:00:00.034 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:00:00.034+0000 7f6aa34e9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:00:00.035 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:00:00.034+0000 7f6aa34e9640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:00:00.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:00.435 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:00.451 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:00.452 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:00.452 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:00.453 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:00.453 DEBUG:tasks.cephfs.test_snap_schedules:snapshots added=['scheduled-2023-07-09-22_00_00_UTC'] 2023-07-09T22:00:00.453 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688939999.0459309, now = 1688940000.4536035, timo = 1 2023-07-09T22:00:01.454 DEBUG:tasks.cephfs.test_snap_schedules:expecting removal of snap snap_test_dir1/.snap/scheduled-2023-07-09-22_00_00 in ~61s... 2023-07-09T22:00:01.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:01.455 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:01.471 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:01.473 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:01.473 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:01.473 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:02.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:02.475 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:02.491 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:02.493 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:02.493 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:02.493 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:03.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:03.495 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:03.511 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:03.512 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:03.512 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:03.512 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:04.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:04.513 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:04.530 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:04.531 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:04.531 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:04.531 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:05.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:05.533 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:05.550 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:05.551 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:05.551 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:05.552 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:05.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:00:05.606 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:00:06.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:06.553 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:06.569 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:06.570 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:06.570 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:06.571 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:07.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:07.572 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:07.589 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:07.590 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:07.590 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:07.590 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:08.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:08.593 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:08.609 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:08.610 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:08.611 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:08.611 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:09.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:09.613 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:09.630 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:09.631 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:09.632 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:09.632 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:10.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:10.634 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:10.651 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:10.652 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:10.652 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:10.652 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:11.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:11.654 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:11.671 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:11.672 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:11.672 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:11.672 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:12.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:12.674 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:12.690 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:12.691 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:12.692 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:12.692 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:13.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:13.694 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:13.710 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:13.711 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:13.712 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:13.712 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:14.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:14.714 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:14.732 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:14.733 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:14.734 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:14.735 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:15.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:15.736 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:15.754 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:15.755 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:15.755 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:15.756 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:16.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:16.758 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:16.775 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:16.777 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:16.778 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:16.778 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:17.780 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:17.796 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:17.797 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:17.798 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:17.798 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:18.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:18.800 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:18.815 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:18.816 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:18.816 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:18.817 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:19.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:19.818 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:19.832 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:19.833 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:19.833 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:19.834 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:20.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:20.835 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:20.851 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:20.852 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:20.853 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:20.853 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:21.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:21.854 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:21.870 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:21.873 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:21.874 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:21.874 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:22.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:22.875 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:22.891 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:22.892 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:22.893 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:22.893 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:23.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:23.895 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:23.910 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:23.911 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:23.912 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:23.912 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:24.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:24.915 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:24.932 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:24.933 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:24.933 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:24.934 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:25.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:25.935 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:25.951 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:25.952 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:25.952 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:25.952 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:26.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:26.954 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:26.970 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:26.971 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:26.971 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:26.972 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:27.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:27.974 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:27.990 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:27.991 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:27.991 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:27.991 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:28.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:28.993 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:29.008 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:29.009 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:29.010 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:29.010 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:30.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:30.012 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:30.028 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:30.029 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:30.030 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:30.030 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:31.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:31.032 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:31.049 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:31.050 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:31.050 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:31.050 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:32.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:32.052 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:32.068 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:32.069 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:32.070 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:32.070 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:33.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:33.071 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:33.088 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:33.090 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:33.091 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:33.091 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:34.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:34.093 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:34.109 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:34.110 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:34.110 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:34.110 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:35.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:35.112 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:35.128 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:35.129 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:35.130 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:35.130 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:35.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:00:35.673 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:00:36.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:36.131 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:36.148 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:36.149 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:36.149 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:36.149 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:37.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:37.151 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:37.167 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:37.169 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:37.169 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:37.170 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:38.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:38.171 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:38.187 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:38.188 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:38.189 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:38.189 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:39.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:39.191 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:39.207 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:39.208 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:39.209 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:39.209 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:40.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:40.211 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:40.230 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:40.230 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:40.230 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:40.231 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:41.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:41.232 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:41.249 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:41.250 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:41.250 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:41.250 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:42.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:42.252 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:42.268 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:42.269 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:42.270 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:42.270 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:43.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:43.272 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:43.288 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:43.289 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:43.289 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:43.289 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:44.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:44.290 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:44.307 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:44.308 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:44.308 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:44.308 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:45.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:45.309 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:45.326 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:45.327 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:45.327 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:45.327 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:46.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:46.329 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:46.345 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:46.346 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:46.346 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:46.347 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:47.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:47.349 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:47.366 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:47.367 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:47.367 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:47.368 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:48.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:48.372 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:48.390 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:48.390 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:48.391 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:48.391 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:49.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:49.393 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:49.410 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:49.411 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:49.412 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:49.412 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:50.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:50.414 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:50.430 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:50.431 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:50.431 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:50.432 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:51.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:51.433 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:51.449 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:51.450 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:51.450 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:51.451 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:52.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:52.453 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:52.468 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:52.469 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:52.470 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:52.470 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:53.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:53.472 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:53.488 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:53.489 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:53.489 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:53.490 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:54.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:54.491 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:54.507 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:54.509 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:54.509 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:54.509 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:55.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:55.511 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:55.527 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:55.528 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:55.528 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:55.528 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:56.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:56.530 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:56.547 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:56.548 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:56.548 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:56.548 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:57.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:57.549 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:57.565 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:57.566 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:57.567 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:57.568 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:58.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:58.569 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:58.587 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:58.588 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:58.588 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:58.589 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:00:59.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:00:59.591 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:00:59.607 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_00_00_UTC 2023-07-09T22:00:59.608 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:00:59.609 INFO:tasks.cephfs.test_snap_schedules:added: set() 2023-07-09T22:00:59.609 INFO:tasks.cephfs.test_snap_schedules:removed: set() 2023-07-09T22:01:00.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:00.611 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:01:00.628 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_01_00_UTC 2023-07-09T22:01:00.629 INFO:tasks.cephfs.test_snap_schedules:snapshots: {'scheduled-2023-07-09-22_01_00_UTC'} 2023-07-09T22:01:00.629 INFO:tasks.cephfs.test_snap_schedules:added: {'scheduled-2023-07-09-22_01_00_UTC'} 2023-07-09T22:01:00.630 INFO:tasks.cephfs.test_snap_schedules:removed: {'scheduled-2023-07-09-22_00_00_UTC'} 2023-07-09T22:01:00.630 DEBUG:tasks.cephfs.test_snap_schedules:snapshots removed=['scheduled-2023-07-09-22_00_00_UTC'] 2023-07-09T22:01:00.630 DEBUG:tasks.cephfs.test_snap_schedules:exec=1688939999.0459309, now = 1688940060.6308153, timo = 61 2023-07-09T22:01:01.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-09T22:01:01.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 Processor -- start 2023-07-09T22:01:01.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 -- start start 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7d840b7980 0x7f7d84160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d840d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8415bf80 con 0x7f7d840ceb80 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840cd070 con 0x7f7d840b7980 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8c39f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840cfd70 con 0x7f7d840d0780 2023-07-09T22:01:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8993a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7d840ceb80 0x7f7d840cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40082/0 (socket says 172.21.15.37:40082) 2023-07-09T22:01:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8993a640 1 -- 172.21.15.37:0/4047779487 learned_addr learned my addr 172.21.15.37:0/4047779487 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a93c640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d840d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/4047779487 >> v2:172.21.15.119:3300/0 conn(0x7f7d840b7980 0x7f7d84160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d89139640 1 -- 172.21.15.37:0/4047779487 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183450693 0 0) 0x7f7d74001120 con 0x7f7d840ceb80 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d89139640 1 -- 172.21.15.37:0/4047779487 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d70003530 con 0x7f7d840ceb80 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a13b640 1 -- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 msgr2=0x7f7d840d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d840d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a13b640 1 -- 172.21.15.37:0/4047779487 >> v1:172.21.15.37:6789/0 conn(0x7f7d840ceb80 legacy=0x7f7d840cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:01.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.786+0000 7f7d8a13b640 1 -- 172.21.15.37:0/4047779487 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84160570 con 0x7f7d840b7980 2023-07-09T22:01:01.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d84160030 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7d800097c0 tx=0x7f7d8001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=229a2d43e5bb46cd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d89139640 1 -- 172.21.15.37:0/4047779487 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800ab600 con 0x7f7d840b7980 2023-07-09T22:01:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d89139640 1 -- 172.21.15.37:0/4047779487 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d800a7050 con 0x7f7d840b7980 2023-07-09T22:01:01.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d89139640 1 -- 172.21.15.37:0/4047779487 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d800ab980 con 0x7f7d840b7980 2023-07-09T22:01:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 -- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 msgr2=0x7f7d84160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d84160030 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f7d800097c0 tx=0x7f7d8001c480 comp rx=0 tx=0).stop 2023-07-09T22:01:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 -- 172.21.15.37:0/4047779487 shutdown_connections 2023-07-09T22:01:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d840d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:01.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/4047779487 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d84160030 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.790+0000 7f7d8c39f640 1 -- 172.21.15.37:0/4047779487 >> 172.21.15.37:0/4047779487 conn(0x7f7d84073090 msgr2=0x7f7d84069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- 172.21.15.37:0/4047779487 shutdown_connections 2023-07-09T22:01:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- 172.21.15.37:0/4047779487 wait complete. 2023-07-09T22:01:01.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 Processor -- start 2023-07-09T22:01:01.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- start start 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d841523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d8415dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c7c70 con 0x7f7d840ceb80 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c87f0 con 0x7f7d840b7980 2023-07-09T22:01:01.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8c39f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840c8ad0 con 0x7f7d840d0780 2023-07-09T22:01:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50746/0 (socket says 172.21.15.37:50746) 2023-07-09T22:01:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 -- 172.21.15.37:0/343262507 learned_addr learned my addr 172.21.15.37:0/343262507 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d841523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8a93c640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d8415dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 -- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 msgr2=0x7f7d8415dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d8415dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:01.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 -- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 msgr2=0x7f7d841523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d841523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 -- 172.21.15.37:0/343262507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009420 con 0x7f7d840ceb80 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d8993a640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c4d0 tx=0x7f7d7400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.794+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74005cf0 con 0x7f7d840ceb80 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74005e50 con 0x7f7d840ceb80 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74007290 con 0x7f7d840ceb80 2023-07-09T22:01:01.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d840b1c00 con 0x7f7d840ceb80 2023-07-09T22:01:01.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d841520e0 con 0x7f7d840ceb80 2023-07-09T22:01:01.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8404d7d0 con 0x7f7d840ceb80 2023-07-09T22:01:01.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 86) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f7d740073f0 con 0x7f7d840ceb80 2023-07-09T22:01:01.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d7affd640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 0x7f7d680689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6520+0+0 (secure 0 0 0) 0x7f7d740837d0 con 0x7f7d840ceb80 2023-07-09T22:01:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.798+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 0x7f7d680689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:01.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.802+0000 7f7d8a13b640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 0x7f7d680689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d800ad000 tx=0x7f7d80008040 comp rx=0 tx=0).ready entity=mgr.8480 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:01.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.802+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d74050730 con 0x7f7d840ceb80 2023-07-09T22:01:01.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:01.974+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 --> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7d840c8960 con 0x7f7d68066510 2023-07-09T22:01:02.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.046+0000 7f7d7affd640 1 -- 172.21.15.37:0/343262507 <== mgr.8480 v2:172.21.15.119:6832/4130882000 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f7d840c8960 con 0x7f7d68066510 2023-07-09T22:01:02.052 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path snap_test_dir1 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 msgr2=0x7f7d680689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 0x7f7d680689c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7d800ad000 tx=0x7f7d80008040 comp rx=0 tx=0).stop 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 msgr2=0x7f7d84150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c4d0 tx=0x7f7d7400c990 comp rx=0 tx=0).stop 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 shutdown_connections 2023-07-09T22:01:02.054 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d840d0780 0x7f7d8415dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d840ceb80 0x7f7d84150610 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f7d68066510 0x7f7d680689c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 --2- 172.21.15.37:0/343262507 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d840b7980 0x7f7d841523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 >> 172.21.15.37:0/343262507 conn(0x7f7d84073090 msgr2=0x7f7d840b4fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 shutdown_connections 2023-07-09T22:01:02.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.050+0000 7f7d8c39f640 1 -- 172.21.15.37:0/343262507 wait complete. 2023-07-09T22:01:02.072 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-09T22:01:02.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:02.073 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:01:02.087 INFO:teuthology.orchestra.run.smithi037.stdout:scheduled-2023-07-09-22_01_00_UTC 2023-07-09T22:01:02.088 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/.snap/scheduled-2023-07-09-22_01_00_UTC 2023-07-09T22:01:02.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:02.088 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/.snap/scheduled-2023-07-09-22_01_00_UTC) 2023-07-09T22:01:02.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:02.146 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T22:01:02.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T22:01:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.386+0000 7f5af2648640 1 Processor -- start 2023-07-09T22:01:02.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 -- start start 2023-07-09T22:01:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 0x7f5aec160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5aec0ceb80 0x7f5aec0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aec15bf80 con 0x7f5aec0b3c20 2023-07-09T22:01:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aec0cd070 con 0x7f5aec0ceb80 2023-07-09T22:01:02.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af2648640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0cfd70 con 0x7f5aec0b7980 2023-07-09T22:01:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5aec0ceb80 0x7f5aec0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5aec0ceb80 0x7f5aec0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50762/0 (socket says 172.21.15.37:50762) 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5af0be5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5aec0b3c20 0x7f5aec0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40084/0 (socket says 172.21.15.37:40084) 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 -- 172.21.15.37:0/4045944624 learned_addr learned my addr 172.21.15.37:0/4045944624 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aebfff640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 0x7f5aec160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 -- 172.21.15.37:0/4045944624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 msgr2=0x7f5aec160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 0x7f5aec160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 -- 172.21.15.37:0/4045944624 >> v1:172.21.15.37:6789/0 conn(0x7f5aec0b3c20 legacy=0x7f5aec0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeb7fe640 1 -- 172.21.15.37:0/4045944624 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec160570 con 0x7f5aec0ceb80 2023-07-09T22:01:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aeaffd640 1 -- 172.21.15.37:0/4045944624 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 463488847 0 0) 0x7f5ae40014a0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.390+0000 7f5aebfff640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 0x7f5aec160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:02.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0ceb80 0x7f5aec0cef90 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e7dccb6505311 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5aeaffd640 1 -- 172.21.15.37:0/4045944624 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00ab600 con 0x7f5aec0ceb80 2023-07-09T22:01:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5aeaffd640 1 -- 172.21.15.37:0/4045944624 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae00a7050 con 0x7f5aec0ceb80 2023-07-09T22:01:02.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5aeaffd640 1 -- 172.21.15.37:0/4045944624 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae00ab980 con 0x7f5aec0ceb80 2023-07-09T22:01:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- 172.21.15.37:0/4045944624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0ceb80 msgr2=0x7f5aec0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0ceb80 0x7f5aec0cef90 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0009870 tx=0x7f5ae001c540 comp rx=0 tx=0).stop 2023-07-09T22:01:02.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- 172.21.15.37:0/4045944624 shutdown_connections 2023-07-09T22:01:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0ceb80 0x7f5aec0cef90 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 --2- 172.21.15.37:0/4045944624 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0b7980 0x7f5aec160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- 172.21.15.37:0/4045944624 >> 172.21.15.37:0/4045944624 conn(0x7f5aec073090 msgr2=0x7f5aec069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- 172.21.15.37:0/4045944624 shutdown_connections 2023-07-09T22:01:02.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- 172.21.15.37:0/4045944624 wait complete. 2023-07-09T22:01:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 Processor -- start 2023-07-09T22:01:02.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.394+0000 7f5af2648640 1 -- start start 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 0x7f5aec156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 0x7f5aec0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec156cd0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0c9270 con 0x7f5aec0b7980 2023-07-09T22:01:02.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aec0cc210 con 0x7f5aec0ceb80 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50764/0 (socket says 172.21.15.37:50764) 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 -- 172.21.15.37:0/4056862946 learned_addr learned my addr 172.21.15.37:0/4056862946 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af0be5640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 0x7f5aec0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 -- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 msgr2=0x7f5aec0c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 0x7f5aec156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 0x7f5aec0c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 -- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 msgr2=0x7f5aec156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 0x7f5aec156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 -- 172.21.15.37:0/4056862946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00094d0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af0be5640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 0x7f5aec0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 0x7f5aec156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5aebfff640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c7c0 tx=0x7f5adc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc007a30 con 0x7f5aec0b3c20 2023-07-09T22:01:02.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc007b90 con 0x7f5aec0b3c20 2023-07-09T22:01:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc00ce70 con 0x7f5aec0b3c20 2023-07-09T22:01:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aec0cbc20 con 0x7f5aec0b3c20 2023-07-09T22:01:02.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aec0c9760 con 0x7f5aec0b3c20 2023-07-09T22:01:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec04d7d0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.398+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 86) v1 ==== 85891+0+0 (secure 0 0 0) 0x7f5adc0113f0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.402+0000 7f5ae8ff9640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 0x7f5ad80689c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.402+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6520+0+0 (secure 0 0 0) 0x7f5adc084a10 con 0x7f5aec0b3c20 2023-07-09T22:01:02.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.402+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 0x7f5ad80689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:02.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.402+0000 7f5aeb7fe640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 0x7f5ad80689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5aec08ad30 tx=0x7f5ae00a6000 comp rx=0 tx=0).ready entity=mgr.8480 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:02.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.406+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5adc0517b0 con 0x7f5aec0b3c20 2023-07-09T22:01:02.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:02.602+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7f5aec0b1600 con 0x7f5aec0b3c20 2023-07-09T22:01:03.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.586+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f5adc051b80 con 0x7f5aec0b3c20 2023-07-09T22:01:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.586+0000 7f5ae8ff9640 1 -- 172.21.15.37:0/4056862946 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v87) v1 ==== 93+0+0 (secure 0 0 0) 0x7f5adc06f310 con 0x7f5aec0b3c20 2023-07-09T22:01:03.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 msgr2=0x7f5ad80689c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 0x7f5ad80689c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5aec08ad30 tx=0x7f5ae00a6000 comp rx=0 tx=0).stop 2023-07-09T22:01:03.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 msgr2=0x7f5aec1546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00c7c0 tx=0x7f5adc00cc80 comp rx=0 tx=0).stop 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 shutdown_connections 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5aec0ceb80 0x7f5aec0c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f5ad8066510 0x7f5ad80689c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5aec0b7980 0x7f5aec156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 --2- 172.21.15.37:0/4056862946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5aec0b3c20 0x7f5aec1546c0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 >> 172.21.15.37:0/4056862946 conn(0x7f5aec073090 msgr2=0x7f5aec0b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:03.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 shutdown_connections 2023-07-09T22:01:03.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.590+0000 7f5af2648640 1 -- 172.21.15.37:0/4056862946 wait complete. 2023-07-09T22:01:03.618 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T22:01:03.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:03.712 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:03.767 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T22:01:03.768 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:03.768 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:03.769 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:03.768+0000 7f5271cc8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:03.772 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:03.766+0000 7f8265046180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:03.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:03.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 Processor -- start 2023-07-09T22:01:03.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 -- start start 2023-07-09T22:01:03.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 0x7f150006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 0x7f15000d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15000b49f0 con 0x7f15000b7ab0 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15000b7e80 con 0x7f15000cef80 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f1504dba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cc8a0 con 0x7f15000b4340 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 0x7f150006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14fed9d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 0x7f15000d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:03.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14fe59c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f15000b7ab0 0x7f15000b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51030/0 (socket says 172.21.15.37:51030) 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14fe59c640 1 -- 172.21.15.37:0/2427838771 learned_addr learned my addr 172.21.15.37:0/2427838771 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14f7fff640 1 -- 172.21.15.37:0/2427838771 >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 msgr2=0x7f15000d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14f7fff640 1 --2- 172.21.15.37:0/2427838771 >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 0x7f15000d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14f7fff640 1 -- 172.21.15.37:0/2427838771 >> v1:172.21.15.119:6789/0 conn(0x7f15000b7ab0 legacy=0x7f15000b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14f7fff640 1 -- 172.21.15.37:0/2427838771 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15000ccb80 con 0x7f15000b4340 2023-07-09T22:01:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.962+0000 7f14fed9d640 1 --2- 172.21.15.37:0/2427838771 >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 0x7f15000d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:03.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f14f7fff640 1 --2- 172.21.15.37:0/2427838771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 0x7f150006aa50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14e80097c0 tx=0x7f14e801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=961ba4d389584527 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f14fdd9b640 1 -- 172.21.15.37:0/2427838771 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80ab650 con 0x7f15000b4340 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f14fdd9b640 1 -- 172.21.15.37:0/2427838771 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e80ab7b0 con 0x7f15000b4340 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f14fdd9b640 1 -- 172.21.15.37:0/2427838771 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80abb40 con 0x7f15000b4340 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 -- 172.21.15.37:0/2427838771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 msgr2=0x7f150006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 --2- 172.21.15.37:0/2427838771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 0x7f150006aa50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f14e80097c0 tx=0x7f14e801c450 comp rx=0 tx=0).stop 2023-07-09T22:01:03.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 -- 172.21.15.37:0/2427838771 shutdown_connections 2023-07-09T22:01:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 --2- 172.21.15.37:0/2427838771 >> v2:172.21.15.119:3300/0 conn(0x7f15000cef80 0x7f15000d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 --2- 172.21.15.37:0/2427838771 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000b4340 0x7f150006aa50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.966+0000 7f1504dba640 1 -- 172.21.15.37:0/2427838771 >> 172.21.15.37:0/2427838771 conn(0x7f1500073090 msgr2=0x7f1500069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- 172.21.15.37:0/2427838771 shutdown_connections 2023-07-09T22:01:03.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- 172.21.15.37:0/2427838771 wait complete. 2023-07-09T22:01:03.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 Processor -- start 2023-07-09T22:01:03.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- start start 2023-07-09T22:01:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7ab0 0x7f15000b6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000cef80 0x7f15000b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150014f090 con 0x7f15000b7ab0 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15000c9bd0 con 0x7f15000b4340 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f1504dba640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000c81f0 con 0x7f15000cef80 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14f7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7ab0 0x7f15000b6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fed9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000cef80 0x7f15000b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:45498/0 (socket says 172.21.15.37:45498) 2023-07-09T22:01:03.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 -- 172.21.15.37:0/1094811306 learned_addr learned my addr 172.21.15.37:0/1094811306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:03.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 -- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000cef80 msgr2=0x7f15000b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000cef80 0x7f15000b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 -- 172.21.15.37:0/1094811306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7ab0 msgr2=0x7f15000b6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7ab0 0x7f15000b6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.970+0000 7f14fe59c640 1 -- 172.21.15.37:0/1094811306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f8009a70 con 0x7f15000b4340 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f14fe59c640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c500 tx=0x7f14f000c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:03.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f0005cf0 con 0x7f15000b4340 2023-07-09T22:01:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f0005e50 con 0x7f15000b4340 2023-07-09T22:01:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e8009420 con 0x7f15000b4340 2023-07-09T22:01:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f00072d0 con 0x7f15000b4340 2023-07-09T22:01:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15000c78c0 con 0x7f15000b4340 2023-07-09T22:01:03.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f150004d7d0 con 0x7f15000b4340 2023-07-09T22:01:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.974+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f14f0007430 con 0x7f15000b4340 2023-07-09T22:01:03.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.978+0000 7f14f6ffd640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 0x7f14e0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.978+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6520+0+0 (secure 0 0 0) 0x7f14f0037020 con 0x7f15000b4340 2023-07-09T22:01:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.978+0000 7f14f7fff640 1 -- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 msgr2=0x7f14e0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:03.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.978+0000 7f14f7fff640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 0x7f14e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:03.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:03.982+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14f0050bd0 con 0x7f15000b4340 2023-07-09T22:01:04.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.142+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150006a830 con 0x7f15000b4340 2023-07-09T22:01:04.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f14f6ffd640 1 -- 172.21.15.37:0/1094811306 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+19041 (secure 0 0 0) 0x7f14f00541f0 con 0x7f15000b4340 2023-07-09T22:01:04.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:04.150 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":180,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:00:59.559769+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.2b","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3145962994":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6833/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6832/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/113945541":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/3463027125":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/473096067":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/207456882":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/1513289062":"2023-07-10T21:59:57.510086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 msgr2=0x7f14e0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 0x7f14e0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 msgr2=0x7f150014eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f14f000c500 tx=0x7f14f000c900 comp rx=0 tx=0).stop 2023-07-09T22:01:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 shutdown_connections 2023-07-09T22:01:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f15000cef80 0x7f15000b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15000b7ab0 0x7f15000b6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f14e00664c0 0x7f14e0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 --2- 172.21.15.37:0/1094811306 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f15000b4340 0x7f150014eb50 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 >> 172.21.15.37:0/1094811306 conn(0x7f1500073090 msgr2=0x7f1500069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 shutdown_connections 2023-07-09T22:01:04.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.146+0000 7f1504dba640 1 -- 172.21.15.37:0/1094811306 wait complete. 2023-07-09T22:01:04.173 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:59:37.562054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:59:38.431596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:04.174 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:04.190 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:04.188+0000 7f5271cc8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:04.220 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:04.214+0000 7f8265046180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:04.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 Processor -- start 2023-07-09T22:01:04.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 -- start start 2023-07-09T22:01:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fcfbc0cc090 0x7fcfbc0c3980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcfbc06bd00 0x7fcfbc0c3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0c34f0 con 0x7fcfbc141440 2023-07-09T22:01:04.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc06c530 con 0x7fcfbc06bd00 2023-07-09T22:01:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc320b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc141810 con 0x7fcfbc0cc090 2023-07-09T22:01:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc0fa7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcfbc141440 0x7fcfbc0cb980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40094/0 (socket says 172.21.15.37:40094) 2023-07-09T22:01:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc0fa7640 1 -- 172.21.15.37:0/4005692504 learned_addr learned my addr 172.21.15.37:0/4005692504 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:04.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/4005692504 >> v2:172.21.15.37:3300/0 conn(0x7fcfbc06bd00 0x7fcfbc0c3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfbbfff640 1 --2- 172.21.15.37:0/4005692504 >> v2:172.21.15.119:3300/0 conn(0x7fcfbc0cc090 0x7fcfbc0c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfbb7fe640 1 -- 172.21.15.37:0/4005692504 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624681064 0 0) 0x7fcfbc0c34f0 con 0x7fcfbc141440 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfbb7fe640 1 -- 172.21.15.37:0/4005692504 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfac003530 con 0x7fcfbc141440 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc17a8640 1 -- 172.21.15.37:0/4005692504 >> v2:172.21.15.119:3300/0 conn(0x7fcfbc0cc090 msgr2=0x7fcfbc0c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/4005692504 >> v2:172.21.15.119:3300/0 conn(0x7fcfbc0cc090 0x7fcfbc0c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc17a8640 1 -- 172.21.15.37:0/4005692504 >> v1:172.21.15.37:6789/0 conn(0x7fcfbc141440 legacy=0x7fcfbc0cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.318+0000 7fcfc17a8640 1 -- 172.21.15.37:0/4005692504 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc06c250 con 0x7fcfbc06bd00 2023-07-09T22:01:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/4005692504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0c3ec0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc15b970 tx=0x7fcfb401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27c99ee22c963f70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfbb7fe640 1 -- 172.21.15.37:0/4005692504 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a59a0 con 0x7fcfbc06bd00 2023-07-09T22:01:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfbb7fe640 1 -- 172.21.15.37:0/4005692504 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb40a5b00 con 0x7fcfbc06bd00 2023-07-09T22:01:04.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfbb7fe640 1 -- 172.21.15.37:0/4005692504 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40a5e70 con 0x7fcfbc06bd00 2023-07-09T22:01:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- 172.21.15.37:0/4005692504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc06bd00 msgr2=0x7fcfbc0c3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 --2- 172.21.15.37:0/4005692504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0c3ec0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc15b970 tx=0x7fcfb401c8e0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- 172.21.15.37:0/4005692504 shutdown_connections 2023-07-09T22:01:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 --2- 172.21.15.37:0/4005692504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0c3ec0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 --2- 172.21.15.37:0/4005692504 >> v2:172.21.15.119:3300/0 conn(0x7fcfbc0cc090 0x7fcfbc0c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- 172.21.15.37:0/4005692504 >> 172.21.15.37:0/4005692504 conn(0x7fcfbc0cde40 msgr2=0x7fcfbc0ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- 172.21.15.37:0/4005692504 shutdown_connections 2023-07-09T22:01:04.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- 172.21.15.37:0/4005692504 wait complete. 2023-07-09T22:01:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 Processor -- start 2023-07-09T22:01:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.326+0000 7fcfc320b640 1 -- start start 2023-07-09T22:01:04.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfbc0cc090 0x7fcfbc0b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc15b690 con 0x7fcfbc141440 2023-07-09T22:01:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc15c1b0 con 0x7fcfbc06bd00 2023-07-09T22:01:04.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b37e0 con 0x7fcfbc0cc090 2023-07-09T22:01:04.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50804/0 (socket says 172.21.15.37:50804) 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 -- 172.21.15.37:0/3934906144 learned_addr learned my addr 172.21.15.37:0/3934906144 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfbbfff640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfbc0cc090 0x7fcfbc0b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc0fa7640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 -- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfbc0cc090 msgr2=0x7fcfbc0b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfbc0cc090 0x7fcfbc0b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 -- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfbc06bd00 msgr2=0x7fcfbc0b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 -- 172.21.15.37:0/3934906144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4009a70 con 0x7fcfbc141440 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc17a8640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40194f0 tx=0x7fcfb4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40aed30 con 0x7fcfbc141440 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb40aee90 con 0x7fcfbc141440 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc0b2e50 con 0x7fcfbc141440 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb40b7610 con 0x7fcfbc141440 2023-07-09T22:01:04.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc13aff0 con 0x7fcfbc141440 2023-07-09T22:01:04.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.330+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc15c340 con 0x7fcfbc141440 2023-07-09T22:01:04.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.334+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fcfb40b4050 con 0x7fcfbc141440 2023-07-09T22:01:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.334+0000 7fcfb97fa640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 0x7fcfa0068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.334+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6520+0+0 (secure 0 0 0) 0x7fcfb411f530 con 0x7fcfbc141440 2023-07-09T22:01:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.334+0000 7fcfc0fa7640 1 -- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 msgr2=0x7fcfa0068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:04.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.334+0000 7fcfc0fa7640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 0x7fcfa0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:04.340 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:04.336+0000 7f5271cc8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:04.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.338+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfb40ec640 con 0x7fcfbc141440 2023-07-09T22:01:04.388 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:04.382+0000 7f8265046180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:04.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfbc04d7d0 con 0x7fcfbc141440 2023-07-09T22:01:04.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfb97fa640 1 -- 172.21.15.37:0/3934906144 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfb4009450 con 0x7fcfbc141440 2023-07-09T22:01:04.502 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 msgr2=0x7fcfa0068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 0x7fcfa0068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 msgr2=0x7fcfbc13aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40194f0 tx=0x7fcfb4019680 comp rx=0 tx=0).stop 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 shutdown_connections 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcfbc141440 0x7fcfbc13aab0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fcfbc0cc090 0x7fcfbc0b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fcfa00664c0 0x7fcfa0068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 --2- 172.21.15.37:0/3934906144 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fcfbc06bd00 0x7fcfbc0b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 >> 172.21.15.37:0/3934906144 conn(0x7fcfbc0cde40 msgr2=0x7fcfbc0ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 shutdown_connections 2023-07-09T22:01:04.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.498+0000 7fcfc320b640 1 -- 172.21.15.37:0/3934906144 wait complete. 2023-07-09T22:01:04.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:04.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.714+0000 7f0be759e640 1 Processor -- start 2023-07-09T22:01:04.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.714+0000 7f0be759e640 1 -- start start 2023-07-09T22:01:04.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be80ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0be80b11a0 0x7f0be80cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be815bf00 con 0x7f0be815bb30 2023-07-09T22:01:04.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be80ce970 con 0x7f0be80b11a0 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be815f6e0 con 0x7f0be80b41e0 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0be815bb30 0x7f0be80b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40106/0 (socket says 172.21.15.37:40106) 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be659c640 1 -- 172.21.15.37:0/388906101 learned_addr learned my addr 172.21.15.37:0/388906101 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/388906101 >> v2:172.21.15.37:3300/0 conn(0x7f0be80b11a0 0x7f0be80cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be5d9b640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be80ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be559a640 1 -- 172.21.15.37:0/388906101 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762182786 0 0) 0x7f0be815bf00 con 0x7f0be815bb30 2023-07-09T22:01:04.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be559a640 1 -- 172.21.15.37:0/388906101 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bd0003530 con 0x7f0be815bb30 2023-07-09T22:01:04.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be6d9d640 1 -- 172.21.15.37:0/388906101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 msgr2=0x7f0be80ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:04.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be80ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be6d9d640 1 -- 172.21.15.37:0/388906101 >> v1:172.21.15.37:6789/0 conn(0x7f0be815bb30 legacy=0x7f0be80b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.718+0000 7f0be6d9d640 1 -- 172.21.15.37:0/388906101 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be815f9c0 con 0x7f0be80b11a0 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b11a0 0x7f0be80cfcb0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009d90 tx=0x7f0be001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a916085426a41ee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be559a640 1 -- 172.21.15.37:0/388906101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00a5950 con 0x7f0be80b11a0 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be559a640 1 -- 172.21.15.37:0/388906101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be00a5ab0 con 0x7f0be80b11a0 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be559a640 1 -- 172.21.15.37:0/388906101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00a5e40 con 0x7f0be80b11a0 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 -- 172.21.15.37:0/388906101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b11a0 msgr2=0x7f0be80cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b11a0 0x7f0be80cfcb0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009d90 tx=0x7f0be001c890 comp rx=0 tx=0).stop 2023-07-09T22:01:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 -- 172.21.15.37:0/388906101 shutdown_connections 2023-07-09T22:01:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be80b11a0 0x7f0be80cfcb0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 --2- 172.21.15.37:0/388906101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be80ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 -- 172.21.15.37:0/388906101 >> 172.21.15.37:0/388906101 conn(0x7f0be806aac0 msgr2=0x7f0be80cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 -- 172.21.15.37:0/388906101 shutdown_connections 2023-07-09T22:01:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.722+0000 7f0be759e640 1 -- 172.21.15.37:0/388906101 wait complete. 2023-07-09T22:01:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 Processor -- start 2023-07-09T22:01:04.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- start start 2023-07-09T22:01:04.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b11a0 0x7f0be8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be81f3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80b1920 con 0x7f0be815bb30 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be81f5000 con 0x7f0be80b11a0 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be80b1bc0 con 0x7f0be80b41e0 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50820/0 (socket says 172.21.15.37:50820) 2023-07-09T22:01:04.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 -- 172.21.15.37:0/2134843156 learned_addr learned my addr 172.21.15.37:0/2134843156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:04.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be5d9b640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be81f3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be659c640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b11a0 0x7f0be8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:04.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 -- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 msgr2=0x7f0be81f3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be81f3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 -- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b11a0 msgr2=0x7f0be8153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b11a0 0x7f0be8153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 -- 172.21.15.37:0/2134843156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be0009a70 con 0x7f0be815bb30 2023-07-09T22:01:04.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be5d9b640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be81f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:04.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be6d9d640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009d90 tx=0x7f0be0019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00adce0 con 0x7f0be815bb30 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be00ade40 con 0x7f0be815bb30 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be00b9690 con 0x7f0be815bb30 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be81f43c0 con 0x7f0be815bb30 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.726+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be81f4970 con 0x7f0be815bb30 2023-07-09T22:01:04.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be80b1d50 con 0x7f0be815bb30 2023-07-09T22:01:04.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f0be00b97f0 con 0x7f0be815bb30 2023-07-09T22:01:04.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0bd6ffd640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 0x7f0bc8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f0be011f9c0 con 0x7f0be815bb30 2023-07-09T22:01:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0be659c640 1 -- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 msgr2=0x7f0bc8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.730+0000 7f0be659c640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 0x7f0bc8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:04.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.734+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0be00ec980 con 0x7f0be815bb30 2023-07-09T22:01:04.827 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:04.824+0000 7f5271cc8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:04.885 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:04.884+0000 7f5271cc8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.890+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0be804e020 con 0x7f0be815bb30 2023-07-09T22:01:04.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.890+0000 7f0bd6ffd640 1 -- 172.21.15.37:0/2134843156 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v181) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0be0009450 con 0x7f0be815bb30 2023-07-09T22:01:04.897 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 msgr2=0x7f0bc8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 0x7f0bc8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 msgr2=0x7f0be814ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f0be0009d90 tx=0x7f0be0019630 comp rx=0 tx=0).stop 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 shutdown_connections 2023-07-09T22:01:04.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0be815bb30 0x7f0be814ade0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0be80b41e0 0x7f0be81f3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f0bc80664c0 0x7f0bc8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 --2- 172.21.15.37:0/2134843156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0be80b11a0 0x7f0be8153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 >> 172.21.15.37:0/2134843156 conn(0x7f0be806aac0 msgr2=0x7f0be80d1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 shutdown_connections 2023-07-09T22:01:04.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:04.894+0000 7f0be759e640 1 -- 172.21.15.37:0/2134843156 wait complete. 2023-07-09T22:01:04.914 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:04.910+0000 7f8265046180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:04.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:01:04.941 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:04.940+0000 7f5271cc8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:04.980 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:04.974+0000 7f8265046180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:05.034 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.032+0000 7f5271cc8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:05.044 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.038+0000 7f8265046180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:05.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.070+0000 7f607f500640 1 Processor -- start 2023-07-09T22:01:05.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.070+0000 7f607f500640 1 -- start start 2023-07-09T22:01:05.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607f500640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f60780cf290 0x7f6078160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607f500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 0x7f60780d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607f500640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607815bf80 con 0x7f60780b7980 2023-07-09T22:01:05.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607f500640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60780cd070 con 0x7f60780cf290 2023-07-09T22:01:05.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607f500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cfd70 con 0x7f60780d0780 2023-07-09T22:01:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607ca9b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f60780cf290 0x7f6078160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607da9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 0x7f60780d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607d29c640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f60780b7980 0x7f60780ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51040/0 (socket says 172.21.15.37:51040) 2023-07-09T22:01:05.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607d29c640 1 -- 172.21.15.37:0/1428646746 learned_addr learned my addr 172.21.15.37:0/1428646746 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607da9d640 1 -- 172.21.15.37:0/1428646746 >> v2:172.21.15.119:3300/0 conn(0x7f60780cf290 msgr2=0x7f6078160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607da9d640 1 --2- 172.21.15.37:0/1428646746 >> v2:172.21.15.119:3300/0 conn(0x7f60780cf290 0x7f6078160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607da9d640 1 -- 172.21.15.37:0/1428646746 >> v1:172.21.15.119:6789/0 conn(0x7f60780b7980 legacy=0x7f60780ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.074+0000 7f607da9d640 1 -- 172.21.15.37:0/1428646746 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078160570 con 0x7f60780d0780 2023-07-09T22:01:05.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607da9d640 1 --2- 172.21.15.37:0/1428646746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 0x7f60780d0bc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607001c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e960e26b09e1f574 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f606ffff640 1 -- 172.21.15.37:0/1428646746 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700a5810 con 0x7f60780d0780 2023-07-09T22:01:05.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f606ffff640 1 -- 172.21.15.37:0/1428646746 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700a5970 con 0x7f60780d0780 2023-07-09T22:01:05.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f606ffff640 1 -- 172.21.15.37:0/1428646746 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700a5d00 con 0x7f60780d0780 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- 172.21.15.37:0/1428646746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 msgr2=0x7f60780d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 --2- 172.21.15.37:0/1428646746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 0x7f60780d0bc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6070009d90 tx=0x7f607001c950 comp rx=0 tx=0).stop 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- 172.21.15.37:0/1428646746 shutdown_connections 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 --2- 172.21.15.37:0/1428646746 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780d0780 0x7f60780d0bc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 --2- 172.21.15.37:0/1428646746 >> v2:172.21.15.119:3300/0 conn(0x7f60780cf290 0x7f6078160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- 172.21.15.37:0/1428646746 >> 172.21.15.37:0/1428646746 conn(0x7f6078073090 msgr2=0x7f6078069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:05.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- 172.21.15.37:0/1428646746 shutdown_connections 2023-07-09T22:01:05.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- 172.21.15.37:0/1428646746 wait complete. 2023-07-09T22:01:05.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 Processor -- start 2023-07-09T22:01:05.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.078+0000 7f607f500640 1 -- start start 2023-07-09T22:01:05.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780b7980 0x7f6078150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 0x7f60780b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780b4280 con 0x7f60780d0780 2023-07-09T22:01:05.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607815b1c0 con 0x7f60780cf290 2023-07-09T22:01:05.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607815b950 con 0x7f60780b7980 2023-07-09T22:01:05.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50832/0 (socket says 172.21.15.37:50832) 2023-07-09T22:01:05.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 -- 172.21.15.37:0/1086633825 learned_addr learned my addr 172.21.15.37:0/1086633825 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:05.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607ca9b640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 0x7f60780b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607d29c640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780b7980 0x7f6078150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 -- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780b7980 msgr2=0x7f6078150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780b7980 0x7f6078150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 -- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 msgr2=0x7f60780b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 0x7f60780b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 -- 172.21.15.37:0/1086633825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070009a70 con 0x7f60780d0780 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607ca9b640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 0x7f60780b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607da9d640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f60700b0040 tx=0x7f60700196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700b9860 con 0x7f60780d0780 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700b99c0 con 0x7f60780d0780 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780b44b0 con 0x7f60780d0780 2023-07-09T22:01:05.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700b9d70 con 0x7f60780d0780 2023-07-09T22:01:05.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f607815b430 con 0x7f60780d0780 2023-07-09T22:01:05.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.082+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780737d0 con 0x7f60780d0780 2023-07-09T22:01:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.086+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f60700c4460 con 0x7f60780d0780 2023-07-09T22:01:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.086+0000 7f606dffb640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 0x7f605c068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.086+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6608+0+0 (secure 0 0 0) 0x7f607011f520 con 0x7f60780d0780 2023-07-09T22:01:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.086+0000 7f607d29c640 1 -- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 msgr2=0x7f605c068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:05.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.086+0000 7f607d29c640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 0x7f605c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:05.092 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.088+0000 7f5271cc8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:05.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.090+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60780737d0 con 0x7f60780d0780 2023-07-09T22:01:05.139 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.134+0000 7f8265046180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:05.176 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.172+0000 7f5271cc8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:05.199 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.194+0000 7f8265046180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:05.232 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.228+0000 7f5271cc8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:05.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6078160570 con 0x7f60780d0780 2023-07-09T22:01:05.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f606dffb640 1 -- 172.21.15.37:0/1086633825 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v181) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6078160570 con 0x7f60780d0780 2023-07-09T22:01:05.254 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:01:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 msgr2=0x7f605c068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 0x7f605c068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 msgr2=0x7f60781510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f60700b0040 tx=0x7f60700196f0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 shutdown_connections 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60780d0780 0x7f60781510d0 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f605c0664c0 0x7f605c068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f60780cf290 0x7f60780b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 --2- 172.21.15.37:0/1086633825 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f60780b7980 0x7f6078150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 >> 172.21.15.37:0/1086633825 conn(0x7f6078073090 msgr2=0x7f607815f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 shutdown_connections 2023-07-09T22:01:05.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.250+0000 7f607f500640 1 -- 172.21.15.37:0/1086633825 wait complete. 2023-07-09T22:01:05.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:01:05.289 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.286+0000 7f8265046180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:05.350 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.346+0000 7f8265046180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:05.373 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.372+0000 7f5271cc8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 Processor -- start 2023-07-09T22:01:05.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 -- start start 2023-07-09T22:01:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 0x7fb30c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c15bf80 con 0x7fb30c0b7980 2023-07-09T22:01:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30c160570 con 0x7fb30c0d0780 2023-07-09T22:01:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb311f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0cd070 con 0x7fb30c0cf290 2023-07-09T22:01:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb30b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb30c0b7980 0x7fb30c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40112/0 (socket says 172.21.15.37:40112) 2023-07-09T22:01:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb30b7fe640 1 -- 172.21.15.37:0/1260200030 learned_addr learned my addr 172.21.15.37:0/1260200030 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:05.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb30affd640 1 --2- 172.21.15.37:0/1260200030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 0x7fb30c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313215271 0 0) 0x7fb2fc001120 con 0x7fb30c0b7980 2023-07-09T22:01:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.418+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f4003530 con 0x7fb30c0b7980 2023-07-09T22:01:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3266227078 0 0) 0x7fb3040014a0 con 0x7fb30c0d0780 2023-07-09T22:01:05.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30affd640 1 -- 172.21.15.37:0/1260200030 >> v1:172.21.15.119:6789/0 conn(0x7fb30c0d0780 legacy=0x7fb30c0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30affd640 1 -- 172.21.15.37:0/1260200030 >> v1:172.21.15.37:6789/0 conn(0x7fb30c0b7980 legacy=0x7fb30c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30affd640 1 -- 172.21.15.37:0/1260200030 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c0d02f0 con 0x7fb30c0cf290 2023-07-09T22:01:05.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30affd640 1 --2- 172.21.15.37:0/1260200030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 0x7fb30c160030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097f0 tx=0x7fb30001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11aaa75d6ef98d4d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000ab600 con 0x7fb30c0cf290 2023-07-09T22:01:05.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3000a7050 con 0x7fb30c0cf290 2023-07-09T22:01:05.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb30a7fc640 1 -- 172.21.15.37:0/1260200030 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000ab980 con 0x7fb30c0cf290 2023-07-09T22:01:05.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 -- 172.21.15.37:0/1260200030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 msgr2=0x7fb30c160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 --2- 172.21.15.37:0/1260200030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 0x7fb30c160030 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb3000097f0 tx=0x7fb30001c4c0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 -- 172.21.15.37:0/1260200030 shutdown_connections 2023-07-09T22:01:05.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 --2- 172.21.15.37:0/1260200030 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0cf290 0x7fb30c160030 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 -- 172.21.15.37:0/1260200030 >> 172.21.15.37:0/1260200030 conn(0x7fb30c073090 msgr2=0x7fb30c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:05.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 -- 172.21.15.37:0/1260200030 shutdown_connections 2023-07-09T22:01:05.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.422+0000 7fb311f8f640 1 -- 172.21.15.37:0/1260200030 wait complete. 2023-07-09T22:01:05.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 Processor -- start 2023-07-09T22:01:05.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 -- start start 2023-07-09T22:01:05.435 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.428+0000 7f5271cc8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 0x7fb30c150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 0x7fb30c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c150550 con 0x7fb30c0d0780 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0b2b10 con 0x7fb30c0cf290 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb311f8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb30c0c97b0 con 0x7fb30c0b7980 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30b7fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 0x7fb30c150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50838/0 (socket says 172.21.15.37:50838) 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 0x7fb30c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 -- 172.21.15.37:0/257410337 learned_addr learned my addr 172.21.15.37:0/257410337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 -- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 msgr2=0x7fb30c150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 0x7fb30c150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 -- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 msgr2=0x7fb30c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 0x7fb30c0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 -- 172.21.15.37:0/257410337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009420 con 0x7fb30c0d0780 2023-07-09T22:01:05.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30affd640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 0x7fb30c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30b7fe640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 0x7fb30c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb30bfff640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c750 tx=0x7fb30400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304003db0 con 0x7fb30c0d0780 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.426+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400ce60 con 0x7fb30c0d0780 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb30c0b2d40 con 0x7fb30c0d0780 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb304005270 con 0x7fb30c0d0780 2023-07-09T22:01:05.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb30c0b3300 con 0x7fb30c0d0780 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c04d7d0 con 0x7fb30c0d0780 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fb3040053d0 con 0x7fb30c0d0780 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb2f3fff640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 0x7fb2f8068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6608+0+0 (secure 0 0 0) 0x7fb304083970 con 0x7fb30c0d0780 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb30b7fe640 1 -- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 msgr2=0x7fb2f8068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:05.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.430+0000 7fb30b7fe640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 0x7fb2f8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:05.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.434+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb3040508a0 con 0x7fb30c0d0780 2023-07-09T22:01:05.506 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.502+0000 7f8265046180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:05.569 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.566+0000 7f8265046180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:05.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.590+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb30c160570 con 0x7fb30c0d0780 2023-07-09T22:01:05.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.590+0000 7fb2f3fff640 1 -- 172.21.15.37:0/257410337 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v181) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb304017020 con 0x7fb30c0d0780 2023-07-09T22:01:05.597 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:01:05.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 msgr2=0x7fb2f8068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 0x7fb2f8068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 msgr2=0x7fb30c0cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7fb30400c750 tx=0x7fb30400cc10 comp rx=0 tx=0).stop 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 shutdown_connections 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb30c0d0780 0x7fb30c0cb1e0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fb2f80664c0 0x7fb2f8068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb30c0cf290 0x7fb30c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 --2- 172.21.15.37:0/257410337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb30c0b7980 0x7fb30c150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 >> 172.21.15.37:0/257410337 conn(0x7fb30c073090 msgr2=0x7fb30c0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 shutdown_connections 2023-07-09T22:01:05.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.594+0000 7fb311f8f640 1 -- 172.21.15.37:0/257410337 wait complete. 2023-07-09T22:01:05.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T22:01:05.680 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:05.680 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:05.680 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:05.688 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.684+0000 7f5271cc8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:05.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:01:05.748 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:01:05.824 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.820+0000 7f5271cc8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:05.835 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:05.835 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:05.835 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:05.844 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.838+0000 7f8265046180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:05.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.842+0000 7f8268abd640 1 Processor -- start 2023-07-09T22:01:05.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.842+0000 7f8268abd640 1 -- start start 2023-07-09T22:01:05.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8268abd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f82640b2110 0x7f826415b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8268abd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82640ca5d0 0x7f826406ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8268abd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f826406b280 con 0x7f826415b5c0 2023-07-09T22:01:05.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8268abd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826406a670 con 0x7f82640ca5d0 2023-07-09T22:01:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8268abd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f826406a950 con 0x7f82640b2110 2023-07-09T22:01:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f826259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f826415b5c0 0x7f82640b1a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40128/0 (socket says 172.21.15.37:40128) 2023-07-09T22:01:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f826259c640 1 -- 172.21.15.37:0/1296495510 learned_addr learned my addr 172.21.15.37:0/1296495510 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:05.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8262d9d640 1 --2- 172.21.15.37:0/1296495510 >> v2:172.21.15.37:3300/0 conn(0x7f82640ca5d0 0x7f826406ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f825bfff640 1 --2- 172.21.15.37:0/1296495510 >> v2:172.21.15.119:3300/0 conn(0x7f82640b2110 0x7f826415b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8262d9d640 1 -- 172.21.15.37:0/1296495510 >> v2:172.21.15.119:3300/0 conn(0x7f82640b2110 msgr2=0x7f826415b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8262d9d640 1 --2- 172.21.15.37:0/1296495510 >> v2:172.21.15.119:3300/0 conn(0x7f82640b2110 0x7f826415b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8262d9d640 1 -- 172.21.15.37:0/1296495510 >> v1:172.21.15.37:6789/0 conn(0x7f826415b5c0 legacy=0x7f82640b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8262d9d640 1 -- 172.21.15.37:0/1296495510 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826406ac30 con 0x7f82640ca5d0 2023-07-09T22:01:05.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.846+0000 7f8261d9b640 1 -- 172.21.15.37:0/1296495510 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2509486019 0 0) 0x7f826406b280 con 0x7f826415b5c0 2023-07-09T22:01:05.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8262d9d640 1 --2- 172.21.15.37:0/1296495510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640ca5d0 0x7f826406ecf0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f826406f480 tx=0x7f825c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7f009d8408afe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8261d9b640 1 -- 172.21.15.37:0/1296495510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0a5930 con 0x7f82640ca5d0 2023-07-09T22:01:05.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8261d9b640 1 -- 172.21.15.37:0/1296495510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f825c0a5a90 con 0x7f82640ca5d0 2023-07-09T22:01:05.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8261d9b640 1 -- 172.21.15.37:0/1296495510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f825c0a5e20 con 0x7f82640ca5d0 2023-07-09T22:01:05.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 -- 172.21.15.37:0/1296495510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640ca5d0 msgr2=0x7f826406ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 --2- 172.21.15.37:0/1296495510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640ca5d0 0x7f826406ecf0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f826406f480 tx=0x7f825c01c850 comp rx=0 tx=0).stop 2023-07-09T22:01:05.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 -- 172.21.15.37:0/1296495510 shutdown_connections 2023-07-09T22:01:05.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 --2- 172.21.15.37:0/1296495510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640ca5d0 0x7f826406ecf0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 --2- 172.21.15.37:0/1296495510 >> v2:172.21.15.119:3300/0 conn(0x7f82640b2110 0x7f826415b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 -- 172.21.15.37:0/1296495510 >> 172.21.15.37:0/1296495510 conn(0x7f82640d0c10 msgr2=0x7f8264072400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 -- 172.21.15.37:0/1296495510 shutdown_connections 2023-07-09T22:01:05.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.850+0000 7f8268abd640 1 -- 172.21.15.37:0/1296495510 wait complete. 2023-07-09T22:01:05.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 Processor -- start 2023-07-09T22:01:05.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 -- start start 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82640ca5d0 0x7f826414a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826415b5c0 0x7f8264155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c5310 con 0x7f82640b2110 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c55f0 con 0x7f82640ca5d0 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82640c58d0 con 0x7f826415b5c0 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50852/0 (socket says 172.21.15.37:50852) 2023-07-09T22:01:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 -- 172.21.15.37:0/2247885559 learned_addr learned my addr 172.21.15.37:0/2247885559 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f825bfff640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82640ca5d0 0x7f826414a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8262d9d640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826415b5c0 0x7f8264155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:05.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 -- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826415b5c0 msgr2=0x7f8264155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826415b5c0 0x7f8264155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 -- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82640ca5d0 msgr2=0x7f826414a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82640ca5d0 0x7f826414a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 -- 172.21.15.37:0/2247885559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c009a70 con 0x7f82640b2110 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f826259c640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f825400c480 tx=0x7f825400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:05.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540074e0 con 0x7f82640b2110 2023-07-09T22:01:05.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8254007660 con 0x7f82640b2110 2023-07-09T22:01:05.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8254004a30 con 0x7f82640b2110 2023-07-09T22:01:05.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.854+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82640c5bb0 con 0x7f82640b2110 2023-07-09T22:01:05.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8264156340 con 0x7f82640b2110 2023-07-09T22:01:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f826404d7d0 con 0x7f82640b2110 2023-07-09T22:01:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f8254004b90 con 0x7f82640b2110 2023-07-09T22:01:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f825affd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 0x7f8244068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:05.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6592+0+0 (secure 0 0 0) 0x7f82540834e0 con 0x7f82640b2110 2023-07-09T22:01:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f825bfff640 1 -- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 msgr2=0x7f8244068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:05.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.858+0000 7f825bfff640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 0x7f8244068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:05.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:05.862+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82540504b0 con 0x7f82640b2110 2023-07-09T22:01:05.950 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:05.948+0000 7f5271cc8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:05.991 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:05.986+0000 7f8265046180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:06.020 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:06.016+0000 7f5271cc8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:06.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.030+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82640b5f00 con 0x7f82640b2110 2023-07-09T22:01:06.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.030+0000 7f825affd640 1 -- 172.21.15.37:0/2247885559 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v182) v1 ==== 80+0+473 (secure 0 0 0) 0x7f8254053ad0 con 0x7f82640b2110 2023-07-09T22:01:06.037 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3145962994 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/801119985 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/801119985 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/113945541 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3463027125 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/473096067 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/207456882 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.038 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/1513289062 2023-07-10T21:59:57.510086+0000 2023-07-09T22:01:06.039 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T22:01:06.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 msgr2=0x7f8244068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 0x7f8244068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 msgr2=0x7f82640c4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f825400c480 tx=0x7f825400c940 comp rx=0 tx=0).stop 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 shutdown_connections 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f826415b5c0 0x7f8264155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f82440664c0 0x7f8244068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82640ca5d0 0x7f826414a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 --2- 172.21.15.37:0/2247885559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82640b2110 0x7f82640c4d30 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 >> 172.21.15.37:0/2247885559 conn(0x7f82640d0c10 msgr2=0x7f82640ced00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 shutdown_connections 2023-07-09T22:01:06.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.034+0000 7f8268abd640 1 -- 172.21.15.37:0/2247885559 wait complete. 2023-07-09T22:01:06.058 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T22:01:06.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:06.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:06.124 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[65206]: fuse finished with error 0 and tester_r 0 2023-07-09T22:01:06.125 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:06.122+0000 7f8265046180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:06.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:01:06.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:06.129 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T22:01:06.157 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:06.156+0000 7f5271cc8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:06.181 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:06.182 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:06.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:06.193 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:01:06.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:06.193 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T22:01:06.202 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:06.198+0000 7f8265046180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:06.244 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T22:01:06.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:06.246 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:06.246 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:06.255 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:01:06.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:01:06.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:06.257 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T22:01:06.305 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T22:01:06.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:06.307 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:06.307 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:06.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:06.317 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:01:06.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:06.318 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T22:01:06.345 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:06.338+0000 7f8265046180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:06.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:06.370 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T22:01:06.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 Processor -- start 2023-07-09T22:01:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 -- start start 2023-07-09T22:01:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73140b4340 0x7f731406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140cef80 0x7f73140d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.521 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73140b49f0 con 0x7f73140b7ab0 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73140b7e80 con 0x7f73140b4340 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7319fc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140cc8a0 con 0x7f73140cef80 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7312ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f73140b4340 0x7f731406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f73137fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f73140b7ab0 0x7f73140b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40144/0 (socket says 172.21.15.37:40144) 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f73137fe640 1 -- 172.21.15.37:0/104024422 learned_addr learned my addr 172.21.15.37:0/104024422 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7313fff640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140cef80 0x7f73140d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7312ffd640 1 -- 172.21.15.37:0/104024422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140cef80 msgr2=0x7f73140d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:06.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7312ffd640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140cef80 0x7f73140d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7312ffd640 1 -- 172.21.15.37:0/104024422 >> v1:172.21.15.37:6789/0 conn(0x7f73140b7ab0 legacy=0x7f73140b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f7312ffd640 1 -- 172.21.15.37:0/104024422 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73140ccb80 con 0x7f73140b4340 2023-07-09T22:01:06.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.514+0000 7f73127fc640 1 -- 172.21.15.37:0/104024422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189096373 0 0) 0x7f73140b49f0 con 0x7f73140b7ab0 2023-07-09T22:01:06.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7312ffd640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f731406aa50 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f73080097c0 tx=0x7f730801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e04383eb638b6a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:06.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f73127fc640 1 -- 172.21.15.37:0/104024422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080ab650 con 0x7f73140b4340 2023-07-09T22:01:06.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f73127fc640 1 -- 172.21.15.37:0/104024422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73080ab7b0 con 0x7f73140b4340 2023-07-09T22:01:06.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f73127fc640 1 -- 172.21.15.37:0/104024422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73080abb40 con 0x7f73140b4340 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 -- 172.21.15.37:0/104024422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 msgr2=0x7f731406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f731406aa50 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f73080097c0 tx=0x7f730801c450 comp rx=0 tx=0).stop 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 -- 172.21.15.37:0/104024422 shutdown_connections 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140cef80 0x7f73140d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 --2- 172.21.15.37:0/104024422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f731406aa50 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 -- 172.21.15.37:0/104024422 >> 172.21.15.37:0/104024422 conn(0x7f7314073090 msgr2=0x7f7314069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 -- 172.21.15.37:0/104024422 shutdown_connections 2023-07-09T22:01:06.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.518+0000 7f7319fc5640 1 -- 172.21.15.37:0/104024422 wait complete. 2023-07-09T22:01:06.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.522+0000 7f7319fc5640 1 Processor -- start 2023-07-09T22:01:06.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.522+0000 7f7319fc5640 1 -- start start 2023-07-09T22:01:06.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.522+0000 7f7319fc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.522+0000 7f7319fc5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140b7ab0 0x7f73140cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.522+0000 7f7319fc5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73140cef80 0x7f73141566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140ca790 con 0x7f73140b4340 2023-07-09T22:01:06.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73140ca300 con 0x7f73140cef80 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73140c96f0 con 0x7f73140b7ab0 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50858/0 (socket says 172.21.15.37:50858) 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 -- 172.21.15.37:0/858070998 learned_addr learned my addr 172.21.15.37:0/858070998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7312ffd640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140b7ab0 0x7f73140cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7313fff640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73140cef80 0x7f73141566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 -- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140b7ab0 msgr2=0x7f73140cb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140b7ab0 0x7f73140cb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 -- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73140cef80 msgr2=0x7f73141566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73140cef80 0x7f73141566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 -- 172.21.15.37:0/858070998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308009420 con 0x7f73140b4340 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f73137fe640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f73040011f0 tx=0x7f730400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73040074e0 con 0x7f73140b4340 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7304007640 con 0x7f73140b4340 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7304004a10 con 0x7f73140b4340 2023-07-09T22:01:06.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73140c99d0 con 0x7f73140b4340 2023-07-09T22:01:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73140c9f90 con 0x7f73140b4340 2023-07-09T22:01:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f731406ab50 con 0x7f73140b4340 2023-07-09T22:01:06.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.526+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7f7304004b70 con 0x7f73140b4340 2023-07-09T22:01:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.530+0000 7f72fbfff640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 0x7f73000689a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.530+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6592+0+0 (secure 0 0 0) 0x7f7304083500 con 0x7f73140b4340 2023-07-09T22:01:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.530+0000 7f7312ffd640 1 -- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 msgr2=0x7f73000689a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:06.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.530+0000 7f7312ffd640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 0x7f73000689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:06.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.534+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7304050440 con 0x7f73140b4340 2023-07-09T22:01:06.705 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:06.704+0000 7f5271cc8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:06.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.722+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f731404d7d0 con 0x7f73140b4340 2023-07-09T22:01:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.722+0000 7f72fbfff640 1 -- 172.21.15.37:0/858070998 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f7304053a60 con 0x7f73140b4340 2023-07-09T22:01:06.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:06.729 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T22:01:06.729 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T22:01:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 msgr2=0x7f73000689a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 0x7f73000689a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 msgr2=0x7f73140cad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f73040011f0 tx=0x7f730400c9b0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 shutdown_connections 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7f73000664f0 0x7f73000689a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f73140cef80 0x7f73141566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f73140b7ab0 0x7f73140cb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 --2- 172.21.15.37:0/858070998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f73140b4340 0x7f73140cad40 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 >> 172.21.15.37:0/858070998 conn(0x7f7314073090 msgr2=0x7f73140b4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 shutdown_connections 2023-07-09T22:01:06.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.726+0000 7f7319fc5640 1 -- 172.21.15.37:0/858070998 wait complete. 2023-07-09T22:01:06.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:06.789 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:06.788+0000 7f5271cc8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:01:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 Processor -- start 2023-07-09T22:01:06.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 -- start start 2023-07-09T22:01:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1340b7ab0 0x7fe13406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340cef80 0x7fe1340b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1340b49f0 con 0x7fe1340b4170 2023-07-09T22:01:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1340b7e80 con 0x7fe1340b7ab0 2023-07-09T22:01:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe139d59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340b4610 con 0x7fe1340cef80 2023-07-09T22:01:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe1337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1340b7ab0 0x7fe13406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe1337fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe1340b7ab0 0x7fe13406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50874/0 (socket says 172.21.15.37:50874) 2023-07-09T22:01:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe1337fe640 1 -- 172.21.15.37:0/2887219167 learned_addr learned my addr 172.21.15.37:0/2887219167 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.890+0000 7fe132ffd640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340cef80 0x7fe1340b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1337fe640 1 -- 172.21.15.37:0/2887219167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340cef80 msgr2=0x7fe1340b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1337fe640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340cef80 0x7fe1340b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1337fe640 1 -- 172.21.15.37:0/2887219167 >> v1:172.21.15.119:6789/0 conn(0x7fe1340b4170 legacy=0x7fe13415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1337fe640 1 -- 172.21.15.37:0/2887219167 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1340cc8a0 con 0x7fe1340b7ab0 2023-07-09T22:01:06.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1337fe640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340b7ab0 0x7fe13406aa50 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe12401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5488fdc609770a8b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1327fc640 1 -- 172.21.15.37:0/2887219167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240aa670 con 0x7fe1340b7ab0 2023-07-09T22:01:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1327fc640 1 -- 172.21.15.37:0/2887219167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240aa7d0 con 0x7fe1340b7ab0 2023-07-09T22:01:06.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.894+0000 7fe1327fc640 1 -- 172.21.15.37:0/2887219167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240aab60 con 0x7fe1340b7ab0 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- 172.21.15.37:0/2887219167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340b7ab0 msgr2=0x7fe13406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340b7ab0 0x7fe13406aa50 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7fe124009870 tx=0x7fe12401c510 comp rx=0 tx=0).stop 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- 172.21.15.37:0/2887219167 shutdown_connections 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340cef80 0x7fe1340b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- 172.21.15.37:0/2887219167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340b7ab0 0x7fe13406aa50 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- 172.21.15.37:0/2887219167 >> 172.21.15.37:0/2887219167 conn(0x7fe134073090 msgr2=0x7fe134069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- 172.21.15.37:0/2887219167 shutdown_connections 2023-07-09T22:01:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- 172.21.15.37:0/2887219167 wait complete. 2023-07-09T22:01:06.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 Processor -- start 2023-07-09T22:01:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- start start 2023-07-09T22:01:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1340b7ab0 0x7fe1340b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340cef80 0x7fe1340b2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe134152c70 con 0x7fe1340cef80 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1341511b0 con 0x7fe1340b7ab0 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.898+0000 7fe139d59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1340c6910 con 0x7fe1340b4170 2023-07-09T22:01:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe133fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340cef80 0x7fe1340b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe132ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1340b7ab0 0x7fe1340b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:36710/0 (socket says 172.21.15.37:36710) 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 -- 172.21.15.37:0/1898091807 learned_addr learned my addr 172.21.15.37:0/1898091807 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 -- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1340b7ab0 msgr2=0x7fe1340b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1340b7ab0 0x7fe1340b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 -- 172.21.15.37:0/1898091807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340cef80 msgr2=0x7fe1340b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:06.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340cef80 0x7fe1340b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:06.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 -- 172.21.15.37:0/1898091807 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1240094d0 con 0x7fe1340b4170 2023-07-09T22:01:06.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe1337fe640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1240ac040 tx=0x7fe12401ad50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240b3800 con 0x7fe1340b4170 2023-07-09T22:01:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240b3980 con 0x7fe1340b4170 2023-07-09T22:01:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240b3d30 con 0x7fe1340b4170 2023-07-09T22:01:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1340c6bf0 con 0x7fe1340b4170 2023-07-09T22:01:06.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1340c71b0 con 0x7fe1340b4170 2023-07-09T22:01:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13404d7d0 con 0x7fe1340b4170 2023-07-09T22:01:06.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.902+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fe1240c6440 con 0x7fe1340b4170 2023-07-09T22:01:06.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.906+0000 7fe11bfff640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 0x7fe120068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:06.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.906+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6592+0+0 (secure 0 0 0) 0x7fe12411f0c0 con 0x7fe1340b4170 2023-07-09T22:01:06.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.906+0000 7fe132ffd640 1 -- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 msgr2=0x7fe120068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:06.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.906+0000 7fe132ffd640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 0x7fe120068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:06.910+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe1240ebf80 con 0x7fe1340b4170 2023-07-09T22:01:06.936 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:06.930+0000 7f8265046180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:06.937 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:06.932+0000 7f5271cc8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:01:07.020 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.016+0000 7f5271cc8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:01:07.026 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:07.022+0000 7f8265046180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:01:07.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.070+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1340b56d0 con 0x7fe1340b4170 2023-07-09T22:01:07.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.070+0000 7fe11bfff640 1 -- 172.21.15.37:0/1898091807 <== mon.2 v2:172.21.15.119:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+19176 (secure 0 0 0) 0x7fe1240aa630 con 0x7fe1340b4170 2023-07-09T22:01:07.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:07.076 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":182,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:05.586772+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.2b","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/3145962994":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6833/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6832/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/113945541":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/3463027125":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/473096067":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/207456882":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/1513289062":"2023-07-10T21:59:57.510086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":22,"snaps":[{"begin":3,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 msgr2=0x7fe120068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 0x7fe120068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 msgr2=0x7fe134150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe1240ac040 tx=0x7fe12401ad50 comp rx=0 tx=0).stop 2023-07-09T22:01:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 shutdown_connections 2023-07-09T22:01:07.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1340cef80 0x7fe1340b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fe1200664c0 0x7fe120068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe1340b7ab0 0x7fe1340b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 --2- 172.21.15.37:0/1898091807 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe1340b4170 0x7fe134150c70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 >> 172.21.15.37:0/1898091807 conn(0x7fe134073090 msgr2=0x7fe1340ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 shutdown_connections 2023-07-09T22:01:07.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.074+0000 7fe139d59640 1 -- 172.21.15.37:0/1898091807 wait complete. 2023-07-09T22:01:07.099 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T21:59:37.562054+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '175', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T21:59:38.431596+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '182', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 5, 'snap_epoch': 182, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:07.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:07.189 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:07.182+0000 7f8265046180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:01:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 Processor -- start 2023-07-09T22:01:07.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 -- start start 2023-07-09T22:01:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 0x7fbfec0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfec0d0360 0x7fbfec0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfec0b3bb0 con 0x7fbfec15f130 2023-07-09T22:01:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfec0d07e0 con 0x7fbfec0d0360 2023-07-09T22:01:07.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbff1700640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0cccb0 con 0x7fbfec0b76b0 2023-07-09T22:01:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfec0d0360 0x7fbfec0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfe3fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 0x7fbfec0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfec0d0360 0x7fbfec0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50878/0 (socket says 172.21.15.37:50878) 2023-07-09T22:01:07.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeaffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fbfec15f130 0x7fbfec0b6fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:51064/0 (socket says 172.21.15.37:51064) 2023-07-09T22:01:07.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 -- 172.21.15.37:0/1655111633 learned_addr learned my addr 172.21.15.37:0/1655111633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 -- 172.21.15.37:0/1655111633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 msgr2=0x7fbfec0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:07.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 0x7fbfec0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfea7fc640 1 -- 172.21.15.37:0/1655111633 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578745264 0 0) 0x7fbfec0b3bb0 con 0x7fbfec15f130 2023-07-09T22:01:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 -- 172.21.15.37:0/1655111633 >> v1:172.21.15.119:6789/0 conn(0x7fbfec15f130 legacy=0x7fbfec0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfeb7fe640 1 -- 172.21.15.37:0/1655111633 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0b8100 con 0x7fbfec0d0360 2023-07-09T22:01:07.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.246+0000 7fbfe3fff640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 0x7fbfec0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:07.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbfeb7fe640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0d0360 0x7fbfec0cd140 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009e50 tx=0x7fbfe401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68c935354096b24 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbfea7fc640 1 -- 172.21.15.37:0/1655111633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40a5810 con 0x7fbfec0d0360 2023-07-09T22:01:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbfea7fc640 1 -- 172.21.15.37:0/1655111633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe40a5970 con 0x7fbfec0d0360 2023-07-09T22:01:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbfea7fc640 1 -- 172.21.15.37:0/1655111633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe40a5d00 con 0x7fbfec0d0360 2023-07-09T22:01:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- 172.21.15.37:0/1655111633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0d0360 msgr2=0x7fbfec0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0d0360 0x7fbfec0cd140 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009e50 tx=0x7fbfe401c950 comp rx=0 tx=0).stop 2023-07-09T22:01:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- 172.21.15.37:0/1655111633 shutdown_connections 2023-07-09T22:01:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0b76b0 0x7fbfec0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 --2- 172.21.15.37:0/1655111633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0d0360 0x7fbfec0cd140 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- 172.21.15.37:0/1655111633 >> 172.21.15.37:0/1655111633 conn(0x7fbfec072d20 msgr2=0x7fbfec0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- 172.21.15.37:0/1655111633 shutdown_connections 2023-07-09T22:01:07.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- 172.21.15.37:0/1655111633 wait complete. 2023-07-09T22:01:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 Processor -- start 2023-07-09T22:01:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.254+0000 7fbff1700640 1 -- start start 2023-07-09T22:01:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0d0360 0x7fbfec0d1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfec15f130 0x7fbfec0d23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec0cbf60 con 0x7fbfec0b76b0 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec1598c0 con 0x7fbfec15f130 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfec159ba0 con 0x7fbfec0d0360 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50888/0 (socket says 172.21.15.37:50888) 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 -- 172.21.15.37:0/355750783 learned_addr learned my addr 172.21.15.37:0/355750783 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfe3fff640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0d0360 0x7fbfec0d1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeb7fe640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfec15f130 0x7fbfec0d23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 -- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0d0360 msgr2=0x7fbfec0d1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0d0360 0x7fbfec0d1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 -- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfec15f130 msgr2=0x7fbfec0d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfec15f130 0x7fbfec0d23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 -- 172.21.15.37:0/355750783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd4009420 con 0x7fbfec0b76b0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfeaffd640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0011f0 tx=0x7fbfdc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc0074e0 con 0x7fbfec0b76b0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfdc007640 con 0x7fbfec0b76b0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfdc004a10 con 0x7fbfec0b76b0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfe4009b30 con 0x7fbfec0b76b0 2023-07-09T22:01:07.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfec0c5cb0 con 0x7fbfec0b76b0 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.258+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfec0668f0 con 0x7fbfec0b76b0 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.262+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 87) v1 ==== 85874+0+0 (secure 0 0 0) 0x7fbfdc004b70 con 0x7fbfec0b76b0 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.262+0000 7fbfe37fe640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 0x7fbfcc068970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.262+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 6592+0+0 (secure 0 0 0) 0x7fbfdc0835a0 con 0x7fbfec0b76b0 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.262+0000 7fbfe3fff640 1 -- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 msgr2=0x7fbfcc068970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/4130882000 2023-07-09T22:01:07.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.262+0000 7fbfe3fff640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 0x7fbfcc068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:07.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.266+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfdc050570 con 0x7fbfec0b76b0 2023-07-09T22:01:07.283 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:07.278+0000 7f8265046180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:01:07.293 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.292+0000 7f5271cc8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:01:07.353 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.352+0000 7f5271cc8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:01:07.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.362+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7fbfdc050940 con 0x7fbfec0b76b0 2023-07-09T22:01:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.362+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 msgr2=0x7fbfcc068970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:07.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.362+0000 7fbfe37fe640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 0x7fbfcc068970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.435 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fae3f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.435 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fae3f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.435 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fae3f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.436 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fae3f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.436 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fae3f640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.436 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fd644640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.436 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fd644640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.436 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fd644640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.437 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fd644640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.437 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:07.432+0000 7f51fd644640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:07.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfec0b3a20 con 0x7fbfec0b76b0 2023-07-09T22:01:07.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbfe37fe640 1 -- 172.21.15.37:0/355750783 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v183) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfdc070960 con 0x7fbfec0b76b0 2023-07-09T22:01:07.438 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 msgr2=0x7fbfec157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0011f0 tx=0x7fbfdc00c9b0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 shutdown_connections 2023-07-09T22:01:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:6832/4130882000,v1:172.21.15.119:6833/4130882000] conn(0x7fbfcc0664c0 0x7fbfcc068970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbfec15f130 0x7fbfec0d23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbfec0d0360 0x7fbfec0d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 --2- 172.21.15.37:0/355750783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfec0b76b0 0x7fbfec157130 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 >> 172.21.15.37:0/355750783 conn(0x7fbfec072d20 msgr2=0x7fbfec06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 shutdown_connections 2023-07-09T22:01:07.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.434+0000 7fbff1700640 1 -- 172.21.15.37:0/355750783 wait complete. 2023-07-09T22:01:07.461 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:07.587 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:07.582+0000 7f8265046180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:01:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 Processor -- start 2023-07-09T22:01:07.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 -- start start 2023-07-09T22:01:07.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e015bb30 0x7f99e00ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99e00b41e0 0x7f99e00cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e015bf00 con 0x7f99e00b11a0 2023-07-09T22:01:07.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00ce970 con 0x7f99e00b41e0 2023-07-09T22:01:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e725b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e015f6e0 con 0x7f99e015bb30 2023-07-09T22:01:07.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99e00b41e0 0x7f99e00cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6259640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e015bb30 0x7f99e00ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f99e00b41e0 0x7f99e00cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:42880/0 (socket says 172.21.15.37:42880) 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 -- 172.21.15.37:0/4263079122 learned_addr learned my addr 172.21.15.37:0/4263079122 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e5a58640 1 --1- 172.21.15.37:0/4263079122 >> v1:172.21.15.119:6789/0 conn(0x7f99e00b11a0 0x7f99e00b3ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:60946/0 (socket says 172.21.15.37:60946) 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 -- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e015bb30 msgr2=0x7f99e00ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:07.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 --2- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e015bb30 0x7f99e00ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 -- 172.21.15.37:0/4263079122 >> v1:172.21.15.119:6789/0 conn(0x7f99e00b11a0 legacy=0x7f99e00b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.606+0000 7f99e6a5a640 1 -- 172.21.15.37:0/4263079122 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e015f9c0 con 0x7f99e00b41e0 2023-07-09T22:01:07.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e6a5a640 1 --2- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e00b41e0 0x7f99e00cfcb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009e50 tx=0x7f99d801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899c1e4e2aa5053e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e5257640 1 -- 172.21.15.37:0/4263079122 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a5810 con 0x7f99e00b41e0 2023-07-09T22:01:07.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e5257640 1 -- 172.21.15.37:0/4263079122 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d80a5970 con 0x7f99e00b41e0 2023-07-09T22:01:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e5257640 1 -- 172.21.15.37:0/4263079122 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80a5d00 con 0x7f99e00b41e0 2023-07-09T22:01:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 -- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e00b41e0 msgr2=0x7f99e00cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 --2- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e00b41e0 0x7f99e00cfcb0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009e50 tx=0x7f99d801c950 comp rx=0 tx=0).stop 2023-07-09T22:01:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 -- 172.21.15.37:0/4263079122 shutdown_connections 2023-07-09T22:01:07.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 --2- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e00b41e0 0x7f99e00cfcb0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 --2- 172.21.15.37:0/4263079122 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e015bb30 0x7f99e00ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 -- 172.21.15.37:0/4263079122 >> 172.21.15.37:0/4263079122 conn(0x7f99e006aac0 msgr2=0x7f99e00cead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 -- 172.21.15.37:0/4263079122 shutdown_connections 2023-07-09T22:01:07.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.610+0000 7f99e725b640 1 -- 172.21.15.37:0/4263079122 wait complete. 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 Processor -- start 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- start start 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00b41e0 0x7f99e00b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 0x7f99e00b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b24a0 con 0x7f99e00b11a0 2023-07-09T22:01:07.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b2740 con 0x7f99e015bb30 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00b2a20 con 0x7f99e00b41e0 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49712/0 (socket says 172.21.15.37:49712) 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 -- 172.21.15.37:0/2598607310 learned_addr learned my addr 172.21.15.37:0/2598607310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6a5a640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 0x7f99e00b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e5a58640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00b41e0 0x7f99e00b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 -- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00b41e0 msgr2=0x7f99e00b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00b41e0 0x7f99e00b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 -- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 msgr2=0x7f99e00b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 0x7f99e00b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 -- 172.21.15.37:0/2598607310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009b30 con 0x7f99e00b11a0 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6a5a640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 0x7f99e00b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e6259640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00e930 tx=0x7f99dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc009690 con 0x7f99e00b11a0 2023-07-09T22:01:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00ca00 con 0x7f99e00b11a0 2023-07-09T22:01:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99dc00cd70 con 0x7f99e00b11a0 2023-07-09T22:01:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00b2d00 con 0x7f99e00b11a0 2023-07-09T22:01:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.614+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e00b32c0 con 0x7f99e00b11a0 2023-07-09T22:01:07.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.618+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e004e020 con 0x7f99e00b11a0 2023-07-09T22:01:07.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.618+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f99dc013470 con 0x7f99e00b11a0 2023-07-09T22:01:07.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.618+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f99dc083d60 con 0x7f99e00b11a0 2023-07-09T22:01:07.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.622+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f99dc0513a0 con 0x7f99e00b11a0 2023-07-09T22:01:07.656 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:07.650+0000 7f8265046180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:01:07.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f99e00cf560 con 0x7f99e00b11a0 2023-07-09T22:01:07.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99d6ffd640 1 -- 172.21.15.37:0/2598607310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v183) v1 ==== 92+0+10 (secure 0 0 0) 0x7f99dc0170a0 con 0x7f99e00b11a0 2023-07-09T22:01:07.782 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 msgr2=0x7f99e015eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00e930 tx=0x7f99dc00edf0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 shutdown_connections 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f99e015bb30 0x7f99e00b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f99e00b41e0 0x7f99e00b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 --2- 172.21.15.37:0/2598607310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e00b11a0 0x7f99e015eb10 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 >> 172.21.15.37:0/2598607310 conn(0x7f99e006aac0 msgr2=0x7f99e00cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 shutdown_connections 2023-07-09T22:01:07.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.778+0000 7f99e725b640 1 -- 172.21.15.37:0/2598607310 wait complete. 2023-07-09T22:01:07.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:01:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.942+0000 7f0d7b076640 1 Processor -- start 2023-07-09T22:01:07.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.942+0000 7f0d7b076640 1 -- start start 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d740cfb40 0x7f0d740cff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 0x7f0d740cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 0x7f0d740ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d740ce640 con 0x7f0d740cfb40 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d740d0450 con 0x7f0d740b1420 2023-07-09T22:01:07.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7b076640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740ce080 con 0x7f0d740b0ed0 2023-07-09T22:01:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d740cfb40 0x7f0d740cff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0d740cfb40 0x7f0d740cff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49728/0 (socket says 172.21.15.37:49728) 2023-07-09T22:01:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 -- 172.21.15.37:0/2622490995 learned_addr learned my addr 172.21.15.37:0/2622490995 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d79873640 1 --2- 172.21.15.37:0/2622490995 >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 0x7f0d740cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a875640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 0x7f0d740ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 -- 172.21.15.37:0/2622490995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 msgr2=0x7f0d740ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 0x7f0d740ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 -- 172.21.15.37:0/2622490995 >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 msgr2=0x7f0d740cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2622490995 >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 0x7f0d740cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a074640 1 -- 172.21.15.37:0/2622490995 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d740ce360 con 0x7f0d740cfb40 2023-07-09T22:01:07.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d79873640 1 --2- 172.21.15.37:0/2622490995 >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 0x7f0d740cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.946+0000 7f0d7a875640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 0x7f0d740ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:07.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740cfb40 0x7f0d740cff10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f0d740716f0 tx=0x7f0d7001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553d7bcd9a214fef server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d79072640 1 -- 172.21.15.37:0/2622490995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700ac600 con 0x7f0d740cfb40 2023-07-09T22:01:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d79072640 1 -- 172.21.15.37:0/2622490995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700a8050 con 0x7f0d740cfb40 2023-07-09T22:01:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d79072640 1 -- 172.21.15.37:0/2622490995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700ac980 con 0x7f0d740cfb40 2023-07-09T22:01:07.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- 172.21.15.37:0/2622490995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740cfb40 msgr2=0x7f0d740cff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740cfb40 0x7f0d740cff10 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f0d740716f0 tx=0x7f0d7001c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- 172.21.15.37:0/2622490995 shutdown_connections 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740b0ed0 0x7f0d740ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2622490995 >> v2:172.21.15.119:3300/0 conn(0x7f0d740b1420 0x7f0d740cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2622490995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740cfb40 0x7f0d740cff10 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- 172.21.15.37:0/2622490995 >> 172.21.15.37:0/2622490995 conn(0x7f0d74072d20 msgr2=0x7f0d740d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:07.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- 172.21.15.37:0/2622490995 shutdown_connections 2023-07-09T22:01:07.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- 172.21.15.37:0/2622490995 wait complete. 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 Processor -- start 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- start start 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 0x7f0d7414f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 0x7f0d740b63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:07.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.950+0000 7f0d7b076640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7414fba0 con 0x7f0d740b0ed0 2023-07-09T22:01:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7b076640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740b68e0 con 0x7f0d740b1420 2023-07-09T22:01:07.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7b076640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740c6490 con 0x7f0d740cfb40 2023-07-09T22:01:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49744/0 (socket says 172.21.15.37:49744) 2023-07-09T22:01:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 -- 172.21.15.37:0/2546283603 learned_addr learned my addr 172.21.15.37:0/2546283603 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d79873640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 0x7f0d7414f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a875640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 0x7f0d740b63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 -- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 msgr2=0x7f0d740b63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 0x7f0d740b63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 -- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 msgr2=0x7f0d7414f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 0x7f0d7414f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:07.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 -- 172.21.15.37:0/2546283603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d700094d0 con 0x7f0d740b0ed0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d79873640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 0x7f0d7414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a875640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 0x7f0d740b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7a074640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001cd70 tx=0x7f0d7001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700b7620 con 0x7f0d740b0ed0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700ace90 con 0x7f0d740b0ed0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d700b7980 con 0x7f0d740b0ed0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d740b6b10 con 0x7f0d740b0ed0 2023-07-09T22:01:07.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d740b70d0 con 0x7f0d740b0ed0 2023-07-09T22:01:07.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7404e020 con 0x7f0d740b0ed0 2023-07-09T22:01:07.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.954+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f0d700b3040 con 0x7f0d740b0ed0 2023-07-09T22:01:07.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.958+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f0d7011e0b0 con 0x7f0d740b0ed0 2023-07-09T22:01:07.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:07.962+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0d700eb4f0 con 0x7f0d740b0ed0 2023-07-09T22:01:08.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.114+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d741561c0 con 0x7f0d740b0ed0 2023-07-09T22:01:08.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.114+0000 7f0d6affd640 1 -- 172.21.15.37:0/2546283603 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v183) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d700eeb10 con 0x7f0d740b0ed0 2023-07-09T22:01:08.121 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:01:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 msgr2=0x7f0d740b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f0d7001cd70 tx=0x7f0d7001ad10 comp rx=0 tx=0).stop 2023-07-09T22:01:08.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 shutdown_connections 2023-07-09T22:01:08.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0d740cfb40 0x7f0d740b63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0d740b1420 0x7f0d7414f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 --2- 172.21.15.37:0/2546283603 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d740b0ed0 0x7f0d740b2420 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 >> 172.21.15.37:0/2546283603 conn(0x7f0d74072d20 msgr2=0x7f0d74155710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 shutdown_connections 2023-07-09T22:01:08.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.118+0000 7f0d7b076640 1 -- 172.21.15.37:0/2546283603 wait complete. 2023-07-09T22:01:08.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:01:08.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.282+0000 7f8689998640 1 Processor -- start 2023-07-09T22:01:08.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.282+0000 7f8689998640 1 -- start start 2023-07-09T22:01:08.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689998640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f86840b1420 0x7f86840af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689998640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86840b0ed0 0x7f86840afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689998640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86840ce080 con 0x7f86840cfb40 2023-07-09T22:01:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689998640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840ce640 con 0x7f86840b0ed0 2023-07-09T22:01:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689998640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840ce360 con 0x7f86840b1420 2023-07-09T22:01:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86840b0ed0 0x7f86840afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f86840b0ed0 0x7f86840afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49750/0 (socket says 172.21.15.37:49750) 2023-07-09T22:01:08.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 -- 172.21.15.37:0/3478951633 learned_addr learned my addr 172.21.15.37:0/3478951633 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8683fff640 1 --2- 172.21.15.37:0/3478951633 >> v2:172.21.15.119:3300/0 conn(0x7f86840b1420 0x7f86840af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 -- 172.21.15.37:0/3478951633 >> v2:172.21.15.119:3300/0 conn(0x7f86840b1420 msgr2=0x7f86840af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 --2- 172.21.15.37:0/3478951633 >> v2:172.21.15.119:3300/0 conn(0x7f86840b1420 0x7f86840af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 -- 172.21.15.37:0/3478951633 >> v1:172.21.15.119:6789/0 conn(0x7f86840cfb40 legacy=0x7f86840cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 -- 172.21.15.37:0/3478951633 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840aed30 con 0x7f86840b0ed0 2023-07-09T22:01:08.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.286+0000 7f8689197640 1 --2- 172.21.15.37:0/3478951633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b0ed0 0x7f86840afa70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f86840716f0 tx=0x7f867c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4a10b1a7f44a2d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f86837fe640 1 -- 172.21.15.37:0/3478951633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a57e0 con 0x7f86840b0ed0 2023-07-09T22:01:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f86837fe640 1 -- 172.21.15.37:0/3478951633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0a5940 con 0x7f86840b0ed0 2023-07-09T22:01:08.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f86837fe640 1 -- 172.21.15.37:0/3478951633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a5cd0 con 0x7f86840b0ed0 2023-07-09T22:01:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- 172.21.15.37:0/3478951633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b0ed0 msgr2=0x7f86840afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- 172.21.15.37:0/3478951633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b0ed0 0x7f86840afa70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f86840716f0 tx=0x7f867c01c960 comp rx=0 tx=0).stop 2023-07-09T22:01:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- 172.21.15.37:0/3478951633 shutdown_connections 2023-07-09T22:01:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- 172.21.15.37:0/3478951633 >> v2:172.21.15.119:3300/0 conn(0x7f86840b1420 0x7f86840af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- 172.21.15.37:0/3478951633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b0ed0 0x7f86840afa70 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- 172.21.15.37:0/3478951633 >> 172.21.15.37:0/3478951633 conn(0x7f8684072d20 msgr2=0x7f86840d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- 172.21.15.37:0/3478951633 shutdown_connections 2023-07-09T22:01:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- 172.21.15.37:0/3478951633 wait complete. 2023-07-09T22:01:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 Processor -- start 2023-07-09T22:01:08.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- start start 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86840b0ed0 0x7f86840c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86840cfb40 0x7f8684156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c7910 con 0x7f86840b1420 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c69f0 con 0x7f86840cfb40 2023-07-09T22:01:08.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8689998640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840c6c90 con 0x7f86840b0ed0 2023-07-09T22:01:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8683fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8683fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49762/0 (socket says 172.21.15.37:49762) 2023-07-09T22:01:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.290+0000 7f8683fff640 1 -- 172.21.15.37:0/3192531075 learned_addr learned my addr 172.21.15.37:0/3192531075 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8689197640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86840cfb40 0x7f8684156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8688996640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86840b0ed0 0x7f86840c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 -- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86840b0ed0 msgr2=0x7f86840c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86840b0ed0 0x7f86840c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 -- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86840cfb40 msgr2=0x7f8684156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86840cfb40 0x7f8684156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 -- 172.21.15.37:0/3192531075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009b30 con 0x7f86840b1420 2023-07-09T22:01:08.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8683fff640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f867000d5f0 tx=0x7f867000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86700125f0 con 0x7f86840b1420 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670012750 con 0x7f86840b1420 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840c6f70 con 0x7f86840b1420 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670012ae0 con 0x7f86840b1420 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840c7530 con 0x7f86840b1420 2023-07-09T22:01:08.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840c7a50 con 0x7f86840b1420 2023-07-09T22:01:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 88) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f8670012c40 con 0x7f86840b1420 2023-07-09T22:01:08.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.294+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f8670083fb0 con 0x7f86840b1420 2023-07-09T22:01:08.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.298+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86840c7a50 con 0x7f86840b1420 2023-07-09T22:01:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.366+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8670050f50 con 0x7f86840b1420 2023-07-09T22:01:08.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.366+0000 7f86817fa640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 0x7f866806e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.366+0000 7f8688996640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 0x7f866806e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.370+0000 7f8688996640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 0x7f866806e710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f8678007e40 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f86840c7a50 con 0x7f86840b1420 2023-07-09T22:01:08.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f86817fa640 1 -- 172.21.15.37:0/3192531075 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v183) v1 ==== 100+0+11 (secure 0 0 0) 0x7f86840c7a50 con 0x7f86840b1420 2023-07-09T22:01:08.462 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 msgr2=0x7f866806e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 0x7f866806e710 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f8678007e40 comp rx=0 tx=0).stop 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 msgr2=0x7f8684150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f867000d5f0 tx=0x7f867000dab0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 shutdown_connections 2023-07-09T22:01:08.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f866806c330 0x7f866806e710 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f86840cfb40 0x7f8684156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86840b1420 0x7f8684150000 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 --2- 172.21.15.37:0/3192531075 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f86840b0ed0 0x7f86840c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 >> 172.21.15.37:0/3192531075 conn(0x7f8684072d20 msgr2=0x7f86841596b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 shutdown_connections 2023-07-09T22:01:08.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.458+0000 7f8689998640 1 -- 172.21.15.37:0/3192531075 wait complete. 2023-07-09T22:01:08.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:08.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 Processor -- start 2023-07-09T22:01:08.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 -- start start 2023-07-09T22:01:08.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c240b7ab0 0x7f0c2406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240b49f0 con 0x7f0c240cef80 2023-07-09T22:01:08.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c240cc8a0 con 0x7f0c240b4340 2023-07-09T22:01:08.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c290d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c240b7e80 con 0x7f0c240b7ab0 2023-07-09T22:01:08.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c22d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c240b7ab0 0x7f0c2406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c1bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c240cef80 0x7f0c240b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47888/0 (socket says 172.21.15.37:47888) 2023-07-09T22:01:08.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c1bfff640 1 -- 172.21.15.37:0/3598092747 learned_addr learned my addr 172.21.15.37:0/3598092747 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c22d9d640 1 -- 172.21.15.37:0/3598092747 >> v1:172.21.15.119:6789/0 conn(0x7f0c240b4340 legacy=0x7f0c240d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c22d9d640 1 -- 172.21.15.37:0/3598092747 >> v1:172.21.15.37:6789/0 conn(0x7f0c240cef80 legacy=0x7f0c240b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c22d9d640 1 -- 172.21.15.37:0/3598092747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c240ccb80 con 0x7f0c240b7ab0 2023-07-09T22:01:08.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.622+0000 7f0c2259c640 1 -- 172.21.15.37:0/3598092747 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266718604 0 0) 0x7f0c240b49f0 con 0x7f0c240cef80 2023-07-09T22:01:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c22d9d640 1 --2- 172.21.15.37:0/3598092747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c2406aa50 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f0c140097c0 tx=0x7f0c1401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e17f4f55553920 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c2259c640 1 -- 172.21.15.37:0/3598092747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140ab610 con 0x7f0c240b7ab0 2023-07-09T22:01:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c2259c640 1 -- 172.21.15.37:0/3598092747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c140ab770 con 0x7f0c240b7ab0 2023-07-09T22:01:08.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c2259c640 1 -- 172.21.15.37:0/3598092747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c140abb00 con 0x7f0c240b7ab0 2023-07-09T22:01:08.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 -- 172.21.15.37:0/3598092747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 msgr2=0x7f0c2406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 --2- 172.21.15.37:0/3598092747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c2406aa50 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f0c140097c0 tx=0x7f0c1401c410 comp rx=0 tx=0).stop 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 -- 172.21.15.37:0/3598092747 shutdown_connections 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 --2- 172.21.15.37:0/3598092747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c2406aa50 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 -- 172.21.15.37:0/3598092747 >> 172.21.15.37:0/3598092747 conn(0x7f0c24073090 msgr2=0x7f0c24069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 -- 172.21.15.37:0/3598092747 shutdown_connections 2023-07-09T22:01:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.626+0000 7f0c290d8640 1 -- 172.21.15.37:0/3598092747 wait complete. 2023-07-09T22:01:08.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 Processor -- start 2023-07-09T22:01:08.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- start start 2023-07-09T22:01:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c240b4340 0x7f0c240c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c240cef80 0x7f0c241513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c8bf0 con 0x7f0c240b7ab0 2023-07-09T22:01:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c240c8980 con 0x7f0c240b4340 2023-07-09T22:01:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c241528e0 con 0x7f0c240cef80 2023-07-09T22:01:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49776/0 (socket says 172.21.15.37:49776) 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 -- 172.21.15.37:0/2876993716 learned_addr learned my addr 172.21.15.37:0/2876993716 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c22d9d640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c240b4340 0x7f0c240c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c2359e640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c240cef80 0x7f0c241513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 -- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c240cef80 msgr2=0x7f0c241513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c240cef80 0x7f0c241513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 -- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c240b4340 msgr2=0x7f0c240c8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c240b4340 0x7f0c240c8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 -- 172.21.15.37:0/2876993716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c14009420 con 0x7f0c240b7ab0 2023-07-09T22:01:08.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1bfff640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c4b0 tx=0x7f0c0c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c0074e0 con 0x7f0c240b7ab0 2023-07-09T22:01:08.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c0c007660 con 0x7f0c240b7ab0 2023-07-09T22:01:08.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c24152bc0 con 0x7f0c240b7ab0 2023-07-09T22:01:08.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c0c004a30 con 0x7f0c240b7ab0 2023-07-09T22:01:08.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c24153180 con 0x7f0c240b7ab0 2023-07-09T22:01:08.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.630+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c241533a0 con 0x7f0c240b7ab0 2023-07-09T22:01:08.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.634+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f0c0c004b90 con 0x7f0c240b7ab0 2023-07-09T22:01:08.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.634+0000 7f0c1b7fe640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 0x7f0c04068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.634+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f0c0c082f90 con 0x7f0c240b7ab0 2023-07-09T22:01:08.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.634+0000 7f0c22d9d640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 0x7f0c04068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.634+0000 7f0c22d9d640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 0x7f0c04068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0c140af000 tx=0x7f0c140a7000 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:08.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.638+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c0c050450 con 0x7f0c240b7ab0 2023-07-09T22:01:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0c240d0750 con 0x7f0c240b7ab0 2023-07-09T22:01:08.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c1b7fe640 1 -- 172.21.15.37:0/2876993716 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f0c0c018070 con 0x7f0c240b7ab0 2023-07-09T22:01:08.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:08.831 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T22:01:08.831 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T22:01:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 msgr2=0x7f0c04068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 0x7f0c04068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0c140af000 tx=0x7f0c140a7000 comp rx=0 tx=0).stop 2023-07-09T22:01:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 msgr2=0x7f0c240c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c00c4b0 tx=0x7f0c0c00c970 comp rx=0 tx=0).stop 2023-07-09T22:01:08.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 shutdown_connections 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0c040660d0 0x7f0c04068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0c240cef80 0x7f0c241513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c240b7ab0 0x7f0c240c5ce0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 --2- 172.21.15.37:0/2876993716 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0c240b4340 0x7f0c240c8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 >> 172.21.15.37:0/2876993716 conn(0x7f0c24073090 msgr2=0x7f0c24157300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 shutdown_connections 2023-07-09T22:01:08.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.826+0000 7f0c290d8640 1 -- 172.21.15.37:0/2876993716 wait complete. 2023-07-09T22:01:08.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:08.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 Processor -- start 2023-07-09T22:01:08.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 -- start start 2023-07-09T22:01:08.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f822015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f82200af830 0x7f82200afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200cd610 con 0x7f82200cb9f0 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200cdbd0 con 0x7f82200af830 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8224d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822015bef0 con 0x7f8220070700 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8217fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f82200cb9f0 0x7f822015c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47896/0 (socket says 172.21.15.37:47896) 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f8217fff640 1 -- 172.21.15.37:0/2273349154 learned_addr learned my addr 172.21.15.37:0/2273349154 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:08.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f821ed9d640 1 --2- 172.21.15.37:0/2273349154 >> v2:172.21.15.37:3300/0 conn(0x7f82200af830 0x7f82200afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.990+0000 7f821e59c640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f822015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:08.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821dd9b640 1 -- 172.21.15.37:0/2273349154 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428786211 0 0) 0x7f82200cd610 con 0x7f82200cb9f0 2023-07-09T22:01:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821dd9b640 1 -- 172.21.15.37:0/2273349154 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c003530 con 0x7f82200cb9f0 2023-07-09T22:01:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821ed9d640 1 -- 172.21.15.37:0/2273349154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 msgr2=0x7f822015fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821ed9d640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f822015fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821ed9d640 1 -- 172.21.15.37:0/2273349154 >> v1:172.21.15.37:6789/0 conn(0x7f82200cb9f0 legacy=0x7f822015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:08.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821ed9d640 1 -- 172.21.15.37:0/2273349154 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82200cd8f0 con 0x7f82200af830 2023-07-09T22:01:09.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821ed9d640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82200afcd0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f8218009d90 tx=0x7f821801c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0aa8686f437c4e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821dd9b640 1 -- 172.21.15.37:0/2273349154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180a5780 con 0x7f82200af830 2023-07-09T22:01:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821dd9b640 1 -- 172.21.15.37:0/2273349154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82180a58e0 con 0x7f82200af830 2023-07-09T22:01:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f821dd9b640 1 -- 172.21.15.37:0/2273349154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82180a5c70 con 0x7f82200af830 2023-07-09T22:01:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f8224d40640 1 -- 172.21.15.37:0/2273349154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 msgr2=0x7f82200afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.994+0000 7f8224d40640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82200afcd0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f8218009d90 tx=0x7f821801c8c0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- 172.21.15.37:0/2273349154 shutdown_connections 2023-07-09T22:01:09.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82200afcd0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 --2- 172.21.15.37:0/2273349154 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f822015fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- 172.21.15.37:0/2273349154 >> 172.21.15.37:0/2273349154 conn(0x7f82200ca830 msgr2=0x7f82200cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- 172.21.15.37:0/2273349154 shutdown_connections 2023-07-09T22:01:09.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- 172.21.15.37:0/2273349154 wait complete. 2023-07-09T22:01:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 Processor -- start 2023-07-09T22:01:09.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- start start 2023-07-09T22:01:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f8220145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200cb9f0 0x7f82200c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82201459a0 con 0x7f82200af830 2023-07-09T22:01:09.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200c7230 con 0x7f82200cb9f0 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8224d40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8220145070 con 0x7f8220070700 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49792/0 (socket says 172.21.15.37:49792) 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 -- 172.21.15.37:0/2988227150 learned_addr learned my addr 172.21.15.37:0/2988227150 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f821ed9d640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200cb9f0 0x7f82200c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f821e59c640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f8220145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 -- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 msgr2=0x7f8220145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f8220145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 -- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200cb9f0 msgr2=0x7f82200c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200cb9f0 0x7f82200c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:08.998+0000 7f8217fff640 1 -- 172.21.15.37:0/2988227150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009a70 con 0x7f82200af830 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8217fff640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f820800c420 tx=0x7f820800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8208005cf0 con 0x7f82200af830 2023-07-09T22:01:09.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8208005e50 con 0x7f82200af830 2023-07-09T22:01:09.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82080072d0 con 0x7f82200af830 2023-07-09T22:01:09.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8220145350 con 0x7f82200af830 2023-07-09T22:01:09.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8220144c30 con 0x7f82200af830 2023-07-09T22:01:09.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8220145b10 con 0x7f82200af830 2023-07-09T22:01:09.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f8208007430 con 0x7f82200af830 2023-07-09T22:01:09.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 0x7f82000685b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f82080832c0 con 0x7f82200af830 2023-07-09T22:01:09.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.002+0000 7f821e59c640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 0x7f82000685b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.006+0000 7f821e59c640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 0x7f82000685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8210009af0 tx=0x7f8210008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.006+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f82080506c0 con 0x7f82200af830 2023-07-09T22:01:09.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f822004d7d0 con 0x7f82200af830 2023-07-09T22:01:09.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8216ffd640 1 -- 172.21.15.37:0/2988227150 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+19740 (secure 0 0 0) 0x7f8208053ce0 con 0x7f82200af830 2023-07-09T22:01:09.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:09.171 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":183,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:07.356028+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.2b","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/4130882000":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/9964786":"2023-07-10T22:01:07.355989+0000","172.21.15.119:6832/4130882000":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/1221926063":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2516280985":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2871729814":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2673406021":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/518799361":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/3879107718":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/842862974":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/3145962994":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6833/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6832/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/113945541":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/3463027125":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/473096067":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/207456882":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/1513289062":"2023-07-10T21:59:57.510086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 msgr2=0x7f82000685b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 0x7f82000685b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8210009af0 tx=0x7f8210008040 comp rx=0 tx=0).stop 2023-07-09T22:01:09.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 msgr2=0x7f82201446f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.166+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f820800c420 tx=0x7f820800c8e0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 shutdown_connections 2023-07-09T22:01:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f8200066100 0x7f82000685b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f82200cb9f0 0x7f82200c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f82200af830 0x7f82201446f0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 --2- 172.21.15.37:0/2988227150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8220070700 0x7f8220145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 >> 172.21.15.37:0/2988227150 conn(0x7f82200ca830 msgr2=0x7f82200c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 shutdown_connections 2023-07-09T22:01:09.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.170+0000 7f8224d40640 1 -- 172.21.15.37:0/2988227150 wait complete. 2023-07-09T22:01:09.192 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T22:01:09.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:09.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.330+0000 7f24a8e34640 1 Processor -- start 2023-07-09T22:01:09.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.330+0000 7f24a8e34640 1 -- start start 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a8e34640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24a40b7ab0 0x7f24a406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a8e34640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24a40cef80 0x7f24a40b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a8e34640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a40b49f0 con 0x7f24a40b4170 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a8e34640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40b7e80 con 0x7f24a40b7ab0 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a8e34640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a40b4610 con 0x7f24a40cef80 2023-07-09T22:01:09.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24a40b7ab0 0x7f24a406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f24a40b7ab0 0x7f24a406aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49802/0 (socket says 172.21.15.37:49802) 2023-07-09T22:01:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 -- 172.21.15.37:0/3355597192 learned_addr learned my addr 172.21.15.37:0/3355597192 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f249bfff640 1 --2- 172.21.15.37:0/3355597192 >> v2:172.21.15.119:3300/0 conn(0x7f24a40cef80 0x7f24a40b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 -- 172.21.15.37:0/3355597192 >> v2:172.21.15.119:3300/0 conn(0x7f24a40cef80 msgr2=0x7f24a40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 --2- 172.21.15.37:0/3355597192 >> v2:172.21.15.119:3300/0 conn(0x7f24a40cef80 0x7f24a40b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 -- 172.21.15.37:0/3355597192 >> v1:172.21.15.119:6789/0 conn(0x7f24a40b4170 legacy=0x7f24a415f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.334+0000 7f24a259c640 1 -- 172.21.15.37:0/3355597192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a40cc8a0 con 0x7f24a40b7ab0 2023-07-09T22:01:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a259c640 1 --2- 172.21.15.37:0/3355597192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40b7ab0 0x7f24a406aa50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f24a40b4d10 tx=0x7f249401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce44aa3bc2f90bc4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a1d9b640 1 -- 172.21.15.37:0/3355597192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa430 con 0x7f24a40b7ab0 2023-07-09T22:01:09.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a1d9b640 1 -- 172.21.15.37:0/3355597192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24940aa590 con 0x7f24a40b7ab0 2023-07-09T22:01:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a1d9b640 1 -- 172.21.15.37:0/3355597192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24940aa920 con 0x7f24a40b7ab0 2023-07-09T22:01:09.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- 172.21.15.37:0/3355597192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40b7ab0 msgr2=0x7f24a406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 --2- 172.21.15.37:0/3355597192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40b7ab0 0x7f24a406aa50 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f24a40b4d10 tx=0x7f249401c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- 172.21.15.37:0/3355597192 shutdown_connections 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 --2- 172.21.15.37:0/3355597192 >> v2:172.21.15.119:3300/0 conn(0x7f24a40cef80 0x7f24a40b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 --2- 172.21.15.37:0/3355597192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40b7ab0 0x7f24a406aa50 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- 172.21.15.37:0/3355597192 >> 172.21.15.37:0/3355597192 conn(0x7f24a4073090 msgr2=0x7f24a4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- 172.21.15.37:0/3355597192 shutdown_connections 2023-07-09T22:01:09.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- 172.21.15.37:0/3355597192 wait complete. 2023-07-09T22:01:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 Processor -- start 2023-07-09T22:01:09.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.338+0000 7f24a8e34640 1 -- start start 2023-07-09T22:01:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 0x7f24a40c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 0x7f24a41f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415e410 con 0x7f24a40cef80 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a4159640 con 0x7f24a40b7ab0 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a415e610 con 0x7f24a40b4170 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49804/0 (socket says 172.21.15.37:49804) 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 -- 172.21.15.37:0/1947119420 learned_addr learned my addr 172.21.15.37:0/1947119420 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249bfff640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 0x7f24a41f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a259c640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 0x7f24a40c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 -- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 msgr2=0x7f24a40c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 0x7f24a40c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 -- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 msgr2=0x7f24a41f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 0x7f24a41f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 -- 172.21.15.37:0/1947119420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940094d0 con 0x7f24a40cef80 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a259c640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 0x7f24a40c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249bfff640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 0x7f24a41f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a2d9d640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c730 tx=0x7f249c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c003b80 con 0x7f24a40cef80 2023-07-09T22:01:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c003ce0 con 0x7f24a40cef80 2023-07-09T22:01:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a415e8f0 con 0x7f24a40cef80 2023-07-09T22:01:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00aa30 con 0x7f24a40cef80 2023-07-09T22:01:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a415eeb0 con 0x7f24a40cef80 2023-07-09T22:01:09.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a404d7d0 con 0x7f24a40cef80 2023-07-09T22:01:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.342+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 89) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f249c00ab90 con 0x7f24a40cef80 2023-07-09T22:01:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.346+0000 7f249affd640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 0x7f2484068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.346+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f249c083b80 con 0x7f24a40cef80 2023-07-09T22:01:09.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.346+0000 7f24a259c640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 0x7f2484068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.346+0000 7f24a259c640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 0x7f2484068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7000 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.350+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f249c050ed0 con 0x7f24a40cef80 2023-07-09T22:01:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.534+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24a4071010 con 0x7f24a40cef80 2023-07-09T22:01:09.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.534+0000 7f249affd640 1 -- 172.21.15.37:0/1947119420 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f249c0544f0 con 0x7f24a40cef80 2023-07-09T22:01:09.541 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:09.541 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T22:01:09.541 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T22:01:09.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 msgr2=0x7f2484068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 0x7f2484068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f24940ae000 tx=0x7f24940a7000 comp rx=0 tx=0).stop 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 msgr2=0x7f24a41f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f249c00c730 tx=0x7f249c00cbf0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 shutdown_connections 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24840660d0 0x7f2484068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24a40cef80 0x7f24a41f81e0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24a40b7ab0 0x7f24a41f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 --2- 172.21.15.37:0/1947119420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24a40b4170 0x7f24a40c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 >> 172.21.15.37:0/1947119420 conn(0x7f24a4073090 msgr2=0x7f24a40ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 shutdown_connections 2023-07-09T22:01:09.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.538+0000 7f24a8e34640 1 -- 172.21.15.37:0/1947119420 wait complete. 2023-07-09T22:01:09.562 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:09.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.702+0000 7f0cf2c7b640 1 Processor -- start 2023-07-09T22:01:09.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.702+0000 7f0cf2c7b640 1 -- start start 2023-07-09T22:01:09.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf2c7b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cec0b4340 0x7f0cec06aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf2c7b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0b49f0 con 0x7f0cec0b7ab0 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf2c7b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0cc8a0 con 0x7f0cec0cef80 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf2c7b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0b7e80 con 0x7f0cec0b4340 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cebfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0cec0b4340 0x7f0cec06aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf0a17640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0cec0b7ab0 0x7f0cec0b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47902/0 (socket says 172.21.15.37:47902) 2023-07-09T22:01:09.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cf0a17640 1 -- 172.21.15.37:0/43615998 learned_addr learned my addr 172.21.15.37:0/43615998 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:09.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cebfff640 1 -- 172.21.15.37:0/43615998 >> v1:172.21.15.119:6789/0 conn(0x7f0cec0cef80 legacy=0x7f0cec0d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cebfff640 1 -- 172.21.15.37:0/43615998 >> v1:172.21.15.37:6789/0 conn(0x7f0cec0b7ab0 legacy=0x7f0cec0b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0cebfff640 1 -- 172.21.15.37:0/43615998 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec0ccb80 con 0x7f0cec0b4340 2023-07-09T22:01:09.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.706+0000 7f0ceb7fe640 1 -- 172.21.15.37:0/43615998 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255224239 0 0) 0x7f0cec0b49f0 con 0x7f0cec0b7ab0 2023-07-09T22:01:09.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cebfff640 1 --2- 172.21.15.37:0/43615998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0b4340 0x7f0cec06aa50 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80097c0 tx=0x7f0cd801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b1e1cb41fa3475 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0ceb7fe640 1 -- 172.21.15.37:0/43615998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80ab650 con 0x7f0cec0b4340 2023-07-09T22:01:09.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0ceb7fe640 1 -- 172.21.15.37:0/43615998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd80ab7b0 con 0x7f0cec0b4340 2023-07-09T22:01:09.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0ceb7fe640 1 -- 172.21.15.37:0/43615998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd80abb40 con 0x7f0cec0b4340 2023-07-09T22:01:09.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/43615998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0b4340 msgr2=0x7f0cec06aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/43615998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0b4340 0x7f0cec06aa50 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80097c0 tx=0x7f0cd801c450 comp rx=0 tx=0).stop 2023-07-09T22:01:09.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/43615998 shutdown_connections 2023-07-09T22:01:09.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/43615998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0b4340 0x7f0cec06aa50 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/43615998 >> 172.21.15.37:0/43615998 conn(0x7f0cec073090 msgr2=0x7f0cec069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/43615998 shutdown_connections 2023-07-09T22:01:09.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/43615998 wait complete. 2023-07-09T22:01:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 Processor -- start 2023-07-09T22:01:09.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.710+0000 7f0cf2c7b640 1 -- start start 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cec0b4340 0x7f0cec0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cec0b7ab0 0x7f0cec0caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec1f3d80 con 0x7f0cec0cef80 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c5d80 con 0x7f0cec0b4340 2023-07-09T22:01:09.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c6020 con 0x7f0cec0b7ab0 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49822/0 (socket says 172.21.15.37:49822) 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 -- 172.21.15.37:0/3528688047 learned_addr learned my addr 172.21.15.37:0/3528688047 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf0a17640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cec0b4340 0x7f0cec0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cebfff640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cec0b7ab0 0x7f0cec0caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 -- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cec0b7ab0 msgr2=0x7f0cec0caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cec0b7ab0 0x7f0cec0caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 -- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cec0b4340 msgr2=0x7f0cec0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cec0b4340 0x7f0cec0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 -- 172.21.15.37:0/3528688047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8009420 con 0x7f0cec0cef80 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf1218640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400c730 tx=0x7f0ce400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4003b80 con 0x7f0cec0cef80 2023-07-09T22:01:09.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4003ce0 con 0x7f0cec0cef80 2023-07-09T22:01:09.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec0c6300 con 0x7f0cec0cef80 2023-07-09T22:01:09.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4005310 con 0x7f0cec0cef80 2023-07-09T22:01:09.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec0c6690 con 0x7f0cec0cef80 2023-07-09T22:01:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec0c6b00 con 0x7f0cec0cef80 2023-07-09T22:01:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.714+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f0ce4005680 con 0x7f0cec0cef80 2023-07-09T22:01:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.718+0000 7f0ce97fa640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:09.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.718+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f0ce4084240 con 0x7f0cec0cef80 2023-07-09T22:01:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.718+0000 7f0cf0a17640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:09.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.718+0000 7f0cf0a17640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 0x7f0cd0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0007fd0 tx=0x7f0ce0007ba0 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:09.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.722+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0cec0c6b00 con 0x7f0cec0cef80 2023-07-09T22:01:09.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.906+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cec0c6b00 con 0x7f0cec0cef80 2023-07-09T22:01:09.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.906+0000 7f0ce97fa640 1 -- 172.21.15.37:0/3528688047 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+4675 (secure 0 0 0) 0x7f0cec0c6b00 con 0x7f0cec0cef80 2023-07-09T22:01:09.913 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:09.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":76,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T21:59:39.435714+0000","modified":"2023-07-09T21:59:43.088709+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10194},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10194":{"gid":10194,"name":"c","rank":0,"incarnation":73,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/649009446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":649009446},{"type":"v1","addr":"172.21.15.37:6835","nonce":649009446}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-07-09T22:01:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 76 2023-07-09T22:01:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 msgr2=0x7f0cd0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 0x7f0cd0068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0007fd0 tx=0x7f0ce0007ba0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 msgr2=0x7f0cec1f73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f0ce400c730 tx=0x7f0ce400cbf0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 shutdown_connections 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f0cd00663a0 0x7f0cd0068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0cec0cef80 0x7f0cec1f73d0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0cec0b7ab0 0x7f0cec0caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 --2- 172.21.15.37:0/3528688047 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0cec0b4340 0x7f0cec0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 >> 172.21.15.37:0/3528688047 conn(0x7f0cec073090 msgr2=0x7f0cec0d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:09.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 shutdown_connections 2023-07-09T22:01:09.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:09.910+0000 7f0cf2c7b640 1 -- 172.21.15.37:0/3528688047 wait complete. 2023-07-09T22:01:09.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:10.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 Processor -- start 2023-07-09T22:01:10.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 -- start start 2023-07-09T22:01:10.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 0x7f1ac01600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1ac00cf260 0x7f1ac00d0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac006acb0 con 0x7f1ac00cc800 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac01605f0 con 0x7f1ac00cf260 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac798f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac00ccc90 con 0x7f1ac015ba60 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac4f2a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1ac00cc800 0x7f1ac00ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47906/0 (socket says 172.21.15.37:47906) 2023-07-09T22:01:10.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac4f2a640 1 -- 172.21.15.37:0/2075215491 learned_addr learned my addr 172.21.15.37:0/2075215491 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:10.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/2075215491 >> v2:172.21.15.119:3300/0 conn(0x7f1ac00cf260 0x7f1ac00d0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac572b640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 0x7f1ac01600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ab7fff640 1 -- 172.21.15.37:0/2075215491 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064654252 0 0) 0x7f1ac006acb0 con 0x7f1ac00cc800 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ab7fff640 1 -- 172.21.15.37:0/2075215491 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aac003530 con 0x7f1ac00cc800 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 msgr2=0x7f1ac01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 0x7f1ac01600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/2075215491 >> v1:172.21.15.37:6789/0 conn(0x7f1ac00cc800 legacy=0x7f1ac00ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/2075215491 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00cfe20 con 0x7f1ac00cf260 2023-07-09T22:01:10.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.074+0000 7f1ac572b640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 0x7f1ac01600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:10.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac00d0900 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009d90 tx=0x7f1ab801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e5a5830a13f025d server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ab7fff640 1 -- 172.21.15.37:0/2075215491 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80a59e0 con 0x7f1ac00cf260 2023-07-09T22:01:10.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ab7fff640 1 -- 172.21.15.37:0/2075215491 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80a5b40 con 0x7f1ac00cf260 2023-07-09T22:01:10.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ab7fff640 1 -- 172.21.15.37:0/2075215491 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80ad440 con 0x7f1ac00cf260 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 -- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 msgr2=0x7f1ac00d0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac00d0900 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009d90 tx=0x7f1ab801c920 comp rx=0 tx=0).stop 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 -- 172.21.15.37:0/2075215491 shutdown_connections 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac00d0900 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 --2- 172.21.15.37:0/2075215491 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac015ba60 0x7f1ac01600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 -- 172.21.15.37:0/2075215491 >> 172.21.15.37:0/2075215491 conn(0x7f1ac0073090 msgr2=0x7f1ac0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 -- 172.21.15.37:0/2075215491 shutdown_connections 2023-07-09T22:01:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.078+0000 7f1ac798f640 1 -- 172.21.15.37:0/2075215491 wait complete. 2023-07-09T22:01:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 Processor -- start 2023-07-09T22:01:10.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- start start 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac00cc800 0x7f1ac0153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac01529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac01f3f10 con 0x7f1ac015ba60 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac0151f90 con 0x7f1ac00cf260 2023-07-09T22:01:10.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac014a890 con 0x7f1ac00cc800 2023-07-09T22:01:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49836/0 (socket says 172.21.15.37:49836) 2023-07-09T22:01:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/3999926063 learned_addr learned my addr 172.21.15.37:0/3999926063 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac4f2a640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac01529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac572b640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac00cc800 0x7f1ac0153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac00cc800 msgr2=0x7f1ac0153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac00cc800 0x7f1ac0153550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 msgr2=0x7f1ac01529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac01529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 -- 172.21.15.37:0/3999926063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009420 con 0x7f1ac015ba60 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac5f2c640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b0040 tx=0x7f1ab80196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80adce0 con 0x7f1ac015ba60 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab80ade40 con 0x7f1ac015ba60 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab80b9690 con 0x7f1ac015ba60 2023-07-09T22:01:10.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8009a70 con 0x7f1ac015ba60 2023-07-09T22:01:10.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.082+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac014ae50 con 0x7f1ac015ba60 2023-07-09T22:01:10.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.086+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac00668f0 con 0x7f1ac015ba60 2023-07-09T22:01:10.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.086+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1ab80b97f0 con 0x7f1ac015ba60 2023-07-09T22:01:10.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.086+0000 7f1ab5ffb640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 0x7f1aa4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.086+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f1ab811f930 con 0x7f1ac015ba60 2023-07-09T22:01:10.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.086+0000 7f1ac572b640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 0x7f1aa4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.090+0000 7f1ac572b640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 0x7f1aa4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009c50 tx=0x7f1abc009190 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.090+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ab80ecac0 con 0x7f1ac015ba60 2023-07-09T22:01:10.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.250+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ac006a7f0 con 0x7f1ac015ba60 2023-07-09T22:01:10.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.250+0000 7f1ab5ffb640 1 -- 172.21.15.37:0/3999926063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+19740 (secure 0 0 0) 0x7f1ab8009450 con 0x7f1ac015ba60 2023-07-09T22:01:10.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:10.256 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":183,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:07.356028+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-07-09T21:59:37.562054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"175","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-07-09T21:59:38.431596+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":182,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.2b","mappings":[{"from":3,"to":0}]},{"pgid":"22.32","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:6833/4130882000":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/9964786":"2023-07-10T22:01:07.355989+0000","172.21.15.119:6832/4130882000":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/1221926063":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2516280985":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2871729814":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/2673406021":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/518799361":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/3879107718":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/842862974":"2023-07-10T22:01:07.355989+0000","172.21.15.119:0/3145962994":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6833/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:6832/801119985":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/113945541":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/3463027125":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/473096067":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/207456882":"2023-07-10T21:59:57.510086+0000","172.21.15.119:0/1513289062":"2023-07-10T21:59:57.510086+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]},{"pool":22,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:10.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 msgr2=0x7f1aa4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 0x7f1aa4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1abc009c50 tx=0x7f1abc009190 comp rx=0 tx=0).stop 2023-07-09T22:01:10.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 msgr2=0x7f1ac0145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80b0040 tx=0x7f1ab80196c0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 shutdown_connections 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1aa40663a0 0x7f1aa4068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ac015ba60 0x7f1ac0145d30 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1ac00cf260 0x7f1ac01529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 --2- 172.21.15.37:0/3999926063 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1ac00cc800 0x7f1ac0153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 >> 172.21.15.37:0/3999926063 conn(0x7f1ac0073090 msgr2=0x7f1ac015aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:10.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 shutdown_connections 2023-07-09T22:01:10.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.254+0000 7f1ac798f640 1 -- 172.21.15.37:0/3999926063 wait complete. 2023-07-09T22:01:10.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T22:01:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 Processor -- start 2023-07-09T22:01:10.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 -- start start 2023-07-09T22:01:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9ed80b47a0 0x7f9ed80b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80cef80 con 0x7f9ed80b4140 2023-07-09T22:01:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80cf260 con 0x7f9ed80b7a60 2023-07-09T22:01:10.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edf00b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80ccee0 con 0x7f9ed80b47a0 2023-07-09T22:01:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edd5a8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9ed80b4140 0x7f9ed80d05f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47920/0 (socket says 172.21.15.37:47920) 2023-07-09T22:01:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9edd5a8640 1 -- 172.21.15.37:0/285842747 learned_addr learned my addr 172.21.15.37:0/285842747 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/285842747 >> v2:172.21.15.119:3300/0 conn(0x7f9ed80b47a0 0x7f9ed80b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 284293505 0 0) 0x7f9ed80cef80 con 0x7f9ed80b4140 2023-07-09T22:01:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec8003530 con 0x7f9ed80b4140 2023-07-09T22:01:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188733015 0 0) 0x7f9ed80cf260 con 0x7f9ed80b7a60 2023-07-09T22:01:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed80cef80 con 0x7f9ed80b7a60 2023-07-09T22:01:10.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed7fff640 1 -- 172.21.15.37:0/285842747 >> v1:172.21.15.119:6789/0 conn(0x7f9ed80b7a60 legacy=0x7f9ed80cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed7fff640 1 -- 172.21.15.37:0/285842747 >> v1:172.21.15.37:6789/0 conn(0x7f9ed80b4140 legacy=0x7f9ed80d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.418+0000 7f9ed7fff640 1 -- 172.21.15.37:0/285842747 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80cf540 con 0x7f9ed80b47a0 2023-07-09T22:01:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/285842747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed80b3c00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49bdeabf80072c18 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40ab600 con 0x7f9ed80b47a0 2023-07-09T22:01:10.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec40a7050 con 0x7f9ed80b47a0 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9ed77fe640 1 -- 172.21.15.37:0/285842747 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40ab980 con 0x7f9ed80b47a0 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 -- 172.21.15.37:0/285842747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 msgr2=0x7f9ed80b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 --2- 172.21.15.37:0/285842747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed80b3c00 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40097c0 tx=0x7f9ec401c480 comp rx=0 tx=0).stop 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 -- 172.21.15.37:0/285842747 shutdown_connections 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 --2- 172.21.15.37:0/285842747 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed80b3c00 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 -- 172.21.15.37:0/285842747 >> 172.21.15.37:0/285842747 conn(0x7f9ed8073050 msgr2=0x7f9ed8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:10.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 -- 172.21.15.37:0/285842747 shutdown_connections 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.422+0000 7f9edf00b640 1 -- 172.21.15.37:0/285842747 wait complete. 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 Processor -- start 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- start start 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed81f7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 0x7f9ed81f79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed815bc70 con 0x7f9ed80b4140 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8153c90 con 0x7f9ed80b47a0 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8153f70 con 0x7f9ed80b7a60 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49848/0 (socket says 172.21.15.37:49848) 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 -- 172.21.15.37:0/260230319 learned_addr learned my addr 172.21.15.37:0/260230319 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed81f7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edd5a8640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 0x7f9ed81f79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 -- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 msgr2=0x7f9ed81f79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 0x7f9ed81f79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 -- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 msgr2=0x7f9ed81f7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed81f7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 -- 172.21.15.37:0/260230319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009420 con 0x7f9ed80b4140 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edd5a8640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 0x7f9ed81f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:10.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edcda7640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c490 tx=0x7f9ecc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc0052d0 con 0x7f9ed80b4140 2023-07-09T22:01:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ecc005430 con 0x7f9ed80b4140 2023-07-09T22:01:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ecc012870 con 0x7f9ed80b4140 2023-07-09T22:01:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed8154250 con 0x7f9ed80b4140 2023-07-09T22:01:10.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.426+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed814f4a0 con 0x7f9ed80b4140 2023-07-09T22:01:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed80cdaa0 con 0x7f9ed80b4140 2023-07-09T22:01:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9ecc0129d0 con 0x7f9ed80b4140 2023-07-09T22:01:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9ed57fa640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 0x7f9ebc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 6978+0+0 (secure 0 0 0) 0x7f9ecc083d60 con 0x7f9ed80b4140 2023-07-09T22:01:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 0x7f9ebc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.430+0000 7f9ed7fff640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 0x7f9ebc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40ad000 tx=0x7f9ec4008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.434+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ecc050d20 con 0x7f9ed80b4140 2023-07-09T22:01:10.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.630+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9ed804d7d0 con 0x7f9ed80b4140 2023-07-09T22:01:10.634 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T22:01:10.630+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T22:01:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.638+0000 7f9ed57fa640 1 -- 172.21.15.37:0/260230319 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9ecc054340 con 0x7f9ed80b4140 2023-07-09T22:01:10.642 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T22:01:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 msgr2=0x7f9ebc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 0x7f9ebc068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40ad000 tx=0x7f9ec4008040 comp rx=0 tx=0).stop 2023-07-09T22:01:10.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 msgr2=0x7f9ed814ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00c490 tx=0x7f9ecc00c950 comp rx=0 tx=0).stop 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 shutdown_connections 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f9ebc0663a0 0x7f9ebc068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9ed80b7a60 0x7f9ed81f79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9ed80b47a0 0x7f9ed81f7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 --2- 172.21.15.37:0/260230319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ed80b4140 0x7f9ed814ef60 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 >> 172.21.15.37:0/260230319 conn(0x7f9ed8073050 msgr2=0x7f9ed80cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 shutdown_connections 2023-07-09T22:01:10.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.642+0000 7f9edf00b640 1 -- 172.21.15.37:0/260230319 wait complete. 2023-07-09T22:01:10.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T22:01:10.717 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T22:01:10.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.814+0000 7f502e05c640 1 Processor -- start 2023-07-09T22:01:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.814+0000 7f502e05c640 1 -- start start 2023-07-09T22:01:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f502e05c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50280b7980 0x7f5028160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f502e05c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f502e05c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f502815bf80 con 0x7f50280b3c20 2023-07-09T22:01:10.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f502e05c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280cd070 con 0x7f50280b7980 2023-07-09T22:01:10.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f502e05c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280cfd70 con 0x7f50280ceb80 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f5026ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f50277fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f50280b7980 0x7f5028160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f5027fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f50280b3c20 0x7f50280b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:32796/0 (socket says 172.21.15.37:32796) 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f5027fff640 1 -- 172.21.15.37:0/2414921393 learned_addr learned my addr 172.21.15.37:0/2414921393 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f50277fe640 1 -- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 msgr2=0x7f50280cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:10.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f50277fe640 1 --2- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f50277fe640 1 -- 172.21.15.37:0/2414921393 >> v1:172.21.15.119:6789/0 conn(0x7f50280b3c20 legacy=0x7f50280b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.818+0000 7f50277fe640 1 -- 172.21.15.37:0/2414921393 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5028160570 con 0x7f50280b7980 2023-07-09T22:01:10.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f50277fe640 1 --2- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b7980 0x7f5028160030 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afedbfcd03e219e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f50267fc640 1 -- 172.21.15.37:0/2414921393 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ab600 con 0x7f50280b7980 2023-07-09T22:01:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f50267fc640 1 -- 172.21.15.37:0/2414921393 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a7050 con 0x7f50280b7980 2023-07-09T22:01:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f50267fc640 1 -- 172.21.15.37:0/2414921393 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ab980 con 0x7f50280b7980 2023-07-09T22:01:10.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b7980 msgr2=0x7f5028160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 --2- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b7980 0x7f5028160030 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801c480 comp rx=0 tx=0).stop 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- 172.21.15.37:0/2414921393 shutdown_connections 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 --2- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 --2- 172.21.15.37:0/2414921393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b7980 0x7f5028160030 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- 172.21.15.37:0/2414921393 >> 172.21.15.37:0/2414921393 conn(0x7f5028073090 msgr2=0x7f5028069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- 172.21.15.37:0/2414921393 shutdown_connections 2023-07-09T22:01:10.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- 172.21.15.37:0/2414921393 wait complete. 2023-07-09T22:01:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 Processor -- start 2023-07-09T22:01:10.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.822+0000 7f502e05c640 1 -- start start 2023-07-09T22:01:10.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b3c20 0x7f502815b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280c7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502815c120 con 0x7f50280b7980 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502815c400 con 0x7f50280b3c20 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502815c6e0 con 0x7f50280ceb80 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49882/0 (socket says 172.21.15.37:49882) 2023-07-09T22:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 -- 172.21.15.37:0/405017310 learned_addr learned my addr 172.21.15.37:0/405017310 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f50277fe640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b3c20 0x7f502815b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5027fff640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280c7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 -- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 msgr2=0x7f50280c7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280c7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 -- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b3c20 msgr2=0x7f502815b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:10.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b3c20 0x7f502815b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 -- 172.21.15.37:0/405017310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009420 con 0x7f50280b7980 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5027fff640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f5026ffd640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f501c00e930 tx=0x7f501c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c009690 con 0x7f50280b7980 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c00ca00 con 0x7f50280b7980 2023-07-09T22:01:10.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502815c9c0 con 0x7f50280b7980 2023-07-09T22:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c00cd70 con 0x7f50280b7980 2023-07-09T22:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50280c9e00 con 0x7f50280b7980 2023-07-09T22:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f502804d7d0 con 0x7f50280b7980 2023-07-09T22:01:10.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.826+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f501c013470 con 0x7f50280b7980 2023-07-09T22:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.830+0000 7f500ffff640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 0x7f5014068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.830+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7036+0+0 (secure 0 0 0) 0x7f501c0844d0 con 0x7f50280b7980 2023-07-09T22:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.830+0000 7f50277fe640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 0x7f5014068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:10.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.830+0000 7f50277fe640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 0x7f5014068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50180ad000 tx=0x7f5018008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:10.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:10.834+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f501c051540 con 0x7f50280b7980 2023-07-09T22:01:11.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.022+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f502806a800 con 0x7f50280b7980 2023-07-09T22:01:11.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.642+0000 7f500ffff640 1 -- 172.21.15.37:0/405017310 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7f501c054b60 con 0x7f50280b7980 2023-07-09T22:01:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 msgr2=0x7f5014068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 0x7f5014068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f50180ad000 tx=0x7f5018008040 comp rx=0 tx=0).stop 2023-07-09T22:01:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 msgr2=0x7f5028154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f501c00e930 tx=0x7f501c00edf0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 shutdown_connections 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f50140663a0 0x7f5014068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f50280ceb80 0x7f50280c7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50280b7980 0x7f5028154160 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 --2- 172.21.15.37:0/405017310 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f50280b3c20 0x7f502815b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 >> 172.21.15.37:0/405017310 conn(0x7f5028073090 msgr2=0x7f50280b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:11.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 shutdown_connections 2023-07-09T22:01:11.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.646+0000 7f502e05c640 1 -- 172.21.15.37:0/405017310 wait complete. 2023-07-09T22:01:11.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T22:01:11.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 Processor -- start 2023-07-09T22:01:11.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 -- start start 2023-07-09T22:01:11.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c900b7980 0x7f1c90160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1c900ceb80 0x7f1c900cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 0x7f1c900b4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c900cd070 con 0x7f1c900b7980 2023-07-09T22:01:11.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c900cfd70 con 0x7f1c900ceb80 2023-07-09T22:01:11.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c96f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9015bf80 con 0x7f1c900b3c20 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c900b7980 0x7f1c90160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1c900b7980 0x7f1c90160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49886/0 (socket says 172.21.15.37:49886) 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 -- 172.21.15.37:0/1063329789 learned_addr learned my addr 172.21.15.37:0/1063329789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/1063329789 >> v2:172.21.15.119:3300/0 conn(0x7f1c900ceb80 0x7f1c900cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c954dd640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 0x7f1c900b4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 -- 172.21.15.37:0/1063329789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 msgr2=0x7f1c900b4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:11.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 0x7f1c900b4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 -- 172.21.15.37:0/1063329789 >> v2:172.21.15.119:3300/0 conn(0x7f1c900ceb80 msgr2=0x7f1c900cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:11.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/1063329789 >> v2:172.21.15.119:3300/0 conn(0x7f1c900ceb80 0x7f1c900cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c94cdc640 1 -- 172.21.15.37:0/1063329789 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90160570 con 0x7f1c900b7980 2023-07-09T22:01:11.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.866+0000 7f1c954dd640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 0x7f1c900b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c90160030 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1c900b4cd0 tx=0x7f1c8401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97e35c3b433205 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:11.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c8f7fe640 1 -- 172.21.15.37:0/1063329789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840ab600 con 0x7f1c900b7980 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c8f7fe640 1 -- 172.21.15.37:0/1063329789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840a7050 con 0x7f1c900b7980 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c8f7fe640 1 -- 172.21.15.37:0/1063329789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c840ab980 con 0x7f1c900b7980 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 -- 172.21.15.37:0/1063329789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 msgr2=0x7f1c90160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c90160030 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f1c900b4cd0 tx=0x7f1c8401c500 comp rx=0 tx=0).stop 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 -- 172.21.15.37:0/1063329789 shutdown_connections 2023-07-09T22:01:11.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900b3c20 0x7f1c900b4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 --2- 172.21.15.37:0/1063329789 >> v2:172.21.15.119:3300/0 conn(0x7f1c900ceb80 0x7f1c900cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 --2- 172.21.15.37:0/1063329789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c90160030 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 -- 172.21.15.37:0/1063329789 >> 172.21.15.37:0/1063329789 conn(0x7f1c90073090 msgr2=0x7f1c90069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 -- 172.21.15.37:0/1063329789 shutdown_connections 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.870+0000 7f1c96f40640 1 -- 172.21.15.37:0/1063329789 wait complete. 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 Processor -- start 2023-07-09T22:01:11.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- start start 2023-07-09T22:01:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c900b3c20 0x7f1c900c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 0x7f1c901521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9015e220 con 0x7f1c900b7980 2023-07-09T22:01:11.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90155430 con 0x7f1c900b3c20 2023-07-09T22:01:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90158590 con 0x7f1c900ceb80 2023-07-09T22:01:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49902/0 (socket says 172.21.15.37:49902) 2023-07-09T22:01:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 -- 172.21.15.37:0/512061446 learned_addr learned my addr 172.21.15.37:0/512061446 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:11.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c900b3c20 0x7f1c900c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c954dd640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 0x7f1c901521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 -- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 msgr2=0x7f1c901521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 0x7f1c901521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 -- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c900b3c20 msgr2=0x7f1c900c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c900b3c20 0x7f1c900c66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 -- 172.21.15.37:0/512061446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840094d0 con 0x7f1c900b7980 2023-07-09T22:01:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c954dd640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 0x7f1c901521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8ffff640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00d800 tx=0x7f1c7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:11.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00b660 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c00b7c0 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c900c6dc0 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c00bb30 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c900c7380 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.874+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9004d7d0 con 0x7f1c900b7980 2023-07-09T22:01:11.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.878+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1c7c00bc90 con 0x7f1c900b7980 2023-07-09T22:01:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.878+0000 7f1c8d7fa640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 0x7f1c74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:11.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.878+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 7036+0+0 (secure 0 0 0) 0x7f1c7c0846c0 con 0x7f1c900b7980 2023-07-09T22:01:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.878+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 0x7f1c74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.878+0000 7f1c94cdc640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 0x7f1c74068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c840ad000 tx=0x7f1c84008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:11.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:11.882+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1c7c0515c0 con 0x7f1c900b7980 2023-07-09T22:01:12.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.042+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c900c7cb0 con 0x7f1c900b7980 2023-07-09T22:01:12.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c8d7fa640 1 -- 172.21.15.37:0/512061446 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v186) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1c7c054be0 con 0x7f1c900b7980 2023-07-09T22:01:12.654 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T22:01:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 msgr2=0x7f1c74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 0x7f1c74068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c840ad000 tx=0x7f1c84008040 comp rx=0 tx=0).stop 2023-07-09T22:01:12.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 msgr2=0x7f1c9015dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00d800 tx=0x7f1c7c00dcc0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 shutdown_connections 2023-07-09T22:01:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1c740663a0 0x7f1c74068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1c900ceb80 0x7f1c901521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c900b7980 0x7f1c9015dce0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 --2- 172.21.15.37:0/512061446 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1c900b3c20 0x7f1c900c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 >> 172.21.15.37:0/512061446 conn(0x7f1c90073090 msgr2=0x7f1c900d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.650+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 shutdown_connections 2023-07-09T22:01:12.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.654+0000 7f1c96f40640 1 -- 172.21.15.37:0/512061446 wait complete. 2023-07-09T22:01:12.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T22:01:12.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 Processor -- start 2023-07-09T22:01:12.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 -- start start 2023-07-09T22:01:12.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 0x7f76e4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e415bf80 con 0x7f76e40ceb80 2023-07-09T22:01:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e4160570 con 0x7f76e40d0780 2023-07-09T22:01:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76ea700640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40cd070 con 0x7f76e40b7980 2023-07-09T22:01:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f76e40ceb80 0x7f76e40cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47928/0 (socket says 172.21.15.37:47928) 2023-07-09T22:01:12.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e37fe640 1 -- 172.21.15.37:0/1689198127 learned_addr learned my addr 172.21.15.37:0/1689198127 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1689198127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 0x7f76e4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958847522 0 0) 0x7f76d8001120 con 0x7f76e40ceb80 2023-07-09T22:01:12.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc003530 con 0x7f76e40ceb80 2023-07-09T22:01:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408179455 0 0) 0x7f76dc0014a0 con 0x7f76e40d0780 2023-07-09T22:01:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d8001120 con 0x7f76e40d0780 2023-07-09T22:01:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e3fff640 1 -- 172.21.15.37:0/1689198127 >> v1:172.21.15.119:6789/0 conn(0x7f76e40d0780 legacy=0x7f76e40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e3fff640 1 -- 172.21.15.37:0/1689198127 >> v1:172.21.15.37:6789/0 conn(0x7f76e40ceb80 legacy=0x7f76e40cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.830+0000 7f76e3fff640 1 -- 172.21.15.37:0/1689198127 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e40d02f0 con 0x7f76e40b7980 2023-07-09T22:01:12.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1689198127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 0x7f76e4160030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2be3cc8a4186fec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:12.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40ab600 con 0x7f76e40b7980 2023-07-09T22:01:12.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40a7050 con 0x7f76e40b7980 2023-07-09T22:01:12.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76e2ffd640 1 -- 172.21.15.37:0/1689198127 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40ab980 con 0x7f76e40b7980 2023-07-09T22:01:12.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 -- 172.21.15.37:0/1689198127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 msgr2=0x7f76e4160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 --2- 172.21.15.37:0/1689198127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 0x7f76e4160030 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d401c4c0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 -- 172.21.15.37:0/1689198127 shutdown_connections 2023-07-09T22:01:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 --2- 172.21.15.37:0/1689198127 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40b7980 0x7f76e4160030 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 -- 172.21.15.37:0/1689198127 >> 172.21.15.37:0/1689198127 conn(0x7f76e4073090 msgr2=0x7f76e4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 -- 172.21.15.37:0/1689198127 shutdown_connections 2023-07-09T22:01:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.834+0000 7f76ea700640 1 -- 172.21.15.37:0/1689198127 wait complete. 2023-07-09T22:01:12.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 Processor -- start 2023-07-09T22:01:12.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 -- start start 2023-07-09T22:01:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40ceb80 0x7f76e414d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76e40d0780 0x7f76e40caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:12.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40cb400 con 0x7f76e40b7980 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40c9e20 con 0x7f76e40d0780 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76ea700640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e40ca100 con 0x7f76e40ceb80 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49904/0 (socket says 172.21.15.37:49904) 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 -- 172.21.15.37:0/1484819835 learned_addr learned my addr 172.21.15.37:0/1484819835 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40ceb80 0x7f76e414d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:12.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e8c9d640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76e40d0780 0x7f76e40caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 -- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40ceb80 msgr2=0x7f76e414d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40ceb80 0x7f76e414d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 -- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76e40d0780 msgr2=0x7f76e40caec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76e40d0780 0x7f76e40caec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.838+0000 7f76e3fff640 1 -- 172.21.15.37:0/1484819835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4009420 con 0x7f76e40b7980 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e3fff640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40b4610 con 0x7f76e40b7980 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40b4770 con 0x7f76e40b7980 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d40b4b20 con 0x7f76e40b7980 2023-07-09T22:01:12.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e40ca3e0 con 0x7f76e40b7980 2023-07-09T22:01:12.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e40ca9a0 con 0x7f76e40b7980 2023-07-09T22:01:12.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e40cab90 con 0x7f76e40b7980 2023-07-09T22:01:12.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f76d40b2040 con 0x7f76e40b7980 2023-07-09T22:01:12.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 0x7f76d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:12.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.842+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 6598+0+0 (secure 0 0 0) 0x7f76d411eb90 con 0x7f76e40b7980 2023-07-09T22:01:12.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.846+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 0x7f76d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:12.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.846+0000 7f76e37fe640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 0x7f76d0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f76e4156af0 tx=0x7f76d8007d80 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:12.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.846+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76d40ebd80 con 0x7f76e40b7980 2023-07-09T22:01:13.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:12.998+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76e40737d0 con 0x7f76e40b7980 2023-07-09T22:01:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.654+0000 7f76e0ff9640 1 -- 172.21.15.37:0/1484819835 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v187) v1 ==== 169+0+0 (secure 0 0 0) 0x7f76e40737d0 con 0x7f76e40b7980 2023-07-09T22:01:13.660 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T22:01:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 msgr2=0x7f76d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 0x7f76d0068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f76e4156af0 tx=0x7f76d8007d80 comp rx=0 tx=0).stop 2023-07-09T22:01:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 msgr2=0x7f76e4150100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f76d40097f0 tx=0x7f76d4019260 comp rx=0 tx=0).stop 2023-07-09T22:01:13.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 shutdown_connections 2023-07-09T22:01:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f76d00663a0 0x7f76d0068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f76e40d0780 0x7f76e40caec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f76e40ceb80 0x7f76e414d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 --2- 172.21.15.37:0/1484819835 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76e40b7980 0x7f76e4150100 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 >> 172.21.15.37:0/1484819835 conn(0x7f76e4073090 msgr2=0x7f76e40d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 shutdown_connections 2023-07-09T22:01:13.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.658+0000 7f76ea700640 1 -- 172.21.15.37:0/1484819835 wait complete. 2023-07-09T22:01:13.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T22:01:13.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 Processor -- start 2023-07-09T22:01:13.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 -- start start 2023-07-09T22:01:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f12700b7980 0x7f1270160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127015bf80 con 0x7f12700ceb80 2023-07-09T22:01:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1270160570 con 0x7f12700d0780 2023-07-09T22:01:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1274d82640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12700cd070 con 0x7f12700b7980 2023-07-09T22:01:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1267fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f12700ceb80 0x7f12700cefc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47936/0 (socket says 172.21.15.37:47936) 2023-07-09T22:01:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f1267fff640 1 -- 172.21.15.37:0/3541352678 learned_addr learned my addr 172.21.15.37:0/3541352678 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f126e59c640 1 --2- 172.21.15.37:0/3541352678 >> v2:172.21.15.119:3300/0 conn(0x7f12700b7980 0x7f1270160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:13.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f126dd9b640 1 -- 172.21.15.37:0/3541352678 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933541739 0 0) 0x7f1258001120 con 0x7f12700ceb80 2023-07-09T22:01:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.838+0000 7f126dd9b640 1 -- 172.21.15.37:0/3541352678 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c003530 con 0x7f12700ceb80 2023-07-09T22:01:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126e59c640 1 -- 172.21.15.37:0/3541352678 >> v1:172.21.15.119:6789/0 conn(0x7f12700d0780 legacy=0x7f12700d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126e59c640 1 -- 172.21.15.37:0/3541352678 >> v1:172.21.15.37:6789/0 conn(0x7f12700ceb80 legacy=0x7f12700cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126e59c640 1 -- 172.21.15.37:0/3541352678 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12700d02f0 con 0x7f12700b7980 2023-07-09T22:01:13.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126e59c640 1 --2- 172.21.15.37:0/3541352678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f1270160030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f12600097c0 tx=0x7f126001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54fc8f7f4e711721 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126dd9b640 1 -- 172.21.15.37:0/3541352678 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600ab600 con 0x7f12700b7980 2023-07-09T22:01:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126dd9b640 1 -- 172.21.15.37:0/3541352678 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600a7050 con 0x7f12700b7980 2023-07-09T22:01:13.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f126dd9b640 1 -- 172.21.15.37:0/3541352678 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600ab980 con 0x7f12700b7980 2023-07-09T22:01:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 -- 172.21.15.37:0/3541352678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 msgr2=0x7f1270160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 --2- 172.21.15.37:0/3541352678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f1270160030 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f12600097c0 tx=0x7f126001c480 comp rx=0 tx=0).stop 2023-07-09T22:01:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 -- 172.21.15.37:0/3541352678 shutdown_connections 2023-07-09T22:01:13.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 --2- 172.21.15.37:0/3541352678 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f1270160030 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 -- 172.21.15.37:0/3541352678 >> 172.21.15.37:0/3541352678 conn(0x7f1270073090 msgr2=0x7f1270069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 -- 172.21.15.37:0/3541352678 shutdown_connections 2023-07-09T22:01:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.842+0000 7f1274d82640 1 -- 172.21.15.37:0/3541352678 wait complete. 2023-07-09T22:01:13.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 Processor -- start 2023-07-09T22:01:13.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 -- start start 2023-07-09T22:01:13.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 0x7f1270146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 0x7f127014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c7370 con 0x7f12700d0780 2023-07-09T22:01:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c7610 con 0x7f12700b7980 2023-07-09T22:01:13.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1274d82640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c78f0 con 0x7f12700ceb80 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 0x7f127014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:43092/0 (socket says 172.21.15.37:43092) 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 -- 172.21.15.37:0/2575197735 learned_addr learned my addr 172.21.15.37:0/2575197735 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1267fff640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 0x7f1270146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 -- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 msgr2=0x7f1270146ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 0x7f1270146ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 -- 172.21.15.37:0/2575197735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 msgr2=0x7f127014cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 0x7f127014cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 -- 172.21.15.37:0/2575197735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1260009420 con 0x7f12700b7980 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f1267fff640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 0x7f1270146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126ed9d640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 0x7f127014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.846+0000 7f126e59c640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f12600ae040 tx=0x7f1260019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:13.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600b4840 con 0x7f12700b7980 2023-07-09T22:01:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12600b49c0 con 0x7f12700b7980 2023-07-09T22:01:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12600b4d70 con 0x7f12700b7980 2023-07-09T22:01:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12700c7bd0 con 0x7f12700b7980 2023-07-09T22:01:13.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12700c8190 con 0x7f12700b7980 2023-07-09T22:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127004d7d0 con 0x7f12700b7980 2023-07-09T22:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f12600b2040 con 0x7f12700b7980 2023-07-09T22:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 0x7f1250068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f126011edf0 con 0x7f12700b7980 2023-07-09T22:01:13.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.850+0000 7f1267fff640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 0x7f1250068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:13.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.854+0000 7f1267fff640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 0x7f1250068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1270167930 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:13.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:13.854+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f12600ec210 con 0x7f12700b7980 2023-07-09T22:01:14.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.010+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1270150a90 con 0x7f12700b7980 2023-07-09T22:01:14.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.018+0000 7f1266ffd640 1 -- 172.21.15.37:0/2575197735 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f12600b00a0 con 0x7f12700b7980 2023-07-09T22:01:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 msgr2=0x7f1250068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 0x7f1250068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1270167930 tx=0x7f1258009040 comp rx=0 tx=0).stop 2023-07-09T22:01:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 msgr2=0x7f12700c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f12600ae040 tx=0x7f1260019220 comp rx=0 tx=0).stop 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 shutdown_connections 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f12500663a0 0x7f1250068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f12700d0780 0x7f127014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f12700ceb80 0x7f1270146ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 --2- 172.21.15.37:0/2575197735 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f12700b7980 0x7f12700c86b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 >> 172.21.15.37:0/2575197735 conn(0x7f1270073090 msgr2=0x7f12701575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 shutdown_connections 2023-07-09T22:01:14.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.022+0000 7f1274d82640 1 -- 172.21.15.37:0/2575197735 wait complete. 2023-07-09T22:01:14.045 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T22:01:14.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 Processor -- start 2023-07-09T22:01:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 -- start start 2023-07-09T22:01:14.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a415bf80 con 0x7f81a40b7980 2023-07-09T22:01:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40cd070 con 0x7f81a40d0780 2023-07-09T22:01:14.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a9f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a40cfd70 con 0x7f81a40cf290 2023-07-09T22:01:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a2ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:58656/0 (socket says 172.21.15.37:58656) 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a3fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81a40d0780 0x7f81a40d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a2ffd640 1 -- 172.21.15.37:0/2784355393 learned_addr learned my addr 172.21.15.37:0/2784355393 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a37fe640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f81a40b7980 0x7f81a40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:32822/0 (socket says 172.21.15.37:32822) 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a3fff640 1 -- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 msgr2=0x7f81a4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a3fff640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a3fff640 1 -- 172.21.15.37:0/2784355393 >> v1:172.21.15.119:6789/0 conn(0x7f81a40b7980 legacy=0x7f81a40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a3fff640 1 -- 172.21.15.37:0/2784355393 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a4160570 con 0x7f81a40d0780 2023-07-09T22:01:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a27fc640 1 -- 172.21.15.37:0/2784355393 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101261072 0 0) 0x7f8194001120 con 0x7f81a40b7980 2023-07-09T22:01:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.186+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:14.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a3fff640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a40d0c00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f819c009d90 tx=0x7f819c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d60d0a028d3226 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a27fc640 1 -- 172.21.15.37:0/2784355393 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0a5810 con 0x7f81a40d0780 2023-07-09T22:01:14.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a27fc640 1 -- 172.21.15.37:0/2784355393 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c0a5970 con 0x7f81a40d0780 2023-07-09T22:01:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a27fc640 1 -- 172.21.15.37:0/2784355393 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0a5d00 con 0x7f81a40d0780 2023-07-09T22:01:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 -- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 msgr2=0x7f81a40d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a40d0c00 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f819c009d90 tx=0x7f819c01c950 comp rx=0 tx=0).stop 2023-07-09T22:01:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 -- 172.21.15.37:0/2784355393 shutdown_connections 2023-07-09T22:01:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a40d0c00 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 --2- 172.21.15.37:0/2784355393 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40cf290 0x7f81a4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 -- 172.21.15.37:0/2784355393 >> 172.21.15.37:0/2784355393 conn(0x7f81a4073090 msgr2=0x7f81a4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 -- 172.21.15.37:0/2784355393 shutdown_connections 2023-07-09T22:01:14.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.190+0000 7f81a9f40640 1 -- 172.21.15.37:0/2784355393 wait complete. 2023-07-09T22:01:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 Processor -- start 2023-07-09T22:01:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- start start 2023-07-09T22:01:14.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a415b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4152720 con 0x7f81a40cf290 2023-07-09T22:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a415aa80 con 0x7f81a40d0780 2023-07-09T22:01:14.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a415ad60 con 0x7f81a40b7980 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49912/0 (socket says 172.21.15.37:49912) 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 -- 172.21.15.37:0/3363877236 learned_addr learned my addr 172.21.15.37:0/3363877236 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a37fe640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a3fff640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 -- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 msgr2=0x7f81a415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 -- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 msgr2=0x7f81a415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 -- 172.21.15.37:0/3363877236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980094d0 con 0x7f81a40cf290 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a3fff640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a2ffd640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f819800e9d0 tx=0x7f819800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800ca60 con 0x7f81a40cf290 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800cbc0 con 0x7f81a40cf290 2023-07-09T22:01:14.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198013470 con 0x7f81a40cf290 2023-07-09T22:01:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c009a70 con 0x7f81a40cf290 2023-07-09T22:01:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.193+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a415b320 con 0x7f81a40cf290 2023-07-09T22:01:14.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a415b4e0 con 0x7f81a40cf290 2023-07-09T22:01:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f81980135d0 con 0x7f81a40cf290 2023-07-09T22:01:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f818bfff640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 0x7f8190068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f8198084140 con 0x7f81a40cf290 2023-07-09T22:01:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f81a37fe640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 0x7f8190068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.197+0000 7f81a37fe640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 0x7f8190068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8194000f70 tx=0x7f8194007ba0 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.201+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8198051480 con 0x7f81a40cf290 2023-07-09T22:01:14.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.357+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f81a404d7d0 con 0x7f81a40cf290 2023-07-09T22:01:14.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f818bfff640 1 -- 172.21.15.37:0/3363877236 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v62) v1 ==== 120+0+0 (secure 0 0 0) 0x7f8198054aa0 con 0x7f81a40cf290 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 msgr2=0x7f8190068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 0x7f8190068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8194000f70 tx=0x7f8194007ba0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 msgr2=0x7f81a41521e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f819800e9d0 tx=0x7f819800ee90 comp rx=0 tx=0).stop 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 shutdown_connections 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81900663a0 0x7f8190068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81a40d0780 0x7f81a415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40cf290 0x7f81a41521e0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 --2- 172.21.15.37:0/3363877236 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81a40b7980 0x7f81a415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 >> 172.21.15.37:0/3363877236 conn(0x7f81a4073090 msgr2=0x7f81a415f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 shutdown_connections 2023-07-09T22:01:14.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.361+0000 7f81a9f40640 1 -- 172.21.15.37:0/3363877236 wait complete. 2023-07-09T22:01:14.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T22:01:14.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.525+0000 7f7a116ca640 1 Processor -- start 2023-07-09T22:01:14.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.525+0000 7f7a116ca640 1 -- start start 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a116ca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f7a0c0b7980 0x7f7a0c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a116ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f7a0c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a116ca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0c15bf80 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a116ca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0c0cd070 con 0x7f7a0c0b7980 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a116ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0cfd70 con 0x7f7a0c0ceb80 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7a0c0b3c20 0x7f7a0c0b4080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47952/0 (socket says 172.21.15.37:47952) 2023-07-09T22:01:14.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/2539943142 learned_addr learned my addr 172.21.15.37:0/2539943142 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0affd640 1 --2- 172.21.15.37:0/2539943142 >> v2:172.21.15.119:3300/0 conn(0x7f7a0c0b7980 0x7f7a0c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a03fff640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f7a0c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531955938 0 0) 0x7f7a040014a0 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f8003530 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551593111 0 0) 0x7f79f8003530 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 msgr2=0x7f7a0c0cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:14.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f7a0c0cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 >> v2:172.21.15.119:3300/0 conn(0x7f7a0c0b7980 msgr2=0x7f7a0c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 --2- 172.21.15.37:0/2539943142 >> v2:172.21.15.119:3300/0 conn(0x7f7a0c0b7980 0x7f7a0c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c160570 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7a04001b90 con 0x7f7a0c0b3c20 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 >> v1:172.21.15.37:6789/0 conn(0x7f7a0c0b3c20 legacy=0x7f7a0c0b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8003980 0x7f79f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f79f80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8004d10 0x7f79f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0cd070 con 0x7f79f8004d10 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0cfd70 con 0x7f79f8003980 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f800b990 con 0x7f7a0c0ceb80 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8004d10 0x7f79f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a03fff640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f79f80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0affd640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8003980 0x7f79f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 msgr2=0x7f79f80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0ceb80 0x7f79f80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8003980 msgr2=0x7f79f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8003980 0x7f79f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.529+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/2539943142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f8003530 con 0x7f79f8004d10 2023-07-09T22:01:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8004d10 0x7f79f8005180 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400a830 tx=0x7f7a0401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee985752ecd7ee4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040ad630 con 0x7f79f8004d10 2023-07-09T22:01:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a040a8070 con 0x7f79f8004d10 2023-07-09T22:01:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a0a7fc640 1 -- 172.21.15.37:0/2539943142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040ad9f0 con 0x7f79f8004d10 2023-07-09T22:01:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 -- 172.21.15.37:0/2539943142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8004d10 msgr2=0x7f79f8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 --2- 172.21.15.37:0/2539943142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79f8004d10 0x7f79f8005180 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7a0400a830 tx=0x7f7a0401d360 comp rx=0 tx=0).stop 2023-07-09T22:01:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/2539943142 reap_dead start 2023-07-09T22:01:14.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 -- 172.21.15.37:0/2539943142 shutdown_connections 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 -- 172.21.15.37:0/2539943142 >> 172.21.15.37:0/2539943142 conn(0x7f7a0c073090 msgr2=0x7f7a0c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 -- 172.21.15.37:0/2539943142 shutdown_connections 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.533+0000 7f7a116ca640 1 -- 172.21.15.37:0/2539943142 wait complete. 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 Processor -- start 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- start start 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8004d10 0x7f7a0c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0b0650 0x7f7a0c159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0b0ac0 con 0x7f7a0c0b6270 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0b6c20 con 0x7f79f8004d10 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0c0c9c80 con 0x7f7a0c0b0650 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49930/0 (socket says 172.21.15.37:49930) 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/3461575733 learned_addr learned my addr 172.21.15.37:0/3461575733 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8004d10 0x7f7a0c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a03fff640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0b0650 0x7f7a0c159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0b0650 msgr2=0x7f7a0c159500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0b0650 0x7f7a0c159500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8004d10 msgr2=0x7f7a0c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8004d10 0x7f7a0c0cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 -- 172.21.15.37:0/3461575733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0c9ed0 con 0x7f7a0c0b6270 2023-07-09T22:01:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a0b7fe640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f7a04098d80 tx=0x7f79f8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040ad630 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a040ad790 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a040adb00 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0c0c5d70 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0c0c6330 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.537+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0c04d7d0 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.541+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7a040aa030 con 0x7f7a0c0b6270 2023-07-09T22:01:14.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.541+0000 7f7a037fe640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 0x7f79ec068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.541+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f7a0411d860 con 0x7f7a0c0b6270 2023-07-09T22:01:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.541+0000 7f7a0affd640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 0x7f79ec068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.541+0000 7f7a0affd640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 0x7f79ec068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009bc0 tx=0x7f79fc009190 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.545+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a040eab30 con 0x7f7a0c0b6270 2023-07-09T22:01:14.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.705+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7f7a0c15d100 con 0x7f7a0c0b6270 2023-07-09T22:01:14.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.709+0000 7f7a037fe640 1 -- 172.21.15.37:0/3461575733 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v63) v1 ==== 115+0+0 (secure 0 0 0) 0x7f7a0c15d100 con 0x7f7a0c0b6270 2023-07-09T22:01:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 msgr2=0x7f79ec068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 0x7f79ec068880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009bc0 tx=0x7f79fc009190 comp rx=0 tx=0).stop 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 msgr2=0x7f7a0c0b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f7a04098d80 tx=0x7f79f8005800 comp rx=0 tx=0).stop 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 shutdown_connections 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f79ec0663d0 0x7f79ec068880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7a0c0b6270 0x7f7a0c0b66e0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7a0c0b0650 0x7f7a0c159500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 --2- 172.21.15.37:0/3461575733 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f79f8004d10 0x7f7a0c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 >> 172.21.15.37:0/3461575733 conn(0x7f7a0c073090 msgr2=0x7f7a0c15b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 shutdown_connections 2023-07-09T22:01:14.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.713+0000 7f7a116ca640 1 -- 172.21.15.37:0/3461575733 wait complete. 2023-07-09T22:01:14.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention' 2023-07-09T22:01:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.873+0000 7f044b3fa640 1 Processor -- start 2023-07-09T22:01:14.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.873+0000 7f044b3fa640 1 -- start start 2023-07-09T22:01:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f044b3fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04440cef80 0x7f044406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f044b3fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440b49f0 con 0x7f04440b7ab0 2023-07-09T22:01:14.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f044b3fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04440cc8a0 con 0x7f04440b4340 2023-07-09T22:01:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f044b3fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04440b7e80 con 0x7f04440cef80 2023-07-09T22:01:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449196640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f04440b7ab0 0x7f04440b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47958/0 (socket says 172.21.15.37:47958) 2023-07-09T22:01:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449196640 1 -- 172.21.15.37:0/2196085497 learned_addr learned my addr 172.21.15.37:0/2196085497 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:14.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449997640 1 --2- 172.21.15.37:0/2196085497 >> v2:172.21.15.37:3300/0 conn(0x7f04440cef80 0x7f044406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f043bfff640 1 -- 172.21.15.37:0/2196085497 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1354336940 0 0) 0x7f04440b49f0 con 0x7f04440b7ab0 2023-07-09T22:01:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f043bfff640 1 -- 172.21.15.37:0/2196085497 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0430003530 con 0x7f04440b7ab0 2023-07-09T22:01:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449997640 1 -- 172.21.15.37:0/2196085497 >> v1:172.21.15.119:6789/0 conn(0x7f04440b4340 legacy=0x7f04440d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449997640 1 -- 172.21.15.37:0/2196085497 >> v1:172.21.15.37:6789/0 conn(0x7f04440b7ab0 legacy=0x7f04440b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449997640 1 -- 172.21.15.37:0/2196085497 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04440ccb80 con 0x7f04440cef80 2023-07-09T22:01:14.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.877+0000 7f0449997640 1 --2- 172.21.15.37:0/2196085497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cef80 0x7f044406aa50 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f043c009d90 tx=0x7f043c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe6ff110d4f3621 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f043bfff640 1 -- 172.21.15.37:0/2196085497 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0a59e0 con 0x7f04440cef80 2023-07-09T22:01:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f043bfff640 1 -- 172.21.15.37:0/2196085497 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043c0a5b40 con 0x7f04440cef80 2023-07-09T22:01:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f043bfff640 1 -- 172.21.15.37:0/2196085497 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043c0ad440 con 0x7f04440cef80 2023-07-09T22:01:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- 172.21.15.37:0/2196085497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cef80 msgr2=0x7f044406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 --2- 172.21.15.37:0/2196085497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cef80 0x7f044406aa50 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f043c009d90 tx=0x7f043c01c920 comp rx=0 tx=0).stop 2023-07-09T22:01:14.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- 172.21.15.37:0/2196085497 shutdown_connections 2023-07-09T22:01:14.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 --2- 172.21.15.37:0/2196085497 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440cef80 0x7f044406aa50 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- 172.21.15.37:0/2196085497 >> 172.21.15.37:0/2196085497 conn(0x7f0444073090 msgr2=0x7f0444069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:14.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- 172.21.15.37:0/2196085497 shutdown_connections 2023-07-09T22:01:14.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- 172.21.15.37:0/2196085497 wait complete. 2023-07-09T22:01:14.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 Processor -- start 2023-07-09T22:01:14.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- start start 2023-07-09T22:01:14.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04440b7ab0 0x7f04440b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 0x7f04441f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440b2c80 con 0x7f04440b4340 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04440b2f60 con 0x7f04440b7ab0 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f044b3fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04440b3240 con 0x7f04440cef80 2023-07-09T22:01:14.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f0449196640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f0449196640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49940/0 (socket says 172.21.15.37:49940) 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f0449196640 1 -- 172.21.15.37:0/4187700851 learned_addr learned my addr 172.21.15.37:0/4187700851 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.881+0000 7f0448995640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04440b7ab0 0x7f04440b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449997640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 0x7f04441f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 -- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 msgr2=0x7f04441f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 0x7f04441f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 -- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04440b7ab0 msgr2=0x7f04440b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04440b7ab0 0x7f04440b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 -- 172.21.15.37:0/4187700851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c009a70 con 0x7f04440b4340 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449997640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 0x7f04441f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0449196640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f044000c4d0 tx=0x7f044000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440005cf0 con 0x7f04440b4340 2023-07-09T22:01:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0440005e50 con 0x7f04440b4340 2023-07-09T22:01:14.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0440007270 con 0x7f04440b4340 2023-07-09T22:01:14.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04440b28c0 con 0x7f04440b4340 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04440b63f0 con 0x7f04440b4340 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0444139fa0 con 0x7f04440b4340 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f04400073d0 con 0x7f04440b4340 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.885+0000 7f0439ffb640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 0x7f0428068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.889+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f04400833e0 con 0x7f04440b4340 2023-07-09T22:01:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.889+0000 7f0448995640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 0x7f0428068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.889+0000 7f0448995640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 0x7f0428068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04440b6760 tx=0x7f0434009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:14.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:14.889+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0444139fa0 con 0x7f04440b4340 2023-07-09T22:01:15.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.101+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]} v 0) v1 -- 0x7f0444139fa0 con 0x7f04440b4340 2023-07-09T22:01:15.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.657+0000 7f0439ffb640 1 -- 172.21.15.37:0/4187700851 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_snap_schedule_with_retention"]}]=0 v1383) v1 ==== 163+0+0 (secure 0 0 0) 0x7f0444139fa0 con 0x7f04440b4340 2023-07-09T22:01:15.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 msgr2=0x7f0428068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 0x7f0428068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f04440b6760 tx=0x7f0434009040 comp rx=0 tx=0).stop 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 msgr2=0x7f04440b2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f044000c4d0 tx=0x7f044000c990 comp rx=0 tx=0).stop 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 shutdown_connections 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f04280663a0 0x7f0428068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f04440cef80 0x7f04441f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f04440b7ab0 0x7f04440b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 --2- 172.21.15.37:0/4187700851 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04440b4340 0x7f04440b2380 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 >> 172.21.15.37:0/4187700851 conn(0x7f0444073090 msgr2=0x7f04440d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 shutdown_connections 2023-07-09T22:01:15.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.661+0000 7f044b3fa640 1 -- 172.21.15.37:0/4187700851 wait complete. 2023-07-09T22:01:15.688 INFO:tasks.cephfs_test_runner:Test scheduled snapshots along with rentention policy ... ok 2023-07-09T22:01:15.689 INFO:tasks.cephfs_test_runner:Starting test: test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) Test the correctness of snap directory name 2023-07-09T22:01:15.689 INFO:tasks.cephfs_test_runner:test_snap_dir_name (tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir) 2023-07-09T22:01:15.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-09T22:01:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 Processor -- start 2023-07-09T22:01:15.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 -- start start 2023-07-09T22:01:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f81780b4340 0x7f817806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 0x7f81780d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81780b49f0 con 0x7f81780b7ab0 2023-07-09T22:01:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780b7e80 con 0x7f81780b4340 2023-07-09T22:01:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817d234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81780cc8a0 con 0x7f81780cef80 2023-07-09T22:01:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f8176d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f81780b7ab0 0x7f81780b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:47964/0 (socket says 172.21.15.37:47964) 2023-07-09T22:01:15.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f8176d9d640 1 -- 172.21.15.37:0/2098568879 learned_addr learned my addr 172.21.15.37:0/2098568879 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f816ffff640 1 --2- 172.21.15.37:0/2098568879 >> v2:172.21.15.119:3300/0 conn(0x7f81780b4340 0x7f817806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817759e640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 0x7f81780d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1556282463 0 0) 0x7f81780b49f0 con 0x7f81780b7ab0 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8164003530 con 0x7f81780b7ab0 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f816ffff640 1 -- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 msgr2=0x7f81780d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:15.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f816ffff640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 0x7f81780d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040152198 0 0) 0x7f8164003530 con 0x7f81780b7ab0 2023-07-09T22:01:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f816ffff640 1 -- 172.21.15.37:0/2098568879 >> v1:172.21.15.37:6789/0 conn(0x7f81780b7ab0 legacy=0x7f81780b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f816ffff640 1 -- 172.21.15.37:0/2098568879 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780ccb80 con 0x7f81780b4340 2023-07-09T22:01:15.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.833+0000 7f817759e640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 0x7f81780d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f816ffff640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b4340 0x7f817806aa50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f81600097c0 tx=0x7f816001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a6db66ce81237ec server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168001680 con 0x7f81780b4340 2023-07-09T22:01:15.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81600a7050 con 0x7f81780b4340 2023-07-09T22:01:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817659c640 1 -- 172.21.15.37:0/2098568879 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81600ab620 con 0x7f81780b4340 2023-07-09T22:01:15.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 -- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b4340 msgr2=0x7f817806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b4340 0x7f817806aa50 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f81600097c0 tx=0x7f816001c370 comp rx=0 tx=0).stop 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 -- 172.21.15.37:0/2098568879 shutdown_connections 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780cef80 0x7f81780d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 --2- 172.21.15.37:0/2098568879 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b4340 0x7f817806aa50 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 -- 172.21.15.37:0/2098568879 >> 172.21.15.37:0/2098568879 conn(0x7f8178073090 msgr2=0x7f8178069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 -- 172.21.15.37:0/2098568879 shutdown_connections 2023-07-09T22:01:15.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.837+0000 7f817d234640 1 -- 172.21.15.37:0/2098568879 wait complete. 2023-07-09T22:01:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 Processor -- start 2023-07-09T22:01:15.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- start start 2023-07-09T22:01:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780b4340 0x7f8178148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b7ab0 0x7f8178149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178149b40 con 0x7f81780cef80 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8178149e20 con 0x7f81780b7ab0 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817814a100 con 0x7f81780b4340 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49950/0 (socket says 172.21.15.37:49950) 2023-07-09T22:01:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 -- 172.21.15.37:0/3502942829 learned_addr learned my addr 172.21.15.37:0/3502942829 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f816ffff640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b7ab0 0x7f8178149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f8176d9d640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780b4340 0x7f8178148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 -- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780b4340 msgr2=0x7f8178148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780b4340 0x7f8178148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 -- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b7ab0 msgr2=0x7f8178149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b7ab0 0x7f8178149160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 -- 172.21.15.37:0/3502942829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170009a70 con 0x7f81780cef80 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817759e640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f817000efb0 tx=0x7f817000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170014480 con 0x7f81780cef80 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000f040 con 0x7f81780cef80 2023-07-09T22:01:15.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170014800 con 0x7f81780cef80 2023-07-09T22:01:15.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8160009420 con 0x7f81780cef80 2023-07-09T22:01:15.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.841+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8178152060 con 0x7f81780cef80 2023-07-09T22:01:15.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81780b6ec0 con 0x7f81780cef80 2023-07-09T22:01:15.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f8170014960 con 0x7f81780cef80 2023-07-09T22:01:15.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f816f7fe640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 0x7f8158068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:15.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f8170084f90 con 0x7f81780cef80 2023-07-09T22:01:15.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f8176d9d640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 0x7f8158068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:15.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.845+0000 7f8176d9d640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 0x7f8158068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8168001ec0 tx=0x7f8168001a60 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:15.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:15.849+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8170052140 con 0x7f81780cef80 2023-07-09T22:01:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.061+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f817808b130 con 0x7f81780cef80 2023-07-09T22:01:16.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f816f7fe640 1 -- 172.21.15.37:0/3502942829 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1384) v1 ==== 158+0+0 (secure 0 0 0) 0x7f8170055760 con 0x7f81780cef80 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 msgr2=0x7f8158068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 0x7f8158068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8168001ec0 tx=0x7f8168001a60 comp rx=0 tx=0).stop 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 msgr2=0x7f8178154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f817000efb0 tx=0x7f817000c490 comp rx=0 tx=0).stop 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 shutdown_connections 2023-07-09T22:01:16.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f81580663a0 0x7f8158068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81780cef80 0x7f8178154e90 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f81780b7ab0 0x7f8178149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 --2- 172.21.15.37:0/3502942829 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f81780b4340 0x7f8178148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 >> 172.21.15.37:0/3502942829 conn(0x7f8178073090 msgr2=0x7f8178069dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 shutdown_connections 2023-07-09T22:01:16.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.661+0000 7f817d234640 1 -- 172.21.15.37:0/3502942829 wait complete. 2023-07-09T22:01:16.691 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-07-09T22:01:16.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 Processor -- start 2023-07-09T22:01:16.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 -- start start 2023-07-09T22:01:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b7980 0x7fc478160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc4780ceb80 0x7fc4780cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4780b3c20 0x7fc4780b4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780cd070 con 0x7fc4780b3c20 2023-07-09T22:01:16.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780cfd70 con 0x7fc4780ceb80 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc47d60b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47815bf80 con 0x7fc4780b7980 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4780b3c20 0x7fc4780b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc4780b3c20 0x7fc4780b4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49964/0 (socket says 172.21.15.37:49964) 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 -- 172.21.15.37:0/1968381323 learned_addr learned my addr 172.21.15.37:0/1968381323 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc476ffd640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b7980 0x7fc478160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4767fc640 1 --2- 172.21.15.37:0/1968381323 >> v2:172.21.15.119:3300/0 conn(0x7fc4780ceb80 0x7fc4780cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 -- 172.21.15.37:0/1968381323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b7980 msgr2=0x7fc478160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:16.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b7980 0x7fc478160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 -- 172.21.15.37:0/1968381323 >> v2:172.21.15.119:3300/0 conn(0x7fc4780ceb80 msgr2=0x7fc4780cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:16.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 --2- 172.21.15.37:0/1968381323 >> v2:172.21.15.119:3300/0 conn(0x7fc4780ceb80 0x7fc4780cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.837+0000 7fc4777fe640 1 -- 172.21.15.37:0/1968381323 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478160570 con 0x7fc4780b3c20 2023-07-09T22:01:16.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc4777fe640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b3c20 0x7fc4780b4080 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc4780b4ca0 tx=0x7fc47001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174d3364bd9de3c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc475ffb640 1 -- 172.21.15.37:0/1968381323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a5650 con 0x7fc4780b3c20 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc475ffb640 1 -- 172.21.15.37:0/1968381323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700a57b0 con 0x7fc4780b3c20 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc475ffb640 1 -- 172.21.15.37:0/1968381323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a5b40 con 0x7fc4780b3c20 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- 172.21.15.37:0/1968381323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b3c20 msgr2=0x7fc4780b4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b3c20 0x7fc4780b4080 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7fc4780b4ca0 tx=0x7fc47001c9d0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- 172.21.15.37:0/1968381323 shutdown_connections 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b3c20 0x7fc4780b4080 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 --2- 172.21.15.37:0/1968381323 >> v2:172.21.15.119:3300/0 conn(0x7fc4780ceb80 0x7fc4780cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 --2- 172.21.15.37:0/1968381323 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b7980 0x7fc478160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- 172.21.15.37:0/1968381323 >> 172.21.15.37:0/1968381323 conn(0x7fc478073090 msgr2=0x7fc478069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- 172.21.15.37:0/1968381323 shutdown_connections 2023-07-09T22:01:16.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- 172.21.15.37:0/1968381323 wait complete. 2023-07-09T22:01:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 Processor -- start 2023-07-09T22:01:16.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.841+0000 7fc47d60b640 1 -- start start 2023-07-09T22:01:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 0x7fc478152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4780ceb80 0x7fc478159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478150720 con 0x7fc4780b7980 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478152950 con 0x7fc4780ceb80 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780d20e0 con 0x7fc4780b3c20 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49974/0 (socket says 172.21.15.37:49974) 2023-07-09T22:01:16.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 -- 172.21.15.37:0/407219291 learned_addr learned my addr 172.21.15.37:0/407219291 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc476ffd640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 0x7fc478152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4777fe640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4780ceb80 0x7fc478159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 -- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 msgr2=0x7fc478152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 0x7fc478152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 -- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4780ceb80 msgr2=0x7fc478159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4780ceb80 0x7fc478159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:16.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 -- 172.21.15.37:0/407219291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009b30 con 0x7fc4780b7980 2023-07-09T22:01:16.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc476ffd640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 0x7fc478152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:16.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc4767fc640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d800 tx=0x7fc46c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00b6c0 con 0x7fc4780b7980 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c00b820 con 0x7fc4780b7980 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c00bb90 con 0x7fc4780b7980 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4780d23c0 con 0x7fc4780b7980 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc478150930 con 0x7fc4780b7980 2023-07-09T22:01:16.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.845+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47804d7d0 con 0x7fc4780b7980 2023-07-09T22:01:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.849+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc46c00bcf0 con 0x7fc4780b7980 2023-07-09T22:01:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.849+0000 7fc45f7fe640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 0x7fc464068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.849+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7fc46c084290 con 0x7fc4780b7980 2023-07-09T22:01:16.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.849+0000 7fc476ffd640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 0x7fc464068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:16.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.849+0000 7fc476ffd640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 0x7fc464068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc46800b9f0 tx=0x7fc468008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:16.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:16.853+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc46c0550e0 con 0x7fc4780b7980 2023-07-09T22:01:17.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.005+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4780b1600 con 0x7fc4780b7980 2023-07-09T22:01:17.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc45f7fe640 1 -- 172.21.15.37:0/407219291 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v64)=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc46c054c70 con 0x7fc4780b7980 2023-07-09T22:01:17.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 msgr2=0x7fc464068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 0x7fc464068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc46800b9f0 tx=0x7fc468008040 comp rx=0 tx=0).stop 2023-07-09T22:01:17.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 msgr2=0x7fc47814f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00d800 tx=0x7fc46c00dcc0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 shutdown_connections 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc4640663a0 0x7fc464068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc4780ceb80 0x7fc478159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4780b7980 0x7fc47814f440 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 --2- 172.21.15.37:0/407219291 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc4780b3c20 0x7fc478152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 >> 172.21.15.37:0/407219291 conn(0x7fc478073090 msgr2=0x7fc4781552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 shutdown_connections 2023-07-09T22:01:17.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.013+0000 7fc47d60b640 1 -- 172.21.15.37:0/407219291 wait complete. 2023-07-09T22:01:17.039 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T22:01:17.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:17.095 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:17.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T22:01:17.164 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:17.164 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:17.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:01:17.173 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:17.174 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:17.183 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:17.184 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:17.184 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:17.224 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:01:17.225 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:17.225 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:17.234 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:17.235 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-07-09T22:01:17.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 Processor -- start 2023-07-09T22:01:17.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 -- start start 2023-07-09T22:01:17.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa015bbf0 0x7f5fa00d1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5fa006bc30 0x7f5fa00ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fa00b1650 0x7f5fa00cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00d1380 con 0x7f5fa00b1650 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00b13e0 con 0x7f5fa006bc30 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9f59e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa002bbe0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fa00b1650 0x7f5fa00cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fa00b1650 0x7f5fa00cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44946/0 (socket says 172.21.15.37:44946) 2023-07-09T22:01:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/2350404387 learned_addr learned my addr 172.21.15.37:0/2350404387 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f97fff640 1 --2- 172.21.15.37:0/2350404387 >> v2:172.21.15.119:3300/0 conn(0x7f5fa006bc30 0x7f5fa00ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9e59c640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa015bbf0 0x7f5fa00d1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/2350404387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa015bbf0 msgr2=0x7f5fa00d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa015bbf0 0x7f5fa00d1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/2350404387 >> v2:172.21.15.119:3300/0 conn(0x7f5fa006bc30 msgr2=0x7f5fa00ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/2350404387 >> v2:172.21.15.119:3300/0 conn(0x7f5fa006bc30 0x7f5fa00ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.409+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/2350404387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa00b1100 con 0x7f5fa00b1650 2023-07-09T22:01:17.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa00b1650 0x7f5fa00cef30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009e50 tx=0x7f5f9801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12e2951567f68fe server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9dd9b640 1 -- 172.21.15.37:0/2350404387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980a5740 con 0x7f5fa00b1650 2023-07-09T22:01:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9dd9b640 1 -- 172.21.15.37:0/2350404387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980a58a0 con 0x7f5fa00b1650 2023-07-09T22:01:17.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9dd9b640 1 -- 172.21.15.37:0/2350404387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980a5c30 con 0x7f5fa00b1650 2023-07-09T22:01:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 -- 172.21.15.37:0/2350404387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa00b1650 msgr2=0x7f5fa00cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa00b1650 0x7f5fa00cef30 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f5f98009e50 tx=0x7f5f9801c9a0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 -- 172.21.15.37:0/2350404387 shutdown_connections 2023-07-09T22:01:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa00b1650 0x7f5fa00cef30 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/2350404387 >> v2:172.21.15.119:3300/0 conn(0x7f5fa006bc30 0x7f5fa00ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/2350404387 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa015bbf0 0x7f5fa00d1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 -- 172.21.15.37:0/2350404387 >> 172.21.15.37:0/2350404387 conn(0x7f5fa002b640 msgr2=0x7f5fa00d2060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 -- 172.21.15.37:0/2350404387 shutdown_connections 2023-07-09T22:01:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.413+0000 7f5f9f59e640 1 -- 172.21.15.37:0/2350404387 wait complete. 2023-07-09T22:01:17.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 Processor -- start 2023-07-09T22:01:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- start start 2023-07-09T22:01:17.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa006bc30 0x7f5fa00cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fa00b1650 0x7f5fa00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa0152eb0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00cb960 con 0x7f5fa00b1650 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00cbc40 con 0x7f5fa006bc30 2023-07-09T22:01:17.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44956/0 (socket says 172.21.15.37:44956) 2023-07-09T22:01:17.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/1752552877 learned_addr learned my addr 172.21.15.37:0/1752552877 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9e59c640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa006bc30 0x7f5fa00cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f97fff640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fa00b1650 0x7f5fa00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa006bc30 msgr2=0x7f5fa00cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa006bc30 0x7f5fa00cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fa00b1650 msgr2=0x7f5fa00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fa00b1650 0x7f5fa00c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 -- 172.21.15.37:0/1752552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009b30 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9ed9d640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f5f9801b050 tx=0x7f5f98019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980b8670 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980b87f0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa01530c0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980b8ba0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.417+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa00cb600 con 0x7f5fa015bbf0 2023-07-09T22:01:17.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa006b020 con 0x7f5fa015bbf0 2023-07-09T22:01:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5f980b8d00 con 0x7f5fa015bbf0 2023-07-09T22:01:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f96ffd640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 0x7f5f80068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f5f9811f2b0 con 0x7f5fa015bbf0 2023-07-09T22:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f9e59c640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 0x7f5f80068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.421+0000 7f5f9e59c640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 0x7f5f80068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009ac0 tx=0x7f5f90009190 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.425+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5f980ec720 con 0x7f5fa015bbf0 2023-07-09T22:01:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.609+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa00cbe00 con 0x7f5fa015bbf0 2023-07-09T22:01:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.609+0000 7f5f96ffd640 1 -- 172.21.15.37:0/1752552877 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+3530 (secure 0 0 0) 0x7f5f98009510 con 0x7f5fa015bbf0 2023-07-09T22:01:17.617 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:17.617 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":78,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8351,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6835/2349253614","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":2349253614},{"type":"v1","addr":"172.21.15.119:6835","nonce":2349253614}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9637,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/47815005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":47815005},{"type":"v1","addr":"172.21.15.37:6833","nonce":47815005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":9649,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/3648939358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6836","nonce":3648939358},{"type":"v1","addr":"172.21.15.119:6837","nonce":3648939358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":10677,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2773822953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2773822953},{"type":"v1","addr":"172.21.15.37:6835","nonce":2773822953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":78}],"filesystems":[]} 2023-07-09T22:01:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 78 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 msgr2=0x7f5f80068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 0x7f5f80068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009ac0 tx=0x7f5f90009190 comp rx=0 tx=0).stop 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 msgr2=0x7f5fa00cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f5f9801b050 tx=0x7f5f98019740 comp rx=0 tx=0).stop 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 shutdown_connections 2023-07-09T22:01:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5f800663d0 0x7f5f80068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fa015bbf0 0x7f5fa00cd280 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5fa00b1650 0x7f5fa00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 --2- 172.21.15.37:0/1752552877 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5fa006bc30 0x7f5fa00cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 >> 172.21.15.37:0/1752552877 conn(0x7f5fa002b640 msgr2=0x7f5fa00b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 shutdown_connections 2023-07-09T22:01:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.613+0000 7f5f9f59e640 1 -- 172.21.15.37:0/1752552877 wait complete. 2023-07-09T22:01:17.638 INFO:tasks.ceph.mds.a:Restarting daemon 2023-07-09T22:01:17.638 INFO:tasks.ceph.mds.a:Stopping old one... 2023-07-09T22:01:17.639 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T22:01:17.639 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:01:17.639 INFO:tasks.ceph.mds.c:Restarting daemon 2023-07-09T22:01:17.640 INFO:tasks.ceph.mds.c:Stopping old one... 2023-07-09T22:01:17.640 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T22:01:17.640 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:01:17.640 INFO:tasks.ceph.mds.b:Restarting daemon 2023-07-09T22:01:17.641 INFO:tasks.ceph.mds.b:Stopping old one... 2023-07-09T22:01:17.641 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T22:01:17.641 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:01:17.641 INFO:tasks.ceph.mds.d:Restarting daemon 2023-07-09T22:01:17.642 INFO:tasks.ceph.mds.d:Stopping old one... 2023-07-09T22:01:17.642 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T22:01:17.642 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:01:17.651 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T22:01:17.651 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-07-09T22:01:17.652 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T22:01:17.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-07-09T22:01:17.656 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T22:01:17.656 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-07-09T22:01:17.657 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T22:01:17.658 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-07-09T22:01:17.699 INFO:tasks.ceph.mds.c:Started 2023-07-09T22:01:17.700 DEBUG:teuthology.parallel:result is None 2023-07-09T22:01:17.702 INFO:tasks.ceph.mds.a:Started 2023-07-09T22:01:17.702 DEBUG:teuthology.parallel:result is None 2023-07-09T22:01:17.703 INFO:tasks.ceph.mds.b:Started 2023-07-09T22:01:17.703 DEBUG:teuthology.parallel:result is None 2023-07-09T22:01:17.706 INFO:tasks.ceph.mds.d:Started 2023-07-09T22:01:17.707 DEBUG:teuthology.parallel:result is None 2023-07-09T22:01:17.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-07-09T22:01:17.787 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-07-09T22:01:17.788 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T22:01:17.796 INFO:tasks.ceph.mds.b.smithi119.stdout:starting mds.b at 2023-07-09T22:01:17.796 INFO:tasks.ceph.mds.d.smithi119.stdout:starting mds.d at 2023-07-09T22:01:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.849+0000 7f90b460b640 1 Processor -- start 2023-07-09T22:01:17.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.849+0000 7f90b460b640 1 -- start start 2023-07-09T22:01:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b460b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 0x7f90ac0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b460b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac0cef80 con 0x7f90ac0b47a0 2023-07-09T22:01:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b460b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ac0cf260 con 0x7f90ac0b4310 2023-07-09T22:01:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b460b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac0cf540 con 0x7f90ac0b7a60 2023-07-09T22:01:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b1ba6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f90ac0b47a0 0x7f90ac0b3c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49044/0 (socket says 172.21.15.37:49044) 2023-07-09T22:01:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b1ba6640 1 -- 172.21.15.37:0/2216088316 learned_addr learned my addr 172.21.15.37:0/2216088316 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:17.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b23a7640 1 --2- 172.21.15.37:0/2216088316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 0x7f90ac0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614052339 0 0) 0x7f90ac0cef80 con 0x7f90ac0b47a0 2023-07-09T22:01:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9098003530 con 0x7f90ac0b47a0 2023-07-09T22:01:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983446007 0 0) 0x7f90ac0cf260 con 0x7f90ac0b4310 2023-07-09T22:01:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90ac0cef80 con 0x7f90ac0b4310 2023-07-09T22:01:17.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b23a7640 1 -- 172.21.15.37:0/2216088316 >> v1:172.21.15.119:6789/0 conn(0x7f90ac0b4310 legacy=0x7f90ac0d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b23a7640 1 -- 172.21.15.37:0/2216088316 >> v1:172.21.15.37:6789/0 conn(0x7f90ac0b47a0 legacy=0x7f90ac0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.853+0000 7f90b23a7640 1 -- 172.21.15.37:0/2216088316 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ac0cfdf0 con 0x7f90ac0b7a60 2023-07-09T22:01:17.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b23a7640 1 --2- 172.21.15.37:0/2216088316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 0x7f90ac0cc7d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90a80097f0 tx=0x7f90a801c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=694e3baf7929c37e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80ab600 con 0x7f90ac0b7a60 2023-07-09T22:01:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a80a7050 con 0x7f90ac0b7a60 2023-07-09T22:01:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b13a5640 1 -- 172.21.15.37:0/2216088316 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80ab980 con 0x7f90ac0b7a60 2023-07-09T22:01:17.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- 172.21.15.37:0/2216088316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 msgr2=0x7f90ac0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 --2- 172.21.15.37:0/2216088316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 0x7f90ac0cc7d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90a80097f0 tx=0x7f90a801c4c0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- 172.21.15.37:0/2216088316 shutdown_connections 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 --2- 172.21.15.37:0/2216088316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b7a60 0x7f90ac0cc7d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- 172.21.15.37:0/2216088316 >> 172.21.15.37:0/2216088316 conn(0x7f90ac073050 msgr2=0x7f90ac069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- 172.21.15.37:0/2216088316 shutdown_connections 2023-07-09T22:01:17.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- 172.21.15.37:0/2216088316 wait complete. 2023-07-09T22:01:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 Processor -- start 2023-07-09T22:01:17.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.857+0000 7f90b460b640 1 -- start start 2023-07-09T22:01:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b4310 0x7f90ac15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 0x7f90ac152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac151460 con 0x7f90ac0b7a60 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac15ea50 con 0x7f90ac0b47a0 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ac15e1b0 con 0x7f90ac0b4310 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44994/0 (socket says 172.21.15.37:44994) 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 -- 172.21.15.37:0/1577522920 learned_addr learned my addr 172.21.15.37:0/1577522920 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b1ba6640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 0x7f90ac152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b23a7640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b4310 0x7f90ac15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 -- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b4310 msgr2=0x7f90ac15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b4310 0x7f90ac15dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 -- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 msgr2=0x7f90ac152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:17.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 0x7f90ac152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 -- 172.21.15.37:0/1577522920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009420 con 0x7f90ac0b7a60 2023-07-09T22:01:17.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b1ba6640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 0x7f90ac152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b2ba8640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c6c0 tx=0x7f90a400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4003b80 con 0x7f90ac0b7a60 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a4003ce0 con 0x7f90ac0b7a60 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40052f0 con 0x7f90ac0b7a60 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ac15e490 con 0x7f90ac0b7a60 2023-07-09T22:01:17.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ac1534f0 con 0x7f90ac0b7a60 2023-07-09T22:01:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.861+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ac0cdaa0 con 0x7f90ac0b7a60 2023-07-09T22:01:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.865+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f90a4005450 con 0x7f90ac0b7a60 2023-07-09T22:01:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.865+0000 7f90a2ffd640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 0x7f9090068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:17.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.865+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 6126+0+0 (secure 0 0 0) 0x7f90a4083c20 con 0x7f90ac0b7a60 2023-07-09T22:01:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.865+0000 7f90b23a7640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 0x7f9090068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:17.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.865+0000 7f90b23a7640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 0x7f9090068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90a80ad000 tx=0x7f90a80a6000 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:17.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:17.869+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f90a4050f50 con 0x7f90ac0b7a60 2023-07-09T22:01:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:18.037+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f90ac1515a0 con 0x7f90ac0b7a60 2023-07-09T22:01:19.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90a2ffd640 1 -- 172.21.15.37:0/1577522920 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v192) v1 ==== 97+0+0 (secure 0 0 0) 0x7f90ac1515a0 con 0x7f90ac0b7a60 2023-07-09T22:01:19.042 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-07-09T22:01:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 msgr2=0x7f9090068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 0x7f9090068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f90a80ad000 tx=0x7f90a80a6000 comp rx=0 tx=0).stop 2023-07-09T22:01:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 msgr2=0x7f90ac158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c6c0 tx=0x7f90a400cb80 comp rx=0 tx=0).stop 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 shutdown_connections 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90900663a0 0x7f9090068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f90ac0b7a60 0x7f90ac158730 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f90ac0b47a0 0x7f90ac152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 --2- 172.21.15.37:0/1577522920 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f90ac0b4310 0x7f90ac15dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.037+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 >> 172.21.15.37:0/1577522920 conn(0x7f90ac073050 msgr2=0x7f90ac0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.041+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 shutdown_connections 2023-07-09T22:01:19.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.041+0000 7f90b460b640 1 -- 172.21.15.37:0/1577522920 wait complete. 2023-07-09T22:01:19.068 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-07-09T22:01:19.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 Processor -- start 2023-07-09T22:01:19.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 -- start start 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4415fce0 0x7f2d440c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2d441600b0 0x7f2d44163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440c9df0 0x7f2d440af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440cd080 con 0x7f2d440c9df0 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440cd920 con 0x7f2d441600b0 2023-07-09T22:01:19.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.209+0000 7f2d4b7e2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440ca2f0 con 0x7f2d4415fce0 2023-07-09T22:01:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440c9df0 0x7f2d440af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d440c9df0 0x7f2d440af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45000/0 (socket says 172.21.15.37:45000) 2023-07-09T22:01:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 -- 172.21.15.37:0/2197790701 learned_addr learned my addr 172.21.15.37:0/2197790701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:19.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d4957e640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4415fce0 0x7f2d440c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d48d7d640 1 --2- 172.21.15.37:0/2197790701 >> v2:172.21.15.119:3300/0 conn(0x7f2d441600b0 0x7f2d44163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 -- 172.21.15.37:0/2197790701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4415fce0 msgr2=0x7f2d440c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4415fce0 0x7f2d440c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 -- 172.21.15.37:0/2197790701 >> v2:172.21.15.119:3300/0 conn(0x7f2d441600b0 msgr2=0x7f2d44163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 --2- 172.21.15.37:0/2197790701 >> v2:172.21.15.119:3300/0 conn(0x7f2d441600b0 0x7f2d44163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 -- 172.21.15.37:0/2197790701 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440cd2d0 con 0x7f2d440c9df0 2023-07-09T22:01:19.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d49d7f640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440af830 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f2d44071700 tx=0x7f2d3c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b82cdc5c34837 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d3bfff640 1 -- 172.21.15.37:0/2197790701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0a56a0 con 0x7f2d440c9df0 2023-07-09T22:01:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d3bfff640 1 -- 172.21.15.37:0/2197790701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c0a5800 con 0x7f2d440c9df0 2023-07-09T22:01:19.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.213+0000 7f2d3bfff640 1 -- 172.21.15.37:0/2197790701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0a5b90 con 0x7f2d440c9df0 2023-07-09T22:01:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2197790701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 msgr2=0x7f2d440af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440af830 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f2d44071700 tx=0x7f2d3c01c910 comp rx=0 tx=0).stop 2023-07-09T22:01:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2197790701 shutdown_connections 2023-07-09T22:01:19.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440af830 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2197790701 >> v2:172.21.15.119:3300/0 conn(0x7f2d441600b0 0x7f2d44163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2197790701 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4415fce0 0x7f2d440c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2197790701 >> 172.21.15.37:0/2197790701 conn(0x7f2d440ca830 msgr2=0x7f2d440cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2197790701 shutdown_connections 2023-07-09T22:01:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2197790701 wait complete. 2023-07-09T22:01:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 Processor -- start 2023-07-09T22:01:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- start start 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4415fce0 0x7f2d440cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 0x7f2d440b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440b2700 con 0x7f2d440c9df0 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4406bda0 con 0x7f2d4415fce0 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4b7e2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44158040 con 0x7f2d4406b800 2023-07-09T22:01:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4957e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4957e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45008/0 (socket says 172.21.15.37:45008) 2023-07-09T22:01:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d4957e640 1 -- 172.21.15.37:0/2556399445 learned_addr learned my addr 172.21.15.37:0/2556399445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d48d7d640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4415fce0 0x7f2d440cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.217+0000 7f2d49d7f640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 0x7f2d440b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 -- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 msgr2=0x7f2d440b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 0x7f2d440b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 -- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4415fce0 msgr2=0x7f2d440cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4415fce0 0x7f2d440cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 -- 172.21.15.37:0/2556399445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009b30 con 0x7f2d440c9df0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d49d7f640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 0x7f2d440b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4957e640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d800 tx=0x7f2d4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000b6c0 con 0x7f2d440c9df0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4000b820 con 0x7f2d440c9df0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000bb90 con 0x7f2d440c9df0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d441582e0 con 0x7f2d440c9df0 2023-07-09T22:01:19.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d441585c0 con 0x7f2d440c9df0 2023-07-09T22:01:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4404d7d0 con 0x7f2d440c9df0 2023-07-09T22:01:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2d4000bcf0 con 0x7f2d440c9df0 2023-07-09T22:01:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 0x7f2d28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.221+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f2d40084080 con 0x7f2d440c9df0 2023-07-09T22:01:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.225+0000 7f2d48d7d640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 0x7f2d28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.225+0000 7f2d48d7d640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 0x7f2d28068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d440c4dc0 tx=0x7f2d34008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.225+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d400b4700 con 0x7f2d440c9df0 2023-07-09T22:01:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2d440b24d0 con 0x7f2d440c9df0 2023-07-09T22:01:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d39ffb640 1 -- 172.21.15.37:0/2556399445 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v31) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2d40055180 con 0x7f2d440c9df0 2023-07-09T22:01:19.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:19.440 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:01:19.440 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-07-09T22:01:19.440 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.440 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-07-09T22:01:19.440 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkm0TKExAApBJavwzdM7jVEnP6NvXPCw==", 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.441 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQHSHIBAA3H+4U+ufhRzQ0CIGbpg+3w==", 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T22:01:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-07-09T22:01:19.443 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKsVgGxAA47HLM6QWrQuN0mTqU0qNVA==", 2023-07-09T22:01:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T22:01:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T22:01:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKOINKBAATN531hJfyrMI+jtt9kKSYA==", 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.445 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-07-09T22:01:19.446 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDeJKtkbOsFCRAA8ZhnKrzzuEj6Z0Q3qlDHgg==", 2023-07-09T22:01:19.447 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.447 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.448 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.448 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.448 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.449 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.449 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.449 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDhJKtkEro1EBAAenKfd5WgWkEZsBbYrXxV0Q==", 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.450 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDkJKtksFxJGBAAyHfNBqwk0jk37K2OpVpkzQ==", 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.451 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-07-09T22:01:19.452 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDnJKtkK3HdHhAAwait+NRp3JmPJVUiluC9vA==", 2023-07-09T22:01:19.453 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.453 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.454 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.454 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.454 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.454 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.455 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-07-09T22:01:19.455 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDtJKtkDgvtJRAAoUEO0BFXaO7P481B7COJpQ==", 2023-07-09T22:01:19.455 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.455 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.456 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDwJKtk7azuLBAApi3tKvfiw/ioujEkopfXHA==", 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.457 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDzJKtkqVQzMxAAK7IabgviCokHnNfTi21B5g==", 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQD2JKtkqEzVORAAhtwqAhbBIuoYHkmA1OyqGw==", 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.459 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-07-09T22:01:19.460 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A==", 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow r", 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.461 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkPucaNhAA8wjoxAbQIXEcCoj/ERi2qg==", 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T22:01:19.462 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkQTZfMhAATqBRrM0aoIpnRASeEyviaw==", 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.463 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDbJKtkVsTOABAAQ8vHkryLjb/JFa+7pbc61Q==", 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-07-09T22:01:19.465 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDZJKtk03XHMhAAwAANykATfxU16bMKUZdXEA==", 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.466 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.467 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.468 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-07-09T22:01:19.468 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtkKUwnDxAA3KKbCfW4QqPJHbJ4/Bm3BA==", 2023-07-09T22:01:19.468 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.468 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T22:01:19.469 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T22:01:19.469 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.469 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.469 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQDaJKtk6RA1CxAAjY3vkwYtvfHXhjncEtmLTg==", 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-07-09T22:01:19.470 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-07-09T22:01:19.471 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-07-09T22:01:19.471 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.471 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:19.471 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-07-09T22:01:19.471 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:01:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 msgr2=0x7f2d28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 0x7f2d28068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2d440c4dc0 tx=0x7f2d34008040 comp rx=0 tx=0).stop 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 msgr2=0x7f2d440b0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f2d4000d800 tx=0x7f2d4000dcc0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.433+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 shutdown_connections 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2d280663a0 0x7f2d28068850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2d4406b800 0x7f2d440b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2d4415fce0 0x7f2d440cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 --2- 172.21.15.37:0/2556399445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d440c9df0 0x7f2d440b0be0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 >> 172.21.15.37:0/2556399445 conn(0x7f2d440ca830 msgr2=0x7f2d4415f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 shutdown_connections 2023-07-09T22:01:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.437+0000 7f2d4b7e2640 1 -- 172.21.15.37:0/2556399445 wait complete. 2023-07-09T22:01:19.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.613+0000 7f23f4eec640 1 Processor -- start 2023-07-09T22:01:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.613+0000 7f23f4eec640 1 -- start start 2023-07-09T22:01:19.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23f4eec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23f00b7ab0 0x7f23f006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23f4eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b4340 0x7f23f00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23f4eec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f00b49f0 con 0x7f23f00cef80 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23f4eec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00b7e80 con 0x7f23f00b7ab0 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23f4eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00cc8a0 con 0x7f23f00b4340 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23f00b7ab0 0x7f23f006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f23f00b7ab0 0x7f23f006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45022/0 (socket says 172.21.15.37:45022) 2023-07-09T22:01:19.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 -- 172.21.15.37:0/2123510775 learned_addr learned my addr 172.21.15.37:0/2123510775 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:19.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23eed9d640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b4340 0x7f23f00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 -- 172.21.15.37:0/2123510775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b4340 msgr2=0x7f23f00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b4340 0x7f23f00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 -- 172.21.15.37:0/2123510775 >> v1:172.21.15.119:6789/0 conn(0x7f23f00cef80 legacy=0x7f23f00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.617+0000 7f23ee59c640 1 -- 172.21.15.37:0/2123510775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00ccb80 con 0x7f23f00b7ab0 2023-07-09T22:01:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23ee59c640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00b7ab0 0x7f23f006aa50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009870 tx=0x7f23e001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c6c2c81f24b8c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23ed59a640 1 -- 172.21.15.37:0/2123510775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e00aa670 con 0x7f23f00b7ab0 2023-07-09T22:01:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23ed59a640 1 -- 172.21.15.37:0/2123510775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e00aa7d0 con 0x7f23f00b7ab0 2023-07-09T22:01:19.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23ed59a640 1 -- 172.21.15.37:0/2123510775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e00aab60 con 0x7f23f00b7ab0 2023-07-09T22:01:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- 172.21.15.37:0/2123510775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00b7ab0 msgr2=0x7f23f006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00b7ab0 0x7f23f006aa50 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f23e0009870 tx=0x7f23e001c510 comp rx=0 tx=0).stop 2023-07-09T22:01:19.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- 172.21.15.37:0/2123510775 shutdown_connections 2023-07-09T22:01:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b4340 0x7f23f00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- 172.21.15.37:0/2123510775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00b7ab0 0x7f23f006aa50 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- 172.21.15.37:0/2123510775 >> 172.21.15.37:0/2123510775 conn(0x7f23f0073090 msgr2=0x7f23f0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- 172.21.15.37:0/2123510775 shutdown_connections 2023-07-09T22:01:19.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- 172.21.15.37:0/2123510775 wait complete. 2023-07-09T22:01:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 Processor -- start 2023-07-09T22:01:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- start start 2023-07-09T22:01:19.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 0x7f23f014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 0x7f23f00c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c8350 con 0x7f23f00cef80 2023-07-09T22:01:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00c8630 con 0x7f23f00b4340 2023-07-09T22:01:19.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.621+0000 7f23f4eec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00b51a0 con 0x7f23f00b7ab0 2023-07-09T22:01:19.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45038/0 (socket says 172.21.15.37:45038) 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 -- 172.21.15.37:0/3854449205 learned_addr learned my addr 172.21.15.37:0/3854449205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23ee59c640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 0x7f23f014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23edd9b640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 0x7f23f00c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 -- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 msgr2=0x7f23f00c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 0x7f23f00c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 -- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 msgr2=0x7f23f014d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 0x7f23f014d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 -- 172.21.15.37:0/3854449205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00094d0 con 0x7f23f00cef80 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23ee59c640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 0x7f23f014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23edd9b640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 0x7f23f00c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23eed9d640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f23e8007e30 tx=0x7f23e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e8014620 con 0x7f23f00cef80 2023-07-09T22:01:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e800ee90 con 0x7f23f00cef80 2023-07-09T22:01:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f00b5480 con 0x7f23f00cef80 2023-07-09T22:01:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e80149c0 con 0x7f23f00cef80 2023-07-09T22:01:19.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f00c7f90 con 0x7f23f00cef80 2023-07-09T22:01:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f00b56c0 con 0x7f23f00cef80 2023-07-09T22:01:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.625+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f23e8014b20 con 0x7f23f00cef80 2023-07-09T22:01:19.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.629+0000 7f23deffd640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 0x7f23d0068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.629+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f23e80844a0 con 0x7f23f00cef80 2023-07-09T22:01:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.629+0000 7f23ee59c640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 0x7f23d0068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.629+0000 7f23ee59c640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 0x7f23d0068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ae000 tx=0x7f23e0008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.629+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23f00b56c0 con 0x7f23f00cef80 2023-07-09T22:01:19.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.789+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23f00b56c0 con 0x7f23f00cef80 2023-07-09T22:01:19.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.789+0000 7f23deffd640 1 -- 172.21.15.37:0/3854449205 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v192) v1 ==== 74+0+14727 (secure 0 0 0) 0x7f23f00b56c0 con 0x7f23f00cef80 2023-07-09T22:01:19.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:19.796 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":192,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:19.036213+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":174,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 msgr2=0x7f23d0068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 0x7f23d0068880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f23e00ae000 tx=0x7f23e0008040 comp rx=0 tx=0).stop 2023-07-09T22:01:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 msgr2=0x7f23f00b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f23e8007e30 tx=0x7f23e800e4b0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 shutdown_connections 2023-07-09T22:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f23d00663d0 0x7f23d0068880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23f00cef80 0x7f23f00b24b0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f23f00b7ab0 0x7f23f00c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 --2- 172.21.15.37:0/3854449205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f23f00b4340 0x7f23f014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 >> 172.21.15.37:0/3854449205 conn(0x7f23f0073090 msgr2=0x7f23f00d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 shutdown_connections 2023-07-09T22:01:19.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.793+0000 7f23f4eec640 1 -- 172.21.15.37:0/3854449205 wait complete. 2023-07-09T22:01:19.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:19.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 Processor -- start 2023-07-09T22:01:19.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 -- start start 2023-07-09T22:01:19.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1f3c0cf290 0x7f1f3c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c0d0780 0x7f1f3c0d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3c15bf80 con 0x7f1f3c0b7980 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cd070 con 0x7f1f3c0cf290 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f4287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cfd70 con 0x7f1f3c0d0780 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1f3c0b7980 0x7f1f3c0ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49048/0 (socket says 172.21.15.37:49048) 2023-07-09T22:01:19.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3bfff640 1 -- 172.21.15.37:0/2405138776 learned_addr learned my addr 172.21.15.37:0/2405138776 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c0d0780 0x7f1f3c0d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3b7fe640 1 --2- 172.21.15.37:0/2405138776 >> v2:172.21.15.119:3300/0 conn(0x7f1f3c0cf290 0x7f1f3c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3914159481 0 0) 0x7f1f2c001120 con 0x7f1f3c0b7980 2023-07-09T22:01:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f24003530 con 0x7f1f3c0b7980 2023-07-09T22:01:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163368669 0 0) 0x7f1f24003530 con 0x7f1f3c0b7980 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c0d0780 msgr2=0x7f1f3c0d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c0d0780 0x7f1f3c0d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 >> v2:172.21.15.119:3300/0 conn(0x7f1f3c0cf290 msgr2=0x7f1f3c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 --2- 172.21.15.37:0/2405138776 >> v2:172.21.15.119:3300/0 conn(0x7f1f3c0cf290 0x7f1f3c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c160570 con 0x7f1f3c0b7980 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1f2c001810 con 0x7f1f3c0b7980 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 >> v1:172.21.15.37:6789/0 conn(0x7f1f3c0b7980 legacy=0x7f1f3c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f24003980 0x7f1f24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f24004360 0x7f1f24004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f24004ea0 0x7f1f2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cd070 con 0x7f1f24004ea0 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0cfd70 con 0x7f1f24004360 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f2400bed0 con 0x7f1f24003980 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c0d0780 0x7f1f3c0d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f24004ea0 0x7f1f2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3bfff640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f24003980 0x7f1f24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f3b7fe640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f24004360 0x7f1f24004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 -- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f24003980 msgr2=0x7f1f24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f24003980 0x7f1f24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 -- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f24004360 msgr2=0x7f1f24004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f24004360 0x7f1f24004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.961+0000 7f1f40e18640 1 -- 172.21.15.37:0/2405138776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f24003530 con 0x7f1f24004ea0 2023-07-09T22:01:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f40e18640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f24004ea0 0x7f1f2400b990 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0d0b50 tx=0x7f1f3401cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244b9494aae198f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34003c60 con 0x7f1f24004ea0 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3400f040 con 0x7f1f24004ea0 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f3affd640 1 -- 172.21.15.37:0/2405138776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340a56c0 con 0x7f1f24004ea0 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 -- 172.21.15.37:0/2405138776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f24004ea0 msgr2=0x7f1f2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 --2- 172.21.15.37:0/2405138776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f24004ea0 0x7f1f2400b990 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0d0b50 tx=0x7f1f3401cd00 comp rx=0 tx=0).stop 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f40e18640 1 -- 172.21.15.37:0/2405138776 reap_dead start 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 -- 172.21.15.37:0/2405138776 shutdown_connections 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 -- 172.21.15.37:0/2405138776 >> 172.21.15.37:0/2405138776 conn(0x7f1f3c073090 msgr2=0x7f1f3c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:19.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 -- 172.21.15.37:0/2405138776 shutdown_connections 2023-07-09T22:01:19.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.965+0000 7f1f4287b640 1 -- 172.21.15.37:0/2405138776 wait complete. 2023-07-09T22:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 Processor -- start 2023-07-09T22:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- start start 2023-07-09T22:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f3c0b42f0 0x7f1f3c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c15e8d0 0x7f1f3c1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c15ed40 con 0x7f1f3c1538f0 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c153cc0 con 0x7f1f3c0b42f0 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c0b2790 con 0x7f1f3c15e8d0 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45058/0 (socket says 172.21.15.37:45058) 2023-07-09T22:01:19.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 -- 172.21.15.37:0/541245778 learned_addr learned my addr 172.21.15.37:0/541245778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3b7fe640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f3c0b42f0 0x7f1f3c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f40e18640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c15e8d0 0x7f1f3c1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 -- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c15e8d0 msgr2=0x7f1f3c1f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c15e8d0 0x7f1f3c1f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 -- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f3c0b42f0 msgr2=0x7f1f3c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f3c0b42f0 0x7f1f3c15e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 -- 172.21.15.37:0/541245778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0b2a70 con 0x7f1f3c1538f0 2023-07-09T22:01:19.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f3bfff640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007310 tx=0x7f1f2c004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00f9c0 con 0x7f1f3c1538f0 2023-07-09T22:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00fb20 con 0x7f1f3c1538f0 2023-07-09T22:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00feb0 con 0x7f1f3c1538f0 2023-07-09T22:01:19.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f3c0b2d50 con 0x7f1f3c1538f0 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.969+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3c0b4930 con 0x7f1f3c1538f0 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3c0b2500 con 0x7f1f3c1538f0 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1f2c01d460 con 0x7f1f3c1538f0 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f38ff9640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f1f2c083a50 con 0x7f1f3c1538f0 2023-07-09T22:01:19.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f3b7fe640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:19.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.973+0000 7f1f3b7fe640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 0x7f1f28068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0b2050 tx=0x7f1f30008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:19.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:19.977+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f2c051030 con 0x7f1f3c1538f0 2023-07-09T22:01:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1f3c15bf80 con 0x7f1f3c1538f0 2023-07-09T22:01:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f38ff9640 1 -- 172.21.15.37:0/541245778 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v192) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f3c15bf80 con 0x7f1f3c1538f0 2023-07-09T22:01:20.139 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 msgr2=0x7f1f28068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 0x7f1f28068850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c0b2050 tx=0x7f1f30008040 comp rx=0 tx=0).stop 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 msgr2=0x7f1f3c0c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c007310 tx=0x7f1f2c004f90 comp rx=0 tx=0).stop 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 shutdown_connections 2023-07-09T22:01:20.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1f280663a0 0x7f1f28068850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1f3c15e8d0 0x7f1f3c1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1f3c0b42f0 0x7f1f3c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 --2- 172.21.15.37:0/541245778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f3c1538f0 0x7f1f3c0c6750 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 >> 172.21.15.37:0/541245778 conn(0x7f1f3c073090 msgr2=0x7f1f3c0ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 shutdown_connections 2023-07-09T22:01:20.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.133+0000 7f1f4287b640 1 -- 172.21.15.37:0/541245778 wait complete. 2023-07-09T22:01:20.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:20.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.297+0000 7f19101db640 1 Processor -- start 2023-07-09T22:01:20.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.297+0000 7f19101db640 1 -- start start 2023-07-09T22:01:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f19101db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19080b7980 0x7f1908160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f19101db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 0x7f19080cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f19101db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190815bf80 con 0x7f19080b3c20 2023-07-09T22:01:20.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f19101db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19080cd070 con 0x7f19080b7980 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f19101db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080cfd70 con 0x7f19080ceb80 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19080b7980 0x7f1908160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f19080b7980 0x7f1908160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45062/0 (socket says 172.21.15.37:45062) 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 -- 172.21.15.37:0/1319751156 learned_addr learned my addr 172.21.15.37:0/1319751156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190d776640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 0x7f19080cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 -- 172.21.15.37:0/1319751156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 msgr2=0x7f19080cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:20.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 0x7f19080cef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 -- 172.21.15.37:0/1319751156 >> v1:172.21.15.119:6789/0 conn(0x7f19080b3c20 legacy=0x7f19080b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190df77640 1 -- 172.21.15.37:0/1319751156 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1908160570 con 0x7f19080b7980 2023-07-09T22:01:20.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.301+0000 7f190d776640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 0x7f19080cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f190df77640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f1908160030 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1904009870 tx=0x7f190401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e516a9f2d1a3a6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f190cf75640 1 -- 172.21.15.37:0/1319751156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19040ab600 con 0x7f19080b7980 2023-07-09T22:01:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f190cf75640 1 -- 172.21.15.37:0/1319751156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19040a7050 con 0x7f19080b7980 2023-07-09T22:01:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f190cf75640 1 -- 172.21.15.37:0/1319751156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19040ab980 con 0x7f19080b7980 2023-07-09T22:01:20.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- 172.21.15.37:0/1319751156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 msgr2=0x7f1908160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f1908160030 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f1904009870 tx=0x7f190401c540 comp rx=0 tx=0).stop 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- 172.21.15.37:0/1319751156 shutdown_connections 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080ceb80 0x7f19080cef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 --2- 172.21.15.37:0/1319751156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f1908160030 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- 172.21.15.37:0/1319751156 >> 172.21.15.37:0/1319751156 conn(0x7f1908073090 msgr2=0x7f1908069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- 172.21.15.37:0/1319751156 shutdown_connections 2023-07-09T22:01:20.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- 172.21.15.37:0/1319751156 wait complete. 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 Processor -- start 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.305+0000 7f19101db640 1 -- start start 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 0x7f19080c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19080ceb80 0x7f19080c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080c84f0 con 0x7f19080b7980 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19080c9de0 con 0x7f19080ceb80 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19080ca0c0 con 0x7f19080b3c20 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45064/0 (socket says 172.21.15.37:45064) 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 -- 172.21.15.37:0/1555349644 learned_addr learned my addr 172.21.15.37:0/1555349644 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190df77640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 0x7f19080c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190e778640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19080ceb80 0x7f19080c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 -- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 msgr2=0x7f19080c7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 0x7f19080c7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 -- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19080ceb80 msgr2=0x7f19080c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19080ceb80 0x7f19080c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 -- 172.21.15.37:0/1555349644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19040094d0 con 0x7f19080b7980 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190df77640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 0x7f19080c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f190d776640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f18f800e810 tx=0x7f18f800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800c8d0 con 0x7f19080b7980 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f800ca30 con 0x7f19080b7980 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f800cde0 con 0x7f19080b7980 2023-07-09T22:01:20.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19080ca3a0 con 0x7f19080b7980 2023-07-09T22:01:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19080ca960 con 0x7f19080b7980 2023-07-09T22:01:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f190804d7d0 con 0x7f19080b7980 2023-07-09T22:01:20.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.309+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f18f8013410 con 0x7f19080b7980 2023-07-09T22:01:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.313+0000 7f18fe7fc640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.313+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7f18f8083b40 con 0x7f19080b7980 2023-07-09T22:01:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.313+0000 7f190df77640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.313+0000 7f190df77640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 0x7f18ec068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f190808ad30 tx=0x7f1904008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.317+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18f8051010 con 0x7f19080b7980 2023-07-09T22:01:20.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f190806a800 con 0x7f19080b7980 2023-07-09T22:01:20.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f18fe7fc640 1 -- 172.21.15.37:0/1555349644 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v192) v1 ==== 92+0+10 (secure 0 0 0) 0x7f18f8054630 con 0x7f19080b7980 2023-07-09T22:01:20.479 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 msgr2=0x7f18ec068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 0x7f18ec068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f190808ad30 tx=0x7f1904008040 comp rx=0 tx=0).stop 2023-07-09T22:01:20.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 msgr2=0x7f19080c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f18f800e810 tx=0x7f18f800ecd0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 shutdown_connections 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18ec0663a0 0x7f18ec068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f19080ceb80 0x7f19080c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19080b7980 0x7f19080c9270 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 --2- 172.21.15.37:0/1555349644 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f19080b3c20 0x7f19080c7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 >> 172.21.15.37:0/1555349644 conn(0x7f1908073090 msgr2=0x7f190815b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 shutdown_connections 2023-07-09T22:01:20.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.473+0000 7f19101db640 1 -- 172.21.15.37:0/1555349644 wait complete. 2023-07-09T22:01:20.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-09T22:01:20.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.637+0000 7fc2786d8640 1 Processor -- start 2023-07-09T22:01:20.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.637+0000 7fc2786d8640 1 -- start start 2023-07-09T22:01:20.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc2786d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b4340 0x7fc27006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc2786d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc2700cef80 0x7fc2700d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc2786d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2700b49f0 con 0x7fc2700b7ab0 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc2786d8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2700b7e80 con 0x7fc2700cef80 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc2786d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700cc8a0 con 0x7fc2700b4340 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276474640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc2700b7ab0 0x7fc2700b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49060/0 (socket says 172.21.15.37:49060) 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276474640 1 -- 172.21.15.37:0/3446817207 learned_addr learned my addr 172.21.15.37:0/3446817207 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:20.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276c75640 1 --2- 172.21.15.37:0/3446817207 >> v2:172.21.15.37:3300/0 conn(0x7fc2700cef80 0x7fc2700d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc275c73640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b4340 0x7fc27006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276c75640 1 -- 172.21.15.37:0/3446817207 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b4340 msgr2=0x7fc27006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:20.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276c75640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b4340 0x7fc27006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276c75640 1 -- 172.21.15.37:0/3446817207 >> v1:172.21.15.37:6789/0 conn(0x7fc2700b7ab0 legacy=0x7fc2700b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.641+0000 7fc276c75640 1 -- 172.21.15.37:0/3446817207 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2700ccb80 con 0x7fc2700cef80 2023-07-09T22:01:20.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc276c75640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700d02a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4708db7c14b5d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc275472640 1 -- 172.21.15.37:0/3446817207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680a59e0 con 0x7fc2700cef80 2023-07-09T22:01:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc275472640 1 -- 172.21.15.37:0/3446817207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680a5b40 con 0x7fc2700cef80 2023-07-09T22:01:20.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc275472640 1 -- 172.21.15.37:0/3446817207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680ad440 con 0x7fc2700cef80 2023-07-09T22:01:20.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- 172.21.15.37:0/3446817207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 msgr2=0x7fc2700d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700d02a0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fc268009d90 tx=0x7fc26801c920 comp rx=0 tx=0).stop 2023-07-09T22:01:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- 172.21.15.37:0/3446817207 shutdown_connections 2023-07-09T22:01:20.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700d02a0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- 172.21.15.37:0/3446817207 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b4340 0x7fc27006aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- 172.21.15.37:0/3446817207 >> 172.21.15.37:0/3446817207 conn(0x7fc270073090 msgr2=0x7fc270069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- 172.21.15.37:0/3446817207 shutdown_connections 2023-07-09T22:01:20.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- 172.21.15.37:0/3446817207 wait complete. 2023-07-09T22:01:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 Processor -- start 2023-07-09T22:01:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 -- start start 2023-07-09T22:01:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2700b4340 0x7fc270157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b7ab0 0x7fc2700c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.645+0000 7fc2786d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700c7de0 con 0x7fc2700cef80 2023-07-09T22:01:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc270157ed0 con 0x7fc2700b4340 2023-07-09T22:01:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2700c7b00 con 0x7fc2700b7ab0 2023-07-09T22:01:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45080/0 (socket says 172.21.15.37:45080) 2023-07-09T22:01:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 -- 172.21.15.37:0/1999223511 learned_addr learned my addr 172.21.15.37:0/1999223511 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc275c73640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b7ab0 0x7fc2700c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276474640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2700b4340 0x7fc270157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 -- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b7ab0 msgr2=0x7fc2700c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b7ab0 0x7fc2700c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 -- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2700b4340 msgr2=0x7fc270157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2700b4340 0x7fc270157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 -- 172.21.15.37:0/1999223511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc268009a70 con 0x7fc2700cef80 2023-07-09T22:01:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc276c75640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fc2680b0040 tx=0x7fc2680196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680add90 con 0x7fc2700cef80 2023-07-09T22:01:20.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc268009450 con 0x7fc2700cef80 2023-07-09T22:01:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680b9690 con 0x7fc2700cef80 2023-07-09T22:01:20.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2700ca8f0 con 0x7fc2700cef80 2023-07-09T22:01:20.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2700caeb0 con 0x7fc2700cef80 2023-07-09T22:01:20.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2700cb0a0 con 0x7fc2700cef80 2023-07-09T22:01:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.649+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc2680b97f0 con 0x7fc2700cef80 2023-07-09T22:01:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.653+0000 7fc266ffd640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 0x7fc254068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.653+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7fc26811f290 con 0x7fc2700cef80 2023-07-09T22:01:20.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.653+0000 7fc276474640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 0x7fc254068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.653+0000 7fc276474640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 0x7fc254068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005890 tx=0x7fc26c009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.657+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc2680ec9a0 con 0x7fc2700cef80 2023-07-09T22:01:20.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.813+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc27004d7d0 con 0x7fc2700cef80 2023-07-09T22:01:20.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.813+0000 7fc266ffd640 1 -- 172.21.15.37:0/1999223511 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v192) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc2680effc0 con 0x7fc2700cef80 2023-07-09T22:01:20.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:20.821 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 2, 2023-07-09T22:01:20.822 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": "rbd" 2023-07-09T22:01:20.822 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:20.822 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T22:01:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 msgr2=0x7fc254068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 0x7fc254068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc26c005890 tx=0x7fc26c009040 comp rx=0 tx=0).stop 2023-07-09T22:01:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 msgr2=0x7fc2700cb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fc2680b0040 tx=0x7fc2680196c0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 shutdown_connections 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc2540663a0 0x7fc254068850 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2700cef80 0x7fc2700cb3d0 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc2700b7ab0 0x7fc2700c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 --2- 172.21.15.37:0/1999223511 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc2700b4340 0x7fc270157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 >> 172.21.15.37:0/1999223511 conn(0x7fc270073090 msgr2=0x7fc2700b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 shutdown_connections 2023-07-09T22:01:20.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.817+0000 7fc2786d8640 1 -- 172.21.15.37:0/1999223511 wait complete. 2023-07-09T22:01:20.841 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-09T22:01:20.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-09T22:01:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.981+0000 7fd2a747b640 1 Processor -- start 2023-07-09T22:01:20.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.981+0000 7fd2a747b640 1 -- start start 2023-07-09T22:01:20.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a747b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd2a00b7980 0x7fd2a0160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a747b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2a00d0780 0x7fd2a00d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a747b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a015bf80 con 0x7fd2a00ceb80 2023-07-09T22:01:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a747b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00cd070 con 0x7fd2a00d0780 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a747b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a00cfd70 con 0x7fd2a00b7980 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2a00d0780 0x7fd2a00d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2a00d0780 0x7fd2a00d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45094/0 (socket says 172.21.15.37:45094) 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2469693864 learned_addr learned my addr 172.21.15.37:0/2469693864 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5217640 1 --2- 172.21.15.37:0/2469693864 >> v2:172.21.15.119:3300/0 conn(0x7fd2a00b7980 0x7fd2a0160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2469693864 >> v2:172.21.15.119:3300/0 conn(0x7fd2a00b7980 msgr2=0x7fd2a0160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:20.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 --2- 172.21.15.37:0/2469693864 >> v2:172.21.15.119:3300/0 conn(0x7fd2a00b7980 0x7fd2a0160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2469693864 >> v1:172.21.15.37:6789/0 conn(0x7fd2a00ceb80 legacy=0x7fd2a00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.985+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2469693864 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a0160570 con 0x7fd2a00d0780 2023-07-09T22:01:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a5a18640 1 --2- 172.21.15.37:0/2469693864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00d0b80 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0069aa0 tx=0x7fd29801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe505c16225df901 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd297fff640 1 -- 172.21.15.37:0/2469693864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980a5690 con 0x7fd2a00d0780 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd297fff640 1 -- 172.21.15.37:0/2469693864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2980a57f0 con 0x7fd2a00d0780 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd297fff640 1 -- 172.21.15.37:0/2469693864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980a5b80 con 0x7fd2a00d0780 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- 172.21.15.37:0/2469693864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 msgr2=0x7fd2a00d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2469693864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00d0b80 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fd2a0069aa0 tx=0x7fd29801c9d0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- 172.21.15.37:0/2469693864 shutdown_connections 2023-07-09T22:01:20.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2469693864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00d0b80 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2469693864 >> v2:172.21.15.119:3300/0 conn(0x7fd2a00b7980 0x7fd2a0160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- 172.21.15.37:0/2469693864 >> 172.21.15.37:0/2469693864 conn(0x7fd2a0073090 msgr2=0x7fd2a0069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- 172.21.15.37:0/2469693864 shutdown_connections 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- 172.21.15.37:0/2469693864 wait complete. 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 Processor -- start 2023-07-09T22:01:20.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- start start 2023-07-09T22:01:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 0x7fd2a00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a00ceb80 0x7fd2a01525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:20.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a01545f0 con 0x7fd2a00d0780 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00cb6c0 con 0x7fd2a00ceb80 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a747b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00cb9a0 con 0x7fd2a00b7980 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.989+0000 7fd2a5a18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45108/0 (socket says 172.21.15.37:45108) 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2785682816 learned_addr learned my addr 172.21.15.37:0/2785682816 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:21.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a4a16640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a00ceb80 0x7fd2a01525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5217640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 0x7fd2a00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 msgr2=0x7fd2a00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 0x7fd2a00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a00ceb80 msgr2=0x7fd2a01525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a00ceb80 0x7fd2a01525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 -- 172.21.15.37:0/2785682816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd298009b30 con 0x7fd2a00d0780 2023-07-09T22:01:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5217640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 0x7fd2a00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a5a18640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fd2980af040 tx=0x7fd298019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:21.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980a5690 con 0x7fd2a00d0780 2023-07-09T22:01:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2980b8880 con 0x7fd2a00d0780 2023-07-09T22:01:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980b8c30 con 0x7fd2a00d0780 2023-07-09T22:01:21.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00cbc80 con 0x7fd2a00d0780 2023-07-09T22:01:21.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a0152ae0 con 0x7fd2a00d0780 2023-07-09T22:01:21.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a00cc1a0 con 0x7fd2a00d0780 2023-07-09T22:01:21.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.993+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd2980b6440 con 0x7fd2a00d0780 2023-07-09T22:01:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.997+0000 7fd295ffb640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 0x7fd284068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.997+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5266+0+0 (secure 0 0 0) 0x7fd29811eff0 con 0x7fd2a00d0780 2023-07-09T22:01:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.997+0000 7fd2a5217640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 0x7fd284068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.997+0000 7fd2a5217640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 0x7fd284068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00b0fe0 tx=0x7fd29c008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:21.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:20.997+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd2a00cc1a0 con 0x7fd2a00d0780 2023-07-09T22:01:21.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.153+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd2a0160570 con 0x7fd2a00d0780 2023-07-09T22:01:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.681+0000 7fd295ffb640 1 -- 172.21.15.37:0/2785682816 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v193) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd2a0160570 con 0x7fd2a00d0780 2023-07-09T22:01:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-07-09T22:01:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 msgr2=0x7fd284068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 0x7fd284068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00b0fe0 tx=0x7fd29c008040 comp rx=0 tx=0).stop 2023-07-09T22:01:21.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 msgr2=0x7fd2a00b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fd2980af040 tx=0x7fd298019770 comp rx=0 tx=0).stop 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 shutdown_connections 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fd2840663a0 0x7fd284068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2a00d0780 0x7fd2a00b3de0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd2a00ceb80 0x7fd2a01525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 --2- 172.21.15.37:0/2785682816 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd2a00b7980 0x7fd2a00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 >> 172.21.15.37:0/2785682816 conn(0x7fd2a0073090 msgr2=0x7fd2a00d2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 shutdown_connections 2023-07-09T22:01:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.685+0000 7fd2a747b640 1 -- 172.21.15.37:0/2785682816 wait complete. 2023-07-09T22:01:21.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-09T22:01:21.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 Processor -- start 2023-07-09T22:01:21.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 -- start start 2023-07-09T22:01:21.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f53980b7980 0x7f5398160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53980d0780 0x7f53980d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539815bf80 con 0x7f53980ceb80 2023-07-09T22:01:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980cd070 con 0x7f53980d0780 2023-07-09T22:01:21.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.861+0000 7f539d53a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53980cfd70 con 0x7f53980b7980 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53980d0780 0x7f53980d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53980d0780 0x7f53980d0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45116/0 (socket says 172.21.15.37:45116) 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 -- 172.21.15.37:0/1026752436 learned_addr learned my addr 172.21.15.37:0/1026752436 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f5396ffd640 1 --2- 172.21.15.37:0/1026752436 >> v2:172.21.15.119:3300/0 conn(0x7f53980b7980 0x7f5398160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 -- 172.21.15.37:0/1026752436 >> v2:172.21.15.119:3300/0 conn(0x7f53980b7980 msgr2=0x7f5398160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:21.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 --2- 172.21.15.37:0/1026752436 >> v2:172.21.15.119:3300/0 conn(0x7f53980b7980 0x7f5398160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 -- 172.21.15.37:0/1026752436 >> v1:172.21.15.119:6789/0 conn(0x7f53980ceb80 legacy=0x7f53980cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 -- 172.21.15.37:0/1026752436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398160570 con 0x7f53980d0780 2023-07-09T22:01:21.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53977fe640 1 --2- 172.21.15.37:0/1026752436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980d0780 0x7f53980d0b80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f5398069aa0 tx=0x7f539001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fb55ea239f52da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53967fc640 1 -- 172.21.15.37:0/1026752436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5690 con 0x7f53980d0780 2023-07-09T22:01:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53967fc640 1 -- 172.21.15.37:0/1026752436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53900a57f0 con 0x7f53980d0780 2023-07-09T22:01:21.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.865+0000 7f53967fc640 1 -- 172.21.15.37:0/1026752436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53900a5b80 con 0x7f53980d0780 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- 172.21.15.37:0/1026752436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980d0780 msgr2=0x7f53980d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- 172.21.15.37:0/1026752436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980d0780 0x7f53980d0b80 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7f5398069aa0 tx=0x7f539001c9d0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- 172.21.15.37:0/1026752436 shutdown_connections 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- 172.21.15.37:0/1026752436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980d0780 0x7f53980d0b80 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- 172.21.15.37:0/1026752436 >> v2:172.21.15.119:3300/0 conn(0x7f53980b7980 0x7f5398160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- 172.21.15.37:0/1026752436 >> 172.21.15.37:0/1026752436 conn(0x7f5398073090 msgr2=0x7f5398069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:21.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- 172.21.15.37:0/1026752436 shutdown_connections 2023-07-09T22:01:21.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- 172.21.15.37:0/1026752436 wait complete. 2023-07-09T22:01:21.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 Processor -- start 2023-07-09T22:01:21.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- start start 2023-07-09T22:01:21.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53980b7980 0x7f53980b46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 0x7f539814d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53980c5cb0 con 0x7f53980ceb80 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539814eb40 con 0x7f53980b7980 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f539d53a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539814ee10 con 0x7f53980d0780 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f538ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f538ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45130/0 (socket says 172.21.15.37:45130) 2023-07-09T22:01:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f538ffff640 1 -- 172.21.15.37:0/1422196850 learned_addr learned my addr 172.21.15.37:0/1422196850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f5396ffd640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53980b7980 0x7f53980b46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.869+0000 7f53977fe640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 0x7f539814d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 -- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 msgr2=0x7f539814d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 0x7f539814d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 -- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53980b7980 msgr2=0x7f53980b46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53980b7980 0x7f53980b46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:21.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 -- 172.21.15.37:0/1422196850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5390009b30 con 0x7f53980ceb80 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f53977fe640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 0x7f539814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538ffff640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f538000c500 tx=0x7f538000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380005220 con 0x7f53980ceb80 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5380005380 con 0x7f53980ceb80 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5380007270 con 0x7f53980ceb80 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53980c5f50 con 0x7f53980ceb80 2023-07-09T22:01:21.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53980c6510 con 0x7f53980ceb80 2023-07-09T22:01:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53980c6700 con 0x7f53980ceb80 2023-07-09T22:01:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f53800073d0 con 0x7f53980ceb80 2023-07-09T22:01:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 0x7f5378068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:21.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.873+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 5636+0+0 (secure 0 0 0) 0x7f5380084220 con 0x7f53980ceb80 2023-07-09T22:01:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.877+0000 7f5396ffd640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 0x7f5378068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:21.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.877+0000 7f5396ffd640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 0x7f5378068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53880079c0 tx=0x7f5388008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:21.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:21.877+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5380051720 con 0x7f53980ceb80 2023-07-09T22:01:22.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.033+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f539815bf80 con 0x7f53980ceb80 2023-07-09T22:01:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.689+0000 7f538f7fe640 1 -- 172.21.15.37:0/1422196850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v194) v1 ==== 170+0+0 (secure 0 0 0) 0x7f539815bf80 con 0x7f53980ceb80 2023-07-09T22:01:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-07-09T22:01:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 msgr2=0x7f5378068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 0x7f5378068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53880079c0 tx=0x7f5388008040 comp rx=0 tx=0).stop 2023-07-09T22:01:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 msgr2=0x7f539814e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f538000c500 tx=0x7f538000c9c0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 shutdown_connections 2023-07-09T22:01:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f53780663a0 0x7f5378068850 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f53980d0780 0x7f539814d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53980ceb80 0x7f539814e600 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 --2- 172.21.15.37:0/1422196850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f53980b7980 0x7f53980b46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.701+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 >> 172.21.15.37:0/1422196850 conn(0x7f5398073090 msgr2=0x7f539815c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:22.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.713+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 shutdown_connections 2023-07-09T22:01:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.713+0000 7f539d53a640 1 -- 172.21.15.37:0/1422196850 wait complete. 2023-07-09T22:01:22.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-09T22:01:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.881+0000 7f18f9ad8640 1 Processor -- start 2023-07-09T22:01:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.881+0000 7f18f9ad8640 1 -- start start 2023-07-09T22:01:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f9ad8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18f41585b0 0x7f18f406b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f9ad8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40c9090 con 0x7f18f40c4520 2023-07-09T22:01:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f9ad8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18f40c8a60 con 0x7f18f406b970 2023-07-09T22:01:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f9ad8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18f40cbf40 con 0x7f18f41585b0 2023-07-09T22:01:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18f41585b0 0x7f18f406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f18f41585b0 0x7f18f406b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45142/0 (socket says 172.21.15.37:45142) 2023-07-09T22:01:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 -- 172.21.15.37:0/4028792087 learned_addr learned my addr 172.21.15.37:0/4028792087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f3fff640 1 --1- 172.21.15.37:0/4028792087 >> v1:172.21.15.37:6789/0 conn(0x7f18f40c4520 0x7f18f415c200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49080/0 (socket says 172.21.15.37:49080) 2023-07-09T22:01:22.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 -- 172.21.15.37:0/4028792087 >> v1:172.21.15.119:6789/0 conn(0x7f18f406b970 legacy=0x7f18f40c3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 -- 172.21.15.37:0/4028792087 >> v1:172.21.15.37:6789/0 conn(0x7f18f40c4520 legacy=0x7f18f415c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.885+0000 7f18f37fe640 1 -- 172.21.15.37:0/4028792087 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f415ce10 con 0x7f18f41585b0 2023-07-09T22:01:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f37fe640 1 --2- 172.21.15.37:0/4028792087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f41585b0 0x7f18f406b430 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320da73cf4874546 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f27fc640 1 -- 172.21.15.37:0/4028792087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40a95f0 con 0x7f18f41585b0 2023-07-09T22:01:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f27fc640 1 -- 172.21.15.37:0/4028792087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e40a9750 con 0x7f18f41585b0 2023-07-09T22:01:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f27fc640 1 -- 172.21.15.37:0/4028792087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e40a9ae0 con 0x7f18f41585b0 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4028792087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f41585b0 msgr2=0x7f18f406b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4028792087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f41585b0 0x7f18f406b430 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f18e4009870 tx=0x7f18e401c510 comp rx=0 tx=0).stop 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4028792087 shutdown_connections 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4028792087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f41585b0 0x7f18f406b430 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4028792087 >> 172.21.15.37:0/4028792087 conn(0x7f18f40cde40 msgr2=0x7f18f40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4028792087 shutdown_connections 2023-07-09T22:01:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4028792087 wait complete. 2023-07-09T22:01:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.889+0000 7f18f9ad8640 1 Processor -- start 2023-07-09T22:01:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- start start 2023-07-09T22:01:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 0x7f18f4145db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f41585b0 0x7f18f4070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40aeb80 con 0x7f18f40c4520 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40aedb0 con 0x7f18f406b970 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f40af090 con 0x7f18f41585b0 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45154/0 (socket says 172.21.15.37:45154) 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 -- 172.21.15.37:0/4052669887 learned_addr learned my addr 172.21.15.37:0/4052669887 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f37fe640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 0x7f18f4145db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f3fff640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f41585b0 0x7f18f4070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 -- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f41585b0 msgr2=0x7f18f4070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f41585b0 0x7f18f4070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 -- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 msgr2=0x7f18f4145db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 0x7f18f4145db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 -- 172.21.15.37:0/4052669887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e40094d0 con 0x7f18f40c4520 2023-07-09T22:01:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f37fe640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 0x7f18f4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f2ffd640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c500 tx=0x7f18e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8005220 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e8005380 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e8007270 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f40af370 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18f40af930 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.893+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18f404d7d0 con 0x7f18f40c4520 2023-07-09T22:01:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.897+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f18e80073d0 con 0x7f18f40c4520 2023-07-09T22:01:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.897+0000 7f18dbfff640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 0x7f18e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.897+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 6018+0+0 (secure 0 0 0) 0x7f18e8084570 con 0x7f18f40c4520 2023-07-09T22:01:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.897+0000 7f18f37fe640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 0x7f18e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.897+0000 7f18f37fe640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 0x7f18e0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18e40ae000 tx=0x7f18e40b3040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:22.901+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f18e8051990 con 0x7f18f40c4520 2023-07-09T22:01:23.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.085+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18f406b210 con 0x7f18f40c4520 2023-07-09T22:01:23.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.721+0000 7f18dbfff640 1 -- 172.21.15.37:0/4052669887 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v80) v1 ==== 174+0+0 (secure 0 0 0) 0x7f18e8054fb0 con 0x7f18f40c4520 2023-07-09T22:01:23.729 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 23 and data pool 24 2023-07-09T22:01:23.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.729+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 msgr2=0x7f18e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.729+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 0x7f18e0068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f18e40ae000 tx=0x7f18e40b3040 comp rx=0 tx=0).stop 2023-07-09T22:01:23.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 msgr2=0x7f18f4152b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f18e800c500 tx=0x7f18e800c9c0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 shutdown_connections 2023-07-09T22:01:23.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f18e00663a0 0x7f18e0068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f18f41585b0 0x7f18f4070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18f40c4520 0x7f18f4152b30 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 --2- 172.21.15.37:0/4052669887 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f18f406b970 0x7f18f4145db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 >> 172.21.15.37:0/4052669887 conn(0x7f18f40cde40 msgr2=0x7f18f406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 shutdown_connections 2023-07-09T22:01:23.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.733+0000 7f18f9ad8640 1 -- 172.21.15.37:0/4052669887 wait complete. 2023-07-09T22:01:23.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:23.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 Processor -- start 2023-07-09T22:01:23.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 -- start start 2023-07-09T22:01:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680b4340 0x7fb76806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7680cef80 0x7fb7680d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7680b49f0 con 0x7fb7680b7ab0 2023-07-09T22:01:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7680b7e80 con 0x7fb7680cef80 2023-07-09T22:01:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76efdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7680cc8a0 con 0x7fb7680b4340 2023-07-09T22:01:23.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76d578640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7680cef80 0x7fb7680d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76d578640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb7680cef80 0x7fb7680d02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45160/0 (socket says 172.21.15.37:45160) 2023-07-09T22:01:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb76d578640 1 -- 172.21.15.37:0/1427386620 learned_addr learned my addr 172.21.15.37:0/1427386620 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.901+0000 7fb767fff640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680b4340 0x7fb76806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76d578640 1 -- 172.21.15.37:0/1427386620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680b4340 msgr2=0x7fb76806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76d578640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680b4340 0x7fb76806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76d578640 1 -- 172.21.15.37:0/1427386620 >> v1:172.21.15.37:6789/0 conn(0x7fb7680b7ab0 legacy=0x7fb7680b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76d578640 1 -- 172.21.15.37:0/1427386620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680ccb80 con 0x7fb7680cef80 2023-07-09T22:01:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76d578640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680cef80 0x7fb7680d02a0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fb760009e50 tx=0x7fb76001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f5e2499fe05628 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb7677fe640 1 -- 172.21.15.37:0/1427386620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600a58a0 con 0x7fb7680cef80 2023-07-09T22:01:23.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb7677fe640 1 -- 172.21.15.37:0/1427386620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7600a5a00 con 0x7fb7680cef80 2023-07-09T22:01:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb7677fe640 1 -- 172.21.15.37:0/1427386620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7600a5d90 con 0x7fb7680cef80 2023-07-09T22:01:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 -- 172.21.15.37:0/1427386620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680cef80 msgr2=0x7fb7680d02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680cef80 0x7fb7680d02a0 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7fb760009e50 tx=0x7fb76001c9e0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 -- 172.21.15.37:0/1427386620 shutdown_connections 2023-07-09T22:01:23.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680cef80 0x7fb7680d02a0 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 --2- 172.21.15.37:0/1427386620 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680b4340 0x7fb76806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 -- 172.21.15.37:0/1427386620 >> 172.21.15.37:0/1427386620 conn(0x7fb768073090 msgr2=0x7fb768069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.905+0000 7fb76efdb640 1 -- 172.21.15.37:0/1427386620 shutdown_connections 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 -- 172.21.15.37:0/1427386620 wait complete. 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 Processor -- start 2023-07-09T22:01:23.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 -- start start 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7680b7ab0 0x7fb7681485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680cef80 0x7fb768147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681f82d0 con 0x7fb7680b4340 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681564c0 con 0x7fb7680b7ab0 2023-07-09T22:01:23.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76efdb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7681f7970 con 0x7fb7680cef80 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45162/0 (socket says 172.21.15.37:45162) 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 -- 172.21.15.37:0/218037368 learned_addr learned my addr 172.21.15.37:0/218037368 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb767fff640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7680b7ab0 0x7fb7681485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76d578640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680cef80 0x7fb768147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 -- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680cef80 msgr2=0x7fb768147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680cef80 0x7fb768147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 -- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7680b7ab0 msgr2=0x7fb7681485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7680b7ab0 0x7fb7681485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 -- 172.21.15.37:0/218037368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb760009b30 con 0x7fb7680b4340 2023-07-09T22:01:23.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.909+0000 7fb76cd77640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c500 tx=0x7fb75c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c005220 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c005380 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c007270 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7681f7c10 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7681f86f0 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb76804d7d0 con 0x7fb7680b4340 2023-07-09T22:01:23.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb75c0073d0 con 0x7fb7680b4340 2023-07-09T22:01:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 0x7fb74c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb75c0836a0 con 0x7fb7680b4340 2023-07-09T22:01:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.913+0000 7fb767fff640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 0x7fb74c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:23.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.917+0000 7fb767fff640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 0x7fb74c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7681603f0 tx=0x7fb754009190 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:23.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:23.917+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb75c050a90 con 0x7fb7680b4340 2023-07-09T22:01:24.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.073+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7681f8540 con 0x7fb7680b4340 2023-07-09T22:01:24.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb7657fa640 1 -- 172.21.15.37:0/218037368 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18384 (secure 0 0 0) 0x7fb75c0540b0 con 0x7fb7680b4340 2023-07-09T22:01:24.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:24.083 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":195,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:23.091367+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:24.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 msgr2=0x7fb74c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 0x7fb74c068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb7681603f0 tx=0x7fb754009190 comp rx=0 tx=0).stop 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 msgr2=0x7fb7681571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c500 tx=0x7fb75c00c9c0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 shutdown_connections 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb74c0663a0 0x7fb74c068850 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb7680cef80 0x7fb768147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb7680b7ab0 0x7fb7681485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 --2- 172.21.15.37:0/218037368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7680b4340 0x7fb7681571a0 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 >> 172.21.15.37:0/218037368 conn(0x7fb768073090 msgr2=0x7fb768069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 shutdown_connections 2023-07-09T22:01:24.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.077+0000 7fb76efdb640 1 -- 172.21.15.37:0/218037368 wait complete. 2023-07-09T22:01:24.103 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 Processor -- start 2023-07-09T22:01:24.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 -- start start 2023-07-09T22:01:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 0x7ff36406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640b49f0 con 0x7ff3640cef80 2023-07-09T22:01:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3640cc8a0 con 0x7ff3640b7ab0 2023-07-09T22:01:24.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff36989e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640b7e80 con 0x7ff3640b4340 2023-07-09T22:01:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff3637fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff3640cef80 0x7ff3640d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49098/0 (socket says 172.21.15.37:49098) 2023-07-09T22:01:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff3637fe640 1 -- 172.21.15.37:0/941700011 learned_addr learned my addr 172.21.15.37:0/941700011 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff3627fc640 1 --2- 172.21.15.37:0/941700011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 0x7ff36406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319813668 0 0) 0x7ff3640b49f0 con 0x7ff3640cef80 2023-07-09T22:01:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.241+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff34c003530 con 0x7ff3640cef80 2023-07-09T22:01:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff3627fc640 1 -- 172.21.15.37:0/941700011 >> v1:172.21.15.119:6789/0 conn(0x7ff3640b7ab0 legacy=0x7ff3640b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995743243 0 0) 0x7ff3640cc8a0 con 0x7ff3640b7ab0 2023-07-09T22:01:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff3627fc640 1 -- 172.21.15.37:0/941700011 >> v1:172.21.15.37:6789/0 conn(0x7ff3640cef80 legacy=0x7ff3640d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff3627fc640 1 -- 172.21.15.37:0/941700011 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3640ccb80 con 0x7ff3640b4340 2023-07-09T22:01:24.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff3627fc640 1 --2- 172.21.15.37:0/941700011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 0x7ff36406aa50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3580097f0 tx=0x7ff35801c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65be7389de2e72da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c001a00 con 0x7ff3640b4340 2023-07-09T22:01:24.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3580a7050 con 0x7ff3640b4340 2023-07-09T22:01:24.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.245+0000 7ff361ffb640 1 -- 172.21.15.37:0/941700011 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580ab620 con 0x7ff3640b4340 2023-07-09T22:01:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- 172.21.15.37:0/941700011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 msgr2=0x7ff36406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 --2- 172.21.15.37:0/941700011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 0x7ff36406aa50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7ff3580097f0 tx=0x7ff35801c2d0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- 172.21.15.37:0/941700011 shutdown_connections 2023-07-09T22:01:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 --2- 172.21.15.37:0/941700011 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640b4340 0x7ff36406aa50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- 172.21.15.37:0/941700011 >> 172.21.15.37:0/941700011 conn(0x7ff364073090 msgr2=0x7ff364069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- 172.21.15.37:0/941700011 shutdown_connections 2023-07-09T22:01:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- 172.21.15.37:0/941700011 wait complete. 2023-07-09T22:01:24.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 Processor -- start 2023-07-09T22:01:24.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- start start 2023-07-09T22:01:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3640b7ab0 0x7ff3640ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640cef80 0x7ff3640c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640cb5c0 con 0x7ff3640b4340 2023-07-09T22:01:24.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640cb8a0 con 0x7ff3640b7ab0 2023-07-09T22:01:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff36989e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3640c9d30 con 0x7ff3640cef80 2023-07-09T22:01:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45164/0 (socket says 172.21.15.37:45164) 2023-07-09T22:01:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 -- 172.21.15.37:0/3102458295 learned_addr learned my addr 172.21.15.37:0/3102458295 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff3627fc640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3640b7ab0 0x7ff3640ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff3637fe640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640cef80 0x7ff3640c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 -- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640cef80 msgr2=0x7ff3640c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640cef80 0x7ff3640c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 -- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3640b7ab0 msgr2=0x7ff3640ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3640b7ab0 0x7ff3640ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.249+0000 7ff362ffd640 1 -- 172.21.15.37:0/3102458295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff358009420 con 0x7ff3640b4340 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff362ffd640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c4d0 tx=0x7ff35400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354005480 con 0x7ff3640b4340 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354003600 con 0x7ff3640b4340 2023-07-09T22:01:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540039b0 con 0x7ff3640b4340 2023-07-09T22:01:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3640ca010 con 0x7ff3640b4340 2023-07-09T22:01:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3640cbb80 con 0x7ff3640b4340 2023-07-09T22:01:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3640ca250 con 0x7ff3640b4340 2023-07-09T22:01:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff354003b10 con 0x7ff3640b4340 2023-07-09T22:01:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 0x7ff350068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6118+0+0 (secure 0 0 0) 0x7ff354083400 con 0x7ff3640b4340 2023-07-09T22:01:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.253+0000 7ff3627fc640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 0x7ff350068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.257+0000 7ff3627fc640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 0x7ff350068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ad000 tx=0x7ff3580a6000 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.257+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff3640ca250 con 0x7ff3640b4340 2023-07-09T22:01:24.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.413+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3640ca200 con 0x7ff3640b4340 2023-07-09T22:01:24.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.413+0000 7ff34bfff640 1 -- 172.21.15.37:0/3102458295 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v195) v1 ==== 74+0+18384 (secure 0 0 0) 0x7ff354054330 con 0x7ff3640b4340 2023-07-09T22:01:24.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:24.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":195,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:23.091367+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 msgr2=0x7ff350068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 0x7ff350068880 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff3580ad000 tx=0x7ff3580a6000 comp rx=0 tx=0).stop 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 msgr2=0x7ff36414cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c4d0 tx=0x7ff35400c990 comp rx=0 tx=0).stop 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 shutdown_connections 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7ff3500663d0 0x7ff350068880 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff3640cef80 0x7ff3640c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff3640b7ab0 0x7ff3640ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 --2- 172.21.15.37:0/3102458295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3640b4340 0x7ff36414cb30 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 >> 172.21.15.37:0/3102458295 conn(0x7ff364073090 msgr2=0x7ff3640d02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 shutdown_connections 2023-07-09T22:01:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.417+0000 7ff36989e640 1 -- 172.21.15.37:0/3102458295 wait complete. 2023-07-09T22:01:24.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-09T22:01:24.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.581+0000 7febfb26d640 1 Processor -- start 2023-07-09T22:01:24.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.581+0000 7febfb26d640 1 -- start start 2023-07-09T22:01:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febfb26d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febf4160410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febfb26d640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7febf40c47c0 0x7febf4163c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febfb26d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40cbcd0 con 0x7febf40c42b0 2023-07-09T22:01:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febfb26d640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40ca6d0 con 0x7febf40c47c0 2023-07-09T22:01:24.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febfb26d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40ca050 con 0x7febf40b0390 2023-07-09T22:01:24.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf8808640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7febf40c42b0 0x7febf40cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49114/0 (socket says 172.21.15.37:49114) 2023-07-09T22:01:24.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf8808640 1 -- 172.21.15.37:0/574859607 learned_addr learned my addr 172.21.15.37:0/574859607 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf980a640 1 --2- 172.21.15.37:0/574859607 >> v2:172.21.15.119:3300/0 conn(0x7febf40c47c0 0x7febf4163c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febf4160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289460070 0 0) 0x7febe4001120 con 0x7febf40c42b0 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe0003530 con 0x7febf40c42b0 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316379000 0 0) 0x7febe0003530 con 0x7febf40c42b0 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 msgr2=0x7febf4160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febf4160410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 >> v2:172.21.15.119:3300/0 conn(0x7febf40c47c0 msgr2=0x7febf4163c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:24.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 --2- 172.21.15.37:0/574859607 >> v2:172.21.15.119:3300/0 conn(0x7febf40c47c0 0x7febf4163c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf406cb80 con 0x7febf40c42b0 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7febe4001810 con 0x7febf40c42b0 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 >> v1:172.21.15.37:6789/0 conn(0x7febf40c42b0 legacy=0x7febf40cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febe0003980 0x7febe0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febe00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febe0004d10 0x7febe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40ca6d0 con 0x7febe0003980 2023-07-09T22:01:24.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40ca050 con 0x7febe0004d10 2023-07-09T22:01:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe000b990 con 0x7febf40b0390 2023-07-09T22:01:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febe0003980 0x7febe0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf8808640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febe00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf980a640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febe0004d10 0x7febe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 -- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 msgr2=0x7febe00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febf40b0390 0x7febe00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 -- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febe0004d10 msgr2=0x7febe0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febe0004d10 0x7febe0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.585+0000 7febf9009640 1 -- 172.21.15.37:0/574859607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0003530 con 0x7febe0003980 2023-07-09T22:01:24.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febf9009640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febe0003980 0x7febe0003d90 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7febf0009ae0 tx=0x7febf001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293f0f423109dcaf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00a6510 con 0x7febe0003980 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf00a6670 con 0x7febe0003980 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febebfff640 1 -- 172.21.15.37:0/574859607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00a6a20 con 0x7febe0003980 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 -- 172.21.15.37:0/574859607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febe0003980 msgr2=0x7febe0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 --2- 172.21.15.37:0/574859607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febe0003980 0x7febe0003d90 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7febf0009ae0 tx=0x7febf001ca20 comp rx=0 tx=0).stop 2023-07-09T22:01:24.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febf980a640 1 -- 172.21.15.37:0/574859607 reap_dead start 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 -- 172.21.15.37:0/574859607 shutdown_connections 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 -- 172.21.15.37:0/574859607 >> 172.21.15.37:0/574859607 conn(0x7febf40cde40 msgr2=0x7febf40ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 -- 172.21.15.37:0/574859607 shutdown_connections 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.589+0000 7febfb26d640 1 -- 172.21.15.37:0/574859607 wait complete. 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 Processor -- start 2023-07-09T22:01:24.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- start start 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febe0003980 0x7febf40b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf40c4e80 0x7febf4158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b22c0 con 0x7febf4157310 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40b2b60 con 0x7febf40c4e80 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c5380 con 0x7febe0003980 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45190/0 (socket says 172.21.15.37:45190) 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 -- 172.21.15.37:0/113676059 learned_addr learned my addr 172.21.15.37:0/113676059 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf9009640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febe0003980 0x7febf40b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf980a640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf40c4e80 0x7febf4158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 -- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febe0003980 msgr2=0x7febf40b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febe0003980 0x7febf40b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 -- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf40c4e80 msgr2=0x7febf4158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf40c4e80 0x7febf4158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 -- 172.21.15.37:0/113676059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b2510 con 0x7febf4157310 2023-07-09T22:01:24.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febf8808640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7febe4007310 tx=0x7febe40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400f9c0 con 0x7febf4157310 2023-07-09T22:01:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400fb40 con 0x7febf4157310 2023-07-09T22:01:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40133f0 con 0x7febf4157310 2023-07-09T22:01:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf40b27f0 con 0x7febf4157310 2023-07-09T22:01:24.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.593+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf4156c70 con 0x7febf4157310 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf404d7d0 con 0x7febf4157310 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7febe4013550 con 0x7febf4157310 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febe9ffb640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 0x7febd8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 6118+0+0 (secure 0 0 0) 0x7febe4083db0 con 0x7febf4157310 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febf9009640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 0x7febd8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:24.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.597+0000 7febf9009640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 0x7febd8068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00046d0 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:24.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.601+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7febe4088070 con 0x7febf4157310 2023-07-09T22:01:24.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:24.797+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7febf40cbcd0 con 0x7febf4157310 2023-07-09T22:01:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.733+0000 7febe9ffb640 1 -- 172.21.15.37:0/113676059 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) v1 ==== 118+0+0 (secure 0 0 0) 0x7febf40cbcd0 con 0x7febf4157310 2023-07-09T22:01:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 msgr2=0x7febd8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 0x7febd8068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7febf00af000 tx=0x7febf00046d0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 msgr2=0x7febf41563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7febe4007310 tx=0x7febe40077d0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 shutdown_connections 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7febd80663d0 0x7febd8068880 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7febf40c4e80 0x7febf4158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7febf4157310 0x7febf41563f0 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 --2- 172.21.15.37:0/113676059 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7febe0003980 0x7febf40b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 >> 172.21.15.37:0/113676059 conn(0x7febf40cde40 msgr2=0x7febf40c2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 shutdown_connections 2023-07-09T22:01:25.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.737+0000 7febfb26d640 1 -- 172.21.15.37:0/113676059 wait complete. 2023-07-09T22:01:25.765 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-07-09T22:01:25.765 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-07-09T22:01:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.909+0000 7f2cb8e93640 1 Processor -- start 2023-07-09T22:01:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb8e93640 1 -- start start 2023-07-09T22:01:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb8e93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2cb4160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb8e93640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb415bf80 con 0x7f2cb40b7980 2023-07-09T22:01:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb8e93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb4160570 con 0x7f2cb40d0780 2023-07-09T22:01:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb8e93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40cd070 con 0x7f2cb40cf290 2023-07-09T22:01:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2cb40b7980 0x7f2cb40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49118/0 (socket says 172.21.15.37:49118) 2023-07-09T22:01:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb259c640 1 -- 172.21.15.37:0/922595979 learned_addr learned my addr 172.21.15.37:0/922595979 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2cb4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 297121003 0 0) 0x7f2ca4001120 con 0x7f2cb40b7980 2023-07-09T22:01:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca0003530 con 0x7f2cb40b7980 2023-07-09T22:01:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2947906826 0 0) 0x7f2cac0014a0 con 0x7f2cb40d0780 2023-07-09T22:01:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca4001120 con 0x7f2cb40d0780 2023-07-09T22:01:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 847062394 0 0) 0x7f2ca0003530 con 0x7f2cb40b7980 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 msgr2=0x7f2cb4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2cb4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 >> v1:172.21.15.119:6789/0 conn(0x7f2cb40d0780 legacy=0x7f2cb40d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40d02f0 con 0x7f2cb40b7980 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2ca4001810 con 0x7f2cb40b7980 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 >> v1:172.21.15.37:6789/0 conn(0x7f2cb40b7980 legacy=0x7f2cb40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2ca0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2ca00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca0004d10 0x7f2ca0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40cd070 con 0x7f2ca00040f0 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000baa0 con 0x7f2ca0004d10 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000bc60 con 0x7f2cb40cf290 2023-07-09T22:01:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2ca00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb259c640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2ca0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb2d9d640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca0004d10 0x7f2ca0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 -- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 msgr2=0x7f2ca0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2ca0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 -- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca0004d10 msgr2=0x7f2ca0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ca0004d10 0x7f2ca0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cabfff640 1 -- 172.21.15.37:0/922595979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0003530 con 0x7f2ca00040f0 2023-07-09T22:01:25.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.913+0000 7f2cb259c640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40cf290 0x7f2ca0003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cabfff640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2ca00047d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009ae0 tx=0x7f2c9c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8d427c75de5e28 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0a5640 con 0x7f2ca00040f0 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c0a57a0 con 0x7f2ca00040f0 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb1d9b640 1 -- 172.21.15.37:0/922595979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0a5b50 con 0x7f2ca00040f0 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 -- 172.21.15.37:0/922595979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 msgr2=0x7f2ca00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/922595979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2ca00047d0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c009ae0 tx=0x7f2c9c01ca50 comp rx=0 tx=0).stop 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb2d9d640 1 -- 172.21.15.37:0/922595979 reap_dead start 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 -- 172.21.15.37:0/922595979 shutdown_connections 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 -- 172.21.15.37:0/922595979 >> 172.21.15.37:0/922595979 conn(0x7f2cb4073090 msgr2=0x7f2cb4069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 -- 172.21.15.37:0/922595979 shutdown_connections 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.917+0000 7f2cb8e93640 1 -- 172.21.15.37:0/922595979 wait complete. 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 Processor -- start 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- start start 2023-07-09T22:01:25.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cb40b44c0 0x7f2cb415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40a8b50 0x7f2cb40b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41e8450 con 0x7f2ca00040f0 2023-07-09T22:01:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41e7bb0 con 0x7f2cb40b44c0 2023-07-09T22:01:25.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41e7e90 con 0x7f2cb40a8b50 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45212/0 (socket says 172.21.15.37:45212) 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 -- 172.21.15.37:0/981242125 learned_addr learned my addr 172.21.15.37:0/981242125 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb2d9d640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40a8b50 0x7f2cb40b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cabfff640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cb40b44c0 0x7f2cb415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 -- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40a8b50 msgr2=0x7f2cb40b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40a8b50 0x7f2cb40b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 -- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cb40b44c0 msgr2=0x7f2cb415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cb40b44c0 0x7f2cb415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 -- 172.21.15.37:0/981242125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb41e8170 con 0x7f2ca00040f0 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb259c640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40072c0 tx=0x7f2ca4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca400fa80 con 0x7f2ca00040f0 2023-07-09T22:01:25.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca400fbe0 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca40133f0 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40b2d40 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb415aed0 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.921+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb40b2f30 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.925+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2ca4013550 con 0x7f2ca00040f0 2023-07-09T22:01:25.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.925+0000 7f2caaffd640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 0x7f2c94068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.925+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f2ca40842f0 con 0x7f2ca00040f0 2023-07-09T22:01:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.925+0000 7f2cabfff640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 0x7f2c94068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.925+0000 7f2cabfff640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 0x7f2c94068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0af000 tx=0x7f2c9c0046d0 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:25.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:25.929+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ca4051580 con 0x7f2ca00040f0 2023-07-09T22:01:26.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.117+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2cb404d7d0 con 0x7f2ca00040f0 2023-07-09T22:01:26.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2caaffd640 1 -- 172.21.15.37:0/981242125 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2ca4054ba0 con 0x7f2ca00040f0 2023-07-09T22:01:26.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 msgr2=0x7f2c94068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 0x7f2c94068850 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c0af000 tx=0x7f2c9c0046d0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 msgr2=0x7f2cb41e55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40072c0 tx=0x7f2ca4007780 comp rx=0 tx=0).stop 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 shutdown_connections 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f2c940663a0 0x7f2c94068850 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2cb40a8b50 0x7f2cb40b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2cb40b44c0 0x7f2cb415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 --2- 172.21.15.37:0/981242125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ca00040f0 0x7f2cb41e55f0 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 >> 172.21.15.37:0/981242125 conn(0x7f2cb4073090 msgr2=0x7f2cb40d0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 shutdown_connections 2023-07-09T22:01:26.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.737+0000 7f2cb8e93640 1 -- 172.21.15.37:0/981242125 wait complete. 2023-07-09T22:01:26.767 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-07-09T22:01:26.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:26.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 Processor -- start 2023-07-09T22:01:26.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 -- start start 2023-07-09T22:01:26.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb0880b7ab0 0x7fb08806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0880cef80 0x7fb0880b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0880b49f0 con 0x7fb0880b4170 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880b7e80 con 0x7fb0880cef80 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb09078f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880b4610 con 0x7fb0880b7ab0 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb08dd2a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0880cef80 0x7fb0880b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb08dd2a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb0880cef80 0x7fb0880b3c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45226/0 (socket says 172.21.15.37:45226) 2023-07-09T22:01:26.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb08dd2a640 1 -- 172.21.15.37:0/910092685 learned_addr learned my addr 172.21.15.37:0/910092685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.909+0000 7fb08e52b640 1 --2- 172.21.15.37:0/910092685 >> v2:172.21.15.119:3300/0 conn(0x7fb0880b7ab0 0x7fb08806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08dd2a640 1 -- 172.21.15.37:0/910092685 >> v2:172.21.15.119:3300/0 conn(0x7fb0880b7ab0 msgr2=0x7fb08806aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08dd2a640 1 --2- 172.21.15.37:0/910092685 >> v2:172.21.15.119:3300/0 conn(0x7fb0880b7ab0 0x7fb08806aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08dd2a640 1 -- 172.21.15.37:0/910092685 >> v1:172.21.15.119:6789/0 conn(0x7fb0880b4170 legacy=0x7fb08815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08dd2a640 1 -- 172.21.15.37:0/910092685 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880cc8a0 con 0x7fb0880cef80 2023-07-09T22:01:26.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08dd2a640 1 --2- 172.21.15.37:0/910092685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880b3c30 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fb08806b360 tx=0x7fb07801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f482b48d90306658 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08d529640 1 -- 172.21.15.37:0/910092685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780aa430 con 0x7fb0880cef80 2023-07-09T22:01:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08d529640 1 -- 172.21.15.37:0/910092685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0780aa590 con 0x7fb0880cef80 2023-07-09T22:01:26.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb08d529640 1 -- 172.21.15.37:0/910092685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0780aa920 con 0x7fb0880cef80 2023-07-09T22:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 -- 172.21.15.37:0/910092685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 msgr2=0x7fb0880b3c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 --2- 172.21.15.37:0/910092685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880b3c30 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fb08806b360 tx=0x7fb07801c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 -- 172.21.15.37:0/910092685 shutdown_connections 2023-07-09T22:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 --2- 172.21.15.37:0/910092685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880b3c30 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 --2- 172.21.15.37:0/910092685 >> v2:172.21.15.119:3300/0 conn(0x7fb0880b7ab0 0x7fb08806aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.913+0000 7fb09078f640 1 -- 172.21.15.37:0/910092685 >> 172.21.15.37:0/910092685 conn(0x7fb088073090 msgr2=0x7fb088069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- 172.21.15.37:0/910092685 shutdown_connections 2023-07-09T22:01:26.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- 172.21.15.37:0/910092685 wait complete. 2023-07-09T22:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 Processor -- start 2023-07-09T22:01:26.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- start start 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0880b4170 0x7fb0881543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0880b7ab0 0x7fb0880c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0881596e0 con 0x7fb0880cef80 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880ca430 con 0x7fb0880b4170 2023-07-09T22:01:26.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb09078f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880ca710 con 0x7fb0880b7ab0 2023-07-09T22:01:26.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45232/0 (socket says 172.21.15.37:45232) 2023-07-09T22:01:26.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 -- 172.21.15.37:0/1959873792 learned_addr learned my addr 172.21.15.37:0/1959873792 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08e52b640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0880b4170 0x7fb0881543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08dd2a640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0880b7ab0 0x7fb0880c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 -- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0880b7ab0 msgr2=0x7fb0880c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0880b7ab0 0x7fb0880c6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 -- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0880b4170 msgr2=0x7fb0881543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0880b4170 0x7fb0881543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 -- 172.21.15.37:0/1959873792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780094d0 con 0x7fb0880cef80 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb08ed2c640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c730 tx=0x7fb08000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.917+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080003b80 con 0x7fb0880cef80 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080003ce0 con 0x7fb0880cef80 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000aa30 con 0x7fb0880cef80 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880ca9f0 con 0x7fb0880cef80 2023-07-09T22:01:26.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0880c67e0 con 0x7fb0880cef80 2023-07-09T22:01:26.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb088159850 con 0x7fb0880cef80 2023-07-09T22:01:26.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb08000ab90 con 0x7fb0880cef80 2023-07-09T22:01:26.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb07effd640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 0x7fb06c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:26.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb080083c80 con 0x7fb0880cef80 2023-07-09T22:01:26.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.921+0000 7fb08e52b640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 0x7fb06c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:26.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.925+0000 7fb08e52b640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 0x7fb06c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b9d0 tx=0x7fb084008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:26.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:26.925+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb088159850 con 0x7fb0880cef80 2023-07-09T22:01:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.109+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb088159820 con 0x7fb0880cef80 2023-07-09T22:01:27.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb07effd640 1 -- 172.21.15.37:0/1959873792 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fb080050fa0 con 0x7fb0880cef80 2023-07-09T22:01:27.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:27.118 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:01:27.118 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:01:27.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 msgr2=0x7fb06c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 0x7fb06c068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb08400b9d0 tx=0x7fb084008040 comp rx=0 tx=0).stop 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 msgr2=0x7fb0880c7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fb08000c730 tx=0x7fb08000cbf0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 shutdown_connections 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb06c0663a0 0x7fb06c068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb0880cef80 0x7fb0880c7010 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb0880b7ab0 0x7fb0880c6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 --2- 172.21.15.37:0/1959873792 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb0880b4170 0x7fb0881543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 >> 172.21.15.37:0/1959873792 conn(0x7fb088073090 msgr2=0x7fb088155030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 shutdown_connections 2023-07-09T22:01:27.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.113+0000 7fb09078f640 1 -- 172.21.15.37:0/1959873792 wait complete. 2023-07-09T22:01:27.139 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:27.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 Processor -- start 2023-07-09T22:01:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 -- start start 2023-07-09T22:01:27.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f77200cef80 0x7f772006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77200b49f0 con 0x7f77200b7ab0 2023-07-09T22:01:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77200cc8a0 con 0x7f77200b4340 2023-07-09T22:01:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f772519f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77200b7e80 con 0x7f77200cef80 2023-07-09T22:01:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f77200b7ab0 0x7f77200b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:49132/0 (socket says 172.21.15.37:49132) 2023-07-09T22:01:27.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 -- 172.21.15.37:0/791598768 learned_addr learned my addr 172.21.15.37:0/791598768 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908882070 0 0) 0x7f77200b49f0 con 0x7f77200b7ab0 2023-07-09T22:01:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7708003530 con 0x7f77200b7ab0 2023-07-09T22:01:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771f59e640 1 --2- 172.21.15.37:0/791598768 >> v2:172.21.15.119:3300/0 conn(0x7f77200cef80 0x7f772006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3301998488 0 0) 0x7f7708003530 con 0x7f77200b7ab0 2023-07-09T22:01:27.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 >> v2:172.21.15.119:3300/0 conn(0x7f77200cef80 msgr2=0x7f772006aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 --2- 172.21.15.37:0/791598768 >> v2:172.21.15.119:3300/0 conn(0x7f77200cef80 0x7f772006aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 >> v1:172.21.15.119:6789/0 conn(0x7f77200b4340 legacy=0x7f77200d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200ccb80 con 0x7f77200b7ab0 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7710001680 con 0x7f77200b7ab0 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 >> v1:172.21.15.37:6789/0 conn(0x7f77200b7ab0 legacy=0x7f77200b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f7708003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77080047d0 0x7f7708004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708005180 0x7f770800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770800bfd0 con 0x7f7708005180 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770800c140 con 0x7f7708003980 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770800c300 con 0x7f77080047d0 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f7708003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771f59e640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708005180 0x7f770800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771e59c640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77080047d0 0x7f7708004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 -- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77080047d0 msgr2=0x7f7708004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77080047d0 0x7f7708004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 -- 172.21.15.37:0/791598768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708005180 msgr2=0x7f770800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7708005180 0x7f770800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771ed9d640 1 -- 172.21.15.37:0/791598768 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708003530 con 0x7f7708003980 2023-07-09T22:01:27.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.277+0000 7f771f59e640 1 -- 172.21.15.37:0/791598768 reap_dead start 2023-07-09T22:01:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f771ed9d640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f7708003d90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f771000c240 tx=0x7f771001cc00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c65d1256f765cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710005ae0 con 0x7f7708003980 2023-07-09T22:01:27.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7710005c60 con 0x7f7708003980 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f771dd9b640 1 -- 172.21.15.37:0/791598768 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77100a5820 con 0x7f7708003980 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 -- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 msgr2=0x7f7708003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f7708003d90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f771000c240 tx=0x7f771001cc00 comp rx=0 tx=0).stop 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 -- 172.21.15.37:0/791598768 shutdown_connections 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 --2- 172.21.15.37:0/791598768 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f7708003d90 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 -- 172.21.15.37:0/791598768 >> 172.21.15.37:0/791598768 conn(0x7f7720073090 msgr2=0x7f7720069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 -- 172.21.15.37:0/791598768 shutdown_connections 2023-07-09T22:01:27.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.281+0000 7f772519f640 1 -- 172.21.15.37:0/791598768 wait complete. 2023-07-09T22:01:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 Processor -- start 2023-07-09T22:01:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 -- start start 2023-07-09T22:01:27.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f772014c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77200ca9b0 0x7f77200d01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772014cb00 con 0x7f77200cae20 2023-07-09T22:01:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77200cb390 con 0x7f7708003980 2023-07-09T22:01:27.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77200cb670 con 0x7f77200ca9b0 2023-07-09T22:01:27.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45240/0 (socket says 172.21.15.37:45240) 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 -- 172.21.15.37:0/2836744666 learned_addr learned my addr 172.21.15.37:0/2836744666 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771e59c640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77200ca9b0 0x7f77200d01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771ed9d640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f772014c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 -- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77200ca9b0 msgr2=0x7f77200d01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77200ca9b0 0x7f77200d01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 -- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 msgr2=0x7f772014c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f772014c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 -- 172.21.15.37:0/2836744666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77200cb950 con 0x7f77200cae20 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f771f59e640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f772015f3f0 tx=0x7f7718011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800e040 con 0x7f77200cae20 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771800f040 con 0x7f77200cae20 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77200cbc30 con 0x7f77200cae20 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.285+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718004270 con 0x7f77200cae20 2023-07-09T22:01:27.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7720159160 con 0x7f77200cae20 2023-07-09T22:01:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772004d7d0 con 0x7f77200cae20 2023-07-09T22:01:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f77180043d0 con 0x7f77200cae20 2023-07-09T22:01:27.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f77077fe640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 0x7f770c068840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f77180840a0 con 0x7f77200cae20 2023-07-09T22:01:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f771ed9d640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 0x7f770c068840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.289+0000 7f771ed9d640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 0x7f770c068840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77100ab000 tx=0x7f77100b1040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.293+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7718051220 con 0x7f77200cae20 2023-07-09T22:01:27.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.449+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f772006a830 con 0x7f77200cae20 2023-07-09T22:01:27.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.449+0000 7f77077fe640 1 -- 172.21.15.37:0/2836744666 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+18371 (secure 0 0 0) 0x7f7718054840 con 0x7f77200cae20 2023-07-09T22:01:27.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:27.456 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":196,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:24.695736+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 msgr2=0x7f770c068840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 0x7f770c068840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77100ab000 tx=0x7f77100b1040 comp rx=0 tx=0).stop 2023-07-09T22:01:27.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 msgr2=0x7f77200d06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f772015f3f0 tx=0x7f7718011cb0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 shutdown_connections 2023-07-09T22:01:27.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f770c066390 0x7f770c068840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77200cae20 0x7f77200d06e0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f77200ca9b0 0x7f77200d01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 --2- 172.21.15.37:0/2836744666 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7708003980 0x7f772014c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 >> 172.21.15.37:0/2836744666 conn(0x7f7720073090 msgr2=0x7f7720069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:27.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 shutdown_connections 2023-07-09T22:01:27.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.453+0000 7f772519f640 1 -- 172.21.15.37:0/2836744666 wait complete. 2023-07-09T22:01:27.478 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-09T22:01:27.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:01:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.613+0000 7f24d66af640 1 Processor -- start 2023-07-09T22:01:27.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 -- start start 2023-07-09T22:01:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f24d00b7810 0x7f24d015fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24d00cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d00ccd40 con 0x7f24d00ce1a0 2023-07-09T22:01:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d00cc5a0 con 0x7f24d00b7810 2023-07-09T22:01:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d66af640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d01602d0 con 0x7f24d006a450 2023-07-09T22:01:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f24d00ce1a0 0x7f24d0069d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60394/0 (socket says 172.21.15.37:60394) 2023-07-09T22:01:27.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 -- 172.21.15.37:0/1877910796 learned_addr learned my addr 172.21.15.37:0/1877910796 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:27.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2430820109 0 0) 0x7f24d00ccd40 con 0x7f24d00ce1a0 2023-07-09T22:01:27.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24bc003530 con 0x7f24d00ce1a0 2023-07-09T22:01:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d56ad640 1 --2- 172.21.15.37:0/1877910796 >> v2:172.21.15.119:3300/0 conn(0x7f24d00b7810 0x7f24d015fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d5eae640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24d00cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3169601544 0 0) 0x7f24bc003530 con 0x7f24d00ce1a0 2023-07-09T22:01:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 msgr2=0x7f24d00cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24d00cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 >> v2:172.21.15.119:3300/0 conn(0x7f24d00b7810 msgr2=0x7f24d015fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 --2- 172.21.15.37:0/1877910796 >> v2:172.21.15.119:3300/0 conn(0x7f24d00b7810 0x7f24d015fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00ce680 con 0x7f24d00ce1a0 2023-07-09T22:01:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f24c0001680 con 0x7f24d00ce1a0 2023-07-09T22:01:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 >> v1:172.21.15.37:6789/0 conn(0x7f24d00ce1a0 legacy=0x7f24d0069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24bc003980 0x7f24bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00cc5a0 con 0x7f24bc0047d0 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d01602d0 con 0x7f24bc003980 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc00ba40 con 0x7f24d006a450 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d56ad640 1 --2- 172.21.15.37:0/1877910796 >> v2:172.21.15.119:3300/0 conn(0x7f24d00b7810 0x7f24d015fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d5eae640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d56ad640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24bc003980 0x7f24bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 -- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 msgr2=0x7f24bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d006a450 0x7f24bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 -- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24bc003980 msgr2=0x7f24bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:27.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24bc003980 0x7f24bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d4eac640 1 -- 172.21.15.37:0/1877910796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24bc003530 con 0x7f24bc0047d0 2023-07-09T22:01:27.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.617+0000 7f24d56ad640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24bc003980 0x7f24bc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d4eac640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c40 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c240 tx=0x7f24c001f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=707dae4654842f83 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0005ae0 con 0x7f24bc0047d0 2023-07-09T22:01:27.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c00ab070 con 0x7f24bc0047d0 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24c7fff640 1 -- 172.21.15.37:0/1877910796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0005ea0 con 0x7f24bc0047d0 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 -- 172.21.15.37:0/1877910796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 msgr2=0x7f24bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 --2- 172.21.15.37:0/1877910796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24bc004c40 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c240 tx=0x7f24c001f310 comp rx=0 tx=0).stop 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d5eae640 1 -- 172.21.15.37:0/1877910796 reap_dead start 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 -- 172.21.15.37:0/1877910796 shutdown_connections 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 -- 172.21.15.37:0/1877910796 >> 172.21.15.37:0/1877910796 conn(0x7f24d00cea60 msgr2=0x7f24d00cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:27.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 -- 172.21.15.37:0/1877910796 shutdown_connections 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.621+0000 7f24d66af640 1 -- 172.21.15.37:0/1877910796 wait complete. 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 Processor -- start 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- start start 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d00b5b00 0x7f24d00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24d00ca0d0 0x7f24d00ca540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00c9dd0 con 0x7f24bc0047d0 2023-07-09T22:01:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b18b0 con 0x7f24d00ca0d0 2023-07-09T22:01:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d00b64b0 con 0x7f24d00b5b00 2023-07-09T22:01:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51402/0 (socket says 172.21.15.37:51402) 2023-07-09T22:01:27.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 -- 172.21.15.37:0/3813660509 learned_addr learned my addr 172.21.15.37:0/3813660509 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d4eac640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d00b5b00 0x7f24d00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d5eae640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24d00ca0d0 0x7f24d00ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 -- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d00b5b00 msgr2=0x7f24d00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d00b5b00 0x7f24d00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 -- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24d00ca0d0 msgr2=0x7f24d00ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24d00ca0d0 0x7f24d00ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 -- 172.21.15.37:0/3813660509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d00caa80 con 0x7f24bc0047d0 2023-07-09T22:01:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d56ad640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0108c0 tx=0x7f24cc010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00eae0 con 0x7f24bc0047d0 2023-07-09T22:01:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24cc00c050 con 0x7f24bc0047d0 2023-07-09T22:01:27.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24cc00ee40 con 0x7f24bc0047d0 2023-07-09T22:01:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d00c91c0 con 0x7f24bc0047d0 2023-07-09T22:01:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.625+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d00c9780 con 0x7f24bc0047d0 2023-07-09T22:01:27.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d004e020 con 0x7f24bc0047d0 2023-07-09T22:01:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f24cc015470 con 0x7f24bc0047d0 2023-07-09T22:01:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24c5ffb640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 0x7f24b4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f24cc084a70 con 0x7f24bc0047d0 2023-07-09T22:01:27.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24d4eac640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 0x7f24b4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.629+0000 7f24d4eac640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 0x7f24b4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ae000 tx=0x7f24c0001a80 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:27.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.633+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f24cc055680 con 0x7f24bc0047d0 2023-07-09T22:01:27.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.785+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24d00cca60 con 0x7f24b40663a0 2023-07-09T22:01:27.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.797+0000 7f24c5ffb640 1 -- 172.21.15.37:0/3813660509 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306269 (secure 0 0 0) 0x7f24c00b8040 con 0x7f24b40663a0 2023-07-09T22:01:27.806 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:27.808 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:01:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 msgr2=0x7f24b4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 0x7f24b4068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ae000 tx=0x7f24c0001a80 comp rx=0 tx=0).stop 2023-07-09T22:01:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 msgr2=0x7f24d0157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:27.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f24cc0108c0 tx=0x7f24cc010d80 comp rx=0 tx=0).stop 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 shutdown_connections 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f24b40663a0 0x7f24b4068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f24d00ca0d0 0x7f24d00ca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f24d00b5b00 0x7f24d00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 --2- 172.21.15.37:0/3813660509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24bc0047d0 0x7f24d0157850 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 >> 172.21.15.37:0/3813660509 conn(0x7f24d00cea60 msgr2=0x7f24d00b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:27.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 shutdown_connections 2023-07-09T22:01:27.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:27.801+0000 7f24d66af640 1 -- 172.21.15.37:0/3813660509 wait complete. 2023-07-09T22:01:27.825 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T22:01:27.387155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355340,"kb_used_data":20044,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754619380,"statfs":{"total":773094113280,"available":772730245120,"internally_reserved":0,"allocated":20525056,"data_stored":11163188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698343"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706120+0000","last_change":"2023-07-09T22:01:22.706120+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706120+0000","last_undegraded":"2023-07-09T22:01:22.706120+0000","last_fullsized":"2023-07-09T22:01:22.706120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702050+0000","last_change":"2023-07-09T22:01:22.702050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702050+0000","last_undegraded":"2023-07-09T22:01:22.702050+0000","last_fullsized":"2023-07-09T22:01:22.702050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705927+0000","last_change":"2023-07-09T22:01:22.705927+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705927+0000","last_undegraded":"2023-07-09T22:01:22.705927+0000","last_fullsized":"2023-07-09T22:01:22.705927+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707177+0000","last_change":"2023-07-09T22:01:22.707177+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707177+0000","last_undegraded":"2023-07-09T22:01:22.707177+0000","last_fullsized":"2023-07-09T22:01:22.707177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698907+0000","last_change":"2023-07-09T22:01:22.698907+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698907+0000","last_undegraded":"2023-07-09T22:01:22.698907+0000","last_fullsized":"2023-07-09T22:01:22.698907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700501+0000","last_change":"2023-07-09T22:01:22.700501+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700501+0000","last_undegraded":"2023-07-09T22:01:22.700501+0000","last_fullsized":"2023-07-09T22:01:22.700501+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705133+0000","last_change":"2023-07-09T22:01:22.705133+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705133+0000","last_undegraded":"2023-07-09T22:01:22.705133+0000","last_fullsized":"2023-07-09T22:01:22.705133+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.709286+0000","last_change":"2023-07-09T22:01:22.709286+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.709286+0000","last_undegraded":"2023-07-09T22:01:22.709286+0000","last_fullsized":"2023-07-09T22:01:22.709286+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707145+0000","last_change":"2023-07-09T22:01:22.707145+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707145+0000","last_undegraded":"2023-07-09T22:01:22.707145+0000","last_fullsized":"2023-07-09T22:01:22.707145+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704043+0000","last_change":"2023-07-09T22:01:22.704043+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704043+0000","last_undegraded":"2023-07-09T22:01:22.704043+0000","last_fullsized":"2023-07-09T22:01:22.704043+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703515+0000","last_change":"2023-07-09T22:01:22.703515+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703515+0000","last_undegraded":"2023-07-09T22:01:22.703515+0000","last_fullsized":"2023-07-09T22:01:22.703515+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700008+0000","last_change":"2023-07-09T22:01:22.700008+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700008+0000","last_undegraded":"2023-07-09T22:01:22.700008+0000","last_fullsized":"2023-07-09T22:01:22.700008+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.710499+0000","last_change":"2023-07-09T22:01:22.710499+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.710499+0000","last_undegraded":"2023-07-09T22:01:22.710499+0000","last_fullsized":"2023-07-09T22:01:22.710499+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700027+0000","last_change":"2023-07-09T22:01:22.700027+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700027+0000","last_undegraded":"2023-07-09T22:01:22.700027+0000","last_fullsized":"2023-07-09T22:01:22.700027+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701170+0000","last_change":"2023-07-09T22:01:22.701170+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701170+0000","last_undegraded":"2023-07-09T22:01:22.701170+0000","last_fullsized":"2023-07-09T22:01:22.701170+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708215+0000","last_change":"2023-07-09T22:01:22.708215+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708215+0000","last_undegraded":"2023-07-09T22:01:22.708215+0000","last_fullsized":"2023-07-09T22:01:22.708215+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701728+0000","last_change":"2023-07-09T22:01:22.701728+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701728+0000","last_undegraded":"2023-07-09T22:01:22.701728+0000","last_fullsized":"2023-07-09T22:01:22.701728+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703432+0000","last_change":"2023-07-09T22:01:22.703432+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703432+0000","last_undegraded":"2023-07-09T22:01:22.703432+0000","last_fullsized":"2023-07-09T22:01:22.703432+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703046+0000","last_change":"2023-07-09T22:01:22.703046+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703046+0000","last_undegraded":"2023-07-09T22:01:22.703046+0000","last_fullsized":"2023-07-09T22:01:22.703046+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704801+0000","last_change":"2023-07-09T22:01:22.704801+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704801+0000","last_undegraded":"2023-07-09T22:01:22.704801+0000","last_fullsized":"2023-07-09T22:01:22.704801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708684+0000","last_change":"2023-07-09T22:01:22.708684+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708684+0000","last_undegraded":"2023-07-09T22:01:22.708684+0000","last_fullsized":"2023-07-09T22:01:22.708684+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699667+0000","last_change":"2023-07-09T22:01:22.699667+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699667+0000","last_undegraded":"2023-07-09T22:01:22.699667+0000","last_fullsized":"2023-07-09T22:01:22.699667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699476+0000","last_change":"2023-07-09T22:01:22.699476+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699476+0000","last_undegraded":"2023-07-09T22:01:22.699476+0000","last_fullsized":"2023-07-09T22:01:22.699476+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707731+0000","last_change":"2023-07-09T22:01:22.707731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707731+0000","last_undegraded":"2023-07-09T22:01:22.707731+0000","last_fullsized":"2023-07-09T22:01:22.707731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708878+0000","last_change":"2023-07-09T22:01:22.708878+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708878+0000","last_undegraded":"2023-07-09T22:01:22.708878+0000","last_fullsized":"2023-07-09T22:01:22.708878+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703106+0000","last_change":"2023-07-09T22:01:22.703106+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703106+0000","last_undegraded":"2023-07-09T22:01:22.703106+0000","last_fullsized":"2023-07-09T22:01:22.703106+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703197+0000","last_change":"2023-07-09T22:01:22.703197+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703197+0000","last_undegraded":"2023-07-09T22:01:22.703197+0000","last_fullsized":"2023-07-09T22:01:22.703197+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707050+0000","last_change":"2023-07-09T22:01:22.707050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707050+0000","last_undegraded":"2023-07-09T22:01:22.707050+0000","last_fullsized":"2023-07-09T22:01:22.707050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702571+0000","last_change":"2023-07-09T22:01:22.702571+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702571+0000","last_undegraded":"2023-07-09T22:01:22.702571+0000","last_fullsized":"2023-07-09T22:01:22.702571+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704183+0000","last_change":"2023-07-09T22:01:22.704183+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704183+0000","last_undegraded":"2023-07-09T22:01:22.704183+0000","last_fullsized":"2023-07-09T22:01:22.704183+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700710+0000","last_change":"2023-07-09T22:01:22.700710+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700710+0000","last_undegraded":"2023-07-09T22:01:22.700710+0000","last_fullsized":"2023-07-09T22:01:22.700710+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704645+0000","last_change":"2023-07-09T22:01:22.704645+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704645+0000","last_undegraded":"2023-07-09T22:01:22.704645+0000","last_fullsized":"2023-07-09T22:01:22.704645+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700184+0000","last_change":"2023-07-09T22:01:22.700184+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700184+0000","last_undegraded":"2023-07-09T22:01:22.700184+0000","last_fullsized":"2023-07-09T22:01:22.700184+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717723+0000","last_change":"2023-07-09T22:01:22.715731+0000","last_active":"2023-07-09T22:01:22.717723+0000","last_peered":"2023-07-09T22:01:22.717723+0000","last_clean":"2023-07-09T22:01:22.717723+0000","last_became_active":"2023-07-09T22:01:22.715273+0000","last_became_peered":"2023-07-09T22:01:22.715273+0000","last_unstale":"2023-07-09T22:01:22.717723+0000","last_undegraded":"2023-07-09T22:01:22.717723+0000","last_fullsized":"2023-07-09T22:01:22.717723+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:27.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704993+0000","last_change":"2023-07-09T22:01:22.704993+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704993+0000","last_undegraded":"2023-07-09T22:01:22.704993+0000","last_fullsized":"2023-07-09T22:01:22.704993+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720633+0000","last_change":"2023-07-09T22:01:22.718159+0000","last_active":"2023-07-09T22:01:22.720633+0000","last_peered":"2023-07-09T22:01:22.720633+0000","last_clean":"2023-07-09T22:01:22.720633+0000","last_became_active":"2023-07-09T22:01:22.717875+0000","last_became_peered":"2023-07-09T22:01:22.717875+0000","last_unstale":"2023-07-09T22:01:22.720633+0000","last_undegraded":"2023-07-09T22:01:22.720633+0000","last_fullsized":"2023-07-09T22:01:22.720633+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:13.200629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699546+0000","last_change":"2023-07-09T22:01:22.699546+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699546+0000","last_undegraded":"2023-07-09T22:01:22.699546+0000","last_fullsized":"2023-07-09T22:01:22.699546+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720016+0000","last_change":"2023-07-09T22:01:22.718561+0000","last_active":"2023-07-09T22:01:22.720016+0000","last_peered":"2023-07-09T22:01:22.720016+0000","last_clean":"2023-07-09T22:01:22.720016+0000","last_became_active":"2023-07-09T22:01:22.718237+0000","last_became_peered":"2023-07-09T22:01:22.718237+0000","last_unstale":"2023-07-09T22:01:22.720016+0000","last_undegraded":"2023-07-09T22:01:22.720016+0000","last_fullsized":"2023-07-09T22:01:22.720016+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:59:09.972489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701007+0000","last_change":"2023-07-09T22:01:22.701007+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701007+0000","last_undegraded":"2023-07-09T22:01:22.701007+0000","last_fullsized":"2023-07-09T22:01:22.701007+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717061+0000","last_change":"2023-07-09T22:01:22.715327+0000","last_active":"2023-07-09T22:01:22.717061+0000","last_peered":"2023-07-09T22:01:22.717061+0000","last_clean":"2023-07-09T22:01:22.717061+0000","last_became_active":"2023-07-09T22:01:22.715043+0000","last_became_peered":"2023-07-09T22:01:22.715043+0000","last_unstale":"2023-07-09T22:01:22.717061+0000","last_undegraded":"2023-07-09T22:01:22.717061+0000","last_fullsized":"2023-07-09T22:01:22.717061+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:50.672686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703028+0000","last_change":"2023-07-09T22:01:22.703028+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703028+0000","last_undegraded":"2023-07-09T22:01:22.703028+0000","last_fullsized":"2023-07-09T22:01:22.703028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718156+0000","last_change":"2023-07-09T22:01:22.715924+0000","last_active":"2023-07-09T22:01:22.718156+0000","last_peered":"2023-07-09T22:01:22.718156+0000","last_clean":"2023-07-09T22:01:22.718156+0000","last_became_active":"2023-07-09T22:01:22.715637+0000","last_became_peered":"2023-07-09T22:01:22.715637+0000","last_unstale":"2023-07-09T22:01:22.718156+0000","last_undegraded":"2023-07-09T22:01:22.718156+0000","last_fullsized":"2023-07-09T22:01:22.718156+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:56.532342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699397+0000","last_change":"2023-07-09T22:01:22.699397+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699397+0000","last_undegraded":"2023-07-09T22:01:22.699397+0000","last_fullsized":"2023-07-09T22:01:22.699397+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712882+0000","last_change":"2023-07-09T22:01:22.707769+0000","last_active":"2023-07-09T22:01:22.712882+0000","last_peered":"2023-07-09T22:01:22.712882+0000","last_clean":"2023-07-09T22:01:22.712882+0000","last_became_active":"2023-07-09T22:01:22.707486+0000","last_became_peered":"2023-07-09T22:01:22.707486+0000","last_unstale":"2023-07-09T22:01:22.712882+0000","last_undegraded":"2023-07-09T22:01:22.712882+0000","last_fullsized":"2023-07-09T22:01:22.712882+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:55.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699032+0000","last_change":"2023-07-09T22:01:22.699032+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699032+0000","last_undegraded":"2023-07-09T22:01:22.699032+0000","last_fullsized":"2023-07-09T22:01:22.699032+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720871+0000","last_change":"2023-07-09T22:01:22.717274+0000","last_active":"2023-07-09T22:01:22.720871+0000","last_peered":"2023-07-09T22:01:22.720871+0000","last_clean":"2023-07-09T22:01:22.720871+0000","last_became_active":"2023-07-09T22:01:22.715566+0000","last_became_peered":"2023-07-09T22:01:22.715566+0000","last_unstale":"2023-07-09T22:01:22.720871+0000","last_undegraded":"2023-07-09T22:01:22.720871+0000","last_fullsized":"2023-07-09T22:01:22.720871+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:38.659620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705603+0000","last_change":"2023-07-09T22:01:22.705603+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705603+0000","last_undegraded":"2023-07-09T22:01:22.705603+0000","last_fullsized":"2023-07-09T22:01:22.705603+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718280+0000","last_change":"2023-07-09T22:01:22.716202+0000","last_active":"2023-07-09T22:01:22.718280+0000","last_peered":"2023-07-09T22:01:22.718280+0000","last_clean":"2023-07-09T22:01:22.718280+0000","last_became_active":"2023-07-09T22:01:22.715939+0000","last_became_peered":"2023-07-09T22:01:22.715939+0000","last_unstale":"2023-07-09T22:01:22.718280+0000","last_undegraded":"2023-07-09T22:01:22.718280+0000","last_fullsized":"2023-07-09T22:01:22.718280+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:43.985311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701955+0000","last_change":"2023-07-09T22:01:22.701955+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701955+0000","last_undegraded":"2023-07-09T22:01:22.701955+0000","last_fullsized":"2023-07-09T22:01:22.701955+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720677+0000","last_change":"2023-07-09T22:01:22.712512+0000","last_active":"2023-07-09T22:01:22.720677+0000","last_peered":"2023-07-09T22:01:22.720677+0000","last_clean":"2023-07-09T22:01:22.720677+0000","last_became_active":"2023-07-09T22:01:22.712232+0000","last_became_peered":"2023-07-09T22:01:22.712232+0000","last_unstale":"2023-07-09T22:01:22.720677+0000","last_undegraded":"2023-07-09T22:01:22.720677+0000","last_fullsized":"2023-07-09T22:01:22.720677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:09.561358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705981+0000","last_change":"2023-07-09T22:01:22.705981+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705981+0000","last_undegraded":"2023-07-09T22:01:22.705981+0000","last_fullsized":"2023-07-09T22:01:22.705981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.723151+0000","last_change":"2023-07-09T22:01:22.721233+0000","last_active":"2023-07-09T22:01:22.723151+0000","last_peered":"2023-07-09T22:01:22.723151+0000","last_clean":"2023-07-09T22:01:22.723151+0000","last_became_active":"2023-07-09T22:01:22.720929+0000","last_became_peered":"2023-07-09T22:01:22.720929+0000","last_unstale":"2023-07-09T22:01:22.723151+0000","last_undegraded":"2023-07-09T22:01:22.723151+0000","last_fullsized":"2023-07-09T22:01:22.723151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:36:21.099465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700038+0000","last_change":"2023-07-09T22:01:22.700038+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700038+0000","last_undegraded":"2023-07-09T22:01:22.700038+0000","last_fullsized":"2023-07-09T22:01:22.700038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713603+0000","last_change":"2023-07-09T22:01:22.711186+0000","last_active":"2023-07-09T22:01:22.713603+0000","last_peered":"2023-07-09T22:01:22.713603+0000","last_clean":"2023-07-09T22:01:22.713603+0000","last_became_active":"2023-07-09T22:01:22.710901+0000","last_became_peered":"2023-07-09T22:01:22.710901+0000","last_unstale":"2023-07-09T22:01:22.713603+0000","last_undegraded":"2023-07-09T22:01:22.713603+0000","last_fullsized":"2023-07-09T22:01:22.713603+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:57.127428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702180+0000","last_change":"2023-07-09T22:01:22.702180+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702180+0000","last_undegraded":"2023-07-09T22:01:22.702180+0000","last_fullsized":"2023-07-09T22:01:22.702180+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719454+0000","last_change":"2023-07-09T22:01:22.716955+0000","last_active":"2023-07-09T22:01:22.719454+0000","last_peered":"2023-07-09T22:01:22.719454+0000","last_clean":"2023-07-09T22:01:22.719454+0000","last_became_active":"2023-07-09T22:01:22.716695+0000","last_became_peered":"2023-07-09T22:01:22.716695+0000","last_unstale":"2023-07-09T22:01:22.719454+0000","last_undegraded":"2023-07-09T22:01:22.719454+0000","last_fullsized":"2023-07-09T22:01:22.719454+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:45.561939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702731+0000","last_change":"2023-07-09T22:01:22.702731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702731+0000","last_undegraded":"2023-07-09T22:01:22.702731+0000","last_fullsized":"2023-07-09T22:01:22.702731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713751+0000","last_change":"2023-07-09T22:01:22.710096+0000","last_active":"2023-07-09T22:01:22.713751+0000","last_peered":"2023-07-09T22:01:22.713751+0000","last_clean":"2023-07-09T22:01:22.713751+0000","last_became_active":"2023-07-09T22:01:22.709830+0000","last_became_peered":"2023-07-09T22:01:22.709830+0000","last_unstale":"2023-07-09T22:01:22.713751+0000","last_undegraded":"2023-07-09T22:01:22.713751+0000","last_fullsized":"2023-07-09T22:01:22.713751+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:08.779913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698615+0000","last_change":"2023-07-09T22:01:22.698615+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698615+0000","last_undegraded":"2023-07-09T22:01:22.698615+0000","last_fullsized":"2023-07-09T22:01:22.698615+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.724861+0000","last_change":"2023-07-09T22:01:22.724154+0000","last_active":"2023-07-09T22:01:22.724861+0000","last_peered":"2023-07-09T22:01:22.724861+0000","last_clean":"2023-07-09T22:01:22.724861+0000","last_became_active":"2023-07-09T22:01:22.723898+0000","last_became_peered":"2023-07-09T22:01:22.723898+0000","last_unstale":"2023-07-09T22:01:22.724861+0000","last_undegraded":"2023-07-09T22:01:22.724861+0000","last_fullsized":"2023-07-09T22:01:22.724861+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:01:25.517184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698845+0000","last_change":"2023-07-09T22:01:22.698845+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698845+0000","last_undegraded":"2023-07-09T22:01:22.698845+0000","last_fullsized":"2023-07-09T22:01:22.698845+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717097+0000","last_change":"2023-07-09T22:01:22.714987+0000","last_active":"2023-07-09T22:01:22.717097+0000","last_peered":"2023-07-09T22:01:22.717097+0000","last_clean":"2023-07-09T22:01:22.717097+0000","last_became_active":"2023-07-09T22:01:22.709986+0000","last_became_peered":"2023-07-09T22:01:22.709986+0000","last_unstale":"2023-07-09T22:01:22.717097+0000","last_undegraded":"2023-07-09T22:01:22.717097+0000","last_fullsized":"2023-07-09T22:01:22.717097+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:51.712361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702403+0000","last_change":"2023-07-09T22:01:22.702403+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702403+0000","last_undegraded":"2023-07-09T22:01:22.702403+0000","last_fullsized":"2023-07-09T22:01:22.702403+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.716447+0000","last_change":"2023-07-09T22:01:22.712957+0000","last_active":"2023-07-09T22:01:22.716447+0000","last_peered":"2023-07-09T22:01:22.716447+0000","last_clean":"2023-07-09T22:01:22.716447+0000","last_became_active":"2023-07-09T22:01:22.712670+0000","last_became_peered":"2023-07-09T22:01:22.712670+0000","last_unstale":"2023-07-09T22:01:22.716447+0000","last_undegraded":"2023-07-09T22:01:22.716447+0000","last_fullsized":"2023-07-09T22:01:22.716447+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:43.538177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699736+0000","last_change":"2023-07-09T22:01:22.699736+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699736+0000","last_undegraded":"2023-07-09T22:01:22.699736+0000","last_fullsized":"2023-07-09T22:01:22.699736+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712992+0000","last_change":"2023-07-09T22:01:22.709765+0000","last_active":"2023-07-09T22:01:22.712992+0000","last_peered":"2023-07-09T22:01:22.712992+0000","last_clean":"2023-07-09T22:01:22.712992+0000","last_became_active":"2023-07-09T22:01:22.708560+0000","last_became_peered":"2023-07-09T22:01:22.708560+0000","last_unstale":"2023-07-09T22:01:22.712992+0000","last_undegraded":"2023-07-09T22:01:22.712992+0000","last_fullsized":"2023-07-09T22:01:22.712992+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:52.687950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702033+0000","last_change":"2023-07-09T22:01:22.702033+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702033+0000","last_undegraded":"2023-07-09T22:01:22.702033+0000","last_fullsized":"2023-07-09T22:01:22.702033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722105+0000","last_change":"2023-07-09T22:01:22.719697+0000","last_active":"2023-07-09T22:01:22.722105+0000","last_peered":"2023-07-09T22:01:22.722105+0000","last_clean":"2023-07-09T22:01:22.722105+0000","last_became_active":"2023-07-09T22:01:22.719063+0000","last_became_peered":"2023-07-09T22:01:22.719063+0000","last_unstale":"2023-07-09T22:01:22.722105+0000","last_undegraded":"2023-07-09T22:01:22.722105+0000","last_fullsized":"2023-07-09T22:01:22.722105+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:38.288817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699163+0000","last_change":"2023-07-09T22:01:22.699163+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699163+0000","last_undegraded":"2023-07-09T22:01:22.699163+0000","last_fullsized":"2023-07-09T22:01:22.699163+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720298+0000","last_change":"2023-07-09T22:01:22.714900+0000","last_active":"2023-07-09T22:01:22.720298+0000","last_peered":"2023-07-09T22:01:22.720298+0000","last_clean":"2023-07-09T22:01:22.720298+0000","last_became_active":"2023-07-09T22:01:22.714627+0000","last_became_peered":"2023-07-09T22:01:22.714627+0000","last_unstale":"2023-07-09T22:01:22.720298+0000","last_undegraded":"2023-07-09T22:01:22.720298+0000","last_fullsized":"2023-07-09T22:01:22.720298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:22.412609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701743+0000","last_change":"2023-07-09T22:01:22.701743+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701743+0000","last_undegraded":"2023-07-09T22:01:22.701743+0000","last_fullsized":"2023-07-09T22:01:22.701743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.721960+0000","last_change":"2023-07-09T22:01:22.721160+0000","last_active":"2023-07-09T22:01:22.721960+0000","last_peered":"2023-07-09T22:01:22.721960+0000","last_clean":"2023-07-09T22:01:22.721960+0000","last_became_active":"2023-07-09T22:01:22.720842+0000","last_became_peered":"2023-07-09T22:01:22.720842+0000","last_unstale":"2023-07-09T22:01:22.721960+0000","last_undegraded":"2023-07-09T22:01:22.721960+0000","last_fullsized":"2023-07-09T22:01:22.721960+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:11:37.760665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706666+0000","last_change":"2023-07-09T22:01:22.706666+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706666+0000","last_undegraded":"2023-07-09T22:01:22.706666+0000","last_fullsized":"2023-07-09T22:01:22.706666+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717030+0000","last_change":"2023-07-09T22:01:22.714982+0000","last_active":"2023-07-09T22:01:22.717030+0000","last_peered":"2023-07-09T22:01:22.717030+0000","last_clean":"2023-07-09T22:01:22.717030+0000","last_became_active":"2023-07-09T22:01:22.714665+0000","last_became_peered":"2023-07-09T22:01:22.714665+0000","last_unstale":"2023-07-09T22:01:22.717030+0000","last_undegraded":"2023-07-09T22:01:22.717030+0000","last_fullsized":"2023-07-09T22:01:22.717030+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:30:27.738602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702745+0000","last_change":"2023-07-09T22:01:22.702745+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702745+0000","last_undegraded":"2023-07-09T22:01:22.702745+0000","last_fullsized":"2023-07-09T22:01:22.702745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720386+0000","last_change":"2023-07-09T22:01:22.716729+0000","last_active":"2023-07-09T22:01:22.720386+0000","last_peered":"2023-07-09T22:01:22.720386+0000","last_clean":"2023-07-09T22:01:22.720386+0000","last_became_active":"2023-07-09T22:01:22.716453+0000","last_became_peered":"2023-07-09T22:01:22.716453+0000","last_unstale":"2023-07-09T22:01:22.720386+0000","last_undegraded":"2023-07-09T22:01:22.720386+0000","last_fullsized":"2023-07-09T22:01:22.720386+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:56.554277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705528+0000","last_change":"2023-07-09T22:01:22.705528+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705528+0000","last_undegraded":"2023-07-09T22:01:22.705528+0000","last_fullsized":"2023-07-09T22:01:22.705528+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720432+0000","last_change":"2023-07-09T22:01:22.719319+0000","last_active":"2023-07-09T22:01:22.720432+0000","last_peered":"2023-07-09T22:01:22.720432+0000","last_clean":"2023-07-09T22:01:22.720432+0000","last_became_active":"2023-07-09T22:01:22.718992+0000","last_became_peered":"2023-07-09T22:01:22.718992+0000","last_unstale":"2023-07-09T22:01:22.720432+0000","last_undegraded":"2023-07-09T22:01:22.720432+0000","last_fullsized":"2023-07-09T22:01:22.720432+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:45.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698581+0000","last_change":"2023-07-09T22:01:22.698581+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698581+0000","last_undegraded":"2023-07-09T22:01:22.698581+0000","last_fullsized":"2023-07-09T22:01:22.698581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712961+0000","last_change":"2023-07-09T22:01:22.707404+0000","last_active":"2023-07-09T22:01:22.712961+0000","last_peered":"2023-07-09T22:01:22.712961+0000","last_clean":"2023-07-09T22:01:22.712961+0000","last_became_active":"2023-07-09T22:01:22.707132+0000","last_became_peered":"2023-07-09T22:01:22.707132+0000","last_unstale":"2023-07-09T22:01:22.712961+0000","last_undegraded":"2023-07-09T22:01:22.712961+0000","last_fullsized":"2023-07-09T22:01:22.712961+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:55:55.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699588+0000","last_change":"2023-07-09T22:01:22.699588+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699588+0000","last_undegraded":"2023-07-09T22:01:22.699588+0000","last_fullsized":"2023-07-09T22:01:22.699588+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722125+0000","last_change":"2023-07-09T22:01:22.719872+0000","last_active":"2023-07-09T22:01:22.722125+0000","last_peered":"2023-07-09T22:01:22.722125+0000","last_clean":"2023-07-09T22:01:22.722125+0000","last_became_active":"2023-07-09T22:01:22.719439+0000","last_became_peered":"2023-07-09T22:01:22.719439+0000","last_unstale":"2023-07-09T22:01:22.722125+0000","last_undegraded":"2023-07-09T22:01:22.722125+0000","last_fullsized":"2023-07-09T22:01:22.722125+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:06.238635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1227,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705352+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:01:22.705352+0000","last_peered":"2023-07-09T22:01:22.705352+0000","last_clean":"2023-07-09T22:01:22.705352+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:01:22.705352+0000","last_undegraded":"2023-07-09T22:01:22.705352+0000","last_fullsized":"2023-07-09T22:01:22.705352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:21.495358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705411+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:01:22.705411+0000","last_peered":"2023-07-09T22:01:22.705411+0000","last_clean":"2023-07-09T22:01:22.705411+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:01:22.705411+0000","last_undegraded":"2023-07-09T22:01:22.705411+0000","last_fullsized":"2023-07-09T22:01:22.705411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:05.715239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705077+0000","last_change":"2023-07-09T22:01:22.705077+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705077+0000","last_undegraded":"2023-07-09T22:01:22.705077+0000","last_fullsized":"2023-07-09T22:01:22.705077+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717001+0000","last_change":"2023-07-09T22:01:22.714653+0000","last_active":"2023-07-09T22:01:22.717001+0000","last_peered":"2023-07-09T22:01:22.717001+0000","last_clean":"2023-07-09T22:01:22.717001+0000","last_became_active":"2023-07-09T22:01:22.714202+0000","last_became_peered":"2023-07-09T22:01:22.714202+0000","last_unstale":"2023-07-09T22:01:22.717001+0000","last_undegraded":"2023-07-09T22:01:22.717001+0000","last_fullsized":"2023-07-09T22:01:22.717001+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:15:40.623736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":330,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705222+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:01:22.705222+0000","last_peered":"2023-07-09T22:01:22.705222+0000","last_clean":"2023-07-09T22:01:22.705222+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:01:22.705222+0000","last_undegraded":"2023-07-09T22:01:22.705222+0000","last_fullsized":"2023-07-09T22:01:22.705222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:07:02.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699076+0000","last_change":"2023-07-09T22:01:22.699076+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699076+0000","last_undegraded":"2023-07-09T22:01:22.699076+0000","last_fullsized":"2023-07-09T22:01:22.699076+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720735+0000","last_change":"2023-07-09T22:01:22.718035+0000","last_active":"2023-07-09T22:01:22.720735+0000","last_peered":"2023-07-09T22:01:22.720735+0000","last_clean":"2023-07-09T22:01:22.720735+0000","last_became_active":"2023-07-09T22:01:22.717691+0000","last_became_peered":"2023-07-09T22:01:22.717691+0000","last_unstale":"2023-07-09T22:01:22.720735+0000","last_undegraded":"2023-07-09T22:01:22.720735+0000","last_fullsized":"2023-07-09T22:01:22.720735+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:30:35.329450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.700982+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:01:22.700982+0000","last_peered":"2023-07-09T22:01:22.700982+0000","last_clean":"2023-07-09T22:01:22.700982+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:01:22.700982+0000","last_undegraded":"2023-07-09T22:01:22.700982+0000","last_fullsized":"2023-07-09T22:01:22.700982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:44.666312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700751+0000","last_change":"2023-07-09T22:01:22.700751+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700751+0000","last_undegraded":"2023-07-09T22:01:22.700751+0000","last_fullsized":"2023-07-09T22:01:22.700751+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722974+0000","last_change":"2023-07-09T22:01:22.720784+0000","last_active":"2023-07-09T22:01:22.722974+0000","last_peered":"2023-07-09T22:01:22.722974+0000","last_clean":"2023-07-09T22:01:22.722974+0000","last_became_active":"2023-07-09T22:01:22.720486+0000","last_became_peered":"2023-07-09T22:01:22.720486+0000","last_unstale":"2023-07-09T22:01:22.722974+0000","last_undegraded":"2023-07-09T22:01:22.722974+0000","last_fullsized":"2023-07-09T22:01:22.722974+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:22.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704835+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:01:22.704835+0000","last_peered":"2023-07-09T22:01:22.704835+0000","last_clean":"2023-07-09T22:01:22.704835+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:01:22.704835+0000","last_undegraded":"2023-07-09T22:01:22.704835+0000","last_fullsized":"2023-07-09T22:01:22.704835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:44.309853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701433+0000","last_change":"2023-07-09T22:01:22.701433+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701433+0000","last_undegraded":"2023-07-09T22:01:22.701433+0000","last_fullsized":"2023-07-09T22:01:22.701433+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713115+0000","last_change":"2023-07-09T22:01:22.708768+0000","last_active":"2023-07-09T22:01:22.713115+0000","last_peered":"2023-07-09T22:01:22.713115+0000","last_clean":"2023-07-09T22:01:22.713115+0000","last_became_active":"2023-07-09T22:01:22.708312+0000","last_became_peered":"2023-07-09T22:01:22.708312+0000","last_unstale":"2023-07-09T22:01:22.713115+0000","last_undegraded":"2023-07-09T22:01:22.713115+0000","last_fullsized":"2023-07-09T22:01:22.713115+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:00.877979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.706954+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:01:22.706954+0000","last_peered":"2023-07-09T22:01:22.706954+0000","last_clean":"2023-07-09T22:01:22.706954+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:01:22.706954+0000","last_undegraded":"2023-07-09T22:01:22.706954+0000","last_fullsized":"2023-07-09T22:01:22.706954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:44.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700880+0000","last_change":"2023-07-09T22:01:22.700880+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700880+0000","last_undegraded":"2023-07-09T22:01:22.700880+0000","last_fullsized":"2023-07-09T22:01:22.700880+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718262+0000","last_change":"2023-07-09T22:01:22.716008+0000","last_active":"2023-07-09T22:01:22.718262+0000","last_peered":"2023-07-09T22:01:22.718262+0000","last_clean":"2023-07-09T22:01:22.718262+0000","last_became_active":"2023-07-09T22:01:22.715729+0000","last_became_peered":"2023-07-09T22:01:22.715729+0000","last_unstale":"2023-07-09T22:01:22.718262+0000","last_undegraded":"2023-07-09T22:01:22.718262+0000","last_fullsized":"2023-07-09T22:01:22.718262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:20:28.978973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":329,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.708790+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:01:22.708790+0000","last_peered":"2023-07-09T22:01:22.708790+0000","last_clean":"2023-07-09T22:01:22.708790+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:01:22.708790+0000","last_undegraded":"2023-07-09T22:01:22.708790+0000","last_fullsized":"2023-07-09T22:01:22.708790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:41.059249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704695+0000","last_change":"2023-07-09T22:01:22.704695+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704695+0000","last_undegraded":"2023-07-09T22:01:22.704695+0000","last_fullsized":"2023-07-09T22:01:22.704695+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712831+0000","last_change":"2023-07-09T22:01:22.708500+0000","last_active":"2023-07-09T22:01:22.712831+0000","last_peered":"2023-07-09T22:01:22.712831+0000","last_clean":"2023-07-09T22:01:22.712831+0000","last_became_active":"2023-07-09T22:01:22.708177+0000","last_became_peered":"2023-07-09T22:01:22.708177+0000","last_unstale":"2023-07-09T22:01:22.712831+0000","last_undegraded":"2023-07-09T22:01:22.712831+0000","last_fullsized":"2023-07-09T22:01:22.712831+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:04.644983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":323,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704311+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:01:22.704311+0000","last_peered":"2023-07-09T22:01:22.704311+0000","last_clean":"2023-07-09T22:01:22.704311+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:01:22.704311+0000","last_undegraded":"2023-07-09T22:01:22.704311+0000","last_fullsized":"2023-07-09T22:01:22.704311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:41.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706346+0000","last_change":"2023-07-09T22:01:22.706346+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706346+0000","last_undegraded":"2023-07-09T22:01:22.706346+0000","last_fullsized":"2023-07-09T22:01:22.706346+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719347+0000","last_change":"2023-07-09T22:01:22.711803+0000","last_active":"2023-07-09T22:01:22.719347+0000","last_peered":"2023-07-09T22:01:22.719347+0000","last_clean":"2023-07-09T22:01:22.719347+0000","last_became_active":"2023-07-09T22:01:22.709155+0000","last_became_peered":"2023-07-09T22:01:22.709155+0000","last_unstale":"2023-07-09T22:01:22.719347+0000","last_undegraded":"2023-07-09T22:01:22.719347+0000","last_fullsized":"2023-07-09T22:01:22.719347+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:56:18.713961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704055+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:01:22.704055+0000","last_peered":"2023-07-09T22:01:22.704055+0000","last_clean":"2023-07-09T22:01:22.704055+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:01:22.704055+0000","last_undegraded":"2023-07-09T22:01:22.704055+0000","last_fullsized":"2023-07-09T22:01:22.704055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:11.876041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47948,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323892,"statfs":{"total":96636764160,"available":96587665408,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95899999999999996,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.036,"15min":1.036},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.107,"15min":1.107},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.014,"5min":1.0509999999999999,"15min":1.077},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75}]},{"osd":6,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575310,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":1.075,"15min":1.075},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":0.999,"15min":1.04},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98199999999999998,"15min":1.177},"last":0.752},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.1890000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.504},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":1.02,"15min":1.026},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85299999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.92600000000000005,"5min":0.94899999999999995,"15min":1.161},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.099},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.052},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":1.01,"15min":1.0860000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94599999999999995,"5min":1.016,"15min":1.077},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575309,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89300000000000002,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.05},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88500000000000001,"5min":1.095,"15min":1.095},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.034},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.59799999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.81100000000000005,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1251979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":1.075},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95199999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":0.998,"15min":1.03},"last":0.79300000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0800000000000001,"15min":1.0960000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61599999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.026,"5min":1.038,"15min":1.1240000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.84899999999999998,"5min":1.05,"15min":1.079},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.016},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.96499999999999997,"15min":1.018},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.069},"last":0.997}]},{"osd":7,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77200000000000002,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0149999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.375}]},{"osd":1,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.133},"last":0.308},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.194},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.5429999999999999},"last":0.752},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85499999999999998},"min":{"1min":0.65300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.014,"5min":1.133,"15min":1.5649999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.05,"5min":1.1479999999999999,"15min":1.302},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1879999999999999,"15min":1.262},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79700000000000004,"15min":0.79600000000000004},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81399999999999995,"15min":0.82099999999999995},"min":{"1min":0.57499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575311,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312196,"statfs":{"total":96636764160,"available":96575688704,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.77100000000000002,"5min":0.78600000000000003,"15min":0.85099999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.016},"last":0.501},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":1.117,"15min":1.337},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.45000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1970000000000001,"15min":1.306},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.57699999999999996},"max":{"1min":1.304,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.111,"15min":1.375},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.70599999999999996,"5min":0.59499999999999997,"15min":0.52200000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.294},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.1499999999999999,"5min":1.2809999999999999,"15min":1.298},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1679999999999999,"5min":1.196,"15min":1.256},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.46999999999999997},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.373}]},{"osd":2,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81799999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.89200000000000002},"last":0.54100000000000004}]},{"osd":3,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.79800000000000004,"5min":0.879,"15min":0.96999999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.84699999999999998,"15min":0.83999999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.2769999999999999,"15min":1.337},"last":0.80000000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.67500000000000004,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.55100000000000005,"15min":0.45600000000000002},"max":{"1min":0.90200000000000002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.79000000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48899999999999999},"max":{"1min":1.0249999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.157,"15min":1.1659999999999999},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.006,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":1},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83799999999999997,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":0.97799999999999998,"5min":1.321,"15min":1.321},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834575311,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42188,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329652,"statfs":{"total":96636764160,"available":96593563648,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.90300000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":0.93899999999999995},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1850000000000001,"5min":1.306,"15min":1.306},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.3260000000000001,"15min":1.381},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.55000000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.3400000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":1.2210000000000001,"5min":1.397,"15min":1.397},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:01:27.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:01:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 Processor -- start 2023-07-09T22:01:28.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 -- start start 2023-07-09T22:01:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb5c40cef80 0x7fb5c406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40b49f0 con 0x7fb5c40b4340 2023-07-09T22:01:28.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5c40cc8a0 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5caddb640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c40b7e80 con 0x7fb5c40cef80 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb5c40b4340 0x7fb5c40d02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60406/0 (socket says 172.21.15.37:60406) 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c3fff640 1 -- 172.21.15.37:0/2338150623 learned_addr learned my addr 172.21.15.37:0/2338150623 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c9378640 1 --2- 172.21.15.37:0/2338150623 >> v2:172.21.15.119:3300/0 conn(0x7fb5c40cef80 0x7fb5c406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c37fe640 1 -- 172.21.15.37:0/2338150623 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012345106 0 0) 0x7fb5c40b49f0 con 0x7fb5c40b4340 2023-07-09T22:01:28.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c37fe640 1 -- 172.21.15.37:0/2338150623 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5b4003530 con 0x7fb5c40b4340 2023-07-09T22:01:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c9378640 1 -- 172.21.15.37:0/2338150623 >> v1:172.21.15.119:6789/0 conn(0x7fb5c40b7ab0 legacy=0x7fb5c40b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c9378640 1 -- 172.21.15.37:0/2338150623 >> v1:172.21.15.37:6789/0 conn(0x7fb5c40b4340 legacy=0x7fb5c40d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.005+0000 7fb5c9378640 1 -- 172.21.15.37:0/2338150623 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c40ccb80 con 0x7fb5c40cef80 2023-07-09T22:01:28.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5c9378640 1 --2- 172.21.15.37:0/2338150623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c406aa50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009d90 tx=0x7fb5bc01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e25cd43bef738606 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5c37fe640 1 -- 172.21.15.37:0/2338150623 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0a59e0 con 0x7fb5c40cef80 2023-07-09T22:01:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5c37fe640 1 -- 172.21.15.37:0/2338150623 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5bc0a5b40 con 0x7fb5c40cef80 2023-07-09T22:01:28.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5c37fe640 1 -- 172.21.15.37:0/2338150623 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5bc0ad440 con 0x7fb5c40cef80 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 -- 172.21.15.37:0/2338150623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 msgr2=0x7fb5c406aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 --2- 172.21.15.37:0/2338150623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c406aa50 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc009d90 tx=0x7fb5bc01c920 comp rx=0 tx=0).stop 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 -- 172.21.15.37:0/2338150623 shutdown_connections 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 --2- 172.21.15.37:0/2338150623 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c406aa50 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 -- 172.21.15.37:0/2338150623 >> 172.21.15.37:0/2338150623 conn(0x7fb5c4073090 msgr2=0x7fb5c4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:28.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 -- 172.21.15.37:0/2338150623 shutdown_connections 2023-07-09T22:01:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.009+0000 7fb5caddb640 1 -- 172.21.15.37:0/2338150623 wait complete. 2023-07-09T22:01:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 Processor -- start 2023-07-09T22:01:28.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 -- start start 2023-07-09T22:01:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5c40b4340 0x7fb5c414f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c414ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40cbec0 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40cb2b0 con 0x7fb5c40cef80 2023-07-09T22:01:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5caddb640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40cb590 con 0x7fb5c40b4340 2023-07-09T22:01:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51404/0 (socket says 172.21.15.37:51404) 2023-07-09T22:01:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 -- 172.21.15.37:0/3370610431 learned_addr learned my addr 172.21.15.37:0/3370610431 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c9378640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c414ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c8b77640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5c40b4340 0x7fb5c414f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 -- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5c40b4340 msgr2=0x7fb5c414f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5c40b4340 0x7fb5c414f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 -- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 msgr2=0x7fb5c414ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c414ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 -- 172.21.15.37:0/3370610431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc009a70 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.013+0000 7fb5c3fff640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0001ec0 tx=0x7fb5b000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0005d50 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b0007070 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0007420 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c40cb870 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c40caed0 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c404d7d0 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5b0007580 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 0x7fb5a8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb5b0083070 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.017+0000 7fb5c8b77640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 0x7fb5a8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.021+0000 7fb5c8b77640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 0x7fb5a8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007fd0 tx=0x7fb5b8009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.021+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5b0050510 con 0x7fb5c40b7ab0 2023-07-09T22:01:28.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.173+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5c40cf4d0 con 0x7fb5a80663a0 2023-07-09T22:01:28.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.181+0000 7fb5c17fa640 1 -- 172.21.15.37:0/3370610431 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306269 (secure 0 0 0) 0x7fb5b80014f0 con 0x7fb5a80663a0 2023-07-09T22:01:28.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:28.194 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:01:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 msgr2=0x7fb5a8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 0x7fb5a8068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb5b8007fd0 tx=0x7fb5b8009040 comp rx=0 tx=0).stop 2023-07-09T22:01:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 msgr2=0x7fb5c41503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0001ec0 tx=0x7fb5b000c960 comp rx=0 tx=0).stop 2023-07-09T22:01:28.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 shutdown_connections 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb5a80663a0 0x7fb5a8068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb5c40cef80 0x7fb5c414ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c40b7ab0 0x7fb5c41503b0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 --2- 172.21.15.37:0/3370610431 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb5c40b4340 0x7fb5c414f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.185+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 >> 172.21.15.37:0/3370610431 conn(0x7fb5c4073090 msgr2=0x7fb5c4069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.189+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 shutdown_connections 2023-07-09T22:01:28.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.189+0000 7fb5caddb640 1 -- 172.21.15.37:0/3370610431 wait complete. 2023-07-09T22:01:28.213 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T22:01:27.387155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355340,"kb_used_data":20044,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754619380,"statfs":{"total":773094113280,"available":772730245120,"internally_reserved":0,"allocated":20525056,"data_stored":11163188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698343"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706120+0000","last_change":"2023-07-09T22:01:22.706120+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706120+0000","last_undegraded":"2023-07-09T22:01:22.706120+0000","last_fullsized":"2023-07-09T22:01:22.706120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702050+0000","last_change":"2023-07-09T22:01:22.702050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702050+0000","last_undegraded":"2023-07-09T22:01:22.702050+0000","last_fullsized":"2023-07-09T22:01:22.702050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705927+0000","last_change":"2023-07-09T22:01:22.705927+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705927+0000","last_undegraded":"2023-07-09T22:01:22.705927+0000","last_fullsized":"2023-07-09T22:01:22.705927+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707177+0000","last_change":"2023-07-09T22:01:22.707177+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707177+0000","last_undegraded":"2023-07-09T22:01:22.707177+0000","last_fullsized":"2023-07-09T22:01:22.707177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698907+0000","last_change":"2023-07-09T22:01:22.698907+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698907+0000","last_undegraded":"2023-07-09T22:01:22.698907+0000","last_fullsized":"2023-07-09T22:01:22.698907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700501+0000","last_change":"2023-07-09T22:01:22.700501+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700501+0000","last_undegraded":"2023-07-09T22:01:22.700501+0000","last_fullsized":"2023-07-09T22:01:22.700501+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705133+0000","last_change":"2023-07-09T22:01:22.705133+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705133+0000","last_undegraded":"2023-07-09T22:01:22.705133+0000","last_fullsized":"2023-07-09T22:01:22.705133+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.709286+0000","last_change":"2023-07-09T22:01:22.709286+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.709286+0000","last_undegraded":"2023-07-09T22:01:22.709286+0000","last_fullsized":"2023-07-09T22:01:22.709286+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707145+0000","last_change":"2023-07-09T22:01:22.707145+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707145+0000","last_undegraded":"2023-07-09T22:01:22.707145+0000","last_fullsized":"2023-07-09T22:01:22.707145+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704043+0000","last_change":"2023-07-09T22:01:22.704043+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704043+0000","last_undegraded":"2023-07-09T22:01:22.704043+0000","last_fullsized":"2023-07-09T22:01:22.704043+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703515+0000","last_change":"2023-07-09T22:01:22.703515+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703515+0000","last_undegraded":"2023-07-09T22:01:22.703515+0000","last_fullsized":"2023-07-09T22:01:22.703515+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700008+0000","last_change":"2023-07-09T22:01:22.700008+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700008+0000","last_undegraded":"2023-07-09T22:01:22.700008+0000","last_fullsized":"2023-07-09T22:01:22.700008+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.710499+0000","last_change":"2023-07-09T22:01:22.710499+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.710499+0000","last_undegraded":"2023-07-09T22:01:22.710499+0000","last_fullsized":"2023-07-09T22:01:22.710499+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700027+0000","last_change":"2023-07-09T22:01:22.700027+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700027+0000","last_undegraded":"2023-07-09T22:01:22.700027+0000","last_fullsized":"2023-07-09T22:01:22.700027+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701170+0000","last_change":"2023-07-09T22:01:22.701170+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701170+0000","last_undegraded":"2023-07-09T22:01:22.701170+0000","last_fullsized":"2023-07-09T22:01:22.701170+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708215+0000","last_change":"2023-07-09T22:01:22.708215+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708215+0000","last_undegraded":"2023-07-09T22:01:22.708215+0000","last_fullsized":"2023-07-09T22:01:22.708215+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701728+0000","last_change":"2023-07-09T22:01:22.701728+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701728+0000","last_undegraded":"2023-07-09T22:01:22.701728+0000","last_fullsized":"2023-07-09T22:01:22.701728+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703432+0000","last_change":"2023-07-09T22:01:22.703432+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703432+0000","last_undegraded":"2023-07-09T22:01:22.703432+0000","last_fullsized":"2023-07-09T22:01:22.703432+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703046+0000","last_change":"2023-07-09T22:01:22.703046+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703046+0000","last_undegraded":"2023-07-09T22:01:22.703046+0000","last_fullsized":"2023-07-09T22:01:22.703046+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704801+0000","last_change":"2023-07-09T22:01:22.704801+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704801+0000","last_undegraded":"2023-07-09T22:01:22.704801+0000","last_fullsized":"2023-07-09T22:01:22.704801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708684+0000","last_change":"2023-07-09T22:01:22.708684+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708684+0000","last_undegraded":"2023-07-09T22:01:22.708684+0000","last_fullsized":"2023-07-09T22:01:22.708684+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699667+0000","last_change":"2023-07-09T22:01:22.699667+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699667+0000","last_undegraded":"2023-07-09T22:01:22.699667+0000","last_fullsized":"2023-07-09T22:01:22.699667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699476+0000","last_change":"2023-07-09T22:01:22.699476+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699476+0000","last_undegraded":"2023-07-09T22:01:22.699476+0000","last_fullsized":"2023-07-09T22:01:22.699476+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707731+0000","last_change":"2023-07-09T22:01:22.707731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707731+0000","last_undegraded":"2023-07-09T22:01:22.707731+0000","last_fullsized":"2023-07-09T22:01:22.707731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708878+0000","last_change":"2023-07-09T22:01:22.708878+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708878+0000","last_undegraded":"2023-07-09T22:01:22.708878+0000","last_fullsized":"2023-07-09T22:01:22.708878+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703106+0000","last_change":"2023-07-09T22:01:22.703106+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703106+0000","last_undegraded":"2023-07-09T22:01:22.703106+0000","last_fullsized":"2023-07-09T22:01:22.703106+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703197+0000","last_change":"2023-07-09T22:01:22.703197+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703197+0000","last_undegraded":"2023-07-09T22:01:22.703197+0000","last_fullsized":"2023-07-09T22:01:22.703197+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707050+0000","last_change":"2023-07-09T22:01:22.707050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707050+0000","last_undegraded":"2023-07-09T22:01:22.707050+0000","last_fullsized":"2023-07-09T22:01:22.707050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702571+0000","last_change":"2023-07-09T22:01:22.702571+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702571+0000","last_undegraded":"2023-07-09T22:01:22.702571+0000","last_fullsized":"2023-07-09T22:01:22.702571+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704183+0000","last_change":"2023-07-09T22:01:22.704183+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704183+0000","last_undegraded":"2023-07-09T22:01:22.704183+0000","last_fullsized":"2023-07-09T22:01:22.704183+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700710+0000","last_change":"2023-07-09T22:01:22.700710+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700710+0000","last_undegraded":"2023-07-09T22:01:22.700710+0000","last_fullsized":"2023-07-09T22:01:22.700710+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704645+0000","last_change":"2023-07-09T22:01:22.704645+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704645+0000","last_undegraded":"2023-07-09T22:01:22.704645+0000","last_fullsized":"2023-07-09T22:01:22.704645+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700184+0000","last_change":"2023-07-09T22:01:22.700184+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700184+0000","last_undegraded":"2023-07-09T22:01:22.700184+0000","last_fullsized":"2023-07-09T22:01:22.700184+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717723+0000","last_change":"2023-07-09T22:01:22.715731+0000","last_active":"2023-07-09T22:01:22.717723+0000","last_peered":"2023-07-09T22:01:22.717723+0000","last_clean":"2023-07-09T22:01:22.717723+0000","last_became_active":"2023-07-09T22:01:22.715273+0000","last_became_peered":"2023-07-09T22:01:22.715273+0000","last_unstale":"2023-07-09T22:01:22.717723+0000","last_undegraded":"2023-07-09T22:01:22.717723+0000","last_fullsized":"2023-07-09T22:01:22.717723+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:27.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704993+0000","last_change":"2023-07-09T22:01:22.704993+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704993+0000","last_undegraded":"2023-07-09T22:01:22.704993+0000","last_fullsized":"2023-07-09T22:01:22.704993+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720633+0000","last_change":"2023-07-09T22:01:22.718159+0000","last_active":"2023-07-09T22:01:22.720633+0000","last_peered":"2023-07-09T22:01:22.720633+0000","last_clean":"2023-07-09T22:01:22.720633+0000","last_became_active":"2023-07-09T22:01:22.717875+0000","last_became_peered":"2023-07-09T22:01:22.717875+0000","last_unstale":"2023-07-09T22:01:22.720633+0000","last_undegraded":"2023-07-09T22:01:22.720633+0000","last_fullsized":"2023-07-09T22:01:22.720633+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:13.200629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699546+0000","last_change":"2023-07-09T22:01:22.699546+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699546+0000","last_undegraded":"2023-07-09T22:01:22.699546+0000","last_fullsized":"2023-07-09T22:01:22.699546+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720016+0000","last_change":"2023-07-09T22:01:22.718561+0000","last_active":"2023-07-09T22:01:22.720016+0000","last_peered":"2023-07-09T22:01:22.720016+0000","last_clean":"2023-07-09T22:01:22.720016+0000","last_became_active":"2023-07-09T22:01:22.718237+0000","last_became_peered":"2023-07-09T22:01:22.718237+0000","last_unstale":"2023-07-09T22:01:22.720016+0000","last_undegraded":"2023-07-09T22:01:22.720016+0000","last_fullsized":"2023-07-09T22:01:22.720016+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:59:09.972489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701007+0000","last_change":"2023-07-09T22:01:22.701007+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701007+0000","last_undegraded":"2023-07-09T22:01:22.701007+0000","last_fullsized":"2023-07-09T22:01:22.701007+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717061+0000","last_change":"2023-07-09T22:01:22.715327+0000","last_active":"2023-07-09T22:01:22.717061+0000","last_peered":"2023-07-09T22:01:22.717061+0000","last_clean":"2023-07-09T22:01:22.717061+0000","last_became_active":"2023-07-09T22:01:22.715043+0000","last_became_peered":"2023-07-09T22:01:22.715043+0000","last_unstale":"2023-07-09T22:01:22.717061+0000","last_undegraded":"2023-07-09T22:01:22.717061+0000","last_fullsized":"2023-07-09T22:01:22.717061+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:50.672686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703028+0000","last_change":"2023-07-09T22:01:22.703028+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703028+0000","last_undegraded":"2023-07-09T22:01:22.703028+0000","last_fullsized":"2023-07-09T22:01:22.703028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718156+0000","last_change":"2023-07-09T22:01:22.715924+0000","last_active":"2023-07-09T22:01:22.718156+0000","last_peered":"2023-07-09T22:01:22.718156+0000","last_clean":"2023-07-09T22:01:22.718156+0000","last_became_active":"2023-07-09T22:01:22.715637+0000","last_became_peered":"2023-07-09T22:01:22.715637+0000","last_unstale":"2023-07-09T22:01:22.718156+0000","last_undegraded":"2023-07-09T22:01:22.718156+0000","last_fullsized":"2023-07-09T22:01:22.718156+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:56.532342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699397+0000","last_change":"2023-07-09T22:01:22.699397+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699397+0000","last_undegraded":"2023-07-09T22:01:22.699397+0000","last_fullsized":"2023-07-09T22:01:22.699397+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712882+0000","last_change":"2023-07-09T22:01:22.707769+0000","last_active":"2023-07-09T22:01:22.712882+0000","last_peered":"2023-07-09T22:01:22.712882+0000","last_clean":"2023-07-09T22:01:22.712882+0000","last_became_active":"2023-07-09T22:01:22.707486+0000","last_became_peered":"2023-07-09T22:01:22.707486+0000","last_unstale":"2023-07-09T22:01:22.712882+0000","last_undegraded":"2023-07-09T22:01:22.712882+0000","last_fullsized":"2023-07-09T22:01:22.712882+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:55.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699032+0000","last_change":"2023-07-09T22:01:22.699032+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699032+0000","last_undegraded":"2023-07-09T22:01:22.699032+0000","last_fullsized":"2023-07-09T22:01:22.699032+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720871+0000","last_change":"2023-07-09T22:01:22.717274+0000","last_active":"2023-07-09T22:01:22.720871+0000","last_peered":"2023-07-09T22:01:22.720871+0000","last_clean":"2023-07-09T22:01:22.720871+0000","last_became_active":"2023-07-09T22:01:22.715566+0000","last_became_peered":"2023-07-09T22:01:22.715566+0000","last_unstale":"2023-07-09T22:01:22.720871+0000","last_undegraded":"2023-07-09T22:01:22.720871+0000","last_fullsized":"2023-07-09T22:01:22.720871+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:38.659620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705603+0000","last_change":"2023-07-09T22:01:22.705603+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705603+0000","last_undegraded":"2023-07-09T22:01:22.705603+0000","last_fullsized":"2023-07-09T22:01:22.705603+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718280+0000","last_change":"2023-07-09T22:01:22.716202+0000","last_active":"2023-07-09T22:01:22.718280+0000","last_peered":"2023-07-09T22:01:22.718280+0000","last_clean":"2023-07-09T22:01:22.718280+0000","last_became_active":"2023-07-09T22:01:22.715939+0000","last_became_peered":"2023-07-09T22:01:22.715939+0000","last_unstale":"2023-07-09T22:01:22.718280+0000","last_undegraded":"2023-07-09T22:01:22.718280+0000","last_fullsized":"2023-07-09T22:01:22.718280+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:43.985311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701955+0000","last_change":"2023-07-09T22:01:22.701955+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701955+0000","last_undegraded":"2023-07-09T22:01:22.701955+0000","last_fullsized":"2023-07-09T22:01:22.701955+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720677+0000","last_change":"2023-07-09T22:01:22.712512+0000","last_active":"2023-07-09T22:01:22.720677+0000","last_peered":"2023-07-09T22:01:22.720677+0000","last_clean":"2023-07-09T22:01:22.720677+0000","last_became_active":"2023-07-09T22:01:22.712232+0000","last_became_peered":"2023-07-09T22:01:22.712232+0000","last_unstale":"2023-07-09T22:01:22.720677+0000","last_undegraded":"2023-07-09T22:01:22.720677+0000","last_fullsized":"2023-07-09T22:01:22.720677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:09.561358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705981+0000","last_change":"2023-07-09T22:01:22.705981+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705981+0000","last_undegraded":"2023-07-09T22:01:22.705981+0000","last_fullsized":"2023-07-09T22:01:22.705981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.723151+0000","last_change":"2023-07-09T22:01:22.721233+0000","last_active":"2023-07-09T22:01:22.723151+0000","last_peered":"2023-07-09T22:01:22.723151+0000","last_clean":"2023-07-09T22:01:22.723151+0000","last_became_active":"2023-07-09T22:01:22.720929+0000","last_became_peered":"2023-07-09T22:01:22.720929+0000","last_unstale":"2023-07-09T22:01:22.723151+0000","last_undegraded":"2023-07-09T22:01:22.723151+0000","last_fullsized":"2023-07-09T22:01:22.723151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:36:21.099465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700038+0000","last_change":"2023-07-09T22:01:22.700038+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700038+0000","last_undegraded":"2023-07-09T22:01:22.700038+0000","last_fullsized":"2023-07-09T22:01:22.700038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713603+0000","last_change":"2023-07-09T22:01:22.711186+0000","last_active":"2023-07-09T22:01:22.713603+0000","last_peered":"2023-07-09T22:01:22.713603+0000","last_clean":"2023-07-09T22:01:22.713603+0000","last_became_active":"2023-07-09T22:01:22.710901+0000","last_became_peered":"2023-07-09T22:01:22.710901+0000","last_unstale":"2023-07-09T22:01:22.713603+0000","last_undegraded":"2023-07-09T22:01:22.713603+0000","last_fullsized":"2023-07-09T22:01:22.713603+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:57.127428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702180+0000","last_change":"2023-07-09T22:01:22.702180+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702180+0000","last_undegraded":"2023-07-09T22:01:22.702180+0000","last_fullsized":"2023-07-09T22:01:22.702180+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719454+0000","last_change":"2023-07-09T22:01:22.716955+0000","last_active":"2023-07-09T22:01:22.719454+0000","last_peered":"2023-07-09T22:01:22.719454+0000","last_clean":"2023-07-09T22:01:22.719454+0000","last_became_active":"2023-07-09T22:01:22.716695+0000","last_became_peered":"2023-07-09T22:01:22.716695+0000","last_unstale":"2023-07-09T22:01:22.719454+0000","last_undegraded":"2023-07-09T22:01:22.719454+0000","last_fullsized":"2023-07-09T22:01:22.719454+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:45.561939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702731+0000","last_change":"2023-07-09T22:01:22.702731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702731+0000","last_undegraded":"2023-07-09T22:01:22.702731+0000","last_fullsized":"2023-07-09T22:01:22.702731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713751+0000","last_change":"2023-07-09T22:01:22.710096+0000","last_active":"2023-07-09T22:01:22.713751+0000","last_peered":"2023-07-09T22:01:22.713751+0000","last_clean":"2023-07-09T22:01:22.713751+0000","last_became_active":"2023-07-09T22:01:22.709830+0000","last_became_peered":"2023-07-09T22:01:22.709830+0000","last_unstale":"2023-07-09T22:01:22.713751+0000","last_undegraded":"2023-07-09T22:01:22.713751+0000","last_fullsized":"2023-07-09T22:01:22.713751+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:08.779913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698615+0000","last_change":"2023-07-09T22:01:22.698615+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698615+0000","last_undegraded":"2023-07-09T22:01:22.698615+0000","last_fullsized":"2023-07-09T22:01:22.698615+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.724861+0000","last_change":"2023-07-09T22:01:22.724154+0000","last_active":"2023-07-09T22:01:22.724861+0000","last_peered":"2023-07-09T22:01:22.724861+0000","last_clean":"2023-07-09T22:01:22.724861+0000","last_became_active":"2023-07-09T22:01:22.723898+0000","last_became_peered":"2023-07-09T22:01:22.723898+0000","last_unstale":"2023-07-09T22:01:22.724861+0000","last_undegraded":"2023-07-09T22:01:22.724861+0000","last_fullsized":"2023-07-09T22:01:22.724861+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:01:25.517184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698845+0000","last_change":"2023-07-09T22:01:22.698845+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698845+0000","last_undegraded":"2023-07-09T22:01:22.698845+0000","last_fullsized":"2023-07-09T22:01:22.698845+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717097+0000","last_change":"2023-07-09T22:01:22.714987+0000","last_active":"2023-07-09T22:01:22.717097+0000","last_peered":"2023-07-09T22:01:22.717097+0000","last_clean":"2023-07-09T22:01:22.717097+0000","last_became_active":"2023-07-09T22:01:22.709986+0000","last_became_peered":"2023-07-09T22:01:22.709986+0000","last_unstale":"2023-07-09T22:01:22.717097+0000","last_undegraded":"2023-07-09T22:01:22.717097+0000","last_fullsized":"2023-07-09T22:01:22.717097+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:51.712361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702403+0000","last_change":"2023-07-09T22:01:22.702403+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702403+0000","last_undegraded":"2023-07-09T22:01:22.702403+0000","last_fullsized":"2023-07-09T22:01:22.702403+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.716447+0000","last_change":"2023-07-09T22:01:22.712957+0000","last_active":"2023-07-09T22:01:22.716447+0000","last_peered":"2023-07-09T22:01:22.716447+0000","last_clean":"2023-07-09T22:01:22.716447+0000","last_became_active":"2023-07-09T22:01:22.712670+0000","last_became_peered":"2023-07-09T22:01:22.712670+0000","last_unstale":"2023-07-09T22:01:22.716447+0000","last_undegraded":"2023-07-09T22:01:22.716447+0000","last_fullsized":"2023-07-09T22:01:22.716447+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:43.538177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699736+0000","last_change":"2023-07-09T22:01:22.699736+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699736+0000","last_undegraded":"2023-07-09T22:01:22.699736+0000","last_fullsized":"2023-07-09T22:01:22.699736+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712992+0000","last_change":"2023-07-09T22:01:22.709765+0000","last_active":"2023-07-09T22:01:22.712992+0000","last_peered":"2023-07-09T22:01:22.712992+0000","last_clean":"2023-07-09T22:01:22.712992+0000","last_became_active":"2023-07-09T22:01:22.708560+0000","last_became_peered":"2023-07-09T22:01:22.708560+0000","last_unstale":"2023-07-09T22:01:22.712992+0000","last_undegraded":"2023-07-09T22:01:22.712992+0000","last_fullsized":"2023-07-09T22:01:22.712992+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:52.687950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702033+0000","last_change":"2023-07-09T22:01:22.702033+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702033+0000","last_undegraded":"2023-07-09T22:01:22.702033+0000","last_fullsized":"2023-07-09T22:01:22.702033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722105+0000","last_change":"2023-07-09T22:01:22.719697+0000","last_active":"2023-07-09T22:01:22.722105+0000","last_peered":"2023-07-09T22:01:22.722105+0000","last_clean":"2023-07-09T22:01:22.722105+0000","last_became_active":"2023-07-09T22:01:22.719063+0000","last_became_peered":"2023-07-09T22:01:22.719063+0000","last_unstale":"2023-07-09T22:01:22.722105+0000","last_undegraded":"2023-07-09T22:01:22.722105+0000","last_fullsized":"2023-07-09T22:01:22.722105+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:38.288817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699163+0000","last_change":"2023-07-09T22:01:22.699163+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699163+0000","last_undegraded":"2023-07-09T22:01:22.699163+0000","last_fullsized":"2023-07-09T22:01:22.699163+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720298+0000","last_change":"2023-07-09T22:01:22.714900+0000","last_active":"2023-07-09T22:01:22.720298+0000","last_peered":"2023-07-09T22:01:22.720298+0000","last_clean":"2023-07-09T22:01:22.720298+0000","last_became_active":"2023-07-09T22:01:22.714627+0000","last_became_peered":"2023-07-09T22:01:22.714627+0000","last_unstale":"2023-07-09T22:01:22.720298+0000","last_undegraded":"2023-07-09T22:01:22.720298+0000","last_fullsized":"2023-07-09T22:01:22.720298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:22.412609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701743+0000","last_change":"2023-07-09T22:01:22.701743+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701743+0000","last_undegraded":"2023-07-09T22:01:22.701743+0000","last_fullsized":"2023-07-09T22:01:22.701743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.721960+0000","last_change":"2023-07-09T22:01:22.721160+0000","last_active":"2023-07-09T22:01:22.721960+0000","last_peered":"2023-07-09T22:01:22.721960+0000","last_clean":"2023-07-09T22:01:22.721960+0000","last_became_active":"2023-07-09T22:01:22.720842+0000","last_became_peered":"2023-07-09T22:01:22.720842+0000","last_unstale":"2023-07-09T22:01:22.721960+0000","last_undegraded":"2023-07-09T22:01:22.721960+0000","last_fullsized":"2023-07-09T22:01:22.721960+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:11:37.760665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706666+0000","last_change":"2023-07-09T22:01:22.706666+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706666+0000","last_undegraded":"2023-07-09T22:01:22.706666+0000","last_fullsized":"2023-07-09T22:01:22.706666+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717030+0000","last_change":"2023-07-09T22:01:22.714982+0000","last_active":"2023-07-09T22:01:22.717030+0000","last_peered":"2023-07-09T22:01:22.717030+0000","last_clean":"2023-07-09T22:01:22.717030+0000","last_became_active":"2023-07-09T22:01:22.714665+0000","last_became_peered":"2023-07-09T22:01:22.714665+0000","last_unstale":"2023-07-09T22:01:22.717030+0000","last_undegraded":"2023-07-09T22:01:22.717030+0000","last_fullsized":"2023-07-09T22:01:22.717030+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:30:27.738602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702745+0000","last_change":"2023-07-09T22:01:22.702745+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702745+0000","last_undegraded":"2023-07-09T22:01:22.702745+0000","last_fullsized":"2023-07-09T22:01:22.702745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720386+0000","last_change":"2023-07-09T22:01:22.716729+0000","last_active":"2023-07-09T22:01:22.720386+0000","last_peered":"2023-07-09T22:01:22.720386+0000","last_clean":"2023-07-09T22:01:22.720386+0000","last_became_active":"2023-07-09T22:01:22.716453+0000","last_became_peered":"2023-07-09T22:01:22.716453+0000","last_unstale":"2023-07-09T22:01:22.720386+0000","last_undegraded":"2023-07-09T22:01:22.720386+0000","last_fullsized":"2023-07-09T22:01:22.720386+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:56.554277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705528+0000","last_change":"2023-07-09T22:01:22.705528+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705528+0000","last_undegraded":"2023-07-09T22:01:22.705528+0000","last_fullsized":"2023-07-09T22:01:22.705528+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720432+0000","last_change":"2023-07-09T22:01:22.719319+0000","last_active":"2023-07-09T22:01:22.720432+0000","last_peered":"2023-07-09T22:01:22.720432+0000","last_clean":"2023-07-09T22:01:22.720432+0000","last_became_active":"2023-07-09T22:01:22.718992+0000","last_became_peered":"2023-07-09T22:01:22.718992+0000","last_unstale":"2023-07-09T22:01:22.720432+0000","last_undegraded":"2023-07-09T22:01:22.720432+0000","last_fullsized":"2023-07-09T22:01:22.720432+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:45.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698581+0000","last_change":"2023-07-09T22:01:22.698581+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698581+0000","last_undegraded":"2023-07-09T22:01:22.698581+0000","last_fullsized":"2023-07-09T22:01:22.698581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712961+0000","last_change":"2023-07-09T22:01:22.707404+0000","last_active":"2023-07-09T22:01:22.712961+0000","last_peered":"2023-07-09T22:01:22.712961+0000","last_clean":"2023-07-09T22:01:22.712961+0000","last_became_active":"2023-07-09T22:01:22.707132+0000","last_became_peered":"2023-07-09T22:01:22.707132+0000","last_unstale":"2023-07-09T22:01:22.712961+0000","last_undegraded":"2023-07-09T22:01:22.712961+0000","last_fullsized":"2023-07-09T22:01:22.712961+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:55:55.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699588+0000","last_change":"2023-07-09T22:01:22.699588+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699588+0000","last_undegraded":"2023-07-09T22:01:22.699588+0000","last_fullsized":"2023-07-09T22:01:22.699588+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722125+0000","last_change":"2023-07-09T22:01:22.719872+0000","last_active":"2023-07-09T22:01:22.722125+0000","last_peered":"2023-07-09T22:01:22.722125+0000","last_clean":"2023-07-09T22:01:22.722125+0000","last_became_active":"2023-07-09T22:01:22.719439+0000","last_became_peered":"2023-07-09T22:01:22.719439+0000","last_unstale":"2023-07-09T22:01:22.722125+0000","last_undegraded":"2023-07-09T22:01:22.722125+0000","last_fullsized":"2023-07-09T22:01:22.722125+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:06.238635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1227,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705352+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:01:22.705352+0000","last_peered":"2023-07-09T22:01:22.705352+0000","last_clean":"2023-07-09T22:01:22.705352+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:01:22.705352+0000","last_undegraded":"2023-07-09T22:01:22.705352+0000","last_fullsized":"2023-07-09T22:01:22.705352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:21.495358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705411+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:01:22.705411+0000","last_peered":"2023-07-09T22:01:22.705411+0000","last_clean":"2023-07-09T22:01:22.705411+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:01:22.705411+0000","last_undegraded":"2023-07-09T22:01:22.705411+0000","last_fullsized":"2023-07-09T22:01:22.705411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:05.715239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705077+0000","last_change":"2023-07-09T22:01:22.705077+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705077+0000","last_undegraded":"2023-07-09T22:01:22.705077+0000","last_fullsized":"2023-07-09T22:01:22.705077+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717001+0000","last_change":"2023-07-09T22:01:22.714653+0000","last_active":"2023-07-09T22:01:22.717001+0000","last_peered":"2023-07-09T22:01:22.717001+0000","last_clean":"2023-07-09T22:01:22.717001+0000","last_became_active":"2023-07-09T22:01:22.714202+0000","last_became_peered":"2023-07-09T22:01:22.714202+0000","last_unstale":"2023-07-09T22:01:22.717001+0000","last_undegraded":"2023-07-09T22:01:22.717001+0000","last_fullsized":"2023-07-09T22:01:22.717001+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:15:40.623736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":330,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705222+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:01:22.705222+0000","last_peered":"2023-07-09T22:01:22.705222+0000","last_clean":"2023-07-09T22:01:22.705222+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:01:22.705222+0000","last_undegraded":"2023-07-09T22:01:22.705222+0000","last_fullsized":"2023-07-09T22:01:22.705222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:07:02.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699076+0000","last_change":"2023-07-09T22:01:22.699076+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699076+0000","last_undegraded":"2023-07-09T22:01:22.699076+0000","last_fullsized":"2023-07-09T22:01:22.699076+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720735+0000","last_change":"2023-07-09T22:01:22.718035+0000","last_active":"2023-07-09T22:01:22.720735+0000","last_peered":"2023-07-09T22:01:22.720735+0000","last_clean":"2023-07-09T22:01:22.720735+0000","last_became_active":"2023-07-09T22:01:22.717691+0000","last_became_peered":"2023-07-09T22:01:22.717691+0000","last_unstale":"2023-07-09T22:01:22.720735+0000","last_undegraded":"2023-07-09T22:01:22.720735+0000","last_fullsized":"2023-07-09T22:01:22.720735+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:30:35.329450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.700982+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:01:22.700982+0000","last_peered":"2023-07-09T22:01:22.700982+0000","last_clean":"2023-07-09T22:01:22.700982+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:01:22.700982+0000","last_undegraded":"2023-07-09T22:01:22.700982+0000","last_fullsized":"2023-07-09T22:01:22.700982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:44.666312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700751+0000","last_change":"2023-07-09T22:01:22.700751+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700751+0000","last_undegraded":"2023-07-09T22:01:22.700751+0000","last_fullsized":"2023-07-09T22:01:22.700751+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722974+0000","last_change":"2023-07-09T22:01:22.720784+0000","last_active":"2023-07-09T22:01:22.722974+0000","last_peered":"2023-07-09T22:01:22.722974+0000","last_clean":"2023-07-09T22:01:22.722974+0000","last_became_active":"2023-07-09T22:01:22.720486+0000","last_became_peered":"2023-07-09T22:01:22.720486+0000","last_unstale":"2023-07-09T22:01:22.722974+0000","last_undegraded":"2023-07-09T22:01:22.722974+0000","last_fullsized":"2023-07-09T22:01:22.722974+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:22.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704835+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:01:22.704835+0000","last_peered":"2023-07-09T22:01:22.704835+0000","last_clean":"2023-07-09T22:01:22.704835+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:01:22.704835+0000","last_undegraded":"2023-07-09T22:01:22.704835+0000","last_fullsized":"2023-07-09T22:01:22.704835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:44.309853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701433+0000","last_change":"2023-07-09T22:01:22.701433+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701433+0000","last_undegraded":"2023-07-09T22:01:22.701433+0000","last_fullsized":"2023-07-09T22:01:22.701433+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713115+0000","last_change":"2023-07-09T22:01:22.708768+0000","last_active":"2023-07-09T22:01:22.713115+0000","last_peered":"2023-07-09T22:01:22.713115+0000","last_clean":"2023-07-09T22:01:22.713115+0000","last_became_active":"2023-07-09T22:01:22.708312+0000","last_became_peered":"2023-07-09T22:01:22.708312+0000","last_unstale":"2023-07-09T22:01:22.713115+0000","last_undegraded":"2023-07-09T22:01:22.713115+0000","last_fullsized":"2023-07-09T22:01:22.713115+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:00.877979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.706954+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:01:22.706954+0000","last_peered":"2023-07-09T22:01:22.706954+0000","last_clean":"2023-07-09T22:01:22.706954+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:01:22.706954+0000","last_undegraded":"2023-07-09T22:01:22.706954+0000","last_fullsized":"2023-07-09T22:01:22.706954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:44.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700880+0000","last_change":"2023-07-09T22:01:22.700880+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700880+0000","last_undegraded":"2023-07-09T22:01:22.700880+0000","last_fullsized":"2023-07-09T22:01:22.700880+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718262+0000","last_change":"2023-07-09T22:01:22.716008+0000","last_active":"2023-07-09T22:01:22.718262+0000","last_peered":"2023-07-09T22:01:22.718262+0000","last_clean":"2023-07-09T22:01:22.718262+0000","last_became_active":"2023-07-09T22:01:22.715729+0000","last_became_peered":"2023-07-09T22:01:22.715729+0000","last_unstale":"2023-07-09T22:01:22.718262+0000","last_undegraded":"2023-07-09T22:01:22.718262+0000","last_fullsized":"2023-07-09T22:01:22.718262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:20:28.978973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":329,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.708790+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:01:22.708790+0000","last_peered":"2023-07-09T22:01:22.708790+0000","last_clean":"2023-07-09T22:01:22.708790+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:01:22.708790+0000","last_undegraded":"2023-07-09T22:01:22.708790+0000","last_fullsized":"2023-07-09T22:01:22.708790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:41.059249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704695+0000","last_change":"2023-07-09T22:01:22.704695+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704695+0000","last_undegraded":"2023-07-09T22:01:22.704695+0000","last_fullsized":"2023-07-09T22:01:22.704695+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712831+0000","last_change":"2023-07-09T22:01:22.708500+0000","last_active":"2023-07-09T22:01:22.712831+0000","last_peered":"2023-07-09T22:01:22.712831+0000","last_clean":"2023-07-09T22:01:22.712831+0000","last_became_active":"2023-07-09T22:01:22.708177+0000","last_became_peered":"2023-07-09T22:01:22.708177+0000","last_unstale":"2023-07-09T22:01:22.712831+0000","last_undegraded":"2023-07-09T22:01:22.712831+0000","last_fullsized":"2023-07-09T22:01:22.712831+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:04.644983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":323,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704311+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:01:22.704311+0000","last_peered":"2023-07-09T22:01:22.704311+0000","last_clean":"2023-07-09T22:01:22.704311+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:01:22.704311+0000","last_undegraded":"2023-07-09T22:01:22.704311+0000","last_fullsized":"2023-07-09T22:01:22.704311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:41.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706346+0000","last_change":"2023-07-09T22:01:22.706346+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706346+0000","last_undegraded":"2023-07-09T22:01:22.706346+0000","last_fullsized":"2023-07-09T22:01:22.706346+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719347+0000","last_change":"2023-07-09T22:01:22.711803+0000","last_active":"2023-07-09T22:01:22.719347+0000","last_peered":"2023-07-09T22:01:22.719347+0000","last_clean":"2023-07-09T22:01:22.719347+0000","last_became_active":"2023-07-09T22:01:22.709155+0000","last_became_peered":"2023-07-09T22:01:22.709155+0000","last_unstale":"2023-07-09T22:01:22.719347+0000","last_undegraded":"2023-07-09T22:01:22.719347+0000","last_fullsized":"2023-07-09T22:01:22.719347+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:56:18.713961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704055+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:01:22.704055+0000","last_peered":"2023-07-09T22:01:22.704055+0000","last_clean":"2023-07-09T22:01:22.704055+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:01:22.704055+0000","last_undegraded":"2023-07-09T22:01:22.704055+0000","last_fullsized":"2023-07-09T22:01:22.704055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:11.876041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47948,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323892,"statfs":{"total":96636764160,"available":96587665408,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95899999999999996,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.036,"15min":1.036},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.107,"15min":1.107},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.014,"5min":1.0509999999999999,"15min":1.077},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75}]},{"osd":6,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575310,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":1.075,"15min":1.075},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":0.999,"15min":1.04},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98199999999999998,"15min":1.177},"last":0.752},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.1890000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.504},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":1.02,"15min":1.026},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85299999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.92600000000000005,"5min":0.94899999999999995,"15min":1.161},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.099},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.052},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":1.01,"15min":1.0860000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94599999999999995,"5min":1.016,"15min":1.077},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575309,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89300000000000002,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.05},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88500000000000001,"5min":1.095,"15min":1.095},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.034},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.59799999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.81100000000000005,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1251979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":1.075},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95199999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":0.998,"15min":1.03},"last":0.79300000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0800000000000001,"15min":1.0960000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61599999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.026,"5min":1.038,"15min":1.1240000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.84899999999999998,"5min":1.05,"15min":1.079},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.016},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.96499999999999997,"15min":1.018},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.069},"last":0.997}]},{"osd":7,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77200000000000002,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0149999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.375}]},{"osd":1,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.133},"last":0.308},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.194},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.5429999999999999},"last":0.752},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85499999999999998},"min":{"1min":0.65300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.014,"5min":1.133,"15min":1.5649999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.05,"5min":1.1479999999999999,"15min":1.302},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1879999999999999,"15min":1.262},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79700000000000004,"15min":0.79600000000000004},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81399999999999995,"15min":0.82099999999999995},"min":{"1min":0.57499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575311,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312196,"statfs":{"total":96636764160,"available":96575688704,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.77100000000000002,"5min":0.78600000000000003,"15min":0.85099999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.016},"last":0.501},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":1.117,"15min":1.337},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.45000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1970000000000001,"15min":1.306},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.57699999999999996},"max":{"1min":1.304,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.111,"15min":1.375},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.70599999999999996,"5min":0.59499999999999997,"15min":0.52200000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.294},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.1499999999999999,"5min":1.2809999999999999,"15min":1.298},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1679999999999999,"5min":1.196,"15min":1.256},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.46999999999999997},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.373}]},{"osd":2,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81799999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.89200000000000002},"last":0.54100000000000004}]},{"osd":3,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.79800000000000004,"5min":0.879,"15min":0.96999999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.84699999999999998,"15min":0.83999999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.2769999999999999,"15min":1.337},"last":0.80000000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.67500000000000004,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.55100000000000005,"15min":0.45600000000000002},"max":{"1min":0.90200000000000002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.79000000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48899999999999999},"max":{"1min":1.0249999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.157,"15min":1.1659999999999999},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.006,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":1},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83799999999999997,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":0.97799999999999998,"5min":1.321,"15min":1.321},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834575311,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42188,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329652,"statfs":{"total":96636764160,"available":96593563648,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.90300000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":0.93899999999999995},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1850000000000001,"5min":1.306,"15min":1.306},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.3260000000000001,"15min":1.381},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.55000000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.3400000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":1.2210000000000001,"5min":1.397,"15min":1.397},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:01:28.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:01:28.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.393+0000 7fa21ef59640 1 Processor -- start 2023-07-09T22:01:28.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.393+0000 7fa21ef59640 1 -- start start 2023-07-09T22:01:28.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.393+0000 7fa21ef59640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2180b7ab0 0x7fa21806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ef59640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa2180cef80 0x7fa2180b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ef59640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180b49f0 con 0x7fa2180b4170 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ef59640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180b7e80 con 0x7fa2180b7ab0 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ef59640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180b4610 con 0x7fa2180cef80 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2180b7ab0 0x7fa21806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2180b7ab0 0x7fa21806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51408/0 (socket says 172.21.15.37:51408) 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 -- 172.21.15.37:0/3490055514 learned_addr learned my addr 172.21.15.37:0/3490055514 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa217fff640 1 --2- 172.21.15.37:0/3490055514 >> v2:172.21.15.119:3300/0 conn(0x7fa2180cef80 0x7fa2180b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 -- 172.21.15.37:0/3490055514 >> v2:172.21.15.119:3300/0 conn(0x7fa2180cef80 msgr2=0x7fa2180b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 --2- 172.21.15.37:0/3490055514 >> v2:172.21.15.119:3300/0 conn(0x7fa2180cef80 0x7fa2180b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 -- 172.21.15.37:0/3490055514 >> v1:172.21.15.37:6789/0 conn(0x7fa2180b4170 legacy=0x7fa21815f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 -- 172.21.15.37:0/3490055514 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180cc8a0 con 0x7fa2180b7ab0 2023-07-09T22:01:28.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa21ccf5640 1 --2- 172.21.15.37:0/3490055514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21806aa50 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa2180b4d10 tx=0x7fa20c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b74e76cc23952a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.397+0000 7fa2177fe640 1 -- 172.21.15.37:0/3490055514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0aa430 con 0x7fa2180b7ab0 2023-07-09T22:01:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa2177fe640 1 -- 172.21.15.37:0/3490055514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20c0aa590 con 0x7fa2180b7ab0 2023-07-09T22:01:28.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa2177fe640 1 -- 172.21.15.37:0/3490055514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20c0aa920 con 0x7fa2180b7ab0 2023-07-09T22:01:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- 172.21.15.37:0/3490055514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 msgr2=0x7fa21806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- 172.21.15.37:0/3490055514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21806aa50 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fa2180b4d10 tx=0x7fa20c01c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- 172.21.15.37:0/3490055514 shutdown_connections 2023-07-09T22:01:28.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- 172.21.15.37:0/3490055514 >> v2:172.21.15.119:3300/0 conn(0x7fa2180cef80 0x7fa2180b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- 172.21.15.37:0/3490055514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21806aa50 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- 172.21.15.37:0/3490055514 >> 172.21.15.37:0/3490055514 conn(0x7fa218073090 msgr2=0x7fa218069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- 172.21.15.37:0/3490055514 shutdown_connections 2023-07-09T22:01:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- 172.21.15.37:0/3490055514 wait complete. 2023-07-09T22:01:28.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 Processor -- start 2023-07-09T22:01:28.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- start start 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2180b4170 0x7fa2181537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2180cef80 0x7fa2180b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218153d20 con 0x7fa2180b7ab0 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c6e60 con 0x7fa2180b4170 2023-07-09T22:01:28.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ef59640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2180c6250 con 0x7fa2180cef80 2023-07-09T22:01:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa217fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51410/0 (socket says 172.21.15.37:51410) 2023-07-09T22:01:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa217fff640 1 -- 172.21.15.37:0/2309350800 learned_addr learned my addr 172.21.15.37:0/2309350800 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21ccf5640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2180b4170 0x7fa2181537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.401+0000 7fa21d4f6640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2180cef80 0x7fa2180b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 -- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2180cef80 msgr2=0x7fa2180b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2180cef80 0x7fa2180b5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 -- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2180b4170 msgr2=0x7fa2181537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2180b4170 0x7fa2181537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 -- 172.21.15.37:0/2309350800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20c0094d0 con 0x7fa2180b7ab0 2023-07-09T22:01:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa217fff640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa20400e900 tx=0x7fa20400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa204009690 con 0x7fa2180b7ab0 2023-07-09T22:01:28.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa20400ca00 con 0x7fa2180b7ab0 2023-07-09T22:01:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2180c6530 con 0x7fa2180b7ab0 2023-07-09T22:01:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa20400cd90 con 0x7fa2180b7ab0 2023-07-09T22:01:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2180c6af0 con 0x7fa2180b7ab0 2023-07-09T22:01:28.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa21804d7d0 con 0x7fa2180b7ab0 2023-07-09T22:01:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.405+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa204013470 con 0x7fa2180b7ab0 2023-07-09T22:01:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.409+0000 7fa2157fa640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 0x7fa1fc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.409+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fa204084090 con 0x7fa2180b7ab0 2023-07-09T22:01:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.409+0000 7fa21ccf5640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 0x7fa1fc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.409+0000 7fa21ccf5640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 0x7fa1fc068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0ae000 tx=0x7fa20c0b5040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.413+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa2040513d0 con 0x7fa2180b7ab0 2023-07-09T22:01:28.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.561+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2180cf4d0 con 0x7fa1fc0663a0 2023-07-09T22:01:28.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.569+0000 7fa2157fa640 1 -- 172.21.15.37:0/2309350800 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306269 (secure 0 0 0) 0x7fa20c0aa780 con 0x7fa1fc0663a0 2023-07-09T22:01:28.579 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:28.580 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:01:28.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 msgr2=0x7fa1fc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 0x7fa1fc068850 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa20c0ae000 tx=0x7fa20c0b5040 comp rx=0 tx=0).stop 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 msgr2=0x7fa21815b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7fa20400e900 tx=0x7fa20400edc0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 shutdown_connections 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa1fc0663a0 0x7fa1fc068850 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa2180cef80 0x7fa2180b5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2180b7ab0 0x7fa21815b3f0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 --2- 172.21.15.37:0/2309350800 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa2180b4170 0x7fa2181537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 >> 172.21.15.37:0/2309350800 conn(0x7fa218073090 msgr2=0x7fa2180ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:28.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 shutdown_connections 2023-07-09T22:01:28.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.573+0000 7fa21ef59640 1 -- 172.21.15.37:0/2309350800 wait complete. 2023-07-09T22:01:28.600 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-07-09T22:01:27.387155+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355340,"kb_used_data":20044,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754619380,"statfs":{"total":773094113280,"available":772730245120,"internally_reserved":0,"allocated":20525056,"data_stored":11163188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.698343"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706120+0000","last_change":"2023-07-09T22:01:22.706120+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706120+0000","last_undegraded":"2023-07-09T22:01:22.706120+0000","last_fullsized":"2023-07-09T22:01:22.706120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702050+0000","last_change":"2023-07-09T22:01:22.702050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702050+0000","last_undegraded":"2023-07-09T22:01:22.702050+0000","last_fullsized":"2023-07-09T22:01:22.702050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705927+0000","last_change":"2023-07-09T22:01:22.705927+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705927+0000","last_undegraded":"2023-07-09T22:01:22.705927+0000","last_fullsized":"2023-07-09T22:01:22.705927+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707177+0000","last_change":"2023-07-09T22:01:22.707177+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707177+0000","last_undegraded":"2023-07-09T22:01:22.707177+0000","last_fullsized":"2023-07-09T22:01:22.707177+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698907+0000","last_change":"2023-07-09T22:01:22.698907+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698907+0000","last_undegraded":"2023-07-09T22:01:22.698907+0000","last_fullsized":"2023-07-09T22:01:22.698907+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700501+0000","last_change":"2023-07-09T22:01:22.700501+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700501+0000","last_undegraded":"2023-07-09T22:01:22.700501+0000","last_fullsized":"2023-07-09T22:01:22.700501+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705133+0000","last_change":"2023-07-09T22:01:22.705133+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705133+0000","last_undegraded":"2023-07-09T22:01:22.705133+0000","last_fullsized":"2023-07-09T22:01:22.705133+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.709286+0000","last_change":"2023-07-09T22:01:22.709286+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.709286+0000","last_undegraded":"2023-07-09T22:01:22.709286+0000","last_fullsized":"2023-07-09T22:01:22.709286+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707145+0000","last_change":"2023-07-09T22:01:22.707145+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707145+0000","last_undegraded":"2023-07-09T22:01:22.707145+0000","last_fullsized":"2023-07-09T22:01:22.707145+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704043+0000","last_change":"2023-07-09T22:01:22.704043+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704043+0000","last_undegraded":"2023-07-09T22:01:22.704043+0000","last_fullsized":"2023-07-09T22:01:22.704043+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703515+0000","last_change":"2023-07-09T22:01:22.703515+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703515+0000","last_undegraded":"2023-07-09T22:01:22.703515+0000","last_fullsized":"2023-07-09T22:01:22.703515+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700008+0000","last_change":"2023-07-09T22:01:22.700008+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700008+0000","last_undegraded":"2023-07-09T22:01:22.700008+0000","last_fullsized":"2023-07-09T22:01:22.700008+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.710499+0000","last_change":"2023-07-09T22:01:22.710499+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.710499+0000","last_undegraded":"2023-07-09T22:01:22.710499+0000","last_fullsized":"2023-07-09T22:01:22.710499+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700027+0000","last_change":"2023-07-09T22:01:22.700027+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700027+0000","last_undegraded":"2023-07-09T22:01:22.700027+0000","last_fullsized":"2023-07-09T22:01:22.700027+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701170+0000","last_change":"2023-07-09T22:01:22.701170+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701170+0000","last_undegraded":"2023-07-09T22:01:22.701170+0000","last_fullsized":"2023-07-09T22:01:22.701170+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708215+0000","last_change":"2023-07-09T22:01:22.708215+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708215+0000","last_undegraded":"2023-07-09T22:01:22.708215+0000","last_fullsized":"2023-07-09T22:01:22.708215+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701728+0000","last_change":"2023-07-09T22:01:22.701728+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701728+0000","last_undegraded":"2023-07-09T22:01:22.701728+0000","last_fullsized":"2023-07-09T22:01:22.701728+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703432+0000","last_change":"2023-07-09T22:01:22.703432+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703432+0000","last_undegraded":"2023-07-09T22:01:22.703432+0000","last_fullsized":"2023-07-09T22:01:22.703432+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703046+0000","last_change":"2023-07-09T22:01:22.703046+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703046+0000","last_undegraded":"2023-07-09T22:01:22.703046+0000","last_fullsized":"2023-07-09T22:01:22.703046+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704801+0000","last_change":"2023-07-09T22:01:22.704801+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704801+0000","last_undegraded":"2023-07-09T22:01:22.704801+0000","last_fullsized":"2023-07-09T22:01:22.704801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708684+0000","last_change":"2023-07-09T22:01:22.708684+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708684+0000","last_undegraded":"2023-07-09T22:01:22.708684+0000","last_fullsized":"2023-07-09T22:01:22.708684+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699667+0000","last_change":"2023-07-09T22:01:22.699667+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699667+0000","last_undegraded":"2023-07-09T22:01:22.699667+0000","last_fullsized":"2023-07-09T22:01:22.699667+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699476+0000","last_change":"2023-07-09T22:01:22.699476+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699476+0000","last_undegraded":"2023-07-09T22:01:22.699476+0000","last_fullsized":"2023-07-09T22:01:22.699476+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707731+0000","last_change":"2023-07-09T22:01:22.707731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707731+0000","last_undegraded":"2023-07-09T22:01:22.707731+0000","last_fullsized":"2023-07-09T22:01:22.707731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.708878+0000","last_change":"2023-07-09T22:01:22.708878+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.708878+0000","last_undegraded":"2023-07-09T22:01:22.708878+0000","last_fullsized":"2023-07-09T22:01:22.708878+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703106+0000","last_change":"2023-07-09T22:01:22.703106+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703106+0000","last_undegraded":"2023-07-09T22:01:22.703106+0000","last_fullsized":"2023-07-09T22:01:22.703106+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703197+0000","last_change":"2023-07-09T22:01:22.703197+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703197+0000","last_undegraded":"2023-07-09T22:01:22.703197+0000","last_fullsized":"2023-07-09T22:01:22.703197+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.707050+0000","last_change":"2023-07-09T22:01:22.707050+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.707050+0000","last_undegraded":"2023-07-09T22:01:22.707050+0000","last_fullsized":"2023-07-09T22:01:22.707050+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702571+0000","last_change":"2023-07-09T22:01:22.702571+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702571+0000","last_undegraded":"2023-07-09T22:01:22.702571+0000","last_fullsized":"2023-07-09T22:01:22.702571+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704183+0000","last_change":"2023-07-09T22:01:22.704183+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704183+0000","last_undegraded":"2023-07-09T22:01:22.704183+0000","last_fullsized":"2023-07-09T22:01:22.704183+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700710+0000","last_change":"2023-07-09T22:01:22.700710+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700710+0000","last_undegraded":"2023-07-09T22:01:22.700710+0000","last_fullsized":"2023-07-09T22:01:22.700710+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704645+0000","last_change":"2023-07-09T22:01:22.704645+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704645+0000","last_undegraded":"2023-07-09T22:01:22.704645+0000","last_fullsized":"2023-07-09T22:01:22.704645+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700184+0000","last_change":"2023-07-09T22:01:22.700184+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700184+0000","last_undegraded":"2023-07-09T22:01:22.700184+0000","last_fullsized":"2023-07-09T22:01:22.700184+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717723+0000","last_change":"2023-07-09T22:01:22.715731+0000","last_active":"2023-07-09T22:01:22.717723+0000","last_peered":"2023-07-09T22:01:22.717723+0000","last_clean":"2023-07-09T22:01:22.717723+0000","last_became_active":"2023-07-09T22:01:22.715273+0000","last_became_peered":"2023-07-09T22:01:22.715273+0000","last_unstale":"2023-07-09T22:01:22.717723+0000","last_undegraded":"2023-07-09T22:01:22.717723+0000","last_fullsized":"2023-07-09T22:01:22.717723+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:27.542378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704993+0000","last_change":"2023-07-09T22:01:22.704993+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704993+0000","last_undegraded":"2023-07-09T22:01:22.704993+0000","last_fullsized":"2023-07-09T22:01:22.704993+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720633+0000","last_change":"2023-07-09T22:01:22.718159+0000","last_active":"2023-07-09T22:01:22.720633+0000","last_peered":"2023-07-09T22:01:22.720633+0000","last_clean":"2023-07-09T22:01:22.720633+0000","last_became_active":"2023-07-09T22:01:22.717875+0000","last_became_peered":"2023-07-09T22:01:22.717875+0000","last_unstale":"2023-07-09T22:01:22.720633+0000","last_undegraded":"2023-07-09T22:01:22.720633+0000","last_fullsized":"2023-07-09T22:01:22.720633+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:02:13.200629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699546+0000","last_change":"2023-07-09T22:01:22.699546+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699546+0000","last_undegraded":"2023-07-09T22:01:22.699546+0000","last_fullsized":"2023-07-09T22:01:22.699546+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720016+0000","last_change":"2023-07-09T22:01:22.718561+0000","last_active":"2023-07-09T22:01:22.720016+0000","last_peered":"2023-07-09T22:01:22.720016+0000","last_clean":"2023-07-09T22:01:22.720016+0000","last_became_active":"2023-07-09T22:01:22.718237+0000","last_became_peered":"2023-07-09T22:01:22.718237+0000","last_unstale":"2023-07-09T22:01:22.720016+0000","last_undegraded":"2023-07-09T22:01:22.720016+0000","last_fullsized":"2023-07-09T22:01:22.720016+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:59:09.972489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701007+0000","last_change":"2023-07-09T22:01:22.701007+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701007+0000","last_undegraded":"2023-07-09T22:01:22.701007+0000","last_fullsized":"2023-07-09T22:01:22.701007+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717061+0000","last_change":"2023-07-09T22:01:22.715327+0000","last_active":"2023-07-09T22:01:22.717061+0000","last_peered":"2023-07-09T22:01:22.717061+0000","last_clean":"2023-07-09T22:01:22.717061+0000","last_became_active":"2023-07-09T22:01:22.715043+0000","last_became_peered":"2023-07-09T22:01:22.715043+0000","last_unstale":"2023-07-09T22:01:22.717061+0000","last_undegraded":"2023-07-09T22:01:22.717061+0000","last_fullsized":"2023-07-09T22:01:22.717061+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:50.672686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.703028+0000","last_change":"2023-07-09T22:01:22.703028+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.703028+0000","last_undegraded":"2023-07-09T22:01:22.703028+0000","last_fullsized":"2023-07-09T22:01:22.703028+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718156+0000","last_change":"2023-07-09T22:01:22.715924+0000","last_active":"2023-07-09T22:01:22.718156+0000","last_peered":"2023-07-09T22:01:22.718156+0000","last_clean":"2023-07-09T22:01:22.718156+0000","last_became_active":"2023-07-09T22:01:22.715637+0000","last_became_peered":"2023-07-09T22:01:22.715637+0000","last_unstale":"2023-07-09T22:01:22.718156+0000","last_undegraded":"2023-07-09T22:01:22.718156+0000","last_fullsized":"2023-07-09T22:01:22.718156+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:29:56.532342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699397+0000","last_change":"2023-07-09T22:01:22.699397+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699397+0000","last_undegraded":"2023-07-09T22:01:22.699397+0000","last_fullsized":"2023-07-09T22:01:22.699397+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712882+0000","last_change":"2023-07-09T22:01:22.707769+0000","last_active":"2023-07-09T22:01:22.712882+0000","last_peered":"2023-07-09T22:01:22.712882+0000","last_clean":"2023-07-09T22:01:22.712882+0000","last_became_active":"2023-07-09T22:01:22.707486+0000","last_became_peered":"2023-07-09T22:01:22.707486+0000","last_unstale":"2023-07-09T22:01:22.712882+0000","last_undegraded":"2023-07-09T22:01:22.712882+0000","last_fullsized":"2023-07-09T22:01:22.712882+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:49:55.741357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699032+0000","last_change":"2023-07-09T22:01:22.699032+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699032+0000","last_undegraded":"2023-07-09T22:01:22.699032+0000","last_fullsized":"2023-07-09T22:01:22.699032+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720871+0000","last_change":"2023-07-09T22:01:22.717274+0000","last_active":"2023-07-09T22:01:22.720871+0000","last_peered":"2023-07-09T22:01:22.720871+0000","last_clean":"2023-07-09T22:01:22.720871+0000","last_became_active":"2023-07-09T22:01:22.715566+0000","last_became_peered":"2023-07-09T22:01:22.715566+0000","last_unstale":"2023-07-09T22:01:22.720871+0000","last_undegraded":"2023-07-09T22:01:22.720871+0000","last_fullsized":"2023-07-09T22:01:22.720871+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:38.659620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705603+0000","last_change":"2023-07-09T22:01:22.705603+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705603+0000","last_undegraded":"2023-07-09T22:01:22.705603+0000","last_fullsized":"2023-07-09T22:01:22.705603+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718280+0000","last_change":"2023-07-09T22:01:22.716202+0000","last_active":"2023-07-09T22:01:22.718280+0000","last_peered":"2023-07-09T22:01:22.718280+0000","last_clean":"2023-07-09T22:01:22.718280+0000","last_became_active":"2023-07-09T22:01:22.715939+0000","last_became_peered":"2023-07-09T22:01:22.715939+0000","last_unstale":"2023-07-09T22:01:22.718280+0000","last_undegraded":"2023-07-09T22:01:22.718280+0000","last_fullsized":"2023-07-09T22:01:22.718280+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:20:43.985311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701955+0000","last_change":"2023-07-09T22:01:22.701955+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701955+0000","last_undegraded":"2023-07-09T22:01:22.701955+0000","last_fullsized":"2023-07-09T22:01:22.701955+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720677+0000","last_change":"2023-07-09T22:01:22.712512+0000","last_active":"2023-07-09T22:01:22.720677+0000","last_peered":"2023-07-09T22:01:22.720677+0000","last_clean":"2023-07-09T22:01:22.720677+0000","last_became_active":"2023-07-09T22:01:22.712232+0000","last_became_peered":"2023-07-09T22:01:22.712232+0000","last_unstale":"2023-07-09T22:01:22.720677+0000","last_undegraded":"2023-07-09T22:01:22.720677+0000","last_fullsized":"2023-07-09T22:01:22.720677+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:43:09.561358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705981+0000","last_change":"2023-07-09T22:01:22.705981+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705981+0000","last_undegraded":"2023-07-09T22:01:22.705981+0000","last_fullsized":"2023-07-09T22:01:22.705981+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.723151+0000","last_change":"2023-07-09T22:01:22.721233+0000","last_active":"2023-07-09T22:01:22.723151+0000","last_peered":"2023-07-09T22:01:22.723151+0000","last_clean":"2023-07-09T22:01:22.723151+0000","last_became_active":"2023-07-09T22:01:22.720929+0000","last_became_peered":"2023-07-09T22:01:22.720929+0000","last_unstale":"2023-07-09T22:01:22.723151+0000","last_undegraded":"2023-07-09T22:01:22.723151+0000","last_fullsized":"2023-07-09T22:01:22.723151+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:36:21.099465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700038+0000","last_change":"2023-07-09T22:01:22.700038+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700038+0000","last_undegraded":"2023-07-09T22:01:22.700038+0000","last_fullsized":"2023-07-09T22:01:22.700038+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713603+0000","last_change":"2023-07-09T22:01:22.711186+0000","last_active":"2023-07-09T22:01:22.713603+0000","last_peered":"2023-07-09T22:01:22.713603+0000","last_clean":"2023-07-09T22:01:22.713603+0000","last_became_active":"2023-07-09T22:01:22.710901+0000","last_became_peered":"2023-07-09T22:01:22.710901+0000","last_unstale":"2023-07-09T22:01:22.713603+0000","last_undegraded":"2023-07-09T22:01:22.713603+0000","last_fullsized":"2023-07-09T22:01:22.713603+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:57.127428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702180+0000","last_change":"2023-07-09T22:01:22.702180+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702180+0000","last_undegraded":"2023-07-09T22:01:22.702180+0000","last_fullsized":"2023-07-09T22:01:22.702180+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719454+0000","last_change":"2023-07-09T22:01:22.716955+0000","last_active":"2023-07-09T22:01:22.719454+0000","last_peered":"2023-07-09T22:01:22.719454+0000","last_clean":"2023-07-09T22:01:22.719454+0000","last_became_active":"2023-07-09T22:01:22.716695+0000","last_became_peered":"2023-07-09T22:01:22.716695+0000","last_unstale":"2023-07-09T22:01:22.719454+0000","last_undegraded":"2023-07-09T22:01:22.719454+0000","last_fullsized":"2023-07-09T22:01:22.719454+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:35:45.561939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702731+0000","last_change":"2023-07-09T22:01:22.702731+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702731+0000","last_undegraded":"2023-07-09T22:01:22.702731+0000","last_fullsized":"2023-07-09T22:01:22.702731+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713751+0000","last_change":"2023-07-09T22:01:22.710096+0000","last_active":"2023-07-09T22:01:22.713751+0000","last_peered":"2023-07-09T22:01:22.713751+0000","last_clean":"2023-07-09T22:01:22.713751+0000","last_became_active":"2023-07-09T22:01:22.709830+0000","last_became_peered":"2023-07-09T22:01:22.709830+0000","last_unstale":"2023-07-09T22:01:22.713751+0000","last_undegraded":"2023-07-09T22:01:22.713751+0000","last_fullsized":"2023-07-09T22:01:22.713751+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:08.779913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698615+0000","last_change":"2023-07-09T22:01:22.698615+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698615+0000","last_undegraded":"2023-07-09T22:01:22.698615+0000","last_fullsized":"2023-07-09T22:01:22.698615+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.724861+0000","last_change":"2023-07-09T22:01:22.724154+0000","last_active":"2023-07-09T22:01:22.724861+0000","last_peered":"2023-07-09T22:01:22.724861+0000","last_clean":"2023-07-09T22:01:22.724861+0000","last_became_active":"2023-07-09T22:01:22.723898+0000","last_became_peered":"2023-07-09T22:01:22.723898+0000","last_unstale":"2023-07-09T22:01:22.724861+0000","last_undegraded":"2023-07-09T22:01:22.724861+0000","last_fullsized":"2023-07-09T22:01:22.724861+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:01:25.517184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698845+0000","last_change":"2023-07-09T22:01:22.698845+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698845+0000","last_undegraded":"2023-07-09T22:01:22.698845+0000","last_fullsized":"2023-07-09T22:01:22.698845+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717097+0000","last_change":"2023-07-09T22:01:22.714987+0000","last_active":"2023-07-09T22:01:22.717097+0000","last_peered":"2023-07-09T22:01:22.717097+0000","last_clean":"2023-07-09T22:01:22.717097+0000","last_became_active":"2023-07-09T22:01:22.709986+0000","last_became_peered":"2023-07-09T22:01:22.709986+0000","last_unstale":"2023-07-09T22:01:22.717097+0000","last_undegraded":"2023-07-09T22:01:22.717097+0000","last_fullsized":"2023-07-09T22:01:22.717097+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:36:51.712361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702403+0000","last_change":"2023-07-09T22:01:22.702403+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702403+0000","last_undegraded":"2023-07-09T22:01:22.702403+0000","last_fullsized":"2023-07-09T22:01:22.702403+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.716447+0000","last_change":"2023-07-09T22:01:22.712957+0000","last_active":"2023-07-09T22:01:22.716447+0000","last_peered":"2023-07-09T22:01:22.716447+0000","last_clean":"2023-07-09T22:01:22.716447+0000","last_became_active":"2023-07-09T22:01:22.712670+0000","last_became_peered":"2023-07-09T22:01:22.712670+0000","last_unstale":"2023-07-09T22:01:22.716447+0000","last_undegraded":"2023-07-09T22:01:22.716447+0000","last_fullsized":"2023-07-09T22:01:22.716447+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:43.538177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699736+0000","last_change":"2023-07-09T22:01:22.699736+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699736+0000","last_undegraded":"2023-07-09T22:01:22.699736+0000","last_fullsized":"2023-07-09T22:01:22.699736+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712992+0000","last_change":"2023-07-09T22:01:22.709765+0000","last_active":"2023-07-09T22:01:22.712992+0000","last_peered":"2023-07-09T22:01:22.712992+0000","last_clean":"2023-07-09T22:01:22.712992+0000","last_became_active":"2023-07-09T22:01:22.708560+0000","last_became_peered":"2023-07-09T22:01:22.708560+0000","last_unstale":"2023-07-09T22:01:22.712992+0000","last_undegraded":"2023-07-09T22:01:22.712992+0000","last_fullsized":"2023-07-09T22:01:22.712992+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:34:52.687950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702033+0000","last_change":"2023-07-09T22:01:22.702033+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702033+0000","last_undegraded":"2023-07-09T22:01:22.702033+0000","last_fullsized":"2023-07-09T22:01:22.702033+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722105+0000","last_change":"2023-07-09T22:01:22.719697+0000","last_active":"2023-07-09T22:01:22.722105+0000","last_peered":"2023-07-09T22:01:22.722105+0000","last_clean":"2023-07-09T22:01:22.722105+0000","last_became_active":"2023-07-09T22:01:22.719063+0000","last_became_peered":"2023-07-09T22:01:22.719063+0000","last_unstale":"2023-07-09T22:01:22.722105+0000","last_undegraded":"2023-07-09T22:01:22.722105+0000","last_fullsized":"2023-07-09T22:01:22.722105+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:53:38.288817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699163+0000","last_change":"2023-07-09T22:01:22.699163+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699163+0000","last_undegraded":"2023-07-09T22:01:22.699163+0000","last_fullsized":"2023-07-09T22:01:22.699163+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720298+0000","last_change":"2023-07-09T22:01:22.714900+0000","last_active":"2023-07-09T22:01:22.720298+0000","last_peered":"2023-07-09T22:01:22.720298+0000","last_clean":"2023-07-09T22:01:22.720298+0000","last_became_active":"2023-07-09T22:01:22.714627+0000","last_became_peered":"2023-07-09T22:01:22.714627+0000","last_unstale":"2023-07-09T22:01:22.720298+0000","last_undegraded":"2023-07-09T22:01:22.720298+0000","last_fullsized":"2023-07-09T22:01:22.720298+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:51:22.412609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701743+0000","last_change":"2023-07-09T22:01:22.701743+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701743+0000","last_undegraded":"2023-07-09T22:01:22.701743+0000","last_fullsized":"2023-07-09T22:01:22.701743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.721960+0000","last_change":"2023-07-09T22:01:22.721160+0000","last_active":"2023-07-09T22:01:22.721960+0000","last_peered":"2023-07-09T22:01:22.721960+0000","last_clean":"2023-07-09T22:01:22.721960+0000","last_became_active":"2023-07-09T22:01:22.720842+0000","last_became_peered":"2023-07-09T22:01:22.720842+0000","last_unstale":"2023-07-09T22:01:22.721960+0000","last_undegraded":"2023-07-09T22:01:22.721960+0000","last_fullsized":"2023-07-09T22:01:22.721960+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:11:37.760665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706666+0000","last_change":"2023-07-09T22:01:22.706666+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706666+0000","last_undegraded":"2023-07-09T22:01:22.706666+0000","last_fullsized":"2023-07-09T22:01:22.706666+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717030+0000","last_change":"2023-07-09T22:01:22.714982+0000","last_active":"2023-07-09T22:01:22.717030+0000","last_peered":"2023-07-09T22:01:22.717030+0000","last_clean":"2023-07-09T22:01:22.717030+0000","last_became_active":"2023-07-09T22:01:22.714665+0000","last_became_peered":"2023-07-09T22:01:22.714665+0000","last_unstale":"2023-07-09T22:01:22.717030+0000","last_undegraded":"2023-07-09T22:01:22.717030+0000","last_fullsized":"2023-07-09T22:01:22.717030+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:30:27.738602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.702745+0000","last_change":"2023-07-09T22:01:22.702745+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.702745+0000","last_undegraded":"2023-07-09T22:01:22.702745+0000","last_fullsized":"2023-07-09T22:01:22.702745+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720386+0000","last_change":"2023-07-09T22:01:22.716729+0000","last_active":"2023-07-09T22:01:22.720386+0000","last_peered":"2023-07-09T22:01:22.720386+0000","last_clean":"2023-07-09T22:01:22.720386+0000","last_became_active":"2023-07-09T22:01:22.716453+0000","last_became_peered":"2023-07-09T22:01:22.716453+0000","last_unstale":"2023-07-09T22:01:22.720386+0000","last_undegraded":"2023-07-09T22:01:22.720386+0000","last_fullsized":"2023-07-09T22:01:22.720386+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:53:56.554277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705528+0000","last_change":"2023-07-09T22:01:22.705528+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705528+0000","last_undegraded":"2023-07-09T22:01:22.705528+0000","last_fullsized":"2023-07-09T22:01:22.705528+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720432+0000","last_change":"2023-07-09T22:01:22.719319+0000","last_active":"2023-07-09T22:01:22.720432+0000","last_peered":"2023-07-09T22:01:22.720432+0000","last_clean":"2023-07-09T22:01:22.720432+0000","last_became_active":"2023-07-09T22:01:22.718992+0000","last_became_peered":"2023-07-09T22:01:22.718992+0000","last_unstale":"2023-07-09T22:01:22.720432+0000","last_undegraded":"2023-07-09T22:01:22.720432+0000","last_fullsized":"2023-07-09T22:01:22.720432+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:02:45.713044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.698581+0000","last_change":"2023-07-09T22:01:22.698581+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.698581+0000","last_undegraded":"2023-07-09T22:01:22.698581+0000","last_fullsized":"2023-07-09T22:01:22.698581+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712961+0000","last_change":"2023-07-09T22:01:22.707404+0000","last_active":"2023-07-09T22:01:22.712961+0000","last_peered":"2023-07-09T22:01:22.712961+0000","last_clean":"2023-07-09T22:01:22.712961+0000","last_became_active":"2023-07-09T22:01:22.707132+0000","last_became_peered":"2023-07-09T22:01:22.707132+0000","last_unstale":"2023-07-09T22:01:22.712961+0000","last_undegraded":"2023-07-09T22:01:22.712961+0000","last_fullsized":"2023-07-09T22:01:22.712961+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:55:55.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699588+0000","last_change":"2023-07-09T22:01:22.699588+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699588+0000","last_undegraded":"2023-07-09T22:01:22.699588+0000","last_fullsized":"2023-07-09T22:01:22.699588+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722125+0000","last_change":"2023-07-09T22:01:22.719872+0000","last_active":"2023-07-09T22:01:22.722125+0000","last_peered":"2023-07-09T22:01:22.722125+0000","last_clean":"2023-07-09T22:01:22.722125+0000","last_became_active":"2023-07-09T22:01:22.719439+0000","last_became_peered":"2023-07-09T22:01:22.719439+0000","last_unstale":"2023-07-09T22:01:22.722125+0000","last_undegraded":"2023-07-09T22:01:22.722125+0000","last_fullsized":"2023-07-09T22:01:22.722125+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:06.238635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1227,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705352+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:01:22.705352+0000","last_peered":"2023-07-09T22:01:22.705352+0000","last_clean":"2023-07-09T22:01:22.705352+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:01:22.705352+0000","last_undegraded":"2023-07-09T22:01:22.705352+0000","last_fullsized":"2023-07-09T22:01:22.705352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:37:21.495358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705411+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:01:22.705411+0000","last_peered":"2023-07-09T22:01:22.705411+0000","last_clean":"2023-07-09T22:01:22.705411+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:01:22.705411+0000","last_undegraded":"2023-07-09T22:01:22.705411+0000","last_fullsized":"2023-07-09T22:01:22.705411+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:03:05.715239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.705077+0000","last_change":"2023-07-09T22:01:22.705077+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.705077+0000","last_undegraded":"2023-07-09T22:01:22.705077+0000","last_fullsized":"2023-07-09T22:01:22.705077+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.717001+0000","last_change":"2023-07-09T22:01:22.714653+0000","last_active":"2023-07-09T22:01:22.717001+0000","last_peered":"2023-07-09T22:01:22.717001+0000","last_clean":"2023-07-09T22:01:22.717001+0000","last_became_active":"2023-07-09T22:01:22.714202+0000","last_became_peered":"2023-07-09T22:01:22.714202+0000","last_unstale":"2023-07-09T22:01:22.717001+0000","last_undegraded":"2023-07-09T22:01:22.717001+0000","last_fullsized":"2023-07-09T22:01:22.717001+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:15:40.623736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":330,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.705222+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:01:22.705222+0000","last_peered":"2023-07-09T22:01:22.705222+0000","last_clean":"2023-07-09T22:01:22.705222+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:01:22.705222+0000","last_undegraded":"2023-07-09T22:01:22.705222+0000","last_fullsized":"2023-07-09T22:01:22.705222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:07:02.006794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.699076+0000","last_change":"2023-07-09T22:01:22.699076+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.699076+0000","last_undegraded":"2023-07-09T22:01:22.699076+0000","last_fullsized":"2023-07-09T22:01:22.699076+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.720735+0000","last_change":"2023-07-09T22:01:22.718035+0000","last_active":"2023-07-09T22:01:22.720735+0000","last_peered":"2023-07-09T22:01:22.720735+0000","last_clean":"2023-07-09T22:01:22.720735+0000","last_became_active":"2023-07-09T22:01:22.717691+0000","last_became_peered":"2023-07-09T22:01:22.717691+0000","last_unstale":"2023-07-09T22:01:22.720735+0000","last_undegraded":"2023-07-09T22:01:22.720735+0000","last_fullsized":"2023-07-09T22:01:22.720735+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:30:35.329450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.700982+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:01:22.700982+0000","last_peered":"2023-07-09T22:01:22.700982+0000","last_clean":"2023-07-09T22:01:22.700982+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:01:22.700982+0000","last_undegraded":"2023-07-09T22:01:22.700982+0000","last_fullsized":"2023-07-09T22:01:22.700982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:44.666312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700751+0000","last_change":"2023-07-09T22:01:22.700751+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700751+0000","last_undegraded":"2023-07-09T22:01:22.700751+0000","last_fullsized":"2023-07-09T22:01:22.700751+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.722974+0000","last_change":"2023-07-09T22:01:22.720784+0000","last_active":"2023-07-09T22:01:22.722974+0000","last_peered":"2023-07-09T22:01:22.722974+0000","last_clean":"2023-07-09T22:01:22.722974+0000","last_became_active":"2023-07-09T22:01:22.720486+0000","last_became_peered":"2023-07-09T22:01:22.720486+0000","last_unstale":"2023-07-09T22:01:22.722974+0000","last_undegraded":"2023-07-09T22:01:22.722974+0000","last_fullsized":"2023-07-09T22:01:22.722974+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:42:22.280653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":379,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704835+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:01:22.704835+0000","last_peered":"2023-07-09T22:01:22.704835+0000","last_clean":"2023-07-09T22:01:22.704835+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:01:22.704835+0000","last_undegraded":"2023-07-09T22:01:22.704835+0000","last_fullsized":"2023-07-09T22:01:22.704835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:52:44.309853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.701433+0000","last_change":"2023-07-09T22:01:22.701433+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.701433+0000","last_undegraded":"2023-07-09T22:01:22.701433+0000","last_fullsized":"2023-07-09T22:01:22.701433+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.713115+0000","last_change":"2023-07-09T22:01:22.708768+0000","last_active":"2023-07-09T22:01:22.713115+0000","last_peered":"2023-07-09T22:01:22.713115+0000","last_clean":"2023-07-09T22:01:22.713115+0000","last_became_active":"2023-07-09T22:01:22.708312+0000","last_became_peered":"2023-07-09T22:01:22.708312+0000","last_unstale":"2023-07-09T22:01:22.713115+0000","last_undegraded":"2023-07-09T22:01:22.713115+0000","last_fullsized":"2023-07-09T22:01:22.713115+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:46:00.877979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":321,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.706954+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:01:22.706954+0000","last_peered":"2023-07-09T22:01:22.706954+0000","last_clean":"2023-07-09T22:01:22.706954+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:01:22.706954+0000","last_undegraded":"2023-07-09T22:01:22.706954+0000","last_fullsized":"2023-07-09T22:01:22.706954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:03:44.756038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.700880+0000","last_change":"2023-07-09T22:01:22.700880+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.700880+0000","last_undegraded":"2023-07-09T22:01:22.700880+0000","last_fullsized":"2023-07-09T22:01:22.700880+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.718262+0000","last_change":"2023-07-09T22:01:22.716008+0000","last_active":"2023-07-09T22:01:22.718262+0000","last_peered":"2023-07-09T22:01:22.718262+0000","last_clean":"2023-07-09T22:01:22.718262+0000","last_became_active":"2023-07-09T22:01:22.715729+0000","last_became_peered":"2023-07-09T22:01:22.715729+0000","last_unstale":"2023-07-09T22:01:22.718262+0000","last_undegraded":"2023-07-09T22:01:22.718262+0000","last_fullsized":"2023-07-09T22:01:22.718262+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:20:28.978973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":329,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.708790+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:01:22.708790+0000","last_peered":"2023-07-09T22:01:22.708790+0000","last_clean":"2023-07-09T22:01:22.708790+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:01:22.708790+0000","last_undegraded":"2023-07-09T22:01:22.708790+0000","last_fullsized":"2023-07-09T22:01:22.708790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:18:41.059249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.704695+0000","last_change":"2023-07-09T22:01:22.704695+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.704695+0000","last_undegraded":"2023-07-09T22:01:22.704695+0000","last_fullsized":"2023-07-09T22:01:22.704695+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.712831+0000","last_change":"2023-07-09T22:01:22.708500+0000","last_active":"2023-07-09T22:01:22.712831+0000","last_peered":"2023-07-09T22:01:22.712831+0000","last_clean":"2023-07-09T22:01:22.712831+0000","last_became_active":"2023-07-09T22:01:22.708177+0000","last_became_peered":"2023-07-09T22:01:22.708177+0000","last_unstale":"2023-07-09T22:01:22.712831+0000","last_undegraded":"2023-07-09T22:01:22.712831+0000","last_fullsized":"2023-07-09T22:01:22.712831+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:26:04.644983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":323,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704311+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:01:22.704311+0000","last_peered":"2023-07-09T22:01:22.704311+0000","last_clean":"2023-07-09T22:01:22.704311+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:01:22.704311+0000","last_undegraded":"2023-07-09T22:01:22.704311+0000","last_fullsized":"2023-07-09T22:01:22.704311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:03:41.163982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":1,"reported_epoch":194,"state":"creating+peering","last_fresh":"2023-07-09T22:01:22.706346+0000","last_change":"2023-07-09T22:01:22.706346+0000","last_active":"2023-07-09T22:01:22.685056+0000","last_peered":"2023-07-09T22:01:22.685056+0000","last_clean":"2023-07-09T22:01:22.685056+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-07-09T22:01:22.706346+0000","last_undegraded":"2023-07-09T22:01:22.706346+0000","last_fullsized":"2023-07-09T22:01:22.706346+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.719347+0000","last_change":"2023-07-09T22:01:22.711803+0000","last_active":"2023-07-09T22:01:22.719347+0000","last_peered":"2023-07-09T22:01:22.719347+0000","last_clean":"2023-07-09T22:01:22.719347+0000","last_became_active":"2023-07-09T22:01:22.709155+0000","last_became_peered":"2023-07-09T22:01:22.709155+0000","last_unstale":"2023-07-09T22:01:22.719347+0000","last_undegraded":"2023-07-09T22:01:22.719347+0000","last_fullsized":"2023-07-09T22:01:22.719347+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:56:18.713961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":335,"reported_epoch":194,"state":"active+clean","last_fresh":"2023-07-09T22:01:22.704055+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:01:22.704055+0000","last_peered":"2023-07-09T22:01:22.704055+0000","last_clean":"2023-07-09T22:01:22.704055+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:01:22.704055+0000","last_undegraded":"2023-07-09T22:01:22.704055+0000","last_fullsized":"2023-07-09T22:01:22.704055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:49:11.876041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47948,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323892,"statfs":{"total":96636764160,"available":96587665408,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.80900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95899999999999996,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69099999999999995}]},{"osd":2,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.036,"15min":1.036},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.72899999999999998}]},{"osd":3,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.107,"15min":1.107},"last":0.79300000000000004}]},{"osd":4,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.77600000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.014,"5min":1.0509999999999999,"15min":1.077},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75}]},{"osd":6,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834575310,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":1.075,"15min":1.075},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":0.999,"15min":1.04},"last":0.84399999999999997}]},{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98199999999999998,"15min":1.177},"last":0.752},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.1890000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.504},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.86099999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":1.02,"15min":1.026},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85299999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.92600000000000005,"5min":0.94899999999999995,"15min":1.161},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.099},"last":0.51200000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.052},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.53900000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":1.01,"15min":1.0860000000000001},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.749,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94599999999999995,"5min":1.016,"15min":1.077},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575309,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55548,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316292,"statfs":{"total":96636764160,"available":96579883008,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89300000000000002,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.82899999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.05},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79600000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88500000000000001,"5min":1.095,"15min":1.095},"last":0.748},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.034},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.59799999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.72099999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.81100000000000005,"5min":1.004,"15min":1.004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49299999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.69599999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575311,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37512,"kb_used_data":2368,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334328,"statfs":{"total":96636764160,"available":96598351872,"internally_reserved":0,"allocated":2424832,"data_stored":1251979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":1.075},"last":0.623},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95199999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":0.998,"15min":1.03},"last":0.79300000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0800000000000001,"15min":1.0960000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.84499999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61599999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.026,"5min":1.038,"15min":1.1240000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.84899999999999998,"5min":1.05,"15min":1.079},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.016},"last":0.81200000000000006}]},{"osd":6,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.96499999999999997,"15min":1.018},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.069},"last":0.997}]},{"osd":7,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77200000000000002,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.0149999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575310,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.48399999999999999,"15min":0.47999999999999998},"min":{"1min":0.36799999999999999,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.375}]},{"osd":1,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.47699999999999998,"15min":0.48199999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":1.133},"last":0.308},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53800000000000003,"15min":0.53300000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.34799999999999998},"max":{"1min":0.72699999999999998,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.194},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65200000000000002,"15min":0.64900000000000002},"min":{"1min":0.436,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.83199999999999996,"5min":0.89800000000000002,"15min":1.2390000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.79600000000000004,"15min":0.80900000000000005},"min":{"1min":0.46000000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.244,"5min":1.244,"15min":1.5429999999999999},"last":0.752},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.84999999999999998,"15min":0.85499999999999998},"min":{"1min":0.65300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.014,"5min":1.133,"15min":1.5649999999999999},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.84899999999999998},"min":{"1min":0.627,"5min":0.61299999999999999,"15min":0.56599999999999995},"max":{"1min":1.05,"5min":1.1479999999999999,"15min":1.302},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.81899999999999995,"15min":0.82099999999999995},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.101,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.58399999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1379999999999999,"5min":1.1879999999999999,"15min":1.262},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.79700000000000004,"15min":0.79600000000000004},"min":{"1min":0.51400000000000001,"5min":0.498,"15min":0.498},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.67500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:25 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79700000000000004,"15min":0.81399999999999995},"min":{"1min":0.58099999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81399999999999995,"15min":0.82099999999999995},"min":{"1min":0.57499999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.99399999999999999,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834575311,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59644,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312196,"statfs":{"total":96636764160,"available":96575688704,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.96499999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.77100000000000002,"5min":0.78600000000000003,"15min":0.85099999999999998},"last":0.47999999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.52700000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.016},"last":0.501},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.51400000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":1.117,"15min":1.337},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.45000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1970000000000001,"15min":1.306},"last":0.69699999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.57699999999999996},"max":{"1min":1.304,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.111,"15min":1.375},"last":0.60799999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.70599999999999996,"5min":0.59499999999999997,"15min":0.52200000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.294},"last":0.78500000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.1499999999999999,"5min":1.2809999999999999,"15min":1.298},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1679999999999999,"5min":1.196,"15min":1.256},"last":0.77200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575311,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37500,"kb_used_data":2356,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334340,"statfs":{"total":96636764160,"available":96598364160,"internally_reserved":0,"allocated":2412544,"data_stored":1245303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.495,"15min":0.46999999999999997},"min":{"1min":0.34100000000000003,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.68400000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.751,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.373}]},{"osd":2,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.34100000000000003,"15min":0.32200000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.81799999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.56399999999999995,"15min":0.56299999999999994},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.65700000000000003,"5min":0.872,"15min":0.89200000000000002},"last":0.54100000000000004}]},{"osd":3,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.439,"15min":0.41599999999999998},"max":{"1min":0.79800000000000004,"5min":0.879,"15min":0.96999999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.56799999999999995,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.71599999999999997,"5min":0.79400000000000004,"15min":0.86499999999999999},"last":0.41999999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.83099999999999996,"15min":0.82999999999999996},"min":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.53800000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.84699999999999998,"15min":0.83999999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.046,"5min":1.2769999999999999,"15min":1.337},"last":0.80000000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.79700000000000004,"15min":0.80300000000000005},"min":{"1min":0.67500000000000004,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.01,"5min":1.1279999999999999,"15min":1.2150000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.81000000000000005,"15min":0.81200000000000006},"min":{"1min":0.56999999999999995,"5min":0.55100000000000005,"15min":0.45600000000000002},"max":{"1min":0.90200000000000002,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.94999999999999996}]},{"osd":6,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.78900000000000003,"15min":0.79000000000000004},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.48899999999999999},"max":{"1min":1.0249999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.82099999999999995,"15min":0.82199999999999995},"min":{"1min":0.55200000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.157,"15min":1.1659999999999999},"last":0.91500000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:00:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.82999999999999996,"15min":0.82299999999999995},"min":{"1min":0.65100000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.006,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":1},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.83799999999999997,"15min":0.83499999999999996},"min":{"1min":0.63800000000000001,"5min":0.60499999999999998,"15min":0.57799999999999996},"max":{"1min":0.97799999999999998,"5min":1.321,"15min":1.321},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834575311,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42188,"kb_used_data":2948,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329652,"statfs":{"total":96636764160,"available":96593563648,"internally_reserved":0,"allocated":3018752,"data_stored":1842347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.38200000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.90300000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.56399999999999995}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":0.93899999999999995},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1850000000000001,"5min":1.306,"15min":1.306},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.3600000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.3260000000000001,"15min":1.381},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.65800000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.55000000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.3400000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":1.2210000000000001,"5min":1.397,"15min":1.397},"last":0.58899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:01:28.606 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3f is not active+clean 2023-07-09T22:01:28.607 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.706120+0000', 'last_change': '2023-07-09T22:01:22.706120+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.706120+0000', 'last_undegraded': '2023-07-09T22:01:22.706120+0000', 'last_fullsized': '2023-07-09T22:01:22.706120+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.607 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3e is not active+clean 2023-07-09T22:01:28.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702050+0000', 'last_change': '2023-07-09T22:01:22.702050+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702050+0000', 'last_undegraded': '2023-07-09T22:01:22.702050+0000', 'last_fullsized': '2023-07-09T22:01:22.702050+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.608 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3d is not active+clean 2023-07-09T22:01:28.608 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705927+0000', 'last_change': '2023-07-09T22:01:22.705927+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705927+0000', 'last_undegraded': '2023-07-09T22:01:22.705927+0000', 'last_fullsized': '2023-07-09T22:01:22.705927+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3c is not active+clean 2023-07-09T22:01:28.609 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.707177+0000', 'last_change': '2023-07-09T22:01:22.707177+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.707177+0000', 'last_undegraded': '2023-07-09T22:01:22.707177+0000', 'last_fullsized': '2023-07-09T22:01:22.707177+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.609 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3b is not active+clean 2023-07-09T22:01:28.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.698907+0000', 'last_change': '2023-07-09T22:01:22.698907+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.698907+0000', 'last_undegraded': '2023-07-09T22:01:22.698907+0000', 'last_fullsized': '2023-07-09T22:01:22.698907+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3a is not active+clean 2023-07-09T22:01:28.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700501+0000', 'last_change': '2023-07-09T22:01:22.700501+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700501+0000', 'last_undegraded': '2023-07-09T22:01:22.700501+0000', 'last_fullsized': '2023-07-09T22:01:22.700501+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.39 is not active+clean 2023-07-09T22:01:28.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705133+0000', 'last_change': '2023-07-09T22:01:22.705133+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705133+0000', 'last_undegraded': '2023-07-09T22:01:22.705133+0000', 'last_fullsized': '2023-07-09T22:01:22.705133+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.38 is not active+clean 2023-07-09T22:01:28.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.709286+0000', 'last_change': '2023-07-09T22:01:22.709286+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.709286+0000', 'last_undegraded': '2023-07-09T22:01:22.709286+0000', 'last_fullsized': '2023-07-09T22:01:22.709286+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.37 is not active+clean 2023-07-09T22:01:28.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.707145+0000', 'last_change': '2023-07-09T22:01:22.707145+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.707145+0000', 'last_undegraded': '2023-07-09T22:01:22.707145+0000', 'last_fullsized': '2023-07-09T22:01:22.707145+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.36 is not active+clean 2023-07-09T22:01:28.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704043+0000', 'last_change': '2023-07-09T22:01:22.704043+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704043+0000', 'last_undegraded': '2023-07-09T22:01:22.704043+0000', 'last_fullsized': '2023-07-09T22:01:22.704043+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.35 is not active+clean 2023-07-09T22:01:28.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703515+0000', 'last_change': '2023-07-09T22:01:22.703515+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703515+0000', 'last_undegraded': '2023-07-09T22:01:22.703515+0000', 'last_fullsized': '2023-07-09T22:01:22.703515+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.34 is not active+clean 2023-07-09T22:01:28.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700008+0000', 'last_change': '2023-07-09T22:01:22.700008+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700008+0000', 'last_undegraded': '2023-07-09T22:01:22.700008+0000', 'last_fullsized': '2023-07-09T22:01:22.700008+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.33 is not active+clean 2023-07-09T22:01:28.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.710499+0000', 'last_change': '2023-07-09T22:01:22.710499+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.710499+0000', 'last_undegraded': '2023-07-09T22:01:22.710499+0000', 'last_fullsized': '2023-07-09T22:01:22.710499+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.32 is not active+clean 2023-07-09T22:01:28.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700027+0000', 'last_change': '2023-07-09T22:01:22.700027+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700027+0000', 'last_undegraded': '2023-07-09T22:01:22.700027+0000', 'last_fullsized': '2023-07-09T22:01:22.700027+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.31 is not active+clean 2023-07-09T22:01:28.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701170+0000', 'last_change': '2023-07-09T22:01:22.701170+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701170+0000', 'last_undegraded': '2023-07-09T22:01:22.701170+0000', 'last_fullsized': '2023-07-09T22:01:22.701170+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.30 is not active+clean 2023-07-09T22:01:28.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.708215+0000', 'last_change': '2023-07-09T22:01:22.708215+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.708215+0000', 'last_undegraded': '2023-07-09T22:01:22.708215+0000', 'last_fullsized': '2023-07-09T22:01:22.708215+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2f is not active+clean 2023-07-09T22:01:28.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701728+0000', 'last_change': '2023-07-09T22:01:22.701728+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701728+0000', 'last_undegraded': '2023-07-09T22:01:22.701728+0000', 'last_fullsized': '2023-07-09T22:01:22.701728+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2e is not active+clean 2023-07-09T22:01:28.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703432+0000', 'last_change': '2023-07-09T22:01:22.703432+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703432+0000', 'last_undegraded': '2023-07-09T22:01:22.703432+0000', 'last_fullsized': '2023-07-09T22:01:22.703432+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T22:01:28.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2d is not active+clean 2023-07-09T22:01:28.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703046+0000', 'last_change': '2023-07-09T22:01:22.703046+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703046+0000', 'last_undegraded': '2023-07-09T22:01:22.703046+0000', 'last_fullsized': '2023-07-09T22:01:22.703046+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2c is not active+clean 2023-07-09T22:01:28.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704801+0000', 'last_change': '2023-07-09T22:01:22.704801+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704801+0000', 'last_undegraded': '2023-07-09T22:01:22.704801+0000', 'last_fullsized': '2023-07-09T22:01:22.704801+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2b is not active+clean 2023-07-09T22:01:28.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.708684+0000', 'last_change': '2023-07-09T22:01:22.708684+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.708684+0000', 'last_undegraded': '2023-07-09T22:01:22.708684+0000', 'last_fullsized': '2023-07-09T22:01:22.708684+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2a is not active+clean 2023-07-09T22:01:28.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699667+0000', 'last_change': '2023-07-09T22:01:22.699667+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699667+0000', 'last_undegraded': '2023-07-09T22:01:22.699667+0000', 'last_fullsized': '2023-07-09T22:01:22.699667+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.29 is not active+clean 2023-07-09T22:01:28.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699476+0000', 'last_change': '2023-07-09T22:01:22.699476+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699476+0000', 'last_undegraded': '2023-07-09T22:01:22.699476+0000', 'last_fullsized': '2023-07-09T22:01:22.699476+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.28 is not active+clean 2023-07-09T22:01:28.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.707731+0000', 'last_change': '2023-07-09T22:01:22.707731+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.707731+0000', 'last_undegraded': '2023-07-09T22:01:22.707731+0000', 'last_fullsized': '2023-07-09T22:01:22.707731+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.27 is not active+clean 2023-07-09T22:01:28.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.708878+0000', 'last_change': '2023-07-09T22:01:22.708878+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.708878+0000', 'last_undegraded': '2023-07-09T22:01:22.708878+0000', 'last_fullsized': '2023-07-09T22:01:22.708878+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.26 is not active+clean 2023-07-09T22:01:28.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703106+0000', 'last_change': '2023-07-09T22:01:22.703106+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703106+0000', 'last_undegraded': '2023-07-09T22:01:22.703106+0000', 'last_fullsized': '2023-07-09T22:01:22.703106+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.25 is not active+clean 2023-07-09T22:01:28.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703197+0000', 'last_change': '2023-07-09T22:01:22.703197+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703197+0000', 'last_undegraded': '2023-07-09T22:01:22.703197+0000', 'last_fullsized': '2023-07-09T22:01:22.703197+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.24 is not active+clean 2023-07-09T22:01:28.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.707050+0000', 'last_change': '2023-07-09T22:01:22.707050+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.707050+0000', 'last_undegraded': '2023-07-09T22:01:22.707050+0000', 'last_fullsized': '2023-07-09T22:01:22.707050+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.23 is not active+clean 2023-07-09T22:01:28.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702571+0000', 'last_change': '2023-07-09T22:01:22.702571+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702571+0000', 'last_undegraded': '2023-07-09T22:01:22.702571+0000', 'last_fullsized': '2023-07-09T22:01:22.702571+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.22 is not active+clean 2023-07-09T22:01:28.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704183+0000', 'last_change': '2023-07-09T22:01:22.704183+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704183+0000', 'last_undegraded': '2023-07-09T22:01:22.704183+0000', 'last_fullsized': '2023-07-09T22:01:22.704183+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T22:01:28.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.21 is not active+clean 2023-07-09T22:01:28.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700710+0000', 'last_change': '2023-07-09T22:01:22.700710+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700710+0000', 'last_undegraded': '2023-07-09T22:01:22.700710+0000', 'last_fullsized': '2023-07-09T22:01:22.700710+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.20 is not active+clean 2023-07-09T22:01:28.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704645+0000', 'last_change': '2023-07-09T22:01:22.704645+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704645+0000', 'last_undegraded': '2023-07-09T22:01:22.704645+0000', 'last_fullsized': '2023-07-09T22:01:22.704645+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T22:01:28.627 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.10 is not active+clean 2023-07-09T22:01:28.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700184+0000', 'last_change': '2023-07-09T22:01:22.700184+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700184+0000', 'last_undegraded': '2023-07-09T22:01:22.700184+0000', 'last_fullsized': '2023-07-09T22:01:22.700184+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.11 is not active+clean 2023-07-09T22:01:28.628 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704993+0000', 'last_change': '2023-07-09T22:01:22.704993+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704993+0000', 'last_undegraded': '2023-07-09T22:01:22.704993+0000', 'last_fullsized': '2023-07-09T22:01:22.704993+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.628 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.12 is not active+clean 2023-07-09T22:01:28.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699546+0000', 'last_change': '2023-07-09T22:01:22.699546+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699546+0000', 'last_undegraded': '2023-07-09T22:01:22.699546+0000', 'last_fullsized': '2023-07-09T22:01:22.699546+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.13 is not active+clean 2023-07-09T22:01:28.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701007+0000', 'last_change': '2023-07-09T22:01:22.701007+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701007+0000', 'last_undegraded': '2023-07-09T22:01:22.701007+0000', 'last_fullsized': '2023-07-09T22:01:22.701007+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.14 is not active+clean 2023-07-09T22:01:28.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.703028+0000', 'last_change': '2023-07-09T22:01:22.703028+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.703028+0000', 'last_undegraded': '2023-07-09T22:01:22.703028+0000', 'last_fullsized': '2023-07-09T22:01:22.703028+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.15 is not active+clean 2023-07-09T22:01:28.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699397+0000', 'last_change': '2023-07-09T22:01:22.699397+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699397+0000', 'last_undegraded': '2023-07-09T22:01:22.699397+0000', 'last_fullsized': '2023-07-09T22:01:22.699397+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.16 is not active+clean 2023-07-09T22:01:28.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699032+0000', 'last_change': '2023-07-09T22:01:22.699032+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699032+0000', 'last_undegraded': '2023-07-09T22:01:22.699032+0000', 'last_fullsized': '2023-07-09T22:01:22.699032+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.17 is not active+clean 2023-07-09T22:01:28.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705603+0000', 'last_change': '2023-07-09T22:01:22.705603+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705603+0000', 'last_undegraded': '2023-07-09T22:01:22.705603+0000', 'last_fullsized': '2023-07-09T22:01:22.705603+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.0 is not active+clean 2023-07-09T22:01:28.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701955+0000', 'last_change': '2023-07-09T22:01:22.701955+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701955+0000', 'last_undegraded': '2023-07-09T22:01:22.701955+0000', 'last_fullsized': '2023-07-09T22:01:22.701955+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1 is not active+clean 2023-07-09T22:01:28.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705981+0000', 'last_change': '2023-07-09T22:01:22.705981+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705981+0000', 'last_undegraded': '2023-07-09T22:01:22.705981+0000', 'last_fullsized': '2023-07-09T22:01:22.705981+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T22:01:28.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.2 is not active+clean 2023-07-09T22:01:28.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700038+0000', 'last_change': '2023-07-09T22:01:22.700038+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700038+0000', 'last_undegraded': '2023-07-09T22:01:22.700038+0000', 'last_fullsized': '2023-07-09T22:01:22.700038+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.3 is not active+clean 2023-07-09T22:01:28.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702180+0000', 'last_change': '2023-07-09T22:01:22.702180+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702180+0000', 'last_undegraded': '2023-07-09T22:01:22.702180+0000', 'last_fullsized': '2023-07-09T22:01:22.702180+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.4 is not active+clean 2023-07-09T22:01:28.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702731+0000', 'last_change': '2023-07-09T22:01:22.702731+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702731+0000', 'last_undegraded': '2023-07-09T22:01:22.702731+0000', 'last_fullsized': '2023-07-09T22:01:22.702731+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.5 is not active+clean 2023-07-09T22:01:28.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.698615+0000', 'last_change': '2023-07-09T22:01:22.698615+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.698615+0000', 'last_undegraded': '2023-07-09T22:01:22.698615+0000', 'last_fullsized': '2023-07-09T22:01:22.698615+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.6 is not active+clean 2023-07-09T22:01:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.698845+0000', 'last_change': '2023-07-09T22:01:22.698845+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.698845+0000', 'last_undegraded': '2023-07-09T22:01:22.698845+0000', 'last_fullsized': '2023-07-09T22:01:22.698845+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-07-09T22:01:28.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.7 is not active+clean 2023-07-09T22:01:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702403+0000', 'last_change': '2023-07-09T22:01:22.702403+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702403+0000', 'last_undegraded': '2023-07-09T22:01:22.702403+0000', 'last_fullsized': '2023-07-09T22:01:22.702403+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.8 is not active+clean 2023-07-09T22:01:28.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699736+0000', 'last_change': '2023-07-09T22:01:22.699736+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699736+0000', 'last_undegraded': '2023-07-09T22:01:22.699736+0000', 'last_fullsized': '2023-07-09T22:01:22.699736+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.9 is not active+clean 2023-07-09T22:01:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702033+0000', 'last_change': '2023-07-09T22:01:22.702033+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702033+0000', 'last_undegraded': '2023-07-09T22:01:22.702033+0000', 'last_fullsized': '2023-07-09T22:01:22.702033+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.a is not active+clean 2023-07-09T22:01:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699163+0000', 'last_change': '2023-07-09T22:01:22.699163+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699163+0000', 'last_undegraded': '2023-07-09T22:01:22.699163+0000', 'last_fullsized': '2023-07-09T22:01:22.699163+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.b is not active+clean 2023-07-09T22:01:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701743+0000', 'last_change': '2023-07-09T22:01:22.701743+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701743+0000', 'last_undegraded': '2023-07-09T22:01:22.701743+0000', 'last_fullsized': '2023-07-09T22:01:22.701743+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.c is not active+clean 2023-07-09T22:01:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.706666+0000', 'last_change': '2023-07-09T22:01:22.706666+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.706666+0000', 'last_undegraded': '2023-07-09T22:01:22.706666+0000', 'last_fullsized': '2023-07-09T22:01:22.706666+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-07-09T22:01:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.d is not active+clean 2023-07-09T22:01:28.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.702745+0000', 'last_change': '2023-07-09T22:01:22.702745+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.702745+0000', 'last_undegraded': '2023-07-09T22:01:22.702745+0000', 'last_fullsized': '2023-07-09T22:01:22.702745+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.e is not active+clean 2023-07-09T22:01:28.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705528+0000', 'last_change': '2023-07-09T22:01:22.705528+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705528+0000', 'last_undegraded': '2023-07-09T22:01:22.705528+0000', 'last_fullsized': '2023-07-09T22:01:22.705528+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.f is not active+clean 2023-07-09T22:01:28.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.698581+0000', 'last_change': '2023-07-09T22:01:22.698581+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.698581+0000', 'last_undegraded': '2023-07-09T22:01:22.698581+0000', 'last_fullsized': '2023-07-09T22:01:22.698581+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.642 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.19 is not active+clean 2023-07-09T22:01:28.642 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699588+0000', 'last_change': '2023-07-09T22:01:22.699588+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699588+0000', 'last_undegraded': '2023-07-09T22:01:22.699588+0000', 'last_fullsized': '2023-07-09T22:01:22.699588+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1a is not active+clean 2023-07-09T22:01:28.643 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.705077+0000', 'last_change': '2023-07-09T22:01:22.705077+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.705077+0000', 'last_undegraded': '2023-07-09T22:01:22.705077+0000', 'last_fullsized': '2023-07-09T22:01:22.705077+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-07-09T22:01:28.643 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1b is not active+clean 2023-07-09T22:01:28.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.699076+0000', 'last_change': '2023-07-09T22:01:22.699076+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.699076+0000', 'last_undegraded': '2023-07-09T22:01:22.699076+0000', 'last_fullsized': '2023-07-09T22:01:22.699076+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.644 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.18 is not active+clean 2023-07-09T22:01:28.644 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700751+0000', 'last_change': '2023-07-09T22:01:22.700751+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700751+0000', 'last_undegraded': '2023-07-09T22:01:22.700751+0000', 'last_fullsized': '2023-07-09T22:01:22.700751+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-07-09T22:01:28.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1e is not active+clean 2023-07-09T22:01:28.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.701433+0000', 'last_change': '2023-07-09T22:01:22.701433+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.701433+0000', 'last_undegraded': '2023-07-09T22:01:22.701433+0000', 'last_fullsized': '2023-07-09T22:01:22.701433+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-07-09T22:01:28.645 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1f is not active+clean 2023-07-09T22:01:28.645 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.700880+0000', 'last_change': '2023-07-09T22:01:22.700880+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.700880+0000', 'last_undegraded': '2023-07-09T22:01:22.700880+0000', 'last_fullsized': '2023-07-09T22:01:22.700880+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-07-09T22:01:28.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1c is not active+clean 2023-07-09T22:01:28.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.704695+0000', 'last_change': '2023-07-09T22:01:22.704695+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.704695+0000', 'last_undegraded': '2023-07-09T22:01:22.704695+0000', 'last_fullsized': '2023-07-09T22:01:22.704695+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-07-09T22:01:28.646 INFO:tasks.cephfs.filesystem.ceph_manager:PG 24.1d is not active+clean 2023-07-09T22:01:28.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '24.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 194, 'state': 'creating+peering', 'last_fresh': '2023-07-09T22:01:22.706346+0000', 'last_change': '2023-07-09T22:01:22.706346+0000', 'last_active': '2023-07-09T22:01:22.685056+0000', 'last_peered': '2023-07-09T22:01:22.685056+0000', 'last_clean': '2023-07-09T22:01:22.685056+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-07-09T22:01:22.706346+0000', 'last_undegraded': '2023-07-09T22:01:22.706346+0000', 'last_fullsized': '2023-07-09T22:01:22.706346+0000', 'mapping_epoch': 194, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 194, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'last_clean_scrub_stamp': '2023-07-09T22:01:22.685056+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-07-09T22:01:28.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-07-09T22:01:28.680 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-07-09T22:01:28.673+0000 7f98d55a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T22:01:28.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.785+0000 7f5e7aebd640 1 Processor -- start 2023-07-09T22:01:28.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.785+0000 7f5e7aebd640 1 -- start start 2023-07-09T22:01:28.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.785+0000 7f5e7aebd640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f5e740b4340 0x7f5e7406aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.785+0000 7f5e7aebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e740d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7aebd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e740b49f0 con 0x7f5e740b7ab0 2023-07-09T22:01:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7aebd640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e740b7e80 con 0x7f5e740b4340 2023-07-09T22:01:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7aebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cc8a0 con 0x7f5e740cef80 2023-07-09T22:01:28.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e78c59640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5e740b7ab0 0x7f5e740b3c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60412/0 (socket says 172.21.15.37:60412) 2023-07-09T22:01:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e78c59640 1 -- 172.21.15.37:0/3066497528 learned_addr learned my addr 172.21.15.37:0/3066497528 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> v2:172.21.15.119:3300/0 conn(0x7f5e740b4340 0x7f5e7406aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e740d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050853860 0 0) 0x7f5e740b49f0 con 0x7f5e740b7ab0 2023-07-09T22:01:28.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e64003530 con 0x7f5e740b7ab0 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267923132 0 0) 0x7f5e64003530 con 0x7f5e740b7ab0 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 msgr2=0x7f5e740d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e740d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 >> v2:172.21.15.119:3300/0 conn(0x7f5e740b4340 msgr2=0x7f5e7406aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 --2- 172.21.15.37:0/3066497528 >> v2:172.21.15.119:3300/0 conn(0x7f5e740b4340 0x7f5e7406aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e740ccb80 con 0x7f5e740b7ab0 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f5e68001680 con 0x7f5e740b7ab0 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> v2:172.21.15.119:3300/0 conn(0x7f5e740b4340 0x7f5e7406aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e740d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 >> v1:172.21.15.37:6789/0 conn(0x7f5e740b7ab0 legacy=0x7f5e740b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e64003980 0x7f5e64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e640043b0 0x7f5e64004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e64004f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e740cc8a0 con 0x7f5e640043b0 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e64005670 con 0x7f5e64003980 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6400b9e0 con 0x7f5e740cef80 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e78c59640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e64003980 0x7f5e64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e640043b0 0x7f5e64004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e64004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 -- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 msgr2=0x7f5e64004f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e64004f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 -- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e64003980 msgr2=0x7f5e64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e64003980 0x7f5e64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e73fff640 1 -- 172.21.15.37:0/3066497528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c009a70 con 0x7f5e640043b0 2023-07-09T22:01:28.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.789+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e740cef80 0x7f5e64004f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e640043b0 0x7f5e64004870 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406af90 tx=0x7f5e6001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18410dee4d2c755 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004020 con 0x7f5e640043b0 2023-07-09T22:01:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60004180 con 0x7f5e640043b0 2023-07-09T22:01:28.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e737fe640 1 -- 172.21.15.37:0/3066497528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60004510 con 0x7f5e640043b0 2023-07-09T22:01:28.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3066497528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e640043b0 msgr2=0x7f5e64004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3066497528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e640043b0 0x7f5e64004870 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7f5e7406af90 tx=0x7f5e6001cc10 comp rx=0 tx=0).stop 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7945a640 1 -- 172.21.15.37:0/3066497528 reap_dead start 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3066497528 shutdown_connections 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3066497528 >> 172.21.15.37:0/3066497528 conn(0x7f5e74073090 msgr2=0x7f5e74069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3066497528 shutdown_connections 2023-07-09T22:01:28.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3066497528 wait complete. 2023-07-09T22:01:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 Processor -- start 2023-07-09T22:01:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.793+0000 7f5e7aebd640 1 -- start start 2023-07-09T22:01:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e640043b0 0x7f5e74145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 0x7f5e74147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7415e710 con 0x7f5e7415d2d0 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7415dc80 con 0x7f5e74147a60 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e74148410 con 0x7f5e640043b0 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51432/0 (socket says 172.21.15.37:51432) 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 -- 172.21.15.37:0/3409020898 learned_addr learned my addr 172.21.15.37:0/3409020898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e78c59640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e640043b0 0x7f5e74145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 0x7f5e74147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 -- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e640043b0 msgr2=0x7f5e74145120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e640043b0 0x7f5e74145120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 -- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 msgr2=0x7f5e74147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 0x7f5e74147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 -- 172.21.15.37:0/3409020898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7415de70 con 0x7f5e7415d2d0 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7945a640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 0x7f5e74147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:28.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e73fff640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009bd0 tx=0x7f5e64005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600044f0 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e600a58d0 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e600a5c40 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e7415e150 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e74145bb0 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e74145a10 con 0x7f5e7415d2d0 2023-07-09T22:01:28.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.797+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f5e60006040 con 0x7f5e7415d2d0 2023-07-09T22:01:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.801+0000 7f5e717fa640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 0x7f5e58068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.801+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f5e6011ea60 con 0x7f5e7415d2d0 2023-07-09T22:01:28.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.801+0000 7f5e78c59640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 0x7f5e58068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.801+0000 7f5e78c59640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 0x7f5e58068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001cd0 tx=0x7f5e68007900 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:28.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:28.805+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e74145a10 con 0x7f5e7415d2d0 2023-07-09T22:01:29.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5e74145a10 con 0x7f5e7415d2d0 2023-07-09T22:01:29.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e717fa640 1 -- 172.21.15.37:0/3409020898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+3235 (secure 0 0 0) 0x7f5e600bbcc0 con 0x7f5e7415d2d0 2023-07-09T22:01:29.018 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:29.019 INFO:teuthology.orchestra.run.smithi037.stdout:{"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":2364,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":196,"num_osds":8,"num_up_osds":8,"osd_up_since":1688937737,"num_in_osds":8,"osd_in_since":1688937727,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":41}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":363868160,"bytes_avail":772730245120,"bytes_total":773094113280,"inactive_pgs_ratio":0.60952383279800415},"fsmap":{"epoch":84,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"a","status":"up:active","gid":10761}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-07-09T22:01:11.383611+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mgr":{"daemons":{"summary":"","x":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"y":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"mon":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-07-09T22:01:29.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 msgr2=0x7f5e58068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 0x7f5e58068850 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001cd0 tx=0x7f5e68007900 comp rx=0 tx=0).stop 2023-07-09T22:01:29.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 msgr2=0x7f5e7415d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009bd0 tx=0x7f5e64005800 comp rx=0 tx=0).stop 2023-07-09T22:01:29.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 shutdown_connections 2023-07-09T22:01:29.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f5e580663a0 0x7f5e58068850 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f5e74147a60 0x7f5e74147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e7415d2d0 0x7f5e7415d740 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 --2- 172.21.15.37:0/3409020898 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f5e640043b0 0x7f5e74145120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 >> 172.21.15.37:0/3409020898 conn(0x7f5e74073090 msgr2=0x7f5e74159e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 shutdown_connections 2023-07-09T22:01:29.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.013+0000 7f5e7aebd640 1 -- 172.21.15.37:0/3409020898 wait complete. 2023-07-09T22:01:29.039 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-07-09T22:01:29.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:01:29.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.221+0000 7f9083e0b640 1 Processor -- start 2023-07-09T22:01:29.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.221+0000 7f9083e0b640 1 -- start start 2023-07-09T22:01:29.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9083e0b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f907c15fce0 0x7f907c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9083e0b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 0x7f907c163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9083e0b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f907c0cd080 con 0x7f907c1600b0 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9083e0b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c0cd920 con 0x7f907c15fce0 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9083e0b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f907c0ca2f0 con 0x7f907c0aff40 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f907c15fce0 0x7f907c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f907c15fce0 0x7f907c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51442/0 (socket says 172.21.15.37:51442) 2023-07-09T22:01:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 -- 172.21.15.37:0/1090590803 learned_addr learned my addr 172.21.15.37:0/1090590803 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f90823a8640 1 --2- 172.21.15.37:0/1090590803 >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 0x7f907c163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 -- 172.21.15.37:0/1090590803 >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 msgr2=0x7f907c163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 --2- 172.21.15.37:0/1090590803 >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 0x7f907c163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 -- 172.21.15.37:0/1090590803 >> v1:172.21.15.119:6789/0 conn(0x7f907c1600b0 legacy=0x7f907c0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 -- 172.21.15.37:0/1090590803 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c0cd2d0 con 0x7f907c15fce0 2023-07-09T22:01:29.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f90823a8640 1 --2- 172.21.15.37:0/1090590803 >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 0x7f907c163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:29.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.225+0000 7f9081ba7640 1 --2- 172.21.15.37:0/1090590803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15fce0 0x7f907c0c9620 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f907c0c9550 tx=0x7f907801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9623c023b2447b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9080ba5640 1 -- 172.21.15.37:0/1090590803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90780ab620 con 0x7f907c15fce0 2023-07-09T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9080ba5640 1 -- 172.21.15.37:0/1090590803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90780ab780 con 0x7f907c15fce0 2023-07-09T22:01:29.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9080ba5640 1 -- 172.21.15.37:0/1090590803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90780abb10 con 0x7f907c15fce0 2023-07-09T22:01:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- 172.21.15.37:0/1090590803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15fce0 msgr2=0x7f907c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1090590803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15fce0 0x7f907c0c9620 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f907c0c9550 tx=0x7f907801c400 comp rx=0 tx=0).stop 2023-07-09T22:01:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- 172.21.15.37:0/1090590803 shutdown_connections 2023-07-09T22:01:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1090590803 >> v2:172.21.15.119:3300/0 conn(0x7f907c0aff40 0x7f907c163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1090590803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15fce0 0x7f907c0c9620 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- 172.21.15.37:0/1090590803 >> 172.21.15.37:0/1090590803 conn(0x7f907c0ca830 msgr2=0x7f907c0cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- 172.21.15.37:0/1090590803 shutdown_connections 2023-07-09T22:01:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- 172.21.15.37:0/1090590803 wait complete. 2023-07-09T22:01:29.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 Processor -- start 2023-07-09T22:01:29.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- start start 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c0aff40 0x7f907c0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c15fce0 0x7f907c1628b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0b33a0 con 0x7f907c15b350 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0b0c80 con 0x7f907c15fce0 2023-07-09T22:01:29.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f9083e0b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907c0b0f60 con 0x7f907c0aff40 2023-07-09T22:01:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.229+0000 7f90823a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51456/0 (socket says 172.21.15.37:51456) 2023-07-09T22:01:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f9081ba7640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c0aff40 0x7f907c0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90813a6640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c15fce0 0x7f907c1628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 -- 172.21.15.37:0/1283321385 learned_addr learned my addr 172.21.15.37:0/1283321385 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 -- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c0aff40 msgr2=0x7f907c0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c0aff40 0x7f907c0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 -- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c15fce0 msgr2=0x7f907c1628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c15fce0 0x7f907c1628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 -- 172.21.15.37:0/1283321385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780094d0 con 0x7f907c15b350 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90823a8640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f907400cea0 tx=0x7f907400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074003bf0 con 0x7f907c15b350 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9074003d70 con 0x7f907c15b350 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907400d880 con 0x7f907c15b350 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f907c148b20 con 0x7f907c15b350 2023-07-09T22:01:29.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f907c162df0 con 0x7f907c15b350 2023-07-09T22:01:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f907c163010 con 0x7f907c15b350 2023-07-09T22:01:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.233+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f907400d9e0 con 0x7f907c15b350 2023-07-09T22:01:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.237+0000 7f90727fc640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 0x7f9060068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:29.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.237+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f9074084790 con 0x7f907c15b350 2023-07-09T22:01:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.237+0000 7f9081ba7640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 0x7f9060068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:29.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.237+0000 7f9081ba7640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 0x7f9060068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90780af000 tx=0x7f90780b6040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:29.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.241+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f907c163010 con 0x7f907c15b350 2023-07-09T22:01:29.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.389+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f907c0b3550 con 0x7f90600663a0 2023-07-09T22:01:29.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.401+0000 7f90727fc640 1 -- 172.21.15.37:0/1283321385 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311469 (secure 0 0 0) 0x7f907c0b3550 con 0x7f90600663a0 2023-07-09T22:01:29.408 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:29.410 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:01:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 msgr2=0x7f9060068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 0x7f9060068850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90780af000 tx=0x7f90780b6040 comp rx=0 tx=0).stop 2023-07-09T22:01:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 msgr2=0x7f907c147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7f907400cea0 tx=0x7f907400cf90 comp rx=0 tx=0).stop 2023-07-09T22:01:29.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 shutdown_connections 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f90600663a0 0x7f9060068850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f907c15b350 0x7f907c147ca0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f907c15fce0 0x7f907c1628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 --2- 172.21.15.37:0/1283321385 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f907c0aff40 0x7f907c0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 >> 172.21.15.37:0/1283321385 conn(0x7f907c0ca830 msgr2=0x7f907c15be70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 shutdown_connections 2023-07-09T22:01:29.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:29.405+0000 7f9083e0b640 1 -- 172.21.15.37:0/1283321385 wait complete. 2023-07-09T22:01:29.428 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-07-09T22:01:29.387585+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355656,"kb_used_data":20360,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754619064,"statfs":{"total":773094113280,"available":772729921536,"internally_reserved":0,"allocated":20848640,"data_stored":11312436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.690093"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707325+0000","last_change":"2023-07-09T22:01:23.713229+0000","last_active":"2023-07-09T22:01:24.707325+0000","last_peered":"2023-07-09T22:01:24.707325+0000","last_clean":"2023-07-09T22:01:24.707325+0000","last_became_active":"2023-07-09T22:01:23.712871+0000","last_became_peered":"2023-07-09T22:01:23.712871+0000","last_unstale":"2023-07-09T22:01:24.707325+0000","last_undegraded":"2023-07-09T22:01:24.707325+0000","last_fullsized":"2023-07-09T22:01:24.707325+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:47.828159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466269+0000","last_change":"2023-07-09T22:01:23.719780+0000","last_active":"2023-07-09T22:01:25.466269+0000","last_peered":"2023-07-09T22:01:25.466269+0000","last_clean":"2023-07-09T22:01:25.466269+0000","last_became_active":"2023-07-09T22:01:23.719488+0000","last_became_peered":"2023-07-09T22:01:23.719488+0000","last_unstale":"2023-07-09T22:01:25.466269+0000","last_undegraded":"2023-07-09T22:01:25.466269+0000","last_fullsized":"2023-07-09T22:01:25.466269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:15:33.489915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707135+0000","last_change":"2023-07-09T22:01:23.725267+0000","last_active":"2023-07-09T22:01:24.707135+0000","last_peered":"2023-07-09T22:01:24.707135+0000","last_clean":"2023-07-09T22:01:24.707135+0000","last_became_active":"2023-07-09T22:01:23.724831+0000","last_became_peered":"2023-07-09T22:01:23.724831+0000","last_unstale":"2023-07-09T22:01:24.707135+0000","last_undegraded":"2023-07-09T22:01:24.707135+0000","last_fullsized":"2023-07-09T22:01:24.707135+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:13:12.543721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707276+0000","last_change":"2023-07-09T22:01:23.722710+0000","last_active":"2023-07-09T22:01:24.707276+0000","last_peered":"2023-07-09T22:01:24.707276+0000","last_clean":"2023-07-09T22:01:24.707276+0000","last_became_active":"2023-07-09T22:01:23.722380+0000","last_became_peered":"2023-07-09T22:01:23.722380+0000","last_unstale":"2023-07-09T22:01:24.707276+0000","last_undegraded":"2023-07-09T22:01:24.707276+0000","last_fullsized":"2023-07-09T22:01:24.707276+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:27.405058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890752+0000","last_change":"2023-07-09T22:01:23.720969+0000","last_active":"2023-07-09T22:01:24.890752+0000","last_peered":"2023-07-09T22:01:24.890752+0000","last_clean":"2023-07-09T22:01:24.890752+0000","last_became_active":"2023-07-09T22:01:23.720679+0000","last_became_peered":"2023-07-09T22:01:23.720679+0000","last_unstale":"2023-07-09T22:01:24.890752+0000","last_undegraded":"2023-07-09T22:01:24.890752+0000","last_fullsized":"2023-07-09T22:01:24.890752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:38.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465801+0000","last_change":"2023-07-09T22:01:23.727000+0000","last_active":"2023-07-09T22:01:25.465801+0000","last_peered":"2023-07-09T22:01:25.465801+0000","last_clean":"2023-07-09T22:01:25.465801+0000","last_became_active":"2023-07-09T22:01:23.726655+0000","last_became_peered":"2023-07-09T22:01:23.726655+0000","last_unstale":"2023-07-09T22:01:25.465801+0000","last_undegraded":"2023-07-09T22:01:25.465801+0000","last_fullsized":"2023-07-09T22:01:25.465801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:56.137472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994122+0000","last_change":"2023-07-09T22:01:23.718058+0000","last_active":"2023-07-09T22:01:24.994122+0000","last_peered":"2023-07-09T22:01:24.994122+0000","last_clean":"2023-07-09T22:01:24.994122+0000","last_became_active":"2023-07-09T22:01:23.715924+0000","last_became_peered":"2023-07-09T22:01:23.715924+0000","last_unstale":"2023-07-09T22:01:24.994122+0000","last_undegraded":"2023-07-09T22:01:24.994122+0000","last_fullsized":"2023-07-09T22:01:24.994122+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:16:44.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994116+0000","last_change":"2023-07-09T22:01:23.716036+0000","last_active":"2023-07-09T22:01:24.994116+0000","last_peered":"2023-07-09T22:01:24.994116+0000","last_clean":"2023-07-09T22:01:24.994116+0000","last_became_active":"2023-07-09T22:01:23.715558+0000","last_became_peered":"2023-07-09T22:01:23.715558+0000","last_unstale":"2023-07-09T22:01:24.994116+0000","last_undegraded":"2023-07-09T22:01:24.994116+0000","last_fullsized":"2023-07-09T22:01:24.994116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:54.813203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994515+0000","last_change":"2023-07-09T22:01:23.719271+0000","last_active":"2023-07-09T22:01:24.994515+0000","last_peered":"2023-07-09T22:01:24.994515+0000","last_clean":"2023-07-09T22:01:24.994515+0000","last_became_active":"2023-07-09T22:01:23.718952+0000","last_became_peered":"2023-07-09T22:01:23.718952+0000","last_unstale":"2023-07-09T22:01:24.994515+0000","last_undegraded":"2023-07-09T22:01:24.994515+0000","last_fullsized":"2023-07-09T22:01:24.994515+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:41.825605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994578+0000","last_change":"2023-07-09T22:01:23.716041+0000","last_active":"2023-07-09T22:01:24.994578+0000","last_peered":"2023-07-09T22:01:24.994578+0000","last_clean":"2023-07-09T22:01:24.994578+0000","last_became_active":"2023-07-09T22:01:23.715773+0000","last_became_peered":"2023-07-09T22:01:23.715773+0000","last_unstale":"2023-07-09T22:01:24.994578+0000","last_undegraded":"2023-07-09T22:01:24.994578+0000","last_fullsized":"2023-07-09T22:01:24.994578+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:49.023012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706778+0000","last_change":"2023-07-09T22:01:23.715860+0000","last_active":"2023-07-09T22:01:24.706778+0000","last_peered":"2023-07-09T22:01:24.706778+0000","last_clean":"2023-07-09T22:01:24.706778+0000","last_became_active":"2023-07-09T22:01:23.715560+0000","last_became_peered":"2023-07-09T22:01:23.715560+0000","last_unstale":"2023-07-09T22:01:24.706778+0000","last_undegraded":"2023-07-09T22:01:24.706778+0000","last_fullsized":"2023-07-09T22:01:24.706778+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:33:57.376366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466094+0000","last_change":"2023-07-09T22:01:23.726973+0000","last_active":"2023-07-09T22:01:25.466094+0000","last_peered":"2023-07-09T22:01:25.466094+0000","last_clean":"2023-07-09T22:01:25.466094+0000","last_became_active":"2023-07-09T22:01:23.726676+0000","last_became_peered":"2023-07-09T22:01:23.726676+0000","last_unstale":"2023-07-09T22:01:25.466094+0000","last_undegraded":"2023-07-09T22:01:25.466094+0000","last_fullsized":"2023-07-09T22:01:25.466094+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:24.722720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095082+0000","last_change":"2023-07-09T22:01:23.718891+0000","last_active":"2023-07-09T22:01:26.095082+0000","last_peered":"2023-07-09T22:01:26.095082+0000","last_clean":"2023-07-09T22:01:26.095082+0000","last_became_active":"2023-07-09T22:01:23.718622+0000","last_became_peered":"2023-07-09T22:01:23.718622+0000","last_unstale":"2023-07-09T22:01:26.095082+0000","last_undegraded":"2023-07-09T22:01:26.095082+0000","last_fullsized":"2023-07-09T22:01:26.095082+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:23:18.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890526+0000","last_change":"2023-07-09T22:01:23.722222+0000","last_active":"2023-07-09T22:01:24.890526+0000","last_peered":"2023-07-09T22:01:24.890526+0000","last_clean":"2023-07-09T22:01:24.890526+0000","last_became_active":"2023-07-09T22:01:23.718328+0000","last_became_peered":"2023-07-09T22:01:23.718328+0000","last_unstale":"2023-07-09T22:01:24.890526+0000","last_undegraded":"2023-07-09T22:01:24.890526+0000","last_fullsized":"2023-07-09T22:01:24.890526+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:42:10.209731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706225+0000","last_change":"2023-07-09T22:01:23.721852+0000","last_active":"2023-07-09T22:01:24.706225+0000","last_peered":"2023-07-09T22:01:24.706225+0000","last_clean":"2023-07-09T22:01:24.706225+0000","last_became_active":"2023-07-09T22:01:23.721553+0000","last_became_peered":"2023-07-09T22:01:23.721553+0000","last_unstale":"2023-07-09T22:01:24.706225+0000","last_undegraded":"2023-07-09T22:01:24.706225+0000","last_fullsized":"2023-07-09T22:01:24.706225+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:23:42.487204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706528+0000","last_change":"2023-07-09T22:01:23.723575+0000","last_active":"2023-07-09T22:01:24.706528+0000","last_peered":"2023-07-09T22:01:24.706528+0000","last_clean":"2023-07-09T22:01:24.706528+0000","last_became_active":"2023-07-09T22:01:23.723290+0000","last_became_peered":"2023-07-09T22:01:23.723290+0000","last_unstale":"2023-07-09T22:01:24.706528+0000","last_undegraded":"2023-07-09T22:01:24.706528+0000","last_fullsized":"2023-07-09T22:01:24.706528+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:12.772078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994536+0000","last_change":"2023-07-09T22:01:23.718104+0000","last_active":"2023-07-09T22:01:24.994536+0000","last_peered":"2023-07-09T22:01:24.994536+0000","last_clean":"2023-07-09T22:01:24.994536+0000","last_became_active":"2023-07-09T22:01:23.717385+0000","last_became_peered":"2023-07-09T22:01:23.717385+0000","last_unstale":"2023-07-09T22:01:24.994536+0000","last_undegraded":"2023-07-09T22:01:24.994536+0000","last_fullsized":"2023-07-09T22:01:24.994536+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:39.709490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098196+0000","last_change":"2023-07-09T22:01:23.721347+0000","last_active":"2023-07-09T22:01:26.098196+0000","last_peered":"2023-07-09T22:01:26.098196+0000","last_clean":"2023-07-09T22:01:26.098196+0000","last_became_active":"2023-07-09T22:01:23.721071+0000","last_became_peered":"2023-07-09T22:01:23.721071+0000","last_unstale":"2023-07-09T22:01:26.098196+0000","last_undegraded":"2023-07-09T22:01:26.098196+0000","last_fullsized":"2023-07-09T22:01:26.098196+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:43:18.654280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706935+0000","last_change":"2023-07-09T22:01:23.725566+0000","last_active":"2023-07-09T22:01:24.706935+0000","last_peered":"2023-07-09T22:01:24.706935+0000","last_clean":"2023-07-09T22:01:24.706935+0000","last_became_active":"2023-07-09T22:01:23.725262+0000","last_became_peered":"2023-07-09T22:01:23.725262+0000","last_unstale":"2023-07-09T22:01:24.706935+0000","last_undegraded":"2023-07-09T22:01:24.706935+0000","last_fullsized":"2023-07-09T22:01:24.706935+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:25:25.449844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700522+0000","last_change":"2023-07-09T22:01:23.710818+0000","last_active":"2023-07-09T22:01:24.700522+0000","last_peered":"2023-07-09T22:01:24.700522+0000","last_clean":"2023-07-09T22:01:24.700522+0000","last_became_active":"2023-07-09T22:01:23.710525+0000","last_became_peered":"2023-07-09T22:01:23.710525+0000","last_unstale":"2023-07-09T22:01:24.700522+0000","last_undegraded":"2023-07-09T22:01:24.700522+0000","last_fullsized":"2023-07-09T22:01:24.700522+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:09.477535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095243+0000","last_change":"2023-07-09T22:01:23.721862+0000","last_active":"2023-07-09T22:01:26.095243+0000","last_peered":"2023-07-09T22:01:26.095243+0000","last_clean":"2023-07-09T22:01:26.095243+0000","last_became_active":"2023-07-09T22:01:23.721533+0000","last_became_peered":"2023-07-09T22:01:23.721533+0000","last_unstale":"2023-07-09T22:01:26.095243+0000","last_undegraded":"2023-07-09T22:01:26.095243+0000","last_fullsized":"2023-07-09T22:01:26.095243+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:15:15.971900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466231+0000","last_change":"2023-07-09T22:01:23.718113+0000","last_active":"2023-07-09T22:01:25.466231+0000","last_peered":"2023-07-09T22:01:25.466231+0000","last_clean":"2023-07-09T22:01:25.466231+0000","last_became_active":"2023-07-09T22:01:23.717836+0000","last_became_peered":"2023-07-09T22:01:23.717836+0000","last_unstale":"2023-07-09T22:01:25.466231+0000","last_undegraded":"2023-07-09T22:01:25.466231+0000","last_fullsized":"2023-07-09T22:01:25.466231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:43:41.008241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890526+0000","last_change":"2023-07-09T22:01:23.712786+0000","last_active":"2023-07-09T22:01:24.890526+0000","last_peered":"2023-07-09T22:01:24.890526+0000","last_clean":"2023-07-09T22:01:24.890526+0000","last_became_active":"2023-07-09T22:01:23.712459+0000","last_became_peered":"2023-07-09T22:01:23.712459+0000","last_unstale":"2023-07-09T22:01:24.890526+0000","last_undegraded":"2023-07-09T22:01:24.890526+0000","last_fullsized":"2023-07-09T22:01:24.890526+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:04.419617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706659+0000","last_change":"2023-07-09T22:01:23.723565+0000","last_active":"2023-07-09T22:01:24.706659+0000","last_peered":"2023-07-09T22:01:24.706659+0000","last_clean":"2023-07-09T22:01:24.706659+0000","last_became_active":"2023-07-09T22:01:23.723278+0000","last_became_peered":"2023-07-09T22:01:23.723278+0000","last_unstale":"2023-07-09T22:01:24.706659+0000","last_undegraded":"2023-07-09T22:01:24.706659+0000","last_fullsized":"2023-07-09T22:01:24.706659+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:43:15.130967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095453+0000","last_change":"2023-07-09T22:01:23.718186+0000","last_active":"2023-07-09T22:01:26.095453+0000","last_peered":"2023-07-09T22:01:26.095453+0000","last_clean":"2023-07-09T22:01:26.095453+0000","last_became_active":"2023-07-09T22:01:23.717909+0000","last_became_peered":"2023-07-09T22:01:23.717909+0000","last_unstale":"2023-07-09T22:01:26.095453+0000","last_undegraded":"2023-07-09T22:01:26.095453+0000","last_fullsized":"2023-07-09T22:01:26.095453+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:13.159089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700645+0000","last_change":"2023-07-09T22:01:23.712319+0000","last_active":"2023-07-09T22:01:24.700645+0000","last_peered":"2023-07-09T22:01:24.700645+0000","last_clean":"2023-07-09T22:01:24.700645+0000","last_became_active":"2023-07-09T22:01:23.712004+0000","last_became_peered":"2023-07-09T22:01:23.712004+0000","last_unstale":"2023-07-09T22:01:24.700645+0000","last_undegraded":"2023-07-09T22:01:24.700645+0000","last_fullsized":"2023-07-09T22:01:24.700645+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:53:54.614391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466032+0000","last_change":"2023-07-09T22:01:23.718534+0000","last_active":"2023-07-09T22:01:25.466032+0000","last_peered":"2023-07-09T22:01:25.466032+0000","last_clean":"2023-07-09T22:01:25.466032+0000","last_became_active":"2023-07-09T22:01:23.718262+0000","last_became_peered":"2023-07-09T22:01:23.718262+0000","last_unstale":"2023-07-09T22:01:25.466032+0000","last_undegraded":"2023-07-09T22:01:25.466032+0000","last_fullsized":"2023-07-09T22:01:25.466032+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:02.862122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095129+0000","last_change":"2023-07-09T22:01:23.723894+0000","last_active":"2023-07-09T22:01:26.095129+0000","last_peered":"2023-07-09T22:01:26.095129+0000","last_clean":"2023-07-09T22:01:26.095129+0000","last_became_active":"2023-07-09T22:01:23.723169+0000","last_became_peered":"2023-07-09T22:01:23.723169+0000","last_unstale":"2023-07-09T22:01:26.095129+0000","last_undegraded":"2023-07-09T22:01:26.095129+0000","last_fullsized":"2023-07-09T22:01:26.095129+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:22:59.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465881+0000","last_change":"2023-07-09T22:01:23.730564+0000","last_active":"2023-07-09T22:01:25.465881+0000","last_peered":"2023-07-09T22:01:25.465881+0000","last_clean":"2023-07-09T22:01:25.465881+0000","last_became_active":"2023-07-09T22:01:23.730226+0000","last_became_peered":"2023-07-09T22:01:23.730226+0000","last_unstale":"2023-07-09T22:01:25.465881+0000","last_undegraded":"2023-07-09T22:01:25.465881+0000","last_fullsized":"2023-07-09T22:01:25.465881+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:14:17.079777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098232+0000","last_change":"2023-07-09T22:01:23.716311+0000","last_active":"2023-07-09T22:01:26.098232+0000","last_peered":"2023-07-09T22:01:26.098232+0000","last_clean":"2023-07-09T22:01:26.098232+0000","last_became_active":"2023-07-09T22:01:23.715996+0000","last_became_peered":"2023-07-09T22:01:23.715996+0000","last_unstale":"2023-07-09T22:01:26.098232+0000","last_undegraded":"2023-07-09T22:01:26.098232+0000","last_fullsized":"2023-07-09T22:01:26.098232+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:32.477357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706311+0000","last_change":"2023-07-09T22:01:23.715515+0000","last_active":"2023-07-09T22:01:24.706311+0000","last_peered":"2023-07-09T22:01:24.706311+0000","last_clean":"2023-07-09T22:01:24.706311+0000","last_became_active":"2023-07-09T22:01:23.715144+0000","last_became_peered":"2023-07-09T22:01:23.715144+0000","last_unstale":"2023-07-09T22:01:24.706311+0000","last_undegraded":"2023-07-09T22:01:24.706311+0000","last_fullsized":"2023-07-09T22:01:24.706311+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:11.739998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098230+0000","last_change":"2023-07-09T22:01:23.719702+0000","last_active":"2023-07-09T22:01:26.098230+0000","last_peered":"2023-07-09T22:01:26.098230+0000","last_clean":"2023-07-09T22:01:26.098230+0000","last_became_active":"2023-07-09T22:01:23.719414+0000","last_became_peered":"2023-07-09T22:01:23.719414+0000","last_unstale":"2023-07-09T22:01:26.098230+0000","last_undegraded":"2023-07-09T22:01:26.098230+0000","last_fullsized":"2023-07-09T22:01:26.098230+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:58.644573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465999+0000","last_change":"2023-07-09T22:01:23.724501+0000","last_active":"2023-07-09T22:01:25.465999+0000","last_peered":"2023-07-09T22:01:25.465999+0000","last_clean":"2023-07-09T22:01:25.465999+0000","last_became_active":"2023-07-09T22:01:23.724142+0000","last_became_peered":"2023-07-09T22:01:23.724142+0000","last_unstale":"2023-07-09T22:01:25.465999+0000","last_undegraded":"2023-07-09T22:01:25.465999+0000","last_fullsized":"2023-07-09T22:01:25.465999+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:36:07.126782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'4","reported_seq":17,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707569+0000","last_change":"2023-07-09T22:01:22.715731+0000","last_active":"2023-07-09T22:01:24.707569+0000","last_peered":"2023-07-09T22:01:24.707569+0000","last_clean":"2023-07-09T22:01:24.707569+0000","last_became_active":"2023-07-09T22:01:22.715273+0000","last_became_peered":"2023-07-09T22:01:22.715273+0000","last_unstale":"2023-07-09T22:01:24.707569+0000","last_undegraded":"2023-07-09T22:01:24.707569+0000","last_fullsized":"2023-07-09T22:01:24.707569+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:43:08.737110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.094930+0000","last_change":"2023-07-09T22:01:23.713673+0000","last_active":"2023-07-09T22:01:26.094930+0000","last_peered":"2023-07-09T22:01:26.094930+0000","last_clean":"2023-07-09T22:01:26.094930+0000","last_became_active":"2023-07-09T22:01:23.713335+0000","last_became_peered":"2023-07-09T22:01:23.713335+0000","last_unstale":"2023-07-09T22:01:26.094930+0000","last_undegraded":"2023-07-09T22:01:26.094930+0000","last_fullsized":"2023-07-09T22:01:26.094930+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:30:24.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890955+0000","last_change":"2023-07-09T22:01:22.718159+0000","last_active":"2023-07-09T22:01:24.890955+0000","last_peered":"2023-07-09T22:01:24.890955+0000","last_clean":"2023-07-09T22:01:24.890955+0000","last_became_active":"2023-07-09T22:01:22.717875+0000","last_became_peered":"2023-07-09T22:01:22.717875+0000","last_unstale":"2023-07-09T22:01:24.890955+0000","last_undegraded":"2023-07-09T22:01:24.890955+0000","last_fullsized":"2023-07-09T22:01:24.890955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:01:00.271778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890606+0000","last_change":"2023-07-09T22:01:23.718407+0000","last_active":"2023-07-09T22:01:24.890606+0000","last_peered":"2023-07-09T22:01:24.890606+0000","last_clean":"2023-07-09T22:01:24.890606+0000","last_became_active":"2023-07-09T22:01:23.717970+0000","last_became_peered":"2023-07-09T22:01:23.717970+0000","last_unstale":"2023-07-09T22:01:24.890606+0000","last_undegraded":"2023-07-09T22:01:24.890606+0000","last_fullsized":"2023-07-09T22:01:24.890606+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:40:35.601917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706960+0000","last_change":"2023-07-09T22:01:22.718561+0000","last_active":"2023-07-09T22:01:24.706960+0000","last_peered":"2023-07-09T22:01:24.706960+0000","last_clean":"2023-07-09T22:01:24.706960+0000","last_became_active":"2023-07-09T22:01:22.718237+0000","last_became_peered":"2023-07-09T22:01:22.718237+0000","last_unstale":"2023-07-09T22:01:24.706960+0000","last_undegraded":"2023-07-09T22:01:24.706960+0000","last_fullsized":"2023-07-09T22:01:24.706960+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:09:52.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466123+0000","last_change":"2023-07-09T22:01:23.724205+0000","last_active":"2023-07-09T22:01:25.466123+0000","last_peered":"2023-07-09T22:01:25.466123+0000","last_clean":"2023-07-09T22:01:25.466123+0000","last_became_active":"2023-07-09T22:01:23.723907+0000","last_became_peered":"2023-07-09T22:01:23.723907+0000","last_unstale":"2023-07-09T22:01:25.466123+0000","last_undegraded":"2023-07-09T22:01:25.466123+0000","last_fullsized":"2023-07-09T22:01:25.466123+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:39.114162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700560+0000","last_change":"2023-07-09T22:01:22.715327+0000","last_active":"2023-07-09T22:01:24.700560+0000","last_peered":"2023-07-09T22:01:24.700560+0000","last_clean":"2023-07-09T22:01:24.700560+0000","last_became_active":"2023-07-09T22:01:22.715043+0000","last_became_peered":"2023-07-09T22:01:22.715043+0000","last_unstale":"2023-07-09T22:01:24.700560+0000","last_undegraded":"2023-07-09T22:01:24.700560+0000","last_fullsized":"2023-07-09T22:01:24.700560+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:42.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994423+0000","last_change":"2023-07-09T22:01:23.717835+0000","last_active":"2023-07-09T22:01:24.994423+0000","last_peered":"2023-07-09T22:01:24.994423+0000","last_clean":"2023-07-09T22:01:24.994423+0000","last_became_active":"2023-07-09T22:01:23.717493+0000","last_became_peered":"2023-07-09T22:01:23.717493+0000","last_unstale":"2023-07-09T22:01:24.994423+0000","last_undegraded":"2023-07-09T22:01:24.994423+0000","last_fullsized":"2023-07-09T22:01:24.994423+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:33.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994234+0000","last_change":"2023-07-09T22:01:22.715924+0000","last_active":"2023-07-09T22:01:24.994234+0000","last_peered":"2023-07-09T22:01:24.994234+0000","last_clean":"2023-07-09T22:01:24.994234+0000","last_became_active":"2023-07-09T22:01:22.715637+0000","last_became_peered":"2023-07-09T22:01:22.715637+0000","last_unstale":"2023-07-09T22:01:24.994234+0000","last_undegraded":"2023-07-09T22:01:24.994234+0000","last_fullsized":"2023-07-09T22:01:24.994234+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:26:38.202117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700739+0000","last_change":"2023-07-09T22:01:23.720644+0000","last_active":"2023-07-09T22:01:24.700739+0000","last_peered":"2023-07-09T22:01:24.700739+0000","last_clean":"2023-07-09T22:01:24.700739+0000","last_became_active":"2023-07-09T22:01:23.720341+0000","last_became_peered":"2023-07-09T22:01:23.720341+0000","last_unstale":"2023-07-09T22:01:24.700739+0000","last_undegraded":"2023-07-09T22:01:24.700739+0000","last_fullsized":"2023-07-09T22:01:24.700739+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:59.554729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890679+0000","last_change":"2023-07-09T22:01:22.707769+0000","last_active":"2023-07-09T22:01:24.890679+0000","last_peered":"2023-07-09T22:01:24.890679+0000","last_clean":"2023-07-09T22:01:24.890679+0000","last_became_active":"2023-07-09T22:01:22.707486+0000","last_became_peered":"2023-07-09T22:01:22.707486+0000","last_unstale":"2023-07-09T22:01:24.890679+0000","last_undegraded":"2023-07-09T22:01:24.890679+0000","last_fullsized":"2023-07-09T22:01:24.890679+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:52.950121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700752+0000","last_change":"2023-07-09T22:01:23.721470+0000","last_active":"2023-07-09T22:01:24.700752+0000","last_peered":"2023-07-09T22:01:24.700752+0000","last_clean":"2023-07-09T22:01:24.700752+0000","last_became_active":"2023-07-09T22:01:23.721185+0000","last_became_peered":"2023-07-09T22:01:23.721185+0000","last_unstale":"2023-07-09T22:01:24.700752+0000","last_undegraded":"2023-07-09T22:01:24.700752+0000","last_fullsized":"2023-07-09T22:01:24.700752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:29:24.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700282+0000","last_change":"2023-07-09T22:01:22.717274+0000","last_active":"2023-07-09T22:01:24.700282+0000","last_peered":"2023-07-09T22:01:24.700282+0000","last_clean":"2023-07-09T22:01:24.700282+0000","last_became_active":"2023-07-09T22:01:22.715566+0000","last_became_peered":"2023-07-09T22:01:22.715566+0000","last_unstale":"2023-07-09T22:01:24.700282+0000","last_undegraded":"2023-07-09T22:01:24.700282+0000","last_fullsized":"2023-07-09T22:01:24.700282+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:08.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707462+0000","last_change":"2023-07-09T22:01:23.716546+0000","last_active":"2023-07-09T22:01:24.707462+0000","last_peered":"2023-07-09T22:01:24.707462+0000","last_clean":"2023-07-09T22:01:24.707462+0000","last_became_active":"2023-07-09T22:01:23.716239+0000","last_became_peered":"2023-07-09T22:01:23.716239+0000","last_unstale":"2023-07-09T22:01:24.707462+0000","last_undegraded":"2023-07-09T22:01:24.707462+0000","last_fullsized":"2023-07-09T22:01:24.707462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:26.216058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994361+0000","last_change":"2023-07-09T22:01:22.716202+0000","last_active":"2023-07-09T22:01:24.994361+0000","last_peered":"2023-07-09T22:01:24.994361+0000","last_clean":"2023-07-09T22:01:24.994361+0000","last_became_active":"2023-07-09T22:01:22.715939+0000","last_became_peered":"2023-07-09T22:01:22.715939+0000","last_unstale":"2023-07-09T22:01:24.994361+0000","last_undegraded":"2023-07-09T22:01:24.994361+0000","last_fullsized":"2023-07-09T22:01:24.994361+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:11:05.655942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994124+0000","last_change":"2023-07-09T22:01:23.715836+0000","last_active":"2023-07-09T22:01:24.994124+0000","last_peered":"2023-07-09T22:01:24.994124+0000","last_clean":"2023-07-09T22:01:24.994124+0000","last_became_active":"2023-07-09T22:01:23.714927+0000","last_became_peered":"2023-07-09T22:01:23.714927+0000","last_unstale":"2023-07-09T22:01:24.994124+0000","last_undegraded":"2023-07-09T22:01:24.994124+0000","last_fullsized":"2023-07-09T22:01:24.994124+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:42.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095509+0000","last_change":"2023-07-09T22:01:22.712512+0000","last_active":"2023-07-09T22:01:26.095509+0000","last_peered":"2023-07-09T22:01:26.095509+0000","last_clean":"2023-07-09T22:01:26.095509+0000","last_became_active":"2023-07-09T22:01:22.712232+0000","last_became_peered":"2023-07-09T22:01:22.712232+0000","last_unstale":"2023-07-09T22:01:26.095509+0000","last_undegraded":"2023-07-09T22:01:26.095509+0000","last_fullsized":"2023-07-09T22:01:26.095509+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:37.111747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098447+0000","last_change":"2023-07-09T22:01:23.718344+0000","last_active":"2023-07-09T22:01:26.098447+0000","last_peered":"2023-07-09T22:01:26.098447+0000","last_clean":"2023-07-09T22:01:26.098447+0000","last_became_active":"2023-07-09T22:01:23.717770+0000","last_became_peered":"2023-07-09T22:01:23.717770+0000","last_unstale":"2023-07-09T22:01:26.098447+0000","last_undegraded":"2023-07-09T22:01:26.098447+0000","last_fullsized":"2023-07-09T22:01:26.098447+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:43:42.040797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994665+0000","last_change":"2023-07-09T22:01:22.721233+0000","last_active":"2023-07-09T22:01:24.994665+0000","last_peered":"2023-07-09T22:01:24.994665+0000","last_clean":"2023-07-09T22:01:24.994665+0000","last_became_active":"2023-07-09T22:01:22.720929+0000","last_became_peered":"2023-07-09T22:01:22.720929+0000","last_unstale":"2023-07-09T22:01:24.994665+0000","last_undegraded":"2023-07-09T22:01:24.994665+0000","last_fullsized":"2023-07-09T22:01:24.994665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:19:36.390753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706836+0000","last_change":"2023-07-09T22:01:23.715208+0000","last_active":"2023-07-09T22:01:24.706836+0000","last_peered":"2023-07-09T22:01:24.706836+0000","last_clean":"2023-07-09T22:01:24.706836+0000","last_became_active":"2023-07-09T22:01:23.714888+0000","last_became_peered":"2023-07-09T22:01:23.714888+0000","last_unstale":"2023-07-09T22:01:24.706836+0000","last_undegraded":"2023-07-09T22:01:24.706836+0000","last_fullsized":"2023-07-09T22:01:24.706836+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:12.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890820+0000","last_change":"2023-07-09T22:01:22.711186+0000","last_active":"2023-07-09T22:01:24.890820+0000","last_peered":"2023-07-09T22:01:24.890820+0000","last_clean":"2023-07-09T22:01:24.890820+0000","last_became_active":"2023-07-09T22:01:22.710901+0000","last_became_peered":"2023-07-09T22:01:22.710901+0000","last_unstale":"2023-07-09T22:01:24.890820+0000","last_undegraded":"2023-07-09T22:01:24.890820+0000","last_fullsized":"2023-07-09T22:01:24.890820+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:34:13.169446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706446+0000","last_change":"2023-07-09T22:01:23.715960+0000","last_active":"2023-07-09T22:01:24.706446+0000","last_peered":"2023-07-09T22:01:24.706446+0000","last_clean":"2023-07-09T22:01:24.706446+0000","last_became_active":"2023-07-09T22:01:23.715669+0000","last_became_peered":"2023-07-09T22:01:23.715669+0000","last_unstale":"2023-07-09T22:01:24.706446+0000","last_undegraded":"2023-07-09T22:01:24.706446+0000","last_fullsized":"2023-07-09T22:01:24.706446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:26:13.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994447+0000","last_change":"2023-07-09T22:01:22.716955+0000","last_active":"2023-07-09T22:01:24.994447+0000","last_peered":"2023-07-09T22:01:24.994447+0000","last_clean":"2023-07-09T22:01:24.994447+0000","last_became_active":"2023-07-09T22:01:22.716695+0000","last_became_peered":"2023-07-09T22:01:22.716695+0000","last_unstale":"2023-07-09T22:01:24.994447+0000","last_undegraded":"2023-07-09T22:01:24.994447+0000","last_fullsized":"2023-07-09T22:01:24.994447+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:09.387829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095291+0000","last_change":"2023-07-09T22:01:23.724075+0000","last_active":"2023-07-09T22:01:26.095291+0000","last_peered":"2023-07-09T22:01:26.095291+0000","last_clean":"2023-07-09T22:01:26.095291+0000","last_became_active":"2023-07-09T22:01:23.723610+0000","last_became_peered":"2023-07-09T22:01:23.723610+0000","last_unstale":"2023-07-09T22:01:26.095291+0000","last_undegraded":"2023-07-09T22:01:26.095291+0000","last_fullsized":"2023-07-09T22:01:26.095291+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:32.866127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890881+0000","last_change":"2023-07-09T22:01:22.710096+0000","last_active":"2023-07-09T22:01:24.890881+0000","last_peered":"2023-07-09T22:01:24.890881+0000","last_clean":"2023-07-09T22:01:24.890881+0000","last_became_active":"2023-07-09T22:01:22.709830+0000","last_became_peered":"2023-07-09T22:01:22.709830+0000","last_unstale":"2023-07-09T22:01:24.890881+0000","last_undegraded":"2023-07-09T22:01:24.890881+0000","last_fullsized":"2023-07-09T22:01:24.890881+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:52:43.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890832+0000","last_change":"2023-07-09T22:01:23.724125+0000","last_active":"2023-07-09T22:01:24.890832+0000","last_peered":"2023-07-09T22:01:24.890832+0000","last_clean":"2023-07-09T22:01:24.890832+0000","last_became_active":"2023-07-09T22:01:23.723878+0000","last_became_peered":"2023-07-09T22:01:23.723878+0000","last_unstale":"2023-07-09T22:01:24.890832+0000","last_undegraded":"2023-07-09T22:01:24.890832+0000","last_fullsized":"2023-07-09T22:01:24.890832+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:10.829134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706691+0000","last_change":"2023-07-09T22:01:22.724154+0000","last_active":"2023-07-09T22:01:24.706691+0000","last_peered":"2023-07-09T22:01:24.706691+0000","last_clean":"2023-07-09T22:01:24.706691+0000","last_became_active":"2023-07-09T22:01:22.723898+0000","last_became_peered":"2023-07-09T22:01:22.723898+0000","last_unstale":"2023-07-09T22:01:24.706691+0000","last_undegraded":"2023-07-09T22:01:24.706691+0000","last_fullsized":"2023-07-09T22:01:24.706691+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:07.454648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890872+0000","last_change":"2023-07-09T22:01:23.723337+0000","last_active":"2023-07-09T22:01:24.890872+0000","last_peered":"2023-07-09T22:01:24.890872+0000","last_clean":"2023-07-09T22:01:24.890872+0000","last_became_active":"2023-07-09T22:01:23.723073+0000","last_became_peered":"2023-07-09T22:01:23.723073+0000","last_unstale":"2023-07-09T22:01:24.890872+0000","last_undegraded":"2023-07-09T22:01:24.890872+0000","last_fullsized":"2023-07-09T22:01:24.890872+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:35.659739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700389+0000","last_change":"2023-07-09T22:01:22.714987+0000","last_active":"2023-07-09T22:01:24.700389+0000","last_peered":"2023-07-09T22:01:24.700389+0000","last_clean":"2023-07-09T22:01:24.700389+0000","last_became_active":"2023-07-09T22:01:22.709986+0000","last_became_peered":"2023-07-09T22:01:22.709986+0000","last_unstale":"2023-07-09T22:01:24.700389+0000","last_undegraded":"2023-07-09T22:01:24.700389+0000","last_fullsized":"2023-07-09T22:01:24.700389+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:48:54.374792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466295+0000","last_change":"2023-07-09T22:01:23.728291+0000","last_active":"2023-07-09T22:01:25.466295+0000","last_peered":"2023-07-09T22:01:25.466295+0000","last_clean":"2023-07-09T22:01:25.466295+0000","last_became_active":"2023-07-09T22:01:23.727958+0000","last_became_peered":"2023-07-09T22:01:23.727958+0000","last_unstale":"2023-07-09T22:01:25.466295+0000","last_undegraded":"2023-07-09T22:01:25.466295+0000","last_fullsized":"2023-07-09T22:01:25.466295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:45.889399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466277+0000","last_change":"2023-07-09T22:01:22.712957+0000","last_active":"2023-07-09T22:01:25.466277+0000","last_peered":"2023-07-09T22:01:25.466277+0000","last_clean":"2023-07-09T22:01:25.466277+0000","last_became_active":"2023-07-09T22:01:22.712670+0000","last_became_peered":"2023-07-09T22:01:22.712670+0000","last_unstale":"2023-07-09T22:01:25.466277+0000","last_undegraded":"2023-07-09T22:01:25.466277+0000","last_fullsized":"2023-07-09T22:01:25.466277+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:51:43.547488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706143+0000","last_change":"2023-07-09T22:01:23.716117+0000","last_active":"2023-07-09T22:01:24.706143+0000","last_peered":"2023-07-09T22:01:24.706143+0000","last_clean":"2023-07-09T22:01:24.706143+0000","last_became_active":"2023-07-09T22:01:23.715033+0000","last_became_peered":"2023-07-09T22:01:23.715033+0000","last_unstale":"2023-07-09T22:01:24.706143+0000","last_undegraded":"2023-07-09T22:01:24.706143+0000","last_fullsized":"2023-07-09T22:01:24.706143+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:58.145389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890962+0000","last_change":"2023-07-09T22:01:22.709765+0000","last_active":"2023-07-09T22:01:24.890962+0000","last_peered":"2023-07-09T22:01:24.890962+0000","last_clean":"2023-07-09T22:01:24.890962+0000","last_became_active":"2023-07-09T22:01:22.708560+0000","last_became_peered":"2023-07-09T22:01:22.708560+0000","last_unstale":"2023-07-09T22:01:24.890962+0000","last_undegraded":"2023-07-09T22:01:24.890962+0000","last_fullsized":"2023-07-09T22:01:24.890962+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:08.639751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994281+0000","last_change":"2023-07-09T22:01:23.716944+0000","last_active":"2023-07-09T22:01:24.994281+0000","last_peered":"2023-07-09T22:01:24.994281+0000","last_clean":"2023-07-09T22:01:24.994281+0000","last_became_active":"2023-07-09T22:01:23.715628+0000","last_became_peered":"2023-07-09T22:01:23.715628+0000","last_unstale":"2023-07-09T22:01:24.994281+0000","last_undegraded":"2023-07-09T22:01:24.994281+0000","last_fullsized":"2023-07-09T22:01:24.994281+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:09:17.527604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"196'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095376+0000","last_change":"2023-07-09T22:01:22.719697+0000","last_active":"2023-07-09T22:01:26.095376+0000","last_peered":"2023-07-09T22:01:26.095376+0000","last_clean":"2023-07-09T22:01:26.095376+0000","last_became_active":"2023-07-09T22:01:22.719063+0000","last_became_peered":"2023-07-09T22:01:22.719063+0000","last_unstale":"2023-07-09T22:01:26.095376+0000","last_undegraded":"2023-07-09T22:01:26.095376+0000","last_fullsized":"2023-07-09T22:01:26.095376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:56.075602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700407+0000","last_change":"2023-07-09T22:01:23.717346+0000","last_active":"2023-07-09T22:01:24.700407+0000","last_peered":"2023-07-09T22:01:24.700407+0000","last_clean":"2023-07-09T22:01:24.700407+0000","last_became_active":"2023-07-09T22:01:23.717081+0000","last_became_peered":"2023-07-09T22:01:23.717081+0000","last_unstale":"2023-07-09T22:01:24.700407+0000","last_undegraded":"2023-07-09T22:01:24.700407+0000","last_fullsized":"2023-07-09T22:01:24.700407+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.093444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095227+0000","last_change":"2023-07-09T22:01:22.714900+0000","last_active":"2023-07-09T22:01:26.095227+0000","last_peered":"2023-07-09T22:01:26.095227+0000","last_clean":"2023-07-09T22:01:26.095227+0000","last_became_active":"2023-07-09T22:01:22.714627+0000","last_became_peered":"2023-07-09T22:01:22.714627+0000","last_unstale":"2023-07-09T22:01:26.095227+0000","last_undegraded":"2023-07-09T22:01:26.095227+0000","last_fullsized":"2023-07-09T22:01:26.095227+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:13:18.206801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994272+0000","last_change":"2023-07-09T22:01:23.722295+0000","last_active":"2023-07-09T22:01:24.994272+0000","last_peered":"2023-07-09T22:01:24.994272+0000","last_clean":"2023-07-09T22:01:24.994272+0000","last_became_active":"2023-07-09T22:01:23.722038+0000","last_became_peered":"2023-07-09T22:01:23.722038+0000","last_unstale":"2023-07-09T22:01:24.994272+0000","last_undegraded":"2023-07-09T22:01:24.994272+0000","last_fullsized":"2023-07-09T22:01:24.994272+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:07.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700651+0000","last_change":"2023-07-09T22:01:22.721160+0000","last_active":"2023-07-09T22:01:24.700651+0000","last_peered":"2023-07-09T22:01:24.700651+0000","last_clean":"2023-07-09T22:01:24.700651+0000","last_became_active":"2023-07-09T22:01:22.720842+0000","last_became_peered":"2023-07-09T22:01:22.720842+0000","last_unstale":"2023-07-09T22:01:24.700651+0000","last_undegraded":"2023-07-09T22:01:24.700651+0000","last_fullsized":"2023-07-09T22:01:24.700651+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:20:11.655517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707418+0000","last_change":"2023-07-09T22:01:23.716968+0000","last_active":"2023-07-09T22:01:24.707418+0000","last_peered":"2023-07-09T22:01:24.707418+0000","last_clean":"2023-07-09T22:01:24.707418+0000","last_became_active":"2023-07-09T22:01:23.715785+0000","last_became_peered":"2023-07-09T22:01:23.715785+0000","last_unstale":"2023-07-09T22:01:24.707418+0000","last_undegraded":"2023-07-09T22:01:24.707418+0000","last_fullsized":"2023-07-09T22:01:24.707418+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:54.940588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706609+0000","last_change":"2023-07-09T22:01:22.714982+0000","last_active":"2023-07-09T22:01:24.706609+0000","last_peered":"2023-07-09T22:01:24.706609+0000","last_clean":"2023-07-09T22:01:24.706609+0000","last_became_active":"2023-07-09T22:01:22.714665+0000","last_became_peered":"2023-07-09T22:01:22.714665+0000","last_unstale":"2023-07-09T22:01:24.706609+0000","last_undegraded":"2023-07-09T22:01:24.706609+0000","last_fullsized":"2023-07-09T22:01:24.706609+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:20:39.765658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466046+0000","last_change":"2023-07-09T22:01:23.724862+0000","last_active":"2023-07-09T22:01:25.466046+0000","last_peered":"2023-07-09T22:01:25.466046+0000","last_clean":"2023-07-09T22:01:25.466046+0000","last_became_active":"2023-07-09T22:01:23.724582+0000","last_became_peered":"2023-07-09T22:01:23.724582+0000","last_unstale":"2023-07-09T22:01:25.466046+0000","last_undegraded":"2023-07-09T22:01:25.466046+0000","last_fullsized":"2023-07-09T22:01:25.466046+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:01.881076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095331+0000","last_change":"2023-07-09T22:01:22.716729+0000","last_active":"2023-07-09T22:01:26.095331+0000","last_peered":"2023-07-09T22:01:26.095331+0000","last_clean":"2023-07-09T22:01:26.095331+0000","last_became_active":"2023-07-09T22:01:22.716453+0000","last_became_peered":"2023-07-09T22:01:22.716453+0000","last_unstale":"2023-07-09T22:01:26.095331+0000","last_undegraded":"2023-07-09T22:01:26.095331+0000","last_fullsized":"2023-07-09T22:01:26.095331+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:02.848202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095110+0000","last_change":"2023-07-09T22:01:23.721167+0000","last_active":"2023-07-09T22:01:26.095110+0000","last_peered":"2023-07-09T22:01:26.095110+0000","last_clean":"2023-07-09T22:01:26.095110+0000","last_became_active":"2023-07-09T22:01:23.720630+0000","last_became_peered":"2023-07-09T22:01:23.720630+0000","last_unstale":"2023-07-09T22:01:26.095110+0000","last_undegraded":"2023-07-09T22:01:26.095110+0000","last_fullsized":"2023-07-09T22:01:26.095110+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:16.525297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706438+0000","last_change":"2023-07-09T22:01:22.719319+0000","last_active":"2023-07-09T22:01:24.706438+0000","last_peered":"2023-07-09T22:01:24.706438+0000","last_clean":"2023-07-09T22:01:24.706438+0000","last_became_active":"2023-07-09T22:01:22.718992+0000","last_became_peered":"2023-07-09T22:01:22.718992+0000","last_unstale":"2023-07-09T22:01:24.706438+0000","last_undegraded":"2023-07-09T22:01:24.706438+0000","last_fullsized":"2023-07-09T22:01:24.706438+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:15.284566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700882+0000","last_change":"2023-07-09T22:01:23.713908+0000","last_active":"2023-07-09T22:01:24.700882+0000","last_peered":"2023-07-09T22:01:24.700882+0000","last_clean":"2023-07-09T22:01:24.700882+0000","last_became_active":"2023-07-09T22:01:23.713494+0000","last_became_peered":"2023-07-09T22:01:23.713494+0000","last_unstale":"2023-07-09T22:01:24.700882+0000","last_undegraded":"2023-07-09T22:01:24.700882+0000","last_fullsized":"2023-07-09T22:01:24.700882+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.549855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890404+0000","last_change":"2023-07-09T22:01:22.707404+0000","last_active":"2023-07-09T22:01:24.890404+0000","last_peered":"2023-07-09T22:01:24.890404+0000","last_clean":"2023-07-09T22:01:24.890404+0000","last_became_active":"2023-07-09T22:01:22.707132+0000","last_became_peered":"2023-07-09T22:01:22.707132+0000","last_unstale":"2023-07-09T22:01:24.890404+0000","last_undegraded":"2023-07-09T22:01:24.890404+0000","last_fullsized":"2023-07-09T22:01:24.890404+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:50.935135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465783+0000","last_change":"2023-07-09T22:01:23.720888+0000","last_active":"2023-07-09T22:01:25.465783+0000","last_peered":"2023-07-09T22:01:25.465783+0000","last_clean":"2023-07-09T22:01:25.465783+0000","last_became_active":"2023-07-09T22:01:23.720574+0000","last_became_peered":"2023-07-09T22:01:23.720574+0000","last_unstale":"2023-07-09T22:01:25.465783+0000","last_undegraded":"2023-07-09T22:01:25.465783+0000","last_fullsized":"2023-07-09T22:01:25.465783+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:47:27.272225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095261+0000","last_change":"2023-07-09T22:01:22.719872+0000","last_active":"2023-07-09T22:01:26.095261+0000","last_peered":"2023-07-09T22:01:26.095261+0000","last_clean":"2023-07-09T22:01:26.095261+0000","last_became_active":"2023-07-09T22:01:22.719439+0000","last_became_peered":"2023-07-09T22:01:22.719439+0000","last_unstale":"2023-07-09T22:01:26.095261+0000","last_undegraded":"2023-07-09T22:01:26.095261+0000","last_fullsized":"2023-07-09T22:01:26.095261+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:55.472549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1231,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466429+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:01:25.466429+0000","last_peered":"2023-07-09T22:01:25.466429+0000","last_clean":"2023-07-09T22:01:25.466429+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:01:25.466429+0000","last_undegraded":"2023-07-09T22:01:25.466429+0000","last_fullsized":"2023-07-09T22:01:25.466429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:29.405401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":383,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706549+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:01:24.706549+0000","last_peered":"2023-07-09T22:01:24.706549+0000","last_clean":"2023-07-09T22:01:24.706549+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:01:24.706549+0000","last_undegraded":"2023-07-09T22:01:24.706549+0000","last_fullsized":"2023-07-09T22:01:24.706549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:20.264619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.094986+0000","last_change":"2023-07-09T22:01:23.719535+0000","last_active":"2023-07-09T22:01:26.094986+0000","last_peered":"2023-07-09T22:01:26.094986+0000","last_clean":"2023-07-09T22:01:26.094986+0000","last_became_active":"2023-07-09T22:01:23.719252+0000","last_became_peered":"2023-07-09T22:01:23.719252+0000","last_unstale":"2023-07-09T22:01:26.094986+0000","last_undegraded":"2023-07-09T22:01:26.094986+0000","last_fullsized":"2023-07-09T22:01:26.094986+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:14.882589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":16,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707369+0000","last_change":"2023-07-09T22:01:22.714653+0000","last_active":"2023-07-09T22:01:24.707369+0000","last_peered":"2023-07-09T22:01:24.707369+0000","last_clean":"2023-07-09T22:01:24.707369+0000","last_became_active":"2023-07-09T22:01:22.714202+0000","last_became_peered":"2023-07-09T22:01:22.714202+0000","last_unstale":"2023-07-09T22:01:24.707369+0000","last_undegraded":"2023-07-09T22:01:24.707369+0000","last_fullsized":"2023-07-09T22:01:24.707369+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:38:21.944632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466419+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:01:25.466419+0000","last_peered":"2023-07-09T22:01:25.466419+0000","last_clean":"2023-07-09T22:01:25.466419+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:01:25.466419+0000","last_undegraded":"2023-07-09T22:01:25.466419+0000","last_fullsized":"2023-07-09T22:01:25.466419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:08:52.470722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700429+0000","last_change":"2023-07-09T22:01:23.714356+0000","last_active":"2023-07-09T22:01:24.700429+0000","last_peered":"2023-07-09T22:01:24.700429+0000","last_clean":"2023-07-09T22:01:24.700429+0000","last_became_active":"2023-07-09T22:01:23.713494+0000","last_became_peered":"2023-07-09T22:01:23.713494+0000","last_unstale":"2023-07-09T22:01:24.700429+0000","last_undegraded":"2023-07-09T22:01:24.700429+0000","last_fullsized":"2023-07-09T22:01:24.700429+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:18:01.072956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'6","reported_seq":19,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095375+0000","last_change":"2023-07-09T22:01:22.718035+0000","last_active":"2023-07-09T22:01:26.095375+0000","last_peered":"2023-07-09T22:01:26.095375+0000","last_clean":"2023-07-09T22:01:26.095375+0000","last_became_active":"2023-07-09T22:01:22.717691+0000","last_became_peered":"2023-07-09T22:01:22.717691+0000","last_unstale":"2023-07-09T22:01:26.095375+0000","last_undegraded":"2023-07-09T22:01:26.095375+0000","last_fullsized":"2023-07-09T22:01:26.095375+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:38.876037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700419+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:01:24.700419+0000","last_peered":"2023-07-09T22:01:24.700419+0000","last_clean":"2023-07-09T22:01:24.700419+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:01:24.700419+0000","last_undegraded":"2023-07-09T22:01:24.700419+0000","last_fullsized":"2023-07-09T22:01:24.700419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:33:52.309259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465702+0000","last_change":"2023-07-09T22:01:23.724106+0000","last_active":"2023-07-09T22:01:25.465702+0000","last_peered":"2023-07-09T22:01:25.465702+0000","last_clean":"2023-07-09T22:01:25.465702+0000","last_became_active":"2023-07-09T22:01:23.723712+0000","last_became_peered":"2023-07-09T22:01:23.723712+0000","last_unstale":"2023-07-09T22:01:25.465702+0000","last_undegraded":"2023-07-09T22:01:25.465702+0000","last_fullsized":"2023-07-09T22:01:25.465702+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:54.293417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095441+0000","last_change":"2023-07-09T22:01:22.720784+0000","last_active":"2023-07-09T22:01:26.095441+0000","last_peered":"2023-07-09T22:01:26.095441+0000","last_clean":"2023-07-09T22:01:26.095441+0000","last_became_active":"2023-07-09T22:01:22.720486+0000","last_became_peered":"2023-07-09T22:01:22.720486+0000","last_unstale":"2023-07-09T22:01:26.095441+0000","last_undegraded":"2023-07-09T22:01:26.095441+0000","last_fullsized":"2023-07-09T22:01:26.095441+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:48.170521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":383,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706952+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:01:24.706952+0000","last_peered":"2023-07-09T22:01:24.706952+0000","last_clean":"2023-07-09T22:01:24.706952+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:01:24.706952+0000","last_undegraded":"2023-07-09T22:01:24.706952+0000","last_fullsized":"2023-07-09T22:01:24.706952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:19.001163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706771+0000","last_change":"2023-07-09T22:01:23.717207+0000","last_active":"2023-07-09T22:01:24.706771+0000","last_peered":"2023-07-09T22:01:24.706771+0000","last_clean":"2023-07-09T22:01:24.706771+0000","last_became_active":"2023-07-09T22:01:23.716943+0000","last_became_peered":"2023-07-09T22:01:23.716943+0000","last_unstale":"2023-07-09T22:01:24.706771+0000","last_undegraded":"2023-07-09T22:01:24.706771+0000","last_fullsized":"2023-07-09T22:01:24.706771+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:27:37.154935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706363+0000","last_change":"2023-07-09T22:01:22.708768+0000","last_active":"2023-07-09T22:01:24.706363+0000","last_peered":"2023-07-09T22:01:24.706363+0000","last_clean":"2023-07-09T22:01:24.706363+0000","last_became_active":"2023-07-09T22:01:22.708312+0000","last_became_peered":"2023-07-09T22:01:22.708312+0000","last_unstale":"2023-07-09T22:01:24.706363+0000","last_undegraded":"2023-07-09T22:01:24.706363+0000","last_fullsized":"2023-07-09T22:01:24.706363+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:53.699324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994602+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:01:24.994602+0000","last_peered":"2023-07-09T22:01:24.994602+0000","last_clean":"2023-07-09T22:01:24.994602+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:01:24.994602+0000","last_undegraded":"2023-07-09T22:01:24.994602+0000","last_fullsized":"2023-07-09T22:01:24.994602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:29.510663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700754+0000","last_change":"2023-07-09T22:01:23.711122+0000","last_active":"2023-07-09T22:01:24.700754+0000","last_peered":"2023-07-09T22:01:24.700754+0000","last_clean":"2023-07-09T22:01:24.700754+0000","last_became_active":"2023-07-09T22:01:23.710832+0000","last_became_peered":"2023-07-09T22:01:23.710832+0000","last_unstale":"2023-07-09T22:01:24.700754+0000","last_undegraded":"2023-07-09T22:01:24.700754+0000","last_fullsized":"2023-07-09T22:01:24.700754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:30:28.746079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'8","reported_seq":21,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994280+0000","last_change":"2023-07-09T22:01:22.716008+0000","last_active":"2023-07-09T22:01:24.994280+0000","last_peered":"2023-07-09T22:01:24.994280+0000","last_clean":"2023-07-09T22:01:24.994280+0000","last_became_active":"2023-07-09T22:01:22.715729+0000","last_became_peered":"2023-07-09T22:01:22.715729+0000","last_unstale":"2023-07-09T22:01:24.994280+0000","last_undegraded":"2023-07-09T22:01:24.994280+0000","last_fullsized":"2023-07-09T22:01:24.994280+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:45:45.503490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":333,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466190+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:01:25.466190+0000","last_peered":"2023-07-09T22:01:25.466190+0000","last_clean":"2023-07-09T22:01:25.466190+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:01:25.466190+0000","last_undegraded":"2023-07-09T22:01:25.466190+0000","last_fullsized":"2023-07-09T22:01:25.466190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:22.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098126+0000","last_change":"2023-07-09T22:01:23.717402+0000","last_active":"2023-07-09T22:01:26.098126+0000","last_peered":"2023-07-09T22:01:26.098126+0000","last_clean":"2023-07-09T22:01:26.098126+0000","last_became_active":"2023-07-09T22:01:23.716999+0000","last_became_peered":"2023-07-09T22:01:23.716999+0000","last_unstale":"2023-07-09T22:01:26.098126+0000","last_undegraded":"2023-07-09T22:01:26.098126+0000","last_fullsized":"2023-07-09T22:01:26.098126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:24.937818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890801+0000","last_change":"2023-07-09T22:01:22.708500+0000","last_active":"2023-07-09T22:01:24.890801+0000","last_peered":"2023-07-09T22:01:24.890801+0000","last_clean":"2023-07-09T22:01:24.890801+0000","last_became_active":"2023-07-09T22:01:22.708177+0000","last_became_peered":"2023-07-09T22:01:22.708177+0000","last_unstale":"2023-07-09T22:01:24.890801+0000","last_undegraded":"2023-07-09T22:01:24.890801+0000","last_fullsized":"2023-07-09T22:01:24.890801+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:51.684860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":327,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994727+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:01:24.994727+0000","last_peered":"2023-07-09T22:01:24.994727+0000","last_clean":"2023-07-09T22:01:24.994727+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:01:24.994727+0000","last_undegraded":"2023-07-09T22:01:24.994727+0000","last_fullsized":"2023-07-09T22:01:24.994727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:00.049070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994440+0000","last_change":"2023-07-09T22:01:23.721554+0000","last_active":"2023-07-09T22:01:24.994440+0000","last_peered":"2023-07-09T22:01:24.994440+0000","last_clean":"2023-07-09T22:01:24.994440+0000","last_became_active":"2023-07-09T22:01:23.721259+0000","last_became_peered":"2023-07-09T22:01:23.721259+0000","last_unstale":"2023-07-09T22:01:24.994440+0000","last_undegraded":"2023-07-09T22:01:24.994440+0000","last_fullsized":"2023-07-09T22:01:24.994440+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:52:26.645769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095198+0000","last_change":"2023-07-09T22:01:22.711803+0000","last_active":"2023-07-09T22:01:26.095198+0000","last_peered":"2023-07-09T22:01:26.095198+0000","last_clean":"2023-07-09T22:01:26.095198+0000","last_became_active":"2023-07-09T22:01:22.709155+0000","last_became_peered":"2023-07-09T22:01:22.709155+0000","last_unstale":"2023-07-09T22:01:26.095198+0000","last_undegraded":"2023-07-09T22:01:26.095198+0000","last_fullsized":"2023-07-09T22:01:26.095198+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:10.911494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":339,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098412+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:01:26.098412+0000","last_peered":"2023-07-09T22:01:26.098412+0000","last_clean":"2023-07-09T22:01:26.098412+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:01:26.098412+0000","last_undegraded":"2023-07-09T22:01:26.098412+0000","last_fullsized":"2023-07-09T22:01:26.098412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:02.845004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575312,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":3043328,"data_stored":1856240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95899999999999996,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80900000000000005}]},{"osd":2,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.036,"15min":1.036},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.107,"15min":1.107},"last":0.752}]},{"osd":4,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70399999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.014,"5min":1.0509999999999999,"15min":1.077},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575311,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37536,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334304,"statfs":{"total":96636764160,"available":96598327296,"internally_reserved":0,"allocated":2449408,"data_stored":1265872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":1.075,"15min":1.075},"last":0.443},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":0.999,"15min":1.04},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98199999999999998,"15min":1.177},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.1890000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.504},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":1.02,"15min":1.026},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85299999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.92600000000000005,"5min":0.94899999999999995,"15min":1.161},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.099},"last":0.626}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.052},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":1.01,"15min":1.0860000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94599999999999995,"5min":1.016,"15min":1.077},"last":0.75700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575310,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2457600,"data_stored":1265996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89300000000000002,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.05},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.84699999999999998}]},{"osd":2,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88500000000000001,"5min":1.095,"15min":1.095},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.034},"last":0.749},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.59799999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.81100000000000005,"5min":1.004,"15min":1.004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.92600000000000005}]},{"osd":6,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.89300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575312,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37552,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334288,"statfs":{"total":96636764160,"available":96598310912,"internally_reserved":0,"allocated":2465792,"data_stored":1266636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":1.075},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95199999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":0.998,"15min":1.03},"last":0.78400000000000003}]},{"osd":2,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0800000000000001,"15min":1.0960000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61599999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.026,"5min":1.038,"15min":1.1240000000000001},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.84899999999999998,"5min":1.05,"15min":1.079},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.016},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.96499999999999997,"15min":1.018},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.069},"last":0.89400000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77200000000000002,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.94599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575311,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37556,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334284,"statfs":{"total":96636764160,"available":96598306816,"internally_reserved":0,"allocated":2469888,"data_stored":1268040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.377},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.433},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.85599999999999998}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59680,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312160,"statfs":{"total":96636764160,"available":96575651840,"internally_reserved":0,"allocated":2449408,"data_stored":1265872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.96499999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.77100000000000002,"5min":0.78600000000000003,"15min":0.85099999999999998},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.016},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.44}]},{"osd":4,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":1.117,"15min":1.337},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.45000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1970000000000001,"15min":1.306},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.57699999999999996},"max":{"1min":1.304,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.111,"15min":1.375},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.627},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.70599999999999996,"5min":0.59499999999999997,"15min":0.52200000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.294},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.1499999999999999,"5min":1.2809999999999999,"15min":1.298},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1679999999999999,"5min":1.196,"15min":1.256},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575312,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1267436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.625}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.876}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.82199999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.747},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575312,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42220,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329620,"statfs":{"total":96636764160,"available":96593530880,"internally_reserved":0,"allocated":3051520,"data_stored":1856344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.90300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.503}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":0.93899999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1850000000000001,"5min":1.306,"15min":1.306},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.3600000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.871}]},{"osd":6,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.3260000000000001,"15min":1.381},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.55000000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.3400000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":1.2210000000000001,"5min":1.397,"15min":1.397},"last":0.96599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:01:32.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:01:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 Processor -- start 2023-07-09T22:01:32.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 -- start start 2023-07-09T22:01:32.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fba340b7810 0x7fba3415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 0x7fba34069d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba340ccd40 con 0x7fba3406a280 2023-07-09T22:01:32.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba340cc5a0 con 0x7fba340b7810 2023-07-09T22:01:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3ab79640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3406a700 con 0x7fba340ce1a0 2023-07-09T22:01:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3a378640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fba3406a280 0x7fba3402ad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60414/0 (socket says 172.21.15.37:60414) 2023-07-09T22:01:32.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba3a378640 1 -- 172.21.15.37:0/3345277535 learned_addr learned my addr 172.21.15.37:0/3345277535 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39b77640 1 --2- 172.21.15.37:0/3345277535 >> v2:172.21.15.119:3300/0 conn(0x7fba340b7810 0x7fba3415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39376640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 0x7fba34069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba38b75640 1 -- 172.21.15.37:0/3345277535 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2561617217 0 0) 0x7fba340ccd40 con 0x7fba3406a280 2023-07-09T22:01:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba38b75640 1 -- 172.21.15.37:0/3345277535 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba20003530 con 0x7fba3406a280 2023-07-09T22:01:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39b77640 1 -- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 msgr2=0x7fba34069d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39b77640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 0x7fba34069d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39b77640 1 -- 172.21.15.37:0/3345277535 >> v1:172.21.15.37:6789/0 conn(0x7fba3406a280 legacy=0x7fba3402ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39b77640 1 -- 172.21.15.37:0/3345277535 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba341602d0 con 0x7fba340b7810 2023-07-09T22:01:32.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.589+0000 7fba39376640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 0x7fba34069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:32.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba39b77640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340b7810 0x7fba3415fd90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fba300097c0 tx=0x7fba3001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b4e06dff237f84 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba38b75640 1 -- 172.21.15.37:0/3345277535 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300ab650 con 0x7fba340b7810 2023-07-09T22:01:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba38b75640 1 -- 172.21.15.37:0/3345277535 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300ab7b0 con 0x7fba340b7810 2023-07-09T22:01:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba38b75640 1 -- 172.21.15.37:0/3345277535 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300abb40 con 0x7fba340b7810 2023-07-09T22:01:32.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 -- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340b7810 msgr2=0x7fba3415fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340b7810 0x7fba3415fd90 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fba300097c0 tx=0x7fba3001c450 comp rx=0 tx=0).stop 2023-07-09T22:01:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 -- 172.21.15.37:0/3345277535 shutdown_connections 2023-07-09T22:01:32.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340ce1a0 0x7fba34069d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 --2- 172.21.15.37:0/3345277535 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340b7810 0x7fba3415fd90 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 -- 172.21.15.37:0/3345277535 >> 172.21.15.37:0/3345277535 conn(0x7fba340cea60 msgr2=0x7fba340cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:32.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 -- 172.21.15.37:0/3345277535 shutdown_connections 2023-07-09T22:01:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.593+0000 7fba3ab79640 1 -- 172.21.15.37:0/3345277535 wait complete. 2023-07-09T22:01:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 Processor -- start 2023-07-09T22:01:32.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- start start 2023-07-09T22:01:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340b7810 0x7fba340b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 0x7fba34156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340c8ba0 con 0x7fba3406a280 2023-07-09T22:01:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b3590 con 0x7fba340ce1a0 2023-07-09T22:01:32.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba340b1df0 con 0x7fba340b7810 2023-07-09T22:01:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51470/0 (socket says 172.21.15.37:51470) 2023-07-09T22:01:32.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 -- 172.21.15.37:0/2478777895 learned_addr learned my addr 172.21.15.37:0/2478777895 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3a378640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 0x7fba34156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39376640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340b7810 0x7fba340b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 -- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340b7810 msgr2=0x7fba340b18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340b7810 0x7fba340b18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 -- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 msgr2=0x7fba34156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 0x7fba34156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 -- 172.21.15.37:0/2478777895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba24009420 con 0x7fba3406a280 2023-07-09T22:01:32.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3a378640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 0x7fba34156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba39b77640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fba300ad040 tx=0x7fba3001ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300bf610 con 0x7fba3406a280 2023-07-09T22:01:32.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba300bf790 con 0x7fba3406a280 2023-07-09T22:01:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba30009420 con 0x7fba3406a280 2023-07-09T22:01:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba300bfb40 con 0x7fba3406a280 2023-07-09T22:01:32.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.597+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba340b3aa0 con 0x7fba3406a280 2023-07-09T22:01:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3404e020 con 0x7fba3406a280 2023-07-09T22:01:32.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fba300b5400 con 0x7fba3406a280 2023-07-09T22:01:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba2a7fc640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 0x7fba18068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fba3011ed60 con 0x7fba3406a280 2023-07-09T22:01:32.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba39376640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 0x7fba18068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.601+0000 7fba39376640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 0x7fba18068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba3415bc30 tx=0x7fba24008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:32.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.605+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba300ec090 con 0x7fba3406a280 2023-07-09T22:01:32.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.761+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba3406c450 con 0x7fba180663a0 2023-07-09T22:01:32.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba2a7fc640 1 -- 172.21.15.37:0/2478777895 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311469 (secure 0 0 0) 0x7fba24011e60 con 0x7fba180663a0 2023-07-09T22:01:32.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:32.781 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:01:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 msgr2=0x7fba18068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 0x7fba18068850 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fba3415bc30 tx=0x7fba24008040 comp rx=0 tx=0).stop 2023-07-09T22:01:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 msgr2=0x7fba340b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fba300ad040 tx=0x7fba3001ac90 comp rx=0 tx=0).stop 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 shutdown_connections 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fba180663a0 0x7fba18068850 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fba340ce1a0 0x7fba34156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fba340b7810 0x7fba340b18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 --2- 172.21.15.37:0/2478777895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba3406a280 0x7fba340b4580 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 >> 172.21.15.37:0/2478777895 conn(0x7fba340cea60 msgr2=0x7fba340b6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 shutdown_connections 2023-07-09T22:01:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.773+0000 7fba3ab79640 1 -- 172.21.15.37:0/2478777895 wait complete. 2023-07-09T22:01:32.800 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-07-09T22:01:31.388406+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":584,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":365,"ondisk_log_size":365,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":355656,"kb_used_data":20360,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754619064,"statfs":{"total":773094113280,"available":772729921536,"internally_reserved":0,"allocated":20848640,"data_stored":11312436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002278"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707325+0000","last_change":"2023-07-09T22:01:23.713229+0000","last_active":"2023-07-09T22:01:24.707325+0000","last_peered":"2023-07-09T22:01:24.707325+0000","last_clean":"2023-07-09T22:01:24.707325+0000","last_became_active":"2023-07-09T22:01:23.712871+0000","last_became_peered":"2023-07-09T22:01:23.712871+0000","last_unstale":"2023-07-09T22:01:24.707325+0000","last_undegraded":"2023-07-09T22:01:24.707325+0000","last_fullsized":"2023-07-09T22:01:24.707325+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:30:47.828159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466269+0000","last_change":"2023-07-09T22:01:23.719780+0000","last_active":"2023-07-09T22:01:25.466269+0000","last_peered":"2023-07-09T22:01:25.466269+0000","last_clean":"2023-07-09T22:01:25.466269+0000","last_became_active":"2023-07-09T22:01:23.719488+0000","last_became_peered":"2023-07-09T22:01:23.719488+0000","last_unstale":"2023-07-09T22:01:25.466269+0000","last_undegraded":"2023-07-09T22:01:25.466269+0000","last_fullsized":"2023-07-09T22:01:25.466269+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:15:33.489915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707135+0000","last_change":"2023-07-09T22:01:23.725267+0000","last_active":"2023-07-09T22:01:24.707135+0000","last_peered":"2023-07-09T22:01:24.707135+0000","last_clean":"2023-07-09T22:01:24.707135+0000","last_became_active":"2023-07-09T22:01:23.724831+0000","last_became_peered":"2023-07-09T22:01:23.724831+0000","last_unstale":"2023-07-09T22:01:24.707135+0000","last_undegraded":"2023-07-09T22:01:24.707135+0000","last_fullsized":"2023-07-09T22:01:24.707135+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:13:12.543721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707276+0000","last_change":"2023-07-09T22:01:23.722710+0000","last_active":"2023-07-09T22:01:24.707276+0000","last_peered":"2023-07-09T22:01:24.707276+0000","last_clean":"2023-07-09T22:01:24.707276+0000","last_became_active":"2023-07-09T22:01:23.722380+0000","last_became_peered":"2023-07-09T22:01:23.722380+0000","last_unstale":"2023-07-09T22:01:24.707276+0000","last_undegraded":"2023-07-09T22:01:24.707276+0000","last_fullsized":"2023-07-09T22:01:24.707276+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:27.405058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890752+0000","last_change":"2023-07-09T22:01:23.720969+0000","last_active":"2023-07-09T22:01:24.890752+0000","last_peered":"2023-07-09T22:01:24.890752+0000","last_clean":"2023-07-09T22:01:24.890752+0000","last_became_active":"2023-07-09T22:01:23.720679+0000","last_became_peered":"2023-07-09T22:01:23.720679+0000","last_unstale":"2023-07-09T22:01:24.890752+0000","last_undegraded":"2023-07-09T22:01:24.890752+0000","last_fullsized":"2023-07-09T22:01:24.890752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:06:38.727074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465801+0000","last_change":"2023-07-09T22:01:23.727000+0000","last_active":"2023-07-09T22:01:25.465801+0000","last_peered":"2023-07-09T22:01:25.465801+0000","last_clean":"2023-07-09T22:01:25.465801+0000","last_became_active":"2023-07-09T22:01:23.726655+0000","last_became_peered":"2023-07-09T22:01:23.726655+0000","last_unstale":"2023-07-09T22:01:25.465801+0000","last_undegraded":"2023-07-09T22:01:25.465801+0000","last_fullsized":"2023-07-09T22:01:25.465801+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:51:56.137472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994122+0000","last_change":"2023-07-09T22:01:23.718058+0000","last_active":"2023-07-09T22:01:24.994122+0000","last_peered":"2023-07-09T22:01:24.994122+0000","last_clean":"2023-07-09T22:01:24.994122+0000","last_became_active":"2023-07-09T22:01:23.715924+0000","last_became_peered":"2023-07-09T22:01:23.715924+0000","last_unstale":"2023-07-09T22:01:24.994122+0000","last_undegraded":"2023-07-09T22:01:24.994122+0000","last_fullsized":"2023-07-09T22:01:24.994122+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:16:44.933803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994116+0000","last_change":"2023-07-09T22:01:23.716036+0000","last_active":"2023-07-09T22:01:24.994116+0000","last_peered":"2023-07-09T22:01:24.994116+0000","last_clean":"2023-07-09T22:01:24.994116+0000","last_became_active":"2023-07-09T22:01:23.715558+0000","last_became_peered":"2023-07-09T22:01:23.715558+0000","last_unstale":"2023-07-09T22:01:24.994116+0000","last_undegraded":"2023-07-09T22:01:24.994116+0000","last_fullsized":"2023-07-09T22:01:24.994116+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:51:54.813203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994515+0000","last_change":"2023-07-09T22:01:23.719271+0000","last_active":"2023-07-09T22:01:24.994515+0000","last_peered":"2023-07-09T22:01:24.994515+0000","last_clean":"2023-07-09T22:01:24.994515+0000","last_became_active":"2023-07-09T22:01:23.718952+0000","last_became_peered":"2023-07-09T22:01:23.718952+0000","last_unstale":"2023-07-09T22:01:24.994515+0000","last_undegraded":"2023-07-09T22:01:24.994515+0000","last_fullsized":"2023-07-09T22:01:24.994515+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:09:41.825605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994578+0000","last_change":"2023-07-09T22:01:23.716041+0000","last_active":"2023-07-09T22:01:24.994578+0000","last_peered":"2023-07-09T22:01:24.994578+0000","last_clean":"2023-07-09T22:01:24.994578+0000","last_became_active":"2023-07-09T22:01:23.715773+0000","last_became_peered":"2023-07-09T22:01:23.715773+0000","last_unstale":"2023-07-09T22:01:24.994578+0000","last_undegraded":"2023-07-09T22:01:24.994578+0000","last_fullsized":"2023-07-09T22:01:24.994578+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:21:49.023012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706778+0000","last_change":"2023-07-09T22:01:23.715860+0000","last_active":"2023-07-09T22:01:24.706778+0000","last_peered":"2023-07-09T22:01:24.706778+0000","last_clean":"2023-07-09T22:01:24.706778+0000","last_became_active":"2023-07-09T22:01:23.715560+0000","last_became_peered":"2023-07-09T22:01:23.715560+0000","last_unstale":"2023-07-09T22:01:24.706778+0000","last_undegraded":"2023-07-09T22:01:24.706778+0000","last_fullsized":"2023-07-09T22:01:24.706778+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:33:57.376366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466094+0000","last_change":"2023-07-09T22:01:23.726973+0000","last_active":"2023-07-09T22:01:25.466094+0000","last_peered":"2023-07-09T22:01:25.466094+0000","last_clean":"2023-07-09T22:01:25.466094+0000","last_became_active":"2023-07-09T22:01:23.726676+0000","last_became_peered":"2023-07-09T22:01:23.726676+0000","last_unstale":"2023-07-09T22:01:25.466094+0000","last_undegraded":"2023-07-09T22:01:25.466094+0000","last_fullsized":"2023-07-09T22:01:25.466094+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:47:24.722720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095082+0000","last_change":"2023-07-09T22:01:23.718891+0000","last_active":"2023-07-09T22:01:26.095082+0000","last_peered":"2023-07-09T22:01:26.095082+0000","last_clean":"2023-07-09T22:01:26.095082+0000","last_became_active":"2023-07-09T22:01:23.718622+0000","last_became_peered":"2023-07-09T22:01:23.718622+0000","last_unstale":"2023-07-09T22:01:26.095082+0000","last_undegraded":"2023-07-09T22:01:26.095082+0000","last_fullsized":"2023-07-09T22:01:26.095082+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:23:18.479248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890526+0000","last_change":"2023-07-09T22:01:23.722222+0000","last_active":"2023-07-09T22:01:24.890526+0000","last_peered":"2023-07-09T22:01:24.890526+0000","last_clean":"2023-07-09T22:01:24.890526+0000","last_became_active":"2023-07-09T22:01:23.718328+0000","last_became_peered":"2023-07-09T22:01:23.718328+0000","last_unstale":"2023-07-09T22:01:24.890526+0000","last_undegraded":"2023-07-09T22:01:24.890526+0000","last_fullsized":"2023-07-09T22:01:24.890526+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:42:10.209731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706225+0000","last_change":"2023-07-09T22:01:23.721852+0000","last_active":"2023-07-09T22:01:24.706225+0000","last_peered":"2023-07-09T22:01:24.706225+0000","last_clean":"2023-07-09T22:01:24.706225+0000","last_became_active":"2023-07-09T22:01:23.721553+0000","last_became_peered":"2023-07-09T22:01:23.721553+0000","last_unstale":"2023-07-09T22:01:24.706225+0000","last_undegraded":"2023-07-09T22:01:24.706225+0000","last_fullsized":"2023-07-09T22:01:24.706225+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:23:42.487204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706528+0000","last_change":"2023-07-09T22:01:23.723575+0000","last_active":"2023-07-09T22:01:24.706528+0000","last_peered":"2023-07-09T22:01:24.706528+0000","last_clean":"2023-07-09T22:01:24.706528+0000","last_became_active":"2023-07-09T22:01:23.723290+0000","last_became_peered":"2023-07-09T22:01:23.723290+0000","last_unstale":"2023-07-09T22:01:24.706528+0000","last_undegraded":"2023-07-09T22:01:24.706528+0000","last_fullsized":"2023-07-09T22:01:24.706528+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:12.772078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994536+0000","last_change":"2023-07-09T22:01:23.718104+0000","last_active":"2023-07-09T22:01:24.994536+0000","last_peered":"2023-07-09T22:01:24.994536+0000","last_clean":"2023-07-09T22:01:24.994536+0000","last_became_active":"2023-07-09T22:01:23.717385+0000","last_became_peered":"2023-07-09T22:01:23.717385+0000","last_unstale":"2023-07-09T22:01:24.994536+0000","last_undegraded":"2023-07-09T22:01:24.994536+0000","last_fullsized":"2023-07-09T22:01:24.994536+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:41:39.709490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098196+0000","last_change":"2023-07-09T22:01:23.721347+0000","last_active":"2023-07-09T22:01:26.098196+0000","last_peered":"2023-07-09T22:01:26.098196+0000","last_clean":"2023-07-09T22:01:26.098196+0000","last_became_active":"2023-07-09T22:01:23.721071+0000","last_became_peered":"2023-07-09T22:01:23.721071+0000","last_unstale":"2023-07-09T22:01:26.098196+0000","last_undegraded":"2023-07-09T22:01:26.098196+0000","last_fullsized":"2023-07-09T22:01:26.098196+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:43:18.654280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706935+0000","last_change":"2023-07-09T22:01:23.725566+0000","last_active":"2023-07-09T22:01:24.706935+0000","last_peered":"2023-07-09T22:01:24.706935+0000","last_clean":"2023-07-09T22:01:24.706935+0000","last_became_active":"2023-07-09T22:01:23.725262+0000","last_became_peered":"2023-07-09T22:01:23.725262+0000","last_unstale":"2023-07-09T22:01:24.706935+0000","last_undegraded":"2023-07-09T22:01:24.706935+0000","last_fullsized":"2023-07-09T22:01:24.706935+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:25:25.449844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700522+0000","last_change":"2023-07-09T22:01:23.710818+0000","last_active":"2023-07-09T22:01:24.700522+0000","last_peered":"2023-07-09T22:01:24.700522+0000","last_clean":"2023-07-09T22:01:24.700522+0000","last_became_active":"2023-07-09T22:01:23.710525+0000","last_became_peered":"2023-07-09T22:01:23.710525+0000","last_unstale":"2023-07-09T22:01:24.700522+0000","last_undegraded":"2023-07-09T22:01:24.700522+0000","last_fullsized":"2023-07-09T22:01:24.700522+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:09.477535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095243+0000","last_change":"2023-07-09T22:01:23.721862+0000","last_active":"2023-07-09T22:01:26.095243+0000","last_peered":"2023-07-09T22:01:26.095243+0000","last_clean":"2023-07-09T22:01:26.095243+0000","last_became_active":"2023-07-09T22:01:23.721533+0000","last_became_peered":"2023-07-09T22:01:23.721533+0000","last_unstale":"2023-07-09T22:01:26.095243+0000","last_undegraded":"2023-07-09T22:01:26.095243+0000","last_fullsized":"2023-07-09T22:01:26.095243+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:15:15.971900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466231+0000","last_change":"2023-07-09T22:01:23.718113+0000","last_active":"2023-07-09T22:01:25.466231+0000","last_peered":"2023-07-09T22:01:25.466231+0000","last_clean":"2023-07-09T22:01:25.466231+0000","last_became_active":"2023-07-09T22:01:23.717836+0000","last_became_peered":"2023-07-09T22:01:23.717836+0000","last_unstale":"2023-07-09T22:01:25.466231+0000","last_undegraded":"2023-07-09T22:01:25.466231+0000","last_fullsized":"2023-07-09T22:01:25.466231+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:43:41.008241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890526+0000","last_change":"2023-07-09T22:01:23.712786+0000","last_active":"2023-07-09T22:01:24.890526+0000","last_peered":"2023-07-09T22:01:24.890526+0000","last_clean":"2023-07-09T22:01:24.890526+0000","last_became_active":"2023-07-09T22:01:23.712459+0000","last_became_peered":"2023-07-09T22:01:23.712459+0000","last_unstale":"2023-07-09T22:01:24.890526+0000","last_undegraded":"2023-07-09T22:01:24.890526+0000","last_fullsized":"2023-07-09T22:01:24.890526+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:01:04.419617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706659+0000","last_change":"2023-07-09T22:01:23.723565+0000","last_active":"2023-07-09T22:01:24.706659+0000","last_peered":"2023-07-09T22:01:24.706659+0000","last_clean":"2023-07-09T22:01:24.706659+0000","last_became_active":"2023-07-09T22:01:23.723278+0000","last_became_peered":"2023-07-09T22:01:23.723278+0000","last_unstale":"2023-07-09T22:01:24.706659+0000","last_undegraded":"2023-07-09T22:01:24.706659+0000","last_fullsized":"2023-07-09T22:01:24.706659+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:43:15.130967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095453+0000","last_change":"2023-07-09T22:01:23.718186+0000","last_active":"2023-07-09T22:01:26.095453+0000","last_peered":"2023-07-09T22:01:26.095453+0000","last_clean":"2023-07-09T22:01:26.095453+0000","last_became_active":"2023-07-09T22:01:23.717909+0000","last_became_peered":"2023-07-09T22:01:23.717909+0000","last_unstale":"2023-07-09T22:01:26.095453+0000","last_undegraded":"2023-07-09T22:01:26.095453+0000","last_fullsized":"2023-07-09T22:01:26.095453+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:16:13.159089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700645+0000","last_change":"2023-07-09T22:01:23.712319+0000","last_active":"2023-07-09T22:01:24.700645+0000","last_peered":"2023-07-09T22:01:24.700645+0000","last_clean":"2023-07-09T22:01:24.700645+0000","last_became_active":"2023-07-09T22:01:23.712004+0000","last_became_peered":"2023-07-09T22:01:23.712004+0000","last_unstale":"2023-07-09T22:01:24.700645+0000","last_undegraded":"2023-07-09T22:01:24.700645+0000","last_fullsized":"2023-07-09T22:01:24.700645+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:53:54.614391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466032+0000","last_change":"2023-07-09T22:01:23.718534+0000","last_active":"2023-07-09T22:01:25.466032+0000","last_peered":"2023-07-09T22:01:25.466032+0000","last_clean":"2023-07-09T22:01:25.466032+0000","last_became_active":"2023-07-09T22:01:23.718262+0000","last_became_peered":"2023-07-09T22:01:23.718262+0000","last_unstale":"2023-07-09T22:01:25.466032+0000","last_undegraded":"2023-07-09T22:01:25.466032+0000","last_fullsized":"2023-07-09T22:01:25.466032+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:24:02.862122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095129+0000","last_change":"2023-07-09T22:01:23.723894+0000","last_active":"2023-07-09T22:01:26.095129+0000","last_peered":"2023-07-09T22:01:26.095129+0000","last_clean":"2023-07-09T22:01:26.095129+0000","last_became_active":"2023-07-09T22:01:23.723169+0000","last_became_peered":"2023-07-09T22:01:23.723169+0000","last_unstale":"2023-07-09T22:01:26.095129+0000","last_undegraded":"2023-07-09T22:01:26.095129+0000","last_fullsized":"2023-07-09T22:01:26.095129+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:22:59.360663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465881+0000","last_change":"2023-07-09T22:01:23.730564+0000","last_active":"2023-07-09T22:01:25.465881+0000","last_peered":"2023-07-09T22:01:25.465881+0000","last_clean":"2023-07-09T22:01:25.465881+0000","last_became_active":"2023-07-09T22:01:23.730226+0000","last_became_peered":"2023-07-09T22:01:23.730226+0000","last_unstale":"2023-07-09T22:01:25.465881+0000","last_undegraded":"2023-07-09T22:01:25.465881+0000","last_fullsized":"2023-07-09T22:01:25.465881+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:14:17.079777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098232+0000","last_change":"2023-07-09T22:01:23.716311+0000","last_active":"2023-07-09T22:01:26.098232+0000","last_peered":"2023-07-09T22:01:26.098232+0000","last_clean":"2023-07-09T22:01:26.098232+0000","last_became_active":"2023-07-09T22:01:23.715996+0000","last_became_peered":"2023-07-09T22:01:23.715996+0000","last_unstale":"2023-07-09T22:01:26.098232+0000","last_undegraded":"2023-07-09T22:01:26.098232+0000","last_fullsized":"2023-07-09T22:01:26.098232+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:29:32.477357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706311+0000","last_change":"2023-07-09T22:01:23.715515+0000","last_active":"2023-07-09T22:01:24.706311+0000","last_peered":"2023-07-09T22:01:24.706311+0000","last_clean":"2023-07-09T22:01:24.706311+0000","last_became_active":"2023-07-09T22:01:23.715144+0000","last_became_peered":"2023-07-09T22:01:23.715144+0000","last_unstale":"2023-07-09T22:01:24.706311+0000","last_undegraded":"2023-07-09T22:01:24.706311+0000","last_fullsized":"2023-07-09T22:01:24.706311+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:24:11.739998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098230+0000","last_change":"2023-07-09T22:01:23.719702+0000","last_active":"2023-07-09T22:01:26.098230+0000","last_peered":"2023-07-09T22:01:26.098230+0000","last_clean":"2023-07-09T22:01:26.098230+0000","last_became_active":"2023-07-09T22:01:23.719414+0000","last_became_peered":"2023-07-09T22:01:23.719414+0000","last_unstale":"2023-07-09T22:01:26.098230+0000","last_undegraded":"2023-07-09T22:01:26.098230+0000","last_fullsized":"2023-07-09T22:01:26.098230+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:32:58.644573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465999+0000","last_change":"2023-07-09T22:01:23.724501+0000","last_active":"2023-07-09T22:01:25.465999+0000","last_peered":"2023-07-09T22:01:25.465999+0000","last_clean":"2023-07-09T22:01:25.465999+0000","last_became_active":"2023-07-09T22:01:23.724142+0000","last_became_peered":"2023-07-09T22:01:23.724142+0000","last_unstale":"2023-07-09T22:01:25.465999+0000","last_undegraded":"2023-07-09T22:01:25.465999+0000","last_fullsized":"2023-07-09T22:01:25.465999+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:36:07.126782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"195'4","reported_seq":17,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707569+0000","last_change":"2023-07-09T22:01:22.715731+0000","last_active":"2023-07-09T22:01:24.707569+0000","last_peered":"2023-07-09T22:01:24.707569+0000","last_clean":"2023-07-09T22:01:24.707569+0000","last_became_active":"2023-07-09T22:01:22.715273+0000","last_became_peered":"2023-07-09T22:01:22.715273+0000","last_unstale":"2023-07-09T22:01:24.707569+0000","last_undegraded":"2023-07-09T22:01:24.707569+0000","last_fullsized":"2023-07-09T22:01:24.707569+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:43:08.737110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.094930+0000","last_change":"2023-07-09T22:01:23.713673+0000","last_active":"2023-07-09T22:01:26.094930+0000","last_peered":"2023-07-09T22:01:26.094930+0000","last_clean":"2023-07-09T22:01:26.094930+0000","last_became_active":"2023-07-09T22:01:23.713335+0000","last_became_peered":"2023-07-09T22:01:23.713335+0000","last_unstale":"2023-07-09T22:01:26.094930+0000","last_undegraded":"2023-07-09T22:01:26.094930+0000","last_fullsized":"2023-07-09T22:01:26.094930+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:30:24.483987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890955+0000","last_change":"2023-07-09T22:01:22.718159+0000","last_active":"2023-07-09T22:01:24.890955+0000","last_peered":"2023-07-09T22:01:24.890955+0000","last_clean":"2023-07-09T22:01:24.890955+0000","last_became_active":"2023-07-09T22:01:22.717875+0000","last_became_peered":"2023-07-09T22:01:22.717875+0000","last_unstale":"2023-07-09T22:01:24.890955+0000","last_undegraded":"2023-07-09T22:01:24.890955+0000","last_fullsized":"2023-07-09T22:01:24.890955+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:01:00.271778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890606+0000","last_change":"2023-07-09T22:01:23.718407+0000","last_active":"2023-07-09T22:01:24.890606+0000","last_peered":"2023-07-09T22:01:24.890606+0000","last_clean":"2023-07-09T22:01:24.890606+0000","last_became_active":"2023-07-09T22:01:23.717970+0000","last_became_peered":"2023-07-09T22:01:23.717970+0000","last_unstale":"2023-07-09T22:01:24.890606+0000","last_undegraded":"2023-07-09T22:01:24.890606+0000","last_fullsized":"2023-07-09T22:01:24.890606+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:40:35.601917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706960+0000","last_change":"2023-07-09T22:01:22.718561+0000","last_active":"2023-07-09T22:01:24.706960+0000","last_peered":"2023-07-09T22:01:24.706960+0000","last_clean":"2023-07-09T22:01:24.706960+0000","last_became_active":"2023-07-09T22:01:22.718237+0000","last_became_peered":"2023-07-09T22:01:22.718237+0000","last_unstale":"2023-07-09T22:01:24.706960+0000","last_undegraded":"2023-07-09T22:01:24.706960+0000","last_fullsized":"2023-07-09T22:01:24.706960+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:09:52.235763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466123+0000","last_change":"2023-07-09T22:01:23.724205+0000","last_active":"2023-07-09T22:01:25.466123+0000","last_peered":"2023-07-09T22:01:25.466123+0000","last_clean":"2023-07-09T22:01:25.466123+0000","last_became_active":"2023-07-09T22:01:23.723907+0000","last_became_peered":"2023-07-09T22:01:23.723907+0000","last_unstale":"2023-07-09T22:01:25.466123+0000","last_undegraded":"2023-07-09T22:01:25.466123+0000","last_fullsized":"2023-07-09T22:01:25.466123+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:39.114162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700560+0000","last_change":"2023-07-09T22:01:22.715327+0000","last_active":"2023-07-09T22:01:24.700560+0000","last_peered":"2023-07-09T22:01:24.700560+0000","last_clean":"2023-07-09T22:01:24.700560+0000","last_became_active":"2023-07-09T22:01:22.715043+0000","last_became_peered":"2023-07-09T22:01:22.715043+0000","last_unstale":"2023-07-09T22:01:24.700560+0000","last_undegraded":"2023-07-09T22:01:24.700560+0000","last_fullsized":"2023-07-09T22:01:24.700560+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:26:42.215546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994423+0000","last_change":"2023-07-09T22:01:23.717835+0000","last_active":"2023-07-09T22:01:24.994423+0000","last_peered":"2023-07-09T22:01:24.994423+0000","last_clean":"2023-07-09T22:01:24.994423+0000","last_became_active":"2023-07-09T22:01:23.717493+0000","last_became_peered":"2023-07-09T22:01:23.717493+0000","last_unstale":"2023-07-09T22:01:24.994423+0000","last_undegraded":"2023-07-09T22:01:24.994423+0000","last_fullsized":"2023-07-09T22:01:24.994423+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:50:33.917858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994234+0000","last_change":"2023-07-09T22:01:22.715924+0000","last_active":"2023-07-09T22:01:24.994234+0000","last_peered":"2023-07-09T22:01:24.994234+0000","last_clean":"2023-07-09T22:01:24.994234+0000","last_became_active":"2023-07-09T22:01:22.715637+0000","last_became_peered":"2023-07-09T22:01:22.715637+0000","last_unstale":"2023-07-09T22:01:24.994234+0000","last_undegraded":"2023-07-09T22:01:24.994234+0000","last_fullsized":"2023-07-09T22:01:24.994234+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:26:38.202117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700739+0000","last_change":"2023-07-09T22:01:23.720644+0000","last_active":"2023-07-09T22:01:24.700739+0000","last_peered":"2023-07-09T22:01:24.700739+0000","last_clean":"2023-07-09T22:01:24.700739+0000","last_became_active":"2023-07-09T22:01:23.720341+0000","last_became_peered":"2023-07-09T22:01:23.720341+0000","last_unstale":"2023-07-09T22:01:24.700739+0000","last_undegraded":"2023-07-09T22:01:24.700739+0000","last_fullsized":"2023-07-09T22:01:24.700739+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:26:59.554729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890679+0000","last_change":"2023-07-09T22:01:22.707769+0000","last_active":"2023-07-09T22:01:24.890679+0000","last_peered":"2023-07-09T22:01:24.890679+0000","last_clean":"2023-07-09T22:01:24.890679+0000","last_became_active":"2023-07-09T22:01:22.707486+0000","last_became_peered":"2023-07-09T22:01:22.707486+0000","last_unstale":"2023-07-09T22:01:24.890679+0000","last_undegraded":"2023-07-09T22:01:24.890679+0000","last_fullsized":"2023-07-09T22:01:24.890679+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:50:52.950121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700752+0000","last_change":"2023-07-09T22:01:23.721470+0000","last_active":"2023-07-09T22:01:24.700752+0000","last_peered":"2023-07-09T22:01:24.700752+0000","last_clean":"2023-07-09T22:01:24.700752+0000","last_became_active":"2023-07-09T22:01:23.721185+0000","last_became_peered":"2023-07-09T22:01:23.721185+0000","last_unstale":"2023-07-09T22:01:24.700752+0000","last_undegraded":"2023-07-09T22:01:24.700752+0000","last_fullsized":"2023-07-09T22:01:24.700752+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:29:24.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700282+0000","last_change":"2023-07-09T22:01:22.717274+0000","last_active":"2023-07-09T22:01:24.700282+0000","last_peered":"2023-07-09T22:01:24.700282+0000","last_clean":"2023-07-09T22:01:24.700282+0000","last_became_active":"2023-07-09T22:01:22.715566+0000","last_became_peered":"2023-07-09T22:01:22.715566+0000","last_unstale":"2023-07-09T22:01:24.700282+0000","last_undegraded":"2023-07-09T22:01:24.700282+0000","last_fullsized":"2023-07-09T22:01:24.700282+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:38:08.309503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707462+0000","last_change":"2023-07-09T22:01:23.716546+0000","last_active":"2023-07-09T22:01:24.707462+0000","last_peered":"2023-07-09T22:01:24.707462+0000","last_clean":"2023-07-09T22:01:24.707462+0000","last_became_active":"2023-07-09T22:01:23.716239+0000","last_became_peered":"2023-07-09T22:01:23.716239+0000","last_unstale":"2023-07-09T22:01:24.707462+0000","last_undegraded":"2023-07-09T22:01:24.707462+0000","last_fullsized":"2023-07-09T22:01:24.707462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:47:26.216058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994361+0000","last_change":"2023-07-09T22:01:22.716202+0000","last_active":"2023-07-09T22:01:24.994361+0000","last_peered":"2023-07-09T22:01:24.994361+0000","last_clean":"2023-07-09T22:01:24.994361+0000","last_became_active":"2023-07-09T22:01:22.715939+0000","last_became_peered":"2023-07-09T22:01:22.715939+0000","last_unstale":"2023-07-09T22:01:24.994361+0000","last_undegraded":"2023-07-09T22:01:24.994361+0000","last_fullsized":"2023-07-09T22:01:24.994361+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:11:05.655942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994124+0000","last_change":"2023-07-09T22:01:23.715836+0000","last_active":"2023-07-09T22:01:24.994124+0000","last_peered":"2023-07-09T22:01:24.994124+0000","last_clean":"2023-07-09T22:01:24.994124+0000","last_became_active":"2023-07-09T22:01:23.714927+0000","last_became_peered":"2023-07-09T22:01:23.714927+0000","last_unstale":"2023-07-09T22:01:24.994124+0000","last_undegraded":"2023-07-09T22:01:24.994124+0000","last_fullsized":"2023-07-09T22:01:24.994124+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:40:42.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095509+0000","last_change":"2023-07-09T22:01:22.712512+0000","last_active":"2023-07-09T22:01:26.095509+0000","last_peered":"2023-07-09T22:01:26.095509+0000","last_clean":"2023-07-09T22:01:26.095509+0000","last_became_active":"2023-07-09T22:01:22.712232+0000","last_became_peered":"2023-07-09T22:01:22.712232+0000","last_unstale":"2023-07-09T22:01:26.095509+0000","last_undegraded":"2023-07-09T22:01:26.095509+0000","last_fullsized":"2023-07-09T22:01:26.095509+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:17:37.111747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098447+0000","last_change":"2023-07-09T22:01:23.718344+0000","last_active":"2023-07-09T22:01:26.098447+0000","last_peered":"2023-07-09T22:01:26.098447+0000","last_clean":"2023-07-09T22:01:26.098447+0000","last_became_active":"2023-07-09T22:01:23.717770+0000","last_became_peered":"2023-07-09T22:01:23.717770+0000","last_unstale":"2023-07-09T22:01:26.098447+0000","last_undegraded":"2023-07-09T22:01:26.098447+0000","last_fullsized":"2023-07-09T22:01:26.098447+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:43:42.040797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994665+0000","last_change":"2023-07-09T22:01:22.721233+0000","last_active":"2023-07-09T22:01:24.994665+0000","last_peered":"2023-07-09T22:01:24.994665+0000","last_clean":"2023-07-09T22:01:24.994665+0000","last_became_active":"2023-07-09T22:01:22.720929+0000","last_became_peered":"2023-07-09T22:01:22.720929+0000","last_unstale":"2023-07-09T22:01:24.994665+0000","last_undegraded":"2023-07-09T22:01:24.994665+0000","last_fullsized":"2023-07-09T22:01:24.994665+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:19:36.390753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706836+0000","last_change":"2023-07-09T22:01:23.715208+0000","last_active":"2023-07-09T22:01:24.706836+0000","last_peered":"2023-07-09T22:01:24.706836+0000","last_clean":"2023-07-09T22:01:24.706836+0000","last_became_active":"2023-07-09T22:01:23.714888+0000","last_became_peered":"2023-07-09T22:01:23.714888+0000","last_unstale":"2023-07-09T22:01:24.706836+0000","last_undegraded":"2023-07-09T22:01:24.706836+0000","last_fullsized":"2023-07-09T22:01:24.706836+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:12.301729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"195'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890820+0000","last_change":"2023-07-09T22:01:22.711186+0000","last_active":"2023-07-09T22:01:24.890820+0000","last_peered":"2023-07-09T22:01:24.890820+0000","last_clean":"2023-07-09T22:01:24.890820+0000","last_became_active":"2023-07-09T22:01:22.710901+0000","last_became_peered":"2023-07-09T22:01:22.710901+0000","last_unstale":"2023-07-09T22:01:24.890820+0000","last_undegraded":"2023-07-09T22:01:24.890820+0000","last_fullsized":"2023-07-09T22:01:24.890820+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:34:13.169446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706446+0000","last_change":"2023-07-09T22:01:23.715960+0000","last_active":"2023-07-09T22:01:24.706446+0000","last_peered":"2023-07-09T22:01:24.706446+0000","last_clean":"2023-07-09T22:01:24.706446+0000","last_became_active":"2023-07-09T22:01:23.715669+0000","last_became_peered":"2023-07-09T22:01:23.715669+0000","last_unstale":"2023-07-09T22:01:24.706446+0000","last_undegraded":"2023-07-09T22:01:24.706446+0000","last_fullsized":"2023-07-09T22:01:24.706446+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:26:13.119471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994447+0000","last_change":"2023-07-09T22:01:22.716955+0000","last_active":"2023-07-09T22:01:24.994447+0000","last_peered":"2023-07-09T22:01:24.994447+0000","last_clean":"2023-07-09T22:01:24.994447+0000","last_became_active":"2023-07-09T22:01:22.716695+0000","last_became_peered":"2023-07-09T22:01:22.716695+0000","last_unstale":"2023-07-09T22:01:24.994447+0000","last_undegraded":"2023-07-09T22:01:24.994447+0000","last_fullsized":"2023-07-09T22:01:24.994447+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:20:09.387829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095291+0000","last_change":"2023-07-09T22:01:23.724075+0000","last_active":"2023-07-09T22:01:26.095291+0000","last_peered":"2023-07-09T22:01:26.095291+0000","last_clean":"2023-07-09T22:01:26.095291+0000","last_became_active":"2023-07-09T22:01:23.723610+0000","last_became_peered":"2023-07-09T22:01:23.723610+0000","last_unstale":"2023-07-09T22:01:26.095291+0000","last_undegraded":"2023-07-09T22:01:26.095291+0000","last_fullsized":"2023-07-09T22:01:26.095291+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:32.866127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890881+0000","last_change":"2023-07-09T22:01:22.710096+0000","last_active":"2023-07-09T22:01:24.890881+0000","last_peered":"2023-07-09T22:01:24.890881+0000","last_clean":"2023-07-09T22:01:24.890881+0000","last_became_active":"2023-07-09T22:01:22.709830+0000","last_became_peered":"2023-07-09T22:01:22.709830+0000","last_unstale":"2023-07-09T22:01:24.890881+0000","last_undegraded":"2023-07-09T22:01:24.890881+0000","last_fullsized":"2023-07-09T22:01:24.890881+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:52:43.885434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890832+0000","last_change":"2023-07-09T22:01:23.724125+0000","last_active":"2023-07-09T22:01:24.890832+0000","last_peered":"2023-07-09T22:01:24.890832+0000","last_clean":"2023-07-09T22:01:24.890832+0000","last_became_active":"2023-07-09T22:01:23.723878+0000","last_became_peered":"2023-07-09T22:01:23.723878+0000","last_unstale":"2023-07-09T22:01:24.890832+0000","last_undegraded":"2023-07-09T22:01:24.890832+0000","last_fullsized":"2023-07-09T22:01:24.890832+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:04:10.829134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706691+0000","last_change":"2023-07-09T22:01:22.724154+0000","last_active":"2023-07-09T22:01:24.706691+0000","last_peered":"2023-07-09T22:01:24.706691+0000","last_clean":"2023-07-09T22:01:24.706691+0000","last_became_active":"2023-07-09T22:01:22.723898+0000","last_became_peered":"2023-07-09T22:01:22.723898+0000","last_unstale":"2023-07-09T22:01:24.706691+0000","last_undegraded":"2023-07-09T22:01:24.706691+0000","last_fullsized":"2023-07-09T22:01:24.706691+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:07.454648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890872+0000","last_change":"2023-07-09T22:01:23.723337+0000","last_active":"2023-07-09T22:01:24.890872+0000","last_peered":"2023-07-09T22:01:24.890872+0000","last_clean":"2023-07-09T22:01:24.890872+0000","last_became_active":"2023-07-09T22:01:23.723073+0000","last_became_peered":"2023-07-09T22:01:23.723073+0000","last_unstale":"2023-07-09T22:01:24.890872+0000","last_undegraded":"2023-07-09T22:01:24.890872+0000","last_fullsized":"2023-07-09T22:01:24.890872+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:29:35.659739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700389+0000","last_change":"2023-07-09T22:01:22.714987+0000","last_active":"2023-07-09T22:01:24.700389+0000","last_peered":"2023-07-09T22:01:24.700389+0000","last_clean":"2023-07-09T22:01:24.700389+0000","last_became_active":"2023-07-09T22:01:22.709986+0000","last_became_peered":"2023-07-09T22:01:22.709986+0000","last_unstale":"2023-07-09T22:01:24.700389+0000","last_undegraded":"2023-07-09T22:01:24.700389+0000","last_fullsized":"2023-07-09T22:01:24.700389+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:48:54.374792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466295+0000","last_change":"2023-07-09T22:01:23.728291+0000","last_active":"2023-07-09T22:01:25.466295+0000","last_peered":"2023-07-09T22:01:25.466295+0000","last_clean":"2023-07-09T22:01:25.466295+0000","last_became_active":"2023-07-09T22:01:23.727958+0000","last_became_peered":"2023-07-09T22:01:23.727958+0000","last_unstale":"2023-07-09T22:01:25.466295+0000","last_undegraded":"2023-07-09T22:01:25.466295+0000","last_fullsized":"2023-07-09T22:01:25.466295+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:45.889399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466277+0000","last_change":"2023-07-09T22:01:22.712957+0000","last_active":"2023-07-09T22:01:25.466277+0000","last_peered":"2023-07-09T22:01:25.466277+0000","last_clean":"2023-07-09T22:01:25.466277+0000","last_became_active":"2023-07-09T22:01:22.712670+0000","last_became_peered":"2023-07-09T22:01:22.712670+0000","last_unstale":"2023-07-09T22:01:25.466277+0000","last_undegraded":"2023-07-09T22:01:25.466277+0000","last_fullsized":"2023-07-09T22:01:25.466277+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:51:43.547488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706143+0000","last_change":"2023-07-09T22:01:23.716117+0000","last_active":"2023-07-09T22:01:24.706143+0000","last_peered":"2023-07-09T22:01:24.706143+0000","last_clean":"2023-07-09T22:01:24.706143+0000","last_became_active":"2023-07-09T22:01:23.715033+0000","last_became_peered":"2023-07-09T22:01:23.715033+0000","last_unstale":"2023-07-09T22:01:24.706143+0000","last_undegraded":"2023-07-09T22:01:24.706143+0000","last_fullsized":"2023-07-09T22:01:24.706143+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:39:58.145389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890962+0000","last_change":"2023-07-09T22:01:22.709765+0000","last_active":"2023-07-09T22:01:24.890962+0000","last_peered":"2023-07-09T22:01:24.890962+0000","last_clean":"2023-07-09T22:01:24.890962+0000","last_became_active":"2023-07-09T22:01:22.708560+0000","last_became_peered":"2023-07-09T22:01:22.708560+0000","last_unstale":"2023-07-09T22:01:24.890962+0000","last_undegraded":"2023-07-09T22:01:24.890962+0000","last_fullsized":"2023-07-09T22:01:24.890962+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:24:08.639751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994281+0000","last_change":"2023-07-09T22:01:23.716944+0000","last_active":"2023-07-09T22:01:24.994281+0000","last_peered":"2023-07-09T22:01:24.994281+0000","last_clean":"2023-07-09T22:01:24.994281+0000","last_became_active":"2023-07-09T22:01:23.715628+0000","last_became_peered":"2023-07-09T22:01:23.715628+0000","last_unstale":"2023-07-09T22:01:24.994281+0000","last_undegraded":"2023-07-09T22:01:24.994281+0000","last_fullsized":"2023-07-09T22:01:24.994281+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:09:17.527604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"196'1","reported_seq":14,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095376+0000","last_change":"2023-07-09T22:01:22.719697+0000","last_active":"2023-07-09T22:01:26.095376+0000","last_peered":"2023-07-09T22:01:26.095376+0000","last_clean":"2023-07-09T22:01:26.095376+0000","last_became_active":"2023-07-09T22:01:22.719063+0000","last_became_peered":"2023-07-09T22:01:22.719063+0000","last_unstale":"2023-07-09T22:01:26.095376+0000","last_undegraded":"2023-07-09T22:01:26.095376+0000","last_fullsized":"2023-07-09T22:01:26.095376+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:39:56.075602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700407+0000","last_change":"2023-07-09T22:01:23.717346+0000","last_active":"2023-07-09T22:01:24.700407+0000","last_peered":"2023-07-09T22:01:24.700407+0000","last_clean":"2023-07-09T22:01:24.700407+0000","last_became_active":"2023-07-09T22:01:23.717081+0000","last_became_peered":"2023-07-09T22:01:23.717081+0000","last_unstale":"2023-07-09T22:01:24.700407+0000","last_undegraded":"2023-07-09T22:01:24.700407+0000","last_fullsized":"2023-07-09T22:01:24.700407+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:26:33.093444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095227+0000","last_change":"2023-07-09T22:01:22.714900+0000","last_active":"2023-07-09T22:01:26.095227+0000","last_peered":"2023-07-09T22:01:26.095227+0000","last_clean":"2023-07-09T22:01:26.095227+0000","last_became_active":"2023-07-09T22:01:22.714627+0000","last_became_peered":"2023-07-09T22:01:22.714627+0000","last_unstale":"2023-07-09T22:01:26.095227+0000","last_undegraded":"2023-07-09T22:01:26.095227+0000","last_fullsized":"2023-07-09T22:01:26.095227+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:13:18.206801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994272+0000","last_change":"2023-07-09T22:01:23.722295+0000","last_active":"2023-07-09T22:01:24.994272+0000","last_peered":"2023-07-09T22:01:24.994272+0000","last_clean":"2023-07-09T22:01:24.994272+0000","last_became_active":"2023-07-09T22:01:23.722038+0000","last_became_peered":"2023-07-09T22:01:23.722038+0000","last_unstale":"2023-07-09T22:01:24.994272+0000","last_undegraded":"2023-07-09T22:01:24.994272+0000","last_fullsized":"2023-07-09T22:01:24.994272+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:36:07.241554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700651+0000","last_change":"2023-07-09T22:01:22.721160+0000","last_active":"2023-07-09T22:01:24.700651+0000","last_peered":"2023-07-09T22:01:24.700651+0000","last_clean":"2023-07-09T22:01:24.700651+0000","last_became_active":"2023-07-09T22:01:22.720842+0000","last_became_peered":"2023-07-09T22:01:22.720842+0000","last_unstale":"2023-07-09T22:01:24.700651+0000","last_undegraded":"2023-07-09T22:01:24.700651+0000","last_fullsized":"2023-07-09T22:01:24.700651+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T05:20:11.655517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707418+0000","last_change":"2023-07-09T22:01:23.716968+0000","last_active":"2023-07-09T22:01:24.707418+0000","last_peered":"2023-07-09T22:01:24.707418+0000","last_clean":"2023-07-09T22:01:24.707418+0000","last_became_active":"2023-07-09T22:01:23.715785+0000","last_became_peered":"2023-07-09T22:01:23.715785+0000","last_unstale":"2023-07-09T22:01:24.707418+0000","last_undegraded":"2023-07-09T22:01:24.707418+0000","last_fullsized":"2023-07-09T22:01:24.707418+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:08:54.940588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706609+0000","last_change":"2023-07-09T22:01:22.714982+0000","last_active":"2023-07-09T22:01:24.706609+0000","last_peered":"2023-07-09T22:01:24.706609+0000","last_clean":"2023-07-09T22:01:24.706609+0000","last_became_active":"2023-07-09T22:01:22.714665+0000","last_became_peered":"2023-07-09T22:01:22.714665+0000","last_unstale":"2023-07-09T22:01:24.706609+0000","last_undegraded":"2023-07-09T22:01:24.706609+0000","last_fullsized":"2023-07-09T22:01:24.706609+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:20:39.765658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466046+0000","last_change":"2023-07-09T22:01:23.724862+0000","last_active":"2023-07-09T22:01:25.466046+0000","last_peered":"2023-07-09T22:01:25.466046+0000","last_clean":"2023-07-09T22:01:25.466046+0000","last_became_active":"2023-07-09T22:01:23.724582+0000","last_became_peered":"2023-07-09T22:01:23.724582+0000","last_unstale":"2023-07-09T22:01:25.466046+0000","last_undegraded":"2023-07-09T22:01:25.466046+0000","last_fullsized":"2023-07-09T22:01:25.466046+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:59:01.881076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095331+0000","last_change":"2023-07-09T22:01:22.716729+0000","last_active":"2023-07-09T22:01:26.095331+0000","last_peered":"2023-07-09T22:01:26.095331+0000","last_clean":"2023-07-09T22:01:26.095331+0000","last_became_active":"2023-07-09T22:01:22.716453+0000","last_became_peered":"2023-07-09T22:01:22.716453+0000","last_unstale":"2023-07-09T22:01:26.095331+0000","last_undegraded":"2023-07-09T22:01:26.095331+0000","last_fullsized":"2023-07-09T22:01:26.095331+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:57:02.848202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095110+0000","last_change":"2023-07-09T22:01:23.721167+0000","last_active":"2023-07-09T22:01:26.095110+0000","last_peered":"2023-07-09T22:01:26.095110+0000","last_clean":"2023-07-09T22:01:26.095110+0000","last_became_active":"2023-07-09T22:01:23.720630+0000","last_became_peered":"2023-07-09T22:01:23.720630+0000","last_unstale":"2023-07-09T22:01:26.095110+0000","last_undegraded":"2023-07-09T22:01:26.095110+0000","last_fullsized":"2023-07-09T22:01:26.095110+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:16.525297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706438+0000","last_change":"2023-07-09T22:01:22.719319+0000","last_active":"2023-07-09T22:01:24.706438+0000","last_peered":"2023-07-09T22:01:24.706438+0000","last_clean":"2023-07-09T22:01:24.706438+0000","last_became_active":"2023-07-09T22:01:22.718992+0000","last_became_peered":"2023-07-09T22:01:22.718992+0000","last_unstale":"2023-07-09T22:01:24.706438+0000","last_undegraded":"2023-07-09T22:01:24.706438+0000","last_fullsized":"2023-07-09T22:01:24.706438+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:55:15.284566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700882+0000","last_change":"2023-07-09T22:01:23.713908+0000","last_active":"2023-07-09T22:01:24.700882+0000","last_peered":"2023-07-09T22:01:24.700882+0000","last_clean":"2023-07-09T22:01:24.700882+0000","last_became_active":"2023-07-09T22:01:23.713494+0000","last_became_peered":"2023-07-09T22:01:23.713494+0000","last_unstale":"2023-07-09T22:01:24.700882+0000","last_undegraded":"2023-07-09T22:01:24.700882+0000","last_fullsized":"2023-07-09T22:01:24.700882+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:28.549855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890404+0000","last_change":"2023-07-09T22:01:22.707404+0000","last_active":"2023-07-09T22:01:24.890404+0000","last_peered":"2023-07-09T22:01:24.890404+0000","last_clean":"2023-07-09T22:01:24.890404+0000","last_became_active":"2023-07-09T22:01:22.707132+0000","last_became_peered":"2023-07-09T22:01:22.707132+0000","last_unstale":"2023-07-09T22:01:24.890404+0000","last_undegraded":"2023-07-09T22:01:24.890404+0000","last_fullsized":"2023-07-09T22:01:24.890404+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:34:50.935135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465783+0000","last_change":"2023-07-09T22:01:23.720888+0000","last_active":"2023-07-09T22:01:25.465783+0000","last_peered":"2023-07-09T22:01:25.465783+0000","last_clean":"2023-07-09T22:01:25.465783+0000","last_became_active":"2023-07-09T22:01:23.720574+0000","last_became_peered":"2023-07-09T22:01:23.720574+0000","last_unstale":"2023-07-09T22:01:25.465783+0000","last_undegraded":"2023-07-09T22:01:25.465783+0000","last_fullsized":"2023-07-09T22:01:25.465783+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:47:27.272225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095261+0000","last_change":"2023-07-09T22:01:22.719872+0000","last_active":"2023-07-09T22:01:26.095261+0000","last_peered":"2023-07-09T22:01:26.095261+0000","last_clean":"2023-07-09T22:01:26.095261+0000","last_became_active":"2023-07-09T22:01:22.719439+0000","last_became_peered":"2023-07-09T22:01:22.719439+0000","last_unstale":"2023-07-09T22:01:26.095261+0000","last_undegraded":"2023-07-09T22:01:26.095261+0000","last_fullsized":"2023-07-09T22:01:26.095261+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:58:55.472549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"183'326","reported_seq":1231,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466429+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:01:25.466429+0000","last_peered":"2023-07-09T22:01:25.466429+0000","last_clean":"2023-07-09T22:01:25.466429+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:01:25.466429+0000","last_undegraded":"2023-07-09T22:01:25.466429+0000","last_fullsized":"2023-07-09T22:01:25.466429+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:29.405401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":383,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706549+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:01:24.706549+0000","last_peered":"2023-07-09T22:01:24.706549+0000","last_clean":"2023-07-09T22:01:24.706549+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:01:24.706549+0000","last_undegraded":"2023-07-09T22:01:24.706549+0000","last_fullsized":"2023-07-09T22:01:24.706549+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:10:20.264619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.094986+0000","last_change":"2023-07-09T22:01:23.719535+0000","last_active":"2023-07-09T22:01:26.094986+0000","last_peered":"2023-07-09T22:01:26.094986+0000","last_clean":"2023-07-09T22:01:26.094986+0000","last_became_active":"2023-07-09T22:01:23.719252+0000","last_became_peered":"2023-07-09T22:01:23.719252+0000","last_unstale":"2023-07-09T22:01:26.094986+0000","last_undegraded":"2023-07-09T22:01:26.094986+0000","last_fullsized":"2023-07-09T22:01:26.094986+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:28:14.882589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"195'3","reported_seq":16,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.707369+0000","last_change":"2023-07-09T22:01:22.714653+0000","last_active":"2023-07-09T22:01:24.707369+0000","last_peered":"2023-07-09T22:01:24.707369+0000","last_clean":"2023-07-09T22:01:24.707369+0000","last_became_active":"2023-07-09T22:01:22.714202+0000","last_became_peered":"2023-07-09T22:01:22.714202+0000","last_unstale":"2023-07-09T22:01:24.707369+0000","last_undegraded":"2023-07-09T22:01:24.707369+0000","last_fullsized":"2023-07-09T22:01:24.707369+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:38:21.944632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":334,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466419+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:01:25.466419+0000","last_peered":"2023-07-09T22:01:25.466419+0000","last_clean":"2023-07-09T22:01:25.466419+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:01:25.466419+0000","last_undegraded":"2023-07-09T22:01:25.466419+0000","last_fullsized":"2023-07-09T22:01:25.466419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:08:52.470722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700429+0000","last_change":"2023-07-09T22:01:23.714356+0000","last_active":"2023-07-09T22:01:24.700429+0000","last_peered":"2023-07-09T22:01:24.700429+0000","last_clean":"2023-07-09T22:01:24.700429+0000","last_became_active":"2023-07-09T22:01:23.713494+0000","last_became_peered":"2023-07-09T22:01:23.713494+0000","last_unstale":"2023-07-09T22:01:24.700429+0000","last_undegraded":"2023-07-09T22:01:24.700429+0000","last_fullsized":"2023-07-09T22:01:24.700429+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:18:01.072956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"195'6","reported_seq":19,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095375+0000","last_change":"2023-07-09T22:01:22.718035+0000","last_active":"2023-07-09T22:01:26.095375+0000","last_peered":"2023-07-09T22:01:26.095375+0000","last_clean":"2023-07-09T22:01:26.095375+0000","last_became_active":"2023-07-09T22:01:22.717691+0000","last_became_peered":"2023-07-09T22:01:22.717691+0000","last_unstale":"2023-07-09T22:01:26.095375+0000","last_undegraded":"2023-07-09T22:01:26.095375+0000","last_fullsized":"2023-07-09T22:01:26.095375+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:41:38.876037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700419+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:01:24.700419+0000","last_peered":"2023-07-09T22:01:24.700419+0000","last_clean":"2023-07-09T22:01:24.700419+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:01:24.700419+0000","last_undegraded":"2023-07-09T22:01:24.700419+0000","last_fullsized":"2023-07-09T22:01:24.700419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:33:52.309259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.465702+0000","last_change":"2023-07-09T22:01:23.724106+0000","last_active":"2023-07-09T22:01:25.465702+0000","last_peered":"2023-07-09T22:01:25.465702+0000","last_clean":"2023-07-09T22:01:25.465702+0000","last_became_active":"2023-07-09T22:01:23.723712+0000","last_became_peered":"2023-07-09T22:01:23.723712+0000","last_unstale":"2023-07-09T22:01:25.465702+0000","last_undegraded":"2023-07-09T22:01:25.465702+0000","last_fullsized":"2023-07-09T22:01:25.465702+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:54.293417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095441+0000","last_change":"2023-07-09T22:01:22.720784+0000","last_active":"2023-07-09T22:01:26.095441+0000","last_peered":"2023-07-09T22:01:26.095441+0000","last_clean":"2023-07-09T22:01:26.095441+0000","last_became_active":"2023-07-09T22:01:22.720486+0000","last_became_peered":"2023-07-09T22:01:22.720486+0000","last_unstale":"2023-07-09T22:01:26.095441+0000","last_undegraded":"2023-07-09T22:01:26.095441+0000","last_fullsized":"2023-07-09T22:01:26.095441+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:53:48.170521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":383,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706952+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:01:24.706952+0000","last_peered":"2023-07-09T22:01:24.706952+0000","last_clean":"2023-07-09T22:01:24.706952+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:01:24.706952+0000","last_undegraded":"2023-07-09T22:01:24.706952+0000","last_fullsized":"2023-07-09T22:01:24.706952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:25:19.001163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706771+0000","last_change":"2023-07-09T22:01:23.717207+0000","last_active":"2023-07-09T22:01:24.706771+0000","last_peered":"2023-07-09T22:01:24.706771+0000","last_clean":"2023-07-09T22:01:24.706771+0000","last_became_active":"2023-07-09T22:01:23.716943+0000","last_became_peered":"2023-07-09T22:01:23.716943+0000","last_unstale":"2023-07-09T22:01:24.706771+0000","last_undegraded":"2023-07-09T22:01:24.706771+0000","last_fullsized":"2023-07-09T22:01:24.706771+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:27:37.154935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.706363+0000","last_change":"2023-07-09T22:01:22.708768+0000","last_active":"2023-07-09T22:01:24.706363+0000","last_peered":"2023-07-09T22:01:24.706363+0000","last_clean":"2023-07-09T22:01:24.706363+0000","last_became_active":"2023-07-09T22:01:22.708312+0000","last_became_peered":"2023-07-09T22:01:22.708312+0000","last_unstale":"2023-07-09T22:01:24.706363+0000","last_undegraded":"2023-07-09T22:01:24.706363+0000","last_fullsized":"2023-07-09T22:01:24.706363+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:22:53.699324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":325,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994602+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:01:24.994602+0000","last_peered":"2023-07-09T22:01:24.994602+0000","last_clean":"2023-07-09T22:01:24.994602+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:01:24.994602+0000","last_undegraded":"2023-07-09T22:01:24.994602+0000","last_fullsized":"2023-07-09T22:01:24.994602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:49:29.510663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.700754+0000","last_change":"2023-07-09T22:01:23.711122+0000","last_active":"2023-07-09T22:01:24.700754+0000","last_peered":"2023-07-09T22:01:24.700754+0000","last_clean":"2023-07-09T22:01:24.700754+0000","last_became_active":"2023-07-09T22:01:23.710832+0000","last_became_peered":"2023-07-09T22:01:23.710832+0000","last_unstale":"2023-07-09T22:01:24.700754+0000","last_undegraded":"2023-07-09T22:01:24.700754+0000","last_fullsized":"2023-07-09T22:01:24.700754+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:30:28.746079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"195'8","reported_seq":21,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994280+0000","last_change":"2023-07-09T22:01:22.716008+0000","last_active":"2023-07-09T22:01:24.994280+0000","last_peered":"2023-07-09T22:01:24.994280+0000","last_clean":"2023-07-09T22:01:24.994280+0000","last_became_active":"2023-07-09T22:01:22.715729+0000","last_became_peered":"2023-07-09T22:01:22.715729+0000","last_unstale":"2023-07-09T22:01:24.994280+0000","last_undegraded":"2023-07-09T22:01:24.994280+0000","last_fullsized":"2023-07-09T22:01:24.994280+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:45:45.503490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":333,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:25.466190+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:01:25.466190+0000","last_peered":"2023-07-09T22:01:25.466190+0000","last_clean":"2023-07-09T22:01:25.466190+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:01:25.466190+0000","last_undegraded":"2023-07-09T22:01:25.466190+0000","last_fullsized":"2023-07-09T22:01:25.466190+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:50:22.294205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098126+0000","last_change":"2023-07-09T22:01:23.717402+0000","last_active":"2023-07-09T22:01:26.098126+0000","last_peered":"2023-07-09T22:01:26.098126+0000","last_clean":"2023-07-09T22:01:26.098126+0000","last_became_active":"2023-07-09T22:01:23.716999+0000","last_became_peered":"2023-07-09T22:01:23.716999+0000","last_unstale":"2023-07-09T22:01:26.098126+0000","last_undegraded":"2023-07-09T22:01:26.098126+0000","last_fullsized":"2023-07-09T22:01:26.098126+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:15:24.937818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"195'2","reported_seq":15,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.890801+0000","last_change":"2023-07-09T22:01:22.708500+0000","last_active":"2023-07-09T22:01:24.890801+0000","last_peered":"2023-07-09T22:01:24.890801+0000","last_clean":"2023-07-09T22:01:24.890801+0000","last_became_active":"2023-07-09T22:01:22.708177+0000","last_became_peered":"2023-07-09T22:01:22.708177+0000","last_unstale":"2023-07-09T22:01:24.890801+0000","last_undegraded":"2023-07-09T22:01:24.890801+0000","last_fullsized":"2023-07-09T22:01:24.890801+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:04:51.684860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":327,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994727+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:01:24.994727+0000","last_peered":"2023-07-09T22:01:24.994727+0000","last_clean":"2023-07-09T22:01:24.994727+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:01:24.994727+0000","last_undegraded":"2023-07-09T22:01:24.994727+0000","last_fullsized":"2023-07-09T22:01:24.994727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:24:00.049070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":11,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:24.994440+0000","last_change":"2023-07-09T22:01:23.721554+0000","last_active":"2023-07-09T22:01:24.994440+0000","last_peered":"2023-07-09T22:01:24.994440+0000","last_clean":"2023-07-09T22:01:24.994440+0000","last_became_active":"2023-07-09T22:01:23.721259+0000","last_became_peered":"2023-07-09T22:01:23.721259+0000","last_unstale":"2023-07-09T22:01:24.994440+0000","last_undegraded":"2023-07-09T22:01:24.994440+0000","last_fullsized":"2023-07-09T22:01:24.994440+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:22.685056+0000","last_clean_scrub_stamp":"2023-07-09T22:01:22.685056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:52:26.645769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.095198+0000","last_change":"2023-07-09T22:01:22.711803+0000","last_active":"2023-07-09T22:01:26.095198+0000","last_peered":"2023-07-09T22:01:26.095198+0000","last_clean":"2023-07-09T22:01:26.095198+0000","last_became_active":"2023-07-09T22:01:22.709155+0000","last_became_peered":"2023-07-09T22:01:22.709155+0000","last_unstale":"2023-07-09T22:01:26.095198+0000","last_undegraded":"2023-07-09T22:01:26.095198+0000","last_fullsized":"2023-07-09T22:01:26.095198+0000","mapping_epoch":193,"log_start":"0'0","ondisk_log_start":"0'0","created":193,"last_epoch_clean":194,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:01:21.677580+0000","last_clean_scrub_stamp":"2023-07-09T22:01:21.677580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:23:10.911494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":339,"reported_epoch":196,"state":"active+clean","last_fresh":"2023-07-09T22:01:26.098412+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:01:26.098412+0000","last_peered":"2023-07-09T22:01:26.098412+0000","last_clean":"2023-07-09T22:01:26.098412+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:01:26.098412+0000","last_undegraded":"2023-07-09T22:01:26.098412+0000","last_fullsized":"2023-07-09T22:01:26.098412+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:02:02.845004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1940,"num_read_kb":4014,"num_write":539,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":326,"ondisk_log_size":326,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575312,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47972,"kb_used_data":2972,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323868,"statfs":{"total":96636764160,"available":96587640832,"internally_reserved":0,"allocated":3043328,"data_stored":1856240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.73499999999999999,"15min":0.73899999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73599999999999999,"15min":0.74399999999999999},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71899999999999997,"15min":0.745},"min":{"1min":0.44600000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.95899999999999996,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74199999999999999,"15min":0.75900000000000001},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.80900000000000005}]},{"osd":2,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71799999999999997,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.437},"max":{"1min":0.99299999999999999,"5min":1.036,"15min":1.036},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75700000000000001,"15min":0.76400000000000001},"min":{"1min":0.57099999999999995,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75900000000000001,"15min":0.77400000000000002},"min":{"1min":0.55600000000000005,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.79000000000000004,"15min":0.81000000000000005},"min":{"1min":0.55800000000000005,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":1.1000000000000001,"5min":1.107,"15min":1.107},"last":0.752}]},{"osd":4,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56299999999999994,"15min":0.57499999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.34499999999999997},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70399999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.63},"min":{"1min":0.438,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.014,"5min":1.0509999999999999,"15min":1.077},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.65700000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.437},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.90500000000000003}]},{"osd":6,"last update":"Sun Jul 9 22:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.68899999999999995,"15min":0.68300000000000005},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.006,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61799999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575311,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37536,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334304,"statfs":{"total":96636764160,"available":96598327296,"internally_reserved":0,"allocated":2449408,"data_stored":1265872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.70499999999999996,"15min":0.73099999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83199999999999996,"5min":1.075,"15min":1.075},"last":0.443},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.73799999999999999,"15min":0.749},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.999,"5min":0.999,"15min":1.04},"last":0.56799999999999995}]},{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.72399999999999998,"15min":0.748},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88600000000000001,"5min":0.98199999999999998,"15min":1.177},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.72799999999999998,"15min":0.747},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.41799999999999998},"max":{"1min":0.86299999999999999,"5min":1.002,"15min":1.1890000000000001},"last":0.50800000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.72699999999999998,"15min":0.754},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.90400000000000003,"5min":1.0089999999999999,"15min":1.504},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.749,"15min":0.76400000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.97499999999999998,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74199999999999999,"15min":0.77200000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.90900000000000003,"5min":1.02,"15min":1.026},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.754,"15min":0.77000000000000002},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.85299999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.68999999999999995}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.57299999999999995},"min":{"1min":0.376,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.92600000000000005,"5min":0.94899999999999995,"15min":1.161},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90600000000000003,"5min":1.05,"15min":1.099},"last":0.626}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63},"min":{"1min":0.39700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.86499999999999999,"5min":0.93899999999999995,"15min":1.052},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.65200000000000002},"min":{"1min":0.43099999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88400000000000001,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.76900000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.67600000000000005,"15min":0.68600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95399999999999996,"5min":1.01,"15min":1.0860000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.70299999999999996,"15min":0.71199999999999997},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94599999999999995,"5min":1.016,"15min":1.077},"last":0.75700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575310,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2400,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2457600,"data_stored":1265996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.70399999999999996,"15min":0.71699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.79800000000000004,"5min":1.012,"15min":1.012},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.44800000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.89300000000000002,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.86899999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":0.90900000000000003,"5min":0.99399999999999999,"15min":1.05},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.74399999999999999},"min":{"1min":0.47499999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91900000000000004,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.84699999999999998}]},{"osd":2,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.75800000000000001,"15min":0.76100000000000001},"min":{"1min":0.53200000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.88500000000000001,"5min":1.095,"15min":1.095},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72499999999999998,"15min":0.73099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.83799999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77300000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.84799999999999998,"5min":1.008,"15min":1.034},"last":0.749},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.76100000000000001,"15min":0.76800000000000002},"min":{"1min":0.59799999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96099999999999997,"5min":0.98199999999999998,"15min":1.0720000000000001},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.56499999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.81100000000000005,"5min":1.004,"15min":1.004},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60499999999999998,"15min":0.61299999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":0.78300000000000003,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.92600000000000005}]},{"osd":6,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.63100000000000001,"15min":0.628},"min":{"1min":0.47199999999999998,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.98199999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.64000000000000001},"min":{"1min":0.46500000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.82899999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:00:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":1.0660000000000001,"15min":1.0800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.70099999999999996},"min":{"1min":0.50700000000000001,"5min":0.48499999999999999,"15min":0.41099999999999998},"max":{"1min":1.0069999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.89300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834575312,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37552,"kb_used_data":2408,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334288,"statfs":{"total":96636764160,"available":96598310912,"internally_reserved":0,"allocated":2465792,"data_stored":1266636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.752,"15min":0.745},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.99299999999999999,"5min":0.996,"15min":1.075},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.72599999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.55800000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.54700000000000004,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95199999999999996,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.76700000000000002,"15min":0.752},"min":{"1min":0.55900000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.95099999999999996,"5min":0.998,"15min":1.03},"last":0.78400000000000003}]},{"osd":2,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.747,"15min":0.747},"min":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.97699999999999998,"5min":1.0800000000000001,"15min":1.0960000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.77000000000000002},"min":{"1min":0.55400000000000005,"5min":0.51500000000000001,"15min":0.505},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.60999999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76400000000000001,"15min":0.74299999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78800000000000003,"15min":0.77400000000000002},"min":{"1min":0.61599999999999999,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.026,"5min":1.038,"15min":1.1240000000000001},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.629,"15min":0.60899999999999999},"min":{"1min":0.46200000000000002,"5min":0.41099999999999998,"15min":0.36799999999999999},"max":{"1min":0.84899999999999998,"5min":1.05,"15min":1.079},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64200000000000002,"15min":0.61099999999999999},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.34599999999999997},"max":{"1min":0.84199999999999997,"5min":1.016,"15min":1.016},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.64800000000000002,"15min":0.63900000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.83399999999999996,"5min":0.96499999999999997,"15min":1.018},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.52700000000000002,"5min":0.45300000000000001,"15min":0.438},"max":{"1min":0.90600000000000003,"5min":1.069,"15min":1.069},"last":0.89400000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:40 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.77200000000000002,"15min":0.73299999999999998},"min":{"1min":0.57599999999999996,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":0.99199999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.94599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575311,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37556,"kb_used_data":2412,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334284,"statfs":{"total":96636764160,"available":96598306816,"internally_reserved":0,"allocated":2469888,"data_stored":1268040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.377},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.433},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.52800000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.752}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.85599999999999998}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.70299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59680,"kb_used_data":2392,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312160,"statfs":{"total":96636764160,"available":96575651840,"internally_reserved":0,"allocated":2449408,"data_stored":1265872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.44700000000000001,"15min":0.46000000000000002},"min":{"1min":0.316,"5min":0.307,"15min":0.30299999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.96499999999999997},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.33600000000000002,"15min":0.32100000000000001},"max":{"1min":0.77100000000000002,"5min":0.78600000000000003,"15min":0.85099999999999998},"last":0.42199999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.46600000000000003,"15min":0.46899999999999997},"min":{"1min":0.35299999999999998,"5min":0.33200000000000002,"15min":0.33000000000000002},"max":{"1min":0.68700000000000006,"5min":0.748,"15min":0.77200000000000002},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.56399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40400000000000003,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57899999999999996,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.41799999999999998,"15min":0.38200000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.016},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.55700000000000005,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.371,"15min":0.371},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.44}]},{"osd":4,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63600000000000001,"5min":0.56499999999999995,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":1.117,"15min":1.337},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.84099999999999997,"15min":0.82699999999999996},"min":{"1min":0.65400000000000003,"5min":0.57899999999999996,"15min":0.45000000000000001},"max":{"1min":1.1319999999999999,"5min":1.1970000000000001,"15min":1.306},"last":0.54100000000000004}]},{"osd":5,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.871,"15min":0.84499999999999997},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.57699999999999996},"max":{"1min":1.304,"5min":1.3169999999999999,"15min":1.3899999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.82199999999999995,"15min":0.81899999999999995},"min":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.52200000000000002},"max":{"1min":1.089,"5min":1.111,"15min":1.375},"last":0.52300000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.627},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.70599999999999996,"5min":0.59499999999999997,"15min":0.52200000000000002},"max":{"1min":1.232,"5min":1.232,"15min":1.294},"last":0.65100000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.82399999999999995,"15min":0.83199999999999996},"min":{"1min":0.623,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.1499999999999999,"5min":1.2809999999999999,"15min":1.298},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1679999999999999,"5min":1.196,"15min":1.256},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834575312,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37548,"kb_used_data":2404,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334292,"statfs":{"total":96636764160,"available":96598315008,"internally_reserved":0,"allocated":2461696,"data_stored":1267436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.56899999999999995}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.625}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.72899999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.876}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.71699999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.82199999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.747},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.89800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834575312,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42220,"kb_used_data":2980,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329620,"statfs":{"total":96636764160,"available":96593530880,"internally_reserved":0,"allocated":3051520,"data_stored":1856344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.48499999999999999,"15min":0.48799999999999999},"min":{"1min":0.31900000000000001,"5min":0.30499999999999999,"15min":0.30299999999999999},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.89300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58799999999999997,"15min":0.57899999999999996},"min":{"1min":0.48299999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.44500000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53300000000000003,"15min":0.52400000000000002},"min":{"1min":0.39100000000000001,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.74299999999999999,"5min":0.83499999999999996,"15min":0.90300000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56100000000000005,"15min":0.56200000000000006},"min":{"1min":0.41099999999999998,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.71499999999999997,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.503}]},{"osd":3,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52300000000000002},"min":{"1min":0.34699999999999998,"5min":0.33500000000000002,"15min":0.33400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61499999999999999,"15min":0.60999999999999999},"min":{"1min":0.46800000000000003,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":0.77400000000000002,"5min":0.86299999999999999,"15min":0.93899999999999995},"last":0.51700000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81200000000000006,"15min":0.80400000000000005},"min":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1850000000000001,"5min":1.306,"15min":1.306},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80400000000000005,"15min":0.80700000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.351,"5min":1.351,"15min":1.3600000000000001},"last":0.88900000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.81299999999999994,"15min":0.80900000000000005},"min":{"1min":0.52700000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.2529999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.83799999999999997,"15min":0.82599999999999996},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.871}]},{"osd":6,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81000000000000005,"15min":0.81299999999999994},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":1.135,"5min":1.3260000000000001,"15min":1.381},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82899999999999996,"15min":0.82299999999999995},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.82299999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.84999999999999998,"15min":0.84299999999999997},"min":{"1min":0.62,"5min":0.62,"15min":0.55000000000000004},"max":{"1min":1.296,"5min":1.296,"15min":1.3400000000000001},"last":0.753},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.82999999999999996,"15min":0.82899999999999996},"min":{"1min":0.64400000000000002,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":1.2210000000000001,"5min":1.397,"15min":1.397},"last":0.96599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:01:32.808 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-09T22:01:32.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-07-09T22:01:32.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 Processor -- start 2023-07-09T22:01:32.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 -- start start 2023-07-09T22:01:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f48e00c3e10 0x7f48e00c4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f48e015c200 0x7f48e015c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e00c9090 con 0x7f48e01585b0 2023-07-09T22:01:32.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00cbf40 con 0x7f48e00c3e10 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48e5574640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00c47d0 con 0x7f48e015c200 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48deffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f48e01585b0 0x7f48e006b430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60418/0 (socket says 172.21.15.37:60418) 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48deffd640 1 -- 172.21.15.37:0/2358344330 learned_addr learned my addr 172.21.15.37:0/2358344330 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48de7fc640 1 --2- 172.21.15.37:0/2358344330 >> v2:172.21.15.37:3300/0 conn(0x7f48e00c3e10 0x7f48e00c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48df7fe640 1 --2- 172.21.15.37:0/2358344330 >> v2:172.21.15.119:3300/0 conn(0x7f48e015c200 0x7f48e015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:32.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48de7fc640 1 -- 172.21.15.37:0/2358344330 >> v2:172.21.15.119:3300/0 conn(0x7f48e015c200 msgr2=0x7f48e015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48de7fc640 1 --2- 172.21.15.37:0/2358344330 >> v2:172.21.15.119:3300/0 conn(0x7f48e015c200 0x7f48e015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48de7fc640 1 -- 172.21.15.37:0/2358344330 >> v1:172.21.15.37:6789/0 conn(0x7f48e01585b0 legacy=0x7f48e006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.985+0000 7f48de7fc640 1 -- 172.21.15.37:0/2358344330 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e015cba0 con 0x7f48e00c3e10 2023-07-09T22:01:32.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48de7fc640 1 --2- 172.21.15.37:0/2358344330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e00c3e10 0x7f48e00c4290 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f48e006edb0 tx=0x7f48d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93b22acedd6aafe1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48ddffb640 1 -- 172.21.15.37:0/2358344330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40ab680 con 0x7f48e00c3e10 2023-07-09T22:01:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48ddffb640 1 -- 172.21.15.37:0/2358344330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40ab7e0 con 0x7f48e00c3e10 2023-07-09T22:01:32.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48ddffb640 1 -- 172.21.15.37:0/2358344330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40abb70 con 0x7f48e00c3e10 2023-07-09T22:01:32.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 -- 172.21.15.37:0/2358344330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e00c3e10 msgr2=0x7f48e00c4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 --2- 172.21.15.37:0/2358344330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e00c3e10 0x7f48e00c4290 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f48e006edb0 tx=0x7f48d401c460 comp rx=0 tx=0).stop 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 -- 172.21.15.37:0/2358344330 shutdown_connections 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 --2- 172.21.15.37:0/2358344330 >> v2:172.21.15.119:3300/0 conn(0x7f48e015c200 0x7f48e015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 --2- 172.21.15.37:0/2358344330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e00c3e10 0x7f48e00c4290 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 -- 172.21.15.37:0/2358344330 >> 172.21.15.37:0/2358344330 conn(0x7f48e00cde40 msgr2=0x7f48e00ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 -- 172.21.15.37:0/2358344330 shutdown_connections 2023-07-09T22:01:32.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.989+0000 7f48e5574640 1 -- 172.21.15.37:0/2358344330 wait complete. 2023-07-09T22:01:32.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 Processor -- start 2023-07-09T22:01:32.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- start start 2023-07-09T22:01:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48e00c3e10 0x7f48e014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48e015c200 0x7f48e00c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c6f10 con 0x7f48e01585b0 2023-07-09T22:01:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c6540 con 0x7f48e015c200 2023-07-09T22:01:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e00c5930 con 0x7f48e00c3e10 2023-07-09T22:01:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51488/0 (socket says 172.21.15.37:51488) 2023-07-09T22:01:33.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 -- 172.21.15.37:0/10353503 learned_addr learned my addr 172.21.15.37:0/10353503 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48deffd640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48e00c3e10 0x7f48e014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48df7fe640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48e015c200 0x7f48e00c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 -- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48e00c3e10 msgr2=0x7f48e014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48e00c3e10 0x7f48e014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 -- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48e015c200 msgr2=0x7f48e00c69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48e015c200 0x7f48e00c69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 -- 172.21.15.37:0/10353503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d4009420 con 0x7f48e01585b0 2023-07-09T22:01:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48de7fc640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ad040 tx=0x7f48d401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40b5810 con 0x7f48e01585b0 2023-07-09T22:01:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d40b5990 con 0x7f48e01585b0 2023-07-09T22:01:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d40b5d40 con 0x7f48e01585b0 2023-07-09T22:01:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e00c5c10 con 0x7f48e01585b0 2023-07-09T22:01:33.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.993+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e00c61d0 con 0x7f48e01585b0 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e00c66d0 con 0x7f48e01585b0 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f48d40b4390 con 0x7f48e01585b0 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48c77fe640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 0x7f48cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f48d411ede0 con 0x7f48e01585b0 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48deffd640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 0x7f48cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:32.997+0000 7f48deffd640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 0x7f48cc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005890 tx=0x7f48d0009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:33.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.001+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48d40ebff0 con 0x7f48e01585b0 2023-07-09T22:01:33.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.205+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f48e004d7d0 con 0x7f48e01585b0 2023-07-09T22:01:33.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48c77fe640 1 -- 172.21.15.37:0/10353503 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v32) v1 ==== 190+0+147 (secure 0 0 0) 0x7f48d40ef610 con 0x7f48e01585b0 2023-07-09T22:01:33.218 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-07-09T22:01:33.219 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQDaJKtktWwvLBAA1S8ssopNqwRnZjGionbI4A== 2023-07-09T22:01:33.219 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-07-09T22:01:33.219 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-07-09T22:01:33.219 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-07-09T22:01:33.219 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-07-09T22:01:33.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 msgr2=0x7f48cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 0x7f48cc068850 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005890 tx=0x7f48d0009040 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 msgr2=0x7f48e0146dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f48d40ad040 tx=0x7f48d401aca0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 shutdown_connections 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f48cc0663a0 0x7f48cc068850 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f48e015c200 0x7f48e00c69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f48e01585b0 0x7f48e0146dc0 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 --2- 172.21.15.37:0/10353503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f48e00c3e10 0x7f48e014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 >> 172.21.15.37:0/10353503 conn(0x7f48e00cde40 msgr2=0x7f48e00ce210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 shutdown_connections 2023-07-09T22:01:33.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.213+0000 7f48e5574640 1 -- 172.21.15.37:0/10353503 wait complete. 2023-07-09T22:01:33.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:33.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 Processor -- start 2023-07-09T22:01:33.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 -- start start 2023-07-09T22:01:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa34406f6d0 0x7fa34406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3440cbe90 con 0x7fa3440af830 2023-07-09T22:01:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344159bb0 con 0x7fa3440cc320 2023-07-09T22:01:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34bd2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa34406d370 con 0x7fa34406f6d0 2023-07-09T22:01:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa349ac8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa3440af830 0x7fa3440afc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60424/0 (socket says 172.21.15.37:60424) 2023-07-09T22:01:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa349ac8640 1 -- 172.21.15.37:0/4123670852 learned_addr learned my addr 172.21.15.37:0/4123670852 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:33.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.377+0000 7fa34a2c9640 1 --2- 172.21.15.37:0/4123670852 >> v2:172.21.15.37:3300/0 conn(0x7fa34406f6d0 0x7fa34406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34a2c9640 1 -- 172.21.15.37:0/4123670852 >> v1:172.21.15.119:6789/0 conn(0x7fa3440cc320 legacy=0x7fa34406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34a2c9640 1 -- 172.21.15.37:0/4123670852 >> v1:172.21.15.37:6789/0 conn(0x7fa3440af830 legacy=0x7fa3440afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34a2c9640 1 -- 172.21.15.37:0/4123670852 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440b38b0 con 0x7fa34406f6d0 2023-07-09T22:01:33.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa348ac6640 1 -- 172.21.15.37:0/4123670852 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914632796 0 0) 0x7fa344159bb0 con 0x7fa3440cc320 2023-07-09T22:01:33.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34a2c9640 1 --2- 172.21.15.37:0/4123670852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa34406c160 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009d90 tx=0x7fa33c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64366c0851050159 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:33.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa348ac6640 1 -- 172.21.15.37:0/4123670852 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0a5a00 con 0x7fa34406f6d0 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa348ac6640 1 -- 172.21.15.37:0/4123670852 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c0a5b60 con 0x7fa34406f6d0 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa348ac6640 1 -- 172.21.15.37:0/4123670852 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33c0ad440 con 0x7fa34406f6d0 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34bd2c640 1 -- 172.21.15.37:0/4123670852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 msgr2=0x7fa34406c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/4123670852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa34406c160 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7fa33c009d90 tx=0x7fa33c01c920 comp rx=0 tx=0).stop 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34bd2c640 1 -- 172.21.15.37:0/4123670852 shutdown_connections 2023-07-09T22:01:33.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/4123670852 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa34406c160 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.381+0000 7fa34bd2c640 1 -- 172.21.15.37:0/4123670852 >> 172.21.15.37:0/4123670852 conn(0x7fa3440ca830 msgr2=0x7fa3440cac30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- 172.21.15.37:0/4123670852 shutdown_connections 2023-07-09T22:01:33.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- 172.21.15.37:0/4123670852 wait complete. 2023-07-09T22:01:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 Processor -- start 2023-07-09T22:01:33.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- start start 2023-07-09T22:01:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 0x7fa3440c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 0x7fa3440c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344159080 con 0x7fa34406f6d0 2023-07-09T22:01:33.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344158500 con 0x7fa3440cc320 2023-07-09T22:01:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34bd2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3441587e0 con 0x7fa3440af830 2023-07-09T22:01:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51500/0 (socket says 172.21.15.37:51500) 2023-07-09T22:01:33.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 -- 172.21.15.37:0/1473296567 learned_addr learned my addr 172.21.15.37:0/1473296567 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34a2c9640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 0x7fa3440c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 -- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 msgr2=0x7fa3440c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa3492c7640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 0x7fa3440c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 0x7fa3440c9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 -- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 msgr2=0x7fa3440c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 0x7fa3440c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa349ac8640 1 -- 172.21.15.37:0/1473296567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33c009a70 con 0x7fa34406f6d0 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa34a2c9640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 0x7fa3440c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.385+0000 7fa3492c7640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 0x7fa3440c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa349ac8640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa34000c420 tx=0x7fa34000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340005cf0 con 0x7fa34406f6d0 2023-07-09T22:01:33.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa340005e50 con 0x7fa34406f6d0 2023-07-09T22:01:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa344158ac0 con 0x7fa34406f6d0 2023-07-09T22:01:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3400072f0 con 0x7fa34406f6d0 2023-07-09T22:01:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa344158170 con 0x7fa34406f6d0 2023-07-09T22:01:33.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3440ab900 con 0x7fa34406f6d0 2023-07-09T22:01:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa340007450 con 0x7fa34406f6d0 2023-07-09T22:01:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 0x7fa328068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fa3400834a0 con 0x7fa34406f6d0 2023-07-09T22:01:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.389+0000 7fa3492c7640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 0x7fa328068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:33.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.393+0000 7fa3492c7640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 0x7fa328068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3440b0910 tx=0x7fa334009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:33.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.393+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa3400507c0 con 0x7fa34406f6d0 2023-07-09T22:01:33.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3440cbaf0 con 0x7fa34406f6d0 2023-07-09T22:01:33.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa33a7fc640 1 -- 172.21.15.37:0/1473296567 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fa340053de0 con 0x7fa34406f6d0 2023-07-09T22:01:33.590 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:33.590 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:01:33.591 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:01:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 msgr2=0x7fa328068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 0x7fa328068850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3440b0910 tx=0x7fa334009040 comp rx=0 tx=0).stop 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 msgr2=0x7fa3440b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7fa34000c420 tx=0x7fa34000c8e0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 shutdown_connections 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa3280663a0 0x7fa328068850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa3440cc320 0x7fa3440c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa3440af830 0x7fa3440c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 --2- 172.21.15.37:0/1473296567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa34406f6d0 0x7fa3440b1640 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 >> 172.21.15.37:0/1473296567 conn(0x7fa3440ca830 msgr2=0x7fa3440b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:33.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 shutdown_connections 2023-07-09T22:01:33.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:33.585+0000 7fa34bd2c640 1 -- 172.21.15.37:0/1473296567 wait complete. 2023-07-09T22:01:34.014 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-07-09T22:01:23.091702+0000', 'modified': '2023-07-09T22:01:26.737153+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10761}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10761': {'gid': 10761, 'name': 'a', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/3019715389', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 3019715389}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 3019715389}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-09T22:01:34.014 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-07-09T22:01:34.015 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-07-09T22:01:34.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.157+0000 7f27441ac640 1 Processor -- start 2023-07-09T22:01:34.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.157+0000 7f27441ac640 1 -- start start 2023-07-09T22:01:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.157+0000 7f27441ac640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273c0b7a60 0x7f273c0cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f27441ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f27441ac640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0cef80 con 0x7f273c0b4140 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f27441ac640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c0b45b0 con 0x7f273c0b7a60 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f27441ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0cf260 con 0x7f273c0b47a0 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273c0b7a60 0x7f273c0cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f273c0b7a60 0x7f273c0cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51502/0 (socket says 172.21.15.37:51502) 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 -- 172.21.15.37:0/4121369736 learned_addr learned my addr 172.21.15.37:0/4121369736 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741747640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 -- 172.21.15.37:0/4121369736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 msgr2=0x7f273c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c0b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 -- 172.21.15.37:0/4121369736 >> v1:172.21.15.37:6789/0 conn(0x7f273c0b4140 legacy=0x7f273c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 -- 172.21.15.37:0/4121369736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0cf540 con 0x7f273c0b7a60 2023-07-09T22:01:34.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2741f48640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b7a60 0x7f273c0cc7d0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f2738009870 tx=0x7f273801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a7ea41fb69c27b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.161+0000 7f2740f46640 1 -- 172.21.15.37:0/4121369736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380a7070 con 0x7f273c0b7a60 2023-07-09T22:01:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f2740f46640 1 -- 172.21.15.37:0/4121369736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380ab430 con 0x7f273c0b7a60 2023-07-09T22:01:34.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f2740f46640 1 -- 172.21.15.37:0/4121369736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380ab7c0 con 0x7f273c0b7a60 2023-07-09T22:01:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- 172.21.15.37:0/4121369736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b7a60 msgr2=0x7f273c0cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b7a60 0x7f273c0cc7d0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f2738009870 tx=0x7f273801c540 comp rx=0 tx=0).stop 2023-07-09T22:01:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- 172.21.15.37:0/4121369736 shutdown_connections 2023-07-09T22:01:34.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c0b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- 172.21.15.37:0/4121369736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b7a60 0x7f273c0cc7d0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- 172.21.15.37:0/4121369736 >> 172.21.15.37:0/4121369736 conn(0x7f273c073050 msgr2=0x7f273c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- 172.21.15.37:0/4121369736 shutdown_connections 2023-07-09T22:01:34.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- 172.21.15.37:0/4121369736 wait complete. 2023-07-09T22:01:34.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 Processor -- start 2023-07-09T22:01:34.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- start start 2023-07-09T22:01:34.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 0x7f273c152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c154ac0 con 0x7f273c0b4140 2023-07-09T22:01:34.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c152fc0 con 0x7f273c0b7a60 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f27441ac640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1532a0 con 0x7f273c0b47a0 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51518/0 (socket says 172.21.15.37:51518) 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.165+0000 7f2741f48640 1 -- 172.21.15.37:0/450186316 learned_addr learned my addr 172.21.15.37:0/450186316 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2742749640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 0x7f273c152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741747640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 -- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 msgr2=0x7f273c152450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c152450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 -- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 msgr2=0x7f273c152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 0x7f273c152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 -- 172.21.15.37:0/450186316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380094d0 con 0x7f273c0b4140 2023-07-09T22:01:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741747640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:34.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2742749640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 0x7f273c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f2741f48640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f27380ad040 tx=0x7f27380192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27327fc640 1 -- 172.21.15.37:0/450186316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380bc070 con 0x7f273c0b4140 2023-07-09T22:01:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27327fc640 1 -- 172.21.15.37:0/450186316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27380b4420 con 0x7f273c0b4140 2023-07-09T22:01:34.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27327fc640 1 -- 172.21.15.37:0/450186316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380b47d0 con 0x7f273c0b4140 2023-07-09T22:01:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c153580 con 0x7f273c0b4140 2023-07-09T22:01:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c156b90 con 0x7f273c0b4140 2023-07-09T22:01:34.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.169+0000 7f27327fc640 1 -- 172.21.15.37:0/450186316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f27380b4930 con 0x7f273c0b4140 2023-07-09T22:01:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f27327fc640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 0x7f2720068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f27327fc640 1 -- 172.21.15.37:0/450186316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f273811d990 con 0x7f273c0b4140 2023-07-09T22:01:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 Processor -- start 2023-07-09T22:01:34.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 0x7f2720068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- start start 2023-07-09T22:01:34.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 0x7f2720068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f273c15e800 tx=0x7f272c008040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a4967bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a491e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a47e4f80 con 0x5592a4968110 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a471ec60 con 0x5592a4967800 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592a4772700 con 0x5592a491df90 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51520/0 (socket says 172.21.15.37:51520) 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 -- 172.21.15.37:0/2507613577 learned_addr learned my addr 172.21.15.37:0/2507613577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2742749640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a491e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741f48640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a4967bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 -- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 msgr2=0x5592a491e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a491e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 -- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 msgr2=0x5592a4967bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a4967bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 -- 172.21.15.37:0/2507613577 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592a4467890 con 0x5592a4968110 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2742749640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a491e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741f48640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a4967bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2741747640 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f272c006d50 tx=0x7f272c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e7b71495aa9b971 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f271f7fe640 1 -- 172.21.15.37:0/2507613577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c004030 con 0x5592a4968110 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f271f7fe640 1 -- 172.21.15.37:0/2507613577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c01a070 con 0x5592a4968110 2023-07-09T22:01:34.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f271f7fe640 1 -- 172.21.15.37:0/2507613577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c004390 con 0x5592a4968110 2023-07-09T22:01:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- 172.21.15.37:0/2507613577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 msgr2=0x5592a491da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f272c006d50 tx=0x7f272c013000 comp rx=0 tx=0).stop 2023-07-09T22:01:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- 172.21.15.37:0/2507613577 shutdown_connections 2023-07-09T22:01:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a491e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4968110 0x5592a491da50 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 --2- 172.21.15.37:0/2507613577 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a4967bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- 172.21.15.37:0/2507613577 >> 172.21.15.37:0/2507613577 conn(0x5592a47e0a70 msgr2=0x5592a491c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- 172.21.15.37:0/2507613577 shutdown_connections 2023-07-09T22:01:34.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.173+0000 7f2747527000 1 -- 172.21.15.37:0/2507613577 wait complete. 2023-07-09T22:01:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- start start 2023-07-09T22:01:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 Processor -- start 2023-07-09T22:01:34.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a4928fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4929a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a476b7a0 con 0x5592a4967800 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a4727f00 con 0x5592a4968110 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592a4727ba0 con 0x5592a491df90 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 10 client.0 _ll_register_callbacks cb 0x5592a4909930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T22:01:34.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51532/0 (socket says 172.21.15.37:51532) 2023-07-09T22:01:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 -- 172.21.15.37:0/1074788752 learned_addr learned my addr 172.21.15.37:0/1074788752 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741f48640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a4928fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2742749640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4929a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 -- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 msgr2=0x5592a4928fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a4928fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 -- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 msgr2=0x5592a4929a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4929a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 -- 172.21.15.37:0/1074788752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c00e050 con 0x5592a4967800 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2742749640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4929a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2741747640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f272c008010 tx=0x7f272c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ecb84270b7af2c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c004520 con 0x5592a4967800 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592a476a0f0 con 0x5592a4967800 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f272c003830 con 0x5592a4967800 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272c003a30 con 0x5592a4967800 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 10 client.10938 fetch_fsmap learned FSMap version 84 2023-07-09T22:01:34.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5592a4730130 con 0x5592a4967800 2023-07-09T22:01:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5592a476a0f0 con 0x5592a4967800 2023-07-09T22:01:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 84) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f272c003b90 con 0x5592a4967800 2023-07-09T22:01:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 10 client.10938 fetch_fsmap finished waiting for FSMap version 84 2023-07-09T22:01:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 10 client.10938 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T22:01:34.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 20 client.10938 populate_metadata read hostname 'smithi037' 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a492a320 0x5592a4978d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 4 client.10938 mds_command: new command op to 10761 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.177+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 --> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592a4732e40 con 0x5592a492a320 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2741f48640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a492a320 0x5592a4978d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2741f48640 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a492a320 0x5592a4978d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f47effdda9a81b74 server_cookie=ff503ae8db5a1a60 in_seq=0 out_seq=0 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f271cff9640 10 client.10938 ms_handle_connect on v2:172.21.15.37:6834/3019715389 2023-07-09T22:01:34.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f271cff9640 1 -- 172.21.15.37:0/1074788752 <== mds.0 v2:172.21.15.37:6834/3019715389 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5592a4732e40 con 0x5592a492a320 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f271cff9640 10 client.10938 handle_command_reply: tid=0 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 client.10938 shutdown 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 msgr2=0x5592a4929510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 secure :-1 s=READY pgs=2017 cs=0 l=1 rev1=1 crypto rx=0x7f272c008010 tx=0x7f272c0046d0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 shutdown_connections 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a492a320 0x5592a4978d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4929a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a4967800 0x5592a4929510 unknown :-1 s=CLOSED pgs=2017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f271cff9640 0 client.10938 ms_handle_reset on v2:172.21.15.37:6834/3019715389 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 --2- 172.21.15.37:0/1074788752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a491df90 0x5592a4928fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 >> 172.21.15.37:0/1074788752 conn(0x5592a47e0a70 msgr2=0x5592a491ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 shutdown_connections 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 1 -- 172.21.15.37:0/1074788752 wait complete. 2023-07-09T22:01:34.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.181+0000 7f2747527000 20 client.10938 trim_cache size 0 max 16384 2023-07-09T22:01:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 Processor -- start 2023-07-09T22:01:34.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 -- start start 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a497a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4968110 0x5592a49628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a4428940 con 0x5592a491df90 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a49157a0 con 0x5592a4967800 2023-07-09T22:01:34.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592a473a230 con 0x5592a4968110 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51546/0 (socket says 172.21.15.37:51546) 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 -- 172.21.15.37:0/457853197 learned_addr learned my addr 172.21.15.37:0/457853197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741747640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a497a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2742749640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4968110 0x5592a49628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 -- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4968110 msgr2=0x5592a49628b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4968110 0x5592a49628b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 -- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 msgr2=0x5592a497a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a497a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 -- 172.21.15.37:0/457853197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592a47163c0 con 0x5592a491df90 2023-07-09T22:01:34.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741747640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a497a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f2741f48640 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f273801a170 tx=0x7f27380f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0ab06ec96237aa server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f271ffff640 1 -- 172.21.15.37:0/457853197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273811bc70 con 0x5592a491df90 2023-07-09T22:01:34.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f271ffff640 1 -- 172.21.15.37:0/457853197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738106030 con 0x5592a491df90 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.197+0000 7f271ffff640 1 -- 172.21.15.37:0/457853197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380b4be0 con 0x5592a491df90 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/457853197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 msgr2=0x5592a497a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7f273801a170 tx=0x7f27380f1040 comp rx=0 tx=0).stop 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/457853197 shutdown_connections 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4968110 0x5592a49628b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4967800 0x5592a497a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- 172.21.15.37:0/457853197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a497a470 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/457853197 >> 172.21.15.37:0/457853197 conn(0x5592a47e0a70 msgr2=0x5592a4978d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/457853197 shutdown_connections 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/457853197 wait complete. 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- start start 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 Processor -- start 2023-07-09T22:01:34.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 0x5592a49c5740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4965510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a4708ea0 con 0x5592a491df90 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592a4922490 con 0x5592a4968110 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x5592a4765aa0 con 0x5592a4967800 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 10 client.0 _ll_register_callbacks cb 0x5592a48ea4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51552/0 (socket says 172.21.15.37:51552) 2023-07-09T22:01:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 -- 172.21.15.37:0/3514922048 learned_addr learned my addr 172.21.15.37:0/3514922048 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741747640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 0x5592a49c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 -- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 msgr2=0x5592a49c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 0x5592a49c5740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 -- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 msgr2=0x5592a4965510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2742749640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4965510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4965510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 -- 172.21.15.37:0/3514922048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c156b90 con 0x5592a491df90 2023-07-09T22:01:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741747640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 0x5592a49c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2742749640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4965510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2741f48640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f27381061a0 tx=0x7f27380f4040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853cfe89b9e44475 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f271cff9640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-07-09T22:01:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380b4de0 con 0x5592a491df90 2023-07-09T22:01:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f27380edd50 con 0x5592a491df90 2023-07-09T22:01:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592a4921920 con 0x5592a491df90 2023-07-09T22:01:34.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f273811be80 con 0x5592a491df90 2023-07-09T22:01:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 10 client.10944 fetch_fsmap learned FSMap version 84 2023-07-09T22:01:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) v3 -- 0x5592a4467cc0 con 0x5592a491df90 2023-07-09T22:01:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.201+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5592a4921920 con 0x5592a491df90 2023-07-09T22:01:34.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 84) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2738108070 con 0x5592a491df90 2023-07-09T22:01:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 10 client.10944 fetch_fsmap finished waiting for FSMap version 84 2023-07-09T22:01:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 10 client.10944 resolve_mds: resolved name 'a' to daemon mds.a 2023-07-09T22:01:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 20 client.10944 populate_metadata read hostname 'smithi037' 2023-07-09T22:01:34.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a4965ed0 0x5592a49662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 4 client.10944 mds_command: new command op to 10761 tid=0[{"prefix": "status"}] 2023-07-09T22:01:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 --> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5592a47246f0 con 0x5592a4965ed0 2023-07-09T22:01:34.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2741747640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a4965ed0 0x5592a49662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2741747640 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a4965ed0 0x5592a49662a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efc6d38e0dd87fa server_cookie=64023bd48d44b7c1 in_seq=0 out_seq=0 2023-07-09T22:01:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f271cff9640 10 client.10944 ms_handle_connect on v2:172.21.15.37:6834/3019715389 2023-07-09T22:01:34.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f271cff9640 1 -- 172.21.15.37:0/3514922048 <== mds.0 v2:172.21.15.37:6834/3019715389 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x5592a47246f0 con 0x5592a4965ed0 2023-07-09T22:01:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f271cff9640 10 client.10944 handle_command_reply: tid=0 2023-07-09T22:01:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 client.10944 shutdown 2023-07-09T22:01:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 msgr2=0x5592a49c5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7f27381061a0 tx=0x7f27380f4040 comp rx=0 tx=0).stop 2023-07-09T22:01:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 shutdown_connections 2023-07-09T22:01:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:6834/3019715389,v1:172.21.15.37:6835/3019715389] conn(0x5592a4965ed0 0x5592a49662a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x5592a4968110 0x5592a4965510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x5592a4967800 0x5592a49c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 --2- 172.21.15.37:0/3514922048 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5592a491df90 0x5592a49c5200 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 >> 172.21.15.37:0/3514922048 conn(0x5592a47e0a70 msgr2=0x5592a49795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f271cff9640 0 client.10944 ms_handle_reset on v2:172.21.15.37:6834/3019715389 2023-07-09T22:01:34.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 shutdown_connections 2023-07-09T22:01:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 1 -- 172.21.15.37:0/3514922048 wait complete. 2023-07-09T22:01:34.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f2747527000 20 client.10944 trim_cache size 0 max 16384 2023-07-09T22:01:34.225 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:01:34.225 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "43b31e6b-703a-46c6-8fb1-0669649379d3", 2023-07-09T22:01:34.225 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 10761, 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 10.489639691000001, 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 84, 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 196, 2023-07-09T22:01:34.226 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 196, 2023-07-09T22:01:34.227 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 16.416392791 2023-07-09T22:01:34.227 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:01:34.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 msgr2=0x7f2720068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 0x7f2720068850 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f273c15e800 tx=0x7f272c008040 comp rx=0 tx=0).stop 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 msgr2=0x7f273c0c8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f27380ad040 tx=0x7f27380192e0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 shutdown_connections 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f27200663a0 0x7f2720068850 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f273c0b7a60 0x7f273c152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f273c0b47a0 0x7f273c152450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 --2- 172.21.15.37:0/450186316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f273c0b4140 0x7f273c0c8100 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 >> 172.21.15.37:0/450186316 conn(0x7f273c073050 msgr2=0x7f273c0b4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 shutdown_connections 2023-07-09T22:01:34.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.205+0000 7f27441ac640 1 -- 172.21.15.37:0/450186316 wait complete. 2023-07-09T22:01:34.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T22:01:34.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 Processor -- start 2023-07-09T22:01:34.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 -- start start 2023-07-09T22:01:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14e00b4340 0x7f14e006aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00cef80 0x7f14e00d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14e00b49f0 con 0x7f14e00b7ab0 2023-07-09T22:01:34.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14e00b7e80 con 0x7f14e00b4340 2023-07-09T22:01:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e63fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00cc8a0 con 0x7f14e00cef80 2023-07-09T22:01:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14e00b4340 0x7f14e006aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f14e00b4340 0x7f14e006aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51558/0 (socket says 172.21.15.37:51558) 2023-07-09T22:01:34.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 -- 172.21.15.37:0/637371722 learned_addr learned my addr 172.21.15.37:0/637371722 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14e4997640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00cef80 0x7f14e00d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 -- 172.21.15.37:0/637371722 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00cef80 msgr2=0x7f14e00d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00cef80 0x7f14e00d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 -- 172.21.15.37:0/637371722 >> v1:172.21.15.119:6789/0 conn(0x7f14e00b7ab0 legacy=0x7f14e00b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.369+0000 7f14df7fe640 1 -- 172.21.15.37:0/637371722 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e00ccb80 con 0x7f14e00b4340 2023-07-09T22:01:34.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14df7fe640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00b4340 0x7f14e006aa50 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009870 tx=0x7f14d401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f1a609edd22475 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14deffd640 1 -- 172.21.15.37:0/637371722 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40aa670 con 0x7f14e00b4340 2023-07-09T22:01:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14deffd640 1 -- 172.21.15.37:0/637371722 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d40aa7d0 con 0x7f14e00b4340 2023-07-09T22:01:34.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14deffd640 1 -- 172.21.15.37:0/637371722 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d40aab60 con 0x7f14e00b4340 2023-07-09T22:01:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 -- 172.21.15.37:0/637371722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00b4340 msgr2=0x7f14e006aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00b4340 0x7f14e006aa50 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f14d4009870 tx=0x7f14d401c510 comp rx=0 tx=0).stop 2023-07-09T22:01:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 -- 172.21.15.37:0/637371722 shutdown_connections 2023-07-09T22:01:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00cef80 0x7f14e00d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 --2- 172.21.15.37:0/637371722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00b4340 0x7f14e006aa50 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 -- 172.21.15.37:0/637371722 >> 172.21.15.37:0/637371722 conn(0x7f14e0073090 msgr2=0x7f14e0069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 -- 172.21.15.37:0/637371722 shutdown_connections 2023-07-09T22:01:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.373+0000 7f14e63fa640 1 -- 172.21.15.37:0/637371722 wait complete. 2023-07-09T22:01:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 Processor -- start 2023-07-09T22:01:34.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- start start 2023-07-09T22:01:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e00b4340 0x7f14e01536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 0x7f14e0141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c7380 con 0x7f14e00cef80 2023-07-09T22:01:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c75f0 con 0x7f14e00b4340 2023-07-09T22:01:34.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14e00c78d0 con 0x7f14e00b7ab0 2023-07-09T22:01:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51566/0 (socket says 172.21.15.37:51566) 2023-07-09T22:01:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 -- 172.21.15.37:0/1774210651 learned_addr learned my addr 172.21.15.37:0/1774210651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:34.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14df7fe640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 0x7f14e0141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14dffff640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e00b4340 0x7f14e01536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 -- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 msgr2=0x7f14e0141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 0x7f14e0141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 -- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e00b4340 msgr2=0x7f14e01536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e00b4340 0x7f14e01536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 -- 172.21.15.37:0/1774210651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d40094d0 con 0x7f14e00cef80 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14df7fe640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 0x7f14e0141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:34.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e4997640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009fd0 tx=0x7f14d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014420 con 0x7f14e00cef80 2023-07-09T22:01:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14d8014580 con 0x7f14e00cef80 2023-07-09T22:01:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14d8014930 con 0x7f14e00cef80 2023-07-09T22:01:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e00c7bb0 con 0x7f14e00cef80 2023-07-09T22:01:34.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e0153be0 con 0x7f14e00cef80 2023-07-09T22:01:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.377+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e00c7dd0 con 0x7f14e00cef80 2023-07-09T22:01:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.381+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f14d8014a90 con 0x7f14e00cef80 2023-07-09T22:01:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.381+0000 7f14dcff9640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 0x7f14cc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:34.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.381+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f14d8084860 con 0x7f14e00cef80 2023-07-09T22:01:34.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.381+0000 7f14dffff640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 0x7f14cc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:34.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.381+0000 7f14dffff640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 0x7f14cc068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14d0000f70 tx=0x7f14d0009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:34.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.385+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f14d8055580 con 0x7f14e00cef80 2023-07-09T22:01:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14e004d7d0 con 0x7f14e00cef80 2023-07-09T22:01:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14dcff9640 1 -- 172.21.15.37:0/1774210651 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14d8055110 con 0x7f14e00cef80 2023-07-09T22:01:34.579 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T22:01:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 msgr2=0x7f14cc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 0x7f14cc068850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14d0000f70 tx=0x7f14d0009040 comp rx=0 tx=0).stop 2023-07-09T22:01:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 msgr2=0x7f14e00ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f14d8009fd0 tx=0x7f14d800e4b0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 shutdown_connections 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14cc0663a0 0x7f14cc068850 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14e00cef80 0x7f14e00ca200 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14e00b7ab0 0x7f14e0141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 --2- 172.21.15.37:0/1774210651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f14e00b4340 0x7f14e01536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.573+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 >> 172.21.15.37:0/1774210651 conn(0x7f14e0073090 msgr2=0x7f14e015ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.577+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 shutdown_connections 2023-07-09T22:01:34.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:34.577+0000 7f14e63fa640 1 -- 172.21.15.37:0/1774210651 wait complete. 2023-07-09T22:01:34.600 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T22:01:34.600 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T22:01:34.601 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T22:01:34.601 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T22:01:34.601 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:34.601 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T22:01:34.602 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T22:01:34.602 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T22:01:34.602 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:34.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.603 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T22:01:34.612 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.613 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T22:01:34.614 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 40109sec preferred_lft 40109sec 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T22:01:34.615 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.616 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T22:01:34.616 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T22:01:34.616 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.617 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T22:01:34.618 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T22:01:34.619 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:34.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.620 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T22:01:34.684 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T22:01:34.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.687 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T22:01:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T22:01:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T22:01:34.741 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T22:01:34.742 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T22:01:34.742 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T22:01:34.742 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T22:01:34.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.743 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T22:01:34.743 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T22:01:34.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T22:01:34.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T22:01:34.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T22:01:34.744 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T22:01:34.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.839 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T22:01:34.849 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T22:01:34.849 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T22:01:34.849 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:34.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:34.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T22:01:34.914 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T22:01:34.914 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T22:01:34.914 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:34.965 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:34.965 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T22:01:34.966 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:35.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T22:01:35.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T22:01:35.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T22:01:35.144 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T22:01:35.145 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T22:01:35.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:35.146 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T22:01:35.201 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T22:01:35.201 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T22:01:35.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T22:01:35.274 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T22:01:35.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T22:01:35.336 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T22:01:35.338 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T22:01:35.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:35.340 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T22:01:35.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T22:01:35.345+0000 7f3b3fc3a580 -1 init, newargv = 0x55946b6c28c0 newargc=15 2023-07-09T22:01:35.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67224]: starting ceph client 2023-07-09T22:01:35.358 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67224]: starting fuse 2023-07-09T22:01:35.361 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T22:01:35.362 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T22:01:35.362 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T22:01:35.363 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T22:01:35.363 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T22:01:35.363 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T22:01:35.364 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T22:01:35.364 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:35.364 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T22:01:35.364 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T22:01:35.365 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T22:01:35.365 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T22:01:35.365 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:35.366 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T22:01:35.366 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T22:01:35.366 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T22:01:35.367 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T22:01:35.367 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:35.367 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T22:01:35.368 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T22:01:35.368 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T22:01:35.368 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T22:01:35.368 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T22:01:35.369 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T22:01:35.369 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T22:01:35.370 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T22:01:35.370 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:35.371 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T22:01:35.371 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T22:01:35.487 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.67224.asok 2023-07-09T22:01:35.670 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.67224.asok 2023-07-09T22:01:35.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:35.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.67224.asok status 2023-07-09T22:01:35.847 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:01:35.847 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T22:01:35.848 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T22:01:35.848 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T22:01:35.848 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T22:01:35.849 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T22:01:35.849 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T22:01:35.849 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "67224", 2023-07-09T22:01:35.849 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T22:01:35.850 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:35.850 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T22:01:35.850 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T22:01:35.850 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 10956, 2023-07-09T22:01:35.850 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T22:01:35.851 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T22:01:35.851 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T22:01:35.851 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 10956 2023-07-09T22:01:35.851 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:35.852 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T22:01:35.852 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T22:01:35.852 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T22:01:35.852 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2744807359 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2744807359 2023-07-09T22:01:35.853 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.10956 192.168.0.1:0/2744807359", 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2744807359", 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 84, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 196, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T22:01:35.854 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T22:01:35.855 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:01:35.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:35.862 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T22:01:35.862 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:35.872 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T22:01:35.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:35.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:35.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:35.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:01:35.921 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:01:35.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-07-09T22:01:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 Processor -- start 2023-07-09T22:01:36.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 -- start start 2023-07-09T22:01:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f14340b47a0 0x7f14340b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f14340d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14340cef80 con 0x7f14340b7a60 2023-07-09T22:01:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14340ccee0 con 0x7f14340b47a0 2023-07-09T22:01:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1439de9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b45b0 con 0x7f14340b4140 2023-07-09T22:01:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14337fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14340b7a60 0x7f14340cc7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60446/0 (socket says 172.21.15.37:60446) 2023-07-09T22:01:36.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14337fe640 1 -- 172.21.15.37:0/512754556 learned_addr learned my addr 172.21.15.37:0/512754556 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039148942 0 0) 0x7f14340cef80 con 0x7f14340b7a60 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1432ffd640 1 --2- 172.21.15.37:0/512754556 >> v2:172.21.15.119:3300/0 conn(0x7f14340b47a0 0x7f14340b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f141c003530 con 0x7f14340b7a60 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f1433fff640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f14340d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2258014889 0 0) 0x7f141c003530 con 0x7f14340b7a60 2023-07-09T22:01:36.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 msgr2=0x7f14340d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f14340d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 >> v2:172.21.15.119:3300/0 conn(0x7f14340b47a0 msgr2=0x7f14340b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 --2- 172.21.15.37:0/512754556 >> v2:172.21.15.119:3300/0 conn(0x7f14340b47a0 0x7f14340b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340cf260 con 0x7f14340b7a60 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.165+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f1424001680 con 0x7f14340b7a60 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 >> v1:172.21.15.37:6789/0 conn(0x7f14340b7a60 legacy=0x7f14340cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c0039b0 0x7f141c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f141c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c004d10 0x7f141c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14340b45b0 con 0x7f141c0039b0 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00b990 con 0x7f141c004d10 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141c00bad0 con 0x7f14340b4140 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c0039b0 0x7f141c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f1433fff640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c004d10 0x7f141c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f1432ffd640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f141c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 -- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 msgr2=0x7f141c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340b4140 0x7f141c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 -- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c004d10 msgr2=0x7f141c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c004d10 0x7f141c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 -- 172.21.15.37:0/512754556 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f141c003530 con 0x7f141c0039b0 2023-07-09T22:01:36.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f1433fff640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c004d10 0x7f141c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:36.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14337fe640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c0039b0 0x7f141c003dc0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f142400c240 tx=0x7f142401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ad95444390f234 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1424005ae0 con 0x7f141c0039b0 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1424005c40 con 0x7f141c0039b0 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.169+0000 7f14327fc640 1 -- 172.21.15.37:0/512754556 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14240a5810 con 0x7f141c0039b0 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- 172.21.15.37:0/512754556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c0039b0 msgr2=0x7f141c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 --2- 172.21.15.37:0/512754556 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f141c0039b0 0x7f141c003dc0 secure :-1 s=READY pgs=2026 cs=0 l=1 rev1=1 crypto rx=0x7f142400c240 tx=0x7f142401cbe0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1433fff640 1 -- 172.21.15.37:0/512754556 reap_dead start 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- 172.21.15.37:0/512754556 shutdown_connections 2023-07-09T22:01:36.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- 172.21.15.37:0/512754556 >> 172.21.15.37:0/512754556 conn(0x7f1434073050 msgr2=0x7f1434069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:36.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- 172.21.15.37:0/512754556 shutdown_connections 2023-07-09T22:01:36.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- 172.21.15.37:0/512754556 wait complete. 2023-07-09T22:01:36.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 Processor -- start 2023-07-09T22:01:36.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- start start 2023-07-09T22:01:36.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c0039b0 0x7f14341565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340cbc50 0x7f14341534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143415dec0 con 0x7f14340cb210 2023-07-09T22:01:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1434153d30 con 0x7f141c0039b0 2023-07-09T22:01:36.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1439de9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14340ca450 con 0x7f14340cbc50 2023-07-09T22:01:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1432ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1432ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51588/0 (socket says 172.21.15.37:51588) 2023-07-09T22:01:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1432ffd640 1 -- 172.21.15.37:0/4208465107 learned_addr learned my addr 172.21.15.37:0/4208465107 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f1433fff640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340cbc50 0x7f14341534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.173+0000 7f14337fe640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c0039b0 0x7f14341565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 -- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340cbc50 msgr2=0x7f14341534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340cbc50 0x7f14341534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 -- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c0039b0 msgr2=0x7f14341565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c0039b0 0x7f14341565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 -- 172.21.15.37:0/4208465107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14340ca730 con 0x7f14340cb210 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1432ffd640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f1428011660 tx=0x7f1428011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800f9c0 con 0x7f14340cb210 2023-07-09T22:01:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142800fb20 con 0x7f14340cb210 2023-07-09T22:01:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142800fe90 con 0x7f14340cb210 2023-07-09T22:01:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14340caa10 con 0x7f14340cb210 2023-07-09T22:01:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14340ca0b0 con 0x7f14340cb210 2023-07-09T22:01:36.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14340cdaa0 con 0x7f14340cb210 2023-07-09T22:01:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.177+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1428015460 con 0x7f14340cb210 2023-07-09T22:01:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.181+0000 7f141bfff640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 0x7f1420068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.181+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1428084180 con 0x7f14340cb210 2023-07-09T22:01:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.181+0000 7f14337fe640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 0x7f1420068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.181+0000 7f14337fe640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 0x7f1420068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14240ab000 tx=0x7f14240a7070 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.185+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1428051550 con 0x7f14340cb210 2023-07-09T22:01:36.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.361+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f14340d00d0 con 0x7f14200663d0 2023-07-09T22:01:36.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.361+0000 7f141bfff640 1 -- 172.21.15.37:0/4208465107 <== mgr.9937 v2:172.21.15.119:6832/350512922 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f1424001440 con 0x7f14200663d0 2023-07-09T22:01:36.368 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-07-09T22:01:36.369 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-07-09T22:01:36.369 INFO:teuthology.orchestra.run.smithi037.stdout: "name": "cephfs" 2023-07-09T22:01:36.369 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:36.370 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-07-09T22:01:36.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 msgr2=0x7f1420068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 0x7f1420068880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f14240ab000 tx=0x7f14240a7070 comp rx=0 tx=0).stop 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 msgr2=0x7f1434152f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7f1428011660 tx=0x7f1428011b20 comp rx=0 tx=0).stop 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 shutdown_connections 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f14200663d0 0x7f1420068880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f14340cbc50 0x7f14341534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14340cb210 0x7f1434152f70 unknown :-1 s=CLOSED pgs=2027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 --2- 172.21.15.37:0/4208465107 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f141c0039b0 0x7f14341565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 >> 172.21.15.37:0/4208465107 conn(0x7f1434073050 msgr2=0x7f14340b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 shutdown_connections 2023-07-09T22:01:36.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.365+0000 7f1439de9640 1 -- 172.21.15.37:0/4208465107 wait complete. 2023-07-09T22:01:36.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2023-07-09T22:01:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.529+0000 7fa4766d8640 1 Processor -- start 2023-07-09T22:01:36.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.529+0000 7fa4766d8640 1 -- start start 2023-07-09T22:01:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa4766d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa4700d0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa4766d8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa47015bf80 con 0x7fa4700b7980 2023-07-09T22:01:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa4766d8640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4700d02f0 con 0x7fa4700cf290 2023-07-09T22:01:36.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa4766d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700cd070 con 0x7fa470160030 2023-07-09T22:01:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa4700b7980 0x7fa4700ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60456/0 (socket says 172.21.15.37:60456) 2023-07-09T22:01:36.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46ffff640 1 -- 172.21.15.37:0/4091543533 learned_addr learned my addr 172.21.15.37:0/4091543533 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:36.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa474c75640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa4700d0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877674003 0 0) 0x7fa460001120 con 0x7fa4700b7980 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa458003530 con 0x7fa4700b7980 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185178645 0 0) 0x7fa4700d02f0 con 0x7fa4700cf290 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa460001120 con 0x7fa4700cf290 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2038937504 0 0) 0x7fa458003530 con 0x7fa4700b7980 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 msgr2=0x7fa4700d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa4700d0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 >> v1:172.21.15.119:6789/0 conn(0x7fa4700cf290 legacy=0x7fa4700d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700cc7f0 con 0x7fa4700b7980 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fa460001790 con 0x7fa4700b7980 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 >> v1:172.21.15.37:6789/0 conn(0x7fa4700b7980 legacy=0x7fa4700ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa458003b40 0x7fa458003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4580047d0 0x7fa458004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa458005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700cd070 con 0x7fa4580047d0 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800ba40 con 0x7fa458003b40 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45800bc00 con 0x7fa470160030 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4580047d0 0x7fa458004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa474c75640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa458005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46ffff640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa458003b40 0x7fa458003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 -- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 msgr2=0x7fa458005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa458005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 -- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa458003b40 msgr2=0x7fa458003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:36.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa458003b40 0x7fa458003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa46f7fe640 1 -- 172.21.15.37:0/4091543533 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458003530 con 0x7fa4580047d0 2023-07-09T22:01:36.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.533+0000 7fa474c75640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa470160030 0x7fa458005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:36.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4580047d0 0x7fa458004c40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fa464007fd0 tx=0x7fa46401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e722dc95a6f802f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640052d0 con 0x7fa4580047d0 2023-07-09T22:01:36.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa464005450 con 0x7fa4580047d0 2023-07-09T22:01:36.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa46effd640 1 -- 172.21.15.37:0/4091543533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4640a88b0 con 0x7fa4580047d0 2023-07-09T22:01:36.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- 172.21.15.37:0/4091543533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4580047d0 msgr2=0x7fa458004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 --2- 172.21.15.37:0/4091543533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4580047d0 0x7fa458004c40 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7fa464007fd0 tx=0x7fa46401ec50 comp rx=0 tx=0).stop 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa474c75640 1 -- 172.21.15.37:0/4091543533 reap_dead start 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- 172.21.15.37:0/4091543533 shutdown_connections 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- 172.21.15.37:0/4091543533 >> 172.21.15.37:0/4091543533 conn(0x7fa470073090 msgr2=0x7fa470069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- 172.21.15.37:0/4091543533 shutdown_connections 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- 172.21.15.37:0/4091543533 wait complete. 2023-07-09T22:01:36.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 Processor -- start 2023-07-09T22:01:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.537+0000 7fa4766d8640 1 -- start start 2023-07-09T22:01:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 0x7fa4701e6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4700b2810 0x7fa47015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701e62e0 con 0x7fa4700b2c80 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4701e6000 con 0x7fa4700b2810 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4700b1d30 con 0x7fa4580047d0 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51606/0 (socket says 172.21.15.37:51606) 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 -- 172.21.15.37:0/2610934293 learned_addr learned my addr 172.21.15.37:0/2610934293 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46f7fe640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4700b2810 0x7fa47015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46ffff640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 0x7fa4701e6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 -- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 msgr2=0x7fa4701e6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 0x7fa4701e6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 -- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4700b2810 msgr2=0x7fa47015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4700b2810 0x7fa47015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 -- 172.21.15.37:0/2610934293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4700b2010 con 0x7fa4700b2c80 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46ffff640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 0x7fa4701e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:36.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa474c75640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fa47008ad30 tx=0x7fa468009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800e050 con 0x7fa4700b2c80 2023-07-09T22:01:36.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800f040 con 0x7fa4700b2c80 2023-07-09T22:01:36.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468003be0 con 0x7fa4700b2c80 2023-07-09T22:01:36.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4700b22f0 con 0x7fa4700b2c80 2023-07-09T22:01:36.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4700b39c0 con 0x7fa4700b2c80 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4700b24e0 con 0x7fa4700b2c80 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.541+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 90) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa468015650 con 0x7fa4700b2c80 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.545+0000 7fa46cff9640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 0x7fa45c068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.545+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fa468083d80 con 0x7fa4700b2c80 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.545+0000 7fa46ffff640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 0x7fa45c068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:36.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.545+0000 7fa46ffff640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 0x7fa45c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa460001060 tx=0x7fa460009040 comp rx=0 tx=0).ready entity=mgr.9937 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:36.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.549+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa468050f90 con 0x7fa4700b2c80 2023-07-09T22:01:36.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:36.745+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7fa47004d7d0 con 0x7fa4700b2c80 2023-07-09T22:01:37.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.577+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fa468051360 con 0x7fa4700b2c80 2023-07-09T22:01:37.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.577+0000 7fa46cff9640 1 -- 172.21.15.37:0/2610934293 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v91) v1 ==== 92+0+0 (secure 0 0 0) 0x7fa4680810a0 con 0x7fa4700b2c80 2023-07-09T22:01:37.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 msgr2=0x7fa45c068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 0x7fa45c068880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa460001060 tx=0x7fa460009040 comp rx=0 tx=0).stop 2023-07-09T22:01:37.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 msgr2=0x7fa47015e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7fa47008ad30 tx=0x7fa468009f90 comp rx=0 tx=0).stop 2023-07-09T22:01:37.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 shutdown_connections 2023-07-09T22:01:37.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fa45c0663d0 0x7fa45c068880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4700b2c80 0x7fa47015e430 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa4700b2810 0x7fa47015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 --2- 172.21.15.37:0/2610934293 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa4580047d0 0x7fa4701e6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 >> 172.21.15.37:0/2610934293 conn(0x7fa470073090 msgr2=0x7fa4700ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:37.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 shutdown_connections 2023-07-09T22:01:37.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.581+0000 7fa4766d8640 1 -- 172.21.15.37:0/2610934293 wait complete. 2023-07-09T22:01:37.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2023-07-09T22:01:37.759 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:37.759+0000 7ff93ac4a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 Processor -- start 2023-07-09T22:01:37.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 -- start start 2023-07-09T22:01:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 0x7fb68c0cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c0d0360 0x7fb68c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0b7930 con 0x7fb68c0d0360 2023-07-09T22:01:37.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb68c0d07e0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.757+0000 7fb691540640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c0b3bb0 con 0x7fb68c15f130 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c0d0360 0x7fb68c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68a7fc640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 0x7fb68c0cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb68c0d0360 0x7fb68c0b50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60496/0 (socket says 172.21.15.37:60496) 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 -- 172.21.15.37:0/2585002329 learned_addr learned my addr 172.21.15.37:0/2585002329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:37.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68affd640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 -- 172.21.15.37:0/2585002329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 msgr2=0x7fb68c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 -- 172.21.15.37:0/2585002329 >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 msgr2=0x7fb68c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 --2- 172.21.15.37:0/2585002329 >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 0x7fb68c0cfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 -- 172.21.15.37:0/2585002329 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb68c0cccb0 con 0x7fb68c0d0360 2023-07-09T22:01:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68a7fc640 1 --2- 172.21.15.37:0/2585002329 >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 0x7fb68c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:37.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68affd640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:37.768 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fdbc6f70180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb68b7fe640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d0360 0x7fb68c0b50a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0716f0 tx=0x7fb68401c660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6cdd7b22d0a32c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.761+0000 7fb689ffb640 1 -- 172.21.15.37:0/2585002329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a64f0 con 0x7fb68c0d0360 2023-07-09T22:01:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb689ffb640 1 -- 172.21.15.37:0/2585002329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6840a6650 con 0x7fb68c0d0360 2023-07-09T22:01:37.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb689ffb640 1 -- 172.21.15.37:0/2585002329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6840a69e0 con 0x7fb68c0d0360 2023-07-09T22:01:37.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- 172.21.15.37:0/2585002329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d0360 msgr2=0x7fb68c0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d0360 0x7fb68c0b50a0 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7fb68c0716f0 tx=0x7fb68401c660 comp rx=0 tx=0).stop 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- 172.21.15.37:0/2585002329 shutdown_connections 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0d0360 0x7fb68c0b50a0 unknown :-1 s=CLOSED pgs=2035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- 172.21.15.37:0/2585002329 >> v2:172.21.15.119:3300/0 conn(0x7fb68c0b74e0 0x7fb68c0cfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- 172.21.15.37:0/2585002329 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- 172.21.15.37:0/2585002329 >> 172.21.15.37:0/2585002329 conn(0x7fb68c072d20 msgr2=0x7fb68c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:37.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- 172.21.15.37:0/2585002329 shutdown_connections 2023-07-09T22:01:37.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- 172.21.15.37:0/2585002329 wait complete. 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 Processor -- start 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- start start 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 0x7fb68c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c1571b0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c156300 con 0x7fb68c0d0360 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.765+0000 7fb691540640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c1565a0 con 0x7fb68c15f130 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68a7fc640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 0x7fb68c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60498/0 (socket says 172.21.15.37:60498) 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 -- 172.21.15.37:0/3032548251 learned_addr learned my addr 172.21.15.37:0/3032548251 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:37.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68b7fe640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:37.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 -- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 msgr2=0x7fb68c151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 -- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 msgr2=0x7fb68c155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 0x7fb68c155dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 -- 172.21.15.37:0/3032548251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb680009420 con 0x7fb68c0b74e0 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68a7fc640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 0x7fb68c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68b7fe640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:37.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb68affd640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00ebe0 tx=0x7fb67c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c00eee0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c00cc30 con 0x7fb68c0b74e0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c009420 con 0x7fb68c0b74e0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c013470 con 0x7fb68c0b74e0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb684009b30 con 0x7fb68c0b74e0 2023-07-09T22:01:37.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c0668f0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.769+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fb67c0135d0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.773+0000 7fb6737fe640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 0x7fb6780688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.773+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fb67c084690 con 0x7fb68c0b74e0 2023-07-09T22:01:37.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.773+0000 7fb68a7fc640 1 -- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 msgr2=0x7fb6780688a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:37.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.773+0000 7fb68a7fc640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 0x7fb6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:37.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.777+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb67c051940 con 0x7fb68c0b74e0 2023-07-09T22:01:37.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.933+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7fb68c0d26b0 con 0x7fb68c0b74e0 2023-07-09T22:01:37.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb6737fe640 1 -- 172.21.15.37:0/3032548251 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v65)=0 v65) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb67c054f60 con 0x7fb68c0b74e0 2023-07-09T22:01:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 msgr2=0x7fb6780688a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:37.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 0x7fb6780688a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 msgr2=0x7fb68c157640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00ebe0 tx=0x7fb67c00c520 comp rx=0 tx=0).stop 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 shutdown_connections 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fb6780663f0 0x7fb6780688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb68c15f130 0x7fb68c151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb68c0d0360 0x7fb68c155dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 --2- 172.21.15.37:0/3032548251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c0b74e0 0x7fb68c157640 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 >> 172.21.15.37:0/3032548251 conn(0x7fb68c072d20 msgr2=0x7fb68c0cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 shutdown_connections 2023-07-09T22:01:37.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:37.941+0000 7fb691540640 1 -- 172.21.15.37:0/3032548251 wait complete. 2023-07-09T22:01:37.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2023-07-09T22:01:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 Processor -- start 2023-07-09T22:01:38.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 -- start start 2023-07-09T22:01:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 0x7f193c0b6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f193c0d0530 0x7f193c0cd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c0b3bb0 con 0x7f193c0b74e0 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0b7960 con 0x7f193c0d0530 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1942582640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0cccb0 con 0x7f193c15f130 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f193c0d0530 0x7f193c0cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f193c0d0530 0x7f193c0cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60514/0 (socket says 172.21.15.37:60514) 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 -- 172.21.15.37:0/261155739 learned_addr learned my addr 172.21.15.37:0/261155739 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:38.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f193bfff640 1 --2- 172.21.15.37:0/261155739 >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 0x7f193c0b6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 -- 172.21.15.37:0/261155739 >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 msgr2=0x7f193c0b6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 --2- 172.21.15.37:0/261155739 >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 0x7f193c0b6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 -- 172.21.15.37:0/261155739 >> v1:172.21.15.119:6789/0 conn(0x7f193c0b74e0 legacy=0x7f193c0cfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:38.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f1940b1f640 1 -- 172.21.15.37:0/261155739 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0b8100 con 0x7f193c0d0530 2023-07-09T22:01:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.109+0000 7f193bfff640 1 --2- 172.21.15.37:0/261155739 >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 0x7f193c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:38.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1940b1f640 1 --2- 172.21.15.37:0/261155739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0cd140 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f193c08a900 tx=0x7f193401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187df8bf8ab440b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f193affd640 1 -- 172.21.15.37:0/261155739 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340a5790 con 0x7f193c0d0530 2023-07-09T22:01:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f193affd640 1 -- 172.21.15.37:0/261155739 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19340a58f0 con 0x7f193c0d0530 2023-07-09T22:01:38.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f193affd640 1 -- 172.21.15.37:0/261155739 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340a5c80 con 0x7f193c0d0530 2023-07-09T22:01:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 -- 172.21.15.37:0/261155739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 msgr2=0x7f193c0cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 --2- 172.21.15.37:0/261155739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0cd140 secure :-1 s=READY pgs=2037 cs=0 l=1 rev1=1 crypto rx=0x7f193c08a900 tx=0x7f193401c8d0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 -- 172.21.15.37:0/261155739 shutdown_connections 2023-07-09T22:01:38.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 --2- 172.21.15.37:0/261155739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0cd140 unknown :-1 s=CLOSED pgs=2037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 --2- 172.21.15.37:0/261155739 >> v2:172.21.15.119:3300/0 conn(0x7f193c15f130 0x7f193c0b6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 -- 172.21.15.37:0/261155739 >> 172.21.15.37:0/261155739 conn(0x7f193c072d20 msgr2=0x7f193c0d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 -- 172.21.15.37:0/261155739 shutdown_connections 2023-07-09T22:01:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.113+0000 7f1942582640 1 -- 172.21.15.37:0/261155739 wait complete. 2023-07-09T22:01:38.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 Processor -- start 2023-07-09T22:01:38.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- start start 2023-07-09T22:01:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 0x7f193c0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 0x7f193c0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c14f430 con 0x7f193c0d0530 2023-07-09T22:01:38.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c15c700 con 0x7f193c0b74e0 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c0c8890 con 0x7f193c15f130 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60522/0 (socket says 172.21.15.37:60522) 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 -- 172.21.15.37:0/3338417277 learned_addr learned my addr 172.21.15.37:0/3338417277 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193bfff640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 0x7f193c0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1940b1f640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 0x7f193c0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 -- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 msgr2=0x7f193c0ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 0x7f193c0ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 -- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 msgr2=0x7f193c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 0x7f193c0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 -- 172.21.15.37:0/3338417277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1934009b30 con 0x7f193c0d0530 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1940b1f640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 0x7f193c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193bfff640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 0x7f193c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f193b7fe640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f193000b410 tx=0x7f193000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:38.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930004020 con 0x7f193c0d0530 2023-07-09T22:01:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1930004180 con 0x7f193c0d0530 2023-07-09T22:01:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c0c8b70 con 0x7f193c0d0530 2023-07-09T22:01:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1930011630 con 0x7f193c0d0530 2023-07-09T22:01:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.117+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c15c390 con 0x7f193c0d0530 2023-07-09T22:01:38.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c0668f0 con 0x7f193c0d0530 2023-07-09T22:01:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7f1930011790 con 0x7f193c0d0530 2023-07-09T22:01:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f1938ff9640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 0x7f19280688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7f1930083cd0 con 0x7f193c0d0530 2023-07-09T22:01:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f193bfff640 1 -- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 msgr2=0x7f19280688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:38.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.121+0000 7f193bfff640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 0x7f19280688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:38.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.125+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1930050f60 con 0x7f193c0d0530 2023-07-09T22:01:38.174 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:38.175+0000 7ff93ac4a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:38.218 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:38.213+0000 7fdbc6f70180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:38.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.285+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f193c15c840 con 0x7f193c0d0530 2023-07-09T22:01:38.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.289+0000 7f1938ff9640 1 -- 172.21.15.37:0/3338417277 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v66)=0 v66) v1 ==== 133+0+0 (secure 0 0 0) 0x7f19300150c0 con 0x7f193c0d0530 2023-07-09T22:01:38.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.289+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 msgr2=0x7f19280688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:38.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.289+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 0x7f19280688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 msgr2=0x7f193c0c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7f193000b410 tx=0x7f193000b8d0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 shutdown_connections 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7f1928066420 0x7f19280688d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f193c15f130 0x7f193c0ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f193c0d0530 0x7f193c0c7e20 unknown :-1 s=CLOSED pgs=2038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 --2- 172.21.15.37:0/3338417277 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f193c0b74e0 0x7f193c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 >> 172.21.15.37:0/3338417277 conn(0x7f193c072d20 msgr2=0x7f193c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:38.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 shutdown_connections 2023-07-09T22:01:38.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.293+0000 7f1942582640 1 -- 172.21.15.37:0/3338417277 wait complete. 2023-07-09T22:01:38.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:38.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2023-07-09T22:01:38.325 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:38.327+0000 7ff93ac4a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:38.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add --fs cephfs snap_test_dir1 1M 2023-07-09T22:01:38.380 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:38.373+0000 7fdbc6f70180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:38.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 Processor -- start 2023-07-09T22:01:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 -- start start 2023-07-09T22:01:38.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc49c0d0780 0x7fc49c0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc49c15bf80 con 0x7fc49c0b7980 2023-07-09T22:01:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc49c0cd070 con 0x7fc49c0d0780 2023-07-09T22:01:38.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a469e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c0cfd70 con 0x7fc49c0cf290 2023-07-09T22:01:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a1c39640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc49c0d0780 0x7fc49c0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fc49c0d0780 0x7fc49c0d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41520/0 (socket says 172.21.15.37:41520) 2023-07-09T22:01:38.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/2034140327 learned_addr learned my addr 172.21.15.37:0/2034140327 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 msgr2=0x7fc49c160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 --2- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/2034140327 >> v1:172.21.15.119:6789/0 conn(0x7fc49c0b7980 legacy=0x7fc49c0ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.521+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/2034140327 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c160570 con 0x7fc49c0d0780 2023-07-09T22:01:38.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a2c3b640 1 --2- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0d0780 0x7fc49c0d0c00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc494009e50 tx=0x7fc49401ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1aa1f74c9486831 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a1438640 1 -- 172.21.15.37:0/2034140327 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940a56e0 con 0x7fc49c0d0780 2023-07-09T22:01:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a1438640 1 -- 172.21.15.37:0/2034140327 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4940a5840 con 0x7fc49c0d0780 2023-07-09T22:01:38.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a1438640 1 -- 172.21.15.37:0/2034140327 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940a5bd0 con 0x7fc49c0d0780 2023-07-09T22:01:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 -- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0d0780 msgr2=0x7fc49c0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 --2- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0d0780 0x7fc49c0d0c00 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc494009e50 tx=0x7fc49401ca10 comp rx=0 tx=0).stop 2023-07-09T22:01:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 -- 172.21.15.37:0/2034140327 shutdown_connections 2023-07-09T22:01:38.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 --2- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0d0780 0x7fc49c0d0c00 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 --2- 172.21.15.37:0/2034140327 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 -- 172.21.15.37:0/2034140327 >> 172.21.15.37:0/2034140327 conn(0x7fc49c073090 msgr2=0x7fc49c069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 -- 172.21.15.37:0/2034140327 shutdown_connections 2023-07-09T22:01:38.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.525+0000 7fc4a469e640 1 -- 172.21.15.37:0/2034140327 wait complete. 2023-07-09T22:01:38.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 Processor -- start 2023-07-09T22:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- start start 2023-07-09T22:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0b7980 0x7fc49c143420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 0x7fc49c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c143960 con 0x7fc49c0d0780 2023-07-09T22:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c159760 con 0x7fc49c0b7980 2023-07-09T22:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49c1599b0 con 0x7fc49c0cf290 2023-07-09T22:01:38.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 0x7fc49c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 0x7fc49c0b2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60532/0 (socket says 172.21.15.37:60532) 2023-07-09T22:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/3948503911 learned_addr learned my addr 172.21.15.37:0/3948503911 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a1c39640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0b7980 0x7fc49c143420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 msgr2=0x7fc49c151d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc49c0cf290 0x7fc49c151d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0b7980 msgr2=0x7fc49c143420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:38.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc49c0b7980 0x7fc49c143420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:38.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009b30 con 0x7fc49c0d0780 2023-07-09T22:01:38.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a2c3b640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 0x7fc49c0b2820 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc49401a640 tx=0x7fc4940197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940a56e0 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4940b88a0 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4940b8c50 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc49c159c90 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.529+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49c15a250 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc49c0737d0 con 0x7fc49c0d0780 2023-07-09T22:01:38.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 91) v1 ==== 85777+0+0 (secure 0 0 0) 0x7fc4940c2410 con 0x7fc49c0d0780 2023-07-09T22:01:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc492ffd640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:38.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 6118+0+0 (secure 0 0 0) 0x7fc49411ee60 con 0x7fc49c0d0780 2023-07-09T22:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc4a243a640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 msgr2=0x7fc4800688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.533+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:38.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.537+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc49c0737d0 con 0x7fc49c0d0780 2023-07-09T22:01:38.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.717+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc49c0ccd90 con 0x7fc480066420 2023-07-09T22:01:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.737+0000 7fc4a243a640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 msgr2=0x7fc4800688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:38.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:38.737+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T22:01:38.806 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:38.807+0000 7ff93ac4a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:38.864 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:38.863+0000 7ff93ac4a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:38.895 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:38.889+0000 7fdbc6f70180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:38.919 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:38.919+0000 7ff93ac4a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:38.957 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:38.949+0000 7fdbc6f70180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:39.003 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.003+0000 7ff93ac4a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:39.015 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.009+0000 7fdbc6f70180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:39.060 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.059+0000 7ff93ac4a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:39.105 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.101+0000 7fdbc6f70180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:39.143 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.143+0000 7ff93ac4a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:39.141+0000 7fc4a243a640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 msgr2=0x7fc4800688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:39.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:39.141+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-09T22:01:39.167 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.161+0000 7fdbc6f70180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:39.199 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.199+0000 7ff93ac4a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:39.258 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.253+0000 7fdbc6f70180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:39.317 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.313+0000 7fdbc6f70180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:39.339 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.339+0000 7ff93ac4a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:39.397 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.399+0000 7ff93ac4a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:39.467 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.461+0000 7fdbc6f70180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:39.527 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.521+0000 7fdbc6f70180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:39.636 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:39.636 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:39.636 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:39.644 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.643+0000 7ff93ac4a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:39.779 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:39.779 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:39.779 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:39.780 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.779+0000 7ff93ac4a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:39.787 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.781+0000 7fdbc6f70180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:39.904 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.903+0000 7ff93ac4a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:39.928 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:39.921+0000 7fdbc6f70180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:39.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:39.945+0000 7fc4a243a640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 msgr2=0x7fc4800688d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/350512922 2023-07-09T22:01:39.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:39.945+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-09T22:01:39.974 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:39.975+0000 7ff93ac4a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:40.059 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:40.053+0000 7fdbc6f70180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:40.107 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:40.107+0000 7ff93ac4a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:40.133 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:40.129+0000 7fdbc6f70180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:40.274 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:40.269+0000 7fdbc6f70180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:40.640 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:40.639+0000 7ff93ac4a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:40.726 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:40.727+0000 7ff93ac4a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:01:40.843 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:40.837+0000 7fdbc6f70180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:40.872 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:40.871+0000 7ff93ac4a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:01:40.931 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:40.925+0000 7fdbc6f70180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:01:40.955 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:40.955+0000 7ff93ac4a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:01:41.085 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:41.081+0000 7fdbc6f70180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:01:41.173 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:41.169+0000 7fdbc6f70180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:01:41.223 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.223+0000 7ff93ac4a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:01:41.282 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.283+0000 7ff93ac4a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:01:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:41.289+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 92) v1 ==== 85386+0+0 (secure 0 0 0) 0x7fc4940ec6d0 con 0x7fc49c0d0780 2023-07-09T22:01:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:41.289+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 msgr2=0x7fc4800688d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:41.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:41.289+0000 7fc492ffd640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/350512922,v1:172.21.15.119:6833/350512922] conn(0x7fc480066420 0x7fc4800688d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:41.423 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8bb17a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.424 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8bb17a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.424 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8bb17a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.424 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8bb17a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.425 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8bb17a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.425 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8b9176640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.425 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8b9176640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.425 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8b9176640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.426 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8b9176640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.426 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:41.423+0000 7ff8b9176640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:01:41.478 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:41.473+0000 7fdbc6f70180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:01:41.541 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:41.537+0000 7fdbc6f70180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:01:42.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.297+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fc4940ef4b0 con 0x7fc49c0d0780 2023-07-09T22:01:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.297+0000 7fc492ffd640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fc480033ce0 0x7fc4800709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.297+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 --> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "snap_test_dir1", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4800340b0 con 0x7fc480033ce0 2023-07-09T22:01:42.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.301+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fc480033ce0 0x7fc4800709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.305+0000 7fc4a243a640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fc480033ce0 0x7fc4800709b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc498007fd0 tx=0x7fc498007e40 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:42.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc492ffd640 1 -- 172.21.15.37:0/3948503911 <== mgr.10351 v2:172.21.15.119:6832/2249208328 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc4800340b0 con 0x7fc480033ce0 2023-07-09T22:01:42.378 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule set for path snap_test_dir1 2023-07-09T22:01:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fc480033ce0 msgr2=0x7fc4800709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fc480033ce0 0x7fc4800709b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc498007fd0 tx=0x7fc498007e40 comp rx=0 tx=0).stop 2023-07-09T22:01:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 msgr2=0x7fc49c0b2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 --2- 172.21.15.37:0/3948503911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc49c0d0780 0x7fc49c0b2820 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7fc49401a640 tx=0x7fc4940197b0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a2c3b640 1 -- 172.21.15.37:0/3948503911 reap_dead start 2023-07-09T22:01:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 shutdown_connections 2023-07-09T22:01:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 >> 172.21.15.37:0/3948503911 conn(0x7fc49c073090 msgr2=0x7fc49c0ceb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 shutdown_connections 2023-07-09T22:01:42.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.373+0000 7fc4a469e640 1 -- 172.21.15.37:0/3948503911 wait complete. 2023-07-09T22:01:42.401 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path snap_test_dir1 2023-07-09T22:01:42.402 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule retention add --fs cephfs snap_test_dir1 1M 2023-07-09T22:01:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 Processor -- start 2023-07-09T22:01:42.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 -- start start 2023-07-09T22:01:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab815bf80 con 0x7f8ab80b7980 2023-07-09T22:01:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab80cd070 con 0x7f8ab80d0780 2023-07-09T22:01:42.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8abd3e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80cfd70 con 0x7f8ab80cf290 2023-07-09T22:01:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8ab77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8ab77fe640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:41552/0 (socket says 172.21.15.37:41552) 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8ab6ffd640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f8ab80b7980 0x7f8ab80ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:55560/0 (socket says 172.21.15.37:55560) 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8ab6ffd640 1 -- 172.21.15.37:0/2852360616 learned_addr learned my addr 172.21.15.37:0/2852360616 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.545+0000 7f8aaffff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56442/0 (socket says 172.21.15.37:56442) 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8aaffff640 1 -- 172.21.15.37:0/2852360616 >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 msgr2=0x7f8ab80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8aaffff640 1 --2- 172.21.15.37:0/2852360616 >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8ab67fc640 1 -- 172.21.15.37:0/2852360616 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221509690 0 0) 0x7f8aa8001120 con 0x7f8ab80b7980 2023-07-09T22:01:42.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8aaffff640 1 -- 172.21.15.37:0/2852360616 >> v1:172.21.15.119:6789/0 conn(0x7f8ab80b7980 legacy=0x7f8ab80ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8aaffff640 1 -- 172.21.15.37:0/2852360616 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8160570 con 0x7f8ab80cf290 2023-07-09T22:01:42.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8ab77fe640 1 --2- 172.21.15.37:0/2852360616 >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:42.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8aaffff640 1 --2- 172.21.15.37:0/2852360616 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097c0 tx=0x7f8aa001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e0e45f3fdec7503 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:42.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8ab67fc640 1 -- 172.21.15.37:0/2852360616 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00ab600 con 0x7f8ab80cf290 2023-07-09T22:01:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8ab67fc640 1 -- 172.21.15.37:0/2852360616 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00a7050 con 0x7f8ab80cf290 2023-07-09T22:01:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.549+0000 7f8ab67fc640 1 -- 172.21.15.37:0/2852360616 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa00ab980 con 0x7f8ab80cf290 2023-07-09T22:01:42.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2852360616 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 msgr2=0x7f8ab8160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2852360616 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097c0 tx=0x7f8aa001c480 comp rx=0 tx=0).stop 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2852360616 shutdown_connections 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2852360616 >> v2:172.21.15.119:3300/0 conn(0x7f8ab80d0780 0x7f8ab80d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2852360616 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8160030 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2852360616 >> 172.21.15.37:0/2852360616 conn(0x7f8ab8073090 msgr2=0x7f8ab8069f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2852360616 shutdown_connections 2023-07-09T22:01:42.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2852360616 wait complete. 2023-07-09T22:01:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 Processor -- start 2023-07-09T22:01:42.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- start start 2023-07-09T22:01:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab80b7980 0x7f8ab815ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab8159350 con 0x7f8ab80d0780 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b1d10 con 0x7f8ab80b7980 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8abd3e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab80b1ff0 con 0x7f8ab80cf290 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60542/0 (socket says 172.21.15.37:60542) 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 -- 172.21.15.37:0/2677229552 learned_addr learned my addr 172.21.15.37:0/2677229552 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:42.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8aaffff640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab6ffd640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab80b7980 0x7f8ab815ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 -- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 msgr2=0x7f8ab8154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 -- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab80b7980 msgr2=0x7f8ab815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab80b7980 0x7f8ab815ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.553+0000 7f8ab77fe640 1 -- 172.21.15.37:0/2677229552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab0009a70 con 0x7f8ab80d0780 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8ab77fe640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000efc0 tx=0x7f8ab0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:42.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab0009d70 con 0x7f8ab80d0780 2023-07-09T22:01:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab000f040 con 0x7f8ab80d0780 2023-07-09T22:01:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa0009420 con 0x7f8ab80d0780 2023-07-09T22:01:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab00039a0 con 0x7f8ab80d0780 2023-07-09T22:01:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab80b25b0 con 0x7f8ab80d0780 2023-07-09T22:01:42.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab804d7d0 con 0x7f8ab80d0780 2023-07-09T22:01:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7f8ab00144a0 con 0x7f8ab80d0780 2023-07-09T22:01:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 0x7f8a980685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f8ab0084650 con 0x7f8ab80d0780 2023-07-09T22:01:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.557+0000 7f8ab6ffd640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 0x7f8a980685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:42.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.561+0000 7f8ab6ffd640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 0x7f8a980685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8000f70 tx=0x7f8aa8007df0 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:42.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.561+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8ab00557c0 con 0x7f8ab80d0780 2023-07-09T22:01:42.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.737+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 --> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "snap_test_dir1", "retention_spec_or_period": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ab80cff80 con 0x7f8a98066120 2023-07-09T22:01:42.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8aaf7fe640 1 -- 172.21.15.37:0/2677229552 <== mgr.10351 v2:172.21.15.119:6832/2249208328 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+39 (secure 0 0 0) 0x7f8aa8004c80 con 0x7f8a98066120 2023-07-09T22:01:42.799 INFO:teuthology.orchestra.run.smithi037.stdout:Retention added to path snap_test_dir1 2023-07-09T22:01:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 msgr2=0x7f8a980685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 0x7f8a980685d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8000f70 tx=0x7f8aa8007df0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 msgr2=0x7f8ab8154890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f8ab000efc0 tx=0x7f8ab0009f90 comp rx=0 tx=0).stop 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 shutdown_connections 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8a98066120 0x7f8a980685d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab80d0780 0x7f8ab8154890 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f8ab80cf290 0x7f8ab8154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 --2- 172.21.15.37:0/2677229552 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f8ab80b7980 0x7f8ab815ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:42.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 >> 172.21.15.37:0/2677229552 conn(0x7f8ab8073090 msgr2=0x7f8ab815c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 shutdown_connections 2023-07-09T22:01:42.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:42.793+0000 7f8abd3e9640 1 -- 172.21.15.37:0/2677229552 wait complete. 2023-07-09T22:01:42.819 DEBUG:tasks.cephfs.test_snap_schedules:res=Retention added to path snap_test_dir1 2023-07-09T22:01:42.824 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T22:01:42.828 DEBUG:teuthology.orchestra.run.smithi119:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-07-09T22:01:42.873 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T22:01:42.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-07-09T22:01:42.875 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.876 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-07-09T22:01:42.877 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-07-09T22:01:42.878 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-07-09T22:01:42.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.880 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2023-07-09T22:01:42.881 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T22:01:42.882 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-09T22:01:42.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-09T22:01:42.884 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: debug finisher = 20 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-07-09T22:01:42.885 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-07-09T22:01:42.886 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T22:01:42.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-07-09T22:01:42.888 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-07-09T22:01:42.889 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout: client snapdir = .snap 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-07-09T22:01:42.890 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-07-09T22:01:42.891 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-07-09T22:01:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-07-09T22:01:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-07-09T22:01:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-07-09T22:01:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-07-09T22:01:42.892 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-07-09T22:01:42.893 INFO:teuthology.orchestra.run.smithi119.stdout:[global] 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: chdir = "" 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: auth supported = cephx 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: filestore xattr use omap = true 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.894 INFO:teuthology.orchestra.run.smithi119.stdout: mon clock drift allowed = 1.000 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: osd crush chooseleaf type = 0 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: auth debug = true 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on old message = true 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: ms die on bug = true 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.895 INFO:teuthology.orchestra.run.smithi119.stdout: mon max pg per osd = 10000 # >= luminous 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: mon pg warn max object skew = 0 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: # disable pg_autoscaler by default for new pools 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: osd_pool_default_pg_autoscale_mode = off 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default size = 2 2023-07-09T22:01:42.896 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow primary affinity = true 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd allow pg remap = true 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on legacy crush tunables = false 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on crush straw calc version zero = false 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on no sortbitwise = false 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on osd down out interval zero = false 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon warn on too few osds = false 2023-07-09T22:01:42.897 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_pool_no_redundancy = false 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: mon_allow_pool_size_one = true 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: osd default data pool replay window = 5 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.898 INFO:teuthology.orchestra.run.smithi119.stdout: mon allow pool delete = true 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: mon cluster log file level = debug 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: debug asserts on shutdown = true 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: mon health detail to clog = false 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: mon host = "172.21.15.37,172.21.15.119,[v2:172.21.15.119:3301,v1:172.21.15.119:6790]" 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: fsid = 43b31e6b-703a-46c6-8fb1-0669649379d3 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.899 INFO:teuthology.orchestra.run.smithi119.stdout:[osd] 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: osd journal size = 100 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub load threshold = 5.0 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: osd scrub max interval = 600 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: osd mclock profile = high_recovery_ops 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.900 INFO:teuthology.orchestra.run.smithi119.stdout: osd recover clone overlap = true 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd recovery max chunk = 1048576 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug shutdown = true 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug op order = true 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug verify stray on activate = true 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd open classes on start = true 2023-07-09T22:01:42.901 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug pg log writeout = true 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: osd deep scrub update digest min age = 30 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: osd map max advance = 10 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: journal zero on create = true 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.902 INFO:teuthology.orchestra.run.smithi119.stdout: filestore ondisk finisher threads = 3 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: filestore apply finisher threads = 3 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: bdev debug aio = true 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: osd debug misdirected ops = true 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: bdev async discard = True 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: bdev enable discard = True 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore allocator = bitmap 2023-07-09T22:01:42.903 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore block size = 96636764160 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: bluestore fsck on mount = True 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluefs = 1/20 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: debug bluestore = 1/20 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: debug osd = 20 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: debug rocksdb = 4/10 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd backfillfull_ratio = 0.85 2023-07-09T22:01:42.904 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd full ratio = 0.9 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd nearfull ratio = 0.8 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: osd failsafe full ratio = 0.95 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: osd objectstore = bluestore 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout:[mgr] 2023-07-09T22:01:42.905 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: debug mgr = 20 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: mgr/telemetry/nag = false 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-07-09T22:01:42.906 INFO:teuthology.orchestra.run.smithi119.stdout: debug finisher = 20 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout:[mon] 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: debug mon = 20 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: debug paxos = 20 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: debug auth = 20 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: mon data avail warn = 5 2023-07-09T22:01:42.907 INFO:teuthology.orchestra.run.smithi119.stdout: mon mgr mkfs grace = 240 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min pgs per osd = 4 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd reporter subtree level = osd 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: mon osd prime pg temp = true 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: mon reweight min bytes per osd = 10 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: auth mon ticket ttl = 660 # 11m 2023-07-09T22:01:42.908 INFO:teuthology.orchestra.run.smithi119.stdout: auth service ticket ttl = 240 # 4m 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: # don't complain about insecure global_id in the test suite 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: # 1m isn't quite enough 2023-07-09T22:01:42.909 INFO:teuthology.orchestra.run.smithi119.stdout: mon_down_mkfs_grace = 2m 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: mon_warn_on_filestore_osds = false 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: mon op complaint time = 120 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout:[client] 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: rgw cache enabled = true 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable ops log = true 2023-07-09T22:01:42.910 INFO:teuthology.orchestra.run.smithi119.stdout: rgw enable usage log = true 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: client mount timeout = 600 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: debug client = 20 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: pid file = "" 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-07-09T22:01:42.911 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout: client snapdir = .snap 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.a] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.b] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mon.c] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.a] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.c] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.b] 2023-07-09T22:01:42.912 INFO:teuthology.orchestra.run.smithi119.stdout:[mds.d] 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout:[mds] 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds = 20 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: debug mds balancer = 20 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: debug ms = 1 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug frag = True 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: mds debug scatterstat = True 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: mds op complaint time = 180 2023-07-09T22:01:42.913 INFO:teuthology.orchestra.run.smithi119.stdout: mds verify scatter = True 2023-07-09T22:01:42.914 INFO:teuthology.orchestra.run.smithi119.stdout: osd op complaint time = 180 2023-07-09T22:01:42.914 INFO:teuthology.orchestra.run.smithi119.stdout: rados mon op timeout = 900 2023-07-09T22:01:42.914 INFO:teuthology.orchestra.run.smithi119.stdout: rados osd op timeout = 900 2023-07-09T22:01:42.914 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:42.915 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:42.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:43.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 Processor -- start 2023-07-09T22:01:43.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 -- start start 2023-07-09T22:01:43.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fec940b08d0 0x7fec9406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9409c9d0 con 0x7fec9406cff0 2023-07-09T22:01:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9409c120 con 0x7fec9415bd40 2023-07-09T22:01:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9bbe2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9415c110 con 0x7fec940b08d0 2023-07-09T22:01:43.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9a17f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fec9406cff0 0x7fec9406fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43810/0 (socket says 172.21.15.37:43810) 2023-07-09T22:01:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9a17f640 1 -- 172.21.15.37:0/57016593 learned_addr learned my addr 172.21.15.37:0/57016593 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9917d640 1 --2- 172.21.15.37:0/57016593 >> v2:172.21.15.119:3300/0 conn(0x7fec940b08d0 0x7fec9406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374350725 0 0) 0x7fec9409c9d0 con 0x7fec9406cff0 2023-07-09T22:01:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec80003530 con 0x7fec9406cff0 2023-07-09T22:01:43.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9917d640 1 -- 172.21.15.37:0/57016593 >> v1:172.21.15.119:6789/0 conn(0x7fec9415bd40 legacy=0x7fec94099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1751784144 0 0) 0x7fec9409c120 con 0x7fec9415bd40 2023-07-09T22:01:43.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9917d640 1 -- 172.21.15.37:0/57016593 >> v1:172.21.15.37:6789/0 conn(0x7fec9406cff0 legacy=0x7fec9406fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.125+0000 7fec9917d640 1 -- 172.21.15.37:0/57016593 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940b0dd0 con 0x7fec940b08d0 2023-07-09T22:01:43.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9917d640 1 --2- 172.21.15.37:0/57016593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec9406cab0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fec840097c0 tx=0x7fec8401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf587935359c8d7e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec840ab610 con 0x7fec940b08d0 2023-07-09T22:01:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec840ab770 con 0x7fec940b08d0 2023-07-09T22:01:43.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9897c640 1 -- 172.21.15.37:0/57016593 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec840abb00 con 0x7fec940b08d0 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 -- 172.21.15.37:0/57016593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 msgr2=0x7fec9406cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/57016593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec9406cab0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fec840097c0 tx=0x7fec8401c3f0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 -- 172.21.15.37:0/57016593 shutdown_connections 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/57016593 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec9406cab0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 -- 172.21.15.37:0/57016593 >> 172.21.15.37:0/57016593 conn(0x7fec940694f0 msgr2=0x7fec940698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 -- 172.21.15.37:0/57016593 shutdown_connections 2023-07-09T22:01:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.129+0000 7fec9bbe2640 1 -- 172.21.15.37:0/57016593 wait complete. 2023-07-09T22:01:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 Processor -- start 2023-07-09T22:01:43.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- start start 2023-07-09T22:01:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec940ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec9415bd40 0x7fec94155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940abd90 con 0x7fec9406cff0 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94159710 con 0x7fec940b08d0 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94159960 con 0x7fec9415bd40 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60556/0 (socket says 172.21.15.37:60556) 2023-07-09T22:01:43.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 -- 172.21.15.37:0/791611338 learned_addr learned my addr 172.21.15.37:0/791611338 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9917d640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec940ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9a17f640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec9415bd40 0x7fec94155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 -- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec9415bd40 msgr2=0x7fec94155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec9415bd40 0x7fec94155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 -- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 msgr2=0x7fec940ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec940ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 -- 172.21.15.37:0/791611338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec84009420 con 0x7fec9406cff0 2023-07-09T22:01:43.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9997e640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c4d0 tx=0x7fec9000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec90005480 con 0x7fec9406cff0 2023-07-09T22:01:43.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec90003600 con 0x7fec9406cff0 2023-07-09T22:01:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900039b0 con 0x7fec9406cff0 2023-07-09T22:01:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec94159c40 con 0x7fec9406cff0 2023-07-09T22:01:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.133+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9415a200 con 0x7fec9406cff0 2023-07-09T22:01:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.137+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94066bc0 con 0x7fec9406cff0 2023-07-09T22:01:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.137+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 93) v1 ==== 85513+0+0 (secure 0 0 0) 0x7fec90003b10 con 0x7fec9406cff0 2023-07-09T22:01:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.137+0000 7fec8a7fc640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 0x7fec780685d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.137+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fec90083140 con 0x7fec9406cff0 2023-07-09T22:01:43.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.137+0000 7fec9917d640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 0x7fec780685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.141+0000 7fec9917d640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 0x7fec780685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec840af000 tx=0x7fec840a7000 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.141+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec900542a0 con 0x7fec9406cff0 2023-07-09T22:01:43.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.297+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9415aee0 con 0x7fec9406cff0 2023-07-09T22:01:43.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.301+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fec90050be0 con 0x7fec9406cff0 2023-07-09T22:01:43.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec8a7fc640 1 -- 172.21.15.37:0/791611338 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18878 (secure 0 0 0) 0x7fec90074710 con 0x7fec9406cff0 2023-07-09T22:01:43.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:43.311 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":197,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:41.285428+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 msgr2=0x7fec780685d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 0x7fec780685d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec840af000 tx=0x7fec840a7000 comp rx=0 tx=0).stop 2023-07-09T22:01:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 msgr2=0x7fec940a9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7fec9000c4d0 tx=0x7fec9000c990 comp rx=0 tx=0).stop 2023-07-09T22:01:43.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 shutdown_connections 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fec78066120 0x7fec780685d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fec9415bd40 0x7fec94155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fec940b08d0 0x7fec940ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 --2- 172.21.15.37:0/791611338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec9406cff0 0x7fec940a9790 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.305+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 >> 172.21.15.37:0/791611338 conn(0x7fec940694f0 msgr2=0x7fec940af940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.309+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 shutdown_connections 2023-07-09T22:01:43.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.309+0000 7fec9bbe2640 1 -- 172.21.15.37:0/791611338 wait complete. 2023-07-09T22:01:43.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T22:01:21.205098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T22:01:22.084065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:43.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 Processor -- start 2023-07-09T22:01:43.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 -- start start 2023-07-09T22:01:43.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa9901600d0 0x7fa9900b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006ee70 con 0x7fa9900b17d0 2023-07-09T22:01:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99006f0f0 con 0x7fa99006e9f0 2023-07-09T22:01:43.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa994dfa640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99006f3d0 con 0x7fa9901600d0 2023-07-09T22:01:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa98ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa9900b17d0 0x7fa9901604a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43824/0 (socket says 172.21.15.37:43824) 2023-07-09T22:01:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.473+0000 7fa98ed9d640 1 -- 172.21.15.37:0/433014483 learned_addr learned my addr 172.21.15.37:0/433014483 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98e59c640 1 --2- 172.21.15.37:0/433014483 >> v2:172.21.15.119:3300/0 conn(0x7fa9901600d0 0x7fa9900b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715899751 0 0) 0x7fa99006ee70 con 0x7fa9900b17d0 2023-07-09T22:01:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa97c003530 con 0x7fa9900b17d0 2023-07-09T22:01:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98e59c640 1 -- 172.21.15.37:0/433014483 >> v1:172.21.15.119:6789/0 conn(0x7fa99006e9f0 legacy=0x7fa9900b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709150268 0 0) 0x7fa99006f0f0 con 0x7fa99006e9f0 2023-07-09T22:01:43.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98e59c640 1 -- 172.21.15.37:0/433014483 >> v1:172.21.15.37:6789/0 conn(0x7fa9900b17d0 legacy=0x7fa9901604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98e59c640 1 -- 172.21.15.37:0/433014483 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900b2450 con 0x7fa9901600d0 2023-07-09T22:01:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98e59c640 1 --2- 172.21.15.37:0/433014483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9901600d0 0x7fa9900b2f30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa9800097c0 tx=0x7fa98001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f0603100b53d6c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800ab650 con 0x7fa9901600d0 2023-07-09T22:01:43.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9800ab7b0 con 0x7fa9901600d0 2023-07-09T22:01:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.477+0000 7fa98dd9b640 1 -- 172.21.15.37:0/433014483 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800abb40 con 0x7fa9901600d0 2023-07-09T22:01:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- 172.21.15.37:0/433014483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9901600d0 msgr2=0x7fa9900b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 --2- 172.21.15.37:0/433014483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9901600d0 0x7fa9900b2f30 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fa9800097c0 tx=0x7fa98001c450 comp rx=0 tx=0).stop 2023-07-09T22:01:43.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- 172.21.15.37:0/433014483 shutdown_connections 2023-07-09T22:01:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 --2- 172.21.15.37:0/433014483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa9901600d0 0x7fa9900b2f30 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- 172.21.15.37:0/433014483 >> 172.21.15.37:0/433014483 conn(0x7fa9900ce0f0 msgr2=0x7fa9900ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- 172.21.15.37:0/433014483 shutdown_connections 2023-07-09T22:01:43.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- 172.21.15.37:0/433014483 wait complete. 2023-07-09T22:01:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 Processor -- start 2023-07-09T22:01:43.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- start start 2023-07-09T22:01:43.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99006e9f0 0x7fa990152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9900b17d0 0x7fa99014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9900ad3f0 con 0x7fa9901600d0 2023-07-09T22:01:43.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa990153520 con 0x7fa99006e9f0 2023-07-09T22:01:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa994dfa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa990155900 con 0x7fa9900b17d0 2023-07-09T22:01:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa98ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa98ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60568/0 (socket says 172.21.15.37:60568) 2023-07-09T22:01:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.481+0000 7fa98ed9d640 1 -- 172.21.15.37:0/925823360 learned_addr learned my addr 172.21.15.37:0/925823360 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98e59c640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99006e9f0 0x7fa990152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa987fff640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9900b17d0 0x7fa99014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 -- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9900b17d0 msgr2=0x7fa99014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9900b17d0 0x7fa99014b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 -- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99006e9f0 msgr2=0x7fa990152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99006e9f0 0x7fa990152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 -- 172.21.15.37:0/925823360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa980009420 con 0x7fa9901600d0 2023-07-09T22:01:43.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa98ed9d640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cb40 tx=0x7fa98800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98800aca0 con 0x7fa9901600d0 2023-07-09T22:01:43.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98800ae00 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9900ace30 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988012620 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa990155e80 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa990066bc0 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fa988007070 con 0x7fa9901600d0 2023-07-09T22:01:43.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 0x7fa970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.485+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fa9880841a0 con 0x7fa9901600d0 2023-07-09T22:01:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.489+0000 7fa98e59c640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 0x7fa970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.489+0000 7fa98e59c640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 0x7fa970068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af000 tx=0x7fa9800a7000 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.489+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9880512f0 con 0x7fa9901600d0 2023-07-09T22:01:43.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.645+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9900b3bd0 con 0x7fa9901600d0 2023-07-09T22:01:43.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.645+0000 7fa986ffd640 1 -- 172.21.15.37:0/925823360 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa988054910 con 0x7fa9901600d0 2023-07-09T22:01:43.653 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:43.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 msgr2=0x7fa970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 0x7fa970068930 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa9800af000 tx=0x7fa9800a7000 comp rx=0 tx=0).stop 2023-07-09T22:01:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 msgr2=0x7fa990146e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 secure :-1 s=READY pgs=2046 cs=0 l=1 rev1=1 crypto rx=0x7fa98800cb40 tx=0x7fa98800a060 comp rx=0 tx=0).stop 2023-07-09T22:01:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 shutdown_connections 2023-07-09T22:01:43.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fa970066480 0x7fa970068930 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9901600d0 0x7fa990146e00 unknown :-1 s=CLOSED pgs=2046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa9900b17d0 0x7fa99014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 --2- 172.21.15.37:0/925823360 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa99006e9f0 0x7fa990152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 >> 172.21.15.37:0/925823360 conn(0x7fa9900ce0f0 msgr2=0x7fa990151e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 shutdown_connections 2023-07-09T22:01:43.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.649+0000 7fa994dfa640 1 -- 172.21.15.37:0/925823360 wait complete. 2023-07-09T22:01:43.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:43.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 Processor -- start 2023-07-09T22:01:43.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 -- start start 2023-07-09T22:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec8070f70 0x7f0ec806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 0x7f0ec81601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec815fa40 con 0x7f0ec81606f0 2023-07-09T22:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec815fd20 con 0x7f0ec8070f70 2023-07-09T22:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ece20b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec8071340 con 0x7f0ec806b880 2023-07-09T22:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec8070f70 0x7f0ec806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0ec8070f70 0x7f0ec806ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60574/0 (socket says 172.21.15.37:60574) 2023-07-09T22:01:43.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 -- 172.21.15.37:0/938892426 learned_addr learned my addr 172.21.15.37:0/938892426 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:43.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec7fff640 1 --1- 172.21.15.37:0/938892426 >> v1:172.21.15.37:6789/0 conn(0x7f0ec81606f0 0x7f0ec80cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43838/0 (socket says 172.21.15.37:43838) 2023-07-09T22:01:43.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 -- 172.21.15.37:0/938892426 >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 msgr2=0x7f0ec81601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:43.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec6ffd640 1 --2- 172.21.15.37:0/938892426 >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 0x7f0ec81601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 --2- 172.21.15.37:0/938892426 >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 0x7f0ec81601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 -- 172.21.15.37:0/938892426 >> v1:172.21.15.37:6789/0 conn(0x7f0ec81606f0 legacy=0x7f0ec80cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec77fe640 1 -- 172.21.15.37:0/938892426 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec806bcd0 con 0x7f0ec8070f70 2023-07-09T22:01:43.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.817+0000 7f0ec6ffd640 1 --2- 172.21.15.37:0/938892426 >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 0x7f0ec81601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ec77fe640 1 --2- 172.21.15.37:0/938892426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec8070f70 0x7f0ec806ed10 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f0ec806a2c0 tx=0x7f0eb801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979b68b8d9855788 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ec67fc640 1 -- 172.21.15.37:0/938892426 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80ac410 con 0x7f0ec8070f70 2023-07-09T22:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ec67fc640 1 -- 172.21.15.37:0/938892426 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb80ac570 con 0x7f0ec8070f70 2023-07-09T22:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ec67fc640 1 -- 172.21.15.37:0/938892426 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb80ac900 con 0x7f0ec8070f70 2023-07-09T22:01:43.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 -- 172.21.15.37:0/938892426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec8070f70 msgr2=0x7f0ec806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 --2- 172.21.15.37:0/938892426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec8070f70 0x7f0ec806ed10 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f0ec806a2c0 tx=0x7f0eb801c3b0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 -- 172.21.15.37:0/938892426 shutdown_connections 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 --2- 172.21.15.37:0/938892426 >> v2:172.21.15.119:3300/0 conn(0x7f0ec806b880 0x7f0ec81601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 --2- 172.21.15.37:0/938892426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec8070f70 0x7f0ec806ed10 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 -- 172.21.15.37:0/938892426 >> 172.21.15.37:0/938892426 conn(0x7f0ec80694f0 msgr2=0x7f0ec80698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 -- 172.21.15.37:0/938892426 shutdown_connections 2023-07-09T22:01:43.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.821+0000 7f0ece20b640 1 -- 172.21.15.37:0/938892426 wait complete. 2023-07-09T22:01:43.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 Processor -- start 2023-07-09T22:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- start start 2023-07-09T22:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec806b880 0x7f0ec8142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ec8070f70 0x7f0ec80d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80b2430 con 0x7f0ec81606f0 2023-07-09T22:01:43.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80d1590 con 0x7f0ec806b880 2023-07-09T22:01:43.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec80d1870 con 0x7f0ec8070f70 2023-07-09T22:01:43.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60578/0 (socket says 172.21.15.37:60578) 2023-07-09T22:01:43.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 -- 172.21.15.37:0/3790242365 learned_addr learned my addr 172.21.15.37:0/3790242365 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:43.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec77fe640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec806b880 0x7f0ec8142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec6ffd640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ec8070f70 0x7f0ec80d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 -- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ec8070f70 msgr2=0x7f0ec80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ec8070f70 0x7f0ec80d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 -- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec806b880 msgr2=0x7f0ec8142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec806b880 0x7f0ec8142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 -- 172.21.15.37:0/3790242365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80094d0 con 0x7f0ec81606f0 2023-07-09T22:01:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ec7fff640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c6c0 tx=0x7f0ec000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec0004d70 con 0x7f0ec81606f0 2023-07-09T22:01:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec000a640 con 0x7f0ec81606f0 2023-07-09T22:01:43.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec000a9f0 con 0x7f0ec81606f0 2023-07-09T22:01:43.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80b2640 con 0x7f0ec81606f0 2023-07-09T22:01:43.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.825+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec8141a90 con 0x7f0ec81606f0 2023-07-09T22:01:43.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec806c500 con 0x7f0ec81606f0 2023-07-09T22:01:43.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f0ec000ab50 con 0x7f0ec81606f0 2023-07-09T22:01:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0eaffff640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 0x7f0eb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f0ec0083520 con 0x7f0ec81606f0 2023-07-09T22:01:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0ec77fe640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 0x7f0eb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:43.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.829+0000 7f0ec77fe640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 0x7f0eb4068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80ae000 tx=0x7f0eb8008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:43.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.833+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ec806c500 con 0x7f0ec81606f0 2023-07-09T22:01:43.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0ec806c500 con 0x7f0ec81606f0 2023-07-09T22:01:43.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0eaffff640 1 -- 172.21.15.37:0/3790242365 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0ec806c500 con 0x7f0ec81606f0 2023-07-09T22:01:43.995 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:43.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 msgr2=0x7f0eb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 0x7f0eb4068930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80ae000 tx=0x7f0eb8008040 comp rx=0 tx=0).stop 2023-07-09T22:01:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 msgr2=0x7f0ec813ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 secure :-1 s=READY pgs=2049 cs=0 l=1 rev1=1 crypto rx=0x7f0ec000c6c0 tx=0x7f0ec000cb80 comp rx=0 tx=0).stop 2023-07-09T22:01:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 shutdown_connections 2023-07-09T22:01:43.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0eb4066480 0x7f0eb4068930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0ec81606f0 0x7f0ec813ec20 unknown :-1 s=CLOSED pgs=2049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f0ec8070f70 0x7f0ec80d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 --2- 172.21.15.37:0/3790242365 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f0ec806b880 0x7f0ec8142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 >> 172.21.15.37:0/3790242365 conn(0x7f0ec80694f0 msgr2=0x7f0ec80698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 shutdown_connections 2023-07-09T22:01:43.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:43.989+0000 7f0ece20b640 1 -- 172.21.15.37:0/3790242365 wait complete. 2023-07-09T22:01:44.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:01:44.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.153+0000 7fe67365c640 1 Processor -- start 2023-07-09T22:01:44.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.153+0000 7fe67365c640 1 -- start start 2023-07-09T22:01:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe67365c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe66c070f70 0x7fe66c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe67365c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe66c06b880 0x7fe66c1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe67365c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66c15fa40 con 0x7fe66c1606f0 2023-07-09T22:01:44.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe67365c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c15fd20 con 0x7fe66c070f70 2023-07-09T22:01:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe67365c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe66c071340 con 0x7fe66c06b880 2023-07-09T22:01:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe66c070f70 0x7fe66c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe66c070f70 0x7fe66c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60584/0 (socket says 172.21.15.37:60584) 2023-07-09T22:01:44.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 -- 172.21.15.37:0/268720886 learned_addr learned my addr 172.21.15.37:0/268720886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe670bf7640 1 --2- 172.21.15.37:0/268720886 >> v2:172.21.15.119:3300/0 conn(0x7fe66c06b880 0x7fe66c1601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 -- 172.21.15.37:0/268720886 >> v2:172.21.15.119:3300/0 conn(0x7fe66c06b880 msgr2=0x7fe66c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 --2- 172.21.15.37:0/268720886 >> v2:172.21.15.119:3300/0 conn(0x7fe66c06b880 0x7fe66c1601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 -- 172.21.15.37:0/268720886 >> v1:172.21.15.37:6789/0 conn(0x7fe66c1606f0 legacy=0x7fe66c0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.157+0000 7fe6713f8640 1 -- 172.21.15.37:0/268720886 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c06bcd0 con 0x7fe66c070f70 2023-07-09T22:01:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe6713f8640 1 --2- 172.21.15.37:0/268720886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c06ed10 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06a2c0 tx=0x7fe66801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f459147f3740f822 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe663fff640 1 -- 172.21.15.37:0/268720886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680ac410 con 0x7fe66c070f70 2023-07-09T22:01:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe663fff640 1 -- 172.21.15.37:0/268720886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6680ac570 con 0x7fe66c070f70 2023-07-09T22:01:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe663fff640 1 -- 172.21.15.37:0/268720886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680ac900 con 0x7fe66c070f70 2023-07-09T22:01:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- 172.21.15.37:0/268720886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 msgr2=0x7fe66c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 --2- 172.21.15.37:0/268720886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c06ed10 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7fe66c06a2c0 tx=0x7fe66801c3b0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- 172.21.15.37:0/268720886 shutdown_connections 2023-07-09T22:01:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 --2- 172.21.15.37:0/268720886 >> v2:172.21.15.119:3300/0 conn(0x7fe66c06b880 0x7fe66c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 --2- 172.21.15.37:0/268720886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c06ed10 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- 172.21.15.37:0/268720886 >> 172.21.15.37:0/268720886 conn(0x7fe66c0694f0 msgr2=0x7fe66c0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- 172.21.15.37:0/268720886 shutdown_connections 2023-07-09T22:01:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- 172.21.15.37:0/268720886 wait complete. 2023-07-09T22:01:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 Processor -- start 2023-07-09T22:01:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.161+0000 7fe67365c640 1 -- start start 2023-07-09T22:01:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 0x7fe66c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 0x7fe66c13d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c156c00 con 0x7fe66c070f70 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c13eba0 con 0x7fe66c1606f0 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66c141dd0 con 0x7fe66c06b880 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60586/0 (socket says 172.21.15.37:60586) 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 -- 172.21.15.37:0/146222770 learned_addr learned my addr 172.21.15.37:0/146222770 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe671bf9640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 0x7fe66c13d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe6713f8640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 0x7fe66c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 -- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 msgr2=0x7fe66c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 0x7fe66c1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 -- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 msgr2=0x7fe66c13d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 0x7fe66c13d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 -- 172.21.15.37:0/146222770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680094d0 con 0x7fe66c070f70 2023-07-09T22:01:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe671bf9640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 0x7fe66c13d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe6713f8640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 0x7fe66c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:44.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe670bf7640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e870 tx=0x7fe65c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c009510 con 0x7fe66c070f70 2023-07-09T22:01:44.174 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00eec0 con 0x7fe66c070f70 2023-07-09T22:01:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe66c142020 con 0x7fe66c070f70 2023-07-09T22:01:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00cae0 con 0x7fe66c070f70 2023-07-09T22:01:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66c1423b0 con 0x7fe66c070f70 2023-07-09T22:01:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.165+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66c142980 con 0x7fe66c070f70 2023-07-09T22:01:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.169+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fe65c00cc60 con 0x7fe66c070f70 2023-07-09T22:01:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.169+0000 7fe661ffb640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 0x7fe650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.169+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fe65c084360 con 0x7fe66c070f70 2023-07-09T22:01:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.169+0000 7fe6713f8640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 0x7fe650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.169+0000 7fe6713f8640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 0x7fe650068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ae000 tx=0x7fe668008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.173+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe65c051330 con 0x7fe66c070f70 2023-07-09T22:01:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.325+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe66c066bc0 con 0x7fe66c070f70 2023-07-09T22:01:44.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.325+0000 7fe661ffb640 1 -- 172.21.15.37:0/146222770 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe65c054950 con 0x7fe66c070f70 2023-07-09T22:01:44.334 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:01:44.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 msgr2=0x7fe650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 0x7fe650068930 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe6680ae000 tx=0x7fe668008040 comp rx=0 tx=0).stop 2023-07-09T22:01:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 msgr2=0x7fe66c0b3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7fe65c00e870 tx=0x7fe65c00ec70 comp rx=0 tx=0).stop 2023-07-09T22:01:44.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 shutdown_connections 2023-07-09T22:01:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fe650066480 0x7fe650068930 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe66c1606f0 0x7fe66c13d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe66c070f70 0x7fe66c0b3b00 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 --2- 172.21.15.37:0/146222770 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe66c06b880 0x7fe66c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 >> 172.21.15.37:0/146222770 conn(0x7fe66c0694f0 msgr2=0x7fe66c0699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 shutdown_connections 2023-07-09T22:01:44.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.329+0000 7fe67365c640 1 -- 172.21.15.37:0/146222770 wait complete. 2023-07-09T22:01:44.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:01:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.493+0000 7ffae1b2c640 1 Processor -- start 2023-07-09T22:01:44.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.493+0000 7ffae1b2c640 1 -- start start 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffae1b2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffadc15bb90 0x7ffadc0ce170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffae1b2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc0b5370 con 0x7ffadc06f990 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffae1b2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc0cd6d0 con 0x7ffadc0b4bf0 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffae1b2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0cdd50 con 0x7ffadc15bb90 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffadc15bb90 0x7ffadc0ce170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffadc15bb90 0x7ffadc0ce170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60600/0 (socket says 172.21.15.37:60600) 2023-07-09T22:01:44.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 -- 172.21.15.37:0/1215020196 learned_addr learned my addr 172.21.15.37:0/1215020196 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 -- 172.21.15.37:0/1215020196 >> v1:172.21.15.119:6789/0 conn(0x7ffadc0b4bf0 legacy=0x7ffadc06f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:44.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 -- 172.21.15.37:0/1215020196 >> v1:172.21.15.37:6789/0 conn(0x7ffadc06f990 legacy=0x7ffadc15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.497+0000 7ffadb7fe640 1 -- 172.21.15.37:0/1215020196 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0b5090 con 0x7ffadc15bb90 2023-07-09T22:01:44.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffadb7fe640 1 --2- 172.21.15.37:0/1215020196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc0ce170 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009870 tx=0x7ffacc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e201a93d2e18dc98 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffada7fc640 1 -- 172.21.15.37:0/1215020196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0ac630 con 0x7ffadc15bb90 2023-07-09T22:01:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffada7fc640 1 -- 172.21.15.37:0/1215020196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0ac790 con 0x7ffadc15bb90 2023-07-09T22:01:44.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffada7fc640 1 -- 172.21.15.37:0/1215020196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0acb20 con 0x7ffadc15bb90 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- 172.21.15.37:0/1215020196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 msgr2=0x7ffadc0ce170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/1215020196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc0ce170 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009870 tx=0x7ffacc01c3b0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- 172.21.15.37:0/1215020196 shutdown_connections 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/1215020196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc0ce170 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- 172.21.15.37:0/1215020196 >> 172.21.15.37:0/1215020196 conn(0x7ffadc0cbcc0 msgr2=0x7ffadc0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- 172.21.15.37:0/1215020196 shutdown_connections 2023-07-09T22:01:44.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- 172.21.15.37:0/1215020196 wait complete. 2023-07-09T22:01:44.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 Processor -- start 2023-07-09T22:01:44.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.501+0000 7ffae1b2c640 1 -- start start 2023-07-09T22:01:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffadc06f990 0x7ffadc141d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 0x7ffadc15ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0c8d50 con 0x7ffadc15bb90 2023-07-09T22:01:44.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1526d0 con 0x7ffadc0b4bf0 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1529b0 con 0x7ffadc06f990 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60602/0 (socket says 172.21.15.37:60602) 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 -- 172.21.15.37:0/2485450138 learned_addr learned my addr 172.21.15.37:0/2485450138 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadb7fe640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffadc06f990 0x7ffadc141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadaffd640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 0x7ffadc15ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 -- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffadc06f990 msgr2=0x7ffadc141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffadc06f990 0x7ffadc141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 -- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 msgr2=0x7ffadc15ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 0x7ffadc15ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 -- 172.21.15.37:0/2485450138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0094d0 con 0x7ffadc15bb90 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadaffd640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 0x7ffadc15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:44.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffadbfff640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7ffad400c730 tx=0x7ffad400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4003b80 con 0x7ffadc15bb90 2023-07-09T22:01:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad4003ce0 con 0x7ffadc15bb90 2023-07-09T22:01:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad400aa30 con 0x7ffadc15bb90 2023-07-09T22:01:44.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0c8690 con 0x7ffadc15bb90 2023-07-09T22:01:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc14e6e0 con 0x7ffadc15bb90 2023-07-09T22:01:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc066bc0 con 0x7ffadc15bb90 2023-07-09T22:01:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.505+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7ffad400ab90 con 0x7ffadc15bb90 2023-07-09T22:01:44.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.509+0000 7ffac3fff640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 0x7ffac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.509+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7ffad4083f10 con 0x7ffadc15bb90 2023-07-09T22:01:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.509+0000 7ffadb7fe640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 0x7ffac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.509+0000 7ffadb7fe640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 0x7ffac8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0ae000 tx=0x7ffacc008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.513+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffad4051010 con 0x7ffadc15bb90 2023-07-09T22:01:44.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.669+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffadc15f370 con 0x7ffadc15bb90 2023-07-09T22:01:44.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.669+0000 7ffac3fff640 1 -- 172.21.15.37:0/2485450138 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffad4054630 con 0x7ffadc15bb90 2023-07-09T22:01:44.676 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:01:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 msgr2=0x7ffac8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 0x7ffac8068930 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0ae000 tx=0x7ffacc008040 comp rx=0 tx=0).stop 2023-07-09T22:01:44.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 msgr2=0x7ffadc15d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7ffad400c730 tx=0x7ffad400cbf0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 shutdown_connections 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ffac8066480 0x7ffac8068930 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffadc15bb90 0x7ffadc15d210 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffadc0b4bf0 0x7ffadc15ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 --2- 172.21.15.37:0/2485450138 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffadc06f990 0x7ffadc141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 >> 172.21.15.37:0/2485450138 conn(0x7ffadc0cbcc0 msgr2=0x7ffadc14b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 shutdown_connections 2023-07-09T22:01:44.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.673+0000 7ffae1b2c640 1 -- 172.21.15.37:0/2485450138 wait complete. 2023-07-09T22:01:44.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T22:01:44.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 Processor -- start 2023-07-09T22:01:44.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 -- start start 2023-07-09T22:01:44.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0c006fa40 0x7fd0c006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c009c9d0 con 0x7fd0c00b08d0 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c0070400 con 0x7fd0c006fa40 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c789e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c009c120 con 0x7fd0c015bd40 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0c006fa40 0x7fd0c006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0c006fa40 0x7fd0c006fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60618/0 (socket says 172.21.15.37:60618) 2023-07-09T22:01:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 -- 172.21.15.37:0/105258398 learned_addr learned my addr 172.21.15.37:0/105258398 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c563a640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 -- 172.21.15.37:0/105258398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 msgr2=0x7fd0c0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:44.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c0099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 -- 172.21.15.37:0/105258398 >> v1:172.21.15.119:6789/0 conn(0x7fd0c00b08d0 legacy=0x7fd0c006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c5e3b640 1 -- 172.21.15.37:0/105258398 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c015c110 con 0x7fd0c006fa40 2023-07-09T22:01:44.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.837+0000 7fd0c563a640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c5e3b640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c006fa40 0x7fd0c006fec0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e50 tx=0x7fd0b801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63376a2a0959dc28 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0b7fff640 1 -- 172.21.15.37:0/105258398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80a5640 con 0x7fd0c006fa40 2023-07-09T22:01:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0b7fff640 1 -- 172.21.15.37:0/105258398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b80a57a0 con 0x7fd0c006fa40 2023-07-09T22:01:44.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0b7fff640 1 -- 172.21.15.37:0/105258398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b80a5b30 con 0x7fd0c006fa40 2023-07-09T22:01:44.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- 172.21.15.37:0/105258398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c006fa40 msgr2=0x7fd0c006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c006fa40 0x7fd0c006fec0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8009e50 tx=0x7fd0b801c980 comp rx=0 tx=0).stop 2023-07-09T22:01:44.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- 172.21.15.37:0/105258398 shutdown_connections 2023-07-09T22:01:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c006fa40 0x7fd0c006fec0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 --2- 172.21.15.37:0/105258398 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c0099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- 172.21.15.37:0/105258398 >> 172.21.15.37:0/105258398 conn(0x7fd0c00694f0 msgr2=0x7fd0c00698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- 172.21.15.37:0/105258398 shutdown_connections 2023-07-09T22:01:44.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- 172.21.15.37:0/105258398 wait complete. 2023-07-09T22:01:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 Processor -- start 2023-07-09T22:01:44.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.841+0000 7fd0c789e640 1 -- start start 2023-07-09T22:01:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0c006fa40 0x7fd0c015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c01f7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00ae110 con 0x7fd0c00b08d0 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c015e1a0 con 0x7fd0c006fa40 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c015e480 con 0x7fd0c015bd40 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c563a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0c006fa40 0x7fd0c015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60632/0 (socket says 172.21.15.37:60632) 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 -- 172.21.15.37:0/2102209796 learned_addr learned my addr 172.21.15.37:0/2102209796 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:44.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c5e3b640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c01f7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 -- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 msgr2=0x7fd0c01f7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c01f7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 -- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0c006fa40 msgr2=0x7fd0c015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0c006fa40 0x7fd0c015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 -- 172.21.15.37:0/2102209796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b8009b30 con 0x7fd0c00b08d0 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c5e3b640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c01f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c4e39640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c390 tx=0x7fd0b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b00052d0 con 0x7fd0c00b08d0 2023-07-09T22:01:44.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0005430 con 0x7fd0c00b08d0 2023-07-09T22:01:44.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00ae3d0 con 0x7fd0c00b08d0 2023-07-09T22:01:44.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0003820 con 0x7fd0c00b08d0 2023-07-09T22:01:44.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c0153800 con 0x7fd0c00b08d0 2023-07-09T22:01:44.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.845+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c0066bc0 con 0x7fd0c00b08d0 2023-07-09T22:01:44.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.849+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd0b0003980 con 0x7fd0c00b08d0 2023-07-09T22:01:44.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.849+0000 7fd0b5ffb640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 0x7fd0a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:44.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.849+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fd0b0083650 con 0x7fd0c00b08d0 2023-07-09T22:01:44.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.849+0000 7fd0c563a640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 0x7fd0a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:44.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.849+0000 7fd0c563a640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 0x7fd0a4068960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009950 tx=0x7fd0bc008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:44.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:44.853+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0b0050770 con 0x7fd0c00b08d0 2023-07-09T22:01:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.017+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd0c00aa3d0 con 0x7fd0c00b08d0 2023-07-09T22:01:45.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.017+0000 7fd0b5ffb640 1 -- 172.21.15.37:0/2102209796 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v197) v1 ==== 80+0+476 (secure 0 0 0) 0x7fd0b0053d90 con 0x7fd0c00b08d0 2023-07-09T22:01:45.027 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2890812838 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.027 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3021106069 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.027 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2635851899 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.028 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4271011706 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.029 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3528085809 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.029 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.029 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.029 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4247408657 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T22:01:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 msgr2=0x7fd0a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 0x7fd0a4068960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009950 tx=0x7fd0bc008040 comp rx=0 tx=0).stop 2023-07-09T22:01:45.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 msgr2=0x7fd0c01f7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c390 tx=0x7fd0b000c850 comp rx=0 tx=0).stop 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 shutdown_connections 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd0a40664b0 0x7fd0a4068960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0c015bd40 0x7fd0c01f7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c00b08d0 0x7fd0c01f7340 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 --2- 172.21.15.37:0/2102209796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0c006fa40 0x7fd0c015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 >> 172.21.15.37:0/2102209796 conn(0x7fd0c00694f0 msgr2=0x7fd0c006b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 shutdown_connections 2023-07-09T22:01:45.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.021+0000 7fd0c789e640 1 -- 172.21.15.37:0/2102209796 wait complete. 2023-07-09T22:01:45.045 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:45.045 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:45.055 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:45.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 Processor -- start 2023-07-09T22:01:45.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 -- start start 2023-07-09T22:01:45.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 0x7f85ac099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85ac06fa40 0x7f85ac06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac09c9d0 con 0x7f85ac0b08d0 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac070400 con 0x7f85ac06fa40 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b312c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac09c120 con 0x7f85ac15bd40 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85ac06fa40 0x7f85ac06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f85ac06fa40 0x7f85ac06fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60636/0 (socket says 172.21.15.37:60636) 2023-07-09T22:01:45.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 -- 172.21.15.37:0/2840022970 learned_addr learned my addr 172.21.15.37:0/2840022970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b0ec8640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 0x7f85ac099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 -- 172.21.15.37:0/2840022970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 msgr2=0x7f85ac099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:45.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 0x7f85ac099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 -- 172.21.15.37:0/2840022970 >> v1:172.21.15.37:6789/0 conn(0x7f85ac0b08d0 legacy=0x7f85ac06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b16c9640 1 -- 172.21.15.37:0/2840022970 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac15c110 con 0x7f85ac06fa40 2023-07-09T22:01:45.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.237+0000 7f85b0ec8640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 0x7f85ac099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:45.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b16c9640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac06fa40 0x7f85ac06fec0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e1157b0b0fe8bd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85ab7fe640 1 -- 172.21.15.37:0/2840022970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5640 con 0x7f85ac06fa40 2023-07-09T22:01:45.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85ab7fe640 1 -- 172.21.15.37:0/2840022970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40a57a0 con 0x7f85ac06fa40 2023-07-09T22:01:45.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85ab7fe640 1 -- 172.21.15.37:0/2840022970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40a5b30 con 0x7f85ac06fa40 2023-07-09T22:01:45.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 -- 172.21.15.37:0/2840022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac06fa40 msgr2=0x7f85ac06fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac06fa40 0x7f85ac06fec0 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7f85a4009e50 tx=0x7f85a401c980 comp rx=0 tx=0).stop 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 -- 172.21.15.37:0/2840022970 shutdown_connections 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac06fa40 0x7f85ac06fec0 unknown :-1 s=CLOSED pgs=2059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 --2- 172.21.15.37:0/2840022970 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac15bd40 0x7f85ac099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 -- 172.21.15.37:0/2840022970 >> 172.21.15.37:0/2840022970 conn(0x7f85ac0694f0 msgr2=0x7f85ac0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 -- 172.21.15.37:0/2840022970 shutdown_connections 2023-07-09T22:01:45.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.241+0000 7f85b312c640 1 -- 172.21.15.37:0/2840022970 wait complete. 2023-07-09T22:01:45.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 Processor -- start 2023-07-09T22:01:45.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- start start 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac06fa40 0x7f85ac15c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b08d0 0x7f85ac15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac15b360 con 0x7f85ac15bd40 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac15b080 con 0x7f85ac06fa40 2023-07-09T22:01:45.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac15e890 con 0x7f85ac0b08d0 2023-07-09T22:01:45.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60650/0 (socket says 172.21.15.37:60650) 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 -- 172.21.15.37:0/4128527399 learned_addr learned my addr 172.21.15.37:0/4128527399 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b0ec8640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac06fa40 0x7f85ac15c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85abfff640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b08d0 0x7f85ac15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 -- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b08d0 msgr2=0x7f85ac15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b08d0 0x7f85ac15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 -- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac06fa40 msgr2=0x7f85ac15c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac06fa40 0x7f85ac15c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 -- 172.21.15.37:0/4128527399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a4009b30 con 0x7f85ac15bd40 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b16c9640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f85a40af040 tx=0x7f85a4019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b8670 con 0x7f85ac15bd40 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40b87d0 con 0x7f85ac15bd40 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac15eb70 con 0x7f85ac15bd40 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40b8b80 con 0x7f85ac15bd40 2023-07-09T22:01:45.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.245+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac152c10 con 0x7f85ac15bd40 2023-07-09T22:01:45.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac15e6f0 con 0x7f85ac15bd40 2023-07-09T22:01:45.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f85a40b8ce0 con 0x7f85ac15bd40 2023-07-09T22:01:45.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85a97fa640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 0x7f8590068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f85a411f620 con 0x7f85ac15bd40 2023-07-09T22:01:45.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85b0ec8640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 0x7f8590068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.249+0000 7f85b0ec8640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 0x7f8590068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c900 tx=0x7f85a0008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.253+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85ac15e6f0 con 0x7f85ac15bd40 2023-07-09T22:01:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.413+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85ac15e6f0 con 0x7f85ac15bd40 2023-07-09T22:01:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.413+0000 7f85a97fa640 1 -- 172.21.15.37:0/4128527399 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18878 (secure 0 0 0) 0x7f85ac15e6f0 con 0x7f85ac15bd40 2023-07-09T22:01:45.421 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:45.421 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":197,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:41.285428+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 msgr2=0x7f8590068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 0x7f8590068930 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c900 tx=0x7f85a0008040 comp rx=0 tx=0).stop 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 msgr2=0x7f85ac15aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7f85a40af040 tx=0x7f85a4019720 comp rx=0 tx=0).stop 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 shutdown_connections 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f8590066480 0x7f8590068930 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f85ac15bd40 0x7f85ac15aaa0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f85ac0b08d0 0x7f85ac15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 --2- 172.21.15.37:0/4128527399 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f85ac06fa40 0x7f85ac15c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 >> 172.21.15.37:0/4128527399 conn(0x7f85ac0694f0 msgr2=0x7f85ac0ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 shutdown_connections 2023-07-09T22:01:45.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.417+0000 7f85b312c640 1 -- 172.21.15.37:0/4128527399 wait complete. 2023-07-09T22:01:45.443 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T22:01:21.205098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T22:01:22.084065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:45.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:45.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 Processor -- start 2023-07-09T22:01:45.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 -- start start 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f29340cf630 0x7f293406b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293415fa40 con 0x7f2934070f70 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293415fd20 con 0x7f293406ed10 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.585+0000 7f293c311640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2934071340 con 0x7f29340cf630 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a0ad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2934070f70 0x7f29341601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43862/0 (socket says 172.21.15.37:43862) 2023-07-09T22:01:45.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a0ad640 1 -- 172.21.15.37:0/1389199350 learned_addr learned my addr 172.21.15.37:0/1389199350 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a8ae640 1 --2- 172.21.15.37:0/1389199350 >> v2:172.21.15.119:3300/0 conn(0x7f29340cf630 0x7f293406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59655043 0 0) 0x7f293415fa40 con 0x7f2934070f70 2023-07-09T22:01:45.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2920003530 con 0x7f2934070f70 2023-07-09T22:01:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 686098588 0 0) 0x7f293415fd20 con 0x7f293406ed10 2023-07-09T22:01:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f293415fa40 con 0x7f293406ed10 2023-07-09T22:01:45.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1677885479 0 0) 0x7f2920003530 con 0x7f2934070f70 2023-07-09T22:01:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 >> v2:172.21.15.119:3300/0 conn(0x7f29340cf630 msgr2=0x7f293406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 --2- 172.21.15.37:0/1389199350 >> v2:172.21.15.119:3300/0 conn(0x7f29340cf630 0x7f293406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 >> v1:172.21.15.119:6789/0 conn(0x7f293406ed10 legacy=0x7f29340cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293406f160 con 0x7f2934070f70 2023-07-09T22:01:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2930001680 con 0x7f2934070f70 2023-07-09T22:01:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 >> v1:172.21.15.37:6789/0 conn(0x7f2934070f70 legacy=0x7f29341601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920003b10 0x7f2920003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 0x7f2920004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200051f0 0x7f292000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934071340 con 0x7f29200047d0 2023-07-09T22:01:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292000c130 con 0x7f2920003b10 2023-07-09T22:01:45.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292000c2f0 con 0x7f29200051f0 2023-07-09T22:01:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a8ae640 1 --2- 172.21.15.37:0/1389199350 >> v2:172.21.15.119:3300/0 conn(0x7f29340cf630 0x7f293406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 0x7f2920004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a0ad640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920003b10 0x7f2920003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a8ae640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200051f0 0x7f292000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 -- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200051f0 msgr2=0x7f292000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200051f0 0x7f292000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 -- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920003b10 msgr2=0x7f2920003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2920003b10 0x7f2920003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f29398ac640 1 -- 172.21.15.37:0/1389199350 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920003530 con 0x7f29200047d0 2023-07-09T22:01:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a8ae640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200051f0 0x7f292000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.589+0000 7f293a8ae640 1 -- 172.21.15.37:0/1389199350 reap_dead start 2023-07-09T22:01:45.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f29398ac640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 0x7f2920004c40 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f29240018c0 tx=0x7f292401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d60fbd85ef3dbf server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240052d0 con 0x7f29200047d0 2023-07-09T22:01:45.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29240a7050 con 0x7f29200047d0 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f29390ab640 1 -- 172.21.15.37:0/1389199350 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924003820 con 0x7f29200047d0 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 msgr2=0x7f2920004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 0x7f2920004c40 secure :-1 s=READY pgs=2062 cs=0 l=1 rev1=1 crypto rx=0x7f29240018c0 tx=0x7f292401c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- 172.21.15.37:0/1389199350 shutdown_connections 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 --2- 172.21.15.37:0/1389199350 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29200047d0 0x7f2920004c40 unknown :-1 s=CLOSED pgs=2062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- 172.21.15.37:0/1389199350 >> 172.21.15.37:0/1389199350 conn(0x7f29340694f0 msgr2=0x7f29340698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- 172.21.15.37:0/1389199350 shutdown_connections 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- 172.21.15.37:0/1389199350 wait complete. 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 Processor -- start 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.593+0000 7f293c311640 1 -- start start 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200047d0 0x7f2934156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2934133c70 0x7f2934134110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29340b4470 con 0x7f2934140e00 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2934156770 con 0x7f2934133c70 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2934134650 con 0x7f29200047d0 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60676/0 (socket says 172.21.15.37:60676) 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 -- 172.21.15.37:0/4018814266 learned_addr learned my addr 172.21.15.37:0/4018814266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293a0ad640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200047d0 0x7f2934156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293a8ae640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2934133c70 0x7f2934134110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 -- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200047d0 msgr2=0x7f2934156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200047d0 0x7f2934156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 -- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2934133c70 msgr2=0x7f2934134110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2934133c70 0x7f2934134110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 -- 172.21.15.37:0/4018814266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29340b4dd0 con 0x7f2934140e00 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f29398ac640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f29240ad040 tx=0x7f2920005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29240038c0 con 0x7f2934140e00 2023-07-09T22:01:45.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2924003a20 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2924003d90 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29340b37f0 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29340b3db0 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29340b45b0 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.597+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f29240b4430 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.601+0000 7f292affd640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 0x7f2918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.601+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f292411e640 con 0x7f2934140e00 2023-07-09T22:01:45.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.601+0000 7f293a0ad640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 0x7f2918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.601+0000 7f293a0ad640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 0x7f2918068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2930001ec0 tx=0x7f2930001e10 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.605+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f29340b45b0 con 0x7f2934140e00 2023-07-09T22:01:45.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.757+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29340b45b0 con 0x7f2934140e00 2023-07-09T22:01:45.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.757+0000 7f292affd640 1 -- 172.21.15.37:0/4018814266 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29340b45b0 con 0x7f2934140e00 2023-07-09T22:01:45.765 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:45.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 msgr2=0x7f2918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 0x7f2918068930 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2930001ec0 tx=0x7f2930001e10 comp rx=0 tx=0).stop 2023-07-09T22:01:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 msgr2=0x7f29340b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 secure :-1 s=READY pgs=2063 cs=0 l=1 rev1=1 crypto rx=0x7f29240ad040 tx=0x7f2920005800 comp rx=0 tx=0).stop 2023-07-09T22:01:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 shutdown_connections 2023-07-09T22:01:45.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f2918066480 0x7f2918068930 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2934133c70 0x7f2934134110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2934140e00 0x7f29340b4890 unknown :-1 s=CLOSED pgs=2063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 --2- 172.21.15.37:0/4018814266 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f29200047d0 0x7f2934156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 >> 172.21.15.37:0/4018814266 conn(0x7f29340694f0 msgr2=0x7f29340d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 shutdown_connections 2023-07-09T22:01:45.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.761+0000 7f293c311640 1 -- 172.21.15.37:0/4018814266 wait complete. 2023-07-09T22:01:45.786 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:45.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.925+0000 7f65d17e2640 1 Processor -- start 2023-07-09T22:01:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.925+0000 7f65d17e2640 1 -- start start 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65d17e2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65cc06c7f0 0x7f65cc06cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65d17e2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f65cc15bc80 0x7f65cc0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65d17e2640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65cc0701a0 con 0x7f65cc06f470 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65d17e2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc0b68e0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65d17e2640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65cc06d100 con 0x7f65cc15bc80 2023-07-09T22:01:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65cc06c7f0 0x7f65cc06cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f65cc06c7f0 0x7f65cc06cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60684/0 (socket says 172.21.15.37:60684) 2023-07-09T22:01:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 -- 172.21.15.37:0/1561974772 learned_addr learned my addr 172.21.15.37:0/1561974772 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65cb7fe640 1 --2- 172.21.15.37:0/1561974772 >> v2:172.21.15.119:3300/0 conn(0x7f65cc15bc80 0x7f65cc0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 -- 172.21.15.37:0/1561974772 >> v2:172.21.15.119:3300/0 conn(0x7f65cc15bc80 msgr2=0x7f65cc0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 --2- 172.21.15.37:0/1561974772 >> v2:172.21.15.119:3300/0 conn(0x7f65cc15bc80 0x7f65cc0b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 -- 172.21.15.37:0/1561974772 >> v1:172.21.15.37:6789/0 conn(0x7f65cc06f470 legacy=0x7f65cc0b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.929+0000 7f65caffd640 1 -- 172.21.15.37:0/1561974772 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65cc06f900 con 0x7f65cc06c7f0 2023-07-09T22:01:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65caffd640 1 --2- 172.21.15.37:0/1561974772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc06cbc0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f65cc06d460 tx=0x7f65bc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dea7d3023d861dc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65ca7fc640 1 -- 172.21.15.37:0/1561974772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0a89f0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65ca7fc640 1 -- 172.21.15.37:0/1561974772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc0a8b50 con 0x7f65cc06c7f0 2023-07-09T22:01:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65ca7fc640 1 -- 172.21.15.37:0/1561974772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0b0440 con 0x7f65cc06c7f0 2023-07-09T22:01:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- 172.21.15.37:0/1561974772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 msgr2=0x7f65cc06cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- 172.21.15.37:0/1561974772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc06cbc0 secure :-1 s=READY pgs=2065 cs=0 l=1 rev1=1 crypto rx=0x7f65cc06d460 tx=0x7f65bc01ecf0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- 172.21.15.37:0/1561974772 shutdown_connections 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- 172.21.15.37:0/1561974772 >> v2:172.21.15.119:3300/0 conn(0x7f65cc15bc80 0x7f65cc0b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- 172.21.15.37:0/1561974772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc06cbc0 unknown :-1 s=CLOSED pgs=2065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- 172.21.15.37:0/1561974772 >> 172.21.15.37:0/1561974772 conn(0x7f65cc0ceed0 msgr2=0x7f65cc0cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- 172.21.15.37:0/1561974772 shutdown_connections 2023-07-09T22:01:45.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- 172.21.15.37:0/1561974772 wait complete. 2023-07-09T22:01:45.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 Processor -- start 2023-07-09T22:01:45.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- start start 2023-07-09T22:01:45.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65cc06f470 0x7f65cc15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65cc15bc80 0x7f65cc146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc160040 con 0x7f65cc06c7f0 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc149cd0 con 0x7f65cc15bc80 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.933+0000 7f65d17e2640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65cc15a920 con 0x7f65cc06f470 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60700/0 (socket says 172.21.15.37:60700) 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 -- 172.21.15.37:0/122676440 learned_addr learned my addr 172.21.15.37:0/122676440 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:45.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 -- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65cc06f470 msgr2=0x7f65cc15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65cc06f470 0x7f65cc15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 -- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65cc15bc80 msgr2=0x7f65cc146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65cc15bc80 0x7f65cc146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:45.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 -- 172.21.15.37:0/122676440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0094d0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65caffd640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f65bc01b900 tx=0x7f65bc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0ba600 con 0x7f65cc06c7f0 2023-07-09T22:01:45.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65bc0ba760 con 0x7f65cc06c7f0 2023-07-09T22:01:45.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65bc0bab10 con 0x7f65cc06c7f0 2023-07-09T22:01:45.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65cc147230 con 0x7f65cc06c7f0 2023-07-09T22:01:45.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65cc1493a0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65cc06fea0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f65bc0bac70 con 0x7f65cc06c7f0 2023-07-09T22:01:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 0x7f65ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.937+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f65bc1228b0 con 0x7f65cc06c7f0 2023-07-09T22:01:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.941+0000 7f65c3fff640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 0x7f65ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:45.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.941+0000 7f65c3fff640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 0x7f65ac068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65b4000f70 tx=0x7f65b40079c0 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:45.941+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f65cc06fea0 con 0x7f65cc06c7f0 2023-07-09T22:01:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65cc06fea0 con 0x7f65cc06c7f0 2023-07-09T22:01:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65c37fe640 1 -- 172.21.15.37:0/122676440 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65cc06fea0 con 0x7f65cc06c7f0 2023-07-09T22:01:46.102 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:46.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 msgr2=0x7f65ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 0x7f65ac068930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65b4000f70 tx=0x7f65b40079c0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 msgr2=0x7f65cc15fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 secure :-1 s=READY pgs=2066 cs=0 l=1 rev1=1 crypto rx=0x7f65bc01b900 tx=0x7f65bc01ba90 comp rx=0 tx=0).stop 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 shutdown_connections 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f65ac066480 0x7f65ac068930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f65cc15bc80 0x7f65cc146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f65cc06f470 0x7f65cc15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 --2- 172.21.15.37:0/122676440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f65cc06c7f0 0x7f65cc15fb00 unknown :-1 s=CLOSED pgs=2066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 >> 172.21.15.37:0/122676440 conn(0x7f65cc0ceed0 msgr2=0x7f65cc06b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 shutdown_connections 2023-07-09T22:01:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.097+0000 7f65d17e2640 1 -- 172.21.15.37:0/122676440 wait complete. 2023-07-09T22:01:46.124 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:01:46.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 Processor -- start 2023-07-09T22:01:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 -- start start 2023-07-09T22:01:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 0x7f05f80b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f806e9f0 0x7f05f806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f806f0f0 con 0x7f05f81600d0 2023-07-09T22:01:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f806dbd0 con 0x7f05f806e9f0 2023-07-09T22:01:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05ff911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f81614b0 con 0x7f05f80b17d0 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f806e9f0 0x7f05f806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05f806e9f0 0x7f05f806d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60704/0 (socket says 172.21.15.37:60704) 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 -- 172.21.15.37:0/1900377583 learned_addr learned my addr 172.21.15.37:0/1900377583 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fceac640 1 --2- 172.21.15.37:0/1900377583 >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 0x7f05f80b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 -- 172.21.15.37:0/1900377583 >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 msgr2=0x7f05f80b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 --2- 172.21.15.37:0/1900377583 >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 0x7f05f80b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 -- 172.21.15.37:0/1900377583 >> v1:172.21.15.119:6789/0 conn(0x7f05f81600d0 legacy=0x7f05f80b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fdeae640 1 -- 172.21.15.37:0/1900377583 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f806f3d0 con 0x7f05f806e9f0 2023-07-09T22:01:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.265+0000 7f05fceac640 1 --2- 172.21.15.37:0/1900377583 >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 0x7f05f80b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05fdeae640 1 --2- 172.21.15.37:0/1900377583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f806d690 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f05f806d2a0 tx=0x7f05f001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a8d1ec0e3b3dd9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05effff640 1 -- 172.21.15.37:0/1900377583 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00a5860 con 0x7f05f806e9f0 2023-07-09T22:01:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05effff640 1 -- 172.21.15.37:0/1900377583 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f00a59c0 con 0x7f05f806e9f0 2023-07-09T22:01:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05effff640 1 -- 172.21.15.37:0/1900377583 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00a5d50 con 0x7f05f806e9f0 2023-07-09T22:01:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 -- 172.21.15.37:0/1900377583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 msgr2=0x7f05f806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 --2- 172.21.15.37:0/1900377583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f806d690 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7f05f806d2a0 tx=0x7f05f001c9a0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 -- 172.21.15.37:0/1900377583 shutdown_connections 2023-07-09T22:01:46.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 --2- 172.21.15.37:0/1900377583 >> v2:172.21.15.119:3300/0 conn(0x7f05f80b17d0 0x7f05f80b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 --2- 172.21.15.37:0/1900377583 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f806d690 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 -- 172.21.15.37:0/1900377583 >> 172.21.15.37:0/1900377583 conn(0x7f05f80ce0f0 msgr2=0x7f05f80ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 -- 172.21.15.37:0/1900377583 shutdown_connections 2023-07-09T22:01:46.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.269+0000 7f05ff911640 1 -- 172.21.15.37:0/1900377583 wait complete. 2023-07-09T22:01:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 Processor -- start 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- start start 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 0x7f05f814c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05f81600d0 0x7f05f8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814e280 con 0x7f05f806e9f0 2023-07-09T22:01:46.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814e560 con 0x7f05f80b17d0 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f814e840 con 0x7f05f81600d0 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60718/0 (socket says 172.21.15.37:60718) 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 -- 172.21.15.37:0/2827074156 learned_addr learned my addr 172.21.15.37:0/2827074156 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fceac640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 0x7f05f814c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fdeae640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05f81600d0 0x7f05f8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 -- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05f81600d0 msgr2=0x7f05f8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05f81600d0 0x7f05f8156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 -- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 msgr2=0x7f05f814c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 0x7f05f814c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 -- 172.21.15.37:0/2827074156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009b30 con 0x7f05f806e9f0 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fceac640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 0x7f05f814c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05fd6ad640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c3c0 tx=0x7f05f400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40052d0 con 0x7f05f806e9f0 2023-07-09T22:01:46.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f4005430 con 0x7f05f806e9f0 2023-07-09T22:01:46.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4003840 con 0x7f05f806e9f0 2023-07-09T22:01:46.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f814eb20 con 0x7f05f806e9f0 2023-07-09T22:01:46.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f814cb40 con 0x7f05f806e9f0 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.273+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f814f040 con 0x7f05f806e9f0 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.277+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f05f40039a0 con 0x7f05f806e9f0 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.277+0000 7f05edffb640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 0x7f05dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.277+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f05f4083820 con 0x7f05f806e9f0 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.277+0000 7f05fceac640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 0x7f05dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.277+0000 7f05fceac640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 0x7f05dc068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05f81596a0 tx=0x7f05e8008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.281+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05f814f040 con 0x7f05f806e9f0 2023-07-09T22:01:46.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05f814f040 con 0x7f05f806e9f0 2023-07-09T22:01:46.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05edffb640 1 -- 172.21.15.37:0/2827074156 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05f814f040 con 0x7f05f806e9f0 2023-07-09T22:01:46.439 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:01:46.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 msgr2=0x7f05dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 0x7f05dc068930 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f05f81596a0 tx=0x7f05e8008040 comp rx=0 tx=0).stop 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 msgr2=0x7f05f8153eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c3c0 tx=0x7f05f400c880 comp rx=0 tx=0).stop 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 shutdown_connections 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f05dc066480 0x7f05dc068930 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05f81600d0 0x7f05f8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05f80b17d0 0x7f05f814c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 --2- 172.21.15.37:0/2827074156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05f806e9f0 0x7f05f8153eb0 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 >> 172.21.15.37:0/2827074156 conn(0x7f05f80ce0f0 msgr2=0x7f05f80ce4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 shutdown_connections 2023-07-09T22:01:46.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.433+0000 7f05ff911640 1 -- 172.21.15.37:0/2827074156 wait complete. 2023-07-09T22:01:46.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:01:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 Processor -- start 2023-07-09T22:01:46.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 -- start start 2023-07-09T22:01:46.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e4c06b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c15fa40 con 0x7f7e4c070f70 2023-07-09T22:01:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e4c15fd20 con 0x7f7e4c0cef20 2023-07-09T22:01:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e54434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c071340 con 0x7f7e4c06ed10 2023-07-09T22:01:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e521d0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7e4c070f70 0x7f7e4c1601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43878/0 (socket says 172.21.15.37:43878) 2023-07-09T22:01:46.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e521d0640 1 -- 172.21.15.37:0/3265419416 learned_addr learned my addr 172.21.15.37:0/3265419416 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e519cf640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e4c06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821903760 0 0) 0x7f7e4c15fa40 con 0x7f7e4c070f70 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e38003530 con 0x7f7e4c070f70 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206417093 0 0) 0x7f7e4c15fd20 con 0x7f7e4c0cef20 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e4c15fa40 con 0x7f7e4c0cef20 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2577579697 0 0) 0x7f7e38003530 con 0x7f7e4c070f70 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 msgr2=0x7f7e4c06b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e4c06b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 >> v1:172.21.15.119:6789/0 conn(0x7f7e4c0cef20 legacy=0x7f7e4c15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c06f160 con 0x7f7e4c070f70 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f7e48001600 con 0x7f7e4c070f70 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 >> v1:172.21.15.37:6789/0 conn(0x7f7e4c070f70 legacy=0x7f7e4c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38003b40 0x7f7e38003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380047d0 0x7f7e38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e380052a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c071340 con 0x7f7e38003b40 2023-07-09T22:01:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3800bb70 con 0x7f7e380047d0 2023-07-09T22:01:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3800bd30 con 0x7f7e4c06ed10 2023-07-09T22:01:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.601+0000 7f7e521d0640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38003b40 0x7f7e38003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e519cf640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380047d0 0x7f7e38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e529d1640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e380052a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 -- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 msgr2=0x7f7e380052a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e4c06ed10 0x7f7e380052a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 -- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380047d0 msgr2=0x7f7e38004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e380047d0 0x7f7e38004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 -- 172.21.15.37:0/3265419416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38003530 con 0x7f7e38003b40 2023-07-09T22:01:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e521d0640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38003b40 0x7f7e38003f30 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f7e48007f20 tx=0x7f7e4801caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b42cfa031cbd75 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48005ae0 con 0x7f7e38003b40 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e48005c60 con 0x7f7e38003b40 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.605+0000 7f7e511ce640 1 -- 172.21.15.37:0/3265419416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48007070 con 0x7f7e38003b40 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- 172.21.15.37:0/3265419416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38003b40 msgr2=0x7f7e38003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 --2- 172.21.15.37:0/3265419416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e38003b40 0x7f7e38003f30 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f7e48007f20 tx=0x7f7e4801caa0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 -- 172.21.15.37:0/3265419416 reap_dead start 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- 172.21.15.37:0/3265419416 shutdown_connections 2023-07-09T22:01:46.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- 172.21.15.37:0/3265419416 >> 172.21.15.37:0/3265419416 conn(0x7f7e4c0694f0 msgr2=0x7f7e4c0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- 172.21.15.37:0/3265419416 shutdown_connections 2023-07-09T22:01:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- 172.21.15.37:0/3265419416 wait complete. 2023-07-09T22:01:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 Processor -- start 2023-07-09T22:01:46.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- start start 2023-07-09T22:01:46.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 0x7f7e4c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e4c157030 0x7f7e4c1440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c1574a0 con 0x7f7e4c144630 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c155fc0 con 0x7f7e4c157030 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e54434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4c159780 con 0x7f7e38003b40 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60736/0 (socket says 172.21.15.37:60736) 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 -- 172.21.15.37:0/1897848685 learned_addr learned my addr 172.21.15.37:0/1897848685 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e519cf640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e4c157030 0x7f7e4c1440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e521d0640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 0x7f7e4c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 -- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 msgr2=0x7f7e4c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 0x7f7e4c156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 -- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e4c157030 msgr2=0x7f7e4c1440f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e4c157030 0x7f7e4c1440f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e529d1640 1 -- 172.21.15.37:0/1897848685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e4c158e50 con 0x7f7e4c144630 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.609+0000 7f7e521d0640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 0x7f7e4c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e529d1640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0ced70 tx=0x7f7e4400fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44006b60 con 0x7f7e4c144630 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e44006ce0 con 0x7f7e4c144630 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4c159130 con 0x7f7e4c144630 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e44003bc0 con 0x7f7e4c144630 2023-07-09T22:01:46.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4c158a70 con 0x7f7e4c144630 2023-07-09T22:01:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4c06ca60 con 0x7f7e4c144630 2023-07-09T22:01:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f7e44003d20 con 0x7f7e4c144630 2023-07-09T22:01:46.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 0x7f7e30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.613+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f7e44082f20 con 0x7f7e4c144630 2023-07-09T22:01:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.617+0000 7f7e521d0640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 0x7f7e30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.617+0000 7f7e521d0640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 0x7f7e30068960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e480ab000 tx=0x7f7e480a7070 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.617+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e44050020 con 0x7f7e4c144630 2023-07-09T22:01:46.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e4c066bc0 con 0x7f7e4c144630 2023-07-09T22:01:46.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e42ffd640 1 -- 172.21.15.37:0/1897848685 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e44053640 con 0x7f7e4c144630 2023-07-09T22:01:46.783 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:01:46.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 msgr2=0x7f7e30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 0x7f7e30068960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7e480ab000 tx=0x7f7e480a7070 comp rx=0 tx=0).stop 2023-07-09T22:01:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 msgr2=0x7f7e4c144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.777+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c0ced70 tx=0x7f7e4400fae0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 shutdown_connections 2023-07-09T22:01:46.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f7e300664b0 0x7f7e30068960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e4c144630 0x7f7e4c144aa0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7e4c157030 0x7f7e4c1440f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 --2- 172.21.15.37:0/1897848685 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7e38003b40 0x7f7e4c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 >> 172.21.15.37:0/1897848685 conn(0x7f7e4c0694f0 msgr2=0x7f7e4c06f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 shutdown_connections 2023-07-09T22:01:46.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.781+0000 7f7e54434640 1 -- 172.21.15.37:0/1897848685 wait complete. 2023-07-09T22:01:46.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T22:01:46.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 Processor -- start 2023-07-09T22:01:46.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 -- start start 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38080b08d0 0x7f380806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f380806cff0 0x7f380806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380809c9d0 con 0x7f380815bd40 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380809c120 con 0x7f380806cff0 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f38105fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380815c110 con 0x7f38080b08d0 2023-07-09T22:01:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380e396640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f380815bd40 0x7f3808099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43888/0 (socket says 172.21.15.37:43888) 2023-07-09T22:01:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380e396640 1 -- 172.21.15.37:0/2227111973 learned_addr learned my addr 172.21.15.37:0/2227111973 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380eb97640 1 --2- 172.21.15.37:0/2227111973 >> v2:172.21.15.37:3300/0 conn(0x7f380806cff0 0x7f380806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380db95640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38080b08d0 0x7f380806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380eb97640 1 -- 172.21.15.37:0/2227111973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38080b08d0 msgr2=0x7f380806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380eb97640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38080b08d0 0x7f380806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380eb97640 1 -- 172.21.15.37:0/2227111973 >> v1:172.21.15.37:6789/0 conn(0x7f380815bd40 legacy=0x7f3808099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.945+0000 7f380eb97640 1 -- 172.21.15.37:0/2227111973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080b0dd0 con 0x7f380806cff0 2023-07-09T22:01:46.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f380eb97640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f380806fa40 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f3800009d90 tx=0x7f380001c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed644fc4f3d4a396 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f380d394640 1 -- 172.21.15.37:0/2227111973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000a5890 con 0x7f380806cff0 2023-07-09T22:01:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f380d394640 1 -- 172.21.15.37:0/2227111973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38000a59f0 con 0x7f380806cff0 2023-07-09T22:01:46.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f380d394640 1 -- 172.21.15.37:0/2227111973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38000a5d80 con 0x7f380806cff0 2023-07-09T22:01:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 -- 172.21.15.37:0/2227111973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 msgr2=0x7f380806fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f380806fa40 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7f3800009d90 tx=0x7f380001c8c0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 -- 172.21.15.37:0/2227111973 shutdown_connections 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f380806fa40 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 --2- 172.21.15.37:0/2227111973 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f38080b08d0 0x7f380806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 -- 172.21.15.37:0/2227111973 >> 172.21.15.37:0/2227111973 conn(0x7f38080694f0 msgr2=0x7f38080698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 -- 172.21.15.37:0/2227111973 shutdown_connections 2023-07-09T22:01:46.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.949+0000 7f38105fa640 1 -- 172.21.15.37:0/2227111973 wait complete. 2023-07-09T22:01:46.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 Processor -- start 2023-07-09T22:01:46.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- start start 2023-07-09T22:01:46.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38080b08d0 0x7f38080aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 0x7f38080ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080aac20 con 0x7f380806cff0 2023-07-09T22:01:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3808155bb0 con 0x7f38080b08d0 2023-07-09T22:01:46.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3808154a70 con 0x7f380815bd40 2023-07-09T22:01:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60758/0 (socket says 172.21.15.37:60758) 2023-07-09T22:01:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 -- 172.21.15.37:0/3412354332 learned_addr learned my addr 172.21.15.37:0/3412354332 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:46.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380db95640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38080b08d0 0x7f38080aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380eb97640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 0x7f38080ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 -- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 msgr2=0x7f38080ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 0x7f38080ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 -- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38080b08d0 msgr2=0x7f38080aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:46.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38080b08d0 0x7f38080aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:46.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 -- 172.21.15.37:0/3412354332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800009a70 con 0x7f380806cff0 2023-07-09T22:01:46.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380eb97640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 0x7f38080ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f380e396640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f380400c430 tx=0x7f380400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804005cf0 con 0x7f380806cff0 2023-07-09T22:01:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804005e50 con 0x7f380806cff0 2023-07-09T22:01:46.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040072d0 con 0x7f380806cff0 2023-07-09T22:01:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3808154d50 con 0x7f380806cff0 2023-07-09T22:01:46.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38081558d0 con 0x7f380806cff0 2023-07-09T22:01:46.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.953+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3808066bc0 con 0x7f380806cff0 2023-07-09T22:01:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.957+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f3804007430 con 0x7f380806cff0 2023-07-09T22:01:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.957+0000 7f37feffd640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 0x7f37ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:46.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.957+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f3804083660 con 0x7f380806cff0 2023-07-09T22:01:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.957+0000 7f380db95640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 0x7f37ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:46.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.957+0000 7f380db95640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 0x7f37ec068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38081668c0 tx=0x7f37f8008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:46.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:46.961+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3804050790 con 0x7f380806cff0 2023-07-09T22:01:47.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3808098400 con 0x7f380806cff0 2023-07-09T22:01:47.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f37feffd640 1 -- 172.21.15.37:0/3412354332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v197) v1 ==== 80+0+476 (secure 0 0 0) 0x7f3804053db0 con 0x7f380806cff0 2023-07-09T22:01:47.150 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2890812838 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.150 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3021106069 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2635851899 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4271011706 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3528085809 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.151 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4247408657 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:47.152 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T22:01:47.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 msgr2=0x7f37ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 0x7f37ec068930 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f38081668c0 tx=0x7f37f8008040 comp rx=0 tx=0).stop 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 msgr2=0x7f38081568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7f380400c430 tx=0x7f380400c8f0 comp rx=0 tx=0).stop 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 shutdown_connections 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f37ec066480 0x7f37ec068930 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f380815bd40 0x7f38080ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:47.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f38080b08d0 0x7f38080aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 --2- 172.21.15.37:0/3412354332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f380806cff0 0x7f38081568c0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 >> 172.21.15.37:0/3412354332 conn(0x7f38080694f0 msgr2=0x7f3808097880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 shutdown_connections 2023-07-09T22:01:47.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:47.145+0000 7f38105fa640 1 -- 172.21.15.37:0/3412354332 wait complete. 2023-07-09T22:01:47.170 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T22:01:47.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:47.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:47.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67224]: fuse finished with error 0 and tester_r 0 2023-07-09T22:01:47.193 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:01:53.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:01:53.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:53.295 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T22:01:53.306 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:53.307 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:53.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:01:53.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-07-09T22:01:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 Processor -- start 2023-07-09T22:01:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 -- start start 2023-07-09T22:01:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f3518099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f351806fa40 0x7f351806fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351809c9d0 con 0x7f35180b08d0 2023-07-09T22:01:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3518070400 con 0x7f351806fa40 2023-07-09T22:01:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351f174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351809c120 con 0x7f351815bd40 2023-07-09T22:01:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f3517fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f35180b08d0 0x7f351806cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53196/0 (socket says 172.21.15.37:53196) 2023-07-09T22:01:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f3517fff640 1 -- 172.21.15.37:0/4293928375 learned_addr learned my addr 172.21.15.37:0/4293928375 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351cf10640 1 --2- 172.21.15.37:0/4293928375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f3518099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351d711640 1 --2- 172.21.15.37:0/4293928375 >> v2:172.21.15.119:3300/0 conn(0x7f351806fa40 0x7f351806fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f35177fe640 1 -- 172.21.15.37:0/4293928375 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4169700788 0 0) 0x7f351809c9d0 con 0x7f35180b08d0 2023-07-09T22:01:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f35177fe640 1 -- 172.21.15.37:0/4293928375 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3508003530 con 0x7f35180b08d0 2023-07-09T22:01:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351cf10640 1 -- 172.21.15.37:0/4293928375 >> v2:172.21.15.119:3300/0 conn(0x7f351806fa40 msgr2=0x7f351806fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351cf10640 1 --2- 172.21.15.37:0/4293928375 >> v2:172.21.15.119:3300/0 conn(0x7f351806fa40 0x7f351806fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351cf10640 1 -- 172.21.15.37:0/4293928375 >> v1:172.21.15.37:6789/0 conn(0x7f35180b08d0 legacy=0x7f351806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.557+0000 7f351cf10640 1 -- 172.21.15.37:0/4293928375 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351815c110 con 0x7f351815bd40 2023-07-09T22:01:53.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.561+0000 7f351cf10640 1 --2- 172.21.15.37:0/4293928375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f3518099a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097c0 tx=0x7f350c01c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd217a456d66f74 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:53.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.561+0000 7f35177fe640 1 -- 172.21.15.37:0/4293928375 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0ab600 con 0x7f351815bd40 2023-07-09T22:01:53.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.561+0000 7f35177fe640 1 -- 172.21.15.37:0/4293928375 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0a7050 con 0x7f351815bd40 2023-07-09T22:01:53.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.561+0000 7f35177fe640 1 -- 172.21.15.37:0/4293928375 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0ab980 con 0x7f351815bd40 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- 172.21.15.37:0/4293928375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 msgr2=0x7f3518099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- 172.21.15.37:0/4293928375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f3518099a50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f350c0097c0 tx=0x7f350c01c3f0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- 172.21.15.37:0/4293928375 shutdown_connections 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- 172.21.15.37:0/4293928375 >> v2:172.21.15.119:3300/0 conn(0x7f351806fa40 0x7f351806fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- 172.21.15.37:0/4293928375 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f3518099a50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- 172.21.15.37:0/4293928375 >> 172.21.15.37:0/4293928375 conn(0x7f35180694f0 msgr2=0x7f35180698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:53.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- 172.21.15.37:0/4293928375 shutdown_connections 2023-07-09T22:01:53.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- 172.21.15.37:0/4293928375 wait complete. 2023-07-09T22:01:53.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 Processor -- start 2023-07-09T22:01:53.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- start start 2023-07-09T22:01:53.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 0x7f3518156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f35181f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35181f4f80 con 0x7f351806fa40 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3518155a40 con 0x7f35180b08d0 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351f174640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35180ac690 con 0x7f351815bd40 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351cf10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351cf10640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59892/0 (socket says 172.21.15.37:59892) 2023-07-09T22:01:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351cf10640 1 -- 172.21.15.37:0/2019044003 learned_addr learned my addr 172.21.15.37:0/2019044003 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351d711640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f35181f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f3517fff640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 0x7f3518156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351cf10640 1 -- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 msgr2=0x7f35181f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.565+0000 7f351cf10640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f35181f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351cf10640 1 -- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 msgr2=0x7f3518156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351cf10640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 0x7f3518156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351cf10640 1 -- 172.21.15.37:0/2019044003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350c009420 con 0x7f351806fa40 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f3517fff640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 0x7f3518156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351cf10640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f350c0ae040 tx=0x7f350c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0abea0 con 0x7f351806fa40 2023-07-09T22:01:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c0b7450 con 0x7f351806fa40 2023-07-09T22:01:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35180ac970 con 0x7f351806fa40 2023-07-09T22:01:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c0b77e0 con 0x7f351806fa40 2023-07-09T22:01:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3518096790 con 0x7f351806fa40 2023-07-09T22:01:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35180ace90 con 0x7f351806fa40 2023-07-09T22:01:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f350c0b7940 con 0x7f351806fa40 2023-07-09T22:01:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 0x7f34fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.569+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f350c11ea60 con 0x7f351806fa40 2023-07-09T22:01:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.573+0000 7f3517fff640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 0x7f34fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.573+0000 7f3517fff640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 0x7f34fc068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35180ad050 tx=0x7f3504009040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.573+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35180ace90 con 0x7f351806fa40 2023-07-09T22:01:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.761+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f35180965f0 con 0x7f351806fa40 2023-07-09T22:01:53.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.761+0000 7f35157fa640 1 -- 172.21.15.37:0/2019044003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) v1 ==== 53+0+73 (secure 0 0 0) 0x7f35180965f0 con 0x7f351806fa40 2023-07-09T22:01:53.764 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-09T22:01:53.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 msgr2=0x7f34fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 0x7f34fc068930 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35180ad050 tx=0x7f3504009040 comp rx=0 tx=0).stop 2023-07-09T22:01:53.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 msgr2=0x7f3518155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:53.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f350c0ae040 tx=0x7f350c01ac30 comp rx=0 tx=0).stop 2023-07-09T22:01:53.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 shutdown_connections 2023-07-09T22:01:53.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f34fc066480 0x7f34fc068930 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f351815bd40 0x7f35181f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f35180b08d0 0x7f3518156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 --2- 172.21.15.37:0/2019044003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f351806fa40 0x7f3518155500 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:53.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 >> 172.21.15.37:0/2019044003 conn(0x7f35180694f0 msgr2=0x7f35180ae040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:53.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 shutdown_connections 2023-07-09T22:01:53.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:53.765+0000 7f351f174640 1 -- 172.21.15.37:0/2019044003 wait complete. 2023-07-09T22:01:53.785 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-09T22:01:53.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-09T22:01:53.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-07-09T22:01:53.788 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-09T22:01:53.788 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:53.789 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-09T22:01:53.789 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-09T22:01:53.789 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-09T22:01:53.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:53.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:53.790 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-07-09T22:01:53.801 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-09T22:01:53.801 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-09T22:01:53.801 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-07-09T22:01:53.801 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.801 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.802 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 40089sec preferred_lft 40089sec 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link 2023-07-09T22:01:53.803 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 02:42:a7:96:bd:3b brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-07-09T22:01:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.805 INFO:teuthology.orchestra.run.smithi037.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-07-09T22:01:53.806 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-07-09T22:01:53.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:53.807 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-09T22:01:53.868 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-07-09T22:01:53.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:53.870 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-07-09T22:01:53.922 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-07-09T22:01:53.922 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-09T22:01:53.922 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-07-09T22:01:53.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-07-09T22:01:53.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-07-09T22:01:53.923 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-09T22:01:53.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:53.924 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-07-09T22:01:53.925 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-07-09T22:01:53.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-07-09T22:01:53.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-07-09T22:01:53.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-07-09T22:01:53.928 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-07-09T22:01:54.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:54.018 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T22:01:54.029 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T22:01:54.029 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T22:01:54.030 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:54.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:54.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-07-09T22:01:54.094 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-07-09T22:01:54.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T22:01:54.095 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:54.146 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-07-09T22:01:54.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-09T22:01:54.147 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:54.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T22:01:54.258 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T22:01:54.259 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T22:01:54.320 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T22:01:54.322 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T22:01:54.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:54.325 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T22:01:54.373 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-09T22:01:54.373 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-07-09T22:01:54.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-07-09T22:01:54.442 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-09T22:01:54.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-09T22:01:54.509 INFO:teuthology.orchestra.run.smithi037.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-09T22:01:54.510 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-09T22:01:54.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:54.511 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-07-09T22:01:54.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2023-07-09T22:01:54.517+0000 7f345f5a4580 -1 init, newargv = 0x55c9d2a31770 newargc=15 2023-07-09T22:01:54.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67847]: starting ceph client 2023-07-09T22:01:54.527 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67847]: starting fuse 2023-07-09T22:01:54.530 INFO:teuthology.orchestra.run.smithi037.stdout:42 2023-07-09T22:01:54.531 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-07-09T22:01:54.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-09T22:01:54.532 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-07-09T22:01:54.532 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-07-09T22:01:54.532 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-07-09T22:01:54.532 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-07-09T22:01:54.533 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:54.533 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-07-09T22:01:54.533 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-09T22:01:54.534 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-07-09T22:01:54.534 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-07-09T22:01:54.534 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:54.535 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-07-09T22:01:54.535 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-07-09T22:01:54.535 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-07-09T22:01:54.535 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-07-09T22:01:54.536 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:54.536 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-07-09T22:01:54.536 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-09T22:01:54.537 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-09T22:01:54.537 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-09T22:01:54.537 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-07-09T22:01:54.537 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-07-09T22:01:54.538 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-07-09T22:01:54.538 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-09T22:01:54.538 DEBUG:teuthology.orchestra.run.smithi037:> 2023-07-09T22:01:54.539 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2023-07-09T22:01:54.539 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-07-09T22:01:54.655 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.67847.asok 2023-07-09T22:01:54.839 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.67847.asok 2023-07-09T22:01:54.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:54.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.67847.asok status 2023-07-09T22:01:55.014 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "35b2d86cfd512f15ace2077050d20c8669933212", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 18.0.0-4759-g35b2d86c (35b2d86cfd512f15ace2077050d20c8669933212) reef (dev)", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "67847", 2023-07-09T22:01:55.015 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 11136, 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-07-09T22:01:55.016 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 11136 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T22:01:55.017 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3965271219 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 3965271219 2023-07-09T22:01:55.018 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.11136 192.168.0.1:0/3965271219", 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/3965271219", 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 84, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 197, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-07-09T22:01:55.019 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-07-09T22:01:55.020 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:01:55.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:55.030 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-07-09T22:01:55.031 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:55.041 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-07-09T22:01:55.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:55.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:55.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:55.109 INFO:tasks.cephfs.test_snap_schedules:expecting snap snap_test_dir1/.snap/scheduled-2023-07-09-22_02_00 in ~18s... 2023-07-09T22:01:55.109 DEBUG:tasks.cephfs.test_snap_schedules:expected_schedule: ['1M'], expected_retention: [{'M': 1}] 2023-07-09T22:01:55.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule list --fs cephfs --format json snap_test_dir1 2023-07-09T22:01:55.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 Processor -- start 2023-07-09T22:01:55.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 -- start start 2023-07-09T22:01:55.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b1c15bb40 0x7f4b1c06b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c06c470 0x7f4b1c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b1c06ce00 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1c0ced20 con 0x7f4b1c15bb40 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b219db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c0cd5a0 con 0x7f4b1c06c470 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b1affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b1c15bb40 0x7f4b1c06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b1affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f4b1c15bb40 0x7f4b1c06b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59906/0 (socket says 172.21.15.37:59906) 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b1affd640 1 -- 172.21.15.37:0/4283744053 learned_addr learned my addr 172.21.15.37:0/4283744053 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.301+0000 7f4b13fff640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c06c470 0x7f4b1c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1affd640 1 -- 172.21.15.37:0/4283744053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c06c470 msgr2=0x7f4b1c06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:55.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1affd640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c06c470 0x7f4b1c06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1affd640 1 -- 172.21.15.37:0/4283744053 >> v1:172.21.15.119:6789/0 conn(0x7f4b1c15f6d0 legacy=0x7f4b1c15fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:55.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1affd640 1 -- 172.21.15.37:0/4283744053 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c0cd880 con 0x7f4b1c15bb40 2023-07-09T22:01:55.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1affd640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15bb40 0x7f4b1c06b830 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c785403fdc686e00 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/4283744053 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0aa5f0 con 0x7f4b1c15bb40 2023-07-09T22:01:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/4283744053 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c0aa750 con 0x7f4b1c15bb40 2023-07-09T22:01:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b1a7fc640 1 -- 172.21.15.37:0/4283744053 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c0aaae0 con 0x7f4b1c15bb40 2023-07-09T22:01:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b219db640 1 -- 172.21.15.37:0/4283744053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15bb40 msgr2=0x7f4b1c06b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.305+0000 7f4b219db640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15bb40 0x7f4b1c06b830 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009870 tx=0x7f4b0c01c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- 172.21.15.37:0/4283744053 shutdown_connections 2023-07-09T22:01:55.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c06c470 0x7f4b1c06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 --2- 172.21.15.37:0/4283744053 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15bb40 0x7f4b1c06b830 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- 172.21.15.37:0/4283744053 >> 172.21.15.37:0/4283744053 conn(0x7f4b1c0d2470 msgr2=0x7f4b1c0d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:55.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- 172.21.15.37:0/4283744053 shutdown_connections 2023-07-09T22:01:55.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- 172.21.15.37:0/4283744053 wait complete. 2023-07-09T22:01:55.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 Processor -- start 2023-07-09T22:01:55.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- start start 2023-07-09T22:01:55.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b1c06c470 0x7f4b1c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c15bb40 0x7f4b1c0d01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c14f080 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c14f360 con 0x7f4b1c06c470 2023-07-09T22:01:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b219db640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c14f640 con 0x7f4b1c15bb40 2023-07-09T22:01:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b13fff640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c15bb40 0x7f4b1c0d01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59916/0 (socket says 172.21.15.37:59916) 2023-07-09T22:01:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1945857370 learned_addr learned my addr 172.21.15.37:0/1945857370 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:55.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1affd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b1c06c470 0x7f4b1c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c15bb40 msgr2=0x7f4b1c0d01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c15bb40 0x7f4b1c0d01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b1c06c470 msgr2=0x7f4b1c144970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b1c06c470 0x7f4b1c144970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.309+0000 7f4b1b7fe640 1 -- 172.21.15.37:0/1945857370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c0094d0 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b1b7fe640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c780 tx=0x7f4b1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b14004b70 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400ce90 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1400a850 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c14f920 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1c14eca0 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1c066bc0 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7f4b1400a9b0 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 0x7f4afc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f4b140842f0 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.313+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 0x7f4afc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.317+0000 7f4b1affd640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 0x7f4afc068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ae000 tx=0x7f4b0c0b5040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.317+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4b14051370 con 0x7f4b1c15f6d0 2023-07-09T22:01:55.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.493+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 --> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b1c0703e0 con 0x7f4afc066480 2023-07-09T22:01:55.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b18ff9640 1 -- 172.21.15.37:0/1945857370 <== mgr.10351 v2:172.21.15.119:6832/2249208328 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+72 (secure 0 0 0) 0x7f4b0c0aa8c0 con 0x7f4afc066480 2023-07-09T22:01:55.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:55.503 INFO:teuthology.orchestra.run.smithi037.stdout:{"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-09T22:01:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 msgr2=0x7f4afc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 0x7f4afc068930 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c0ae000 tx=0x7f4b0c0b5040 comp rx=0 tx=0).stop 2023-07-09T22:01:55.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 msgr2=0x7f4b1c1427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 secure :-1 s=READY pgs=2081 cs=0 l=1 rev1=1 crypto rx=0x7f4b1400c780 tx=0x7f4b1400cc40 comp rx=0 tx=0).stop 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 shutdown_connections 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f4afc066480 0x7f4afc068930 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4b1c15f6d0 0x7f4b1c1427e0 unknown :-1 s=CLOSED pgs=2081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4b1c15bb40 0x7f4b1c0d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 --2- 172.21.15.37:0/1945857370 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4b1c06c470 0x7f4b1c144970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 >> 172.21.15.37:0/1945857370 conn(0x7f4b1c0d2470 msgr2=0x7f4b1c0c7d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 shutdown_connections 2023-07-09T22:01:55.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.501+0000 7f4b219db640 1 -- 172.21.15.37:0/1945857370 wait complete. 2023-07-09T22:01:55.524 DEBUG:tasks.cephfs.test_snap_schedules:res= {"path": "snap_test_dir1", "schedule": ["1M"], "retention": [{"M": 1}]} 2023-07-09T22:01:55.525 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'path': 'snap_test_dir1', 'schedule': ['1M'], 'retention': [{'M': 1}]} 2023-07-09T22:01:55.525 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove --fs cephfs snap_test_dir1 2023-07-09T22:01:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.669+0000 7fd20c856640 1 Processor -- start 2023-07-09T22:01:55.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.669+0000 7fd20c856640 1 -- start start 2023-07-09T22:01:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 0x7fd20806b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20806c470 0x7fd20806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 0x7fd20815fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20806ce30 con 0x7fd20806c470 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080cd5a0 con 0x7fd20815bb40 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20c856640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2080cd880 con 0x7fd20815f6d0 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20806c470 0x7fd20806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd20806c470 0x7fd20806c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59918/0 (socket says 172.21.15.37:59918) 2023-07-09T22:01:55.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 -- 172.21.15.37:0/3020365891 learned_addr learned my addr 172.21.15.37:0/3020365891 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20659c640 1 --2- 172.21.15.37:0/3020365891 >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 0x7fd20806b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd206d9d640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 0x7fd20815fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 -- 172.21.15.37:0/3020365891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 msgr2=0x7fd20815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:55.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 0x7fd20815fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 -- 172.21.15.37:0/3020365891 >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 msgr2=0x7fd20806b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 --2- 172.21.15.37:0/3020365891 >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 0x7fd20806b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd1fffff640 1 -- 172.21.15.37:0/3020365891 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20815bf10 con 0x7fd20806c470 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd20659c640 1 --2- 172.21.15.37:0/3020365891 >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 0x7fd20806b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.673+0000 7fd206d9d640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 0x7fd20815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:55.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd1fffff640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd20806c8f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fd2080d3180 tx=0x7fd1f001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4d1bc0c37f3e7a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd205d9b640 1 -- 172.21.15.37:0/3020365891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080ced00 con 0x7fd20806c470 2023-07-09T22:01:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd205d9b640 1 -- 172.21.15.37:0/3020365891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00aa5f0 con 0x7fd20806c470 2023-07-09T22:01:55.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd205d9b640 1 -- 172.21.15.37:0/3020365891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00aa980 con 0x7fd20806c470 2023-07-09T22:01:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- 172.21.15.37:0/3020365891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 msgr2=0x7fd20806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd20806c8f0 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7fd2080d3180 tx=0x7fd1f001c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- 172.21.15.37:0/3020365891 shutdown_connections 2023-07-09T22:01:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd20806c8f0 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 --2- 172.21.15.37:0/3020365891 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815f6d0 0x7fd20815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 --2- 172.21.15.37:0/3020365891 >> v2:172.21.15.119:3300/0 conn(0x7fd20815bb40 0x7fd20806b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- 172.21.15.37:0/3020365891 >> 172.21.15.37:0/3020365891 conn(0x7fd2080d2470 msgr2=0x7fd2080d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:55.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- 172.21.15.37:0/3020365891 shutdown_connections 2023-07-09T22:01:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- 172.21.15.37:0/3020365891 wait complete. 2023-07-09T22:01:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 Processor -- start 2023-07-09T22:01:55.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.677+0000 7fd20c856640 1 -- start start 2023-07-09T22:01:55.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815bb40 0x7fd20815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 0x7fd2080d0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208151b20 con 0x7fd20806c470 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd208151e00 con 0x7fd20815f6d0 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2081520e0 con 0x7fd20815bb40 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59926/0 (socket says 172.21.15.37:59926) 2023-07-09T22:01:55.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 -- 172.21.15.37:0/1368954470 learned_addr learned my addr 172.21.15.37:0/1368954470 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd206d9d640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 0x7fd2080d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 -- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815bb40 msgr2=0x7fd20815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815bb40 0x7fd20815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 -- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 msgr2=0x7fd2080d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 0x7fd2080d0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 -- 172.21.15.37:0/1368954470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f00094d0 con 0x7fd20806c470 2023-07-09T22:01:55.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd206d9d640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 0x7fd2080d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:01:55.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20659c640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c7f0 tx=0x7fd1f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007820 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f8007980 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f8007d30 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2081523c0 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20815e090 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.681+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd208151870 con 0x7fd20806c470 2023-07-09T22:01:55.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.685+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fd1f80113f0 con 0x7fd20806c470 2023-07-09T22:01:55.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.685+0000 7fd1feffd640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 0x7fd1e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:55.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.685+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fd1f8084670 con 0x7fd20806c470 2023-07-09T22:01:55.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.685+0000 7fd1fffff640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 0x7fd1e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:55.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.685+0000 7fd1fffff640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 0x7fd1e8068930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00ae000 tx=0x7fd1f0008040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:55.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.689+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd1f80515c0 con 0x7fd20806c470 2023-07-09T22:01:55.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.865+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 --> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "fs": "cephfs", "path": "snap_test_dir1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2081604a0 con 0x7fd1e8066480 2023-07-09T22:01:55.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd1feffd640 1 -- 172.21.15.37:0/1368954470 <== mgr.10351 v2:172.21.15.119:6832/2249208328 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fd1f00aa760 con 0x7fd1e8066480 2023-07-09T22:01:55.939 INFO:teuthology.orchestra.run.smithi037.stdout:Schedule removed for path snap_test_dir1 2023-07-09T22:01:55.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 msgr2=0x7fd1e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 0x7fd1e8068930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00ae000 tx=0x7fd1f0008040 comp rx=0 tx=0).stop 2023-07-09T22:01:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 msgr2=0x7fd208148ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7fd1f800c7f0 tx=0x7fd1f800ccb0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 shutdown_connections 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fd1e8066480 0x7fd1e8068930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd20815f6d0 0x7fd2080d0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd20815bb40 0x7fd20815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 --2- 172.21.15.37:0/1368954470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd20806c470 0x7fd208148ff0 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 >> 172.21.15.37:0/1368954470 conn(0x7fd2080d2470 msgr2=0x7fd2080d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:55.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 shutdown_connections 2023-07-09T22:01:55.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:55.937+0000 7fd20c856640 1 -- 172.21.15.37:0/1368954470 wait complete. 2023-07-09T22:01:55.960 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path snap_test_dir1 2023-07-09T22:01:55.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:55.961 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/.snap) 2023-07-09T22:01:55.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:55.976 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1) 2023-07-09T22:01:56.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2023-07-09T22:01:56.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 Processor -- start 2023-07-09T22:01:56.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 -- start start 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab7806b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab780cef20 0x7fab780cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab780cf8b0 con 0x7fab78070f70 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab7815fa40 con 0x7fab780cef20 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7ec9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab7815fd20 con 0x7fab7806ed10 2023-07-09T22:01:56.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab780cef20 0x7fab780cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fab780cef20 0x7fab780cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59936/0 (socket says 172.21.15.37:59936) 2023-07-09T22:01:56.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 -- 172.21.15.37:0/867285197 learned_addr learned my addr 172.21.15.37:0/867285197 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab77fff640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab7806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 -- 172.21.15.37:0/867285197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 msgr2=0x7fab7806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:56.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab7806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 -- 172.21.15.37:0/867285197 >> v1:172.21.15.119:6789/0 conn(0x7fab78070f70 legacy=0x7fab781601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab7d239640 1 -- 172.21.15.37:0/867285197 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78071340 con 0x7fab780cef20 2023-07-09T22:01:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.217+0000 7fab77fff640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab7806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:01:56.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7d239640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780cef20 0x7fab780cf370 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fab70009e50 tx=0x7fab7001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb44bebccf90e93 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab777fe640 1 -- 172.21.15.37:0/867285197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700a56a0 con 0x7fab780cef20 2023-07-09T22:01:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab777fe640 1 -- 172.21.15.37:0/867285197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700a5800 con 0x7fab780cef20 2023-07-09T22:01:56.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab777fe640 1 -- 172.21.15.37:0/867285197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700a5b90 con 0x7fab780cef20 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 -- 172.21.15.37:0/867285197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780cef20 msgr2=0x7fab780cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780cef20 0x7fab780cf370 secure :-1 s=READY pgs=2084 cs=0 l=1 rev1=1 crypto rx=0x7fab70009e50 tx=0x7fab7001c8f0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 -- 172.21.15.37:0/867285197 shutdown_connections 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab7806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/867285197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab780cef20 0x7fab780cf370 unknown :-1 s=CLOSED pgs=2084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 -- 172.21.15.37:0/867285197 >> 172.21.15.37:0/867285197 conn(0x7fab780694f0 msgr2=0x7fab780698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:56.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 -- 172.21.15.37:0/867285197 shutdown_connections 2023-07-09T22:01:56.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.221+0000 7fab7ec9c640 1 -- 172.21.15.37:0/867285197 wait complete. 2023-07-09T22:01:56.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 Processor -- start 2023-07-09T22:01:56.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- start start 2023-07-09T22:01:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab78157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab780cef20 0x7fab7813b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab781455b0 con 0x7fab78070f70 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab78159350 con 0x7fab780cef20 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab78158740 con 0x7fab7806ed10 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59952/0 (socket says 172.21.15.37:59952) 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 -- 172.21.15.37:0/271627866 learned_addr learned my addr 172.21.15.37:0/271627866 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:56.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ca38640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab78157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7d239640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab780cef20 0x7fab7813b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 -- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 msgr2=0x7fab78157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab78157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 -- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab780cef20 msgr2=0x7fab7813b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab780cef20 0x7fab7813b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 -- 172.21.15.37:0/271627866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009b30 con 0x7fab78070f70 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab77fff640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e810 tx=0x7fab6400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:56.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400c8d0 con 0x7fab78070f70 2023-07-09T22:01:56.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6400ca30 con 0x7fab78070f70 2023-07-09T22:01:56.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400cdc0 con 0x7fab78070f70 2023-07-09T22:01:56.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab78158a20 con 0x7fab78070f70 2023-07-09T22:01:56.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.225+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab78158fe0 con 0x7fab78070f70 2023-07-09T22:01:56.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab78066f40 con 0x7fab78070f70 2023-07-09T22:01:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 94) v1 ==== 85834+0+0 (secure 0 0 0) 0x7fab64013410 con 0x7fab78070f70 2023-07-09T22:01:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab757fa640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 0x7fab5c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fab64083fd0 con 0x7fab78070f70 2023-07-09T22:01:56.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab7ca38640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 0x7fab5c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.229+0000 7fab7ca38640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 0x7fab5c068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007fd0 tx=0x7fab6c009040 comp rx=0 tx=0).ready entity=mgr.10351 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:56.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.233+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab64050ff0 con 0x7fab78070f70 2023-07-09T22:01:56.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.425+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) v1 -- 0x7fab78066bc0 con 0x7fab78070f70 2023-07-09T22:01:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.577+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fab640513c0 con 0x7fab78070f70 2023-07-09T22:01:56.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.577+0000 7fab757fa640 1 -- 172.21.15.37:0/271627866 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v95) v1 ==== 93+0+0 (secure 0 0 0) 0x7fab64080e60 con 0x7fab78070f70 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 msgr2=0x7fab5c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 0x7fab5c068960 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007fd0 tx=0x7fab6c009040 comp rx=0 tx=0).stop 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 msgr2=0x7fab780b4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7fab6400e810 tx=0x7fab6400ecd0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 shutdown_connections 2023-07-09T22:01:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fab5c0664b0 0x7fab5c068960 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fab780cef20 0x7fab7813b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fab78070f70 0x7fab780b4a50 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 --2- 172.21.15.37:0/271627866 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fab7806ed10 0x7fab78157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 >> 172.21.15.37:0/271627866 conn(0x7fab780694f0 msgr2=0x7fab7815b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 shutdown_connections 2023-07-09T22:01:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.581+0000 7fab7ec9c640 1 -- 172.21.15.37:0/271627866 wait complete. 2023-07-09T22:01:56.603 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-07-09T22:01:56.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:56.668 DEBUG:teuthology.orchestra.run.smithi119:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-07-09T22:01:56.735 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-07-09T22:01:56.736 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:56.736 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:56.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:56.754 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:56.753+0000 7fc7bd213180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:56.760 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:56.759+0000 7fee2fbe8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-09T22:01:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.897+0000 7f3cd9d8f640 1 Processor -- start 2023-07-09T22:01:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.897+0000 7f3cd9d8f640 1 -- start start 2023-07-09T22:01:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd9d8f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3cd40b08d0 0x7f3cd406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd9d8f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd406cff0 0x7f3cd406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd9d8f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd409c9d0 con 0x7f3cd415bd40 2023-07-09T22:01:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd9d8f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd409c120 con 0x7f3cd406cff0 2023-07-09T22:01:56.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd9d8f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd415c110 con 0x7f3cd40b08d0 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd406cff0 0x7f3cd406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cd406cff0 0x7f3cd406fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59968/0 (socket says 172.21.15.37:59968) 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 -- 172.21.15.37:0/2048354890 learned_addr learned my addr 172.21.15.37:0/2048354890 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd2ffd640 1 --2- 172.21.15.37:0/2048354890 >> v2:172.21.15.119:3300/0 conn(0x7f3cd40b08d0 0x7f3cd406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 -- 172.21.15.37:0/2048354890 >> v2:172.21.15.119:3300/0 conn(0x7f3cd40b08d0 msgr2=0x7f3cd406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 --2- 172.21.15.37:0/2048354890 >> v2:172.21.15.119:3300/0 conn(0x7f3cd40b08d0 0x7f3cd406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 -- 172.21.15.37:0/2048354890 >> v1:172.21.15.119:6789/0 conn(0x7f3cd415bd40 legacy=0x7f3cd4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.901+0000 7f3cd3fff640 1 -- 172.21.15.37:0/2048354890 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40b0dd0 con 0x7f3cd406cff0 2023-07-09T22:01:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd3fff640 1 --2- 172.21.15.37:0/2048354890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd406cff0 0x7f3cd406fa40 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3cd406b700 tx=0x7f3ccc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb9333072bbf2d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd27fc640 1 -- 172.21.15.37:0/2048354890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0a5710 con 0x7f3cd406cff0 2023-07-09T22:01:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd27fc640 1 -- 172.21.15.37:0/2048354890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0a5870 con 0x7f3cd406cff0 2023-07-09T22:01:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd27fc640 1 -- 172.21.15.37:0/2048354890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0a5c00 con 0x7f3cd406cff0 2023-07-09T22:01:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/2048354890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd406cff0 msgr2=0x7f3cd406fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/2048354890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd406cff0 0x7f3cd406fa40 secure :-1 s=READY pgs=2087 cs=0 l=1 rev1=1 crypto rx=0x7f3cd406b700 tx=0x7f3ccc01c940 comp rx=0 tx=0).stop 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/2048354890 shutdown_connections 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/2048354890 >> v2:172.21.15.119:3300/0 conn(0x7f3cd40b08d0 0x7f3cd406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/2048354890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd406cff0 0x7f3cd406fa40 unknown :-1 s=CLOSED pgs=2087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/2048354890 >> 172.21.15.37:0/2048354890 conn(0x7f3cd40694f0 msgr2=0x7f3cd40698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/2048354890 shutdown_connections 2023-07-09T22:01:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/2048354890 wait complete. 2023-07-09T22:01:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 Processor -- start 2023-07-09T22:01:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.905+0000 7f3cd9d8f640 1 -- start start 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd406cff0 0x7f3cd40ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 0x7f3cd40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd415d0b0 con 0x7f3cd415bd40 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd414e950 con 0x7f3cd40b08d0 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd414f4d0 con 0x7f3cd406cff0 2023-07-09T22:01:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 0x7f3cd40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd37fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd406cff0 0x7f3cd40ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59984/0 (socket says 172.21.15.37:59984) 2023-07-09T22:01:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 -- 172.21.15.37:0/3559100665 learned_addr learned my addr 172.21.15.37:0/3559100665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd2ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 0x7f3cd40afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:33830/0 (socket says 172.21.15.37:33830) 2023-07-09T22:01:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 -- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd406cff0 msgr2=0x7f3cd40ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd406cff0 0x7f3cd40ae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 -- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 msgr2=0x7f3cd40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 0x7f3cd40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 -- 172.21.15.37:0/3559100665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc009b30 con 0x7f3cd415bd40 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd3fff640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0af040 tx=0x7f3ccc0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0b8670 con 0x7f3cd415bd40 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ccc0b87f0 con 0x7f3cd415bd40 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd414eba0 con 0x7f3cd415bd40 2023-07-09T22:01:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0b8ba0 con 0x7f3cd415bd40 2023-07-09T22:01:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd414f160 con 0x7f3cd415bd40 2023-07-09T22:01:56.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.909+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd414f640 con 0x7f3cd415bd40 2023-07-09T22:01:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.913+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f3ccc0b8d00 con 0x7f3cd415bd40 2023-07-09T22:01:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.913+0000 7f3cbbfff640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 0x7f3cc0068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.913+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f3ccc11f450 con 0x7f3cd415bd40 2023-07-09T22:01:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.913+0000 7f3cd37fe640 1 -- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 msgr2=0x7f3cc0068910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.913+0000 7f3cd37fe640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 0x7f3cc0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:56.917+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3ccc0ec4e0 con 0x7f3cd415bd40 2023-07-09T22:01:57.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.073+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cd4066bc0 con 0x7f3cd415bd40 2023-07-09T22:01:57.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cbbfff640 1 -- 172.21.15.37:0/3559100665 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18878 (secure 0 0 0) 0x7f3ccc009510 con 0x7f3cd415bd40 2023-07-09T22:01:57.078 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:57.078 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":197,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:41.285428+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:01:57.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 msgr2=0x7f3cc0068910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:57.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 0x7f3cc0068910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 msgr2=0x7f3cd415e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc0af040 tx=0x7f3ccc0196e0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 shutdown_connections 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3cc0066460 0x7f3cc0068910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cd415bd40 0x7f3cd415e470 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3cd40b08d0 0x7f3cd40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 --2- 172.21.15.37:0/3559100665 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3cd406cff0 0x7f3cd40ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 >> 172.21.15.37:0/3559100665 conn(0x7f3cd40694f0 msgr2=0x7f3cd4098640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 shutdown_connections 2023-07-09T22:01:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.077+0000 7f3cd9d8f640 1 -- 172.21.15.37:0/3559100665 wait complete. 2023-07-09T22:01:57.100 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T22:01:21.205098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T22:01:22.084065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:01:57.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:01:57.175 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:57.175+0000 7fee2fbe8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:57.201 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:57.201+0000 7fc7bd213180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-09T22:01:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 Processor -- start 2023-07-09T22:01:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 -- start start 2023-07-09T22:01:57.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 0x7fbb1415fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb1406c940 0x7fbb1406cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb1406bef0 con 0x7fbb1415ba30 2023-07-09T22:01:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1406f770 con 0x7fbb1406c940 2023-07-09T22:01:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb1af2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb1406fa50 con 0x7fbb140b4a50 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb1406c940 0x7fbb1406cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb13fff640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 0x7fbb1415fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbb1406c940 0x7fbb1406cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59996/0 (socket says 172.21.15.37:59996) 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 -- 172.21.15.37:0/1326978978 learned_addr learned my addr 172.21.15.37:0/1326978978 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb18cc8640 1 --1- 172.21.15.37:0/1326978978 >> v1:172.21.15.119:6789/0 conn(0x7fbb1415ba30 0x7fbb1415f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:33202/0 (socket says 172.21.15.37:33202) 2023-07-09T22:01:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 -- 172.21.15.37:0/1326978978 >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 msgr2=0x7fbb1415fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 --2- 172.21.15.37:0/1326978978 >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 0x7fbb1415fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 -- 172.21.15.37:0/1326978978 >> v1:172.21.15.119:6789/0 conn(0x7fbb1415ba30 legacy=0x7fbb1415f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb194c9640 1 -- 172.21.15.37:0/1326978978 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb1406c140 con 0x7fbb1406c940 2023-07-09T22:01:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb137fe640 1 -- 172.21.15.37:0/1326978978 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607038524 0 0) 0x7fbb1406bef0 con 0x7fbb1415ba30 2023-07-09T22:01:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.249+0000 7fbb13fff640 1 --2- 172.21.15.37:0/1326978978 >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 0x7fbb1415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:57.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb194c9640 1 --2- 172.21.15.37:0/1326978978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1406c940 0x7fbb1406cd40 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fbb140b1fa0 tx=0x7fbb0c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18db2c0b56e4f8f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb137fe640 1 -- 172.21.15.37:0/1326978978 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0a56e0 con 0x7fbb1406c940 2023-07-09T22:01:57.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb137fe640 1 -- 172.21.15.37:0/1326978978 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c0a5840 con 0x7fbb1406c940 2023-07-09T22:01:57.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb137fe640 1 -- 172.21.15.37:0/1326978978 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0a5bd0 con 0x7fbb1406c940 2023-07-09T22:01:57.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1326978978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1406c940 msgr2=0x7fbb1406cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1326978978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1406c940 0x7fbb1406cd40 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fbb140b1fa0 tx=0x7fbb0c01c9d0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1326978978 shutdown_connections 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1326978978 >> v2:172.21.15.119:3300/0 conn(0x7fbb140b4a50 0x7fbb1415fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1326978978 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb1406c940 0x7fbb1406cd40 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1326978978 >> 172.21.15.37:0/1326978978 conn(0x7fbb140d2460 msgr2=0x7fbb140d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1326978978 shutdown_connections 2023-07-09T22:01:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1326978978 wait complete. 2023-07-09T22:01:57.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 Processor -- start 2023-07-09T22:01:57.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.257+0000 7fbb1af2c640 1 -- start start 2023-07-09T22:01:57.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb1406c940 0x7fbb1413ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1415ba30 0x7fbb1415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb14156810 con 0x7fbb140b4a50 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140b5190 con 0x7fbb1415ba30 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb140b7c40 con 0x7fbb1406c940 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60010/0 (socket says 172.21.15.37:60010) 2023-07-09T22:01:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 -- 172.21.15.37:0/1993914205 learned_addr learned my addr 172.21.15.37:0/1993914205 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:57.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb18cc8640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb1406c940 0x7fbb1413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb194c9640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1415ba30 0x7fbb1415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 -- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb1406c940 msgr2=0x7fbb1413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb1406c940 0x7fbb1413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 -- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1415ba30 msgr2=0x7fbb1415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1415ba30 0x7fbb1415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 -- 172.21.15.37:0/1993914205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb00009420 con 0x7fbb140b4a50 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb13fff640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000e9d0 tx=0x7fbb0000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000ca60 con 0x7fbb140b4a50 2023-07-09T22:01:57.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0000cbc0 con 0x7fbb140b4a50 2023-07-09T22:01:57.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00013470 con 0x7fbb140b4a50 2023-07-09T22:01:57.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0c009b30 con 0x7fbb140b4a50 2023-07-09T22:01:57.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1415cfc0 con 0x7fbb140b4a50 2023-07-09T22:01:57.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb14066bc0 con 0x7fbb140b4a50 2023-07-09T22:01:57.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.261+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fbb000135d0 con 0x7fbb140b4a50 2023-07-09T22:01:57.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.265+0000 7fbb117fa640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 0x7fbaf80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.265+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fbb000840d0 con 0x7fbb140b4a50 2023-07-09T22:01:57.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.265+0000 7fbb18cc8640 1 -- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 msgr2=0x7fbaf80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:57.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.265+0000 7fbb18cc8640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 0x7fbaf80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:57.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.269+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbb00051200 con 0x7fbb140b4a50 2023-07-09T22:01:57.325 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:57.327+0000 7fee2fbe8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:57.381 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:57.377+0000 7fc7bd213180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-09T22:01:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbb140ce550 con 0x7fbb140b4a50 2023-07-09T22:01:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb117fa640 1 -- 172.21.15.37:0/1993914205 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v197) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbb00054820 con 0x7fbb140b4a50 2023-07-09T22:01:57.443 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:01:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 msgr2=0x7fbaf80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 0x7fbaf80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 msgr2=0x7fbb140b7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 secure :-1 s=READY pgs=2090 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000e9d0 tx=0x7fbb0000ee90 comp rx=0 tx=0).stop 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 shutdown_connections 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fbaf8066430 0x7fbaf80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbb1415ba30 0x7fbb1415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb140b4a50 0x7fbb140b7700 unknown :-1 s=CLOSED pgs=2090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 --2- 172.21.15.37:0/1993914205 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbb1406c940 0x7fbb1413ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 >> 172.21.15.37:0/1993914205 conn(0x7fbb140d2460 msgr2=0x7fbb140d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 shutdown_connections 2023-07-09T22:01:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.441+0000 7fbb1af2c640 1 -- 172.21.15.37:0/1993914205 wait complete. 2023-07-09T22:01:57.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:01:57.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.613+0000 7f223da5b640 1 Processor -- start 2023-07-09T22:01:57.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.613+0000 7f223da5b640 1 -- start start 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223da5b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f223815bca0 0x7f2238070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223da5b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223815f460 con 0x7f223815c070 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223da5b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f223806c110 con 0x7f22380718a0 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223da5b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f223815c4c0 con 0x7f223815bca0 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f2237fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f223815c070 0x7f2238071190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34340/0 (socket says 172.21.15.37:34340) 2023-07-09T22:01:57.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f2237fff640 1 -- 172.21.15.37:0/919903397 learned_addr learned my addr 172.21.15.37:0/919903397 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223ca59640 1 --2- 172.21.15.37:0/919903397 >> v2:172.21.15.119:3300/0 conn(0x7f223815bca0 0x7f2238070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223ca59640 1 -- 172.21.15.37:0/919903397 >> v1:172.21.15.119:6789/0 conn(0x7f22380718a0 legacy=0x7f223806c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f22377fe640 1 -- 172.21.15.37:0/919903397 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875766432 0 0) 0x7f223815f460 con 0x7f223815c070 2023-07-09T22:01:57.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223ca59640 1 -- 172.21.15.37:0/919903397 >> v1:172.21.15.37:6789/0 conn(0x7f223815c070 legacy=0x7f2238071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.617+0000 7f223ca59640 1 -- 172.21.15.37:0/919903397 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2238160470 con 0x7f223815bca0 2023-07-09T22:01:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223ca59640 1 --2- 172.21.15.37:0/919903397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238070ab0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f222c009740 tx=0x7f222c01c2b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4e7efca1ac308db server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f22377fe640 1 -- 172.21.15.37:0/919903397 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0ab600 con 0x7f223815bca0 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f22377fe640 1 -- 172.21.15.37:0/919903397 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222c0a7050 con 0x7f223815bca0 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f22377fe640 1 -- 172.21.15.37:0/919903397 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222c0ab980 con 0x7f223815bca0 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- 172.21.15.37:0/919903397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 msgr2=0x7f2238070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 --2- 172.21.15.37:0/919903397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238070ab0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f222c009740 tx=0x7f222c01c2b0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- 172.21.15.37:0/919903397 shutdown_connections 2023-07-09T22:01:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 --2- 172.21.15.37:0/919903397 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238070ab0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- 172.21.15.37:0/919903397 >> 172.21.15.37:0/919903397 conn(0x7f22380cedd0 msgr2=0x7f22380cf1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- 172.21.15.37:0/919903397 shutdown_connections 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- 172.21.15.37:0/919903397 wait complete. 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 Processor -- start 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.621+0000 7f223da5b640 1 -- start start 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 0x7f22380b68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223815c070 0x7f22380b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b41e0 con 0x7f223815c070 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b5ae0 con 0x7f223815bca0 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22380b5dc0 con 0x7f22380718a0 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223ca59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 0x7f22380b68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223d25a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223815c070 0x7f22380b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223ca59640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 0x7f22380b68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56646/0 (socket says 172.21.15.37:56646) 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223ca59640 1 -- 172.21.15.37:0/262932192 learned_addr learned my addr 172.21.15.37:0/262932192 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 -- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 msgr2=0x7f22380b68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 0x7f22380b68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 -- 172.21.15.37:0/262932192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223815c070 msgr2=0x7f22380b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223815c070 0x7f22380b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 -- 172.21.15.37:0/262932192 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c009420 con 0x7f223815bca0 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f2237fff640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238141e10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f222400c3e0 tx=0x7f222400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240074e0 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224007640 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224004a30 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22380b60a0 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380b5790 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2238061100 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.625+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f2224004b90 con 0x7f223815bca0 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.629+0000 7f22357fa640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 0x7f221c0688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.629+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f2224083e30 con 0x7f223815bca0 2023-07-09T22:01:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.629+0000 7f223ca59640 1 -- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 msgr2=0x7f221c0688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.629+0000 7f223ca59640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 0x7f221c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:57.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.633+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2224050eb0 con 0x7f223815bca0 2023-07-09T22:01:57.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.789+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2238066970 con 0x7f223815bca0 2023-07-09T22:01:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.789+0000 7f22357fa640 1 -- 172.21.15.37:0/262932192 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v197) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2224001070 con 0x7f223815bca0 2023-07-09T22:01:57.792 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:01:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 msgr2=0x7f221c0688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 0x7f221c0688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 msgr2=0x7f2238141e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238141e10 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f222400c3e0 tx=0x7f222400c8a0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 shutdown_connections 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f221c066430 0x7f221c0688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f223815c070 0x7f22380b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f223815bca0 0x7f2238141e10 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 --2- 172.21.15.37:0/262932192 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f22380718a0 0x7f22380b68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 >> 172.21.15.37:0/262932192 conn(0x7f22380cedd0 msgr2=0x7f22380cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 shutdown_connections 2023-07-09T22:01:57.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.793+0000 7f223da5b640 1 -- 172.21.15.37:0/262932192 wait complete. 2023-07-09T22:01:57.804 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:57.803+0000 7fee2fbe8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:57.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:01:57.863 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:57.863+0000 7fee2fbe8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:57.903 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:57.901+0000 7fc7bd213180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:57.918 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:57.919+0000 7fee2fbe8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:57.966 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fc7bd213180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-09T22:01:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 Processor -- start 2023-07-09T22:01:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 -- start start 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd30070f70 0x7fdd3006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 0x7fdd301601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3015fa40 con 0x7fdd301606f0 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd3015fd20 con 0x7fdd30070f70 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd36d2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd30071340 con 0x7fdd3006b880 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.965+0000 7fdd34ac8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd30070f70 0x7fdd3006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd352c9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdd301606f0 0x7fdd300cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34354/0 (socket says 172.21.15.37:34354) 2023-07-09T22:01:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd352c9640 1 -- 172.21.15.37:0/4269711534 learned_addr learned my addr 172.21.15.37:0/4269711534 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:57.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2ffff640 1 --2- 172.21.15.37:0/4269711534 >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 0x7fdd301601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2f7fe640 1 -- 172.21.15.37:0/4269711534 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829287432 0 0) 0x7fdd3015fa40 con 0x7fdd301606f0 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2f7fe640 1 -- 172.21.15.37:0/4269711534 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd20003530 con 0x7fdd301606f0 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd34ac8640 1 -- 172.21.15.37:0/4269711534 >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 msgr2=0x7fdd301601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd34ac8640 1 --2- 172.21.15.37:0/4269711534 >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 0x7fdd301601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd34ac8640 1 -- 172.21.15.37:0/4269711534 >> v1:172.21.15.37:6789/0 conn(0x7fdd301606f0 legacy=0x7fdd300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd34ac8640 1 -- 172.21.15.37:0/4269711534 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3006bcd0 con 0x7fdd30070f70 2023-07-09T22:01:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2ffff640 1 --2- 172.21.15.37:0/4269711534 >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 0x7fdd301601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd34ac8640 1 --2- 172.21.15.37:0/4269711534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd3006ed10 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fdd3006a2c0 tx=0x7fdd2401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199ed80d3079b856 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2f7fe640 1 -- 172.21.15.37:0/4269711534 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240ac640 con 0x7fdd30070f70 2023-07-09T22:01:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2f7fe640 1 -- 172.21.15.37:0/4269711534 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240ac7a0 con 0x7fdd30070f70 2023-07-09T22:01:57.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.969+0000 7fdd2f7fe640 1 -- 172.21.15.37:0/4269711534 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240acb10 con 0x7fdd30070f70 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4269711534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 msgr2=0x7fdd3006ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4269711534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd3006ed10 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7fdd3006a2c0 tx=0x7fdd2401c310 comp rx=0 tx=0).stop 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4269711534 shutdown_connections 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4269711534 >> v2:172.21.15.119:3300/0 conn(0x7fdd3006b880 0x7fdd301601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4269711534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd3006ed10 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4269711534 >> 172.21.15.37:0/4269711534 conn(0x7fdd300694f0 msgr2=0x7fdd300698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4269711534 shutdown_connections 2023-07-09T22:01:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4269711534 wait complete. 2023-07-09T22:01:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 Processor -- start 2023-07-09T22:01:57.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- start start 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd3006b880 0x7fdd30157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd301606f0 0x7fdd301f7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30159100 con 0x7fdd30070f70 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd301593a0 con 0x7fdd301606f0 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd36d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30159680 con 0x7fdd3006b880 2023-07-09T22:01:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd2ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36264/0 (socket says 172.21.15.37:36264) 2023-07-09T22:01:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd2ffff640 1 -- 172.21.15.37:0/4281738229 learned_addr learned my addr 172.21.15.37:0/4281738229 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd34ac8640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd3006b880 0x7fdd30157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.973+0000 7fdd352c9640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd301606f0 0x7fdd301f7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 -- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd3006b880 msgr2=0x7fdd30157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd3006b880 0x7fdd30157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 -- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd301606f0 msgr2=0x7fdd301f7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:57.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd301606f0 0x7fdd301f7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 -- 172.21.15.37:0/4281738229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c009420 con 0x7fdd30070f70 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2ffff640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00e980 tx=0x7fdd1c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00ca00 con 0x7fdd30070f70 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c00cb60 con 0x7fdd30070f70 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd24009420 con 0x7fdd30070f70 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c013470 con 0x7fdd30070f70 2023-07-09T22:01:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd300b3470 con 0x7fdd30070f70 2023-07-09T22:01:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd30066bc0 con 0x7fdd30070f70 2023-07-09T22:01:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7fdd1c0135d0 con 0x7fdd30070f70 2023-07-09T22:01:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 0x7fdd140688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fdd1c084370 con 0x7fdd30070f70 2023-07-09T22:01:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.977+0000 7fdd34ac8640 1 -- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 msgr2=0x7fdd140688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:57.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.981+0000 7fdd34ac8640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 0x7fdd140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:57.981+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd1c0514a0 con 0x7fdd30070f70 2023-07-09T22:01:58.004 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.003+0000 7fee2fbe8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:58.028 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.025+0000 7fc7bd213180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-09T22:01:58.062 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.063+0000 7fee2fbe8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:58.120 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.117+0000 7fc7bd213180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-09T22:01:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.141+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd3006c4f0 con 0x7fdd30070f70 2023-07-09T22:01:58.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.141+0000 7fdd2d7fa640 1 -- 172.21.15.37:0/4281738229 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v197) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd1c054ac0 con 0x7fdd30070f70 2023-07-09T22:01:58.144 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:01:58.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 msgr2=0x7fdd140688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 0x7fdd140688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 msgr2=0x7fdd301f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00e980 tx=0x7fdd1c00ee40 comp rx=0 tx=0).stop 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 shutdown_connections 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7fdd14066430 0x7fdd140688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdd301606f0 0x7fdd301f7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd30070f70 0x7fdd301f7800 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 --2- 172.21.15.37:0/4281738229 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdd3006b880 0x7fdd30157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 >> 172.21.15.37:0/4281738229 conn(0x7fdd300694f0 msgr2=0x7fdd3015ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 shutdown_connections 2023-07-09T22:01:58.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.145+0000 7fdd36d2c640 1 -- 172.21.15.37:0/4281738229 wait complete. 2023-07-09T22:01:58.147 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.147+0000 7fee2fbe8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:58.166 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:01:58.181 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.181+0000 7fc7bd213180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-09T22:01:58.201 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.203+0000 7fee2fbe8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:58.272 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.269+0000 7fc7bd213180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-09T22:01:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.309+0000 7f1bdb58f640 1 Processor -- start 2023-07-09T22:01:58.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 -- start start 2023-07-09T22:01:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd41507e0 0x7f1bd406fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f1bd40b17d0 0x7f1bd4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd415af50 con 0x7f1bd4150bb0 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406eec0 con 0x7f1bd41507e0 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bdb58f640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40711c0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd41507e0 0x7f1bd406fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1bd41507e0 0x7f1bd406fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36270/0 (socket says 172.21.15.37:36270) 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 -- 172.21.15.37:0/353593291 learned_addr learned my addr 172.21.15.37:0/353593291 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:58.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd9b2c640 1 --2- 172.21.15.37:0/353593291 >> v2:172.21.15.119:3300/0 conn(0x7f1bd40b17d0 0x7f1bd4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 -- 172.21.15.37:0/353593291 >> v2:172.21.15.119:3300/0 conn(0x7f1bd40b17d0 msgr2=0x7f1bd4070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 --2- 172.21.15.37:0/353593291 >> v2:172.21.15.119:3300/0 conn(0x7f1bd40b17d0 0x7f1bd4070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 -- 172.21.15.37:0/353593291 >> v1:172.21.15.119:6789/0 conn(0x7f1bd4150bb0 legacy=0x7f1bd40b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.313+0000 7f1bd932b640 1 -- 172.21.15.37:0/353593291 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd406f110 con 0x7f1bd41507e0 2023-07-09T22:01:58.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bd932b640 1 --2- 172.21.15.37:0/353593291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd41507e0 0x7f1bd406fbf0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4157b00 tx=0x7f1bd001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbdb2d12159b3da server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bcbfff640 1 -- 172.21.15.37:0/353593291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00aa430 con 0x7f1bd41507e0 2023-07-09T22:01:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bcbfff640 1 -- 172.21.15.37:0/353593291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00aa590 con 0x7f1bd41507e0 2023-07-09T22:01:58.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bcbfff640 1 -- 172.21.15.37:0/353593291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00aa920 con 0x7f1bd41507e0 2023-07-09T22:01:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 -- 172.21.15.37:0/353593291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd41507e0 msgr2=0x7f1bd406fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/353593291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd41507e0 0x7f1bd406fbf0 secure :-1 s=READY pgs=2095 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4157b00 tx=0x7f1bd001c4d0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 -- 172.21.15.37:0/353593291 shutdown_connections 2023-07-09T22:01:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/353593291 >> v2:172.21.15.119:3300/0 conn(0x7f1bd40b17d0 0x7f1bd4070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/353593291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd41507e0 0x7f1bd406fbf0 unknown :-1 s=CLOSED pgs=2095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 -- 172.21.15.37:0/353593291 >> 172.21.15.37:0/353593291 conn(0x7f1bd40ce0f0 msgr2=0x7f1bd40ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 -- 172.21.15.37:0/353593291 shutdown_connections 2023-07-09T22:01:58.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 -- 172.21.15.37:0/353593291 wait complete. 2023-07-09T22:01:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.317+0000 7f1bdb58f640 1 Processor -- start 2023-07-09T22:01:58.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- start start 2023-07-09T22:01:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd41507e0 0x7f1bd4146b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd4150bb0 0x7f1bd406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40af430 con 0x7f1bd40b17d0 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40af710 con 0x7f1bd4150bb0 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40af9f0 con 0x7f1bd41507e0 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36274/0 (socket says 172.21.15.37:36274) 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 -- 172.21.15.37:0/1608868886 learned_addr learned my addr 172.21.15.37:0/1608868886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd9b2c640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd4150bb0 0x7f1bd406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd8b2a640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd41507e0 0x7f1bd4146b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 -- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd41507e0 msgr2=0x7f1bd4146b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd41507e0 0x7f1bd4146b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 -- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd4150bb0 msgr2=0x7f1bd406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd4150bb0 0x7f1bd406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 -- 172.21.15.37:0/1608868886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd00094d0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bd932b640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ac040 tx=0x7f1bd001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00aa430 con 0x7f1bd40b17d0 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00b3820 con 0x7f1bd40b17d0 2023-07-09T22:01:58.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00b3bd0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd40afcd0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.321+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd40b04d0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4066bc0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f1bd00b3d30 con 0x7f1bd40b17d0 2023-07-09T22:01:58.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bc9ffb640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 0x7f1bb80688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f1bd011eca0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bd8b2a640 1 -- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 msgr2=0x7f1bb80688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:58.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.325+0000 7f1bd8b2a640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 0x7f1bb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:58.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.329+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1bd00ebcd0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.334 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.333+0000 7fc7bd213180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-09T22:01:58.343 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.343+0000 7fee2fbe8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:58.401 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.403+0000 7fee2fbe8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:58.485 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.485+0000 7fc7bd213180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-09T22:01:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1bd40b0180 con 0x7f1bd40b17d0 2023-07-09T22:01:58.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bc9ffb640 1 -- 172.21.15.37:0/1608868886 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v197) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bd00ef2f0 con 0x7f1bd40b17d0 2023-07-09T22:01:58.487 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:01:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 msgr2=0x7f1bb80688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 0x7f1bb80688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 msgr2=0x7f1bd40ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7f1bd00ac040 tx=0x7f1bd001ad10 comp rx=0 tx=0).stop 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 shutdown_connections 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f1bb8066430 0x7f1bb80688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1bd4150bb0 0x7f1bd406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1bd41507e0 0x7f1bd4146b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 --2- 172.21.15.37:0/1608868886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1bd40b17d0 0x7f1bd40ca940 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 >> 172.21.15.37:0/1608868886 conn(0x7f1bd40ce0f0 msgr2=0x7f1bd4158110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 shutdown_connections 2023-07-09T22:01:58.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.485+0000 7f1bdb58f640 1 -- 172.21.15.37:0/1608868886 wait complete. 2023-07-09T22:01:58.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-09T22:01:58.549 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.545+0000 7fc7bd213180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-09T22:01:58.640 INFO:tasks.ceph.mgr.x.smithi119.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:58.641 INFO:tasks.ceph.mgr.x.smithi119.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:58.641 INFO:tasks.ceph.mgr.x.smithi119.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:58.649 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.651+0000 7fee2fbe8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 Processor -- start 2023-07-09T22:01:58.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 -- start start 2023-07-09T22:01:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f313815be70 0x7f313806b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313806bde0 con 0x7f31380b1050 2023-07-09T22:01:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313806c060 con 0x7f313815be70 2023-07-09T22:01:58.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f313de9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313806c340 con 0x7f313815baa0 2023-07-09T22:01:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f31377fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f31377fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:56658/0 (socket says 172.21.15.37:56658) 2023-07-09T22:01:58.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.693+0000 7f31377fe640 1 -- 172.21.15.37:0/2328680882 learned_addr learned my addr 172.21.15.37:0/2328680882 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.697+0000 7f3136ffd640 1 --2- 172.21.15.37:0/2328680882 >> v2:172.21.15.37:3300/0 conn(0x7f313815be70 0x7f313806b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.697+0000 7f31377fe640 1 -- 172.21.15.37:0/2328680882 >> v2:172.21.15.37:3300/0 conn(0x7f313815be70 msgr2=0x7f313806b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.697+0000 7f31377fe640 1 --2- 172.21.15.37:0/2328680882 >> v2:172.21.15.37:3300/0 conn(0x7f313815be70 0x7f313806b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.697+0000 7f31377fe640 1 -- 172.21.15.37:0/2328680882 >> v1:172.21.15.37:6789/0 conn(0x7f31380b1050 legacy=0x7f313806f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.697+0000 7f31377fe640 1 -- 172.21.15.37:0/2328680882 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313806c620 con 0x7f313815baa0 2023-07-09T22:01:58.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.701+0000 7f31377fe640 1 --2- 172.21.15.37:0/2328680882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f312801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=704880380e93739b server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:58.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.701+0000 7f31367fc640 1 -- 172.21.15.37:0/2328680882 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280a95f0 con 0x7f313815baa0 2023-07-09T22:01:58.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.701+0000 7f31367fc640 1 -- 172.21.15.37:0/2328680882 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31280a9750 con 0x7f313815baa0 2023-07-09T22:01:58.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f31367fc640 1 -- 172.21.15.37:0/2328680882 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31280a9ae0 con 0x7f313815baa0 2023-07-09T22:01:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 -- 172.21.15.37:0/2328680882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 msgr2=0x7f313806d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 --2- 172.21.15.37:0/2328680882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f312801c510 comp rx=0 tx=0).stop 2023-07-09T22:01:58.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 -- 172.21.15.37:0/2328680882 shutdown_connections 2023-07-09T22:01:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 --2- 172.21.15.37:0/2328680882 >> v2:172.21.15.37:3300/0 conn(0x7f313815be70 0x7f313806b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 --2- 172.21.15.37:0/2328680882 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f313815baa0 0x7f313806d440 secure :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3128009870 tx=0x7f312801c510 comp rx=0 tx=0).stop 2023-07-09T22:01:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 -- 172.21.15.37:0/2328680882 >> 172.21.15.37:0/2328680882 conn(0x7f31380ce090 msgr2=0x7f31380ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 -- 172.21.15.37:0/2328680882 shutdown_connections 2023-07-09T22:01:58.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.705+0000 7f313de9c640 1 -- 172.21.15.37:0/2328680882 wait complete. 2023-07-09T22:01:58.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 Processor -- start 2023-07-09T22:01:58.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 -- start start 2023-07-09T22:01:58.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 0x7f3138153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 0x7f3138153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 0x7f31380a8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380d0950 con 0x7f313815be70 2023-07-09T22:01:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380cfd40 con 0x7f31381540f0 2023-07-09T22:01:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f313de9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31380d0020 con 0x7f31380b1050 2023-07-09T22:01:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.709+0000 7f3136ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 0x7f3138153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3136ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 0x7f3138153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36304/0 (socket says 172.21.15.37:36304) 2023-07-09T22:01:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3136ffd640 1 -- 172.21.15.37:0/1812018576 learned_addr learned my addr 172.21.15.37:0/1812018576 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 0x7f31380a8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f31377fe640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 0x7f3138153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 msgr2=0x7f3138153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 0x7f3138153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 msgr2=0x7f3138153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 0x7f3138153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 -- 172.21.15.37:0/1812018576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31280094d0 con 0x7f31381540f0 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f31377fe640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 0x7f3138153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:01:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f3137fff640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 0x7f31380a8160 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f313000c730 tx=0x7f313000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130006d60 con 0x7f31381540f0 2023-07-09T22:01:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3130003980 con 0x7f31381540f0 2023-07-09T22:01:58.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31380d0300 con 0x7f31381540f0 2023-07-09T22:01:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381538a0 con 0x7f31381540f0 2023-07-09T22:01:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.713+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3130003d70 con 0x7f31381540f0 2023-07-09T22:01:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.717+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f31300050d0 con 0x7f31381540f0 2023-07-09T22:01:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.721+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3118005260 con 0x7f31381540f0 2023-07-09T22:01:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.721+0000 7f311ffff640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 0x7f31240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.721+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f3130083b00 con 0x7f31381540f0 2023-07-09T22:01:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.721+0000 7f31377fe640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 msgr2=0x7f31240689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.721+0000 7f31377fe640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 0x7f31240689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.725+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3130050c90 con 0x7f31381540f0 2023-07-09T22:01:58.784 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.783+0000 7fee2fbe8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:58.804 INFO:tasks.ceph.mgr.y.smithi037.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-07-09T22:01:58.804 INFO:tasks.ceph.mgr.y.smithi037.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-07-09T22:01:58.804 INFO:tasks.ceph.mgr.y.smithi037.stderr: from numpy import show_config as show_numpy_config 2023-07-09T22:01:58.813 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.809+0000 7fc7bd213180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-09T22:01:58.908 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.907+0000 7fee2fbe8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:58.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.925+0000 7f31377fe640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 msgr2=0x7f31240689b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:58.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.925+0000 7f31377fe640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 0x7f31240689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-09T22:01:58.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.929+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3118005510 con 0x7f31381540f0 2023-07-09T22:01:58.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.929+0000 7f311ffff640 1 -- 172.21.15.37:0/1812018576 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 8 entries v197) v1 ==== 80+0+476 (secure 0 0 0) 0x7f31300542b0 con 0x7f31381540f0 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2890812838 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3021106069 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/2635851899 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4271011706 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/3528085809 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6833/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:6832/350512922 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.935 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.119:0/4247408657 2023-07-10T22:01:41.285377+0000 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:listed 8 entries 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 msgr2=0x7f31240689b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 0x7f31240689b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 msgr2=0x7f31380a8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 0x7f31380a8160 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f313000c730 tx=0x7f313000cbf0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 shutdown_connections 2023-07-09T22:01:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f3124066500 0x7f31240689b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f31381540f0 0x7f31380a8160 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f313815be70 0x7f3138153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 --2- 172.21.15.37:0/1812018576 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f31380b1050 0x7f3138153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:58.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 >> 172.21.15.37:0/1812018576 conn(0x7f31380ce090 msgr2=0x7f31380725b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:58.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 shutdown_connections 2023-07-09T22:01:58.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:58.933+0000 7f313de9c640 1 -- 172.21.15.37:0/1812018576 wait complete. 2023-07-09T22:01:58.954 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-07-09T22:01:58.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:58.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-07-09T22:01:58.956 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:58.953+0000 7fc7bd213180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:58.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[67847]: fuse finished with error 0 and tester_r 0 2023-07-09T22:01:58.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:01:58.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:58.978 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-07-09T22:01:58.979 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:58.979+0000 7fee2fbe8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:59.090 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:59.089+0000 7fc7bd213180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-09T22:01:59.105 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:59.105 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:59.111 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:59.111+0000 7fee2fbe8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:59.114 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:59.114 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:01:59.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:59.115 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-07-09T22:01:59.164 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-07-09T22:01:59.165 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:59.161+0000 7fc7bd213180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-09T22:01:59.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:59.166 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:01:59.167 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:59.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:01:59.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:01:59.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:59.177 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-07-09T22:01:59.224 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-07-09T22:01:59.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:59.226 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:01:59.226 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:01:59.235 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:01:59.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:01:59.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:01:59.236 DEBUG:teuthology.orchestra.run.smithi119:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-07-09T22:01:59.284 INFO:teuthology.orchestra.run.smithi119.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-07-09T22:01:59.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:01:59.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:01:59.306 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:59.305+0000 7fc7bd213180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-09T22:01:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 Processor -- start 2023-07-09T22:01:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 -- start start 2023-07-09T22:01:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f577415bd40 0x7f5774099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f577406fa40 0x7f577406fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f577409c9d0 con 0x7f57740b08d0 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57740703c0 con 0x7f577406fa40 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5779c9c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f577409c120 con 0x7f577415bd40 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f577406fa40 0x7f577406fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f577406fa40 0x7f577406fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36320/0 (socket says 172.21.15.37:36320) 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 -- 172.21.15.37:0/3883047394 learned_addr learned my addr 172.21.15.37:0/3883047394 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f57737fe640 1 --2- 172.21.15.37:0/3883047394 >> v2:172.21.15.119:3300/0 conn(0x7f577415bd40 0x7f5774099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 -- 172.21.15.37:0/3883047394 >> v2:172.21.15.119:3300/0 conn(0x7f577415bd40 msgr2=0x7f5774099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:59.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 --2- 172.21.15.37:0/3883047394 >> v2:172.21.15.119:3300/0 conn(0x7f577415bd40 0x7f5774099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 -- 172.21.15.37:0/3883047394 >> v1:172.21.15.119:6789/0 conn(0x7f57740b08d0 legacy=0x7f577406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.429+0000 7f5773fff640 1 -- 172.21.15.37:0/3883047394 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577415c110 con 0x7f577406fa40 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5773fff640 1 --2- 172.21.15.37:0/3883047394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f577406fa40 0x7f577406fe80 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f5774099750 tx=0x7f576c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53329b3d7212b437 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f57727fc640 1 -- 172.21.15.37:0/3883047394 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a5600 con 0x7f577406fa40 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f57727fc640 1 -- 172.21.15.37:0/3883047394 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576c0a5760 con 0x7f577406fa40 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f57727fc640 1 -- 172.21.15.37:0/3883047394 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576c0a5af0 con 0x7f577406fa40 2023-07-09T22:01:59.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 -- 172.21.15.37:0/3883047394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f577406fa40 msgr2=0x7f577406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 --2- 172.21.15.37:0/3883047394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f577406fa40 0x7f577406fe80 secure :-1 s=READY pgs=2098 cs=0 l=1 rev1=1 crypto rx=0x7f5774099750 tx=0x7f576c01c940 comp rx=0 tx=0).stop 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 -- 172.21.15.37:0/3883047394 shutdown_connections 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 --2- 172.21.15.37:0/3883047394 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f577406fa40 0x7f577406fe80 unknown :-1 s=CLOSED pgs=2098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 --2- 172.21.15.37:0/3883047394 >> v2:172.21.15.119:3300/0 conn(0x7f577415bd40 0x7f5774099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 -- 172.21.15.37:0/3883047394 >> 172.21.15.37:0/3883047394 conn(0x7f57740694f0 msgr2=0x7f57740698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 -- 172.21.15.37:0/3883047394 shutdown_connections 2023-07-09T22:01:59.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.433+0000 7f5779c9c640 1 -- 172.21.15.37:0/3883047394 wait complete. 2023-07-09T22:01:59.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 Processor -- start 2023-07-09T22:01:59.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- start start 2023-07-09T22:01:59.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 0x7f57740927d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 0x7f57740aae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f577415bd40 0x7f57740acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740aee20 con 0x7f57740b08d0 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57740ae1a0 con 0x7f577406fa40 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57740ae480 con 0x7f577415bd40 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 0x7f57740aae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 0x7f57740927d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5772ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 0x7f57740aae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36332/0 (socket says 172.21.15.37:36332) 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5772ffd640 1 -- 172.21.15.37:0/375144503 learned_addr learned my addr 172.21.15.37:0/375144503 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5773fff640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f577415bd40 0x7f57740acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 -- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f577415bd40 msgr2=0x7f57740acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f577415bd40 0x7f57740acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 -- 172.21.15.37:0/375144503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 msgr2=0x7f57740aae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 0x7f57740aae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 -- 172.21.15.37:0/375144503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576c009b30 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f57737fe640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 0x7f57740927d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f576400e8a0 tx=0x7f576400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400c940 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f576400caa0 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f576400ce10 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57740ae760 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.437+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f577415b4b0 con 0x7f577406fa40 2023-07-09T22:01:59.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57740af090 con 0x7f577406fa40 2023-07-09T22:01:59.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f5764013470 con 0x7f577406fa40 2023-07-09T22:01:59.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f575bfff640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 0x7f57600688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f5764084250 con 0x7f577406fa40 2023-07-09T22:01:59.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f5772ffd640 1 -- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 msgr2=0x7f57600688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.441+0000 7f5772ffd640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 0x7f57600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:59.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.445+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5764051410 con 0x7f577406fa40 2023-07-09T22:01:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.633+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5774066bc0 con 0x7f577406fa40 2023-07-09T22:01:59.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f575bfff640 1 -- 172.21.15.37:0/375144503 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7f5764054a30 con 0x7f577406fa40 2023-07-09T22:01:59.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:01:59.638 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:01:59.638 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:01:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 msgr2=0x7f57600688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:01:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 0x7f57600688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 msgr2=0x7f57740927d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 0x7f57740927d0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f576400e8a0 tx=0x7f576400ed60 comp rx=0 tx=0).stop 2023-07-09T22:01:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 shutdown_connections 2023-07-09T22:01:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f5760066430 0x7f57600688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f577415bd40 0x7f57740acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57740b08d0 0x7f57740aae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 --2- 172.21.15.37:0/375144503 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f577406fa40 0x7f57740927d0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 >> 172.21.15.37:0/375144503 conn(0x7f57740694f0 msgr2=0x7f57741591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 shutdown_connections 2023-07-09T22:01:59.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.637+0000 7f5779c9c640 1 -- 172.21.15.37:0/375144503 wait complete. 2023-07-09T22:01:59.655 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:59.655+0000 7fee2fbe8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:59.660 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:01:59.739 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:59.739+0000 7fee2fbe8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:01:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.845+0000 7f05bc25c640 1 Processor -- start 2023-07-09T22:01:59.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.845+0000 7f05bc25c640 1 -- start start 2023-07-09T22:01:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.845+0000 7f05bc25c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b415bd40 0x7f05b4099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05bc25c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05b406fa40 0x7f05b406fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05bc25c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b409c9d0 con 0x7f05b40b08d0 2023-07-09T22:01:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05bc25c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b4070400 con 0x7f05b406fa40 2023-07-09T22:01:59.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05bc25c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b409c120 con 0x7f05b415bd40 2023-07-09T22:01:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05ba7f9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f05b406fa40 0x7f05b406fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05b97f7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f05b40b08d0 0x7f05b406cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34376/0 (socket says 172.21.15.37:34376) 2023-07-09T22:01:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05b97f7640 1 -- 172.21.15.37:0/1627976455 learned_addr learned my addr 172.21.15.37:0/1627976455 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05b9ff8640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b415bd40 0x7f05b4099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05ba7f9640 1 -- 172.21.15.37:0/1627976455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b415bd40 msgr2=0x7f05b4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05ba7f9640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b415bd40 0x7f05b4099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05ba7f9640 1 -- 172.21.15.37:0/1627976455 >> v1:172.21.15.37:6789/0 conn(0x7f05b40b08d0 legacy=0x7f05b406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05b8ff6640 1 -- 172.21.15.37:0/1627976455 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1226504520 0 0) 0x7f05b409c9d0 con 0x7f05b40b08d0 2023-07-09T22:01:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.849+0000 7f05ba7f9640 1 -- 172.21.15.37:0/1627976455 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b415c110 con 0x7f05b406fa40 2023-07-09T22:01:59.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05ba7f9640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b406fa40 0x7f05b406fec0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009d90 tx=0x7f05ac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6a4fd9719b3879 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05b8ff6640 1 -- 172.21.15.37:0/1627976455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0a5780 con 0x7f05b406fa40 2023-07-09T22:01:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05b8ff6640 1 -- 172.21.15.37:0/1627976455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ac0a58e0 con 0x7f05b406fa40 2023-07-09T22:01:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05b8ff6640 1 -- 172.21.15.37:0/1627976455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ac0a5c70 con 0x7f05b406fa40 2023-07-09T22:01:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 -- 172.21.15.37:0/1627976455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b406fa40 msgr2=0x7f05b406fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b406fa40 0x7f05b406fec0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f05ac009d90 tx=0x7f05ac01c8c0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 -- 172.21.15.37:0/1627976455 shutdown_connections 2023-07-09T22:01:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b406fa40 0x7f05b406fec0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 --2- 172.21.15.37:0/1627976455 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b415bd40 0x7f05b4099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 -- 172.21.15.37:0/1627976455 >> 172.21.15.37:0/1627976455 conn(0x7f05b40694f0 msgr2=0x7f05b40698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:01:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 -- 172.21.15.37:0/1627976455 shutdown_connections 2023-07-09T22:01:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.853+0000 7f05bc25c640 1 -- 172.21.15.37:0/1627976455 wait complete. 2023-07-09T22:01:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 Processor -- start 2023-07-09T22:01:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- start start 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 0x7f05b415e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b40b08d0 0x7f05b40acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 0x7f05b4152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415d090 con 0x7f05b415bd40 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415d370 con 0x7f05b406fa40 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b415d650 con 0x7f05b40b08d0 2023-07-09T22:01:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05ba7f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 0x7f05b4152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05ba7f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 0x7f05b4152b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36354/0 (socket says 172.21.15.37:36354) 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05ba7f9640 1 -- 172.21.15.37:0/12359010 learned_addr learned my addr 172.21.15.37:0/12359010 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 0x7f05b415e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b97f7640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b40b08d0 0x7f05b40acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 -- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b40b08d0 msgr2=0x7f05b40acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b40b08d0 0x7f05b40acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 -- 172.21.15.37:0/12359010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 msgr2=0x7f05b4152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 0x7f05b4152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 -- 172.21.15.37:0/12359010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ac009a70 con 0x7f05b406fa40 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05b9ff8640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 0x7f05b415e130 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e870 tx=0x7f05b000ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b00095d0 con 0x7f05b406fa40 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000c940 con 0x7f05b406fa40 2023-07-09T22:01:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000ccb0 con 0x7f05b406fa40 2023-07-09T22:01:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b415d930 con 0x7f05b406fa40 2023-07-09T22:01:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.857+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b40ad4b0 con 0x7f05b406fa40 2023-07-09T22:01:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b4066bc0 con 0x7f05b406fa40 2023-07-09T22:01:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7f05b0013470 con 0x7f05b406fa40 2023-07-09T22:01:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05aa7fc640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 0x7f05980688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:01:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f05b00841d0 con 0x7f05b406fa40 2023-07-09T22:01:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05b97f7640 1 -- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 msgr2=0x7f05980688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:01:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.861+0000 7f05b97f7640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 0x7f05980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:01:59.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:01:59.865+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f05b0051430 con 0x7f05b406fa40 2023-07-09T22:01:59.889 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:59.891+0000 7fee2fbe8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:01:59.895 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:59.893+0000 7fc7bd213180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-09T22:01:59.973 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:01:59.975+0000 7fee2fbe8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:01:59.986 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:01:59.985+0000 7fc7bd213180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-09T22:02:00.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.025+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05b4096fc0 con 0x7f05b406fa40 2023-07-09T22:02:00.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05aa7fc640 1 -- 172.21.15.37:0/12359010 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+18878 (secure 0 0 0) 0x7f05b0054a50 con 0x7f05b406fa40 2023-07-09T22:02:00.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:00.031 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":197,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:01:41.285428+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:02:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 msgr2=0x7f05980688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:02:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 0x7f05980688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 msgr2=0x7f05b415e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 0x7f05b415e130 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e870 tx=0x7f05b000ed30 comp rx=0 tx=0).stop 2023-07-09T22:02:00.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 shutdown_connections 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7f0598066430 0x7f05980688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05b415bd40 0x7f05b4152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05b40b08d0 0x7f05b40acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 --2- 172.21.15.37:0/12359010 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05b406fa40 0x7f05b415e130 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 >> 172.21.15.37:0/12359010 conn(0x7f05b40694f0 msgr2=0x7f05b40cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 shutdown_connections 2023-07-09T22:02:00.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.029+0000 7f05bc25c640 1 -- 172.21.15.37:0/12359010 wait complete. 2023-07-09T22:02:00.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-09T21:22:18.012880+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-07-09T21:22:23.956457+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-09T22:01:21.205098+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '195', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-07-09T22:01:22.084065+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-09T22:02:00.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-09T22:02:00.144 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:02:00.141+0000 7fc7bd213180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-09T22:02:00.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.197+0000 7ff77e18f640 1 Processor -- start 2023-07-09T22:02:00.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.197+0000 7ff77e18f640 1 -- start start 2023-07-09T22:02:00.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff77e18f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff77806ed10 0x7ff77806b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff77e18f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77815fa40 con 0x7ff778070f70 2023-07-09T22:02:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff77e18f640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77815fd20 con 0x7ff7780cef20 2023-07-09T22:02:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff77e18f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff778071340 con 0x7ff77806ed10 2023-07-09T22:02:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff776ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff77806ed10 0x7ff77806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff7777fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff778070f70 0x7ff7781601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34392/0 (socket says 172.21.15.37:34392) 2023-07-09T22:02:00.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff7777fe640 1 -- 172.21.15.37:0/836044711 learned_addr learned my addr 172.21.15.37:0/836044711 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff776ffd640 1 -- 172.21.15.37:0/836044711 >> v1:172.21.15.119:6789/0 conn(0x7ff7780cef20 legacy=0x7ff77815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff776ffd640 1 -- 172.21.15.37:0/836044711 >> v1:172.21.15.37:6789/0 conn(0x7ff778070f70 legacy=0x7ff7781601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff776ffd640 1 -- 172.21.15.37:0/836044711 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77806f160 con 0x7ff77806ed10 2023-07-09T22:02:00.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.201+0000 7ff7767fc640 1 -- 172.21.15.37:0/836044711 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 82479658 0 0) 0x7ff77815fa40 con 0x7ff778070f70 2023-07-09T22:02:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff776ffd640 1 --2- 172.21.15.37:0/836044711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff77806ed10 0x7ff77806b880 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0097c0 tx=0x7ff76c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a8642e09f09375f server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff7767fc640 1 -- 172.21.15.37:0/836044711 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ab600 con 0x7ff77806ed10 2023-07-09T22:02:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff7767fc640 1 -- 172.21.15.37:0/836044711 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c0a7050 con 0x7ff77806ed10 2023-07-09T22:02:00.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff7767fc640 1 -- 172.21.15.37:0/836044711 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ab980 con 0x7ff77806ed10 2023-07-09T22:02:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- 172.21.15.37:0/836044711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff77806ed10 msgr2=0x7ff77806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 --2- 172.21.15.37:0/836044711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff77806ed10 0x7ff77806b880 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0097c0 tx=0x7ff76c01c360 comp rx=0 tx=0).stop 2023-07-09T22:02:00.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- 172.21.15.37:0/836044711 shutdown_connections 2023-07-09T22:02:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 --2- 172.21.15.37:0/836044711 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff77806ed10 0x7ff77806b880 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- 172.21.15.37:0/836044711 >> 172.21.15.37:0/836044711 conn(0x7ff7780694f0 msgr2=0x7ff7780698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- 172.21.15.37:0/836044711 shutdown_connections 2023-07-09T22:02:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- 172.21.15.37:0/836044711 wait complete. 2023-07-09T22:02:00.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 Processor -- start 2023-07-09T22:02:00.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.205+0000 7ff77e18f640 1 -- start start 2023-07-09T22:02:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff77806ed10 0x7ff77813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 0x7ff7780b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780b4170 con 0x7ff7780cef20 2023-07-09T22:02:00.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780b2da0 con 0x7ff778070f70 2023-07-09T22:02:00.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780b3080 con 0x7ff77806ed10 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff777fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 0x7ff7780b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:35712/0 (socket says 172.21.15.37:35712) 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 -- 172.21.15.37:0/4059879276 learned_addr learned my addr 172.21.15.37:0/4059879276 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff7777fe640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff77806ed10 0x7ff77813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 -- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff77806ed10 msgr2=0x7ff77813eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff77806ed10 0x7ff77813eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 -- 172.21.15.37:0/4059879276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 msgr2=0x7ff7780b2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 0x7ff7780b2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 -- 172.21.15.37:0/4059879276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76c009420 con 0x7ff778070f70 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff777fff640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 0x7ff7780b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff776ffd640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff76c019f90 tx=0x7ff76c01aba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c004220 con 0x7ff778070f70 2023-07-09T22:02:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c004380 con 0x7ff778070f70 2023-07-09T22:02:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c003820 con 0x7ff778070f70 2023-07-09T22:02:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7780b3360 con 0x7ff778070f70 2023-07-09T22:02:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77813b2a0 con 0x7ff778070f70 2023-07-09T22:02:00.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.209+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7780b42b0 con 0x7ff778070f70 2023-07-09T22:02:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.213+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 4 ==== mgrmap(e 95) v1 ==== 85817+0+0 (secure 0 0 0) 0x7ff76c003980 con 0x7ff778070f70 2023-07-09T22:02:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.213+0000 7ff75ffff640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 0x7ff7640688e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.213+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 6462+0+0 (secure 0 0 0) 0x7ff76c11e890 con 0x7ff778070f70 2023-07-09T22:02:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.213+0000 7ff7777fe640 1 -- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 msgr2=0x7ff7640688e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.119:6832/2249208328 2023-07-09T22:02:00.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.213+0000 7ff7777fe640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 0x7ff7640688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-09T22:02:00.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.217+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7780b42b0 con 0x7ff778070f70 2023-07-09T22:02:00.237 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:02:00.237+0000 7fc7bd213180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-09T22:02:00.244 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.243+0000 7fee2fbe8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:02:00.304 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.303+0000 7fee2fbe8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:02:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.317+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 7 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7ff76c0ebdb0 con 0x7ff778070f70 2023-07-09T22:02:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.317+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 msgr2=0x7ff7640688e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-09T22:02:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.317+0000 7ff75ffff640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 0x7ff7640688e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.381+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7780b42b0 con 0x7ff778070f70 2023-07-09T22:02:00.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.381+0000 7ff75ffff640 1 -- 172.21.15.37:0/4059879276 <== mon.1 v2:172.21.15.119:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v198) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7780b42b0 con 0x7ff778070f70 2023-07-09T22:02:00.384 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-07-09T22:02:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 msgr2=0x7ff77813ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7ff76c019f90 tx=0x7ff76c01aba0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 shutdown_connections 2023-07-09T22:02:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:6832/2249208328,v1:172.21.15.119:6833/2249208328] conn(0x7ff764066430 0x7ff7640688e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7780cef20 0x7ff7780b2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff778070f70 0x7ff77813ad60 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 --2- 172.21.15.37:0/4059879276 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff77806ed10 0x7ff77813eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 >> 172.21.15.37:0/4059879276 conn(0x7ff7780694f0 msgr2=0x7ff77815c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 shutdown_connections 2023-07-09T22:02:00.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.385+0000 7ff77e18f640 1 -- 172.21.15.37:0/4059879276 wait complete. 2023-07-09T22:02:00.389 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedb855a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.390 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedb855a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.390 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedb855a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.390 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedb855a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.390 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedb855a640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.391 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedbbd61640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.391 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedbbd61640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.391 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedbbd61640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.392 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedbbd61640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.392 INFO:tasks.ceph.mgr.x.smithi119.stderr:2023-07-09T22:02:00.387+0000 7fedbbd61640 -1 client.0 error registering admin socket command: (17) File exists 2023-07-09T22:02:00.408 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-07-09T22:02:00.544 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:02:00.541+0000 7fc7bd213180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-09T22:02:00.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.553+0000 7f1dfe819640 1 Processor -- start 2023-07-09T22:02:00.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.553+0000 7f1dfe819640 1 -- start start 2023-07-09T22:02:00.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1dfe819640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1df80b4a50 0x7f1df815fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1dfe819640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df806bef0 con 0x7f1df806c940 2023-07-09T22:02:00.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1dfe819640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df806f770 con 0x7f1df815ba30 2023-07-09T22:02:00.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1dfe819640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df806fa50 con 0x7f1df80b4a50 2023-07-09T22:02:00.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1df80b4a50 0x7f1df815fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1df80b4a50 0x7f1df815fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36390/0 (socket says 172.21.15.37:36390) 2023-07-09T22:02:00.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 -- 172.21.15.37:0/840876465 learned_addr learned my addr 172.21.15.37:0/840876465 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:00.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 -- 172.21.15.37:0/840876465 >> v1:172.21.15.119:6789/0 conn(0x7f1df815ba30 legacy=0x7f1df815f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 -- 172.21.15.37:0/840876465 >> v1:172.21.15.37:6789/0 conn(0x7f1df806c940 legacy=0x7f1df806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 -- 172.21.15.37:0/840876465 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df806c140 con 0x7f1df80b4a50 2023-07-09T22:02:00.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.557+0000 7f1df77fe640 1 --2- 172.21.15.37:0/840876465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df80b4a50 0x7f1df815fd80 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009870 tx=0x7f1dec01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af91c9b9da613f0c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1df6ffd640 1 -- 172.21.15.37:0/840876465 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0a8050 con 0x7f1df80b4a50 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1df6ffd640 1 -- 172.21.15.37:0/840876465 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dec0ac5f0 con 0x7f1df80b4a50 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1df6ffd640 1 -- 172.21.15.37:0/840876465 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dec0ac980 con 0x7f1df80b4a50 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- 172.21.15.37:0/840876465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df80b4a50 msgr2=0x7f1df815fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 --2- 172.21.15.37:0/840876465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df80b4a50 0x7f1df815fd80 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7f1dec009870 tx=0x7f1dec01c540 comp rx=0 tx=0).stop 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- 172.21.15.37:0/840876465 shutdown_connections 2023-07-09T22:02:00.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 --2- 172.21.15.37:0/840876465 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df80b4a50 0x7f1df815fd80 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- 172.21.15.37:0/840876465 >> 172.21.15.37:0/840876465 conn(0x7f1df80d2460 msgr2=0x7f1df80d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- 172.21.15.37:0/840876465 shutdown_connections 2023-07-09T22:02:00.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- 172.21.15.37:0/840876465 wait complete. 2023-07-09T22:02:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 Processor -- start 2023-07-09T22:02:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.561+0000 7f1dfe819640 1 -- start start 2023-07-09T22:02:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 0x7f1df8141420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1df80b4a50 0x7f1df8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8146a30 con 0x7f1df815ba30 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8145e20 con 0x7f1df806c940 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df8146100 con 0x7f1df80b4a50 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36404/0 (socket says 172.21.15.37:36404) 2023-07-09T22:02:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 -- 172.21.15.37:0/723673035 learned_addr learned my addr 172.21.15.37:0/723673035 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df77fe640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1df80b4a50 0x7f1df8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df7fff640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 0x7f1df8141420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 -- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1df80b4a50 msgr2=0x7f1df8145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1df80b4a50 0x7f1df8145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 -- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 msgr2=0x7f1df8141420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 0x7f1df8141420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 -- 172.21.15.37:0/723673035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dec0094d0 con 0x7f1df815ba30 2023-07-09T22:02:00.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df7fff640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 0x7f1df8141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:00.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfcdb6640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c710 tx=0x7f1df000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df0003b80 con 0x7f1df815ba30 2023-07-09T22:02:00.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1df0003d00 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df81463e0 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1df000aa90 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df8141960 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.565+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df8146ba0 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.569+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f1df000abf0 con 0x7f1df815ba30 2023-07-09T22:02:00.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.569+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f1df0083950 con 0x7f1df815ba30 2023-07-09T22:02:00.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.573+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1df0050ec0 con 0x7f1df815ba30 2023-07-09T22:02:00.612 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-07-09T22:02:00.609+0000 7fc7bd213180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-09T22:02:00.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.729+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1df8066bc0 con 0x7f1df815ba30 2023-07-09T22:02:00.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1df4ff9640 1 -- 172.21.15.37:0/723673035 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v198) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1df00544e0 con 0x7f1df815ba30 2023-07-09T22:02:00.734 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 8 2023-07-09T22:02:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 msgr2=0x7f1df8147290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c710 tx=0x7f1df000cbd0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 shutdown_connections 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1df815ba30 0x7f1df8147290 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1df80b4a50 0x7f1df8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 --2- 172.21.15.37:0/723673035 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1df806c940 0x7f1df8141420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 >> 172.21.15.37:0/723673035 conn(0x7f1df80d2460 msgr2=0x7f1df80b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 shutdown_connections 2023-07-09T22:02:00.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.733+0000 7f1dfe819640 1 -- 172.21.15.37:0/723673035 wait complete. 2023-07-09T22:02:00.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-09T22:02:00.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 Processor -- start 2023-07-09T22:02:00.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 -- start start 2023-07-09T22:02:00.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f3c48070f70 0x7f3c4806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4815fa40 con 0x7f3c4806b880 2023-07-09T22:02:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4815fd20 con 0x7f3c480cef20 2023-07-09T22:02:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c4dd3a640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48071340 con 0x7f3c48070f70 2023-07-09T22:02:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c46ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3c4806b880 0x7f3c481601b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34414/0 (socket says 172.21.15.37:34414) 2023-07-09T22:02:00.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c46ffd640 1 -- 172.21.15.37:0/1454929008 learned_addr learned my addr 172.21.15.37:0/1454929008 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c477fe640 1 --2- 172.21.15.37:0/1454929008 >> v2:172.21.15.119:3300/0 conn(0x7f3c48070f70 0x7f3c4806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c467fc640 1 -- 172.21.15.37:0/1454929008 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373458308 0 0) 0x7f3c4815fa40 con 0x7f3c4806b880 2023-07-09T22:02:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c467fc640 1 -- 172.21.15.37:0/1454929008 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c30003530 con 0x7f3c4806b880 2023-07-09T22:02:00.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c477fe640 1 -- 172.21.15.37:0/1454929008 >> v1:172.21.15.119:6789/0 conn(0x7f3c480cef20 legacy=0x7f3c4815c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c477fe640 1 -- 172.21.15.37:0/1454929008 >> v1:172.21.15.37:6789/0 conn(0x7f3c4806b880 legacy=0x7f3c481601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.901+0000 7f3c477fe640 1 -- 172.21.15.37:0/1454929008 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4806bcd0 con 0x7f3c48070f70 2023-07-09T22:02:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c477fe640 1 --2- 172.21.15.37:0/1454929008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c48070f70 0x7f3c4806ed10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3c380097c0 tx=0x7f3c3801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0b75d97e9e89865 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c467fc640 1 -- 172.21.15.37:0/1454929008 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380ab600 con 0x7f3c48070f70 2023-07-09T22:02:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c467fc640 1 -- 172.21.15.37:0/1454929008 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c380a7050 con 0x7f3c48070f70 2023-07-09T22:02:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c467fc640 1 -- 172.21.15.37:0/1454929008 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c380ab980 con 0x7f3c48070f70 2023-07-09T22:02:00.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/1454929008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c48070f70 msgr2=0x7f3c4806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/1454929008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c48070f70 0x7f3c4806ed10 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3c380097c0 tx=0x7f3c3801c360 comp rx=0 tx=0).stop 2023-07-09T22:02:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/1454929008 shutdown_connections 2023-07-09T22:02:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/1454929008 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c48070f70 0x7f3c4806ed10 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/1454929008 >> 172.21.15.37:0/1454929008 conn(0x7f3c480694f0 msgr2=0x7f3c480698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:00.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/1454929008 shutdown_connections 2023-07-09T22:02:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.905+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/1454929008 wait complete. 2023-07-09T22:02:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 Processor -- start 2023-07-09T22:02:00.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- start start 2023-07-09T22:02:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 0x7f3c480b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 0x7f3c481f9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c481f9f70 con 0x7f3c480cef20 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48144960 con 0x7f3c4806b880 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b3640 con 0x7f3c48070f70 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36408/0 (socket says 172.21.15.37:36408) 2023-07-09T22:02:00.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 -- 172.21.15.37:0/2753644335 learned_addr learned my addr 172.21.15.37:0/2753644335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:00.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c477fe640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 0x7f3c480b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c46ffd640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 0x7f3c481f9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:00.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 -- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 msgr2=0x7f3c481f9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 0x7f3c481f9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 -- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 msgr2=0x7f3c480b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 0x7f3c480b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 -- 172.21.15.37:0/2753644335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c38009420 con 0x7f3c480cef20 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c477fe640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 0x7f3c480b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:00.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c46ffd640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 0x7f3c481f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c47fff640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c7a0 tx=0x7f3c4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40003b80 con 0x7f3c480cef20 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40003ce0 con 0x7f3c480cef20 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000aa90 con 0x7f3c480cef20 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4813e980 con 0x7f3c480cef20 2023-07-09T22:02:00.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480b2ff0 con 0x7f3c480cef20 2023-07-09T22:02:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.909+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c480b37f0 con 0x7f3c480cef20 2023-07-09T22:02:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.913+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f3c4000abf0 con 0x7f3c480cef20 2023-07-09T22:02:00.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.913+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f3c40083a20 con 0x7f3c480cef20 2023-07-09T22:02:00.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:00.917+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3c40050ee0 con 0x7f3c480cef20 2023-07-09T22:02:01.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c48066bc0 con 0x7f3c480cef20 2023-07-09T22:02:01.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c2ffff640 1 -- 172.21.15.37:0/2753644335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v198) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c40054500 con 0x7f3c480cef20 2023-07-09T22:02:01.074 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-07-09T22:02:01.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 msgr2=0x7f3c48144420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c7a0 tx=0x7f3c4000cc60 comp rx=0 tx=0).stop 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 shutdown_connections 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c480cef20 0x7f3c48144420 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f3c48070f70 0x7f3c481f9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 --2- 172.21.15.37:0/2753644335 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f3c4806b880 0x7f3c480b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 >> 172.21.15.37:0/2753644335 conn(0x7f3c480694f0 msgr2=0x7f3c4815c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 shutdown_connections 2023-07-09T22:02:01.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.073+0000 7f3c4dd3a640 1 -- 172.21.15.37:0/2753644335 wait complete. 2023-07-09T22:02:01.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-09T22:02:01.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.237+0000 7f03d4034640 1 Processor -- start 2023-07-09T22:02:01.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.237+0000 7f03d4034640 1 -- start start 2023-07-09T22:02:01.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d4034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 0x7f03cc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d4034640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc15fa40 con 0x7f03cc0cef20 2023-07-09T22:02:01.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d4034640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03cc15fd20 con 0x7f03cc06b880 2023-07-09T22:02:01.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d4034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc071340 con 0x7f03cc070f70 2023-07-09T22:02:01.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d25d1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f03cc0cef20 0x7f03cc15c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34420/0 (socket says 172.21.15.37:34420) 2023-07-09T22:02:01.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d25d1640 1 -- 172.21.15.37:0/2025556546 learned_addr learned my addr 172.21.15.37:0/2025556546 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d1dd0640 1 --2- 172.21.15.37:0/2025556546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 0x7f03cc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 742555766 0 0) 0x7f03cc15fa40 con 0x7f03cc0cef20 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b8003530 con 0x7f03cc0cef20 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 999079427 0 0) 0x7f03cc15fd20 con 0x7f03cc06b880 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03cc15fa40 con 0x7f03cc06b880 2023-07-09T22:02:01.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d1dd0640 1 -- 172.21.15.37:0/2025556546 >> v1:172.21.15.119:6789/0 conn(0x7f03cc06b880 legacy=0x7f03cc1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d1dd0640 1 -- 172.21.15.37:0/2025556546 >> v1:172.21.15.37:6789/0 conn(0x7f03cc0cef20 legacy=0x7f03cc15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.241+0000 7f03d1dd0640 1 -- 172.21.15.37:0/2025556546 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03cc06bcd0 con 0x7f03cc070f70 2023-07-09T22:02:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d1dd0640 1 --2- 172.21.15.37:0/2025556546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 0x7f03cc06ed10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f03c80097f0 tx=0x7f03c801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63a3775b738d658 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80ab600 con 0x7f03cc070f70 2023-07-09T22:02:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c80a7050 con 0x7f03cc070f70 2023-07-09T22:02:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d0dce640 1 -- 172.21.15.37:0/2025556546 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c80ab980 con 0x7f03cc070f70 2023-07-09T22:02:01.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 -- 172.21.15.37:0/2025556546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 msgr2=0x7f03cc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 --2- 172.21.15.37:0/2025556546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 0x7f03cc06ed10 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f03c80097f0 tx=0x7f03c801c3a0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 -- 172.21.15.37:0/2025556546 shutdown_connections 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 --2- 172.21.15.37:0/2025556546 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc070f70 0x7f03cc06ed10 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 -- 172.21.15.37:0/2025556546 >> 172.21.15.37:0/2025556546 conn(0x7f03cc0694f0 msgr2=0x7f03cc0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 -- 172.21.15.37:0/2025556546 shutdown_connections 2023-07-09T22:02:01.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 -- 172.21.15.37:0/2025556546 wait complete. 2023-07-09T22:02:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.245+0000 7f03d4034640 1 Processor -- start 2023-07-09T22:02:01.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- start start 2023-07-09T22:02:01.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc06b880 0x7f03cc141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03cc0cef20 0x7f03cc0b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc0b2780 con 0x7f03cc070f70 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc144270 con 0x7f03cc0cef20 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03cc144550 con 0x7f03cc06b880 2023-07-09T22:02:01.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36424/0 (socket says 172.21.15.37:36424) 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 -- 172.21.15.37:0/2165813337 learned_addr learned my addr 172.21.15.37:0/2165813337 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d25d1640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03cc0cef20 0x7f03cc0b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d1dd0640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc06b880 0x7f03cc141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 -- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc06b880 msgr2=0x7f03cc141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc06b880 0x7f03cc141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 -- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03cc0cef20 msgr2=0x7f03cc0b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03cc0cef20 0x7f03cc0b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 -- 172.21.15.37:0/2165813337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c8009420 con 0x7f03cc070f70 2023-07-09T22:02:01.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d15cf640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c430 tx=0x7f03bc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc0052d0 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03bc005450 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03bc003840 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03cc144830 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03cc156bf0 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.249+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03cc156e10 con 0x7f03cc070f70 2023-07-09T22:02:01.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.253+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 96) v1 ==== 85369+0+0 (secure 0 0 0) 0x7f03bc0039a0 con 0x7f03cc070f70 2023-07-09T22:02:01.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.253+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f03bc083160 con 0x7f03cc070f70 2023-07-09T22:02:01.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.257+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f03bc0506d0 con 0x7f03cc070f70 2023-07-09T22:02:01.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.321+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f03bc050180 con 0x7f03cc070f70 2023-07-09T22:02:01.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.321+0000 7f03c27fc640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 0x7f03b006e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.321+0000 7f03d1dd0640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 0x7f03b006e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.321+0000 7f03d1dd0640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 0x7f03b006e530 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f03c80ad000 tx=0x7f03c80a6000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03cc066bc0 con 0x7f03cc070f70 2023-07-09T22:02:01.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03c27fc640 1 -- 172.21.15.37:0/2165813337 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v198) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03bc0705f0 con 0x7f03cc070f70 2023-07-09T22:02:01.419 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 msgr2=0x7f03b006e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 0x7f03b006e530 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f03c80ad000 tx=0x7f03c80a6000 comp rx=0 tx=0).stop 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 msgr2=0x7f03cc1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f03bc00c430 tx=0x7f03bc00c8f0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 shutdown_connections 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f03cc0cef20 0x7f03cc0b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03cc070f70 0x7f03cc1591e0 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f03b006c150 0x7f03b006e530 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 --2- 172.21.15.37:0/2165813337 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f03cc06b880 0x7f03cc141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 >> 172.21.15.37:0/2165813337 conn(0x7f03cc0694f0 msgr2=0x7f03cc0d00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 shutdown_connections 2023-07-09T22:02:01.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.417+0000 7f03d4034640 1 -- 172.21.15.37:0/2165813337 wait complete. 2023-07-09T22:02:01.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:02:01.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.581+0000 7fde7548a640 1 Processor -- start 2023-07-09T22:02:01.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.581+0000 7fde7548a640 1 -- start start 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde7548a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fde7009a060 0x7fde701524d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde7548a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde70152a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde7548a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7006be50 con 0x7fde7015c040 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde7548a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7009c000 con 0x7fde7009a060 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde7548a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7009c2e0 con 0x7fde7006b930 2023-07-09T22:02:01.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fde7015c040 0x7fde70099950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34426/0 (socket says 172.21.15.37:34426) 2023-07-09T22:02:01.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6ffff640 1 -- 172.21.15.37:0/2833053420 learned_addr learned my addr 172.21.15.37:0/2833053420 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:01.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/2833053420 >> v2:172.21.15.37:3300/0 conn(0x7fde7009a060 0x7fde701524d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde74c89640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde70152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6f7fe640 1 -- 172.21.15.37:0/2833053420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 msgr2=0x7fde70152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:01.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde70152a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6f7fe640 1 -- 172.21.15.37:0/2833053420 >> v1:172.21.15.37:6789/0 conn(0x7fde7015c040 legacy=0x7fde70099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.585+0000 7fde6f7fe640 1 -- 172.21.15.37:0/2833053420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7009c5c0 con 0x7fde7009a060 2023-07-09T22:02:01.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde701524d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fde640097c0 tx=0x7fde6401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e51df04c8cab942 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde6effd640 1 -- 172.21.15.37:0/2833053420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640ab600 con 0x7fde7009a060 2023-07-09T22:02:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde6effd640 1 -- 172.21.15.37:0/2833053420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde640a7050 con 0x7fde7009a060 2023-07-09T22:02:01.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde6effd640 1 -- 172.21.15.37:0/2833053420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640ab980 con 0x7fde7009a060 2023-07-09T22:02:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- 172.21.15.37:0/2833053420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 msgr2=0x7fde701524d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde701524d0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7fde640097c0 tx=0x7fde6401c3f0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- 172.21.15.37:0/2833053420 shutdown_connections 2023-07-09T22:02:01.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde70152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- 172.21.15.37:0/2833053420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde701524d0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- 172.21.15.37:0/2833053420 >> 172.21.15.37:0/2833053420 conn(0x7fde700694f0 msgr2=0x7fde700698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- 172.21.15.37:0/2833053420 shutdown_connections 2023-07-09T22:02:01.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- 172.21.15.37:0/2833053420 wait complete. 2023-07-09T22:02:01.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 Processor -- start 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 -- start start 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde700aa610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.589+0000 7fde7548a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde7015c040 0x7fde70097a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ae680 con 0x7fde7009a060 2023-07-09T22:02:01.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700ae920 con 0x7fde7015c040 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde70153100 con 0x7fde7006b930 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36444/0 (socket says 172.21.15.37:36444) 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 -- 172.21.15.37:0/4183351471 learned_addr learned my addr 172.21.15.37:0/4183351471 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde74c89640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde7015c040 0x7fde70097a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6ffff640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde700aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 -- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 msgr2=0x7fde700aa610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde700aa610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 -- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde7015c040 msgr2=0x7fde70097a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde7015c040 0x7fde70097a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 -- 172.21.15.37:0/4183351471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde64009420 con 0x7fde7009a060 2023-07-09T22:02:01.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6f7fe640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fde640ae040 tx=0x7fde64019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640b4430 con 0x7fde7009a060 2023-07-09T22:02:01.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde640b4590 con 0x7fde7009a060 2023-07-09T22:02:01.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde701533e0 con 0x7fde7009a060 2023-07-09T22:02:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640b4940 con 0x7fde7009a060 2023-07-09T22:02:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde700aec00 con 0x7fde7009a060 2023-07-09T22:02:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde70061100 con 0x7fde7009a060 2023-07-09T22:02:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.593+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fde640b2040 con 0x7fde7009a060 2023-07-09T22:02:01.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.597+0000 7fde6cff9640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 0x7fde5c068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.597+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fde6411d990 con 0x7fde7009a060 2023-07-09T22:02:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.597+0000 7fde6ffff640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 0x7fde5c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.597+0000 7fde6ffff640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 0x7fde5c068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde60005890 tx=0x7fde60009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.601+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fde640eaee0 con 0x7fde7009a060 2023-07-09T22:02:01.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde70153240 con 0x7fde7009a060 2023-07-09T22:02:01.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde6cff9640 1 -- 172.21.15.37:0/4183351471 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fde70153240 con 0x7fde7009a060 2023-07-09T22:02:01.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:01.791 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:02:01.791 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:02:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 msgr2=0x7fde5c068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 0x7fde5c068580 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fde60005890 tx=0x7fde60009040 comp rx=0 tx=0).stop 2023-07-09T22:02:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 msgr2=0x7fde70097520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7fde640ae040 tx=0x7fde64019190 comp rx=0 tx=0).stop 2023-07-09T22:02:01.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 shutdown_connections 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fde7015c040 0x7fde70097a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fde7009a060 0x7fde70097520 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fde5c0660d0 0x7fde5c068580 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 --2- 172.21.15.37:0/4183351471 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fde7006b930 0x7fde700aa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 >> 172.21.15.37:0/4183351471 conn(0x7fde700694f0 msgr2=0x7fde7015def0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 shutdown_connections 2023-07-09T22:02:01.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.789+0000 7fde7548a640 1 -- 172.21.15.37:0/4183351471 wait complete. 2023-07-09T22:02:01.811 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:02:01.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 Processor -- start 2023-07-09T22:02:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 -- start start 2023-07-09T22:02:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 0x7f986415c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986406be50 con 0x7f986409a060 2023-07-09T22:02:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f986409c000 con 0x7f986415c040 2023-07-09T22:02:01.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9868f73640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986409c2e0 con 0x7f9864152be0 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9862ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f986409a060 0x7f98641524d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34434/0 (socket says 172.21.15.37:34434) 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9862ffd640 1 -- 172.21.15.37:0/556279752 learned_addr learned my addr 172.21.15.37:0/556279752 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9863fff640 1 --2- 172.21.15.37:0/556279752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 0x7f986415c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806728915 0 0) 0x7f986406be50 con 0x7f986409a060 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f984c003530 con 0x7f986409a060 2023-07-09T22:02:01.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870866595 0 0) 0x7f986409c000 con 0x7f986415c040 2023-07-09T22:02:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f986406be50 con 0x7f986415c040 2023-07-09T22:02:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9863fff640 1 -- 172.21.15.37:0/556279752 >> v1:172.21.15.119:6789/0 conn(0x7f986415c040 legacy=0x7f9864099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9863fff640 1 -- 172.21.15.37:0/556279752 >> v1:172.21.15.37:6789/0 conn(0x7f986409a060 legacy=0x7f98641524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.953+0000 7f9863fff640 1 -- 172.21.15.37:0/556279752 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986409c5c0 con 0x7f9864152be0 2023-07-09T22:02:01.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9863fff640 1 --2- 172.21.15.37:0/556279752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 0x7f986415c410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f985c009dc0 tx=0x7f985c01c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=367d247249d3dbca server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0a5990 con 0x7f9864152be0 2023-07-09T22:02:01.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0a5af0 con 0x7f9864152be0 2023-07-09T22:02:01.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f98627fc640 1 -- 172.21.15.37:0/556279752 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0a5e60 con 0x7f9864152be0 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 -- 172.21.15.37:0/556279752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 msgr2=0x7f986415c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 --2- 172.21.15.37:0/556279752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 0x7f986415c410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f985c009dc0 tx=0x7f985c01c8b0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 -- 172.21.15.37:0/556279752 shutdown_connections 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 --2- 172.21.15.37:0/556279752 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9864152be0 0x7f986415c410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 -- 172.21.15.37:0/556279752 >> 172.21.15.37:0/556279752 conn(0x7f98640694f0 msgr2=0x7f98640698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:01.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 -- 172.21.15.37:0/556279752 shutdown_connections 2023-07-09T22:02:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.957+0000 7f9868f73640 1 -- 172.21.15.37:0/556279752 wait complete. 2023-07-09T22:02:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 Processor -- start 2023-07-09T22:02:01.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- start start 2023-07-09T22:02:01.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986409a060 0x7f98640aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 0x7f98640ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98641f8880 con 0x7f986415c040 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864151a40 con 0x7f9864152be0 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9864097a30 con 0x7f986409a060 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36458/0 (socket says 172.21.15.37:36458) 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 -- 172.21.15.37:0/1994743092 learned_addr learned my addr 172.21.15.37:0/1994743092 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9862ffd640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 0x7f98640ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f98637fe640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986409a060 0x7f98640aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 -- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986409a060 msgr2=0x7f98640aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986409a060 0x7f98640aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 -- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 msgr2=0x7f98640ab020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:01.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 0x7f98640ab020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 -- 172.21.15.37:0/1994743092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c009a70 con 0x7f986415c040 2023-07-09T22:02:01.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9862ffd640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 0x7f98640ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9863fff640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f985c0194c0 tx=0x7f985c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c007000 con 0x7f986415c040 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0aed30 con 0x7f986415c040 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0aeea0 con 0x7f986415c040 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98641f85a0 con 0x7f986415c040 2023-07-09T22:02:01.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986415fa60 con 0x7f986415c040 2023-07-09T22:02:01.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.961+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986415fd10 con 0x7f986415c040 2023-07-09T22:02:01.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.965+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7f985c0b4050 con 0x7f986415c040 2023-07-09T22:02:01.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.965+0000 7f984bfff640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 0x7f9850068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:01.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.965+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7f985c11eff0 con 0x7f986415c040 2023-07-09T22:02:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.965+0000 7f98637fe640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 0x7f9850068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:01.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.965+0000 7f98637fe640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 0x7f9850068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98540015e0 tx=0x7f9854009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:01.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:01.969+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f985c14f700 con 0x7f986415c040 2023-07-09T22:02:02.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9864151bd0 con 0x7f986415c040 2023-07-09T22:02:02.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f984bfff640 1 -- 172.21.15.37:0/1994743092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+19447 (secure 0 0 0) 0x7f985c0b2090 con 0x7f986415c040 2023-07-09T22:02:02.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:02.128 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":198,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:02:00.307221+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2562275025":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/88497583":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2455535740":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3923412593":"2023-07-10T22:02:00.307165+0000","172.21.15.119:6833/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3375034810":"2023-07-10T22:02:00.307165+0000","172.21.15.119:6832/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/970506968":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/820648977":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:02:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 msgr2=0x7f9850068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 0x7f9850068580 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f98540015e0 tx=0x7f9854009040 comp rx=0 tx=0).stop 2023-07-09T22:02:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 msgr2=0x7f9864151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.125+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f985c0194c0 tx=0x7f985c019650 comp rx=0 tx=0).stop 2023-07-09T22:02:02.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 shutdown_connections 2023-07-09T22:02:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f986415c040 0x7f9864151ed0 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9864152be0 0x7f98640ab020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f98500660d0 0x7f9850068580 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 --2- 172.21.15.37:0/1994743092 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f986409a060 0x7f98640aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 >> 172.21.15.37:0/1994743092 conn(0x7f98640694f0 msgr2=0x7f986415e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 shutdown_connections 2023-07-09T22:02:02.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.129+0000 7f9868f73640 1 -- 172.21.15.37:0/1994743092 wait complete. 2023-07-09T22:02:02.148 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T22:02:02.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:02:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 Processor -- start 2023-07-09T22:02:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 -- start start 2023-07-09T22:02:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd0ac0afd70 0x7fd0ac06fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0a9670 con 0x7fd0ac158a50 2023-07-09T22:02:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac06c080 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0b1f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0ac06ea90 con 0x7fd0ac0afd70 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36468/0 (socket says 172.21.15.37:36468) 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 -- 172.21.15.37:0/2184371275 learned_addr learned my addr 172.21.15.37:0/2184371275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0abfff640 1 --2- 172.21.15.37:0/2184371275 >> v2:172.21.15.119:3300/0 conn(0x7fd0ac0afd70 0x7fd0ac06fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 -- 172.21.15.37:0/2184371275 >> v2:172.21.15.119:3300/0 conn(0x7fd0ac0afd70 msgr2=0x7fd0ac06fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 --2- 172.21.15.37:0/2184371275 >> v2:172.21.15.119:3300/0 conn(0x7fd0ac0afd70 0x7fd0ac06fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.289+0000 7fd0aaffd640 1 -- 172.21.15.37:0/2184371275 >> v1:172.21.15.119:6789/0 conn(0x7fd0ac158a50 legacy=0x7fd0ac06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:02.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0aaffd640 1 -- 172.21.15.37:0/2184371275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac06ed70 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0aaffd640 1 --2- 172.21.15.37:0/2184371275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0acd90 tx=0x7fd0a001eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8244832736ed2f70 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0aa7fc640 1 -- 172.21.15.37:0/2184371275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00a7af0 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0aa7fc640 1 -- 172.21.15.37:0/2184371275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a00a7c50 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0aa7fc640 1 -- 172.21.15.37:0/2184371275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a00af440 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 -- 172.21.15.37:0/2184371275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 msgr2=0x7fd0ac06bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/2184371275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac0acd90 tx=0x7fd0a001eb10 comp rx=0 tx=0).stop 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 -- 172.21.15.37:0/2184371275 shutdown_connections 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/2184371275 >> v2:172.21.15.119:3300/0 conn(0x7fd0ac0afd70 0x7fd0ac06fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/2184371275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac06bb40 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 -- 172.21.15.37:0/2184371275 >> 172.21.15.37:0/2184371275 conn(0x7fd0ac0af260 msgr2=0x7fd0ac0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 -- 172.21.15.37:0/2184371275 shutdown_connections 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.293+0000 7fd0b1f40640 1 -- 172.21.15.37:0/2184371275 wait complete. 2023-07-09T22:02:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 Processor -- start 2023-07-09T22:02:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 -- start start 2023-07-09T22:02:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0ac0afd70 0x7fd0ac155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0ac158a50 0x7fd0ac152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac094180 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac157cd0 con 0x7fd0ac158a50 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0b1f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac157fb0 con 0x7fd0ac0afd70 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36482/0 (socket says 172.21.15.37:36482) 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 -- 172.21.15.37:0/3807777483 learned_addr learned my addr 172.21.15.37:0/3807777483 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:02.302 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0aaffd640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0ac0afd70 0x7fd0ac155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0abfff640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0ac158a50 0x7fd0ac152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 -- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0ac0afd70 msgr2=0x7fd0ac155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0ac0afd70 0x7fd0ac155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 -- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0ac158a50 msgr2=0x7fd0ac152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0ac158a50 0x7fd0ac152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 -- 172.21.15.37:0/3807777483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a000b770 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.297+0000 7fd0ab7fe640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c400 tx=0x7fd09c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c0052d0 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c005430 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c003890 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac158290 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac156040 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac066bc0 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 97) v1 ==== 85496+0+0 (secure 0 0 0) 0x7fd09c0039f0 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 0x7fd098068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fd09c083290 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.301+0000 7fd0aaffd640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 0x7fd098068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.305+0000 7fd0aaffd640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 0x7fd098068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b1000 tx=0x7fd0a0008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.305+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd09c050710 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0ac06b4f0 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd093fff640 1 -- 172.21.15.37:0/3807777483 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fd09c053d30 con 0x7fd0ac06d9e0 2023-07-09T22:02:02.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:02.499 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:02:02.499 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:02:02.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 msgr2=0x7fd098068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 0x7fd098068580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd0a00b1000 tx=0x7fd0a0008040 comp rx=0 tx=0).stop 2023-07-09T22:02:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 msgr2=0x7fd0ac1575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c400 tx=0x7fd09c00c8c0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 shutdown_connections 2023-07-09T22:02:02.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd0ac158a50 0x7fd0ac152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd0980660d0 0x7fd098068580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd0ac0afd70 0x7fd0ac155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 --2- 172.21.15.37:0/3807777483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0ac06d9e0 0x7fd0ac1575f0 unknown :-1 s=CLOSED pgs=2118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 >> 172.21.15.37:0/3807777483 conn(0x7fd0ac0af260 msgr2=0x7fd0ac0a61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 shutdown_connections 2023-07-09T22:02:02.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.497+0000 7fd0b1f40640 1 -- 172.21.15.37:0/3807777483 wait complete. 2023-07-09T22:02:02.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:02:02.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 Processor -- start 2023-07-09T22:02:02.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 -- start start 2023-07-09T22:02:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fbd6015bd40 0x7fbd60099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 0x7fbd6006fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6009c9d0 con 0x7fbd600b08d0 2023-07-09T22:02:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd60070400 con 0x7fbd6015bd40 2023-07-09T22:02:02.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd6649c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6009c120 con 0x7fbd6006fa40 2023-07-09T22:02:02.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd5f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbd600b08d0 0x7fbd6006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34446/0 (socket says 172.21.15.37:34446) 2023-07-09T22:02:02.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd5f7fe640 1 -- 172.21.15.37:0/591677290 learned_addr learned my addr 172.21.15.37:0/591677290 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:02.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd64a39640 1 --2- 172.21.15.37:0/591677290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 0x7fbd6006fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd5ffff640 1 --2- 172.21.15.37:0/591677290 >> v2:172.21.15.119:3300/0 conn(0x7fbd6015bd40 0x7fbd60099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd5effd640 1 -- 172.21.15.37:0/591677290 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1628521089 0 0) 0x7fbd6009c9d0 con 0x7fbd600b08d0 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd5effd640 1 -- 172.21.15.37:0/591677290 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd48003530 con 0x7fbd600b08d0 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd64a39640 1 -- 172.21.15.37:0/591677290 >> v2:172.21.15.119:3300/0 conn(0x7fbd6015bd40 msgr2=0x7fbd60099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd64a39640 1 --2- 172.21.15.37:0/591677290 >> v2:172.21.15.119:3300/0 conn(0x7fbd6015bd40 0x7fbd60099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd64a39640 1 -- 172.21.15.37:0/591677290 >> v1:172.21.15.37:6789/0 conn(0x7fbd600b08d0 legacy=0x7fbd6006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.669+0000 7fbd64a39640 1 -- 172.21.15.37:0/591677290 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6015c110 con 0x7fbd6006fa40 2023-07-09T22:02:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd64a39640 1 --2- 172.21.15.37:0/591677290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 0x7fbd6006fec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009d90 tx=0x7fbd5801c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=600281e289321db3 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd5effd640 1 -- 172.21.15.37:0/591677290 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580a5780 con 0x7fbd6006fa40 2023-07-09T22:02:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd5effd640 1 -- 172.21.15.37:0/591677290 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580a58e0 con 0x7fbd6006fa40 2023-07-09T22:02:02.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd5effd640 1 -- 172.21.15.37:0/591677290 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd580a5c70 con 0x7fbd6006fa40 2023-07-09T22:02:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 -- 172.21.15.37:0/591677290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 msgr2=0x7fbd6006fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 --2- 172.21.15.37:0/591677290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 0x7fbd6006fec0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009d90 tx=0x7fbd5801c8c0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 -- 172.21.15.37:0/591677290 shutdown_connections 2023-07-09T22:02:02.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 --2- 172.21.15.37:0/591677290 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd6006fa40 0x7fbd6006fec0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 --2- 172.21.15.37:0/591677290 >> v2:172.21.15.119:3300/0 conn(0x7fbd6015bd40 0x7fbd60099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 -- 172.21.15.37:0/591677290 >> 172.21.15.37:0/591677290 conn(0x7fbd600694f0 msgr2=0x7fbd600698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:02.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 -- 172.21.15.37:0/591677290 shutdown_connections 2023-07-09T22:02:02.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.673+0000 7fbd6649c640 1 -- 172.21.15.37:0/591677290 wait complete. 2023-07-09T22:02:02.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 Processor -- start 2023-07-09T22:02:02.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- start start 2023-07-09T22:02:02.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd600b08d0 0x7fbd600acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 0x7fbd60157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6015d3e0 con 0x7fbd6006fa40 2023-07-09T22:02:02.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600aa6e0 con 0x7fbd6015bd40 2023-07-09T22:02:02.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600aaf80 con 0x7fbd600b08d0 2023-07-09T22:02:02.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36486/0 (socket says 172.21.15.37:36486) 2023-07-09T22:02:02.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 -- 172.21.15.37:0/3795590597 learned_addr learned my addr 172.21.15.37:0/3795590597 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:02.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5f7fe640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd600b08d0 0x7fbd600acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd64a39640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 0x7fbd60157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 -- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd600b08d0 msgr2=0x7fbd600acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd600b08d0 0x7fbd600acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 -- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 msgr2=0x7fbd60157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 0x7fbd60157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 -- 172.21.15.37:0/3795590597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58009a70 con 0x7fbd6006fa40 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd64a39640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 0x7fbd60157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5ffff640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e930 tx=0x7fbd5000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50009690 con 0x7fbd6006fa40 2023-07-09T22:02:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5000ca00 con 0x7fbd6006fa40 2023-07-09T22:02:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000cd70 con 0x7fbd6006fa40 2023-07-09T22:02:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6015d100 con 0x7fbd6006fa40 2023-07-09T22:02:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.677+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd600aac10 con 0x7fbd6006fa40 2023-07-09T22:02:02.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd60066bc0 con 0x7fbd6006fa40 2023-07-09T22:02:02.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fbd50013470 con 0x7fbd6006fa40 2023-07-09T22:02:02.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd5cff9640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 0x7fbd4c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:02.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fbd500843b0 con 0x7fbd6006fa40 2023-07-09T22:02:02.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd5f7fe640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 0x7fbd4c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:02.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.681+0000 7fbd5f7fe640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 0x7fbd4c068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd60153870 tx=0x7fbd54009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:02.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.685+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbd500514b0 con 0x7fbd6006fa40 2023-07-09T22:02:02.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.873+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd6009c630 con 0x7fbd6006fa40 2023-07-09T22:02:02.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.873+0000 7fbd5cff9640 1 -- 172.21.15.37:0/3795590597 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4686 (secure 0 0 0) 0x7fbd50054ad0 con 0x7fbd6006fa40 2023-07-09T22:02:02.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:02.877 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-07-09T22:01:23.091702+0000","modified":"2023-07-09T22:01:26.737153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10761},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10761":{"gid":10761,"name":"a","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/3019715389","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3019715389},{"type":"v1","addr":"172.21.15.37:6835","nonce":3019715389}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-07-09T22:02:02.877 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 84 2023-07-09T22:02:02.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 msgr2=0x7fbd4c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 0x7fbd4c068850 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbd60153870 tx=0x7fbd54009040 comp rx=0 tx=0).stop 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 msgr2=0x7fbd60153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7fbd5000e930 tx=0x7fbd5000edf0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 shutdown_connections 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fbd6015bd40 0x7fbd60157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fbd4c0663a0 0x7fbd4c068850 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fbd600b08d0 0x7fbd600acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 --2- 172.21.15.37:0/3795590597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbd6006fa40 0x7fbd60153330 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 >> 172.21.15.37:0/3795590597 conn(0x7fbd600694f0 msgr2=0x7fbd600698c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 shutdown_connections 2023-07-09T22:02:02.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:02.877+0000 7fbd6649c640 1 -- 172.21.15.37:0/3795590597 wait complete. 2023-07-09T22:02:02.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:02:03.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 Processor -- start 2023-07-09T22:02:03.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 -- start start 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e00ae880 0x7fa8e0097af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8e0098030 0x7fa8e0165890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e015c1c0 con 0x7fa8e00ace40 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00af8b0 con 0x7fa8e0098030 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.037+0000 7fa8e7034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e00984b0 con 0x7fa8e00ae880 2023-07-09T22:02:03.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8e0098030 0x7fa8e0165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa8e0098030 0x7fa8e0165890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36494/0 (socket says 172.21.15.37:36494) 2023-07-09T22:02:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1131638702 learned_addr learned my addr 172.21.15.37:0/1131638702 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8dffff640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e00ae880 0x7fa8e0097af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1131638702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e00ae880 msgr2=0x7fa8e0097af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e00ae880 0x7fa8e0097af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1131638702 >> v1:172.21.15.119:6789/0 conn(0x7fa8e00ace40 legacy=0x7fa8e00affb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1131638702 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e006d9f0 con 0x7fa8e0098030 2023-07-09T22:02:03.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8e55d1640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e0098030 0x7fa8e0165890 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009e50 tx=0x7fa8d801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c091ce52473ca5 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8df7fe640 1 -- 172.21.15.37:0/1131638702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a57d0 con 0x7fa8e0098030 2023-07-09T22:02:03.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8df7fe640 1 -- 172.21.15.37:0/1131638702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d80a5930 con 0x7fa8e0098030 2023-07-09T22:02:03.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.041+0000 7fa8df7fe640 1 -- 172.21.15.37:0/1131638702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80a5cc0 con 0x7fa8e0098030 2023-07-09T22:02:03.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- 172.21.15.37:0/1131638702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e0098030 msgr2=0x7fa8e0165890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e0098030 0x7fa8e0165890 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8009e50 tx=0x7fa8d801ca10 comp rx=0 tx=0).stop 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- 172.21.15.37:0/1131638702 shutdown_connections 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e00ae880 0x7fa8e0097af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1131638702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e0098030 0x7fa8e0165890 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- 172.21.15.37:0/1131638702 >> 172.21.15.37:0/1131638702 conn(0x7fa8e0096fb0 msgr2=0x7fa8e00b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:03.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- 172.21.15.37:0/1131638702 shutdown_connections 2023-07-09T22:02:03.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- 172.21.15.37:0/1131638702 wait complete. 2023-07-09T22:02:03.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 Processor -- start 2023-07-09T22:02:03.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- start start 2023-07-09T22:02:03.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e0098030 0x7fa8e0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8e00ace40 0x7fa8e00998c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0156570 con 0x7fa8e00ae880 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01551a0 con 0x7fa8e00ace40 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e7034640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0155480 con 0x7fa8e0098030 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36506/0 (socket says 172.21.15.37:36506) 2023-07-09T22:02:03.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1120704175 learned_addr learned my addr 172.21.15.37:0/1120704175 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e4dd0640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e0098030 0x7fa8e0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8dffff640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8e00ace40 0x7fa8e00998c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e0098030 msgr2=0x7fa8e0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e0098030 0x7fa8e0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8e00ace40 msgr2=0x7fa8e00998c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8e00ace40 0x7fa8e00998c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.045+0000 7fa8e55d1640 1 -- 172.21.15.37:0/1120704175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d8009b30 con 0x7fa8e00ae880 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8e55d1640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fa8d801a640 tx=0x7fa8d80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80b8670 con 0x7fa8e00ae880 2023-07-09T22:02:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d80b87d0 con 0x7fa8e00ae880 2023-07-09T22:02:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80b8b80 con 0x7fa8e00ae880 2023-07-09T22:02:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e0155760 con 0x7fa8e00ae880 2023-07-09T22:02:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01542a0 con 0x7fa8e00ae880 2023-07-09T22:02:03.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e0097c80 con 0x7fa8e00ae880 2023-07-09T22:02:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8d80b8ce0 con 0x7fa8e00ae880 2023-07-09T22:02:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 0x7fa8c4068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fa8d811f6d0 con 0x7fa8e00ae880 2023-07-09T22:02:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.049+0000 7fa8e4dd0640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 0x7fa8c4068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.053+0000 7fa8e4dd0640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 0x7fa8c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4007fd0 tx=0x7fa8d4009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.053+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8d80ec910 con 0x7fa8e00ae880 2023-07-09T22:02:03.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.209+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8e0095bb0 con 0x7fa8e00ae880 2023-07-09T22:02:03.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.209+0000 7fa8dd7fa640 1 -- 172.21.15.37:0/1120704175 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v198) v1 ==== 74+0+19447 (secure 0 0 0) 0x7fa8d80eff30 con 0x7fa8e00ae880 2023-07-09T22:02:03.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:03.212 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":198,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:02:00.307221+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-07-09T22:01:21.205098+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"195","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-07-09T22:01:22.084065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.119:0/2562275025":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/88497583":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2455535740":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3923412593":"2023-07-10T22:02:00.307165+0000","172.21.15.119:6833/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3375034810":"2023-07-10T22:02:00.307165+0000","172.21.15.119:6832/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/970506968":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/820648977":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:02:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 msgr2=0x7fa8c4068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 0x7fa8c4068850 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4007fd0 tx=0x7fa8d4009040 comp rx=0 tx=0).stop 2023-07-09T22:02:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 msgr2=0x7fa8e0099e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7fa8d801a640 tx=0x7fa8d80197b0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 shutdown_connections 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa8e00ae880 0x7fa8e0099e00 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa8e00ace40 0x7fa8e00998c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa8c40663a0 0x7fa8c4068850 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 --2- 172.21.15.37:0/1120704175 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa8e0098030 0x7fa8e0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 >> 172.21.15.37:0/1120704175 conn(0x7fa8e0096fb0 msgr2=0x7fa8e00adaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 shutdown_connections 2023-07-09T22:02:03.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.213+0000 7fa8e7034640 1 -- 172.21.15.37:0/1120704175 wait complete. 2023-07-09T22:02:03.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-07-09T22:02:03.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 Processor -- start 2023-07-09T22:02:03.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 -- start start 2023-07-09T22:02:03.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fdf8815c040 0x7fdf88099950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf8806b930 0x7fdf88099e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8806be50 con 0x7fdf8809bab0 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8809c000 con 0x7fdf8806b930 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf8cc69640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8809c2e0 con 0x7fdf8815c040 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf8806b930 0x7fdf88099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdf8806b930 0x7fdf88099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36520/0 (socket says 172.21.15.37:36520) 2023-07-09T22:02:03.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf87fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdf8809bab0 0x7fdf881524d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34448/0 (socket says 172.21.15.37:34448) 2023-07-09T22:02:03.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 -- 172.21.15.37:0/3225951435 learned_addr learned my addr 172.21.15.37:0/3225951435 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf877fe640 1 --2- 172.21.15.37:0/3225951435 >> v2:172.21.15.119:3300/0 conn(0x7fdf8815c040 0x7fdf88099950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 -- 172.21.15.37:0/3225951435 >> v2:172.21.15.119:3300/0 conn(0x7fdf8815c040 msgr2=0x7fdf88099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:03.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 --2- 172.21.15.37:0/3225951435 >> v2:172.21.15.119:3300/0 conn(0x7fdf8815c040 0x7fdf88099950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 -- 172.21.15.37:0/3225951435 >> v1:172.21.15.37:6789/0 conn(0x7fdf8809bab0 legacy=0x7fdf881524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.377+0000 7fdf86ffd640 1 -- 172.21.15.37:0/3225951435 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8809c5c0 con 0x7fdf8806b930 2023-07-09T22:02:03.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf86ffd640 1 --2- 172.21.15.37:0/3225951435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88099e90 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fdf8806d800 tx=0x7fdf7c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a525873bf10f81ef server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf867fc640 1 -- 172.21.15.37:0/3225951435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0ab660 con 0x7fdf8806b930 2023-07-09T22:02:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf867fc640 1 -- 172.21.15.37:0/3225951435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0ab7c0 con 0x7fdf8806b930 2023-07-09T22:02:03.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf867fc640 1 -- 172.21.15.37:0/3225951435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0abb50 con 0x7fdf8806b930 2023-07-09T22:02:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 -- 172.21.15.37:0/3225951435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 msgr2=0x7fdf88099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/3225951435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88099e90 secure :-1 s=READY pgs=2124 cs=0 l=1 rev1=1 crypto rx=0x7fdf8806d800 tx=0x7fdf7c01c440 comp rx=0 tx=0).stop 2023-07-09T22:02:03.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 -- 172.21.15.37:0/3225951435 shutdown_connections 2023-07-09T22:02:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/3225951435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88099e90 unknown :-1 s=CLOSED pgs=2124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/3225951435 >> v2:172.21.15.119:3300/0 conn(0x7fdf8815c040 0x7fdf88099950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 -- 172.21.15.37:0/3225951435 >> 172.21.15.37:0/3225951435 conn(0x7fdf880694f0 msgr2=0x7fdf880698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 -- 172.21.15.37:0/3225951435 shutdown_connections 2023-07-09T22:02:03.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.381+0000 7fdf8cc69640 1 -- 172.21.15.37:0/3225951435 wait complete. 2023-07-09T22:02:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 Processor -- start 2023-07-09T22:02:03.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- start start 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf8809bab0 0x7fdf880ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf8815c040 0x7fdf88097530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88155010 con 0x7fdf8806b930 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88151ed0 con 0x7fdf8809bab0 2023-07-09T22:02:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881552c0 con 0x7fdf8815c040 2023-07-09T22:02:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36526/0 (socket says 172.21.15.37:36526) 2023-07-09T22:02:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 -- 172.21.15.37:0/347653608 learned_addr learned my addr 172.21.15.37:0/347653608 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf86ffd640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf8809bab0 0x7fdf880ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 -- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf8815c040 msgr2=0x7fdf88097530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf8815c040 0x7fdf88097530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 -- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf8809bab0 msgr2=0x7fdf880ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf8809bab0 0x7fdf880ad030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 -- 172.21.15.37:0/347653608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0094d0 con 0x7fdf8806b930 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf877fe640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800d5f0 tx=0x7fdf7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf780125f0 con 0x7fdf8806b930 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf78012750 con 0x7fdf8806b930 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf881555a0 con 0x7fdf8806b930 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf78012ae0 con 0x7fdf8806b930 2023-07-09T22:02:03.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.385+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf880b0e40 con 0x7fdf8806b930 2023-07-09T22:02:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf88061100 con 0x7fdf8806b930 2023-07-09T22:02:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fdf78012c40 con 0x7fdf8806b930 2023-07-09T22:02:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf6ffff640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 0x7fdf74068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 6849+0+0 (secure 0 0 0) 0x7fdf78084610 con 0x7fdf8806b930 2023-07-09T22:02:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf86ffd640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 0x7fdf74068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.389+0000 7fdf86ffd640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 0x7fdf74068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0af000 tx=0x7fdf7c008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.393+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf780516f0 con 0x7fdf8806b930 2023-07-09T22:02:03.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.577+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdf8806d160 con 0x7fdf8806b930 2023-07-09T22:02:03.581 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-07-09T22:02:03.581+0000 7fce6685b640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-07-09T22:02:03.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf6ffff640 1 -- 172.21.15.37:0/347653608 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v85) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdf78054d10 con 0x7fdf8806b930 2023-07-09T22:02:03.590 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-07-09T22:02:03.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 msgr2=0x7fdf74068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 0x7fdf74068850 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0af000 tx=0x7fdf7c008040 comp rx=0 tx=0).stop 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 msgr2=0x7fdf88155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800d5f0 tx=0x7fdf7800dab0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 shutdown_connections 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fdf740663a0 0x7fdf74068850 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fdf8815c040 0x7fdf88097530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fdf8809bab0 0x7fdf880ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 --2- 172.21.15.37:0/347653608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8806b930 0x7fdf88155da0 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 >> 172.21.15.37:0/347653608 conn(0x7fdf880694f0 msgr2=0x7fdf8815d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:03.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 shutdown_connections 2023-07-09T22:02:03.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.589+0000 7fdf8cc69640 1 -- 172.21.15.37:0/347653608 wait complete. 2023-07-09T22:02:03.596 INFO:tasks.ceph.mds.a.smithi037.stderr: -4159> 2023-07-09T22:01:28.673+0000 7f98d55a4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-09T22:02:03.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-07-09T22:02:03.648 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-07-09T22:02:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.761+0000 7f92a83e9640 1 Processor -- start 2023-07-09T22:02:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.761+0000 7f92a83e9640 1 -- start start 2023-07-09T22:02:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a83e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 0x7f92a006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a83e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a00cef20 0x7f92a00cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a83e9640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a015fa40 con 0x7f92a006b880 2023-07-09T22:02:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a83e9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a00cf8e0 con 0x7f92a00cef20 2023-07-09T22:02:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a83e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a015fd20 con 0x7f92a0070f70 2023-07-09T22:02:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a00cef20 0x7f92a00cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f92a00cef20 0x7f92a00cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36562/0 (socket says 172.21.15.37:36562) 2023-07-09T22:02:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 -- 172.21.15.37:0/3888015752 learned_addr learned my addr 172.21.15.37:0/3888015752 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6185640 1 --2- 172.21.15.37:0/3888015752 >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 0x7f92a006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 -- 172.21.15.37:0/3888015752 >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 msgr2=0x7f92a006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 --2- 172.21.15.37:0/3888015752 >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 0x7f92a006ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 -- 172.21.15.37:0/3888015752 >> v1:172.21.15.119:6789/0 conn(0x7f92a006b880 legacy=0x7f92a01601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6986640 1 -- 172.21.15.37:0/3888015752 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0071340 con 0x7f92a00cef20 2023-07-09T22:02:03.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.765+0000 7f92a6185640 1 --2- 172.21.15.37:0/3888015752 >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 0x7f92a006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a6986640 1 --2- 172.21.15.37:0/3888015752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a00cf3a0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f92a006d540 tx=0x7f929801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6972ea2a490ce28c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a5183640 1 -- 172.21.15.37:0/3888015752 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980a5660 con 0x7f92a00cef20 2023-07-09T22:02:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a5183640 1 -- 172.21.15.37:0/3888015752 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980a57c0 con 0x7f92a00cef20 2023-07-09T22:02:03.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a5183640 1 -- 172.21.15.37:0/3888015752 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980a5b50 con 0x7f92a00cef20 2023-07-09T22:02:03.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- 172.21.15.37:0/3888015752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 msgr2=0x7f92a00cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- 172.21.15.37:0/3888015752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a00cf3a0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f92a006d540 tx=0x7f929801c8b0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- 172.21.15.37:0/3888015752 shutdown_connections 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- 172.21.15.37:0/3888015752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a00cf3a0 unknown :-1 s=CLOSED pgs=2128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- 172.21.15.37:0/3888015752 >> v2:172.21.15.119:3300/0 conn(0x7f92a0070f70 0x7f92a006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- 172.21.15.37:0/3888015752 >> 172.21.15.37:0/3888015752 conn(0x7f92a00694f0 msgr2=0x7f92a00698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- 172.21.15.37:0/3888015752 shutdown_connections 2023-07-09T22:02:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- 172.21.15.37:0/3888015752 wait complete. 2023-07-09T22:02:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 Processor -- start 2023-07-09T22:02:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- start start 2023-07-09T22:02:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a006b880 0x7f92a00b2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92a0070f70 0x7f92a013e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a013c170 con 0x7f92a00cef20 2023-07-09T22:02:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a00b35b0 con 0x7f92a006b880 2023-07-09T22:02:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.769+0000 7f92a83e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a013b5c0 con 0x7f92a0070f70 2023-07-09T22:02:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36570/0 (socket says 172.21.15.37:36570) 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 -- 172.21.15.37:0/4038053675 learned_addr learned my addr 172.21.15.37:0/4038053675 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6185640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a006b880 0x7f92a00b2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a5984640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92a0070f70 0x7f92a013e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 -- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92a0070f70 msgr2=0x7f92a013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92a0070f70 0x7f92a013e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 -- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a006b880 msgr2=0x7f92a00b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a006b880 0x7f92a00b2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 -- 172.21.15.37:0/4038053675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9298009b30 con 0x7f92a00cef20 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a6986640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f92980194c0 tx=0x7f9298019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980a5660 con 0x7f92a00cef20 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92980b8880 con 0x7f92a00cef20 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92980b8c10 con 0x7f92a00cef20 2023-07-09T22:02:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a013b7d0 con 0x7f92a00cef20 2023-07-09T22:02:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a013bd90 con 0x7f92a00cef20 2023-07-09T22:02:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a0066bc0 con 0x7f92a00cef20 2023-07-09T22:02:03.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.773+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f92980b6440 con 0x7f92a00cef20 2023-07-09T22:02:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.777+0000 7f9296ffd640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 0x7f9284068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.777+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6935+0+0 (secure 0 0 0) 0x7f929811f7d0 con 0x7f92a00cef20 2023-07-09T22:02:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.777+0000 7f92a6185640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 0x7f9284068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:03.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.777+0000 7f92a6185640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 0x7f9284068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f929c009950 tx=0x7f929c008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:03.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.781+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92980ec910 con 0x7f92a00cef20 2023-07-09T22:02:03.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:03.969+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f92a006d840 con 0x7f92a00cef20 2023-07-09T22:02:04.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f9296ffd640 1 -- 172.21.15.37:0/4038053675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v86) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9298009510 con 0x7f92a00cef20 2023-07-09T22:02:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 msgr2=0x7f9284068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 0x7f9284068850 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f929c009950 tx=0x7f929c008040 comp rx=0 tx=0).stop 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 msgr2=0x7f92a013c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 secure :-1 s=READY pgs=2129 cs=0 l=1 rev1=1 crypto rx=0x7f92980194c0 tx=0x7f9298019650 comp rx=0 tx=0).stop 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 shutdown_connections 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92a00cef20 0x7f92a013c570 unknown :-1 s=CLOSED pgs=2129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f92840663a0 0x7f9284068850 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f92a0070f70 0x7f92a013e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 --2- 172.21.15.37:0/4038053675 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f92a006b880 0x7f92a00b2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 >> 172.21.15.37:0/4038053675 conn(0x7f92a00694f0 msgr2=0x7f92a015d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.609+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 shutdown_connections 2023-07-09T22:02:04.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.613+0000 7f92a83e9640 1 -- 172.21.15.37:0/4038053675 wait complete. 2023-07-09T22:02:04.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-07-09T22:02:04.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.821+0000 7fc85a6ec640 1 Processor -- start 2023-07-09T22:02:04.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.821+0000 7fc85a6ec640 1 -- start start 2023-07-09T22:02:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc85a6ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc85415bb40 0x7fc85406b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc85a6ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85406c8f0 0x7fc85415fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc85a6ec640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8540cd5a0 con 0x7fc85406c470 2023-07-09T22:02:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc85a6ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8540ced20 con 0x7fc85415bb40 2023-07-09T22:02:04.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc85a6ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540cd880 con 0x7fc85406c8f0 2023-07-09T22:02:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc85415bb40 0x7fc85406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc85415bb40 0x7fc85406b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36582/0 (socket says 172.21.15.37:36582) 2023-07-09T22:02:04.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 -- 172.21.15.37:0/2457771570 learned_addr learned my addr 172.21.15.37:0/2457771570 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc858c89640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85406c8f0 0x7fc85415fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 -- 172.21.15.37:0/2457771570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85406c8f0 msgr2=0x7fc85415fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85406c8f0 0x7fc85415fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 -- 172.21.15.37:0/2457771570 >> v1:172.21.15.119:6789/0 conn(0x7fc85406c470 legacy=0x7fc85415f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.825+0000 7fc853fff640 1 -- 172.21.15.37:0/2457771570 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85406cd70 con 0x7fc85415bb40 2023-07-09T22:02:04.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc853fff640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85415bb40 0x7fc85406b830 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5be40e02434cc7c server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc852ffd640 1 -- 172.21.15.37:0/2457771570 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440aa670 con 0x7fc85415bb40 2023-07-09T22:02:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc852ffd640 1 -- 172.21.15.37:0/2457771570 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8440aa7d0 con 0x7fc85415bb40 2023-07-09T22:02:04.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc852ffd640 1 -- 172.21.15.37:0/2457771570 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8440aab60 con 0x7fc85415bb40 2023-07-09T22:02:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- 172.21.15.37:0/2457771570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85415bb40 msgr2=0x7fc85406b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85415bb40 0x7fc85406b830 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fc844009870 tx=0x7fc84401c510 comp rx=0 tx=0).stop 2023-07-09T22:02:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- 172.21.15.37:0/2457771570 shutdown_connections 2023-07-09T22:02:04.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85406c8f0 0x7fc85415fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/2457771570 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85415bb40 0x7fc85406b830 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- 172.21.15.37:0/2457771570 >> 172.21.15.37:0/2457771570 conn(0x7fc8540d2470 msgr2=0x7fc8540d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- 172.21.15.37:0/2457771570 shutdown_connections 2023-07-09T22:02:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- 172.21.15.37:0/2457771570 wait complete. 2023-07-09T22:02:04.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 Processor -- start 2023-07-09T22:02:04.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.829+0000 7fc85a6ec640 1 -- start start 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85406c470 0x7fc85414d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85415bb40 0x7fc85414b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85414c410 con 0x7fc85406c8f0 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540cb2c0 con 0x7fc85406c470 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540ca990 con 0x7fc85415bb40 2023-07-09T22:02:04.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36584/0 (socket says 172.21.15.37:36584) 2023-07-09T22:02:04.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 -- 172.21.15.37:0/3120654850 learned_addr learned my addr 172.21.15.37:0/3120654850 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:04.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc853fff640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85406c470 0x7fc85414d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc858c89640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85415bb40 0x7fc85414b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 -- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85415bb40 msgr2=0x7fc85414b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85415bb40 0x7fc85414b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 -- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85406c470 msgr2=0x7fc85414d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85406c470 0x7fc85414d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 -- 172.21.15.37:0/3120654850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8440094d0 con 0x7fc85406c8f0 2023-07-09T22:02:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc8537fe640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c3c0 tx=0x7fc84800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:04.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480052d0 con 0x7fc85406c8f0 2023-07-09T22:02:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc848005430 con 0x7fc85406c8f0 2023-07-09T22:02:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848003840 con 0x7fc85406c8f0 2023-07-09T22:02:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8540cac70 con 0x7fc85406c8f0 2023-07-09T22:02:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8541444f0 con 0x7fc85406c8f0 2023-07-09T22:02:04.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.833+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc854066bc0 con 0x7fc85406c8f0 2023-07-09T22:02:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.837+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fc8480039a0 con 0x7fc85406c8f0 2023-07-09T22:02:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.837+0000 7fc850ff9640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 0x7fc840068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:04.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.837+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 6935+0+0 (secure 0 0 0) 0x7fc848083720 con 0x7fc85406c8f0 2023-07-09T22:02:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.837+0000 7fc853fff640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 0x7fc840068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:04.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.837+0000 7fc853fff640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 0x7fc840068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ae000 tx=0x7fc8440b5040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:04.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.841+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc848050730 con 0x7fc85406c8f0 2023-07-09T22:02:05.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:04.997+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8540cb400 con 0x7fc85406c8f0 2023-07-09T22:02:05.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.617+0000 7fc850ff9640 1 -- 172.21.15.37:0/3120654850 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v200) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc848053d50 con 0x7fc85406c8f0 2023-07-09T22:02:05.620 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-07-09T22:02:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 msgr2=0x7fc840068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 0x7fc840068850 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8440ae000 tx=0x7fc8440b5040 comp rx=0 tx=0).stop 2023-07-09T22:02:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 msgr2=0x7fc85414dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc84800c3c0 tx=0x7fc84800c880 comp rx=0 tx=0).stop 2023-07-09T22:02:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 shutdown_connections 2023-07-09T22:02:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fc8400663a0 0x7fc840068850 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fc85415bb40 0x7fc85414b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc85406c8f0 0x7fc85414dd90 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 --2- 172.21.15.37:0/3120654850 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fc85406c470 0x7fc85414d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 >> 172.21.15.37:0/3120654850 conn(0x7fc8540d2470 msgr2=0x7fc8540d11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:05.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 shutdown_connections 2023-07-09T22:02:05.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.621+0000 7fc85a6ec640 1 -- 172.21.15.37:0/3120654850 wait complete. 2023-07-09T22:02:05.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-07-09T22:02:05.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.801+0000 7fb55d4de640 1 Processor -- start 2023-07-09T22:02:05.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.801+0000 7fb55d4de640 1 -- start start 2023-07-09T22:02:05.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55d4de640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb55815b8d0 0x7fb5580b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55d4de640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 0x7fb5580b7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55d4de640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5580b3bf0 con 0x7fb5580b2db0 2023-07-09T22:02:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55d4de640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55806fa00 con 0x7fb55815b8d0 2023-07-09T22:02:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55d4de640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580b3ed0 con 0x7fb55815bca0 2023-07-09T22:02:05.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55ccdd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb5580b2db0 0x7fb55815f5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34458/0 (socket says 172.21.15.37:34458) 2023-07-09T22:02:05.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb55ccdd640 1 -- 172.21.15.37:0/1696765285 learned_addr learned my addr 172.21.15.37:0/1696765285 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:05.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb557fff640 1 --2- 172.21.15.37:0/1696765285 >> v2:172.21.15.119:3300/0 conn(0x7fb55815b8d0 0x7fb5580b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb5577fe640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 0x7fb5580b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804020465 0 0) 0x7fb5580b3bf0 con 0x7fb5580b2db0 2023-07-09T22:02:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb540003530 con 0x7fb5580b2db0 2023-07-09T22:02:05.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb557fff640 1 -- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 msgr2=0x7fb5580b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb557fff640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 0x7fb5580b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb557fff640 1 -- 172.21.15.37:0/1696765285 >> v1:172.21.15.37:6789/0 conn(0x7fb5580b2db0 legacy=0x7fb55815f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3776036995 0 0) 0x7fb540003530 con 0x7fb5580b2db0 2023-07-09T22:02:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb557fff640 1 -- 172.21.15.37:0/1696765285 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5580b41b0 con 0x7fb55815b8d0 2023-07-09T22:02:05.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.805+0000 7fb5577fe640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 0x7fb5580b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:05.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb557fff640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815b8d0 0x7fb5580b3610 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb5480097c0 tx=0x7fb54801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3391fb411bc59bfc server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480ab670 con 0x7fb55815b8d0 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480ab7d0 con 0x7fb55815b8d0 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb556ffd640 1 -- 172.21.15.37:0/1696765285 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480abb60 con 0x7fb55815b8d0 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815b8d0 msgr2=0x7fb5580b3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815b8d0 0x7fb5580b3610 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fb5480097c0 tx=0x7fb54801c450 comp rx=0 tx=0).stop 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- 172.21.15.37:0/1696765285 shutdown_connections 2023-07-09T22:02:05.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815bca0 0x7fb5580b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 --2- 172.21.15.37:0/1696765285 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815b8d0 0x7fb5580b3610 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- 172.21.15.37:0/1696765285 >> 172.21.15.37:0/1696765285 conn(0x7fb5580d23e0 msgr2=0x7fb5580d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- 172.21.15.37:0/1696765285 shutdown_connections 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- 172.21.15.37:0/1696765285 wait complete. 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 Processor -- start 2023-07-09T22:02:05.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.809+0000 7fb55d4de640 1 -- start start 2023-07-09T22:02:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815b8d0 0x7fb5581598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 0x7fb558159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5581f7400 con 0x7fb5580b2db0 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55815d8c0 con 0x7fb55815bca0 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55815dba0 con 0x7fb55815b8d0 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36586/0 (socket says 172.21.15.37:36586) 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 -- 172.21.15.37:0/2922268904 learned_addr learned my addr 172.21.15.37:0/2922268904 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb5577fe640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815b8d0 0x7fb5581598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55ccdd640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 0x7fb558159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 -- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815b8d0 msgr2=0x7fb5581598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815b8d0 0x7fb5581598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 -- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 msgr2=0x7fb558159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:05.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 0x7fb558159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 -- 172.21.15.37:0/2922268904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c009420 con 0x7fb5580b2db0 2023-07-09T22:02:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55ccdd640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 0x7fb558159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:05.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb557fff640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fb5480ad040 tx=0x7fb54801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480bf610 con 0x7fb5580b2db0 2023-07-09T22:02:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480bf7b0 con 0x7fb5580b2db0 2023-07-09T22:02:05.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480bfb60 con 0x7fb5580b2db0 2023-07-09T22:02:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb548009420 con 0x7fb5580b2db0 2023-07-09T22:02:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb558150d80 con 0x7fb5580b2db0 2023-07-09T22:02:05.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.813+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb558061100 con 0x7fb5580b2db0 2023-07-09T22:02:05.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.817+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb5480bfcc0 con 0x7fb5580b2db0 2023-07-09T22:02:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.817+0000 7fb554ff9640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 0x7fb544068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.817+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 6497+0+0 (secure 0 0 0) 0x7fb54811ed00 con 0x7fb5580b2db0 2023-07-09T22:02:05.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.817+0000 7fb5577fe640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 0x7fb544068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.817+0000 7fb5577fe640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 0x7fb544068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb5580b7ea0 tx=0x7fb54c008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:05.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.821+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb5480ebf50 con 0x7fb5580b2db0 2023-07-09T22:02:05.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:05.977+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb55815dce0 con 0x7fb5580b2db0 2023-07-09T22:02:06.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:06.011 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb554ff9640 1 -- 172.21.15.37:0/2922268904 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v201) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb55815dce0 con 0x7fb5580b2db0 2023-07-09T22:02:06.630 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-07-09T22:02:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 msgr2=0x7fb544068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 0x7fb544068850 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb5580b7ea0 tx=0x7fb54c008040 comp rx=0 tx=0).stop 2023-07-09T22:02:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 msgr2=0x7fb5581f6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7fb5480ad040 tx=0x7fb54801ac90 comp rx=0 tx=0).stop 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 shutdown_connections 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb55815bca0 0x7fb558159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb5440663a0 0x7fb544068850 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb55815b8d0 0x7fb5581598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 --2- 172.21.15.37:0/2922268904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5580b2db0 0x7fb5581f6ec0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.629+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 >> 172.21.15.37:0/2922268904 conn(0x7fb5580d23e0 msgr2=0x7fb55806ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:06.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.633+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 shutdown_connections 2023-07-09T22:02:06.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.633+0000 7fb55d4de640 1 -- 172.21.15.37:0/2922268904 wait complete. 2023-07-09T22:02:06.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-07-09T22:02:06.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 Processor -- start 2023-07-09T22:02:06.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 -- start start 2023-07-09T22:02:06.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70fc06ed10 0x7f70fc06b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:06.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15fa40 con 0x7f70fc0cef20 2023-07-09T22:02:06.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc15fd20 con 0x7f70fc070f70 2023-07-09T22:02:06.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f7101159640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc071340 con 0x7f70fc06ed10 2023-07-09T22:02:06.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70fc06ed10 0x7f70fc06b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:06.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f70fc06ed10 0x7f70fc06b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36592/0 (socket says 172.21.15.37:36592) 2023-07-09T22:02:06.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 -- 172.21.15.37:0/1482597952 learned_addr learned my addr 172.21.15.37:0/1482597952 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:06.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 -- 172.21.15.37:0/1482597952 >> v1:172.21.15.119:6789/0 conn(0x7f70fc070f70 legacy=0x7f70fc1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:06.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 -- 172.21.15.37:0/1482597952 >> v1:172.21.15.37:6789/0 conn(0x7f70fc0cef20 legacy=0x7f70fc15c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.801+0000 7f70f3fff640 1 -- 172.21.15.37:0/1482597952 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc06f160 con 0x7f70fc06ed10 2023-07-09T22:02:06.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f70f3fff640 1 --2- 172.21.15.37:0/1482597952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc06b880 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009870 tx=0x7f70e401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=440809b4c74b780e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:06.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f70fa59c640 1 -- 172.21.15.37:0/1482597952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40ab600 con 0x7f70fc06ed10 2023-07-09T22:02:06.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f70fa59c640 1 -- 172.21.15.37:0/1482597952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40a7050 con 0x7f70fc06ed10 2023-07-09T22:02:06.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f70fa59c640 1 -- 172.21.15.37:0/1482597952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40ab980 con 0x7f70fc06ed10 2023-07-09T22:02:06.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 -- 172.21.15.37:0/1482597952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 msgr2=0x7f70fc06b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 --2- 172.21.15.37:0/1482597952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc06b880 secure :-1 s=READY pgs=2135 cs=0 l=1 rev1=1 crypto rx=0x7f70e4009870 tx=0x7f70e401c3e0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 -- 172.21.15.37:0/1482597952 shutdown_connections 2023-07-09T22:02:06.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 --2- 172.21.15.37:0/1482597952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc06b880 unknown :-1 s=CLOSED pgs=2135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 -- 172.21.15.37:0/1482597952 >> 172.21.15.37:0/1482597952 conn(0x7f70fc0694f0 msgr2=0x7f70fc0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:06.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 -- 172.21.15.37:0/1482597952 shutdown_connections 2023-07-09T22:02:06.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.805+0000 7f7101159640 1 -- 172.21.15.37:0/1482597952 wait complete. 2023-07-09T22:02:06.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 Processor -- start 2023-07-09T22:02:06.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- start start 2023-07-09T22:02:06.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 0x7f70fc145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70fc0cef20 0x7f70fc0b2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc13d0f0 con 0x7f70fc06ed10 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b5170 con 0x7f70fc070f70 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0b4560 con 0x7f70fc0cef20 2023-07-09T22:02:06.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36604/0 (socket says 172.21.15.37:36604) 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 -- 172.21.15.37:0/1970142629 learned_addr learned my addr 172.21.15.37:0/1970142629 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70f3fff640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 0x7f70fc145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 -- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70fc0cef20 msgr2=0x7f70fc0b2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70fc0cef20 0x7f70fc0b2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 -- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 msgr2=0x7f70fc145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.813 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 0x7f70fc145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 -- 172.21.15.37:0/1970142629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40094d0 con 0x7f70fc06ed10 2023-07-09T22:02:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70f3fff640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 0x7f70fc145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70fad9d640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b410 tx=0x7f70ec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:06.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec004020 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec004180 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011630 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0b4840 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.809+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc0b4e00 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc066bc0 con 0x7f70fc06ed10 2023-07-09T22:02:06.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f70ec011790 con 0x7f70fc06ed10 2023-07-09T22:02:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f70f37fe640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 0x7f70dc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f70ec083ce0 con 0x7f70fc06ed10 2023-07-09T22:02:06.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f70f3fff640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 0x7f70dc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:06.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.813+0000 7f70f3fff640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 0x7f70dc068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ad000 tx=0x7f70e4008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:06.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.817+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f70ec050f90 con 0x7f70fc06ed10 2023-07-09T22:02:06.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.973+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f70fc167bc0 con 0x7f70fc06ed10 2023-07-09T22:02:06.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.977+0000 7f70f37fe640 1 -- 172.21.15.37:0/1970142629 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v67) v1 ==== 104+0+0 (secure 0 0 0) 0x7f70ec0545b0 con 0x7f70fc06ed10 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 msgr2=0x7f70dc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 0x7f70dc068850 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f70e40ad000 tx=0x7f70e4008040 comp rx=0 tx=0).stop 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 msgr2=0x7f70fc155930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00b410 tx=0x7f70ec00b8d0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 shutdown_connections 2023-07-09T22:02:06.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f70dc0663a0 0x7f70dc068850 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f70fc0cef20 0x7f70fc0b2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f70fc070f70 0x7f70fc145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 --2- 172.21.15.37:0/1970142629 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70fc06ed10 0x7f70fc155930 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 >> 172.21.15.37:0/1970142629 conn(0x7f70fc0694f0 msgr2=0x7f70fc1601b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 shutdown_connections 2023-07-09T22:02:06.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:06.981+0000 7f7101159640 1 -- 172.21.15.37:0/1970142629 wait complete. 2023-07-09T22:02:07.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/allow_m_granularity 2023-07-09T22:02:07.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 Processor -- start 2023-07-09T22:02:07.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 -- start start 2023-07-09T22:02:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f01ec070f70 0x7f01ec06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01ec0cef20 0x7f01ec0cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec15fa40 con 0x7f01ec06b880 2023-07-09T22:02:07.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0cf8e0 con 0x7f01ec0cef20 2023-07-09T22:02:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f4434640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec15fd20 con 0x7f01ec070f70 2023-07-09T22:02:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01ec0cef20 0x7f01ec0cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f01ec0cef20 0x7f01ec0cf3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36620/0 (socket says 172.21.15.37:36620) 2023-07-09T22:02:07.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 -- 172.21.15.37:0/3629980408 learned_addr learned my addr 172.21.15.37:0/3629980408 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f21d0640 1 --2- 172.21.15.37:0/3629980408 >> v2:172.21.15.119:3300/0 conn(0x7f01ec070f70 0x7f01ec06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 -- 172.21.15.37:0/3629980408 >> v2:172.21.15.119:3300/0 conn(0x7f01ec070f70 msgr2=0x7f01ec06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 --2- 172.21.15.37:0/3629980408 >> v2:172.21.15.119:3300/0 conn(0x7f01ec070f70 0x7f01ec06ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 -- 172.21.15.37:0/3629980408 >> v1:172.21.15.119:6789/0 conn(0x7f01ec06b880 legacy=0x7f01ec1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.145+0000 7f01f29d1640 1 -- 172.21.15.37:0/3629980408 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec071340 con 0x7f01ec0cef20 2023-07-09T22:02:07.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f29d1640 1 --2- 172.21.15.37:0/3629980408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0cef20 0x7f01ec0cf3a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06d540 tx=0x7f01e401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1d67c5789c68ce server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f11ce640 1 -- 172.21.15.37:0/3629980408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40a5620 con 0x7f01ec0cef20 2023-07-09T22:02:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f11ce640 1 -- 172.21.15.37:0/3629980408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e40a5780 con 0x7f01ec0cef20 2023-07-09T22:02:07.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f11ce640 1 -- 172.21.15.37:0/3629980408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e40a5b10 con 0x7f01ec0cef20 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 -- 172.21.15.37:0/3629980408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0cef20 msgr2=0x7f01ec0cf3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 --2- 172.21.15.37:0/3629980408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0cef20 0x7f01ec0cf3a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f01ec06d540 tx=0x7f01e401c870 comp rx=0 tx=0).stop 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 -- 172.21.15.37:0/3629980408 shutdown_connections 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 --2- 172.21.15.37:0/3629980408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec0cef20 0x7f01ec0cf3a0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 --2- 172.21.15.37:0/3629980408 >> v2:172.21.15.119:3300/0 conn(0x7f01ec070f70 0x7f01ec06ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 -- 172.21.15.37:0/3629980408 >> 172.21.15.37:0/3629980408 conn(0x7f01ec0694f0 msgr2=0x7f01ec0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 -- 172.21.15.37:0/3629980408 shutdown_connections 2023-07-09T22:02:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.149+0000 7f01f4434640 1 -- 172.21.15.37:0/3629980408 wait complete. 2023-07-09T22:02:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 Processor -- start 2023-07-09T22:02:07.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- start start 2023-07-09T22:02:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 0x7f01ec13b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01ec0cef20 0x7f01ec13da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec135ae0 con 0x7f01ec070f70 2023-07-09T22:02:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec135790 con 0x7f01ec06b880 2023-07-09T22:02:07.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec13ba50 con 0x7f01ec0cef20 2023-07-09T22:02:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36630/0 (socket says 172.21.15.37:36630) 2023-07-09T22:02:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 -- 172.21.15.37:0/986255309 learned_addr learned my addr 172.21.15.37:0/986255309 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f21d0640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 0x7f01ec13b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f29d1640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01ec0cef20 0x7f01ec13da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 -- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01ec0cef20 msgr2=0x7f01ec13da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01ec0cef20 0x7f01ec13da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 -- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 msgr2=0x7f01ec13b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 0x7f01ec13b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 -- 172.21.15.37:0/986255309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e4009b30 con 0x7f01ec070f70 2023-07-09T22:02:07.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f21d0640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 0x7f01ec13b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f19cf640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c450 tx=0x7f01dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc012830 con 0x7f01ec070f70 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0129b0 con 0x7f01ec070f70 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc012d60 con 0x7f01ec070f70 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01ec0b4b00 con 0x7f01ec070f70 2023-07-09T22:02:07.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.153+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec0b50c0 con 0x7f01ec070f70 2023-07-09T22:02:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec066bc0 con 0x7f01ec070f70 2023-07-09T22:02:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f01dc01c460 con 0x7f01ec070f70 2023-07-09T22:02:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01e2ffd640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 0x7f01d0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f01dc083b20 con 0x7f01ec070f70 2023-07-09T22:02:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01f21d0640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 0x7f01d0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.157+0000 7f01f21d0640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 0x7f01d0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007e50 tx=0x7f01e8008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.161+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f01dc050f10 con 0x7f01ec070f70 2023-07-09T22:02:07.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.325+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"} v 0) v1 -- 0x7f01ec06c520 con 0x7f01ec070f70 2023-07-09T22:02:07.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01e2ffd640 1 -- 172.21.15.37:0/986255309 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/allow_m_granularity"}]=0 v68) v1 ==== 120+0+0 (secure 0 0 0) 0x7f01dc054530 con 0x7f01ec070f70 2023-07-09T22:02:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 msgr2=0x7f01d0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 0x7f01d0068850 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f01e8007e50 tx=0x7f01e8008040 comp rx=0 tx=0).stop 2023-07-09T22:02:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 msgr2=0x7f01ec13d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00c450 tx=0x7f01dc00c910 comp rx=0 tx=0).stop 2023-07-09T22:02:07.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 shutdown_connections 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f01d00663a0 0x7f01d0068850 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f01ec0cef20 0x7f01ec13da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01ec070f70 0x7f01ec13d4c0 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 --2- 172.21.15.37:0/986255309 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f01ec06b880 0x7f01ec13b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 >> 172.21.15.37:0/986255309 conn(0x7f01ec0694f0 msgr2=0x7f01ec13e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 shutdown_connections 2023-07-09T22:02:07.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.329+0000 7f01f4434640 1 -- 172.21.15.37:0/986255309 wait complete. 2023-07-09T22:02:07.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr/snap_schedule/dump_on_update 2023-07-09T22:02:07.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.493+0000 7fb423d2c640 1 Processor -- start 2023-07-09T22:02:07.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.493+0000 7fb423d2c640 1 -- start start 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb423d2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb41c070f70 0x7fb41c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb423d2c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fb41c0cef20 0x7fb41c0cf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb423d2c640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c15fa40 con 0x7fb41c06b880 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb423d2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c0cf8e0 con 0x7fb41c070f70 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb423d2c640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c15fd20 con 0x7fb41c0cef20 2023-07-09T22:02:07.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb41c070f70 0x7fb41c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb41c070f70 0x7fb41c06ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55436/0 (socket says 172.21.15.37:55436) 2023-07-09T22:02:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 -- 172.21.15.37:0/3994502289 learned_addr learned my addr 172.21.15.37:0/3994502289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb4222c9640 1 --2- 172.21.15.37:0/3994502289 >> v2:172.21.15.119:3300/0 conn(0x7fb41c0cef20 0x7fb41c0cf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 -- 172.21.15.37:0/3994502289 >> v2:172.21.15.119:3300/0 conn(0x7fb41c0cef20 msgr2=0x7fb41c0cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 --2- 172.21.15.37:0/3994502289 >> v2:172.21.15.119:3300/0 conn(0x7fb41c0cef20 0x7fb41c0cf3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 -- 172.21.15.37:0/3994502289 >> v1:172.21.15.119:6789/0 conn(0x7fb41c06b880 legacy=0x7fb41c1601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.497+0000 7fb421ac8640 1 -- 172.21.15.37:0/3994502289 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c071340 con 0x7fb41c070f70 2023-07-09T22:02:07.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb421ac8640 1 --2- 172.21.15.37:0/3994502289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c06ed10 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fb41c06b630 tx=0x7fb41801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c627725d7acac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb420ac6640 1 -- 172.21.15.37:0/3994502289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180ab600 con 0x7fb41c070f70 2023-07-09T22:02:07.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb420ac6640 1 -- 172.21.15.37:0/3994502289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4180a7050 con 0x7fb41c070f70 2023-07-09T22:02:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb420ac6640 1 -- 172.21.15.37:0/3994502289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4180ab980 con 0x7fb41c070f70 2023-07-09T22:02:07.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- 172.21.15.37:0/3994502289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 msgr2=0x7fb41c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- 172.21.15.37:0/3994502289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c06ed10 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fb41c06b630 tx=0x7fb41801c3e0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- 172.21.15.37:0/3994502289 shutdown_connections 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- 172.21.15.37:0/3994502289 >> v2:172.21.15.119:3300/0 conn(0x7fb41c0cef20 0x7fb41c0cf3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- 172.21.15.37:0/3994502289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c06ed10 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- 172.21.15.37:0/3994502289 >> 172.21.15.37:0/3994502289 conn(0x7fb41c0694f0 msgr2=0x7fb41c0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- 172.21.15.37:0/3994502289 shutdown_connections 2023-07-09T22:02:07.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- 172.21.15.37:0/3994502289 wait complete. 2023-07-09T22:02:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 Processor -- start 2023-07-09T22:02:07.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- start start 2023-07-09T22:02:07.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c06b880 0x7fb41c0b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 0x7fb41c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b33b0 con 0x7fb41c070f70 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b3690 con 0x7fb41c06b880 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.501+0000 7fb423d2c640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b3970 con 0x7fb41c0cef20 2023-07-09T22:02:07.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55448/0 (socket says 172.21.15.37:55448) 2023-07-09T22:02:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 -- 172.21.15.37:0/94060118 learned_addr learned my addr 172.21.15.37:0/94060118 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb421ac8640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c06b880 0x7fb41c0b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4222c9640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 0x7fb41c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 -- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 msgr2=0x7fb41c158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 0x7fb41c158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 -- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c06b880 msgr2=0x7fb41c0b4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c06b880 0x7fb41c0b4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 -- 172.21.15.37:0/94060118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180094d0 con 0x7fb41c070f70 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4222c9640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 0x7fb41c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:07.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4212c7640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c500 tx=0x7fb40c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c005220 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c005380 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c0b3c50 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c007270 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c0b4840 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c066bc0 con 0x7fb41c070f70 2023-07-09T22:02:07.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.505+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb40c0073d0 con 0x7fb41c070f70 2023-07-09T22:02:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.509+0000 7fb4127fc640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 0x7fb400068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.509+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fb40c083790 con 0x7fb41c070f70 2023-07-09T22:02:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.509+0000 7fb421ac8640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 0x7fb400068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.509+0000 7fb421ac8640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 0x7fb400068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4180ad000 tx=0x7fb4180a6000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.509+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb40c050a50 con 0x7fb41c070f70 2023-07-09T22:02:07.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.677+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"} v 0) v1 -- 0x7fb41c06d840 con 0x7fb41c070f70 2023-07-09T22:02:07.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb4127fc640 1 -- 172.21.15.37:0/94060118 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mgr", "name": "mgr/snap_schedule/dump_on_update"}]=0 v69) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb40c054070 con 0x7fb41c070f70 2023-07-09T22:02:07.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 msgr2=0x7fb400068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 0x7fb400068850 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4180ad000 tx=0x7fb4180a6000 comp rx=0 tx=0).stop 2023-07-09T22:02:07.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 msgr2=0x7fb41c144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c500 tx=0x7fb40c00c9c0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 shutdown_connections 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb4000663a0 0x7fb400068850 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb41c0cef20 0x7fb41c158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb41c070f70 0x7fb41c144430 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 --2- 172.21.15.37:0/94060118 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb41c06b880 0x7fb41c0b4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.681+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 >> 172.21.15.37:0/94060118 conn(0x7fb41c0694f0 msgr2=0x7fb41c144e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:07.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.685+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 shutdown_connections 2023-07-09T22:02:07.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.685+0000 7fb423d2c640 1 -- 172.21.15.37:0/94060118 wait complete. 2023-07-09T22:02:07.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name' 2023-07-09T22:02:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 Processor -- start 2023-07-09T22:02:07.847 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 -- start start 2023-07-09T22:02:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d9c160010 0x7f7d9c164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c1603e0 0x7f7d9c06cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c06b930 con 0x7f7d9c06d6f0 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c164c50 con 0x7f7d9c160010 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da3e9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c06c790 con 0x7f7d9c1603e0 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da1c3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d9c160010 0x7f7d9c164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da1c3a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7d9c160010 0x7f7d9c164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55456/0 (socket says 172.21.15.37:55456) 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.845+0000 7f7da1c3a640 1 -- 172.21.15.37:0/3195865463 learned_addr learned my addr 172.21.15.37:0/3195865463 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da1c3a640 1 -- 172.21.15.37:0/3195865463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c1603e0 msgr2=0x7f7d9c06cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da1c3a640 1 --2- 172.21.15.37:0/3195865463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c1603e0 0x7f7d9c06cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da1c3a640 1 -- 172.21.15.37:0/3195865463 >> v1:172.21.15.119:6789/0 conn(0x7f7d9c06d6f0 legacy=0x7f7d9c070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da1c3a640 1 -- 172.21.15.37:0/3195865463 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c06bb80 con 0x7f7d9c160010 2023-07-09T22:02:07.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da1c3a640 1 --2- 172.21.15.37:0/3195865463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c160010 0x7f7d9c164710 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f7d98006fd0 tx=0x7f7d9801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e67d020a983cfda server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da0c38640 1 -- 172.21.15.37:0/3195865463 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980a6040 con 0x7f7d9c160010 2023-07-09T22:02:07.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da0c38640 1 -- 172.21.15.37:0/3195865463 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d980aa600 con 0x7f7d9c160010 2023-07-09T22:02:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da0c38640 1 -- 172.21.15.37:0/3195865463 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d980aa990 con 0x7f7d9c160010 2023-07-09T22:02:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3195865463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c160010 msgr2=0x7f7d9c164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3195865463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c160010 0x7f7d9c164710 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f7d98006fd0 tx=0x7f7d9801c4e0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3195865463 shutdown_connections 2023-07-09T22:02:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3195865463 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c1603e0 0x7f7d9c06cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3195865463 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c160010 0x7f7d9c164710 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3195865463 >> 172.21.15.37:0/3195865463 conn(0x7f7d9c0af260 msgr2=0x7f7d9c0af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.849+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3195865463 shutdown_connections 2023-07-09T22:02:07.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3195865463 wait complete. 2023-07-09T22:02:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 Processor -- start 2023-07-09T22:02:07.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- start start 2023-07-09T22:02:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d9c06d6f0 0x7f7d9c0a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 0x7f7d9c0a7210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0a5ac0 con 0x7f7d9c1603e0 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c157ad0 con 0x7f7d9c06d6f0 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0a6490 con 0x7f7d9c160010 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55462/0 (socket says 172.21.15.37:55462) 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 -- 172.21.15.37:0/3329534886 learned_addr learned my addr 172.21.15.37:0/3329534886 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da1c3a640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d9c06d6f0 0x7f7d9c0a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da1439640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 0x7f7d9c0a7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 -- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 msgr2=0x7f7d9c0a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 0x7f7d9c0a7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 -- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d9c06d6f0 msgr2=0x7f7d9c0a8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d9c06d6f0 0x7f7d9c0a8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:07.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 -- 172.21.15.37:0/3329534886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d98009480 con 0x7f7d9c1603e0 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da1439640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 0x7f7d9c0a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da243b640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c7b0 tx=0x7f7d9400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d94003d90 con 0x7f7d9c1603e0 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d9400ce60 con 0x7f7d9c1603e0 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d940052b0 con 0x7f7d9c1603e0 2023-07-09T22:02:07.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.853+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c06d2e0 con 0x7f7d9c1603e0 2023-07-09T22:02:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c0a6a10 con 0x7f7d9c1603e0 2023-07-09T22:02:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c066bc0 con 0x7f7d9c1603e0 2023-07-09T22:02:07.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f7d94006b20 con 0x7f7d9c1603e0 2023-07-09T22:02:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7d927fc640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 0x7f7d80068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f7d94083310 con 0x7f7d9c1603e0 2023-07-09T22:02:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.857+0000 7f7da1c3a640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 0x7f7d80068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:07.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.861+0000 7f7da1c3a640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 0x7f7d80068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae000 tx=0x7f7d980a7000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:07.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:07.861+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d94050670 con 0x7f7d9c1603e0 2023-07-09T22:02:08.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.077+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]} v 0) v1 -- 0x7f7d9c0affb0 con 0x7f7d9c1603e0 2023-07-09T22:02:08.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.629+0000 7f7d927fc640 1 -- 172.21.15.37:0/3329534886 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedulesSnapdir.test_snap_dir_name"]}]=0 v1427) v1 ==== 155+0+0 (secure 0 0 0) 0x7f7d94053c90 con 0x7f7d9c1603e0 2023-07-09T22:02:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 msgr2=0x7f7d80068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 0x7f7d80068850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7d980ae000 tx=0x7f7d980a7000 comp rx=0 tx=0).stop 2023-07-09T22:02:08.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 msgr2=0x7f7d9c0a5580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 secure :-1 s=READY pgs=2142 cs=0 l=1 rev1=1 crypto rx=0x7f7d9400c7b0 tx=0x7f7d9400cc70 comp rx=0 tx=0).stop 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 shutdown_connections 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d9c1603e0 0x7f7d9c0a5580 unknown :-1 s=CLOSED pgs=2142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f7d800663a0 0x7f7d80068850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f7d9c160010 0x7f7d9c0a7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 --2- 172.21.15.37:0/3329534886 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f7d9c06d6f0 0x7f7d9c0a8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:08.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 >> 172.21.15.37:0/3329534886 conn(0x7f7d9c0af260 msgr2=0x7f7d9c15f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 shutdown_connections 2023-07-09T22:02:08.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:08.633+0000 7f7da3e9e640 1 -- 172.21.15.37:0/3329534886 wait complete. 2023-07-09T22:02:08.657 INFO:tasks.cephfs_test_runner:Test the correctness of snap directory name ... ok 2023-07-09T22:02:08.657 INFO:tasks.cephfs_test_runner: 2023-07-09T22:02:08.657 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-07-09T22:02:08.658 INFO:tasks.cephfs_test_runner:Ran 10 tests in 2345.061s 2023-07-09T22:02:08.658 INFO:tasks.cephfs_test_runner: 2023-07-09T22:02:08.658 INFO:tasks.cephfs_test_runner:OK 2023-07-09T22:02:08.658 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-07-09T22:02:08.667 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-09T22:02:08.715 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-09T22:02:08.716 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:02:08.716 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:02:08.725 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:02:08.725 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-07-09T22:02:08.726 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:02:08.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357856k,nr_inodes=4089464,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18538 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,nr_inodes=819001,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276008k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-07-09T22:02:08.777 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:02:08.778 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:02:08.787 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:02:08.788 DEBUG:teuthology.orchestra.run.smithi119:> set -ex 2023-07-09T22:02:08.788 DEBUG:teuthology.orchestra.run.smithi119:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-09T22:02:08.841 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354724k,nr_inodes=4088681,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15527 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275380k,nr_inodes=818845,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275384k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-07-09T22:02:08.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:08.842 DEBUG:teuthology.orchestra.run.smithi119:> ip netns list 2023-07-09T22:02:08.893 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-07-09T22:02:08.893 INFO:teuthology.orchestra.run.smithi119.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-07-09T22:02:08.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:08.895 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-07-09T22:02:08.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:08.961 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-07-09T22:02:09.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:09.045 DEBUG:teuthology.orchestra.run.smithi119:> sudo ip link delete ceph-brx 2023-07-09T22:02:09.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:09.236 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-07-09T22:02:09.246 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-07-09T22:02:09.247 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-07-09T22:02:09.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:09.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-07-09T22:02:09.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:09.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-07-09T22:02:09.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-09T22:02:09.413 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-07-09T22:02:09.597 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-07-09T22:02:09.609 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-07-09T22:02:09.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:02:09.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.757+0000 7f402ccca640 1 Processor -- start 2023-07-09T22:02:09.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 -- start start 2023-07-09T22:02:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f402806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f402806cff0 0x7f402806fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f402809c9d0 con 0x7f402815bd40 2023-07-09T22:02:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402809c120 con 0x7f402806cff0 2023-07-09T22:02:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402ccca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402815c110 con 0x7f40280b08d0 2023-07-09T22:02:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f402815bd40 0x7f4028099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54700/0 (socket says 172.21.15.37:54700) 2023-07-09T22:02:09.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 -- 172.21.15.37:0/674633254 learned_addr learned my addr 172.21.15.37:0/674633254 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:09.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4026d9d640 1 --2- 172.21.15.37:0/674633254 >> v2:172.21.15.119:3300/0 conn(0x7f402806cff0 0x7f402806fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f401ffff640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f402806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518744688 0 0) 0x7f402809c9d0 con 0x7f402815bd40 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4014003530 con 0x7f402815bd40 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3381294726 0 0) 0x7f4014003530 con 0x7f402815bd40 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 msgr2=0x7f402806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:09.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f402806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 >> v2:172.21.15.119:3300/0 conn(0x7f402806cff0 msgr2=0x7f402806fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:09.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 --2- 172.21.15.37:0/674633254 >> v2:172.21.15.119:3300/0 conn(0x7f402806cff0 0x7f402806fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40280b0dd0 con 0x7f402815bd40 2023-07-09T22:02:09.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f4018001680 con 0x7f402815bd40 2023-07-09T22:02:09.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 >> v1:172.21.15.37:6789/0 conn(0x7f402815bd40 legacy=0x7f4028099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4014003980 0x7f4014003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f40140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4014004d10 0x7f4014005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402809c120 con 0x7f4014003980 2023-07-09T22:02:09.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402815c110 con 0x7f4014004d10 2023-07-09T22:02:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401400b990 con 0x7f40280b08d0 2023-07-09T22:02:09.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4014003980 0x7f4014003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f4026d9d640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4014004d10 0x7f4014005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f401ffff640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f40140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 -- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 msgr2=0x7f40140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:09.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f40280b08d0 0x7f40140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 -- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4014004d10 msgr2=0x7f4014005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f4014004d10 0x7f4014005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.761+0000 7f402659c640 1 -- 172.21.15.37:0/674633254 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014003530 con 0x7f4014003980 2023-07-09T22:02:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402659c640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4014003980 0x7f4014003d90 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f401800c240 tx=0x7f401801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef17350dfcdf476e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180a5960 con 0x7f4014003980 2023-07-09T22:02:09.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40180a5ac0 con 0x7f4014003980 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f4025d9b640 1 -- 172.21.15.37:0/674633254 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40180a5e90 con 0x7f4014003980 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 -- 172.21.15.37:0/674633254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4014003980 msgr2=0x7f4014003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 --2- 172.21.15.37:0/674633254 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4014003980 0x7f4014003d90 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f401800c240 tx=0x7f401801cc60 comp rx=0 tx=0).stop 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f4026d9d640 1 -- 172.21.15.37:0/674633254 reap_dead start 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 -- 172.21.15.37:0/674633254 shutdown_connections 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 -- 172.21.15.37:0/674633254 >> 172.21.15.37:0/674633254 conn(0x7f40280694f0 msgr2=0x7f40280698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:09.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 -- 172.21.15.37:0/674633254 shutdown_connections 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.765+0000 7f402ccca640 1 -- 172.21.15.37:0/674633254 wait complete. 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 Processor -- start 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- start start 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4014003980 0x7f40280aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40281f4cf0 0x7f40280afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40280b04f0 con 0x7f4028152960 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40281f40b0 con 0x7f40281f4cf0 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40281f5160 con 0x7f4014003980 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55482/0 (socket says 172.21.15.37:55482) 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 -- 172.21.15.37:0/44585760 learned_addr learned my addr 172.21.15.37:0/44585760 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f401ffff640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40281f4cf0 0x7f40280afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402659c640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4014003980 0x7f40280aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 -- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4014003980 msgr2=0x7f40280aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4014003980 0x7f40280aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 -- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40281f4cf0 msgr2=0x7f40280afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40281f4cf0 0x7f40280afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 -- 172.21.15.37:0/44585760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40280b0250 con 0x7f4028152960 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f4026d9d640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f4028099780 tx=0x7f4020011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:09.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402000e040 con 0x7f4028152960 2023-07-09T22:02:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402000f040 con 0x7f4028152960 2023-07-09T22:02:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4020015a80 con 0x7f4028152960 2023-07-09T22:02:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40280ade20 con 0x7f4028152960 2023-07-09T22:02:09.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.769+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40280ae3e0 con 0x7f4028152960 2023-07-09T22:02:09.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4028066bc0 con 0x7f4028152960 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f4020015be0 con 0x7f4028152960 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f401effd640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 0x7f4008068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f4020083fa0 con 0x7f4028152960 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f402659c640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 0x7f4008068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.773+0000 7f402659c640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 0x7f4008068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40180aa000 tx=0x7f4018001a80 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:09.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.777+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4020054c60 con 0x7f4028152960 2023-07-09T22:02:09.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.929+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4028070390 con 0x7f40080663a0 2023-07-09T22:02:09.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.933+0000 7f401effd640 1 -- 172.21.15.37:0/44585760 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72579 (secure 0 0 0) 0x7f4018001440 con 0x7f40080663a0 2023-07-09T22:02:09.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:09.938 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:02:09.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 msgr2=0x7f4008068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 0x7f4008068850 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f40180aa000 tx=0x7f4018001a80 comp rx=0 tx=0).stop 2023-07-09T22:02:09.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 msgr2=0x7f4028096f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:09.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f4028099780 tx=0x7f4020011cb0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 shutdown_connections 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4028152960 0x7f4028096f90 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f40281f4cf0 0x7f40280afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f40080663a0 0x7f4008068850 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 --2- 172.21.15.37:0/44585760 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f4014003980 0x7f40280aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:09.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 >> 172.21.15.37:0/44585760 conn(0x7f40280694f0 msgr2=0x7f4028158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 shutdown_connections 2023-07-09T22:02:09.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:09.937+0000 7f402ccca640 1 -- 172.21.15.37:0/44585760 wait complete. 2023-07-09T22:02:09.959 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-09T22:02:08.333269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356936,"kb_used_data":21640,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754617784,"statfs":{"total":773094113280,"available":772728610816,"internally_reserved":0,"allocated":22159360,"data_stored":12504923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-667770,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-288,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001334"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1317,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325346+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:02:06.325346+0000","last_peered":"2023-07-09T22:02:06.325346+0000","last_clean":"2023-07-09T22:02:06.325346+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:02:06.325346+0000","last_undegraded":"2023-07-09T22:02:06.325346+0000","last_fullsized":"2023-07-09T22:02:06.325346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:39.464948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":391,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626029+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:02:05.626029+0000","last_peered":"2023-07-09T22:02:05.626029+0000","last_clean":"2023-07-09T22:02:05.626029+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:02:05.626029+0000","last_undegraded":"2023-07-09T22:02:05.626029+0000","last_fullsized":"2023-07-09T22:02:05.626029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:41.202813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":342,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325214+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:02:06.325214+0000","last_peered":"2023-07-09T22:02:06.325214+0000","last_clean":"2023-07-09T22:02:06.325214+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:02:06.325214+0000","last_undegraded":"2023-07-09T22:02:06.325214+0000","last_fullsized":"2023-07-09T22:02:06.325214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:54.249346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.178141+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:02:06.178141+0000","last_peered":"2023-07-09T22:02:06.178141+0000","last_clean":"2023-07-09T22:02:06.178141+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:02:06.178141+0000","last_undegraded":"2023-07-09T22:02:06.178141+0000","last_fullsized":"2023-07-09T22:02:06.178141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:55:54.031263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":392,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626141+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:02:05.626141+0000","last_peered":"2023-07-09T22:02:05.626141+0000","last_clean":"2023-07-09T22:02:05.626141+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:02:05.626141+0000","last_undegraded":"2023-07-09T22:02:05.626141+0000","last_fullsized":"2023-07-09T22:02:05.626141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:04:43.096892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.322890+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:02:06.322890+0000","last_peered":"2023-07-09T22:02:06.322890+0000","last_clean":"2023-07-09T22:02:06.322890+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:02:06.322890+0000","last_undegraded":"2023-07-09T22:02:06.322890+0000","last_fullsized":"2023-07-09T22:02:06.322890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:05.796181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":341,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.326118+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:02:06.326118+0000","last_peered":"2023-07-09T22:02:06.326118+0000","last_clean":"2023-07-09T22:02:06.326118+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:02:06.326118+0000","last_undegraded":"2023-07-09T22:02:06.326118+0000","last_fullsized":"2023-07-09T22:02:06.326118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:47.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.323232+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:02:06.323232+0000","last_peered":"2023-07-09T22:02:06.323232+0000","last_clean":"2023-07-09T22:02:06.323232+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:02:06.323232+0000","last_undegraded":"2023-07-09T22:02:06.323232+0000","last_fullsized":"2023-07-09T22:02:06.323232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:24.847159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":347,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325578+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:02:06.325578+0000","last_peered":"2023-07-09T22:02:06.325578+0000","last_clean":"2023-07-09T22:02:06.325578+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:02:06.325578+0000","last_undegraded":"2023-07-09T22:02:06.325578+0000","last_fullsized":"2023-07-09T22:02:06.325578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:15.247741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575318,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48008,"kb_used_data":3008,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323832,"statfs":{"total":96636764160,"available":96587603968,"internally_reserved":0,"allocated":3080192,"data_stored":1877903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.96399999999999997,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93200000000000005,"5min":1.165,"15min":1.165},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.036},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.147},"last":0.70999999999999996}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.107,"15min":1.107},"last":0.84499999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.66200000000000003,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834575317,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37572,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334268,"statfs":{"total":96636764160,"available":96598290432,"internally_reserved":0,"allocated":2486272,"data_stored":1287535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.075,"15min":1.075},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71699999999999997,"15min":0.746},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84899999999999998,"5min":0.999,"15min":1.04},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.98199999999999998,"15min":1.032},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.41799999999999998},"max":{"1min":0.90400000000000003,"5min":1.002,"15min":1.1200000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89700000000000002,"5min":1.0089999999999999,"15min":1.504},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.0580000000000001,"15min":1.0609999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.76600000000000001},"min":{"1min":0.59499999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":1.02,"15min":1.026},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.036,"15min":1.4530000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":0.90600000000000003,"15min":1.099},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.627},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.052},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80900000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.56000000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.0860000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.99099999999999999,"15min":1.077},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575316,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.82899999999999996,"5min":1.012,"15min":1.012},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.008,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.90900000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.753},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96999999999999997,"5min":1.0409999999999999,"15min":1.0900000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.747,"15min":0.754},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0029999999999999,"5min":1.095,"15min":1.095},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86499999999999999,"5min":0.98899999999999999,"15min":1.0349999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":1.008,"15min":1.034},"last":1.014},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96499999999999997,"15min":1.0720000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.628},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575318,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.46000000000000002,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":0.996,"15min":0.996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91100000000000003,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92800000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.628},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89200000000000002,"5min":0.998,"15min":1.03},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.038,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.89800000000000002,"5min":1.016,"15min":1.016},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.016,"5min":1.038,"15min":1.038},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.05,"15min":1.079},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":1.016,"15min":1.016},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.96099999999999997,"15min":1.018},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.433,"15min":0.39800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575317,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37920,"kb_used_data":2776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333920,"statfs":{"total":96636764160,"available":96597934080,"internally_reserved":0,"allocated":2842624,"data_stored":1628429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575318,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2490368,"data_stored":1287636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.96499999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.77100000000000002,"15min":0.85099999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.90000000000000002,"15min":1.016},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.1100000000000001,"5min":1.117,"15min":1.163},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.131,"5min":1.1970000000000001,"15min":1.2070000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"max":{"1min":0.97199999999999998,"5min":1.111,"15min":1.2330000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0900000000000001,"5min":1.264,"15min":1.264},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52200000000000002},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.294},"last":0.88800000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.046,"5min":1.196,"15min":1.2050000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575318,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37912,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333928,"statfs":{"total":96636764160,"available":96597942272,"internally_reserved":0,"allocated":2834432,"data_stored":1627825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.78000000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.621},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834575318,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42580,"kb_used_data":3340,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329260,"statfs":{"total":96636764160,"available":96593162240,"internally_reserved":0,"allocated":3420160,"data_stored":2206239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.373},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93799999999999994,"5min":1.306,"15min":1.306},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.995,"5min":1.351,"15min":1.351},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.503},"max":{"1min":1.0009999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":0.97399999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":0.998,"5min":1.135,"15min":1.3260000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.0820000000000001,"5min":1.381,"15min":1.381},"last":0.57799999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.296,"15min":1.296},"last":0.626},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.82299999999999995},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.96599999999999997,"5min":1.2709999999999999,"15min":1.397},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:02:09.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:02:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.101+0000 7ff804b40640 1 Processor -- start 2023-07-09T22:02:10.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff804b40640 1 -- start start 2023-07-09T22:02:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff804b40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff80006cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff804b40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80009c9d0 con 0x7ff80015bd40 2023-07-09T22:02:10.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff804b40640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80009c120 con 0x7ff80006cff0 2023-07-09T22:02:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff804b40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80015c110 con 0x7ff8000b08d0 2023-07-09T22:02:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fe59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff80015bd40 0x7ff800099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54702/0 (socket says 172.21.15.37:54702) 2023-07-09T22:02:10.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fe59c640 1 -- 172.21.15.37:0/2378308367 learned_addr learned my addr 172.21.15.37:0/2378308367 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff80006cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1773359799 0 0) 0x7ff80009c9d0 con 0x7ff80015bd40 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7ec003530 con 0x7ff80015bd40 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4161359721 0 0) 0x7ff7ec003530 con 0x7ff80015bd40 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 msgr2=0x7ff80006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff80006cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 >> v1:172.21.15.119:6789/0 conn(0x7ff80006cff0 legacy=0x7ff80006fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8000b0dd0 con 0x7ff80015bd40 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ff7f0001680 con 0x7ff80015bd40 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 >> v1:172.21.15.37:6789/0 conn(0x7ff80015bd40 legacy=0x7ff800099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff7ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7ec003ef0 0x7ff7ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec004d10 0x7ff7ec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80015c110 con 0x7ff7ec003ef0 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec00ba70 con 0x7ff7ec004d10 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ec00bc30 con 0x7ff8000b08d0 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7ec003ef0 0x7ff7ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fe59c640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff7ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fed9d640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec004d10 0x7ff7ec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 -- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 msgr2=0x7ff7ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000b08d0 0x7ff7ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 -- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec004d10 msgr2=0x7ff7ec005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec004d10 0x7ff7ec005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7f7fff640 1 -- 172.21.15.37:0/2378308367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ec003530 con 0x7ff7ec003ef0 2023-07-09T22:02:10.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.105+0000 7ff7fed9d640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec004d10 0x7ff7ec005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:10.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7ec003ef0 0x7ff7ec0047d0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0d00 tx=0x7ff7e801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f202c81561479b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80a55e0 con 0x7ff7ec003ef0 2023-07-09T22:02:10.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e80a5740 con 0x7ff7ec003ef0 2023-07-09T22:02:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff7fdd9b640 1 -- 172.21.15.37:0/2378308367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e80a5af0 con 0x7ff7ec003ef0 2023-07-09T22:02:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 -- 172.21.15.37:0/2378308367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7ec003ef0 msgr2=0x7ff7ec0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 --2- 172.21.15.37:0/2378308367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7ec003ef0 0x7ff7ec0047d0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7ff8000b0d00 tx=0x7ff7e801c9f0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff7fed9d640 1 -- 172.21.15.37:0/2378308367 reap_dead start 2023-07-09T22:02:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 -- 172.21.15.37:0/2378308367 shutdown_connections 2023-07-09T22:02:10.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 -- 172.21.15.37:0/2378308367 >> 172.21.15.37:0/2378308367 conn(0x7ff8000694f0 msgr2=0x7ff8000698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 -- 172.21.15.37:0/2378308367 shutdown_connections 2023-07-09T22:02:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.109+0000 7ff804b40640 1 -- 172.21.15.37:0/2378308367 wait complete. 2023-07-09T22:02:10.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 Processor -- start 2023-07-09T22:02:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- start start 2023-07-09T22:02:10.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 0x7ff80009a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000965f0 0x7ff80015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8001f4260 con 0x7ff8001f38b0 2023-07-09T22:02:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff800096a80 con 0x7ff7ec003ef0 2023-07-09T22:02:10.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff800096d60 con 0x7ff8000965f0 2023-07-09T22:02:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55488/0 (socket says 172.21.15.37:55488) 2023-07-09T22:02:10.123 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 -- 172.21.15.37:0/879027180 learned_addr learned my addr 172.21.15.37:0/879027180 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fe59c640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 0x7ff80009a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7f7fff640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000965f0 0x7ff80015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 -- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000965f0 msgr2=0x7ff80015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000965f0 0x7ff80015c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 -- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 msgr2=0x7ff80009a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 0x7ff80009a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 -- 172.21.15.37:0/879027180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800097040 con 0x7ff8001f38b0 2023-07-09T22:02:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fe59c640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 0x7ff80009a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:10.126 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7fed9d640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7ff800099780 tx=0x7ff7f8010aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8003d90 con 0x7ff8001f38b0 2023-07-09T22:02:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f800d050 con 0x7ff8001f38b0 2023-07-09T22:02:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8005310 con 0x7ff8001f38b0 2023-07-09T22:02:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff800097320 con 0x7ff8001f38b0 2023-07-09T22:02:10.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.113+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80009a700 con 0x7ff8001f38b0 2023-07-09T22:02:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80009a8f0 con 0x7ff8001f38b0 2023-07-09T22:02:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff7f8005470 con 0x7ff8001f38b0 2023-07-09T22:02:10.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff7f6ffd640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 0x7ff7e0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7ff7f8086bf0 con 0x7ff8001f38b0 2023-07-09T22:02:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff7fe59c640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 0x7ff7e0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.117+0000 7ff7fe59c640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 0x7ff7e0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00010f0 tx=0x7ff7f0009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.121+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff80009a8f0 con 0x7ff8001f38b0 2023-07-09T22:02:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.273+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff80009c660 con 0x7ff7e00663a0 2023-07-09T22:02:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff7f6ffd640 1 -- 172.21.15.37:0/879027180 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72579 (secure 0 0 0) 0x7ff7f0004e80 con 0x7ff7e00663a0 2023-07-09T22:02:10.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:10.280 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:02:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 msgr2=0x7ff7e0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 0x7ff7e0068850 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00010f0 tx=0x7ff7f0009040 comp rx=0 tx=0).stop 2023-07-09T22:02:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 msgr2=0x7ff8001f3d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7ff800099780 tx=0x7ff7f8010aa0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 shutdown_connections 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8001f38b0 0x7ff8001f3d20 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff7e00663a0 0x7ff7e0068850 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff8000965f0 0x7ff80015c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 --2- 172.21.15.37:0/879027180 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff7ec003ef0 0x7ff80009a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 >> 172.21.15.37:0/879027180 conn(0x7ff8000694f0 msgr2=0x7ff800158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 shutdown_connections 2023-07-09T22:02:10.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.277+0000 7ff804b40640 1 -- 172.21.15.37:0/879027180 wait complete. 2023-07-09T22:02:10.300 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2023-07-09T22:02:08.333269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356936,"kb_used_data":21640,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754617784,"statfs":{"total":773094113280,"available":772728610816,"internally_reserved":0,"allocated":22159360,"data_stored":12504923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-667770,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-288,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001334"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1317,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325346+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:02:06.325346+0000","last_peered":"2023-07-09T22:02:06.325346+0000","last_clean":"2023-07-09T22:02:06.325346+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:02:06.325346+0000","last_undegraded":"2023-07-09T22:02:06.325346+0000","last_fullsized":"2023-07-09T22:02:06.325346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:39.464948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":391,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626029+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:02:05.626029+0000","last_peered":"2023-07-09T22:02:05.626029+0000","last_clean":"2023-07-09T22:02:05.626029+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:02:05.626029+0000","last_undegraded":"2023-07-09T22:02:05.626029+0000","last_fullsized":"2023-07-09T22:02:05.626029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:41.202813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":342,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325214+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:02:06.325214+0000","last_peered":"2023-07-09T22:02:06.325214+0000","last_clean":"2023-07-09T22:02:06.325214+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:02:06.325214+0000","last_undegraded":"2023-07-09T22:02:06.325214+0000","last_fullsized":"2023-07-09T22:02:06.325214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:54.249346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.178141+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:02:06.178141+0000","last_peered":"2023-07-09T22:02:06.178141+0000","last_clean":"2023-07-09T22:02:06.178141+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:02:06.178141+0000","last_undegraded":"2023-07-09T22:02:06.178141+0000","last_fullsized":"2023-07-09T22:02:06.178141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:55:54.031263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":392,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626141+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:02:05.626141+0000","last_peered":"2023-07-09T22:02:05.626141+0000","last_clean":"2023-07-09T22:02:05.626141+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:02:05.626141+0000","last_undegraded":"2023-07-09T22:02:05.626141+0000","last_fullsized":"2023-07-09T22:02:05.626141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:04:43.096892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.322890+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:02:06.322890+0000","last_peered":"2023-07-09T22:02:06.322890+0000","last_clean":"2023-07-09T22:02:06.322890+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:02:06.322890+0000","last_undegraded":"2023-07-09T22:02:06.322890+0000","last_fullsized":"2023-07-09T22:02:06.322890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:05.796181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":341,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.326118+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:02:06.326118+0000","last_peered":"2023-07-09T22:02:06.326118+0000","last_clean":"2023-07-09T22:02:06.326118+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:02:06.326118+0000","last_undegraded":"2023-07-09T22:02:06.326118+0000","last_fullsized":"2023-07-09T22:02:06.326118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:47.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.323232+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:02:06.323232+0000","last_peered":"2023-07-09T22:02:06.323232+0000","last_clean":"2023-07-09T22:02:06.323232+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:02:06.323232+0000","last_undegraded":"2023-07-09T22:02:06.323232+0000","last_fullsized":"2023-07-09T22:02:06.323232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:24.847159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":347,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325578+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:02:06.325578+0000","last_peered":"2023-07-09T22:02:06.325578+0000","last_clean":"2023-07-09T22:02:06.325578+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:02:06.325578+0000","last_undegraded":"2023-07-09T22:02:06.325578+0000","last_fullsized":"2023-07-09T22:02:06.325578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:15.247741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575318,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48008,"kb_used_data":3008,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323832,"statfs":{"total":96636764160,"available":96587603968,"internally_reserved":0,"allocated":3080192,"data_stored":1877903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.96399999999999997,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93200000000000005,"5min":1.165,"15min":1.165},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.036},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.147},"last":0.70999999999999996}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.107,"15min":1.107},"last":0.84499999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.66200000000000003,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834575317,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37572,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334268,"statfs":{"total":96636764160,"available":96598290432,"internally_reserved":0,"allocated":2486272,"data_stored":1287535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.075,"15min":1.075},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71699999999999997,"15min":0.746},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84899999999999998,"5min":0.999,"15min":1.04},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.98199999999999998,"15min":1.032},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.41799999999999998},"max":{"1min":0.90400000000000003,"5min":1.002,"15min":1.1200000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89700000000000002,"5min":1.0089999999999999,"15min":1.504},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.0580000000000001,"15min":1.0609999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.76600000000000001},"min":{"1min":0.59499999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":1.02,"15min":1.026},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.036,"15min":1.4530000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":0.90600000000000003,"15min":1.099},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.627},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.052},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80900000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.56000000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.0860000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.99099999999999999,"15min":1.077},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575316,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.82899999999999996,"5min":1.012,"15min":1.012},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.008,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.90900000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.753},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96999999999999997,"5min":1.0409999999999999,"15min":1.0900000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.747,"15min":0.754},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0029999999999999,"5min":1.095,"15min":1.095},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86499999999999999,"5min":0.98899999999999999,"15min":1.0349999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":1.008,"15min":1.034},"last":1.014},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96499999999999997,"15min":1.0720000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.628},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575318,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.46000000000000002,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":0.996,"15min":0.996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91100000000000003,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92800000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.628},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89200000000000002,"5min":0.998,"15min":1.03},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.038,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.89800000000000002,"5min":1.016,"15min":1.016},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.016,"5min":1.038,"15min":1.038},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.05,"15min":1.079},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":1.016,"15min":1.016},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.96099999999999997,"15min":1.018},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.433,"15min":0.39800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575317,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37920,"kb_used_data":2776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333920,"statfs":{"total":96636764160,"available":96597934080,"internally_reserved":0,"allocated":2842624,"data_stored":1628429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575318,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2490368,"data_stored":1287636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.96499999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.77100000000000002,"15min":0.85099999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.90000000000000002,"15min":1.016},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.1100000000000001,"5min":1.117,"15min":1.163},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.131,"5min":1.1970000000000001,"15min":1.2070000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"max":{"1min":0.97199999999999998,"5min":1.111,"15min":1.2330000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0900000000000001,"5min":1.264,"15min":1.264},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52200000000000002},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.294},"last":0.88800000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.046,"5min":1.196,"15min":1.2050000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575318,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37912,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333928,"statfs":{"total":96636764160,"available":96597942272,"internally_reserved":0,"allocated":2834432,"data_stored":1627825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.78000000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.621},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834575318,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42580,"kb_used_data":3340,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329260,"statfs":{"total":96636764160,"available":96593162240,"internally_reserved":0,"allocated":3420160,"data_stored":2206239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.373},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93799999999999994,"5min":1.306,"15min":1.306},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.995,"5min":1.351,"15min":1.351},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.503},"max":{"1min":1.0009999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":0.97399999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":0.998,"5min":1.135,"15min":1.3260000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.0820000000000001,"5min":1.381,"15min":1.381},"last":0.57799999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.296,"15min":1.296},"last":0.626},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.82299999999999995},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.96599999999999997,"5min":1.2709999999999999,"15min":1.397},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:02:10.302 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-07-09T22:02:10.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:02:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 Processor -- start 2023-07-09T22:02:10.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 -- start start 2023-07-09T22:02:10.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe64415bd00 0x7fe6440b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6440b1590 0x7fe64409b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 0x7fe64406b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe64409beb0 con 0x7fe64415bd00 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440b19e0 con 0x7fe64409ba30 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649912640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64406d490 con 0x7fe6440b1590 2023-07-09T22:02:10.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe64415bd00 0x7fe6440b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe64415bd00 0x7fe6440b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55494/0 (socket says 172.21.15.37:55494) 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 -- 172.21.15.37:0/1670326809 learned_addr learned my addr 172.21.15.37:0/1670326809 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649111640 1 --2- 172.21.15.37:0/1670326809 >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 0x7fe64406b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe643fff640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6440b1590 0x7fe64409b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 -- 172.21.15.37:0/1670326809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6440b1590 msgr2=0x7fe64409b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6440b1590 0x7fe64409b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 -- 172.21.15.37:0/1670326809 >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 msgr2=0x7fe64406b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 --2- 172.21.15.37:0/1670326809 >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 0x7fe64406b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe648910640 1 -- 172.21.15.37:0/1670326809 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64409c0d0 con 0x7fe64415bd00 2023-07-09T22:02:10.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.445+0000 7fe649111640 1 --2- 172.21.15.37:0/1670326809 >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 0x7fe64406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:10.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe648910640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64415bd00 0x7fe6440b1050 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fe64409cab0 tx=0x7fe63801c180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afce8ee584f166e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe6437fe640 1 -- 172.21.15.37:0/1670326809 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ab600 con 0x7fe64415bd00 2023-07-09T22:02:10.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe6437fe640 1 -- 172.21.15.37:0/1670326809 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6380a7050 con 0x7fe64415bd00 2023-07-09T22:02:10.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe6437fe640 1 -- 172.21.15.37:0/1670326809 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6380ab980 con 0x7fe64415bd00 2023-07-09T22:02:10.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 -- 172.21.15.37:0/1670326809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64415bd00 msgr2=0x7fe6440b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64415bd00 0x7fe6440b1050 secure :-1 s=READY pgs=2149 cs=0 l=1 rev1=1 crypto rx=0x7fe64409cab0 tx=0x7fe63801c180 comp rx=0 tx=0).stop 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 -- 172.21.15.37:0/1670326809 shutdown_connections 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 --2- 172.21.15.37:0/1670326809 >> v2:172.21.15.119:3300/0 conn(0x7fe64409ba30 0x7fe64406b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe6440b1590 0x7fe64409b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 --2- 172.21.15.37:0/1670326809 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe64415bd00 0x7fe6440b1050 unknown :-1 s=CLOSED pgs=2149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 -- 172.21.15.37:0/1670326809 >> 172.21.15.37:0/1670326809 conn(0x7fe644069e90 msgr2=0x7fe6440ce090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 -- 172.21.15.37:0/1670326809 shutdown_connections 2023-07-09T22:02:10.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 -- 172.21.15.37:0/1670326809 wait complete. 2023-07-09T22:02:10.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.449+0000 7fe649912640 1 Processor -- start 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- start start 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe64409ba30 0x7fe6440ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6440b1590 0x7fe644152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441533d0 con 0x7fe6441593f0 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644154230 con 0x7fe6440b1590 2023-07-09T22:02:10.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440acc80 con 0x7fe64409ba30 2023-07-09T22:02:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55496/0 (socket says 172.21.15.37:55496) 2023-07-09T22:02:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 -- 172.21.15.37:0/1320499458 learned_addr learned my addr 172.21.15.37:0/1320499458 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:10.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe648910640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe64409ba30 0x7fe6440ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe643fff640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6440b1590 0x7fe644152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 -- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe64409ba30 msgr2=0x7fe6440ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe64409ba30 0x7fe6440ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 -- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6440b1590 msgr2=0x7fe644152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6440b1590 0x7fe644152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 -- 172.21.15.37:0/1320499458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe638009480 con 0x7fe6441593f0 2023-07-09T22:02:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649111640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe63c007e40 tx=0x7fe63c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c003ba0 con 0x7fe6441593f0 2023-07-09T22:02:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c00f040 con 0x7fe6441593f0 2023-07-09T22:02:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6441535b0 con 0x7fe6441593f0 2023-07-09T22:02:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00de80 con 0x7fe6441593f0 2023-07-09T22:02:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644153b70 con 0x7fe6441593f0 2023-07-09T22:02:10.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.453+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644154370 con 0x7fe6441593f0 2023-07-09T22:02:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.457+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fe63c004030 con 0x7fe6441593f0 2023-07-09T22:02:10.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.457+0000 7fe6417fa640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 0x7fe628068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.457+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fe63c084230 con 0x7fe6441593f0 2023-07-09T22:02:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.457+0000 7fe648910640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 0x7fe628068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.457+0000 7fe648910640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 0x7fe628068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe6380a6000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.461+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe644154370 con 0x7fe6441593f0 2023-07-09T22:02:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.613+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe64406efb0 con 0x7fe6280663d0 2023-07-09T22:02:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe6417fa640 1 -- 172.21.15.37:0/1320499458 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72579 (secure 0 0 0) 0x7fe638004300 con 0x7fe6280663d0 2023-07-09T22:02:10.618 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:10.619 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:02:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 msgr2=0x7fe628068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 0x7fe628068880 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe6380ad000 tx=0x7fe6380a6000 comp rx=0 tx=0).stop 2023-07-09T22:02:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 msgr2=0x7fe6441503d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7fe63c007e40 tx=0x7fe63c00d4a0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 shutdown_connections 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe6441593f0 0x7fe6441503d0 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fe6440b1590 0x7fe644152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fe6280663d0 0x7fe628068880 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 --2- 172.21.15.37:0/1320499458 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fe64409ba30 0x7fe6440ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 >> 172.21.15.37:0/1320499458 conn(0x7fe644069e90 msgr2=0x7fe644099810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 shutdown_connections 2023-07-09T22:02:10.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.617+0000 7fe649912640 1 -- 172.21.15.37:0/1320499458 wait complete. 2023-07-09T22:02:10.639 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2023-07-09T22:02:10.333634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":356936,"kb_used_data":21640,"kb_used_omap":0,"kb_used_meta":335232,"kb_avail":754617784,"statfs":{"total":773094113280,"available":772728610816,"internally_reserved":0,"allocated":22159360,"data_stored":12504923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":343277568},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-667770,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":-317,"num_read_kb":-281,"num_write":-288,"num_write_kb":-2057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.742289"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1317,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325346+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:02:06.325346+0000","last_peered":"2023-07-09T22:02:06.325346+0000","last_clean":"2023-07-09T22:02:06.325346+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:02:06.325346+0000","last_undegraded":"2023-07-09T22:02:06.325346+0000","last_fullsized":"2023-07-09T22:02:06.325346+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:29:39.464948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":391,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626029+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:02:05.626029+0000","last_peered":"2023-07-09T22:02:05.626029+0000","last_clean":"2023-07-09T22:02:05.626029+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:02:05.626029+0000","last_undegraded":"2023-07-09T22:02:05.626029+0000","last_fullsized":"2023-07-09T22:02:05.626029+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:04:41.202813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":342,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325214+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:02:06.325214+0000","last_peered":"2023-07-09T22:02:06.325214+0000","last_clean":"2023-07-09T22:02:06.325214+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:02:06.325214+0000","last_undegraded":"2023-07-09T22:02:06.325214+0000","last_fullsized":"2023-07-09T22:02:06.325214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:33:54.249346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":334,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.178141+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:02:06.178141+0000","last_peered":"2023-07-09T22:02:06.178141+0000","last_clean":"2023-07-09T22:02:06.178141+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:02:06.178141+0000","last_undegraded":"2023-07-09T22:02:06.178141+0000","last_fullsized":"2023-07-09T22:02:06.178141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:55:54.031263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":392,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:05.626141+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:02:05.626141+0000","last_peered":"2023-07-09T22:02:05.626141+0000","last_clean":"2023-07-09T22:02:05.626141+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:02:05.626141+0000","last_undegraded":"2023-07-09T22:02:05.626141+0000","last_fullsized":"2023-07-09T22:02:05.626141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:04:43.096892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":333,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.322890+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:02:06.322890+0000","last_peered":"2023-07-09T22:02:06.322890+0000","last_clean":"2023-07-09T22:02:06.322890+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:02:06.322890+0000","last_undegraded":"2023-07-09T22:02:06.322890+0000","last_fullsized":"2023-07-09T22:02:06.322890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T04:27:05.796181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":341,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.326118+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:02:06.326118+0000","last_peered":"2023-07-09T22:02:06.326118+0000","last_clean":"2023-07-09T22:02:06.326118+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:02:06.326118+0000","last_undegraded":"2023-07-09T22:02:06.326118+0000","last_fullsized":"2023-07-09T22:02:06.326118+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:43:47.813945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":335,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.323232+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:02:06.323232+0000","last_peered":"2023-07-09T22:02:06.323232+0000","last_clean":"2023-07-09T22:02:06.323232+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:02:06.323232+0000","last_undegraded":"2023-07-09T22:02:06.323232+0000","last_fullsized":"2023-07-09T22:02:06.323232+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T06:02:24.847159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":347,"reported_epoch":200,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.325578+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:02:06.325578+0000","last_peered":"2023-07-09T22:02:06.325578+0000","last_clean":"2023-07-09T22:02:06.325578+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:02:06.325578+0000","last_undegraded":"2023-07-09T22:02:06.325578+0000","last_fullsized":"2023-07-09T22:02:06.325578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T00:37:15.247741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575318,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48008,"kb_used_data":3008,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323832,"statfs":{"total":96636764160,"available":96587603968,"internally_reserved":0,"allocated":3080192,"data_stored":1877903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.96399999999999997,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.60199999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93200000000000005,"5min":1.165,"15min":1.165},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.036},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.147},"last":0.70999999999999996}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.107,"15min":1.107},"last":0.84499999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.89400000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.66200000000000003,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":1.05},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.022}]}]},{"osd":6,"up_from":13,"seq":55834575317,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37572,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334268,"statfs":{"total":96636764160,"available":96598290432,"internally_reserved":0,"allocated":2486272,"data_stored":1287535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.075,"15min":1.075},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71699999999999997,"15min":0.746},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84899999999999998,"5min":0.999,"15min":1.04},"last":0.88100000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.98199999999999998,"15min":1.032},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.41799999999999998},"max":{"1min":0.90400000000000003,"5min":1.002,"15min":1.1200000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89700000000000002,"5min":1.0089999999999999,"15min":1.504},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.0580000000000001,"15min":1.0609999999999999},"last":0.86399999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.76600000000000001},"min":{"1min":0.59499999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":1.02,"15min":1.026},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.036,"15min":1.4530000000000001},"last":0.90600000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":1.161},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":0.90600000000000003,"15min":1.099},"last":0.81000000000000005}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.627},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.052},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80900000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.56000000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.0860000000000001},"last":0.753},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.99099999999999999,"15min":1.077},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575316,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55636,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316204,"statfs":{"total":96636764160,"available":96579792896,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.82899999999999996,"5min":1.012,"15min":1.012},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.008,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.90900000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.753},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96999999999999997,"5min":1.0409999999999999,"15min":1.0900000000000001},"last":0.98899999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.747,"15min":0.754},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0029999999999999,"5min":1.095,"15min":1.095},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86499999999999999,"5min":0.98899999999999999,"15min":1.0349999999999999},"last":0.78200000000000003}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":1.008,"15min":1.034},"last":1.014},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96499999999999997,"15min":1.0720000000000001},"last":0.75600000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.628},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.88300000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.84899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834575318,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37588,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334252,"statfs":{"total":96636764160,"available":96598274048,"internally_reserved":0,"allocated":2502656,"data_stored":1294678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.46000000000000002,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":0.996,"15min":0.996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91100000000000003,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.53100000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92800000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.628},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89200000000000002,"5min":0.998,"15min":1.03},"last":0.61399999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.038,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.89800000000000002,"5min":1.016,"15min":1.016},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.016,"5min":1.038,"15min":1.038},"last":0.56200000000000006}]},{"osd":5,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.05,"15min":1.079},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":1.016,"15min":1.016},"last":0.46899999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.96099999999999997,"15min":1.018},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.54400000000000004}]},{"osd":7,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.433,"15min":0.39800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.44500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575317,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37920,"kb_used_data":2776,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333920,"statfs":{"total":96636764160,"available":96597934080,"internally_reserved":0,"allocated":2842624,"data_stored":1628429,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.55900000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.44900000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.83199999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575318,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59720,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312120,"statfs":{"total":96636764160,"available":96575610880,"internally_reserved":0,"allocated":2490368,"data_stored":1287636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.96499999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.77100000000000002,"15min":0.85099999999999998},"last":0.49099999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.39400000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.90000000000000002,"15min":1.016},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.55600000000000005}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.1100000000000001,"5min":1.117,"15min":1.163},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.131,"5min":1.1970000000000001,"15min":1.2070000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"max":{"1min":0.97199999999999998,"5min":1.111,"15min":1.2330000000000001},"last":0.76200000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0900000000000001,"5min":1.264,"15min":1.264},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52200000000000002},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.294},"last":0.88800000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.046,"5min":1.196,"15min":1.2050000000000001},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575318,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37912,"kb_used_data":2768,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94333928,"statfs":{"total":96636764160,"available":96597942272,"internally_reserved":0,"allocated":2834432,"data_stored":1627825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.36599999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.498},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.69299999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.78000000000000003}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.621},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.752}]}]},{"osd":0,"up_from":13,"seq":55834575318,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42580,"kb_used_data":3340,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329260,"statfs":{"total":96636764160,"available":96593162240,"internally_reserved":0,"allocated":3420160,"data_stored":2206239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.373},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45300000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.40000000000000002}]},{"osd":3,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.47399999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93799999999999994,"5min":1.306,"15min":1.306},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.995,"5min":1.351,"15min":1.351},"last":0.49099999999999999}]},{"osd":5,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.503},"max":{"1min":1.0009999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":0.97399999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.56699999999999995}]},{"osd":6,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":0.998,"5min":1.135,"15min":1.3260000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.0820000000000001,"5min":1.381,"15min":1.381},"last":0.57799999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.296,"15min":1.296},"last":0.626},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.82299999999999995},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.96599999999999997,"5min":1.2709999999999999,"15min":1.397},"last":0.64400000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:02:10.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-09T22:02:10.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.781+0000 7f2ed587b640 1 Processor -- start 2023-07-09T22:02:10.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.781+0000 7f2ed587b640 1 -- start start 2023-07-09T22:02:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ed587b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ed0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ed587b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed009c9d0 con 0x7f2ed006fa40 2023-07-09T22:02:10.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ed587b640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed009c120 con 0x7f2ed00b08d0 2023-07-09T22:02:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ed587b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015c110 con 0x7f2ed015bd40 2023-07-09T22:02:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ecf7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2ed006fa40 0x7f2ed015f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54710/0 (socket says 172.21.15.37:54710) 2023-07-09T22:02:10.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ecf7fe640 1 -- 172.21.15.37:0/3872351528 learned_addr learned my addr 172.21.15.37:0/3872351528 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:10.787 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ed0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511022170 0 0) 0x7f2ed009c9d0 con 0x7f2ed006fa40 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ebc003530 con 0x7f2ed006fa40 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129065836 0 0) 0x7f2ed009c120 con 0x7f2ed00b08d0 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ed009c9d0 con 0x7f2ed00b08d0 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 262043340 0 0) 0x7f2ebc003530 con 0x7f2ed006fa40 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 msgr2=0x7f2ed0099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.788 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ed0099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 >> v1:172.21.15.119:6789/0 conn(0x7f2ed00b08d0 legacy=0x7f2ed006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed00b0dd0 con 0x7f2ed006fa40 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7f2ec8001680 con 0x7f2ed006fa40 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 >> v1:172.21.15.37:6789/0 conn(0x7f2ed006fa40 legacy=0x7f2ed015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ebc003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ebc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ebc004d10 0x7f2ebc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed015c110 con 0x7f2ebc003b40 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc00bb20 con 0x7f2ebc004d10 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ebc00bc90 con 0x7f2ed015bd40 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ebc003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ec67fc640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ebc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2ecf7fe640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ebc004d10 0x7f2ebc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 -- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 msgr2=0x7f2ebc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.790 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed015bd40 0x7f2ebc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 -- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ebc004d10 msgr2=0x7f2ebc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ebc004d10 0x7f2ebc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.785+0000 7f2eceffd640 1 -- 172.21.15.37:0/3872351528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc003530 con 0x7f2ebc003b40 2023-07-09T22:02:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2eceffd640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ebc003f30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009f90 tx=0x7f2ec001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa71d605056f2878 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00a5a10 con 0x7f2ebc003b40 2023-07-09T22:02:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec000f040 con 0x7f2ebc003b40 2023-07-09T22:02:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ece7fc640 1 -- 172.21.15.37:0/3872351528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00a5db0 con 0x7f2ebc003b40 2023-07-09T22:02:10.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 -- 172.21.15.37:0/3872351528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 msgr2=0x7f2ebc003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 --2- 172.21.15.37:0/3872351528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ebc003f30 secure :-1 s=READY pgs=2152 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0009f90 tx=0x7f2ec001cc20 comp rx=0 tx=0).stop 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ecf7fe640 1 -- 172.21.15.37:0/3872351528 reap_dead start 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 -- 172.21.15.37:0/3872351528 shutdown_connections 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 -- 172.21.15.37:0/3872351528 >> 172.21.15.37:0/3872351528 conn(0x7f2ed00694f0 msgr2=0x7f2ed00698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 -- 172.21.15.37:0/3872351528 shutdown_connections 2023-07-09T22:02:10.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 -- 172.21.15.37:0/3872351528 wait complete. 2023-07-09T22:02:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.789+0000 7f2ed587b640 1 Processor -- start 2023-07-09T22:02:10.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- start start 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed01f3c70 0x7f2ed015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ed01f40e0 0x7f2ed015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed00979c0 con 0x7f2ebc003b40 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0097ca0 con 0x7f2ed01f40e0 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed0097f80 con 0x7f2ed01f3c70 2023-07-09T22:02:10.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55502/0 (socket says 172.21.15.37:55502) 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 -- 172.21.15.37:0/2871349814 learned_addr learned my addr 172.21.15.37:0/2871349814 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ec67fc640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed01f3c70 0x7f2ed015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ecf7fe640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ed01f40e0 0x7f2ed015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 -- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed01f3c70 msgr2=0x7f2ed015ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed01f3c70 0x7f2ed015ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 -- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ed01f40e0 msgr2=0x7f2ed015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ed01f40e0 0x7f2ed015eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 -- 172.21.15.37:0/2871349814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed0098260 con 0x7f2ebc003b40 2023-07-09T22:02:10.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eceffd640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00b0040 tx=0x7f2ec0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0003ba0 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0003d00 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec0004240 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed0098540 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed015d380 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.793+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed0066bc0 con 0x7f2ebc003b40 2023-07-09T22:02:10.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.797+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2ec00b4040 con 0x7f2ebc003b40 2023-07-09T22:02:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.797+0000 7f2eccff9640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 0x7f2eb0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.797+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f2ec011e400 con 0x7f2ebc003b40 2023-07-09T22:02:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.797+0000 7f2ec67fc640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 0x7f2eb0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:10.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.797+0000 7f2ec67fc640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 0x7f2eb0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cd350 tx=0x7f2eb8009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:10.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.801+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ec00eb890 con 0x7f2ebc003b40 2023-07-09T22:02:10.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.957+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ed009a400 con 0x7f2ebc003b40 2023-07-09T22:02:10.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.957+0000 7f2eccff9640 1 -- 172.21.15.37:0/2871349814 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+15933 (secure 0 0 0) 0x7f2ec00eeeb0 con 0x7f2ebc003b40 2023-07-09T22:02:10.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:10.961 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":201,"fsid":"43b31e6b-703a-46c6-8fb1-0669649379d3","created":"2023-07-09T21:22:05.000467+0000","modified":"2023-07-09T22:02:06.616396+0000","last_up_change":"2023-07-09T21:22:17.364749+0000","last_in_change":"2023-07-09T21:22:07.570217+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-09T21:22:18.012880+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-07-09T21:22:23.956457+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c0d9d184-1b6b-4124-a102-b0bb12334aa9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6809","nonce":3872612948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6811","nonce":3872612948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6815","nonce":3872612948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":3872612948},{"type":"v1","addr":"172.21.15.37:6813","nonce":3872612948}]},"public_addr":"172.21.15.37:6809/3872612948","cluster_addr":"172.21.15.37:6811/3872612948","heartbeat_back_addr":"172.21.15.37:6815/3872612948","heartbeat_front_addr":"172.21.15.37:6813/3872612948","state":["exists","up"]},{"osd":1,"uuid":"f70dcc4b-43f8-40d2-971d-ce1b49ff373e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6817","nonce":3133493931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6819","nonce":3133493931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6823","nonce":3133493931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":3133493931},{"type":"v1","addr":"172.21.15.37:6821","nonce":3133493931}]},"public_addr":"172.21.15.37:6817/3133493931","cluster_addr":"172.21.15.37:6819/3133493931","heartbeat_back_addr":"172.21.15.37:6823/3133493931","heartbeat_front_addr":"172.21.15.37:6821/3133493931","state":["exists","up"]},{"osd":2,"uuid":"10ba599b-3a04-4405-81eb-75db70618a1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6801","nonce":836778419}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6803","nonce":836778419}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6807","nonce":836778419}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":836778419},{"type":"v1","addr":"172.21.15.37:6805","nonce":836778419}]},"public_addr":"172.21.15.37:6801/836778419","cluster_addr":"172.21.15.37:6803/836778419","heartbeat_back_addr":"172.21.15.37:6807/836778419","heartbeat_front_addr":"172.21.15.37:6805/836778419","state":["exists","up"]},{"osd":3,"uuid":"536df8a4-a8e1-4aff-b27a-31048529d14c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6825","nonce":1042910606}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6827","nonce":1042910606}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6831","nonce":1042910606}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":1042910606},{"type":"v1","addr":"172.21.15.37:6829","nonce":1042910606}]},"public_addr":"172.21.15.37:6825/1042910606","cluster_addr":"172.21.15.37:6827/1042910606","heartbeat_back_addr":"172.21.15.37:6831/1042910606","heartbeat_front_addr":"172.21.15.37:6829/1042910606","state":["exists","up"]},{"osd":4,"uuid":"f0c39bfe-dd86-4834-adcf-11fe7c1c7ca8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6808","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6809","nonce":1723829532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6810","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6811","nonce":1723829532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6814","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6815","nonce":1723829532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6812","nonce":1723829532},{"type":"v1","addr":"172.21.15.119:6813","nonce":1723829532}]},"public_addr":"172.21.15.119:6809/1723829532","cluster_addr":"172.21.15.119:6811/1723829532","heartbeat_back_addr":"172.21.15.119:6815/1723829532","heartbeat_front_addr":"172.21.15.119:6813/1723829532","state":["exists","up"]},{"osd":5,"uuid":"08046945-b9c6-47b1-b26e-d147b5e82559","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6821","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6823","nonce":2030521603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6825","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6827","nonce":2030521603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6830","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6831","nonce":2030521603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6828","nonce":2030521603},{"type":"v1","addr":"172.21.15.119:6829","nonce":2030521603}]},"public_addr":"172.21.15.119:6823/2030521603","cluster_addr":"172.21.15.119:6827/2030521603","heartbeat_back_addr":"172.21.15.119:6831/2030521603","heartbeat_front_addr":"172.21.15.119:6829/2030521603","state":["exists","up"]},{"osd":6,"uuid":"2366a411-8370-47c5-8e69-d265adf753aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6800","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6801","nonce":1695629895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6802","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6803","nonce":1695629895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6806","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6807","nonce":1695629895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6804","nonce":1695629895},{"type":"v1","addr":"172.21.15.119:6805","nonce":1695629895}]},"public_addr":"172.21.15.119:6801/1695629895","cluster_addr":"172.21.15.119:6803/1695629895","heartbeat_back_addr":"172.21.15.119:6807/1695629895","heartbeat_front_addr":"172.21.15.119:6805/1695629895","state":["exists","up"]},{"osd":7,"uuid":"dc8ded18-d0bc-4942-aed3-f1e8a6bb1a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":194,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6816","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6817","nonce":904929402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6818","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6819","nonce":904929402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6824","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6826","nonce":904929402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6820","nonce":904929402},{"type":"v1","addr":"172.21.15.119:6822","nonce":904929402}]},"public_addr":"172.21.15.119:6817/904929402","cluster_addr":"172.21.15.119:6819/904929402","heartbeat_back_addr":"172.21.15.119:6826/904929402","heartbeat_front_addr":"172.21.15.119:6822/904929402","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.165369+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.307566+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.321249+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.295210+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.254501+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.417966+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.136148+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-09T21:22:13.302324+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:6835/3019715389":"2023-07-10T22:02:03.581262+0000","172.21.15.119:0/2562275025":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/88497583":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2455535740":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3923412593":"2023-07-10T22:02:00.307165+0000","172.21.15.37:6834/3019715389":"2023-07-10T22:02:03.581262+0000","172.21.15.119:6833/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3375034810":"2023-07-10T22:02:00.307165+0000","172.21.15.119:6832/2249208328":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/2890812838":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/970506968":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3021106069":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/2635851899":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4271011706":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/820648977":"2023-07-10T22:02:00.307165+0000","172.21.15.119:0/3528085809":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6833/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:6832/350512922":"2023-07-10T22:01:41.285377+0000","172.21.15.119:0/4247408657":"2023-07-10T22:01:41.285377+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":16,"snaps":[{"begin":2,"length":2}]},{"pool":20,"snaps":[{"begin":2,"length":32}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-09T22:02:10.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 msgr2=0x7f2eb0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 0x7f2eb0068850 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00cd350 tx=0x7f2eb8009040 comp rx=0 tx=0).stop 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 msgr2=0x7f2ed00a9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00b0040 tx=0x7f2ec0009750 comp rx=0 tx=0).stop 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 shutdown_connections 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ed01f40e0 0x7f2ed015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2eb00663a0 0x7f2eb0068850 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ed01f3c70 0x7f2ed015ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 --2- 172.21.15.37:0/2871349814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ebc003b40 0x7f2ed00a9850 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 >> 172.21.15.37:0/2871349814 conn(0x7f2ed00694f0 msgr2=0x7f2ed00afc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 shutdown_connections 2023-07-09T22:02:10.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:10.961+0000 7f2ed587b640 1 -- 172.21.15.37:0/2871349814 wait complete. 2023-07-09T22:02:11.982 INFO:tasks.ceph:Scrubbing osd.0 2023-07-09T22:02:11.983 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.137+0000 7ffb89d11640 1 Processor -- start 2023-07-09T22:02:12.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 -- start start 2023-07-09T22:02:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 0x7ffb8406c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb840cdd10 0x7ffb840ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8406ce00 con 0x7ffb8415bb40 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb840cd5a0 con 0x7ffb840cdd10 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb89d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840cd880 con 0x7ffb8406c470 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ffb840cdd10 0x7ffb840ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb837fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ffb8415bb40 0x7ffb8406b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54726/0 (socket says 172.21.15.37:54726) 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb837fe640 1 -- 172.21.15.37:0/37382610 learned_addr learned my addr 172.21.15.37:0/37382610 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:12.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 --2- 172.21.15.37:0/37382610 >> v2:172.21.15.37:3300/0 conn(0x7ffb840cdd10 0x7ffb840ce190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55508/0 (socket says 172.21.15.37:55508) 2023-07-09T22:02:12.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 0x7ffb8406c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 -- 172.21.15.37:0/37382610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 msgr2=0x7ffb8406c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:12.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 0x7ffb8406c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 -- 172.21.15.37:0/37382610 >> v1:172.21.15.37:6789/0 conn(0x7ffb8415bb40 legacy=0x7ffb8406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb83fff640 1 -- 172.21.15.37:0/37382610 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8415bf10 con 0x7ffb840cdd10 2023-07-09T22:02:12.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.141+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 0x7ffb8406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:12.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb83fff640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb840cdd10 0x7ffb840ce190 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009d90 tx=0x7ffb7c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6fa28fd87719a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb827fc640 1 -- 172.21.15.37:0/37382610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0a59e0 con 0x7ffb840cdd10 2023-07-09T22:02:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb827fc640 1 -- 172.21.15.37:0/37382610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0a5b40 con 0x7ffb840cdd10 2023-07-09T22:02:12.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb827fc640 1 -- 172.21.15.37:0/37382610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0ad440 con 0x7ffb840cdd10 2023-07-09T22:02:12.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- 172.21.15.37:0/37382610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb840cdd10 msgr2=0x7ffb840ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb840cdd10 0x7ffb840ce190 secure :-1 s=READY pgs=2155 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009d90 tx=0x7ffb7c01c920 comp rx=0 tx=0).stop 2023-07-09T22:02:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- 172.21.15.37:0/37382610 shutdown_connections 2023-07-09T22:02:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb840cdd10 0x7ffb840ce190 unknown :-1 s=CLOSED pgs=2155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 --2- 172.21.15.37:0/37382610 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb8406c470 0x7ffb8406c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- 172.21.15.37:0/37382610 >> 172.21.15.37:0/37382610 conn(0x7ffb840d2470 msgr2=0x7ffb840d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- 172.21.15.37:0/37382610 shutdown_connections 2023-07-09T22:02:12.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- 172.21.15.37:0/37382610 wait complete. 2023-07-09T22:02:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 Processor -- start 2023-07-09T22:02:12.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.145+0000 7ffb89d11640 1 -- start start 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb8406c470 0x7ffb840caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb840cdd10 0x7ffb841f82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 0x7ffb84139cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840cb4c0 con 0x7ffb8415bb40 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb841f8800 con 0x7ffb8406c470 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb840c9ee0 con 0x7ffb840cdd10 2023-07-09T22:02:12.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 0x7ffb84139cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 0x7ffb84139cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55510/0 (socket says 172.21.15.37:55510) 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 -- 172.21.15.37:0/3210631434 learned_addr learned my addr 172.21.15.37:0/3210631434 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb840cdd10 0x7ffb841f82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb837fe640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb8406c470 0x7ffb840caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 -- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb840cdd10 msgr2=0x7ffb841f82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb840cdd10 0x7ffb841f82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 -- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb8406c470 msgr2=0x7ffb840caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ffb8406c470 0x7ffb840caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7c009a70 con 0x7ffb8415bb40 2023-07-09T22:02:12.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ffb840cdd10 0x7ffb841f82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:12.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb83fff640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 0x7ffb84139cd0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b0040 tx=0x7ffb7c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0ade40 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c0b9450 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c0b9800 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb840ca1c0 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb840ca780 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.149+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffb840703e0 con 0x7ffb8415bb40 2023-07-09T22:02:12.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ffb7c0b9960 con 0x7ffb8415bb40 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ffb700663a0 0x7ffb70068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7ffb7c11f870 con 0x7ffb8415bb40 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7ffb7006ce50 0x7ffb7006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffb7006f950 con 0x7ffb7006ce50 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb7c121e50 con 0x7ffb8415bb40 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb837fe640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ffb700663a0 0x7ffb70068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7ffb7006ce50 0x7ffb7006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb82ffd640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7ffb7006ce50 0x7ffb7006f280 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb837fe640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ffb700663a0 0x7ffb70068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb74005890 tx=0x7ffb74009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.153+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== osd.0 v2:172.21.15.37:6808/3872612948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ffb7006f950 con 0x7ffb7006ce50 2023-07-09T22:02:12.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.165+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 --> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffb84066bc0 con 0x7ffb7006ce50 2023-07-09T22:02:12.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.165+0000 7ffb6bfff640 1 -- 172.21.15.37:0/3210631434 <== osd.0 v2:172.21.15.37:6808/3872612948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ffb84066bc0 con 0x7ffb7006ce50 2023-07-09T22:02:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:12.169 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:12.169 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:12.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.165+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7ffb7006ce50 msgr2=0x7ffb7006f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.165+0000 7ffb89d11640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:6808/3872612948,v1:172.21.15.37:6809/3872612948] conn(0x7ffb7006ce50 0x7ffb7006f280 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ffb700663a0 msgr2=0x7ffb70068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ffb700663a0 0x7ffb70068850 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ffb74005890 tx=0x7ffb74009040 comp rx=0 tx=0).stop 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 msgr2=0x7ffb84139cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 --2- 172.21.15.37:0/3210631434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffb8415bb40 0x7ffb84139cd0 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0b0040 tx=0x7ffb7c0196c0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb83fff640 1 -- 172.21.15.37:0/3210631434 reap_dead start 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 shutdown_connections 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 >> 172.21.15.37:0/3210631434 conn(0x7ffb840d2470 msgr2=0x7ffb84153fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 shutdown_connections 2023-07-09T22:02:12.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.169+0000 7ffb89d11640 1 -- 172.21.15.37:0/3210631434 wait complete. 2023-07-09T22:02:12.187 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-07-09T22:02:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 Processor -- start 2023-07-09T22:02:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 -- start start 2023-07-09T22:02:12.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fae48158a50 0x7fae4806bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae480a9670 con 0x7fae480afd70 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4806ea90 con 0x7fae4806d9e0 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae50407640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4806c080 con 0x7fae48158a50 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae4d9a2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fae480afd70 0x7fae4806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54728/0 (socket says 172.21.15.37:54728) 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae4d9a2640 1 -- 172.21.15.37:0/2851935024 learned_addr learned my addr 172.21.15.37:0/2851935024 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:12.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.329+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/2851935024 >> v2:172.21.15.119:3300/0 conn(0x7fae48158a50 0x7fae4806bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623696933 0 0) 0x7fae480a9670 con 0x7fae480afd70 2023-07-09T22:02:12.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae34003530 con 0x7fae480afd70 2023-07-09T22:02:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983187802 0 0) 0x7fae4806ea90 con 0x7fae4806d9e0 2023-07-09T22:02:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae480a9670 con 0x7fae4806d9e0 2023-07-09T22:02:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2998059512 0 0) 0x7fae34003530 con 0x7fae480afd70 2023-07-09T22:02:12.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 >> v2:172.21.15.119:3300/0 conn(0x7fae48158a50 msgr2=0x7fae4806bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 --2- 172.21.15.37:0/2851935024 >> v2:172.21.15.119:3300/0 conn(0x7fae48158a50 0x7fae4806bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 >> v1:172.21.15.119:6789/0 conn(0x7fae4806d9e0 legacy=0x7fae4806fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4806ed70 con 0x7fae480afd70 2023-07-09T22:02:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7fae38001680 con 0x7fae480afd70 2023-07-09T22:02:12.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 >> v1:172.21.15.37:6789/0 conn(0x7fae480afd70 legacy=0x7fae4806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 0x7fae34003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae340047d0 0x7fae34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae34005180 0x7fae3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4806c080 con 0x7fae34003b10 2023-07-09T22:02:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3400e1f0 con 0x7fae34005180 2023-07-09T22:02:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3400e3b0 con 0x7fae340047d0 2023-07-09T22:02:12.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 0x7fae34003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d9a2640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae340047d0 0x7fae34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e9a4640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae34005180 0x7fae3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 -- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae340047d0 msgr2=0x7fae34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae340047d0 0x7fae34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 -- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae34005180 msgr2=0x7fae3400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:12.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae34005180 0x7fae3400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e1a3640 1 -- 172.21.15.37:0/2851935024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae34003530 con 0x7fae34003b10 2023-07-09T22:02:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4e9a4640 1 -- 172.21.15.37:0/2851935024 reap_dead start 2023-07-09T22:02:12.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.333+0000 7fae4d9a2640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae340047d0 0x7fae34004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:12.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 0x7fae34003f00 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fae44009ac0 tx=0x7fae4401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce2c4d82449786e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440059a0 con 0x7fae34003b10 2023-07-09T22:02:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44005b00 con 0x7fae34003b10 2023-07-09T22:02:12.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae4d1a1640 1 -- 172.21.15.37:0/2851935024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44006030 con 0x7fae34003b10 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 msgr2=0x7fae34003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 0x7fae34003f00 secure :-1 s=READY pgs=2158 cs=0 l=1 rev1=1 crypto rx=0x7fae44009ac0 tx=0x7fae4401ca00 comp rx=0 tx=0).stop 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- 172.21.15.37:0/2851935024 shutdown_connections 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 --2- 172.21.15.37:0/2851935024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae34003b10 0x7fae34003f00 unknown :-1 s=CLOSED pgs=2158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- 172.21.15.37:0/2851935024 >> 172.21.15.37:0/2851935024 conn(0x7fae480af260 msgr2=0x7fae480af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- 172.21.15.37:0/2851935024 shutdown_connections 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- 172.21.15.37:0/2851935024 wait complete. 2023-07-09T22:02:12.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 Processor -- start 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- start start 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae34003b10 0x7fae480ab2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 0x7fae481e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae48092900 con 0x7fae480ab7e0 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae480ac500 con 0x7fae481573b0 2023-07-09T22:02:12.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.337+0000 7fae50407640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae480abc60 con 0x7fae34003b10 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55532/0 (socket says 172.21.15.37:55532) 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 -- 172.21.15.37:0/3530414258 learned_addr learned my addr 172.21.15.37:0/3530414258 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae34003b10 0x7fae480ab2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4e9a4640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 0x7fae481e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 -- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae34003b10 msgr2=0x7fae480ab2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae34003b10 0x7fae480ab2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 -- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 msgr2=0x7fae481e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 0x7fae481e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 -- 172.21.15.37:0/3530414258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae480abf40 con 0x7fae480ab7e0 2023-07-09T22:02:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4e9a4640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 0x7fae481e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae4d9a2640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fae38001b70 tx=0x7fae3800e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38010510 con 0x7fae480ab7e0 2023-07-09T22:02:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38010670 con 0x7fae480ab7e0 2023-07-09T22:02:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae480ac220 con 0x7fae480ab7e0 2023-07-09T22:02:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae38010a20 con 0x7fae480ab7e0 2023-07-09T22:02:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae481e93a0 con 0x7fae480ab7e0 2023-07-09T22:02:12.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae48092ab0 con 0x7fae480ab7e0 2023-07-09T22:02:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.341+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fae38010b80 con 0x7fae480ab7e0 2023-07-09T22:02:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.345+0000 7fae3effd640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 0x7fae2c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.345+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fae380834f0 con 0x7fae480ab7e0 2023-07-09T22:02:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.345+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 0x7fae2c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.345+0000 7fae4e1a3640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 0x7fae2c068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae440ac000 tx=0x7fae440046d0 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.345+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fae48092ab0 con 0x7fae480ab7e0 2023-07-09T22:02:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fae4806f610 con 0x7fae2c0663a0 2023-07-09T22:02:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae3effd640 1 -- 172.21.15.37:0/3530414258 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fae44005cf0 con 0x7fae2c0663a0 2023-07-09T22:02:12.502 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 msgr2=0x7fae2c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 0x7fae2c068850 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fae440ac000 tx=0x7fae440046d0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 msgr2=0x7fae481e57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7fae38001b70 tx=0x7fae3800e820 comp rx=0 tx=0).stop 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 shutdown_connections 2023-07-09T22:02:12.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fae481573b0 0x7fae481e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae480ab7e0 0x7fae481e57f0 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fae2c0663a0 0x7fae2c068850 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 --2- 172.21.15.37:0/3530414258 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fae34003b10 0x7fae480ab2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 >> 172.21.15.37:0/3530414258 conn(0x7fae480af260 msgr2=0x7fae48070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 shutdown_connections 2023-07-09T22:02:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.501+0000 7fae50407640 1 -- 172.21.15.37:0/3530414258 wait complete. 2023-07-09T22:02:12.524 INFO:tasks.ceph:Scrubbing osd.1 2023-07-09T22:02:12.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:12.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 Processor -- start 2023-07-09T22:02:12.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 -- start start 2023-07-09T22:02:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 0x7f05e40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e40cd5a0 con 0x7f05e406c470 2023-07-09T22:02:12.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e40cd880 con 0x7f05e415bb40 2023-07-09T22:02:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05ec634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e406cd70 con 0x7f05e406c8f0 2023-07-09T22:02:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e9bcf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f05e406c470 0x7f05e40cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54736/0 (socket says 172.21.15.37:54736) 2023-07-09T22:02:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e9bcf640 1 -- 172.21.15.37:0/1995172257 learned_addr learned my addr 172.21.15.37:0/1995172257 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:12.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05eabd1640 1 --2- 172.21.15.37:0/1995172257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 0x7f05e40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211801609 0 0) 0x7f05e40cd5a0 con 0x7f05e406c470 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d0003530 con 0x7f05e406c470 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797113745 0 0) 0x7f05e40cd880 con 0x7f05e415bb40 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e40cd5a0 con 0x7f05e415bb40 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05eabd1640 1 -- 172.21.15.37:0/1995172257 >> v1:172.21.15.119:6789/0 conn(0x7f05e415bb40 legacy=0x7f05e406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05eabd1640 1 -- 172.21.15.37:0/1995172257 >> v1:172.21.15.37:6789/0 conn(0x7f05e406c470 legacy=0x7f05e40cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.669+0000 7f05eabd1640 1 -- 172.21.15.37:0/1995172257 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e415bf10 con 0x7f05e406c8f0 2023-07-09T22:02:12.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05eabd1640 1 --2- 172.21.15.37:0/1995172257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 0x7f05e40ce420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009dc0 tx=0x7f05dc01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced967898ad6aee9 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0a5a00 con 0x7f05e406c8f0 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0a5b60 con 0x7f05e406c8f0 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05e93ce640 1 -- 172.21.15.37:0/1995172257 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc0ad440 con 0x7f05e406c8f0 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 -- 172.21.15.37:0/1995172257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 msgr2=0x7f05e40ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 --2- 172.21.15.37:0/1995172257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 0x7f05e40ce420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009dc0 tx=0x7f05dc01c940 comp rx=0 tx=0).stop 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 -- 172.21.15.37:0/1995172257 shutdown_connections 2023-07-09T22:02:12.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 --2- 172.21.15.37:0/1995172257 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e406c8f0 0x7f05e40ce420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 -- 172.21.15.37:0/1995172257 >> 172.21.15.37:0/1995172257 conn(0x7f05e40d2470 msgr2=0x7f05e40d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 -- 172.21.15.37:0/1995172257 shutdown_connections 2023-07-09T22:02:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.673+0000 7f05ec634640 1 -- 172.21.15.37:0/1995172257 wait complete. 2023-07-09T22:02:12.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 Processor -- start 2023-07-09T22:02:12.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- start start 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 0x7f05e40b7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e406c8f0 0x7f05e415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e415bb40 0x7f05e415f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415c7e0 con 0x7f05e406c470 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e40b8010 con 0x7f05e406c8f0 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e415c9f0 con 0x7f05e415bb40 2023-07-09T22:02:12.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 0x7f05e40b7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 0x7f05e40b7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55544/0 (socket says 172.21.15.37:55544) 2023-07-09T22:02:12.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 -- 172.21.15.37:0/3331702148 learned_addr learned my addr 172.21.15.37:0/3331702148 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05e9bcf640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e406c8f0 0x7f05e415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05eabd1640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e415bb40 0x7f05e415f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 -- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e415bb40 msgr2=0x7f05e415f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e415bb40 0x7f05e415f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 -- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e406c8f0 msgr2=0x7f05e415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f05e406c8f0 0x7f05e415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc009a70 con 0x7f05e406c470 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05eabd1640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f05e415bb40 0x7f05e415f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ea3d0640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 0x7f05e40b7ad0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c490 tx=0x7f05e000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e00052d0 con 0x7f05e406c470 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0005430 con 0x7f05e406c470 2023-07-09T22:02:12.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0012870 con 0x7f05e406c470 2023-07-09T22:02:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e415ccd0 con 0x7f05e406c470 2023-07-09T22:02:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.677+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e415d290 con 0x7f05e406c470 2023-07-09T22:02:12.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f05e40703e0 con 0x7f05e406c470 2023-07-09T22:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f05e00129d0 con 0x7f05e406c470 2023-07-09T22:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f05c80663a0 0x7f05c8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f05e00839e0 con 0x7f05e406c470 2023-07-09T22:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7f05c806ce50 0x7f05c806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05c806f950 con 0x7f05c806ce50 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05e00882c0 con 0x7f05e406c470 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05e9bcf640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f05c80663a0 0x7f05c8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05eabd1640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7f05c806ce50 0x7f05c806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05e9bcf640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f05c80663a0 0x7f05c8068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05e4150340 tx=0x7f05d4009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.681+0000 7f05eabd1640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7f05c806ce50 0x7f05c806f280 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.685+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== osd.1 v2:172.21.15.37:6816/3133493931 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05c806f950 con 0x7f05c806ce50 2023-07-09T22:02:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 --> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f05e4066bc0 con 0x7f05c806ce50 2023-07-09T22:02:12.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05daffd640 1 -- 172.21.15.37:0/3331702148 <== osd.1 v2:172.21.15.37:6816/3133493931 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f05e4066bc0 con 0x7f05c806ce50 2023-07-09T22:02:12.698 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:12.699 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:12.699 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7f05c806ce50 msgr2=0x7f05c806f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:6816/3133493931,v1:172.21.15.37:6817/3133493931] conn(0x7f05c806ce50 0x7f05c806f280 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f05c80663a0 msgr2=0x7f05c8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f05c80663a0 0x7f05c8068850 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f05e4150340 tx=0x7f05d4009040 comp rx=0 tx=0).stop 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 msgr2=0x7f05e40b7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 --2- 172.21.15.37:0/3331702148 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05e406c470 0x7f05e40b7ad0 secure :-1 s=READY pgs=2161 cs=0 l=1 rev1=1 crypto rx=0x7f05e000c490 tx=0x7f05e000c950 comp rx=0 tx=0).stop 2023-07-09T22:02:12.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05eabd1640 1 -- 172.21.15.37:0/3331702148 reap_dead start 2023-07-09T22:02:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 shutdown_connections 2023-07-09T22:02:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 >> 172.21.15.37:0/3331702148 conn(0x7f05e40d2470 msgr2=0x7f05e415a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 shutdown_connections 2023-07-09T22:02:12.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.697+0000 7f05ec634640 1 -- 172.21.15.37:0/3331702148 wait complete. 2023-07-09T22:02:12.717 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-07-09T22:02:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 Processor -- start 2023-07-09T22:02:12.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 -- start start 2023-07-09T22:02:12.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb33015cde0 0x7fb3300a9890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb33015d1b0 0x7fb3300955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3300a9dd0 con 0x7fb330095b30 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3300960b0 con 0x7fb33015d1b0 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb336256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33006c4c0 con 0x7fb33015cde0 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb33015d1b0 0x7fb3300955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb330095b30 0x7fb330096610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54752/0 (socket says 172.21.15.37:54752) 2023-07-09T22:02:12.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb33015d1b0 0x7fb3300955f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55548/0 (socket says 172.21.15.37:55548) 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32ffff640 1 -- 172.21.15.37:0/3111170488 learned_addr learned my addr 172.21.15.37:0/3111170488 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32f7fe640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb33015cde0 0x7fb3300a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 -- 172.21.15.37:0/3111170488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb33015cde0 msgr2=0x7fb3300a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb33015cde0 0x7fb3300a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 -- 172.21.15.37:0/3111170488 >> v1:172.21.15.37:6789/0 conn(0x7fb330095b30 legacy=0x7fb330096610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32effd640 1 -- 172.21.15.37:0/3111170488 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb33006c7a0 con 0x7fb33015d1b0 2023-07-09T22:02:12.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.861+0000 7fb32e7fc640 1 -- 172.21.15.37:0/3111170488 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4143418034 0 0) 0x7fb3300a9dd0 con 0x7fb330095b30 2023-07-09T22:02:12.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb32effd640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300955f0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097c0 tx=0x7fb32401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80a6f546a002c14 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb32e7fc640 1 -- 172.21.15.37:0/3111170488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240ad640 con 0x7fb33015d1b0 2023-07-09T22:02:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb32e7fc640 1 -- 172.21.15.37:0/3111170488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3240ad7a0 con 0x7fb33015d1b0 2023-07-09T22:02:12.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb32e7fc640 1 -- 172.21.15.37:0/3111170488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3240adb30 con 0x7fb33015d1b0 2023-07-09T22:02:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 -- 172.21.15.37:0/3111170488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 msgr2=0x7fb3300955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300955f0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7fb3240097c0 tx=0x7fb32401c480 comp rx=0 tx=0).stop 2023-07-09T22:02:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 -- 172.21.15.37:0/3111170488 shutdown_connections 2023-07-09T22:02:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300955f0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 --2- 172.21.15.37:0/3111170488 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb33015cde0 0x7fb3300a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 -- 172.21.15.37:0/3111170488 >> 172.21.15.37:0/3111170488 conn(0x7fb3300af260 msgr2=0x7fb3300af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 -- 172.21.15.37:0/3111170488 shutdown_connections 2023-07-09T22:02:12.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.865+0000 7fb336256640 1 -- 172.21.15.37:0/3111170488 wait complete. 2023-07-09T22:02:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 Processor -- start 2023-07-09T22:02:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- start start 2023-07-09T22:02:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 0x7fb3300a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 0x7fb3301f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301f86a0 con 0x7fb33015d1b0 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330162010 con 0x7fb33015cde0 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301622f0 con 0x7fb330095b30 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55552/0 (socket says 172.21.15.37:55552) 2023-07-09T22:02:12.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 -- 172.21.15.37:0/3028905960 learned_addr learned my addr 172.21.15.37:0/3028905960 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32f7fe640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 0x7fb3300a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32effd640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 0x7fb3301f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 -- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 msgr2=0x7fb3300a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 0x7fb3300a8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 -- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 msgr2=0x7fb3301f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 0x7fb3301f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 -- 172.21.15.37:0/3028905960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb324009420 con 0x7fb33015d1b0 2023-07-09T22:02:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32effd640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 0x7fb3301f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32f7fe640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 0x7fb3300a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb32ffff640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cb30 tx=0x7fb32800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32800aca0 con 0x7fb33015d1b0 2023-07-09T22:02:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32800ae20 con 0x7fb33015d1b0 2023-07-09T22:02:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328012640 con 0x7fb33015d1b0 2023-07-09T22:02:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3301625d0 con 0x7fb33015d1b0 2023-07-09T22:02:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb330162b90 con 0x7fb33015d1b0 2023-07-09T22:02:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.869+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb330066bc0 con 0x7fb33015d1b0 2023-07-09T22:02:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.873+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fb328007070 con 0x7fb33015d1b0 2023-07-09T22:02:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.873+0000 7fb317fff640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 0x7fb31c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.873+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fb328083ec0 con 0x7fb33015d1b0 2023-07-09T22:02:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.873+0000 7fb32f7fe640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 0x7fb31c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.873+0000 7fb32f7fe640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 0x7fb31c068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb320009ac0 tx=0x7fb320008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:12.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:12.877+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb328051200 con 0x7fb33015d1b0 2023-07-09T22:02:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.029+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb330162460 con 0x7fb31c0663a0 2023-07-09T22:02:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.029+0000 7fb317fff640 1 -- 172.21.15.37:0/3028905960 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb330162460 con 0x7fb31c0663a0 2023-07-09T22:02:13.032 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2023-07-09T22:02:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 msgr2=0x7fb31c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 0x7fb31c068850 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb320009ac0 tx=0x7fb320008040 comp rx=0 tx=0).stop 2023-07-09T22:02:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 msgr2=0x7fb3300961f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7fb32800cb30 tx=0x7fb32800a060 comp rx=0 tx=0).stop 2023-07-09T22:02:13.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 shutdown_connections 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb33015d1b0 0x7fb3300961f0 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fb33015cde0 0x7fb3301f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fb31c0663a0 0x7fb31c068850 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 --2- 172.21.15.37:0/3028905960 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fb330095b30 0x7fb3300a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 >> 172.21.15.37:0/3028905960 conn(0x7fb3300af260 msgr2=0x7fb3300a90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 shutdown_connections 2023-07-09T22:02:13.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.033+0000 7fb336256640 1 -- 172.21.15.37:0/3028905960 wait complete. 2023-07-09T22:02:13.053 INFO:tasks.ceph:Scrubbing osd.2 2023-07-09T22:02:13.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:13.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 Processor -- start 2023-07-09T22:02:13.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 -- start start 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 0x7f9f8c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f9f8c0cdd10 0x7f9f8c0ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f8c06ce00 con 0x7f9f8c15bb40 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cd5a0 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.197+0000 7f9f91f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0cd880 con 0x7f9f8c06c470 2023-07-09T22:02:13.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9f8c15bb40 0x7f9f8c06b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54768/0 (socket says 172.21.15.37:54768) 2023-07-09T22:02:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8b7fe640 1 -- 172.21.15.37:0/627906296 learned_addr learned my addr 172.21.15.37:0/627906296 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:13.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/627906296 >> v2:172.21.15.119:3300/0 conn(0x7f9f8c0cdd10 0x7f9f8c0ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8affd640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 0x7f9f8c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/627906296 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207817540 0 0) 0x7f9f7c001120 con 0x7f9f8c15bb40 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/627906296 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f74003530 con 0x7f9f8c15bb40 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 -- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 msgr2=0x7f9f8c06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 0x7f9f8c06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 -- 172.21.15.37:0/627906296 >> v1:172.21.15.37:6789/0 conn(0x7f9f8c15bb40 legacy=0x7f9f8c06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 -- 172.21.15.37:0/627906296 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c15bf10 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8affd640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 0x7f9f8c06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:13.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.201+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c0cdd10 0x7f9f8c0ce190 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2888f2edcc1e971 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/627906296 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840a59e0 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/627906296 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840a5b40 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f8a7fc640 1 -- 172.21.15.37:0/627906296 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840ad440 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c0cdd10 msgr2=0x7f9f8c0ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c0cdd10 0x7f9f8c0ce190 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009d90 tx=0x7f9f8401c920 comp rx=0 tx=0).stop 2023-07-09T22:02:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- 172.21.15.37:0/627906296 shutdown_connections 2023-07-09T22:02:13.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c0cdd10 0x7f9f8c0ce190 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- 172.21.15.37:0/627906296 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c06c470 0x7f9f8c06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- 172.21.15.37:0/627906296 >> 172.21.15.37:0/627906296 conn(0x7f9f8c0d2470 msgr2=0x7f9f8c0d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- 172.21.15.37:0/627906296 shutdown_connections 2023-07-09T22:02:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- 172.21.15.37:0/627906296 wait complete. 2023-07-09T22:02:13.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 Processor -- start 2023-07-09T22:02:13.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- start start 2023-07-09T22:02:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06c470 0x7f9f8c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c0cdd10 0x7f9f8c149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 0x7f9f8c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c14d970 con 0x7f9f8c15bb40 2023-07-09T22:02:13.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c0caa60 con 0x7f9f8c06c470 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.205+0000 7f9f91f40640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f8c14d640 con 0x7f9f8c0cdd10 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 0x7f9f8c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 0x7f9f8c14e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55558/0 (socket says 172.21.15.37:55558) 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 -- 172.21.15.37:0/1114319373 learned_addr learned my addr 172.21.15.37:0/1114319373 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06c470 0x7f9f8c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c0cdd10 0x7f9f8c149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 -- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c0cdd10 msgr2=0x7f9f8c149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f9f8c0cdd10 0x7f9f8c149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 -- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06c470 msgr2=0x7f9f8c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06c470 0x7f9f8c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f80009420 con 0x7f9f8c15bb40 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f9f8c06c470 0x7f9f8c14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f8bfff640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 0x7f9f8c14e250 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b0040 tx=0x7f9f840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840adce0 con 0x7f9f8c15bb40 2023-07-09T22:02:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f840ade40 con 0x7f9f8c15bb40 2023-07-09T22:02:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f84009a70 con 0x7f9f8c15bb40 2023-07-09T22:02:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840b9690 con 0x7f9f8c15bb40 2023-07-09T22:02:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f8c1fcc10 con 0x7f9f8c15bb40 2023-07-09T22:02:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f8c0703e0 con 0x7f9f8c15bb40 2023-07-09T22:02:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.209+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f9f840b97f0 con 0x7f9f8c15bb40 2023-07-09T22:02:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9f780663a0 0x7f9f78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f9f8411f5d0 con 0x7f9f8c15bb40 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7f9f7806ce50 0x7f9f7806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f7806f950 con 0x7f9f7806ce50 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f84121bb0 con 0x7f9f8c15bb40 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9f780663a0 0x7f9f78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7f9f7806ce50 0x7f9f7806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f8b7fe640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9f780663a0 0x7f9f78068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c001280 tx=0x7f9f7c009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f8affd640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7f9f7806ce50 0x7f9f7806f280 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.213+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== osd.2 v2:172.21.15.37:6800/836778419 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9f7806f950 con 0x7f9f7806ce50 2023-07-09T22:02:13.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 --> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f8c14dab0 con 0x7f9f7806ce50 2023-07-09T22:02:13.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f73fff640 1 -- 172.21.15.37:0/1114319373 <== osd.2 v2:172.21.15.37:6800/836778419 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9f8c14dab0 con 0x7f9f7806ce50 2023-07-09T22:02:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:13.228 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:13.228 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:13.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7f9f7806ce50 msgr2=0x7f9f7806f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:6800/836778419,v1:172.21.15.37:6801/836778419] conn(0x7f9f7806ce50 0x7f9f7806f280 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9f780663a0 msgr2=0x7f9f78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9f780663a0 0x7f9f78068850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c001280 tx=0x7f9f7c009040 comp rx=0 tx=0).stop 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 msgr2=0x7f9f8c14e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 --2- 172.21.15.37:0/1114319373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f8c15bb40 0x7f9f8c14e250 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7f9f840b0040 tx=0x7f9f840196c0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f8bfff640 1 -- 172.21.15.37:0/1114319373 reap_dead start 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 shutdown_connections 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 >> 172.21.15.37:0/1114319373 conn(0x7f9f8c0d2470 msgr2=0x7f9f8c06b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 shutdown_connections 2023-07-09T22:02:13.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.225+0000 7f9f91f40640 1 -- 172.21.15.37:0/1114319373 wait complete. 2023-07-09T22:02:13.247 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-07-09T22:02:13.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 Processor -- start 2023-07-09T22:02:13.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 -- start start 2023-07-09T22:02:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f61ac15bd40 0x7f61ac099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61ac0b08d0 0x7f61ac06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac09c9d0 con 0x7f61ac06cff0 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac09c120 con 0x7f61ac0b08d0 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61b0a93640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac15c110 con 0x7f61ac15bd40 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61ac0b08d0 0x7f61ac06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f61ac0b08d0 0x7f61ac06cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55568/0 (socket says 172.21.15.37:55568) 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 -- 172.21.15.37:0/438271723 learned_addr learned my addr 172.21.15.37:0/438271723 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61aa59c640 1 --2- 172.21.15.37:0/438271723 >> v2:172.21.15.119:3300/0 conn(0x7f61ac15bd40 0x7f61ac099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 -- 172.21.15.37:0/438271723 >> v2:172.21.15.119:3300/0 conn(0x7f61ac15bd40 msgr2=0x7f61ac099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 --2- 172.21.15.37:0/438271723 >> v2:172.21.15.119:3300/0 conn(0x7f61ac15bd40 0x7f61ac099a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 -- 172.21.15.37:0/438271723 >> v1:172.21.15.119:6789/0 conn(0x7f61ac06cff0 legacy=0x7f61ac06fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.389+0000 7f61a9d9b640 1 -- 172.21.15.37:0/438271723 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0b0dd0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61a9d9b640 1 --2- 172.21.15.37:0/438271723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac06cab0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f61ac099750 tx=0x7f61a001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b393916dec161930 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61a959a640 1 -- 172.21.15.37:0/438271723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab600 con 0x7f61ac0b08d0 2023-07-09T22:02:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61a959a640 1 -- 172.21.15.37:0/438271723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00a7050 con 0x7f61ac0b08d0 2023-07-09T22:02:13.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61a959a640 1 -- 172.21.15.37:0/438271723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab980 con 0x7f61ac0b08d0 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 -- 172.21.15.37:0/438271723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 msgr2=0x7f61ac06cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 --2- 172.21.15.37:0/438271723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac06cab0 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f61ac099750 tx=0x7f61a001c470 comp rx=0 tx=0).stop 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 -- 172.21.15.37:0/438271723 shutdown_connections 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 --2- 172.21.15.37:0/438271723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac06cab0 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 --2- 172.21.15.37:0/438271723 >> v2:172.21.15.119:3300/0 conn(0x7f61ac15bd40 0x7f61ac099a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 -- 172.21.15.37:0/438271723 >> 172.21.15.37:0/438271723 conn(0x7f61ac0694f0 msgr2=0x7f61ac0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 -- 172.21.15.37:0/438271723 shutdown_connections 2023-07-09T22:02:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.393+0000 7f61b0a93640 1 -- 172.21.15.37:0/438271723 wait complete. 2023-07-09T22:02:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 Processor -- start 2023-07-09T22:02:13.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- start start 2023-07-09T22:02:13.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 0x7f61ac153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61ac15bd40 0x7f61ac156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0ac9f0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac1535a0 con 0x7f61ac06cff0 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0abde0 con 0x7f61ac15bd40 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55580/0 (socket says 172.21.15.37:55580) 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 -- 172.21.15.37:0/4054261967 learned_addr learned my addr 172.21.15.37:0/4054261967 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61aa59c640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 0x7f61ac153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61aad9d640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61ac15bd40 0x7f61ac156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 -- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61ac15bd40 msgr2=0x7f61ac156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61ac15bd40 0x7f61ac156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 -- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 msgr2=0x7f61ac153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 0x7f61ac153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 -- 172.21.15.37:0/4054261967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00094d0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61aa59c640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 0x7f61ac153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61a9d9b640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae040 tx=0x7f61a0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b37d0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00b3930 con 0x7f61ac0b08d0 2023-07-09T22:02:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00b3ca0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac0ac0c0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac0ac680 con 0x7f61ac0b08d0 2023-07-09T22:02:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.397+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac066bc0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.401+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f61a00b2070 con 0x7f61ac0b08d0 2023-07-09T22:02:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.401+0000 7f619affd640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 0x7f618c068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.401+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f61a011e400 con 0x7f61ac0b08d0 2023-07-09T22:02:13.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.401+0000 7f61aa59c640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 0x7f618c068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.401+0000 7f61aa59c640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 0x7f618c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f619c007a70 tx=0x7f619c008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.405+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f61a00eb5a0 con 0x7f61ac0b08d0 2023-07-09T22:02:13.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.557+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f61ac099f90 con 0x7f618c0663a0 2023-07-09T22:02:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.557+0000 7f619affd640 1 -- 172.21.15.37:0/4054261967 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f619c007710 con 0x7f618c0663a0 2023-07-09T22:02:13.561 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2023-07-09T22:02:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 msgr2=0x7f618c068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 0x7f618c068850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f619c007a70 tx=0x7f619c008040 comp rx=0 tx=0).stop 2023-07-09T22:02:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 msgr2=0x7f61ac0ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae040 tx=0x7f61a0019210 comp rx=0 tx=0).stop 2023-07-09T22:02:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 shutdown_connections 2023-07-09T22:02:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f618c0663a0 0x7f618c068850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f61ac15bd40 0x7f61ac156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61ac0b08d0 0x7f61ac0ace80 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 --2- 172.21.15.37:0/4054261967 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f61ac06cff0 0x7f61ac153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 >> 172.21.15.37:0/4054261967 conn(0x7f61ac0694f0 msgr2=0x7f61ac070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 shutdown_connections 2023-07-09T22:02:13.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.561+0000 7f61b0a93640 1 -- 172.21.15.37:0/4054261967 wait complete. 2023-07-09T22:02:13.582 INFO:tasks.ceph:Scrubbing osd.3 2023-07-09T22:02:13.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 Processor -- start 2023-07-09T22:02:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 -- start start 2023-07-09T22:02:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c06b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f768c06c8c0 0x7f768c15fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0cd5a0 con 0x7f768c06c470 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c0ced20 con 0x7f768c06c8c0 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f76940bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0cd880 con 0x7f768c15bb40 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f769265a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f768c06c8c0 0x7f768c15fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f7691658640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f768c06c470 0x7f768c15f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54778/0 (socket says 172.21.15.37:54778) 2023-07-09T22:02:13.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f7691658640 1 -- 172.21.15.37:0/3809431022 learned_addr learned my addr 172.21.15.37:0/3809431022 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f769265a640 1 -- 172.21.15.37:0/3809431022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 msgr2=0x7f768c06b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f7691e59640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c06b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f769265a640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c06b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f769265a640 1 -- 172.21.15.37:0/3809431022 >> v1:172.21.15.37:6789/0 conn(0x7f768c06c470 legacy=0x7f768c15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f769265a640 1 -- 172.21.15.37:0/3809431022 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c15bf10 con 0x7f768c06c8c0 2023-07-09T22:02:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f7691e59640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c06b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:13.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.729+0000 7f7690e57640 1 -- 172.21.15.37:0/3809431022 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495847401 0 0) 0x7f768c0cd5a0 con 0x7f768c06c470 2023-07-09T22:02:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f769265a640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c15fde0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f7684009d90 tx=0x7f768401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25884a7397a80fd server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f7690e57640 1 -- 172.21.15.37:0/3809431022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840a59e0 con 0x7f768c06c8c0 2023-07-09T22:02:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f7690e57640 1 -- 172.21.15.37:0/3809431022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76840a5b40 con 0x7f768c06c8c0 2023-07-09T22:02:13.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f7690e57640 1 -- 172.21.15.37:0/3809431022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840ad440 con 0x7f768c06c8c0 2023-07-09T22:02:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 -- 172.21.15.37:0/3809431022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 msgr2=0x7f768c15fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c15fde0 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f7684009d90 tx=0x7f768401c920 comp rx=0 tx=0).stop 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 -- 172.21.15.37:0/3809431022 shutdown_connections 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c15fde0 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 --2- 172.21.15.37:0/3809431022 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c06b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 -- 172.21.15.37:0/3809431022 >> 172.21.15.37:0/3809431022 conn(0x7f768c0d2470 msgr2=0x7f768c0d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 -- 172.21.15.37:0/3809431022 shutdown_connections 2023-07-09T22:02:13.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.733+0000 7f76940bd640 1 -- 172.21.15.37:0/3809431022 wait complete. 2023-07-09T22:02:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 Processor -- start 2023-07-09T22:02:13.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- start start 2023-07-09T22:02:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f768c06c470 0x7f768c15e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c1507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c15efc0 con 0x7f768c06c8c0 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c151cb0 con 0x7f768c06c470 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c15e720 con 0x7f768c15bb40 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55590/0 (socket says 172.21.15.37:55590) 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 -- 172.21.15.37:0/3154282943 learned_addr learned my addr 172.21.15.37:0/3154282943 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691e59640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f768c06c470 0x7f768c15e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f769265a640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c1507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 -- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 msgr2=0x7f768c1507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f768c15bb40 0x7f768c1507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 -- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f768c06c470 msgr2=0x7f768c15e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f768c06c470 0x7f768c15e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009a70 con 0x7f768c06c8c0 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f7691658640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c152140 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c520 tx=0x7f767c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0074e0 con 0x7f768c06c8c0 2023-07-09T22:02:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c007640 con 0x7f768c06c8c0 2023-07-09T22:02:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c15ea00 con 0x7f768c06c8c0 2023-07-09T22:02:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0049f0 con 0x7f768c06c8c0 2023-07-09T22:02:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.737+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0ca880 con 0x7f768c06c8c0 2023-07-09T22:02:13.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f768c06cd40 con 0x7f768c06c8c0 2023-07-09T22:02:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f767c004b50 con 0x7f768c06c8c0 2023-07-09T22:02:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f76700663d0 0x7f7670068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f767c083080 con 0x7f768c06c8c0 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f767006ce80 0x7f767006f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f767006f980 con 0x7f767006ce80 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f767c085600 con 0x7f768c06c8c0 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f7691e59640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f76700663d0 0x7f7670068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f769265a640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f767006ce80 0x7f767006f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f769265a640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f767006ce80 0x7f767006f2b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.741+0000 7f7691e59640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f76700663d0 0x7f7670068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f768c0cdaa0 tx=0x7f7688008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.745+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== osd.3 v2:172.21.15.37:6824/1042910606 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f767006f980 con 0x7f767006ce80 2023-07-09T22:02:13.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 --> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f768c0703e0 con 0x7f767006ce80 2023-07-09T22:02:13.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76827fc640 1 -- 172.21.15.37:0/3154282943 <== osd.3 v2:172.21.15.37:6824/1042910606 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f76840a5900 con 0x7f767006ce80 2023-07-09T22:02:13.758 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:13.758 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:13.759 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:13.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f767006ce80 msgr2=0x7f767006f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:6824/1042910606,v1:172.21.15.37:6825/1042910606] conn(0x7f767006ce80 0x7f767006f2b0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f76700663d0 msgr2=0x7f7670068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f76700663d0 0x7f7670068880 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f768c0cdaa0 tx=0x7f7688008040 comp rx=0 tx=0).stop 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 msgr2=0x7f768c152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 --2- 172.21.15.37:0/3154282943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f768c06c8c0 0x7f768c152140 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f767c00c520 tx=0x7f767c00c9e0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f769265a640 1 -- 172.21.15.37:0/3154282943 reap_dead start 2023-07-09T22:02:13.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 shutdown_connections 2023-07-09T22:02:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 >> 172.21.15.37:0/3154282943 conn(0x7f768c0d2470 msgr2=0x7f768c0c7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 shutdown_connections 2023-07-09T22:02:13.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.757+0000 7f76940bd640 1 -- 172.21.15.37:0/3154282943 wait complete. 2023-07-09T22:02:13.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-07-09T22:02:13.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.917+0000 7f46b9911640 1 Processor -- start 2023-07-09T22:02:13.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 -- start start 2023-07-09T22:02:13.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 0x7f46b406cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b406cff0 0x7f46b406fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b409c9d0 con 0x7f46b415bd40 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b409c120 con 0x7f46b406cff0 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b9911640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b415c110 con 0x7f46b40b08d0 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b406cff0 0x7f46b406fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46b406cff0 0x7f46b406fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55596/0 (socket says 172.21.15.37:55596) 2023-07-09T22:02:13.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 -- 172.21.15.37:0/250816281 learned_addr learned my addr 172.21.15.37:0/250816281 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46abfff640 1 --2- 172.21.15.37:0/250816281 >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 0x7f46b406cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 -- 172.21.15.37:0/250816281 >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 msgr2=0x7f46b406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 --2- 172.21.15.37:0/250816281 >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 0x7f46b406cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 -- 172.21.15.37:0/250816281 >> v1:172.21.15.119:6789/0 conn(0x7f46b415bd40 legacy=0x7f46b4099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46b37fe640 1 -- 172.21.15.37:0/250816281 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b40b0dd0 con 0x7f46b406cff0 2023-07-09T22:02:13.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.921+0000 7f46abfff640 1 --2- 172.21.15.37:0/250816281 >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 0x7f46b406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:13.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b37fe640 1 --2- 172.21.15.37:0/250816281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b406cff0 0x7f46b406fa40 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f46b406b700 tx=0x7f46ac01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a03c6ff53ed553a server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b27fc640 1 -- 172.21.15.37:0/250816281 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0a56d0 con 0x7f46b406cff0 2023-07-09T22:02:13.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b27fc640 1 -- 172.21.15.37:0/250816281 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0a5830 con 0x7f46b406cff0 2023-07-09T22:02:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b27fc640 1 -- 172.21.15.37:0/250816281 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0a5bc0 con 0x7f46b406cff0 2023-07-09T22:02:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- 172.21.15.37:0/250816281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b406cff0 msgr2=0x7f46b406fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 --2- 172.21.15.37:0/250816281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b406cff0 0x7f46b406fa40 secure :-1 s=READY pgs=2172 cs=0 l=1 rev1=1 crypto rx=0x7f46b406b700 tx=0x7f46ac01c900 comp rx=0 tx=0).stop 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- 172.21.15.37:0/250816281 shutdown_connections 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 --2- 172.21.15.37:0/250816281 >> v2:172.21.15.119:3300/0 conn(0x7f46b40b08d0 0x7f46b406cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 --2- 172.21.15.37:0/250816281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b406cff0 0x7f46b406fa40 unknown :-1 s=CLOSED pgs=2172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- 172.21.15.37:0/250816281 >> 172.21.15.37:0/250816281 conn(0x7f46b40694f0 msgr2=0x7f46b40698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- 172.21.15.37:0/250816281 shutdown_connections 2023-07-09T22:02:13.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- 172.21.15.37:0/250816281 wait complete. 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 Processor -- start 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.925+0000 7f46b9911640 1 -- start start 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b406cff0 0x7f46b4155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46b40b08d0 0x7f46b40ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40ab0b0 con 0x7f46b415bd40 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40ad350 con 0x7f46b406cff0 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b40ab340 con 0x7f46b40b08d0 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55608/0 (socket says 172.21.15.37:55608) 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 -- 172.21.15.37:0/656172972 learned_addr learned my addr 172.21.15.37:0/656172972 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b2ffd640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b406cff0 0x7f46b4155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46abfff640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46b40b08d0 0x7f46b40ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 -- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46b40b08d0 msgr2=0x7f46b40ac2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46b40b08d0 0x7f46b40ac2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 -- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b406cff0 msgr2=0x7f46b4155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b406cff0 0x7f46b4155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:13.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 -- 172.21.15.37:0/656172972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac009b30 con 0x7f46b415bd40 2023-07-09T22:02:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b37fe640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f46ac01a530 tx=0x7f46ac0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0b8670 con 0x7f46b415bd40 2023-07-09T22:02:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac0b87f0 con 0x7f46b415bd40 2023-07-09T22:02:13.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0b8ba0 con 0x7f46b415bd40 2023-07-09T22:02:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b40ab620 con 0x7f46b415bd40 2023-07-09T22:02:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b4155520 con 0x7f46b415bd40 2023-07-09T22:02:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b4066bc0 con 0x7f46b415bd40 2023-07-09T22:02:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.929+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f46ac0b8d00 con 0x7f46b415bd40 2023-07-09T22:02:13.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.933+0000 7f46b0ff9640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 0x7f4694068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.933+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f46ac11f220 con 0x7f46b415bd40 2023-07-09T22:02:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.933+0000 7f46b2ffd640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 0x7f4694068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:13.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.933+0000 7f46b2ffd640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 0x7f4694068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46b4096a40 tx=0x7f46a4009060 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:13.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:13.937+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46ac0ec610 con 0x7f46b415bd40 2023-07-09T22:02:14.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.089+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f46b40ab4b0 con 0x7f46940663a0 2023-07-09T22:02:14.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.089+0000 7f46b0ff9640 1 -- 172.21.15.37:0/656172972 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f46b40ab4b0 con 0x7f46940663a0 2023-07-09T22:02:14.093 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2023-07-09T22:02:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 msgr2=0x7f4694068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 0x7f4694068850 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f46b4096a40 tx=0x7f46a4009060 comp rx=0 tx=0).stop 2023-07-09T22:02:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 msgr2=0x7f46b40ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 secure :-1 s=READY pgs=2173 cs=0 l=1 rev1=1 crypto rx=0x7f46ac01a530 tx=0x7f46ac0196a0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 shutdown_connections 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46b415bd40 0x7f46b40ac810 unknown :-1 s=CLOSED pgs=2173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f46940663a0 0x7f4694068850 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f46b40b08d0 0x7f46b40ac2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 --2- 172.21.15.37:0/656172972 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f46b406cff0 0x7f46b4155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 >> 172.21.15.37:0/656172972 conn(0x7f46b40694f0 msgr2=0x7f46b4070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 shutdown_connections 2023-07-09T22:02:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.093+0000 7f46b9911640 1 -- 172.21.15.37:0/656172972 wait complete. 2023-07-09T22:02:14.114 INFO:tasks.ceph:Scrubbing osd.4 2023-07-09T22:02:14.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:14.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 Processor -- start 2023-07-09T22:02:14.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 -- start start 2023-07-09T22:02:14.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd65015bb40 0x7fd65006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 0x7fd65015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6500cd5a0 con 0x7fd65006c470 2023-07-09T22:02:14.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6500ced20 con 0x7fd65015bb40 2023-07-09T22:02:14.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd657a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6500cd880 con 0x7fd65006c8f0 2023-07-09T22:02:14.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd655ff3640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 0x7fd65015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd6557f2640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fd65015bb40 0x7fd65006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd654ff1640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7fd65006c470 0x7fd65015f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:35290/0 (socket says 172.21.15.37:35290) 2023-07-09T22:02:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd654ff1640 1 -- 172.21.15.37:0/268609269 learned_addr learned my addr 172.21.15.37:0/268609269 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:14.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd655ff3640 1 -- 172.21.15.37:0/268609269 >> v2:172.21.15.119:3300/0 conn(0x7fd65015bb40 msgr2=0x7fd65006b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd655ff3640 1 --2- 172.21.15.37:0/268609269 >> v2:172.21.15.119:3300/0 conn(0x7fd65015bb40 0x7fd65006b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd655ff3640 1 -- 172.21.15.37:0/268609269 >> v1:172.21.15.119:6789/0 conn(0x7fd65006c470 legacy=0x7fd65015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd647fff640 1 -- 172.21.15.37:0/268609269 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228993876 0 0) 0x7fd6500cd5a0 con 0x7fd65006c470 2023-07-09T22:02:14.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.261+0000 7fd655ff3640 1 -- 172.21.15.37:0/268609269 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65006cd70 con 0x7fd65006c8f0 2023-07-09T22:02:14.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd655ff3640 1 --2- 172.21.15.37:0/268609269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 0x7fd65015fde0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f60012b12599c8a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd647fff640 1 -- 172.21.15.37:0/268609269 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480a59e0 con 0x7fd65006c8f0 2023-07-09T22:02:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd647fff640 1 -- 172.21.15.37:0/268609269 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6480a5b40 con 0x7fd65006c8f0 2023-07-09T22:02:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd647fff640 1 -- 172.21.15.37:0/268609269 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6480ad440 con 0x7fd65006c8f0 2023-07-09T22:02:14.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 -- 172.21.15.37:0/268609269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 msgr2=0x7fd65015fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 --2- 172.21.15.37:0/268609269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 0x7fd65015fde0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd648009d90 tx=0x7fd64801c920 comp rx=0 tx=0).stop 2023-07-09T22:02:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 -- 172.21.15.37:0/268609269 shutdown_connections 2023-07-09T22:02:14.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 --2- 172.21.15.37:0/268609269 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65006c8f0 0x7fd65015fde0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 --2- 172.21.15.37:0/268609269 >> v2:172.21.15.119:3300/0 conn(0x7fd65015bb40 0x7fd65006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 -- 172.21.15.37:0/268609269 >> 172.21.15.37:0/268609269 conn(0x7fd6500d2470 msgr2=0x7fd6500d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 -- 172.21.15.37:0/268609269 shutdown_connections 2023-07-09T22:02:14.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.265+0000 7fd657a56640 1 -- 172.21.15.37:0/268609269 wait complete. 2023-07-09T22:02:14.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 Processor -- start 2023-07-09T22:02:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- start start 2023-07-09T22:02:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 0x7fd65015fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65006c8f0 0x7fd650148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65015bb40 0x7fd65014bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd650152200 con 0x7fd65006c470 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65015ff80 con 0x7fd65006c8f0 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd65014c940 con 0x7fd65015bb40 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 0x7fd65015fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 0x7fd65015fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55614/0 (socket says 172.21.15.37:55614) 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 -- 172.21.15.37:0/1985808313 learned_addr learned my addr 172.21.15.37:0/1985808313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd654ff1640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65006c8f0 0x7fd650148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd655ff3640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65015bb40 0x7fd65014bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 -- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65015bb40 msgr2=0x7fd65014bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fd65015bb40 0x7fd65014bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 -- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65006c8f0 msgr2=0x7fd650148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fd65006c8f0 0x7fd650148100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd648009a70 con 0x7fd65006c470 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd6557f2640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 0x7fd65015fa40 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e8a0 tx=0x7fd64c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c009510 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64c00c940 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64c00ccb0 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6501518d0 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.269+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd650151e90 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6500703e0 con 0x7fd65006c470 2023-07-09T22:02:14.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fd64c013470 con 0x7fd65006c470 2023-07-09T22:02:14.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd6340663a0 0x7fd634068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fd64c084360 con 0x7fd65006c470 2023-07-09T22:02:14.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7fd63406ce50 0x7fd63406f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd63406f950 con 0x7fd63406ce50 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd64c0846d0 con 0x7fd65006c470 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd654ff1640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd6340663a0 0x7fd634068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd655ff3640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7fd63406ce50 0x7fd63406f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd654ff1640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd6340663a0 0x7fd634068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd650154960 tx=0x7fd640007c10 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.273+0000 7fd655ff3640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7fd63406ce50 0x7fd63406f280 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.277+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== osd.4 v2:172.21.15.119:6808/1723829532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd63406f950 con 0x7fd63406ce50 2023-07-09T22:02:14.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 --> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd650070100 con 0x7fd63406ce50 2023-07-09T22:02:14.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd645ffb640 1 -- 172.21.15.37:0/1985808313 <== osd.4 v2:172.21.15.119:6808/1723829532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd6480a57e0 con 0x7fd63406ce50 2023-07-09T22:02:14.291 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:14.292 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:14.292 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7fd63406ce50 msgr2=0x7fd63406f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6808/1723829532,v1:172.21.15.119:6809/1723829532] conn(0x7fd63406ce50 0x7fd63406f280 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd6340663a0 msgr2=0x7fd634068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fd6340663a0 0x7fd634068850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd650154960 tx=0x7fd640007c10 comp rx=0 tx=0).stop 2023-07-09T22:02:14.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 msgr2=0x7fd65015fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 --2- 172.21.15.37:0/1985808313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65006c470 0x7fd65015fa40 secure :-1 s=READY pgs=2174 cs=0 l=1 rev1=1 crypto rx=0x7fd64c00e8a0 tx=0x7fd64c00eca0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd655ff3640 1 -- 172.21.15.37:0/1985808313 reap_dead start 2023-07-09T22:02:14.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 shutdown_connections 2023-07-09T22:02:14.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 >> 172.21.15.37:0/1985808313 conn(0x7fd6500d2470 msgr2=0x7fd6500d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 shutdown_connections 2023-07-09T22:02:14.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.289+0000 7fd657a56640 1 -- 172.21.15.37:0/1985808313 wait complete. 2023-07-09T22:02:14.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-07-09T22:02:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.449+0000 7f6ef6a19640 1 Processor -- start 2023-07-09T22:02:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6ef6a19640 1 -- start start 2023-07-09T22:02:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6ef6a19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f6ef015bd40 0x7f6ef0099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6ef6a19640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef009c9d0 con 0x7f6ef00b08d0 2023-07-09T22:02:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6ef6a19640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ef009c120 con 0x7f6ef006fa40 2023-07-09T22:02:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6ef6a19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ef015c110 con 0x7f6ef015bd40 2023-07-09T22:02:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eef7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6ef00b08d0 0x7f6ef006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54784/0 (socket says 172.21.15.37:54784) 2023-07-09T22:02:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eef7fe640 1 -- 172.21.15.37:0/745126059 learned_addr learned my addr 172.21.15.37:0/745126059 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:14.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeffff640 1 --2- 172.21.15.37:0/745126059 >> v2:172.21.15.119:3300/0 conn(0x7f6ef015bd40 0x7f6ef0099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091588220 0 0) 0x7f6ef009c9d0 con 0x7f6ef00b08d0 2023-07-09T22:02:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ed8003530 con 0x7f6ef00b08d0 2023-07-09T22:02:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785207474 0 0) 0x7f6ef009c120 con 0x7f6ef006fa40 2023-07-09T22:02:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef009c9d0 con 0x7f6ef006fa40 2023-07-09T22:02:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeffff640 1 -- 172.21.15.37:0/745126059 >> v1:172.21.15.119:6789/0 conn(0x7f6ef006fa40 legacy=0x7f6ef015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeffff640 1 -- 172.21.15.37:0/745126059 >> v1:172.21.15.37:6789/0 conn(0x7f6ef00b08d0 legacy=0x7f6ef006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2643636939 0 0) 0x7f6ed8003530 con 0x7f6ef00b08d0 2023-07-09T22:02:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.453+0000 7f6eeffff640 1 -- 172.21.15.37:0/745126059 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef00b0dd0 con 0x7f6ef015bd40 2023-07-09T22:02:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6eeffff640 1 --2- 172.21.15.37:0/745126059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef015bd40 0x7f6ef0099a50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee001c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9c64a0f8b3a1251 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee4001680 con 0x7f6ef015bd40 2023-07-09T22:02:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee00a7050 con 0x7f6ef015bd40 2023-07-09T22:02:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6eeeffd640 1 -- 172.21.15.37:0/745126059 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00ab620 con 0x7f6ef015bd40 2023-07-09T22:02:14.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 -- 172.21.15.37:0/745126059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef015bd40 msgr2=0x7f6ef0099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/745126059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef015bd40 0x7f6ef0099a50 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee001c310 comp rx=0 tx=0).stop 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 -- 172.21.15.37:0/745126059 shutdown_connections 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/745126059 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef015bd40 0x7f6ef0099a50 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 -- 172.21.15.37:0/745126059 >> 172.21.15.37:0/745126059 conn(0x7f6ef00694f0 msgr2=0x7f6ef00698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 -- 172.21.15.37:0/745126059 shutdown_connections 2023-07-09T22:02:14.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.457+0000 7f6ef6a19640 1 -- 172.21.15.37:0/745126059 wait complete. 2023-07-09T22:02:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 Processor -- start 2023-07-09T22:02:14.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- start start 2023-07-09T22:02:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 0x7f6ef015e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef015bd40 0x7f6ef00aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015b300 con 0x7f6ef006fa40 2023-07-09T22:02:14.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef0158f20 con 0x7f6ef00b08d0 2023-07-09T22:02:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef015b550 con 0x7f6ef015bd40 2023-07-09T22:02:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55624/0 (socket says 172.21.15.37:55624) 2023-07-09T22:02:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 -- 172.21.15.37:0/2953648361 learned_addr learned my addr 172.21.15.37:0/2953648361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:14.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 0x7f6ef015e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 -- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef015bd40 msgr2=0x7f6ef00aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef015bd40 0x7f6ef00aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 -- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 msgr2=0x7f6ef015e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 0x7f6ef015e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 -- 172.21.15.37:0/2953648361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee0009420 con 0x7f6ef006fa40 2023-07-09T22:02:14.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 0x7f6ef015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:14.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eeffff640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee00190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0004020 con 0x7f6ef006fa40 2023-07-09T22:02:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee0004180 con 0x7f6ef006fa40 2023-07-09T22:02:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef01588d0 con 0x7f6ef006fa40 2023-07-09T22:02:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee00044f0 con 0x7f6ef006fa40 2023-07-09T22:02:14.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef015ea10 con 0x7f6ef006fa40 2023-07-09T22:02:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.461+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef0099b70 con 0x7f6ef006fa40 2023-07-09T22:02:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.465+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f6ee00b2040 con 0x7f6ef006fa40 2023-07-09T22:02:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.465+0000 7f6eecff9640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 0x7f6edc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.465+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f6ee011df00 con 0x7f6ef006fa40 2023-07-09T22:02:14.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.465+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 0x7f6edc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.465+0000 7f6eef7fe640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 0x7f6edc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00995b0 tx=0x7f6ee4009040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.469+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6ee00eb0a0 con 0x7f6ef006fa40 2023-07-09T22:02:14.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6ef0159060 con 0x7f6edc0663a0 2023-07-09T22:02:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6eecff9640 1 -- 172.21.15.37:0/2953648361 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6ee40058e0 con 0x7f6edc0663a0 2023-07-09T22:02:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 4 to deep-scrub 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 msgr2=0x7f6edc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 0x7f6edc068850 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00995b0 tx=0x7f6ee4009040 comp rx=0 tx=0).stop 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 msgr2=0x7f6ef00afed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097c0 tx=0x7f6ee00190b0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 shutdown_connections 2023-07-09T22:02:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f6edc0663a0 0x7f6edc068850 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f6ef015bd40 0x7f6ef00aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f6ef00b08d0 0x7f6ef015e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 --2- 172.21.15.37:0/2953648361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ef006fa40 0x7f6ef00afed0 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 >> 172.21.15.37:0/2953648361 conn(0x7f6ef00694f0 msgr2=0x7f6ef0098660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 shutdown_connections 2023-07-09T22:02:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.625+0000 7f6ef6a19640 1 -- 172.21.15.37:0/2953648361 wait complete. 2023-07-09T22:02:14.648 INFO:tasks.ceph:Scrubbing osd.5 2023-07-09T22:02:14.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 Processor -- start 2023-07-09T22:02:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 -- start start 2023-07-09T22:02:14.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16140cd5f0 0x7f161406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f161415c3f0 0x7f1614158d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140aec60 0x7f16140af100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140af640 con 0x7f16140cd5f0 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16140cace0 con 0x7f161415c3f0 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f161c00b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1614159c50 con 0x7f16140aec60 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f1619da7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16140cd5f0 0x7f161406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f1619da7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16140cd5f0 0x7f161406d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55626/0 (socket says 172.21.15.37:55626) 2023-07-09T22:02:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.793+0000 7f1619da7640 1 -- 172.21.15.37:0/4250490275 learned_addr learned my addr 172.21.15.37:0/4250490275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f161a5a8640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140aec60 0x7f16140af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f16195a6640 1 --2- 172.21.15.37:0/4250490275 >> v2:172.21.15.119:3300/0 conn(0x7f161415c3f0 0x7f1614158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 -- 172.21.15.37:0/4250490275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140aec60 msgr2=0x7f16140af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140aec60 0x7f16140af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 -- 172.21.15.37:0/4250490275 >> v2:172.21.15.119:3300/0 conn(0x7f161415c3f0 msgr2=0x7f1614158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 --2- 172.21.15.37:0/4250490275 >> v2:172.21.15.119:3300/0 conn(0x7f161415c3f0 0x7f1614158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 -- 172.21.15.37:0/4250490275 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161406dac0 con 0x7f16140cd5f0 2023-07-09T22:02:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1619da7640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140cd5f0 0x7f161406d580 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f161406a320 tx=0x7f161001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1c2d0d5f33b169 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1618da5640 1 -- 172.21.15.37:0/4250490275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100aa5f0 con 0x7f16140cd5f0 2023-07-09T22:02:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1618da5640 1 -- 172.21.15.37:0/4250490275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100aa750 con 0x7f16140cd5f0 2023-07-09T22:02:14.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.797+0000 7f1618da5640 1 -- 172.21.15.37:0/4250490275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100aaae0 con 0x7f16140cd5f0 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- 172.21.15.37:0/4250490275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140cd5f0 msgr2=0x7f161406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140cd5f0 0x7f161406d580 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7f161406a320 tx=0x7f161001c4d0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- 172.21.15.37:0/4250490275 shutdown_connections 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140aec60 0x7f16140af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- 172.21.15.37:0/4250490275 >> v2:172.21.15.119:3300/0 conn(0x7f161415c3f0 0x7f1614158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- 172.21.15.37:0/4250490275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140cd5f0 0x7f161406d580 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- 172.21.15.37:0/4250490275 >> 172.21.15.37:0/4250490275 conn(0x7f16140afdb0 msgr2=0x7f16140b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- 172.21.15.37:0/4250490275 shutdown_connections 2023-07-09T22:02:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- 172.21.15.37:0/4250490275 wait complete. 2023-07-09T22:02:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 Processor -- start 2023-07-09T22:02:14.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- start start 2023-07-09T22:02:14.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 0x7f1614157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140cd5f0 0x7f1614164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f161415c3f0 0x7f16140ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614162340 con 0x7f16140aec60 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1614157f70 con 0x7f161415c3f0 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161c00b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1614161d80 con 0x7f16140cd5f0 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 0x7f1614157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 0x7f1614157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55634/0 (socket says 172.21.15.37:55634) 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 -- 172.21.15.37:0/1419414796 learned_addr learned my addr 172.21.15.37:0/1419414796 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:14.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161a5a8640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f161415c3f0 0x7f16140ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f16195a6640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140cd5f0 0x7f1614164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 -- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140cd5f0 msgr2=0x7f1614164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140cd5f0 0x7f1614164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 -- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f161415c3f0 msgr2=0x7f16140ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f161415c3f0 0x7f16140ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f1619da7640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16100094d0 con 0x7f16140aec60 2023-07-09T22:02:14.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f16195a6640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16140cd5f0 0x7f1614164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:14.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.801+0000 7f161a5a8640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f161415c3f0 0x7f16140ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:14.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f1619da7640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 0x7f1614157a30 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f16100ac040 tx=0x7f161001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100b3800 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16100b3980 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16100b3d30 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1614162060 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1614163d70 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f161406d060 con 0x7f16140aec60 2023-07-09T22:02:14.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f16100bc390 con 0x7f16140aec60 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f80663a0 0x7f15f8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f16100a7070 con 0x7f16140aec60 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7f15f806ce50 0x7f15f806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15f806f950 con 0x7f15f806ce50 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f161011eb90 con 0x7f16140aec60 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.805+0000 7f16195a6640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f80663a0 0x7f15f8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.809+0000 7f161a5a8640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7f15f806ce50 0x7f15f806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.809+0000 7f16195a6640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f80663a0 0x7f15f8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16141f7130 tx=0x7f1604008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.809+0000 7f161a5a8640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7f15f806ce50 0x7f15f806f280 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.809+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== osd.5 v2:172.21.15.119:6821/2030521603 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f15f806f950 con 0x7f15f806ce50 2023-07-09T22:02:14.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 --> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f161406cd80 con 0x7f15f806ce50 2023-07-09T22:02:14.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f160a7fc640 1 -- 172.21.15.37:0/1419414796 <== osd.5 v2:172.21.15.119:6821/2030521603 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f160c009b90 con 0x7f15f806ce50 2023-07-09T22:02:14.824 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:14.824 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:14.825 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7f15f806ce50 msgr2=0x7f15f806f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6821/2030521603,v1:172.21.15.119:6823/2030521603] conn(0x7f15f806ce50 0x7f15f806f280 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f80663a0 msgr2=0x7f15f8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f80663a0 0x7f15f8068850 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f16141f7130 tx=0x7f1604008040 comp rx=0 tx=0).stop 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 msgr2=0x7f1614157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 --2- 172.21.15.37:0/1419414796 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16140aec60 0x7f1614157a30 secure :-1 s=READY pgs=2178 cs=0 l=1 rev1=1 crypto rx=0x7f16100ac040 tx=0x7f161001ad10 comp rx=0 tx=0).stop 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161a5a8640 1 -- 172.21.15.37:0/1419414796 reap_dead start 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 shutdown_connections 2023-07-09T22:02:14.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 >> 172.21.15.37:0/1419414796 conn(0x7f16140afdb0 msgr2=0x7f16140cdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 shutdown_connections 2023-07-09T22:02:14.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.821+0000 7f161c00b640 1 -- 172.21.15.37:0/1419414796 wait complete. 2023-07-09T22:02:14.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-07-09T22:02:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 Processor -- start 2023-07-09T22:02:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 -- start start 2023-07-09T22:02:14.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c0b08d0 0x7fa01c06cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa01c06cff0 0x7fa01c06fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c09c9d0 con 0x7fa01c15bd40 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c09c120 con 0x7fa01c06cff0 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa02167b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c15c110 con 0x7fa01c0b08d0 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa01c15bd40 0x7fa01c099a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54800/0 (socket says 172.21.15.37:54800) 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01affd640 1 -- 172.21.15.37:0/3994105804 learned_addr learned my addr 172.21.15.37:0/3994105804 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:14.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01b7fe640 1 --2- 172.21.15.37:0/3994105804 >> v2:172.21.15.119:3300/0 conn(0x7fa01c06cff0 0x7fa01c06fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa013fff640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c0b08d0 0x7fa01c06cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1439997480 0 0) 0x7fa01c09c9d0 con 0x7fa01c15bd40 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa008003530 con 0x7fa01c15bd40 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374407420 0 0) 0x7fa008003530 con 0x7fa01c15bd40 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01b7fe640 1 -- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c0b08d0 msgr2=0x7fa01c06cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01b7fe640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c0b08d0 0x7fa01c06cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01b7fe640 1 -- 172.21.15.37:0/3994105804 >> v1:172.21.15.37:6789/0 conn(0x7fa01c15bd40 legacy=0x7fa01c099a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.985+0000 7fa01b7fe640 1 -- 172.21.15.37:0/3994105804 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0b0dd0 con 0x7fa01c06cff0 2023-07-09T22:02:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa01b7fe640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c06cff0 0x7fa01c06fa40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c6ce1786f10510 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c001680 con 0x7fa01c06cff0 2023-07-09T22:02:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0140a6500 con 0x7fa01c06cff0 2023-07-09T22:02:14.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa01a7fc640 1 -- 172.21.15.37:0/3994105804 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0140a6890 con 0x7fa01c06cff0 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 -- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c06cff0 msgr2=0x7fa01c06fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c06cff0 0x7fa01c06fa40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fa014009d90 tx=0x7fa01401c7e0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 -- 172.21.15.37:0/3994105804 shutdown_connections 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c06cff0 0x7fa01c06fa40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 --2- 172.21.15.37:0/3994105804 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c0b08d0 0x7fa01c06cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:14.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 -- 172.21.15.37:0/3994105804 >> 172.21.15.37:0/3994105804 conn(0x7fa01c0694f0 msgr2=0x7fa01c0698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 -- 172.21.15.37:0/3994105804 shutdown_connections 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.989+0000 7fa02167b640 1 -- 172.21.15.37:0/3994105804 wait complete. 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 Processor -- start 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- start start 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c0b08d0 0x7fa01c15c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c15bd40 0x7fa01c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ad1e0 con 0x7fa01c06cff0 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c150000 con 0x7fa01c0b08d0 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ac5d0 con 0x7fa01c15bd40 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55642/0 (socket says 172.21.15.37:55642) 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 -- 172.21.15.37:0/1338386929 learned_addr learned my addr 172.21.15.37:0/1338386929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:14.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 -- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c15bd40 msgr2=0x7fa01c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c15bd40 0x7fa01c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 -- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c0b08d0 msgr2=0x7fa01c15c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c0b08d0 0x7fa01c15c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 -- 172.21.15.37:0/1338386929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009a70 con 0x7fa01c06cff0 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa01affd640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c7b0 tx=0x7fa00c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c005ae0 con 0x7fa01c06cff0 2023-07-09T22:02:15.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa00c005c40 con 0x7fa01c06cff0 2023-07-09T22:02:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00c007070 con 0x7fa01c06cff0 2023-07-09T22:02:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c0ac8b0 con 0x7fa01c06cff0 2023-07-09T22:02:15.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.993+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c0ace70 con 0x7fa01c06cff0 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.997+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c066bc0 con 0x7fa01c06cff0 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.997+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa00c0071f0 con 0x7fa01c06cff0 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.997+0000 7fa0137fe640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.997+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fa00c083c70 con 0x7fa01c06cff0 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:14.997+0000 7fa013fff640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.001+0000 7fa013fff640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 0x7f9ffc068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa01c06c780 tx=0x7fa004009520 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.001+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa00c051060 con 0x7fa01c06cff0 2023-07-09T22:02:15.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.157+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa01c070390 con 0x7f9ffc0663a0 2023-07-09T22:02:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.157+0000 7fa0137fe640 1 -- 172.21.15.37:0/1338386929 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0040096b0 con 0x7f9ffc0663a0 2023-07-09T22:02:15.160 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 5 to deep-scrub 2023-07-09T22:02:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 msgr2=0x7f9ffc068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 0x7f9ffc068850 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa01c06c780 tx=0x7fa004009520 comp rx=0 tx=0).stop 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 msgr2=0x7fa01c14fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c7b0 tx=0x7fa00c00cc70 comp rx=0 tx=0).stop 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 shutdown_connections 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f9ffc0663a0 0x7f9ffc068850 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa01c15bd40 0x7fa01c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa01c0b08d0 0x7fa01c15c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 --2- 172.21.15.37:0/1338386929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa01c06cff0 0x7fa01c14fac0 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 >> 172.21.15.37:0/1338386929 conn(0x7fa01c0694f0 msgr2=0x7fa01c070dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 shutdown_connections 2023-07-09T22:02:15.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.161+0000 7fa02167b640 1 -- 172.21.15.37:0/1338386929 wait complete. 2023-07-09T22:02:15.181 INFO:tasks.ceph:Scrubbing osd.6 2023-07-09T22:02:15.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:15.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 Processor -- start 2023-07-09T22:02:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 -- start start 2023-07-09T22:02:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 0x7fa81006b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 0x7fa81006c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81015f6d0 0x7fa81015fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa81006ce00 con 0x7fa81015f6d0 2023-07-09T22:02:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8100cd5a0 con 0x7fa81006c470 2023-07-09T22:02:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.325+0000 7fa814819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8100cd880 con 0x7fa81015bb40 2023-07-09T22:02:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81015f6d0 0x7fa81015fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa81015f6d0 0x7fa81015fb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55658/0 (socket says 172.21.15.37:55658) 2023-07-09T22:02:15.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 -- 172.21.15.37:0/2430315671 learned_addr learned my addr 172.21.15.37:0/2430315671 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:15.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa807fff640 1 --2- 172.21.15.37:0/2430315671 >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 0x7fa81006c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80e59c640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 0x7fa81006b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 -- 172.21.15.37:0/2430315671 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 msgr2=0x7fa81006b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:15.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 0x7fa81006b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 -- 172.21.15.37:0/2430315671 >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 msgr2=0x7fa81006c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:15.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/2430315671 >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 0x7fa81006c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 -- 172.21.15.37:0/2430315671 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81015bf10 con 0x7fa81015f6d0 2023-07-09T22:02:15.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa807fff640 1 --2- 172.21.15.37:0/2430315671 >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 0x7fa81006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:15.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80e59c640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 0x7fa81006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81015f6d0 0x7fa81015fb50 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fa8100d3090 tx=0x7fa80801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4628af8d19d0152 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80dd9b640 1 -- 172.21.15.37:0/2430315671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8100ced00 con 0x7fa81015f6d0 2023-07-09T22:02:15.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80dd9b640 1 -- 172.21.15.37:0/2430315671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8080a5820 con 0x7fa81015f6d0 2023-07-09T22:02:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.329+0000 7fa80dd9b640 1 -- 172.21.15.37:0/2430315671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8080a5bb0 con 0x7fa81015f6d0 2023-07-09T22:02:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- 172.21.15.37:0/2430315671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81015f6d0 msgr2=0x7fa81015fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81015f6d0 0x7fa81015fb50 secure :-1 s=READY pgs=2181 cs=0 l=1 rev1=1 crypto rx=0x7fa8100d3090 tx=0x7fa80801c9a0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- 172.21.15.37:0/2430315671 shutdown_connections 2023-07-09T22:02:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81015f6d0 0x7fa81015fb50 unknown :-1 s=CLOSED pgs=2181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- 172.21.15.37:0/2430315671 >> v2:172.21.15.119:3300/0 conn(0x7fa81006c470 0x7fa81006c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- 172.21.15.37:0/2430315671 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015bb40 0x7fa81006b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- 172.21.15.37:0/2430315671 >> 172.21.15.37:0/2430315671 conn(0x7fa8100d2470 msgr2=0x7fa8100d2870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- 172.21.15.37:0/2430315671 shutdown_connections 2023-07-09T22:02:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- 172.21.15.37:0/2430315671 wait complete. 2023-07-09T22:02:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 Processor -- start 2023-07-09T22:02:15.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- start start 2023-07-09T22:02:15.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 0x7fa81014c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81015bb40 0x7fa81014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015f6d0 0x7fa81014a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101f5b10 con 0x7fa81006c470 2023-07-09T22:02:15.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa810152dd0 con 0x7fa81015bb40 2023-07-09T22:02:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa814819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8101530b0 con 0x7fa81015f6d0 2023-07-09T22:02:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 0x7fa81014c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 0x7fa81014c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55666/0 (socket says 172.21.15.37:55666) 2023-07-09T22:02:15.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 -- 172.21.15.37:0/237045101 learned_addr learned my addr 172.21.15.37:0/237045101 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa807fff640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81015bb40 0x7fa81014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015f6d0 0x7fa81014a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 -- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015f6d0 msgr2=0x7fa81014a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fa81015f6d0 0x7fa81014a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 -- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81015bb40 msgr2=0x7fa81014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81015bb40 0x7fa81014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa80e59c640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa808009b30 con 0x7fa81006c470 2023-07-09T22:02:15.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.333+0000 7fa807fff640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fa81015bb40 0x7fa81014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa80e59c640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 0x7fa81014c000 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c7f0 tx=0x7fa80000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800007820 con 0x7fa81006c470 2023-07-09T22:02:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa800007980 con 0x7fa81006c470 2023-07-09T22:02:15.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8101f5d60 con 0x7fa81006c470 2023-07-09T22:02:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa800007d30 con 0x7fa81006c470 2023-07-09T22:02:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa81014bd00 con 0x7fa81006c470 2023-07-09T22:02:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8101604a0 con 0x7fa81006c470 2023-07-09T22:02:15.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fa8000113f0 con 0x7fa81006c470 2023-07-09T22:02:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa7f00663a0 0x7fa7f0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fa800084350 con 0x7fa81006c470 2023-07-09T22:02:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fa7f006ce50 0x7fa7f006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa7f006f950 con 0x7fa7f006ce50 2023-07-09T22:02:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa800086930 con 0x7fa81006c470 2023-07-09T22:02:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa807fff640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa7f00663a0 0x7fa7f0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.337+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fa7f006ce50 0x7fa7f006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.341+0000 7fa807fff640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa7f00663a0 0x7fa7f0068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8100d17f0 tx=0x7fa7f8008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.341+0000 7fa80ed9d640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fa7f006ce50 0x7fa7f006f280 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.341+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== osd.6 v2:172.21.15.119:6800/1695629895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa7f006f950 con 0x7fa7f006ce50 2023-07-09T22:02:15.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 --> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8100703e0 con 0x7fa7f006ce50 2023-07-09T22:02:15.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa806ffd640 1 -- 172.21.15.37:0/237045101 <== osd.6 v2:172.21.15.119:6800/1695629895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa8080a5990 con 0x7fa7f006ce50 2023-07-09T22:02:15.356 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:15.357 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:15.357 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:15.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fa7f006ce50 msgr2=0x7fa7f006f280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6800/1695629895,v1:172.21.15.119:6801/1695629895] conn(0x7fa7f006ce50 0x7fa7f006f280 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa7f00663a0 msgr2=0x7fa7f0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fa7f00663a0 0x7fa7f0068850 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa8100d17f0 tx=0x7fa7f8008040 comp rx=0 tx=0).stop 2023-07-09T22:02:15.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 msgr2=0x7fa81014c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 --2- 172.21.15.37:0/237045101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa81006c470 0x7fa81014c000 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7fa80000c7f0 tx=0x7fa80000ccb0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa80ed9d640 1 -- 172.21.15.37:0/237045101 reap_dead start 2023-07-09T22:02:15.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 shutdown_connections 2023-07-09T22:02:15.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 >> 172.21.15.37:0/237045101 conn(0x7fa8100d2470 msgr2=0x7fa8100c72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 shutdown_connections 2023-07-09T22:02:15.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.353+0000 7fa814819640 1 -- 172.21.15.37:0/237045101 wait complete. 2023-07-09T22:02:15.376 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-07-09T22:02:15.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.517+0000 7efc0d337640 1 Processor -- start 2023-07-09T22:02:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.517+0000 7efc0d337640 1 -- start start 2023-07-09T22:02:15.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc0d337640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 0x7efc08099a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc0d337640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0809c9d0 con 0x7efc0806fa40 2023-07-09T22:02:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc0d337640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc0809c120 con 0x7efc080b08d0 2023-07-09T22:02:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc0d337640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815c110 con 0x7efc0815bd40 2023-07-09T22:02:15.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc077fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc0806fa40 0x7efc0815f810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54814/0 (socket says 172.21.15.37:54814) 2023-07-09T22:02:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc077fe640 1 -- 172.21.15.37:0/797174640 learned_addr learned my addr 172.21.15.37:0/797174640 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:15.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc06ffd640 1 --2- 172.21.15.37:0/797174640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 0x7efc08099a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032158448 0 0) 0x7efc0809c9d0 con 0x7efc0806fa40 2023-07-09T22:02:15.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efbf4003530 con 0x7efc0806fa40 2023-07-09T22:02:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 <== mon.1 v1:172.21.15.119:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566885470 0 0) 0x7efc0809c120 con 0x7efc080b08d0 2023-07-09T22:02:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 --> v1:172.21.15.119:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc0809c9d0 con 0x7efc080b08d0 2023-07-09T22:02:15.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc06ffd640 1 -- 172.21.15.37:0/797174640 >> v1:172.21.15.119:6789/0 conn(0x7efc080b08d0 legacy=0x7efc0806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc06ffd640 1 -- 172.21.15.37:0/797174640 >> v1:172.21.15.37:6789/0 conn(0x7efc0806fa40 legacy=0x7efc0815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.521+0000 7efc06ffd640 1 -- 172.21.15.37:0/797174640 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc080b0dd0 con 0x7efc0815bd40 2023-07-09T22:02:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc06ffd640 1 --2- 172.21.15.37:0/797174640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 0x7efc08099a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097f0 tx=0x7efbf801c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64f679e04f9e8a8e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 <== mon.2 v2:172.21.15.119:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab600 con 0x7efc0815bd40 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 <== mon.2 v2:172.21.15.119:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf80a7050 con 0x7efc0815bd40 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc067fc640 1 -- 172.21.15.37:0/797174640 <== mon.2 v2:172.21.15.119:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80ab960 con 0x7efc0815bd40 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 -- 172.21.15.37:0/797174640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 msgr2=0x7efc08099a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 --2- 172.21.15.37:0/797174640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 0x7efc08099a50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efbf80097f0 tx=0x7efbf801c430 comp rx=0 tx=0).stop 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 -- 172.21.15.37:0/797174640 shutdown_connections 2023-07-09T22:02:15.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 --2- 172.21.15.37:0/797174640 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0815bd40 0x7efc08099a50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 -- 172.21.15.37:0/797174640 >> 172.21.15.37:0/797174640 conn(0x7efc080694f0 msgr2=0x7efc080698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 -- 172.21.15.37:0/797174640 shutdown_connections 2023-07-09T22:02:15.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.525+0000 7efc0d337640 1 -- 172.21.15.37:0/797174640 wait complete. 2023-07-09T22:02:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 Processor -- start 2023-07-09T22:02:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- start start 2023-07-09T22:02:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 0x7efc080aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc080b08d0 0x7efc0815ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815f260 con 0x7efc0815bd40 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815d7c0 con 0x7efc080b08d0 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc0815e650 con 0x7efc0806fa40 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efbfffff640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc080b08d0 0x7efc0815ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc06ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 0x7efc080aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55678/0 (socket says 172.21.15.37:55678) 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc06ffd640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 0x7efc080aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3301/0 says I am v2:172.21.15.37:33464/0 (socket says 172.21.15.37:33464) 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 -- 172.21.15.37:0/3035838298 learned_addr learned my addr 172.21.15.37:0/3035838298 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 -- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 msgr2=0x7efc080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 0x7efc080aef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 -- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc080b08d0 msgr2=0x7efc0815ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc080b08d0 0x7efc0815ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 -- 172.21.15.37:0/3035838298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf8009420 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc077fe640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cad0 tx=0x7efc0000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ac30 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc0000ad90 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00012600 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc0815e930 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0815eef0 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.529+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0815f410 con 0x7efc0815bd40 2023-07-09T22:02:15.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.533+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7efc00012760 con 0x7efc0815bd40 2023-07-09T22:02:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.533+0000 7efbff7fe640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 0x7efbe8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.533+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7efc00083d20 con 0x7efc0815bd40 2023-07-09T22:02:15.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.533+0000 7efc06ffd640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 0x7efbe8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.533+0000 7efc06ffd640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 0x7efbe8068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad000 tx=0x7efbf80a6000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.537+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc0815f410 con 0x7efc0815bd40 2023-07-09T22:02:15.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.689+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7efc08099f90 con 0x7efbe80663a0 2023-07-09T22:02:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efbff7fe640 1 -- 172.21.15.37:0/3035838298 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7efbf80ba070 con 0x7efbe80663a0 2023-07-09T22:02:15.694 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 6 to deep-scrub 2023-07-09T22:02:15.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 msgr2=0x7efbe8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 0x7efbe8068850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efbf80ad000 tx=0x7efbf80a6000 comp rx=0 tx=0).stop 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 msgr2=0x7efc0815b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7efc0000cad0 tx=0x7efc0000cf90 comp rx=0 tx=0).stop 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 shutdown_connections 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc0815bd40 0x7efc0815b2a0 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7efc080b08d0 0x7efc0815ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7efbe80663a0 0x7efbe8068850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 --2- 172.21.15.37:0/3035838298 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7efc0806fa40 0x7efc080aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 >> 172.21.15.37:0/3035838298 conn(0x7efc080694f0 msgr2=0x7efc08166db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 shutdown_connections 2023-07-09T22:02:15.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.693+0000 7efc0d337640 1 -- 172.21.15.37:0/3035838298 wait complete. 2023-07-09T22:02:15.715 INFO:tasks.ceph:Scrubbing osd.7 2023-07-09T22:02:15.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-07-09T22:02:15.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 Processor -- start 2023-07-09T22:02:15.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 -- start start 2023-07-09T22:02:15.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce40b1250 0x7f2ce4159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f2ce40af370 0x7f2ce40b1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce40cbe80 con 0x7f2ce406ec70 2023-07-09T22:02:15.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce40cc1b0 con 0x7f2ce40b1250 2023-07-09T22:02:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cec5c5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce406fef0 con 0x7f2ce40af370 2023-07-09T22:02:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cea361640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce40b1250 0x7f2ce4159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cea361640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2ce40b1250 0x7f2ce4159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55690/0 (socket says 172.21.15.37:55690) 2023-07-09T22:02:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2cea361640 1 -- 172.21.15.37:0/3315289622 learned_addr learned my addr 172.21.15.37:0/3315289622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.861+0000 7f2ce9b60640 1 --2- 172.21.15.37:0/3315289622 >> v2:172.21.15.119:3300/0 conn(0x7f2ce40af370 0x7f2ce40b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cea361640 1 -- 172.21.15.37:0/3315289622 >> v2:172.21.15.119:3300/0 conn(0x7f2ce40af370 msgr2=0x7f2ce40b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cea361640 1 --2- 172.21.15.37:0/3315289622 >> v2:172.21.15.119:3300/0 conn(0x7f2ce40af370 0x7f2ce40b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cea361640 1 -- 172.21.15.37:0/3315289622 >> v1:172.21.15.37:6789/0 conn(0x7f2ce406ec70 legacy=0x7f2ce40ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cea361640 1 -- 172.21.15.37:0/3315289622 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40b1b60 con 0x7f2ce40b1250 2023-07-09T22:02:15.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2ce935f640 1 -- 172.21.15.37:0/3315289622 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556972236 0 0) 0x7f2ce40cbe80 con 0x7f2ce406ec70 2023-07-09T22:02:15.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cea361640 1 --2- 172.21.15.37:0/3315289622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce4159ad0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f2ce406b7e0 tx=0x7f2ce001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df4444c879140c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2ce935f640 1 -- 172.21.15.37:0/3315289622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00ac640 con 0x7f2ce40b1250 2023-07-09T22:02:15.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2ce935f640 1 -- 172.21.15.37:0/3315289622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce00ac7a0 con 0x7f2ce40b1250 2023-07-09T22:02:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2ce935f640 1 -- 172.21.15.37:0/3315289622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce00acb30 con 0x7f2ce40b1250 2023-07-09T22:02:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cec5c5640 1 -- 172.21.15.37:0/3315289622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 msgr2=0x7f2ce4159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.865+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/3315289622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce4159ad0 secure :-1 s=READY pgs=2186 cs=0 l=1 rev1=1 crypto rx=0x7f2ce406b7e0 tx=0x7f2ce001c4d0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- 172.21.15.37:0/3315289622 shutdown_connections 2023-07-09T22:02:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/3315289622 >> v2:172.21.15.119:3300/0 conn(0x7f2ce40af370 0x7f2ce40b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/3315289622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce4159ad0 unknown :-1 s=CLOSED pgs=2186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- 172.21.15.37:0/3315289622 >> 172.21.15.37:0/3315289622 conn(0x7f2ce40afdb0 msgr2=0x7f2ce40b0180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- 172.21.15.37:0/3315289622 shutdown_connections 2023-07-09T22:02:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- 172.21.15.37:0/3315289622 wait complete. 2023-07-09T22:02:15.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 Processor -- start 2023-07-09T22:02:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- start start 2023-07-09T22:02:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce406ec70 0x7f2ce4144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce40af370 0x7f2ce4155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce4153ef0 con 0x7f2ce40b1250 2023-07-09T22:02:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41541d0 con 0x7f2ce406ec70 2023-07-09T22:02:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cec5c5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce41544b0 con 0x7f2ce40af370 2023-07-09T22:02:15.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce41561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55704/0 (socket says 172.21.15.37:55704) 2023-07-09T22:02:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 -- 172.21.15.37:0/1004008712 learned_addr learned my addr 172.21.15.37:0/1004008712 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:15.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2cea361640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce406ec70 0x7f2ce4144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ce9b60640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce40af370 0x7f2ce4155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 -- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce40af370 msgr2=0x7f2ce4155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2ce40af370 0x7f2ce4155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 -- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce406ec70 msgr2=0x7f2ce4144910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2ce406ec70 0x7f2ce4144910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.869+0000 7f2ceab62640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce00094d0 con 0x7f2ce40b1250 2023-07-09T22:02:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2ceab62640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce41561c0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc002240 tx=0x7f2cdc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc003db0 con 0x7f2ce40b1250 2023-07-09T22:02:15.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc00ce30 con 0x7f2ce40b1250 2023-07-09T22:02:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc005270 con 0x7f2ce40b1250 2023-07-09T22:02:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce4154790 con 0x7f2ce40b1250 2023-07-09T22:02:15.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce41f4620 con 0x7f2ce40b1250 2023-07-09T22:02:15.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ce406fc10 con 0x7f2ce40b1250 2023-07-09T22:02:15.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2cdc0053d0 con 0x7f2ce40b1250 2023-07-09T22:02:15.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2cc80663d0 0x7f2cc8068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f2cdc083df0 con 0x7f2ce40b1250 2023-07-09T22:02:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7f2cc806ce80 0x7f2cc806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cc806f980 con 0x7f2cc806ce80 2023-07-09T22:02:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=201) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cdc084160 con 0x7f2ce40b1250 2023-07-09T22:02:15.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.873+0000 7f2cea361640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2cc80663d0 0x7f2cc8068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.877+0000 7f2ce9b60640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7f2cc806ce80 0x7f2cc806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.877+0000 7f2cea361640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2cc80663d0 0x7f2cc8068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00ae000 tx=0x7f2ce0008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.877+0000 7f2ce9b60640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7f2cc806ce80 0x7f2cc806f2b0 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:15.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.877+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== osd.7 v2:172.21.15.119:6816/904929402 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2cc806f980 con 0x7f2cc806ce80 2023-07-09T22:02:15.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 --> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2ce4154980 con 0x7f2cc806ce80 2023-07-09T22:02:15.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cdaffd640 1 -- 172.21.15.37:0/1004008712 <== osd.7 v2:172.21.15.119:6816/904929402 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2ce4154980 con 0x7f2cc806ce80 2023-07-09T22:02:15.893 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-07-09T22:02:15.893 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-07-09T22:02:15.893 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-07-09T22:02:15.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7f2cc806ce80 msgr2=0x7f2cc806f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6816/904929402,v1:172.21.15.119:6817/904929402] conn(0x7f2cc806ce80 0x7f2cc806f2b0 crc :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2cc80663d0 msgr2=0x7f2cc8068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2cc80663d0 0x7f2cc8068880 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2ce00ae000 tx=0x7f2ce0008040 comp rx=0 tx=0).stop 2023-07-09T22:02:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 msgr2=0x7f2ce41561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:15.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 --2- 172.21.15.37:0/1004008712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ce40b1250 0x7f2ce41561c0 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc002240 tx=0x7f2cdc00cbe0 comp rx=0 tx=0).stop 2023-07-09T22:02:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2ceab62640 1 -- 172.21.15.37:0/1004008712 reap_dead start 2023-07-09T22:02:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 shutdown_connections 2023-07-09T22:02:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 >> 172.21.15.37:0/1004008712 conn(0x7f2ce40afdb0 msgr2=0x7f2ce40ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 shutdown_connections 2023-07-09T22:02:15.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:15.889+0000 7f2cec5c5640 1 -- 172.21.15.37:0/1004008712 wait complete. 2023-07-09T22:02:15.911 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-07-09T22:02:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 Processor -- start 2023-07-09T22:02:16.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 -- start start 2023-07-09T22:02:16.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7ff5f81603e0 0x7ff5f8164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f806b930 con 0x7ff5f806d6f0 2023-07-09T22:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f806c790 con 0x7ff5f8160010 2023-07-09T22:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5ff819640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f806d330 con 0x7ff5f81603e0 2023-07-09T22:02:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5fddb6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5f806d6f0 0x7ff5f8070160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54842/0 (socket says 172.21.15.37:54842) 2023-07-09T22:02:16.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5fddb6640 1 -- 172.21.15.37:0/238425072 learned_addr learned my addr 172.21.15.37:0/238425072 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.053+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/238425072 >> v2:172.21.15.119:3300/0 conn(0x7ff5f81603e0 0x7ff5f8164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2070214816 0 0) 0x7ff5f806b930 con 0x7ff5f806d6f0 2023-07-09T22:02:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e4003530 con 0x7ff5f806d6f0 2023-07-09T22:02:16.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 422823641 0 0) 0x7ff5e4003530 con 0x7ff5f806d6f0 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 >> v2:172.21.15.119:3300/0 conn(0x7ff5f81603e0 msgr2=0x7ff5f8164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 --2- 172.21.15.37:0/238425072 >> v2:172.21.15.119:3300/0 conn(0x7ff5f81603e0 0x7ff5f8164710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 >> v1:172.21.15.119:6789/0 conn(0x7ff5f8160010 legacy=0x7ff5f806cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f806bb80 con 0x7ff5f806d6f0 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2613378769 0 0) 0x7ff5f0001a00 con 0x7ff5f806d6f0 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 >> v1:172.21.15.37:6789/0 conn(0x7ff5f806d6f0 legacy=0x7ff5f8070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5e4003980 0x7ff5e4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5e4004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5e4005030 0x7ff5e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f806d330 con 0x7ff5e4004370 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e400bf80 con 0x7ff5e4005030 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e400c140 con 0x7ff5e4003980 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5e4004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fd5b5640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5e4003980 0x7ff5e4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fddb6640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5e4005030 0x7ff5e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 -- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5e4003980 msgr2=0x7ff5e4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5e4003980 0x7ff5e4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 -- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5e4005030 msgr2=0x7ff5e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5e4005030 0x7ff5e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fcdb4640 1 -- 172.21.15.37:0/238425072 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4003530 con 0x7ff5e4004370 2023-07-09T22:02:16.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.057+0000 7ff5fddb6640 1 -- 172.21.15.37:0/238425072 reap_dead start 2023-07-09T22:02:16.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5e4004830 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009ab0 tx=0x7ff5e801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b498a24452b439 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a5620 con 0x7ff5e4004370 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e80a5780 con 0x7ff5e4004370 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5effff640 1 -- 172.21.15.37:0/238425072 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80a5b30 con 0x7ff5e4004370 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 msgr2=0x7ff5e4004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5e4004830 secure :-1 s=READY pgs=2189 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8009ab0 tx=0x7ff5e801ca30 comp rx=0 tx=0).stop 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- 172.21.15.37:0/238425072 shutdown_connections 2023-07-09T22:02:16.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 --2- 172.21.15.37:0/238425072 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5e4004830 unknown :-1 s=CLOSED pgs=2189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- 172.21.15.37:0/238425072 >> 172.21.15.37:0/238425072 conn(0x7ff5f80af260 msgr2=0x7ff5f80af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- 172.21.15.37:0/238425072 shutdown_connections 2023-07-09T22:02:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- 172.21.15.37:0/238425072 wait complete. 2023-07-09T22:02:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 Processor -- start 2023-07-09T22:02:16.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- start start 2023-07-09T22:02:16.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f815c3b0 0x7ff5f8162960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5f8096730 0x7ff5f8096ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80aa500 con 0x7ff5e4004370 2023-07-09T22:02:16.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f80970e0 con 0x7ff5f815c3b0 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5ff819640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f8160800 con 0x7ff5f8096730 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5fd5b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5fd5b5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55724/0 (socket says 172.21.15.37:55724) 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.061+0000 7ff5fd5b5640 1 -- 172.21.15.37:0/1876263051 learned_addr learned my addr 172.21.15.37:0/1876263051 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 -- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5f8096730 msgr2=0x7ff5f8096ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5f8096730 0x7ff5f8096ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 -- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f815c3b0 msgr2=0x7ff5f8162960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f815c3b0 0x7ff5f8162960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 -- 172.21.15.37:0/1876263051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f815c820 con 0x7ff5e4004370 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5fd5b5640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4011510 tx=0x7ff5f40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4015820 con 0x7ff5e4004370 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f4015980 con 0x7ff5e4004370 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f815cac0 con 0x7ff5e4004370 2023-07-09T22:02:16.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4015d30 con 0x7ff5e4004370 2023-07-09T22:02:16.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f80ac7a0 con 0x7ff5e4004370 2023-07-09T22:02:16.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f81609c0 con 0x7ff5e4004370 2023-07-09T22:02:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7ff5f4013390 con 0x7ff5e4004370 2023-07-09T22:02:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.065+0000 7ff5edffb640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 0x7ff5dc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.069+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7ff5f4086cb0 con 0x7ff5e4004370 2023-07-09T22:02:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.069+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 0x7ff5dc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.069+0000 7ff5fcdb4640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 0x7ff5dc068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80af000 tx=0x7ff5e8008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.069+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff5f4053f60 con 0x7ff5e4004370 2023-07-09T22:02:16.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5f806be60 con 0x7ff5dc0663d0 2023-07-09T22:02:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5edffb640 1 -- 172.21.15.37:0/1876263051 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff5e800f080 con 0x7ff5dc0663d0 2023-07-09T22:02:16.227 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 7 to deep-scrub 2023-07-09T22:02:16.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 msgr2=0x7ff5dc068880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 0x7ff5dc068880 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff5e80af000 tx=0x7ff5e8008040 comp rx=0 tx=0).stop 2023-07-09T22:02:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 msgr2=0x7ff5f80a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4011510 tx=0x7ff5f40119d0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 shutdown_connections 2023-07-09T22:02:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7ff5dc0663d0 0x7ff5dc068880 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7ff5f8096730 0x7ff5f8096ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7ff5f815c3b0 0x7ff5f8162960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 --2- 172.21.15.37:0/1876263051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5e4004370 0x7ff5f80a9a20 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 >> 172.21.15.37:0/1876263051 conn(0x7ff5f80af260 msgr2=0x7ff5f806fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 shutdown_connections 2023-07-09T22:02:16.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.225+0000 7ff5ff819640 1 -- 172.21.15.37:0/1876263051 wait complete. 2023-07-09T22:02:16.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:02:16.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.389+0000 7fac1c7e9640 1 Processor -- start 2023-07-09T22:02:16.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.389+0000 7fac1c7e9640 1 -- start start 2023-07-09T22:02:16.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1c7e9640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7fac14094ba0 0x7fac1415c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1c7e9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac141602f0 0x7fac1406ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1c7e9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac141608b0 con 0x7fac1415bdd0 2023-07-09T22:02:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1c7e9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14160b90 con 0x7fac141602f0 2023-07-09T22:02:16.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1c7e9640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14094a30 con 0x7fac14094ba0 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1a585640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac1415bdd0 0x7fac1415fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:54854/0 (socket says 172.21.15.37:54854) 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1a585640 1 -- 172.21.15.37:0/568197600 learned_addr learned my addr 172.21.15.37:0/568197600 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1ad86640 1 --2- 172.21.15.37:0/568197600 >> v2:172.21.15.37:3300/0 conn(0x7fac141602f0 0x7fac1406ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac19d84640 1 --2- 172.21.15.37:0/568197600 >> v2:172.21.15.119:3300/0 conn(0x7fac14094ba0 0x7fac1415c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac19583640 1 -- 172.21.15.37:0/568197600 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957950077 0 0) 0x7fac141608b0 con 0x7fac1415bdd0 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac19583640 1 -- 172.21.15.37:0/568197600 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac00003530 con 0x7fac1415bdd0 2023-07-09T22:02:16.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1ad86640 1 -- 172.21.15.37:0/568197600 >> v2:172.21.15.119:3300/0 conn(0x7fac14094ba0 msgr2=0x7fac1415c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1ad86640 1 --2- 172.21.15.37:0/568197600 >> v2:172.21.15.119:3300/0 conn(0x7fac14094ba0 0x7fac1415c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1ad86640 1 -- 172.21.15.37:0/568197600 >> v1:172.21.15.37:6789/0 conn(0x7fac1415bdd0 legacy=0x7fac1415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.393+0000 7fac1ad86640 1 -- 172.21.15.37:0/568197600 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac140709f0 con 0x7fac141602f0 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1ad86640 1 --2- 172.21.15.37:0/568197600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac141602f0 0x7fac1406ba50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fac14098910 tx=0x7fac0c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5b2b7a639d1055 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac19583640 1 -- 172.21.15.37:0/568197600 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0a5740 con 0x7fac141602f0 2023-07-09T22:02:16.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac19583640 1 -- 172.21.15.37:0/568197600 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0a58a0 con 0x7fac141602f0 2023-07-09T22:02:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac19583640 1 -- 172.21.15.37:0/568197600 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0a5c10 con 0x7fac141602f0 2023-07-09T22:02:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- 172.21.15.37:0/568197600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac141602f0 msgr2=0x7fac1406ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/568197600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac141602f0 0x7fac1406ba50 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7fac14098910 tx=0x7fac0c01c880 comp rx=0 tx=0).stop 2023-07-09T22:02:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- 172.21.15.37:0/568197600 shutdown_connections 2023-07-09T22:02:16.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/568197600 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac141602f0 0x7fac1406ba50 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/568197600 >> v2:172.21.15.119:3300/0 conn(0x7fac14094ba0 0x7fac1415c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- 172.21.15.37:0/568197600 >> 172.21.15.37:0/568197600 conn(0x7fac140af260 msgr2=0x7fac140af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- 172.21.15.37:0/568197600 shutdown_connections 2023-07-09T22:02:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- 172.21.15.37:0/568197600 wait complete. 2023-07-09T22:02:16.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 Processor -- start 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.397+0000 7fac1c7e9640 1 -- start start 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1415bdd0 0x7fac14155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac141602f0 0x7fac14155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14152ee0 con 0x7fac14094ba0 2023-07-09T22:02:16.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1415aa60 con 0x7fac1415bdd0 2023-07-09T22:02:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac14153130 con 0x7fac141602f0 2023-07-09T22:02:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55740/0 (socket says 172.21.15.37:55740) 2023-07-09T22:02:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 -- 172.21.15.37:0/3952267572 learned_addr learned my addr 172.21.15.37:0/3952267572 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:16.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac19d84640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1415bdd0 0x7fac14155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1ad86640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac141602f0 0x7fac14155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 -- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac141602f0 msgr2=0x7fac14155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac141602f0 0x7fac14155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 -- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1415bdd0 msgr2=0x7fac14155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1415bdd0 0x7fac14155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 -- 172.21.15.37:0/3952267572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c009a70 con 0x7fac14094ba0 2023-07-09T22:02:16.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1a585640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c700 tx=0x7fac1000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10007270 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac100073d0 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10001d50 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac14153410 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac140a68c0 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac14066bc0 con 0x7fac14094ba0 2023-07-09T22:02:16.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.401+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7fac100057b0 con 0x7fac14094ba0 2023-07-09T22:02:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.405+0000 7fac0affd640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 0x7fabf8068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.405+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7fac100833c0 con 0x7fac14094ba0 2023-07-09T22:02:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.405+0000 7fac19d84640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 0x7fabf8068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.405+0000 7fac19d84640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 0x7fabf8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac141f7840 tx=0x7fac04009190 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:16.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.409+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fac100507b0 con 0x7fac14094ba0 2023-07-09T22:02:16.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.561+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fac1406c7a0 con 0x7fabf80663a0 2023-07-09T22:02:16.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac0affd640 1 -- 172.21.15.37:0/3952267572 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72375 (secure 0 0 0) 0x7fac04011a30 con 0x7fabf80663a0 2023-07-09T22:02:16.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:16.567 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:02:16.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 msgr2=0x7fabf8068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 0x7fabf8068850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fac141f7840 tx=0x7fac04009190 comp rx=0 tx=0).stop 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 msgr2=0x7fac140a5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7fac1000c700 tx=0x7fac1000cbc0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 shutdown_connections 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7fabf80663a0 0x7fabf8068850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7fac141602f0 0x7fac14155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7fac1415bdd0 0x7fac14155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 --2- 172.21.15.37:0/3952267572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac14094ba0 0x7fac140a5e50 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 >> 172.21.15.37:0/3952267572 conn(0x7fac140af260 msgr2=0x7fac140ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 shutdown_connections 2023-07-09T22:02:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:16.565+0000 7fac1c7e9640 1 -- 172.21.15.37:0/3952267572 wait complete. 2023-07-09T22:02:16.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-07-09T22:02:16.334893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":374184,"kb_used_data":20840,"kb_used_omap":0,"kb_used_meta":353280,"kb_avail":754600536,"statfs":{"total":773094113280,"available":772710948864,"internally_reserved":0,"allocated":21340160,"data_stored":11591800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361758720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002087"},"pg_stats":[{"pgid":"1.0","version":"198'348","reported_seq":1319,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.653436+0000","last_change":"2023-07-09T21:22:19.823332+0000","last_active":"2023-07-09T22:02:07.653436+0000","last_peered":"2023-07-09T22:02:07.653436+0000","last_clean":"2023-07-09T22:02:07.653436+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:02:07.653436+0000","last_undegraded":"2023-07-09T22:02:07.653436+0000","last_fullsized":"2023-07-09T22:02:07.653436+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:18.369582+0000","last_clean_scrub_stamp":"2023-07-09T21:22:18.369582+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T09:11:46.469106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":394,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.636121+0000","last_change":"2023-07-09T21:22:25.791743+0000","last_active":"2023-07-09T22:02:06.636121+0000","last_peered":"2023-07-09T22:02:06.636121+0000","last_clean":"2023-07-09T22:02:06.636121+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:02:06.636121+0000","last_undegraded":"2023-07-09T22:02:06.636121+0000","last_fullsized":"2023-07-09T22:02:06.636121+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:08:52.470722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":344,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.653267+0000","last_change":"2023-07-09T21:22:25.794565+0000","last_active":"2023-07-09T22:02:07.653267+0000","last_peered":"2023-07-09T22:02:07.653267+0000","last_clean":"2023-07-09T22:02:07.653267+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:02:07.653267+0000","last_undegraded":"2023-07-09T22:02:07.653267+0000","last_fullsized":"2023-07-09T22:02:07.653267+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:00:50.927525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":337,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.629540+0000","last_change":"2023-07-09T21:22:25.790208+0000","last_active":"2023-07-09T22:02:06.629540+0000","last_peered":"2023-07-09T22:02:06.629540+0000","last_clean":"2023-07-09T22:02:06.629540+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:02:06.629540+0000","last_undegraded":"2023-07-09T22:02:06.629540+0000","last_fullsized":"2023-07-09T22:02:06.629540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":394,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:06.636277+0000","last_change":"2023-07-09T21:22:25.794144+0000","last_active":"2023-07-09T22:02:06.636277+0000","last_peered":"2023-07-09T22:02:06.636277+0000","last_clean":"2023-07-09T22:02:06.636277+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:02:06.636277+0000","last_undegraded":"2023-07-09T22:02:06.636277+0000","last_fullsized":"2023-07-09T22:02:06.636277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:10:35.809527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":335,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.201482+0000","last_change":"2023-07-09T21:22:25.956374+0000","last_active":"2023-07-09T22:02:07.201482+0000","last_peered":"2023-07-09T22:02:07.201482+0000","last_clean":"2023-07-09T22:02:07.201482+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:02:07.201482+0000","last_undegraded":"2023-07-09T22:02:07.201482+0000","last_fullsized":"2023-07-09T22:02:07.201482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T07:08:32.927971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":343,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.653423+0000","last_change":"2023-07-09T21:22:25.958215+0000","last_active":"2023-07-09T22:02:07.653423+0000","last_peered":"2023-07-09T22:02:07.653423+0000","last_clean":"2023-07-09T22:02:07.653423+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:02:07.653423+0000","last_undegraded":"2023-07-09T22:02:07.653423+0000","last_fullsized":"2023-07-09T22:02:07.653423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T21:58:50.200741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":337,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.202691+0000","last_change":"2023-07-09T21:22:25.791836+0000","last_active":"2023-07-09T22:02:07.202691+0000","last_peered":"2023-07-09T22:02:07.202691+0000","last_clean":"2023-07-09T22:02:07.202691+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:02:07.202691+0000","last_undegraded":"2023-07-09T22:02:07.202691+0000","last_fullsized":"2023-07-09T22:02:07.202691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:08:21.491942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":350,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:07.226881+0000","last_change":"2023-07-09T21:22:25.794396+0000","last_active":"2023-07-09T22:02:07.226881+0000","last_peered":"2023-07-09T22:02:07.226881+0000","last_clean":"2023-07-09T22:02:07.226881+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:02:07.226881+0000","last_undegraded":"2023-07-09T22:02:07.226881+0000","last_fullsized":"2023-07-09T22:02:07.226881+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T21:22:24.773708+0000","last_clean_scrub_stamp":"2023-07-09T21:22:24.773708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":348,"ondisk_log_size":348,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575319,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48040,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323800,"statfs":{"total":96636764160,"available":96587571200,"internally_reserved":0,"allocated":3112960,"data_stored":1891751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.71799999999999997,"15min":0.72999999999999998},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.96399999999999997,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.752},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.74099999999999999},"min":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.41599999999999998},"max":{"1min":0.97499999999999998,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.73599999999999999},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73399999999999999,"15min":0.755},"min":{"1min":0.52800000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.93200000000000005,"5min":1.165,"15min":1.165},"last":0.78500000000000003}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.72899999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.437},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":1.036},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.75900000000000001},"min":{"1min":0.55000000000000004,"5min":0.503,"15min":0.46000000000000002},"max":{"1min":0.96199999999999997,"5min":1.147,"15min":1.147},"last":0.94499999999999995}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.753,"15min":0.77000000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.0309999999999999,"5min":1.0349999999999999,"15min":1.038},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.745,"5min":0.77400000000000002,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.54400000000000004,"15min":0.54200000000000004},"max":{"1min":0.92700000000000005,"5min":1.107,"15min":1.107},"last":0.97699999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.34499999999999997},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.63300000000000001,"15min":0.61199999999999999},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.96299999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.66200000000000003,"15min":0.63800000000000001},"min":{"1min":0.46500000000000002,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":2.948,"5min":2.948,"15min":2.948},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.67700000000000005,"15min":0.65800000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.437},"max":{"1min":0.90500000000000003,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.86599999999999999}]},{"osd":6,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72499999999999998,"15min":0.71499999999999997},"min":{"1min":0.53100000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.71599999999999997,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.92400000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575319,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.68700000000000006,"15min":0.72499999999999998},"min":{"1min":0.443,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.871,"5min":1.075,"15min":1.075},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.71699999999999997,"15min":0.746},"min":{"1min":0.46500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84899999999999998,"5min":0.999,"15min":1.04},"last":0.70899999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.71899999999999997,"15min":0.74299999999999999},"min":{"1min":0.496,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89800000000000002,"5min":0.98199999999999998,"15min":1.032},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70699999999999996,"15min":0.73899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.41799999999999998},"max":{"1min":0.90400000000000003,"5min":1.002,"15min":1.1200000000000001},"last":0.67400000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71799999999999997,"15min":0.749},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.89700000000000002,"5min":1.0089999999999999,"15min":1.504},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.76100000000000001},"min":{"1min":0.55000000000000004,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.996,"5min":1.0580000000000001,"15min":1.0609999999999999},"last":0.65400000000000003}]},{"osd":3,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.73199999999999998,"15min":0.76600000000000001},"min":{"1min":0.59499999999999997,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86499999999999999,"5min":1.02,"15min":1.026},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.748,"15min":0.76700000000000002},"min":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.91700000000000004,"5min":1.036,"15min":1.4530000000000001},"last":0.54700000000000004}]},{"osd":4,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.41199999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.80500000000000005,"5min":0.92600000000000005,"15min":1.161},"last":0.63},{"interface":"front","average":{"1min":0.62,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.45000000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.88400000000000001,"5min":0.90600000000000003,"15min":1.099},"last":0.77700000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.627},"min":{"1min":0.44,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":1.052},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63700000000000001,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80900000000000005,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Sun Jul 9 22:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.66600000000000004,"15min":0.68600000000000005},"min":{"1min":0.56000000000000005,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.871,"5min":0.97399999999999998,"15min":1.0860000000000001},"last":0.749},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68999999999999995,"15min":0.71099999999999997},"min":{"1min":0.499,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91700000000000004,"5min":0.99099999999999999,"15min":1.077},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575317,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.82899999999999996,"5min":1.012,"15min":1.012},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.008,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.58399999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.753},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96999999999999997,"5min":1.0409999999999999,"15min":1.0900000000000001},"last":0.62}]},{"osd":2,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.747,"15min":0.754},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0029999999999999,"5min":1.095,"15min":1.095},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86499999999999999,"5min":0.98899999999999999,"15min":1.0349999999999999},"last":0.745}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":1.008,"15min":1.034},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96499999999999997,"15min":1.0720000000000001},"last":0.85699999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65000000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.628},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.82399999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575320,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.46000000000000002,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":0.996,"15min":0.996},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91100000000000003,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.55200000000000005}]},{"osd":1,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92800000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89200000000000002,"5min":0.998,"15min":1.03},"last":0.91900000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.038,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.875}]},{"osd":3,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.89800000000000002,"5min":1.016,"15min":1.016},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.016,"5min":1.038,"15min":1.038},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.05,"15min":1.079},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":1.016,"15min":1.016},"last":0.80200000000000005}]},{"osd":6,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.96099999999999997,"15min":1.018},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.433,"15min":0.39800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.89800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575319,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.48499999999999999,"15min":0.48199999999999998},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.30199999999999999},"max":{"1min":0.67800000000000005,"5min":1.175,"15min":1.175},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.56000000000000005},"min":{"1min":0.375,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.745,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.47199999999999998,"15min":0.48299999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.627,"5min":0.75700000000000001,"15min":1.133},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73999999999999999,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.441}]},{"osd":2,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59199999999999997,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79400000000000004,"5min":0.93100000000000005,"15min":1.194},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.46700000000000003,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80400000000000005,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.52200000000000002}]},{"osd":4,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.80400000000000005,"15min":0.81000000000000005},"min":{"1min":0.59999999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0589999999999999,"5min":1.244,"15min":1.5429999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.56599999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0780000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.75900000000000001}]},{"osd":5,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83899999999999997,"15min":0.84799999999999998},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.56599999999999995},"max":{"1min":1.161,"5min":1.161,"15min":1.302},"last":0.879},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.622,"5min":0.54200000000000004,"15min":0.52900000000000003},"max":{"1min":1.0449999999999999,"5min":1.1659999999999999,"15min":1.4259999999999999},"last":0.88600000000000001}]},{"osd":6,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.53900000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.046,"5min":1.1879999999999999,"15min":1.262},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.56200000000000006,"5min":0.498,"15min":0.498},"max":{"1min":1.1140000000000001,"5min":1.2010000000000001,"15min":1.363},"last":0.77600000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:01:27 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.81399999999999995,"15min":0.81499999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.1819999999999999,"5min":1.2769999999999999,"15min":1.601},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.55700000000000005,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575320,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312092,"statfs":{"total":96636764160,"available":96575582208,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.96499999999999997},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.77100000000000002,"15min":0.85099999999999998},"last":0.45200000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.50700000000000001}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.90000000000000002,"15min":1.016},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.1100000000000001,"5min":1.117,"15min":1.163},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.131,"5min":1.1970000000000001,"15min":1.2070000000000001},"last":0.69899999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.62},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"max":{"1min":0.97199999999999998,"5min":1.111,"15min":1.2330000000000001},"last":0.59999999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0900000000000001,"5min":1.264,"15min":1.264},"last":0.746},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52200000000000002},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.294},"last":0.63500000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.046,"5min":1.196,"15min":1.2050000000000001},"last":0.78900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575319,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.47299999999999998},"min":{"1min":0.32700000000000001,"5min":0.32200000000000001,"15min":0.29099999999999998},"max":{"1min":0.628,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.35899999999999999,"5min":0.32400000000000001,"15min":0.32300000000000001},"max":{"1min":0.78000000000000003,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.41399999999999998}]},{"osd":2,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.50900000000000001,"15min":0.49299999999999999},"min":{"1min":0.35599999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.81799999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.441,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.67700000000000005,"5min":0.872,"15min":0.89200000000000002},"last":0.433}]},{"osd":3,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.628,"15min":0.61599999999999999},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.41599999999999998},"max":{"1min":0.81100000000000005,"5min":0.84099999999999997,"15min":0.96999999999999997},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.56499999999999995,"15min":0.56000000000000005},"min":{"1min":0.40999999999999998,"5min":0.39200000000000002,"15min":0.38100000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.86499999999999999},"last":0.47999999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.84399999999999997,"15min":0.83399999999999996},"min":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58599999999999997},"max":{"1min":1.117,"5min":1.274,"15min":1.274},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.85599999999999998,"15min":0.84299999999999997},"min":{"1min":0.67500000000000004,"5min":0.51200000000000001,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.2769999999999999,"15min":1.337},"last":0.77800000000000002}]},{"osd":5,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":0.81299999999999994,"15min":0.80600000000000005},"min":{"1min":0.59599999999999997,"5min":0.52700000000000002,"15min":0.46100000000000002},"max":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.2150000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.81399999999999995,"15min":0.81200000000000006},"min":{"1min":0.70099999999999996,"5min":0.56999999999999995,"15min":0.45600000000000002},"max":{"1min":1.1100000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.80500000000000005,"15min":0.79300000000000004},"min":{"1min":0.59599999999999997,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0589999999999999,"5min":1.071,"15min":1.1020000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.84699999999999998,"15min":0.82699999999999996},"min":{"1min":0.69499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1379999999999999,"5min":1.157,"15min":1.157},"last":0.81999999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:01:24 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.84299999999999997,"15min":0.82599999999999996},"min":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.52400000000000002},"max":{"1min":1.052,"5min":1.1599999999999999,"15min":1.1910000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.875,"5min":0.84999999999999998,"15min":0.83799999999999997},"min":{"1min":0.65200000000000002,"5min":0.62,"15min":0.57799999999999996},"max":{"1min":1.131,"5min":1.321,"15min":1.321},"last":0.88600000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575319,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42280,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329560,"statfs":{"total":96636764160,"available":96593469440,"internally_reserved":0,"allocated":3112960,"data_stored":1891751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.59499999999999997}]},{"osd":2,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.377,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.34300000000000003},"max":{"1min":0.68999999999999995,"5min":0.82499999999999996,"15min":0.94799999999999995},"last":0.68700000000000006}]},{"osd":3,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.76600000000000001,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.60499999999999998,"15min":0.60799999999999998},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.39000000000000001},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.63500000000000001}]},{"osd":4,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.80600000000000005,"15min":0.80300000000000005},"min":{"1min":0.63500000000000001,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":0.93799999999999994,"5min":1.306,"15min":1.306},"last":1.05},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79500000000000004,"15min":0.80200000000000005},"min":{"1min":0.52100000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.995,"5min":1.351,"15min":1.351},"last":0.81799999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80900000000000005,"15min":0.80800000000000005},"min":{"1min":0.57999999999999996,"5min":0.503,"15min":0.503},"max":{"1min":1.0009999999999999,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.82199999999999995,"15min":0.82399999999999995},"min":{"1min":0.59699999999999998,"5min":0.58599999999999997,"15min":0.51000000000000001},"max":{"1min":0.97399999999999998,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.89900000000000002}]},{"osd":6,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80600000000000005,"15min":0.80800000000000005},"min":{"1min":0.61699999999999999,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":0.998,"5min":1.135,"15min":1.3260000000000001},"last":0.874},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.82099999999999995,"15min":0.81999999999999995},"min":{"1min":0.63900000000000001,"5min":0.59899999999999998,"15min":0.48499999999999999},"max":{"1min":1.0820000000000001,"5min":1.381,"15min":1.381},"last":1.0680000000000001}]},{"osd":7,"last update":"Sun Jul 9 22:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83099999999999996,"15min":0.83899999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.0069999999999999,"5min":1.296,"15min":1.296},"last":0.99299999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.82399999999999995,"15min":0.82299999999999995},"min":{"1min":0.58899999999999997,"5min":0.56799999999999995,"15min":0.54700000000000004},"max":{"1min":0.96599999999999997,"5min":1.2709999999999999,"15min":1.397},"last":0.97999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:02:16.591 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-07-09T21:22:18.369582+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=18, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.592 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.593 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.593 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.593 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.593 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.594 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.594 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.594 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-07-09T21:22:24.773708+0000 time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=21, tm_min=22, tm_sec=24, tm_wday=6, tm_yday=190, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=7, tm_mday=9, tm_hour=22, tm_min=2, tm_sec=10, tm_wday=6, tm_yday=190, tm_isdst=0) 2023-07-09T22:02:16.595 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-07-09T22:02:36.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:36.101 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:36.596 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-09T22:02:36.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 Processor -- start 2023-07-09T22:02:36.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 -- start start 2023-07-09T22:02:36.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f72b415d1b0 0x7f72b40955f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 0x7f72b4096610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b40960b0 con 0x7f72b415cde0 2023-07-09T22:02:36.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b406c4c0 con 0x7f72b415d1b0 2023-07-09T22:02:36.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72bbfd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b406c7a0 con 0x7f72b4095b30 2023-07-09T22:02:36.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72b9d71640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72b415cde0 0x7f72b40a9890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38862/0 (socket says 172.21.15.37:38862) 2023-07-09T22:02:36.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72b9d71640 1 -- 172.21.15.37:0/1968933150 learned_addr learned my addr 172.21.15.37:0/1968933150 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72ba572640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 0x7f72b4096610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72b9570640 1 --2- 172.21.15.37:0/1968933150 >> v2:172.21.15.119:3300/0 conn(0x7f72b415d1b0 0x7f72b40955f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3144519029 0 0) 0x7f72b40960b0 con 0x7f72b415cde0 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.748+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003530 con 0x7f72b415cde0 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2681656595 0 0) 0x7f72a0003530 con 0x7f72b415cde0 2023-07-09T22:02:36.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b9570640 1 -- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 msgr2=0x7f72b4096610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:36.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b9570640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 0x7f72b4096610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b9570640 1 -- 172.21.15.37:0/1968933150 >> v1:172.21.15.37:6789/0 conn(0x7f72b415cde0 legacy=0x7f72b40a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b9570640 1 -- 172.21.15.37:0/1968933150 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b406ca80 con 0x7f72b415d1b0 2023-07-09T22:02:36.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72ba572640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 0x7f72b4096610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-09T22:02:36.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b9570640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b40955f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f72a40097c0 tx=0x7f72a401c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdb1d0f37356645e server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:36.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0001820 con 0x7f72b415d1b0 2023-07-09T22:02:36.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a40a7050 con 0x7f72b415d1b0 2023-07-09T22:02:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.752+0000 7f72b8d6f640 1 -- 172.21.15.37:0/1968933150 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40ab600 con 0x7f72b415d1b0 2023-07-09T22:02:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 msgr2=0x7f72b40955f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b40955f0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f72a40097c0 tx=0x7f72a401c3a0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- 172.21.15.37:0/1968933150 shutdown_connections 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b4095b30 0x7f72b4096610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/1968933150 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b40955f0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- 172.21.15.37:0/1968933150 >> 172.21.15.37:0/1968933150 conn(0x7f72b40af260 msgr2=0x7f72b40af660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- 172.21.15.37:0/1968933150 shutdown_connections 2023-07-09T22:02:36.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- 172.21.15.37:0/1968933150 wait complete. 2023-07-09T22:02:36.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 Processor -- start 2023-07-09T22:02:36.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- start start 2023-07-09T22:02:36.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 0x7f72b40abac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b41598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b4162640 con 0x7f72b4095b30 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40ac000 con 0x7f72b415d1b0 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72bbfd5640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40a9eb0 con 0x7f72b415cde0 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51690/0 (socket says 172.21.15.37:51690) 2023-07-09T22:02:36.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 -- 172.21.15.37:0/3597080312 learned_addr learned my addr 172.21.15.37:0/3597080312 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:36.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 -- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 msgr2=0x7f72b40abac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72ba572640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b41598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9570640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 0x7f72b40abac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 0x7f72b40abac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 -- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 msgr2=0x7f72b41598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b41598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.756+0000 7f72b9d71640 1 -- 172.21.15.37:0/3597080312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ac009a70 con 0x7f72b4095b30 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72ba572640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b41598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72b9570640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 0x7f72b40abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72b9d71640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f72b0001140 tx=0x7f72b000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0007270 con 0x7f72b4095b30 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00073d0 con 0x7f72b4095b30 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a4009420 con 0x7f72b4095b30 2023-07-09T22:02:36.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00057b0 con 0x7f72b4095b30 2023-07-09T22:02:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b40aa470 con 0x7f72b4095b30 2023-07-09T22:02:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b4066bc0 con 0x7f72b4095b30 2023-07-09T22:02:36.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f72b0005930 con 0x7f72b4095b30 2023-07-09T22:02:36.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 0x7f7298068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:36.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.760+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f72b00836c0 con 0x7f72b4095b30 2023-07-09T22:02:36.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.764+0000 7f72b9570640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 0x7f7298068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:36.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.764+0000 7f72b9570640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 0x7f7298068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72a40ad000 tx=0x7f72a40a6000 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:36.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.768+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72b0050970 con 0x7f72b4095b30 2023-07-09T22:02:36.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.920+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 --> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72b40cdb30 con 0x7f72980663a0 2023-07-09T22:02:36.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72aa7fc640 1 -- 172.21.15.37:0/3597080312 <== mgr.9047 v2:172.21.15.119:6832/2763450555 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72792 (secure 0 0 0) 0x7f72b40cdb30 con 0x7f72980663a0 2023-07-09T22:02:36.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:36.928 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-07-09T22:02:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 msgr2=0x7f7298068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 0x7f7298068850 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f72a40ad000 tx=0x7f72a40a6000 comp rx=0 tx=0).stop 2023-07-09T22:02:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 msgr2=0x7f72b40a9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7f72b0001140 tx=0x7f72b000cb20 comp rx=0 tx=0).stop 2023-07-09T22:02:36.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 shutdown_connections 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f72b415d1b0 0x7f72b41598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f72980663a0 0x7f7298068850 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f72b415cde0 0x7f72b40abac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 --2- 172.21.15.37:0/3597080312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72b4095b30 0x7f72b40a9890 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 >> 172.21.15.37:0/3597080312 conn(0x7f72b40af260 msgr2=0x7f72b4156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:36.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 shutdown_connections 2023-07-09T22:02:36.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:36.924+0000 7f72bbfd5640 1 -- 172.21.15.37:0/3597080312 wait complete. 2023-07-09T22:02:36.948 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-07-09T22:02:36.339117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":374184,"kb_used_data":20840,"kb_used_omap":0,"kb_used_meta":353280,"kb_avail":754600536,"statfs":{"total":773094113280,"available":772710948864,"internally_reserved":0,"allocated":21340160,"data_stored":11591800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":361758720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002449"},"pg_stats":[{"pgid":"1.0","version":"201'349","reported_seq":1329,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:17.055196+0000","last_change":"2023-07-09T22:02:17.055256+0000","last_active":"2023-07-09T22:02:17.055196+0000","last_peered":"2023-07-09T22:02:17.055196+0000","last_clean":"2023-07-09T22:02:17.055196+0000","last_became_active":"2023-07-09T21:22:19.822343+0000","last_became_peered":"2023-07-09T21:22:19.822343+0000","last_unstale":"2023-07-09T22:02:17.055196+0000","last_undegraded":"2023-07-09T22:02:17.055196+0000","last_fullsized":"2023-07-09T22:02:17.055196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"201'349","last_scrub_stamp":"2023-07-09T22:02:17.055097+0000","last_deep_scrub":"201'349","last_deep_scrub_stamp":"2023-07-09T22:02:17.055097+0000","last_clean_scrub_stamp":"2023-07-09T22:02:17.055097+0000","objects_scrubbed":2,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T22:42:55.202928+0000","scrub_duration":0.0070686509999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":403,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:15.530278+0000","last_change":"2023-07-09T22:02:15.530327+0000","last_active":"2023-07-09T22:02:15.530278+0000","last_peered":"2023-07-09T22:02:15.530278+0000","last_clean":"2023-07-09T22:02:15.530278+0000","last_became_active":"2023-07-09T21:22:25.791393+0000","last_became_peered":"2023-07-09T21:22:25.791393+0000","last_unstale":"2023-07-09T22:02:15.530278+0000","last_undegraded":"2023-07-09T22:02:15.530278+0000","last_fullsized":"2023-07-09T22:02:15.530278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:15.530175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:15.530175+0000","last_clean_scrub_stamp":"2023-07-09T22:02:15.530175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:28:00.196134+0000","scrub_duration":0.0034068879999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":353,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:24.052323+0000","last_change":"2023-07-09T22:02:24.052373+0000","last_active":"2023-07-09T22:02:24.052323+0000","last_peered":"2023-07-09T22:02:24.052323+0000","last_clean":"2023-07-09T22:02:24.052323+0000","last_became_active":"2023-07-09T21:22:25.794271+0000","last_became_peered":"2023-07-09T21:22:25.794271+0000","last_unstale":"2023-07-09T22:02:24.052323+0000","last_undegraded":"2023-07-09T22:02:24.052323+0000","last_fullsized":"2023-07-09T22:02:24.052323+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:24.052209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:24.052209+0000","last_clean_scrub_stamp":"2023-07-09T22:02:24.052209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:06:48.199166+0000","scrub_duration":0.0038513060000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":345,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:16.874589+0000","last_change":"2023-07-09T22:02:16.874627+0000","last_active":"2023-07-09T22:02:16.874589+0000","last_peered":"2023-07-09T22:02:16.874589+0000","last_clean":"2023-07-09T22:02:16.874589+0000","last_became_active":"2023-07-09T21:22:25.789910+0000","last_became_peered":"2023-07-09T21:22:25.789910+0000","last_unstale":"2023-07-09T22:02:16.874589+0000","last_undegraded":"2023-07-09T22:02:16.874589+0000","last_fullsized":"2023-07-09T22:02:16.874589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:16.874506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:16.874506+0000","last_clean_scrub_stamp":"2023-07-09T22:02:16.874506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:40:30.925254+0000","scrub_duration":0.0031056009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":403,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:17.529577+0000","last_change":"2023-07-09T22:02:17.529641+0000","last_active":"2023-07-09T22:02:17.529577+0000","last_peered":"2023-07-09T22:02:17.529577+0000","last_clean":"2023-07-09T22:02:17.529577+0000","last_became_active":"2023-07-09T21:22:25.793733+0000","last_became_peered":"2023-07-09T21:22:25.793733+0000","last_unstale":"2023-07-09T22:02:17.529577+0000","last_undegraded":"2023-07-09T22:02:17.529577+0000","last_fullsized":"2023-07-09T22:02:17.529577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:17.529463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:17.529463+0000","last_clean_scrub_stamp":"2023-07-09T22:02:17.529463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T08:15:41.031848+0000","scrub_duration":0.0037989180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":345,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:14.087947+0000","last_change":"2023-07-09T22:02:14.087947+0000","last_active":"2023-07-09T22:02:14.087947+0000","last_peered":"2023-07-09T22:02:14.087947+0000","last_clean":"2023-07-09T22:02:14.087947+0000","last_became_active":"2023-07-09T21:22:25.956040+0000","last_became_peered":"2023-07-09T21:22:25.956040+0000","last_unstale":"2023-07-09T22:02:14.087947+0000","last_undegraded":"2023-07-09T22:02:14.087947+0000","last_fullsized":"2023-07-09T22:02:14.087947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:14.087828+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:14.087828+0000","last_clean_scrub_stamp":"2023-07-09T22:02:14.087828+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T02:08:02.217697+0000","scrub_duration":0.002903025,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":353,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:22.055968+0000","last_change":"2023-07-09T22:02:22.055968+0000","last_active":"2023-07-09T22:02:22.055968+0000","last_peered":"2023-07-09T22:02:22.055968+0000","last_clean":"2023-07-09T22:02:22.055968+0000","last_became_active":"2023-07-09T21:22:25.957923+0000","last_became_peered":"2023-07-09T21:22:25.957923+0000","last_unstale":"2023-07-09T22:02:22.055968+0000","last_undegraded":"2023-07-09T22:02:22.055968+0000","last_fullsized":"2023-07-09T22:02:22.055968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:22.055759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:22.055759+0000","last_clean_scrub_stamp":"2023-07-09T22:02:22.055759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-10T23:32:02.191234+0000","scrub_duration":0.0043034290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":346,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:18.159415+0000","last_change":"2023-07-09T22:02:18.159461+0000","last_active":"2023-07-09T22:02:18.159415+0000","last_peered":"2023-07-09T22:02:18.159415+0000","last_clean":"2023-07-09T22:02:18.159415+0000","last_became_active":"2023-07-09T21:22:25.791510+0000","last_became_peered":"2023-07-09T21:22:25.791510+0000","last_unstale":"2023-07-09T22:02:18.159415+0000","last_undegraded":"2023-07-09T22:02:18.159415+0000","last_fullsized":"2023-07-09T22:02:18.159415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:18.159304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:18.159304+0000","last_clean_scrub_stamp":"2023-07-09T22:02:18.159304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T01:37:25.460976+0000","scrub_duration":0.0035090939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":358,"reported_epoch":201,"state":"active+clean","last_fresh":"2023-07-09T22:02:17.224195+0000","last_change":"2023-07-09T22:02:17.224254+0000","last_active":"2023-07-09T22:02:17.224195+0000","last_peered":"2023-07-09T22:02:17.224195+0000","last_clean":"2023-07-09T22:02:17.224195+0000","last_became_active":"2023-07-09T21:22:25.793719+0000","last_became_peered":"2023-07-09T21:22:25.793719+0000","last_unstale":"2023-07-09T22:02:17.224195+0000","last_undegraded":"2023-07-09T22:02:17.224195+0000","last_fullsized":"2023-07-09T22:02:17.224195+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-09T22:02:17.224102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-09T22:02:17.224102+0000","last_clean_scrub_stamp":"2023-07-09T22:02:17.224102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-07-11T03:31:31.932752+0000","scrub_duration":0.0033671019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2132,"num_read_kb":4426,"num_write":579,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":349,"ondisk_log_size":349,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575324,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48040,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":44992,"kb_avail":94323800,"statfs":{"total":96636764160,"available":96587571200,"internally_reserved":0,"allocated":3112960,"data_stored":1891751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46071808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70399999999999996,"15min":0.72699999999999998},"min":{"1min":0.50600000000000001,"5min":0.43099999999999999,"15min":0.41799999999999998},"max":{"1min":0.91100000000000003,"5min":1.0209999999999999,"15min":1.1339999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.71699999999999997,"15min":0.73699999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.41599999999999998},"max":{"1min":0.878,"5min":0.98899999999999999,"15min":1.0169999999999999},"last":0.66400000000000003}]},{"osd":1,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.69999999999999996,"15min":0.73399999999999999},"min":{"1min":0.49299999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93999999999999995,"5min":0.96499999999999997,"15min":1.0309999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72199999999999998,"15min":0.752},"min":{"1min":0.50600000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88200000000000001,"5min":1.165,"15min":1.165},"last":0.76000000000000001}]},{"osd":2,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.70099999999999996,"15min":0.72399999999999998},"min":{"1min":0.47399999999999998,"5min":0.44800000000000001,"15min":0.437},"max":{"1min":0.88200000000000001,"5min":1.036,"15min":1.036},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.745,"15min":0.76100000000000001},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.46000000000000002},"max":{"1min":1.0069999999999999,"5min":1.147,"15min":1.147},"last":0.68899999999999995}]},{"osd":3,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.76700000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.93000000000000005,"5min":1.0349999999999999,"15min":1.038},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76500000000000001,"15min":0.80000000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97699999999999998,"5min":1.107,"15min":1.107},"last":0.74099999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.58199999999999996},"min":{"1min":0.40899999999999997,"5min":0.35799999999999998,"15min":0.34499999999999997},"max":{"1min":1.0920000000000001,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64100000000000001,"15min":0.61799999999999999},"min":{"1min":0.502,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.96299999999999997,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.33300000000000002},"max":{"1min":1.0669999999999999,"5min":2.948,"15min":2.948},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.68400000000000005,"15min":0.66500000000000004},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.437},"max":{"1min":1.0820000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.625}]},{"osd":6,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.73899999999999999,"15min":0.72099999999999997},"min":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1080000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.69799999999999995},"min":{"1min":0.46200000000000002,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.022,"5min":3.008,"15min":3.008},"last":0.64800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575323,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.67100000000000004,"15min":0.71599999999999997},"min":{"1min":0.46600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83699999999999997,"5min":1.075,"15min":1.075},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70099999999999996,"15min":0.74099999999999999},"min":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88100000000000001,"5min":0.999,"15min":1.04},"last":0.85099999999999998}]},{"osd":1,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.70199999999999996,"15min":0.73799999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.84999999999999998,"5min":0.98199999999999998,"15min":1.032},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.73099999999999998},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.41799999999999998},"max":{"1min":0.79900000000000004,"5min":1.002,"15min":1.1200000000000001},"last":0.79900000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.53200000000000003,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.85199999999999998,"5min":1.0089999999999999,"15min":1.504},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.71399999999999997,"15min":0.755},"min":{"1min":0.496,"5min":0.46500000000000002,"15min":0.436},"max":{"1min":0.88,"5min":1.0580000000000001,"15min":1.0609999999999999},"last":0.88}]},{"osd":3,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72599999999999998,"15min":0.75900000000000001},"min":{"1min":0.55800000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.89000000000000001,"5min":1.02,"15min":1.026},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.73099999999999998,"15min":0.76200000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97799999999999998,"5min":1.036,"15min":1.4530000000000001},"last":0.97799999999999998}]},{"osd":4,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.56399999999999995,"15min":0.56999999999999995},"min":{"1min":0.41899999999999998,"5min":0.34899999999999998,"15min":0.32600000000000001},"max":{"1min":0.76400000000000001,"5min":0.92600000000000005,"15min":1.161},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":1.099},"last":0.92800000000000005}]},{"osd":5,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.61499999999999999,"15min":0.63},"min":{"1min":0.48899999999999999,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.91900000000000004,"15min":1.052},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.65100000000000002},"min":{"1min":0.51900000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84299999999999997,"5min":1.0249999999999999,"15min":1.0409999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67500000000000004,"15min":0.68500000000000005},"min":{"1min":0.52600000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.875,"5min":0.97399999999999998,"15min":1.0860000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69599999999999995,"15min":0.70899999999999996},"min":{"1min":0.55100000000000005,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91200000000000003,"5min":0.99099999999999999,"15min":1.077},"last":0.91200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575322,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68700000000000006,"15min":0.71199999999999997},"min":{"1min":0.44800000000000001,"5min":0.41799999999999998,"15min":0.41099999999999998},"max":{"1min":0.82899999999999996,"5min":1.012,"15min":1.012},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.73799999999999999},"min":{"1min":0.42599999999999999,"5min":0.37,"15min":0.37},"max":{"1min":1.008,"5min":1.0229999999999999,"15min":1.0569999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.749,"15min":0.753},"min":{"1min":0.51700000000000002,"5min":0.49399999999999999,"15min":0.48499999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.73899999999999999},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96999999999999997,"5min":1.0409999999999999,"15min":1.0900000000000001},"last":0.89500000000000002}]},{"osd":2,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.747,"15min":0.754},"min":{"1min":0.5,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0029999999999999,"5min":1.095,"15min":1.095},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.72799999999999998},"min":{"1min":0.52000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86499999999999999,"5min":0.98899999999999999,"15min":1.0349999999999999},"last":0.71799999999999997}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73999999999999999,"15min":0.75600000000000001},"min":{"1min":0.56000000000000005,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":1.008,"15min":1.034},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76400000000000001,"15min":0.76700000000000002},"min":{"1min":0.60399999999999998,"5min":0.52200000000000002,"15min":0.48699999999999999},"max":{"1min":0.96199999999999997,"5min":0.96499999999999997,"15min":1.0720000000000001},"last":0.95399999999999996}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.38200000000000001},"max":{"1min":0.94999999999999996,"5min":1.004,"15min":1.004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60999999999999999,"15min":0.61299999999999999},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.39700000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.83999999999999997}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.629,"15min":0.628},"min":{"1min":0.42099999999999999,"5min":0.41399999999999998,"15min":0.37},"max":{"1min":0.875,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":1.006},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63800000000000001,"15min":0.64200000000000002},"min":{"1min":0.45600000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.91000000000000003,"5min":0.95599999999999996,"15min":1.0009999999999999},"last":0.86199999999999999}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.47199999999999998,"5min":0.45800000000000002,"15min":0.41799999999999998},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.41099999999999998},"max":{"1min":1.004,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":1.0429999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575324,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.74099999999999999},"min":{"1min":0.46000000000000002,"5min":0.44700000000000001,"15min":0.41899999999999998},"max":{"1min":0.876,"5min":0.996,"15min":0.996},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.71699999999999997,"15min":0.72099999999999997},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.91100000000000003,"5min":0.96999999999999997,"15min":0.98299999999999998},"last":0.82899999999999996}]},{"osd":1,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.752,"15min":0.755},"min":{"1min":0.52900000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92800000000000005,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.75800000000000001,"15min":0.75},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.89200000000000002,"5min":0.998,"15min":1.03},"last":0.872}]},{"osd":2,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.73399999999999999,"15min":0.745},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.49199999999999999},"max":{"1min":0.85699999999999998,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.77300000000000002,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.038,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.81100000000000005}]},{"osd":3,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.755,"15min":0.74099999999999999},"min":{"1min":0.56100000000000005,"5min":0.53700000000000003,"15min":0.51300000000000001},"max":{"1min":0.89800000000000002,"5min":1.016,"15min":1.016},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.79000000000000004,"15min":0.77800000000000002},"min":{"1min":0.66500000000000004,"5min":0.53100000000000003,"15min":0.52000000000000002},"max":{"1min":1.016,"5min":1.038,"15min":1.038},"last":0.78900000000000003}]},{"osd":5,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.45500000000000002,"5min":0.41599999999999998,"15min":0.36799999999999999},"max":{"1min":0.96299999999999997,"5min":1.05,"15min":1.079},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64500000000000002,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34599999999999997},"max":{"1min":0.97399999999999998,"5min":1.016,"15min":1.016},"last":0.54600000000000004}]},{"osd":6,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.65400000000000003,"15min":0.64300000000000002},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90500000000000003,"5min":0.96099999999999997,"15min":1.018},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:01:41 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70699999999999996,"15min":0.67900000000000005},"min":{"1min":0.44,"5min":0.433,"15min":0.39800000000000002},"max":{"1min":1.0169999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77800000000000002,"15min":0.73699999999999999},"min":{"1min":0.54200000000000004,"5min":0.49299999999999999,"15min":0.46100000000000002},"max":{"1min":1.0149999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575323,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55652,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":53184,"kb_avail":94316188,"statfs":{"total":96636764160,"available":96579776512,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":54460416},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.47899999999999998,"15min":0.48099999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65400000000000003,"5min":1.175,"15min":1.175},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54200000000000004,"15min":0.55600000000000005},"min":{"1min":0.40200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69599999999999995,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.63600000000000001}]},{"osd":1,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.47899999999999998},"min":{"1min":0.34100000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":1.133},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.76900000000000002,"5min":0.84899999999999998,"15min":0.89500000000000002},"last":0.58599999999999997}]},{"osd":2,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":1.194},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.63500000000000001,"15min":0.64500000000000002},"min":{"1min":0.50800000000000001,"5min":0.436,"15min":0.39600000000000002},"max":{"1min":0.80000000000000004,"5min":0.89500000000000002,"15min":1.2390000000000001},"last":0.73399999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80100000000000005,"15min":0.80800000000000005},"min":{"1min":0.629,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.008,"5min":1.244,"15min":1.5429999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.83799999999999997,"15min":0.85199999999999998},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1200000000000001,"5min":1.133,"15min":1.5649999999999999},"last":0.81899999999999995}]},{"osd":5,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83599999999999997,"15min":0.84799999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.56599999999999995},"max":{"1min":1.0620000000000001,"5min":1.161,"15min":1.302},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.80400000000000005,"15min":0.81799999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.036,"5min":1.1419999999999999,"15min":1.4259999999999999},"last":1.014}]},{"osd":6,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.79000000000000004,"15min":0.79800000000000004},"min":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.98799999999999999,"5min":1.1879999999999999,"15min":1.262},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.79100000000000004,"15min":0.79600000000000004},"min":{"1min":0.622,"5min":0.498,"15min":0.498},"max":{"1min":0.97099999999999997,"5min":1.2010000000000001,"15min":1.363},"last":0.89700000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:02:27 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.81499999999999995,"15min":0.81599999999999995},"min":{"1min":0.65300000000000002,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.014,"5min":1.2769999999999999,"15min":1.601},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.81100000000000005,"15min":0.82199999999999995},"min":{"1min":0.61799999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.091,"5min":1.1639999999999999,"15min":1.4730000000000001},"last":0.98799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575324,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59748,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":57280,"kb_avail":94312092,"statfs":{"total":96636764160,"available":96575582208,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":58654720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.96499999999999997},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67800000000000005,"5min":0.77100000000000002,"15min":0.85099999999999998},"last":0.67400000000000004}]},{"osd":1,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.443},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.55100000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35899999999999999},"max":{"1min":0.78400000000000003,"5min":0.82499999999999996,"15min":0.99399999999999999},"last":0.61299999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.58199999999999996,"15min":0.59199999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.90000000000000002,"15min":1.016},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.76000000000000001,"5min":1.0049999999999999,"15min":1.2290000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.80000000000000004,"15min":0.79600000000000004},"min":{"1min":0.59599999999999997,"5min":0.58999999999999997,"15min":0.46600000000000003},"max":{"1min":1.1100000000000001,"5min":1.117,"15min":1.163},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.45000000000000001},"max":{"1min":1.131,"5min":1.1970000000000001,"15min":1.2070000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.85799999999999998,"15min":0.83799999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.014,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.749},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.82399999999999995,"15min":0.81000000000000005},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52200000000000002},"max":{"1min":0.97199999999999998,"5min":1.111,"15min":1.2330000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.58699999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0900000000000001,"5min":1.264,"15min":1.264},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.82899999999999996},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.52200000000000002},"max":{"1min":1.1879999999999999,"5min":1.232,"15min":1.294},"last":0.64200000000000002}]},{"osd":7,"last update":"Sun Jul 9 22:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.82599999999999996,"15min":0.82499999999999996},"min":{"1min":0.58699999999999997,"5min":0.58599999999999997,"15min":0.58399999999999996},"max":{"1min":1.224,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.046,"5min":1.196,"15min":1.2050000000000001},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834575323,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37604,"kb_used_data":2460,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334236,"statfs":{"total":96636764160,"available":96598257664,"internally_reserved":0,"allocated":2519040,"data_stored":1301383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.49199999999999999,"15min":0.47399999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68600000000000005,"5min":0.75600000000000001,"15min":0.96499999999999997},"last":0.441},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.51200000000000001,"15min":0.53000000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.69899999999999995,"5min":0.80600000000000005,"15min":0.89000000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.495,"15min":0.48999999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.622,"5min":0.752,"15min":0.81799999999999995},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.36599999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.89200000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.61499999999999999,"15min":0.61199999999999999},"min":{"1min":0.46100000000000002,"5min":0.45400000000000001,"15min":0.439},"max":{"1min":0.81699999999999995,"5min":0.82399999999999995,"15min":0.96999999999999997},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.72899999999999998,"5min":0.753,"15min":0.82699999999999996},"last":0.59199999999999997}]},{"osd":4,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.82399999999999995,"15min":0.82899999999999996},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1080000000000001,"5min":1.274,"15min":1.274},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.83499999999999996,"15min":0.84199999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1180000000000001,"5min":1.2769999999999999,"15min":1.337},"last":0.746}]},{"osd":5,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.80400000000000005,"15min":0.79700000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.46100000000000002},"max":{"1min":0.97099999999999997,"5min":1.1970000000000001,"15min":1.1970000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79300000000000004,"15min":0.80700000000000005},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.45600000000000002},"max":{"1min":1.01,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72499999999999998}]},{"osd":6,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.79400000000000004,"15min":0.78800000000000003},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97499999999999998,"5min":1.071,"15min":1.071},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.82899999999999996,"15min":0.82399999999999995},"min":{"1min":0.54900000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.079,"5min":1.157,"15min":1.157},"last":0.81499999999999995}]},{"osd":7,"last update":"Sun Jul 9 22:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.82199999999999995,"15min":0.81999999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.131,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.83899999999999997,"15min":0.83399999999999996},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.57799999999999996},"max":{"1min":1.0529999999999999,"5min":1.321,"15min":1.321},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834575324,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42280,"kb_used_data":3040,"kb_used_omap":0,"kb_used_meta":39232,"kb_avail":94329560,"statfs":{"total":96636764160,"available":96593469440,"internally_reserved":0,"allocated":3112960,"data_stored":1891751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40173568},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.307,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.65000000000000002,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.40400000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.54100000000000004}]},{"osd":2,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.35799999999999998,"5min":0.34999999999999998,"15min":0.32600000000000001},"max":{"1min":0.85699999999999998,"5min":1.2,"15min":1.2},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53500000000000003,"15min":0.55700000000000005},"min":{"1min":0.38300000000000001,"5min":0.376,"15min":0.34300000000000003},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.94799999999999995},"last":0.48599999999999999}]},{"osd":3,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50700000000000001,"15min":0.51800000000000002},"min":{"1min":0.34899999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.64800000000000002,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.754,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78700000000000003,"15min":0.80200000000000005},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.05,"5min":1.1850000000000001,"15min":1.306},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.77900000000000003,"15min":0.80100000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1319999999999999,"5min":1.351,"15min":1.351},"last":0.84199999999999997}]},{"osd":5,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.79200000000000004,"15min":0.80900000000000005},"min":{"1min":0.61499999999999999,"5min":0.52700000000000002,"15min":0.503},"max":{"1min":1.052,"5min":1.2529999999999999,"15min":1.3540000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80100000000000005,"15min":0.81999999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.51000000000000001},"max":{"1min":1.075,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.91400000000000003}]},{"osd":6,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.78500000000000003,"15min":0.80500000000000005},"min":{"1min":0.59099999999999997,"5min":0.53800000000000003,"15min":0.50700000000000001},"max":{"1min":0.97799999999999998,"5min":1.135,"15min":1.3260000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.80200000000000005,"15min":0.81899999999999995},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.48499999999999999},"max":{"1min":1.0680000000000001,"5min":1.381,"15min":1.381},"last":0.82799999999999996}]},{"osd":7,"last update":"Sun Jul 9 22:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.80700000000000005,"15min":0.83599999999999997},"min":{"1min":0.60599999999999998,"5min":0.55700000000000005,"15min":0.55000000000000004},"max":{"1min":1.0309999999999999,"5min":1.296,"15min":1.296},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.54700000000000004},"max":{"1min":1.0940000000000001,"5min":1.2210000000000001,"15min":1.397},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-09T22:02:36.952 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-07-09T22:02:37.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.088+0000 7f2c9d419640 1 Processor -- start 2023-07-09T22:02:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.088+0000 7f2c9d419640 1 -- start start 2023-07-09T22:02:37.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c9d419640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c980cdb10 0x7f2c9815cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c9d419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 0x7f2c9806b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c9d419640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c9815c780 con 0x7f2c9806bc90 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c9d419640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c9806c2c0 con 0x7f2c980cdb10 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c9d419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9806c5a0 con 0x7f2c980cdee0 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c980cdb10 0x7f2c9815cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2c980cdb10 0x7f2c9815cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51698/0 (socket says 172.21.15.37:51698) 2023-07-09T22:02:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 -- 172.21.15.37:0/611875715 learned_addr learned my addr 172.21.15.37:0/611875715 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c8ffff640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 0x7f2c9806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 -- 172.21.15.37:0/611875715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 msgr2=0x7f2c9806b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 0x7f2c9806b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 -- 172.21.15.37:0/611875715 >> v1:172.21.15.119:6789/0 conn(0x7f2c9806bc90 legacy=0x7f2c9806f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c97fff640 1 -- 172.21.15.37:0/611875715 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9815c410 con 0x7f2c980cdb10 2023-07-09T22:02:37.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.092+0000 7f2c8ffff640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 0x7f2c9806b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-09T22:02:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c97fff640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdb10 0x7f2c9815cc10 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009870 tx=0x7f2c8801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41e5abd1937b794 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c977fe640 1 -- 172.21.15.37:0/611875715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880ac630 con 0x7f2c980cdb10 2023-07-09T22:02:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c977fe640 1 -- 172.21.15.37:0/611875715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c880ac790 con 0x7f2c980cdb10 2023-07-09T22:02:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c977fe640 1 -- 172.21.15.37:0/611875715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c880acb20 con 0x7f2c980cdb10 2023-07-09T22:02:37.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- 172.21.15.37:0/611875715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdb10 msgr2=0x7f2c9815cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdb10 0x7f2c9815cc10 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f2c88009870 tx=0x7f2c8801c500 comp rx=0 tx=0).stop 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- 172.21.15.37:0/611875715 shutdown_connections 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdee0 0x7f2c9806b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 --2- 172.21.15.37:0/611875715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdb10 0x7f2c9815cc10 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- 172.21.15.37:0/611875715 >> 172.21.15.37:0/611875715 conn(0x7f2c980cef30 msgr2=0x7f2c980cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:37.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- 172.21.15.37:0/611875715 shutdown_connections 2023-07-09T22:02:37.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- 172.21.15.37:0/611875715 wait complete. 2023-07-09T22:02:37.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 Processor -- start 2023-07-09T22:02:37.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.096+0000 7f2c9d419640 1 -- start start 2023-07-09T22:02:37.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 0x7f2c98148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdb10 0x7f2c980c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980c5a80 con 0x7f2c980cdee0 2023-07-09T22:02:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c980cb890 con 0x7f2c9806bc90 2023-07-09T22:02:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9814fca0 con 0x7f2c980cdb10 2023-07-09T22:02:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51714/0 (socket says 172.21.15.37:51714) 2023-07-09T22:02:37.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 -- 172.21.15.37:0/520248088 learned_addr learned my addr 172.21.15.37:0/520248088 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:37.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c8ffff640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdb10 0x7f2c980c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c97fff640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 0x7f2c98148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 -- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdb10 msgr2=0x7f2c980c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdb10 0x7f2c980c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 -- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 msgr2=0x7f2c98148b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 0x7f2c98148b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 -- 172.21.15.37:0/520248088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c880094d0 con 0x7f2c980cdee0 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c97fff640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 0x7f2c98148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-09T22:02:37.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9cc18640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c7b0 tx=0x7f2c9000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c90004b70 con 0x7f2c980cdee0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c90004cd0 con 0x7f2c980cdee0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9000aa90 con 0x7f2c980cdee0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c980cac80 con 0x7f2c980cdee0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c980cb240 con 0x7f2c980cdee0 2023-07-09T22:02:37.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c980cba40 con 0x7f2c980cdee0 2023-07-09T22:02:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.100+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f2c9000abf0 con 0x7f2c980cdee0 2023-07-09T22:02:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.104+0000 7f2c957fa640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 0x7f2c78068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.104+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f2c90083f70 con 0x7f2c980cdee0 2023-07-09T22:02:37.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.104+0000 7f2c97fff640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 0x7f2c78068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.104+0000 7f2c97fff640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 0x7f2c78068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c880ae000 tx=0x7f2c88008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.108+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2c980cba40 con 0x7f2c980cdee0 2023-07-09T22:02:37.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.260+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2c98061100 con 0x7f2c980cdee0 2023-07-09T22:02:37.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.268+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2c900512b0 con 0x7f2c980cdee0 2023-07-09T22:02:37.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.268+0000 7f2c957fa640 1 -- 172.21.15.37:0/520248088 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v70)=0 v70) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2c90054d40 con 0x7f2c980cdee0 2023-07-09T22:02:37.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 msgr2=0x7f2c78068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 0x7f2c78068850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2c880ae000 tx=0x7f2c88008040 comp rx=0 tx=0).stop 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 msgr2=0x7f2c98149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c7b0 tx=0x7f2c9000cc70 comp rx=0 tx=0).stop 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 shutdown_connections 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2c980cdee0 0x7f2c98149ac0 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f2c780663a0 0x7f2c78068850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f2c980cdb10 0x7f2c980c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 --2- 172.21.15.37:0/520248088 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f2c9806bc90 0x7f2c98148b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 >> 172.21.15.37:0/520248088 conn(0x7f2c980cef30 msgr2=0x7f2c9814f240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:37.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 shutdown_connections 2023-07-09T22:02:37.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.272+0000 7f2c9d419640 1 -- 172.21.15.37:0/520248088 wait complete. 2023-07-09T22:02:37.293 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-07-09T22:02:37.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-09T22:02:37.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 Processor -- start 2023-07-09T22:02:37.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 -- start start 2023-07-09T22:02:37.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16100ace40 0x7f16100ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1610098200 0x7f16100b0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 -- --> v1:172.21.15.119:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f161015c1c0 con 0x7f16100affb0 2023-07-09T22:02:37.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 -- --> v2:172.21.15.119:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16100af8b0 con 0x7f16100ace40 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1614c19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161006d9f0 con 0x7f1610098200 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f160e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16100ace40 0x7f16100ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f160ed9d640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1610098200 0x7f16100b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f160e59c640 1 --2- >> v2:172.21.15.119:3300/0 conn(0x7f16100ace40 0x7f16100ae880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.119:3300/0 says I am v2:172.21.15.37:46640/0 (socket says 172.21.15.37:46640) 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f1607fff640 1 --1- >> v1:172.21.15.119:6789/0 conn(0x7f16100affb0 0x7f1610097af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.119:6789/0 says I am v1:172.21.15.37:50100/0 (socket says 172.21.15.37:50100) 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.432+0000 7f160e59c640 1 -- 172.21.15.37:0/3536370651 learned_addr learned my addr 172.21.15.37:0/3536370651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:37.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160e59c640 1 -- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1610098200 msgr2=0x7f16100b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-09T22:02:37.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160e59c640 1 --2- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1610098200 0x7f16100b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160e59c640 1 -- 172.21.15.37:0/3536370651 >> v1:172.21.15.119:6789/0 conn(0x7f16100affb0 legacy=0x7f1610097af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160e59c640 1 -- 172.21.15.37:0/3536370651 --> v2:172.21.15.119:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f161006dc40 con 0x7f16100ace40 2023-07-09T22:02:37.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160e59c640 1 --2- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100ace40 0x7f16100ae880 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1600009870 tx=0x7f160001c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66080a179b7ea232 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160dd9b640 1 -- 172.21.15.37:0/3536370651 <== mon.1 v2:172.21.15.119:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000a7070 con 0x7f16100ace40 2023-07-09T22:02:37.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160dd9b640 1 -- 172.21.15.37:0/3536370651 <== mon.1 v2:172.21.15.119:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f16000ab430 con 0x7f16100ace40 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f160dd9b640 1 -- 172.21.15.37:0/3536370651 <== mon.1 v2:172.21.15.119:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16000ab7e0 con 0x7f16100ace40 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 -- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100ace40 msgr2=0x7f16100ae880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 --2- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100ace40 0x7f16100ae880 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1600009870 tx=0x7f160001c540 comp rx=0 tx=0).stop 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 -- 172.21.15.37:0/3536370651 shutdown_connections 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 --2- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f1610098200 0x7f16100b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 --2- 172.21.15.37:0/3536370651 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f16100ace40 0x7f16100ae880 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.436+0000 7f1614c19640 1 -- 172.21.15.37:0/3536370651 >> 172.21.15.37:0/3536370651 conn(0x7f1610096fb0 msgr2=0x7f16100b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:37.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- 172.21.15.37:0/3536370651 shutdown_connections 2023-07-09T22:02:37.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- 172.21.15.37:0/3536370651 wait complete. 2023-07-09T22:02:37.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 Processor -- start 2023-07-09T22:02:37.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- start start 2023-07-09T22:02:37.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 --2- >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1610098200 0x7f16101576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 --2- >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16100ace40 0x7f1610158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16101591e0 con 0x7f16100affb0 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- --> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f161006a730 con 0x7f1610098200 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1614c19640 1 -- --> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f161006aa10 con 0x7f16100ace40 2023-07-09T22:02:37.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40618/0 (socket says 172.21.15.37:40618) 2023-07-09T22:02:37.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 -- 172.21.15.37:0/3422790831 learned_addr learned my addr 172.21.15.37:0/3422790831 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-07-09T22:02:37.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160e59c640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1610098200 0x7f16101576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f1607fff640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16100ace40 0x7f1610158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 -- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16100ace40 msgr2=0x7f1610158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16100ace40 0x7f1610158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 -- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1610098200 msgr2=0x7f16101576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1610098200 0x7f16101576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 -- 172.21.15.37:0/3422790831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16000094d0 con 0x7f16100affb0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.440+0000 7f160ed9d640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f160800efc0 tx=0x7f160800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1608009ca0 con 0x7f16100affb0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f160800f040 con 0x7f16100affb0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16080146e0 con 0x7f16100affb0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f161006acf0 con 0x7f16100affb0 2023-07-09T22:02:37.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1610157be0 con 0x7f16100affb0 2023-07-09T22:02:37.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1610066bc0 con 0x7f16100affb0 2023-07-09T22:02:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 98) v1 ==== 85760+0+0 (secure 0 0 0) 0x7f1608014840 con 0x7f16100affb0 2023-07-09T22:02:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 0x7f15f0068850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-09T22:02:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 6083+0+0 (secure 0 0 0) 0x7f1608084ea0 con 0x7f16100affb0 2023-07-09T22:02:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.444+0000 7f160e59c640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 0x7f15f0068850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-09T22:02:37.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.448+0000 7f160e59c640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 0x7f15f0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f16000af000 tx=0x7f1600008040 comp rx=0 tx=0).ready entity=mgr.9047 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-09T22:02:37.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.448+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1608052060 con 0x7f16100affb0 2023-07-09T22:02:37.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f161006b1a0 con 0x7f16100affb0 2023-07-09T22:02:37.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1606ffd640 1 -- 172.21.15.37:0/3422790831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f1608018070 con 0x7f16100affb0 2023-07-09T22:02:37.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-07-09T22:02:37.639 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":86,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8762,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6837/1860940452","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6835","nonce":1860940452},{"type":"v1","addr":"172.21.15.119:6837","nonce":1860940452}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10168,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.119:6836/3044908275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.119:6834","nonce":3044908275},{"type":"v1","addr":"172.21.15.119:6836","nonce":3044908275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":10758,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/1500735544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":1500735544},{"type":"v1","addr":"172.21.15.37:6833","nonce":1500735544}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":11325,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/3400843454","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":3400843454},{"type":"v1","addr":"172.21.15.37:6835","nonce":3400843454}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":86}],"filesystems":[]} 2023-07-09T22:02:37.640 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 86 2023-07-09T22:02:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 msgr2=0x7f15f0068850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 0x7f15f0068850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f16000af000 tx=0x7f1600008040 comp rx=0 tx=0).stop 2023-07-09T22:02:37.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 msgr2=0x7f161015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-09T22:02:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7f160800efc0 tx=0x7f160800c490 comp rx=0 tx=0).stop 2023-07-09T22:02:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 shutdown_connections 2023-07-09T22:02:37.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16100affb0 0x7f161015abf0 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:6832/2763450555,v1:172.21.15.119:6833/2763450555] conn(0x7f15f00663a0 0x7f15f0068850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3301/0,v1:172.21.15.119:6790/0] conn(0x7f16100ace40 0x7f1610158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 --2- 172.21.15.37:0/3422790831 >> [v2:172.21.15.119:3300/0,v1:172.21.15.119:6789/0] conn(0x7f1610098200 0x7f16101576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-09T22:02:37.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 >> 172.21.15.37:0/3422790831 conn(0x7f1610096fb0 msgr2=0x7f16100ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-09T22:02:37.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 shutdown_connections 2023-07-09T22:02:37.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-07-09T22:02:37.636+0000 7f1614c19640 1 -- 172.21.15.37:0/3422790831 wait complete. 2023-07-09T22:02:37.660 DEBUG:tasks.cephfs.filesystem:already dead... 2023-07-09T22:02:37.660 INFO:teuthology.misc:Shutting down mds daemons... 2023-07-09T22:02:37.661 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-07-09T22:02:37.661 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.673 INFO:tasks.ceph.mds.a:Stopped 2023-07-09T22:02:37.674 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-07-09T22:02:37.674 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.729 INFO:tasks.ceph.mds.c:Stopped 2023-07-09T22:02:37.730 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-07-09T22:02:37.730 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.745 INFO:tasks.ceph.mds.b:Stopped 2023-07-09T22:02:37.746 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-07-09T22:02:37.747 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.802 INFO:tasks.ceph.mds.d:Stopped 2023-07-09T22:02:37.803 INFO:teuthology.misc:Shutting down osd daemons... 2023-07-09T22:02:37.804 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-07-09T22:02:37.805 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.887 INFO:tasks.ceph.osd.0:Stopped 2023-07-09T22:02:37.888 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-07-09T22:02:37.888 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:37.982 INFO:tasks.ceph.osd.1:Stopped 2023-07-09T22:02:37.983 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-07-09T22:02:37.983 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:38.066 INFO:tasks.ceph.osd.2:Stopped 2023-07-09T22:02:38.067 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-07-09T22:02:38.067 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:38.156 INFO:tasks.ceph.osd.3:Stopped 2023-07-09T22:02:38.157 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-07-09T22:02:38.158 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:39.176 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-07-09T22:02:44.260 INFO:tasks.ceph.osd.4:Stopped 2023-07-09T22:02:44.261 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-07-09T22:02:44.261 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:44.322 INFO:tasks.ceph.osd.5:Stopped 2023-07-09T22:02:44.322 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-07-09T22:02:44.323 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:44.383 INFO:tasks.ceph.osd.6:Stopped 2023-07-09T22:02:44.384 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-07-09T22:02:44.384 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:44.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~6s 2023-07-09T22:02:50.486 INFO:tasks.ceph.osd.7:Stopped 2023-07-09T22:02:50.487 INFO:teuthology.misc:Shutting down mgr daemons... 2023-07-09T22:02:50.487 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-07-09T22:02:50.487 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:50.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-07-09T22:02:50.488 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-07-09T22:02:50.547 INFO:tasks.ceph.mgr.y:Stopped 2023-07-09T22:02:50.548 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-07-09T22:02:50.548 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:50.612 INFO:tasks.ceph.mgr.x:Stopped 2023-07-09T22:02:50.612 INFO:teuthology.misc:Shutting down mon daemons... 2023-07-09T22:02:50.612 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-07-09T22:02:50.613 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:50.638 INFO:tasks.ceph.mon.a:Stopped 2023-07-09T22:02:50.639 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-07-09T22:02:50.639 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:50.659 INFO:tasks.ceph.mon.b:Stopped 2023-07-09T22:02:50.659 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-07-09T22:02:50.660 INFO:teuthology.orchestra.run:waiting for 300 2023-07-09T22:02:50.720 INFO:tasks.ceph.mon.c:Stopped 2023-07-09T22:02:50.721 INFO:tasks.ceph:Checking cluster log for badness... 2023-07-09T22:02:50.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-09T22:02:50.751 INFO:teuthology.orchestra.run.smithi037.stdout:2023-07-09T21:24:57.853825+0000 mon.a (mon.0) 373 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-09T22:02:50.752 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-07-09T22:02:50.753 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-09T22:02:50.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-09T22:02:50.899 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-07-09T22:02:50.973 INFO:teuthology.orchestra.run.smithi037.stdout:2023-07-09T21:24:57.853825+0000 mon.a (mon.0) 373 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2023-07-09T22:02:50.974 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:02:50.974 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-07-09T22:02:51.567 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:02:51.568 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-07-09T22:02:51.919 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:02:51.920 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-07-09T22:02:52.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:02:52.369 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-07-09T22:02:52.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:02:52.728 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-07-09T22:02:53.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:02:53.123 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-07-09T22:02:53.491 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:02:53.491 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-07-09T22:02:53.811 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:02:53.811 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-07-09T22:02:54.227 INFO:tasks.ceph:Archiving mon data... 2023-07-09T22:02:54.228 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/data/mon.a.tgz 2023-07-09T22:02:54.229 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-07-09T22:02:54.239 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.aRmcHxEn0I 2023-07-09T22:02:54.239 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.aRmcHxEn0I 2023-07-09T22:02:54.677 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.aRmcHxEn0I 2023-07-09T22:02:54.753 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.aRmcHxEn0I is 2MB 2023-07-09T22:02:54.842 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.aRmcHxEn0I 2023-07-09T22:02:54.852 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/data/mon.b.tgz 2023-07-09T22:02:54.852 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-07-09T22:02:54.861 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.xYSErtiPyf 2023-07-09T22:02:54.862 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.xYSErtiPyf 2023-07-09T22:02:55.273 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.xYSErtiPyf 2023-07-09T22:02:55.353 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.xYSErtiPyf is 2MB 2023-07-09T22:02:55.444 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.xYSErtiPyf 2023-07-09T22:02:55.453 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/data/mon.c.tgz 2023-07-09T22:02:55.453 DEBUG:teuthology.orchestra.run.smithi119:> mktemp 2023-07-09T22:02:55.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-07-09T22:02:55.507 INFO:teuthology.orchestra.run.smithi119.stdout:/tmp/tmp.MJ4PSWJf1L 2023-07-09T22:02:55.508 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.MJ4PSWJf1L 2023-07-09T22:02:55.919 DEBUG:teuthology.orchestra.run.smithi119:> sudo chmod 0666 /tmp/tmp.MJ4PSWJf1L 2023-07-09T22:02:55.994 DEBUG:teuthology.orchestra.remote:smithi119:/tmp/tmp.MJ4PSWJf1L is 2MB 2023-07-09T22:02:56.084 DEBUG:teuthology.orchestra.run.smithi119:> rm -fr /tmp/tmp.MJ4PSWJf1L 2023-07-09T22:02:56.094 INFO:tasks.ceph:Cleaning ceph cluster... 2023-07-09T22:02:56.094 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T22:02:56.098 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-07-09T22:02:56.159 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-07-09T22:02:56.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T22:02:56.164 DEBUG:teuthology.orchestra.run.smithi119:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-07-09T22:02:56.199 INFO:teuthology.orchestra.run.smithi037.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T22:02:56.228 INFO:teuthology.orchestra.run.smithi119.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-07-09T22:02:56.235 INFO:tasks.ceph:Archiving crash dumps... 2023-07-09T22:02:56.237 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi037/crash 2023-07-09T22:02:56.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T22:02:56.275 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi119/crash 2023-07-09T22:02:56.276 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-07-09T22:02:56.296 INFO:tasks.ceph:Shutting down logrotate 2023-07-09T22:02:56.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:56.328 DEBUG:teuthology.orchestra.run.smithi119:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:56.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:56.406 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-07-09T22:02:56.448 INFO:tasks.ceph:Compressing logs... 2023-07-09T22:02:56.449 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T22:02:56.455 DEBUG:teuthology.orchestra.run.smithi119:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-09T22:02:56.483 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65793.log 2023-07-09T22:02:56.484 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45243.log 2023-07-09T22:02:56.485 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-07-09T22:02:56.485 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.65793.log.gz 2023-07-09T22:02:56.486 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60831.log 2023-07-09T22:02:56.486 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45243.log.gz 2023-07-09T22:02:56.487 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66860.log 2023-07-09T22:02:56.487 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-07-09T22:02:56.488 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59193.log 2023-07-09T22:02:56.488 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60831.log.gz 2023-07-09T22:02:56.489 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65741.log 2023-07-09T22:02:56.489 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66860.log.gz 2023-07-09T22:02:56.490 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49797.log 2023-07-09T22:02:56.490 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59193.log.gz 2023-07-09T22:02:56.491 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64736.log 2023-07-09T22:02:56.491 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65741.log.gz 2023-07-09T22:02:56.492 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45876.log 2023-07-09T22:02:56.492 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49797.log.gz 2023-07-09T22:02:56.493 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43473.log 2023-07-09T22:02:56.493 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.64736.log.gz 2023-07-09T22:02:56.494 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65306.log 2023-07-09T22:02:56.494 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45876.log.gz 2023-07-09T22:02:56.495 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62978.log 2023-07-09T22:02:56.495 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43473.log.gz 2023-07-09T22:02:56.496 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54398.log 2023-07-09T22:02:56.497 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.65306.log.gz 2023-07-09T22:02:56.497 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61430.log 2023-07-09T22:02:56.497 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62978.log.gz 2023-07-09T22:02:56.498 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57330.log 2023-07-09T22:02:56.499 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54398.log.gz 2023-07-09T22:02:56.500 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47499.log 2023-07-09T22:02:56.500 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61430.log.gz 2023-07-09T22:02:56.500 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49549.log 2023-07-09T22:02:56.500 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57330.log.gz 2023-07-09T22:02:56.501 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64894.log 2023-07-09T22:02:56.501 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47499.log.gz 2023-07-09T22:02:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49549.log: gzip -5 --verbose 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.49549.log.gz /var/log/ceph/ceph-client.admin.52655.log 2023-07-09T22:02:56.502 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.503 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56928.log 2023-07-09T22:02:56.503 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64894.log.gz 2023-07-09T22:02:56.504 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65024.log 2023-07-09T22:02:56.504 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52655.log.gz 2023-07-09T22:02:56.505 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66611.log 2023-07-09T22:02:56.505 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56928.log.gz 2023-07-09T22:02:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53722.log 2023-07-09T22:02:56.506 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.65024.log.gz 2023-07-09T22:02:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62180.log 2023-07-09T22:02:56.507 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.66611.log.gz 2023-07-09T22:02:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61797.log 2023-07-09T22:02:56.508 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53722.log.gz 2023-07-09T22:02:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47113.log 2023-07-09T22:02:56.509 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62180.log.gz 2023-07-09T22:02:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54304.log 2023-07-09T22:02:56.510 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61797.log.gz 2023-07-09T22:02:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66806.log 2023-07-09T22:02:56.511 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47113.log.gz 2023-07-09T22:02:56.511 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65076.log 2023-07-09T22:02:56.512 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54304.log.gz 2023-07-09T22:02:56.512 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59349.log 2023-07-09T22:02:56.513 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66806.log.gz 2023-07-09T22:02:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57534.log 2023-07-09T22:02:56.514 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.65076.log.gz 2023-07-09T22:02:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.59349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62744.log 2023-07-09T22:02:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57534.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57534.log.gz 2023-07-09T22:02:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55367.log 2023-07-09T22:02:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65418.log 2023-07-09T22:02:56.517 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62744.log.gz 2023-07-09T22:02:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55367.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55367.log.gz 2023-07-09T22:02:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61901.log 2023-07-09T22:02:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65418.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65418.log.gz 2023-07-09T22:02:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54476.log 2023-07-09T22:02:56.519 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61901.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.61198.log -- replaced with /var/log/ceph/ceph-client.admin.61901.log.gz 2023-07-09T22:02:56.520 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43943.log 87.8% 2023-07-09T22:02:56.521 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54476.log.gz 2023-07-09T22:02:56.521 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61198.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-mgr.y.log -- replaced with /var/log/ceph/ceph-client.admin.61198.log.gz 2023-07-09T22:02:56.522 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.522 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2023-07-09T22:02:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43943.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43943.log.gz 2023-07-09T22:02:56.523 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60096.log 2023-07-09T22:02:56.524 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37706.log 2023-07-09T22:02:56.524 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64077.log 2023-07-09T22:02:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48215.log 2023-07-09T22:02:56.525 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60096.log.gz 2023-07-09T22:02:56.526 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2023-07-09T22:02:56.526 INFO:teuthology.orchestra.run.smithi119.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2023-07-09T22:02:56.526 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37706.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37706.log.gz 2023-07-09T22:02:56.526 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-07-09T22:02:56.528 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37754.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2023-07-09T22:02:56.528 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-07-09T22:02:56.528 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37634.log 2023-07-09T22:02:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43089.log 2023-07-09T22:02:56.529 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64077.log.gz 2023-07-09T22:02:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48215.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48215.log.gz 2023-07-09T22:02:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57016.log 2023-07-09T22:02:56.530 INFO:teuthology.orchestra.run.smithi037.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.0.59349.log.gz 2023-07-09T22:02:56.530 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68669.log 2023-07-09T22:02:56.530 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43089.log.gz 2023-07-09T22:02:56.531 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57016.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57016.log.gzgzip 2023-07-09T22:02:56.532 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48007.log 2023-07-09T22:02:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53978.log 2023-07-09T22:02:56.532 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68669.log.gz 2023-07-09T22:02:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48007.log: gzip -5 87.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48007.log.gz 2023-07-09T22:02:56.532 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.46691.log 2023-07-09T22:02:56.533 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37658.log 2023-07-09T22:02:56.533 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37634.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37634.log.gz 2023-07-09T22:02:56.533 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-07-09T22:02:56.534 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37658.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37658.log.gz 2023-07-09T22:02:56.534 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-07-09T22:02:56.534 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2023-07-09T22:02:56.534 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T22:02:56.535 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37778.log 2023-07-09T22:02:56.535 INFO:teuthology.orchestra.run.smithi119.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gz 2023-07-09T22:02:56.536 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53668.log 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53978.log.gz 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46691.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.46691.log.gz 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44134.log 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66692.log 88.8% 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53668.log.gz 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44134.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44134.log.gz 2023-07-09T22:02:56.537 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60148.log 2023-07-09T22:02:56.538 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2023-07-09T22:02:56.538 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.66692.log.gz 2023-07-09T22:02:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-07-09T22:02:56.539 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37778.log: gzip 88.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.37778.log.gz -- 2023-07-09T22:02:56.539 INFO:teuthology.orchestra.run.smithi119.stderr: /var/log/ceph/ceph.audit.log 2023-07-09T22:02:56.540 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2023-07-09T22:02:56.540 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60148.log.gz 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48445.log 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49577.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48445.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.48445.log.gz /var/log/ceph/ceph-client.admin.57813.log 2023-07-09T22:02:56.541 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2023-07-09T22:02:56.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43450.log 2023-07-09T22:02:56.543 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.admin.37682.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56195.log 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57813.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57813.log.gz 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44383.log 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56195.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56195.log.gz 2023-07-09T22:02:56.544 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46272.log 2023-07-09T22:02:56.546 INFO:teuthology.orchestra.run.smithi119.stderr: 93.6%gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-07-09T22:02:56.546 INFO:teuthology.orchestra.run.smithi119.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T22:02:56.546 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.1.43450.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-07-09T22:02:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69110.log 2023-07-09T22:02:56.547 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44383.log.gz 2023-07-09T22:02:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63525.log 2023-07-09T22:02:56.547 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46272.log.gz 2023-07-09T22:02:56.547 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69110.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69110.log.gz 2023-07-09T22:02:56.548 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61849.log 2023-07-09T22:02:56.549 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.d.log: 89.9% -- replaced with /var/log/ceph/ceph-client.1.43450.log.gz 2023-07-09T22:02:56.549 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-07-09T22:02:56.549 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56116.log 2023-07-09T22:02:56.549 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63525.log.gz 2023-07-09T22:02:56.550 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61849.log: gzip -5 86.8% --verbose -- replaced with /var/log/ceph/ceph-client.admin.61849.log.gz 2023-07-09T22:02:56.550 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.68720.log 2023-07-09T22:02:56.551 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T22:02:56.551 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53694.log 2023-07-09T22:02:56.552 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56116.log.gz 2023-07-09T22:02:56.552 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68720.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68720.log.gz 2023-07-09T22:02:56.552 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45955.log 2023-07-09T22:02:56.553 INFO:teuthology.orchestra.run.smithi119.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-07-09T22:02:56.553 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62796.log 2023-07-09T22:02:56.553 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53694.log.gz 2023-07-09T22:02:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55393.log 88.7% 2023-07-09T22:02:56.554 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45955.log.gz 2023-07-09T22:02:56.554 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2023-07-09T22:02:56.555 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62796.log.gz 2023-07-09T22:02:56.555 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55393.log: gzip -5 --verbose 87.9% -- -- replaced with /var/log/ceph/ceph-client.admin.55393.log.gz /var/log/ceph/ceph-client.admin.61148.log 2023-07-09T22:02:56.555 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.556 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44331.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz /var/log/ceph/ceph-client.admin.57508.log 2023-07-09T22:02:56.556 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.557 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67552.log 2023-07-09T22:02:56.557 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.61148.log.gz 2023-07-09T22:02:56.558 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51425.log 2023-07-09T22:02:56.558 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57508.log.gz 2023-07-09T22:02:56.559 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50359.log 2023-07-09T22:02:56.559 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67552.log.gz 2023-07-09T22:02:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51425.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51425.log.gz 2023-07-09T22:02:56.560 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2023-07-09T22:02:56.561 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61517.log 2023-07-09T22:02:56.561 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50359.log.gz 2023-07-09T22:02:56.562 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47035.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz --verbose 2023-07-09T22:02:56.562 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.46639.log 2023-07-09T22:02:56.563 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61517.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.61517.log.gz --verbose 2023-07-09T22:02:56.563 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.69032.log 2023-07-09T22:02:56.564 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-07-09T22:02:56.564 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2023-07-09T22:02:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69032.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69032.log.gz 2023-07-09T22:02:56.565 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55289.log 2023-07-09T22:02:56.566 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43233.log 2023-07-09T22:02:56.567 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50940.log 2023-07-09T22:02:56.567 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55289.log.gz 2023-07-09T22:02:56.568 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59167.log 2023-07-09T22:02:56.568 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43233.log.gz 2023-07-09T22:02:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50940.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50940.log.gz 2023-07-09T22:02:56.569 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51889.log 2023-07-09T22:02:56.570 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43557.log 2023-07-09T22:02:56.571 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58167.log 2023-07-09T22:02:56.571 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59167.log.gz 2023-07-09T22:02:56.572 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66272.log 2023-07-09T22:02:56.572 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51889.log.gz 2023-07-09T22:02:56.573 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62441.log 2023-07-09T22:02:56.573 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58167.log.gz 2023-07-09T22:02:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66272.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66272.log.gz 2023-07-09T22:02:56.574 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46090.log 2023-07-09T22:02:56.575 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65862.log 2023-07-09T22:02:56.576 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62441.log.gz 2023-07-09T22:02:56.576 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46090.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46090.log.gz 2023-07-09T22:02:56.577 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47551.log 2023-07-09T22:02:56.577 INFO:teuthology.orchestra.run.smithi037.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-07-09T22:02:56.578 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60637.log 2023-07-09T22:02:56.578 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65862.log.gz 2023-07-09T22:02:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47551.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47551.log.gz 2023-07-09T22:02:56.579 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2023-07-09T22:02:56.580 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52029.log 2023-07-09T22:02:56.580 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60637.log.gz 2023-07-09T22:02:56.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50069.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2023-07-09T22:02:56.581 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64842.log 2023-07-09T22:02:56.582 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43727.log 2023-07-09T22:02:56.582 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52029.log.gz 2023-07-09T22:02:56.583 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64842.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.43499.log -- replaced with /var/log/ceph/ceph-client.admin.64842.log.gz 2023-07-09T22:02:56.583 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.584 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2023-07-09T22:02:56.584 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43727.log.gz 2023-07-09T22:02:56.585 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-osd.4.log: 92.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-07-09T22:02:56.586 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46033.log 2023-07-09T22:02:56.586 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43499.log.gz 2023-07-09T22:02:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46905.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2023-07-09T22:02:56.587 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47785.log 2023-07-09T22:02:56.588 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46033.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.46033.log.gz 2023-07-09T22:02:56.588 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.62640.log 2023-07-09T22:02:56.588 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68206.log 88.1% 2023-07-09T22:02:56.589 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47785.log.gz 2023-07-09T22:02:56.589 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62640.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62640.log.gz 2023-07-09T22:02:56.589 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62952.log 2023-07-09T22:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68206.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68206.log.gz 2023-07-09T22:02:56.590 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54684.log 2023-07-09T22:02:56.591 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62952.log: gzip -5 87.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.62952.log.gz -- 2023-07-09T22:02:56.591 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.66045.log 2023-07-09T22:02:56.592 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54684.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54684.log.gz -5 2023-07-09T22:02:56.592 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50557.log 2023-07-09T22:02:56.593 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66045.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.66045.log.gz 2023-07-09T22:02:56.593 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61677.log 2023-07-09T22:02:56.594 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50557.log: gzip 87.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.50557.log.gz --verbose 2023-07-09T22:02:56.594 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.63869.log 2023-07-09T22:02:56.595 INFO:teuthology.orchestra.run.smithi119.stderr:/var/log/ceph/ceph-client.3.43557.log: 91.0% -- replaced with /var/log/ceph/ceph-client.3.43557.log.gz 2023-07-09T22:02:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61677.log: 87.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.61677.log.gz 2023-07-09T22:02:56.596 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53299.log 2023-07-09T22:02:56.596 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63869.log: gzip 87.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.63869.log.gz --verbose 2023-07-09T22:02:56.596 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.68902.log 2023-07-09T22:02:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53299.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53299.log.gz 2023-07-09T22:02:56.597 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67793.log 2023-07-09T22:02:56.598 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68902.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68902.log.gz 2023-07-09T22:02:56.599 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53408.log 2023-07-09T22:02:56.600 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67793.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.67793.log.gz 2023-07-09T22:02:56.600 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66246.log 2023-07-09T22:02:56.600 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53408.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.53408.log.gz 2023-07-09T22:02:56.601 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59112.log 2023-07-09T22:02:56.601 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66246.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66246.log.gz 2023-07-09T22:02:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48839.log 2023-07-09T22:02:56.602 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60297.log 88.8% 2023-07-09T22:02:56.603 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59112.log.gz 2023-07-09T22:02:56.603 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46774.log 2023-07-09T22:02:56.604 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48839.log.gz 2023-07-09T22:02:56.604 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60297.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60297.log.gz 2023-07-09T22:02:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61122.log 2023-07-09T22:02:56.605 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67578.log 2023-07-09T22:02:56.606 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46774.log.gz 2023-07-09T22:02:56.606 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57757.log 2023-07-09T22:02:56.606 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61122.log.gz 2023-07-09T22:02:56.607 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67578.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67578.log.gzgzip 2023-07-09T22:02:56.607 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61979.log 2023-07-09T22:02:56.608 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53038.log 2023-07-09T22:02:56.608 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.57757.log.gz 2023-07-09T22:02:56.609 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61979.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61979.log.gz 2023-07-09T22:02:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68414.log 2023-07-09T22:02:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53038.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53038.log.gz 2023-07-09T22:02:56.610 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45981.log 2023-07-09T22:02:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67631.log 2023-07-09T22:02:56.612 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68414.log.gz 2023-07-09T22:02:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45981.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45981.log.gz 2023-07-09T22:02:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60349.log 2023-07-09T22:02:56.613 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55523.log 2023-07-09T22:02:56.614 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67631.log.gz 2023-07-09T22:02:56.614 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62005.log 2023-07-09T22:02:56.614 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60349.log.gz 2023-07-09T22:02:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55523.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55523.log.gzgzip 2023-07-09T22:02:56.615 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66886.log 2023-07-09T22:02:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62005.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62005.log.gz 2023-07-09T22:02:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68798.log 2023-07-09T22:02:56.617 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64331.log 2023-07-09T22:02:56.617 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66886.log.gz 2023-07-09T22:02:56.618 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2023-07-09T22:02:56.618 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68798.log.gz 2023-07-09T22:02:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64331.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64331.log.gz 2023-07-09T22:02:56.619 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65356.log 2023-07-09T22:02:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48111.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2023-07-09T22:02:56.620 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66533.log 2023-07-09T22:02:56.621 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65356.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.65356.log.gz 2023-07-09T22:02:56.621 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57610.log 2023-07-09T22:02:56.622 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66533.log: gzip 89.5% -- replaced with /var/log/ceph/ceph-client.admin.66533.log.gz 2023-07-09T22:02:56.622 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.68008.log 2023-07-09T22:02:56.623 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57610.log: gzip 88.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.57610.log.gz --verbose 2023-07-09T22:02:56.623 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.63288.log 2023-07-09T22:02:56.624 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68008.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.68008.log.gz 2023-07-09T22:02:56.624 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.69293.log 2023-07-09T22:02:56.625 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2023-07-09T22:02:56.625 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63288.log.gz 2023-07-09T22:02:56.626 INFO:teuthology.orchestra.run.smithi119.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-07-09T22:02:56.626 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69293.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.69293.log.gz 2023-07-09T22:02:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62576.log 2023-07-09T22:02:56.627 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67526.log 2023-07-09T22:02:56.627 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2023-07-09T22:02:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62576.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62576.log.gz 2023-07-09T22:02:56.628 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37402.log 2023-07-09T22:02:56.629 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53564.log 2023-07-09T22:02:56.629 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.67526.log.gz 2023-07-09T22:02:56.630 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56822.log 2023-07-09T22:02:56.630 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37402.log.gz 2023-07-09T22:02:56.631 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65967.log 2023-07-09T22:02:56.631 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53564.log.gz 2023-07-09T22:02:56.632 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56822.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56822.log.gz 2023-07-09T22:02:56.632 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68362.log 2023-07-09T22:02:56.633 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65967.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65967.log.gz 2023-07-09T22:02:56.633 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2023-07-09T22:02:56.634 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2023-07-09T22:02:56.635 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68362.log.gz 2023-07-09T22:02:56.635 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49741.log 2023-07-09T22:02:56.635 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2023-07-09T22:02:56.636 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55753.log 2023-07-09T22:02:56.636 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2023-07-09T22:02:56.637 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58681.log 2023-07-09T22:02:56.637 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49741.log.gz 2023-07-09T22:02:56.638 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58956.log 2023-07-09T22:02:56.638 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55753.log.gz 2023-07-09T22:02:56.639 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2023-07-09T22:02:56.639 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58681.log.gz 2023-07-09T22:02:56.640 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58956.log: gzip 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58956.log.gz -5 2023-07-09T22:02:56.640 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2023-07-09T22:02:56.641 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64920.log 2023-07-09T22:02:56.641 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2023-07-09T22:02:56.642 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55023.log 2023-07-09T22:02:56.642 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2023-07-09T22:02:56.643 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64920.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.64920.log.gz -5 2023-07-09T22:02:56.643 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.64674.log 2023-07-09T22:02:56.644 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63895.log 2023-07-09T22:02:56.644 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55023.log.gz 2023-07-09T22:02:56.645 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67952.log 2023-07-09T22:02:56.645 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64674.log.gz 2023-07-09T22:02:56.646 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67376.log 2023-07-09T22:02:56.646 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63895.log.gz 2023-07-09T22:02:56.647 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45850.log 2023-07-09T22:02:56.647 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.67952.log.gz 2023-07-09T22:02:56.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67376.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.67376.log.gz 2023-07-09T22:02:56.648 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58708.log 2023-07-09T22:02:56.649 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45850.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45850.log.gz 2023-07-09T22:02:56.649 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69240.log 2023-07-09T22:02:56.650 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62848.log 2023-07-09T22:02:56.650 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58708.log.gz 2023-07-09T22:02:56.651 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59940.log 2023-07-09T22:02:56.651 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69240.log.gz 2023-07-09T22:02:56.652 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62848.log: gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.46168.log -- replaced with /var/log/ceph/ceph-client.admin.62848.log.gz 2023-07-09T22:02:56.652 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59940.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59940.log.gz 2023-07-09T22:02:56.653 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2023-07-09T22:02:56.654 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46665.log 2023-07-09T22:02:56.654 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46168.log.gz 2023-07-09T22:02:56.655 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53273.log 2023-07-09T22:02:56.655 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz 2023-07-09T22:02:56.656 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58734.log 2023-07-09T22:02:56.656 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46665.log.gz 2023-07-09T22:02:56.657 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63182.log 2023-07-09T22:02:56.658 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53273.log.gz 2023-07-09T22:02:56.658 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58734.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58734.log.gz 2023-07-09T22:02:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45133.log 2023-07-09T22:02:56.659 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54899.log 2023-07-09T22:02:56.660 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63182.log.gz 2023-07-09T22:02:56.660 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51711.log 2023-07-09T22:02:56.661 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45133.log.gz 2023-07-09T22:02:56.661 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54899.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54899.log.gz 2023-07-09T22:02:56.662 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61095.log 2023-07-09T22:02:56.663 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55127.log 2023-07-09T22:02:56.663 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.51711.log.gz 2023-07-09T22:02:56.664 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47629.log 2023-07-09T22:02:56.664 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61095.log.gz 2023-07-09T22:02:56.665 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43206.log 2023-07-09T22:02:56.665 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55127.log.gz 2023-07-09T22:02:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47629.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47629.log.gz 2023-07-09T22:02:56.666 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66912.log 2023-07-09T22:02:56.667 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60044.log 2023-07-09T22:02:56.667 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43206.log.gz 2023-07-09T22:02:56.668 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45531.log 2023-07-09T22:02:56.668 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66912.log.gz 2023-07-09T22:02:56.669 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67404.log 2023-07-09T22:02:56.669 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60044.log.gz 2023-07-09T22:02:56.670 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45531.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-07-09T22:02:56.670 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45531.log.gz 2023-07-09T22:02:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67404.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67404.log.gz 2023-07-09T22:02:56.671 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62604.log 2023-07-09T22:02:56.672 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52837.log 2023-07-09T22:02:56.673 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62604.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62604.log.gz 2023-07-09T22:02:56.673 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2023-07-09T22:02:56.674 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42949.log 2023-07-09T22:02:56.674 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52837.log.gz 2023-07-09T22:02:56.675 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48813.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2023-07-09T22:02:56.675 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51965.log 2023-07-09T22:02:56.676 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.42949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68112.log 2023-07-09T22:02:56.676 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42949.log.gz 2023-07-09T22:02:56.677 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51965.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51965.log.gz 2023-07-09T22:02:56.678 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56672.log 2023-07-09T22:02:56.679 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63670.log 2023-07-09T22:02:56.679 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68112.log.gz 2023-07-09T22:02:56.680 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56672.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2023-07-09T22:02:56.680 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54606.log 2023-07-09T22:02:56.681 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59034.log 2023-07-09T22:02:56.681 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63670.log.gz 2023-07-09T22:02:56.682 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54606.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54606.log.gz 2023-07-09T22:02:56.683 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2023-07-09T22:02:56.684 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62900.log 2023-07-09T22:02:56.684 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59034.log.gz 2023-07-09T22:02:56.685 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49171.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2023-07-09T22:02:56.685 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65689.log 2023-07-09T22:02:56.686 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57252.log 2023-07-09T22:02:56.686 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62900.log.gz 2023-07-09T22:02:56.687 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65689.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65689.log.gz 2023-07-09T22:02:56.687 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58930.log 2023-07-09T22:02:56.688 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52550.log 2023-07-09T22:02:56.688 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57252.log.gz 2023-07-09T22:02:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58930.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58930.log.gz 2023-07-09T22:02:56.689 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60401.log 2023-07-09T22:02:56.690 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59060.log 2023-07-09T22:02:56.691 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52550.log.gz 2023-07-09T22:02:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60401.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60401.log.gz 2023-07-09T22:02:56.691 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44617.log 2023-07-09T22:02:56.692 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53616.log 2023-07-09T22:02:56.693 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59060.log.gz 2023-07-09T22:02:56.694 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47347.log 2023-07-09T22:02:56.694 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44617.log.gz 2023-07-09T22:02:56.695 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48995.log 2023-07-09T22:02:56.695 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53616.log.gz 2023-07-09T22:02:56.696 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47347.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47347.log.gz 2023-07-09T22:02:56.696 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58498.log 2023-07-09T22:02:56.697 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48995.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48995.log.gz 2023-07-09T22:02:56.698 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61651.log 2023-07-09T22:02:56.698 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58498.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58498.log.gz 2023-07-09T22:02:56.699 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62154.log 2023-07-09T22:02:56.699 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61651.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61651.log.gz 2023-07-09T22:02:56.700 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-07-09T22:02:56.701 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62154.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62154.log.gz 2023-07-09T22:02:56.701 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61490.log 2023-07-09T22:02:56.702 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47841.log 2023-07-09T22:02:56.703 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61490.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.61490.log.gz 2023-07-09T22:02:56.703 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49380.log 2023-07-09T22:02:56.704 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47841.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47841.log.gz 2023-07-09T22:02:56.705 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46748.log 2023-07-09T22:02:56.706 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46508.log 2023-07-09T22:02:56.706 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49380.log.gz 2023-07-09T22:02:56.707 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46748.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46748.log.gz 2023-07-09T22:02:56.708 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54502.log 2023-07-09T22:02:56.708 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46508.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46508.log.gz 2023-07-09T22:02:56.709 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2023-07-09T22:02:56.710 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49408.log 2023-07-09T22:02:56.710 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54502.log.gz 2023-07-09T22:02:56.711 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49687.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2023-07-09T22:02:56.712 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62770.log 2023-07-09T22:02:56.712 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49408.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49408.log.gz 2023-07-09T22:02:56.713 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43551.log 2023-07-09T22:02:56.714 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66663.log 2023-07-09T22:02:56.714 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62770.log.gz 2023-07-09T22:02:56.715 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43551.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43551.log.gz 2023-07-09T22:02:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58557.log 2023-07-09T22:02:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66663.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.66663.log.gz 2023-07-09T22:02:56.717 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51201.log 2023-07-09T22:02:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58557.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.58557.log.gz 2023-07-09T22:02:56.719 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.60018.log 2023-07-09T22:02:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51201.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51201.log.gz 2023-07-09T22:02:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50914.log 2023-07-09T22:02:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62317.log 2023-07-09T22:02:56.722 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60018.log.gz 2023-07-09T22:02:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50914.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50914.log.gz 2023-07-09T22:02:56.723 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49021.log 2023-07-09T22:02:56.724 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62317.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62317.log.gz 2023-07-09T22:02:56.725 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68138.log 2023-07-09T22:02:56.726 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49021.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49021.log.gz 2023-07-09T22:02:56.726 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64448.log 2023-07-09T22:02:56.727 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68138.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68138.log.gz 2023-07-09T22:02:56.728 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51281.log 2023-07-09T22:02:56.728 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51685.log 2023-07-09T22:02:56.729 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.64448.log.gz 2023-07-09T22:02:56.730 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44828.log 2023-07-09T22:02:56.730 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51281.log.gz 2023-07-09T22:02:56.731 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51685.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51685.log.gz 2023-07-09T22:02:56.732 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59499.log 2023-07-09T22:02:56.733 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51863.log 2023-07-09T22:02:56.733 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44828.log.gz 2023-07-09T22:02:56.734 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59499.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59499.log.gz 2023-07-09T22:02:56.734 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2023-07-09T22:02:56.735 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51863.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51863.log.gz 2023-07-09T22:02:56.736 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47681.log 2023-07-09T22:02:56.737 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69084.log 2023-07-09T22:02:56.737 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2023-07-09T22:02:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47681.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47681.log.gz 2023-07-09T22:02:56.738 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51633.log 2023-07-09T22:02:56.740 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69084.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.69084.log.gz 2023-07-09T22:02:56.740 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68980.log 2023-07-09T22:02:56.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51633.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51633.log.gz 2023-07-09T22:02:56.742 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60323.log 2023-07-09T22:02:56.743 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68980.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68980.log.gz 2023-07-09T22:02:56.743 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2023-07-09T22:02:56.745 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60323.log.gzgzip 2023-07-09T22:02:56.745 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62284.log 2023-07-09T22:02:56.746 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45479.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2023-07-09T22:02:56.746 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61352.log 2023-07-09T22:02:56.748 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62284.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62284.log.gz 2023-07-09T22:02:56.748 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51345.log 2023-07-09T22:02:56.749 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67657.log 2023-07-09T22:02:56.750 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61352.log.gz 2023-07-09T22:02:56.751 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67094.log 2023-07-09T22:02:56.751 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51345.log.gz 2023-07-09T22:02:56.752 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66149.log 2023-07-09T22:02:56.753 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67657.log.gz 2023-07-09T22:02:56.754 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67094.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67094.log.gz 2023-07-09T22:02:56.754 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43154.log 2023-07-09T22:02:56.755 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47759.log 2023-07-09T22:02:56.755 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.66149.log.gz 2023-07-09T22:02:56.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43154.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43154.log.gz 2023-07-09T22:02:56.757 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66071.log 2023-07-09T22:02:56.758 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47759.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47759.log.gz 2023-07-09T22:02:56.758 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62666.log 2023-07-09T22:02:56.759 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66071.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.66071.log.gz 2023-07-09T22:02:56.760 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45505.log 2023-07-09T22:02:56.761 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44643.log 2023-07-09T22:02:56.761 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62666.log.gz 2023-07-09T22:02:56.762 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2023-07-09T22:02:56.763 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45505.log.gz 2023-07-09T22:02:56.764 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44643.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44643.log.gz 2023-07-09T22:02:56.764 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59295.log 2023-07-09T22:02:56.765 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43942.log 2023-07-09T22:02:56.765 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2023-07-09T22:02:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59295.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59295.log.gz 2023-07-09T22:02:56.766 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58297.log 2023-07-09T22:02:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43942.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43942.log.gz 2023-07-09T22:02:56.768 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64051.log 2023-07-09T22:02:56.769 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58297.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58297.log.gz 2023-07-09T22:02:56.770 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2023-07-09T22:02:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64051.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.64051.log.gz 2023-07-09T22:02:56.771 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54226.log 2023-07-09T22:02:56.772 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51371.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2023-07-09T22:02:56.773 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65102.log 2023-07-09T22:02:56.774 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54226.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54226.log.gz 2023-07-09T22:02:56.774 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60070.log 2023-07-09T22:02:56.775 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69162.log 2023-07-09T22:02:56.776 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60070.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.65102.log.gz 2023-07-09T22:02:56.776 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60070.log.gz 2023-07-09T22:02:56.777 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65767.log 2023-07-09T22:02:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69162.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.69162.log.gz 2023-07-09T22:02:56.778 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47707.log 2023-07-09T22:02:56.780 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65767.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65767.log.gz 2023-07-09T22:02:56.780 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68388.log 2023-07-09T22:02:56.781 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47707.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47707.log.gz 2023-07-09T22:02:56.782 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63439.log 2023-07-09T22:02:56.783 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68388.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68388.log.gz 2023-07-09T22:02:56.783 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59008.log 2023-07-09T22:02:56.785 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63439.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63439.log.gz 2023-07-09T22:02:56.785 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43716.log 2023-07-09T22:02:56.786 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59008.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59008.log.gz 2023-07-09T22:02:56.787 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50966.log 2023-07-09T22:02:56.788 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43716.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43716.log.gz 2023-07-09T22:02:56.788 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45739.log 2023-07-09T22:02:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50966.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50966.log.gz 2023-07-09T22:02:56.790 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62415.log 2023-07-09T22:02:56.791 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45739.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45739.log.gz 2023-07-09T22:02:56.791 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50609.log 2023-07-09T22:02:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62415.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62415.log.gz 2023-07-09T22:02:56.793 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43339.log 2023-07-09T22:02:56.794 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50609.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50609.log.gz 2023-07-09T22:02:56.795 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66376.log 2023-07-09T22:02:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43339.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43339.log.gz 2023-07-09T22:02:56.796 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66754.log 2023-07-09T22:02:56.798 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66376.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.66376.log.gz 2023-07-09T22:02:56.798 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63054.log 2023-07-09T22:02:56.799 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66754.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.66754.log.gz 2023-07-09T22:02:56.799 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62519.log 2023-07-09T22:02:56.801 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2023-07-09T22:02:56.801 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63054.log.gz 2023-07-09T22:02:56.802 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62519.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62519.log.gz 2023-07-09T22:02:56.802 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65889.log 2023-07-09T22:02:56.803 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45349.log 2023-07-09T22:02:56.804 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2023-07-09T22:02:56.804 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65889.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.65889.log.gz 2023-07-09T22:02:56.805 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67224.log 2023-07-09T22:02:56.806 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45349.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45349.log.gz 2023-07-09T22:02:56.807 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63947.log 2023-07-09T22:02:56.808 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.67224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57304.log 2023-07-09T22:02:56.809 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63947.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.67224.log.gz 2023-07-09T22:02:56.810 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64103.log 2023-07-09T22:02:56.810 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63947.log.gz 2023-07-09T22:02:56.810 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2023-07-09T22:02:56.811 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.57304.log.gz 2023-07-09T22:02:56.812 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64103.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64103.log.gz 2023-07-09T22:02:56.812 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43006.log 2023-07-09T22:02:56.814 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60584.log 2023-07-09T22:02:56.814 INFO:teuthology.orchestra.run.smithi037.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2023-07-09T22:02:56.815 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49661.log 2023-07-09T22:02:56.816 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43006.log.gz 2023-07-09T22:02:56.817 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66402.log 2023-07-09T22:02:56.817 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60584.log.gz 2023-07-09T22:02:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57865.log 2023-07-09T22:02:56.819 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49661.log.gz 2023-07-09T22:02:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60663.log 2023-07-09T22:02:56.820 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66402.log.gz 2023-07-09T22:02:56.822 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49302.log 2023-07-09T22:02:56.822 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57865.log.gz 2023-07-09T22:02:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66559.log 2023-07-09T22:02:56.823 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60663.log.gz 2023-07-09T22:02:56.825 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-07-09T22:02:56.825 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49302.log.gz 2023-07-09T22:02:56.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43057.log 2023-07-09T22:02:56.826 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66559.log.gz 2023-07-09T22:02:56.828 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48033.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz -5 2023-07-09T22:02:56.828 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48759.log 2023-07-09T22:02:56.829 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62206.log 2023-07-09T22:02:56.830 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43057.log.gz 2023-07-09T22:02:56.831 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2023-07-09T22:02:56.831 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48759.log.gz 2023-07-09T22:02:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62206.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62206.log.gz 2023-07-09T22:02:56.832 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66585.log 2023-07-09T22:02:56.833 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57636.log 2023-07-09T22:02:56.834 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2023-07-09T22:02:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66585.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66585.log.gz 2023-07-09T22:02:56.835 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54710.log 2023-07-09T22:02:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57636.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57636.log.gz 2023-07-09T22:02:56.837 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58063.log 2023-07-09T22:02:56.838 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54710.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.54710.log.gz -5 2023-07-09T22:02:56.838 INFO:teuthology.orchestra.run.smithi037.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43313.log 2023-07-09T22:02:56.840 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58063.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58063.log.gz 2023-07-09T22:02:56.840 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48589.log 2023-07-09T22:02:56.841 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43313.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43313.log.gz 2023-07-09T22:02:56.842 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66834.log 2023-07-09T22:02:56.843 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48589.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48589.log.gz 2023-07-09T22:02:56.843 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59887.log 2023-07-09T22:02:56.844 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66834.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.66834.log.gz 2023-07-09T22:02:56.845 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58786.log 2023-07-09T22:02:56.846 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59887.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59887.log.gz 2023-07-09T22:02:56.846 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64383.log 2023-07-09T22:02:56.847 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44409.log 2023-07-09T22:02:56.848 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58786.log.gz 2023-07-09T22:02:56.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64383.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64383.log.gz 2023-07-09T22:02:56.849 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46879.log 2023-07-09T22:02:56.850 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44409.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44409.log.gz 2023-07-09T22:02:56.850 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64253.log 2023-07-09T22:02:56.852 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46879.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46879.log.gz 2023-07-09T22:02:56.852 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66720.log 2023-07-09T22:02:56.853 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64253.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64253.log.gz 2023-07-09T22:02:56.854 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47401.log 2023-07-09T22:02:56.855 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66720.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.66720.log.gz 2023-07-09T22:02:56.855 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51607.log 2023-07-09T22:02:56.857 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47401.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62467.log 2023-07-09T22:02:56.857 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47401.log.gz 2023-07-09T22:02:56.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51607.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51607.log.gz 2023-07-09T22:02:56.858 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61464.log 2023-07-09T22:02:56.859 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68876.log 2023-07-09T22:02:56.860 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62467.log.gz 2023-07-09T22:02:56.860 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61464.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61464.log.gz 2023-07-09T22:02:56.861 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62692.log 2023-07-09T22:02:56.862 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68876.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68876.log.gz 2023-07-09T22:02:56.862 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2023-07-09T22:02:56.864 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62692.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62692.log.gz 2023-07-09T22:02:56.864 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68310.log 2023-07-09T22:02:56.865 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59628.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2023-07-09T22:02:56.866 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64998.log 2023-07-09T22:02:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68310.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68310.log.gz 2023-07-09T22:02:56.867 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58589.log 2023-07-09T22:02:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64998.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64998.log.gz 2023-07-09T22:02:56.869 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43421.log 2023-07-09T22:02:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58589.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58589.log.gz 2023-07-09T22:02:56.870 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51659.log 2023-07-09T22:02:56.871 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43421.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43421.log.gz 2023-07-09T22:02:56.872 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52759.log 2023-07-09T22:02:56.873 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51659.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51659.log.gz 2023-07-09T22:02:56.874 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60271.log 2023-07-09T22:02:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52759.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52759.log.gz 2023-07-09T22:02:56.875 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63775.log 2023-07-09T22:02:56.877 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63999.log 2023-07-09T22:02:56.877 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60271.log.gz 2023-07-09T22:02:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63775.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63775.log.gz 2023-07-09T22:02:56.878 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64868.log 2023-07-09T22:02:56.879 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68034.log 2023-07-09T22:02:56.880 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63999.log.gz 2023-07-09T22:02:56.880 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64868.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64868.log.gz 2023-07-09T22:02:56.881 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50836.log 2023-07-09T22:02:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68034.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68034.log.gz 2023-07-09T22:02:56.882 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55185.log 2023-07-09T22:02:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50836.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50836.log.gz 2023-07-09T22:02:56.884 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50385.log 2023-07-09T22:02:56.885 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55185.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55185.log.gz 2023-07-09T22:02:56.886 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54082.log 2023-07-09T22:02:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50385.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50385.log.gz 2023-07-09T22:02:56.887 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2023-07-09T22:02:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54082.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54082.log.gz 2023-07-09T22:02:56.889 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64416.log 2023-07-09T22:02:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55075.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2023-07-09T22:02:56.890 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55855.log 2023-07-09T22:02:56.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59966.log 2023-07-09T22:02:56.891 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64416.log.gz 2023-07-09T22:02:56.892 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55855.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55855.log.gz 2023-07-09T22:02:56.893 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61953.log 2023-07-09T22:02:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59966.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59966.log.gz 2023-07-09T22:02:56.894 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49907.log 2023-07-09T22:02:56.895 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61953.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-07-09T22:02:56.896 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61953.log.gz 2023-07-09T22:02:56.896 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49907.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49907.log.gz 2023-07-09T22:02:56.897 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63258.log 2023-07-09T22:02:56.898 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59660.log 2023-07-09T22:02:56.900 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64305.log 2023-07-09T22:02:56.900 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63258.log.gz 2023-07-09T22:02:56.901 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59660.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.59660.log.gz 2023-07-09T22:02:56.901 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.55779.log 2023-07-09T22:02:56.903 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43031.log 2023-07-09T22:02:56.903 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64305.log.gz 2023-07-09T22:02:56.904 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57122.log 2023-07-09T22:02:56.904 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55779.log.gz 2023-07-09T22:02:56.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46534.log 2023-07-09T22:02:56.906 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43031.log.gz 2023-07-09T22:02:56.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57839.log 2023-07-09T22:02:56.907 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57122.log.gz 2023-07-09T22:02:56.908 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55679.log 2023-07-09T22:02:56.909 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46534.log.gz 2023-07-09T22:02:56.910 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56483.log 2023-07-09T22:02:56.910 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57839.log.gz 2023-07-09T22:02:56.911 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.55679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2023-07-09T22:02:56.912 INFO:teuthology.orchestra.run.smithi037.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.0.55679.log.gz 2023-07-09T22:02:56.913 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69136.log 2023-07-09T22:02:56.913 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56483.log.gz 2023-07-09T22:02:56.914 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2023-07-09T22:02:56.914 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2023-07-09T22:02:56.916 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69136.log: gzip 89.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.69136.log.gz -- 2023-07-09T22:02:56.916 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.60779.log 2023-07-09T22:02:56.917 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61770.log 2023-07-09T22:02:56.918 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2023-07-09T22:02:56.919 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64762.log 2023-07-09T22:02:56.919 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60779.log.gz 2023-07-09T22:02:56.920 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61770.log: gzip -5 --verbose 88.6% -- /var/log/ceph/ceph-client.admin.48059.log -- replaced with /var/log/ceph/ceph-client.admin.61770.log.gz 2023-07-09T22:02:56.920 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:56.922 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64762.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64762.log.gz 2023-07-09T22:02:56.922 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59794.log 2023-07-09T22:02:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48059.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48059.log.gz 2023-07-09T22:02:56.923 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60911.log 2023-07-09T22:02:56.925 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56403.log 2023-07-09T22:02:56.925 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59794.log.gz 2023-07-09T22:02:56.926 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60911.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60911.log.gz 2023-07-09T22:02:56.927 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.52934.log 2023-07-09T22:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56403.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56403.log.gz 2023-07-09T22:02:56.928 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59768.log 2023-07-09T22:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52934.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52934.log.gz 2023-07-09T22:02:56.930 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67683.log 2023-07-09T22:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59768.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59768.log.gz 2023-07-09T22:02:56.931 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2023-07-09T22:02:56.933 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43733.log 2023-07-09T22:02:56.933 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.67683.log.gz 2023-07-09T22:02:56.934 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55341.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz 2023-07-09T22:02:56.935 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50505.log 2023-07-09T22:02:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43733.log.gz 2023-07-09T22:02:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45798.log 2023-07-09T22:02:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50505.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50505.log.gz 2023-07-09T22:02:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49047.log 2023-07-09T22:02:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51451.log 2023-07-09T22:02:56.939 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45798.log.gz 2023-07-09T22:02:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49047.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49047.log.gz 2023-07-09T22:02:56.941 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62102.log 2023-07-09T22:02:56.942 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57278.log 2023-07-09T22:02:56.942 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51451.log.gz 2023-07-09T22:02:56.944 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57406.log 2023-07-09T22:02:56.944 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62102.log.gz 2023-07-09T22:02:56.945 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57278.log: gzip -5 --verbose 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57278.log.gz 2023-07-09T22:02:56.946 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.68746.log 2023-07-09T22:02:56.946 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57406.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57406.log.gz 2023-07-09T22:02:56.947 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56049.log 2023-07-09T22:02:56.948 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68746.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68746.log.gz 2023-07-09T22:02:56.949 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65819.log 2023-07-09T22:02:56.950 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56049.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56049.log.gz 2023-07-09T22:02:56.951 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48189.log 2023-07-09T22:02:56.952 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65819.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.65819.log.gz 2023-07-09T22:02:56.953 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61015.log 2023-07-09T22:02:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48189.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48189.log.gz 2023-07-09T22:02:56.954 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68060.log 2023-07-09T22:02:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61015.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61015.log.gz 2023-07-09T22:02:56.956 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60174.log 2023-07-09T22:02:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68060.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68060.log.gz 2023-07-09T22:02:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66780.log 2023-07-09T22:02:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60174.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60174.log.gz 2023-07-09T22:02:56.960 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.66175.log 2023-07-09T22:02:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66780.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.66780.log.gz 2023-07-09T22:02:56.962 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63722.log 2023-07-09T22:02:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66175.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66175.log.gz 2023-07-09T22:02:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51581.log 2023-07-09T22:02:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63722.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.63722.log.gz 2023-07-09T22:02:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50479.log 2023-07-09T22:02:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51581.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51581.log.gz 2023-07-09T22:02:56.967 INFO:teuthology.orchestra.run.smithi037.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44747.log 2023-07-09T22:02:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50479.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50479.log.gz 2023-07-09T22:02:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65632.log 2023-07-09T22:02:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44747.log.gz 2023-07-09T22:02:56.971 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61927.log 2023-07-09T22:02:56.972 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65632.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65632.log.gz 2023-07-09T22:02:56.972 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50713.log 2023-07-09T22:02:56.974 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61927.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61927.log.gz 2023-07-09T22:02:56.974 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62232.log 2023-07-09T22:02:56.975 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50713.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50713.log.gz 2023-07-09T22:02:56.976 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46324.log 2023-07-09T22:02:56.977 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62232.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62232.log.gz 2023-07-09T22:02:56.978 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45661.log 2023-07-09T22:02:56.979 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46324.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46324.log.gz 2023-07-09T22:02:56.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52733.log 2023-07-09T22:02:56.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45661.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45661.log.gz 2023-07-09T22:02:56.982 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56273.log 2023-07-09T22:02:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52733.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52733.log.gz 2023-07-09T22:02:56.983 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59423.log 2023-07-09T22:02:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56273.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56273.log.gz 2023-07-09T22:02:56.985 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53486.log 2023-07-09T22:02:56.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59423.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59423.log.gz 2023-07-09T22:02:56.987 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44151.log 2023-07-09T22:02:56.988 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53486.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53486.log.gz 2023-07-09T22:02:56.989 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54450.log 2023-07-09T22:02:56.990 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44151.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44151.log.gz 2023-07-09T22:02:56.991 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59219.log 2023-07-09T22:02:56.992 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54450.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54450.log.gz 2023-07-09T22:02:56.993 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48419.log 2023-07-09T22:02:56.993 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59219.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59219.log.gz 2023-07-09T22:02:56.994 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2023-07-09T22:02:56.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48419.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48419.log.gz 2023-07-09T22:02:56.996 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48345.log 2023-07-09T22:02:56.997 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49633.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2023-07-09T22:02:56.998 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68928.log 2023-07-09T22:02:57.000 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.48345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63413.log 2023-07-09T22:02:57.001 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68928.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68928.log.gz 2023-07-09T22:02:57.002 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53590.log 2023-07-09T22:02:57.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63413.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63413.log.gz 2023-07-09T22:02:57.004 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53090.log 2023-07-09T22:02:57.005 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53590.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53590.log.gz 2023-07-09T22:02:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56956.log 2023-07-09T22:02:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53090.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53090.log.gz 2023-07-09T22:02:57.007 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49328.log 2023-07-09T22:02:57.008 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56956.log.gz 2023-07-09T22:02:57.009 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68258.log 2023-07-09T22:02:57.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49328.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49328.log.gz 2023-07-09T22:02:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68440.log 2023-07-09T22:02:57.012 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68258.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.68258.log.gz 2023-07-09T22:02:57.013 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63208.log 2023-07-09T22:02:57.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68440.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.68440.log.gz 2023-07-09T22:02:57.014 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47901.log 2023-07-09T22:02:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63208.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63208.log.gz 2023-07-09T22:02:57.016 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48865.log 2023-07-09T22:02:57.017 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47901.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47901.log.gz 2023-07-09T22:02:57.018 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48731.log 2023-07-09T22:02:57.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48865.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48865.log.gz 2023-07-09T22:02:57.020 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51555.log 2023-07-09T22:02:57.021 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48731.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48731.log.gz 2023-07-09T22:02:57.022 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61402.log 2023-07-09T22:02:57.023 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51555.log.gz 2023-07-09T22:02:57.024 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53434.log 2023-07-09T22:02:57.025 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61402.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61402.log.gz 2023-07-09T22:02:57.025 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log 2023-07-09T22:02:57.026 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53434.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53434.log.gz 2023-07-09T22:02:57.027 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45159.log 2023-07-09T22:02:57.029 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51503.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51503.log.gz 2023-07-09T22:02:57.029 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62057.log 2023-07-09T22:02:57.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45159.log.gz 2023-07-09T22:02:57.031 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49354.log 2023-07-09T22:02:57.032 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62057.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62057.log.gz 2023-07-09T22:02:57.033 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-07-09T22:02:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49354.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49354.log.gz 2023-07-09T22:02:57.034 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53952.log 2023-07-09T22:02:57.036 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53064.log 2023-07-09T22:02:57.037 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53952.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53952.log.gz 2023-07-09T22:02:57.038 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57731.log 2023-07-09T22:02:57.039 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37637.log 2023-07-09T22:02:57.041 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57731.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53064.log.gz 2023-07-09T22:02:57.041 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57731.log.gz 2023-07-09T22:02:57.042 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58342.log 2023-07-09T22:02:57.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37637.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37637.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59820.log 2023-07-09T22:02:57.044 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46456.log 2023-07-09T22:02:57.046 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58342.log: /var/log/ceph/ceph-client.admin.59820.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58342.log.gz 2023-07-09T22:02:57.047 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59820.log.gz 2023-07-09T22:02:57.048 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69269.log 2023-07-09T22:02:57.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56429.log 2023-07-09T22:02:57.050 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46456.log.gz 2023-07-09T22:02:57.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69269.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.69269.log.gz 2023-07-09T22:02:57.052 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44487.log 2023-07-09T22:02:57.053 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56429.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56429.log.gz 2023-07-09T22:02:57.055 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60717.log 2023-07-09T22:02:57.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60492.log 2023-07-09T22:02:57.056 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44487.log.gz 2023-07-09T22:02:57.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53325.log 2023-07-09T22:02:57.059 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60717.log.gz/var/log/ceph/ceph-client.admin.60492.log: 2023-07-09T22:02:57.059 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60492.log.gz 2023-07-09T22:02:57.061 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58368.log 2023-07-09T22:02:57.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64646.log 2023-07-09T22:02:57.062 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53325.log.gz 2023-07-09T22:02:57.064 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59245.log 2023-07-09T22:02:57.065 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58368.log.gz/var/log/ceph/ceph-client.admin.64646.log: 2023-07-09T22:02:57.065 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64646.log.gz 2023-07-09T22:02:57.066 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2023-07-09T22:02:57.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60689.log 2023-07-09T22:02:57.068 INFO:teuthology.orchestra.run.smithi037.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.59245.log.gz 2023-07-09T22:02:57.071 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65444.log 2023-07-09T22:02:57.071 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2023-07-09T22:02:57.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60689.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60689.log.gz 2023-07-09T22:02:57.073 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54117.log 2023-07-09T22:02:57.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48917.log 88.0% 2023-07-09T22:02:57.075 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65444.log.gz 2023-07-09T22:02:57.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46116.log 2023-07-09T22:02:57.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48917.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54117.log.gz 2023-07-09T22:02:57.078 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48917.log.gz 2023-07-09T22:02:57.079 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45427.log 2023-07-09T22:02:57.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46116.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54345.log 2023-07-09T22:02:57.081 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46116.log.gz 2023-07-09T22:02:57.082 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44513.log 2023-07-09T22:02:57.083 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45427.log: /var/log/ceph/ceph-client.admin.54345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45427.log.gz 2023-07-09T22:02:57.083 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54345.log.gz 2023-07-09T22:02:57.084 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2023-07-09T22:02:57.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68466.log 2023-07-09T22:02:57.086 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58394.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44513.log.gz 2023-07-09T22:02:57.087 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gz 2023-07-09T22:02:57.088 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68179.log 2023-07-09T22:02:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48163.log 2023-07-09T22:02:57.090 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68179.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.68466.log.gz 2023-07-09T22:02:57.091 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68179.log.gz 2023-07-09T22:02:57.092 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53774.log 2023-07-09T22:02:57.094 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55419.log 2023-07-09T22:02:57.095 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48163.log: /var/log/ceph/ceph-client.admin.53774.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48163.log.gz 2023-07-09T22:02:57.096 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53774.log.gz 2023-07-09T22:02:57.096 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56509.log 2023-07-09T22:02:57.098 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61069.log 2023-07-09T22:02:57.099 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56509.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55419.log.gz 2023-07-09T22:02:57.099 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56509.log.gz 2023-07-09T22:02:57.101 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62128.log 2023-07-09T22:02:57.102 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60989.log 2023-07-09T22:02:57.103 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61069.log.gz 2023-07-09T22:02:57.104 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2023-07-09T22:02:57.105 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60989.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62128.log.gz 2023-07-09T22:02:57.105 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60989.log.gz 2023-07-09T22:02:57.106 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2023-07-09T22:02:57.108 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49224.log 2023-07-09T22:02:57.109 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43259.log: /var/log/ceph/ceph-client.admin.43721.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2023-07-09T22:02:57.110 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2023-07-09T22:02:57.110 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67500.log 2023-07-09T22:02:57.112 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64972.log 2023-07-09T22:02:57.113 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67500.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2023-07-09T22:02:57.114 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67500.log.gz 2023-07-09T22:02:57.114 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69319.log 2023-07-09T22:02:57.116 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49521.log 2023-07-09T22:02:57.117 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69319.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64972.log.gz 2023-07-09T22:02:57.118 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69319.log.gz 2023-07-09T22:02:57.118 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64129.log 2023-07-09T22:02:57.120 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2023-07-09T22:02:57.121 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64129.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49521.log.gz 2023-07-09T22:02:57.121 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64129.log.gz 2023-07-09T22:02:57.122 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61625.log 2023-07-09T22:02:57.124 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54788.log 2023-07-09T22:02:57.125 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61625.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2023-07-09T22:02:57.125 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61625.log.gz 2023-07-09T22:02:57.126 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67300.log 2023-07-09T22:02:57.128 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51529.log 2023-07-09T22:02:57.129 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54788.log: /var/log/ceph/ceph-client.admin.67300.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54788.log.gz 2023-07-09T22:02:57.130 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.67300.log.gz 2023-07-09T22:02:57.130 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2023-07-09T22:02:57.132 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57891.log 2023-07-09T22:02:57.133 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44461.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51529.log.gz 2023-07-09T22:02:57.134 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2023-07-09T22:02:57.134 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54814.log 2023-07-09T22:02:57.136 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57148.log 2023-07-09T22:02:57.137 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54814.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57891.log.gz 2023-07-09T22:02:57.137 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54814.log.gz 2023-07-09T22:02:57.138 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2023-07-09T22:02:57.140 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52405.log 2023-07-09T22:02:57.141 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48495.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57148.log.gz 2023-07-09T22:02:57.142 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2023-07-09T22:02:57.142 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52863.log 2023-07-09T22:02:57.144 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50661.log 2023-07-09T22:02:57.145 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52863.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52405.log.gz 2023-07-09T22:02:57.146 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52863.log.gz 2023-07-09T22:02:57.146 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2023-07-09T22:02:57.149 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45824.log 2023-07-09T22:02:57.149 INFO:teuthology.orchestra.run.smithi037.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.0.48345.log.gz 2023-07-09T22:02:57.149 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50661.log.gz 2023-07-09T22:02:57.150 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47733.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2023-07-09T22:02:57.150 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58141.log 2023-07-09T22:02:57.152 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55497.log 2023-07-09T22:02:57.154 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45824.log: /var/log/ceph/ceph-client.admin.58141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58902.log 2023-07-09T22:02:57.154 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58141.log.gz 2023-07-09T22:02:57.155 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45824.log.gz 2023-07-09T22:02:57.155 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55497.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55497.log.gz 2023-07-09T22:02:57.156 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60427.log 2023-07-09T22:02:57.157 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49250.log 2023-07-09T22:02:57.157 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58902.log.gz 2023-07-09T22:02:57.158 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60427.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67326.log 2023-07-09T22:02:57.159 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60427.log.gz 2023-07-09T22:02:57.160 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47927.log 2023-07-09T22:02:57.160 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49250.log.gz 2023-07-09T22:02:57.161 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56704.log 2023-07-09T22:02:57.162 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67326.log.gz 2023-07-09T22:02:57.163 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50531.log 2023-07-09T22:02:57.164 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47927.log.gz 2023-07-09T22:02:57.165 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56704.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58037.log 2023-07-09T22:02:57.165 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2023-07-09T22:02:57.166 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57070.log 2023-07-09T22:02:57.166 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50531.log.gz 2023-07-09T22:02:57.167 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57460.log 2023-07-09T22:02:57.168 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57070.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58037.log.gz 2023-07-09T22:02:57.169 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53460.log 2023-07-09T22:02:57.169 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57070.log.gz 2023-07-09T22:02:57.171 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.57460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67068.log 2023-07-09T22:02:57.172 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52986.log 2023-07-09T22:02:57.172 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% 94.2% -- replaced with /var/log/ceph/ceph-client.0.57460.log.gz 2023-07-09T22:02:57.172 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53460.log.gz 2023-07-09T22:02:57.173 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45375.log 2023-07-09T22:02:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67068.log: /var/log/ceph/ceph-client.admin.52986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.67068.log.gz 2023-07-09T22:02:57.175 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57174.log 2023-07-09T22:02:57.175 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52986.log.gz 2023-07-09T22:02:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45375.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58245.log 2023-07-09T22:02:57.177 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45375.log.gz 2023-07-09T22:02:57.178 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53538.log 2023-07-09T22:02:57.178 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57174.log.gz 2023-07-09T22:02:57.179 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 2023-07-09T22:02:57.180 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53538.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58245.log.gz 2023-07-09T22:02:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-07-09T22:02:57.181 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53538.log.gz 2023-07-09T22:02:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60805.log 2023-07-09T22:02:57.183 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2023-07-09T22:02:57.184 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60460.log 2023-07-09T22:02:57.186 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57096.log 2023-07-09T22:02:57.187 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60460.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60805.log.gz 2023-07-09T22:02:57.187 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60460.log.gz 2023-07-09T22:02:57.189 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63551.log 2023-07-09T22:02:57.189 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-07-09T22:02:57.190 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62031.log 2023-07-09T22:02:57.190 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57096.log.gz 2023-07-09T22:02:57.191 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46430.log 2023-07-09T22:02:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62031.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63551.log.gz 2023-07-09T22:02:57.193 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2023-07-09T22:02:57.193 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62031.log.gz 2023-07-09T22:02:57.195 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63004.log 2023-07-09T22:02:57.195 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46430.log.gz 2023-07-09T22:02:57.196 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47813.log 2023-07-09T22:02:57.197 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63004.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2023-07-09T22:02:57.198 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58760.log 2023-07-09T22:02:57.198 INFO:teuthology.orchestra.run.smithi037.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63004.log.gz 2023-07-09T22:02:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63973.log 2023-07-09T22:02:57.199 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47813.log.gz 2023-07-09T22:02:57.200 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49437.log 2023-07-09T22:02:57.202 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58760.log.gz 2023-07-09T22:02:57.203 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48969.log 2023-07-09T22:02:57.203 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63973.log.gz 2023-07-09T22:02:57.204 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44669.log 87.8% 2023-07-09T22:02:57.204 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49437.log.gz 2023-07-09T22:02:57.206 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48969.log: gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.57200.log 2023-07-09T22:02:57.206 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48969.log.gz 2023-07-09T22:02:57.207 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64279.log 2023-07-09T22:02:57.207 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.44669.log.gz 2023-07-09T22:02:57.208 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59449.log 2023-07-09T22:02:57.209 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57200.log.gz 2023-07-09T22:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68850.log 2023-07-09T22:02:57.210 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64279.log.gz 2023-07-09T22:02:57.211 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59449.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66637.log 2023-07-09T22:02:57.212 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59449.log.gz 2023-07-09T22:02:57.213 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54424.log 2023-07-09T22:02:57.213 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.68850.log.gz 2023-07-09T22:02:57.214 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66637.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 2023-07-09T22:02:57.214 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66637.log.gz 2023-07-09T22:02:57.216 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44695.log 2023-07-09T22:02:57.216 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54424.log.gz 2023-07-09T22:02:57.217 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46246.log 2023-07-09T22:02:57.217 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2023-07-09T22:02:57.219 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56221.log 2023-07-09T22:02:57.219 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2023-07-09T22:02:57.220 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46246.log: gzip -5 --verbose 89.3% -- /var/log/ceph/ceph-client.admin.54054.log -- replaced with /var/log/ceph/ceph-client.admin.46246.log.gz 2023-07-09T22:02:57.220 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:57.222 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55263.log 2023-07-09T22:02:57.222 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56221.log.gz 2023-07-09T22:02:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54054.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54054.log.gz 2023-07-09T22:02:57.223 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50307.log 2023-07-09T22:02:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47061.log 2023-07-09T22:02:57.225 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50307.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55263.log.gz 2023-07-09T22:02:57.226 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69188.log 2023-07-09T22:02:57.226 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50307.log.gz 2023-07-09T22:02:57.227 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47061.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61573.log 2023-07-09T22:02:57.228 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47061.log.gz 2023-07-09T22:02:57.229 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69188.log: gzip 88.4% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.69188.log.gz -- 2023-07-09T22:02:57.229 INFO:teuthology.orchestra.run.smithi037.stderr: /var/log/ceph/ceph-client.admin.58271.log 2023-07-09T22:02:57.231 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46983.log 2023-07-09T22:02:57.231 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58271.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61573.log.gz 2023-07-09T22:02:57.232 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2023-07-09T22:02:57.232 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58271.log.gz 2023-07-09T22:02:57.234 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54632.log 2023-07-09T22:02:57.234 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46983.log.gz 2023-07-09T22:02:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46007.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2023-07-09T22:02:57.235 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63323.log 2023-07-09T22:02:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55997.log 2023-07-09T22:02:57.237 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63323.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54632.log.gz 2023-07-09T22:02:57.238 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65206.log 2023-07-09T22:02:57.238 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63323.log.gz 2023-07-09T22:02:57.239 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55997.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62349.log 2023-07-09T22:02:57.240 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55997.log.gz 2023-07-09T22:02:57.241 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.65206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62258.log 2023-07-09T22:02:57.242 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51311.log 2023-07-09T22:02:57.243 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62258.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62349.log.gz 2023-07-09T22:02:57.244 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62258.log.gz 2023-07-09T22:02:57.245 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58010.log 2023-07-09T22:02:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55445.log 2023-07-09T22:02:57.247 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58010.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51311.log.gz 2023-07-09T22:02:57.248 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.58010.log.gz 2023-07-09T22:02:57.249 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55945.log 2023-07-09T22:02:57.250 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2023-07-09T22:02:57.252 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55445.log: 87.9%/var/log/ceph/ceph-client.admin.55945.log: -- replaced with /var/log/ceph/ceph-client.admin.55445.log.gz 2023-07-09T22:02:57.252 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55945.log.gz 2023-07-09T22:02:57.253 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56874.log 2023-07-09T22:02:57.254 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63497.log 2023-07-09T22:02:57.255 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56874.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2023-07-09T22:02:57.256 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56874.log.gz 2023-07-09T22:02:57.257 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43629.log 2023-07-09T22:02:57.258 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56770.log 2023-07-09T22:02:57.259 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43629.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63497.log.gz 2023-07-09T22:02:57.260 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43629.log.gz 2023-07-09T22:02:57.260 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59086.log 2023-07-09T22:02:57.262 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55157.log 2023-07-09T22:02:57.263 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59086.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56770.log.gz 2023-07-09T22:02:57.264 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2023-07-09T22:02:57.264 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50583.log 2023-07-09T22:02:57.267 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2023-07-09T22:02:57.268 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50583.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55157.log.gz 2023-07-09T22:02:57.268 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50583.log.gz 2023-07-09T22:02:57.268 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2023-07-09T22:02:57.270 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65915.log 2023-07-09T22:02:57.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47321.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2023-07-09T22:02:57.272 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2023-07-09T22:02:57.272 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59992.log 2023-07-09T22:02:57.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55101.log 2023-07-09T22:02:57.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59992.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65915.log.gz 2023-07-09T22:02:57.275 INFO:teuthology.orchestra.run.smithi037.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59992.log.gz 2023-07-09T22:02:57.276 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44132.log 2023-07-09T22:02:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53221.log 2023-07-09T22:02:57.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44132.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55101.log.gz 2023-07-09T22:02:57.279 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44132.log.gz 2023-07-09T22:02:57.280 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64946.log 2023-07-09T22:02:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65715.log 2023-07-09T22:02:57.282 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64946.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53221.log.gz 2023-07-09T22:02:57.283 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.64946.log.gz 2023-07-09T22:02:57.284 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61599.log 2023-07-09T22:02:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2023-07-09T22:02:57.286 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61599.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65715.log.gz 2023-07-09T22:02:57.287 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61599.log.gz 2023-07-09T22:02:57.288 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48675.log 2023-07-09T22:02:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48703.log 2023-07-09T22:02:57.290 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48675.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2023-07-09T22:02:57.291 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48675.log.gz 2023-07-09T22:02:57.292 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65280.log 2023-07-09T22:02:57.293 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50888.log 2023-07-09T22:02:57.295 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48703.log: /var/log/ceph/ceph-client.admin.65280.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48703.log.gz 2023-07-09T22:02:57.296 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.65280.log.gz 2023-07-09T22:02:57.296 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49276.log 2023-07-09T22:02:57.297 INFO:teuthology.orchestra.run.smithi037.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.0.65206.log.gz 2023-07-09T22:02:57.298 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62718.log 2023-07-09T22:02:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50888.log: /var/log/ceph/ceph-client.admin.49276.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50888.log.gz 2023-07-09T22:02:57.299 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58193.log 2023-07-09T22:02:57.300 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49276.log.gz 2023-07-09T22:02:57.301 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63748.log 2023-07-09T22:02:57.301 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.62718.log.gz 2023-07-09T22:02:57.302 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52509.log 2023-07-09T22:02:57.302 INFO:teuthology.orchestra.run.smithi037.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58193.log.gz 2023-07-09T22:02:57.304 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59527.log 2023-07-09T22:02:57.305 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52509.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.63748.log.gz 2023-07-09T22:02:57.305 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63842.log 2023-07-09T22:02:57.306 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52509.log.gz 2023-07-09T22:02:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59527.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.59527.log.gz 2023-07-09T22:02:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57356.log 2023-07-09T22:02:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63842.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63842.log.gz 2023-07-09T22:02:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52483.log 2023-07-09T22:02:57.311 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46059.log 2023-07-09T22:02:57.312 INFO:teuthology.orchestra.run.smithi037.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.57356.log.gz 2023-07-09T22:02:57.312 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45297.log 2023-07-09T22:02:57.313 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52483.log.gz 2023-07-09T22:02:57.314 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2023-07-09T22:02:57.315 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45297.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46059.log.gz 2023-07-09T22:02:57.316 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51994.log 2023-07-09T22:02:57.316 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45297.log.gz 2023-07-09T22:02:57.317 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz 2023-07-09T22:02:57.318 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68086.log 2023-07-09T22:02:57.320 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68336.log 2023-07-09T22:02:57.320 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51994.log.gz 2023-07-09T22:02:57.321 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52707.log 2023-07-09T22:02:57.321 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.68086.log.gz 2023-07-09T22:02:57.323 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68336.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.68772.log -- replaced with /var/log/ceph/ceph-client.admin.68336.log.gz 2023-07-09T22:02:57.323 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:57.324 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51477.log 2023-07-09T22:02:57.324 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52707.log.gz 2023-07-09T22:02:57.326 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52681.log 2023-07-09T22:02:57.326 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.68772.log.gz 2023-07-09T22:02:57.327 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45609.log 2023-07-09T22:02:57.327 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51477.log.gz 2023-07-09T22:02:57.329 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52681.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.57705.log 2023-07-09T22:02:57.329 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52681.log.gz 2023-07-09T22:02:57.330 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54528.log 2023-07-09T22:02:57.330 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45609.log.gz 2023-07-09T22:02:57.331 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57705.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66990.log 2023-07-09T22:02:57.332 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57705.log.gz 2023-07-09T22:02:57.333 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54554.log 2023-07-09T22:02:57.333 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54528.log.gz 2023-07-09T22:02:57.335 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2023-07-09T22:02:57.335 INFO:teuthology.orchestra.run.smithi037.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.66990.log.gz 2023-07-09T22:02:57.336 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54554.log: gzip 88.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.54554.log.gz --verbose 2023-07-09T22:02:57.336 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.48561.log 2023-07-09T22:02:57.337 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56613.log 2023-07-09T22:02:57.338 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2023-07-09T22:02:57.339 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51815.log 2023-07-09T22:02:57.340 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56613.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48561.log.gz 2023-07-09T22:02:57.341 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61041.log 2023-07-09T22:02:57.341 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56613.log.gz 2023-07-09T22:02:57.342 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.51815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54371.log 2023-07-09T22:02:57.343 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2023-07-09T22:02:57.344 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61041.log.gz 2023-07-09T22:02:57.345 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54371.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54371.log.gz 2023-07-09T22:02:57.346 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49853.log 2023-07-09T22:02:57.347 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43931.log 2023-07-09T22:02:57.348 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2023-07-09T22:02:57.349 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49853.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.49853.log.gz 2023-07-09T22:02:57.350 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53904.log 2023-07-09T22:02:57.351 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2023-07-09T22:02:57.352 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43931.log.gz 2023-07-09T22:02:57.353 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.53904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2023-07-09T22:02:57.355 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48085.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53904.log.gz 2023-07-09T22:02:57.355 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2023-07-09T22:02:57.357 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47981.log 2023-07-09T22:02:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50281.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2023-07-09T22:02:57.358 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54840.log 2023-07-09T22:02:57.360 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48393.log 2023-07-09T22:02:57.360 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47981.log.gz 2023-07-09T22:02:57.362 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54840.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60122.log 2023-07-09T22:02:57.362 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54840.log.gz 2023-07-09T22:02:57.363 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48393.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48393.log.gz 2023-07-09T22:02:57.365 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43735.log 2023-07-09T22:02:57.366 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60122.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59138.log 2023-07-09T22:02:57.366 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60122.log.gz 2023-07-09T22:02:57.368 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52055.log 2023-07-09T22:02:57.369 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59138.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43735.log.gz 2023-07-09T22:02:57.369 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59138.log.gz 2023-07-09T22:02:57.370 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66350.log 2023-07-09T22:02:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50992.log 2023-07-09T22:02:57.372 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66350.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52055.log.gz 2023-07-09T22:02:57.373 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66350.log.gz 2023-07-09T22:02:57.374 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51175.log 2023-07-09T22:02:57.375 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49961.log 2023-07-09T22:02:57.376 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51175.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50992.log.gz 2023-07-09T22:02:57.377 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51175.log.gz 2023-07-09T22:02:57.378 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2023-07-09T22:02:57.379 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47009.log 2023-07-09T22:02:57.380 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49145.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49961.log.gz 2023-07-09T22:02:57.381 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2023-07-09T22:02:57.381 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63156.log 2023-07-09T22:02:57.383 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47087.log 2023-07-09T22:02:57.384 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63156.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47009.log.gz 2023-07-09T22:02:57.385 INFO:teuthology.orchestra.run.smithi037.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63156.log.gz 2023-07-09T22:02:57.385 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68824.log 2023-07-09T22:02:57.387 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51025.log 2023-07-09T22:02:57.388 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68824.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47087.log.gz 2023-07-09T22:02:57.388 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68824.log.gz 2023-07-09T22:02:57.389 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55727.log 2023-07-09T22:02:57.391 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50862.log 2023-07-09T22:02:57.392 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55727.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51025.log.gz 2023-07-09T22:02:57.393 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55727.log.gz 2023-07-09T22:02:57.393 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-07-09T22:02:57.396 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49605.log 2023-07-09T22:02:57.397 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50862.log.gz 2023-07-09T22:02:57.397 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53012.log 2023-07-09T22:02:57.399 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49605.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49605.log.gz 2023-07-09T22:02:57.400 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-07-09T22:02:57.402 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53012.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53012.log.gz 2023-07-09T22:02:57.403 INFO:teuthology.orchestra.run.smithi037.stderr: 90.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-07-09T22:02:57.403 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63921.log 2023-07-09T22:02:57.405 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58472.log 2023-07-09T22:02:57.407 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.63921.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63921.log.gz 2023-07-09T22:02:57.408 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52811.log 2023-07-09T22:02:57.410 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58472.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58472.log.gz 2023-07-09T22:02:57.411 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56142.log 2023-07-09T22:02:57.413 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52811.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52811.log.gz 2023-07-09T22:02:57.414 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2023-07-09T22:02:57.416 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56142.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56142.log.gz 2023-07-09T22:02:57.417 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64357.log 2023-07-09T22:02:57.419 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43603.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2023-07-09T22:02:57.421 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57226.log 2023-07-09T22:02:57.423 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64357.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64357.log.gz 2023-07-09T22:02:57.424 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66097.log 2023-07-09T22:02:57.425 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57226.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57226.log.gz 2023-07-09T22:02:57.427 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51057.log 2023-07-09T22:02:57.428 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66097.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66097.log.gz 2023-07-09T22:02:57.430 INFO:teuthology.orchestra.run.smithi037.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.0.51815.log.gz 2023-07-09T22:02:57.430 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45557.log 2023-07-09T22:02:57.432 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54004.log 2023-07-09T22:02:57.432 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51057.log.gz 2023-07-09T22:02:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45557.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60859.log 2023-07-09T22:02:57.434 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45557.log.gz 2023-07-09T22:02:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54004.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-07-09T22:02:57.436 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54004.log.gz 2023-07-09T22:02:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60859.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2023-07-09T22:02:57.437 INFO:teuthology.orchestra.run.smithi037.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60859.log.gz 2023-07-09T22:02:57.438 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53380.log 2023-07-09T22:02:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47373.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2023-07-09T22:02:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64568.log 2023-07-09T22:02:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53380.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53380.log.gz 2023-07-09T22:02:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62874.log 2023-07-09T22:02:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64568.log.gz 2023-07-09T22:02:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43720.log 2023-07-09T22:02:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62874.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.62874.log.gz 2023-07-09T22:02:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54997.log 2023-07-09T22:02:57.453 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43720.log.gz 2023-07-09T22:02:57.454 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54762.log 2023-07-09T22:02:57.455 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54997.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54997.log.gz 2023-07-09T22:02:57.457 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45401.log 2023-07-09T22:02:57.459 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54762.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54762.log.gz 2023-07-09T22:02:57.461 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.32550.log 2023-07-09T22:02:57.462 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45401.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45401.log.gz 2023-07-09T22:02:57.464 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53123.log 2023-07-09T22:02:57.465 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.32550.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.32550.log.gz 2023-07-09T22:02:57.467 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43941.log 2023-07-09T22:02:57.468 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53123.log.gz 2023-07-09T22:02:57.470 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67438.log 2023-07-09T22:02:57.472 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43941.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43941.log.gz 2023-07-09T22:02:57.473 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56639.log 2023-07-09T22:02:57.475 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67438.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.67438.log.gz 2023-07-09T22:02:57.477 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48891.log 2023-07-09T22:02:57.479 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56639.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56639.log.gz 2023-07-09T22:02:57.481 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65384.log 2023-07-09T22:02:57.482 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48891.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48891.log.gz 2023-07-09T22:02:57.484 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48525.log 2023-07-09T22:02:57.485 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65384.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.65384.log.gz 2023-07-09T22:02:57.487 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50173.log 2023-07-09T22:02:57.489 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48525.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48525.log.gz 2023-07-09T22:02:57.491 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2023-07-09T22:02:57.492 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50173.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50173.log.gz 2023-07-09T22:02:57.494 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46800.log 2023-07-09T22:02:57.495 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47139.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2023-07-09T22:02:57.497 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45635.log 2023-07-09T22:02:57.498 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46800.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46800.log.gz 2023-07-09T22:02:57.500 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55575.log 2023-07-09T22:02:57.502 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45635.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45635.log.gz 2023-07-09T22:02:57.504 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60200.log 2023-07-09T22:02:57.506 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55575.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.55575.log.gz 2023-07-09T22:02:57.508 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58420.log 2023-07-09T22:02:57.509 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60200.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60200.log.gz 2023-07-09T22:02:57.511 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69058.log 2023-07-09T22:02:57.512 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58420.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58420.log.gz 2023-07-09T22:02:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55889.log 2023-07-09T22:02:57.516 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69058.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69058.log.gz 2023-07-09T22:02:57.517 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63613.log 2023-07-09T22:02:57.519 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55889.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55889.log.gz 2023-07-09T22:02:57.521 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53352.log 2023-07-09T22:02:57.522 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63613.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63613.log.gz 2023-07-09T22:02:57.523 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-07-09T22:02:57.524 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54580.log 2023-07-09T22:02:57.525 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53352.log.gz 2023-07-09T22:02:57.527 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46613.log 2023-07-09T22:02:57.529 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54580.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54580.log.gz 2023-07-09T22:02:57.530 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64790.log 2023-07-09T22:02:57.532 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46613.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46613.log.gz 2023-07-09T22:02:57.533 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50225.log 2023-07-09T22:02:57.535 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64790.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64790.log.gz 2023-07-09T22:02:57.537 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2023-07-09T22:02:57.539 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50225.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50225.log.gz 2023-07-09T22:02:57.541 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64620.log 2023-07-09T22:02:57.542 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46957.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2023-07-09T22:02:57.544 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59561.log 2023-07-09T22:02:57.545 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64620.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.64620.log.gz 2023-07-09T22:02:57.547 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45191.log 2023-07-09T22:02:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59561.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.59561.log.gz 2023-07-09T22:02:57.550 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43923.log 2023-07-09T22:02:57.552 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45191.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45191.log.gz 2023-07-09T22:02:57.553 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61300.log 2023-07-09T22:02:57.555 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43923.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43923.log.gz 2023-07-09T22:02:57.557 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55471.log 2023-07-09T22:02:57.559 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61300.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61300.log.gz 2023-07-09T22:02:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54931.log 2023-07-09T22:02:57.562 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55471.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55471.log.gz 2023-07-09T22:02:57.563 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60963.log 2023-07-09T22:02:57.565 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54931.log.gz 2023-07-09T22:02:57.567 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68232.log 2023-07-09T22:02:57.568 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60963.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60963.log.gz 2023-07-09T22:02:57.570 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57917.log 2023-07-09T22:02:57.571 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68232.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.68232.log.gz 2023-07-09T22:02:57.573 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47243.log 2023-07-09T22:02:57.575 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57917.log.gz 2023-07-09T22:02:57.576 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57984.log 2023-07-09T22:02:57.578 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47243.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47243.log.gz 2023-07-09T22:02:57.580 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63108.log 2023-07-09T22:02:57.581 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57984.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57984.log.gz 2023-07-09T22:02:57.583 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47269.log 2023-07-09T22:02:57.599 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.63108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2023-07-09T22:02:57.600 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2023-07-09T22:02:57.610 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-07-09T22:02:57.614 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53748.log 2023-07-09T22:02:57.615 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47191.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2023-07-09T22:02:57.625 INFO:teuthology.orchestra.run.smithi037.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.0.63108.log.gz 2023-07-09T22:02:57.627 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55829.log 2023-07-09T22:02:57.628 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53748.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53748.log.gz 2023-07-09T22:02:57.630 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65050.log 2023-07-09T22:02:57.631 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55829.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55829.log.gz 2023-07-09T22:02:57.633 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68591.log 2023-07-09T22:02:57.634 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65050.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.65050.log.gz 2023-07-09T22:02:57.635 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48647.log 2023-07-09T22:02:57.637 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68591.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.68591.log.gz 2023-07-09T22:02:57.639 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48943.log 2023-07-09T22:02:57.640 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48647.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48647.log.gz 2023-07-09T22:02:57.641 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2023-07-09T22:02:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48943.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48943.log.gz 2023-07-09T22:02:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69006.log 2023-07-09T22:02:57.645 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43933.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2023-07-09T22:02:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68537.log 2023-07-09T22:02:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69006.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.69006.log.gz 2023-07-09T22:02:57.650 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44721.log 2023-07-09T22:02:57.651 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68537.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68537.log.gz 2023-07-09T22:02:57.653 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54174.log 2023-07-09T22:02:57.654 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44721.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44721.log.gz 2023-07-09T22:02:57.656 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63696.log 2023-07-09T22:02:57.657 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54174.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54174.log.gz 2023-07-09T22:02:57.659 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64542.log 2023-07-09T22:02:57.660 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63696.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63696.log.gz 2023-07-09T22:02:57.661 INFO:teuthology.orchestra.run.smithi119.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-07-09T22:02:57.662 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52785.log 2023-07-09T22:02:57.663 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64542.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64542.log.gz 2023-07-09T22:02:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52908.log 2023-07-09T22:02:57.665 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52785.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52785.log.gz 2023-07-09T22:02:57.667 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59397.log 2023-07-09T22:02:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52908.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52908.log.gz 2023-07-09T22:02:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50739.log 2023-07-09T22:02:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59397.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59397.log.gz 2023-07-09T22:02:57.673 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43928.log 2023-07-09T22:02:57.674 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50739.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50739.log.gz 2023-07-09T22:02:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59846.log 2023-07-09T22:02:57.677 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43928.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43928.log.gz 2023-07-09T22:02:57.679 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45583.log 2023-07-09T22:02:57.680 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59846.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.59846.log.gz 2023-07-09T22:02:57.682 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44148.log 2023-07-09T22:02:57.683 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45583.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45583.log.gz 2023-07-09T22:02:57.685 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2023-07-09T22:02:57.686 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44148.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44148.log.gz 2023-07-09T22:02:57.688 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47165.log 2023-07-09T22:02:57.690 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59716.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2023-07-09T22:02:57.691 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64702.log 2023-07-09T22:02:57.692 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47165.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47165.log.gz 2023-07-09T22:02:57.694 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54200.log 2023-07-09T22:02:57.695 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64702.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.64702.log.gz 2023-07-09T22:02:57.697 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54866.log 2023-07-09T22:02:57.698 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54200.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2023-07-09T22:02:57.700 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52288.log 2023-07-09T22:02:57.701 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54866.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54866.log.gz 2023-07-09T22:02:57.703 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50333.log 2023-07-09T22:02:57.704 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52288.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52288.log.gz 2023-07-09T22:02:57.706 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56247.log 2023-07-09T22:02:57.707 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50333.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50333.log.gz 2023-07-09T22:02:57.709 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56299.log 2023-07-09T22:02:57.710 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56247.log.gz 2023-07-09T22:02:57.712 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60245.log 2023-07-09T22:02:57.713 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56299.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56299.log.gz 2023-07-09T22:02:57.715 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46298.log 2023-07-09T22:02:57.716 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60245.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.60245.log.gz 2023-07-09T22:02:57.718 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64514.log 2023-07-09T22:02:57.719 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46298.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46298.log.gz 2023-07-09T22:02:57.721 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60610.log 2023-07-09T22:02:57.722 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64514.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64514.log.gz 2023-07-09T22:02:57.724 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56023.log 2023-07-09T22:02:57.725 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60610.log.gz 2023-07-09T22:02:57.727 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56377.log 2023-07-09T22:02:57.728 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56023.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56023.log.gz 2023-07-09T22:02:57.730 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56848.log 2023-07-09T22:02:57.731 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56377.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56377.log.gz 2023-07-09T22:02:57.733 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44950.log 2023-07-09T22:02:57.734 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56848.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56848.log.gz 2023-07-09T22:02:57.735 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57672.log 2023-07-09T22:02:57.738 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.44950.log: 90.8% -- replaced with /var/log/ceph/ceph-client.0.44950.log.gz 2023-07-09T22:02:57.740 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51253.log 2023-07-09T22:02:57.741 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57672.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57672.log.gz 2023-07-09T22:02:57.743 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2023-07-09T22:02:57.744 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51253.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51253.log.gz 2023-07-09T22:02:57.746 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64155.log 2023-07-09T22:02:57.747 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51123.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2023-07-09T22:02:57.749 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57943.log 2023-07-09T22:02:57.750 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64155.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64155.log.gz 2023-07-09T22:02:57.752 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64227.log 2023-07-09T22:02:57.753 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57943.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57943.log.gz 2023-07-09T22:02:57.755 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66467.log 2023-07-09T22:02:57.756 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64227.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64227.log.gz 2023-07-09T22:02:57.758 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56455.log 2023-07-09T22:02:57.759 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66467.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.66467.log.gz 2023-07-09T22:02:57.761 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44999.log 2023-07-09T22:02:57.762 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56455.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56455.log.gz 2023-07-09T22:02:57.763 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53642.log 2023-07-09T22:02:57.764 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44999.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44999.log.gz 2023-07-09T22:02:57.766 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44147.log 2023-07-09T22:02:57.767 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53642.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53642.log.gz 2023-07-09T22:02:57.770 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37522.log 2023-07-09T22:02:57.771 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44147.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44147.log.gz 2023-07-09T22:02:57.772 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56796.log 2023-07-09T22:02:57.774 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.37522.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37522.log.gz 2023-07-09T22:02:57.775 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56900.log 2023-07-09T22:02:57.777 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56796.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56796.log.gz 2023-07-09T22:02:57.778 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60745.log 2023-07-09T22:02:57.780 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56900.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56900.log.gz 2023-07-09T22:02:57.781 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2023-07-09T22:02:57.782 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60745.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60745.log.gz 2023-07-09T22:02:57.784 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46587.log 2023-07-09T22:02:57.785 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44591.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2023-07-09T22:02:57.787 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44565.log 2023-07-09T22:02:57.788 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46587.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46587.log.gz 2023-07-09T22:02:57.790 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67604.log 2023-07-09T22:02:57.792 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44565.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44565.log.gz 2023-07-09T22:02:57.793 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66019.log 2023-07-09T22:02:57.794 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67604.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67604.log.gz 2023-07-09T22:02:57.796 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-07-09T22:02:57.797 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66019.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.66019.log.gz 2023-07-09T22:02:57.799 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46931.log 2023-07-09T22:02:57.800 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-07-09T22:02:57.802 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2023-07-09T22:02:57.803 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46931.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46931.log.gz 2023-07-09T22:02:57.805 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53800.log 2023-07-09T22:02:57.806 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45772.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2023-07-09T22:02:57.808 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46376.log 2023-07-09T22:02:57.809 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53800.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53800.log.gz 2023-07-09T22:02:57.812 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48617.log 2023-07-09T22:02:57.813 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46376.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46376.log.gz 2023-07-09T22:02:57.814 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66964.log 2023-07-09T22:02:57.815 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48617.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48617.log.gz 2023-07-09T22:02:57.817 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52379.log 2023-07-09T22:02:57.818 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66964.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.66964.log.gz 2023-07-09T22:02:57.820 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61252.log 2023-07-09T22:02:57.821 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52379.log: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-07-09T22:02:57.822 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52379.log.gz 2023-07-09T22:02:57.823 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66324.log 2023-07-09T22:02:57.824 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.61252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66938.log 2023-07-09T22:02:57.826 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66324.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66324.log.gz 91.4% -- replaced with /var/log/ceph/ceph-client.0.61252.log.gz 2023-07-09T22:02:57.827 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:57.827 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2023-07-09T22:02:57.830 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65600.log 2023-07-09T22:02:57.830 INFO:teuthology.orchestra.run.smithi037.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66938.log.gz 2023-07-09T22:02:57.832 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62822.log 2023-07-09T22:02:57.832 INFO:teuthology.orchestra.run.smithi037.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2023-07-09T22:02:57.832 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65600.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.65600.log.gz 2023-07-09T22:02:57.833 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56535.log 2023-07-09T22:02:57.835 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65941.log 2023-07-09T22:02:57.835 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62822.log.gz 2023-07-09T22:02:57.836 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56535.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56535.log.gz 2023-07-09T22:02:57.836 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50765.log 2023-07-09T22:02:57.837 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66435.log 2023-07-09T22:02:57.837 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.65941.log.gz 2023-07-09T22:02:57.838 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50765.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50765.log.gz 2023-07-09T22:02:57.840 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64025.log 2023-07-09T22:02:57.841 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52457.log 2023-07-09T22:02:57.842 INFO:teuthology.orchestra.run.smithi037.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.66435.log.gz 2023-07-09T22:02:57.843 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58814.log 2023-07-09T22:02:57.843 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64025.log.gz 2023-07-09T22:02:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52457.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52457.log.gz 2023-07-09T22:02:57.845 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58115.log 2023-07-09T22:02:57.846 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50411.log 2023-07-09T22:02:57.847 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58814.log.gz 2023-07-09T22:02:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58115.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58115.log.gz 2023-07-09T22:02:57.848 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2023-07-09T22:02:57.849 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68954.log 2023-07-09T22:02:57.850 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50411.log.gz 2023-07-09T22:02:57.851 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43525.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2023-07-09T22:02:57.852 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67170.log 2023-07-09T22:02:57.854 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46194.log 2023-07-09T22:02:57.855 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.68954.log.gz 2023-07-09T22:02:57.855 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67170.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.67170.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43655.log 2023-07-09T22:02:57.856 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:57.857 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67761.log 2023-07-09T22:02:57.857 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46194.log.gz 2023-07-09T22:02:57.858 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43655.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43655.log.gz 2023-07-09T22:02:57.860 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66123.log 2023-07-09T22:02:57.862 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45453.log 2023-07-09T22:02:57.862 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.67761.log.gz 2023-07-09T22:02:57.863 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66123.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.66123.log.gz 2023-07-09T22:02:57.864 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53155.log 2023-07-09T22:02:57.865 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51915.log 2023-07-09T22:02:57.866 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45453.log.gz 2023-07-09T22:02:57.867 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53155.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53155.log.gz 2023-07-09T22:02:57.868 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2023-07-09T22:02:57.869 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52577.log 2023-07-09T22:02:57.870 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51915.log.gz 2023-07-09T22:02:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47577.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2023-07-09T22:02:57.871 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45089.log 2023-07-09T22:02:57.873 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48291.log 2023-07-09T22:02:57.873 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52577.log.gz 2023-07-09T22:02:57.875 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.2.45089.log: 91.1% -- replaced with /var/log/ceph/ceph-client.2.45089.log.gz 2023-07-09T22:02:57.877 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62547.log 2023-07-09T22:02:57.879 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59742.log 2023-07-09T22:02:57.879 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48291.log.gz 2023-07-09T22:02:57.880 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62547.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62547.log.gz 2023-07-09T22:02:57.881 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68492.log 2023-07-09T22:02:57.882 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60375.log 2023-07-09T22:02:57.882 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59742.log.gz 2023-07-09T22:02:57.883 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68492.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68492.log.gz 2023-07-09T22:02:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47295.log 2023-07-09T22:02:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43577.log 2023-07-09T22:02:57.886 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60375.log.gz 2023-07-09T22:02:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51227.log 2023-07-09T22:02:57.888 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47295.log.gz 2023-07-09T22:02:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43577.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43577.log.gz 2023-07-09T22:02:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57560.log 2023-07-09T22:02:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61823.log 2023-07-09T22:02:57.891 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51227.log.gz 2023-07-09T22:02:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57560.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57560.log.gz 2023-07-09T22:02:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67120.log 2023-07-09T22:02:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61823.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.61823.log.gz 2023-07-09T22:02:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65152.log 2023-07-09T22:02:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43681.log 2023-07-09T22:02:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65152.log: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.67120.log.gz 2023-07-09T22:02:57.899 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.65152.log.gz 2023-07-09T22:02:57.900 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50810.log 2023-07-09T22:02:57.901 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43447.log 2023-07-09T22:02:57.902 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43681.log.gz 2023-07-09T22:02:57.903 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45713.log 2023-07-09T22:02:57.904 INFO:teuthology.orchestra.run.smithi037.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50810.log.gz 2023-07-09T22:02:57.905 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43447.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43447.log.gz 2023-07-09T22:02:57.906 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58842.log 2023-07-09T22:02:57.907 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62926.log 2023-07-09T22:02:57.908 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58842.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45713.log.gz 2023-07-09T22:02:57.909 INFO:teuthology.orchestra.run.smithi037.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58842.log.gz 2023-07-09T22:02:57.909 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2023-07-09T22:02:57.911 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65993.log 2023-07-09T22:02:57.912 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52629.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62926.log.gz 2023-07-09T22:02:57.913 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2023-07-09T22:02:57.913 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53850.log 2023-07-09T22:02:57.915 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61744.log 2023-07-09T22:02:57.916 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53850.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.65993.log.gz 2023-07-09T22:02:57.916 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53850.log.gz 2023-07-09T22:02:57.917 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61875.log 2023-07-09T22:02:57.919 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46561.log 2023-07-09T22:02:57.920 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61875.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61744.log.gz 2023-07-09T22:02:57.920 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61875.log.gz 2023-07-09T22:02:57.921 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52322.log 2023-07-09T22:02:57.923 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48787.log 2023-07-09T22:02:57.923 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46561.log.gz 2023-07-09T22:02:57.926 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47655.log 2023-07-09T22:02:57.926 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48787.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52322.log.gz 2023-07-09T22:02:57.926 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48787.log.gz 2023-07-09T22:02:57.927 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62493.log 2023-07-09T22:02:57.929 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52603.log 2023-07-09T22:02:57.930 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47655.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47655.log.gz 2023-07-09T22:02:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.62493.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62493.log.gz 2023-07-09T22:02:57.931 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64201.log 2023-07-09T22:02:57.932 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.52603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2023-07-09T22:02:57.933 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52603.log.gz 2023-07-09T22:02:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64201.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64201.log.gz 2023-07-09T22:02:57.935 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46350.log 2023-07-09T22:02:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44435.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2023-07-09T22:02:57.937 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45929.log 2023-07-09T22:02:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67709.log 2023-07-09T22:02:57.939 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45929.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46350.log.gz 2023-07-09T22:02:57.940 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45929.log.gz 2023-07-09T22:02:57.941 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67735.log 2023-07-09T22:02:57.942 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58982.log 2023-07-09T22:02:57.943 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67735.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.67709.log.gz 2023-07-09T22:02:57.944 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67735.log.gz 2023-07-09T22:02:57.944 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46404.log 2023-07-09T22:02:57.946 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43180.log 2023-07-09T22:02:57.947 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46404.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58982.log.gz 2023-07-09T22:02:57.948 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46404.log.gz 2023-07-09T22:02:57.948 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63801.log 2023-07-09T22:02:57.950 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57042.log 2023-07-09T22:02:57.951 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.63801.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43180.log.gz 2023-07-09T22:02:57.951 INFO:teuthology.orchestra.run.smithi037.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63801.log.gz 2023-07-09T22:02:57.952 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56325.log 2023-07-09T22:02:57.954 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.57042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60885.log 2023-07-09T22:02:57.955 INFO:teuthology.orchestra.run.smithi037.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57042.log.gz 2023-07-09T22:02:57.955 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56325.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56325.log.gz 2023-07-09T22:02:57.956 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47525.log 2023-07-09T22:02:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67474.log 2023-07-09T22:02:57.958 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47525.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60885.log.gz 2023-07-09T22:02:57.959 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47525.log.gz 2023-07-09T22:02:57.960 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67847.log 2023-07-09T22:02:57.962 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53512.log 2023-07-09T22:02:57.963 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.67847.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67474.log.gz 2023-07-09T22:02:57.964 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58219.log 2023-07-09T22:02:57.966 INFO:teuthology.orchestra.run.smithi037.stderr: 92.3%/var/log/ceph/ceph-client.admin.53512.log: -- replaced with /var/log/ceph/ceph-client.0.67847.log.gz 2023-07-09T22:02:57.967 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53512.log.gz 2023-07-09T22:02:57.967 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45687.log 2023-07-09T22:02:57.969 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46826.log 2023-07-09T22:02:57.969 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58219.log.gz 2023-07-09T22:02:57.971 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46852.log 2023-07-09T22:02:57.972 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45687.log: /var/log/ceph/ceph-client.admin.46826.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45687.log.gz 2023-07-09T22:02:57.973 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46826.log.gz 2023-07-09T22:02:57.974 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54252.log 2023-07-09T22:02:57.976 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.46852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64816.log 2023-07-09T22:02:57.976 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46852.log.gz 2023-07-09T22:02:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54736.log 2023-07-09T22:02:57.977 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64816.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54252.log.gz 2023-07-09T22:02:57.978 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64816.log.gz 2023-07-09T22:02:57.980 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50452.log 2023-07-09T22:02:57.981 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.54736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2023-07-09T22:02:57.982 INFO:teuthology.orchestra.run.smithi037.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54736.log.gz 2023-07-09T22:02:57.983 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67042.log 2023-07-09T22:02:57.983 INFO:teuthology.orchestra.run.smithi037.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50452.log.gz 2023-07-09T22:02:57.984 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44123.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2023-07-09T22:02:57.985 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56351.log 2023-07-09T22:02:57.986 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67016.log 2023-07-09T22:02:57.987 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56351.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.67042.log.gz 2023-07-09T22:02:57.988 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56351.log.gz 2023-07-09T22:02:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2023-07-09T22:02:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55971.log 2023-07-09T22:02:57.991 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44357.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.67016.log.gz 2023-07-09T22:02:57.992 INFO:teuthology.orchestra.run.smithi037.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2023-07-09T22:02:57.993 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55211.log 2023-07-09T22:02:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56587.log 2023-07-09T22:02:57.995 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55211.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.55971.log.gz 2023-07-09T22:02:57.996 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55211.log.gz 2023-07-09T22:02:57.997 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2023-07-09T22:02:57.998 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45902.log 2023-07-09T22:02:57.999 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.47603.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56587.log.gz 2023-07-09T22:02:58.000 INFO:teuthology.orchestra.run.smithi037.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2023-07-09T22:02:58.001 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48137.log 2023-07-09T22:02:58.002 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50015.log 2023-07-09T22:02:58.003 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.48137.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45902.log.gz 2023-07-09T22:02:58.004 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48137.log.gz 2023-07-09T22:02:58.005 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56561.log 2023-07-09T22:02:58.006 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67274.log 2023-07-09T22:02:58.007 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56561.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50015.log.gz 2023-07-09T22:02:58.008 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56561.log.gz 2023-07-09T22:02:58.009 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56990.log 2023-07-09T22:02:58.010 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43734.log 2023-07-09T22:02:58.011 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56990.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.67274.log.gz 2023-07-09T22:02:58.012 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56990.log.gz 2023-07-09T22:02:58.012 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55625.log 2023-07-09T22:02:58.014 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66298.log 2023-07-09T22:02:58.015 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55625.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43734.log.gz 2023-07-09T22:02:58.016 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55625.log.gz 2023-07-09T22:02:58.017 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64594.log 2023-07-09T22:02:58.018 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2023-07-09T22:02:58.019 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.64594.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.66298.log.gz 2023-07-09T22:02:58.020 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64594.log.gz 2023-07-09T22:02:58.020 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68643.log 2023-07-09T22:02:58.022 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68284.log 2023-07-09T22:02:58.023 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2023-07-09T22:02:58.024 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68643.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.68643.log.gz 2023-07-09T22:02:58.024 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53247.log 2023-07-09T22:02:58.026 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56075.log 2023-07-09T22:02:58.027 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.53247.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68284.log.gz 2023-07-09T22:02:58.027 INFO:teuthology.orchestra.run.smithi037.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53247.log.gz 2023-07-09T22:02:58.028 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60558.log 2023-07-09T22:02:58.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44539.log 2023-07-09T22:02:58.030 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60558.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56075.log.gz 2023-07-09T22:02:58.031 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60558.log.gz 2023-07-09T22:02:58.032 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54278.log 2023-07-09T22:02:58.033 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60937.log 2023-07-09T22:02:58.035 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44539.log: /var/log/ceph/ceph-client.admin.54278.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44539.log.gz 2023-07-09T22:02:58.035 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54278.log.gz 2023-07-09T22:02:58.036 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59913.log 2023-07-09T22:02:58.038 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.60937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43731.log 2023-07-09T22:02:58.038 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60937.log.gz 2023-07-09T22:02:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.59913.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59913.log.gz 2023-07-09T22:02:58.040 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67895.log 2023-07-09T22:02:58.042 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.43731.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43731.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69214.log 2023-07-09T22:02:58.042 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58524.log 2023-07-09T22:02:58.044 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.69214.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.67895.log.gz 2023-07-09T22:02:58.045 INFO:teuthology.orchestra.run.smithi037.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69214.log.gz 2023-07-09T22:02:58.046 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68563.log 2023-07-09T22:02:58.047 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49493.log 2023-07-09T22:02:58.049 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68563.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58524.log.gz 2023-07-09T22:02:58.049 INFO:teuthology.orchestra.run.smithi037.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.68563.log.gz 2023-07-09T22:02:58.050 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66220.log 2023-07-09T22:02:58.051 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.49493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55549.log 2023-07-09T22:02:58.052 INFO:teuthology.orchestra.run.smithi037.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49493.log.gz 2023-07-09T22:02:58.054 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.66220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58446.log 2023-07-09T22:02:58.055 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66220.log.gz 2023-07-09T22:02:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55549.log.gz 2023-07-09T22:02:58.056 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45217.log 2023-07-09T22:02:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58655.log 2023-07-09T22:02:58.058 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.45217.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58446.log.gz 2023-07-09T22:02:58.059 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45217.log.gz 2023-07-09T22:02:58.060 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67921.log 2023-07-09T22:02:58.062 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55237.log 2023-07-09T22:02:58.063 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.67921.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58655.log.gz 2023-07-09T22:02:58.064 INFO:teuthology.orchestra.run.smithi037.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.67921.log.gz 2023-07-09T22:02:58.065 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56169.log 2023-07-09T22:02:58.066 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.55237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61703.log 2023-07-09T22:02:58.066 INFO:teuthology.orchestra.run.smithi037.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55237.log.gz 2023-07-09T22:02:58.067 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.56169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61326.log 2023-07-09T22:02:58.068 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61703.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56169.log.gz 2023-07-09T22:02:58.069 INFO:teuthology.orchestra.run.smithi037.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61703.log.gz 2023-07-09T22:02:58.070 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58089.log 2023-07-09T22:02:58.072 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.61326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44150.log 2023-07-09T22:02:58.072 INFO:teuthology.orchestra.run.smithi037.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61326.log.gz 2023-07-09T22:02:58.074 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.58089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68617.log 2023-07-09T22:02:58.075 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.58089.log.gz 2023-07-09T22:02:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.44150.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44150.log.gz 2023-07-09T22:02:58.076 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65254.log 2023-07-09T22:02:58.077 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.68617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51149.log 2023-07-09T22:02:58.079 INFO:teuthology.orchestra.run.smithi037.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.68617.log.gz 2023-07-09T22:02:58.079 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.65254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.65254.log.gz 2023-07-09T22:02:58.081 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.51149.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51149.log.gz 2023-07-09T22:02:58.124 INFO:teuthology.orchestra.run.smithi119.stderr: 94.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-07-09T22:02:58.225 INFO:teuthology.orchestra.run.smithi119.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-07-09T22:02:58.319 INFO:teuthology.orchestra.run.smithi119.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-07-09T22:02:58.497 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-07-09T22:02:58.669 INFO:teuthology.orchestra.run.smithi119.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-07-09T22:02:58.671 INFO:teuthology.orchestra.run.smithi119.stderr: 2023-07-09T22:02:58.671 INFO:teuthology.orchestra.run.smithi119.stderr:real 0m2.172s 2023-07-09T22:02:58.671 INFO:teuthology.orchestra.run.smithi119.stderr:user 0m9.715s 2023-07-09T22:02:58.671 INFO:teuthology.orchestra.run.smithi119.stderr:sys 0m0.828s 2023-07-09T22:02:58.687 INFO:teuthology.orchestra.run.smithi037.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-07-09T22:02:58.712 INFO:teuthology.orchestra.run.smithi037.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-07-09T22:02:58.993 INFO:teuthology.orchestra.run.smithi037.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-07-09T22:02:59.017 INFO:teuthology.orchestra.run.smithi037.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-07-09T22:02:59.704 INFO:teuthology.orchestra.run.smithi037.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-07-09T22:02:59.706 INFO:teuthology.orchestra.run.smithi037.stderr: 2023-07-09T22:02:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m3.247s 2023-07-09T22:02:59.706 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m13.080s 2023-07-09T22:02:59.707 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m2.721s 2023-07-09T22:02:59.708 INFO:tasks.ceph:Archiving logs... 2023-07-09T22:02:59.708 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi037/log 2023-07-09T22:02:59.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T22:03:01.457 DEBUG:teuthology.misc:Transferring archived files from smithi119:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi119/log 2023-07-09T22:03:01.458 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-09T22:03:02.321 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-09T22:03:02.331 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-09T22:03:02.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T22:03:02.336 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-09T22:03:02.436 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-09T22:03:02.453 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-09T22:03:02.453 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T22:03:02.458 DEBUG:teuthology.orchestra.run.smithi119:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-09T22:03:02.471 INFO:teuthology.orchestra.run.smithi037.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T22:03:02.471 INFO:teuthology.orchestra.run.smithi037.stdout:============================================================================== 2023-07-09T22:03:02.471 INFO:teuthology.orchestra.run.smithi037.stdout:*hv01.front.sepi 44.4.53.2 2 u 28 64 377 0.094 -1.657 0.635 2023-07-09T22:03:02.472 INFO:teuthology.orchestra.run.smithi037.stdout:+hv02.front.sepi 63.231.80.2 3 u 25 64 377 0.082 +0.079 0.790 2023-07-09T22:03:02.472 INFO:teuthology.orchestra.run.smithi037.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.103 -0.658 0.555 2023-07-09T22:03:02.472 INFO:teuthology.orchestra.run.smithi037.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-09T22:03:02.474 INFO:teuthology.orchestra.run.smithi119.stdout: remote refid st t when poll reach delay offset jitter 2023-07-09T22:03:02.474 INFO:teuthology.orchestra.run.smithi119.stdout:============================================================================== 2023-07-09T22:03:02.474 INFO:teuthology.orchestra.run.smithi119.stdout:*hv01.front.sepi 44.4.53.2 2 u 19 64 377 0.100 -3.575 0.309 2023-07-09T22:03:02.475 INFO:teuthology.orchestra.run.smithi119.stdout:+hv02.front.sepi 63.231.80.2 3 u 39 64 377 0.104 -2.624 0.326 2023-07-09T22:03:02.475 INFO:teuthology.orchestra.run.smithi119.stdout:+hv03.front.sepi 74.6.168.72 3 u 25 64 377 0.086 -3.638 0.656 2023-07-09T22:03:02.475 INFO:teuthology.orchestra.run.smithi119.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-07-09T22:03:02.476 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-09T22:03:02.504 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-09T22:03:02.505 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-09T22:03:02.527 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-09T22:03:02.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-09T22:03:02.609 INFO:teuthology.task.internal:Duration was 3168.820230 seconds 2023-07-09T22:03:02.610 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-09T22:03:02.652 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-09T22:03:02.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T22:03:02.658 DEBUG:teuthology.orchestra.run.smithi119:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-09T22:03:02.792 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-09T22:03:02.792 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2023-07-09T22:03:02.793 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T22:03:02.816 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi119.front.sepia.ceph.com 2023-07-09T22:03:02.817 DEBUG:teuthology.orchestra.run.smithi119:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-09T22:03:02.840 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-09T22:03:02.843 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T22:03:02.870 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-09T22:03:02.922 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-09T22:03:02.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T22:03:02.960 DEBUG:teuthology.orchestra.run.smithi119:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-09T22:03:03.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-09T22:03:03.063 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-09T22:03:03.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T22:03:03.086 DEBUG:teuthology.orchestra.run.smithi119:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-09T22:03:03.107 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-09T22:03:03.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T22:03:03.136 DEBUG:teuthology.orchestra.run.smithi119:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-09T22:03:03.151 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2023-07-09T22:03:03.166 INFO:teuthology.orchestra.run.smithi119.stdout:kernel.core_pattern = core 2023-07-09T22:03:03.184 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T22:03:03.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:03:03.220 DEBUG:teuthology.orchestra.run.smithi119:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-09T22:03:03.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-09T22:03:03.235 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-09T22:03:03.252 INFO:teuthology.task.internal:Transferring archived files... 2023-07-09T22:03:03.253 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi037 2023-07-09T22:03:03.253 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T22:03:03.289 DEBUG:teuthology.misc:Transferring archived files from smithi119:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677/remote/smithi119 2023-07-09T22:03:03.290 DEBUG:teuthology.orchestra.run.smithi119:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-09T22:03:03.313 INFO:teuthology.task.internal:Removing archive directory... 2023-07-09T22:03:03.313 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T22:03:03.339 DEBUG:teuthology.orchestra.run.smithi119:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-09T22:03:03.364 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-09T22:03:03.374 INFO:teuthology.task.internal:Not uploading archives. 2023-07-09T22:03:03.375 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-09T22:03:03.393 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-09T22:03:03.394 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T22:03:03.397 DEBUG:teuthology.orchestra.run.smithi119:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-09T22:03:03.402 INFO:teuthology.orchestra.run.smithi037.stdout: 657845 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 22:03 /home/ubuntu/cephtest 2023-07-09T22:03:03.412 INFO:teuthology.orchestra.run.smithi119.stdout: 657840 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 9 22:03 /home/ubuntu/cephtest 2023-07-09T22:03:03.414 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-09T22:03:03.427 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-09T22:03:03.496 INFO:teuthology.nuke:Checking targets against current locks 2023-07-09T22:03:03.525 DEBUG:teuthology.nuke:shortname: smithi037 2023-07-09T22:03:03.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T22:03:03.550 DEBUG:teuthology.nuke:shortname: smithi119 2023-07-09T22:03:03.551 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-09T22:03:03.553 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:01:02.842369', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBERKsNvOgLwrW0CMr6pA9qZNVRZX7CfRfVg1jgv2ijkdDXBkXubM9DoyudEAEhjwmuDGXfcvENuvjWzk3GW9qdE='} 2023-07-09T22:03:03.577 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi119.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-09_20:19:09-fs-wip-rishabh-2023Jul9-testing-default-smithi/7331677', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-09 21:01:02.840896', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGgJr9Qx0DxQvngxPHLC6IpyukWKPiaqtFj+GfcqpF3VcO/XtZQuHPV/aCeu+oSMECMsqRmUOWvfYs/3btQqkG8='} 2023-07-09T22:03:03.614 INFO:teuthology.orchestra.console:Power off smithi037 2023-07-09T22:03:03.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T22:03:03.638 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:03.657 INFO:teuthology.orchestra.console:Power off smithi119 2023-07-09T22:03:03.658 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-09T22:03:03.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:07.695 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:07.707 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:11.810 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:11.821 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi119.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:12.034 INFO:teuthology.orchestra.console:Power off for smithi119 completed 2023-07-09T22:03:15.922 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-09T22:03:16.132 INFO:teuthology.orchestra.console:Power off for smithi037 completed 2023-07-09T22:03:16.238 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/snap-schedule} duration: 3168.820230484009 failure_reason: '"2023-07-09T21:24:57.853825+0000 mon.a (mon.0) 373 : cluster [WRN] Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY)" in cluster log' flavor: default mon.a-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd mon.b-kernel-sha1: 84139c18d56f518615369e8310ae4ecf07a36dcd owner: scheduled_rishabh@teuthology success: false 2023-07-09T22:03:16.238 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-09T22:03:16.324 INFO:teuthology.run:FAIL